Incubation:APM Datadog series submit backend
The basic metrics capability in the DataDog agent stores metrics data against this API - https://docs.datadoghq.com/api/latest/metrics/#submit-metrics-v1
Investigation of the agent is here - #3 (closed)
We would need a few services and components in place to handle this:
-
Metrics gateway service (e.g. at metrics.gitlab.com) to handle the series API. -
Authentication of access tokens -
Implement /api/v1/series endpoint as covered in above docs #17 (closed)
-
-
PubSub usage to queue metrics for processing (relevant - https://gitlab.com/gitlab-org/gitlab/-/issues/338454#note_652755663) -
Storage of metrics (Clickhouse under evaluation - #4 (closed)) -
Metrics schema design #10 (closed)
-
Edited by Joe Shaw