Document and review current ClickHouse uses/capabilities and future use cases
Document and review current ClickHouse uses/capabilities and future use cases
Summary
This is an exit criteria of the WorkingGroupClickHouse.
Exit criteria DRI: @marshall007
Working Group Links
Use Cases
Stage | Source | Use Cases | Current Solution |
---|---|---|---|
devopsmonitor | gitlab-org/gitlab#384184 (comment 1200798270) | Error Tracking, Logs, Tracing, Metrics | Clickhouse |
devopsplan | gitlab-org&7964 gitlab-org&9281 (closed) gitlab-org/gitlab#384184 (comment 1203339711) | DORA4 metrics, Value Stream analytics, DevOps adoption metrics, Events (powers activity feeds and calendar) | Postgres, JSON reports generated periodically |
devopsanalytics | gitlab-org/gitlab#384184 (comment 1202030574) gitlab-org/gitlab#384184 (comment 1201695976) | User Tracking, Session Recording, A/B testing, Customer Surveys, dogfooding for ~"group::product intelligence", Service Ping, SaaS Product Intelligence events collection | Clickhouse (WIP), PostgreSQL, Redis, Snowplow |
devopsconfigure | gitlab-org&2493 | Kubernetes monitoring (logs, events, metrics), Infrastructure Inventory & Cost Optimization | |
devopsmodelops | POC | Arbitrary data ingestion and exploration (like BigQuery), Monitoring/optimization of analytic workloads | Clickhouse |
devopsverify | gitlab-org/gitlab#387672 (comment 1244770162) gitlab-org/gitlab#384184 (comment 1201234824) | CI/CD analytics, pipeline statistics, historical test data, runner logs, monitoring/optimization of runner fleet | Postgres, Redis, Object Storage |
devopscreate | Repository analytics, contribution statistics, code review analytics, monitoring of remote development environments | Postgres (?) | |
devopssecure | gitlab-org/gitlab#384184 (comment 1202024852) | Security Dashboards, Vulnerability Lists, Add historical views to existing features | Postgres |
devopsgovern | gitlab-org/gitlab#384184 (comment 1202538603) | Audit events | Postgres |
devopspackage | gitlab-org/gitlab#384184 (comment 1203143330) | Indexing package and container image metadata | Postgres |
groupdelivery | gitlab-com/gl-infra/delivery#2936 (closed) | Auto deploy events visualization | Prometheus |
grouprunner | gitlab-org/gitlab#390921 (closed) | Runner Fleet Management | None |
DE Infra/Reliability | https://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/24361 | Package download requests via packages.gitlab.com | MySQL |
- Show closed items
- View on a roadmap
- Issue/www-#33939
- Issuegitlab-org/gitlab#384184
- Show labels
- Show closed items
Activity
@marshall007 As you expressed interest in synthesizing/documenting the ClickHouse use cases in the last WG meeting, would it be ok to add you as DRI of this epic?
@nhxnguyen sure thing. Here is some analysis I had done previously: https://docs.google.com/document/d/1chCcy45ddt_2S01fkTDZrleTXPaB0f55epCdy--HbxA/edit
I will get all this into the epic description shortly.
DORA4 metrics, Value Stream analytics, DevOps adoption metrics, Events (powers activity feeds and calendar)
@marshall007, I've just modified the description because these features are now under devops::plan (groupoptimize was moved to plan recently).
@marshall007 I modified devopsanalytics use case to include use cases of ~"group::product intelligence" that relies on PostgreSQL, Redis and Snowplow right now