Expand Engineering Data Coverage in ClickHouse
### Problem Statement The Development Analytics team's ability to surface engineering health signals depends directly on the breadth and quality of data available in ClickHouse. Today, several high-value data sources — factory profiling, MR review metadata, CI/CD cost telemetry, and test results from non-RSpec frameworks — have no structured representation in ClickHouse. This limits what we can observe, triage, and ultimately push into the product. As we operate as customer zero, each data gap we carry internally is a signal category we cannot validate, cannot offer to product teams, and cannot eventually ship to customers. Closing these gaps is a prerequisite for the broader vision: every team at GitLab — and eventually every team using GitLab — has real-time visibility into the full SDLC. This epic is a direct enabler for the [Development Analytics mission and vision](https://gitlab.com/gitlab-com/content-sites/handbook/-/merge_requests/20308). We are the pulse monitor for GitLab's engineering health, and that only works if we own the full SDLC signal layer. It also supports our customer-zero posture: every dataset landed here is a candidate for productization, and creates the data substrate that adjacent initiatives (Orbit integration, systematic incident root cause analysis, tier-1 DA agents) depend on. ### Participants - TBD ### Exit Criteria - Test results from Jest, Go, and Rust are ingested into ClickHouse with retry signals, and flaky detection can safely expand to cover them - Factory profiling data is in ClickHouse and a dashboard surfaces factory health by factory name, spec type, and team - MR review events (roulette pool size, approval resets, review timeline) are queryable in ClickHouse and surfaced in Grafana - CI/CD cost metrics are in ClickHouse with Grafana dashboards covering cost breakdown by project, job type, and resource category ### Topics | Item | Tracking | Status | |------|----------|--------| | Expand flaky test detection to Jest, Go, and Rust | https://gitlab.com/groups/gitlab-org/quality/analytics/-/work_items/53 | 📋 Planned | | Factory-heavy RSpec test observability, guardrails, and remediation | https://gitlab.com/groups/gitlab-org/quality/-/work_items/403 | 📋 Planned | | MR Process Visibility: reviewer roulette, approval resets, and review timeline | https://gitlab.com/groups/gitlab-org/quality/analytics/-/work_items/45 | 📋 Planned | | Track CI/CD Pipeline Costs in ClickHouse and Grafana | https://gitlab.com/groups/gitlab-org/quality/analytics/-/work_items/34 | 📋 Planned | ### Development Log <!-- STATUS NOTE START --> <!-- STATUS NOTE END -->
epic