Skip to content

Capture workflow:name pipeline field in ClickHouse ci_finished_pipelines table

Description

In order to support future features, we should start capturing the workflow:name definition of a pipeline (stored in ci_pipeline_metadata.name in PG). That column was added in #372538 (closed).

Pipelines can have a configurable name via the workflow:name.

In the case of gitlab pipelines, this contains information about the type of pipeline:

image

This is useful data that could be surfaced to our CI/CD Analytics dashboard. For example, our dashboards could filter pipelines by this dimension.

Related items

Implementation plan

  1. Introduce ClickHouse migration to add name column in ci_finished_pipelines table.
  2. Add name column to subsidiary tables/MVs (ci_finished_pipelines_daily, ci_finished_pipelines_daily_mv, ci_finished_pipelines_hourly, ci_finished_pipelines_hourly_mv)
  3. Adapt Ci::ClickHouse::DataIngestion::FinishedPipelinesSyncService to capture field value.
Edited by Miguel Rincon