Skip to content

Add cronjob to sync finished pipelines to ClickHouse

Pedro Pombeiro (OOO from July 16th till Aug 7th) requested to merge pedropombeiro/470076/implement-ch-worker into master
Sequence MR
1 Create p_ci_finished_pipeline_ch_sync_events table (gitlab-org/gitlab!158060 - merged)
2 Implement service to sync pipelines to ClickHouse (gitlab-org/gitlab!158362 - merged)
3 Introduce worker to import finished pipelines t... (gitlab-org/gitlab!159083 - merged)
4 ◀ you are here gitlab-org/omnibus-gitlab!7783
5 !3839

What does this MR do?

This MR follows up on gitlab-org/gitlab!159083 (merged) to add the cronjob to sync finished builds to ClickHouse to the omnibus package. For context, this job is only supposed to run on .com for the time being. We're working on a path for self-managed users to leverage a ClickHouse database in their installs.

There's no changelog trailer since this feature is behind a feature flag.

Related issues

Create worker to sync finished pipelines to Cli... (gitlab-org/gitlab#470076)

Author checklist

For general guidance, please follow our Contributing guide.

Required

For anything in this list which will not be completed, please provide a reason in the MR discussion.

  • Merge Request Title and Description are up to date, accurate, and descriptive.
  • MR targeting the appropriate branch.
  • MR has a green pipeline.
  • Documentation created/updated. -- not needed
  • Tests added/updated, and test plan for scenarios not covered by automated tests. -- not needed
  • Equivalent MR/issue for omnibus-gitlab opened.

Reviewers checklist

Edited by Pedro Pombeiro (OOO from July 16th till Aug 7th)

Merge request reports