Add Siphon ClickHouse cleanup Rake task

Adam Hegyirequested to merge
ah-add-siphon-clickhouse-cleanup-rake-task into master

What does this MR do and why?

This MR adds a rake task for truncation Siphon-related tables in case of re-snapshotting or rollback is needed.

The rake task iterates over the Siphon table names, their downstream materialized view names.

Proposed steps (to be documented):

Leave Siphon running.

  1. Invoke the ClickHouse cleanup rake task.
  2. Using the Siphon API, retrigger the full table snapshot. (to be implemented within API / UI for Siphon(s) (gitlab-org/analytics-section/siphon#264))

References

Related note: gitlab-com/content-sites/handbook!20596 (comment 3635808466)

How to set up and validate locally

FORCE_CLEAN_SIPHON_TABLES_IN_CLICKHOUSE=true bundle exec rake gitlab:siphon:clean_clickhouse

MR acceptance checklist

Evaluate this MR against the MR acceptance checklist. It helps you analyze changes to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by Adam Hegyi

Merge request reports