Understand how we could push data from CI/CD jobs to Snowflake

Context

When making experiments/hypothesis, we would like to be able to validate them with data.

Sometimes, this data is not available in Snowflake/Tableau. This is the case for any data present inside a CI/CD job.

We made an experiment to push CI/CD data to InfluxDB a while back.

Recently, we made a process to push E2E tests data from CI/CD jobs to Snowflake.

Goal

Understand whether we could reuse the approach taken in Simplify the process of pushing end-to-end test... (gitlab-org/quality/quality-engineering&71 - closed) to push arbitrary CI/CD job data to Snowflake, easily and efficiently.