Add end-to-end tests for Enrichment and Consumption layer flows

With lots of incoming changes to Enrichment + Consumption layer with Trial and all the new things that will get added, we should have some kind of end-to-end test that simulates the actual flows via ClickHouse and jobs to ensure we are not breaking things while we add new ones.

This will also give us more confidence in iterating (like with our hesitation to change Redis behavior), because we worry things might break.

The new change to drop the balance column that provisioning is working on has also highlighted the need for this - everything looks okay, but being confident that everything is fine is a different thing altogether.

Currently we have rspecs, but they are unit tests. We need integration/end-to-end tests that cover the actual flows.