Lost evaluation data due to accidental override

Problem to solve

Extracted from Slack from @AndrasHerczeg.

When we moved the BQ writing to a common module (MR), the write disposition was moved under the output sinks, but before it was a separate field. This means that the current configs no longer set the write disposition and it default to overwriting. It seems like we’ve lost all our historic data.

Proposal

• Restore data from backup.
• Fix daily run configs (!679 (merged)).
• Inform Duo Chat and RCA team about missing data (for 2024-08-19 run).
• Figure out corrective actions.

Further details

Links / references