VersionApp Export data per day
Problem
The data is exported from VersionApp on a daily schedule but we are always exporting at least a week of data. This generates a longer running export but more critically also introduces higher load to dedupe data in downstream systems (see #351679 (comment 1181121789)).
Desired Outcome
Our script should export data in daily instead of weekly chunks. We should keep the check if files are already present. In most cases this should lead to only the previous day being exported.
Details
See current implementation here: https://gitlab.com/gitlab-services/version-gitlab-com/-/blob/master/scripts/data/export_data.sh#L137
Based on #351679 (comment 1177379426) the import process of the Data team should be handle this automatically.
Still please tag @rbacovic before deploying the new solution