Metrics dictionary - reduce metrics fetching time
The auto-loading of introduced_by_url
introduced by https://gitlab.com/gitlab-org/growth/product-intelligence/metric-dictionary/-/merge_requests/40/diffs is taking a lot of time (it takes around 2 hours to generate the json and csv source files). We should aim to improve that time. Some options to achieve that include:
- Only loading all that data when running the script for the first time, and not re-checking the
introduced_by_url
for files that have already been loaded in a previous run - Reducing the load when executing the script locally - for example, only loading the data for the first batch of metrics.