Skip to content

Bump MAX_BATCH_SIZE of member_namespace_id backfill migration

charlie ablett requested to merge cablett-bump-projectmember-backfill-max-batch-size into master

What does this MR do and why?

As of this writing, the backfilling of Member member_namespace_id is ongoing, but slow.

According to @acroitor (see https://gitlab.slack.com/archives/C014ZJZP0JC/p1653555996768419):

it seems the members migration can use a boost. It is up to ~27% i.e. ~4% per day ? 🤔 but a job only takes ~4s on avg and 21s max so far. So the rest of 1 min and 40s+ it just waits for next job.

For comparison, the MAX_BATCH_SIZE value of db/post_migrate/20220120123800_backfill_namespace_id_for_namespace_routes.rb is at 10_000.

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by charlie ablett

Merge request reports