Instrument a sample of background migration jobs
We'd like to gather statistics (similar to regular migrations, e.g. query runtime) for background migration jobs. Ideally, we would sample any queued background migration jobs, execute those with instrumentation and post back results to the MR.
We'll iterate on this design in a few stages:
-
Inject a fake migration into the testing pipeline that instruments traditional background migration jobs out of sidekiq. -
Support batched background migrations with this migration -
Move the testing of background migrations out of a fake migration, and in to a dedicated job (perhaps a rake task) -
Update the posted comment with a new section about background migrations
Edited by Simon Tomlinson