Increase replication job concurrency

Problem to solve

Currently, Praefect only runs one replication job at a time. This concurrency limit is potentially too restrictive for our performance requirements. A better solution might be to have a configurable worker pool that handles X jobs at a time.

Further details

Mean latency is currently over 1 minute.

Screen_Shot_2020-02-12_at_1.22.56_PM

Proposal

Add concurrency with configurable limit

Links / references

Edited by James Ramsay (ex-GitLab)