Implement adaptive concurrency limiting
After the resource watcher and the calculator are in place, it's time to attach them to limiters. This issue aims to do the following tasks:
- Add new configurations:
initialLimit
,maxLimit
,minLimit
,backoffFactor
, andadaptive
boolean. They are mutually exclusive with the existinglimit
config. - Attach resource watcher and calculator to the limiter.
- Add monitoring and logging.
- Add dry-run feature flag. This feature flag allows us to verify the functionality of the adaptive concurrency limit on production via observability tools. The actual limit is still static.
- Add release feature flag. This feature flag enables adaptiveness for real.
Edited by Quang-Minh Nguyen