Add scalability configuration to service manifest
What
Right now, scalability defaults are global for all production services. Add scalability configuration to service manifest to support customization.
Why
When migrating AI gateway to Runway, we made global configuration changes in an effort to reduce cold start latency:
From resource and billing perspective, current defaults are inefficient.
Edited by Chance Feick