2025-08-20: Runway ingress SLI violation in ai-gateway service at us-east4
Runway ingress SLI violation in ai-gateway service at us-east4 (Severity 4)
Problem: The ai-gateway service's runway_ingress component in the us-east4 region experienced an Apdex score of 50.87%, violating its service level objective.
Impact: The incident resulted in increased latency for customers, indicated by dips in the Apdex score correlating with runway deployments.
Causes: The increased latency and Apdex score dips seem to correlate with runway deployments, suggesting these deployments might be influencing server performance.
Response strategy: Efforts to resolve the incident have included multiple deployments to identify and correct the underlying cause of the Apdex score dips, yet no concrete solution has been identified.
This ticket was created to track INC-3390, by incident.io