Investigate and fix GraphQL endpoint slowness in global search

Problem

The GraphQL endpoint is experiencing significant slowness, contributing to error budget violations in global search. Analysis shows that /api/graphql is the top slow search query, with multimatch queries accounting for 27% of all slow queries.

Key Findings

  • /api/graphql is the top slow search query in the past 24 hours
  • Multimatch slow queries: 7,560 out of 27,422 total slow queries (27%)
  • All multimatch slow queries return status 200
  • The bulk of high response times come from GraphQL and group searches for gitlab-org using the API
  • Target SLI is 15 seconds for Zoekt/advanced search

Related Issue

See gitlab-org/search-team/team-tasks#265 for full context and investigation details.

Investigation Areas

  • Identify which GraphQL queries are causing the slowness
  • Determine if exact code search or GLQL is the primary contributor
  • Analyze multimatch query patterns and optimize performance
  • Review group search API requests for gitlab-org scope
Edited by 🤖 GitLab Bot 🤖