Quarantine "allows user to select a custom agent" example on stable branches

Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.

The RSpec example "allows user to select a custom agent" fails consistently on stable branches 19-1-stable-ee, 19-2-stable-ee, 19-3-stable-ee, and older. The example is in ee/spec/support/shared_examples/ai/agentic_chat_shared_example.rb within the "user can use agentic chat" shared examples group.

It is included by these four feature specs:

  • ee/spec/features/work_items/issues/issue_sidebar_spec.rb
  • ee/spec/features/blob_file_name_spec.rb
  • ee/spec/features/projects/jobs_spec.rb
  • ee/spec/features/merge_request/user_sees_approval_widget_spec.rb

The example runs in the CI job rspec-ee system pg17 duo_workflow_service. It expects two .duo-chat-message elements but finds only one ("Based on my analysis..."). Then it hits a 30 second Capybara timeout.

Root cause: The job clones the AI gateway from main. In ee/lib/tasks/gitlab/ai_gateway/utils.rb, DEFAULT_BRANCH is main. A recent change on AI gateway main broke the custom-agent mock path. The build also logs a swallowed ValueError: No LLM operations available for billing tracking on every workflow.

The example was already removed from master via merge request !244590 (merged), so master is not affected.

Next step: Quarantine this example on stable branches to unblock CI. The durable fix belongs on the AI gateway side.

Edited by 🤖 GitLab Bot 🤖