Skip to content

Route model based on rollout schedule

Tan Le requested to merge feature-flag-roll-out into main

What does this MR do and why?

This change allows routing models based on rollout schedules while still respecting group third-party AI settings. If the project is not provided or it is not within the rollout window, the request will be routed to GitLab native model.

  • Add a new feature flag F_THIRD_PARTY_ROLLOUT_PERCENTAGE. This can be a number from 0 to 100.
graph LR
  A[F_THIRD_PARTY_ROLLOUT_PERCENTAGE] --> C[Model Router]
  B[is_third_party_enabled] --> C[Model Router]
  C --> D[Model]

This is blocked by !187 (merged)

Related to #150 (closed)

Edited by Tan Le

Merge request reports