Rollout plan AI builder Beta release

Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.

• Close this issue

Phase 0 – Experiment (Q1 early, internal + design partners)

When

First half of Q1.

Who

• GitLab internal teams.
• Selected design‑partner namespaces.

Goals

Validate end‑to‑end behavior and safety.

Establish baselines for:

• First‑pipeline creation rate.
• Time‑to‑first‑pipeline (TTFP).
• Config validity.

Exit criteria (Experiment → Beta)

• No Sev1/Sev2 incidents attributable to the builder for ≥2 consecutive weeks.
• ≥95% of generated .gitlab-ci.yml are syntactically valid and runnable.
• Baselines for activation & TTFP are measurable.
• No strong “this is harmful/unusable” signal from internal + partners.

Phase 1 – Beta (End of Q1)

Who

All eligible users

Exit criteria (Beta → Q2 GA)

• ≥20% relative uplift in first‑pipeline creation rate for AI‑exposed projects vs comparable non‑AI flows (within the beta population).
• ≥20% reduction in median TTFP for AI‑guided flows vs baseline/manual flows. Config quality:
• ≥95% syntactically valid, runnable configs. Stability & support:
• No Sev1/Sev2 issues from the builder over ≥4 weeks.