Support pipeline job context in Duo Chat

What does this MR do and why?

Allow Duo Chat users to ask questions about pipeline jobs.

AI Gateway MR: gitlab-org/modelops/applied-ml/code-suggestions/ai-assist!1379 (merged)

Evaluation results

Results for the master branch: master evaluation.

Results for this branch: MR evaluation.

Metric	Master branch	This branch
Correctness	3.64	3.62
Readability	3.66	3.67
Comprehensiveness	3.58	3.57

MR acceptance checklist

Please evaluate this MR against the MR acceptance checklist. It helps you analyze changes to reduce risks in quality, performance, reliability, security, and maintainability.

How to set up and validate locally

1. From Rails console enable feature flags:

Feature.enable(:ai_build_reader_for_chat)
Feature.enable(:v2_chat_agent_integration)

2. Run GDK.
3. In AI gateway repo checkout the 468461-support-pipeline-context-in-duo-chat branch and run AI gateway.
4. Visit a pipeline job and ask a question to Duo Chat about the pipeline (What is this pipeline about?)
5. You should receive a details about the build.

Related to #468461 (closed)

changed milestone to %17.4

added Category:Duo Chat GitLab Ultimate Gitlab Duo Enterprise devopsai-powered groupduo chat missed:17.3 sectiondata-science typefeature workflowin dev labels

assigned to @evakadlecova

added pipelinetier-1 label

added backend feature flag labels

	4 Warnings
	This merge request is quite big (627 lines changed), please consider splitting it into multiple merge requests.
	bb00b437: The commit subject must contain at least 3 words. For more information, take a look at our Commit message guidelines.
	c4c009d9: The commit subject must contain at least 3 words. For more information, take a look at our Commit message guidelines.
	c4c009d9: Commits that change 30 or more lines across at least 3 files should describe these changes in the commit body. For more information, take a look at our Commit message guidelines.

	1 Message
	CHANGELOG missing: If this merge request needs a changelog entry, add the Changelog trailer to the commit message you want to add to the changelog. If this merge request doesn't need a CHANGELOG entry, feel free to ignore this message.

Reviewer roulette

Category	Reviewer	Maintainer
backend	@ahegyi (UTC+2, same timezone as author)	@harsimarsandhu (UTC+5.5, 3.5 hours ahead of author)
~"Verify"	Reviewer review is optional for ~"Verify"	@stanhu (UTC-4, 6 hours behind author)

Please refer to documentation page for guidance on how you can benefit from the Reviewer Roulette, or use the GitLab Review Workload Dashboard to find other available reviewers.

If needed, you can retry the danger-review job that generated this comment.

Generated by Danger

added 1 commit

• cd4dc195 - Support pipeline job context in Duo Chat

Compare with previous version

added 1 commit

• c8cf88f5 - Support pipeline job context in Duo Chat

Compare with previous version

resolved all threads

added 507 commits

• c8cf88f5...1cab5da7 - 506 commits from branch master
• 2e859032 - Support pipeline job context in Duo Chat

Compare with previous version

added 9 commits

• 2e859032...fbd06fc2 - 8 commits from branch master
• 477b3845 - Support pipeline job context in Duo Chat

Compare with previous version

changed the description

added 1 commit

• a9b7284f - Support pipeline job context in Duo Chat

Compare with previous version

added 1 commit

• ee27a407 - Support pipeline job context in Duo Chat

Compare with previous version

changed milestone to %17.5

added missed:17.4 label

added 2732 commits

• ee27a407...43a3d0d8 - 2731 commits from branch master
• 6ca78d13 - Support pipeline job context in Duo Chat

Compare with previous version

added 1 commit

• 8ff796cb - Support pipeline job context in Duo Chat

Compare with previous version

added 80 commits

• 8ff796cb...9524e105 - 79 commits from branch master
• 4eb650af - Support pipeline job context in Duo Chat

Compare with previous version

added 1 commit

• 60aaa5d5 - Support pipeline job context in Duo Chat

Compare with previous version

added 1 commit

• 8265dea3 - Support pipeline job context in Duo Chat

Compare with previous version

added 163 commits

• 8265dea3...9889e08c - 162 commits from branch master
• a50183e2 - Support pipeline job context in Duo Chat

Compare with previous version

added 435 commits

• a50183e2...e93fc117 - 434 commits from branch master
• 3761fe60 - Support pipeline job context in Duo Chat

Compare with previous version

added 61 commits

• 3761fe60...56d8d2cc - 60 commits from branch master
• e8e27c57 - Support pipeline job context in Duo Chat

Compare with previous version

added 35 commits

• e8e27c57...ae775944 - 34 commits from branch master
• 1e5dd07c - Support pipeline job context in Duo Chat

Compare with previous version

changed the description

added 386 commits

• 1e5dd07c...9f829ba5 - 385 commits from branch master
• cda4ce73 - Support pipeline job context in Duo Chat

Compare with previous version

changed the description

mentioned in merge request gitlab-org/modelops/applied-ml/code-suggestions/ai-assist!1379 (merged)

added 33 commits

• cda4ce73...9f4a2d68 - 32 commits from branch master
• f11751b5 - Support pipeline job context in Duo Chat

Compare with previous version

@brytannia Can you please review this MR?

requested review from @brytannia

requested review from @lesley-r and removed review request for @brytannia

This is really cool!!

I couldn't find anything to suggest, it looks great to me. :)

@brytannia Would you like to do the maintainer review, or should we also have another person review it? Thank you!

approved this merge request

added pipeline:mr-approved label

added pipelinetier-2 label and removed pipelinetier-1 label

Before you set this MR to auto-merge

This merge request will progress on pipeline tiers until it reaches the last tier: pipelinetier-3. We will trigger a new pipeline for each transition to a higher tier.

Before you set this MR to auto-merge, please check the following:

• You are the last maintainer of this merge request
• The latest pipeline for this merge request is pipelinetier-3 (You can find which tier it is in the pipeline name)
• This pipeline is recent enough (created in the last 8 hours)

If all the criteria above apply, please set auto-merge for this merge request.

See pipeline tiers and merging a merge request for more details.

requested review from @brytannia and removed review request for @lesley-r

requested review from @furkanayhan

@furkanayhan Can you do the Verify review please? Thank you!

E2E Test Result Summary

allure-report-publisher generated test report!

e2e-test-on-gdk: test report for bb00b437

expand test summary

+------------------------------------------------------------------+
|                          suites summary                          |
+-------------+--------+--------+---------+-------+-------+--------+
|             | passed | failed | skipped | flaky | total | result |
+-------------+--------+--------+---------+-------+-------+--------+
| Create      | 129    | 0      | 18      | 0     | 147   | ✅     |
| Govern      | 73     | 0      | 0       | 0     | 73    | ✅     |
| Release     | 5      | 0      | 0       | 0     | 5     | ✅     |
| Verify      | 45     | 0      | 2       | 0     | 47    | ✅     |
| Package     | 24     | 0      | 11      | 0     | 35    | ✅     |
| Plan        | 76     | 0      | 0       | 0     | 76    | ✅     |
| Monitor     | 8      | 0      | 0       | 0     | 8     | ✅     |
| Data Stores | 33     | 0      | 1       | 0     | 34    | ✅     |
| Fulfillment | 2      | 0      | 0       | 0     | 2     | ✅     |
| Analytics   | 2      | 0      | 0       | 0     | 2     | ✅     |
| Secure      | 4      | 0      | 0       | 0     | 4     | ✅     |
| Manage      | 1      | 0      | 1       | 0     | 2     | ✅     |
+-------------+--------+--------+---------+-------+-------+--------+
| Total       | 402    | 0      | 33      | 0     | 435   | ✅     |
+-------------+--------+--------+---------+-------+-------+--------+

e2e-test-on-omnibus: test report for 57880e0a

expand test summary

+------------------------------------------------------------------+
|                          suites summary                          |
+-------------+--------+--------+---------+-------+-------+--------+
|             | passed | failed | skipped | flaky | total | result |
+-------------+--------+--------+---------+-------+-------+--------+
| Plan        | 142    | 0      | 16      | 0     | 158   | ✅     |
| Create      | 222    | 0      | 30      | 0     | 252   | ✅     |
| Data Stores | 58     | 0      | 16      | 0     | 74    | ✅     |
| Analytics   | 4      | 0      | 0       | 0     | 4     | ✅     |
| Package     | 44     | 0      | 20      | 0     | 64    | ✅     |
| Verify      | 70     | 0      | 24      | 0     | 94    | ✅     |
| Govern      | 136    | 0      | 8       | 0     | 144   | ✅     |
| Monitor     | 4      | 0      | 20      | 0     | 24    | ✅     |
| Secure      | 6      | 0      | 4       | 0     | 10    | ✅     |
| Release     | 8      | 0      | 2       | 0     | 10    | ✅     |
| Manage      | 2      | 0      | 14      | 0     | 16    | ✅     |
| Configure   | 0      | 0      | 2       | 0     | 2     | ➖     |
| ModelOps    | 0      | 0      | 2       | 0     | 2     | ➖     |
| Fulfillment | 4      | 0      | 14      | 0     | 18    | ✅     |
| Growth      | 0      | 0      | 4       | 0     | 4     | ➖     |
| Ai-powered  | 0      | 0      | 2       | 0     | 2     | ➖     |
+-------------+--------+--------+---------+-------+-------+--------+
| Total       | 700    | 0      | 178     | 0     | 878   | ✅     |
+-------------+--------+--------+---------+-------+-------+--------+

requested changes

added 1 commit

• 86d62dcd - Use ask_build unit primitive

Compare with previous version

added 1 commit

• 125b3ea3 - Remove EE::JobSerializer

Compare with previous version

added 1 commit

• 057edb50 - Add scenario to test lines limit in JobAiEntity spec

Compare with previous version

added 1 commit

• c9e726d9 - Move extract_resource method to private

Compare with previous version

removed review request for @brytannia

approved this merge request

added 1 commit

• bd21e085 - Add scenarios for build URL identification

Compare with previous version

reset approvals from @brytannia by pushing to the branch

added 1 commit

• 34560f3d - Add scenarios for build URL identification

Compare with previous version

@furkanayhan I addressed your comments, can you please have another look?

requested review from @furkanayhan

added verify-reviewimpacted label

mentioned in issue #498199 (closed)

added 2 commits

• ce183e26 - Remove represent method from JobSerializer
• 57880e0a - Use build_reader unit primitive in BuildReader Executor

Compare with previous version

approved this merge request

removed review request for @furkanayhan

added pipelinetier-3 pipeline:run-e2e-omnibus-once labels and removed pipelinetier-2 label

removed pipeline:run-e2e-omnibus-once label

@harsimarsandhu Can you please do the maintainer review?

requested review from @harsimarsandhu

added 2240 commits

• 57880e0a...2694340c - 2230 commits from branch master
• 239bbe59 - Support pipeline job context in Duo Chat
• 1f21bb9d - Use ask_build unit primitive
• c4c009d9 - Remove EE::JobSerializer
• bac5de79 - Add scenario to test lines limit in JobAiEntity spec
• a28069c1 - Move extract_resource method to private
• 2982df5d - Add scenarios for build URL identification
• 0171367b - Remove represent method from JobSerializer
• df2ebd5d - Use build_reader unit primitive in BuildReader Executor
• 1bb28ea2 - Keep represent method in JobSerializer
• bb00b437 - Fix chat_spec.rb

Compare with previous version

reset approvals from @furkanayhan by pushing to the branch

approved this merge request

enabled automatic add to merge train when checks pass

resolved all threads

Hi @furkanayhan could we ask you to approve again due to rebasing? Thanks.

requested review from @furkanayhan

approved this merge request

resolved all threads

started a merge train

merged

mentioned in commit 8513b692

resolved all threads

mentioned in issue #498931

added workflowstaging-canary label and removed workflowin dev label

added workflowcanary label and removed workflowstaging-canary label

added workflowstaging label and removed workflowcanary label

added workflowproduction label and removed workflowstaging label

added workflowpost-deploy-db-staging label and removed workflowproduction label

added workflowpost-deploy-db-production label and removed workflowpost-deploy-db-staging label

added releasedcandidate label

added releasedpublished label and removed releasedcandidate label

mentioned in issue gitlab-org/quality/triage-reports#20610 (closed)