Add new llm logger for debugging AI features
What does this MR do and why?
Adds a new logger and debugging statements for AI features.
Issue: https://gitlab.com/gitlab-org/gitlab/-/issues/409977
Screenshots or screen recordings
How to set up and validate locally
tail -f log/llm.log
- Set up your local instance for AI features
- Test an AI feature like summarize comments
- Active it by enabling the feature flag:
Feature.enable(:summarize_comments)
- Go to an issue with comments and press the "Summarize Comments" button (see video)
- Active it by enabling the feature flag:
MR acceptance checklist
This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.
-
I have evaluated the MR acceptance checklist for this MR.
Merge request reports
Activity
changed milestone to %16.0
added groupai framework maintenancerefactor typemaintenance labels
assigned to @nicolasdular
- A deleted user
added backend label
1 Warning 4052c546: The commit subject must contain at least 3 words. For more information, take a look at our Commit message guidelines. 1 Message This merge request adds or changes documentation files. A review from the Technical Writing team before you merge is recommended. Reviews can happen after you merge. Documentation review
The following files require a review from a technical writer:
-
doc/administration/logs/index.md
(Link to current live version) -
doc/development/ai_features.md
(Link to current live version)
The review does not need to block merging this merge request. See the:
-
Metadata for the
*.md
files that you've changed. The first few lines of each*.md
file identify the stage and group most closely associated with your docs change. - The Technical Writer assigned for that stage and group.
- Documentation workflows for information on when to assign a merge request for review.
Reviewer roulette
Changes that require review have been detected!
Please refer to the table below for assigning reviewers and maintainers suggested by Danger in the specified category:
Category Reviewer Maintainer backend Marcos Rocha (
@mc_rocha
) (UTC-4, 6 hours behind@nicolasdular
)Sincheol (David) Kim (
@dskim_gitlab
) (UTC+9.5, 7.5 hours ahead of@nicolasdular
)To spread load more evenly across eligible reviewers, Danger has picked a candidate for each review slot, based on their timezone. Feel free to override these selections if you think someone else would be better-suited or use the GitLab Review Workload Dashboard to find other available reviewers.
To read more on how to use the reviewer roulette, please take a look at the Engineering workflow and code review guidelines. Please consider assigning a reviewer or maintainer who is a domain expert in the area of the merge request.
Once you've decided who will review this merge request, assign them as a reviewer! Danger does not automatically notify them for you.
If needed, you can retry the
danger-review
job that generated this comment.Generated by
Danger-
added 1 commit
- 5f12db1d - Add new llm logger for debugging AI features
added 211 commits
-
5f12db1d...1f69486d - 210 commits from branch
master
- 67bb3cd6 - Add new llm logger for debugging AI features
-
5f12db1d...1f69486d - 210 commits from branch
added 1 commit
- 60599ffa - Add new llm logger for debugging AI features
- Resolved by Jan Provaznik
- Resolved by Nicolas Dular
- Resolved by Nicolas Dular
requested review from @mksionek
- Resolved by Nicolas Dular
LGTM @nicolasdular, just one question!
requested review from @jprovaznik and removed review request for @mksionek
@mksionek
, thanks for approving this merge request.This is the first time the merge request is approved. To ensure full test coverage, a new pipeline will be started shortly.
For more info, please refer to the following links:
added pipeline:mr-approved label
- A deleted user
added documentation label
added 255 commits
-
c98e2d5b...e4343ee3 - 253 commits from branch
master
- 68a58339 - Add new llm logger for debugging AI features
- ec2f79e4 - Log the request_id
-
c98e2d5b...e4343ee3 - 253 commits from branch
- Resolved by Suzanne Selhorn
Thanks @nicolasdular, nice improvement
, only minor suggestion/reply to your comment about unused logger.I wonder if there is a documentation counterpart for ~"group::ai-enablement" ?
removed review request for @jprovaznik
added 51 commits
-
ec2f79e4...f35b485d - 47 commits from branch
master
- 01daba12 - Add new llm logger for debugging AI features
- 98d93f3e - Log the request_id
- 7b7ddeaf - Remove logger initialization
- 4052c546 - Fix docs
Toggle commit list-
ec2f79e4...f35b485d - 47 commits from branch
requested review from @jprovaznik and @sselhorn
- Resolved by Nicolas Dular
- Resolved by Nicolas Dular
- Resolved by Nicolas Dular
- Resolved by Nicolas Dular
added Technical Writing development guidelines docsimprovement labels
removed review request for @sselhorn
As we have all approvals, @jprovaznik would you please go ahead and merge the MR? Thanks!
enabled an automatic merge when the pipeline for cb84e753 succeeds
Thanks @nicolasdular, MWPS set
mentioned in commit d743e701
added workflowstaging-canary label
added workflowcanary label and removed workflowstaging-canary label
added workflowstaging label and removed workflowcanary label
added workflowproduction label and removed workflowstaging label
added workflowpost-deploy-db-staging label and removed workflowproduction label
mentioned in merge request gitlab-com/www-gitlab-com!125300 (merged)
added releasedcandidate label
mentioned in merge request gitlab-com/www-gitlab-com!126442 (merged)
mentioned in merge request !161814 (merged)