Add Ml Experiment Tracking metrics
What does this MR do and why?
Adds database metrics to track usage of Ml Experiment Tracking. This change is wrapped by :ml_experiment_tracking feature flag
Database
CountMlCandidatesMetric
Main
https://postgres.ai/console/gitlab/gitlab-production-tunnel-pg12/sessions/15157/commands/52653
SELECT
COUNT("ml_candidates"."id")
FROM
"ml_candidates"
WHERE
"ml_candidates"."id" >= 1
AND "ml_candidates"."id" < 163
Max
https://postgres.ai/console/gitlab/gitlab-production-tunnel-pg12/sessions/15157/commands/52654
SELECT
MAX("ml_candidates"."id")
FROM
"ml_candidates"
min
https://postgres.ai/console/gitlab/gitlab-production-tunnel-pg12/sessions/15157/commands/52655
SELECT
MIN("ml_candidates"."id")
FROM
"ml_candidates"
CountMlExperimentsMetric
Main
https://postgres.ai/console/gitlab/gitlab-production-tunnel-pg12/sessions/15157/commands/52656
SELECT
COUNT("ml_experiments"."id")
FROM
"ml_experiments"
WHERE
"ml_experiments"."id" >= 1
AND "ml_experiments"."id" < 17
Max
https://postgres.ai/console/gitlab/gitlab-production-tunnel-pg12/sessions/15157/commands/52657
SELECT
MAX("ml_experiments"."id")
FROM
"ml_experiments"
min
https://postgres.ai/console/gitlab/gitlab-production-tunnel-pg12/sessions/15157/commands/52658
SELECT
MIN("ml_experiments"."id")
FROM
"ml_experiments"
CountProjectsWithMlCandidatesMetric
Main
https://postgres.ai/console/gitlab/gitlab-production-tunnel-pg12/sessions/15157/commands/52659
SELECT
COUNT(DISTINCT "ml_experiments"."project_id")
FROM
"ml_candidates"
INNER JOIN "ml_experiments" ON "ml_experiments"."id" = "ml_candidates"."experiment_id"
WHERE
"ml_experiments"."project_id" >= 20
AND "ml_experiments"."project_id" < 23
Max
https://postgres.ai/console/gitlab/gitlab-production-tunnel-pg12/sessions/15157/commands/52660
SELECT
MAX("ml_experiments"."project_id")
FROM
"ml_candidates"
INNER JOIN "ml_experiments" ON "ml_experiments"."id" = "ml_candidates"."experiment_id"
min
https://postgres.ai/console/gitlab/gitlab-production-tunnel-pg12/sessions/15157/commands/52661
SELECT
MIN("ml_experiments"."project_id")
FROM
"ml_candidates"
INNER JOIN "ml_experiments" ON "ml_experiments"."id" = "ml_candidates"."experiment_id"
CountUsersWithMlCandidatesMetric
Main
https://postgres.ai/console/gitlab/gitlab-production-tunnel-pg12/sessions/15157/commands/52662
SELECT
COUNT(DISTINCT "ml_candidates"."user_id")
FROM
"ml_candidates"
WHERE
"ml_candidates"."user_id" >= 1
AND "ml_candidates"."user_id" < 49
Max
https://postgres.ai/console/gitlab/gitlab-production-tunnel-pg12/sessions/15157/commands/52663
SELECT MAX("ml_candidates"."user_id") FROM "ml_candidates”
min
https://postgres.ai/console/gitlab/gitlab-production-tunnel-pg12/sessions/15157/commands/52664
SELECT MIN("ml_candidates"."user_id") FROM "ml_candidates"
CountProjectsWithMlExperimentsMetric
Main
https://postgres.ai/console/gitlab/gitlab-production-tunnel-pg12/sessions/15157/commands/52665
SELECT
COUNT(DISTINCT "ml_experiments"."project_id")
FROM
"ml_experiments"
WHERE
"ml_experiments"."project_id" >= 20
AND "ml_experiments"."project_id" < 23
Max
https://postgres.ai/console/gitlab/gitlab-production-tunnel-pg12/sessions/15157/commands/52666
SELECT MAX("ml_experiments"."project_id") FROM "ml_experiments"
min
https://postgres.ai/console/gitlab/gitlab-production-tunnel-pg12/sessions/15157/commands/52667
SELECT MIN("ml_experiments"."project_id") FROM "ml_experiments"
MR acceptance checklist
This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.
-
I have evaluated the MR acceptance checklist for this MR.
Related to #372063 (closed)
Merge request reports
Activity
changed milestone to %15.9
assigned to @eduardobonet
added 1 commit
- 58cefb43 - Adds initial metrics for Ml Experiment Tracking
marked the checklist item I have evaluated the MR acceptance checklist for this MR. as completed
added product intelligence label
- A deleted user
added product intelligencereview pending label
Reviewer roulette
Changes that require review have been detected!
Please refer to the table below for assigning reviewers and maintainers suggested by Danger in the specified category:
Category Reviewer Maintainer backend Omar Qunsul (
@OmarQunsulGitlab
) (UTC+1, same timezone as@eduardobonet
)Douglas Barbosa Alexandre (
@dbalexandre
) (UTC+0, 1 hour behind@eduardobonet
)database Eulyeon K. (
@euko
) (UTC+0, 1 hour behind@eduardobonet
)Adam Hegyi (
@ahegyi
) (UTC+1, same timezone as@eduardobonet
)product intelligence Piotr Skorupa (
@pskorupa
) (UTC+1, same timezone as@eduardobonet
)Maintainer review is optional for product intelligence To spread load more evenly across eligible reviewers, Danger has picked a candidate for each review slot, based on their timezone. Feel free to override these selections if you think someone else would be better-suited or use the GitLab Review Workload Dashboard to find other available reviewers.
To read more on how to use the reviewer roulette, please take a look at the Engineering workflow and code review guidelines. Please consider assigning a reviewer or maintainer who is a domain expert in the area of the merge request.
Once you've decided who will review this merge request, assign them as a reviewer! Danger does not automatically notify them for you.
If needed, you can retry the
danger-review
job that generated this comment.Generated by
Danger- Resolved by Eduardo Bonet
Hi @mikolaj_wawrzyniak, could you do the product intelligence review?
requested review from @mikolaj_wawrzyniak
- Resolved by Douglas Barbosa Alexandre
Hi @alinamihaila, could you do the initial backend review?
Edited by Eduardo Bonet
requested review from @alinamihaila
added featureconsolidation label and removed featureaddition label
added database label
removed review request for @alinamihaila
@alinamihaila
, thanks for approving this merge request.This is the first time the merge request is approved. To ensure full test coverage, a new pipeline will be started shortly.
For more info, please refer to the following links:
added pipeline:mr-approved label
- A deleted user
added databasereview pending label
- Resolved by Mikołaj Wawrzyniak
- Resolved by Mikołaj Wawrzyniak
- Resolved by Mikołaj Wawrzyniak
- Resolved by Mikołaj Wawrzyniak
- Resolved by Mikołaj Wawrzyniak
- Resolved by Alper Akgun
requested review from @euko
requested review from @dbalexandre
removed review request for @dbalexandre
requested review from @dbalexandre
removed review request for @dbalexandre
- Resolved by Eduardo Bonet
added databasereviewed label and removed databasereview pending label
removed review request for @euko
added product intelligenceapproved label and removed product intelligencereview pending label
removed review request for @mikolaj_wawrzyniak
requested review from @a_akgun
added databaseapproved label and removed databasereviewed label
removed review request for @a_akgun
- Resolved by Eduardo Bonet
@mikolaj_wawrzyniak all approvals have been granted, could you merge this?
requested review from @mikolaj_wawrzyniak
removed review request for @mikolaj_wawrzyniak
mentioned in issue gitlab-org/incubation-engineering/mlops/meta#67 (closed)
requested review from @dbalexandre
enabled an automatic merge when the pipeline for d3b0ce6e succeeds
mentioned in commit c12c2869
added workflowstaging-canary label
added workflowcanary label and removed workflowstaging-canary label
added workflowstaging label and removed workflowcanary label
added workflowproduction label and removed workflowstaging label
added workflowpost-deploy-db-production label and removed workflowproduction label
added releasedcandidate label
mentioned in merge request kubitus-project/kubitus-installer!1922 (merged)
added Model Experiments label
added releasedpublished label and removed releasedcandidate label