Skip to content
Snippets Groups Projects

Introduce models for Receptive Agents (Part 1)

Merged Timo Furrer requested to merge receptive-agents/part-1/model into master

What does this MR do and why?

This change set introduces the model for Receptive Agents (see &12180).

:bulb: The commits are suited to be reviewed individually.

This MR is part one of a series of MRs to introduce basic Receptive Agents support in the backend:

  1. Introduce models for Receptive Agents (Part 1) (!163142 - merged)
  2. Receptive Agents REST API (Part 2) (!163143 - merged)
  3. Receptive Agents internal REST API (Part 3) (!163144 - merged)
  4. Introduce Cluster Agent URL Configuration Graph... (!163493 - merged)

Refs #463426 (closed) #463427 (closed)

Edited by Timo Furrer

Merge request reports

Loading
Loading

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
  • Ghost User
  • Timo Furrer mentioned in merge request !163143 (merged)

    mentioned in merge request !163143 (merged)

  • Timo Furrer mentioned in merge request !163144 (merged)

    mentioned in merge request !163144 (merged)

  • Timo Furrer changed milestone to %17.4

    changed milestone to %17.4

  • Timo Furrer changed the description

    changed the description

  • Database migrations (on the main database)

    1 Warnings
    :warning: 20240725224013 - AddClusterAgentUrlConfigurationsFks had a query that exceeded timing
    guidelines
    . Run time should not exceed 100ms, but it was 104.82ms. Please consider possible options
    to improve the query performance.
    ALTER TABLE cluster_agent_url_configurations VALIDATE
    CONSTRAINT fk_49b126e246

    Migrations included in this change have been executed on gitlab.com data for testing purposes. For details, please see the migration testing pipeline (limited access).

    Migration Type Total runtime Result DB size change
    20240725223931 - CreateClusterAgentUrlConfigurations Regular 5.7 s :white_check_mark: +48.00 KiB
    20240725224013 - AddClusterAgentUrlConfigurationsFks Regular 7.6 s :warning: +0.00 B
    20240813074143 - AddIsReceptiveColumnToClusterAgents Regular 4.3 s :white_check_mark: +0.00 B
    Runtime Histogram for all migrations
    Query Runtime Count
    0 seconds - 0.01 seconds 0
    0.01 seconds - 0.1 seconds 5
    0.1 seconds - 1 second 24
    1 second - 5 seconds 0
    5 seconds - 15 seconds 0
    15 seconds - 5 minutes 0
    5 minutes + 0

    Migration: 20240725223931 - CreateClusterAgentUrlConfigurations

    • Type: Regular
    • Duration: 5.7 s
    • Database size change: +48.00 KiB
    Calls Total Time Max Time Mean Time Rows Query
    1 34.6 ms 34.6 ms 34.6 ms 0
    CREATE TABLE "cluster_agent_url_configurations" ("id" bigserial primary key, "created_at" timestamptz NOT NULL, "updated_at" timestamptz NOT NULL, "agent_id" bigint NOT NULL, "project_id" bigint NOT NULL, "created_by_user_id" bigint, "status" smallint DEFAULT 0 NOT NULL, "url" text NOT NULL, "ca_cert" text, "client_key" text, "client_cert" text, "tls_host" text, "public_key" bytea, "encrypted_private_key" bytea, "encrypted_private_key_iv" bytea, CONSTRAINT check_ed21ced327 CHECK (char_length("url") <= 2048), CONSTRAINT check_25ef8c679c CHECK (char_length("ca_cert") <= 16384), CONSTRAINT check_e3736d97df CHECK (char_length("client_key") <= 16384), CONSTRAINT check_93a57284e5 CHECK (char_length("client_cert") <= 16384), CONSTRAINT check_1ffcfef6d6 CHECK (char_length("tls_host") <= 2048))
    1 2.7 ms 2.7 ms 2.7 ms 0
    CREATE INDEX "index_cluster_agent_url_configurations_on_project_id" ON "cluster_agent_url_configurations" ("project_id")
    1 2.4 ms 2.4 ms 2.4 ms 0
    CREATE INDEX "index_cluster_agent_url_configurations_on_user_id" ON "cluster_agent_url_configurations" ("created_by_user_id")
    WHERE created_by_user_id IS NOT NULL
    1 1.8 ms 1.8 ms 1.8 ms 0
    CREATE INDEX "index_cluster_agent_url_configurations_on_agent_id" ON "cluster_agent_url_configurations" ("agent_id")
    1 0.9 ms 0.9 ms 0.9 ms 1
    SELECT "feature_gates"."key", "feature_gates"."value"  FROM "feature_gates"  WHERE "feature_gates"."feature_key" = $1
    1 0.0 ms 0.0 ms 0.0 ms 1
    SELECT $1::regtype::oid
    2 0.0 ms 0.0 ms 0.0 ms 2
    SELECT pg_backend_pid()
    Histogram for CreateClusterAgentUrlConfigurations
    Query Runtime Count
    0 seconds - 0.01 seconds 0
    0.01 seconds - 0.1 seconds 1
    0.1 seconds - 1 second 7
    1 second - 5 seconds 0
    5 seconds - 15 seconds 0
    15 seconds - 5 minutes 0
    5 minutes + 0

    :warning: Migration: 20240725224013 - AddClusterAgentUrlConfigurationsFks

    • Type: Regular
    • Duration: 7.6 s
    • Database size change: +0.00 B
    Calls Total Time Max Time Mean Time Rows Query
    1 104.8 ms 104.8 ms 104.8 ms 0
    ALTER TABLE cluster_agent_url_configurations VALIDATE CONSTRAINT fk_49b126e246
    1 84.2 ms 84.2 ms 84.2 ms 0
    ALTER TABLE cluster_agent_url_configurations VALIDATE CONSTRAINT fk_12d4a33b65
    1 25.6 ms 25.6 ms 25.6 ms 0
    ALTER TABLE cluster_agent_url_configurations ADD CONSTRAINT fk_49b126e246 FOREIGN KEY (project_id) REFERENCES projects (id) ON DELETE CASCADE NOT VALID
    1 17.0 ms 17.0 ms 17.0 ms 0
    ALTER TABLE cluster_agent_url_configurations ADD CONSTRAINT fk_02c2a4f060 FOREIGN KEY (agent_id) REFERENCES cluster_agents (id) ON DELETE CASCADE NOT VALID
    1 11.4 ms 11.4 ms 11.4 ms 0
    ALTER TABLE cluster_agent_url_configurations ADD CONSTRAINT fk_12d4a33b65 FOREIGN KEY (created_by_user_id) REFERENCES users (id) ON DELETE
    SET NULL NOT VALID
    1 10.2 ms 10.2 ms 10.2 ms 0
    ALTER TABLE cluster_agent_url_configurations VALIDATE CONSTRAINT fk_02c2a4f060
    3 1.8 ms 1.0 ms 0.6 ms 0
    SELECT $1 AS one
    FROM "postgres_foreign_keys" WHERE "postgres_foreign_keys"."constrained_table_name" = $2 AND "postgres_foreign_keys"."referenced_table_name" = $3 AND "postgres_foreign_keys"."name" = $4 AND "postgres_foreign_keys"."constrained_columns" = $5 AND "postgres_foreign_keys"."referenced_columns" = $6 AND "postgres_foreign_keys"."on_delete_action" = $7
    LIMIT $8
    6 1.6 ms 0.3 ms 0.3 ms 0
    SELECT "postgres_partitioned_tables".*
    FROM "postgres_partitioned_tables" WHERE (identifier = concat(current_schema(), $1, $2))
    LIMIT $3
    2 0.0 ms 0.0 ms 0.0 ms 2
    SELECT pg_backend_pid()
    Histogram for AddClusterAgentUrlConfigurationsFks
    Query Runtime Count
    0 seconds - 0.01 seconds 0
    0.01 seconds - 0.1 seconds 2
    0.1 seconds - 1 second 15
    1 second - 5 seconds 0
    5 seconds - 15 seconds 0
    15 seconds - 5 minutes 0
    5 minutes + 0

    Migration: 20240813074143 - AddIsReceptiveColumnToClusterAgents

    • Type: Regular
    • Duration: 4.3 s
    • Database size change: +0.00 B
    Calls Total Time Max Time Mean Time Rows Query
    1 2.4 ms 2.4 ms 2.4 ms 0
    ALTER TABLE "cluster_agents" ADD "is_receptive" bool DEFAULT FALSE NOT NULL
    1 0.0 ms 0.0 ms 0.0 ms 1
    SELECT $1::regtype::oid
    2 0.0 ms 0.0 ms 0.0 ms 2
    SELECT pg_backend_pid()
    Histogram for AddIsReceptiveColumnToClusterAgents
    Query Runtime Count
    0 seconds - 0.01 seconds 0
    0.01 seconds - 0.1 seconds 2
    0.1 seconds - 1 second 2
    1 second - 5 seconds 0
    5 seconds - 15 seconds 0
    15 seconds - 5 minutes 0
    5 minutes + 0

    Background Migration: BackfillProtectedEnvironmentApprovalRulesProtectedEnvironmentGroupId

    Sampled 47 batches. Estimated Time to complete: 1 hour and 20 minutes
    • Interval: 120s
    • Total tuple count: 40397
    • Max batch size: 0
    • Estimated seconds to complete: 4800s
    • Estimated number of batches: 40
    • Average batch time: 4.82s
    • Batch size: 1000
    • N. of batches sampled: 47
    • N. of failed batches: 0

    Time estimation is conservative and based on sampling production data in a test environment. It represents the max time that migration could take. The actual time may differ from this estimation.

    _Consider changing max_batch_size and interval if this estimate is unacceptable._

    Calls Total Time Max Time Mean Time Rows Query
    421 956.8 ms 4.7 ms 2.3 ms 42100
    UPDATE protected_environment_approval_rules
    SET protected_environment_group_id = protected_environments.group_id
    FROM protected_environments
    WHERE protected_environments.id = protected_environment_approval_rules.protected_environment_id AND protected_environment_approval_rules.id IN (
    SELECT protected_environment_approval_rules.id
    FROM protected_environment_approval_rules
    WHERE protected_environment_approval_rules.id BETWEEN $1 AND $2 AND protected_environment_approval_rules.protected_environment_group_id IS NULL AND protected_environment_approval_rules.id >= $3 AND protected_environment_approval_rules.id < $4
    )
    47 106.5 ms 4.2 ms 2.3 ms 4666
    UPDATE protected_environment_approval_rules
    SET protected_environment_group_id = protected_environments.group_id
    FROM protected_environments
    WHERE protected_environments.id = protected_environment_approval_rules.protected_environment_id AND protected_environment_approval_rules.id IN (
    SELECT protected_environment_approval_rules.id
    FROM protected_environment_approval_rules
    WHERE protected_environment_approval_rules.id BETWEEN $1 AND $2 AND protected_environment_approval_rules.protected_environment_group_id IS NULL AND protected_environment_approval_rules.id >= $3
    )
    47 7.2 ms 2.6 ms 0.2 ms 47
    UPDATE batched_background_migration_jobs
    SET updated_at = $1, started_at = $2, status = $3, attempts = $4
    WHERE batched_background_migration_jobs.id = $5
    47 5.7 ms 1.1 ms 0.1 ms 47
    UPDATE batched_background_migration_jobs
    SET updated_at = $1, finished_at = $2, status = $3, metrics = $4
    WHERE batched_background_migration_jobs.id = $5
    468 118.8 ms 0.6 ms 0.3 ms 421
    SELECT protected_environment_approval_rules.id
    FROM protected_environment_approval_rules
    WHERE protected_environment_approval_rules.id BETWEEN $1 AND $2 AND protected_environment_approval_rules.protected_environment_group_id IS NULL AND protected_environment_approval_rules.id >= $3
    ORDER BY protected_environment_approval_rules.id ASC
    LIMIT $4
    OFFSET $5
    94 14.4 ms 0.4 ms 0.2 ms 94
    INSERT INTO batched_background_migration_job_transition_logs (batched_background_migration_job_id, created_at, updated_at, previous_status, next_status) VALUES ($1, $2, $3, $4, $5) RETURNING id
    47 1.8 ms 0.2 ms 0.0 ms 47
    SELECT protected_environment_approval_rules.id
    FROM protected_environment_approval_rules
    WHERE protected_environment_approval_rules.id BETWEEN $1 AND $2 AND protected_environment_approval_rules.protected_environment_group_id IS NULL
    ORDER BY protected_environment_approval_rules.id ASC
    LIMIT $3
    47 2.9 ms 0.1 ms 0.1 ms 47
    SELECT sum(batched_background_migration_jobs.batch_size)
    FROM batched_background_migration_jobs
    WHERE batched_background_migration_jobs.batched_background_migration_id = $1 AND batched_background_migration_jobs.status IN ($2)
    94 4.9 ms 0.1 ms 0.1 ms 94
    SELECT batched_background_migration_jobs.*
    FROM batched_background_migration_jobs
    WHERE batched_background_migration_jobs.id = $1
    LIMIT $2
    47 2.1 ms 0.1 ms 0.0 ms 47
    SELECT batched_background_migrations.*
    FROM batched_background_migrations
    WHERE batched_background_migrations.id = $1
    LIMIT $2
    Histogram of batch runtimes for BackfillProtectedEnvironmentApprovalRulesProtectedEnvironmentGroupId
    Batch Runtime Count
    0 seconds - 10 seconds 47
    10 seconds - 1 minute 0
    1 minute - 2 minutes 0
    2 minutes - 3 minutes 0
    3 minutes - 5 minutes 0
    5 minutes + 0
    Histogram across all sampled batches of BackfillProtectedEnvironmentApprovalRulesProtectedEnvironmentGroupId
    Query Runtime Count
    0 seconds - 0.1 seconds 589
    0.1 seconds - 0.5 seconds 770
    0.5 seconds - 1 second 0
    1 second - 2 seconds 0
    2 seconds - 5 seconds 0
    5 seconds + 0

    Background Migration: BackfillProtectedEnvironmentDeployAccessLevelsProtectedEnvironmentGroupId

    Sampled 26 batches. Estimated Time to complete: 10 hours and 56 minutes
    • Interval: 120s
    • Total tuple count: 328408
    • Max batch size: 0
    • Estimated seconds to complete: 39360s
    • Estimated number of batches: 328
    • Average batch time: 4.84s
    • Batch size: 1000
    • N. of batches sampled: 26
    • N. of failed batches: 0

    Time estimation is conservative and based on sampling production data in a test environment. It represents the max time that migration could take. The actual time may differ from this estimation.

    _Consider changing max_batch_size and interval if this estimate is unacceptable._

    Calls Total Time Max Time Mean Time Rows Query
    26 88.3 ms 8.1 ms 3.4 ms 2600
    UPDATE protected_environment_deploy_access_levels
    SET protected_environment_group_id = protected_environments.group_id
    FROM protected_environments
    WHERE protected_environments.id = protected_environment_deploy_access_levels.protected_environment_id AND protected_environment_deploy_access_levels.id IN (
    SELECT protected_environment_deploy_access_levels.id
    FROM protected_environment_deploy_access_levels
    WHERE protected_environment_deploy_access_levels.id BETWEEN $1 AND $2 AND protected_environment_deploy_access_levels.protected_environment_group_id IS NULL AND protected_environment_deploy_access_levels.id >= $3
    )
    234 688.4 ms 5.5 ms 2.9 ms 23400
    UPDATE protected_environment_deploy_access_levels
    SET protected_environment_group_id = protected_environments.group_id
    FROM protected_environments
    WHERE protected_environments.id = protected_environment_deploy_access_levels.protected_environment_id AND protected_environment_deploy_access_levels.id IN (
    SELECT protected_environment_deploy_access_levels.id
    FROM protected_environment_deploy_access_levels
    WHERE protected_environment_deploy_access_levels.id BETWEEN $1 AND $2 AND protected_environment_deploy_access_levels.protected_environment_group_id IS NULL AND protected_environment_deploy_access_levels.id >= $3 AND protected_environment_deploy_access_levels.id < $4
    )
    52 10.3 ms 0.8 ms 0.2 ms 52
    INSERT INTO batched_background_migration_job_transition_logs (batched_background_migration_job_id, created_at, updated_at, previous_status, next_status) VALUES ($1, $2, $3, $4, $5) RETURNING id
    260 59.7 ms 0.7 ms 0.2 ms 234
    SELECT protected_environment_deploy_access_levels.id
    FROM protected_environment_deploy_access_levels
    WHERE protected_environment_deploy_access_levels.id BETWEEN $1 AND $2 AND protected_environment_deploy_access_levels.protected_environment_group_id IS NULL AND protected_environment_deploy_access_levels.id >= $3
    ORDER BY protected_environment_deploy_access_levels.id ASC
    LIMIT $4
    OFFSET $5
    26 3.3 ms 0.4 ms 0.1 ms 26
    UPDATE batched_background_migration_jobs
    SET updated_at = $1, started_at = $2, status = $3, attempts = $4
    WHERE batched_background_migration_jobs.id = $5
    26 3.1 ms 0.2 ms 0.1 ms 26
    UPDATE batched_background_migration_jobs
    SET updated_at = $1, finished_at = $2, status = $3, metrics = $4
    WHERE batched_background_migration_jobs.id = $5
    26 1.3 ms 0.2 ms 0.1 ms 26
    SELECT batched_background_migrations.*
    FROM batched_background_migrations
    WHERE batched_background_migrations.id = $1
    LIMIT $2
    26 1.4 ms 0.1 ms 0.1 ms 26
    SELECT sum(batched_background_migration_jobs.batch_size)
    FROM batched_background_migration_jobs
    WHERE batched_background_migration_jobs.batched_background_migration_id = $1 AND batched_background_migration_jobs.status IN ($2)
    52 2.7 ms 0.1 ms 0.1 ms 52
    SELECT batched_background_migration_jobs.*
    FROM batched_background_migration_jobs
    WHERE batched_background_migration_jobs.id = $1
    LIMIT $2
    26 1.0 ms 0.1 ms 0.0 ms 26
    SELECT protected_environment_deploy_access_levels.id
    FROM protected_environment_deploy_access_levels
    WHERE protected_environment_deploy_access_levels.id BETWEEN $1 AND $2 AND protected_environment_deploy_access_levels.protected_environment_group_id IS NULL
    ORDER BY protected_environment_deploy_access_levels.id ASC
    LIMIT $3
    Histogram of batch runtimes for BackfillProtectedEnvironmentDeployAccessLevelsProtectedEnvironmentGroupId
    Batch Runtime Count
    0 seconds - 10 seconds 26
    10 seconds - 1 minute 0
    1 minute - 2 minutes 0
    2 minutes - 3 minutes 0
    3 minutes - 5 minutes 0
    5 minutes + 0
    Histogram across all sampled batches of BackfillProtectedEnvironmentDeployAccessLevelsProtectedEnvironmentGroupId
    Query Runtime Count
    0 seconds - 0.1 seconds 99
    0.1 seconds - 0.5 seconds 655
    0.5 seconds - 1 second 0
    1 second - 2 seconds 0
    2 seconds - 5 seconds 0
    5 seconds + 0

    Background Migration: BackfillProtectedEnvironmentApprovalRulesProtectedEnvironmentProjectId

    Sampled 31 batches. Estimated Time to complete: 1 hour and 20 minutes
    • Interval: 120s
    • Total tuple count: 40397
    • Max batch size: 0
    • Estimated seconds to complete: 4800s
    • Estimated number of batches: 40
    • Average batch time: 5.28s
    • Batch size: 1000
    • N. of batches sampled: 31
    • N. of failed batches: 0

    Time estimation is conservative and based on sampling production data in a test environment. It represents the max time that migration could take. The actual time may differ from this estimation.

    _Consider changing max_batch_size and interval if this estimate is unacceptable._

    Calls Total Time Max Time Mean Time Rows Query
    277 12974.5 ms 201.0 ms 46.8 ms 27700
    UPDATE protected_environment_approval_rules
    SET protected_environment_project_id = protected_environments.project_id
    FROM protected_environments
    WHERE protected_environments.id = protected_environment_approval_rules.protected_environment_id AND protected_environment_approval_rules.id IN (
    SELECT protected_environment_approval_rules.id
    FROM protected_environment_approval_rules
    WHERE protected_environment_approval_rules.id BETWEEN $1 AND $2 AND protected_environment_approval_rules.protected_environment_project_id IS NULL AND protected_environment_approval_rules.id >= $3 AND protected_environment_approval_rules.id < $4
    )
    31 1480.0 ms 166.1 ms 47.7 ms 3068
    UPDATE protected_environment_approval_rules
    SET protected_environment_project_id = protected_environments.project_id
    FROM protected_environments
    WHERE protected_environments.id = protected_environment_approval_rules.protected_environment_id AND protected_environment_approval_rules.id IN (
    SELECT protected_environment_approval_rules.id
    FROM protected_environment_approval_rules
    WHERE protected_environment_approval_rules.id BETWEEN $1 AND $2 AND protected_environment_approval_rules.protected_environment_project_id IS NULL AND protected_environment_approval_rules.id >= $3
    )
    308 270.2 ms 18.2 ms 0.9 ms 277
    SELECT protected_environment_approval_rules.id
    FROM protected_environment_approval_rules
    WHERE protected_environment_approval_rules.id BETWEEN $1 AND $2 AND protected_environment_approval_rules.protected_environment_project_id IS NULL AND protected_environment_approval_rules.id >= $3
    ORDER BY protected_environment_approval_rules.id ASC
    LIMIT $4
    OFFSET $5
    31 5.4 ms 2.3 ms 0.2 ms 31
    UPDATE batched_background_migration_jobs
    SET updated_at = $1, finished_at = $2, status = $3, metrics = $4
    WHERE batched_background_migration_jobs.id = $5
    62 9.1 ms 0.2 ms 0.1 ms 62
    INSERT INTO batched_background_migration_job_transition_logs (batched_background_migration_job_id, created_at, updated_at, previous_status, next_status) VALUES ($1, $2, $3, $4, $5) RETURNING id
    31 1.9 ms 0.2 ms 0.1 ms 31
    SELECT sum(batched_background_migration_jobs.batch_size)
    FROM batched_background_migration_jobs
    WHERE batched_background_migration_jobs.batched_background_migration_id = $1 AND batched_background_migration_jobs.status IN ($2)
    31 3.2 ms 0.2 ms 0.1 ms 31
    UPDATE batched_background_migration_jobs
    SET updated_at = $1, started_at = $2, status = $3, attempts = $4
    WHERE batched_background_migration_jobs.id = $5
    62 3.3 ms 0.1 ms 0.1 ms 62
    SELECT batched_background_migration_jobs.*
    FROM batched_background_migration_jobs
    WHERE batched_background_migration_jobs.id = $1
    LIMIT $2
    31 1.4 ms 0.1 ms 0.0 ms 31
    SELECT batched_background_migrations.*
    FROM batched_background_migrations
    WHERE batched_background_migrations.id = $1
    LIMIT $2
    31 1.2 ms 0.1 ms 0.0 ms 31
    SELECT protected_environment_approval_rules.id
    FROM protected_environment_approval_rules
    WHERE protected_environment_approval_rules.id BETWEEN $1 AND $2 AND protected_environment_approval_rules.protected_environment_project_id IS NULL
    ORDER BY protected_environment_approval_rules.id ASC
    LIMIT $3
    Histogram of batch runtimes for BackfillProtectedEnvironmentApprovalRulesProtectedEnvironmentProjectId
    Batch Runtime Count
    0 seconds - 10 seconds 31
    10 seconds - 1 minute 0
    1 minute - 2 minutes 0
    2 minutes - 3 minutes 0
    3 minutes - 5 minutes 0
    5 minutes + 0
    Histogram across all sampled batches of BackfillProtectedEnvironmentApprovalRulesProtectedEnvironmentProjectId
    Query Runtime Count
    0 seconds - 0.1 seconds 369
    0.1 seconds - 0.5 seconds 526
    0.5 seconds - 1 second 0
    1 second - 2 seconds 0
    2 seconds - 5 seconds 0
    5 seconds + 0

    Background Migration: BackfillPackagesDependenciesProjectId

    Sampled 13 batches. Estimated Time to complete: 6 days, 11 hours, and 8 minutes
    • Interval: 120s
    • Total tuple count: 93089160
    • Max batch size: 0
    • Estimated seconds to complete: 558480s
    • Estimated number of batches: 4654
    • Average batch time: 22.18s
    • Batch size: 20000
    • N. of batches sampled: 13
    • N. of failed batches: 0

    Time estimation is conservative and based on sampling production data in a test environment. It represents the max time that migration could take. The actual time may differ from this estimation.

    _Consider changing max_batch_size and interval if this estimate is unacceptable._

    Calls Total Time Max Time Mean Time Rows Query
    247 143037.7 ms 1910.2 ms 579.1 ms 247000
    UPDATE packages_dependency_links
    SET dependency_id = subquery.id
    FROM (
    SELECT packages_dependencies.id, joined.packages_dependency_link_id
    FROM (
    SELECT packages_dependency_links.id AS packages_dependency_link_id, packages_dependency_links.project_id, packages_dependencies.name, packages_dependencies.version_pattern
    FROM packages_dependency_links
    JOIN packages_dependencies ON packages_dependencies.id = packages_dependency_links.dependency_id
    WHERE packages_dependency_links.id BETWEEN $1 AND $2 AND packages_dependency_links.id >= $3 AND packages_dependency_links.id < $4
    ) joined
    JOIN packages_dependencies ON packages_dependencies.project_id = joined.project_id AND packages_dependencies.name = joined.name AND packages_dependencies.version_pattern = joined.version_pattern
    ) subquery
    WHERE packages_dependency_links.id = subquery.packages_dependency_link_id
    13 7263.2 ms 982.0 ms 558.7 ms 12926
    UPDATE packages_dependency_links
    SET dependency_id = subquery.id
    FROM (
    SELECT packages_dependencies.id, joined.packages_dependency_link_id
    FROM (
    SELECT packages_dependency_links.id AS packages_dependency_link_id, packages_dependency_links.project_id, packages_dependencies.name, packages_dependencies.version_pattern
    FROM packages_dependency_links
    JOIN packages_dependencies ON packages_dependencies.id = packages_dependency_links.dependency_id
    WHERE packages_dependency_links.id BETWEEN $1 AND $2 AND packages_dependency_links.id >= $3
    ) joined
    JOIN packages_dependencies ON packages_dependencies.project_id = joined.project_id AND packages_dependencies.name = joined.name AND packages_dependencies.version_pattern = joined.version_pattern
    ) subquery
    WHERE packages_dependency_links.id = subquery.packages_dependency_link_id
    247 25531.7 ms 976.4 ms 103.4 ms 49360
    UPDATE packages_dependencies
    SET project_id = subquery.project_id
    FROM (
    SELECT DISTINCT ON (dependency_id) dependency_id, project_id
    FROM packages_dependency_links
    WHERE packages_dependency_links.id BETWEEN $1 AND $2 AND packages_dependency_links.id >= $3 AND packages_dependency_links.id < $4
    ) subquery
    WHERE packages_dependencies.id = subquery.dependency_id AND packages_dependencies.project_id IS NULL
    13 941.2 ms 245.2 ms 72.4 ms 2043
    UPDATE packages_dependencies
    SET project_id = subquery.project_id
    FROM (
    SELECT DISTINCT ON (dependency_id) dependency_id, project_id
    FROM packages_dependency_links
    WHERE packages_dependency_links.id BETWEEN $1 AND $2 AND packages_dependency_links.id >= $3
    ) subquery
    WHERE packages_dependencies.id = subquery.dependency_id AND packages_dependencies.project_id IS NULL
    247 3679.0 ms 47.1 ms 14.9 ms 45899
    INSERT INTO packages_dependencies (project_id, name, version_pattern)
    SELECT packages_dependency_links.project_id AS project_id, packages_dependencies.name AS name, packages_dependencies.version_pattern AS version_pattern
    FROM packages_dependency_links
    JOIN packages_dependencies ON packages_dependencies.id = packages_dependency_links.dependency_id
    WHERE packages_dependency_links.id BETWEEN $1 AND $2 AND packages_dependency_links.id >= $3 AND packages_dependency_links.id < $4 AND packages_dependencies.project_id <> packages_dependency_links.project_id ON CONFLICT DO NOTHING
    260 128.6 ms 20.9 ms 0.5 ms 247
    SELECT packages_dependency_links.id
    FROM packages_dependency_links
    WHERE packages_dependency_links.id BETWEEN $1 AND $2 AND packages_dependency_links.id >= $3
    ORDER BY packages_dependency_links.id ASC
    LIMIT $4
    OFFSET $5
    13 152.7 ms 19.5 ms 11.7 ms 1997
    INSERT INTO packages_dependencies (project_id, name, version_pattern)
    SELECT packages_dependency_links.project_id AS project_id, packages_dependencies.name AS name, packages_dependencies.version_pattern AS version_pattern
    FROM packages_dependency_links
    JOIN packages_dependencies ON packages_dependencies.id = packages_dependency_links.dependency_id
    WHERE packages_dependency_links.id BETWEEN $1 AND $2 AND packages_dependency_links.id >= $3 AND packages_dependencies.project_id <> packages_dependency_links.project_id ON CONFLICT DO NOTHING
    26 4.8 ms 1.1 ms 0.2 ms 26
    INSERT INTO batched_background_migration_job_transition_logs (batched_background_migration_job_id, created_at, updated_at, previous_status, next_status) VALUES ($1, $2, $3, $4, $5) RETURNING id
    13 1.7 ms 0.3 ms 0.1 ms 13
    UPDATE batched_background_migration_jobs
    SET updated_at = $1, finished_at = $2, status = $3, metrics = $4
    WHERE batched_background_migration_jobs.id = $5
    13 1.3 ms 0.2 ms 0.1 ms 13
    UPDATE batched_background_migration_jobs
    SET updated_at = $1, started_at = $2, status = $3, attempts = $4
    WHERE batched_background_migration_jobs.id = $5
    26 1.3 ms 0.1 ms 0.1 ms 26
    SELECT batched_background_migration_jobs.*
    FROM batched_background_migration_jobs
    WHERE batched_background_migration_jobs.id = $1
    LIMIT $2
    13 0.5 ms 0.1 ms 0.0 ms 13
    SELECT packages_dependency_links.id
    FROM packages_dependency_links
    WHERE packages_dependency_links.id BETWEEN $1 AND $2
    ORDER BY packages_dependency_links.id ASC
    LIMIT $3
    13 0.6 ms 0.1 ms 0.0 ms 13
    SELECT sum(batched_background_migration_jobs.batch_size)
    FROM batched_background_migration_jobs
    WHERE batched_background_migration_jobs.batched_background_migration_id = $1 AND batched_background_migration_jobs.status IN ($2)
    13 0.5 ms 0.1 ms 0.0 ms 13
    SELECT batched_background_migrations.*
    FROM batched_background_migrations
    WHERE batched_background_migrations.id = $1
    LIMIT $2
    Histogram of batch runtimes for BackfillPackagesDependenciesProjectId
    Batch Runtime Count
    0 seconds - 10 seconds 0
    10 seconds - 1 minute 13
    1 minute - 2 minutes 0
    2 minutes - 3 minutes 0
    3 minutes - 5 minutes 0
    5 minutes + 0
    Histogram across all sampled batches of BackfillPackagesDependenciesProjectId
    Query Runtime Count
    0 seconds - 0.1 seconds 308
    0.1 seconds - 0.5 seconds 102
    0.5 seconds - 1 second 156
    1 second - 2 seconds 70
    2 seconds - 5 seconds 1
    5 seconds + 0

    Background Migration: ResolveVulnerabilitiesForRemovedAnalyzers

    Sampled 6 batches. Estimated Time to complete: 2 weeks, 16 hours, and 38 minutes
    • Interval: 120s
    • Total tuple count: 105792416
    • Max batch size: 0
    • Estimated seconds to complete: 1269480s
    • Estimated number of batches: 10579
    • Average batch time: 53.73s
    • Batch size: 10000
    • N. of batches sampled: 6
    • N. of failed batches: 0

    Time estimation is conservative and based on sampling production data in a test environment. It represents the max time that migration could take. The actual time may differ from this estimation.

    _Consider changing max_batch_size and interval if this estimate is unacceptable._

    Calls Total Time Max Time Mean Time Rows Collapsed Query
    59 26194.4 ms 1438.6 ms 444.0 ms 4058 Yes
    UPDATE vulnerabilities
    SET state = $1, resolved_by_id = $2, resolved_at = now()
    WHERE vulnerabilities.id IN ($3)
    59 4521.6 ms 727.8 ms 76.6 ms 4058 Yes
    UPDATE vulnerability_reads
    SET dismissal_reason = $1
    WHERE vulnerability_reads.vulnerability_id IN ($2)
    59 16136.7 ms 720.1 ms 273.5 ms 4058 No
    INSERT INTO notes (note, noteable_type, author_id, created_at, updated_at, project_id, noteable_id, system, discussion_id, namespace_id) VALUES ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10), ($11, $12, $13, $14, $15, $16, $17, $18, $19, $20), ($21, $22, $23, $24, $25, $26, $27, $28, $29, $30), ($31, $32, $33, $34, $35, $36, $37, $38, $39, $40), ($41, $42, $43, $44, $45, $46, $47, $48, $49, $50), ($51, $52, $53, $54, $55, $56, $57, $58, $59, $60), ($61, $62, $63, $64, $65, $66, $67, $68, $69, $70), ($71, $72, $73, $74, $75, $76, $77, $78, $79, $80), ($81, $82, $83, $84, $85, $86, $87, $88, $89, $90), ($91, $92, $93, $94, $95, $96, $97, $98, $99, $100), ($101, $102, $103, $104, $105, $106, $107, $108, $109, $110), ($111, $112, $113, $114, $115, $116, $117, $118, $119, $120), ($121, $122, $123, $124, $125, $126, $127, $128, $129, $130), ($131, $132, $133, $134, $135, $136, $137, $138, $139, $140), ($141, $142, $143, $144, $145, $146, $147, $148, $149, $150), ($151, $152, $153, $154, $155, $156, $157, $158, $159, $160), ($161, $162, $163, $164, $165, $166, $167, $168, $169, $170), ($171, $172, $173, $174, $175, $176, $177, $178, $179, $180), ($181, $182, $183, $184, $185, $186, $187, $188, $189, $190), ($191, $192, $193, $194, $195, $196, $197, $198, $199, $200), ($201, $202, $203, $204, $205, $206, $207, $208, $209, $210), ($211, $212, $213, $214, $215, $216, $217, $218, $219, $220), ($221, $222, $223, $224, $225, $226, $227, $228, $229, $230), ($231, $232, $233, $234, $235, $236, $237, $238, $239, $240), ($241, $242, $243, $244, $245, $246, $247, $248, $249, $250), ($251, $252, $253, $254, $255, $256, $257, $258, $259, $260), ($261, $262, $263, $264, $265, $266, $267, $268, $269, $270), ($271, $272, $273, $274, $275, $276, $277, $278, $279, $280), ($281, $282, $283, $284, $285, $286, $287, $288, $289, $290), ($291, $292, $293, $294, $295, $296, $297, $298, $299, $300), ($301, $302, $303, $304, $305, $306, $307, $308, $309, $310), ($311, $312, $313, $314, $315, $316, $317, $318, $319, $320), ($321, $322, $323, $324, $325, $326, $327, $328, $329, $330), ($331, $332, $333, $334, $335, $336, $337, $338, $339, $340), ($341, $342, $343, $344, $345, $346, $347, $348, $349, $350), ($351, $352, $353, $354, $355, $356, $357, $358, $359, $360), ($361, $362, $363, $364, $365, $366, $367, $368, $369, $370), ($371, $372, $373, $374, $375, $376, $377, $378, $379, $380), ($381, $382, $383, $384, $385, $386, $387, $388, $389, $390), ($391, $392, $393, $394, $395, $396, $397, $398, $399, $400), ($401, $402, $403, $404, $405, $406, $407, $408, $409, $410), ($411, $412, $413, $414, $415, $416, $417, $418, $419, $420), ($421, $422, $423, $424, $425, $426, $427, $428, $429, $430), ($431, $432, $433, $434, $435, $436, $437, $438, $439, $440), ($441, $442, $443, $444, $445, $446, $447, $448, $449, $450), ($451, $452, $453, $454, $455, $456, $457, $458, $459, $460), ($461, $462, $463, $464, $465, $466, $467, $468, $469, $470), ($471, $472, $473, $474, $475, $476, $477, $478, $479, $480), ($481, $482, $483, $484, $485, $486, $487, $488, $489, $490), ($491, $492, $493, $494, $495, $496, $497, $498, $499, $500), ($501, $502, $503, $504, $505, $506, $507, $508, $509, $510), ($511, $512, $513, $514, $515, $516, $517, $518, $519, $520), ($521, $522, $523, $524, $525, $526, $527, $528, $529, $530), ($531, $532, $533, $534, $535, $536, $537, $538, $539, $540), ($541, $542, $543, $544, $545, $546, $547, $548, $549, $550), ($551, $552, $553, $554, $555, $556, $557, $558, $559, $560), ($561, $562, $563, $564, $565, $566, $567, $568, $569, $570), ($571, $572, $573, $574, $575, $576, $577, $578, $579, $580), ($581, $582, $583, $584, $585, $586, $587, $588, $589, $590), ($591, $592, $593, $594, $595, $596, $597, $598, $599, $600), ($601, $602, $603, $604, $605, $606, $607, $608, $609, $610), ($611, $612, $613, $614, $615, $616, $617, $618, $619, $620), ($621, $622, $623, $624, $625, $626, $627, $628, $629, $630), ($631, $632, $633, $634, $635, $636, $637, $638, $639, $640), ($641, $642, $643, $644, $645, $646, $647, $648, $649, $650), ($651, $652, $653, $654, $655, $656, $657, $658, $659, $660), ($661, $662, $663, $664, $665, $666, $667, $668, $669, $670), ($671, $672, $673, $674, $675, $676, $677, $678, $679, $680), ($681, $682, $683, $684, $685, $686, $687, $688, $689, $690), ($691, $692, $693, $694, $695, $696, $697, $698, $699, $700), ($701, $702, $703, $704, $705, $706, $707, $708, $709, $710), ($711, $712, $713, $714, $715, $716, $717, $718, $719, $720), ($721, $722, $723, $724, $725, $726, $727, $728, $729, $730), ($731, $732, $733, $734, $735, $736, $737, $738, $739, $740), ($741, $742, $743, $744, $745, $746, $747, $748, $749, $750), ($751, $752, $753, $754, $755, $756, $757, $758, $759, $760), ($761, $762, $763, $764, $765, $766, $767, $768, $769, $770), ($771, $772, $773, $774, $775, $776, $777, $778, $779, $780), ($781, $782, $783, $784, $785, $786, $787, $788, $789, $790), ($791, $792, $793, $794, $795, $796, $797, $798, $799, $800), ($801, $802, $803, $804, $805, $806, $807, $808, $809, $810), ($811, $812, $813, $814, $815, $816, $817, $818, $819, $820), ($821, $822, $823, $824, $825, $826, $827, $828, $829, $830), ($831, $832, $833, $834, $835, $836, $837, $838, $839, $840), ($841, $842, $843, $844, $845, $846, $847, $848, $849, $850), ($851, $852, $853, $854, $855, $856, $857, $858, $859, $860), ($861, $862, $863, $864, $865, $866, $867, $868, $869, $870), ($871, $872, $873, $874, $875, $876, $877, $878, $879, $880), ($881, $882, $883, $884, $885, $886, $887, $888, $889, $890), ($891, $892, $893, $894, $895, $896, $897, $898, $899, $900), ($901, $902, $903, $904, $905, $906, $907, $908, $909, $910), ($911, $912, $913, $914, $915, $916, $917, $918, $919, $920), ($921, $922, $923, $924, $925, $926, $927, $928, $929, $930), ($931, $932, $933, $934, $935, $936, $937, $938, $939, $940), ($941, $942, $943, $944, $945, $946, $947, $948, $949, $950), ($951, $952, $953, $954, $955, $956, $957, $958, $959, $960), ($961, $962, $963, $964, $965, $966, $967, $968, $969, $970), ($971, $972, $973, $974, $975, $976, $977, $978, $979, $980), ($981, $982, $983, $984, $985, $986, $987, $988, $989, $990), ($991, $992, $993, $994, $995, $996, $997, $998, $999, $1000) RETURNING id
    59 3224.4 ms 174.4 ms 54.7 ms 0 Yes
    DELETE
    FROM vulnerability_feedback
    WHERE feedback_type = $1 AND finding_uuid IN ($2)
    594 11026.0 ms 88.1 ms 18.6 ms 3958 Yes
    WITH batched_relation AS MATERIALIZED (
    SELECT vulnerability_reads.*
    FROM vulnerability_reads
    WHERE vulnerability_reads.id BETWEEN $1 AND $2 AND vulnerability_reads.state = $3 AND vulnerability_reads.id >= $4 AND vulnerability_reads.id < $5
    LIMIT $6
    )
    SELECT vulnerability_id, vulnerability_reads.project_id, namespace_id, severity, uuid
    FROM batched_relation vulnerability_reads
    JOIN vulnerability_scanners ON vulnerability_scanners.id = vulnerability_reads.scanner_id
    WHERE vulnerability_scanners.external_id IN ($7)
    59 464.7 ms 81.5 ms 7.9 ms 4058 No
    INSERT INTO vulnerability_state_transitions (vulnerability_id, from_state, to_state, created_at, updated_at, author_id, comment) VALUES ($1, $2, $3, $4, $5, $6, $7), ($8, $9, $10, $11, $12, $13, $14), ($15, $16, $17, $18, $19, $20, $21), ($22, $23, $24, $25, $26, $27, $28), ($29, $30, $31, $32, $33, $34, $35), ($36, $37, $38, $39, $40, $41, $42), ($43, $44, $45, $46, $47, $48, $49), ($50, $51, $52, $53, $54, $55, $56), ($57, $58, $59, $60, $61, $62, $63), ($64, $65, $66, $67, $68, $69, $70), ($71, $72, $73, $74, $75, $76, $77), ($78, $79, $80, $81, $82, $83, $84), ($85, $86, $87, $88, $89, $90, $91), ($92, $93, $94, $95, $96, $97, $98), ($99, $100, $101, $102, $103, $104, $105), ($106, $107, $108, $109, $110, $111, $112), ($113, $114, $115, $116, $117, $118, $119), ($120, $121, $122, $123, $124, $125, $126), ($127, $128, $129, $130, $131, $132, $133), ($134, $135, $136, $137, $138, $139, $140), ($141, $142, $143, $144, $145, $146, $147), ($148, $149, $150, $151, $152, $153, $154), ($155, $156, $157, $158, $159, $160, $161), ($162, $163, $164, $165, $166, $167, $168), ($169, $170, $171, $172, $173, $174, $175), ($176, $177, $178, $179, $180, $181, $182), ($183, $184, $185, $186, $187, $188, $189), ($190, $191, $192, $193, $194, $195, $196), ($197, $198, $199, $200, $201, $202, $203), ($204, $205, $206, $207, $208, $209, $210), ($211, $212, $213, $214, $215, $216, $217), ($218, $219, $220, $221, $222, $223, $224), ($225, $226, $227, $228, $229, $230, $231), ($232, $233, $234, $235, $236, $237, $238), ($239, $240, $241, $242, $243, $244, $245), ($246, $247, $248, $249, $250, $251, $252), ($253, $254, $255, $256, $257, $258, $259), ($260, $261, $262, $263, $264, $265, $266), ($267, $268, $269, $270, $271, $272, $273), ($274, $275, $276, $277, $278, $279, $280), ($281, $282, $283, $284, $285, $286, $287), ($288, $289, $290, $291, $292, $293, $294), ($295, $296, $297, $298, $299, $300, $301), ($302, $303, $304, $305, $306, $307, $308), ($309, $310, $311, $312, $313, $314, $315), ($316, $317, $318, $319, $320, $321, $322), ($323, $324, $325, $326, $327, $328, $329), ($330, $331, $332, $333, $334, $335, $336), ($337, $338, $339, $340, $341, $342, $343), ($344, $345, $346, $347, $348, $349, $350), ($351, $352, $353, $354, $355, $356, $357), ($358, $359, $360, $361, $362, $363, $364), ($365, $366, $367, $368, $369, $370, $371), ($372, $373, $374, $375, $376, $377, $378), ($379, $380, $381, $382, $383, $384, $385), ($386, $387, $388, $389, $390, $391, $392), ($393, $394, $395, $396, $397, $398, $399), ($400, $401, $402, $403, $404, $405, $406), ($407, $408, $409, $410, $411, $412, $413), ($414, $415, $416, $417, $418, $419, $420), ($421, $422, $423, $424, $425, $426, $427), ($428, $429, $430, $431, $432, $433, $434), ($435, $436, $437, $438, $439, $440, $441), ($442, $443, $444, $445, $446, $447, $448), ($449, $450, $451, $452, $453, $454, $455), ($456, $457, $458, $459, $460, $461, $462), ($463, $464, $465, $466, $467, $468, $469), ($470, $471, $472, $473, $474, $475, $476), ($477, $478, $479, $480, $481, $482, $483), ($484, $485, $486, $487, $488, $489, $490), ($491, $492, $493, $494, $495, $496, $497), ($498, $499, $500, $501, $502, $503, $504), ($505, $506, $507, $508, $509, $510, $511), ($512, $513, $514, $515, $516, $517, $518), ($519, $520, $521, $522, $523, $524, $525), ($526, $527, $528, $529, $530, $531, $532), ($533, $534, $535, $536, $537, $538, $539), ($540, $541, $542, $543, $544, $545, $546), ($547, $548, $549, $550, $551, $552, $553), ($554, $555, $556, $557, $558, $559, $560), ($561, $562, $563, $564, $565, $566, $567), ($568, $569, $570, $571, $572, $573, $574), ($575, $576, $577, $578, $579, $580, $581), ($582, $583, $584, $585, $586, $587, $588), ($589, $590, $591, $592, $593, $594, $595), ($596, $597, $598, $599, $600, $601, $602), ($603, $604, $605, $606, $607, $608, $609), ($610, $611, $612, $613, $614, $615, $616), ($617, $618, $619, $620, $621, $622, $623), ($624, $625, $626, $627, $628, $629, $630), ($631, $632, $633, $634, $635, $636, $637), ($638, $639, $640, $641, $642, $643, $644), ($645, $646, $647, $648, $649, $650, $651), ($652, $653, $654, $655, $656, $657, $658), ($659, $660, $661, $662, $663, $664, $665), ($666, $667, $668, $669, $670, $671, $672), ($673, $674, $675, $676, $677, $678, $679), ($680, $681, $682, $683, $684, $685, $686), ($687, $688, $689, $690, $691, $692, $693), ($694, $695, $696, $697, $698, $699, $700)
    6 111.3 ms 56.3 ms 18.6 ms 100 Yes
    WITH batched_relation AS MATERIALIZED (
    SELECT vulnerability_reads.*
    FROM vulnerability_reads
    WHERE vulnerability_reads.id BETWEEN $1 AND $2 AND vulnerability_reads.state = $3 AND vulnerability_reads.id >= $4
    LIMIT $5
    )
    SELECT vulnerability_id, vulnerability_reads.project_id, namespace_id, severity, uuid
    FROM batched_relation vulnerability_reads
    JOIN vulnerability_scanners ON vulnerability_scanners.id = vulnerability_reads.scanner_id
    WHERE vulnerability_scanners.external_id IN ($6)
    59 161.7 ms 47.0 ms 2.7 ms 4058 No
    INSERT INTO system_note_metadata (action, created_at, updated_at, note_id) VALUES ($1, $2, $3, $4), ($5, $6, $7, $8), ($9, $10, $11, $12), ($13, $14, $15, $16), ($17, $18, $19, $20), ($21, $22, $23, $24), ($25, $26, $27, $28), ($29, $30, $31, $32), ($33, $34, $35, $36), ($37, $38, $39, $40), ($41, $42, $43, $44), ($45, $46, $47, $48), ($49, $50, $51, $52), ($53, $54, $55, $56), ($57, $58, $59, $60), ($61, $62, $63, $64), ($65, $66, $67, $68), ($69, $70, $71, $72), ($73, $74, $75, $76), ($77, $78, $79, $80), ($81, $82, $83, $84), ($85, $86, $87, $88), ($89, $90, $91, $92), ($93, $94, $95, $96), ($97, $98, $99, $100), ($101, $102, $103, $104), ($105, $106, $107, $108), ($109, $110, $111, $112), ($113, $114, $115, $116), ($117, $118, $119, $120), ($121, $122, $123, $124), ($125, $126, $127, $128), ($129, $130, $131, $132), ($133, $134, $135, $136), ($137, $138, $139, $140), ($141, $142, $143, $144), ($145, $146, $147, $148), ($149, $150, $151, $152), ($153, $154, $155, $156), ($157, $158, $159, $160), ($161, $162, $163, $164), ($165, $166, $167, $168), ($169, $170, $171, $172), ($173, $174, $175, $176), ($177, $178, $179, $180), ($181, $182, $183, $184), ($185, $186, $187, $188), ($189, $190, $191, $192), ($193, $194, $195, $196), ($197, $198, $199, $200), ($201, $202, $203, $204), ($205, $206, $207, $208), ($209, $210, $211, $212), ($213, $214, $215, $216), ($217, $218, $219, $220), ($221, $222, $223, $224), ($225, $226, $227, $228), ($229, $230, $231, $232), ($233, $234, $235, $236), ($237, $238, $239, $240), ($241, $242, $243, $244), ($245, $246, $247, $248), ($249, $250, $251, $252), ($253, $254, $255, $256), ($257, $258, $259, $260), ($261, $262, $263, $264), ($265, $266, $267, $268), ($269, $270, $271, $272), ($273, $274, $275, $276), ($277, $278, $279, $280), ($281, $282, $283, $284), ($285, $286, $287, $288), ($289, $290, $291, $292), ($293, $294, $295, $296), ($297, $298, $299, $300), ($301, $302, $303, $304), ($305, $306, $307, $308), ($309, $310, $311, $312), ($313, $314, $315, $316), ($317, $318, $319, $320), ($321, $322, $323, $324), ($325, $326, $327, $328), ($329, $330, $331, $332), ($333, $334, $335, $336), ($337, $338, $339, $340), ($341, $342, $343, $344), ($345, $346, $347, $348)
    4 17.4 ms 13.1 ms 4.3 ms 4 No
    UPDATE vulnerability_statistics
    SET medium = GREATEST(medium - $1, $2), total = GREATEST(total - $3, $4), letter_grade =
    CASE WHEN (critical - $5) > $6 THEN $7 WHEN ((high + unknown) - ($8 + $9)) > $10 THEN $11 WHEN (medium - $12) > $13 THEN $14 WHEN (low - $15) > $16 THEN $17 ELSE $18 END, updated_at = now()
    WHERE project_id = $19
    15 24.7 ms 6.0 ms 1.6 ms 15 No
    UPDATE vulnerability_statistics
    SET critical = GREATEST(critical - $1, $2), total = GREATEST(total - $3, $4), letter_grade =
    CASE WHEN (critical - $5) > $6 THEN $7 WHEN ((high + unknown) - ($8 + $9)) > $10 THEN $11 WHEN (medium - $12) > $13 THEN $14 WHEN (low - $15) > $16 THEN $17 ELSE $18 END, updated_at = now()
    WHERE project_id = $19
    17 13.8 ms 5.7 ms 0.8 ms 17 No
    UPDATE vulnerability_statistics
    SET medium = GREATEST(medium - $1, $2), high = GREATEST(high - $3, $4), critical = GREATEST(critical - $5, $6), total = GREATEST(total - $7, $8), letter_grade =
    CASE WHEN (critical - $9) > $10 THEN $11 WHEN ((high + unknown) - ($12 + $13)) > $14 THEN $15 WHEN (medium - $16) > $17 THEN $18 WHEN (low - $19) > $20 THEN $21 ELSE $22 END, updated_at = now()
    WHERE project_id = $23
    6 5.7 ms 5.4 ms 0.9 ms 6 No
    SELECT users.*
    FROM users
    WHERE users.user_type = $1
    ORDER BY users.id ASC
    LIMIT $2
    7 12.4 ms 4.7 ms 1.8 ms 7 No
    UPDATE vulnerability_statistics
    SET high = GREATEST(high - $1, $2), total = GREATEST(total - $3, $4), letter_grade =
    CASE WHEN (critical - $5) > $6 THEN $7 WHEN ((high + unknown) - ($8 + $9)) > $10 THEN $11 WHEN (medium - $12) > $13 THEN $14 WHEN (low - $15) > $16 THEN $17 ELSE $18 END, updated_at = now()
    WHERE project_id = $19
    14 14.0 ms 4.7 ms 1.0 ms 14 No
    UPDATE vulnerability_statistics
    SET low = GREATEST(low - $1, $2), total = GREATEST(total - $3, $4), letter_grade =
    CASE WHEN (critical - $5) > $6 THEN $7 WHEN ((high + unknown) - ($8 + $9)) > $10 THEN $11 WHEN (medium - $12) > $13 THEN $14 WHEN (low - $15) > $16 THEN $17 ELSE $18 END, updated_at = now()
    WHERE project_id = $19
    1 4.3 ms 4.3 ms 4.3 ms 1 No
    UPDATE vulnerability_statistics
    SET medium = GREATEST(medium - $1, $2), high = GREATEST(high - $3, $4), total = GREATEST(total - $5, $6), letter_grade =
    CASE WHEN (critical - $7) > $8 THEN $9 WHEN ((high + unknown) - ($10 + $11)) > $12 THEN $13 WHEN (medium - $14) > $15 THEN $16 WHEN (low - $17) > $18 THEN $19 ELSE $20 END, updated_at = now()
    WHERE project_id = $21
    1 3.9 ms 3.9 ms 3.9 ms 1 No
    UPDATE vulnerability_statistics
    SET high = GREATEST(high - $1, $2), unknown = GREATEST(unknown - $3, $4), critical = GREATEST(critical - $5, $6), medium = GREATEST(medium - $7, $8), total = GREATEST(total - $9, $10), letter_grade =
    CASE WHEN (critical - $11) > $12 THEN $13 WHEN ((high + unknown) - ($14 + $15)) > $16 THEN $17 WHEN (medium - $18) > $19 THEN $20 WHEN (low - $21) > $22 THEN $23 ELSE $24 END, updated_at = now()
    WHERE project_id = $25
    1 1.6 ms 1.6 ms 1.6 ms 1 No
    UPDATE vulnerability_statistics
    SET unknown = GREATEST(unknown - $1, $2), total = GREATEST(total - $3, $4), letter_grade =
    CASE WHEN (critical - $5) > $6 THEN $7 WHEN ((high + unknown) - ($8 + $9)) > $10 THEN $11 WHEN (medium - $12) > $13 THEN $14 WHEN (low - $15) > $16 THEN $17 ELSE $18 END, updated_at = now()
    WHERE project_id = $19
    8 3.4 ms 1.6 ms 0.4 ms 8 No
    UPDATE vulnerability_statistics
    SET critical = GREATEST(critical - $1, $2), high = GREATEST(high - $3, $4), total = GREATEST(total - $5, $6), letter_grade =
    CASE WHEN (critical - $7) > $8 THEN $9 WHEN ((high + unknown) - ($10 + $11)) > $12 THEN $13 WHEN (medium - $14) > $15 THEN $16 WHEN (low - $17) > $18 THEN $19 ELSE $20 END, updated_at = now()
    WHERE project_id = $21
    8 3.3 ms 1.5 ms 0.4 ms 8 No
    UPDATE vulnerability_statistics
    SET critical = GREATEST(critical - $1, $2), medium = GREATEST(medium - $3, $4), total = GREATEST(total - $5, $6), letter_grade =
    CASE WHEN (critical - $7) > $8 THEN $9 WHEN ((high + unknown) - ($10 + $11)) > $12 THEN $13 WHEN (medium - $14) > $15 THEN $16 WHEN (low - $17) > $18 THEN $19 ELSE $20 END, updated_at = now()
    WHERE project_id = $21
    1 0.7 ms 0.7 ms 0.7 ms 1 No
    SELECT feature_gates.key, feature_gates.value
    FROM feature_gates
    WHERE feature_gates.feature_key = $1
    600 58.6 ms 0.5 ms 0.1 ms 594 No
    SELECT vulnerability_reads.id
    FROM vulnerability_reads
    WHERE vulnerability_reads.id BETWEEN $1 AND $2 AND vulnerability_reads.state = $3 AND vulnerability_reads.id >= $4
    ORDER BY vulnerability_reads.id ASC
    LIMIT $5
    OFFSET $6
    12 2.2 ms 0.5 ms 0.2 ms 12 No
    INSERT INTO batched_background_migration_job_transition_logs (batched_background_migration_job_id, created_at, updated_at, previous_status, next_status) VALUES ($1, $2, $3, $4, $5) RETURNING id
    6 1.1 ms 0.3 ms 0.2 ms 6 No
    UPDATE batched_background_migration_jobs
    SET updated_at = $1, finished_at = $2, status = $3, metrics = $4
    WHERE batched_background_migration_jobs.id = $5
    6 0.5 ms 0.1 ms 0.1 ms 6 No
    UPDATE batched_background_migration_jobs
    SET updated_at = $1, started_at = $2, status = $3, attempts = $4
    WHERE batched_background_migration_jobs.id = $5
    12 0.7 ms 0.1 ms 0.1 ms 12 No
    SELECT batched_background_migration_jobs.*
    FROM batched_background_migration_jobs
    WHERE batched_background_migration_jobs.id = $1
    LIMIT $2
    1 0.1 ms 0.1 ms 0.1 ms 1 No
    UPDATE vulnerability_statistics
    SET critical = GREATEST(critical - $1, $2), low = GREATEST(low - $3, $4), high = GREATEST(high - $5, $6), total = GREATEST(total - $7, $8), letter_grade =
    CASE WHEN (critical - $9) > $10 THEN $11 WHEN ((high + unknown) - ($12 + $13)) > $14 THEN $15 WHEN (medium - $16) > $17 THEN $18 WHEN (low - $19) > $20 THEN $21 ELSE $22 END, updated_at = now()
    WHERE project_id = $23
    1 0.1 ms 0.1 ms 0.1 ms 1 No
    UPDATE vulnerability_statistics
    SET medium = GREATEST(medium - $1, $2), low = GREATEST(low - $3, $4), total = GREATEST(total - $5, $6), letter_grade =
    CASE WHEN (critical - $7) > $8 THEN $9 WHEN ((high + unknown) - ($10 + $11)) > $12 THEN $13 WHEN (medium - $14) > $15 THEN $16 WHEN (low - $17) > $18 THEN $19 ELSE $20 END, updated_at = now()
    WHERE project_id = $21
    1 0.1 ms 0.1 ms 0.1 ms 1 No
    UPDATE vulnerability_statistics
    SET high = GREATEST(high - $1, $2), medium = GREATEST(medium - $3, $4), low = GREATEST(low - $5, $6), total = GREATEST(total - $7, $8), letter_grade =
    CASE WHEN (critical - $9) > $10 THEN $11 WHEN ((high + unknown) - ($12 + $13)) > $14 THEN $15 WHEN (medium - $16) > $17 THEN $18 WHEN (low - $19) > $20 THEN $21 ELSE $22 END, updated_at = now()
    WHERE project_id = $23
    1 0.1 ms 0.1 ms 0.1 ms 1 No
    UPDATE vulnerability_statistics
    SET critical = GREATEST(critical - $1, $2), unknown = GREATEST(unknown - $3, $4), medium = GREATEST(medium - $5, $6), total = GREATEST(total - $7, $8), letter_grade =
    CASE WHEN (critical - $9) > $10 THEN $11 WHEN ((high + unknown) - ($12 + $13)) > $14 THEN $15 WHEN (medium - $16) > $17 THEN $18 WHEN (low - $19) > $20 THEN $21 ELSE $22 END, updated_at = now()
    WHERE project_id = $23
    6 0.2 ms 0.1 ms 0.0 ms 6 No
    SELECT vulnerability_reads.id
    FROM vulnerability_reads
    WHERE vulnerability_reads.id BETWEEN $1 AND $2 AND vulnerability_reads.state = $3
    ORDER BY vulnerability_reads.id ASC
    LIMIT $4
    6 0.3 ms 0.1 ms 0.0 ms 6 No
    SELECT sum(batched_background_migration_jobs.batch_size)
    FROM batched_background_migration_jobs
    WHERE batched_background_migration_jobs.batched_background_migration_id = $1 AND batched_background_migration_jobs.status IN ($2)
    6 0.2 ms 0.0 ms 0.0 ms 6 No
    SELECT batched_background_migrations.*
    FROM batched_background_migrations
    WHERE batched_background_migrations.id = $1
    LIMIT $2
    Histogram of batch runtimes for ResolveVulnerabilitiesForRemovedAnalyzers
    Batch Runtime Count
    0 seconds - 10 seconds 0
    10 seconds - 1 minute 4
    1 minute - 2 minutes 2
    2 minutes - 3 minutes 0
    3 minutes - 5 minutes 0
    5 minutes + 0
    Histogram across all sampled batches of ResolveVulnerabilitiesForRemovedAnalyzers
    Query Runtime Count
    0 seconds - 0.1 seconds 384
    0.1 seconds - 0.5 seconds 1266
    0.5 seconds - 1 second 40
    1 second - 2 seconds 5
    2 seconds - 5 seconds 0
    5 seconds + 0

    Background Migration: BackfillProtectedEnvironmentDeployAccessLevelsProtectedEnvironmentProjectId

    Sampled 26 batches. Estimated Time to complete: 10 hours and 56 minutes
    • Interval: 120s
    • Total tuple count: 328408
    • Max batch size: 0
    • Estimated seconds to complete: 39360s
    • Estimated number of batches: 328
    • Average batch time: 5.35s
    • Batch size: 1000
    • N. of batches sampled: 26
    • N. of failed batches: 0

    Time estimation is conservative and based on sampling production data in a test environment. It represents the max time that migration could take. The actual time may differ from this estimation.

    _Consider changing max_batch_size and interval if this estimate is unacceptable._

    Calls Total Time Max Time Mean Time Rows Query
    234 12083.7 ms 248.9 ms 51.6 ms 23400
    UPDATE protected_environment_deploy_access_levels
    SET protected_environment_project_id = protected_environments.project_id
    FROM protected_environments
    WHERE protected_environments.id = protected_environment_deploy_access_levels.protected_environment_id AND protected_environment_deploy_access_levels.id IN (
    SELECT protected_environment_deploy_access_levels.id
    FROM protected_environment_deploy_access_levels
    WHERE protected_environment_deploy_access_levels.id BETWEEN $1 AND $2 AND protected_environment_deploy_access_levels.protected_environment_project_id IS NULL AND protected_environment_deploy_access_levels.id >= $3 AND protected_environment_deploy_access_levels.id < $4
    )
    26 1145.8 ms 163.0 ms 44.1 ms 2600
    UPDATE protected_environment_deploy_access_levels
    SET protected_environment_project_id = protected_environments.project_id
    FROM protected_environments
    WHERE protected_environments.id = protected_environment_deploy_access_levels.protected_environment_id AND protected_environment_deploy_access_levels.id IN (
    SELECT protected_environment_deploy_access_levels.id
    FROM protected_environment_deploy_access_levels
    WHERE protected_environment_deploy_access_levels.id BETWEEN $1 AND $2 AND protected_environment_deploy_access_levels.protected_environment_project_id IS NULL AND protected_environment_deploy_access_levels.id >= $3
    )
    260 71.9 ms 8.8 ms 0.3 ms 234
    SELECT protected_environment_deploy_access_levels.id
    FROM protected_environment_deploy_access_levels
    WHERE protected_environment_deploy_access_levels.id BETWEEN $1 AND $2 AND protected_environment_deploy_access_levels.protected_environment_project_id IS NULL AND protected_environment_deploy_access_levels.id >= $3
    ORDER BY protected_environment_deploy_access_levels.id ASC
    LIMIT $4
    OFFSET $5
    26 5.0 ms 2.1 ms 0.2 ms 26
    UPDATE batched_background_migration_jobs
    SET updated_at = $1, started_at = $2, status = $3, attempts = $4
    WHERE batched_background_migration_jobs.id = $5
    52 9.0 ms 0.5 ms 0.2 ms 52
    INSERT INTO batched_background_migration_job_transition_logs (batched_background_migration_job_id, created_at, updated_at, previous_status, next_status) VALUES ($1, $2, $3, $4, $5) RETURNING id
    26 3.1 ms 0.3 ms 0.1 ms 26
    UPDATE batched_background_migration_jobs
    SET updated_at = $1, finished_at = $2, status = $3, metrics = $4
    WHERE batched_background_migration_jobs.id = $5
    26 1.5 ms 0.2 ms 0.1 ms 26
    SELECT sum(batched_background_migration_jobs.batch_size)
    FROM batched_background_migration_jobs
    WHERE batched_background_migration_jobs.batched_background_migration_id = $1 AND batched_background_migration_jobs.status IN ($2)
    52 2.7 ms 0.1 ms 0.1 ms 52
    SELECT batched_background_migration_jobs.*
    FROM batched_background_migration_jobs
    WHERE batched_background_migration_jobs.id = $1
    LIMIT $2
    26 1.0 ms 0.1 ms 0.0 ms 26
    SELECT protected_environment_deploy_access_levels.id
    FROM protected_environment_deploy_access_levels
    WHERE protected_environment_deploy_access_levels.id BETWEEN $1 AND $2 AND protected_environment_deploy_access_levels.protected_environment_project_id IS NULL
    ORDER BY protected_environment_deploy_access_levels.id ASC
    LIMIT $3
    26 1.2 ms 0.1 ms 0.0 ms 26
    SELECT batched_background_migrations.*
    FROM batched_background_migrations
    WHERE batched_background_migrations.id = $1
    LIMIT $2
    Histogram of batch runtimes for BackfillProtectedEnvironmentDeployAccessLevelsProtectedEnvironmentProjectId
    Batch Runtime Count
    0 seconds - 10 seconds 26
    10 seconds - 1 minute 0
    1 minute - 2 minutes 0
    2 minutes - 3 minutes 0
    3 minutes - 5 minutes 0
    5 minutes + 0
    Histogram across all sampled batches of BackfillProtectedEnvironmentDeployAccessLevelsProtectedEnvironmentProjectId
    Query Runtime Count
    0 seconds - 0.1 seconds 127
    0.1 seconds - 0.5 seconds 627
    0.5 seconds - 1 second 0
    1 second - 2 seconds 0
    2 seconds - 5 seconds 0
    5 seconds + 0

    Other information

    Other migrations pending on GitLab.com
    Migration Type Total runtime Result DB size change
    20240716185821 - RemoveUseWebIdeExtensionMarketplaceColumn Post deploy 4.2 s :white_check_mark: +0.00 B
    20240730225317 - RemoveProjectsVulnerabilityScannersProjectIdFk Post deploy 4.9 s :white_check_mark: +0.00 B
    20240812144054 - RemoveProjectsVulnerabilityFindingEvidencesProjectIdFk Post deploy 4.8 s :white_check_mark: +0.00 B
    20240812175326 - QueueBackfillPackagesDependenciesProjectId Post deploy 5.2 s :white_check_mark: +0.00 B
    20240813202721 - ValidateCiPipelineProjectIdNullConstraint Post deploy 4.5 s :white_check_mark: +0.00 B
    20240814085540 - RequeueResolveVulnerabilitiesForRemovedAnalyzers Post deploy 7.5 s :warning: +0.00 B
    20240814104151 - IndexProtectedEnvironmentApprovalRulesOnProtectedEnvironmentProjectId Post deploy 5.4 s :white_check_mark: +288.00 KiB
    20240814104152 - AddProtectedEnvironmentApprovalRulesProtectedEnvironmentProjectIdFk Post deploy 5.1 s :white_check_mark: +0.00 B
    20240814104153 - AddProtectedEnvironmentApprovalRulesProtectedEnvironmentProjectIdTrigger Post deploy 4.4 s :white_check_mark: +8.00 KiB [note]
    20240814104154 - QueueBackfillProtectedEnvApprovalRulesProtectedEnvProjectId Post deploy 4.8 s :white_check_mark: +0.00 B
    20240814104156 - IndexProtectedEnvironmentApprovalRulesOnProtectedEnvironmentGroupId Post deploy 5.2 s :white_check_mark: +288.00 KiB
    20240814104157 - AddProtectedEnvironmentApprovalRulesProtectedEnvironmentGroupIdFk Post deploy 5.1 s :white_check_mark: +0.00 B
    20240814104158 - AddProtectedEnvironmentApprovalRulesProtectedEnvironmentGroupIdTrigger Post deploy 4.4 s :white_check_mark: +0.00 B
    20240814104159 - QueueBackfillProtectedEnvApprovalRulesProtectedEnvGroupId Post deploy 4.8 s :white_check_mark: +0.00 B
    20240815083835 - IndexProtectedEnvDeployAccessLevelsOnProtectedEnvProjectId Post deploy 6.2 s :white_check_mark: +2.20 MiB
    20240815083836 - AddProtectedEnvironmentDeployAccessLevelsProtectedEnvironmentProjectIdFk Post deploy 5.2 s :white_check_mark: +0.00 B
    20240815083837 - AddProtectedEnvDeployAccessLevelsProtectedEnvProjectIdTrigger Post deploy 4.5 s :white_check_mark: +0.00 B
    20240815083838 - QueueBackfillProtectedEnvDeployAccessLevelsProtectedEnvProjectId Post deploy 4.8 s :white_check_mark: +0.00 B
    20240815083840 - IndexProtectedEnvironmentDeployAccessLevelsOnProtectedEnvironmentGroupId Post deploy 5.3 s :white_check_mark: +2.20 MiB
    20240815083841 - AddProtectedEnvironmentDeployAccessLevelsProtectedEnvironmentGroupIdFk Post deploy 5.0 s :white_check_mark: +0.00 B
    20240815083842 - AddProtectedEnvDeployAccessLevelsProtectedEnvGroupIdTrigger Post deploy 4.4 s :white_check_mark: +0.00 B
    20240815083843 - QueueBackfillProtectedEnvDeployAccessLevelsProtectedEnvGroupId Post deploy 4.8 s :white_check_mark: +0.00 B
    Clone details
    Clone ID Clone Created At Clone Data Timestamp Expected Removal Time
    database-testing-3618188-15054586-main 2024-08-19T08:54:34Z 2024-08-19T08:09:58Z 2024-08-19 21:31:14 +0000
    database-testing-3618188-15054586-ci 2024-08-19T08:54:34Z 2024-08-19T08:44:54Z 2024-08-19 21:31:14 +0000

    Job artifacts

    Database migrations (on the ci database)

    Migrations included in this change have been executed on gitlab.com data for testing purposes. For details, please see the migration testing pipeline (limited access).

    Migration Type Total runtime Result DB size change
    20240725223931 - CreateClusterAgentUrlConfigurations Regular 7.7 s :white_check_mark: +48.00 KiB
    20240725224013 - AddClusterAgentUrlConfigurationsFks Regular 9.6 s :white_check_mark: +0.00 B
    20240813074143 - AddIsReceptiveColumnToClusterAgents Regular 6.3 s :white_check_mark: +0.00 B
    Runtime Histogram for all migrations
    Query Runtime Count
    0 seconds - 0.01 seconds 0
    0.01 seconds - 0.1 seconds 8
    0.1 seconds - 1 second 23
    1 second - 5 seconds 0
    5 seconds - 15 seconds 0
    15 seconds - 5 minutes 0
    5 minutes + 0

    Migration: 20240725223931 - CreateClusterAgentUrlConfigurations

    • Type: Regular
    • Duration: 7.7 s
    • Database size change: +48.00 KiB
    Calls Total Time Max Time Mean Time Rows Query
    1 14.1 ms 14.1 ms 14.1 ms 0
    CREATE TABLE "cluster_agent_url_configurations" ("id" bigserial primary key, "created_at" timestamptz NOT NULL, "updated_at" timestamptz NOT NULL, "agent_id" bigint NOT NULL, "project_id" bigint NOT NULL, "created_by_user_id" bigint, "status" smallint DEFAULT 0 NOT NULL, "url" text NOT NULL, "ca_cert" text, "client_key" text, "client_cert" text, "tls_host" text, "public_key" bytea, "encrypted_private_key" bytea, "encrypted_private_key_iv" bytea, CONSTRAINT check_ed21ced327 CHECK (char_length("url") <= 2048), CONSTRAINT check_25ef8c679c CHECK (char_length("ca_cert") <= 16384), CONSTRAINT check_e3736d97df CHECK (char_length("client_key") <= 16384), CONSTRAINT check_93a57284e5 CHECK (char_length("client_cert") <= 16384), CONSTRAINT check_1ffcfef6d6 CHECK (char_length("tls_host") <= 2048))
    1 1.9 ms 1.9 ms 1.9 ms 0
    CREATE INDEX "index_cluster_agent_url_configurations_on_project_id" ON "cluster_agent_url_configurations" ("project_id")
    1 1.9 ms 1.9 ms 1.9 ms 0
    CREATE INDEX "index_cluster_agent_url_configurations_on_agent_id" ON "cluster_agent_url_configurations" ("agent_id")
    1 1.7 ms 1.7 ms 1.7 ms 0
    CREATE INDEX "index_cluster_agent_url_configurations_on_user_id" ON "cluster_agent_url_configurations" ("created_by_user_id")
    WHERE created_by_user_id IS NOT NULL
    1 1.1 ms 1.1 ms 1.1 ms 0
    CREATE TRIGGER gitlab_schema_write_trigger_for_cluster_agent_url_configurations BEFORE INSERT OR
    UPDATE OR DELETE OR TRUNCATE ON cluster_agent_url_configurations FOR EACH STATEMENT EXECUTE FUNCTION gitlab_schema_prevent_write()
    1 0.1 ms 0.1 ms 0.1 ms 1
    SELECT COUNT(*) from information_schema.triggers
    WHERE event_object_table = $1 AND trigger_name = $2
    1 0.0 ms 0.0 ms 0.0 ms 1
    SELECT table_name
    FROM information_schema.tables
    WHERE table_name = $1 AND table_schema = current_schema()
    2 0.0 ms 0.0 ms 0.0 ms 2
    SELECT pg_backend_pid()
    1 0.0 ms 0.0 ms 0.0 ms 1
    SELECT $1::regtype::oid
    Histogram for CreateClusterAgentUrlConfigurations
    Query Runtime Count
    0 seconds - 0.01 seconds 0
    0.01 seconds - 0.1 seconds 3
    0.1 seconds - 1 second 7
    1 second - 5 seconds 0
    5 seconds - 15 seconds 0
    15 seconds - 5 minutes 0
    5 minutes + 0

    Migration: 20240725224013 - AddClusterAgentUrlConfigurationsFks

    • Type: Regular
    • Duration: 9.6 s
    • Database size change: +0.00 B
    Calls Total Time Max Time Mean Time Rows Query
    1 10.5 ms 10.5 ms 10.5 ms 0
    ALTER TABLE cluster_agent_url_configurations VALIDATE CONSTRAINT fk_12d4a33b65
    1 8.7 ms 8.7 ms 8.7 ms 0
    ALTER TABLE cluster_agent_url_configurations ADD CONSTRAINT fk_02c2a4f060 FOREIGN KEY (agent_id) REFERENCES cluster_agents (id) ON DELETE CASCADE NOT VALID
    1 5.5 ms 5.5 ms 5.5 ms 0
    ALTER TABLE cluster_agent_url_configurations VALIDATE CONSTRAINT fk_49b126e246
    1 4.0 ms 4.0 ms 4.0 ms 0
    ALTER TABLE cluster_agent_url_configurations ADD CONSTRAINT fk_49b126e246 FOREIGN KEY (project_id) REFERENCES projects (id) ON DELETE CASCADE NOT VALID
    1 3.1 ms 3.1 ms 3.1 ms 0
    ALTER TABLE cluster_agent_url_configurations ADD CONSTRAINT fk_12d4a33b65 FOREIGN KEY (created_by_user_id) REFERENCES users (id) ON DELETE
    SET NULL NOT VALID
    1 1.8 ms 1.8 ms 1.8 ms 0
    ALTER TABLE cluster_agent_url_configurations VALIDATE CONSTRAINT fk_02c2a4f060
    6 1.3 ms 0.3 ms 0.2 ms 0
    SELECT "postgres_partitioned_tables".*
    FROM "postgres_partitioned_tables" WHERE (identifier = concat(current_schema(), $1, $2))
    LIMIT $3
    3 0.2 ms 0.1 ms 0.1 ms 0
    SELECT $1 AS one
    FROM "postgres_foreign_keys" WHERE "postgres_foreign_keys"."constrained_table_name" = $2 AND "postgres_foreign_keys"."referenced_table_name" = $3 AND "postgres_foreign_keys"."name" = $4 AND "postgres_foreign_keys"."constrained_columns" = $5 AND "postgres_foreign_keys"."referenced_columns" = $6 AND "postgres_foreign_keys"."on_delete_action" = $7
    LIMIT $8
    2 0.0 ms 0.0 ms 0.0 ms 2
    SELECT pg_backend_pid()
    Histogram for AddClusterAgentUrlConfigurationsFks
    Query Runtime Count
    0 seconds - 0.01 seconds 0
    0.01 seconds - 0.1 seconds 2
    0.1 seconds - 1 second 15
    1 second - 5 seconds 0
    5 seconds - 15 seconds 0
    15 seconds - 5 minutes 0
    5 minutes + 0

    Migration: 20240813074143 - AddIsReceptiveColumnToClusterAgents

    • Type: Regular
    • Duration: 6.3 s
    • Database size change: +0.00 B
    Calls Total Time Max Time Mean Time Rows Query
    1 1.4 ms 1.4 ms 1.4 ms 0
    ALTER TABLE "cluster_agents" ADD "is_receptive" bool DEFAULT FALSE NOT NULL
    1 0.0 ms 0.0 ms 0.0 ms 1
    SELECT $1::regtype::oid
    2 0.0 ms 0.0 ms 0.0 ms 2
    SELECT pg_backend_pid()
    Histogram for AddIsReceptiveColumnToClusterAgents
    Query Runtime Count
    0 seconds - 0.01 seconds 0
    0.01 seconds - 0.1 seconds 3
    0.1 seconds - 1 second 1
    1 second - 5 seconds 0
    5 seconds - 15 seconds 0
    15 seconds - 5 minutes 0
    5 minutes + 0

    Other information

    Other migrations pending on GitLab.com
    Migration Type Total runtime Result DB size change
    20240716185821 - RemoveUseWebIdeExtensionMarketplaceColumn Post deploy 6.3 s :white_check_mark: +0.00 B
    20240812144054 - RemoveProjectsVulnerabilityFindingEvidencesProjectIdFk Post deploy 6.9 s :white_check_mark: +0.00 B
    Clone details
    Clone ID Clone Created At Clone Data Timestamp Expected Removal Time
    database-testing-3618188-15054586-main 2024-08-19T08:54:34Z 2024-08-19T08:09:58Z 2024-08-19 21:31:14 +0000
    database-testing-3618188-15054586-ci 2024-08-19T08:54:34Z 2024-08-19T08:44:54Z 2024-08-19 21:31:14 +0000

    Job artifacts


    Brought to you by gitlab-org/database-team/gitlab-com-database-testing. Epic

    Edited by ****
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Please register or sign in to reply
    Loading