1. 15 Sep, 2022 1 commit
  2. 14 Sep, 2022 3 commits
    • Stan Hu's avatar
      Move Google IP fetch into a separate service with rate limiting · 0535ff53
      Stan Hu authored
      Previously the initial merge request in the Google CDN code
      !96336 would
      fetch the list of Google IPs within the same thread as the process
      that attempts to serve out a Google CDN-frontend URL. However, there
      are several issues with this:
      
      1. If the HTTP endpoint is slow or down for some reason, this will
      delay the response handling.
      
      2. There is no throttling to prevent excessive requests to this
      endpoint.
      
      To improve the reliability, we move the fetching of this URL to a
      background Sidekiq job that has an application rate limit to prevent
      too many requests. The initial limit is 10 requests in a minute, which
      should should be adequate since we only need one worker to populate
      the cache for a whole day.
      
      Relates to #373115
      
      Changelog: changed
      0535ff53
    • Robert May's avatar
      Close issues in the background from commits · 611eec55
      Robert May authored and Peter Leitzen's avatar Peter Leitzen committed
      Adds a new worker to shift the closure of issues
      out of the ProcessCommitWorker to help improve memory
      consumption of that worker.
      611eec55
    • Rostyslav Safonov's avatar
      Preserve branch protection status during GitHub import · 833a49f8
      Rostyslav Safonov authored and George Koltsov's avatar George Koltsov committed
      Details: #22650
      833a49f8
  3. 09 Sep, 2022 1 commit
  4. 02 Sep, 2022 1 commit
    • Dmytro Biryukov's avatar
      Introduce Usage ping for artifacts:reports:junit · 9a53af6f
      Dmytro Biryukov authored and Albert Salim's avatar Albert Salim committed
      Count on pipeline/user scope, apply counter after commit, skip counter if no junit presented
      Generate metric definition for junit report artifacts
      Define event as option on metric definition
      Update sidekiq worker definitions for Ci::TrackFailedBuildWorker
      Use unified has_report? method on pipeline
      Move clean_gitlab_redis_shared_state to the root level of spec
      Test track_event calls
      Make sure if the worker is being called after pipeline completion
      Add rspec for multiple pipelines
      Test complex scenario, when pipeline retried from failed fo success
      9a53af6f
  5. 30 Aug, 2022 1 commit
  6. 25 Aug, 2022 1 commit
    • Jessie Young's avatar
      Update 2FA requirements async for group members · 1aa065f1
      Jessie Young authored and Huzaifa Iftikhar's avatar Huzaifa Iftikhar committed
      * Bugfix for "500 error received (timeout) when disabling 2FA
        enforcement in group settings"
      * This error was occurring for groups with many members because the
        updates were happening synchronously and the request was timing out.
      
      Changelog: fixed
      1aa065f1
  7. 15 Aug, 2022 1 commit
    • James Liu's avatar
      Track CI build failures with Snowplow · 79409441
      James Liu authored
      Adds a Sidekiq worker and service that are invoked when a build
      is dropped due to a failure. The worker collects build information
      and sends a Snowplow tracking event.
      
      Changelog: added
      79409441
  8. 10 Aug, 2022 2 commits
    • Max Orefice's avatar
      Remove legacy workers · 0581c175
      Max Orefice authored and George Koltsov's avatar George Koltsov committed
      0581c175
    • Patrick Bajao's avatar
      Implement more subscribers for MR approved event · f3880b52
      Patrick Bajao authored
      This is part of the effort to reduce the SQL queries executed by
      the `MergeRequests::ApprovalService`. This creates the following
      subscribers to `MergeRequests::ApprovedEvent`:
      - `CreateApprovalNoteWorker`
      - `ResolveTodosAfterApprovalWorker`
      - `ExecuteApprovalHooksWorker`
      
      This is behind `async_after_approval` feature flag.
      f3880b52
  9. 05 Aug, 2022 1 commit
  10. 01 Aug, 2022 2 commits
    • Patrick Bajao's avatar
      Execute side effects of merge request approval async · 487f732e
      Patrick Bajao authored and Marc Shaw's avatar Marc Shaw committed
      Before this, `MergeRequests::ApprovalService` will execute a
      lot of SQL queries. When called with other services in a single
      web request, that can lead 100+ SQL queries in a single queries.
      That exceeds our query limit of 100.
      
      This moves the side effects of approvals to be performed async
      via Sidekiq. As a result, this reduces the number of SQL queries
      executed in the service since it's offloaded to Sidekiq.
      
      `Gitlab::EventStore` is utilized to make it easier in the
      future to add side effects and opens the possiblity to refactor
      the `MergeRequests::AfterApprovalWorker` to be split into smaller
      subscribers.
      
      This is behind `async_after_approval` feature flag.
      487f732e
    • Quang-Minh Nguyen's avatar
  11. 25 Jul, 2022 1 commit
  12. 21 Jul, 2022 1 commit
  13. 18 Jul, 2022 1 commit
  14. 12 Jul, 2022 1 commit
  15. 11 Jul, 2022 1 commit
    • Sri's avatar
      CloudSQL Instance Worker · 6875a3bb
      Sri authored
      This commit introduces the `CreateCloudsqlInstanceWorker`.
      
      Creating Cloud SQL instances is an async operation that
      takes a few minutes to conclude.
      
      Thus the Google Cloud API needs to be watched for operation
      result and on success an app database and app user must be
      created for the new instance.
      
      Worker performs these tasks. Methods added to the Google Cloud
      Client to support `get_instance`, `insert_database` and
      `insert_user` operations.
      
      `SetupCloudsqlInstanceService` that's invoked from
      `CreateCloudsqlInstanceWorker` performs this function.
      6875a3bb
  16. 09 Jul, 2022 1 commit
    • Anshul Riyal's avatar
      Remove PagesTransferWorker · 25fbbc55
      Anshul Riyal authored
      Note: This should be done 1 release later than actual all calls to these
      workers are removed, so it should be done in 15.1
      
      See merge request !87395
      25fbbc55
  17. 06 Jul, 2022 1 commit
  18. 30 Jun, 2022 1 commit
  19. 22 Jun, 2022 1 commit
  20. 21 Jun, 2022 1 commit
  21. 17 Jun, 2022 1 commit
  22. 16 Jun, 2022 1 commit
  23. 13 Jun, 2022 1 commit
  24. 09 Jun, 2022 1 commit
  25. 08 Jun, 2022 2 commits
  26. 02 Jun, 2022 3 commits
    • Tiger Watson's avatar
      Clean up Terraform state files on deletion · c6b66ef7
      Tiger Watson authored and João Alexandre Cunha's avatar João Alexandre Cunha committed
      Previously, deleting a Terraform state did not remove the
      files stored in object storage. Before deleting the state
      itself, each state version must be removed individually.
      
      A Terraform state may have many previous versions associated
      with it, so instead of deleting immediately we must schedule
      a worker to handle removing files from object storage.
      
      Once a state is marked for deletion it can no longer be
      accessed using the REST API, to prevent subsequent Terraform
      operations from modifying it.
      
      Changelog: fixed
      c6b66ef7
    • Markus Koller's avatar
      Rename ProjectServiceWorker to Integrations::ExecuteWorker · 2c88a7fb
      Markus Koller authored and Sean McGivern's avatar Sean McGivern committed
      This is part of our rename from "services" to "integrations".
      
      We also rename the Sidekiq queue in a post-deployment migration.
      
      Changelog: changed
      2c88a7fb
    • Alex Kalderimis's avatar
      Always destroy webhooks synchronously · ab64c349
      Alex Kalderimis authored
      Previously we fell-back to asynchronous batch deletion if there were
      many logs, but we no longer need to do that now that we do not have a
      foreign key preventing deletion.
      
      Now we can delete the hook in all cases, and then start a background
      worker to delete the logs. This is actually unnecessary, since they will
      be truncated over time anyway, but it is nice to minimize table bloat.
      
      Changelog: fixed
      ab64c349
  27. 31 May, 2022 1 commit
  28. 24 May, 2022 1 commit
  29. 23 May, 2022 2 commits
  30. 22 May, 2022 2 commits
  31. 16 May, 2022 1 commit
    • Max Orefice's avatar
      Remove unused artifact worker · 2166d684
      Max Orefice authored
      This commit removes a worker used to remove artifacts for
      a given job. Prefer using ExpireBuildArtifactsWorker which
      is more performant.
      2166d684