stucking jobs
We have trouble with some jobs - they stuck an fill up the queue. We have nearly 8000 jobs in our sidekiq queue
stucking jobs:
Warteschlange Größe Latency Aktionen
cronjob:ci_archive_traces_cron 15 52,220.85 (vor 14 Stunden)
cronjob:expire_build_artifacts 15 53,840.02 (vor 14 Stunden)
cronjob:geo_sidekiq_cron_config 3,166 190,098.19 (vor 2 Tagen)
cronjob:import_export_project_cleanup 18 67,648.42 (vor 18 Stunden)
cronjob:ldap_all_groups_sync 13 49,630.77 (vor 13 Stunden)
cronjob:pages_domain_verification_cron 173 155,862.71 (vor 1 Tag)
cronjob:pipeline_schedule 24 83,195.92 (vor 23 Stunden)
cronjob:prune_web_hook_logs 11 42,448.32 (vor 11 Stunden)
cronjob:repository_archive_cache 21 78,460.51 (vor 21 Stunden)
cronjob:repository_check_dispatch 17 59,240.54 (vor 16 Stunden)
cronjob:schedule_migrate_external_diffs 23 81,143.66 (vor 22 Stunden)
cronjob:stuck_import_jobs 8 27,135.46 (vor 7 Stunden)
cronjob:stuck_merge_jobs 1 6,445.12 (vor 1 Stunde)
cronjob:update_all_mirrors 3,175 190,642.64 (vor 2 Tagen)
merge 1 4,679.93 (vor 1 Stunde)
pipeline_background:archive_trace 75 13,506.33 (vor 3 Stunden)
pipeline_cache:expire_job_cache 272 13,520.95 (vor 3 Stunden)
pipeline_cache:expire_pipeline_cache 33 12,762.6 (vor 3 Stunden)
pipeline_hooks:build_hooks 329 13,544.56 (vor 3 Stunden)
pipeline_hooks:pipeline_hooks 59 13,446.26 (vor 3 Stunden)
pipeline_processing:pipeline_process 28 8,755.41 (vor 2 Stunden)
pipeline_processing:pipeline_update 11 8,732.15 (vor 2 Stunden)
pipeline_processing:stage_update 211 13,488.51 (vor 3 Stunden)
project_cache 14 13,524.68 (vor 3 Stunden)
project_daily_statistics 54 13,329.45 (vor 3 Stunden)
reactive_caching 7 8,265.95 (vor 2 Stunden)
rebase 158 175,677.91 (vor 2 Tagen)
update_project_statistics 7 7,869.8 (vor 2 Stunden) 
Here is a screenshot from background jobs - i have allready increased the sidkiq worker, but they are all busy.
Errors in production log.
production.log:Creating scope :failed. Overwriting existing method Ci::Stage.failed.
production.log:Creating scope :failed. Overwriting existing method Geo::FileRegistry.failed.
and that the rebase fails shows up but I can't find anything else.
gitlab-rake gitlab:check - no errors
Best Regards, Nicole!