Skip to content

Make sidekiq-cluster --dryrun emit the literal commands

Sean McGivern requested to merge sidekiq-cluster-dryrun-emit-command into master

This is useful if you want to expand queues using the query selector, but don't want to actually start the process (perhaps because you have your own process supervisor).

Example:

$ bin/sidekiq-cluster --dryrun --experimental-queue-selector 'name=merge' 'name=merge'
bundle exec sidekiq -c2 -edevelopment -gqueues:merge -r/Users/seanmcgivern/Code/gdk/gitlab -qmerge,1
bundle exec sidekiq -c2 -edevelopment -gqueues:merge -r/Users/seanmcgivern/Code/gdk/gitlab -qmerge,1
$ bin/sidekiq-cluster --dryrun --experimental-queue-selector '*'
bundle exec sidekiq -c50 -edevelopment -gqueues:auto_devops:auto_devops_disable,auto_merge:auto_merge_process,chaos:chaos_cpu_spin,chaos:chaos_db_spin,chaos:chaos_kill,chaos:chaos_leak_mem,chaos:chaos_sleep,container_repository:cleanup_container_repository,container_repository:delete_container_repository,cronjob:admin_email,cronjob:ci_archive_traces_cron,cronjob:container_expiration_policy,cronjob:environments_auto_stop_cron,cronjob:expire_build_artifacts,cronjob:gitlab_usage_ping,cronjob:import_export_project_cleanup,cronjob:issue_due_scheduler,cronjob:namespaces_prune_aggregation_schedules,cronjob:pages_domain_removal_cron,cronjob:pages_domain_ssl_renewal_cron,cronjob:pages_domain_verification_cron,cronjob:personal_access_tokens_expiring,cronjob:pipeline_schedule,cronjob:prune_old_events,cronjob:prune_web_hook_logs,cronjob:remove_expired_group_links,cronjob:remove_expired_members,cronjob:remove_unreferenced_lfs_objects,cronjob:repository_archive_cache,cronjob:repository_check_dispatch,cronjob:requests_profiles,cronjob:schedule_migrate_external_diffs,cronjob:stuck_ci_jobs,cronjob:stuck_export_jobs,cronjob:stuck_import_jobs,cronjob:stuck_merge_jobs,cronjob:trending_projects,deployment:deployments_finished,deployment:deployments_forward_deployment,deployment:deployments_success,gcp_cluster:cluster_configure,gcp_cluster:cluster_configure_istio,gcp_cluster:cluster_install_app,gcp_cluster:cluster_patch_app,gcp_cluster:cluster_project_configure,gcp_cluster:cluster_provision,gcp_cluster:cluster_upgrade_app,gcp_cluster:cluster_wait_for_app_installation,gcp_cluster:cluster_wait_for_ingress_ip_address,gcp_cluster:clusters_applications_activate_service,gcp_cluster:clusters_applications_deactivate_service,gcp_cluster:clusters_applications_uninstall,gcp_cluster:clusters_applications_wait_for_uninstall_app,gcp_cluster:clusters_cleanup_app,gcp_cluster:clusters_cleanup_project_namespace,gcp_cluster:clusters_cleanup_service_account,gcp_cluster:wait_for_cluster_creation,github_importer:github_import_import_diff_note,github_importer:github_import_import_issue,github_importer:github_import_import_lfs_object,github_importer:github_import_import_note,github_importer:github_import_import_pull_request,github_importer:github_import_refresh_import_jid,github_importer:github_import_stage_finish_import,github_importer:github_import_stage_import_base_data,github_importer:github_import_stage_import_issues_and_diff_notes,github_importer:github_import_stage_import_lfs_objects,github_importer:github_import_stage_import_notes,github_importer:github_import_stage_import_pull_requests,github_importer:github_import_stage_import_repository,hashed_storage:hashed_storage_migrator,hashed_storage:hashed_storage_project_migrate,hashed_storage:hashed_storage_project_rollback,hashed_storage:hashed_storage_rollbacker,incident_management:incident_management_process_alert,jira_importer:jira_import_advance_stage,jira_importer:jira_import_stage_finish_import,jira_importer:jira_import_stage_import_attachments,jira_importer:jira_import_stage_import_issues,jira_importer:jira_import_stage_import_labels,jira_importer:jira_import_stage_import_notes,jira_importer:jira_import_stage_start_import,mail_scheduler:mail_scheduler_issue_due,mail_scheduler:mail_scheduler_notification_service,notifications:new_release,object_pool:object_pool_create,object_pool:object_pool_destroy,object_pool:object_pool_join,object_pool:object_pool_schedule_join,object_storage:object_storage_background_move,object_storage:object_storage_migrate_uploads,pipeline_background:archive_trace,pipeline_background:ci_build_trace_chunk_flush,pipeline_background:ci_daily_report_results,pipeline_cache:expire_job_cache,pipeline_cache:expire_pipeline_cache,pipeline_creation:create_pipeline,pipeline_creation:run_pipeline_schedule,pipeline_default:build_coverage,pipeline_default:build_trace_sections,pipeline_default:ci_create_cross_project_pipeline,pipeline_default:ci_pipeline_bridge_status,pipeline_default:pipeline_metrics,pipeline_default:pipeline_notification,pipeline_default:pipeline_update_ci_ref_status,pipeline_hooks:build_hooks,pipeline_hooks:pipeline_hooks,pipeline_processing:build_finished,pipeline_processing:build_queue,pipeline_processing:build_success,pipeline_processing:ci_build_prepare,pipeline_processing:ci_build_schedule,pipeline_processing:ci_resource_groups_assign_resource_from_resource_group,pipeline_processing:pipeline_process,pipeline_processing:pipeline_update,pipeline_processing:stage_update,pipeline_processing:update_head_pipeline_for_merge_request,repository_check:repository_check_batch,repository_check:repository_check_clear,repository_check:repository_check_single_repository,todos_destroyer:todos_destroyer_confidential_issue,todos_destroyer:todos_destroyer_entity_leave,todos_destroyer:todos_destroyer_group_private,todos_destroyer:todos_destroyer_private_features,todos_destroyer:todos_destroyer_project_private,update_namespace_statistics:namespaces_root_statistics,update_namespace_statistics:namespaces_schedule_aggregation,authorized_keys,authorized_projects,background_migration,chat_notification,create_commit_signature,create_evidence,create_note_diff_file,default,delete_diff_files,delete_merged_branches,delete_stored_files,delete_user,detect_repository_languages,email_receiver,emails_on_push,error_tracking_issue_link,expire_build_instance_artifacts,file_hook,git_garbage_collect,github_import_advance_stage,gitlab_shell,group_destroy,group_export,group_import,import_issues_csv,invalid_gpg_signature_update,irker,mailers,merge,merge_request_mergeability_check,migrate_external_diffs,namespaceless_project_destroy,new_issue,new_merge_request,new_note,pages,pages_domain_ssl_renewal,pages_domain_verification,phabricator_import_import_tasks,post_receive,process_commit,project_cache,project_daily_statistics,project_destroy,project_export,project_service,project_update_repository_storage,propagate_service_template,reactive_caching,rebase,remote_mirror_notification,repository_cleanup,repository_fork,repository_import,repository_remove_remote,repository_update_remote_mirror,self_monitoring_project_create,self_monitoring_project_delete,system_hook_push,update_external_pull_requests,update_merge_requests,update_project_statistics,upload_checksum,web_hook,x509_certificate_revoke,cronjob:adjourned_group_deletion,cronjob:adjourned_projects_deletion_cron,cronjob:clear_shared_runners_minutes,cronjob:elastic_index_bulk_cron,cronjob:elastic_metrics_update,cronjob:geo_container_repository_sync_dispatch,cronjob:geo_file_download_dispatch,cronjob:geo_metrics_update,cronjob:geo_migrated_local_files_clean_up,cronjob:geo_prune_event_log,cronjob:geo_repository_sync,cronjob:geo_repository_verification_primary_batch,cronjob:geo_repository_verification_secondary_scheduler,cronjob:geo_repository_verification_secondary_shard,cronjob:geo_scheduler_per_shard_scheduler,cronjob:geo_scheduler_primary_per_shard_scheduler,cronjob:geo_scheduler_secondary_per_shard_scheduler,cronjob:geo_secondary_registry_consistency,cronjob:geo_sidekiq_cron_config,cronjob:historical_data,cronjob:import_software_licenses,cronjob:ldap_all_groups_sync,cronjob:ldap_sync,cronjob:pseudonymizer,cronjob:sync_seat_link,cronjob:update_all_mirrors,cronjob:update_max_seats_used_for_gitlab_com_subscriptions,epics:epics_update_epics_dates,gcp_cluster:cluster_update_app,gcp_cluster:cluster_wait_for_app_update,geo:geo_batch_project_registry,geo:geo_batch_project_registry_scheduler,geo:geo_container_repository_sync,geo:geo_design_repository_shard_sync,geo:geo_design_repository_sync,geo:geo_event,geo:geo_file_download,geo:geo_file_registry_removal,geo:geo_file_removal,geo:geo_hashed_storage_attachments_migration,geo:geo_hashed_storage_migration,geo:geo_project_sync,geo:geo_rename_repository,geo:geo_repositories_clean_up,geo:geo_repository_cleanup,geo:geo_repository_destroy,geo:geo_repository_shard_sync,geo:geo_repository_verification_primary_shard,geo:geo_repository_verification_primary_single,geo:geo_repository_verification_secondary_single,geo:geo_scheduler_primary_scheduler,geo:geo_scheduler_scheduler,geo:geo_scheduler_secondary_scheduler,geo:geo_secondary_repository_backfill,incident_management:incident_management_process_prometheus_alert,jira_connect:jira_connect_sync_branch,jira_connect:jira_connect_sync_merge_request,package_repositories:packages_nuget_extraction,personal_access_tokens:personal_access_tokens_policy,pipeline_default:ci_trigger_downstream_subscriptions,security_scans:store_security_reports,security_scans:store_security_scans,security_scans:sync_security_reports_to_report_approval_rules,adjourned_project_deletion,admin_emails,analytics_code_review_metrics,create_github_webhook,design_management_new_version,elastic_batch_project_indexer,elastic_commit_indexer,elastic_full_index,elastic_indexer,elastic_namespace_indexer,elastic_namespace_rollout,export_csv,ldap_group_sync,new_epic,project_import_schedule,refresh_license_compliance_checks,repository_push_audit_event,repository_update_mirror,service_desk_email_receiver,status_page_publish,sync_seat_link_request -r/Users/seanmcgivern/Code/gdk/gitlab -qauto_devops:auto_devops_disable,1 -qauto_merge:auto_merge_process,1 -qchaos:chaos_cpu_spin,1 -qchaos:chaos_db_spin,1 -qchaos:chaos_kill,1 -qchaos:chaos_leak_mem,1 -qchaos:chaos_sleep,1 -qcontainer_repository:cleanup_container_repository,1 -qcontainer_repository:delete_container_repository,1 -qcronjob:admin_email,1 -qcronjob:ci_archive_traces_cron,1 -qcronjob:container_expiration_policy,1 -qcronjob:environments_auto_stop_cron,1 -qcronjob:expire_build_artifacts,1 -qcronjob:gitlab_usage_ping,1 -qcronjob:import_export_project_cleanup,1 -qcronjob:issue_due_scheduler,1 -qcronjob:namespaces_prune_aggregation_schedules,1 -qcronjob:pages_domain_removal_cron,1 -qcronjob:pages_domain_ssl_renewal_cron,1 -qcronjob:pages_domain_verification_cron,1 -qcronjob:personal_access_tokens_expiring,1 -qcronjob:pipeline_schedule,1 -qcronjob:prune_old_events,1 -qcronjob:prune_web_hook_logs,1 -qcronjob:remove_expired_group_links,1 -qcronjob:remove_expired_members,1 -qcronjob:remove_unreferenced_lfs_objects,1 -qcronjob:repository_archive_cache,1 -qcronjob:repository_check_dispatch,1 -qcronjob:requests_profiles,1 -qcronjob:schedule_migrate_external_diffs,1 -qcronjob:stuck_ci_jobs,1 -qcronjob:stuck_export_jobs,1 -qcronjob:stuck_import_jobs,1 -qcronjob:stuck_merge_jobs,1 -qcronjob:trending_projects,1 -qdeployment:deployments_finished,1 -qdeployment:deployments_forward_deployment,1 -qdeployment:deployments_success,1 -qgcp_cluster:cluster_configure,1 -qgcp_cluster:cluster_configure_istio,1 -qgcp_cluster:cluster_install_app,1 -qgcp_cluster:cluster_patch_app,1 -qgcp_cluster:cluster_project_configure,1 -qgcp_cluster:cluster_provision,1 -qgcp_cluster:cluster_upgrade_app,1 -qgcp_cluster:cluster_wait_for_app_installation,1 -qgcp_cluster:cluster_wait_for_ingress_ip_address,1 -qgcp_cluster:clusters_applications_activate_service,1 -qgcp_cluster:clusters_applications_deactivate_service,1 -qgcp_cluster:clusters_applications_uninstall,1 -qgcp_cluster:clusters_applications_wait_for_uninstall_app,1 -qgcp_cluster:clusters_cleanup_app,1 -qgcp_cluster:clusters_cleanup_project_namespace,1 -qgcp_cluster:clusters_cleanup_service_account,1 -qgcp_cluster:wait_for_cluster_creation,1 -qgithub_importer:github_import_import_diff_note,1 -qgithub_importer:github_import_import_issue,1 -qgithub_importer:github_import_import_lfs_object,1 -qgithub_importer:github_import_import_note,1 -qgithub_importer:github_import_import_pull_request,1 -qgithub_importer:github_import_refresh_import_jid,1 -qgithub_importer:github_import_stage_finish_import,1 -qgithub_importer:github_import_stage_import_base_data,1 -qgithub_importer:github_import_stage_import_issues_and_diff_notes,1 -qgithub_importer:github_import_stage_import_lfs_objects,1 -qgithub_importer:github_import_stage_import_notes,1 -qgithub_importer:github_import_stage_import_pull_requests,1 -qgithub_importer:github_import_stage_import_repository,1 -qhashed_storage:hashed_storage_migrator,1 -qhashed_storage:hashed_storage_project_migrate,1 -qhashed_storage:hashed_storage_project_rollback,1 -qhashed_storage:hashed_storage_rollbacker,1 -qincident_management:incident_management_process_alert,1 -qjira_importer:jira_import_advance_stage,1 -qjira_importer:jira_import_stage_finish_import,1 -qjira_importer:jira_import_stage_import_attachments,1 -qjira_importer:jira_import_stage_import_issues,1 -qjira_importer:jira_import_stage_import_labels,1 -qjira_importer:jira_import_stage_import_notes,1 -qjira_importer:jira_import_stage_start_import,1 -qmail_scheduler:mail_scheduler_issue_due,1 -qmail_scheduler:mail_scheduler_notification_service,1 -qnotifications:new_release,1 -qobject_pool:object_pool_create,1 -qobject_pool:object_pool_destroy,1 -qobject_pool:object_pool_join,1 -qobject_pool:object_pool_schedule_join,1 -qobject_storage:object_storage_background_move,1 -qobject_storage:object_storage_migrate_uploads,1 -qpipeline_background:archive_trace,1 -qpipeline_background:ci_build_trace_chunk_flush,1 -qpipeline_background:ci_daily_report_results,1 -qpipeline_cache:expire_job_cache,1 -qpipeline_cache:expire_pipeline_cache,1 -qpipeline_creation:create_pipeline,1 -qpipeline_creation:run_pipeline_schedule,1 -qpipeline_default:build_coverage,1 -qpipeline_default:build_trace_sections,1 -qpipeline_default:ci_create_cross_project_pipeline,1 -qpipeline_default:ci_pipeline_bridge_status,1 -qpipeline_default:pipeline_metrics,1 -qpipeline_default:pipeline_notification,1 -qpipeline_default:pipeline_update_ci_ref_status,1 -qpipeline_hooks:build_hooks,1 -qpipeline_hooks:pipeline_hooks,1 -qpipeline_processing:build_finished,1 -qpipeline_processing:build_queue,1 -qpipeline_processing:build_success,1 -qpipeline_processing:ci_build_prepare,1 -qpipeline_processing:ci_build_schedule,1 -qpipeline_processing:ci_resource_groups_assign_resource_from_resource_group,1 -qpipeline_processing:pipeline_process,1 -qpipeline_processing:pipeline_update,1 -qpipeline_processing:stage_update,1 -qpipeline_processing:update_head_pipeline_for_merge_request,1 -qrepository_check:repository_check_batch,1 -qrepository_check:repository_check_clear,1 -qrepository_check:repository_check_single_repository,1 -qtodos_destroyer:todos_destroyer_confidential_issue,1 -qtodos_destroyer:todos_destroyer_entity_leave,1 -qtodos_destroyer:todos_destroyer_group_private,1 -qtodos_destroyer:todos_destroyer_private_features,1 -qtodos_destroyer:todos_destroyer_project_private,1 -qupdate_namespace_statistics:namespaces_root_statistics,1 -qupdate_namespace_statistics:namespaces_schedule_aggregation,1 -qauthorized_keys,1 -qauthorized_projects,1 -qbackground_migration,1 -qchat_notification,1 -qcreate_commit_signature,1 -qcreate_evidence,1 -qcreate_note_diff_file,1 -qdefault,1 -qdelete_diff_files,1 -qdelete_merged_branches,1 -qdelete_stored_files,1 -qdelete_user,1 -qdetect_repository_languages,1 -qemail_receiver,1 -qemails_on_push,1 -qerror_tracking_issue_link,1 -qexpire_build_instance_artifacts,1 -qfile_hook,1 -qgit_garbage_collect,1 -qgithub_import_advance_stage,1 -qgitlab_shell,1 -qgroup_destroy,1 -qgroup_export,1 -qgroup_import,1 -qimport_issues_csv,1 -qinvalid_gpg_signature_update,1 -qirker,1 -qmailers,1 -qmerge,1 -qmerge_request_mergeability_check,1 -qmigrate_external_diffs,1 -qnamespaceless_project_destroy,1 -qnew_issue,1 -qnew_merge_request,1 -qnew_note,1 -qpages,1 -qpages_domain_ssl_renewal,1 -qpages_domain_verification,1 -qphabricator_import_import_tasks,1 -qpost_receive,1 -qprocess_commit,1 -qproject_cache,1 -qproject_daily_statistics,1 -qproject_destroy,1 -qproject_export,1 -qproject_service,1 -qproject_update_repository_storage,1 -qpropagate_service_template,1 -qreactive_caching,1 -qrebase,1 -qremote_mirror_notification,1 -qrepository_cleanup,1 -qrepository_fork,1 -qrepository_import,1 -qrepository_remove_remote,1 -qrepository_update_remote_mirror,1 -qself_monitoring_project_create,1 -qself_monitoring_project_delete,1 -qsystem_hook_push,1 -qupdate_external_pull_requests,1 -qupdate_merge_requests,1 -qupdate_project_statistics,1 -qupload_checksum,1 -qweb_hook,1 -qx509_certificate_revoke,1 -qcronjob:adjourned_group_deletion,1 -qcronjob:adjourned_projects_deletion_cron,1 -qcronjob:clear_shared_runners_minutes,1 -qcronjob:elastic_index_bulk_cron,1 -qcronjob:elastic_metrics_update,1 -qcronjob:geo_container_repository_sync_dispatch,1 -qcronjob:geo_file_download_dispatch,1 -qcronjob:geo_metrics_update,1 -qcronjob:geo_migrated_local_files_clean_up,1 -qcronjob:geo_prune_event_log,1 -qcronjob:geo_repository_sync,1 -qcronjob:geo_repository_verification_primary_batch,1 -qcronjob:geo_repository_verification_secondary_scheduler,1 -qcronjob:geo_repository_verification_secondary_shard,1 -qcronjob:geo_scheduler_per_shard_scheduler,1 -qcronjob:geo_scheduler_primary_per_shard_scheduler,1 -qcronjob:geo_scheduler_secondary_per_shard_scheduler,1 -qcronjob:geo_secondary_registry_consistency,1 -qcronjob:geo_sidekiq_cron_config,1 -qcronjob:historical_data,1 -qcronjob:import_software_licenses,1 -qcronjob:ldap_all_groups_sync,1 -qcronjob:ldap_sync,1 -qcronjob:pseudonymizer,1 -qcronjob:sync_seat_link,1 -qcronjob:update_all_mirrors,1 -qcronjob:update_max_seats_used_for_gitlab_com_subscriptions,1 -qepics:epics_update_epics_dates,1 -qgcp_cluster:cluster_update_app,1 -qgcp_cluster:cluster_wait_for_app_update,1 -qgeo:geo_batch_project_registry,1 -qgeo:geo_batch_project_registry_scheduler,1 -qgeo:geo_container_repository_sync,1 -qgeo:geo_design_repository_shard_sync,1 -qgeo:geo_design_repository_sync,1 -qgeo:geo_event,1 -qgeo:geo_file_download,1 -qgeo:geo_file_registry_removal,1 -qgeo:geo_file_removal,1 -qgeo:geo_hashed_storage_attachments_migration,1 -qgeo:geo_hashed_storage_migration,1 -qgeo:geo_project_sync,1 -qgeo:geo_rename_repository,1 -qgeo:geo_repositories_clean_up,1 -qgeo:geo_repository_cleanup,1 -qgeo:geo_repository_destroy,1 -qgeo:geo_repository_shard_sync,1 -qgeo:geo_repository_verification_primary_shard,1 -qgeo:geo_repository_verification_primary_single,1 -qgeo:geo_repository_verification_secondary_single,1 -qgeo:geo_scheduler_primary_scheduler,1 -qgeo:geo_scheduler_scheduler,1 -qgeo:geo_scheduler_secondary_scheduler,1 -qgeo:geo_secondary_repository_backfill,1 -qincident_management:incident_management_process_prometheus_alert,1 -qjira_connect:jira_connect_sync_branch,1 -qjira_connect:jira_connect_sync_merge_request,1 -qpackage_repositories:packages_nuget_extraction,1 -qpersonal_access_tokens:personal_access_tokens_policy,1 -qpipeline_default:ci_trigger_downstream_subscriptions,1 -qsecurity_scans:store_security_reports,1 -qsecurity_scans:store_security_scans,1 -qsecurity_scans:sync_security_reports_to_report_approval_rules,1 -qadjourned_project_deletion,1 -qadmin_emails,1 -qanalytics_code_review_metrics,1 -qcreate_github_webhook,1 -qdesign_management_new_version,1 -qelastic_batch_project_indexer,1 -qelastic_commit_indexer,1 -qelastic_full_index,1 -qelastic_indexer,1 -qelastic_namespace_indexer,1 -qelastic_namespace_rollout,1 -qexport_csv,1 -qldap_group_sync,1 -qnew_epic,1 -qproject_import_schedule,1 -qrefresh_license_compliance_checks,1 -qrepository_push_audit_event,1 -qrepository_update_mirror,1 -qservice_desk_email_receiver,1 -qstatus_page_publish,1 -qsync_seat_link_request,1

For gitlab-com/gl-infra/scalability#184 (closed).

Merge request reports