Status report: 2021-03-03 - 2021-03-10

Scalability Status Update

Closed Issues

*⃣ @andrewn: https://gitlab.com/gitlab-com/gl-infra/infrastructure/-/issues/7517: Track latency and queue duration SLOs for each worker individually
*⃣ @andrewn: https://gitlab.com/gitlab-com/gl-infra/infrastructure/-/issues/7618: Investigate sidekiq server key metrics - 200% error rates
*⃣ @marin: https://gitlab.com/gitlab-com/gl-infra/infrastructure/-/issues/8912: Ensure application limit changes are propagated to GitLab.com
*⃣ @marin, @anthonysandoval: production#3460: 2021-01-29 CI runner service degraded performance
*⃣ @marin, @craig: production#3642: 2021-02-17: Elasticsearch indexing falling behind since 2021-02-16 11:00 UTC
*⃣ @marin, @igorwwwwwwwwwwwwwwwwwwww: production#3650: 2021-02-18: Postgres replication lag
*⃣ @marin, @igorwwwwwwwwwwwwwwwwwwww: production#3651: 2021-02-18: IncreasedServerResponseErrors on gitlab-pages
*⃣ @marin, @igorwwwwwwwwwwwwwwwwwwww: production#3653: 2021-02-18: CI runners apdex drop
*⃣ @qmnguyen0711: #846 (closed): Sentry: Merge Sentry's contexts and users into ApplicationContext
*⃣ @qmnguyen0711: #914 (closed): 2021-03-01 - Planning Board Refinement
*⃣ @qmnguyen0711: gitlab-org/gitlab#323165 (closed): Monitor rails_sql apdex score for primary and secondary databases separately
*⃣ @qmnguyen0711: gitlab-org/gitlab#323164 (closed): Split structured logs db_duration fields between primary database and secondary databases
*⃣ @reprazent, @alexbuijs: #890 (closed): Improve the OnboardingService to not write to the database within git-fetch endpoints
*⃣ @rnienaber: #839 (moved): Investigate InterruptedSet contents
*⃣ @smcgivern: #872 (closed): Analyze uncached PackObjectsHook traffic
*⃣ @smcgivern: #915 (closed): Update feature categories
*⃣ @smcgivern: gitlab-org/gitlab#27135 (closed): pipeline_hooks:build_hooks queue overloaded
*⃣ @smcgivern: gitlab-org/gitlab#211472 (closed): Remove feature flag for Marginalia Ⓜ 13.9
*⃣ @smcgivern: gitlab-org/gitlab#323432 (closed): Kroki specs failing Ⓜ 13.10
*⃣ @smcgivern, @rnienaber: #867 (closed): Proposal: Scaling Sidekiq with Zonal Clusters
*⃣ @stanhu, @reprazent: gitlab-org/gitlab#323161 (closed): Better Marginalia support for API endpoints

Merged Merge Requests

@andrewn: gitlab-cookbooks/gitlab-exporters!212 (merged): Add endpoint_id parsing for marginalia sampler
@andrewn: gitlab-com/runbooks!3300 (merged): Split apdex recording rule into component parts
@andrewn: gitlab-com/runbooks!3304 (merged): Break apdex down into components for all prometheus source SLIs
@andrewn: gitlab-com/runbooks!3307 (merged): fix(elastic): update elastic mappings
@andrewn: gitlab-com/runbooks!3317 (merged): add alerts to detect for query optimiser issues in postgres
@marin: gitlab-com/runbooks!3314 (merged): Reference Engineering 1p vault in Grafana dashboards Readme
@marin: gitlab-com/www-gitlab-com!76596 (merged): Add links to other pages on the relocation page
@marin: gitlab-com/www-gitlab-com!76629 (merged): Fix capitalization typo in Code of Business Conduct
@marin: gitlab-com/www-gitlab-com!76817 (merged): Hard Production Change Lock for incident 3785
@marin: gitlab-com/www-gitlab-com!76829 (merged): Language fixes for PCL page
@qmnguyen0711: gitlab-org/gitlab!54885 (merged): Differentiate metrics and logs from replica/primary databases
@qmnguyen0711: gitlab-org/gitlab!56005 (merged): Port essential database metrics to Sidekiq
@qmnguyen0711: triage-ops!67: Pass triage to Craig
@reprazent: gitlab-org/gitlab!54932 (merged): Add a blurb about pinning gem versions
@reprazent: https://gitlab.com/gitlab-org/labkit-ruby/-/merge_requests/59: Allow reading a single method from the context
@reprazent: !31 (merged): Add a job to generate daily MTBF images
@smcgivern: gitlab-org/gitlab!55506 (merged): Rename Sentry::Client to ErrorTracking::SentryClient
@smcgivern: gitlab-org/gitlab!55720 (merged): Fix Kroki formats spec
@smcgivern: gitlab-org/gitlab!56113 (merged): Update feature categories for 2021-03-09
@smcgivern: triage-ops!63: Add a weekly report for incidents with no service or root cause
@smcgivern: gitlab-com/runbooks!3303 (merged): Add section on working around BigQuery's field name limitations

Reviewed Merge Requests

@andrewn: https://gitlab.com/gitlab-org/labkit-ruby/-/merge_requests/59: Allow reading a single method from the context
@andrewn: https://gitlab.com/gitlab-org/labkit-ruby/-/merge_requests/60: Add client_id as KNOWN_KEY to context
@andrewn: https://ops.gitlab.net/gitlab-cookbooks/chef-repo/-/merge_requests/5119: Bump gitlab-exporters version to 3.7.18
@andrewn: https://ops.gitlab.net/gitlab-cookbooks/chef-repo/-/merge_requests/5120: Bump gitlab-exporters version to 3.7.18 in production
@reprazent: gitlab-org/gitlab!52597 (merged): Remove licensed type from Feature Flags [RUN ALL RSPEC] [RUN AS-IF-FOSS]
@reprazent: gitlab-org/gitlab!54885 (merged): Differentiate metrics and logs from replica/primary databases
@reprazent: gitlab-org/gitlab!54906 (merged): Support composer v2 metadata-url
@reprazent: gitlab-org/gitlab!55089 (merged): Add context metadata for runners API endpoints
@reprazent: gitlab-org/gitlab!55111 (merged): Only set note visibility_level to if associated with a project
@reprazent: gitlab-org/gitlab!55349 (merged): Use policies framework for determining admin access to groups
@reprazent: gitlab-org/gitlab!55406 (merged): HTTP connection adapter with proxy settings
@reprazent: gitlab-org/gitlab!55442 (merged): Enable optimal API v3/repos/{full-path}/events [RUN ALL RSPEC] [RUN AS-IF-FOSS]
@reprazent: gitlab-org/gitlab!55487 (merged): Update existing namespace statistics wiki wiki_size
@reprazent: gitlab-org/gitlab!55584 (merged): Add reviewers detail to merge request status email
@reprazent: gitlab-org/gitlab!55725 (merged): Fix: No such file or directory for pager_duty/validator
@reprazent: gitlab-org/gitlab!55760 (merged): Fix experiment calculation for registration invites
@reprazent: gitlab-org/gitlab!55873 (merged): Reenable OAuth password grants without client credentials
@reprazent: gitlab-org/gitlab!55921 (merged): New Crowdin translations - 05 Mar 2021
@reprazent: gitlab-org/gitlab!56003 (merged): Refactor Labkit::Context to Gitlab::ApplicationContext
@reprazent: gitlab-org/gitlab!56186 (merged): Fix RuboCop offenses for Lint/HashCompareByIdentity
@reprazent: gitlab-com/runbooks!3228 (merged): Improve Plan Performance dashboard
@reprazent: gitlab-com/runbooks!3304 (merged): Break apdex down into components for all prometheus source SLIs
@smcgivern: gitlab-org/gitlab!54867 (merged): Add negated weight issue filter on API
@smcgivern: gitlab-org/gitlab!55066 (merged): Return attachment plus the filename in the Content-Disposition header [RUN ALL RSPEC] [RUN AS-IF-FOSS]
@smcgivern: gitlab-org/gitlab!55099 (merged): Add user callouts to GraphQL
@smcgivern: gitlab-org/gitlab!55237 (merged): Update epic boards in GraphQL API
@smcgivern: gitlab-org/gitlab!55320 (merged): Fix 500 error for long commit messages
@smcgivern: gitlab-org/gitlab!55564 (merged): Improve Marginalia comments for API requests
@smcgivern: gitlab-org/gitlab!55688 (merged): Adding additional test case for upload file button
@smcgivern: gitlab-org/gitlab!55713 (merged): Add comments to document internal secure variables
@smcgivern: gitlab-org/gitlab!55933 (merged): Log large multipart messages from Rack
@smcgivern: gitlab-org/gitlab!56005 (merged): Port essential database metrics to Sidekiq
@smcgivern: gitlab-org/gitlab!56038 (merged): Create vulnerability issue link after merging the MR.
@smcgivern: gitlab-org/gitlab!56145 (merged): Removes the Disk IO tag from various queues
@smcgivern: gitlab-org/gitlab!56187 (merged): Quarantine flaky tests
@smcgivern: gitlab-com/runbooks!3314 (merged): Reference Engineering 1p vault in Grafana dashboards Readme
@smcgivern: gitlab-com/www-gitlab-com!76418 (merged): Add an explanatory key to the service maturity model
@smcgivern: !31 (merged): Add a job to generate daily MTBF images

This status report was autogenerated.

Edited Mar 10, 2021 by ops-gitlab-net