Scalable data access patterns
This is an umbrella theme spanning all Data Access teams, stated as follows: ensure long-term scalability and maintainability of our infrastructure while serving business needs according to the [FY26 Platforms strategy](https://docs.google.com/document/d/1E5T9TSkqxWkvCpWNbfrqmEFM5sXMO4HT-D22m_QjfyA/edit). ## Goals 1. Become intentional about growth 1. Reduce historical usage 1. Comply with [retention policies](https://gitlab.com/groups/gitlab-org/-/epics/13693) 1. Maintain (or enhance) developer velocity in shipping features -- we still want to enable everyone 1. Minimize related toil ## Data Access teams to do 1. **Measure** key metrics of their data scalability and access patterns, track their changes and relations to breaking points 1. **Attribute** usage to its source (for example, tie growth of a metric or a database query to a given product feature) 1. **Provide** policies defining the "paved paths", ie the good patterns to follow when storing and accessing data, through documentation, consultation, and processes in their scope 1. **Automate** actively detecting and preventing bad patterns from entering GitLab, as early in the development cycle as possible 1. **Measure** the impact of the above, set targets and report on success ## Entry points - https://gitlab.com/groups/gitlab-org/-/epics/14527+ - https://gitlab.com/groups/gitlab-org/-/epics/12961+ - https://gitlab.com/groups/gitlab-org/-/epics/16268+ - https://gitlab.com/groups/gitlab-org/-/epics/16271+ - https://gitlab.com/groups/gitlab-com/gl-infra/data-access/durability/-/epics/13+ - https://gitlab.com/groups/gitlab-com/gl-infra/data-access/durability/-/epics/9+ - https://gitlab.com/groups/gitlab-com/gl-infra/-/epics/1410+ - https://gitlab.com/gitlab-org/gitaly/-/issues/6380+ - https://gitlab.com/gitlab-com/gl-infra/scalability/-/issues/4069+ - https://gitlab.com/groups/gitlab-com/gl-infra/data-access/durability/-/epics/21+
epic