Dependency Management using ElasticSearch
The focus is on enhancing GitLab's Dependency Management capabilities by leveraging ElasticSearch while maintaining PostgreSQL as the source of truth (SSOT). The initiative aims to significantly improve performance, scalability, and feature richness of dependency scanning and vulnerability management across the platform. It will enable faster searches, more comprehensive filtering, and better handling of large dependency datasets. ## Background As projects grow in size and complexity, several limitations have emerged: 1. **Performance Bottlenecks**: Large projects with thousands of dependencies experience slow query performance and timeouts. 2. **Limited Search Capabilities**: Complex filtering and searching across multiple dimensions of dependency data is constrained by PostgreSQL's query capabilities. 3. **Scalability Challenges**: The current architecture struggles to scale with the growing volume of dependency data, especially for large enterprises with many projects. 4. **Query Flexibility**: Advanced use cases like fuzzy matching, semantic searches, and aggregations across dependencies are difficult to implement efficiently. ## Goals * Migrate dependency data storage and indexing from PostgreSQL to ElasticSearch * Significantly improve search and filtering performance for dependency information * Enable more advanced querying capabilities (fuzzy matching, faceted search, etc.) * Support enterprise-scale dependency reporting across multiple projects * Improve the user experience when working with large dependency datasets ## Related Epics &13510+s
epic