Enumerated List of ongoing and upcoming projects 16.4
As a pre-planning action item, I'm hoping to involve the team in generating a high level list of "work streams" that exist for our consumption.
Known Problem Areas (Unordered)
- Table size reduction
- LW Lock investigation
- Single-to-Multi-table inheritance plan
- Automated tooling for detecting queries without partition keys
- More?
- BigInt Migrations
- Wrap up self managed for notes, other tables
- Updated metrics
- Automated query analysis
- Detecting added queries
- Running static analysis on updated queries
- Something about merge request tooling updates
- Determining IDs/ect for running prod explain plans?
- Migration ordering for multi-version updates
- Database review improvements (outside of automated query analysis)
- Better support for reviews of the
embeddings
database
- Better support for reviews of the
- Migration testing pipeline improvements
- Decomposition Follow-ups (Yeah, we have a bunch of these we said we'd do and haven't done)
- Load balancer resiliency
- Zone-based database service discovery
- There are a couple outsanding bugs like service_discovery_refresh_thread_interrupt* events
- Database Schema Validation
- Saas schema divergence
- Self managed schema divergence
- Improvements to batched background migrations
- Streamline developer experience for batched background migrations
- Better documentation of available params and why you'd change them
- Auto-tweak as many parameters as possible
- Streamline developer experience for batched background migrations
- Migration helper
- Alleviate confusion around use of
disable_ddl_transaction!
,with_lock_retries
, etc
- Alleviate confusion around use of
What we're likely committed to working on in 16.4
- Partitioning
- Automated tooling for partition keys
- LW Lock analysis
- BigInt Migrations for notes and other recent columns
- Automated Query Analysis
- Detecting added queries
- Migration ordering for multi-version updates
Questions
- Looking at the enumerated problem areas, what's missing? Are there gaps or things we should be considering/working on that aren't listed there (even if we aren't going to work on it)?
- Looking at what we committed to, is there something we're not doing that you're worried about?
Edited by Alex Ives