Change the default replication factor
/cc @justintobler @pks-gitlab @samihiltunen
The default setting for Cluster is to replicate to all cluster members. This is potentially wasteful, and increases load scaling with cluster size due to having to keep more replicas up-to-date. A recent example is a customer who's running large repos with 9 (!) replicas (slack) .
We should
- define a sensible default replica count instead (3? 5?)
- set this explicitly as default in the configuration
- migrate existing configurations if they're using the current "all nodes" default
- communicate