Start running Gitaly on the file (NFS) servers before it reaches full scope?
We can expect a significant speedup for Git operations once they no longer suffer NFS latency. If our highest priority is to improve the user experience then maybe we should consider to start running Gitaly on the NFS servers sooner rather than later.
There are a couple of downsides I can think of:
- more up-front work (authentication will mean: TLS CA and client certificates)
- we start spending CPU cycles and RAM on the NFS servers: we will have to start solving the problem of balancing Git operations, ahead of having read replicas for individual repositories