Recovery plan for Cephfs

Big issue that requires leadership and hard thinking: we are moving our repos to Cephfs and we do not have a backup plan, this has to be covered as soon as possible.

Requirements:

  • Offline
  • Different provider
  • Different credentials
  • Different format (test CephFS corruption and recover from it)

What is not backup

  • Another Ceph cluster to replicate to is great, but not a replacement.
  • Repushing the commits to another cluster is also not a replacement. We are not only backing up git repos

cc/ @jnijhof @northrup @ahanselka @maratkalibek @ahmadsherif