Obtain sharding key migration progress and estimate end date

We want to have a clear overview of the overall backfill of sharding keys. Some data points to include:

  1. How many tables don't have sharding_key

  2. How many tables don't have desired_sharding_key or sharding_key

  3. Progress of migrations to backfill desired_sharding_key

  4. Projection of how long to finish the backfill based on percentage complete

Implementation plan:

  1. How many tables don't have sharding_key
  2. How many tables don't have desired_sharding_key or sharding_key

This can be implemented as an addition to the existing dashboard at: https://manojmj.gitlab.io/tenant-scale-schema-progress/, or even as a new static webpage.

  1. Progress of migrations to backfill desired_sharding_key
  2. Projection of how long to finish the backfill based on percentage complete

This requires access to tables in the database - so this could be a script that we could run locally or on Rails consoles via teleport access to obtain the data. This needn't be part of the dashboard.

Edited by Manoj M J