Automatically analyze --bigkeys per Redis instance
https://redis.io/topics/rediscli#scanning-for-big-keys:
In this special mode,
redis-cli
works as a key space analyzer. It scans the dataset for big keys, but also provides information about the data types that the data set consists of. This mode is enabled with the--bigkeys
option [...]
We have done some analysis on this in the past, but it's been manual (https://gitlab.com/gitlab-com/gl-infra/infrastructure/-/issues/1631), although @rspeicher did also provide a script in https://gitlab.com/gitlab-com/gl-infra/infrastructure/-/issues/1631#note_30622014.
It would be really helpful if we could automatically get this for each Redis instance automatically, but particularly the cache instance.
I'm not 100% sure exactly how we'd do this automatically. In #300 (comment 329606696) @cmiskell mentioned:
Best case we get this data into prometheus, but even dumping it into a GCS bucket periodically with some tooling for analyzing/reporting on that would be a step up
And I agree entirely!