Resolve "[Feature flag] Rollout of `mergeability_caching`"

What does this MR do and why?

This functionality has been tested behind a feature flag, but the caching of that particular check was found to be difficult to invalidate so was not continued.

However, we can still remove the feature flag of caching for the mergeability work.

Related to #340810 (closed)