Shrink the cross-database spec allowlist further

What does this MR do and why?

Shrink the cross-database spec allowlist further

Further specific callsite-based allowlists allow us to shink this list further.

The data is obtained using !69037 (closed)

Related issue: #339299 (closed)

Screenshots or screen recordings

These are strongly recommended to assist reviewers and reduce the time to merge your change.

How to set up and validate locally

Numbered steps to set up and validate the change are strongly suggested.

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

• I have evaluated the MR acceptance checklist for this MR.