Upgrade grpcio==1.62.0
It seems like with our current version of grpcio, that using a TLS channel causes a memory leak in some deployments. We haven't been able to reproduce this with a minimal setup outside of this environment, but we can deterministically reproduce the behavior on these machines, and can validate the usage of TLS channels within a request handler is the cause.
Upgrading to the latest grpcio pulls in updates to boringssl, which I believe must be resolving the issue, as on the latest version of grpcio we do not experience the memory leak.