Brew install on shared macOS runners very slow

Our team uses GitLab Shared Runners macos-12-xcode-13 for our react application for Android and iOS, and in some jobs, we have to use brew install but it takes too long, more than 20 minutes to install one package.

What can we do to speed up this process?