Resolve "Refactor Automatically merge when merge checks pass"

What does this MR do and why?

Refactor parts of the auto merge related services.

Related to #427787 (closed)