"Merge When Build Succeeds" doesn't work

Experienced in !2794 (merged). The build was green but the branch wasn't merged automatically:

I canceled the automatic merge and did it manually in the end.