Combine milestone change notifications
Should follow the logic in
https://gitlab.com/gitlab-org/gitlab-ce/issues/46483
.