I saw this post in my newsfeed and navigated to the group. Although I'm not a member, I still see the Leave button.