Slack notifications spamming with multiple notifications

Hello! Thank you for Gitlab. We enabled Slack notifications and we're getting 10, 20, 30 + notifications for the same thing. Even after I turned off the integration, it's still going it with no signs of slowing down. Any ideas?