duplicate comments via reply by email functionality

Everytime I restart mailroom comments that were generated via direct replies by email are re-run. I've duplicate comments all over the place.

I'm talking about: gitlab_rails['incoming_email_enabled'] = true

I've noticed that inside mailbox mails are not marked as read, could that be the reason why they are reimported on each restart?