The plugin periodically gets in a bugged state where it thinks the user does not have the pack installed. When it gets like this, it kicks every user (except OPs). Performing a server restart seems to fix this.