Unselecting voting buttons shouldn't leave emoji container gray

I think the background should go back to being white. This currently happens on master and not gitlab.com

/cc @MadLittleMods