Replace the trash icon with something more user friendly
The trash icon is a bad metaphor here. Instead we should use the non-destructive concept of "remove" user, since we are neither deleting nor trashing users here. The solid red icon also gives too much emphasis on the remove task, which is likely not a primary task.
I think this is used on group and project members pages.
For reference, this is how this is handled in admin management. The text is a better design but I don't know whether or not "Delete" is accurate here.
And a similar UI for deleting labels: