No emails on push

ZD: https://gitlab.zendesk.com/agent/tickets/22016

Description

There are dead jobs about mail in the "Background Logs" "Dead" sidekiq logs.

Error

Errno::EACCES: Permission denied @ dir_s_mkdir - /opt/gitlab/embedded/service/gitlab-rails/tmp/cache/assets/sprockets

The sidekiq runners are running as the git user, I believe. The /opt/gitlab/embedded/service/gitlab-rails directory is owned by root, and no cache directory exists there.

Next Steps

Should I manually create? If so, should I change ownership?

Stan:

I think we need to investigate why Sprockets is using that cache dir and why it's not there.


/cc @MrChrisW @stanhu