Skip to content

mailroom pods failing with chart 7.2.3

Summary

Mailroom pods are restarting(CrashLoopBackOff) after upgrading to chart 7.2.3

Steps to reproduce

As far as I'm aware if you configure incoming mail

Relevant logs and/or screenshots

Log output from one of the pods:

Defaulted container "mailroom" out of: mailroom, certificates (init), configure (init)

Begin parsing .erb templates from /etc

Begin parsing .tpl templates from /etc

\[2023-08-11 13:07:56\] INFO WEBrick 1.7.0

\[2023-08-11 13:07:56\] INFO ruby 3.0.6 (2023-03-30) \[x86_64-linux\]

{"severity":"INFO","time":"2023-08-11T13:07:56.575+00:00","context":{"email":"gitlab@example.com","name":"inbox"},"action":"Setting up watcher"}

\[2023-08-11 13:07:56\] INFO WEBrick::HTTPServer#start: pid=1 port=8080

{"severity":"INFO","time":"2023-08-11T13:07:56.681+00:00","context":{"email":"gitlab@example.com","name":"inbox"},"action":"Retrieving OAuth2 token..."}

{"severity":"INFO","time":"2023-08-11T13:07:56.836+00:00","context":{"email":"gitlab@example.com","name":"inbox"},"action":"Processing started"}

{"severity":"INFO","time":"2023-08-11T13:07:56.836+00:00","context":{"email":"gitlab-servicedesk@example.com","name":"inbox"},"action":"Setting up watcher"}

{"severity":"INFO","time":"2023-08-11T13:07:56.837+00:00","context":{"email":"gitlab-servicedesk@example.com","name":"inbox"},"action":"Retrieving OAuth2 token..."}

{"severity":"INFO","time":"2023-08-11T13:07:56.970+00:00","context":{"email":"gitlab@example.com","name":"inbox"},"uid":"","action":"asking arbiter to deliver","arbitrator":"MailRoom::Arbitration::Redis"}

_\#\<Thread:0x00007fbe066e95a8 /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/mailbox_watcher.rb:35 run\> terminated with exception (report_on_exception is true):_

/usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:128:in \`block in resolve_master': undefined method \`call' for #\<Redis::Client redis://gitlab-redis-ha-announce-0:26379/0\> (NoMethodError)

Did you mean? call_v

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:170:in \`block in each_sentinel'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:166:in \`each'

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:166:in \`each_sentinel'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:127:in \`resolve_master'

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:119:in \`block in config'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:117:in \`synchronize'

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:117:in \`config'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:69:in \`host'

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/ruby_connection.rb:124:in \`connect'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/ruby_connection.rb:49:in \`initialize'

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client.rb:685:in \`new'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client.rb:685:in \`block in connect'

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/middlewares.rb:12:in \`connect'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client.rb:684:in \`connect'

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client.rb:671:in \`raw_connection'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client.rb:638:in \`ensure_connected'

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client.rb:233:in \`call_v'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-5.0.6/lib/redis/client.rb:73:in \`call_v'

from /usr/lib/ruby/gems/3.0.0/gems/redis-5.0.6/lib/redis.rb:167:in \`block in send_command'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-5.0.6/lib/redis.rb:166:in \`synchronize'

from /usr/lib/ruby/gems/3.0.0/gems/redis-5.0.6/lib/redis.rb:166:in \`send_command'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-5.0.6/lib/redis/commands/strings.rb:95:in \`set'

from /usr/lib/ruby/gems/3.0.0/gems/redis-namespace-1.10.0/lib/redis/namespace.rb:558:in \`wrapped_send'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-namespace-1.10.0/lib/redis/namespace.rb:515:in \`call_with_namespace'

from /usr/lib/ruby/gems/3.0.0/gems/redis-namespace-1.10.0/lib/redis/namespace.rb:389:in \`block (2 levels) in \<class:Namespace\>'

 from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/arbitration/redis.rb:34:in \`deliver?'

from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/mailbox.rb:108:in \`deliver?'

 from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:169:in \`block in unread_messages'

from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:169:in \`select'

 from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:169:in \`unread_messages'

from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:153:in \`block (2 levels) in new_message_ids'

 from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:152:in \`loop'

from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:152:in \`block in new_message_ids'

 from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:201:in \`each'

from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:201:in \`each_with_object'

 from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:201:in \`messages_for_ids'

from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:144:in \`new_messages'

 from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:122:in \`process_mailbox'

from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:26:in \`wait'

 from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/mailbox_watcher.rb:37:in \`block in run'

\[2023-08-11 13:07:56\] INFO going to shutdown ...

\[2023-08-11 13:07:56\] INFO WEBrick::HTTPServer#start done.

{"severity":"INFO","time":"2023-08-11T13:07:56.978+00:00","context":{"email":"gitlab@example.com","name":"inbox"},"action":"Quitting connection..."}

{"severity":"INFO","time":"2023-08-11T13:07:56.978+00:00","context":{"email":"gitlab@example.com","name":"inbox"},"action":"Terminating watching thread..."}

/usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:128:in \`block in resolve_master': undefined method \`call' for #\<Redis::Client redis://gitlab-redis-ha-announce-0:26379/0\> (NoMethodError)

Did you mean? call_v

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:170:in \`block in each_sentinel'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:166:in \`each'

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:166:in \`each_sentinel'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:127:in \`resolve_master'

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:119:in \`block in config'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:117:in \`synchronize'

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:117:in \`config'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/sentinel_config.rb:69:in \`host'

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/ruby_connection.rb:124:in \`connect'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/ruby_connection.rb:49:in \`initialize'

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client.rb:685:in \`new'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client.rb:685:in \`block in connect'

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client/middlewares.rb:12:in \`connect'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client.rb:684:in \`connect'

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client.rb:671:in \`raw_connection'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client.rb:638:in \`ensure_connected'

from /usr/lib/ruby/gems/3.0.0/gems/redis-client-0.15.0/lib/redis_client.rb:233:in \`call_v'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-5.0.6/lib/redis/client.rb:73:in \`call_v'

from /usr/lib/ruby/gems/3.0.0/gems/redis-5.0.6/lib/redis.rb:167:in \`block in send_command'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-5.0.6/lib/redis.rb:166:in \`synchronize'

from /usr/lib/ruby/gems/3.0.0/gems/redis-5.0.6/lib/redis.rb:166:in \`send_command'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-5.0.6/lib/redis/commands/strings.rb:95:in \`set'

from /usr/lib/ruby/gems/3.0.0/gems/redis-namespace-1.10.0/lib/redis/namespace.rb:558:in \`wrapped_send'

 from /usr/lib/ruby/gems/3.0.0/gems/redis-namespace-1.10.0/lib/redis/namespace.rb:515:in \`call_with_namespace'

from /usr/lib/ruby/gems/3.0.0/gems/redis-namespace-1.10.0/lib/redis/namespace.rb:389:in \`block (2 levels) in \<class:Namespace\>'

 from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/arbitration/redis.rb:34:in \`deliver?'

from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/mailbox.rb:108:in \`deliver?'

 from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:169:in \`block in unread_messages'

from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:169:in \`select'

 from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:169:in \`unread_messages'

from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:153:in \`block (2 levels) in new_message_ids'

 from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:152:in \`loop'

from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:152:in \`block in new_message_ids'

 from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:201:in \`each'

from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:201:in \`each_with_object'

 from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:201:in \`messages_for_ids'

from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:144:in \`new_messages'

 from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:122:in \`process_mailbox'

from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/microsoft_graph/connection.rb:26:in \`wait'

 from /usr/lib/ruby/gems/3.0.0/gems/gitlab-mail_room-0.0.23/lib/mail_room/mailbox_watcher.rb:37:in \`block in run'
Edited by Peter Leitzen