Unable to create a new project
### Summary I host ~40 projects on my own GitLab server for 2 months. Now I've figured out that I can not crate a new project any more. I've tried to solve the bug by upgrading Gitlab from 11.0.2 -> 11.3.5. It did't help. Below I'm describing the bug for the last version. ### Steps to reproduce 1. Click on 'New Project' on GitLab dashboard 2. Fill 'Project name' field with 'NewProject' 3. Click on 'Create project' ### What is the current *bug* behavior? The web site hangs for a while and then I get Error 502. The project is not created at all and I don't see it in the list of the project in Admin dashboard. ### What is the expected *correct* behavior? The project must have been created as all the former project I created before. ### Relevant logs and/or screenshots In the logs I see suspicions messages: ``` 2018-10-17_04:59:40.92054 FATAL: terminating connection due to idle-in-transaction timeout E, [2018-10-17T04:59:41.572845 #7252] ERROR -- : worker=3 PID:7360 timeout (61s > 60s), killing ``` ### Output of checks #### Results of GitLab environment info Output of `gitlab-rake gitlab:env:info`: ``` System information System: Current User: git Using RVM: no Ruby Version: 2.4.4p296 Gem Version: 2.7.6 Bundler Version:1.16.2 Rake Version: 12.3.1 Redis Version: 3.2.11 Git Version: 2.18.1 Sidekiq Version:5.1.3 Go Version: unknown GitLab information Version: 11.3.5 Revision: c74e8d9 Directory: /opt/gitlab/embedded/service/gitlab-rails DB Adapter: postgresql URL: https://dras-rsu-ci:9000/gitlab HTTP Clone URL: https://dras-rsu-ci:9000/gitlab/some-group/some-project.git SSH Clone URL: git@dras-rsu-ci:some-group/some-project.git Using LDAP: no Using Omniauth: no GitLab Shell Version: 8.3.3 Repository storage paths: - default: /var/opt/gitlab/git-data/repositories Hooks: /opt/gitlab/embedded/service/gitlab-shell/hooks Git: /opt/gitlab/embedded/bin/git ``` #### Results of GitLab application Check Output of `gitlab-rake gitlab:check SANITIZE=true`: ``` Checking GitLab Shell ... GitLab Shell version >= 8.3.3 ? ... OK (8.3.3) Repo base directory exists? default... yes Repo storage directories are symlinks? default... no Repo paths owned by git:root, or git:git? default... yes Repo paths access is drwxrws---? default... yes hooks directories in repos are links: ... 2/1 ... ok 2/2 ... ok 2/3 ... ok 2/4 ... ok 6/5 ... ok 6/6 ... ok 6/7 ... ok 6/8 ... ok 6/9 ... ok 6/10 ... ok 6/11 ... ok 6/12 ... ok 7/13 ... ok 7/14 ... ok 7/15 ... ok 7/16 ... repository is empty 7/17 ... ok 7/18 ... ok 7/19 ... ok 8/20 ... ok 8/21 ... ok 8/22 ... ok 8/23 ... ok 18/26 ... ok 13/27 ... ok 13/28 ... ok 13/29 ... ok 13/30 ... ok 7/31 ... ok 13/32 ... ok 2/33 ... ok 8/34 ... ok 8/35 ... ok 15/36 ... ok 15/37 ... ok 7/38 ... ok 8/39 ... ok 18/40 ... ok Running /opt/gitlab/embedded/service/gitlab-shell/bin/check Check GitLab API access: OK Redis available via internal API: OK Access to /var/opt/gitlab/.ssh/authorized_keys: OK gitlab-shell self-check successful Checking GitLab Shell ... Finished Checking Sidekiq ... Running? ... yes Number of Sidekiq processes ... 1 Checking Sidekiq ... Finished Reply by email is disabled in config/gitlab.yml Checking LDAP ... LDAP is disabled in config/gitlab.yml Checking LDAP ... Finished Checking GitLab ... Git configured correctly? ... yes Database config exists? ... yes All migrations up? ... yes Database contains orphaned GroupMembers? ... no GitLab config exists? ... yes GitLab config up to date? ... yes Log directory writable? ... yes Tmp directory writable? ... yes Uploads directory exists? ... yes Uploads directory has correct permissions? ... yes Uploads directory tmp has correct permissions? ... yes Init script exists? ... skipped (omnibus-gitlab has no init script) Init script up-to-date? ... skipped (omnibus-gitlab has no init script) Projects have namespace: ... 2/1 ... yes 2/2 ... yes 2/3 ... yes 2/4 ... yes 6/5 ... yes 6/6 ... yes 6/7 ... yes 6/8 ... yes 6/9 ... yes 6/10 ... yes 6/11 ... yes 6/12 ... yes 7/13 ... yes 7/14 ... yes 7/15 ... yes 7/16 ... yes 7/17 ... yes 7/18 ... yes 7/19 ... yes 8/20 ... yes 8/21 ... yes 8/22 ... yes 8/23 ... yes 18/26 ... yes 13/27 ... yes 13/28 ... yes 13/29 ... yes 13/30 ... yes 7/31 ... yes 13/32 ... yes 2/33 ... yes 8/34 ... yes 8/35 ... yes 15/36 ... yes 15/37 ... yes 7/38 ... yes 8/39 ... yes 18/40 ... yes Redis version >= 2.8.0? ... yes Ruby version >= 2.3.5 ? ... yes (2.4.4) Git version >= 2.9.5 ? ... yes (2.18.1) Git user has default SSH configuration? ... yes Active users: ... 13 Checking GitLab ... Finished ``` ### Possible fixes I've tried to increase timeout settings in gitlab.rb: ```ruby gitlab_rails['gitlab_shell_git_timeout'] = 8000 unicorn['worker_timeout'] = 600 ``` It did not help me, but I got error 404 instead of 502
issue