Project export fails due to statement timeout

When trying to export a project, the following errors occured on two consecutive days, for the same project:

 PG::QueryCanceled: ERROR: canceling statement due to statement timeout : SELECT "ci_builds".* FROM "ci_builds" WHERE "ci_builds"."stage_id" = 14280

and

 The errors we encountered were:

    PG::QueryCanceled: ERROR: canceling statement due to statement timeout : SELECT "taggings".* FROM "taggings" WHERE "taggings"."taggable_id" = 31603 AND "taggings"."taggabl...

Also during the export the server became unresponsive from time to time, to the point where even a login on the machine by ssh was not possible anymore. This happened both times I tried to export the project in question, even though I got an email only once. The other time, the export seems to just have died at some point.

Maybe this issue is related to https://gitlab.com/gitlab-org/gitlab-ce/issues/45876

changed the description

changed the description

mentioned in issue #12126 (closed)

mentioned in issue #12154 (closed)

added DEPRECATED_project export bugperformance devopsmanage typebug labels

It looks like there is a more general issue with the setup, that is causing not only the export problem, but also causes the server to become unresponsive when I just push to the project now. The issues started when we tried the first time to export the project, though. I can provide more details about the setup, but would prefer to do this in a non-public way.

The performance issues seems to have been caused by the export job(s), not the other way round: A job was started over and over again, running till it had consumed all resources, and brought the system to a halt.

I assume the process was killed in the end every time, and the system recovered. But after some time / minutes, the export job was started again.

What I did now is this:

• I monitored Monitoring/Background/Jobs/Busy.
• When the export job appeared in the Jobs list, I stopped it via Stop All
• Soon after, the export job appeared in /Queues/project_export, which I deleted

This cycle I had to do two times. Since then, the system seems to be stable again.

The underlying problem still remains, though: I cannot export the project. That is: I do not dare to try it again.

Also, a failing job must not bring the whole system to a halt. I consider this as a severe bug. Also that the job was executed over and over again even in case of error, with seemingly no execution limit, I would consider as a flaw, especially as there seems to be no way delete those jobs before they get executed the next time. And when they are running, one has to stop all running jobs to stop only the one that matters.

Setting ~"group::measure" based on ~"project export".

added groupoptimize label

Setting ~"group::measure" based on ~"project export".

mentioned in issue #13171 (closed)

added 1 deleted label and removed groupoptimize label

added [deprecated] Accepting merge requests label

removed [deprecated] Accepting merge requests label

added Enterprise Edition label

mentioned in issue #13604 (closed)

mentioned in issue #13779 (closed)

mentioned in issue #14638 (closed)

mentioned in issue #14822 (closed)

mentioned in issue #31986 (closed)

mentioned in issue #195981 (closed)

@georgekoltsov @lmcandrew What is our next step here? Is this related to #195981 (closed)? Thanks!

Do we have enough info to proceed with this issue?

I am not sure there is enough information for changes to be made in Project Export. Since this issue has been raised 10 months ago I am curious to see if this issue still exists.

added to epic &2959

changed milestone to %Backlog

added Category:Importers label

marked this issue as related to #22081 (closed)

marked this issue as related to #195981 (closed)

added [deprecated] Accepting merge requests label

changed epic to &3054

We encounter a similar problem since one week or so. The mail we receive is:

Subject: Project export error

Project xxxxxxx couldn't be exported.

The errors we encountered were:

PG::QueryCanceled: ERROR: canceling statement due to statement timeout

added sectiondev label

mentioned in issue gitlab-com/support/support-team-meta#3096 (closed)

added Importer:Project Export/Import label

This is an old issue and doesn't appear to be reproducible any longer. I am closing it at this time. Please reopen if you come across it again.

closed

added groupimport and integrate label and removed 1 deleted label