GitLab Next

We've removed most redirects and don't need
this test anymore.

This should improve latency and throughput

It missed broken anchors in redirect files

This combines our schema and docs verification tasks with the new query
validation task.

Since the new task is not doc specific, the rules section for this has
been renamed.

We should never link to a redirect file, this
updates all links to the proper destinations

We can shrink the docker image if we don't need ruby

Since Ruby 2.7.2 comes with bundler v2.1.4 by default, we need to
upgrade the Gemfile.lock and bump the CI cache keys. We also need to
install bundler v1.17.3 to ensure a smooth transition for other
dependencies, like Gitaly.

Exclude development gems from QA bundle install since debaser doesn't
compile on Ruby 2.7.

Includes a docs change to test image

Issue: #218764
Follow-up for:
!39717
After merging:
!39715

* Revert an approximate match in the documentation linter
* Revert an allow_failure: true behavior
* Update a regular expression to remove false-positives in the linter

Contributes to #218764

This consolidates `trigger-build-docs` into `trigger-build` and make
the `review-docs-deploy` job wait for the downstream `gitlab-docs`
pipeline before finishing.

It was reported in Slack that the "Review "View App" button for the
docs Review App was shown even though the Review App wasn't actually
available.

That was because after triggering the downstream pipeline, we didn't
wait for it to be finished before the `review-docs-deploy` job.
Signed-off-by: Rémy Coutable <remy@rymai.me>

Add a pipeline job to test UI links to docs,
as links break when docs move, especially anchors
when headings change.

1. Cache `node_modules` for these jobs.
1. De-duplicate the `pull-cache` and `pull-push-cache` jobs.
1. Update caches in specific 2-hourly scheduled master jobs.
1. Update caches when MR title includes `UPDATE CACHE` (for testing
   purpose mostly).
Signed-off-by: Rémy Coutable <remy@rymai.me>

No need for the suffix anymore now that we only test against PG11.
Signed-off-by: Rémy Coutable <remy@rymai.me>

This follows the long-term PG testing plan at
https://docs.gitlab.com/ee/development/pipelines.html#long-term-plan.
Signed-off-by: Rémy Coutable <remy@rymai.me>

It happened that changing a CI config led to broken jobs but since those
jobs were allowed to fail we didn't realize they were broken before
getting reports from other engineers (and potentially from downstream
projects).

Fixes gitlab-org/gitlab#215846.
Signed-off-by: Rémy Coutable <remy@rymai.me>

Align MR testing strategy with current GitLab.com to ensure
availability for changes of GitLab.com.
Signed-off-by: Rémy Coutable <remy@rymai.me>

The long-term testing strategy will be documented soon, see
#213696.
Signed-off-by: Rémy Coutable <remy@rymai.me>

We also now run tests against:

- PG9 in nightly pipelines only (vs MR, master, and nightly before)
- PG11 in master and nightly pipelines (vs nightly pipelines before)
Signed-off-by: Rémy Coutable <remy@rymai.me>

Instead of defining `tags:` per-job,
we can use `default:tags:` to clearly
indicate that all jobs use `tags:`

We can do this now that we have merged CE/EE, the variable
is no longer needed.

The following merge requests fixed a bug we had in the docs
pipeline, but introduced another:

- gitlab-docs!731
- gitlab-docs!734

Namely, forks cannot use the project-set $DOCS_GITLAB_REPO_SUFFIX
variable, so they will fail at the internal links test. For example
https://gitlab.com/briankabiro/gitlab-ee/-/jobs/460294523.

Nanoc would create the content under 'public/doc/', whereas it should
be 'public/ee/', since we have some hardcoded links set in
https://gitlab.com/gitlab-org/gitlab-docs/-/blob/887850752fc0e72856da6632db132f005ba77f16/content/index.erb#L44-63

This makes it easier to run linting locally in a single step.

Also minor fix to doc suite to ensure docs pipeline is triggered.

Also use newest linting image (requires disabling new rule).

By passing empty needs because they really doesn't need anything

These jobs now have `needs` with `retrieve-tests-metadata`
as it is the quickest test in `prepare`.

Signed-off-by: Rémy Coutable <remy@rymai.me>

Signed-off-by: Rémy Coutable <remy@rymai.me>

And CI_JOB_TOKEN cannot access them easily