Skip to content

ci: ingest gitlab docs in pipeline schedules

Shinya Maeda requested to merge ingest-in-ci into main

Note: This is a high priority MR for Solution implementation for "users can ask docu... (gitlab-org/gitlab#451215) in %17.0

What does this merge request do and why?

This is a follow-up MR after build: add script for ingestion to vertex ai se... (!757 - merged). It adds ingest:dev job in CI/CD pipelines to refresh gitlab-docs, which will be executed by scheduled pipelines 03:00 AM UTC every day.

In this MR, we execute the ingestion to the development environment, which is ai-enablement-dev-69497ba7 GCP project. Ingestion to staging/production environments is out of scope in this MR, but this MR does groundwork for making it easier.

It also adds ingest:dry-run job to make sure the make ingest script works fine.

Related to Add tests for ingestion scripts (#448)

How to set up and validate locally

Here is an example ingest:dev job run.

You can also run the ingestion locally with the docker image. See this doc.

Merge request checklist

  • Tests added for new functionality. If not, please raise an issue to follow up.
  • Documentation added/updated, if needed.
Edited by Shinya Maeda

Merge request reports