ci: ingest gitlab docs in pipeline schedules
Note: This is a high priority MR for Solution implementation for "users can ask docu... (gitlab-org/gitlab#451215) in %17.0
What does this merge request do and why?
This is a follow-up MR after build: add script for ingestion to vertex ai se... (!757 - merged).
It adds ingest:dev
job in CI/CD pipelines to refresh gitlab-docs, which will be executed by scheduled pipelines 03:00 AM UTC every day.
In this MR, we execute the ingestion to the development environment, which is ai-enablement-dev-69497ba7
GCP project.
Ingestion to staging/production environments is out of scope in this MR, but this MR does groundwork for making it easier.
It also adds ingest:dry-run
job to make sure the make ingest
script works fine.
Related to Add tests for ingestion scripts (#448)
How to set up and validate locally
Here is an example ingest:dev
job run.
You can also run the ingestion locally with the docker image. See this doc.
Merge request checklist
-
Tests added for new functionality. If not, please raise an issue to follow up. -
Documentation added/updated, if needed.