Further improvements for Staging crawler
Related to gitlab-org/gitlab#349074 (closed)
Changes:
- Streamline CI config - add check and test jobs
- Skip
gitlab-qa-sandbox-group
groups and projects as they are being removed quickly and muddy the logs with 404 errors - Add documentation about env variables and exceptions
- Support user sign in to get
_gitlab_session
cookie and set it for Web tests (using CSRF token and user credentials)
Details for authorisation:
Currently GitLab doesn't provide API endpoint to log in for Web requests and it's being explored in gitlab-org/gitlab#27271. This MR adds a crude workaround to sign in as GITLAB_USERNAME
/GITLAB_PASSWORD
user, get its _gitlab_session
cookie and set it for Web requests.
Edited by Nailia Iskhakova