Gitlab Runner Autoscaling (Fleeting) plugin for Slurm (seeking community contributions)
Overview
Currently gitlab runner is able to send CI jobs through multiple shells.
It would be interesting to support HPC environment through workload scheduler as slurm.
Proposal
For this you could to write at the beginning of generated bash script file something like:
#!/bin/sh
#SBATCH --partition=small
#SBATCH --nodes=2
#SBATCH --ntasks-per-node=8
#SBATCH --job-name="my gitlab ci"
#SBATCH --output=log_my_gitlab_ci.out
"job name" could be took from step name describe from yml file
"partition" and "number of tasks" could be set from TOML config file or yml fie
And send the job with:
$ sbatch generated-sbatch-script
Some sbatch example can be found here
Thank you for helping to make GitLab a better product.
This page may contain information related to upcoming products, features and functionality. It is important to note that the information presented is for informational purposes only, so please do not rely on the information for purchasing or planning purposes. Just like with all projects, the items mentioned on the page are subject to change or delay, and the development, release, and timing of any products, features, or functionality remain at the sole discretion of GitLab Inc.