Add standard size GPU-enabled SaaS Linux runner for AI/ML workloads
Release notes
We are aiming to bring the best practices of DevSecOps to data sciences by providing more powerful compute within GitLab runner. Previously, data scientists may have had workloads that were compute-intensive and as a result, jobs may not have been as quickly executed in GitLab. Now, with GPU-enabled SaaS Runners on Linux, these workloads can be seamlessly supported using GitLab.com.
Overview
Add a new compute machine type, a GCP n1-standard-4 with 1 NVIDIA Tesla T4 GPU
to the GitLab SaaS Runners on Linux with tag saas-linux-medium-amd64-gpu-standard
.
Proposal
- Create a new shared-runner-manager for GitLab SaaS to autoscale and provision the new machine type. Tag = saas-linux-medium-amd64-gpu-standard
- Configure the runner manager to use a GCP n1-standard-4 (4 vCPUs, 14GB RAM VM) + 1 NVIDIA TESLA T4 GPU configured virtual machine.
- The Runner that is configured to run workloads on this new machine type will not run un-tagged jobs.
Available Tiers
- Premium
- Ultimate
Implementation tasks
-
Define configuration details for GPU enabled SaaS Linux runners -
Request quota limit increases for some of the quotas for GPU enabled SaaS Linux runners
Reference
This page may contain information related to upcoming products, features and functionality. It is important to note that the information presented is for informational purposes only, so please do not rely on the information for purchasing or planning purposes. Just like with all projects, the items mentioned on the page are subject to change or delay, and the development, release, and timing of any products, features, or functionality remain at the sole discretion of GitLab Inc.
This page may contain information related to upcoming products, features and functionality. It is important to note that the information presented is for informational purposes only, so please do not rely on the information for purchasing or planning purposes. Just like with all projects, the items mentioned on the page are subject to change or delay, and the development, release, and timing of any products, features, or functionality remain at the sole discretion of GitLab Inc.