Add standard size GPU-enabled SaaS Linux runner for AI/ML workloads

Release notes

We are aiming to bring the best practices of DevSecOps to data sciences by providing more powerful compute within GitLab runner. Previously, data scientists may have had workloads that were compute-intensive and as a result, jobs may not have been as quickly executed in GitLab. Now, with GPU-enabled SaaS Runners on Linux, these workloads can be seamlessly supported using GitLab.com.

Overview

Add a new compute machine type, a GCP n1-standard-4 with 1 NVIDIA Tesla T4 GPU to the GitLab SaaS Runners on Linux with tag saas-linux-medium-amd64-gpu-standard.

Proposal

  • Create a new shared-runner-manager for GitLab SaaS to autoscale and provision the new machine type. Tag = saas-linux-medium-amd64-gpu-standard
  • Configure the runner manager to use a GCP n1-standard-4 (4 vCPUs, 14GB RAM VM) + 1 NVIDIA TESLA T4 GPU configured virtual machine.
  • The Runner that is configured to run workloads on this new machine type will not run un-tagged jobs.

Available Tiers

  • Premium
  • Ultimate

Implementation tasks

Reference

This page may contain information related to upcoming products, features and functionality. It is important to note that the information presented is for informational purposes only, so please do not rely on the information for purchasing or planning purposes. Just like with all projects, the items mentioned on the page are subject to change or delay, and the development, release, and timing of any products, features, or functionality remain at the sole discretion of GitLab Inc.

This page may contain information related to upcoming products, features and functionality. It is important to note that the information presented is for informational purposes only, so please do not rely on the information for purchasing or planning purposes. Just like with all projects, the items mentioned on the page are subject to change or delay, and the development, release, and timing of any products, features, or functionality remain at the sole discretion of GitLab Inc.

Edited by Gabriel Engel