Limit number of jobs per node.
Hello,
I'm using have my GitLab CI runner running in a Kubernetes cluster and I'm using the Kubernetes executor for the jobs. Let's say I have 2 nodes and I want to be sure, that it's possible to run 2 jobs in parallel, but not on the same node. If I add a third node, also the limit of parallel jobs should be increased to 3 (if possible, in an automatical way). I'm aware of the general concurrent parameter, but that's only the global limit of parallel jobs, not the "jobs per node" (I'm searching for). Is it possible, maybe with labels/node selector annotations, to get this behaviour? Thanks in advance for your help!
CI build jobs can be highly parallelized and utilize all resources of the node it runs on. What I'm seeing now is that one node is processing two jobs simultaneously (of the same pipeline) which are fighting for resources, while there are other nodes available, doing almost nothing.