Drop unused Go versions from images

The following discussion from !755 (merged) should be addressed:

• @acunskis started a discussion: (+1 comment)

  Not directly related but I think we should probably remove some of the go versions from the matrix, I believe gitlab and gdk repo is using 1.21. Otherwise the amount of jobs being spawned is pretty bonkers