/api/:version/jobs/:id/trace calls are causing an increase in rails queue duration on api nodes leading to increased api latency

here's a chart showing the total time spent on serving different requests on api nodes, notice /api/:version/jobs/:id/trace route clearly standing out:

src: https://log.gitlab.net/goto/3f558db998a361d2819dec8401340a0b

and the resulting spikes in rails queue duration:

src: https://log.gitlab.net/goto/17b213a6c8729e65702b6cc634beb5e6