unable to disable or delete self hosted k8s runner

I have a runner setup based on the gitlab runner helm chart, then we decided to launch it under another naming convention, so I created another runner via web UI, then updated the token in my k8s secret and deleted the pod, now after the pod relaunched the new runner is online and can take jobs fine, however, the old runner still shows up as online and I am unable to either disable in the project nor do I see a delete button to delete it, I got a felling that gitlab runner service may be confused by my operation of token replacement, how do I proceed at this point to make the old runner out of the system?