SSH Prompts for Password

I am trying to git clone git@gitlab.cozykittygames.com:7H3LaughingMan/RPGKit.git but I am having issues doing this since it is prompting me for a password despite me using a SSH Key.

Cloning into 'RPGKit'...
Enter passphrase for key '/u/.ssh/id_rsa':
git@gitlab.cozykittygames.com's password:
Permission denied, please try again.
git@gitlab.cozykittygames.com's password:
Permission denied, please try again.
git@gitlab.cozykittygames.com's password:
Permission denied (publickey,password).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.

I have made sure that id_rsa is the proper key and I am able to load it up in PuTTYgen and the Public Key matches what I gave Gitlab. It even asks me for the passphrase despite they key not being created with on. If I enter nothing it just moves to the next step, if I enter anything it asks me to put in the passphrase again. I am able to SSH into my server on other accounts using these keys so I am not sure what is wrong.