ci: Remove broken fuzzing job

While we have a job which is intended to fuzz our objectinfo implementation, this fuzzer has been broken for a long while already without anybody caring. Let's remove it for now until somebody comes around and wants to reinstate and fix it.