Remove patching mechanism / relocate to libdir

We cannot use patches in the nightlies, because the copr builds are done via a spec file rather than from an srpm.

Also, we should install based on _libdir rather than hardcoding to /lib.