Eliminate the use of Anyhow

We only use the anyhow crate in build.rs where we can just panic. Let's eliminate the crate dependency all together.