Move some toplevel files to subdirectories

I'd like us to have a cleaner layout than what we have today but we have to worry about compatibility. So I'm thinking to move files around and install symlinks. Here's the two that stood out to me, we can do the rest later.