tests: Migrate preflight error handling check to tests/format/project.py

This is where other load time related plugin error handling is
checked, and is the last thing to remove in the `tests/pipeline`
directory.