Not failing gracefully for preflight errors
As was discovered in !208 (closed), we do not catch the errors from the frontend when preflighting the pipeline, ironically preflighting the pipeline is done specifically to catch plugin raised errors, we're just letting them fall through the cracks and presenting the user with a fat stack trace.
This is most likely a regression from the various pipeline/frontend refactors.