Add more tests for pipeline run rerun code

• Test rerun validation code (that we throw exceptions on invalid pipeline runs).
• Test rerun with multiple inputs (non-standard pipeline).
• Test rerun without problem description.
• Test evaluate rerun with data split file.

A followup to !249 (merged).