add yaml validation to spec tests

For configurations that are yaml it would be helpful if we did some basic yaml validation as part of spec tests so we don't accidentally merge a change that generates an invalid config.

I think we could have caught this error much earlier !3441 (diffs)