Check plugins conform to public API

It would be useful to have a series of tests to validate that any present and future plugins satisfy the public API

see !1680 (comment 238812486)