Is the pybind11 >3.0 requirement really needed?

This version is very recent, it isn't part of even very new distributions' package inventory.

It would be nice to be able to build with 2.something still.