Stop changing line height when units change

Previously conversion was sometimes done with the wrong units. #2465 (closed)

Looks like it was dropped in accidentally in 9055a9eb