Seems that with a recent update within the last couple weeks iTerm has started showing characters during mouse input instead of scrolling and clicking: