Mark blobs as binary whenever this is known

This removes the need for using Linguist::BlobHelper#binary? whenever the binary status is already known, in turn reducing loading times of nrclark/dummy_project@81ebdea5 (by about 2-ish seconds locally).