Performance regression when writing references with the reftable backend

Bencher has made us aware of a performance regression when writing references: