Fix ref frames of regular frames in the same TU as OLK

They can only reference frames on or after the OLK, not the leading frames or any frames before the OLK.