Annotate more kinds of operations as non-interfering with trace replays when they occur outside of traces