[bugfix] add only msg observers

Since it's possible that we may have signers observe across blocks, we should only append to observers the signers of that msg.