element.py: Return all refs in _track()

TrackQueue must call _set_ref() for all sources, otherwise the source
will never get out of the inconsistent state. This fixes --track when
using local sources.

Fixes: 03412a9e ("Use explicit source state updates")