Remove extra union with empty filter.

This removes an union with empty Query, since it isn't needed. This fails on Django 3.0 since we can't do a filter operation after union.