Merge request file browser does not always take full viewport height

In a merge request with Show one file at a time enabled, when viewing a short file, the file browser doesn't take the full height of the window:

Possibly a result of !111518 (merged), and may be exacerbated by !111895 (merged).