The lines between the file browser items in the screenshot above suddenly appeared today. Seems to be in the 8.4.0..8.4.1 delta.
cc @DouweM