tmux ignores automatically close setting

I have the "automatically close when a session ends" box unchecked for my tmux profile. However, when I detach cleanly from tmux, the window closes. I tested this on the latest nightly Build 3.1.20170314-nightly. I would like to be able to keep the window open for the scrollback.