Closes #3298. Implements a new record-based snapshot format, addressing many of the limitations of the previous format.

Changelog: feature