Reevaluate the linking of layers and manifest configurations to repositories

This is a followup from #75 (comment 353820750). Please see the thread for context. Once we complete &3006 (closed) and &3007 (closed) we should reevaluate this.