GaugeLasso

Project information

Project ID: 85962177

Reproduction code for "Dense Structural Compression of Transformers via Gauge-Correct Channel Removal" (NeurIPS 2026, arXiv:2609.07264). GaugeLasso shrinks a transformer during training. A gauge-invariant group-lasso penalty drives whole channels to zero so they can be removed, which leaves smaller dense tensors that keep their GPU throughput.

4 Commits
1 Branch
0 Tags

README
MIT License
CITATION.cff

Created on

September 01, 2026