Low-Rank Decay for Grokking in Scale-Invariant Transformers: A Spectral-Geometric View

State-of-the-art research on Low-Rank Decay for Grokking in Scale-Inv achieving benchmark breakthroughs.