LT2: Linear-Time Looped Transformers
Replaces quadratic softmax attention in looped architectures with linear/sparse mechanisms for iterative memory refinement, achieving parity with standard looped transformers at much lower cost.
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.