DoRA: Weight-Decomposed Low-Rank Adaptation
An upgrade over LoRA for parameter-efficient fine-tuning, enabling better performance in LLMs by decomposing weights into magnitude and direction components.
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.