【第201期】LIMR：训练数据智能选择

Seventy3 · Apr 19, 2025 · 13m

Seventy3：借助NotebookLM的能力进行论文解读，专注人工智能、大模型、机器人算法方向，让大家跟着AI一起进步。

进群添加小助手微信：seventy3_podcast

备注：小宇宙

今天的主题是：

LIMR: Less is More for RL Scaling

Summary

This paper explores the efficiency of reinforcement learning (RL) data for enhancing large language models' reasoning abilities. It challenges the idea that more RL training data automatically leads to better performance. The authors introduce Learning Impact Measurement (LIM), a method to strategically select a small subset of highly impactful training samples. Their findings demonstrate that a carefully chosen fraction of data can achieve…