【第166期】underthinking：模型思考不够深入的问题

Seventy3 · Mar 15, 2025 · 17m

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。

今天的主题是：

Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs

Summary

This research investigates "underthinking" in large language models (LLMs), where models prematurely switch between reasoning strategies on complex tasks. The authors found that this frequent thought-switching correlates with incorrect answers and propose a metric to quantify this inefficiency. To address this, they introduce a "thought switching penalty" (TIP) during decoding, discouraging early transitions between reasoning paths. Experiments show that TIP improves…