Towards Understanding Professional AI Assistant Use: Human-in-the-Loop Topic Modeling of Multi-turn Conversations — Chen et al. (2026)

1 More Paper · Sep 19, 2026 · 37m · transcript

Understanding what people use AI assistants for in the workplace is essential for assessing their impact and informing future design. We present a novel framework HILTON: Human-In-the-Loop Topic mOdeling of multi-turn coNversations that combines the summarization capabilities of large language models (LLMs) with unsupervised, non-parametric clustering. The framework first sum-marizes multi-turn conversations between users and AI assistants, then clusters these summaries into coherent topics, which are fur-ther organized hierarchically, and dynamically updated as new data arrives. To ensure…