Large Language Models at Cohere // Nils Reimers // #158

Agentic Conversations (formally mlops.community) · May 16, 2023 · 1h 14m · transcript

MLOps Coffee Sessions #158 with Nils Reimer, MLOps Build or Buy, Large Language Model at Scale, co-hosted by Abi Aryan.

// Abstract

Large Language Models with billions of parameters have the possibility to change how we work with textual data. However, running them on scale at potentially hundreds of millions of texts a day is a massive challenge. Nils talks about finding the right model size for respective tasks, model distillation, and promising new ways of transferring knowledge from large to smaller models.

// Bio

Nils Reimers is highly recognized throughout the AI community for creating…