Latest / Software Engineering Radio - the podcast for professional software developers
SE Radio 610: Phillip Carter on Observability for Large Language Models
Phillip Carter, Principal Product Manager at Honeycomb and open source software developer, talks with host Giovanni Asproni about observability for large language models (LLMs). The episode explores similarities and differences for observability with LLMs versus more conventional systems. Key topics include: how observability helps in testing parts of LLMs that aren't amenable to automated unit or integration testing; using observability to develop and refine the functionality provided by the LLM (observability-driven development); using observability to debug LLMs; and the importance of…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.