Homelab Brief - GPU Memory Fragmentation and OOM During Inference
The CUDA out-of-memory error that fires while nvidia-smi shows plenty free - diagnosing and fixing fragmentation. Produced with an AI-generated voice; adapted from a Big Iron guide. Full guide: https://www.bigiron.cc/guides/gpu-memory-fragmentation-and-the-oom-during-inference
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.