skinny.

Latest / Misar.Blog Podcast

GPU Direct Storage: Accelerating ML Data Loading

Technical deep-dive on GPU Direct Storage (GDS/GDSync) for ML training: how it bypasses CPU to load data directly from NVMe to GPU memory, benchmark results… From the article "GPU Direct Storage: Accelerating ML Data Loading" by Synor, published on Misar.Blog.

In this episode:

0:00 GPU Direct Storage (GDS) Reduces GPU Data-Loading Latency by 2-5×

0:57 In I/O-Bound Machine-Learning Training Workloads

1:34 GDS Is Most Effective for Large Sequential File Reads (>1 MB) Such

2:15 Hardware Requirements for GDS Include an NVIDIA GPU with GP10x Architecture

2:49 Using GDS in Multi-GPU Training

This…

The skinny

The skinny isn't ready yet — notes appear once the transcript is processed.