Local Models Using GPUs with Ollama
Can you use your GPUs when running a local model under Ollama? You can, and it really depends on how you run Ollama and what your hardware is. Ollama supports NVidia and AMD GPUs with some exceptions. You can read about their hardware support here. There are drivers required from the vendors, and configuration, but […]
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.