vram

2 articles

Module 1 Lesson 4: Hardware Requirements

What do you actually need to run an LLM? Breaking down VRAM, RAM, and storage for the Ollama user.

Squeezing every drop of performance. How to force Ollama to use the GPU and manage shared memory.