
Module 6 Lesson 3: Why Outputs Change
Why does the AI say things differently every time? In our final lesson of Module 6, we look at the trade-offs between Determinism and Creativity in model responses.
5 articles

Why does the AI say things differently every time? In our final lesson of Module 6, we look at the trade-offs between Determinism and Creativity in model responses.

Why does an LLM give different answers to the same question? In this lesson, we learn about Temperature, Top-k, and Top-p—the knobs we use to control AI creativity.

How does a set of math formulas actually write a story? In this lesson, we look at the 'Inference' phase—the step-by-step process of turning a prompt into a response.

What happens when 'cheap tokens' add up to massive enterprise costs. Learn how to build an Inference Router to dynamically switch between cloud and local models.

Is your data in there? Learn how attackers can determine if a specific record (like a medical file) was used to train a model, violating user privacy.