·Artificial Intelligence
Module 6 Lesson 3: Why Outputs Change
Why does the AI say things differently every time? In our final lesson of Module 6, we look at the trade-offs between Determinism and Creativity in model responses.
inference
5 articles
·Artificial Intelligence
Module 6 Lesson 2: Sampling Strategies
Why does an LLM give different answers to the same question? In this lesson, we learn about Temperature, Top-k, and Top-p—the knobs we use to control AI creativity.
·Artificial Intelligence
Module 6 Lesson 1: From Prompt to Output
How does a set of math formulas actually write a story? In this lesson, we look at the 'Inference' phase—the step-by-step process of turning a prompt into a response.
·Tech
Inference Economics: Strategies for the $10M Inference Bill
What happens when 'cheap tokens' add up to massive enterprise costs. Learn how to build an Inference Router to dynamically switch between cloud and local models.
·AI Security
Module 5 Lesson 2: Membership Inference Attacks
Is your data in there? Learn how attackers can determine if a specific record (like a medical file) was used to train a model, violating user privacy.