
·AI & ChatGPT
Module 2 Lesson 3: Temperature, Top-p, and Sampling Settings
Control the randomness and creativity of ChatGPT using technical parameters like Temperature and Top-p.
3 articles

Control the randomness and creativity of ChatGPT using technical parameters like Temperature and Top-p.

Why does an LLM give different answers to the same question? In this lesson, we learn about Temperature, Top-k, and Top-p—the knobs we use to control AI creativity.
Mathematically impossible to fail. Using libraries like Outlines and Guidance to force the LLM to follow a specific grammar or regex.