Exploring Next

Exploring Next — Ep 32 w/ Justy & Cody — marktechpost.com/2025/10/14/7-llm-generation-parameters-what-they-do-and-how-to-tune-them

Editors Pick Agentic AI Staff Tech News 7 LLM Generation Parameters—What They Do and How to Tune Them? By Michal Sutter - October 14, 2025 Tuning LLM outputs is largely a decoding problem: you shape the model’s next-token distribution with a handful of sampling controls— max tokens (caps response length under the model’s context limit), temperature (logit scaling for more/less randomness), top-p / nucleus and top-k (truncate the candidate set by probability mass or rank), frequency and presence penalties (discourage repetition or encourage novelty), and stop sequences (hard termination on delimiters).

Open source article

Full episode page with transcript →

Browse all Exploring Next episodes →