Sampling: Temperature & Top-k

Temperature rescales logits before softmax to dial text generation between deterministic and random, while top-k discards every candidate except the k most…

This lesson is part of BitBootcamp Pro. Unlock it with Pro, or browse the free courses.