top-p

Definition of top-p

1. : a sampling setting that lets a model choose only from the most likely next tokens whose combined probability adds up to a chosen value, such as 0.9

   • Top-p of 0.9 cuts off the long tail of odd word choices.
   • Most people only need to adjust temperature, not top-p.