We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 060fe61 commit 6e195ebCopy full SHA for 6e195eb
src/transformers/generation_utils.py
@@ -941,6 +941,9 @@ def generate(
941
top_p (`float`, *optional*, defaults to 1.0):
942
If set to float < 1, only the most probable tokens with probabilities that add up to `top_p` or higher
943
are kept for generation.
944
+ typical_p (`float`, *optional*, defaults to 1.0):
945
+ The amount of probability mass from the original distribution to be considered in typical decoding.
946
+ If set to 1.0 it takes no effect. See [this paper](https://arxiv.org/pdf/2202.00666.pdf) for more details.
947
repetition_penalty (`float`, *optional*, defaults to 1.0):
948
The parameter for repetition penalty. 1.0 means no penalty. See [this
949
paper](https://arxiv.org/pdf/1909.05858.pdf) for more details.
0 commit comments