Add logits_processor option to generate_step function#983

Merged

awni merged 8 commits intoml-explore:mainfrom

nathanrchn:logits_processor

Sep 28, 2024

Commits on Sep 28, 2024

Add logits_processor option for the generation as in huggingface transformers library

nathanrchn
authored and
Awni Hannun
committed
concatenation correction

nathanrchn
authored and
Awni Hannun
committed
Rename the tokens variable for clarity

nathanrchn
authored and
Awni Hannun
committed
remove the logit_bias argument from generate_step method

nathanrchn
authored and
Awni Hannun
committed
fix the variable name

nathanrchn
authored and
Awni Hannun
committed
nits + test
Awni Hannun
committed
test
Awni Hannun
committed
add back logit bias + test
Awni Hannun
committed