Add LogProbs for Chat Completions in OpenAI#2918

Merged

esmeetu merged 18 commits intovllm-project:mainfrom

Feb 26, 2024

Commits on Feb 19, 2024

log probs seem to work for both stream and not
root
committed
move lines down
root
committed

Commits on Feb 20, 2024

yapf change
root
committed
forgot a new line
root
committed

Commits on Feb 22, 2024

Commits on Feb 23, 2024

remove create_logprobs_fn and is None checks
root
committed
assert to value error
root
committed
yapf
root
committed
tests
root
committed
Merge branch 'vllm-project:main' into main
jlcmoore
authored

Commits on Feb 25, 2024

Update vllm/entrypoints/openai/serving_chat.py

jlcmoore
and
esmeetu
authored
remove unused imports
root
committed
remove top logprobs
root
committed

Commits on Feb 26, 2024

remove last part of test for completions
root
committed