server: Fix the status of finish_reason if the stream value is False

[SeongBeomLEE]

• I have read the contributing guidelines
• Self-reported review complexity:
  • Low
  • Medium
  • High

"finish_reason" returns "stop" in all cases because the "stop_word" value is always "True" when using "stream false mode" in /chat/completions API.

So modify the "stopped_word" value so that "length" can also be returned.

Thanks.

[ngxson]

LGTM, thanks!

[ngxson]

I temporary revoke my approval because the CI failed.

It's likely due to another bug in the code, unrelated to this PR. In anyway, the 3 bool stopped_eos, stopped_word, stopped_limit are too hacky and they should be refactored into one single enum.

I would appreciate if you (or someone) can take time to refactor this whole stopped_* mechanism.

[SeongBeomLEE]

@ngxson

can you merge the current PR to resolve the issue?

I will leave another PR later on what you talked about.

thanks.

[ngxson]

I'm closing this because I moved stopped_* to an enum in #10643

finish_reason should now be correct.