not so funny

[imfinethanks]

A.
B.you
C.need
D.1
E.2
F.ah

请问这个结果正常吗？看起来并不是很搞笑

[zhongshsh]

Your generated content is not a complete sentence. I suspect there might be an issue with your generation config. You may need to check generation_config.json (in checkpoint dir), especially if max_new_tokens in the config is mistakenly set to 1.

My generation during testing is normal. (See attached image, I find this response quite interesting, no offense intended).

[imfinethanks]

max_new_tokens=512没发现问题，不过环境从windows+pytorch2.2切换成ubuntu+pytorch2.0后正常了。

Awesome