chatgpt command limit response length

[marko-radosavljevic]

Chatgpt command will crash if the response is over 2000 characters. To prevent that, we have to limit the response.

Just limiting the max tokens is a bad solution, because it would cut the answer short. Getting a guide or a code solution that is 90% there is not very helpful.

The solution is to add 'Answer in 1500 characters or less.' to the user question. And if chatgpt still goes over the limit, we can hard limit to prevent it from crashing.

[tmcdonnell2]

When you say 'hard limit', do you mean do cut the response off if too long? Or attempt to get another response from chatGPT? Can we cut it in "half" and send the rest as a separate message?

[marko-radosavljevic]

Sending the rest as a separate message is probably the best solution, because getting another response would likely be too slow?

[github-actions]

This issue is stale because it has been open 30 days with no activity. Remove stale label, comment or add the valid label or this will be closed in 5 days.

[r4huldeveloper]

I want to work on this bug , can you please tell me is it about gpt 3.5 or gpt 4?

[Zabuzard]

gpt 3.5

[r4huldeveloper]

public static String truncate(String text, int limit) {
if (text.length() <= limit) {
return text;
} else {
return text.substring(0, limit);
}
}
After getting the response from the API, we can implement a method to truncate it if it exceeds the desired character limit.