Feature Request: Addition of transformers 'hallucinations' filter

[GenTxt]

Request addition of transformers 'hallucinations' filter as per description here:

huggingface/transformers#18354

Coder provides best explanation.

Merged Jan. 23 and confirm it's included in required 'https://github.com/zphang/transformers/tree/llama_push' and 4.27.dev

Currently being used outside of text-generation-webui

Requires addition of ' encoder_repetition_penalty ' with slider value 0.8 to 2.0.

Works best with 'do_sample': True, and 'repetition_penalty': 1.03 - 1.05.

Prefer setting 1.0. A slight change to 0.98 or 1.02 will drastically change the output.

[oobabooga]

I have set the upper bound to 1.5 since this parameter is so sensitive. Thanks for the suggestion, I was not aware of encoder_repetition_penalty.

[GenTxt]

Thanks for this option. Works perfectly. I've attempted to find the best method for generating and replicating seeds through 'server.py' and 'api-example.py' but cannot replicate text results or find where the scripts generate seeds. Best example for generating and replicating seeds as per https://github.com/AUTOMATIC1111 Feature should appear on interface and same option using current 'api-example.py' and/or 'server.py' (unless there's a better way?) Attached pic for reference from above repo. Cheers, and keep up the great work.

…

On Wed, Mar 15, 2023 at 10:12 AM oobabooga ***@***.***> wrote: I have set the upper bound to 1.5 since this parameter is so sensitive. Thanks for the suggestion, I was not aware of encoder_repetition_penalty. — Reply to this email directly, view it on GitHub <#326 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AFMAWPPLW4GMA6Q63TBVDZTW4HE3RANCNFSM6AAAAAAV3DFWDE> . You are receiving this because you authored the thread.Message ID: ***@***.***>