Support for zero-terminal SNR noise schedule + velocity prediction models using the XL arch

[caith-h]

Basically asking for support for models trained on zero-terminal SNR noise schedule and velocity prediction such as the terminus series.

Huggingface link:
https://huggingface.co/ptx0/terminus-xl-gamma-v1

Current version:
https://huggingface.co/ptx0/terminus-xl-gamma-training

Reason? These fully trained from scratch models are significantly cheaper to train, requiring only a single A100 card.

While they outperform base sdxl in a significant amount of prompts, they are currently lacking Lora support, which would really help push them to the next level.

[bghira]

it uses XL arch, but kohya complains about the v-pred being 2.x only, and training results in broken model.

[feffy380]

--v_parameterization and --zero_terminal_snr have been available for ages already.
EDIT: ah, looks like support was never added to the SDXL scripts. You should amend the title to specifically mention SDXL, because they're already implemented for 1.x and 2.x

[bghira]

that's what the comment i left after says.

[Goldenkoron]

I am waiting for these to be added for SDXL as well.

[Seedmanc]

Does anybody have these terminus models in safetensors format (or any other SDXL zero-termal ones)? The author's being an ass about putting them in single file and it's a pain to compile everything on your own. Can't find any other working SDXL ztsnr models either.

[kohya-ss]

I've heard that the V-Pred version of NoobAI-XL enables ZTSNR. https://civitai.com/models/833294/noobai-xl-nai-xl

[kohya-ss]

This is supported on #1715.

[bghira]

it seems there are still issues due to the gray results obtained in that pull request though. there are a lot of vpred related options and it is not clear how to enable it simply.