Semantic-aware Classifier-Free Guidance (S-CFG)

[v0xie]

• Adds S-CFG (https://arxiv.org/abs/2404.05384)
  • Handles non square resolutions
  • Optimize memory consumption

Built upon on the code from the official repository: https://github.com/SmilesDZgk/S-CFG
Currently incompatible with PAG as both scripts modify the noise prediction.
Needs more memory optimization - limiting size of attention maps used in calculation
R is a hyperparameter set to 4 by default