Skip to content

0.2.22

Choose a tag to compare

@marella marella released this 12 Aug 15:22

Changes

  • Add experimental CUDA support for StarCoder, StarChat models
  • Add gpt_bigcode as model type for StarCoder, StarChat models
  • Fix loading GPTQ models from a local path