Skip to content

[Feature Request] Support diffuser model: Dream #7147

@Katehuuh

Description

@Katehuuh

When run Dream-v0-Instruct-7B-Q4_K_M.gguf or DiffuCoder,DreamOn,Dream-Coder with llama_cpp_binaries-0.31.0 i get: JSON decode error: Expecting value: line 1 column 1 (char 0) Problematic line: error: {"code":500,"message":"the current context does not logits computation. skipping","type":"server_error"}

GGUF already supports diffusion: Dream 7B#14644.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions