Skip to content

[Model]: Does vllm currently support the Llama-3.1-405B-Instruct multimodal ?  #7503

@jasonstens

Description

@jasonstens

Your current environment

torch 2.3.1

🐛 Describe the bug

If so, could you provide an example script?

Metadata

Metadata

Assignees

No one assigned

    Labels

    new-modelRequests to new models

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions