Add support for video/audio formats for multimodal inputs

[rahulgurnani]

What type of PR is this?

What this PR does / why we need it:

Presently, only image is supported for multimodal inputs. vllm supports video/audio formats as well: https://docs.vllm.ai/en/stable/features/multimodal_inputs/

Which issue(s) this PR fixes:

Addresses #1980

Does this PR introduce a user-facing change?:

Support for video and audio formats for multimodal models.

[netlify]

✅ Deploy Preview for gateway-api-inference-extension ready!

Name	Link
🔨 Latest commit	1883dd3
🔍 Latest deploy log	https://app.netlify.com/projects/gateway-api-inference-extension/deploys/696e3769fe074b0008c5f1e9
😎 Deploy Preview	https://deploy-preview-2181--gateway-api-inference-extension.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify project configuration.

[ahg-g]

Addresses #1980

This doesn't address #1980 which as it is written right now includes prefix-cache multi-modal support

[rahulgurnani]

Addresses #1980

This doesn't address #1980 which as it is written right now includes prefix-cache multi-modal support

yeah, I used "addresses" not "fixes" to imply it addresses it partly. But I agree with you to keep the 2 issues separate for better tracking the progress. I updated the scope of the issue to reflect the same. Thanks!

[ahg-g]

/lgtm
/approve

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: ahg-g, rahulgurnani

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details

Needs approval from an approver in each of these files:

• OWNERS [ahg-g]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment