Skip to content

feat(providers): add Rapid-MLX provider#1361

Open
raullenchai wants to merge 1 commit intoanomalyco:devfrom
raullenchai:feat/add-rapid-mlx-provider
Open

feat(providers): add Rapid-MLX provider#1361
raullenchai wants to merge 1 commit intoanomalyco:devfrom
raullenchai:feat/add-rapid-mlx-provider

Conversation

@raullenchai
Copy link
Copy Markdown

Summary

Adds Rapid-MLX as a new local
provider. Rapid-MLX is an OpenAI-compatible inference server for Apple
Silicon, built on mlx-lm.

Files

  • providers/rapid-mlx/provider.toml — provider entry, mirrors the
    existing lmstudio provider (uses @ai-sdk/openai-compatible).
  • providers/rapid-mlx/models/... — a small set of representative
    MLX-quantized models. More can be added incrementally.

Notes

  • Pattern follows the existing lmstudio provider. No code changes.
  • Model IDs match the exact strings users pass to rapid-mlx serve.
  • Tool calling is supported via Rapid-MLX's parser layer.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant