-
Notifications
You must be signed in to change notification settings - Fork 1.4k
feat(mistral): add FIM support for codestral models #3856
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
|
1871d6f to
1bcbaca
Compare
1bcbaca to
00c6fda
Compare
- Add supportsFim(), completeFim(), and streamFim() methods to MistralHandler - FIM support is only enabled for codestral models (codestral-latest, codestral-2405, etc.) - Uses Mistral's v1/fim/completions endpoint with proper base URL routing - Supports both streaming and non-streaming FIM completions - Add comprehensive test coverage with 10 test cases - Update continuedev Mistral LLM to accurately check model support - Implementation follows the same pattern as KiloCode OpenRouter handler Closes: FIM functionality now works for Mistral's codestral models
00c6fda to
75b04e9
Compare
| })), | ||
| } | ||
| }) | ||
| // kilocode_change - new file |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
no it isnt smartass llm
| return finalOptions | ||
| } | ||
|
|
||
| // kilocode_change start |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
unnecessary
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
(but we dont care about this file)
- Removed incorrect 'new file' marker from mistral.spec.ts - Restored original test structure to minimize changes - Created new mistral-fim.spec.ts for FIM-specific tests - All tests passing

Closes: FIM functionality now works for Mistral's codestral models
Context
Implementation
Screenshots
How to Test
Get in Touch