-
Notifications
You must be signed in to change notification settings - Fork 164
Implement mcp-sse-client-server locally with ollama and mistral #1606
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
First error: |
|
Thanks! @jmartisk do you want to take a look at the bug that this PR surfaces? |
|
I pushed an update to the PR, but it seems that the model you have chosen does not support tools: |
My example started from https://github.com/eugenp/tutorials/blob/master/quarkus-modules/quarkus-mcp-langchain/quarkus-mcp-client/src/main/resources/application.properties I see: |
|
Right, I changed it because those values are wrong |
|
Updated the configuration It is slow on my machine, but I have also |
|
Can |
|
I was able to get your sample to work and now I'm looking into the warning you are seeing.
No, they are totally different things |
|
@diegolovison What you can do is the following: quarkus.langchain4j.timeout=1000s
quarkus.vertx.max-worker-execute-time=${quarkus.langchain4j.timeout} |
|
Ready for review |
samples/mcp-sse-client-server/mcp-client/src/main/resources/application.properties
Outdated
Show resolved
Hide resolved
cescoffier
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Could you use a profile to avoid overriding the default implementation, like %ollama.
This comment has been minimized.
This comment has been minimized.
Do you mean something like ( First time contributing to quarkus / I read https://quarkus.io/guides/config-reference ): But how about <dependency>
<groupId>io.quarkiverse.langchain4j</groupId>
<artifactId>quarkus-langchain4j-openai</artifactId>
</dependency>
<dependency>
<groupId>io.quarkiverse.langchain4j</groupId>
<artifactId>quarkus-langchain4j-ollama</artifactId>
</dependency> |
|
Yes, you will need both extensions. We would need to see if each profile needs to be extended a bit to ensure it works in both cases. We do something similar in https://github.com/cescoffier/langchain4j-deep-dive/blob/main/2-ai-services/5-langchain4j-ai-service-chat-memory/src/main/resources/application.properties |
|
On Maven, it must be a different dependency. The default should be |
They can if you set |
|
Done |
Status for workflow
|
Implement mcp-sse-client-server locally with ollama and mistral
See the discussion on #1605