Demo of Mistral plugged into Retell, see the demo.
- First install dependencies
poetry install-
Fill out the API keys in
env.sh -
In another bash, use
ngrokorcloudflaredto expose the port8080to public network.
make host-url- Update the host name and export the environment variables.
source env.sh
- Start the websocket server
make app-startThe custom LLM URL (to enter in Retell) would look like
wss://henry-corrected-julia-drive.trycloudflare.com/llm-websocket
