FastAPI Chatbot with Orpheus TTS

[jjmlovesgit]

FastAPI chatbot with Realtime Orpheus Streaming Audio responses in 100ms

For those who want to try it:

https://github.com/jjmlovesgit/Orpheus_Edge_FastAPI

brief overview and demo explanation --- https://youtu.be/47YhYkwGd60

fastapi_orpheus_TTS.mp4

Gd60

[jjmlovesgit]

V2

simli_Orph_Fastapi.mp4

[jjmlovesgit]

simli_Orph_Fastapi.mp4

[jjmlovesgit]

UPDATE: Code pushed for longer format responses that can span multiple minutes if required:

repo: https://github.com/jjmlovesgit/Orpheus_Edge_FastAPI

Demo: https://youtu.be/jcUD9Gmh5t8

[jjmlovesgit]

YouTube: https://youtu.be/BO4CdFMhnjU

[jjmlovesgit]

Ok here is the Avatar with Orpheus -- this is latested DeepSeek R1 8B on Ollama and Orpheus FP16 on LM Studio with a thinking mode switch that can be turned on or off -- off for this one so we get the output w/o thoughts...

https://youtu.be/NwwCPCH_FBo

[jjmlovesgit]

Orpheus with DeepSeek-r1 with a toggle for "Thinking" mode... go fast or slow... she calls me "Regular" as in regular customer... need to tweak the prompt as that's lame...

shortdemo.mp4