Feature request: Anthropic messaging API support (just landed in llama.cpp)

[kinchahoy]

Would it be possible / easy to expose the new anthropic messaging support in llama.cpp to enable use with Claude?

Anthropic messages API

It's basically just exposing a new(?) /v1/messages endpoint.

[mostlygeek]

It should already be supported, see #417

[simcop2387]

It'd be nice to have this also support the token counting endpoint as claude and other tools use it for determining when to compact the session automatically. I'll probably try to make a PR for this later today.

[kinchahoy]

That's awesome! +1 to token counting endpoint. I'll test out the messaging API - thanks!