Skip to content

[MLOB-5481] feat: add basic mcp server with tool to query llmobs span events#267

Draft
sabrenner wants to merge 8 commits intomasterfrom
sabrenner/llmobs-mcp-server
Draft

[MLOB-5481] feat: add basic mcp server with tool to query llmobs span events#267
sabrenner wants to merge 8 commits intomasterfrom
sabrenner/llmobs-mcp-server

Conversation

@sabrenner
Copy link
Contributor

@sabrenner sabrenner commented Feb 6, 2026

adds a basic in-house mcp server to query llmobs span events with a basic filter pattern (without needing to specify datadog query syntax).

  • has a basic dev tooling for adding new tools without needing to specify all functions out specifically, they are interpreted from how they are implemented (needing docstrings, etc.)
  • implements a get_llmobs_span_events tool with filters to limit context usage for agents

follow-ups/improvements

  • tool for querying custom evaluation metrics (might require joining, we should implement it first for the llmobs platform in general so it can be used on the frontend)
  • add some tests (?)

@sabrenner sabrenner changed the title feat: add basic mcp server with tool to query llmobs span events [MLOB-5481] feat: add basic mcp server with tool to query llmobs span events Feb 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant