Documentation
Evals.si is one entrypoint for evaluating classic ML models, LLMs, RAG systems and agents, offline and online.
Start here
Section titled “Start here”- Get started: install (PyPI, release binaries, charts) and run your first evaluation in a minute.
- Changelog: what changed in each release.
- Examples: runnable configs for runs, agents, guardrails, fine-tuning and more.
- Agent frameworks: score LangGraph, CrewAI, OpenAI Agents SDK, LlamaIndex and Claude Agent SDK traces.
- Trace sources: score the traces you already keep in MLflow, Phoenix or Langfuse.
- Operations: upgrade policy, backup and restore, runbooks and reference cluster values.
Guides
Section titled “Guides”- agent runs
- annotation
- fine tuning
- guardrails
- identity
- kubernetes
- agentgateway kubernetes
- mcp
- plugins
- web ui
- webhooks
- trace sources
- integrate an agent harness
- agent frameworks
- operations
- end to end