Visr Evals

Quickstart

Run Harbor Framework-compatible task evals without infra or model keys.

Run Example Eval

Example Dataset

Agent

Good first run for checking agent output with an LLM judge.

Use DockerRun isolated in Docker. All model calls use hosted credits.

1Install Visr
```
brew install sourishkrout/visr/visr
```

2Clone the Runme repo

git clone --depth 1 https://github.com/runmedev/runme.git && cd runme

3Run a trial eval

visr run examples/harbor/datasets/runme-llm-judge --agent claude-code --model sonnet

4View the results
```
visr view
```

Skip Ahead

After it runs

Inspect the eval output, run another example, or iterate on your own eval with Visr. For inspiration, browse Harbor's Docker-only tasks.

Free credits

$10

Start your first hosted eval runs on us.

Claim $10 now

How it works

Run task evals locally with the agents you already have installed.
Claude Code, Codex, and others use your existing subscription when available.
Without one, Visr falls back to hosted credits.
Docker runs use hosted credits for strict isolation.

Agent workflow evals

Turn coding-agent runs into a team benchmark.

Visr helps teams test the agentic workflows they actually rely on: Harbor Framework task evals, Claude Code sessions, Codex runs, Cursor habits, OpenClaw playbooks, MCP toolchains, repo instructions, skills, and the prompts that bind them together.

Benchmark real agent work

Capture repeatable task evals from real repositories, then compare agents, prompts, skills, and models against the same evidence.

Score team-specific outcomes

Use criteria that match your codebase: tool use, source quality, command discipline, artifact shape, and regression behavior.

Run local or isolated trials

Exercise the same workflow locally with existing agent CLIs, or switch to Docker when a sandboxed benchmark run matters.

Promote what holds up

Package proven workflows so Claude, Codex, Cursor, OpenClaw, and MCP-backed agents inherit behavior your team has tested.