TokenTrim /
Evaluation & Observabilityjev-agent-failure-benchmark
A benchmark using Jev to attribute multi-Agent failures to an Agent, step and error type.
What Jev Does in this Architecture
Key Architecture Benefit
Provides evaluation scripts and author results; some baselines generate answers while Jev selects candidates.
Reviewed Source Code Evidence
Verified fixed-commit source files demonstrating genuine Jev integration:
Inspect on GitHub
Check out the upstream repository README, issues, and commit log.
TokenTrim/jev-agent-failure-benchmarkArchitecture Category
Evaluation & Observability
Evaluation harnesses, latency profiling, tracing, and telemetry for Jev decisions.
View all in this category →Related Projects in Evaluation & Observability
NiazMorshed2007
jev-review
A local MCP code-quality reviewer returning structured scores to coding Agents.
Jev scores correctness, complexity, tests and security; code ranks areas to improve.
↳ Compares scores across checkpoints while leaving code changes to the primary Agent.
AbdelStark
jev-benchmarks
A benchmark comparing Jev and GLiNER on text classification, probability calibration and selective automation.
Runs the same labeled text tasks through both backends and records probabilities, latency and failures.
↳ Helps examine task-specific accuracy and whether confidence scores support chosen thresholds.
mizchi
jev-playground
A MoonBit and TypeScript Jev playground covering games, browsers, command risk and small languages.
Experiments send action candidates or typed questions to Jev, then execute or record the answers.
↳ Includes source, experiment notes and some offline replays for comparing decision designs.