4esv /
Evaluation & Observabilityjev-eval
Compares Jev and OpenRouter models on labeled tasks for accuracy, calibration, latency and cost.
What Jev Does in this Architecture
Key Architecture Benefit
Publishes data processing, runner and statistics code with model-specific results.
Reviewed Source Code Evidence
Verified fixed-commit source files demonstrating genuine Jev integration:
Architecture Category
Evaluation & Observability
Evaluation harnesses, latency profiling, tracing, and telemetry for Jev decisions.
View all in this category →Related Projects in Evaluation & Observability
NiazMorshed2007
jev-review
A local MCP code-quality reviewer returning structured scores to coding Agents.
Jev scores correctness, complexity, tests and security; code ranks areas to improve.
↳ Compares scores across checkpoints while leaving code changes to the primary Agent.
AbdelStark
jev-benchmarks
A benchmark comparing Jev and GLiNER on text classification, probability calibration and selective automation.
Runs the same labeled text tasks through both backends and records probabilities, latency and failures.
↳ Helps examine task-specific accuracy and whether confidence scores support chosen thresholds.
mizchi
jev-playground
A MoonBit and TypeScript Jev playground covering games, browsers, command risk and small languages.
Experiments send action candidates or typed questions to Jev, then execute or record the answers.
↳ Includes source, experiment notes and some offline replays for comparing decision designs.