Awesome Jev / Routing & Cost Optimization

Routing & Cost Optimization

Complexity-based request routing to tier generative models and optimize token spend.

Back to All Projects26 reviewed repositories
53
Routing & Cost OptimizationMITPython

Uses Jev to classify each Codex turn, then applies local rules to choose the model, reasoning effort, and speed mode.

What Jev does here

Classifies task difficulty and reasoning needs before local policy selects a model configuration.

Keeps routing policy and decision logs local for inspection and tuning.

#llm-routing-cost#coding-agents
53 evidence links
Inspect details
jev-research repository icon by sherajdev

sherajdev

jev-research

1
Routing & Cost OptimizationMITTypeScript

A Jev and Herdr integration guide with a prototype for routing tasks to different Agents.

What Jev does here

Uses task and repository state to choose an executor and assess risk and dispatch readiness.

Provides a readable, editable example of multi-Agent task routing.

#llm-routing-cost#typed-decisions
2 evidence links
Inspect details
jev-demo repository icon by minghanminghan

minghanminghan

jev-demo

0
Routing & Cost OptimizationMITTypeScript

A customer-service routing demo that batches Jev questions before following the resulting route.

What Jev does here

Assesses classification levels, human-handoff intent and frustration, with low-confidence escalation.

Combines routing and human handoff while leaving response generation to the application.

#domain-workflows#classification-ranking
4 evidence links
Inspect details
Routing & Cost OptimizationMITTypeScript

A model-routing playground where Jev picks a candidate and users compare the resulting answers.

What Jev does here

Selects a model from the task and candidate profiles and records probabilities and runs.

Exports observations for checking routing choices against user preferences.

#llm-routing-cost#evaluation-benchmarks
2 evidence links
Inspect details
oh-my-pi repository icon by can1357

can1357

oh-my-pi

31,850
Routing & Cost OptimizationMITTypeScript

Oh My Pi includes an optional TypeSafe judgment provider for bounded decisions in coding-agent workflows.

What Jev does here

Sends agent state and typed questions to Jev and parses structured answers.

Adds a replaceable judgment provider to existing agent workflows.

#coding-agents#multilanguage-sdk#typed-decisions
33633 evidence links
Inspect details
litellm repository icon by BerriAI

BerriAI

litellm

59,123
Routing & Cost OptimizationMITTypeScript

LiteLLM can use Jev to classify requests for its complexity-based model router.

What Jev does here

Maps requests to configured complexity classes that drive backend routing.

Makes the complexity judgment behind routing inspectable.

#llm-routing-cost#multilanguage-sdk
115694 evidence links
Inspect details
firstmate repository icon by kunchenguid

kunchenguid

firstmate

6,587
Routing & Cost OptimizationMITShell

Firstmate can optionally use Jev to match task briefs to dispatch rules before local policy chooses an Agent configuration.

What Jev does here

Sends the task brief and candidate rules to Jev, then resolves execution profiles with confidence and local conditions.

Separates semantic matching from the final dispatch policy.

#llm-routing-cost#coding-agents
20072 evidence links
Inspect details
openchamber repository icon by openchamber

openchamber

openchamber

10,060
Routing & Cost OptimizationMITTypeScript

OpenChamber’s optional automatic model router uses Jev to classify a message before selecting a configured model and reasoning level.

What Jev does here

Jev selects a task category; local category mappings determine the model configuration.

Keeps routing categories and their model assignments explicit.

#llm-routing-cost#coding-agents
11052 evidence links
Inspect details
atomic repository icon by bastani-inc

bastani-inc

atomic

806
Routing & Cost OptimizationCustom licenseTypeScript

An optional Jev decision backend in the Atomic coding Agent for bounded structured choices such as routing.

What Jev does here

Sends predefined questions to Jev and decodes answers for callers; regular models still generate code.

Separates structured decisions from text-generation interfaces.

#coding-agents#llm-routing-cost
1123 evidence links
Inspect details
WrongStack repository icon by WrongStack

WrongStack

WrongStack

329
Routing & Cost OptimizationMITTypeScript

An optional Jev dispatch classifier for choosing among WrongStack specialist Agents.

What Jev does here

Jev evaluates the task against eligible specialists; local dispatch rules use the result.

Makes specialist selection a configurable step in an existing coding Agent.

#coding-agents#llm-routing-cost
363 evidence links
Inspect details
420
Routing & Cost OptimizationMITPython

An optional Jev routing path that matches VexJoy requests to specialist Agents, skills and workflows.

What Jev does here

After deterministic routing guards, Jev judges the remaining candidates and required workflow components.

Keeps repeatable routing rules and model-selected candidates in separate stages.

#llm-routing-cost#mcp-integrations
442 evidence links
Inspect details
165
Routing & Cost OptimizationMITTypeScript

A self-hosted, versioned Agent skills library with optional Jev recommendations.

What Jev does here

Jev scores task relevance among skills the client is allowed to access.

Suggests relevant skills while retaining the library’s client access scope.

#llm-routing-cost#mcp-integrations
142 evidence links
Inspect details
29
Routing & Cost OptimizationMITTypeScript

An experimental semantic HTTP router for Hono using natural-language route descriptions.

What Jev does here

Jev scores request-to-description matches; code selects the first route above its threshold.

Explores semantic routing; the author explicitly warns against using it for authentication or authorization.

#multilanguage-sdk#classification-ranking
2 evidence links
Inspect details
JevRouter repository icon by BillionsBobby

BillionsBobby

JevRouter

28
Routing & Cost OptimizationMITTypeScript

Routes among models, subagents, skills, MCP tools and CLIs using a shared candidate set.

What Jev does here

Jev makes a Choice; the router separately checks availability, permissions, risk and confirmation policy.

Records model choices separately from execution policy.

#llm-routing-cost#mcp-integrations#cli-git-gates
13 evidence links
Inspect details
todo-jev repository icon by maker-KK

maker-KK

todo-jev

2
Routing & Cost OptimizationMITPython

A task-routing experiment combining skill conditions and environment checks to suggest rules, skills or a large model.

What Jev does here

Jev classifies requests and matches skills, with heuristic fallback when unavailable.

Classification and recommendations are implemented; execution handlers still return examples and need real integrations.

#llm-routing-cost#typed-decisions
13 evidence links
Inspect details
30,779
Routing & Cost OptimizationMITPython

A community Claude Code Templates mod that uses Jev to suggest subagent models and reasoning levels.

What Jev does here

Evaluates task tier, reasoning needs and production risk; local policy maps results to invocation settings.

Makes routing rules and per-request choices explicit and configurable.

#llm-routing-cost#coding-agents
34944 evidence links
Inspect details
loki repository icon by wundercorp

wundercorp

loki

24
Routing & Cost OptimizationMITPython

Loki optionally adds Jev typed-judgment tools and routes a new session to a model within the selected gateway.

What Jev does here

Assesses the first task’s capability needs; local policy chooses a same-gateway model and keeps the route sticky.

Makes model routing explicit while retaining the selected route for the session.

#llm-routing-cost#mcp-integrations#typed-decisions
63 evidence links
Inspect details
Routing & Cost OptimizationMITPython

An opt-in Hermes Agent plugin that asks Jev to suggest one relevant skill before a model call.

What Jev does here

Compares the request with the skill roster; inserts a suggestion only when suitable and abstains on failure.

Adds a targeted skill hint that the Agent can still ignore.

#llm-routing-cost#mcp-integrations
12 evidence links
Inspect details
jev-router repository icon by gargpratyush

gargpratyush

jev-router

174
Routing & Cost OptimizationMITJavaScript

A Claude Code and CLI proxy that asks Jev to score task complexity and pick a model from the account’s available set.

What Jev does here

Scores task, reasoning, and tool complexity, then chooses among the exact models the account can run; failures keep the current model.

Makes model choice an inspectable closed-set decision, and never blocks a prompt when Jev is down.

#llm-routing-cost#coding-agents
116 evidence links
Inspect details
Routing & Cost OptimizationMITTypeScript

An OpenCode orchestrator that keeps a cheap sticky parent model and, when Jev flags a hard turn, escalates through a child subagent.

What Jev does here

Scores task, reasoning, and tool complexity, then chooses fast / balanced / strong / long; local policy stays, escalates, or fans out.

Keeps a cheap sticky parent model and opens a stronger child only when Jev flags a hard turn.

#llm-routing-cost#coding-agents
2 evidence links
Inspect details
tiershift repository icon by iamvatsalpatel

iamvatsalpatel

tiershift

2
Routing & Cost OptimizationMITTypeScript

Policy-driven model routing framework routing every LLM call to the cheapest capable tier in ~180 ms via TypeSafe Jev.

What Jev does here

Uses declarative YAML policies evaluated by Jev discrete classification without requiring pre-collected training data.

Provides unified TypeScript and Python interfaces to minimize inference spend with minimal routing overhead.

#llm-routing-cost#typed-decisions
2 evidence links
Inspect details
Janus repository icon by FirasSX914

FirasSX914

Janus

2
Routing & Cost OptimizationMITPython

Framework for measuring when to employ Jev versus generative LLMs on proprietary datasets, routing queries based on measured benchmarks.

What Jev does here

Benchmarks Jev response accuracy and latency via a TypeSafe provider integration, deriving empirical routing policies.

Replaces intuition with empirical data when adopting discrete decision models, optimizing overall cost while preserving task success.

#llm-routing-cost#evaluation-benchmarks
2 evidence links
Inspect details
0
Routing & Cost OptimizationMITTypeScript

A gateway that asks Jev continue / tool / verify questions and invokes a generative LLM only when policy says generation is needed.

What Jev does here

TypeSafeClient.systemOne answers policy questions; the adapter then decides whether a generative model runs.

Places expensive generation behind a Jev gate. Author-reported call savings were not retested here.

#llm-routing-cost#typed-decisions#coding-agents
5 evidence links
Inspect details
jev-router repository icon by prismhq

prismhq

jev-router

3
Routing & Cost OptimizationMITTypeScript

An open-source LLM router built on LiteLLM and Jev: dynamically routes requests based on task complexity and context.

What Jev does here

Evaluates reasoning requirements of input prompts via single forward pass, delegating dispatch to LiteLLM.

Achieves high-throughput prompt triage and cost optimization without brittle heuristic regexes.

#llm-routing-cost#typed-decisions
4 evidence links
Inspect details
pi-jev-router repository icon by mejiasd3v

mejiasd3v

pi-jev-router

7
Routing & Cost OptimizationMITTypeScript

Automatic model router for Pi coding assistant: integrates Jev via Vercel AI Gateway to dispatch tasks efficiently.

What Jev does here

Quickly estimates task complexity from code context and user query, routing between SLMs and frontier models.

Brings out-of-the-box intelligent cost-saving routing directly into the Pi terminal workflow.

#llm-routing-cost#typed-decisions
3 evidence links
Inspect details
jev-router repository icon by rajdhakad9826

rajdhakad9826

jev-router

4
Routing & Cost OptimizationMITTypeScript

Cost-aware LLM router that picks the cheapest model capable of handling a query, using TypeSafe's Jev for fast classification instead of an LLM call.

What Jev does here

Jev returns a structured decision for the local program; consult the source for the exact decision policy.

Adds structured choices or scores to the workflow; performance and cost benefits have not been independently verified.

#llm-routing-cost#typed-decisions
8 evidence links
Inspect details

Explore Other Architecture Categories

Explore Jev Decision Workflows