tiershift GitHub avatar by iamvatsalpatel

iamvatsalpatel /

Routing & Cost Optimization

tiershift

Policy-driven model routing framework routing every LLM call to the cheapest capable tier in ~180 ms via TypeSafe Jev.

License: MITLanguage: TypeScriptLast push: 9/18/2026#llm-routing-cost#typed-decisions

What Jev Does in this Architecture

Uses declarative YAML policies evaluated by Jev discrete classification without requiring pre-collected training data.

Key Architecture Benefit

Provides unified TypeScript and Python interfaces to minimize inference spend with minimal routing overhead.

Review & Benchmark Note: Source code verified against pinned commit. Includes gate benchmarks and dual-language tests; latency depends on regional network proximity.
Clone Repository
git clone https://github.com/iamvatsalpatel/tiershift.git

Inspect on GitHub

Check out the upstream repository README, issues, and commit log.

iamvatsalpatel/tiershift

Architecture Category

Routing & Cost Optimization

Complexity-based request routing to tier generative models and optimize token spend.

View all in this category →

Related Projects in Routing & Cost Optimization

53
Routing & Cost OptimizationMITPython

Uses Jev to classify each Codex turn, then applies local rules to choose the model, reasoning effort, and speed mode.

What Jev does here

Classifies task difficulty and reasoning needs before local policy selects a model configuration.

Keeps routing policy and decision logs local for inspection and tuning.

#llm-routing-cost#coding-agents
53 evidence links
Inspect details
jev-research repository icon by sherajdev

sherajdev

jev-research

1
Routing & Cost OptimizationMITTypeScript

A Jev and Herdr integration guide with a prototype for routing tasks to different Agents.

What Jev does here

Uses task and repository state to choose an executor and assess risk and dispatch readiness.

Provides a readable, editable example of multi-Agent task routing.

#llm-routing-cost#typed-decisions
2 evidence links
Inspect details
jev-demo repository icon by minghanminghan

minghanminghan

jev-demo

0
Routing & Cost OptimizationMITTypeScript

A customer-service routing demo that batches Jev questions before following the resulting route.

What Jev does here

Assesses classification levels, human-handoff intent and frustration, with low-confidence escalation.

Combines routing and human handoff while leaving response generation to the application.

#domain-workflows#classification-ranking
4 evidence links
Inspect details