loki GitHub avatar by wundercorp

wundercorp /

Routing & Cost Optimization

loki

Loki optionally adds Jev typed-judgment tools and routes a new session to a model within the selected gateway.

License: MITLanguage: PythonLast push: 9/17/2026#llm-routing-cost#mcp-integrations#typed-decisions

What Jev Does in this Architecture

Assesses the first task’s capability needs; local policy chooses a same-gateway model and keeps the route sticky.

Key Architecture Benefit

Makes model routing explicit while retaining the selected route for the session.

Review & Benchmark Note: The README describes companion tools and session routing, not a guaranteed completion referee. Cost effects were not measured here.
Clone Repository
git clone https://github.com/wundercorp/loki.git

Inspect on GitHub

Check out the upstream repository README, issues, and commit log.

wundercorp/loki

Architecture Category

Routing & Cost Optimization

Complexity-based request routing to tier generative models and optimize token spend.

View all in this category →

Related Projects in Routing & Cost Optimization

53
Routing & Cost OptimizationMITPython

Uses Jev to classify each Codex turn, then applies local rules to choose the model, reasoning effort, and speed mode.

What Jev does here

Classifies task difficulty and reasoning needs before local policy selects a model configuration.

Keeps routing policy and decision logs local for inspection and tuning.

#llm-routing-cost#coding-agents
53 evidence links
Inspect details
jev-research repository icon by sherajdev

sherajdev

jev-research

1
Routing & Cost OptimizationMITTypeScript

A Jev and Herdr integration guide with a prototype for routing tasks to different Agents.

What Jev does here

Uses task and repository state to choose an executor and assess risk and dispatch readiness.

Provides a readable, editable example of multi-Agent task routing.

#llm-routing-cost#typed-decisions
2 evidence links
Inspect details
jev-demo repository icon by minghanminghan

minghanminghan

jev-demo

0
Routing & Cost OptimizationMITTypeScript

A customer-service routing demo that batches Jev questions before following the resulting route.

What Jev does here

Assesses classification levels, human-handoff intent and frustration, with low-confidence escalation.

Combines routing and human handoff while leaving response generation to the application.

#domain-workflows#classification-ranking
4 evidence links
Inspect details