jev-search-rerank-eval GitHub avatar by zhuyansen

zhuyansen /

Data & Search

jev-search-rerank-eval

Retrieval evaluation system measuring Jev reranking against lexical, embedding, and fusion baselines across 9,831 query-document pairs.

License: MITLanguage: PythonLast push: 9/18/2026#search-retrieval#evaluation-benchmarks#classification-ranking

What Jev Does in this Architecture

Invokes Jev judges to grade multi-level relevance on bilingual queries, evaluating ranking metrics and judge-circularity effects.

Key Architecture Benefit

Provides rigorous empirical evidence comparing discrete judgment rerankers against vector search in multilingual discovery contexts.

Review & Benchmark Note: Source code verified against pinned commit. Complete evaluation suite and CLI inspected; benchmarked on Agent Skills Hub data.
Clone Repository
git clone https://github.com/zhuyansen/jev-search-rerank-eval.git

Inspect on GitHub

Check out the upstream repository README, issues, and commit log.

zhuyansen/jev-search-rerank-eval

Architecture Category

Data & Search

Search intent classification, query routing, vector re-ranking, and ETL triage.

View all in this category →

Related Projects in Data & Search

pg-jev repository icon by realZachi

realZachi

pg-jev

179
Data & SearchPostgreSQLShell

Adds natural-language filtering, classification, and ranking of rows to PostgreSQL queries.

What Jev does here

Sends row content to Jev for a match decision, category, or score used by SQL conditions and ordering.

Combines semantic conditions with existing SQL and reuses cached results.

#database-vector#classification-ranking
103 evidence links
Inspect details
jev-search repository icon by superagents-lab

superagents-lab

jev-search

146
Data & SearchMITTypeScript

Searches the web with Jev choosing sources and time ranges, then ranking returned links.

What Jev does here

Judges search intent, source and time settings, and relevance of individual results.

Keeps links, snippets, editable filters and source-failure warnings visible.

#search-retrieval#classification-ranking
222 evidence links
Inspect details
llama-index-jev repository icon by WiktorB2004

WiktorB2004

llama-index-jev

2
Data & SearchMITPython

Provides Jev rerankers and routers for LlamaIndex to score retrieved passages or select query tools.

What Jev does here

Uses Score for passage relevance and Choice for selecting query engines or tools.

Adds Jev judgments to existing retrieval and query workflows.

#search-retrieval#classification-ranking#llm-routing-cost
2 evidence links
Inspect details