awesomejev

Community project / Evaluations and independent research

Jev Rerank Bench

Reranking comparison with raw provider responses, scoring code, dataset-level results, uncertainty intervals, and documented limitations.

Open the original resource ↗ See it in the full directory Browse all Evaluations and independent research
Awesome Jev share card for Jev Rerank Bench Download share card

Share this listing

Maintaining this project? Share its link, badge, or image. Listed means included, not endorsed.

Download share card

This is an independent community listing. Check the source, license, data handling, and evaluation caveats before relying on a project. Inclusion is not an endorsement or security review.

Found an outdated or inaccurate detail? Report a correction →

Explore more in Evaluations and independent research

  • Jev Spam Eval

    Exploratory zero-shot spam study against trained TF-IDF baselines, including results and explicit post-hoc-tuning caveats.

    Read listing →

  • jev-calibration-audit

    Independent Jev-1.13.0 audit with reproducible code and per-call JSONL: tests abstention options, matched Korean and English items, question-shape interference, and option order; its strong abstention finding is on the KoBBQ dataset, not a universal calibration guarantee.

    Read listing →

  • jev-certify

    Early Python toolkit and CLINC150 study of conformal routing thresholds and prediction-powered audits over Jev 1.13 through OpenRouter, with request plans, 2,412 journalled answers and usage records, analysis code, and tests; its per-incoming-query risk bound depends on matching calibration and deployment traffic, and the study shows the scope gate missing its target after out-of-scope prevalence shifts while fallback accuracy remains unmeasured.

    Read listing →