awesomejev

Community project / Evaluations and independent research

JevBench

Independent cross-model benchmark for typed decisions with 534 frozen cases per complete entrant, source adapters, scoring code, public per-task outcomes, and aggregate result artifacts. Its four-axis score includes accuracy, calibration, latency, and cost; some self-hosted latency is adjusted by assumption, hosting costs can be estimates, and withheld cases are exposed to the services being measured.

Open the original resource ↗ See it in the full directory Browse all Evaluations and independent research
Awesome Jev share card for JevBench Download share card

Share this listing

Maintaining this project? Share its link, badge, or image. Listed means included, not endorsed.

Download share card

This is an independent community listing. Check the source, license, data handling, and evaluation caveats before relying on a project. Inclusion is not an endorsement or security review.

Found an outdated or inaccurate detail? Report a correction →

Explore more in Evaluations and independent research

  • jevmlx

    MIT-licensed local decision layer for Apple Silicon that scores constrained Boolean, enum, and multi-select fields from MLX model logits in one prefill, returns schema-valid JSON, and offers a System One-compatible endpoint and benchmark runner; probabilities are over the supplied options and need calibration against labeled task data.

    Read listing →

  • Kev

    Apache-licensed, locally runnable Jev-style Choice, Score, and Noul models at 0.8B, 4B, and 9B, with released weights, training code, a System One-compatible server, frozen evaluation suites, and a playground. Its author reports a 0.822 new-source development accuracy for Kev-9B against 0.857 for hosted Jev on that suite, but Jev's training data is unknown, so this is not a controlled architecture comparison; test calibration and option order on your own data before setting a decision threshold.

    Read listing →

  • Laya

    Open local Choice, Score, and Noul decision models with published checkpoints and a router for English and multilingual inputs; its Jev comparisons use different prompts and sample sizes rather than a controlled head-to-head, and raw calibration and some languages remain weak.

    Read listing →