Community project / Evaluations and independent research

Verdict

Apache-2.0 118M multilingual bi-encoder for Choice, Score, and Noul on a System One-compatible endpoint, with temperature scaling and optional split-conformal abstention whose coverage depends on its calibration assumptions; it can run locally on CPU or in a browser through ONNX, and the author's reported calibration and typed-decision results are task-specific, including a lower score than Laya on the published typed-decision suite.

Open the original resource ↗ See it in the full directory Start a reading list → Browse all Evaluations and independent research

Download share card ↓

This is an independent community listing. Check the source, license, data handling, and evaluation caveats before relying on a project. Inclusion is not an endorsement or security review.

Found an outdated or inaccurate detail? Report a correction →

Explore more in Evaluations and independent research

• 

  Von

  Open local Choice, Noul, and Score model with public weights, training code, and a System One-shaped API. Benchmark comparisons are author-reported: its README gives a 91.23% accuracy headline without a matching result artifact in the repo, while its 49-task table reports 71.5% macro accuracy.

  Read listing →
• 

  When a Judgment Layer’s Self-Reported Fields Lie

  Independent measurement of Jev’s typed decisions as one of three judgment layers run on identical items (Laya locally, Jev and a frontier model remotely), with per-call ledger-based cost accounting and Murphy/Brier/ECE calibration against binary ground truth; the Jev-specific findings are a verdict vocabulary reaching three values where six are documented, and a sufficient field that does not separate thin evidence from contradictory evidence, and the claim about contradiction rests on seven live readings that have no JSON artifact behind them, which the write-up states in its own errata rather than leaving to be discovered.

  Read listing →
• 

  Awesome Jev Robustness

  Curated index of independent Jev tests grouped by calibration, consistency, perturbation, injection, abstention, failure modes, and language; it links original sources, reports their numbers as author findings, and keeps task benchmarks without a robustness angle in a separate data file.

  Read listing →