Community project / Evaluations and independent research

OneJev

Apache-2.0 open multimodal System One models in four sizes (0.8B to 27B, plus a 27B FP8 build) that answer choice, score, and noul about screenshots, photos, video, and text in one forward pass through a /v1/systemone-compatible server; independent of hosted Jev.

Open the original resource ↗ See it in the full directory Start a reading list → Browse all Evaluations and independent research

Download share card ↓

This is an independent community listing. Check the source, license, data handling, and evaluation caveats before relying on a project. Inclusion is not an endorsement or security review.

Found an outdated or inaccurate detail? Report a correction →

Explore more in Evaluations and independent research

• 

  Open Alternative to Jev

  Apache-licensed Python library that reads option-token probabilities from open models through Transformers or vLLM, with packed and separate question modes, temperature scaling, benchmark scripts, and raw result files; its measurements compare modes of the same open model rather than Jev, packed answers can change with question order, and the package is not a drop-in System One API server.

  Read listing →
• 

  Open Medical Jev

  MIT-licensed independent reproduction of the Jev decision loop with two frozen open-weight readers, a fit-free confidence gate, and split-conformal candidate sets; its four-reading configuration lands within 2 points of hosted Jev 1.13.0 on three 600-item medical licensing papers without training anything, running locally on one 24 GB GPU; only the China paper is a real exam (the US and India papers are fixed-seed draws), the exam items are not redistributed, and its coverage–accuracy curve still trails hosted Jev at the highest precision tiers.

  Read listing →
• 

  OpenJev (DiffusionGemma)

  Apache-licensed decision server that reads Choice, Score, and Noul probabilities from DiffusionGemma 26B through a System One-shaped API, with NVIDIA and Apple silicon backends plus optional image input. Its NVIDIA path pins an unmerged vLLM branch, some limits differ from Jev, and answer quality needs evaluation on the reader's own tasks.

  Read listing →