Community project / Evaluations and independent research

jevos

MIT-licensed 1B yes/no model released as a q4_k_m GGUF that runs on CPU with llama.cpp behind a Jev-compatible /v1/systemone endpoint; it answers only Noul questions, and Choice and Score requests return 422. The authors report 0.815 accuracy against 0.927 for hosted Jev on 2,000 questions from unseen policies, but the training code and evaluation set are not published, so that result cannot be reproduced from the repository.

Open the original resource ↗ See it in the full directory Start a reading list → Browse all Evaluations and independent research

Download share card ↓

This is an independent community listing. Check the source, license, data handling, and evaluation caveats before relying on a project. Inclusion is not an endorsement or security review.

Found an outdated or inaccurate detail? Report a correction →

Explore more in Evaluations and independent research

• 

  Kev

  Apache-licensed, locally runnable Jev-style Choice, Score, and Noul models at 0.8B, 4B, and 9B, with released weights, training code, a System One-compatible server, frozen evaluation suites, and a playground. Its author reports a 0.822 new-source development accuracy for Kev-9B against 0.857 for hosted Jev on that suite, but Jev's training data is unknown, so this is not a controlled architecture comparison; test calibration and option order on your own data before setting a decision threshold.

  Read listing →
• 

  Laya

  Open local Choice, Score, and Noul decision models with published checkpoints and a router for English and multilingual inputs; its Jev comparisons use different prompts and sample sizes rather than a controlled head-to-head, and raw calibration and some languages remain weak.

  Read listing →
• 

  LeJudge

  MIT-licensed PushT study and cost module that turns LeWorldModel's imagined latents into closed-vocabulary facts, asks Jev typed questions about natural-language constraints, and adds the probabilities to a CEM planner's cost; ships oracle and keyword baselines, cached responses, and an offline paper rebuild; live runs send constraint text and probe facts to TypeSafe, and results cover one world model and twelve constraints, with near-miss false positives and rollout drift as material limitations.

  Read listing →