Community project / Evaluations and independent research

RSI-Jev

Jev-like 4B and 27B open models (v6.1-VL) from a self-improving research loop with published version notes and failed-experiment summaries (MIT code, Apache-2.0 weights; some training-source rights unclear); they return choice, score, and noul probabilities about text and images in one forward pass through a /v1/systemone-compatible server, with auto effort choosing depth per question. The authors report 50.98 (4B, pre-release kit) and 65.64 (27B, auto) on Decision Index 0.3's public set, with an official full score pending; the 27B was selected using that benchmark, needs a 96 GB GPU in bf16, and its training corpora are not public.

Open the original resource ↗ See it in the full directory Start a reading list → Browse all Evaluations and independent research

Download share card ↓

This is an independent community listing. Check the source, license, data handling, and evaluation caveats before relying on a project. Inclusion is not an endorsement or security review.

Found an outdated or inaccurate detail? Report a correction →

Explore more in Evaluations and independent research

• 

  ruling

  MIT-licensed System One-compatible server for Apple Silicon that scores typed questions from a stock model's logits with no training, accepts the official SDK unchanged, and re-scores the 256 public judgments that carry Jev's own answers (231 vs 238, no significant difference); serves MLX checkpoints or any OpenAI-compatible endpoint, with no native CUDA path.

  Read listing →
• 

  SemIf (formerly OpenJev)

  Independent open-model research baseline for direct typed option scoring; it reproduces the interface pattern, not Jev's undisclosed model or training.

  Read listing →
• 

  Simple Jev

  Apache-licensed local server that scores Choice, Score, and Noul with open-model logits; tokenizer support and decision calibration vary by model.

  Read listing →