Community project / Evaluations and independent research

JevGPT

Apache-2.0 code and per-item run records for the paper JevGPT: Thinking Fast and Slow in Autonomous Research, a research agent in which GPT-5.5 plans searches and writes answers while, in BrowseComp-Plus question answering, jev-1.13.0 answers parallel Choice questions that locate answer lines and Noul questions that check whether each retrieved document region addresses the request, with code returning the original passages to GPT; the authors report 90.48% accuracy on 830 BrowseComp-Plus questions and 0.5390 nDCG@20 on 105 NeuCLIRBench topics, the released records rebuild those rows without model calls, and live runs need GPT-provider credentials, a TypeSafe key and benchmark indexes; evidence queries and source regions go to TypeSafe, and research questions and selected original passages go to the configured GPT provider.

Open the original resource ↗ See it in the full directory Start a reading list → Browse all Evaluations and independent research

Download share card ↓

This is an independent community listing. Check the source, license, data handling, and evaluation caveats before relying on a project. Inclusion is not an endorsement or security review.

Found an outdated or inaccurate detail? Report a correction →

Explore more in Evaluations and independent research

• 

  jevmlx

  MIT-licensed local decision layer for Apple Silicon that scores constrained Boolean, enum, and multi-select fields from MLX model logits in one prefill, returns schema-valid JSON, and offers a System One-compatible endpoint and benchmark runner; probabilities are over the supplied options and need calibration against labeled task data.

  Read listing →
• 

  jevos

  MIT-licensed 1B yes/no model released as a q4_k_m GGUF that runs on CPU with llama.cpp behind a Jev-compatible /v1/systemone endpoint; it answers only Noul questions, and Choice and Score requests return 422. The authors report 0.815 accuracy against 0.927 for hosted Jev on 2,000 questions from unseen policies, but the training code and evaluation set are not published, so that result cannot be reproduced from the repository.

  Read listing →
• 

  Kev

  Apache-licensed, locally runnable Jev-style Choice, Score, and Noul models at 0.8B, 4B, and 9B, with released weights, training code, a System One-compatible server, frozen evaluation suites, and a playground. Its author reports a 0.822 new-source development accuracy for Kev-9B against 0.857 for hosted Jev on that suite, but Jev's training data is unknown, so this is not a controlled architecture comparison; test calibration and option order on your own data before setting a decision threshold.

  Read listing →