JevBench
Raw Developer Origin & Technical Request
Hacker News
Sep 23, 2026
Hi HN! I built JevBench because Jev kicks ass, and the world deserves to know how the serious open source and fake lookalike projects really perform in comparison.Jev-class models return bounded choices and probabilities instead of text, and are disruptively faster and cheaper than LLMs, while being similarly intelligent on the text input they operate on.JevBench allows looking at accuracy, latency and price all at once, in a weighted way - you can even configure the weighting.A full run asks 534 English decisions. The v1.3 score combines chance-corrected Intelligence, Calibration, Speed and Cost.Leaderboard right now: #1 - Jev 74.4
#2 - SemIf 73.1
#3 - djev 73.0
#4 - Winnow-12B Q8 71.2
#5 reflex 4B 70.3.
MIT harness, public items, frozen artifacts, scoring code and public per-task outcomes:github.com/fstandhartinger/j... no-signup demos:who-is-right.app.mintapis.comhttps//is-it-ai-slop.ap... English-only; latency from one German server; local/demo latency gets a disclosed ×2 adjustment (+150 ms on my servers) which is an informed assumption; held-out prompts still reach evaluated services; ~1-point gaps can be noise.Wdyt?
Developer Debate & Comments
Frequently Asked Questions
Market intelligence mapped to JevBench.
What is the technical positioning of JevBench?
Are engineers actively discussing JevBench?
Which technical concepts are associated with JevBench?
Engagement Signals
Cross-Market Term Frequency
Counts stored text matches for foundational terms like LLMs and latency in analysed public discussions. These counts do not measure adoption.
Stored text matches, not adoption or market-share measurements.
- LLMs: 61 records
- latency: 29 records
- price: 17 records
- accuracy: 13 records
- Cost: 5 records
- Speed: 4 records
- probabilities: 2 records
- Jev-class models: 1 records
- typed decision models: 1 records
- bounded choices: 1 records
- chance-corrected Intelligence: 1 records
- Calibration: 1 records
- MIT harness: 1 records
- public items: 1 records
- frozen artifacts: 1 records
- scoring code: 1 records
- per-task outcomes: 1 records
SaaS Metrics