Benchmarks / Model
Mistral Medium 3.5
Results for Mistral Medium 3.5 by Mistral AI across JumalAIta Intelligence benchmarks, with the configuration and run details of every evaluation.
01 / Result
Creative Reimplementation Benchmark
- Benchmark version
- v1.0
- Generation
- Single shot
- Reasoning effort
- High
- Harness
- Mistral Vibe CLI 2.25.7
- Run date
- 2026-09-27
- Run environment
- Reference container (see the protocol)
- Run time
- 4 min 04 s
- Tool calls
- Not yet published
- Cost
- Not yet published
- Tokens
- Not yet published
- Run note
- Mistral Medium 3.5 extracted frames only from the first ten seconds of the 170-second reference capture and analysed them with Python image statistics. Its own words in the run transcript: "sunrise or dawn scene". It built a procedural sunrise and finished in four minutes. Mistral Vibe CLI 2.25.7 has no tool that shows an image file to the model, so it could not look at the frames it extracted. The submission does not run in any browser: its fragment shader uses floating-point suffixes such as 0.71f, which WebGL 1 (GLSL ES 1.00) does not accept, so compilation fails. The text "Failed to compile shaders!" in the recording is the submission's own error message, not part of a demo.
- Evaluators
- The original authors of the reference demo (members of Jumalauta)
- Recording length
- 2 min 55 s
- Recording published
- 2026-09-28
02 / Summary
Benchmark results
| Benchmark | Version | Rank | Evaluation | Configuration | Status | Result |
|---|---|---|---|---|---|---|
| Creative Reimplementation Benchmark | v1.0 | 13 | Expert-ranked | Single shot · High | Final | Details of Mistral Medium 3.5 in Creative Reimplementation Benchmark |
