TIS-100 Bench / Puzzles / Error: 8
TIS-100 Bench: Error: 8
SPEC79324720 Hard Streaming state Arithmetic construction Community tournament puzzle ·
A garbled specification describes a counter that advances by 8 per input pair. Emit the upper bound if the counter is above it, the lower bound if below it, and zero otherwise.
In TIS-100 puzzle, with 45 minutes to find a working program and keep improving it, without seeing the community leaderboard . 11 of 16 models solved it. Together they found 12 new Pareto-frontier points beyond the community leaderboard.
11 / 16 models solved it
186 best LLM cycles (198 community)
12 new frontier points
Records
Community records from the community leaderboard when we froze it. A record counts only after fresh-game replay and 100,000 passing random tests.
Pareto frontier
Pareto explorer Lower is better ↙
Loading interactive Pareto explorer…
Select a point with the mouse or keyboard to inspect its scores and program.
Error: 8: cycles against instructions for the community frontier and each model’s frontier points 167 251 376 563 843 15 22 31 44 63 Cycles (log scale) Instructions Fable 5.1: 280 cycles, 7 nodes, 25 instructions Fable 5.1: 294 cycles, 6 nodes, 23 instructions Fable 5.1: 238 cycles, 8 nodes, 26 instructions Fable 5.1: 233 cycles, 8 nodes, 27 instructions Fable 5.1: 225 cycles, 8 nodes, 28 instructions Fable 5.1: 283 cycles, 6 nodes, 25 instructions Fable 5.1: 291 cycles, 6 nodes, 24 instructions Fable 5.1: 347 cycles, 4 nodes, 21 instructions Fable 5.1: 339 cycles, 5 nodes, 22 instructions Fable 5.1: 338 cycles, 6 nodes, 22 instructions Fable 5.1: 375 cycles, 5 nodes, 20 instructions Fable 5.1: 414 cycles, 4 nodes, 20 instructions Gemini 4 Argon: 520 cycles, 4 nodes, 20 instructions Gemini 4 Argon: 413 cycles, 4 nodes, 21 instructions Gemini 4 Argon: 335 cycles, 4 nodes, 23 instructions Gemini 4 Argon: 305 cycles, 4 nodes, 24 instructions Gemini 4 Argon: 365 cycles, 4 nodes, 22 instructions Gemini 4 Argon: 216 cycles, 8 nodes, 55 instructions Gemini 4 Argon: 186 cycles, 9 nodes, 54 instructions Gemini 4 Argon: 254 cycles, 9 nodes, 50 instructions Gemini 4 Argon: 303 cycles, 6 nodes, 22 instructions Gemini 4 Argon: 335 cycles, 5 nodes, 22 instructions Gemini 4 Argon: 288 cycles, 5 nodes, 23 instructions Gemini 4 Argon: 275 cycles, 6 nodes, 23 instructions Gemini 4 Argon: 217 cycles, 8 nodes, 52 instructions Gemini 4 Argon: 206 cycles, 9 nodes, 51 instructions GPT-6 Astra: 293 cycles, 5 nodes, 24 instructions GPT-6 Astra: 277 cycles, 6 nodes, 25 instructions GPT-6 Astra: 423 cycles, 4 nodes, 21 instructions GPT-6 Astra: 283 cycles, 5 nodes, 30 instructions GPT-6 Astra: 319 cycles, 4 nodes, 25 instructions GPT-6 Astra: 374 cycles, 4 nodes, 24 instructions GPT-6 Astra: 375 cycles, 4 nodes, 23 instructions GPT-6 Astra: 395 cycles, 4 nodes, 22 instructions GPT-6 Astra: 318 cycles, 4 nodes, 26 instructions GPT-6 Astra: 317 cycles, 4 nodes, 27 instructions GPT-6 Astra: 223 cycles, 8 nodes, 49 instructions GPT-6 Astra: 224 cycles, 8 nodes, 47 instructions Opus 5.5: 277 cycles, 7 nodes, 25 instructions Opus 5.5: 263 cycles, 7 nodes, 36 instructions Opus 5.5: 438 cycles, 4 nodes, 22 instructions Opus 5.5: 279 cycles, 7 nodes, 24 instructions Opus 5.5: 272 cycles, 7 nodes, 30 instructions Opus 5.5: 329 cycles, 6 nodes, 22 instructions Opus 5.5: 317 cycles, 7 nodes, 23 instructions Opus 5.5: 232 cycles, 8 nodes, 26 instructions Opus 5.5: 204 cycles, 8 nodes, 35 instructions Opus 5.5: 215 cycles, 8 nodes, 27 instructions Opus 5.5: 207 cycles, 8 nodes, 31 instructions Opus 5.5: 203 cycles, 8 nodes, 45 instructions Opus 5.5: 322 cycles, 6 nodes, 27 instructions Opus 5.5: 430 cycles, 4 nodes, 28 instructions GPT-6.1 Sol: 433 cycles, 4 nodes, 20 instructions GPT-6.1 Sol: 302 cycles, 5 nodes, 25 instructions GPT-6.1 Sol: 278 cycles, 7 nodes, 25 instructions GPT-6.1 Sol: 380 cycles, 4 nodes, 24 instructions GPT-6.1 Sol: 189 cycles, 9 nodes, 55 instructions GPT-6.1 Sol: 209 cycles, 8 nodes, 55 instructions GPT-6.1 Sol: 294 cycles, 6 nodes, 23 instructions GPT-6.1 Sol: 258 cycles, 8 nodes, 52 instructions GPT-6.1 Sol: 307 cycles, 5 nodes, 23 instructions Kimi K3.1 Pro: 277 cycles, 7 nodes, 25 instructions Kimi K3.1 Pro: 263 cycles, 7 nodes, 36 instructions Kimi K3.1 Pro: 394 cycles, 5 nodes, 23 instructions Kimi K3.1 Pro: 396 cycles, 4 nodes, 23 instructions Kimi K3.1 Pro: 218 cycles, 9 nodes, 52 instructions Kimi K3.1 Pro: 231 cycles, 8 nodes, 52 instructions Kimi K3.1 Pro: 293 cycles, 6 nodes, 23 instructions Kimi K3.1 Pro: 282 cycles, 6 nodes, 32 instructions Kimi K3.1 Pro: 288 cycles, 6 nodes, 27 instructions Kimi K3.1 Pro: 267 cycles, 7 nodes, 30 instructions Kimi K3.1 Pro: 380 cycles, 5 nodes, 29 instructions Kimi K3.1 Pro: 216 cycles, 9 nodes, 57 instructions Gemini 3.8 Flash: 435 cycles, 4 nodes, 22 instructions Gemini 3.8 Flash: 359 cycles, 5 nodes, 30 instructions Gemini 3.8 Flash: 365 cycles, 5 nodes, 29 instructions Gemini 3.8 Flash: 280 cycles, 8 nodes, 31 instructions Gemini 3.8 Flash: 281 cycles, 7 nodes, 31 instructions Gemini 3.8 Flash: 414 cycles, 5 nodes, 22 instructions Gemini 3.8 Flash: 299 cycles, 6 nodes, 26 instructions Gemini 3.8 Flash: 425 cycles, 4 nodes, 28 instructions Gemini 3.8 Flash: 349 cycles, 5 nodes, 31 instructions Muse Wonder 1.0: 366 cycles, 6 nodes, 30 instructions Muse Wonder 1.0: 354 cycles, 6 nodes, 33 instructions Muse Wonder 1.0: 319 cycles, 7 nodes, 29 instructions Muse Wonder 1.0: 310 cycles, 7 nodes, 30 instructions Muse Wonder 1.0: 447 cycles, 4 nodes, 21 instructions Muse Wonder 1.0: 397 cycles, 5 nodes, 21 instructions Muse Wonder 1.0: 308 cycles, 7 nodes, 31 instructions GLM-5.3: 354 cycles, 6 nodes, 31 instructions GLM-5.3: 576 cycles, 4 nodes, 25 instructions GLM-5.3: 520 cycles, 4 nodes, 26 instructions GLM-5.3: 431 cycles, 5 nodes, 29 instructions Grok 4.7: 460 cycles, 7 nodes, 46 instructions Fable 5.1: 245 cycles, 6 nodes, 27 instructions (new frontier point) Fable 5.1: 244 cycles, 7 nodes, 26 instructions (new frontier point) Fable 5.1: 242 cycles, 7 nodes, 27 instructions (new frontier point) Fable 5.1: 244 cycles, 6 nodes, 28 instructions (new frontier point) Fable 5.1: 243 cycles, 6 nodes, 29 instructions (new frontier point) Gemini 4 Argon: 188 cycles, 9 nodes, 53 instructions (new frontier point) Gemini 4 Argon: 234 cycles, 7 nodes, 51 instructions (new frontier point) Gemini 4 Argon: 221 cycles, 7 nodes, 52 instructions (new frontier point) GPT-6 Astra: 259 cycles, 6 nodes, 26 instructions (new frontier point) GPT-6 Astra: 246 cycles, 6 nodes, 33 instructions (new frontier point) Sonnet 5.5: 303 cycles, 4 nodes, 21 instructions (new frontier point) Sonnet 5.5: 288 cycles, 5 nodes, 22 instructions (new frontier point) Opus 5.5: 240 cycles, 8 nodes, 25 instructions (new frontier point) Community leaderboard Nodes are not shown; lower is better on both axes.
Search over time
Loading puzzle trajectories…
Puzzle MetricBest cycles Fewest nodes Fewest instructions In-game record proximity Program runs
Compare models
Top four overall All models Clear
Inspect time 0:00
Best in-game score so far, before independent testing. Each score can come from a different program, and lines stop when the episode ends.
Every model
Best scores can come from different programs. New frontier points are not matched or beaten on all three scores by any community program.
Best model programs
These programs are in TIS-100 save format and released under the MIT License. All of this puzzle’s model programs are on GitHub and Hugging Face .
Gemini 4 Argon Fewest cycles 186 cycles · 9 nodes · 54 instructions SPEC79324720.186-9-54.txt on GitHub
Node 0 ADD 8
MOV ACC, RIGHT
ADD 8Node 1 MOV UP, DOWN
MOV LEFT, ACC
SAV
SUB UP
JLZ P
SWP
P: MOV ACC, RIGHTNode 2 MOV UP, DOWN
MOV UP, RIGHT
MOV LEFT, RIGHTNode 3 ADD 8
SAV
SUB LEFT
JLZ K
MOV ACC, DOWN
MOV LEFT, ACC
JMP E
K: SWP
MOV LEFT, DOWN
E: ADD 8Node 4 SAV
SUB UP
JLZ P
SWP
MOV ACC, RIGHT
JMP E
P: MOV ACC, RIGHT
SWP
E: ADD 16Node 5 SAV
SUB UP
JLZ K
MOV ACC, DOWN
MOV LEFT, ACC
JMP E
K: SWP
MOV LEFT, DOWN
E: ADD 16Node 6 ADD 8
SAV
SUB UP
MOV ACC, DOWN
SWP
ADD 8Node 7 SAV
SUB UP
MOV ACC, DOWN
SWP
ADD 16
MOV RIGHT, DOWNSonnet 5.5 Fewest nodes ★ New frontier point 303 cycles · 4 nodes · 21 instructions SPEC79324720.303-4-21.txt on GitHub
Node 1 S: ADD 8
SAV
SUB UP
JGZ NN
MOV ACC, RIGHT
SWP
JMP S
NN: SWP
MOV ACC, RIGHTNode 2 MOV LEFT, ACC
SAV
SUB UP
JGZ O
SWP
O: MOV ACC, DOWNNode 7 ADD 8
SAV
SUB UP
MOV ACC, DOWN
SWPFable 5.1 Fewest instructions 375 cycles · 5 nodes · 20 instructions SPEC79324720.375-5-20.txt on GitHub
Node 2 L: MOV LEFT, ACC
ADD RIGHT
JGZ N
MOV UP, ACC
SAV
ADD RIGHT
JLZ M
MOV 0, DOWN
JMP L
N: MOV UP, NIL
SUB RIGHT
JMP O
M: SWP
O: MOV ACC, DOWNNode 3 SUB 8
MOV ACC, LEFT
MOV ACC, LEFT← Image Test Pattern: Hwair All puzzles
TIS-100 Bench report →
