TIS-100 Bench: Signal Error Corrector

Copy two streams, replacing a negative value with its partner from the other stream. At most one partner is negative at a time.

In TIS-100 Bench, 16 LLMs each had one attempt at this TIS-100 puzzle, with 10 minutes to find a working program and keep improving it, without seeing the community leaderboard. 16 of 16 models solved it. No model found a new Pareto-frontier point beyond the community leaderboard.

16 / 16models solved it
201best LLM cycles (138 community)
0new frontier points

Records

ScoreCommunity bestBest LLMModel
Cycles138201Gemini 4 Argon · +46%
Nodes55DeepSeek V4.1 Flash Ties record
Instructions1316Gemini 4 Argon · +23%

Community records from the community leaderboard when we froze it. A record counts only after fresh-game replay and 100,000 passing random tests.

Pareto frontier

Pareto explorer

Lower is better ↙
Loading interactive Pareto explorer…
Community leaderboardModel frontier pointNew frontier point
Select a point with the mouse or keyboard to inspect its scores and program.

Search over time

Loading puzzle trajectories…

Every model

ModelSolvedBest cyclesBest nodesBest instructionsNew frontier points
01Gemini 4 ArgonYes201516—
02Muse Wonder 1.0Yes233519—
03Gemini 3.8 FlashYes236517—
04Sonnet 5.5Yes245620—
05Fable 5.1Yes278517—
06GPT-6 AstraYes278518—
07GPT-6.1 SolYes278517—
08Opus 5.5Yes278517—
09Haiku 5.5Yes307620—
10Kimi K3.1 ProYes329518—
11Grok 4.7Yes350620—
12Muse Spark 1.3Yes350520—
13DeepSeek V4.1 FlashYes357518—
14GLM-5.3Yes378624—
15GPT-6 LunaYes388519—
16MiMo-V2.6-ProYes398520—

Best scores can come from different programs. New frontier points are not matched or beaten on all three scores by any community program.

Best model programs

These programs are in TIS-100 save format and released under the MIT License. All of this puzzle’s model programs are on GitHub and Hugging Face.

Gemini 4 Argon Fewest cycles

201 cycles · 6 nodes · 29 instructionsNEXUS.03.176.9.201-6-29.txt on GitHub

Gemini 4 Argon program running on NEXUS.03.176.9 in TIS-100
Node 0
MOV UP, ACC
MOV ACC, RIGHT
MOV ACC, DOWN
Node 1
S: MOV UP, ACC
JGZ O
MOV LEFT, DOWN
MOV UP, ACC
JGZ O
MOV LEFT, DOWN
MOV UP, ACC
JGZ O
MOV LEFT, DOWN
JMP S
O: MOV LEFT, NIL
MOV ACC, DOWN
Node 3
S: MOV UP, ACC
JGZ O
MOV RIGHT, DOWN
MOV UP, ACC
JGZ O
MOV RIGHT, DOWN
JMP S
O: MOV RIGHT, NIL
MOV ACC, DOWN
Node 4
MOV UP, ACC
MOV ACC, LEFT
MOV ACC, DOWN
Node 7
MOV UP, DOWN
Node 8
MOV UP, DOWN

Gemini 4 Argon Fewest nodes

274 cycles · 5 nodes · 17 instructionsNEXUS.03.176.9.274-5-17.txt on GitHub

Gemini 4 Argon program running on NEXUS.03.176.9 in TIS-100
Node 0
MOV UP, ACC
JGZ O
MOV RIGHT, ACC
MOV ACC, DOWN
JMP P
O: MOV RIGHT, DOWN
P: MOV ACC, DOWN
Node 1
MOV UP, LEFT
Node 3
MOV UP, DOWN
Node 7
MOV UP, ACC
JGZ O
MOV UP, ACC
MOV ACC, DOWN
JMP P
O: MOV UP, DOWN
P: MOV ACC, RIGHT
Node 8
MOV LEFT, DOWN

Gemini 4 Argon Fewest instructions

360 cycles · 5 nodes · 16 instructionsNEXUS.03.176.9.360-5-16.txt on GitHub

Gemini 4 Argon program running on NEXUS.03.176.9 in TIS-100
Node 0
MOV UP, ACC
JGZ A
MOV RIGHT, ACC
MOV ACC, DOWN
JMP E
A: SAV
MOV ACC, DOWN
MOV RIGHT, ACC
JGZ E
SWP
E: MOV ACC, DOWN
Node 1
MOV UP, LEFT
Node 3
MOV UP, DOWN
Node 7
MOV UP, DOWN
MOV UP, RIGHT
Node 8
MOV LEFT, DOWN