TIS-100 Bench: Signal Comparator

21340 Easy Routing & synchronization Built-in puzzle · TIS-100 Bench report →

Classify each input as positive, zero, or negative. Every input produces three outputs: one 1 and two 0s.

In TIS-100 Bench, 16 LLMs each had one attempt at this TIS-100 puzzle, with 10 minutes to find a working program and keep improving it, without seeing the community leaderboard. 15 of 16 models solved it. No model found a new Pareto-frontier point beyond the community leaderboard.

15 / 16models solved it
227best LLM cycles (188 community)
0new frontier points

Records

ScoreCommunity bestBest LLMModel
Cycles188227GPT-6 Astra · +21%
Nodes66DeepSeek V4.1 Flash Ties record
Instructions1517Gemini 4 Argon · +13%

Community records from the community leaderboard when we froze it. A record counts only after fresh-game replay and 100,000 passing random tests.

Pareto frontier

Pareto explorer

Lower is better ↙
Loading interactive Pareto explorer…
Community leaderboardModel frontier pointNew frontier point
Select a point with the mouse or keyboard to inspect its scores and program.

Search over time

Loading puzzle trajectories…

Every model

ModelSolvedBest cyclesBest nodesBest instructionsNew frontier points
01GPT-6 AstraYes227618—
02GPT-6.1 SolYes228620—
03Fable 5.1Yes245618—
04Gemini 4 ArgonYes245617—
05Opus 5.5Yes252618—
06DeepSeek V4.1 FlashYes265620—
07GLM-5.3Yes265620—
08Gemini 3.8 FlashYes265620—
09Muse Spark 1.3Yes265619—
10Muse Wonder 1.0Yes265620—
11Sonnet 5.5Yes265620—
12GPT-6 LunaYes265620—
13Kimi K3.1 ProYes266620—
14Grok 4.7Yes278620—
15Haiku 5.5Yes278620—
16MiMo-V2.6-ProNo————

Best scores can come from different programs. New frontier points are not matched or beaten on all three scores by any community program.

Best model programs

These programs are in TIS-100 save format and released under the MIT License. All of this puzzle’s model programs are on GitHub and Hugging Face.

GPT-6 Astra Fewest cyclesFewest nodes

227 cycles · 6 nodes · 27 instructions21340.227-6-27.txt on GitHub

GPT-6 Astra program running on 21340 in TIS-100
Node 0
S: MOV UP ACC
JEZ A
JLZ B
MOV 1 DOWN
JMP S
A: MOV 4 DOWN
JMP S
B: MOV 6 DOWN
Node 4
MOV UP DOWN
Node 5
MOV UP RIGHT
Node 6
S: JRO LEFT
MOV 4 RIGHT
MOV 1 DOWN
JMP S
MOV 1 RIGHT
JMP C
MOV 6 RIGHT
C: MOV 0 DOWN
Node 7
S: JRO LEFT
MOV 0 RIGHT
MOV 1 DOWN
JMP S
MOV 0 RIGHT
JMP C
MOV 1 RIGHT
C: MOV 0 DOWN
Node 8
MOV LEFT DOWN

Gemini 4 Argon Fewest instructions

398 cycles · 6 nodes · 17 instructions21340.398-6-17.txt on GitHub

Gemini 4 Argon program running on 21340 in TIS-100
Node 0
MOV UP, DOWN
Node 4
MOV UP, DOWN
Node 5
MOV UP, RIGHT
Node 6
MOV LEFT, ACC
JGZ G
MOV 0, DOWN
JEZ Z
MOV 1, RIGHT
JMP Z
G: MOV 1, DOWN
MOV 0, RIGHT
Z: MOV 0, RIGHT
JNZ D
MOV 1, RIGHT
D:
Node 7
MOV LEFT, RIGHT
MOV LEFT, DOWN
Node 8
MOV LEFT, DOWN