TIS-100 Bench: Signal Window Filter

Maintain sums of the last three and last five inputs, starting with zero-filled history. Old values must leave each window at the right time.

In TIS-100 Bench, 16 LLMs each had one attempt at this TIS-100 puzzle, with 10 minutes to find a working program and keep improving it, without seeing the community leaderboard. 12 of 16 models solved it. No model found a new Pareto-frontier point beyond the community leaderboard.

12 / 16models solved it
317best LLM cycles (200 community)
0new frontier points

Records

ScoreCommunity bestBest LLMModel
Cycles200317Fable 5.1 · +58%
Nodes44GPT-6 Astra Ties record
Instructions1517Gemini 4 Argon · +13%

Community records from the community leaderboard when we froze it. A record counts only after fresh-game replay and 100,000 passing random tests.

Pareto frontier

Pareto explorer

Lower is better ↙
Loading interactive Pareto explorer…
Community leaderboardModel frontier pointNew frontier point
Select a point with the mouse or keyboard to inspect its scores and program.

Search over time

Loading puzzle trajectories…

Every model

ModelSolvedBest cyclesBest nodesBest instructionsNew frontier points
01Fable 5.1Yes317519—
02GPT-6.1 SolYes318420—
03Opus 5.5Yes325626—
04GPT-6 AstraYes353420—
05Kimi K3.1 ProYes356730—
06Gemini 3.8 FlashYes391621—
07Gemini 4 ArgonYes428417—
08Haiku 5.5Yes433620—
09Sonnet 5.5Yes469424—
10DeepSeek V4.1 FlashYes470827—
11Muse Wonder 1.0Yes620425—
12Grok 4.7Yes669836—
13GLM-5.3No————
14MiMo-V2.6-ProNo————
15Muse Spark 1.3No————
16GPT-6 LunaNo————

Best scores can come from different programs. New frontier points are not matched or beaten on all three scores by any community program.

Best model programs

These programs are in TIS-100 save format and released under the MIT License. All of this puzzle’s model programs are on GitHub and Hugging Face.

Fable 5.1 Fewest cycles

317 cycles · 6 nodes · 22 instructions60099.317-6-22.txt on GitHub

Fable 5.1 program running on 60099 in TIS-100
Node 0
MOV UP, ACC
SWP
MOV ACC, RIGHT
SWP
MOV ACC, DOWN
SAV
Node 1
MOV LEFT, ACC
SWP
MOV ACC, DOWN
MOV ACC, DOWN
Node 3
MOV UP, DOWN
Node 4
MOV UP, DOWN
Node 7
ADD UP
MOV ACC, RIGHT
MOV ACC, DOWN
SUB RIGHT
Node 8
ADD UP
SWP
ADD LEFT
MOV ACC, DOWN
MOV UP, ACC
MOV ACC, LEFT

Gemini 4 Argon Fewest nodesFewest instructions

428 cycles · 4 nodes · 17 instructions60099.428-4-17.txt on GitHub

Gemini 4 Argon program running on 60099 in TIS-100
Node 0
MOV UP, ACC
MOV ACC, DOWN
SWP
MOV ACC, DOWN
Node 3
MOV UP, DOWN
MOV ACC, DOWN
MOV ACC, DOWN
MOV UP, ACC
SWP
Node 7
ADD UP
MOV ACC, RIGHT
SUB UP
MOV ACC, DOWN
MOV UP, RIGHT
Node 8
ADD LEFT
MOV ACC, DOWN
MOV LEFT, ACC