Prompt optimisation · Study 1 · Section 6.5.2

Llama-3.1-8B, full observation

The optimiser returned its seed: the evolved prompt is byte-identical to the rules-only prompt, so the held-out difference is noise.

Loop
(1+1) loop, 6 candidates
Task model
Llama-3.1-8B
Teacher
Qwen3.5-397B
Starting prompt
core_rules.txt
Observation
full
Training floors
simple, gen01, gen02 · 1 episode each
Started
2026-09-28 02:04
Result file
gepa_result_gs_llama8b_full.json

Evaluation after the run

FloorsPromptKillsMean goal score
held-outRules-only8/130.556
held-outEvolved10/130.646
held-outHand-written9/130.660
trainingRules-only2/30.669
trainingEvolved2/30.669
trainingHand-written2/30.566

From gs_llama8b_full.json; its episodes are listed on the episodes page.

Mean goal score on the training floors per candidate (click to open). Small dots: score per floor; dashed: best so far.seedmutation
0.000.250.500.751.00simple: 0.325gen01: 0.777gen02: 0.905candidate 0 (seed): 0.669 — best so far0simple: 0.325gen01: 0.777gen02: 0.584candidate 1 (mutation): 0.5621simple: 0.325gen01: 0.777gen02: 0.894candidate 2 (mutation): 0.6652simple: 0.325gen01: 0.762gen02: 0.638candidate 3 (mutation): 0.5753simple: 0.325gen01: 0.777gen02: 0.638candidate 4 (mutation): 0.5804simple: 0.325gen01: 0.777gen02: 0.584candidate 5 (mutation): 0.5625
Candidate 0seedscore 0.669returned as the best prompt
show827 characters
You play Magic Tower, a turn-based dungeon game on one floor. Each turn you get your state and a numbered list of the actions you can take now; you answer with one action number. GAME RULES: - A fight is a sequence of rounds; you hit first. Your hit = your ATK - the monster's DEF. If your ATK <= the monster's DEF you cannot damage it at all. - The monster's hit = its ATK - your DEF; if your DEF >= its ATK it cannot hurt you. The fight ends when one side reaches 0 HP. If you reach 0 HP you lose the game. - A door needs a key of the same colour; each key opens exactly one door and is used up. - Walking onto an item collects it: gems raise ATK or DEF permanently, potions restore HP, keys open doors. - HP is not restored between fights. GOAL: kill the boss and stay alive. End your answer with: FINAL_CHOICE: <number>
Starting prompt against the returned prompt (candidate 0)

The run returned its starting prompt unchanged.

← all prompt-optimisation runs