Pokemon Red — You Are the Trainer

You play Pokemon Red directly. No middleman script. You start the emulator server, hit its HTTP API for screenshots and state, look at the screen, decide what to do, and send commands back.

Setup (first time)

Clone the repo and install dependencies:

git clone https://github.com/drbarq/Pokemon-OpenClaw.git
cd Pokemon-OpenClaw
pip install pyboy pillow numpy fastapi uvicorn requests
# Place your legally obtained ROM at ./PokemonRed.gb

Set

POKEMON_DIR

to wherever you cloned the repo (default:

~/Code/pokemon-openclaw

Start a Session

# Start emulator server (background process)
cd $POKEMON_DIR && python scripts/emulator_server.py --save ready --port 3456

Turn Loop

Every turn, do these in order:

1. Get state + screenshot

curl -s http://localhost:3456/api/state
curl -s http://localhost:3456/api/screenshot -o /tmp/pokemon_current.png

Then use the

image

tool to look at the screenshot. Always look before acting.

2. Decide: Navigate or Manual?

Use navigate for travel — it BLOCKS until you arrive, hit a battle, or get stuck:

curl -s -X POST http://localhost:3456/api/navigate \
  -H 'Content-Type: application/json' \
  -d '{"destination": "Viridian City"}'

Navigate returns one of:

```
"status": "arrived"
```
— you're there! Continue quest.
```
"status": "battle"
```
— wild encounter interrupted. Fight it, then navigate again.
```
"status": "stuck"
```
— couldn't reach destination. Try manual buttons or different route.
```
"status": "error"
```
— unknown destination or no path. Check destinations list.

The response always includes full game state, so you know exactly where you are.

Important: Navigate blocks — set a long timeout (60-120s) on the curl call.

Check available destinations first:

curl -s http://localhost:3456/api/destinations

Check which maps have pathfinding data:

curl -s http://localhost:3456/api/maps

Fall back to manual buttons only when:

Navigate returns "stuck" or "error"
You're inside a building doing specific interactions
You're in dialogue or a menu

3. Manual controls (when needed)

# Move / interact
curl -s -X POST http://localhost:3456/api/press \
  -H 'Content-Type: application/json' \
  -d '{"buttons": ["up","up","a"], "reasoning": "Walking to door"}'

Valid buttons:

up

down

left

right

start

select

. Send 1-5 per turn.

4. Battle (when in_battle is true in state)

Fight: Press
```
a
```
to open fight menu,
```
a
```
again for FIGHT, navigate to move,
```
a
```
to confirm, then mash
```
a
```
through animations
Run: Press
```
a
```
, then
```
down
```
,
```
right
```
,
```
a
```
to select RUN, mash
```
a
```
through text
Check state after — if still
```
in_battle
```
, go again

5. Quest tracking

curl -s http://localhost:3456/api/quest                    # Current objective
curl -s -X POST http://localhost:3456/api/quest/complete \
  -H 'Content-Type: application/json' \
  -d '{"lesson": "Door is at x=12"}'                      # Advance step + save lesson

6. Save frequently

curl -s -X POST http://localhost:3456/api/command \
  -H 'Content-Type: application/json' \
  -d '{"command": "save", "name": "checkpoint_viridian"}'

Key Endpoints

Endpoint	Method	Purpose
`/api/state`	GET	Game state from RAM (position, party, badges, battle)
`/api/screenshot`	GET	PNG screenshot of game screen
`/api/navigate`	POST	Pathfind to named destination
`/api/destinations`	GET	List all navigation destinations
`/api/maps`	GET	Which maps have pathfinding data
`/api/press`	POST	Send button presses
`/api/quest`	GET	Current quest and step
`/api/quest/complete`	POST	Mark step done, optionally save a lesson
`/api/knowledge`	GET	All lessons learned
`/api/knowledge/lesson`	POST	Add a new lesson
`/api/command`	POST	Save/load/speed commands

Strategy Priority

Navigate first. For any travel, use
```
/api/navigate
```
. It blocks until arrival or battle — no polling needed.
Handle battles immediately. If navigate returns
```
"status": "battle"
```
, fight (mash A), then navigate again to the same destination.
Check quest. Always know your current objective. Don't wander.
HP management. Below 30% → consider healing. Below 15% → definitely heal. Navigate to nearest pokecenter.
Ignore text_active. The text detection flag is broken (always true). Don't spam B to dismiss phantom text.
Save often. Every 10 turns or after any milestone.

Session Pattern

A sub-agent session should:

Start emulator server (if not already running)
Check quest status and destinations
Play 20-50 turns (navigate + manual as needed)
Save state before exiting
Report progress (location, level, quest step, any highlights)

Keep notes in

/tmp/pokemon_notepad.txt

for continuity within a session.

For Full Game Strategy

See

references/game_instructions.md

for Pokemon Red basics: movement, buildings, doors, battles, type matchups, healing, and the quest system.

Pokemon Red

AI Skill Market Insights

Be Part of the 0+ Developer Community

Pokemon Red — You Are the Trainer

Setup (first time)

Start a Session

Turn Loop

1. Get state + screenshot

2. Decide: Navigate or Manual?

3. Manual controls (when needed)

4. Battle (when in_battle is true in state)

5. Quest tracking

6. Save frequently

Key Endpoints

Strategy Priority

Session Pattern

For Full Game Strategy

Quick Start

Manual Installation

TEAR & SHARE

Tags

Brand Guidelines

Theme Factory

Agent-first Marketing Image Generation

🗣️ Text-to-speech using GLM-TTS for generating audio

AI Content Repurposing Machine — Turn 1 Piece of Content Into 50 Assets in 30 Minutes

Channels

Learn

Compare

Company