A personal project

Ruleschat for the wargame
Advanced Squad Leader.

An AI for answering questions over the 700-page rulebook.

The domain

Advanced Squad Leader has
a 700-page rulebook.

Advanced Squad Leader is a tactical WWII wargame that was historically played on hex maps with cardboard counters and dice. Most play has moved online through VASSAL and VASL — but those platforms only move counters and roll dice. Every rule interpretation, modifier, and edge case still falls on the players.

ASL board with counters
Gameplay on VASL
The pipeline

How it works.

i
Stage 01 · Retrieval

RAG over the rulebook

Each question goes through OpenAI's Responses API, which calls file_search against a vector store of the 700-page rulebook and pulls 20 chunks into the model's context.

Responses APIfile_search20 chunks/q
ii
Stage 02 · Grounding

Cited answers

Every claim links to a rule section, and clicking a citation like A4.34 opens the rulebook PDF to that page in-browser.

section_pages.jsonpdf.jseASLRB v3.14
iii
Stage 03 · Evaluation

LLM-as-a-judge

A zero-shot AI judge scores each response Pass / Fail / Needs Review against expected answers, with manual review before results are published.

gpt-4.1-mini judgeJSON modehuman override
iv
Stage 04 · Improvement

Curate & retrain

Strong Q&A pairs feed eval datasets and fine-tuning corpora.

SFT JSONLOpenAI fine-tuneeval JSONL