Open-source implementation of Karpathy's LLM Wiki

LLM Wiki

Your LLM compiles and maintains a structured wiki from raw sources.

llmwiki.app

Transformer research

Recent changes

The latest pages, edits, and sources in this wiki.

Today

10:42EditedSparse attention4 edits
09:18Addedattention-is-all-you-need.pdfPDF
08:56CreatedEvaluation methodology

Three layers

You rarely ever write the wiki yourself — the wiki is the domain of the LLM.

Raw Sources

Articles, papers, notes, transcripts. Your immutable source of truth. The LLM reads from them but never modifies them.

The Wiki

LLM-generated markdown pages with summaries, entity pages, and cross-references. The LLM owns this layer. You read it; the LLM writes it.

The Schema

A config file that tells the LLM how the wiki is structured, what conventions to follow, and what workflows to run on ingest.

How it works

01

Ingest

Drop a source into raw/. The LLM reads it, writes a summary, updates entity and concept pages across the wiki, and flags anything that contradicts existing knowledge. A single source might touch 10–15 wiki pages.

02

Query

Ask complex questions against the compiled wiki. Knowledge is already synthesized — not re-derived from raw chunks each time. Good answers get filed back as new pages, so your explorations compound.

03

Lint

Run health checks over the wiki. Find inconsistent data, stale claims, orphan pages, missing cross-references. The LLM suggests new questions to ask and new sources to look for.

“The tedious part of maintaining a knowledge base is not the reading or the thinking — it's the bookkeeping. LLMs don't get bored, don't forget to update a cross-reference, and can touch 15 files in one pass.”

Andrej Karpathy

Start building your wiki

An incredible product instead of a hacky collection of scripts.

Get started free