diff --git a/AGENTS.md b/AGENTS.md index 8310e0e..fcce618 100644 --- a/AGENTS.md +++ b/AGENTS.md @@ -161,6 +161,12 @@ sections/0N-/ # one .md per BOOK (chapter-level list items are merged int catalog → seller error). - Also: alib.top (Ukraine), 33ob.ru (vinyl), amarka.ru (stamps) — sister sites. +### 18. Local CRW renderer (fastcrw.com, Firecrawl-compatible, localhost:3000) +- Tool: `tools/crw.py [--html] [--wait N ms]` — POST /v1/scrape {"url","formats":["markdown"]} +- Use for JS-heavy sites curl can't read (soznanie.ast-academy.ru festival site rendered fine). +- Limits: Ozon and chitai-gorod search are API/anti-bot protected — CRW returns nothing. +- Insales shops (castalia.ru) don't need it: product data is server-side JSON-LD (curl OK). + ## Not usable / low value - libgen biblioservice worldcat/googlebooks/isbndb/udc (broken on this mirror) - imaton.com (МААП educational publisher, not translations)