dima/jung
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

AGENTS: source #18 local CRW JS renderer (fastcrw, localhost:3000, tools/crw.py) + limits (Ozon/chitai-gorod API-blocked)

Browse source
This commit is contained in:
Dmitry Kokorin 2026-09-09 00:55:17 +03:00
parent 8640a8b627
commit 645cb964b4
1 changed files with 6 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

6
AGENTS.md
View file

@ -161,6 +161,12 @@ sections/0N-<name>/ # one .md per BOOK (chapter-level list items are merged int
catalog → seller error).
- Also: alib.top (Ukraine), 33ob.ru (vinyl), amarka.ru (stamps) — sister sites.
### 18. Local CRW renderer (fastcrw.com, Firecrawl-compatible, localhost:3000)
- Tool: `tools/crw.py <url> [--html] [--wait N ms]` — POST /v1/scrape {"url","formats":["markdown"]}
- Use for JS-heavy sites curl can't read (soznanie.ast-academy.ru festival site rendered fine).
- Limits: Ozon and chitai-gorod search are API/anti-bot protected — CRW returns nothing.
- Insales shops (castalia.ru) don't need it: product data is server-side JSON-LD (curl OK).
## Not usable / low value
- libgen biblioservice worldcat/googlebooks/isbndb/udc (broken on this mirror)
- imaton.com (МААП educational publisher, not translations)