sec01: phase 4 downloads complete (50 files, 204MB) + item 12 EN preview + flib.py pagination

- 45 RU + 5 EN + 1 preview downloaded (flibusta.is OPDS, libgen, archive.org)
- 10 flib pdf stubs replaced via libgen (18,22,28,29,53) or fb2 twins
- flib 'fb2+zip' files unpacked to plain fb2
- item 12 (Evers-Fahey): RG=Request-PDF; PagePlace 23pp preview saved+verified
- evers-fahey dossier enriched (ofj.org bio)
- flib.py: authorall (rel=next pagination) + author <page>
- AGENTS.md: flib pagination/quirks + PagePlace preview tip
- INDEX: phase 4 done line; 8 trade-only items listed in MANIFEST
This commit is contained in:
Dmitry Kokorin 2026-09-17 10:41:43 +03:00
parent 5063bd8174
commit 32e505b2f9
8 changed files with 131 additions and 11 deletions

View file

@ -116,9 +116,11 @@ sections/0N-<name>/ # one .md per BOOK (chapter-level list items are merged int
- **.is OPDS (preferred):** Tool `tools/flib.py`:
- `flib.py authors "query"` → `/opds/search?searchType=authors&searchTerm=…` (id, name, book count)
- `flib.py books "query"` → `searchType=books` (id, title, author, year, format, translator from annotation)
- `flib.py author <id>` → `/opds/author/<id>/alphabet` — full book list
- `flib.py author <id>` → `/opds/author/<id>/alphabet` — book list (**20 per page!**)
- `flib.py authorall <id>` — follows `rel="next"` pages (`/alphabet/1`, `/2`, …) to the end — **always use authorall** (Jung a/5272 = 128 books; the bare feed shows only the first 20)
- Author HTML: `/a/<id>` (e.g. a/57639 = фон Франц, a/118921 = Нойманн); book page `/b/<id>`
- **Direct downloads:** `/b/<id>/fb2|epub|mobi|html|txt` (pdf/doc as «/b/<id>/download» links on the pages)
- **Quirks (2026-07-17):** `fb2+zip` format actually returns a ZIP (unpack: 1 fb2 + cover inside); `/b/<id>/pdf` sometimes 302-redirects to the book HTML page (a ~20 KB stub) when the file isn't served directly — check downloaded «pdf»s with `file`, fall back to libgen (same editions usually there) or the fb2 twin.
- .su search: `https://flibusta.su/booksearch/?ask=<query>` (param is **ask**); HTML links
`/book/<id>-<slug>`, `/author/<id>-<slug>`. API endpoints blocked on .su (api/search.php → 403).
- Value: (1) RU full-text downloads for the download phase; (2) author-book-list = cheap author sweep;
@ -166,6 +168,10 @@ sections/0N-<name>/ # one .md per BOOK (chapter-level list items are merged int
- `fetch_content` on the same URL → richer metadata: full author/editor names, edition, series.
Resolved Ottmann=Klaus, Goldstein=Ralph, Brutsche=Paul, Elder=George, Moon=Beverly,
Killick=Katherine, Pennington/Staples, Rowland=Susan, Bolander=Karen, Acton=Mary via this or OL.
- **PagePlace preview PDFs** (2026-07-17): many Routledge/T&F books have a public preview at
`api.pageplace.de/preview/DT0400.<ISBN13>_A<n>/preview-<ISBN13>_A<n>.pdf` (~20–30 pp: title page +
TOC — perfect for identity/series verification when the full text is closed; find the URL via
SearXNG `"<EN title>" preview pdf`). Used for item 12 (Evers-Fahey, 9781317219583).
### 15. Shop directory (HSE bookshelf34 pattern) — where RU psychoanalytic books are sold
- HSE «Книжный шкаф» (hse.ru/ma/therapy/bookshelfNN) = a DIRECTORY of shops, not a book list: