sec05: RU downloads — 17 files 85MB, all content-verified. libgen mislinked-batch incident (9/20 wrong files: EN papers/novels, RU fantasy, Spanish fiction) → re-sourced from flib; MANIFEST FINAL + card Downloads tables + AGENTS lessons 5/8 updated (content-verify gate mandatory)

This commit is contained in:
Dmitry Kokorin 2026-09-23 00:32:28 +03:00
parent be9080d0a5
commit b43e8f763c
33 changed files with 56505 additions and 3 deletions

View file

@ -450,15 +450,25 @@ sections/0N-<name>/ # one .md per BOOK (chapter-level list items are merged int
4. **flib authorall for prolific RU authors** (Элиаде a/2943 = 49 books) caught «Тайные общества»
(sec05 #13) that libgen title search missed. Always run flib author sweep for authors with
>5 RU books.
5. **libgen mislinked-file trap**: edition 141685581 «На пороге инициации» carried an ePubLibre
Spanish Lermontov file. Before downloading, check the file `locator`/title via
`json.php?object=f&addkeys=*&ids=<fid>`; for recent books prefer flib (cleaner metadata).
5. **libgen mislinked-file trap (SYSTEMIC — 9/20 files in the sec05 RU batch were wrong)**:
edition files can be mislinked (141685581 «На пороге инициации» carried an ePubLibre
Spanish Lermontov file; the sec05 «pdf» batch carried English academic papers:
*Food Engineering Research*, *Surface & Coatings Technology*, *International Journal of Food
Sciences*, an EN novel, even a RU fantasy «Подмененный» as fb2 for «Священное и мирское»;
the 4 van Gennep epubs were Spanish fiction). Sizes pass lgdl's md5 check. **Mandatory:
after every libgen download, content-verify: `pdfinfo` page count vs RSL record + first-page
text (pdftotext -l 3 / fb2 body head / epub xhtml head) must contain the RU title/author.**
For recent books prefer flib (clean files); flib `/b/<id>/download` → 302 → direct
`static.flibusta.is` URL.
6. **Collection-inclusion questions** (#27/#28): download the smallest fb2, parse the TOC
(`<section name="title">`), grep for the EN book title + RU calque. «Символ и ритуал» (Наука
1983) CONTAINS «Ритуальный процесс» (full text, core section) but NOT «Лес символов»
(citations only).
7. **flib pdf download**: `/b/<id>/pdf` may return an HTML stub; `/b/<id>/download` → 302 →
direct `static.flibusta.is:443/b.usr/<File>.<ext>` URL — curl that directly.
8. **Content-verify gate (2026-09-22, after the sec05 mislinked batch)**: every downloaded file
gets a two-second check — magic bytes + `pdfinfo` pages + first-page/head text containing the
expected RU title/author. A file that fails is discarded and re-sourced (usually flib).
## Catalog caching convention