|
|
7d3794560e
|
cross-section dedup system (user tasks 2+3, 2026-09-25):
- tools/xref.py: master book list for ALL 12 sections (RAW 07-12 scraped: sections/07/RAW.md
+ data/isap-raw/), cross-ref matcher (CW gate + distinctive tokens + years + Cyrillic
transliteration), stale MANIFEST 'Not downloadable' checker; data/MASTER-LIST.md generated
(17 book-dupes in 01-06 found, e.g. sec01#51=sec06#14 Solomon)
- file-level dedup: 17 md5-identical files removed from later sections (kept in first),
MANIFESTs/cards -> cross-ref rows, totals updated (sec01 102 / 02 37 / 03 125 / 04 38 /
05 38 / 06 37), dedup rule in AGENTS.md + MANIFEST Notes
- sec05 MANIFEST phantom line '03 Aion' removed (Aion not in sec05 list; files in sec01)
- sec03 #44: 1968 Bodley file was #41's book (content 'English Fairy Tales') — removed,
#44 keeps ABC-CLIO 2002
|
2026-09-25 23:25:05 +03:00 |
|
|
|
2a2699d61a
|
sec05: EN downloads complete (30 files) + SUMMARY at-a-glance + lgdl queue infra
- 30/31 EN candidates downloaded via libgen, all content-verified
(magic+pages+first-page text); 08b 37-pp fragment discarded
- EN gaps: 04/05/15/16/23 not found (rare academic), 03/14 ia-restricted
- MANIFEST.md: EN sections per item + not-downloadable extended
- 26 cards: Downloads tables w/ EN rows + EN NOT FOUND notes (6 cards)
- SUMMARY.md created (canon v1): at-a-glance table 29 items, EN->RU authors
- tools/lgdl.py: speed-probe + CDN-edge re-draw (per-request get.php
302s to different storage hosts), connect timeout, stall wipe on first stall
- AGENTS.md: Lesson 9 (EN-queue infra: ads.php throttle, watchdog,
unbuffered logs, dual-queue trap, AA 403, i2p verdict)
|
2026-09-24 00:04:13 +03:00 |
|
