cross-section dedup system (user tasks 2+3, 2026-09-25):

- tools/xref.py: master book list for ALL 12 sections (RAW 07-12 scraped: sections/07/RAW.md
  + data/isap-raw/), cross-ref matcher (CW gate + distinctive tokens + years + Cyrillic
  transliteration), stale MANIFEST 'Not downloadable' checker; data/MASTER-LIST.md generated
  (17 book-dupes in 01-06 found, e.g. sec01#51=sec06#14 Solomon)
- file-level dedup: 17 md5-identical files removed from later sections (kept in first),
  MANIFESTs/cards -> cross-ref rows, totals updated (sec01 102 / 02 37 / 03 125 / 04 38 /
  05 38 / 06 37), dedup rule in AGENTS.md + MANIFEST Notes
- sec05 MANIFEST phantom line '03 Aion' removed (Aion not in sec05 list; files in sec01)
- sec03 #44: 1968 Bodley file was #41's book (content 'English Fairy Tales') — removed,
  #44 keeps ABC-CLIO 2002
This commit is contained in:
Dmitry Kokorin 2026-09-25 23:25:05 +03:00
parent 4274488410
commit 7d3794560e
46 changed files with 1831 additions and 21889 deletions

View file

@ -21,7 +21,7 @@ no records (verified 2026-09-20)
| lang | file | size | source |
|------|------|------|--------|
| EN | 44-more-english-fairy-tales-en-bodley-1968.pdf | 7.3 MB | lg f/101246384 (2026-09-25 rescue; «English + More English Fairy Tales», Bodley Head 1968, ill. E. Ardizzone) |
| EN | — (cross-ref sec03: 41-jacobs-english-ft-en-1968.pdf) | — | sec03 file (dedup 2026-09-25: дубликат md5-идентичен) |
| EN | 44-more-english-fairy-tales-en-abcclio-2002.pdf | 7.9 MB | lg f/91731102 (2026-09-25 rescue; ABC-CLIO 2002, серия Zipes) |
## Notes