cross-section dedup system (user tasks 2+3, 2026-09-25):

- tools/xref.py: master book list for ALL 12 sections (RAW 07-12 scraped: sections/07/RAW.md
  + data/isap-raw/), cross-ref matcher (CW gate + distinctive tokens + years + Cyrillic
  transliteration), stale MANIFEST 'Not downloadable' checker; data/MASTER-LIST.md generated
  (17 book-dupes in 01-06 found, e.g. sec01#51=sec06#14 Solomon)
- file-level dedup: 17 md5-identical files removed from later sections (kept in first),
  MANIFESTs/cards -> cross-ref rows, totals updated (sec01 102 / 02 37 / 03 125 / 04 38 /
  05 38 / 06 37), dedup rule in AGENTS.md + MANIFEST Notes
- sec05 MANIFEST phantom line '03 Aion' removed (Aion not in sec05 list; files in sec01)
- sec03 #44: 1968 Bodley file was #41's book (content 'English Fairy Tales') — removed,
  #44 keeps ABC-CLIO 2002
This commit is contained in:
Dmitry Kokorin 2026-09-25 23:25:05 +03:00
parent 4274488410
commit 7d3794560e
46 changed files with 1831 additions and 21889 deletions

View file

@ -22,7 +22,7 @@
| lang | file | size | source |
|------|------|------|--------|
| EN | 01-cw9-archetypes-en-routledge-1981.pdf | 9 MB | lg f/91730239 |
| EN | — (cross-ref sec02: 04-cw9-1-archetypes-en-1981.pdf) | — | sec02 file (dedup 2026-09-25: дубликат md5-идентичен) |
| EN | 01-cw9-archetypes-en-princeton-1980-a.pdf | 48 MB | lg f/92458298 |
| EN | 01-cw9-archetypes-en-princeton-1980-b.pdf | 49 MB | lg f/92459383 |
| EN | 01-cw9-archetypes-en-princeton-1977-a.pdf | 9 MB | lg f/100688964 |