7d3794560e
cross-section dedup system (user tasks 2+3, 2026-09-25):
...
- tools/xref.py: master book list for ALL 12 sections (RAW 07-12 scraped: sections/07/RAW.md
+ data/isap-raw/), cross-ref matcher (CW gate + distinctive tokens + years + Cyrillic
transliteration), stale MANIFEST 'Not downloadable' checker; data/MASTER-LIST.md generated
(17 book-dupes in 01-06 found, e.g. sec01#51=sec06#14 Solomon)
- file-level dedup: 17 md5-identical files removed from later sections (kept in first),
MANIFESTs/cards -> cross-ref rows, totals updated (sec01 102 / 02 37 / 03 125 / 04 38 /
05 38 / 06 37), dedup rule in AGENTS.md + MANIFEST Notes
- sec05 MANIFEST phantom line '03 Aion' removed (Aion not in sec05 list; files in sec01)
- sec03 #44 : 1968 Bodley file was #41 's book (content 'English Fairy Tales') — removed,
#44 keeps ABC-CLIO 2002
2026-09-25 23:25:05 +03:00
b7ddfac17e
sec06: key-vs-f_id discovery — 12 EN files recovered (6 rescues) + precheck v2
...
- USER FINDING: libgen edition files map {key: {f_id, md5}} — KEY and f_id VALUE
are DIFFERENT file records; we were downloading/prechecking by the KEY (wrong file).
- Recovered by f_id: 09-t1 (Eliade UCP 1978), 13 Sungod (Cornell 2010), 14 Solomon
(Karnac 2007), 17 God-Image (Inner Light 1992), 19 Hornung (UNC 1982), 20 Psyche in
Scripture (1995), 23 Dionysos (Bollingen LXV/2 Princeton) + backups 12/16/24/25/26/27.
All content-verified. '24 systemic mislinks' = our bug, not libgen.
- lg.py: objects[]=f,e,s,a,p,w + topics[] (file-level search; found Solomon md5) +
md5 in output. lgdl.py: bymd5 subcommand.
- precheck v2: rev-value match = OK; locator words >=2 shared = OK; words present
0 shared = BAD; hash/ISBN/empty locator = no signal (SUSPECT); digit-runs masked
before tokenization (hex 'aaae' trap).
- MANIFEST/SUMMARY/cards/AGENTS.md updated. 34 files, 608 MB (28 backup still downloading).
2026-09-25 10:04:01 +03:00
7b24100450
sec06: 28 карточек (11 ✅ /2 🔶 /15 ❌ ) + rulabel.py (ru labels как канал канонической кириллицы)
...
- Кросс-рефы: 01→sec01#05, 02→sec02#06, 03→sec01#32, 05→sec03#09, 06→sec01#15, 11→sec03#20
- Новые ✅ : Eliade HRI («История веры и религиозных идей» Акад.проект 2008-09),
Otto «Священное» СПбГУ 2008, Kerényi «Дионис» ВРС 2007, MacCulloch Э/Эксмо 2018,
Schimmel «Мир исламского мистицизма» Садра 2012, Scholem 4 изд., von Franz CW6
(«Видения Николая из Флюэ…» Акад.проект 2025, rescue через rutitles diff)
- tools/rulabel.py: Wikidata ru label + aliases = каноническая кириллица
(VIAF/ISNI/GND/BnF с этой машины недоступны: 403/mёртвые API). Ловушки:
Циммер не Зиммер, Корбен не Корбин, Шолем не Шулем.
- AGENTS.md: источник 12 дополнен (rulabel.py + статус authority-APIs)
2026-09-24 11:26:20 +03:00
