dima/jung
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

cross-section dedup system (user tasks 2+3, 2026-09-25):

Browse source 
- tools/xref.py: master book list for ALL 12 sections (RAW 07-12 scraped: sections/07/RAW.md
  + data/isap-raw/), cross-ref matcher (CW gate + distinctive tokens + years + Cyrillic
  transliteration), stale MANIFEST 'Not downloadable' checker; data/MASTER-LIST.md generated
  (17 book-dupes in 01-06 found, e.g. sec01#51=sec06#14 Solomon)
- file-level dedup: 17 md5-identical files removed from later sections (kept in first),
  MANIFESTs/cards -> cross-ref rows, totals updated (sec01 102 / 02 37 / 03 125 / 04 38 /
  05 38 / 06 37), dedup rule in AGENTS.md + MANIFEST Notes
- sec05 MANIFEST phantom line '03 Aion' removed (Aion not in sec05 list; files in sec01)
- sec03 #44: 1968 Bodley file was #41's book (content 'English Fairy Tales') — removed,
  #44 keeps ABC-CLIO 2002
This commit is contained in:
Dmitry Kokorin 2026-09-25 23:25:05 +03:00
parent 4274488410
commit 7d3794560e
46 changed files with 1831 additions and 21889 deletions
Download patch file Download diff file Expand all files Collapse all files

BIN
downloads/04-pictures/01-cw9-archetypes-en-routledge-1981.pdf (Stored with Git LFS)
View file

Binary file not shown.

10
downloads/04-pictures/MANIFEST.md
View file

@ -2,7 +2,7 @@
## Totals
39 files, 1.3 GB (RU 17 / EN 22)
38 files, 1.3 GB (RU 17 / EN 22) — 1 файла удалено как дубли (dedup 2026-09-25)
## Files (per item)
@ -10,7 +10,7 @@
| file | size | source | verify |
|---|---|---|---|
| 01-cw9-archetypes-en-routledge-1981.pdf | 9 MB | lg f/91730239 | pdftext: 2nd ed editorial note ✓ |
| — (cross-ref sec02: 04-cw9-1-archetypes-en-1981.pdf) | — | sec02 file | dedup 2026-09-25: файл дублирует 02 (md5-идентичен) — файл удалён, cross-ref |
| 01-cw9-archetypes-en-princeton-1980-a.pdf | 48 MB | lg f/92458298 | pdftext: "THE ARCHETYPES… 2nd ed, Bollingen XX" ✓ |
| 01-cw9-archetypes-en-princeton-1980-b.pdf | 49 MB | lg f/92459383 | pdftext: same Princeton 2nd ed ✓ |
| 01-cw9-archetypes-en-princeton-1977-a.pdf | 9 MB | lg f/100688964 | pdftext: 2nd ed, R.F.C. Hull tr. ✓ |
@ -106,7 +106,7 @@
|---|---|---|---|
| 38-ottmann-color-symbolism-en-eranos.epub | 469 KB | lg f/107212960 | epub TOC verified: "edited by KLAUS OTTMANN", 7 lectures (Benz, Corbin, Huyghe, Izutsu, Portmann, Scholem, Zahan) — matches Касталия RU edition ✓ |
## FINAL TALLY — section 04, 12 items, 39 files, 1.3 GB
## FINAL TALLY — section 04, 12 items, 38 files, 1.3 GB
| item | EN files | RU files |
|---|---|---|
@ -162,3 +162,7 @@ ETA total ≈ 10 h. All 12 items fully searched; items 11/24/26/31/32/38 complet
Rule (user): per language, ALL pdfs if any pdf exists; else all fb2; else all epub; else all doc.
Naming: `NN-<slug>-<lang>-<edition>.<ext>`. Verification: size == libgen filesize + magic sniff + content spot-check.
Status: ⬜ pending / ⬇ downloading / ✔ verified / ✘ failed (tried alternatives)
## Notes
**2026-09-25 (cross-section dedup):** md5-сверка всех downloads/ — 17 пар идентичных файлов (книга, уже скачанная в ранней секции, повторно скачана в поздней). Файлы УДАЛЕНЫ из поздней секции, в MANIFEST/карточках — cross-ref на раннюю. Правило: файл хранится ровно в одной секции — первой, где книга появилась. Инструмент: `tools/dedup_files.py` (разовый) + `tools/xref.py` (профилактика).