dima/jung
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

cross-section dedup system (user tasks 2+3, 2026-09-25):

Browse source 
- tools/xref.py: master book list for ALL 12 sections (RAW 07-12 scraped: sections/07/RAW.md
  + data/isap-raw/), cross-ref matcher (CW gate + distinctive tokens + years + Cyrillic
  transliteration), stale MANIFEST 'Not downloadable' checker; data/MASTER-LIST.md generated
  (17 book-dupes in 01-06 found, e.g. sec01#51=sec06#14 Solomon)
- file-level dedup: 17 md5-identical files removed from later sections (kept in first),
  MANIFESTs/cards -> cross-ref rows, totals updated (sec01 102 / 02 37 / 03 125 / 04 38 /
  05 38 / 06 37), dedup rule in AGENTS.md + MANIFEST Notes
- sec05 MANIFEST phantom line '03 Aion' removed (Aion not in sec05 list; files in sec01)
- sec03 #44: 1968 Bodley file was #41's book (content 'English Fairy Tales') — removed,
  #44 keeps ABC-CLIO 2002
This commit is contained in:
Dmitry Kokorin 2026-09-25 23:25:05 +03:00
parent 4274488410
commit 7d3794560e
46 changed files with 1831 additions and 21889 deletions
Download patch file Download diff file Expand all files Collapse all files

BIN
downloads/03-myths-fairy-tales/44-more-english-fairy-tales-en-bodley-1968.pdf (Stored with Git LFS)
View file

Binary file not shown.

10
downloads/03-myths-fairy-tales/MANIFEST.md
View file

@ -2,7 +2,7 @@
## Totals
119 files, 1.3 GB (RU 51 / EN 68) + 7 rescue-файлов 2026-09-25 (EN +7, +142 MB: 24, 30, 43×2, 44×2, 66)
125 files, 1.4 GB (RU 51 / EN 68) + 7 rescue-файлов 2026-09-25 (EN +7, +142 MB: 24, 30, 43×2, 44×2, 66) — 1 файла удалено как дубли (dedup 2026-09-25)
## Files (per item)
@ -446,7 +446,7 @@ free-файл не найден (flib/libgen 0, verified 2026-09-25, sec06 sweep
- `43-indian-fairy-tales-en-se-2021.epub` (0.65 MB) — lg f/113903507, Standard Ebooks 2021 ✅
### 44 — 2 files, 15 MB (rescue 2026-09-25)
- `44-more-english-fairy-tales-en-bodley-1968.pdf` (7.3 MB) — lg f/101246384, «English Fairy Tales + More English Fairy Tales», Bodley Head 1968, ill. E. Ardizzone ✅
- ~~44-more-english-fairy-tales-en-bodley-1968.pdf~~ — dedup 2026-09-25: файл дублирует 03 (md5-идентичен) — файл удалён, cross-ref: `41-jacobs-english-ft-en-1968.pdf` (sec03)
- `44-more-english-fairy-tales-en-abcclio-2002.pdf` (7.9 MB) — lg f/91731102, ABC-CLIO 2002 (Zipes series) ✅
### 45 — 3 files, 24 MB
@ -513,5 +513,9 @@ free-файл не найден (flib/libgen 0, verified 2026-09-25, sec06 sweep
## Conventions
**119 files, 1.3 GB** (2026-09-20). EN: libgen.vg (first) + archive.org (CW13, Frazer 1922).
**125 files, 1.4 GB** (2026-09-20). EN: libgen.vg (first) + archive.org (CW13, Frazer 1922).
RU: flibusta.is (pdf/djvu via /b/<id>/download, fb2 direct) + libgen + lib.ru.
## Notes
**2026-09-25 (cross-section dedup):** md5-сверка всех downloads/ — 17 пар идентичных файлов (книга, уже скачанная в ранней секции, повторно скачана в поздней). Файлы УДАЛЕНЫ из поздней секции, в MANIFEST/карточках — cross-ref на раннюю. Правило: файл хранится ровно в одной секции — первой, где книга появилась. Инструмент: `tools/dedup_files.py` (разовый) + `tools/xref.py` (профилактика).