a05bc9ecc3
аудит B-02: +76 строк '## Downloads' в 73 карточках (66 без секции + 10 неполных; sec09 ×43, sec06 ×20, sec12 ×7, sec10 ×4, sec08/11 ×1); fix check-md.py: DL_DIR mapping sec09/sec10 (parity-чек был тихо выключен); rename bonus-tfp → 13-bonus-tfp; parser guard +de (Kerényi DTV 1956)
2026-10-05 00:08:24 +03:00
c78a1fe792
reading-list: RU-клетка больше не пустая для найденных изданий (47 -> 0): (1) make_rootlist card_ru_title — таблица без separator-строки, header 'RU title', lang-first-строки, + cross-ref-резолвинг RU-названия из канонической карточки по Status ('cross-ref secNN #MM' / 'see ../NN-.. #MM'); (2) 6 карточек: sec01 #04/#35 (остатки '— нет' -> cross-ref-строки + Status), #21 («О природе анимуса» неофиц. 2013), sec04 #28 (глава «Символизм в изобразительном искусстве»), #30 («О духовном в искусстве»), sec12 #20 («В самые тёмные места» ИОИ 2020); (3) 3 user-rescue 09-27 (sec09 #12/#24/#35) — RU-таблицы заполнены (СТД 2003 / ИАП 2001+ИОИ 2016 / Касталия 2026); (4) sec08 #13 Wilkinson Coming into Mind: INDEX ✅ -> ❌ (канон sec01 #55 = RU нет, ✅ было ошибкой)
2026-10-01 10:45:49 +03:00
33979959fa
counters: is_en/is_ru понимают legacy-суффиксы (-en.<ext>, -ru.<ext>, -ru.b.<ext>) — 30 файлов по всем секциям больше не падают в 'other'; totals-строки всех 12 MANIFEST пересчитаны по диску (sec01 47/71/0, sec03 52/103/0, sec04 EN+1, sec05 +0.1MB, sec02 +0.4MB — ручные цифры были неточны); rootlist==MANIFEST==disk по всем 12 секциям; legacy-имена задокументированы в CONTEXT.md как долг (не ренейм, FINAL-секции)
2026-10-01 10:04:36 +03:00
aa6bfde7ca
make_rootlist.py: подзаголовок секции — 5 строк (hard-break), каждая метрика отдельной строкой: книг/NEW+xref, RU-издание, EN-оригинал скачан, RU-перевод скачан, Файлов (EN/RU/other)
2026-10-01 09:38:45 +03:00
a6886652dd
make_rootlist.py: секционный подзаголовок v2 — 2 строки с явными лейблами: 'N книг (все NEW / X NEW + Y cross-ref)' + 'RU-издание: ✅ .. найдено · 🔶 .. частично · ❌ .. нет — EN-оригинал скачан: a/b — RU-перевод скачан: c/d — файлов: N (EN/RU/other)'. Xref-детект по карточке -xref.md (раньше не работал — все секции показывались 'all NEW' в метриках). RU-перевод скачан = NEW-items с ≥1 RU-файлом из найденных ( ✅ + 🔶 ); EN = NEW-items с ≥1 EN-файлом из всех NEW.
2026-10-01 09:36:34 +03:00
5854be7209
make_rootlist.py: динамическая дата (datetime.date.today) вместо захардкоженной 2026-09-28
2026-10-01 00:01:42 +03:00
bf89857037
tools/aa.py: AA search/dl tool (cookie-based curl + camoufox DDG hybrid solver: checkbox->captcha PNG->/tmp/aa-code; search/info/dl work with saved cookies; challenge auto-pass blocked by headless WebGL fingerprint — cookies from real browser needed)
2026-09-30 11:22:27 +03:00
0b092a7b82
sweep 01-06: big-file resume queue (vol1 184MB + art 298MB, .part resume-safe)
2026-09-29 11:04:30 +03:00
bfba5fa048
sweep 01-06 wrap-up: READING-LIST regen (583 files), generator xref-tally fix, INDEX fixes
...
- make_rootlist.py: xref items no longer counted into section status tallies
(they carry the canonical card's marker in parens, which was inflating counts:
sec11 6/1/0, sec10 5/0/27 now correct)
- sec10 INDEX: #23 Jamison, #33 Saks ❌ ->✅ (stale after user-oracle rescues)
- sec03 MISSING: #65 stale entry counted out (already corrected 2026-09-24)
- AGENTS.md: section file counts + sec03 40/0/28 + total 583 files
- READING-LIST.md regenerated: 583 files, 768 links
2026-09-29 10:10:20 +03:00
dc3477e2b8
sweep 01-06: sec04 #17 (Art Psychotherapy Psychosis) + sec01 #42 (Freud Unconscious Penguin) verified
2026-09-29 10:02:20 +03:00
99e889d206
sec03 EN sweep 01-06: +7 files (15,19,31,32,33,36,47) + Eliade canonical move (sec05#07 -> sec03#25)
...
libgen re-sweep of EN gaps in sections 01-06 (user request; improved sweep:
file-level objects[]=f + full 100-row dumps) — 75 candidates, 7 rescues verified:
- sec03 #15 Witches Ogres (Shambhala 1992, 236pp, cover OK)
- sec03 #19 Hermes and His Children (Daimon 2020 2nd ed., epub ISBN in file)
- sec03 #31 European Folktale (Indiana 1986, 204pp, cover OK)
- sec03 #32 Fairytale as Art Form (Indiana 1987, 232pp, title OK)
- sec03 #33 Once Upon a Time (Ungar 1976 1st ed., 204pp, title OK; RAW 'Indiana 1970' = ISAP typo)
- sec03 #36 Irresistible Fairy Tale (Princeton 2012, epub OK)
- sec03 #47 Heart of the Hunter (Vintage 2010, mobi)
+ sec02 #16 A Little Course in Dreams (Shambhala 1986, 137pp, verified)
Canonical location fix: Eliade 'Myths, Dreams and Mysteries' files moved
sec05 -> sec03 (first appearance); sec03 #25 card ❌ -> ✅ (RU was found in sec05
rescue 2026-09-21, card was stale).
Still downloading (queue tools/lgdl-en0106-queue.sh): sec03 #50 (Atlas x4), #55 , #57 ,
sec04 #04 (Art of C.G. Jung 2018, 298MB), #17 , sec01 #42 (Freud Unconscious Penguin).
Rejected: 04#23 Encyclopedia (JSTOR article 467KB), 05#16 Singer 2023 (different book).
2026-09-29 08:54:31 +03:00
7a402ee0ba
READING-LIST.md: root view of the whole ISAP list with file links (tools/make_rootlist.py)
...
User request: one big list at repo root mirroring isapzurich.com/en/library/reading-list —
every book with links to ALL downloaded files, INCLUDING cross-section books (link always
resolves to the canonical section's file, tagged →secNN; per user: link every time the
book is mentioned, even if downloaded in an earlier section).
- 483 positions (12 sections), 566 files, 1234 links, 0 broken (verified)
- sources: sections/NN/INDEX.md (items) + downloads/NN/MANIFEST.md (files) + cards (RU title)
- resolves: per-item blocks, xref rows (secNN #MM), legacy 5-col rows (| EN | file | …),
legacy prose «Файлы: `path`» rows, glob xref rows (04-cw9-archetypes-*), card-name drift
(sec07 INDEX) by item-number prefix
- manifest fixes found while building: sec08/10/11 'files in sec??' headings → '0 files'
(23 blocks, paid/absent files), sec12 #03 xref row gained #19 , sec11 #13 → 0 files
- AGENTS.md: layout line + total corrected (483 positions, 566 files)
CANON question answered: the new manifest canon (09-12 style) is exactly what makes this
generator possible; sec01-08 were migrated to it in the previous commit.
2026-09-29 00:07:02 +03:00
2847f1bcea
manifests 01-12: canonical v1 full migration (tools/migrate_manifests_canonical.py)
...
- per-item blocks for EVERY INDEX item (01: 49->55, 02: 28->57, 03: 39->68,
04: 12->39, 05: 23->29); xref blocks: sec02#21->sec01#44, sec12#03/06/13/18/21
- heading normalization (no status/✔/prose tails), INDEX order everywhere (sec12
27/28/31 repositioned)
- tail blocks in canonical order: Not downloadable -> Cross-references -> Notes
(sec04 ND block built from MISSING.md + #16 row; sec03 + #13/#28 rows)
- 2 orphan file rows added: sec06 #26 scholem en-b.epub, sec07 #02 cw3-ru fb2
- Totals recounted from disk (all 12 sections verified: files = mentions)
- 0 file rows lost (git old-vs-new diff check)
- xref.py stale-line check: clean
Prep step for the repo-root READING-LIST.md generator (per user).
2026-09-28 23:50:09 +03:00
726c4b37a4
cleanup: remove queue logs (reproducible from MANIFEST f_ids)
2026-09-28 23:15:28 +03:00
76d044c96b
sec12 FINAL v2: queue2 + oracle round 2 — 35 files (184 MB: EN 27 + RU 8)
...
- queue2 done: Fordham 1973 (214pp), GG-Craig Power (85pp scan, ISBN 0-88214-304-2),
Hannah EN 1981 (266pp), Leonard EN 1990 (416pp, 70MB), Narcissism EN ×2 (191pp)
- не докачалось: Balint 2017b (троттлинг) — не критично
- итог: 14 ✅ / 1 🔶 / 20 ❌
2026-09-28 23:15:20 +03:00
291c3a364f
sec10 phases 1-3: 32 NEW cards (3 ✅ / 29 ❌ ) + 5 xref cards + dossiers fixed (RAW-canonical books) + 6 RU files + EN queue started
2026-09-27 21:13:06 +03:00
e20e2ba1a5
sec09 FINAL: downloads (41 files, 361MB: EN 27 + RU 14) + MANIFEST + SUMMARY + MISSING + AGENTS.md
...
- All 41 files content-verified (pdfinfo + first-page text; epubs xhtml; fb2 titles)
- 08 Fonagy = EN original (renamed -en-); Wirtz #38 = BOOK (Spring Journal Books 2014, 358pp)
- Bonus: Kawai Myōe (Castalia 2018 part 1, flib x2) + TFP Clinical Guide (Yeomans/Clarikin/Kernberg 2018, DIFFERENT TFP book)
- xref.py stale-check: 1-token distinctive match too weak (Stein/Kohut 'treatment' false positive) -> >=2 required
- .gitattributes: +sec05/07/08/09 LFS dir rules
- Linter 0, xref stale 0
2026-09-27 14:11:05 +03:00
5e07978171
xref.py: parser fixes (space-initial authors, hyphen-split surnames, multi-author/multi-work splits, 07-08 cards in pool, min-set scoring)
...
- AUTHOR_LINE: 'Kalsched D.' (space-initial) now recognized as entry start
- hyphen-split surname across lines: 'Schwartz-' + 'Salant, N.'
- multi-author entries split across lines (Hersh/Caligor/Yeomans)
- multi-work author blocks now split per book (Jacoby sec08: Shame is separate)
- card_entries: glob 0[1-9] (was 0[1-6]) — sec07/08 cards now matchable
(fixed 5 matcher misses: Bowlby I/II, Winnicott, Jacoby, Knox)
- score_pair: min-set overlap ratio + eps by inter size (subset tie-break: Vol.I vs Vol.II)
- curly quotes excluded from new-book split trigger
sec09 table: 19 auto-xref (18 true + 1 fragment), 19 NEW
2026-09-27 11:43:53 +03:00
4bc2bfb6e4
sec08 MANIFEST rebuilt to sec01-07 cancon (per-item 'N files' headers, Cross-references before Not downloadable); queue scripts generalized to tools/lgdl-queue.sh + lgdl-rounds.sh, logs/queue removed from downloads dir
2026-09-26 22:45:03 +03:00
9805eabf2c
sec08 FULLY COMPLETE: 48 books (20 ✅ /1 🔶 /27 ❌ ), 44 files (333 MB: EN 31 + RU 13)
...
Research (Phase 0-2): 28 new dossiers + 8 updated; RSL/libgen/flib/castalia/alib/rutitles sweeps;
5 RU rescues (CW4 АСТ 2021, Калшед Когито 2015, Нойманн «Ребёнок» Касталия 2026,
Фордхэм «Дети как личности» Касталия-предзаказ, Герман Бомбора 2022); Blos trap documented
(RU «Психоанализ подросткового возраста» = The Young Adolescent, NOT On Adolescence).
Downloads (content-verified, mislinked/review files discarded: 08/14/18/27/30/38 reviews,
33 JAPA article, 2 md5 dups):
- EN 31: libgen queue (en-queue.sh tries=3 + 25-min cooldown rounds) + ia (CW4 Princeton,
Freud SE 24 vol. for items 19/20); EN gaps: 15/24/39 absent, 14/18/38 ia-restricted,
08/27/30/33 review-fragment-only, 25 absent
- RU 13: flib ×7 + libgen ×6; RU gaps: 25 (no file), 08 (preorder)
Docs: 48 cards CANON v3 (linter 0), MANIFEST 48 per-item blocks, MISSING 27❌ /1🔶 ,
SUMMARY at-a-glance; xref stale-check 0; migrate_cards_v3.py: +rtf to fname_re
2026-09-26 21:48:43 +03:00
285b485377
sec08 stage 0: RAW normalized (multi-author fixes), xref parser patch (4 authors), INDEX (46 items: 41 NEW + 5 xref)
...
- RAW: Mahler/Pine/Stone 1975 vs Stone/Church 1968 (2 separate books), Grossmann×2/Waters
joined; xref.py AUTHOR_LINE now supports up to 4 author groups + continuation-year lines
- xref map: 51 raw entries → 46 unique books (5 B-list duplicates merged); 5 xrefs
(CW8→sec01#03, CW9/I→sec01#04, CW17→sec02#09, Wilkinson→sec01#55, Children's Dreams→sec02#11)
- largest section so far (46 vs 28 sec06)
2026-09-26 16:23:05 +03:00
188e00d2fb
sec07: rescue wave 2 — CW3 RU (АСТ 2025 via flib .su) + 7 EN files (file-level libgen + DOI) + tools/doi.py
...
- CW3 (#02 ) = ✅ : «Психогенез душевных болезней» АСТ 2025 (flibusta.su b/390112;
.su ≠ .is по контенту; калка «психических» вела в тупик; найден браузером пользователя)
- EN rescues (file-level libgen objects[]=f, подсказки пользователя): CW2 1981 pdf 662pp
+ 1973 epub, CW3 1960 pdf 325pp + 1982 epub, Bovensiepen JAP 2006 (ed 15358298),
Krieger JAP 2019 (ed 84462696 — ссылка пользователя), Meier I JAP 2019 (ed 84462697)
— все контент-верифицированы (статьи: автор+журнал+abstract = RAW, не рецензии)
- tools/doi.py: Crossref author+title → DOI → libgen req=DOI (контроли 3/3);
DOI Meier I верифицирован = 10.1111/1468-5922.12545
- CW2 RU: доп. свип (ast.ru server-side search, litres, Yandex Books, Neoclassic) = 0
- AGENTS.md: sources 10c (DOI pipeline) + 10d (flib .su); status line
- итог sec07: 4 ✅ / 23 ❌ RU, 20 EN files (87 MB), linter 0, xref stale 0
2026-09-26 14:40:42 +03:00
b47ff7234c
sec07 stage 0: normalized RAW (parseable by xref), verbatim to data/isap-raw, INDEX.md 27 items
...
- RAW re-scraped from official ISAP PDF (2025 ed., 2pp): multi-author items combined
(Solms/Panksepp, Alcaro/Carta, Panksepp/Biven), same-author repeats for separate works
(Kast x3, Krieger x3)
- xref.py AUTHOR_LINE: initials blob now handles 'C. A.'-style multi-initials
(08-12: +1 recovered item each)
- MASTER-LIST sec07: 24 NEW (16 books + 8 articles) + 3 xref (CW8->sec01#03,
Jacobi->sec01#20, Kast Dynamics->sec04#11)
2026-09-26 11:45:14 +03:00
f5cb34195e
content audit sec01-06: fixes (audit_content.py + 12 file/card corrections)
...
- tools/audit_content.py: per-file vs item-title triage (SUSPECT/SMALL/NO-TEXT/NO-CYR)
- sec01: .part removed; 10 files restored .pdf ext (LFS rename); #04/#19/#27 verify notes
- sec02 #16 : corrupted double-encoded txt -> clean flib fb2 b/844509; #17/#22 doc verified via catdoc
- sec03 #11 : -b epub = Spanish von Franz (Paidós 1983, forged EN OPF) -> bonus label
- sec03 #42 : КАРО 2012 'Irish Tales' = EN reader (not RU, not the listed book) -> bonus rename
- sec03 #56 : Onians b/c/d/e = Cambridge 24-87KB previews -> labeled
- sec06 #18 : filename 1981->1989 (Perera 'Descent to the Goddess' 1989; 1981 = other book)
- sec06 #28 : ia Zimmer OCR layer = foreign Devanagari text; images = RKP (p.100 verified)
- sec04 #30 : buksmart 2020 = RU/FR bilingual w/ VeryPDF watermarks -> note
- linter: azw3/mobi ext + underscore in fname regex; manifest cross-check ignores off-disk rows;
8 legacy cards section-order fixed (CR before DL)
- AGENTS.md: 'Content audit (2026-09-25)' lessons section
- check-md: 0/219
2026-09-26 01:32:02 +03:00
7d3794560e
cross-section dedup system (user tasks 2+3, 2026-09-25):
...
- tools/xref.py: master book list for ALL 12 sections (RAW 07-12 scraped: sections/07/RAW.md
+ data/isap-raw/), cross-ref matcher (CW gate + distinctive tokens + years + Cyrillic
transliteration), stale MANIFEST 'Not downloadable' checker; data/MASTER-LIST.md generated
(17 book-dupes in 01-06 found, e.g. sec01#51=sec06#14 Solomon)
- file-level dedup: 17 md5-identical files removed from later sections (kept in first),
MANIFESTs/cards -> cross-ref rows, totals updated (sec01 102 / 02 37 / 03 125 / 04 38 /
05 38 / 06 37), dedup rule in AGENTS.md + MANIFEST Notes
- sec05 MANIFEST phantom line '03 Aion' removed (Aion not in sec05 list; files in sec01)
- sec03 #44 : 1968 Bodley file was #41 's book (content 'English Fairy Tales') — removed,
#44 keeps ABC-CLIO 2002
2026-09-25 23:25:05 +03:00
4274488410
authors: wiki-anchor audit — 1 wrong QID fixed (Homer: Q327970=Uzhevych → Q6691),
...
9 wikipedia URLs normalized to wikidata, tools/audit_anchors.py (all-language label match)
2026-09-25 22:39:01 +03:00
b7ddfac17e
sec06: key-vs-f_id discovery — 12 EN files recovered (6 rescues) + precheck v2
...
- USER FINDING: libgen edition files map {key: {f_id, md5}} — KEY and f_id VALUE
are DIFFERENT file records; we were downloading/prechecking by the KEY (wrong file).
- Recovered by f_id: 09-t1 (Eliade UCP 1978), 13 Sungod (Cornell 2010), 14 Solomon
(Karnac 2007), 17 God-Image (Inner Light 1992), 19 Hornung (UNC 1982), 20 Psyche in
Scripture (1995), 23 Dionysos (Bollingen LXV/2 Princeton) + backups 12/16/24/25/26/27.
All content-verified. '24 systemic mislinks' = our bug, not libgen.
- lg.py: objects[]=f,e,s,a,p,w + topics[] (file-level search; found Solomon md5) +
md5 in output. lgdl.py: bymd5 subcommand.
- precheck v2: rev-value match = OK; locator words >=2 shared = OK; words present
0 shared = BAD; hash/ISBN/empty locator = no signal (SUSPECT); digit-runs masked
before tokenization (hex 'aaae' trap).
- MANIFEST/SUMMARY/cards/AGENTS.md updated. 34 files, 608 MB (28 backup still downloading).
2026-09-25 10:04:01 +03:00
7b24100450
sec06: 28 карточек (11 ✅ /2 🔶 /15 ❌ ) + rulabel.py (ru labels как канал канонической кириллицы)
...
- Кросс-рефы: 01→sec01#05, 02→sec02#06, 03→sec01#32, 05→sec03#09, 06→sec01#15, 11→sec03#20
- Новые ✅ : Eliade HRI («История веры и религиозных идей» Акад.проект 2008-09),
Otto «Священное» СПбГУ 2008, Kerényi «Дионис» ВРС 2007, MacCulloch Э/Эксмо 2018,
Schimmel «Мир исламского мистицизма» Садра 2012, Scholem 4 изд., von Franz CW6
(«Видения Николая из Флюэ…» Акад.проект 2025, rescue через rutitles diff)
- tools/rulabel.py: Wikidata ru label + aliases = каноническая кириллица
(VIAF/ISNI/GND/BnF с этой машины недоступны: 403/mёртвые API). Ловушки:
Циммер не Зиммер, Корбен не Корбин, Шолем не Шулем.
- AGENTS.md: источник 12 дополнен (rulabel.py + статус authority-APIs)
2026-09-24 11:26:20 +03:00
bc1f91d9be
authors: systemic identity audit — Wiki anchors + 9 date/kinship corrections
...
User caught: Emma Jung dossier said '1877-1965, Jung's eldest daughter'
(actually 1882-1955, his WIFE, Q124210). Systemic response:
- New MANDATORY field **Wiki anchor:** (QID + URL) in dossier canon (AGENTS.md)
- tools/verify_dossiers.py: resumable Wikidata audit (bulk wbgetentities for
anchored, search+CANDIDATE review for the rest, 429 backoff, TSV report)
- 82 dossiers now anchored; 76 marked no-confirmed-QID (WIKI-CHECK notes)
- Date/kinship corrections found by the audit:
* Emma Jung: wife not daughter, 1882-1955 (Q124210)
* Verena Kast: b. 1943 not 1951, father Walter Kast not 'Hans Kast' (Q2515260)
* James Hillman: 1926 not 1941 (Q934774)
* Jolande Jacobi: 1890-1973 not 1902-1980 (Q88022)
* Maria Czaplicka: d. 1921 not 1939 (Q532804)
* Henri Ellenberger: 1905-1993 not 1900-1987 (Q115111)
* Edward F. Edinger: 1922-1998 not 1905-2001 (Q5819984, en.wiki)
* Hans Dieckmann: d. 2007 not 2005 (Q59526701)
* Heinrich Zimmer: 1890-1943, anchored to the Indologist Q215922
(not the Celtist Q76954)
- Homonym traps documented in TSV notes (John Hill=botanist, Karl
Koch=hacker, Barbara Meier=model, Andrew Samuels=soccer, etc.)
2026-09-24 10:29:54 +03:00
2a2699d61a
sec05: EN downloads complete (30 files) + SUMMARY at-a-glance + lgdl queue infra
...
- 30/31 EN candidates downloaded via libgen, all content-verified
(magic+pages+first-page text); 08b 37-pp fragment discarded
- EN gaps: 04/05/15/16/23 not found (rare academic), 03/14 ia-restricted
- MANIFEST.md: EN sections per item + not-downloadable extended
- 26 cards: Downloads tables w/ EN rows + EN NOT FOUND notes (6 cards)
- SUMMARY.md created (canon v1): at-a-glance table 29 items, EN->RU authors
- tools/lgdl.py: speed-probe + CDN-edge re-draw (per-request get.php
302s to different storage hosts), connect timeout, stall wipe on first stall
- AGENTS.md: Lesson 9 (EN-queue infra: ads.php throttle, watchdog,
unbuffered logs, dual-queue trap, AA 403, i2p verdict)
2026-09-24 00:04:13 +03:00
67fac97559
tools/lgdl.py: precheck <f_id> <edition_id> [pages] — mislinked-file gate (reverse-map editions + locator batch path + size sanity; exit 0/1/2); dl with 4th arg auto-prechecks and aborts on RED. Tested: caught 3 bad files (Одержимый магией / Laso / Captain Action comic); OK path verified
2026-09-23 00:49:32 +03:00
d01e323e75
liart.py: OPAC-Global protocol probed (direct.exe FindView/FindSize, guest session); SearXNG record-URL fallback works; direct mode blocked on search labels+iddb (admin-only InfoDB) — data/liart-params.json stub for browser read
2026-09-22 08:42:06 +03:00
31cb0dea70
unification: dossiers → CANON v1 (104/142 changed: H1 [dates] incl. open-ended for living, Homonym warnings unified, RU-name sections → canonical field, Round logs → Notes, Dossier status dropped)
2026-09-21 23:59:49 +03:00
680bf45ee1
unification: SUMMARY → CANON v1 (Final counts, at-a-glance renamed, Authors—EN→RU generated for sec02/03 from dossiers, legacy blocks → Notes ###; sec04 totals row added; 0 rows lost)
2026-09-21 23:56:54 +03:00
62bb11a99d
unification: INDEX → CANON v1 (| # | Group | EN title | Author(s) | Status | File |), 219 rows, 0 status mismatches; sec02 legacy triage table dropped (dup of main table + cards)
2026-09-21 23:48:53 +03:00
3225039d88
unification: sec04 MANIFEST → CANON v1 (Red Book +4 files, queue-table sources resolved from f_ids, page-count pollution fixed); 4 sections' manifests unified; 136 card DL sources normalized (MANIFEST→—, ia prefix, lg f/ ids)
2026-09-21 23:47:05 +03:00
b01f539194
unification: sec03 MANIFEST → CANON v1 (per-item tables; source ids unrecorded → '—' + sweep pointer)
2026-09-21 23:43:39 +03:00
dab9e312d9
unification: sec02 MANIFEST → CANON v1 (per-item tables, cross-section block preserved)
2026-09-21 23:42:36 +03:00
62b16fa4bf
unification: sec01 MANIFEST → CANON v1 (per-item tables, Totals); +4 missing EN files (01/07 ia byte-verified, 32/49); 8 cards DL fixed (sources, missing rows)
2026-09-21 23:41:18 +03:00
f3fb432bd9
v3 migration: linter tools/check-md.py (0/219 issues); sec01 #47 RU table fixed; AGENTS.md: migration done, liart TODO + pending unification markers
2026-09-21 11:11:53 +03:00
4f5372ab56
v3 migration: sec04 #22 — ES section + Original field (Spanish original)
2026-09-21 11:09:57 +03:00
cde7a4cd4e
sec03: Phase 0 — RAW + 68 card skeletons + INDEX + AUTHORS-EN (51 rows) + 39 new author dossiers + input.tsv + oa-sec03.json (68/68 crossref)
2026-09-19 14:40:19 +03:00
34c6372836
sec02: Phase 0 — 57 book cards + RAW + INDEX + AUTHORS-EN + 33 author dossiers (full EN names resolved: Bosnak, Dieckmann=Hans, Alex=William, Hill=Clara, Mattoon, Marjasch, Shafton, Strauch/Meier, Solms, Roesler, Vedfelt, Kelsey, Delaney, Krippner, Aizenstat, Covitz, Lambert, Sanford, Wilmer, Kramer, Domhoff, Barrett/McNamara, etc.)
2026-09-18 20:46:29 +03:00
5441dddbb8
pipeline v3: RU-title candidates (rutitles+ru-dict+pymorphy3), batch sweep driver, OpenAlex/Crossref
...
- tools/rutitles.py: EN->RU token translation (data/ru-dict.tsv, 540+ pairs, Kogito/Castalia
conventions) + Jaccard diff against data/ru-titles.jsonl (692 titles: Kogito 518, Litres 24,
OPP 55, flibusta a/5272+57639+118921+122883+193690+193689). Matching is lemmatized
(pymorphy3) — case endings handled: 'великой матери' -> 'Великая мать' 1.25.
'The Great Mother' -> 'Великая мать' 1.25 top hit; 'The Symbolic Quest' -> correct negative.
- tools/sweep.py: batch driver for Phases 1-2 (rsl+lg+alib+flib+cogito+SearXNG-OZON-snippet
parse+rutitles diff per item; --nlr optional). Query log data/queries.log (JSONL).
Fixed: cogito nav-menu leak (parse bx_product_item only), libgen robot-block (lg.py curl fallback).
- tools/oa.py: OpenAlex + Crossref (Phase 0 identity/ISBN, no key; found Margaret Wilkinson,
Karen Evers-Fahey, Symbolic Quest Princeton ISBN).
- data/sweeps/01-fundamentals/input.tsv: 16 ❌ items loaded; background sweep running.
- AGENTS.md: source 10b (oa.py), flibusta .su = reduced mirror (dropped from pipeline),
pipeline v3 section (rutitles/oa/sweep/pymorphy3 note: pymorphy2 broken on py3.12).
- data/ru-titles.jsonl committed as the RU market universe asset.
2026-09-18 10:56:36 +03:00
32e505b2f9
sec01: phase 4 downloads complete (50 files, 204MB) + item 12 EN preview + flib.py pagination
...
- 45 RU + 5 EN + 1 preview downloaded (flibusta.is OPDS, libgen, archive.org)
- 10 flib pdf stubs replaced via libgen (18,22,28,29,53) or fb2 twins
- flib 'fb2+zip' files unpacked to plain fb2
- item 12 (Evers-Fahey): RG=Request-PDF; PagePlace 23pp preview saved+verified
- evers-fahey dossier enriched (ofj.org bio)
- flib.py: authorall (rel=next pagination) + author <page>
- AGENTS.md: flib pagination/quirks + PagePlace preview tip
- INDEX: phase 4 done line; 8 trade-only items listed in MANIFEST
2026-09-17 10:41:43 +03:00
4420aef7c3
sec01 phase 2 (round 1): 17/55 items resolved
...
- new ✅ : 03 (Структура и динамика психического, Когито), 10 (Эго и архетип, 2 изд.),
13 (Лекции по юнговской типологии, b/509587), 29 (Юнговская карта души, Стайн Мюррей 2010)
- ❌ with evidence: 02 (CW7), 05 (Aion — 'Эйон' 0), 16 (Shadow and Self), 21 (Animus and Anima),
38 (Woman in the Mirror), 47 (Way of All Women)
- flibusta.is OPDS sweep (tools/flib.py): 30+ author feeds checked; bonus books logged
(Edinger x10, Hillman x8, Harding x4, Henderson x2, Douglas Cambridge Handbook, Jung-E Grail Legend)
- tools/ia.py (archive.org EN search/metadata/files); AGENTS.md sources 10+13 updated
2026-09-17 00:09:03 +03:00
868fa9268a
tools/mgu.py: MGU Scientific Library search (GET-discovery, fields/methods/pagination, ISB dead, SER goldmine); AGENTS.md source 22 + Google low-volume warning
2026-09-16 09:59:32 +03:00
4feff7a0f7
ISBN validation (58 ISBNs): tools/isbnval.py + data/isbn-validation.tsv; SUMMARY Table 4 + fixed 2 bad-check-digit typos and 2 publisher-prefix mismatches; AGENTS.md source 21
2026-09-16 00:01:13 +03:00
8b632f1229
lgdl.py: stall detection + fresh-start wipe + speed guard; MANIFEST queue status
2026-09-15 13:23:18 +03:00
40f174db76
downloads: item 05 EN (Abt Daimon 2005/2017) + item 24 (Franz EN 1974 + RU Касталия 2018 djvu); items 03 big facsimiles + 05 RU + 11 RU in background queue
2026-09-15 12:17:59 +03:00
