Commit graph

25 commits

Author SHA1 Message Date
285b485377 sec08 stage 0: RAW normalized (multi-author fixes), xref parser patch (4 authors), INDEX (46 items: 41 NEW + 5 xref)
- RAW: Mahler/Pine/Stone 1975 vs Stone/Church 1968 (2 separate books), Grossmann×2/Waters
  joined; xref.py AUTHOR_LINE now supports up to 4 author groups + continuation-year lines
- xref map: 51 raw entries → 46 unique books (5 B-list duplicates merged); 5 xrefs
  (CW8→sec01#03, CW9/I→sec01#04, CW17→sec02#09, Wilkinson→sec01#55, Children's Dreams→sec02#11)
- largest section so far (46 vs 28 sec06)
2026-09-26 16:23:05 +03:00
b47ff7234c sec07 stage 0: normalized RAW (parseable by xref), verbatim to data/isap-raw, INDEX.md 27 items
- RAW re-scraped from official ISAP PDF (2025 ed., 2pp): multi-author items combined
  (Solms/Panksepp, Alcaro/Carta, Panksepp/Biven), same-author repeats for separate works
  (Kast x3, Krieger x3)
- xref.py AUTHOR_LINE: initials blob now handles 'C. A.'-style multi-initials
  (08-12: +1 recovered item each)
- MASTER-LIST sec07: 24 NEW (16 books + 8 articles) + 3 xref (CW8->sec01#03,
  Jacobi->sec01#20, Kast Dynamics->sec04#11)
2026-09-26 11:45:14 +03:00
7d3794560e cross-section dedup system (user tasks 2+3, 2026-09-25):
- tools/xref.py: master book list for ALL 12 sections (RAW 07-12 scraped: sections/07/RAW.md
  + data/isap-raw/), cross-ref matcher (CW gate + distinctive tokens + years + Cyrillic
  transliteration), stale MANIFEST 'Not downloadable' checker; data/MASTER-LIST.md generated
  (17 book-dupes in 01-06 found, e.g. sec01#51=sec06#14 Solomon)
- file-level dedup: 17 md5-identical files removed from later sections (kept in first),
  MANIFESTs/cards -> cross-ref rows, totals updated (sec01 102 / 02 37 / 03 125 / 04 38 /
  05 38 / 06 37), dedup rule in AGENTS.md + MANIFEST Notes
- sec05 MANIFEST phantom line '03 Aion' removed (Aion not in sec05 list; files in sec01)
- sec03 #44: 1968 Bodley file was #41's book (content 'English Fairy Tales') — removed,
  #44 keeps ABC-CLIO 2002
2026-09-25 23:25:05 +03:00
4274488410 authors: wiki-anchor audit — 1 wrong QID fixed (Homer: Q327970=Uzhevych → Q6691),
9 wikipedia URLs normalized to wikidata, tools/audit_anchors.py (all-language label match)
2026-09-25 22:39:01 +03:00
109662ffe4 sec06: user oracle — 7 спасений (10,13,17,18,20,21,27✅) + каталог Касталии (1285) в data/catalogs + sec03#65 исправлен
- #10 Переписка. Юнг и Уайт — Клуб Касталия 978-5-521-16231-4 (+PDF на castalia.ru)
- #13 Путь Ра через Дуат — Касталия 2022, пер. И. Ветринский, 978-5-521-18582-5
- #17 Бог и бессознательное (Эдингер) — Клуб Касталия 2016, 386с.
- #18 Нисхождение к богине (Перера) — Касталия 2024, 168с., 978-5-521-24012-8
- #20 Глубинная психология в священном писании (Клюгер) — ИНФРА-М 2000, 96с.
- #21 Сатана в Ветхом Завете (Клюгер) — Касталия 2018, 194с.
- #27 Введение в дзэн-буддизм (Судзуки) — RU подтверждён (livelib+jhana.ru), изд. TBD
- Бонус: sec03 #65 Клюгер «Гильгамеш» Касталия 2018 (была ❌) → ✅ (39✅/29❌)
- Клюгер: досье переписано (dates 1907-1987 Q72049066; RU name = «Клюгер»!)
- castalia.ru /collection/all = полный каталог (1285) → data/catalogs + rutitles DB
- Итог sec06: 19 ✅ / 1 🔶 / 8 ❌
2026-09-24 23:01:36 +03:00
bc1f91d9be authors: systemic identity audit — Wiki anchors + 9 date/kinship corrections
User caught: Emma Jung dossier said '1877-1965, Jung's eldest daughter'
(actually 1882-1955, his WIFE, Q124210). Systemic response:
- New MANDATORY field **Wiki anchor:** (QID + URL) in dossier canon (AGENTS.md)
- tools/verify_dossiers.py: resumable Wikidata audit (bulk wbgetentities for
  anchored, search+CANDIDATE review for the rest, 429 backoff, TSV report)
- 82 dossiers now anchored; 76 marked no-confirmed-QID (WIKI-CHECK notes)
- Date/kinship corrections found by the audit:
  * Emma Jung: wife not daughter, 1882-1955 (Q124210)
  * Verena Kast: b. 1943 not 1951, father Walter Kast not 'Hans Kast' (Q2515260)
  * James Hillman: 1926 not 1941 (Q934774)
  * Jolande Jacobi: 1890-1973 not 1902-1980 (Q88022)
  * Maria Czaplicka: d. 1921 not 1939 (Q532804)
  * Henri Ellenberger: 1905-1993 not 1900-1987 (Q115111)
  * Edward F. Edinger: 1922-1998 not 1905-2001 (Q5819984, en.wiki)
  * Hans Dieckmann: d. 2007 not 2005 (Q59526701)
  * Heinrich Zimmer: 1890-1943, anchored to the Indologist Q215922
    (not the Celtist Q76954)
- Homonym traps documented in TSV notes (John Hill=botanist, Karl
  Koch=hacker, Barbara Meier=model, Andrew Samuels=soccer, etc.)
2026-09-24 10:29:54 +03:00
d01e323e75 liart.py: OPAC-Global protocol probed (direct.exe FindView/FindSize, guest session); SearXNG record-URL fallback works; direct mode blocked on search labels+iddb (admin-only InfoDB) — data/liart-params.json stub for browser read 2026-09-22 08:42:06 +03:00
1ff76b4270 sec02: EN soft sweep — +8 files (Fordham 18, von Franz Dreams 19, Hall 22, Meier 26, Whitmont/Perera 28); sec03/04 gaps re-verified (0 rescues); AGENTS.md: EN sweep procedure documented 2026-09-21 10:02:56 +03:00
6334148b45 sec01: RU-name libgen re-sweep (29 queries) — 0 rescues; Tom Hopke homonym flagged; Grail = sec03 #16 duplicate (deleted dup); MISSING/SUMMARY/dossiers updated 2026-09-21 00:53:29 +03:00
6ea86fcfa4 sec03: Jacobs 42-44 closed ❌ (dual-spelling sweep RSL/MGU/lg/alib/flib); bonus «Ирландские сказки» КАРО 2012; 38✅/30❌ final 2026-09-20 14:53:02 +03:00
7e46f47659 sec03: sweep reports (68 items) + OL Phase-0 data 2026-09-19 22:52:52 +03:00
7dda89471d sec03: 68 cards filled (38✅/27❌/3❌?), INDEX, SUMMARY (Table 3), MISSING, 15 dossiers updated 2026-09-19 21:08:15 +03:00
6aa0e1dd10 sec03: triage 37✅/28❌/3❌? (user rescue finds: 29 Касталия 2025, 34 Дионис, 39 Бадж ЦП 2025, 62 Бегущая, 22 Царь и труп, 68 Циммер, 02 Дух Меркурий, 19 Гермес, 56 На коленях богов, 60 Мать, 52 Германская мифология, 41 Английские сказки, 51 Фольклор ВЗ) 2026-09-19 20:52:43 +03:00
cde7a4cd4e sec03: Phase 0 — RAW + 68 card skeletons + INDEX + AUTHORS-EN (51 rows) + 39 new author dossiers + input.tsv + oa-sec03.json (68/68 crossref) 2026-09-19 14:40:19 +03:00
c3a5ad7cb4 sec01/02/04: Phase-A2+A3 — ISBN validation 49/49 (47 OK; 1 bad check-digit 5-311-02450-X; 1 wrong EN ISBN for item 20 fixed to 978-0-9693254-0-6/978-1-57062-036-2); EN backfill: CW6 (sec01, Princeton 2014 6MB) + CW15 Princeton paperback (sec04, 5th pdf); cross-refs CW7/8/9/18/5/10 sec01->sec02/04; sec04 MHS 4 pdf confirmed done 2026-09-19 14:09:08 +03:00
371517aa06 sec02: Phase 3 triage — 23 ✅ / 5 🔶 / 29 ❌ final; MISSING.md; 12 dossiers updated; Hall CUD identity verified; bonus finds (Kaplan-Williams, R.A. Johnson) 2026-09-19 12:33:49 +03:00
34c6372836 sec02: Phase 0 — 57 book cards + RAW + INDEX + AUTHORS-EN + 33 author dossiers (full EN names resolved: Bosnak, Dieckmann=Hans, Alex=William, Hill=Clara, Mattoon, Marjasch, Shafton, Strauch/Meier, Solms, Roesler, Vedfelt, Kelsey, Delaney, Krippner, Aizenstat, Covitz, Lambert, Sanford, Wilmer, Kramer, Domhoff, Barrett/McNamara, etc.) 2026-09-18 20:46:29 +03:00
2952870e44 sec04: pipeline-v3 re-sweep of 24 book-❌ — 0 rescues (all homonyms); reports + query log committed
sweep.py ran RSL+libgen+alib+flibusta+cogito+SearXNG/OZON-snippet+rutitles(692-DB, pymorphy3)
per item. Notable rejections: Актон=лорд Актон+террор-псих, Джоа=Стадхолм (дизайн),
Шаверен=её 'Умирающий пациент' (known, не item 17), Калфф=known 'Сэндплей и его
целительное воздействие'+'В память о Доре Калфф', Хенцлер=дет. иллюстратор, Элдер/Мун=шум.
MISSING.md + SUMMARY.md updated; data/sweeps/04-pictures/ (23 reports) + queries.log (398) committed.
2026-09-18 18:36:16 +03:00
ee4a6482d1 sec01: pipeline-v3 sweep of 16 ❌ — 1 RESCUE (item 47 Harding 'Пути женщин' Касталия 2023) — 38 ✅ / 2 🔶 / 15 ❌
Full mechanical sweep (rsl+lg+alib+flib+cogito+SearXNG-OZON+rutitles, 173 logged queries):
- 47 M. Esther Harding, The Way of all Women -> «Пути женщин» (Клуб Касталия 2023,
  978-5-52-116220-8; Nikbook/chitai-gorod/WB in trade). Identity: same Harding whose 3 other
  books were already known RU (flib a/193689). Card/INDEX/MISSING/SUMMARY/dossier updated.
  INDEX author typo fixed (Maureen -> M. Esther per RAW 'Harding, M. E.').
- All other 15 ❌ confirmed: hits were homonyms (Мейер=Мейерхольд/Мейербер/Scott Meyers,
  Ганна=substring 'оболганная', Стивенс/Уилкинсон/Эверс/Дуглас/Хопке/Фрой=astro/C++/WW2 books).
  Casement: only 'Обучаясь у пациенту' 1995 + 'Обучение у жизни' 2009 (not 'Who Owns Jung?').
- Sweep reports + query log committed (data/sweeps/01-fundamentals/, data/queries.log).
2026-09-18 17:33:08 +03:00
5441dddbb8 pipeline v3: RU-title candidates (rutitles+ru-dict+pymorphy3), batch sweep driver, OpenAlex/Crossref
- tools/rutitles.py: EN->RU token translation (data/ru-dict.tsv, 540+ pairs, Kogito/Castalia
  conventions) + Jaccard diff against data/ru-titles.jsonl (692 titles: Kogito 518, Litres 24,
  OPP 55, flibusta a/5272+57639+118921+122883+193690+193689). Matching is lemmatized
  (pymorphy3) — case endings handled: 'великой матери' -> 'Великая мать' 1.25.
  'The Great Mother' -> 'Великая мать' 1.25 top hit; 'The Symbolic Quest' -> correct negative.
- tools/sweep.py: batch driver for Phases 1-2 (rsl+lg+alib+flib+cogito+SearXNG-OZON-snippet
  parse+rutitles diff per item; --nlr optional). Query log data/queries.log (JSONL).
  Fixed: cogito nav-menu leak (parse bx_product_item only), libgen robot-block (lg.py curl fallback).
- tools/oa.py: OpenAlex + Crossref (Phase 0 identity/ISBN, no key; found Margaret Wilkinson,
  Karen Evers-Fahey, Symbolic Quest Princeton ISBN).
- data/sweeps/01-fundamentals/input.tsv: 16 ❌ items loaded; background sweep running.
- AGENTS.md: source 10b (oa.py), flibusta .su = reduced mirror (dropped from pipeline),
  pipeline v3 section (rutitles/oa/sweep/pymorphy3 note: pymorphy2 broken on py3.12).
- data/ru-titles.jsonl committed as the RU market universe asset.
2026-09-18 10:56:36 +03:00
2157d058df sec01: round 2 closed — 0 new rescues; cache processed catalogs in data/catalogs/
- data/catalogs/: cogito Jungian series (518 titles, 30 pp.), litres 140409 (24 JSON-LD),
  OPP/MISP reading list (55 entries) — source URLs + dates in headers
- author-level check of 16 ❌ against cogito shop search (11 author queries) + full 518-title
  catalog diff: 0 matches; noise rejected (Shamdasani≠Casement, Jung 'Нераскрытая самость'
  ≠ McFarland-Solomon, Berdyaev essay)
- AGENTS.md: catalog caching convention
2026-09-18 09:28:33 +03:00
4484209216 sec01 phase 3: RU ISBN validation (23 ISBNs) + sec04 flibusta sweep
- isbnval: 18 VALID/STRUCT-OK; 3 flagged mismatches (18: 5-88925-009-4=Stegmeyer?,
  23/32: 5-87983-027-6=dream-analysis book?, 26: 978-5-521-24018-0=Пальмира not Castalia)
- data/isbn-sec01-validation.tsv
- sec04 flibusta sweep: 5 books found (01 b/584338+744674, 26 b/623044, 28 b/196622+873580,
  30 b/187351+484722+519332, 32 b/477947); 21 other queries 0 (incl. Красная книга,
  Территория символа, Выявляющий образ, Тест дерево, Символизм цвета)
- item 27: +2 old editions (ЧеРо 1997 5-88711-042-2, Добросвет КДУ 2011 407с.)
2026-09-17 09:40:36 +03:00
a2527a88ee repo-structure: authors/ is canonical cross-section dossier store; section AUTHORS-EN.md now thin indexes
- 56 new author dossiers (all sec04 + sec01 authors), 69 total
- sec04/sec01 AUTHORS-EN.md rewritten as item→dossier link tables
- AGENTS.md conventions + Phase 0 updated
- item 54 identity: Ann Belford Miller (Alice Miller-Ulanov); homonym dossier miller-alice-englard (Alicja Englard, NOT the same person)
2026-09-16 10:48:43 +03:00
4feff7a0f7 ISBN validation (58 ISBNs): tools/isbnval.py + data/isbn-validation.tsv; SUMMARY Table 4 + fixed 2 bad-check-digit typos and 2 publisher-prefix mismatches; AGENTS.md source 21 2026-09-16 00:01:13 +03:00
7a3442263f Phase 2b sweep results: castalia.ru catalog saved (data/), all remaining section-04 items re-verified ❌ via alib author sweep; status 12 ✅ / 1 🔶 / 26 ❌ 2026-09-09 00:52:08 +03:00