Commit graph

26 commits

Author SHA1 Message Date
31cb0dea70 unification: dossiers → CANON v1 (104/142 changed: H1 [dates] incl. open-ended for living, Homonym warnings unified, RU-name sections → canonical field, Round logs → Notes, Dossier status dropped) 2026-09-21 23:59:49 +03:00
680bf45ee1 unification: SUMMARY → CANON v1 (Final counts, at-a-glance renamed, Authors—EN→RU generated for sec02/03 from dossiers, legacy blocks → Notes ###; sec04 totals row added; 0 rows lost) 2026-09-21 23:56:54 +03:00
62bb11a99d unification: INDEX → CANON v1 (| # | Group | EN title | Author(s) | Status | File |), 219 rows, 0 status mismatches; sec02 legacy triage table dropped (dup of main table + cards) 2026-09-21 23:48:53 +03:00
3225039d88 unification: sec04 MANIFEST → CANON v1 (Red Book +4 files, queue-table sources resolved from f_ids, page-count pollution fixed); 4 sections' manifests unified; 136 card DL sources normalized (MANIFEST→—, ia prefix, lg f/ ids) 2026-09-21 23:47:05 +03:00
b01f539194 unification: sec03 MANIFEST → CANON v1 (per-item tables; source ids unrecorded → '—' + sweep pointer) 2026-09-21 23:43:39 +03:00
dab9e312d9 unification: sec02 MANIFEST → CANON v1 (per-item tables, cross-section block preserved) 2026-09-21 23:42:36 +03:00
62b16fa4bf unification: sec01 MANIFEST → CANON v1 (per-item tables, Totals); +4 missing EN files (01/07 ia byte-verified, 32/49); 8 cards DL fixed (sources, missing rows) 2026-09-21 23:41:18 +03:00
f3fb432bd9 v3 migration: linter tools/check-md.py (0/219 issues); sec01 #47 RU table fixed; AGENTS.md: migration done, liart TODO + pending unification markers 2026-09-21 11:11:53 +03:00
4f5372ab56 v3 migration: sec04 #22 — ES section + Original field (Spanish original) 2026-09-21 11:09:57 +03:00
cde7a4cd4e sec03: Phase 0 — RAW + 68 card skeletons + INDEX + AUTHORS-EN (51 rows) + 39 new author dossiers + input.tsv + oa-sec03.json (68/68 crossref) 2026-09-19 14:40:19 +03:00
34c6372836 sec02: Phase 0 — 57 book cards + RAW + INDEX + AUTHORS-EN + 33 author dossiers (full EN names resolved: Bosnak, Dieckmann=Hans, Alex=William, Hill=Clara, Mattoon, Marjasch, Shafton, Strauch/Meier, Solms, Roesler, Vedfelt, Kelsey, Delaney, Krippner, Aizenstat, Covitz, Lambert, Sanford, Wilmer, Kramer, Domhoff, Barrett/McNamara, etc.) 2026-09-18 20:46:29 +03:00
5441dddbb8 pipeline v3: RU-title candidates (rutitles+ru-dict+pymorphy3), batch sweep driver, OpenAlex/Crossref
- tools/rutitles.py: EN->RU token translation (data/ru-dict.tsv, 540+ pairs, Kogito/Castalia
  conventions) + Jaccard diff against data/ru-titles.jsonl (692 titles: Kogito 518, Litres 24,
  OPP 55, flibusta a/5272+57639+118921+122883+193690+193689). Matching is lemmatized
  (pymorphy3) — case endings handled: 'великой матери' -> 'Великая мать' 1.25.
  'The Great Mother' -> 'Великая мать' 1.25 top hit; 'The Symbolic Quest' -> correct negative.
- tools/sweep.py: batch driver for Phases 1-2 (rsl+lg+alib+flib+cogito+SearXNG-OZON-snippet
  parse+rutitles diff per item; --nlr optional). Query log data/queries.log (JSONL).
  Fixed: cogito nav-menu leak (parse bx_product_item only), libgen robot-block (lg.py curl fallback).
- tools/oa.py: OpenAlex + Crossref (Phase 0 identity/ISBN, no key; found Margaret Wilkinson,
  Karen Evers-Fahey, Symbolic Quest Princeton ISBN).
- data/sweeps/01-fundamentals/input.tsv: 16 ❌ items loaded; background sweep running.
- AGENTS.md: source 10b (oa.py), flibusta .su = reduced mirror (dropped from pipeline),
  pipeline v3 section (rutitles/oa/sweep/pymorphy3 note: pymorphy2 broken on py3.12).
- data/ru-titles.jsonl committed as the RU market universe asset.
2026-09-18 10:56:36 +03:00
32e505b2f9 sec01: phase 4 downloads complete (50 files, 204MB) + item 12 EN preview + flib.py pagination
- 45 RU + 5 EN + 1 preview downloaded (flibusta.is OPDS, libgen, archive.org)
- 10 flib pdf stubs replaced via libgen (18,22,28,29,53) or fb2 twins
- flib 'fb2+zip' files unpacked to plain fb2
- item 12 (Evers-Fahey): RG=Request-PDF; PagePlace 23pp preview saved+verified
- evers-fahey dossier enriched (ofj.org bio)
- flib.py: authorall (rel=next pagination) + author <page>
- AGENTS.md: flib pagination/quirks + PagePlace preview tip
- INDEX: phase 4 done line; 8 trade-only items listed in MANIFEST
2026-09-17 10:41:43 +03:00
4420aef7c3 sec01 phase 2 (round 1): 17/55 items resolved
- new ✅: 03 (Структура и динамика психического, Когито), 10 (Эго и архетип, 2 изд.),
  13 (Лекции по юнговской типологии, b/509587), 29 (Юнговская карта души, Стайн Мюррей 2010)
- ❌ with evidence: 02 (CW7), 05 (Aion — 'Эйон' 0), 16 (Shadow and Self), 21 (Animus and Anima),
  38 (Woman in the Mirror), 47 (Way of All Women)
- flibusta.is OPDS sweep (tools/flib.py): 30+ author feeds checked; bonus books logged
  (Edinger x10, Hillman x8, Harding x4, Henderson x2, Douglas Cambridge Handbook, Jung-E Grail Legend)
- tools/ia.py (archive.org EN search/metadata/files); AGENTS.md sources 10+13 updated
2026-09-17 00:09:03 +03:00
868fa9268a tools/mgu.py: MGU Scientific Library search (GET-discovery, fields/methods/pagination, ISB dead, SER goldmine); AGENTS.md source 22 + Google low-volume warning 2026-09-16 09:59:32 +03:00
4feff7a0f7 ISBN validation (58 ISBNs): tools/isbnval.py + data/isbn-validation.tsv; SUMMARY Table 4 + fixed 2 bad-check-digit typos and 2 publisher-prefix mismatches; AGENTS.md source 21 2026-09-16 00:01:13 +03:00
8b632f1229 lgdl.py: stall detection + fresh-start wipe + speed guard; MANIFEST queue status 2026-09-15 13:23:18 +03:00
40f174db76 downloads: item 05 EN (Abt Daimon 2005/2017) + item 24 (Franz EN 1974 + RU Касталия 2018 djvu); items 03 big facsimiles + 05 RU + 11 RU in background queue 2026-09-15 12:17:59 +03:00
e41464c2b4 downloads: item 01 (Jung CW9/1) — 7 PDFs (5 EN Princeton/Routledge 2nd eds + 2 RU АСТ 2019/2020), all size-verified + content-verified; tools/lgdl.py downloader (ads.php card → get.php key → bytes, resume, backoff) 2026-09-15 10:18:30 +03:00
6decbd3146 NLR sweep round 7: all section-04 surnames checked (tools/nlr.py, CRW+Primo); Cunningham 2018 identified; Dora Kalff confirmed absent from NLR (correct spelling Калфф); Schaverien 'Умирающий пациент' in NLR holdings 2026-09-09 12:38:57 +03:00
6dc0738584 #38 FOUND: «Символизм цвета. Из архивов Эраноса 1972» (Клуб Касталия, ISBN 978-5-90811-054-9) — same Ottmann editor as Spring 2005; via castalia.ru sitemap sweep (Phase 2b) 2026-09-09 00:46:19 +03:00
59fb6d3570 alib.ru source (tools/alib.py, CP1251 stem-search marketplace): Turner handbook = Дипак 2015 ISBN 978-5-98580-069-2 (RSL 7609331); Furth 2nd ed 2014; Neumann market round 4 (КДУ/Питер/Маниф/Касталия editions, Angelika Lev bio 2021); notes #16/#26/#29 updated 2026-09-09 00:19:52 +03:00
c0a3ac0f2f EN-side research pillars: tools/ol.py (Open Library) + tools/wd.py (Wikidata), Google Books ISBN pattern, archive.org verification, HSE shop-directory + NikBook/Skifiya/beta2alpha sources, workflow v2 (full names first, reverse publisher sweep, community lists, content verification gate); full EN author names resolved for all 39 items (AUTHORS-EN.md); CONTEXT round 3 (Neumann cogito finds, 1959 disambiguation) 2026-09-09 00:10:25 +03:00
cf85e3f1ad sec04: Jung CW9/1 — ✅ «Архетипы и коллективное бессознательное» АСТ 2019/2020, libgen 141693619 2026-09-08 23:06:59 +03:00
a6c062344f AGENTS/CONTEXT: new sources (cogito person pages, livelib author pages), verified RU editions (Franz, Jaffé/Man&HisSymbols, Lüscher, Kandinsky, Kast, Schaverien) 2026-09-08 22:28:09 +03:00
9b8cf58a4d Init: research structure, tools (lg.py, rsl.py, sx.sh), AGENTS.md, CONTEXT.md, section 04 skeleton (39 book notes) 2026-09-08 22:10:07 +03:00