dima/jung
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
jung/tools
History
Dmitry Kokorin 7d3794560e cross-section dedup system (user tasks 2+3, 2026-09-25): 
- tools/xref.py: master book list for ALL 12 sections (RAW 07-12 scraped: sections/07/RAW.md
  + data/isap-raw/), cross-ref matcher (CW gate + distinctive tokens + years + Cyrillic
  transliteration), stale MANIFEST 'Not downloadable' checker; data/MASTER-LIST.md generated
  (17 book-dupes in 01-06 found, e.g. sec01#51=sec06#14 Solomon)
- file-level dedup: 17 md5-identical files removed from later sections (kept in first),
  MANIFESTs/cards -> cross-ref rows, totals updated (sec01 102 / 02 37 / 03 125 / 04 38 /
  05 38 / 06 37), dedup rule in AGENTS.md + MANIFEST Notes
- sec05 MANIFEST phantom line '03 Aion' removed (Aion not in sec05 list; files in sec01)
- sec03 #44: 1968 Bodley file was #41's book (content 'English Fairy Tales') — removed,
  #44 keeps ABC-CLIO 2002
2026-09-25 23:25:05 +03:00
..
alib.py alib.ru source (tools/alib.py, CP1251 stem-search marketplace): Turner handbook = Дипак 2015 ISBN 978-5-98580-069-2 (RSL 7609331); Furth 2nd ed 2014; Neumann market round 4 (КДУ/Питер/Маниф/Касталия editions, Angelika Lev bio 2021); notes #16/#26/#29 updated 2026-09-09 00:19:52 +03:00
audit_anchors.py authors: wiki-anchor audit — 1 wrong QID fixed (Homer: Q327970=Uzhevych → Q6691), 2026-09-25 22:39:01 +03:00
check-md.py v3 migration: linter tools/check-md.py (0/219 issues); sec01 #47 RU table fixed; AGENTS.md: migration done, liart TODO + pending unification markers 2026-09-21 11:11:53 +03:00
cogito.sh sec04: Jung CW9/1 — ✅ «Архетипы и коллективное бессознательное» АСТ 2019/2020, libgen 141693619 2026-09-08 23:06:59 +03:00
crw.py #38 FOUND: «Символизм цвета. Из архивов Эраноса 1972» (Клуб Касталия, ISBN 978-5-90811-054-9) — same Ottmann editor as Spring 2005; via castalia.ru sitemap sweep (Phase 2b) 2026-09-09 00:46:19 +03:00
dedup_files.py cross-section dedup system (user tasks 2+3, 2026-09-25): 2026-09-25 23:25:05 +03:00
flib.py sec01: phase 4 downloads complete (50 files, 204MB) + item 12 EN preview + flib.py pagination 2026-09-17 10:41:43 +03:00
ia.py sec01 phase 2 (round 1): 17/55 items resolved 2026-09-17 00:09:03 +03:00
isbncheck.py ISBN validation (58 ISBNs): tools/isbnval.py + data/isbn-validation.tsv; SUMMARY Table 4 + fixed 2 bad-check-digit typos and 2 publisher-prefix mismatches; AGENTS.md source 21 2026-09-16 00:01:13 +03:00
isbnval.py ISBN validation (58 ISBNs): tools/isbnval.py + data/isbn-validation.tsv; SUMMARY Table 4 + fixed 2 bad-check-digit typos and 2 publisher-prefix mismatches; AGENTS.md source 21 2026-09-16 00:01:13 +03:00
lg.py sec06: key-vs-f_id discovery — 12 EN files recovered (6 rescues) + precheck v2 2026-09-25 10:04:01 +03:00
lgdl.py sec06: key-vs-f_id discovery — 12 EN files recovered (6 rescues) + precheck v2 2026-09-25 10:04:01 +03:00
liart.py liart.py: OPAC-Global protocol probed (direct.exe FindView/FindSize, guest session); SearXNG record-URL fallback works; direct mode blocked on search labels+iddb (admin-only InfoDB) — data/liart-params.json stub for browser read 2026-09-22 08:42:06 +03:00
make_authors_table.py unification: SUMMARY → CANON v1 (Final counts, at-a-glance renamed, Authors—EN→RU generated for sec02/03 from dossiers, legacy blocks → Notes ###; sec04 totals row added; 0 rows lost) 2026-09-21 23:56:54 +03:00
mgu.py tools/mgu.py: MGU Scientific Library search (GET-discovery, fields/methods/pagination, ISB dead, SER goldmine); AGENTS.md source 22 + Google low-volume warning 2026-09-16 09:59:32 +03:00
migrate_cards_v3.py v3 migration: sec04 #22 — ES section + Original field (Spanish original) 2026-09-21 11:09:57 +03:00
migrate_dossiers.py unification: dossiers → CANON v1 (104/142 changed: H1 [dates] incl. open-ended for living, Homonym warnings unified, RU-name sections → canonical field, Round logs → Notes, Dossier status dropped) 2026-09-21 23:59:49 +03:00
migrate_indexes.py unification: INDEX → CANON v1 (| # | Group | EN title | Author(s) | Status | File |), 219 rows, 0 status mismatches; sec02 legacy triage table dropped (dup of main table + cards) 2026-09-21 23:48:53 +03:00
migrate_manifests.py unification: sec04 MANIFEST → CANON v1 (Red Book +4 files, queue-table sources resolved from f_ids, page-count pollution fixed); 4 sections' manifests unified; 136 card DL sources normalized (MANIFEST→—, ia prefix, lg f/ ids) 2026-09-21 23:47:05 +03:00
nlr.py NLR sweep round 7: all section-04 surnames checked (tools/nlr.py, CRW+Primo); Cunningham 2018 identified; Dora Kalff confirmed absent from NLR (correct spelling Калфф); Schaverien 'Умирающий пациент' in NLR holdings 2026-09-09 12:38:57 +03:00
oa.py sec02: Phase 0 — 57 book cards + RAW + INDEX + AUTHORS-EN + 33 author dossiers (full EN names resolved: Bosnak, Dieckmann=Hans, Alex=William, Hill=Clara, Mattoon, Marjasch, Shafton, Strauch/Meier, Solms, Roesler, Vedfelt, Kelsey, Delaney, Krippner, Aizenstat, Covitz, Lambert, Sanford, Wilmer, Kramer, Domhoff, Barrett/McNamara, etc.) 2026-09-18 20:46:29 +03:00
ol.py EN-side research pillars: tools/ol.py (Open Library) + tools/wd.py (Wikidata), Google Books ISBN pattern, archive.org verification, HSE shop-directory + NikBook/Skifiya/beta2alpha sources, workflow v2 (full names first, reverse publisher sweep, community lists, content verification gate); full EN author names resolved for all 39 items (AUTHORS-EN.md); CONTEXT round 3 (Neumann cogito finds, 1959 disambiguation) 2026-09-09 00:10:25 +03:00
restructure_summary.py unification: SUMMARY → CANON v1 (Final counts, at-a-glance renamed, Authors—EN→RU generated for sec02/03 from dossiers, legacy blocks → Notes ###; sec04 totals row added; 0 rows lost) 2026-09-21 23:56:54 +03:00
rsl.py AGENTS/CONTEXT: new sources (cogito person pages, livelib author pages), verified RU editions (Franz, Jaffé/Man&HisSymbols, Lüscher, Kandinsky, Kast, Schaverien) 2026-09-08 22:28:09 +03:00
rulabel.py sec06: 28 карточек (11✅/2🔶/15❌) + rulabel.py (ru labels как канал канонической кириллицы) 2026-09-24 11:26:20 +03:00
rutitles.py pipeline v3: RU-title candidates (rutitles+ru-dict+pymorphy3), batch sweep driver, OpenAlex/Crossref 2026-09-18 10:56:36 +03:00
sweep.py sec03: Phase 0 — RAW + 68 card skeletons + INDEX + AUTHORS-EN (51 rows) + 39 new author dossiers + input.tsv + oa-sec03.json (68/68 crossref) 2026-09-19 14:40:19 +03:00
sx.sh Init: research structure, tools (lg.py, rsl.py, sx.sh), AGENTS.md, CONTEXT.md, section 04 skeleton (39 book notes) 2026-09-08 22:10:07 +03:00
verify_dossiers.py authors: systemic identity audit — Wiki anchors + 9 date/kinship corrections 2026-09-24 10:29:54 +03:00
wd.py EN-side research pillars: tools/ol.py (Open Library) + tools/wd.py (Wikidata), Google Books ISBN pattern, archive.org verification, HSE shop-directory + NikBook/Skifiya/beta2alpha sources, workflow v2 (full names first, reverse publisher sweep, community lists, content verification gate); full EN author names resolved for all 39 items (AUTHORS-EN.md); CONTEXT round 3 (Neumann cogito finds, 1959 disambiguation) 2026-09-09 00:10:25 +03:00
xref.py cross-section dedup system (user tasks 2+3, 2026-09-25): 2026-09-25 23:25:05 +03:00