EN-side research pillars: tools/ol.py (Open Library) + tools/wd.py (Wikidata), Google Books ISBN pattern, archive.org verification, HSE shop-directory + NikBook/Skifiya/beta2alpha sources, workflow v2 (full names first, reverse publisher sweep, community lists, content verification gate); full EN author names resolved for all 39 items (AUTHORS-EN.md); CONTEXT round 3 (Neumann cogito finds, 1959 disambiguation)

This commit is contained in:
Dmitry Kokorin 2026-09-09 00:10:25 +03:00
parent 77d39ea000
commit c0a3ac0f2f
29 changed files with 281 additions and 34 deletions

View file

@ -108,6 +108,48 @@ sections/0N-<name>/ # one .md per BOOK (chapter-level list items are merged int
- Verified 2026-07-09: no «Выявляющий образ», no «Число и время» (Franz), no «Сэндплей» titles,
no «Тайный мир рисунка» (Furth), no «Тест Дерево», no «Искусство и творческое бессознательное».
### 11. Open Library — the "English RSL" (author works lists, full names, ISBNs)
- Tool: `tools/ol.py "author:Lastname, First"` or `tools/ol.py 'title:"Exact EN Title"'`
- `openlibrary.org/search.json?q=...&fields=title,author_name,publish_year,language,publisher,isbn`
- No key, no rate limits observed (1s between calls is polite). Aggregates all editions of a
work into one doc. **Best use: resolve full EN author names from initial-only list entries**
(`title:"..."` → author_name) and get the EN works list + ISBNs to feed Google Books.
- **NO RU editions indexed** (language=rus → 0 for known RU books) — RU hunting stays with
RSL/libgen/flibusta/GBS SPb.
### 12. Wikidata — identity anchors (life dates + OFFICIAL RU name)
- Tool: `tools/wd.py "Full Name"`
- `wbsearchentities` + `wbgetentities`: QID, P569/P570 (birth/death), EN/DE/RU labels, RU aliases.
The RU label is the single most reliable spelling for RSL/libgen queries.
- Only useful for Wikipedia-scale names (Jung, Neumann, Kandinsky, Jaffé, …); niche authors
are absent — fall back to OL title search or publisher pages.
### 13. archive.org — EN original texts (content verification)
- `archive.org/advancedsearch.php?q=title:("...")&output=json` (metadata); direct file downloads
work (`/download/<item>/<file>`). OCR `_text.pdf` variants → pdftotext.
- Used to verify the 4-essay match for Neumann «Сборник статей» (item in.ernet.dli.2015.139225).
### 14. Google Books — via fetch_content only (API is 429 without key)
- `fetch_content https://books.google.com/books?vid=ISBN<digits>` → authoritative publisher
metadata: full author/editor names, edition, series. Resolved Ottmann=Klaus, Goldstein=Ralph,
Brutsche=Paul, Elder=George, Moon=Beverly, Killick=Katherine, Pennington/Staples, Rowland=Susan,
Bolander=Karen, Acton=Mary via this or OL.
### 15. Shop directory (HSE bookshelf34 pattern) — where RU psychoanalytic books are sold
- HSE «Книжный шкаф» (hse.ru/ma/therapy/bookshelfNN) = a DIRECTORY of shops, not a book list:
NikBook (nikbook.ru — WBS shop, `?q=` search is fuzzy/works), Когито-Центр, **Скифия**
(skifiabook.ru — publisher/shop, JS catalog, has a full price list download), marketplaces.
- NikBook Jungian finds (2026-07-09): Тоцци «Активное воображение в теории, практике и обучении»,
Конгер «Юнг и Райх. Тело как Тень», Эдингер «Библия и психе».
- beta2alpha.ru — RU publisher (Tilda site; sells via Ozon seller beta-2-alpha); Jungian stock TBC.
### 16. Publisher sites — RU full texts and bibliographies
- hi-human.org (Living Human Heritage RU) — publishes book forewords/sections as pages (source
of the Neumann EN-works list with RU titles).
- castalia.ru / castaliasilvasacra.ru (Клуб Касталия) — author articles + shop.
- daimon-verlag.ch / chironpublications.com / spring-publications.com — EN Jungian presses
(spring-publications unreachable from this box; use Google Books ISBN instead).
## Not usable / low value
- libgen biblioservice worldcat/googlebooks/isbndb/udc (broken on this mirror)
- imaton.com (МААП educational publisher, not translations)
@ -128,17 +170,49 @@ sections/0N-<name>/ # one .md per BOOK (chapter-level list items are merged int
5. **Homonym rejection:** different first name / field / era → reject or mark ambiguous
(trap found: Верена Каст ≠ Вернер Каст; «Каст» search returns Verena Kast books).
## Workflow (per section)
## Workflow (per section) — v2 (2026-07-09)
**Phase 0 — Author dossiers** (`authors/`): EN identity + RU surname candidates.
**Phase 1 — Author sweep:** per author: `rsl.py "<First> <Last>"` → `lg.py "<Last>"` →
`cogito q=<Last>`. Apply identity check. Fill author dossier.
**Phase 2 — Title-gap sweep** for still-unmatched books: `rsl.py "<RU title words>"`
(check the author field!), `lg.py` 2–3 whole-word title combos, cogito.
Negatives: one SearXNG `<EN title> «русский перевод»` before declaring ❌.
**Phase 3 — Edition collection:** ALL editions from ALL sources (title variants! books are
reissued under slightly different names), with full metadata.
**Phase 4 — Book notes + commits.**
**Phase 0 — Full names + identity** (`authors/`):
1. Resolve every initial-only author to a full EN name: `tools/ol.py 'title:"EN Title"'`
(author_name) → else `tools/wd.py` (QID + RU label) → else Google Books ISBN page →
else publisher/review page. Record in `sections/<n>/AUTHORS-EN.md` (EN full name, RU name
to query, name source).
2. For big names: `wd.py` gives life dates + the OFFICIAL RU label (best RSL spelling).
3. Build the transliteration matrix per author (2–3 variants: Нойманн/Нойман, Кох/Коч,
Калфф/Кальфф, Ферс/Фёрт) — run every query with ALL variants.
**Phase 1 — Author sweep (EN→RU):** per author: `rsl.py "<First> <Last>"` → `lg.py "<Last>"`
→ `cogito q=<Last>` → `flibusta ?ask=<Last>` → livelib/chitai-gorod author page. Apply identity
check. Fill author dossier.
**Phase 2 — Title-gap sweep** for still-unmatched books: `rsl.py "<RU title words>"` (check
author field!), `lg.py` 2–3 whole-word title combos, cogito, flibusta by RU title, GBS SPb via
SearXNG `site:gbs.spb.ru`.
**Phase 2b — Publisher sweep (RU→EN, reverse direction):** per Jungian RU publisher/imprint
(Касталия, hi-human/Living Human Heritage, ЦГИ/Т8, Когито, Фантом Пресс, Азбука, Серебряные
нити, Питер, Ваклер, Добросвет, Деметра, НикБук, Скифия, beta2alpha, Эксмо/АСТ психология):
enumerate the full Jungian catalog (site search or RSL **series** queries: «Юнгианская
психология», «Библиотека аналитической психологии», «Классики зарубежной психологии») → map
every title to an EN original → backfill both missing items and future sections. This catches
books author queries can never hit (generic titles like «Сборник статей», reworked titles).
**Phase 2c — Community reading lists (oracles):** ISAP Zurich, HSE (hse.ru/ma/therapy),
МИСП, Jung Institute Moscow, education-psy.ru sandplay list, carljung.ru, koob.ru — these
explicitly state which books have RU editions (or lack them). Scrape each, diff vs our ❌ list.
**Phase 3 — Content verification (for suspicious candidates):** when an RU title's mapping to
an EN title is not obvious, verify 1:1 against the EN original: archive.org OCR text (TOC /
editorial note) vs RU essay/chapter list (koob/livelib/preview). Example: Neumann «Сборник
статей» = Art and the Creative Unconscious: Four Essays (4/4 essay match).
**Phase 4 — Edition collection:** ALL editions from ALL sources (title variants!), full metadata
(publisher/year/pages/translator/ISBN) — prefer RSL/GBS SPb records (GOST) over shop data.
**Phase 5 — Book notes + commits** (one commit per completed book or meaningful author gain).
Negatives gate (before ❌): author sweep (RSL + libgen + cogito + flibusta) + one title-level
SearXNG + livelib author page + one shop/retail check. Log every RU query in MISSING.md.
Special cases:
- **Jung's CW volumes:** translated and widely available — don't deep-search; note the RU