diff --git a/AGENTS.md b/AGENTS.md index 70bebad..3d17392 100644 --- a/AGENTS.md +++ b/AGENTS.md @@ -10,7 +10,9 @@ We work **section by section**. Sections **01–05 are COMPLETE** (01: 38✅/2 03: 38✅/30❌; 04: 12✅/1🔶/26❌; **05: 17✅/12❌**). Section 05: research + RU downloads 2026-09-22 (7 rescues from user tips — see Lessons), **EN downloads COMPLETE 2026-09-23** (30 files, 362 MB; 5 EN gaps unavailable + 2 ia-restricted; SUMMARY.md at-a-glance table done). -Section 06–07 pending; 08–12 scope decision pending. Sections 6–7 are skeletons for later. +Section 06: research + user oracle DONE 2026-09-24 (28 карточек: **19 ✅ / 1 🔶 / 8 ❌**; +7 rescues; каталог Касталии 1285 в data/catalogs + rule в gate v3). Section 07 pending; +08–12 scope decision pending. ## Repository layout @@ -520,8 +522,9 @@ Examples: `cogito-yungianskaya-series-2026-07-17.md` (30 pp. CRW crawl, 518 titl observed Kogito/Castalia/Peter conventions) + list of UNTRANSLATED words (finish manually) - `match "RU tokens" [N]` / `both "EN Title"` — Jaccard over **pymorphy3-lemmatized** tokens (case endings handled: «великой матери» → «Великая мать» 1.25; order-agnostic) - - DB (2026-07-17): 692 titles (Когито-518 + ЛитРес-24 + ОПП/МИСП-55 + flib a/5272, 57639, 118921, - 122883, 193690, 193689) + - DB (2026-09-24): 1977 titles (Когито-518 + ЛитРес-24 + ОПП/МИСП-55 + **castalia-full-catalog-1285** + + flib a/5272, 57639, 118921, 122883, 193690, 193689); `build` пересобирает из data/catalogs/* + (новый каталог = просто файл в data/catalogs/, строки «название [таб url]», #-строки игнор) - **Limits (honest):** generic RU titles (Wolff «Введение в основы…») invisible — publisher sweep (Phase 2b) stays a separate phase. Translation ≠ identity: verify real hits. - **pymorphy3** installed (user-site): lemmatization for RU token matching. @@ -607,15 +610,25 @@ not downloadable). Legend for ISBN columns: **✅** = ISBN found; **⚠** = publ with a one-line totals row (DL EN / DL RU file counts). Cross-check the DL columns against the section's `downloads/-*/MANIFEST.md` so the two never disagree. -Negatives gate (before ❌) — **v2 (2026-09-22, after sec05 rescues)**: +Negatives gate (before ❌) — **v3 (2026-09-24, after sec06 rescues)**: author sweep (RSL + libgen + cogito + flibusta **authorall** for prolific RU authors) + -**`tools/rutitles.py both ""` diff (MANDATORY)** + 2–3 RU title variants +**`tools/rutitles.py both ""` diff (MANDATORY; DB includes castalia-full-catalog)** + +**castalia.ru catalog check (MANDATORY for Jungian items — thematically fitting publisher; see rule below)** + +2–3 RU title variants (calque + SearXNG/web_search `"" перевод/на русском` + FR/DE-original variant for Eliade/van Gennep-type authors) + livelib author page + one shop/retail check (cogito person page for identity) + **fantlab.ru for pre-1991/adventure/ethnographic** + predanie.ru for older editions + **user oracle table at section end** (see Lessons). Log every RU query in MISSING.md. Before downloading from libgen: verify file locator/title (mislinked-file trap). +**Castalia catalog rule (2026-09-24, user instruction):** Клуб Касталия — тематически +подходящее издательство (Юнг/аналитическая психология), его каталог = ОБЯЗАТЕЛЬНЫЙ этап поиска +для каждого item (не только ❌-гейта): (1) `data/catalogs/castalia-full-catalog-2026-09-24.md` +(1285 товаров) уже в rutitles DB — `rutitles.py both` всегда ищет и по нему; (2) при подозрительном +❌ (юнгианская тема) — прямое grep каталога по 2–3 RU-вариантам названия; (3) кэш РЕФРЕШИТЬ +(перекроулить `/collection/all?page=1..N`) если он старше ~6 мес или перед финальным ❌ секции; +(4) (PDF)-твины товаров = download-источник (см. source 16). + Special cases: - **Jung's CW volumes:** translated and widely available — don't deep-search; note the RU volume for the item (CW15 = «Дух в человеке, искусстве и литературе», Харвест 2003;