feat(understand): the plant pack, lean 65, five-language aliases, eight golden queries and the counts

The three track-H branches are merged; this is the integration that makes the
six tools one surface.

- TOOL_PACK_NAMES gains "plant" (pipe_takeoff, cable_takeoff); SECTION 26's
  four readers stay core. Lean gains drawing_understand and reaches 65 (55
  with TOOL_PACKS=core). The `understand` and `plant` tags rank after `arch`,
  so the sections file as `understanding` (4) and `plant` (2): 247 tools in
  28 groups.
- discovery/aliases.py folds spec section 12's vocabulary into the six records
  the branches wrote - metraj, metre cetveli, boru / kablo listesi, fark,
  karsilastir, revizyon farki, olcek, birim in both Turkish spellings, BOQ,
  takeoff, scale check, COMPARE - without writing a phrase twice. The Russian
  terms are data only: the BM25 tokenizer keeps [a-z0-9], and no golden case
  pretends otherwise.
- Eight golden tuning cases, four of them Turkish; the shared-command
  allowlist reconciled with what the merged records claim; the token-suite
  formula excludes the new pack; the inventory regenerated, the registry
  snapshot retaken and the README figures taken from check_doc_numbers.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01FKFStjEFzpGyLq5bMpWxTd
This commit is contained in:
Umut CAN
2026-09-24 14:51:29 +03:00
co-authored by Claude Opus 5.5
parent 8c1a6cb27c
commit 835bc4b65e
9 changed files with 338 additions and 70 deletions
+14 -1
View File
@@ -1,6 +1,6 @@
"""Golden query set for tool discovery: English in, one right tool out.
Ninety-nine cases (84 tuning + 15 holdout) split into a **tuning** set and a
One hundred and seven cases (92 tuning + 15 holdout) split into a **tuning** set and a
**holdout** set. The split is
the point of the file. Ranking work is measured against
:data:`TUNING_CASES` only; :data:`HOLDOUT_CASES` were written at the same time,
@@ -204,6 +204,19 @@ TUNING_CASES: tuple[GoldenCase, ...] = (
GoldenCase("merdiven çiz", "arch_stair", "synonym"),
GoldenCase("vaziyet planı çiz", "arch_plan_from_spec", "synonym"),
GoldenCase("oda alanlarını hesapla", "arch_rooms_detect", "synonym"),
# v1.6 track H - reading drawings somebody else made. Written before the
# merged alias records were measured against them; a miss is fixed by
# adding vocabulary to that tool's record in discovery/aliases.py, never by
# moving the expectation. Half of them Turkish: a takeoff is asked for in
# the language of the shop that prices the job.
GoldenCase("boru metrajı çıkar", "pipe_takeoff", "synonym"),
GoldenCase("kablo metrajı", "cable_takeoff", "synonym"),
GoldenCase("iki revizyonu karşılaştır", "drawing_diff", "synonym"),
GoldenCase("bu çizim ölçekli mi", "drawing_scale_check", "synonym"),
GoldenCase("what is in this drawing somebody sent me", "drawing_understand", "paraphrase"),
GoldenCase("pipe takeoff by diameter from the p&id", "pipe_takeoff", "paraphrase"),
GoldenCase("compare two revisions of this drawing", "drawing_diff", "paraphrase"),
GoldenCase("find dangling line ends and gaps", "drawing_topology_check", "paraphrase"),
)