release: 1.6.0
The v1.6 roadmap in five tracks: 154 -> 247 registered tools in 28 groups. Evidence re-measured for the release: - correctness A/B against v1.5.1: 26/48 -> 48/48, 22 fixed, 0 regressed (ab-v1.5.1-vs-v1.6.0.json, replacing the -dev report); - the reference adapter on matrix v7: 21/21 (autocad-mcp-pro.json, which was the v3 run of 1.5); the published-report test follows it to v7; - the 100-point rubric re-scored per category, every withheld point named: 93 (the competitor rows are their July snapshots, not re-reviewed); - the perf lane as medians of five alternating runs, beside a v1.4.0 comparison on one interpreter (perf-v1.4.0-vs-v1.6.0.json). Two roadmap criteria are not green, and the changelog, the README and the roadmap say so: criterion 5 is withdrawn (track D, Plant 3D, dropped) and criterion 7 is not met (creation 1.25x / 1.38x v1.4.0's time, still 1.17x / 1.20x with the timeout off). Carried to 1.7. README rewritten for 1.6: what is new, the mechanical and architectural sheets, the rubric and task-matrix charts, the measured limits (including the four feature tables that ship empty), and the 1.7 roadmap. server.json describes the 1.6 surface and declares TOOL_PACKS. CLAUDE.md corrects the ISO 286 letter set and the empty feature tables. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01FKFStjEFzpGyLq5bMpWxTd
This commit is contained in:
co-authored by
Claude Opus 5.5
parent
7e7fe11a71
commit
17bf3a39ce
@@ -14,23 +14,37 @@
|
||||
"entity_count": 2000
|
||||
},
|
||||
"metric": "entities_per_second",
|
||||
"metric_value": 5715.8,
|
||||
"wall_ms": 349.9,
|
||||
"workload_id": "create_lines_2k"
|
||||
"wall_ms": 306.1,
|
||||
"workload_id": "create_lines_2k",
|
||||
"runs_ms": [
|
||||
287.6,
|
||||
373.6,
|
||||
298.2,
|
||||
425.1,
|
||||
306.1
|
||||
],
|
||||
"metric_value": 6533.8
|
||||
},
|
||||
{
|
||||
"description": "Create 10,000 lines, export DXF, reopen and verify",
|
||||
"detail": {
|
||||
"build_ms": 1633.1,
|
||||
"build_ms": 2149.4,
|
||||
"entity_count": 10000,
|
||||
"export_ms": 273.0,
|
||||
"file_bytes": 1369663,
|
||||
"reopen_ms": 272.1
|
||||
"export_ms": 516.6,
|
||||
"file_bytes": 1369662,
|
||||
"reopen_ms": 535.2
|
||||
},
|
||||
"metric": "entities_per_second",
|
||||
"metric_value": 4590.8,
|
||||
"wall_ms": 2178.3,
|
||||
"workload_id": "roundtrip_10k"
|
||||
"wall_ms": 2553.5,
|
||||
"workload_id": "roundtrip_10k",
|
||||
"runs_ms": [
|
||||
3201.3,
|
||||
2550.0,
|
||||
3118.3,
|
||||
2553.5,
|
||||
2289.4
|
||||
],
|
||||
"metric_value": 3916.2
|
||||
},
|
||||
{
|
||||
"description": "Crossing-selection region query over 10,000 entities",
|
||||
@@ -39,8 +53,15 @@
|
||||
},
|
||||
"metric": "entities_matched",
|
||||
"metric_value": 2500.0,
|
||||
"wall_ms": 2466.9,
|
||||
"workload_id": "region_query_10k"
|
||||
"wall_ms": 712.2,
|
||||
"workload_id": "region_query_10k",
|
||||
"runs_ms": [
|
||||
712.2,
|
||||
806.7,
|
||||
295.1,
|
||||
836.4,
|
||||
300.6
|
||||
]
|
||||
},
|
||||
{
|
||||
"description": "Plate with hole: ISO layers, geometry, dimensions and full critique",
|
||||
@@ -49,8 +70,16 @@
|
||||
},
|
||||
"metric": "critique_issues",
|
||||
"metric_value": 0.0,
|
||||
"wall_ms": 255.7,
|
||||
"workload_id": "premium_pass"
|
||||
"wall_ms": 65.3,
|
||||
"workload_id": "premium_pass",
|
||||
"runs_ms": [
|
||||
76.3,
|
||||
65.3,
|
||||
36.9,
|
||||
83.8,
|
||||
41.3
|
||||
]
|
||||
}
|
||||
]
|
||||
],
|
||||
"aggregation": "median of 5 default-configuration runs, one machine, one interpreter"
|
||||
}
|
||||
|
||||
Reference in New Issue
Block a user