anatoly/autocad-mcp-pro
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

fix: align benchmark docs with verification

Browse Source
This commit is contained in:
Umutcan Edizsalan
2026-07-17 15:16:56 +03:00
parent 112fe5125c
commit 1d47408157
2 changed files with 4 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+3
View File
@@ -86,6 +86,9 @@ python -m benchmarks.render_chart
python -m benchmarks.run_competitors --server autocad-mcp-pro --backend ezdxf --json python -m benchmarks.run_competitors --server autocad-mcp-pro --backend ezdxf --json
``` ```
The v1.3 ezdxf reference run records **10/10 tasks (100.0)**. It is a
self-check, not a competitor ranking.
Cross-project runtime scores will be published only after equivalent adapters Cross-project runtime scores will be published only after equivalent adapters
execute the same task contract. The complete rubric, caveats, version A/B suite, execute the same task contract. The complete rubric, caveats, version A/B suite,
and reproduction commands live in [`benchmarks/`](benchmarks/README.md). and reproduction commands live in [`benchmarks/`](benchmarks/README.md).
benchmarks/render_chart.py
+1 -3
View File
@@ -69,9 +69,7 @@ def render_chart(data: dict[str, Any], output: Path) -> None:
labels = [item["repository"] for item in projects] labels = [item["repository"] for item in projects]
scores = [item["score"] for item in projects] scores = [item["score"] for item in projects]
grades = [item["evidence_grade"] for item in projects] grades = [item["evidence_grade"] for item in projects]
colors = [ colors = ["#0969da" if label == "U-C4N/Autocad-MCP" else "#6e7781" for label in labels]
"#0969da" if label == "U-C4N/Autocad-MCP" else "#6e7781" for label in labels
]
fig, ax = plt.subplots(figsize=(12, 6.4), constrained_layout=True) fig, ax = plt.subplots(figsize=(12, 6.4), constrained_layout=True)
fig.patch.set_facecolor("#f6f8fa") fig.patch.set_facecolor("#f6f8fa")