release: v1.5.0 — discovery layer, honesty debt closed, Wave A
Tool count 131 -> 154; 474 -> 1242 collected tests. The release exists for two measured reasons. A 149-tool catalog costs a client ~40,300 tokens before it has asked for anything, and a drafter searching the way drafters think -- FILLET, BPOLY, QSELECT, WBLOCK -- scored df=0 against the stock index, because those words were simply not in the data. Discovery and batching - DISCOVERY_MODE=search replaces the catalog with search_tools + call_tool, ranked over an AutoCAD command and synonym corpus (discovery/aliases.py) on top of fastmcp's BM25 index. Measured: 40,305 -> 356 tokens advertised. - cad_batch runs a step list in one round trip; fields= projects result-heavy responses. The `core` profile is gone -- discovery replaced it. Honesty debt (Tier 0) - OCS/ECS: `extrusion` appeared nowhere in this codebase, so mirrored and rotated geometry reported coordinates that were quietly wrong. backends/ocs.py translates at the backend boundary; every tool coordinate is WCS on both engines, and a tilted plane refuses rather than answering with a number that looks fine. - drawing_save_as(fmt="dwg") wrote DXF bytes to a .dwg path. drawing_audit never repaired. analysis_measure_area shoelaced points the caller typed in. - ezdxf calls gained a per-call timeout, so one hung call can no longer wedge a server whose document lock is a single asyncio.Lock. Architecture - The 1854-line backend ABC is 19 contract modules; @capability(key, reason=) makes optional methods declarative and a gate fails on undeclared holes. - 8 layout/viewport tools, CHSPACE, CAD_PROGID escape hatch. - Wave A: selection filters, boundary tracing, hatch depth, annotation objects, measurement -- 13 tools of a planned 39. The REGION and 2D-boolean family was cut on evidence: add_region() yields zero ACIS bytes and the greiner_hormann substitute loses 28.2% of the area on a square with one semicircular edge. Verified against a live AutoCAD 2026, which found four COM defects no amount of reading would have caught -- AcadPViewport has no ViewCenter, and the line that set it had been swallowed by a bare except since v1.4. Benchmark v3 (15 tasks) and what it caught - v2 scored this server 10/10, which carried no information: every task in it exercised something the server was built around. Five tasks were added because they can fail, and three did while being written -- a hatch could not be measured though the refusal listed HATCH as measurable, the boundary tools and the measure tool disagreed about the same shape (139.2177 vs 139.2699), and a circle stored as two bulged vertices measured 0.0. - Competitor reports are NOT re-scored. They are pinned v1.4 runs against v2 and were never asked these five questions; the chart shows those rows `not run`. - Correctness A/B: 21/24 -> 24/24, zero regressions. Performance, stated plainly The published v1.4 perf report was recorded on CPython 3.14 and the new one on 3.11.15, so the apparent 2-6x speedup is the interpreter, not this release. Re-measured on one interpreter, v1.5.0 is 28% slower creating entities and 22% slower on the 10k roundtrip. Fully attributed: EZDXF_CALL_TIMEOUT=0 restores v1.4.0's exact numbers. That is the deadlock fix being paid for, the knob is documented, and winning it back is on the 1.6 roadmap. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This commit is contained in:
co-authored by
Claude Opus 5
parent
d5a0ff5109
commit
b03a7615b1
@@ -10,6 +10,10 @@ on:
|
||||
schedule:
|
||||
- cron: "17 5 * * 1"
|
||||
|
||||
env:
|
||||
# Keep in step with ci.yml; all three workflows read the same uv.lock.
|
||||
LOCKED_UV_VERSION: "0.12.1"
|
||||
|
||||
jobs:
|
||||
headless-matrix:
|
||||
runs-on: ubuntu-latest
|
||||
@@ -23,13 +27,19 @@ jobs:
|
||||
steps:
|
||||
- uses: actions/checkout@v4
|
||||
- uses: actions/setup-python@v5
|
||||
id: python
|
||||
with:
|
||||
python-version: "3.12"
|
||||
- name: Install
|
||||
run: pip install -e ".[pdf]"
|
||||
- run: pip install "uv==${{ env.LOCKED_UV_VERSION }}"
|
||||
- name: Install the locked harness environment
|
||||
# This lane publishes evidence, so the harness must not float: an ezdxf
|
||||
# release would otherwise move our own numbers between runs and the
|
||||
# diff would be unattributable. Competitors keep their own pinned
|
||||
# checkouts and venvs (benchmarks/competitors_env.py) either way.
|
||||
run: uv sync --locked --extra pdf --python "${{ steps.python.outputs.python-path }}"
|
||||
- name: Run benchmark (ezdxf lane)
|
||||
run: |
|
||||
python -m benchmarks.run_competitors \
|
||||
uv run --no-sync python -m benchmarks.run_competitors \
|
||||
--server "${{ matrix.server }}" \
|
||||
--backend ezdxf \
|
||||
--artifact-dir "benchmarks/results/ci/${{ matrix.server }}" \
|
||||
|
||||
+43
-13
@@ -11,6 +11,25 @@ concurrency:
|
||||
group: ci-${{ github.ref }}
|
||||
cancel-in-progress: true
|
||||
|
||||
# Two deliberately different installation paths run in this file:
|
||||
#
|
||||
# lint / test-* install from uv.lock with `--locked`. Every version, down to
|
||||
# the transitive graph, is the one the suite was last run
|
||||
# against; `--locked` *fails* rather than re-resolving if
|
||||
# uv.lock has drifted from pyproject.toml. A release upstream
|
||||
# can no longer turn main red on its own schedule.
|
||||
# package installs the built wheel with plain pip, from the dependency
|
||||
# ranges in pyproject.toml — on purpose. That is the path a
|
||||
# user gets from PyPI, and it is the only job that exercises
|
||||
# it, so it must not be locked.
|
||||
#
|
||||
# Locked CI is blind to upstream drift by construction; deps-floating.yml is the
|
||||
# deliberate counterweight that resolves the ranges fresh on a schedule.
|
||||
env:
|
||||
# Pinned for the same reason ruff is: the tool that reads the lockfile is part
|
||||
# of the reproducible environment. Bump this and re-run `uv lock` together.
|
||||
LOCKED_UV_VERSION: "0.12.1"
|
||||
|
||||
jobs:
|
||||
lint:
|
||||
runs-on: ubuntu-latest
|
||||
@@ -19,9 +38,14 @@ jobs:
|
||||
- uses: actions/setup-python@v5
|
||||
with:
|
||||
python-version: "3.11"
|
||||
- run: pip install ruff
|
||||
- run: ruff check .
|
||||
- run: ruff format --check .
|
||||
- run: pip install "uv==${{ env.LOCKED_UV_VERSION }}"
|
||||
# Dev group only: ruff comes from the lock, the project is not built.
|
||||
# The ruff version lives in [dependency-groups] dev in pyproject.toml and
|
||||
# nowhere else — the formatter's output changes between minors, so a
|
||||
# floating ruff fails `ruff format --check .` on unchanged code.
|
||||
- run: uv sync --locked --only-group dev
|
||||
- run: uv run --no-sync ruff check .
|
||||
- run: uv run --no-sync ruff format --check .
|
||||
|
||||
test-linux:
|
||||
runs-on: ubuntu-latest
|
||||
@@ -32,14 +56,17 @@ jobs:
|
||||
steps:
|
||||
- uses: actions/checkout@v4
|
||||
- uses: actions/setup-python@v5
|
||||
id: python
|
||||
with:
|
||||
python-version: ${{ matrix.python-version }}
|
||||
- name: Install dependencies
|
||||
run: |
|
||||
pip install -e ".[pdf]"
|
||||
pip install pytest pytest-asyncio pytest-cov
|
||||
- run: pip install "uv==${{ env.LOCKED_UV_VERSION }}"
|
||||
- name: Install the locked environment
|
||||
# uv.lock is a universal resolution over requires-python >=3.11, so the
|
||||
# same file serves both matrix legs; --python keeps uv on the
|
||||
# interpreter setup-python just provisioned instead of picking its own.
|
||||
run: uv sync --locked --extra pdf --python "${{ steps.python.outputs.python-path }}"
|
||||
- name: Run tests
|
||||
run: pytest --cov=. --cov-report=xml --cov-report=term-missing -v
|
||||
run: uv run --no-sync pytest --cov=. --cov-report=xml --cov-report=term-missing -v
|
||||
- name: Upload coverage
|
||||
if: matrix.python-version == '3.11'
|
||||
uses: actions/upload-artifact@v4
|
||||
@@ -54,14 +81,14 @@ jobs:
|
||||
steps:
|
||||
- uses: actions/checkout@v4
|
||||
- uses: actions/setup-python@v5
|
||||
id: python
|
||||
with:
|
||||
python-version: "3.11"
|
||||
- name: Install dependencies
|
||||
run: |
|
||||
pip install -e ".[full]"
|
||||
pip install pytest pytest-asyncio pytest-cov
|
||||
- run: pip install "uv==${{ env.LOCKED_UV_VERSION }}"
|
||||
- name: Install the locked environment
|
||||
run: uv sync --locked --extra full --python "${{ steps.python.outputs.python-path }}"
|
||||
- name: Run tests
|
||||
run: pytest -v
|
||||
run: uv run --no-sync pytest -v
|
||||
|
||||
package:
|
||||
runs-on: ubuntu-latest
|
||||
@@ -75,6 +102,9 @@ jobs:
|
||||
pip install build twine
|
||||
python -m build
|
||||
twine check dist/*
|
||||
# Unlocked on purpose: this resolves the published dependency ranges the
|
||||
# way a user's `pip install autocad-mcp-pro` does. Locking it would mean
|
||||
# nothing in CI ever proves those ranges are installable.
|
||||
- name: Install wheel in a clean venv and smoke test
|
||||
run: |
|
||||
python -m venv /tmp/smoke
|
||||
|
||||
@@ -0,0 +1,47 @@
|
||||
name: Floating deps
|
||||
|
||||
# The counterweight to a locked CI.
|
||||
#
|
||||
# ci.yml installs from uv.lock, so a PR can never be broken by an upstream
|
||||
# release. That is the point — and it is also a blind spot: a new fastmcp,
|
||||
# ezdxf or pydantic inside the ranges declared in pyproject.toml would go
|
||||
# unnoticed here until a user hit it, because the only unlocked job in CI
|
||||
# (`package`) merely imports the wheel and never runs the suite.
|
||||
#
|
||||
# This job is the deliberate opposite: resolve the declared ranges fresh and
|
||||
# run the full suite against whatever the index serves today. It runs on a
|
||||
# schedule and on demand only, so it never gates a pull request — a red run
|
||||
# here means "the ceiling needs a look", not "your change is broken".
|
||||
#
|
||||
# Lint is intentionally absent: ruff's formatter output moves between minors,
|
||||
# so a floating ruff would fail on unchanged source and say nothing about the
|
||||
# runtime dependencies this job exists to watch.
|
||||
|
||||
on:
|
||||
schedule:
|
||||
# Mondays, 06:17 UTC. Off the hour so it does not queue behind the
|
||||
# every-cron-on-the-hour crowd.
|
||||
- cron: "17 6 * * 1"
|
||||
workflow_dispatch:
|
||||
|
||||
jobs:
|
||||
floating:
|
||||
runs-on: ubuntu-latest
|
||||
strategy:
|
||||
fail-fast: false
|
||||
matrix:
|
||||
python-version: ["3.11", "3.12"]
|
||||
steps:
|
||||
- uses: actions/checkout@v4
|
||||
- uses: actions/setup-python@v5
|
||||
with:
|
||||
python-version: ${{ matrix.python-version }}
|
||||
- name: Install from the declared ranges (uv.lock deliberately ignored)
|
||||
run: |
|
||||
pip install -e ".[pdf]"
|
||||
pip install pytest pytest-asyncio
|
||||
- name: Record what actually resolved
|
||||
# Printed unconditionally: when this job fails, the version list is the
|
||||
# first thing needed to tell which upstream moved.
|
||||
run: pip list
|
||||
- run: pytest -q
|
||||
@@ -13,20 +13,29 @@ on:
|
||||
push:
|
||||
tags: ["v*"]
|
||||
|
||||
env:
|
||||
# Keep in step with ci.yml; both read the same uv.lock.
|
||||
LOCKED_UV_VERSION: "0.12.1"
|
||||
|
||||
jobs:
|
||||
test:
|
||||
runs-on: ubuntu-latest
|
||||
steps:
|
||||
- uses: actions/checkout@v4
|
||||
- uses: actions/setup-python@v5
|
||||
id: python
|
||||
with:
|
||||
python-version: "3.11"
|
||||
- name: Install dependencies
|
||||
run: |
|
||||
pip install -e ".[pdf]"
|
||||
pip install pytest pytest-asyncio ruff
|
||||
- run: ruff check .
|
||||
- run: pytest -q
|
||||
- run: pip install "uv==${{ env.LOCKED_UV_VERSION }}"
|
||||
- name: Install the locked environment
|
||||
# `--locked` refuses to re-resolve, so the artifact that goes to PyPI is
|
||||
# gated by the exact dependency set the suite was run against — not by
|
||||
# whatever the index happens to serve at tag time. ruff's version comes
|
||||
# from [dependency-groups] dev via the lock; it is not restated here.
|
||||
run: uv sync --locked --extra pdf --python "${{ steps.python.outputs.python-path }}"
|
||||
- run: uv run --no-sync ruff check .
|
||||
- run: uv run --no-sync ruff format --check .
|
||||
- run: uv run --no-sync pytest -q
|
||||
|
||||
build:
|
||||
needs: test
|
||||
|
||||
Reference in New Issue
Block a user