Evidence
What we have tested — and what we have not
Testing and fixing is how we build Pinvane. Here is our latest result, how it was scored, and its limits.
Last updated 2026-11-17 (scoring round 27 of six fictional designs).
How we test
Six fictional designs, two reviewers who do not see each other's scores
Six fictional designs
6 machine designs of the kind small workshops build — two mobile platforms, a sorting machine, a robot arm, a gripper and a camera module. Equipment questions such as part ratings were closed with written assumptions: the test is about the drawing tool, not the machines.
Drafted with Pinvane
An AI (Claude) drafted each design with Pinvane and exported the drawing, the work tables — pin table, cut list, test sheet, pre-plug check, check list, parts and purchase lists — and the check results.
Scored without seeing each other
Two other AIs — Codex (OpenAI) and Gemini (Google) — each scored the same outputs on the same 28-point work-readiness rubric. Where they differed, Claude opened the tables and design data and settled the score.
Fixed and scored again
What the scoring found, and the 16 real defects that 4 separate deep reviews found, were traced back to the tool and fixed. Then everything was exported and scored again — this was round 27.
We do not publish the test designs' drawings or data. The numbers below describe how Pinvane did, not the machines.
Claims
Each claim, its source and its limits
Tool limits (item 12): 17 lines of things the tool cannot do yet stay in the assumption tables of all six — 1 of 2.
Small notation issues are still open (for example, a communication test listing more terminals than needed). They do not make a worker do the wrong thing.
Fictional designs: equipment questions were closed with assumptions, and no worker has wired a real machine from these tables yet.
Hidden defects: each of the 4 deep reviews found new defects, so defects we have not found may remain.
What we do not claim
Where Pinvane stands today
- We do not claim that a worker can cut, crimp, wire and test straight from the tables with no further input. The check list shows what people still have to decide.
- We do not claim that every output is free of mistakes. Passing six fictional designs is a test result, not a guarantee.
- We do not compare speed or cost with other wiring tools: we have not measured them the same way.
- Passing our tests and print checks does not prove that a machine's wiring is safe. Safety is the designer's job; Pinvane helps show what is missing.