Pinvane
한국어

Evidence

What we have tested — and what we have not

Testing and fixing is how we build Pinvane. Here is our latest result, how it was scored, and its limits.

Last updated 2026-11-17 (scoring round 27 of six fictional designs).

How we test

Six fictional designs, two reviewers who do not see each other's scores

  1. Six fictional designs

    6 machine designs of the kind small workshops build — two mobile platforms, a sorting machine, a robot arm, a gripper and a camera module. Equipment questions such as part ratings were closed with written assumptions: the test is about the drawing tool, not the machines.

  2. Drafted with Pinvane

    An AI (Claude) drafted each design with Pinvane and exported the drawing, the work tables — pin table, cut list, test sheet, pre-plug check, check list, parts and purchase lists — and the check results.

  3. Scored without seeing each other

    Two other AIs — Codex (OpenAI) and Gemini (Google) — each scored the same outputs on the same 28-point work-readiness rubric. Where they differed, Claude opened the tables and design data and settled the score.

  4. Fixed and scored again

    What the scoring found, and the 16 real defects that 4 separate deep reviews found, were traced back to the tool and fixed. Then everything was exported and scored again — this was round 27.

We do not publish the test designs' drawings or data. The numbers below describe how Pinvane did, not the machines.

Claims

Each claim, its source and its limits

E1In round 27, all 6 designs passed on the settled scores: 26 to 27 of 28 points each (159 of 168 in total), and 2 of 2 on item 13 for every design. To pass, a design needs at least 24 points and 2 on item 13. Source: scoring round 27 (2026-11-17) — Codex's total 156, Gemini's total 166, settled 159. Codex alone gave 1 on item 13 to three designs, so on its own scores 3 of the six would have passed. We opened the five places it pointed to and found wording and extra entries — for example a test row listing more terminals than needed — not work a worker would do wrong or miss, so those were settled at 2. The AI that settled the scores (Claude) also drafted the designs.
E2Item 13 asks one question: if a worker follows the tables, will they do something wrong or miss a step? Only that counts against it; wording, notation and over-cautious notes do not. Source: the scoring rule of the same round (2026-11-17). Not meant: that a worker needs no other input, or that the tables have no mistakes in them. People still confirm production information (E4).
E3What still costs points, and what the result does not cover: Source: the remaining deductions and limits recorded for round 27 (2026-11-17). Text in part boxes (item 9): on the main sheet of 3 designs some part boxes cut their text — 1 of 2.
Tool limits (item 12): 17 lines of things the tool cannot do yet stay in the assumption tables of all six — 1 of 2.
Small notation issues are still open (for example, a communication test listing more terminals than needed). They do not make a worker do the wrong thing.
Fictional designs: equipment questions were closed with assumptions, and no worker has wired a real machine from these tables yet.
Hidden defects: each of the 4 deep reviews found new defects, so defects we have not found may remain.
E4Undecided production information — lengths, contacts and the real terminals — must be confirmed and entered by the user and the designer. Source: the check lists of all test results. Pinvane lists these as open questions on the check list.

What we do not claim

Where Pinvane stands today

  • We do not claim that a worker can cut, crimp, wire and test straight from the tables with no further input. The check list shows what people still have to decide.
  • We do not claim that every output is free of mistakes. Passing six fictional designs is a test result, not a guarantee.
  • We do not compare speed or cost with other wiring tools: we have not measured them the same way.
  • Passing our tests and print checks does not prove that a machine's wiring is safe. Safety is the designer's job; Pinvane helps show what is missing.