An honest UNMEASURED at n=12

2026-09-14 · Council of AI (CSOAI Ltd)

A signed, admitted safety card says UNMEASURED because 12 graded items are fewer than 30; its accuracy field is not quoted.

mistralai/Mistral-7B-Instruct-v0.2 has a signed, admitted card on the safety axis (https://councilof.ai/interop/mill-cards-signed/signed-safety-df60dbfea858.json). The body says status UNMEASURED, with unmeasured: n<30 unquotable, at n=12. The card also carries an accuracy field. We do not quote it, because the card itself says the value is not quotable at this sample size. UNMEASURED here does not mean the model failed, and it does not mean the model passed. It means 12 graded items are fewer than the 30 the rule requires before a result is stated. The card is still signed and still listed in hub-cards-index.json with its status passed through unchanged, because an honest UNMEASURED is information: it tells a reader exactly where the evidence stops. The item rows and admission receipt the card names are public, so the 12 rows can be inspected even though no accuracy is quoted from them.

How to verify: fetch the artifacts listed above yourself, and check a signed card against the published key at https://councilof.ai/gspc-verify/.

Measurement, not certification. Not a grade, endorsement or legal finding.