The measurement body

The measurement harness

The harness is the machinery that turns a question bank and a fleet of models into a signed record a stranger can check without asking us anything. This page describes what it does today. Where a capability is named but not yet working, it is listed as not yet available rather than left out.

What is on the board

22 axes · 15 measured

22 axes are on the board; 15 of them carry a measurement and 7 are declared slots with no run behind them. The larger number counts slots, the smaller counts measurements — quote both or quote the smaller. A published slot exists so the gap is visible; it is not evidence of anything having been measured.

Read live from GET /api/gspc.

Cards published

150catalogued

Catalogued means the index lists them. It is not a claim that a verifier re-checked every one of them today — that is what the verifier in your hands is for.

as of 2026-08-19T09:24:39.174287+00:00 (read from created) · GET /api/state

How a result becomes a signed card

Five steps. The first three happen on the measurement node, where the signing key lives and never leaves. The last two are what you receive.

  1. 1

    A frozen bank is asked

    Every axis has a fixed set of items written from an obligation or a behaviour, not sampled at run time. The same fleet answers the same items, so two runs are comparable.

  2. 2

    The answer is graded deterministically

    A rule reads the answer, not a model. The same response always earns the same score. A response no rule can read is reported as unparsed — never counted as a wrong answer, and never silently dropped.

  3. 3

    The result is signed and chained

    The graded result is written into a small card, the card body is serialised to canonical JSON, and the body is signed Ed25519. The card names the previous card, so the set has an order that cannot be quietly edited.

  4. 4

    The card is published and indexed

    Each card is fetchable on its own, and an index lists every one with its identifier, its key and its signature.

  5. 5

    You verify it without us

    Recompute the hash over the canonical body, check the signature against the published key. Nothing calls home. If we vanished, every card already issued would still verify.

What works today

Each row below was classified by running the tool, not by reading its description. Where the two disagreed, the run decided. 6 capabilities are available today, of which some are available with a stated limit; 3 are named but not yet working and are published as such.

Signed measurement cards

Available

One card per model per axis. Each carries the model, the axis, the graded result, the issuer and a verify path, signed Ed25519 over canonical JSON.

Limit: A card records one graded run. It is not a judgement about the model overall, and it is not a compliance determination.

Offline verification of a card

Available

A recipient recomputes sha256 over the canonical body and checks the signature against the published key, with no call back to us. The verifier is open source.

The card chain

Available

Cards are linked: each names the previous card's identifier, and the manifest names the head. A card removed or reordered after the fact breaks the chain.

Limit: The chain proves internal order and integrity. It is not an external timestamp — see below.

EU AI Act findings report

Available, limited

A deterministic report that maps measured axes to the obligations they bear on, grades the gap on a fixed scale, and states the penalty tier the obligation sits in. No model is consulted to produce it.

Limit: The obligation map currently names a subset of the board's axes, and several of its names no longer match the board's. Where a name does not match, the report says UNMEASURED for an axis that has in fact been measured — it under-reports coverage rather than over-reporting it. Read it beside the live board until the map is re-pointed.

Surface probe

Available

A live check of the published surfaces a result depends on — the board, the card index, the registers, the archive records — reporting each one's actual response.

Dataset intake screening

Available, limited

Candidate benchmark datasets are screened on licence before anything is measured from them. Copyleft and non-commercial licences are rejected.

Limit: Licence is the only predicate implemented today. The canary-string and row-shape checks are described in the tool but are not yet performed, so a clean verdict means licence-clean and nothing more.

Card issuance

Runs on the measurement node

Cards are signed on the measurement node, where the key stays. The key is not in any repository and never leaves that machine.

Limit: There is no issuance on a laptop and no self-service issuance. A run is scheduled on the node; the artifacts and the verifier are what travel.

Automatic sweep of newly released models

Not yet available

The intended behaviour is that a newly published model is detected and queued for measurement within days of release.

Limit: The recency filter in the current dispatcher does not function — every model the registry returns is admitted regardless of age — so the queue it produces is not the selective one the name implies. Treated as not available until the filter is repaired and re-tested.

External timestamp anchor

Not yet available

The intended behaviour is a third-party timestamp proving a card existed at a given moment independently of us.

Limit: The stored anchor records a success that did not occur: the timestamp authority returned an error and the error was recorded as an ok status. There is no valid external timestamp on any card today. The card chain and the signature are unaffected — but neither of them is a proof of time.

Tokenised-asset measurement

Not yet available

A register of tokenised real-world assets exists, and each entry carries a signed card naming the asset and its public issuing address.

Limit: Every entry in that register reads UNMEASURED, because no question bank exists for these issuers yet. The cards verify as signed documents; they contain no assessment of the asset. Nothing in this register should be read as a rating.

What you actually receive

The cards for your subject

One signed card per axis measured, each with its graded result, the size of the run behind it, and the key that signed it.

The bank and the grader

The items your subject was asked and the rule that read the answers, so you can reproduce the score rather than take it.

A verifier you keep

An open-source checker that validates a card offline. It is yours; it does not expire and it does not phone us.

An honest register

Measured, reported and unmeasured are separate statuses and are never added together. An axis we have not measured is listed as unmeasured, not omitted.

What the harness will not do

  • It does not certify. We measure and publish the measurement. No mark is issued, nothing is approved, and no result should be presented as an approval.
  • It does not enforce. A regulator enforces. We measure against a published obligation and hand the reader the evidence and the arithmetic.
  • It does not score what it has not measured. An unmeasured axis is reported as unmeasured. It is never rendered as a zero, and never inferred from a neighbouring axis.
  • It is not open source. The verifier and the schemas are, so that a result can be checked by anyone. The measurement core is not, so that a subject cannot tune to the instrument.

Measurement, not certification. Every figure on this page is read from /api/gspc or /api/state at page load, together with the kind of claim it is and the date it was read from. If an endpoint does not answer, this page shows no number in its place.