CSOAI - for regulators + policy bodies
An assurance baseline you can verify - and publish
You need something you can check without trusting the party who published it. The core here is MIT-licensed, the banks are public, and each measurement is Ed25519-signed against a key you fetch yourself - so anyone can recompute a number and challenge it.
Your path with CSOAI
What you can check, right now
The row that matters most to a supervisor is the empty one. regulatory-framework is a published slot with no run behind it, and it sits here beside three measured axes rather than being left off the page. That is the whole proposition: you can see what we have not measured as plainly as what we have.
| Axis | Bench | n | Leader accuracy | 95% CI | Separation |
|---|---|---|---|---|---|
| governance | GovBench | 237 | 70.0% | 63.9–75.5% | SEPARATED p=0.0086 |
| art5-safeguard | Art5Bench | 36 | 97.2% | 85.8–99.5% | TIE — indistinguishable p=1 |
| conformance | MCPBench | 35 | 74.3% | 57.9–85.8% | TIE — indistinguishable p=1 |
| regulatory-framework | — | nothing measured | unmeasured | unmeasured | UNMEASURED |
verifiable
Publish proof, not promises
Each measurement card is signed over its exact bytes, and the board snapshot carries its own site attestation naming the key that signed it. Re-verification needs no account and no CSOAI code.
What you can check on the board
The two axes a supervisory reader usually wants first: can a model recognise a prohibited practice, and can it place a system in the right risk tier.
Every figure below is read live from GET /api/gspc when this page loads — no count is typed into it. These axes measure how a fleet of models behaves on a frozen, published bank on a date. None of them is an assessment of your organisation, and none is a conformity opinion: determination stays with your regulator.
Board right now: 22 axes · 15 measured — a published slot is not a measurement, which is why both numbers travel together.
EU AI Act Article 5 prohibited-practice trip: does the model recognise a prohibited practice when it sees one.
- What is graded:
- EU AI Act Article 5 prohibited-practice trip
- n:
- 36 bank items
- Leader:
- 97.2% (council-relationality-v3-light (council specialist))
- Separation:
- TIE — the leader's lead is not statistically separated, and a tie is never counted as a win.
- Frozen bank:
- csoai/gspc-art5
EU AI Act risk-tier classification. The largest bank on the board, and the judgement most downstream duties hang off.
- What is graded:
- EU AI Act risk-tier classification
- n:
- 237 bank items
- Leader:
- 70.0% (council-embodiment-v3-light (council specialist))
- Separation:
- SEPARATED
- Frozen bank:
- csoai/gspc-gov
Machinery Regulation self-evolving safety-function classification — a second statute, graded deterministically the same way.
- What is graded:
- Machinery Reg self-evolving safety-function classification (PART_A / OUT_OF_SCOPE / NOT_SAFETY_FUNCTION)
- n:
- 33 bank items
- Leader:
- 54.5% (llama3.2:3b (base model))
- Separation:
- TIE — the leader's lead is not statistically separated, and a tie is never counted as a win.
- Frozen bank:
- csoai/gspc-mach
Re-check it without us
Each published measurement card is Ed25519-signed over its exact bytes, and its id is the sha256 of those bytes. Pin the key from our DID document first — a card verified against the key it ships with proves only that the file is self-consistent.
- /signed/HOW-TO-VERIFY.md — the four commands, start here
- /signed/card_index.json — the signed index of published cards
- /.well-known/did.json — the key to pin against
- /gspc-verify — recompute the replay chain in your browser, no account
Questions, answered
The core is MIT-licensed and every published measurement verifies against a key you fetch from our own DID document, so the assurance does not rest on trusting a single commercial vendor. We measure; determination stays with authorities.
Yes - that is the design, and the method is published rather than described. Pin the key from /.well-known/did.json, fetch a card from the published index, recompute the sha256 of the exact signed bytes and check the Ed25519 signature. If the bytes do not verify, the card is not ours.
Answers from published measurement, or it refuses. Your question is typed into the lobby — nothing sends until you press Ask.
Deterministic pane commands · grounded /api/chat lane · consent checkpoint on consequential steps