Conformance results
The conformance suite (conformance/ in the Integration repository) checks behaviour by reading state back — values, checksums, receipts, grants and recorded executions — never prose. Offline checks need no server, account, model, MCP or network. Model-driven agent runs are optional and never gate the scientific suite; model output is not evidence of scientific correctness.
Current components (69b445674833)
Section titled “Current components (69b445674833)”connectors 9ca1acecfca1 · execution a0434acda3a3 · platform 41384a549a3b · science 0947d828d408 · sdk c634d78fe2c0 · workbench 8cc7e83565a1 · workspace 25134ab754bd
Offline scientific checks
Section titled “Offline scientific checks”python conformance/run.py offline
Passed — 8 tasks, finished 2026-09-27T14:03:13Z.
| Task | Oracle | Outcome |
|---|---|---|
| curve pair is exact | the descriptor/curve pair verifies; zero stays 0.0, missing is None, the unit and the increasing depth axis are the declared ones. | passed |
| typed pairs are exact | every typed descriptor/data pair (tops, trajectory, grid, mesh, points) verifies and keeps its declared context. | passed |
| conversion losses are declared | the LAS reader declares that the normalized view holds the selected curve only; the mesh-text/1 reader declares text formatting as lost and vertical datum and xy unit as unknown. | passed |
| bundle round trip | a curve bundle (1.x) and typed bundles (2.x) read back offline with the exact original bytes, zero/missing distinction and declared losses. | passed |
| corrupted bundle is refused | changing one byte of a curve file makes the bundle unreadable. | passed |
| compatibility matrix | Oracle, by explicit case: the released 1.0 reader reads a current curve bundle (1.x) and refuses a typed (2.x) bundle; the released 2.1 reader reads tops (2.0) and refuses mesh (2.2) as an unknown type; the current reader reads all of them. | passed |
| reinterpreted axis is refused | the verified pair’s depth axis equals the independently expected axis (the fixture’s literal depths, increasing) and the descriptor facts agree with it. A reversed axis with recomputed digests is refused. | passed |
| contracts snapshot | every required skill exists in the installed SDK, and each skill’s declared routes are in the SDK’s bundled OpenAPI snapshot and its declared symbols exist. | passed |
Public server (in-process gateway)
Section titled “Public server (in-process gateway)”python conformance/run.py server
Passed — 8 tasks, finished 2026-09-27T14:03:19Z.
| Task | Oracle | Outcome |
|---|---|---|
| read exact | the uploaded revision is the sha256 of its bytes; the exact read returns [0.0, None, 30.0] in gAPI over the depths [100, 101, 102] and the original bytes unchanged. | passed |
| correct and publish | publishing one change yields a receipt whose revision is the sha256 of the downloaded result, and reading that result gives the changed value with the others unchanged. | passed |
| share and reuse | after the owner grants read and reuse, the member reads the exact values and can configure on the original; a non-member is refused both. | passed |
| revoked access | the member reads successfully while shared, and is refused once the owner removes them; the owner still reads. | passed |
| recover interrupted publication | when the publication’s answer is lost after the server processed it, recovering the same work folder with a fresh client returns that publication, and the run has exactly one published result (same revision). | passed |
| unknown units are operation specific | a curve without a declared unit reads normally (unit empty, values exact); publishing a derived curve without an explicit unit is refused and leaves the run unpublished; the same publication with an explicit unit succeeds. | passed |
| misleading names | two items with the same display name but different values and revisions are both listed; reading each by its exact id and revision returns its own values. | passed |
| contracts deployed | every required skill’s declared routes are in the deployed OpenAPI document. | passed |
Scripted agent (in-process gateway)
Section titled “Scripted agent (in-process gateway)”python conformance/run.py agent
Passed — 4 tasks, finished 2026-09-27T14:03:22Z.
| Task | Oracle | Outcome |
|---|---|---|
| agent publishes with recorded plans | configure and start are policy-approved, publish waits for the person; each execution’s record names this agent, the operation and its plan; the run carries the start plan and the publication carries the publish plan; the receipt identity is the person. | passed |
| agent recovers a lost answer | the publication’s answer is lost after the server processed it; a fresh agent client recovers the recorded outcome, replaying the plan returns the same answer, and the run has one publication. | passed |
| agent tampering changes nothing | executing an approved plan with a different body is refused and the run stays unpublished; another agent cannot use the plan. | passed |
| model agent over mcp | with a fixed model and temperature through the remote MCP endpoint, the same tasks pass. | skipped: A model-driven agent needs the remote MCP endpoint, which this release does not offer; model runs never gate the suite. |
Self-test (deliberate faults)
Section titled “Self-test (deliberate faults)”python conformance/run.py selftest
Passed — 5 tasks, finished 2026-09-27T14:03:25Z.
| Task | Oracle | Outcome |
|---|---|---|
| fault corrupted bundle | a bundle opens; one changed byte in a curve file makes it refuse; restoring the byte reopens it. | passed |
| fault reinterpreted axis | the axis check passes on the fixture pair, fails on the reversed axis with recomputed digests, and passes again. | passed |
| fault removed skill | the contract check passes with the installed skills, fails when one required skill is removed, and passes when it is back. | passed |
| fault weakened denial guard | with the read-grant check in AssetAccess.authorize weakened to fall back to the owner’s grant, the revoked-access task fails; with the guard restored it passes. | passed |
| fault removed route | with the applications/publish operation removed from the gateway’s operation table, publishing fails as unknown (404); with it restored the task passes. | passed |
Public server (qualification deployment)
Section titled “Public server (qualification deployment)”python conformance/run.py server --target https://… --people people.json
Not run for these components.
Scripted agent (qualification deployment)
Section titled “Scripted agent (qualification deployment)”python conformance/run.py agent --target https://… --people people.json
Not run for these components.
Earlier components
Section titled “Earlier components”0af0fcfe2024: agent (in-process) passed, offline passed, selftest (in-process) passed, server (in-process) passed