Conformance suite

The conformance suite (conformance/ in the Integration repository) checks behaviour by reading state back — values, checksums, receipts, grants and recorded executions — never prose. Offline checks need no server, account, model, MCP or network. Model-driven agent runs are optional and never gate the scientific suite; model output is not evidence of scientific correctness.

This page lists each mode’s tasks by their test identifiers. Every hosted Visual run executes every mode and fails when a required task fails, is skipped or is missing; no results are kept here.

Offline scientific checks

python conformance/run.py offline --results FILE

curve_pair_is_exact
typed_pairs_are_exact
conversion_losses_are_declared
bundle_round_trip
corrupted_bundle_is_refused
compatibility_matrix
reinterpreted_axis_is_refused
contracts_snapshot
recipe_describes_table_types
procedure_runs_from_the_wheel
invalid_procedure_says_words
written_location_reads_in_the_connectors
procedure_contract_matches_at_the_pins
read_procedures_match_alike_in_the_sdk_and_the_resolver
guide_quotes_the_journey_verbatim
the_guide_names_what_the_workspace_shows
bundle_interpretation_is_checked_independently
conseil_without_the_readme_needs_a_decision
bundle_interpretation_corruption_is_detected
semantic_evidence_is_evaluated_not_trusted
configuration_matrix_agrees
data_changes_are_detected
opendtect_horizon_bundle_checks
shapefile_packages_are_outside_semantic_verification
released_readers_refuse_the_package_bundle
checker_imports_only_the_standard_library
scattered_members_read_whole_in_place
petrel_shapefile_cut_set_headers_agree
petrel_surfaces_and_shapefile_sets_read_whole_in_place
fault_stick_members_read_whole_in_place
well_tops_member_reads_whole_in_place
petrel_horizons_zip_over_the_unpacked_limit_is_refused
mapper_journey
mapper_bundle_journey
agent_journeys_are_declared
cli_helpers_name_grouped_spellings
demo_serves_a_synthetic_bundle
mvp_journey_is_registered
mvp_horizon_changes_are_frozen
mvp_notebooks_and_script_follow_the_record
mvp_notebooks_name_items_by_name
mvp_source_oracle_reads_the_files
mvp_nlog_recorder_stays_in_its_folder
mvp_qgis_inside_imports_only_qgis_and_the_plugin
mvp_whole_run_record_keeps_no_data_value
mvp_whole_imports_no_connector
mvp_whole_tops_reach_their_well_through_the_wellbore
mvp_whole_product_is_the_release

Public server

python conformance/run.py server --results FILE [--target https://… --people people.json]

read_exact
correct_and_publish
share_and_reuse
revoked_access
recover_interrupted_publication
unknown_units_are_operation_specific
misleading_names
contracts_deployed
entities_associate_exact_revisions
entities_refuse_unregistered_predicates
entities_deny_across_audiences
entities_travel_offline
conseil_contradiction_is_decided_from_the_readme
config_only_variation_reads_without_code
reader_needed_is_refused
both_dialects_round_trip_through_the_gateway
capability_three_discovery_is_bounded
capability_three_inherited_writes_available
capability_three_newly_widened_areas_stay_refused
events_follow_their_writes
events_respect_current_access
resume_without_gaps
stream_matches_pull
inbox_from_the_log
derived_publication_reads_back_with_its_method_and_parents
derived_publication_needs_reuse_of_every_parent
a_publication_names_the_access_key_that_made_it
wells_are_located_by_sources_the_reader_may_read
wells_in_a_box_and_the_extent_match_what_was_located
associations_name_the_well_of_every_source_the_reader_may_read
recipe_reads_curves_in_python
recipe_hands_formation_tops_to_another_application
recipe_keeps_in_step_with_workspace
recipe_shale_volume_from_gamma_ray
recipe_make_a_wavelet
recipe_how_a_result_was_made
recipe_well_files
recipe_spreadsheet_to_wells_and_tops
recipe_keeps_a_table_and_takes_it_out
recipe_wells_from_your_files
recipe_wedge_model_and_synthetic
section_publishing_refusals_name_what_to_do
calculated_results_keep_their_author_and_versions
calculation_refusals_name_what_to_do
gallery_notebooks_run_live
gallery_section_notebooks_run_live
gallery_large_files_notebook_runs_live
gallery_time_depth_notebook_runs_live
gallery_spreadsheet_notebook_runs_live
recipe_uploads_a_folder
an_interrupted_folder_upload_sends_only_what_is_missing
gallery_folder_notebook_runs_live
actions_name_who_and_through_what
a_refused_write_is_found_by_its_request_number_by_administrators_only
the_record_downloads_as_prov_json
a_result_says_how_it_was_made
making_it_again_with_a_newer_input_holds_the_values_of_the_altered_input
a_result_ophiolite_did_not_run_cannot_be_made_again
grids_and_gis_files_land_with_their_literal_values
a_geopackage_layer_is_asked_and_answered_by_path
a_shapefile_without_its_table_is_refused
recipe_grids_and_gis_files
gallery_grids_gis_notebook_runs_live
checks_are_witnessed_or_claimed
recipe_change_coordinates_and_units
a_refused_change_writes_nothing
recipe_opens_the_project_in_qgis
gallery_layers_notebook_runs_live
recipe_layouts_you_keep
recipe_new_data_and_sharing
procedures_are_shared_in_a_project
recipe_reads_a_well_with_its_wellbores
gallery_wells_notebook_runs_live
recipe_whats_next_and_templates
the_cards_python_lines_run
stored_recipe_one_reads_back_as_saved
recipe_events_name_their_authors
procedure_runs_are_published_and_made_again
a_team_procedure_on_a_log_is_published_and_made_again
a_procedure_result_travels_in_a_bundle
a_report_and_a_team_table_are_read_on_this_computer
a_malformed_output_is_refused_by_the_built_in_reader
the_precedence_holds_at_the_deployment
first_run_lands_with_its_source
headers_service_reads_behind_a_token
unchanged_rerun_says_nothing_changed
changed_rerun_is_version_two
a_grid_is_delivered_to_a_folder_as_a_surfer_grid
tops_are_checked_against_a_reference_well_both_ways
a_survey_agrees_with_wellpathpy_within_a_centimetre
four_breadth_files_are_read_on_this_computer
every_read_kind_lands_from_a_generated_procedure
petrophysics_notebooks_run_live
petrel_horizon_points_land_as_stated
petrel_las_repeated_names_land
petrel_las_whole_files_land
petrel_scattered_data_lands_as_stated
petrel_time_map_and_shapefile_horizon_land_as_stated
petrel_fault_sticks_land_in_file_order
petrel_well_tops_land_as_stated
your_own_application_writes_and_is_found
your_own_application_refuses_without_write
your_own_application_on_the_f3_block
your_own_application_guide_finds_by_provenance
mapper_manifest_on_the_f3_block
two_applications_meet
two_applications_on_the_f3_block
tool_version_is_verified_against_a_check
mvp_sources_arrive
mvp_change_reaches_every_holder
mvp_qgis_holds_the_horizon
mvp_whole_journey
a_sandbox_run_is_witnessed

Only against the in-process gateway

sdk_capability_three_round_trip
reading_layouts_stay_off_the_layout_routes
recipe_buckets_as_sources
recipe_public_repositories
a_public_repository_import_is_an_administrators
webhook_delivery_is_signed_retried_logged_and_replayable
ogc_features_read_from_the_landing_address
calculation_needs_the_compute_permission
section_publishing_needs_the_publish_permission
a_mapping_offers_coordinate_systems_with_their_grounds
org_connections_are_given_used_and_taken_back
org_connections_skip_where_the_release_predates_them
org_databases_are_added_in_the_browser_only_where_the_rule_allows
org_databases_skip_where_the_release_predates_them
worked_example_5a_reads_as_written
worked_example_5b_keeps_duplicate_rows_in_value_order
worked_example_5c_schema_changes_in_order
a_sign_in_that_sees_other_rows_is_refused
recipe_reads_any_table
a_spreadsheet_and_a_database_joined_runs_live
registered_application_round_trip
registered_application_provisioning_recovers
procedures_skip_where_the_release_predates_them
procedure_runs_skip_where_the_release_predates_them
an_older_sdk_reads_a_procedure_result
recipe_sql_server_and_oracle_documents
recipe_sql_server_and_oracle_read
petrel_excerpt_folders_land_as_listed
petrel_excerpt_folders_renamed_to_dat_land_the_same
petrel_excerpt_folders_with_one_corrupted_export
petrel_folders_land_whole_in_place
petrel_folders_renamed_to_dat_land_whole_the_same
petrel_folders_whole_with_one_corrupted_export
tool_version_is_verified_against_a_check
mvp_sources_arrive

Only against a deployment

sdk_capability_three_discovery_deployed
ogc_features_collection_pages_every_well_once
org_connections_list_deployed
org_databases_mode_deployed
guide_reads_a_window_on_an_access_key
your_own_application_runs_as_processes
trial_own_database_refused_where_the_rule_forbids

Scripted agent

python conformance/run.py agent --results FILE [--target https://… --people people.json]

agent_publishes_with_recorded_plans
agent_recovers_a_lost_answer
agent_tampering_changes_nothing
mcp_follows_the_same_rules
assistant_follows_the_agent_rules
agent_evidence_is_recorded
agent_evidence_missing_is_shown_missing
agent_unapproved_evidence_is_refused
agent_setting_off_keeps_a_digest_only
agent_rerun_runs_the_remake
agent_runs_a_procedure_she_approved
agent_runs_a_job_under_one_approval
agent_job_refusals
person_reads_what_waits
agent_parent_is_a_job
agent_sdk_runs_a_job
tool_run_publish
agent_imports_a_table_she_approved
agent_imports_a_database_table_she_approved
agent_dry_run_writes_nothing
agent_dry_run_rights_parity
agent_asks_for_a_connection
agent_links_a_source
agent_exchanges_with_a_tool
agent_uses_the_notebook_skill
model_agent_over_mcp
agent_wells_on_a_map
agent_curves_into_python
agent_tops_for_another_application
agent_surface_from_points
agent_keep_in_step
agent_source_in_python
agent_wells_from_a_table
agent_running_a_project

Only against the in-process gateway

agent_uses_the_opendtect_skill

Self-test (deliberate faults)

python conformance/run.py selftest --results FILE

fault_corrupted_bundle
fault_corrupted_decision
fault_reinterpreted_axis
fault_weakened_denial_guard
fault_removed_skill
fault_removed_route
fault_omitted_target_task
fault_recipe_calling_a_missing_route
fault_source_recipe_calling_a_missing_symbol
fault_builder_route_removed
fault_removed_service_desc_link
fault_upload_limits_not_stated
fault_sdk_evidence_removed
fault_sdk_evidence_header_removed
fault_widened_check_tolerance
fault_person_prepared_input
fault_journey_runner
fault_journey_tool_not_listed
fault_journey_http_not_served
fault_journey_cleanup
fault_read_journeys
fault_import_journey
fault_surface_journey

Implementations checked against references (offline)

python conformance/run.py scientific --results FILE

checks_are_produced_offline
checks_name_the_installed_release
the_offline_guard_stops_a_planted_connection
a_changed_calculation_differs
a_changed_scalar_worker_differs
a_reference_added_under_test_is_checked
every_reference_has_rights

Builder journeys J1–J5

python conformance/run.py builder --results FILE --target http://127.0.0.1:PORT --people sandbox.json

builder_wells_on_a_map
builder_curves_into_python
builder_tops_for_another_application
builder_surface_from_points
builder_keep_in_step
builder_source_in_python
builder_wells_from_a_table
builder_well_position
builder_running_a_project