| Test characteristic | Value |
|---|---|
| Test run identifier | TR-67e77b5 |
| Start time | 2025-12-28 18:41:43 UTC |
| End time | 2025-12-28 19:04:25 UTC |
| Test baseline identifier | TB-c5122db |
| Environment identifier | TE-a5b8dc3 |
| Codebase version | interuss/monitoring/v0.19.0 |
| Commit hash | 101c9be31c91e40838b42b3a8208ac4cc6e79471 |
conflicting_flights (resources.flight_planning.FlightIntentsResource)id_generator (resources.interuss.IDGeneratorResource)client_identityutm_client_identity resource
invalid_flight_intents (resources.flight_planning.FlightIntentsResource)non_conflicting_flights (resources.flight_planning.FlightIntentsResource)planning_area (resources.PlanningAreaResource)problematically_big_area (resources.VolumeResource)query_behavior (resources.interuss.QueryBehaviorResource)system_identity (resources.versioning.SystemIdentityResource)test_exclusions (resources.dev.TestExclusionsResource)utm_client_identity (resources.communications.ClientIdentityResource)auth_adapterutm_auth resource
dss (resources.astm.f3548.v21.DSSInstanceResource)auth_adapterutm_auth resource
dss_datastore_cluster (resources.interuss.datastore.DatastoreDBClusterResource)dss_instances (resources.astm.f3548.v21.DSSInstancesResource)auth_adapterutm_auth resource
flight_planners (resources.flight_planning.FlightPlannersResource)auth_adapterutm_auth resource
flight_planners_to_clear (resources.flight_planning.FlightPlannersResource)auth_adapterutm_auth resource
mock_uss (resources.interuss.mock_uss.client.MockUSSResource)auth_adapterutm_auth resource
next_env_auth (resources.communications.AuthAdapterResource)prod_env_version_providers (resources.versioning.VersionProvidersResource)auth_adapternext_env_auth resource
second_utm_auth (resources.communications.AuthAdapterResource)test_env_version_providers (resources.versioning.VersionProvidersResource)auth_adapterutm_auth resource
utm_auth (resources.communications.AuthAdapterResource)| Suite / action generator | Scenario | airspacelink_uss | anra_uss | avision_uss | ax_dss | ax_uss | cal_dss | cal_uss | flytrex_uss | mock_uss | onesky_uss | utmverse_dss | utmverse_uss | wing_dss | wing_uss | zipline_dss | zipline_uss | <None> | Time | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ASTM F3548-21 | → | 1) Get system versions | ✅ | ✅ | 0:00 | ||||||||||||||||
| 2) ASTM F3548 flight planners preparation | ✅ | ✅ | ✅ | ✅ | 0:03 | ||||||||||||||||
| For each F3548 DSS instance | DSS testing for ASTM F3548-21 | 3) ASTM SCD DSS: Operational Intent Explicit Subscription handling | ✅ | 0:04 | |||||||||||||||||
| 4) ASTM SCD DSS: Implicit Subscription handling | ✅ | 0:14 | |||||||||||||||||||
| 5) ASTM SCD DSS: Operational Intent Reference Simple | ✅ | 0:03 | |||||||||||||||||||
|
Skipped: ASTM SCD DSS: Constraint Reference Simple AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 5 scopes currently declared as authorized for AuthAdapterResource: utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions, utm.availability_arbitration, interuss.flight_planning.direct_automated_test |
|||||||||||||||||||||
|
Skipped: ASTM SCD DSS: Constraint Reference Synchronization AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 5 scopes currently declared as authorized for AuthAdapterResource: utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions, utm.availability_arbitration, interuss.flight_planning.direct_automated_test |
|||||||||||||||||||||
| 6) ASTM SCD DSS: USS Availability Synchronization | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 0:04 | ||||||||||||||
| 7) ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 0:02 | ||||||||
| 8) ASTM SCD DSS: Subscription and entity deletion interaction | ✅ | ✅ | ✅ | ✅ | ✅ | 0:22 | |||||||||||||||
| 9) ASTM SCD DSS: Subscription and entity interaction | ✅ | ✅ | ✅ | ✅ | ✅ | 0:46 | |||||||||||||||
| 10) ASTM SCD DSS: Operational Intent Reference Key Validation | ✅ | 0:04 | |||||||||||||||||||
| 11) ASTM SCD DSS: Operational Intent Reference Synchronization | ✅ | ✅ | ✅ | ✅ | ✅ | 0:07 | |||||||||||||||
| 12) ASTM SCD DSS: Interfaces authentication | ✅ | 0:04 | |||||||||||||||||||
| 13) ASTM SCD DSS: Subscription Simple | ✅ | 0:04 | |||||||||||||||||||
| 14) ASTM SCD DSS: Subscription Validation | ✅ | 0:00 | |||||||||||||||||||
| 15) ASTM F3548-21 UTM DSS Operational Intent Reference Access Control | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 0:02 | ||||||||
| 16) ASTM F3548-21 UTM DSS interoperability | ✅ | ✅ | ✅ | ✅ | ✅ | 0:01 | |||||||||||||||
| 17) ASTM SCD DSS: Subscription Synchronization | ✅ | ✅ | ✅ | ✅ | ✅ | 0:39 | |||||||||||||||
| 18) ASTM UTM DSS: Direct datastore access | ✅ | ✅ | ✅ | ✅ | ✅ | 0:34 | |||||||||||||||
|
Skipped: OVN Request Optional Extension to ASTM F3548-21 DSS resource with ID utmverse_dss does not support OVN requests |
|||||||||||||||||||||
| 19) ASTM SCD DSS: Report | ✅ | 0:00 | |||||||||||||||||||
| DSS testing for ASTM F3548-21 | 20) ASTM SCD DSS: Operational Intent Explicit Subscription handling | ✅ | 0:03 | ||||||||||||||||||
| 21) ASTM SCD DSS: Implicit Subscription handling | ✅ | 0:08 | |||||||||||||||||||
| 22) ASTM SCD DSS: Operational Intent Reference Simple | ✅ | 0:02 | |||||||||||||||||||
|
Skipped: ASTM SCD DSS: Constraint Reference Simple AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 5 scopes currently declared as authorized for AuthAdapterResource: utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions, utm.availability_arbitration, interuss.flight_planning.direct_automated_test |
|||||||||||||||||||||
|
Skipped: ASTM SCD DSS: Constraint Reference Synchronization AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 5 scopes currently declared as authorized for AuthAdapterResource: utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions, utm.availability_arbitration, interuss.flight_planning.direct_automated_test |
|||||||||||||||||||||
| 23) ASTM SCD DSS: USS Availability Synchronization | ✅ | ✅ | ✅ | ✅ | ✅ | 0:03 | |||||||||||||||
| 24) ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 0:01 | ||||||||
| 25) ASTM SCD DSS: Subscription and entity deletion interaction | ✅ | ✅ | ✅ | ✅ | ✅ | 0:20 | |||||||||||||||
| 26) ASTM SCD DSS: Subscription and entity interaction | ✅ | ✅ | ✅ | ✅ | ✅ | 0:41 | |||||||||||||||
| 27) ASTM SCD DSS: Operational Intent Reference Key Validation | ✅ | 0:02 | |||||||||||||||||||
| 28) ASTM SCD DSS: Operational Intent Reference Synchronization | ✅ | ✅ | ✅ | ✅ | ✅ | 0:06 | |||||||||||||||
| 29) ASTM SCD DSS: Interfaces authentication | ✅ | 0:03 | |||||||||||||||||||
| 30) ASTM SCD DSS: Subscription Simple | ✅ | 0:02 | |||||||||||||||||||
| 31) ASTM SCD DSS: Subscription Validation | ✅ | 0:00 | |||||||||||||||||||
| 32) ASTM F3548-21 UTM DSS Operational Intent Reference Access Control | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 0:01 | ||||||||
| 33) ASTM F3548-21 UTM DSS interoperability | ✅ | ✅ | ✅ | ✅ | ✅ | 0:01 | |||||||||||||||
| 34) ASTM SCD DSS: Subscription Synchronization | ✅ | ✅ | ✅ | ✅ | ✅ | 0:38 | |||||||||||||||
| 35) ASTM UTM DSS: Direct datastore access | ✅ | ✅ | ✅ | ✅ | ✅ | 0:34 | |||||||||||||||
|
Skipped: OVN Request Optional Extension to ASTM F3548-21 DSS resource with ID ax_dss does not support OVN requests |
|||||||||||||||||||||
| 36) ASTM SCD DSS: Report | ✅ | 0:00 | |||||||||||||||||||
| DSS testing for ASTM F3548-21 | 37) ASTM SCD DSS: Operational Intent Explicit Subscription handling | ✅ | 0:15 | ||||||||||||||||||
| 38) ASTM SCD DSS: Implicit Subscription handling | ✅ | 0:48 | |||||||||||||||||||
| 39) ASTM SCD DSS: Operational Intent Reference Simple | ✅ | 0:08 | |||||||||||||||||||
|
Skipped: ASTM SCD DSS: Constraint Reference Simple AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 5 scopes currently declared as authorized for AuthAdapterResource: utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions, utm.availability_arbitration, interuss.flight_planning.direct_automated_test |
|||||||||||||||||||||
|
Skipped: ASTM SCD DSS: Constraint Reference Synchronization AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 5 scopes currently declared as authorized for AuthAdapterResource: utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions, utm.availability_arbitration, interuss.flight_planning.direct_automated_test |
|||||||||||||||||||||
| 40) ASTM SCD DSS: USS Availability Synchronization | ✅ | ✅ | ✅ | ✅ | ✅ | 0:04 | |||||||||||||||
| 41) ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 0:06 | ||||||||
| 42) ASTM SCD DSS: Subscription and entity deletion interaction | ✅ | ✅ | ✅ | ✅ | ✅ | 0:36 | |||||||||||||||
| 43) ASTM SCD DSS: Subscription and entity interaction | ✅ | ✅ | ✅ | ✅ | ✅ | 1:07 | |||||||||||||||
| 44) ASTM SCD DSS: Operational Intent Reference Key Validation | ✅ | 0:12 | |||||||||||||||||||
| 45) ASTM SCD DSS: Operational Intent Reference Synchronization | ✅ | ✅ | ✅ | ✅ | ✅ | 0:10 | |||||||||||||||
| 46) ASTM SCD DSS: Interfaces authentication | ✅ | 0:14 | |||||||||||||||||||
| 47) ASTM SCD DSS: Subscription Simple | ✅ | 0:14 | |||||||||||||||||||
| 48) ASTM SCD DSS: Subscription Validation | ✅ | 0:02 | |||||||||||||||||||
| 49) ASTM F3548-21 UTM DSS Operational Intent Reference Access Control | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 0:07 | ||||||||
| 50) ASTM F3548-21 UTM DSS interoperability | ✅ | ✅ | ✅ | ✅ | ✅ | 0:01 | |||||||||||||||
| 51) ASTM SCD DSS: Subscription Synchronization | ✅ | ✅ | ✅ | ✅ | ✅ | 0:46 | |||||||||||||||
| 52) ASTM UTM DSS: Direct datastore access | ✅ | ✅ | ✅ | ✅ | ✅ | 0:34 | |||||||||||||||
|
Skipped: OVN Request Optional Extension to ASTM F3548-21 DSS resource with ID cal_dss does not support OVN requests |
|||||||||||||||||||||
| 53) ASTM SCD DSS: Report | ✅ | 0:00 | |||||||||||||||||||
| DSS testing for ASTM F3548-21 | 54) ASTM SCD DSS: Operational Intent Explicit Subscription handling | ✅ | 0:16 | ||||||||||||||||||
| 55) ASTM SCD DSS: Implicit Subscription handling | ✅ | 0:51 | |||||||||||||||||||
| 56) ASTM SCD DSS: Operational Intent Reference Simple | ✅ | 0:08 | |||||||||||||||||||
|
Skipped: ASTM SCD DSS: Constraint Reference Simple AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 5 scopes currently declared as authorized for AuthAdapterResource: utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions, utm.availability_arbitration, interuss.flight_planning.direct_automated_test |
|||||||||||||||||||||
|
Skipped: ASTM SCD DSS: Constraint Reference Synchronization AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 5 scopes currently declared as authorized for AuthAdapterResource: utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions, utm.availability_arbitration, interuss.flight_planning.direct_automated_test |
|||||||||||||||||||||
| 57) ASTM SCD DSS: USS Availability Synchronization | ✅ | ✅ | ✅ | ✅ | ✅ | 0:04 | |||||||||||||||
| 58) ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 0:06 | ||||||||
| 59) ASTM SCD DSS: Subscription and entity deletion interaction | ✅ | ✅ | ✅ | ✅ | ✅ | 0:37 | |||||||||||||||
| 60) ASTM SCD DSS: Subscription and entity interaction | ✅ | ✅ | ✅ | ✅ | ✅ | 1:07 | |||||||||||||||
| 61) ASTM SCD DSS: Operational Intent Reference Key Validation | ✅ | 0:12 | |||||||||||||||||||
| 62) ASTM SCD DSS: Operational Intent Reference Synchronization | ✅ | ✅ | ✅ | ✅ | ✅ | 0:10 | |||||||||||||||
| 63) ASTM SCD DSS: Interfaces authentication | ✅ | 0:14 | |||||||||||||||||||
| 64) ASTM SCD DSS: Subscription Simple | ✅ | 0:14 | |||||||||||||||||||
| 65) ASTM SCD DSS: Subscription Validation | ✅ | 0:02 | |||||||||||||||||||
| 66) ASTM F3548-21 UTM DSS Operational Intent Reference Access Control | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 0:07 | ||||||||
| 67) ASTM F3548-21 UTM DSS interoperability | ✅ | ✅ | ✅ | ✅ | ✅ | 0:01 | |||||||||||||||
| 68) ASTM SCD DSS: Subscription Synchronization | ✅ | ✅ | ✅ | ✅ | ✅ | 0:45 | |||||||||||||||
| 69) ASTM UTM DSS: Direct datastore access | ✅ | ✅ | ✅ | ✅ | ✅ | 0:34 | |||||||||||||||
|
Skipped: OVN Request Optional Extension to ASTM F3548-21 DSS resource with ID wing_dss does not support OVN requests |
|||||||||||||||||||||
| 70) ASTM SCD DSS: Report | ✅ | 0:00 | |||||||||||||||||||
| DSS testing for ASTM F3548-21 | 71) ASTM SCD DSS: Operational Intent Explicit Subscription handling | ✅ | 0:17 | ||||||||||||||||||
| 72) ASTM SCD DSS: Implicit Subscription handling | ✅ | 0:52 | |||||||||||||||||||
| 73) ASTM SCD DSS: Operational Intent Reference Simple | ✅ | 0:09 | |||||||||||||||||||
|
Skipped: ASTM SCD DSS: Constraint Reference Simple AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 5 scopes currently declared as authorized for AuthAdapterResource: utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions, utm.availability_arbitration, interuss.flight_planning.direct_automated_test |
|||||||||||||||||||||
|
Skipped: ASTM SCD DSS: Constraint Reference Synchronization AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 5 scopes currently declared as authorized for AuthAdapterResource: utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions, utm.availability_arbitration, interuss.flight_planning.direct_automated_test |
|||||||||||||||||||||
| 74) ASTM SCD DSS: USS Availability Synchronization | ✅ | ✅ | ✅ | ✅ | ✅ | 0:04 | |||||||||||||||
| 75) ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 0:07 | ||||||||
| 76) ASTM SCD DSS: Subscription and entity deletion interaction | ✅ | ✅ | ✅ | ✅ | ✅ | 0:38 | |||||||||||||||
| 77) ASTM SCD DSS: Subscription and entity interaction | ✅ | ✅ | ✅ | ✅ | ✅ | 1:08 | |||||||||||||||
| 78) ASTM SCD DSS: Operational Intent Reference Key Validation | ✅ | 0:13 | |||||||||||||||||||
| 79) ASTM SCD DSS: Operational Intent Reference Synchronization | ✅ | ✅ | ✅ | ✅ | ✅ | 0:10 | |||||||||||||||
| 80) ASTM SCD DSS: Interfaces authentication | ✅ | 0:15 | |||||||||||||||||||
| 81) ASTM SCD DSS: Subscription Simple | ✅ | 0:14 | |||||||||||||||||||
| 82) ASTM SCD DSS: Subscription Validation | ✅ | 0:02 | |||||||||||||||||||
| 83) ASTM F3548-21 UTM DSS Operational Intent Reference Access Control | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 0:07 | ||||||||
| 84) ASTM F3548-21 UTM DSS interoperability | ✅ | ✅ | ✅ | ✅ | ✅ | 0:01 | |||||||||||||||
| 85) ASTM SCD DSS: Subscription Synchronization | ✅ | ✅ | ✅ | ✅ | ✅ | 0:45 | |||||||||||||||
| 86) ASTM UTM DSS: Direct datastore access | ✅ | ✅ | ✅ | ✅ | ✅ | 0:34 | |||||||||||||||
|
Skipped: OVN Request Optional Extension to ASTM F3548-21 DSS resource with ID zipline_dss does not support OVN requests |
|||||||||||||||||||||
| 87) ASTM SCD DSS: Report | ✅ | 0:00 | |||||||||||||||||||
| For each appropriate combination of flight planner(s) | 88) Solo happy path | 0:00 | |||||||||||||||||||
| For each appropriate combination of flight planner(s) | 89) Validation of operational intents | ✅ | ✅ | 0:03 | |||||||||||||||||
| For each appropriate combination of flight planner(s) | 90) Nominal planning: conflict with higher priority | ✅ | ✅ | 0:08 | |||||||||||||||||