Generic configuration coverage in SETTE test reports

Context

The SETTE result comparison failed to detect a change in the run.stat output following the recent activation of the ASM functionality in the ORCA2_ICE_OBS SETTE configuration (see !192 (merged) and !193 (merged)).

Analysis

The hard-coded list of configurations included in the SETTE result comparison lacks an entry for the ORCA2_ICE_OBS configuration.

Fix

It is recommended to replace the various hard-coded lists of configurations for which sette/sette_rpt.sh and sette/sette_eval.sh report test results by one centrally defined list of all available SETTE configurations with, where required, test-specific exclusions.

To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information