2024 AutoTest Technical Conference

The SOTIF-standard (ISO 21448) established scenario-based testing as state-of-the-art for verifying and validating Advanced Driver Assistance Systems (ADAS) and Automated Driving Systems (ADS). However, the SOTIF standard lacks details for practically selecting scenarios which are used as test cases. Consequently, missing details of SOTIF do not enable its practical application. In this paper, we systematically identify and analyze existing scenario generation techniques, we discuss whether they are capable of implementing the SOTIF standard. Subsequently, we leverage variability modeling techniques to address two essential challenges that remain open: How to model an overall scenario space and how to practically cover it? We elaborate sampling strategies and coverage criteria that are relevant for generating SOTIF-compliant scenario suites. Finally, we compare generated scenario suites, using mutation testing. We assess each scenario suite with a mutation score that indicates the ability to detect potential failures.