SCADE Vision enables automated testing of the AI-based AV perception software under test (SUT), usually a convolutional neural network (CNN). Testing consists of running the SUT inference algorithm twice against each raw input video captured from the AV sensors: the first inference is run on the baseline, unmodified frames, while the second inference is run on an augmented/modified version of the input video frames, when there are objects of interest (e.g., pedestrians, cars) detected in the scene.
The SCADE Vision engine then analyzes the SUT outputs stored in the results database using several defect analysis algorithms to identify weaknesses and fragilities in the AV perception software, including weak detections or false negatives. SCADE Vision does not require labeled data to support AV perception software testing; instead, it searches through raw sensor data recorded by the autonomous vehicles.