Evaluation of results of digital testing
Summary
Evaluation of results of digital testing
S00184
Version: 1.11
- arable farming
- horticulture
- viticulture
- performance evaluation
- data; other (including: nothing)
- Location: remote
- Offered by: POLIMI; UNIMI
Description
One key step following the execution of digital tests is the production of reports evaluating the performance of the system under test with respect to performance metrics (previously defined, for instance, via S00178) on specific test data (previously collected, for instance, via S00183) that document the outcomes of an experimental activity performed in a digital environment. This service is dedicated to executing the operations required by the aforementioned step.
Example service: The performance of an intra-row navigation system is tested on different datasets collected in virtual simulation environments (e.g., via S00183). Different metrics (previously designed through S00178 according to the specifications provided by the customer) are used to track specific aspects of the performance of the customer’s solution The chosen metrics consider, in particular: the misplacement from the centre row line, the number of waypoints correctly visited, and the number of collisions with plant rows. Metrics are computed for different runs and trajectories across the reference data, plotted/tabulated in a detailed report, which also includes qualitative videos demonstrating the navigation trajectory followed by the system in simulation. The report also highlights the most significant deviations of the system from expected performance, and provides links between them and particular situations/events, as documented in the (simulated) sensor data that have been collected, during the execution of the tests, along with the datasets used for the performance metrics.