Preparation of digital test environment
Summary
Preparation of digital test environment
S00180
Version: 1.10
- arable farming
- horticulture
- viticulture
- test setup
- software; data; other (including: nothing)
- Location: remote
- Offered by: POLIMI; UNIMI
Description
To successfully conduct a digital testing campaign, preparatory activities are usually required for setting up the computational environment used for testing. This service is dedicated to the execution of such activities.
Relevant characteristics and phases for the environment to be prepared can be defined together with customers ahead of time, e.g., through Service S00176. This environment preparation phase includes, for example:
setting up the hardware resources required to run the tests
configuring and initialising the virtual environment used for testing (e.g., Docker images, private “data rooms” for safe data sharing)
installation of required software packages and dependencies
setting up authentication layers, user roles and credentials as needed
migration and/or exchange of required data and ground truth annotations
installation and configuration of a simulator
loading and configuring a previously defined simulated environment
execution of dry-runs to check that all elements of the test environment operate as required (actual execution of the tests, if needed, can be done via Service S00182)
Example service: In the context of testing the capability of a Computer Vision model to discriminate weeds from crops, a testing protocol is to be followed (e.g., pre-defined via service S00177) to benchmark the performance of different systems, on different reference datasets, with respect to a set of evaluation metrics (e.g., identified through service S00178). As a prerequisite to executing the tests in compliance with the protocol, we will configure a virtual environment that: i) hosts all data required for testing, including the ground truth annotations used for the evaluation, ii) already includes the required libraries and package dependencies for running AI models out of the box, iii) is accessible only by the customer’s designated team and by authorised personnel from our team via secure authentication.