by Manolis Terrovitis (ATHENA RC) and Dominik Ślęzak (University of Warsaw)
Data infrastructures are critical for efficient handling of large-scale datasets in any domain, and they are required for industrial, commercial, scientific and policy-making purposes. Robust data infrastructures ensure data security and integrity, which is essential for compliance and maintaining the trust of users and stakeholders. They allow for scalability and flexibility, which is needed to handle the constant influx of new data and changing the data processing pipelines. A well-designed data infrastructure ensures that data is properly integrated, standardised, and secure, which is crucial for accurate and reliable analysis.