by Noémi Friedman (Institute for Computer Science and Control (SZTAKI)) and Abdel Labbi (IBM Research – Europe)

Machine learning (ML) brings many new and innovative approaches to engineering, improving efficiency, flexibility and quality of systems. This special theme of ERCIM News focuses on ML applications in industrial engineering (see keynote by Christopher Ganz), with a focus on civil, environmental, mechanical, chemical, process, agricultural, and transportation engineering.

by Christopher Ganz (ABB Future Labs)

In recent years AI has rapidly developed across many fields, finding its way into applications where it hasn’t succeeded previously, and reaching into areas that were unthinkable even a few years ago.

AI and machine learning (ML) have found their place in industry. With machine learning showing its particular strength in areas that map an input data set to an output set or conclusions, its predominant applications are becoming those of classification or perception. Current success stories around ML applications often focus on condition monitoring: determining the current health status of an asset, based on a given set of measurements. The inclusion of data that led to a failure not only allows diagnosis of failures, but also prediction of failures, giving the operator a chance to reduce or stop production and resolve the issue.

by Hamid Asgari, Juha Kortelainen, and Mikko Tahkola (VTT)

Artificial intelligence, machine learning and artificial neural networks are introducing interesting opportunities to engineering design as well as to monitoring and operations of systems and processes. Core and enabling technologies are evolving fast, with great potential for industrial applications. Machine learning, combined with simulation, can enable models that are both fast and sufficiently accurate to be used in new applications.

by Balázs Németh and Péter Gáspár (SZTAKI Institute for Computer Science and Control)

Several advanced complex control systems can incorporate learning agents, especially in designing functions in automated vehicles. At the same time, an open problem is to find a systematic design method that is guaranteed to satisfy the performance specifications of the system. This paper presents a possible design method based on robust control theory, which has been developed in the Systems and Control Laboratory of SZTAKI.

by Dishi Liu, Daigo Maruyama and Stefan Görtz (German Aerospace Center)

Within the framework of the project “Uncertainty Management for Robust Industrial Design in Aeronautics” (UMRIDA), funded by the European Union, several machine learning-based predictive models were compared in terms of their efficiency in estimating statistics of aerodynamic performance of aerofoils. The results show that the models based on both samples and gradients achieve better accuracy than those based solely on samples at the same computational costs.

by Emir Karavelić (Univ. of Sarajevo), Hermann G. Matthies (TU Braunschweig) and Adnan Ibrahimbegovic (Univ. de Technologie de Compiègne)

Bayesian inference can be used in machine learning to provide a reduced order model for multi-scale stochastic plasticity, with parameters as random variables. Machine learning can deliver either the random variables or their probability measure.

by Truong-Vinh Hoang (RWTH-Aachen University) and Hermann G. Matthies (TU Braunschweig)

Data assimilation is a challenge in many forecasting applications ranging from weather and environmental forecasting to engineering applications such as structural health monitoring and digital twins. A common technique for data assimilation is the ensemble Kalman filter (EnKF). However, it is well-known that the EnKF does not yield consistent estimates for highly nonlinear dynamical systems. Deep learning (DL) techniques can be applied to improve the EnKF in high-dimensional and nonlinear dynamical systems. This article presents an extension of the EnKF using deep neural networks (DNNs) with a focus on the theoretical and numerical aspects.

by Gianluigi Folino,  Massimo Guarascio (ICAR-CNR), Francesco Chiaravalloti (IRPI-CNR) and  Salvatore Gabriele (IRPI-CNR)

Accurate rainfall estimates are critical for areas presenting high hydrological risks. We have devised a general machine learning framework based on a deep learning architecture, which also integrates information derived from remote sensing measurements, such as weather radars and satellites. Experimental results conducted on real data from a southern region in Italy, provided by the Department of Civil Protection (DCP), show significant improvements compared to  current state-of-the-art methods.

by João Gante, Gabriel Falcão (University of Coimbra) and Leonel Sousa (INESC-ID)

Despite being available to civilians since the 1980s, the Global Positioning System is still the standard method for positioning. While unquestionably precise enough for most uses, it requires a dedicated antenna and a significant amount of energy from mobile devices. Using 5G’s millimetre wave networks and machine learning, our work shows that we can obtain similar accuracies without these drawbacks.

by Yous van Halder and Benjamin Sanderse (CWI)

Numerically solving the Navier-Stokes equations is an important tool in a wide range of industry applications involving fluid flow, but accurately solving them is computationally expensive. Many of these numerical solutions need to be computed, and a trade-off between computational time and accuracy needs to be made. At CWI we developed a method that attains a speed-up of up to 100 times when solving these equations, based on intrusive neural networks.

by Blaž Kurent, Boštjan Brank (University of Ljubljana) and Aleksandar Pavic (University of Exeter)

As the number of tall wooden buildings increases, a good understanding of their dynamic behaviour becomes important. This calls for the collection of empirical data, namely  in-situ measured dynamic responses, to enable the calibration of finite element models, the use of surrogates, Bayesian structural identification and uncertainty quantification.

by Nan Deng (IMSIA, ENSTA Paris, IP Paris & LIMSI, UPSaclay), Luc R. Pastur (IMSIA, ENSTA Paris, IP Paris) and Bernd R. Noack (Harbin Institute of Technology)

Reduced-order modelling and system identification can help us figure out the elementary degrees of freedom and the underlying mechanisms from the high-dimensional and nonlinear dynamics of fluid flow. Machine learning has brought new opportunities to these two processes and is revolutionising traditional methods. We show a framework to obtain a sparse human-interpretable model from complex high-dimensional data using machine learning and first principles.

by Guy Y. Cornejo Maceda, François Lusseyran (LIMSI, CNRS, Université Paris-Saclay) and Bernd R. Noack (Harbin Institute of Technology)

Machine learning control is a model-free method based on artificial intelligence techniques to build optimal control laws exploiting non-linear dynamics in an unsupervised way. It is a game changer in discovering new dynamics for experiments and real-life applications.

by Henry Muccini (University of L’Aquila) and Karthik Vaidhyanathan (Gran Sasso Science Institute)

Software systems are developed following standard architecting practices but are prone to uncertainties that result in suboptimal behaviour in certain unexpected conditions. We humans learn by making mistakes, by adapting to environments, situations, and conditions. What if our software architectures could automatically learn to handle uncertainties? Just like self-driving cars, self-learnable software architectures have the potential to outperform current software in unanticipated circumstances.

by Costas Smaragdakis and Michael I. Taroudakis (University of Crete and IACM-FORTH)

The analysis of long time series of measured acoustic or seismic signals may lead to the extraction/determination of specific features that characterise the signals and the information they carry. Two scientific fields that could make extensive use of signal characterisation are acoustical oceanography, where the acoustic signal can be used as a monitoring tool of the marine environment and seismology in which the seismic signals are rich in information about the geological structure of the earth. We are developing alternative tools for signal characterisation based on a time-frequency analysis of the corresponding recordings followed by a probabilistic feature extraction driven by the hidden Markov theory, a well-known machine learning approach for describing sequential data.

by Ruslan Bernijazov (Fraunhofer IEM), Leon Özcan and Roman Dumitrescu (University of Paderborn)

Artificial Intelligence (AI) is one of the key technologies of the future and can provide substantial efficiency and productivity gains for product creation. However, manufacturing companies often lack sufficient expertise to take advantage of AI’s potential. The AI marketplace will address this challenge by creating an ecosystem for artificial intelligence in product creation.

by Vladimir Samsonov (Cybernetics Lab IMA & RWTH Aachen University), Mohamed Behery and Gerhard Lakemeyer (RWTH Aachen University)

Continually refined and adjusted methods for production planning are among the cornerstones of manufacturing excellence. Heuristics and metaheuristic methods developed to address these tasks are often hard to deploy or lead to suboptimal results under constantly changing conditions combined with short response times of modern production planning. Within the DFG-funded Cluster of Excellence “Internet of Production”, a team of researchers from RWTH Aachen University is investigating the use of novel deep learning algorithms to facilitate complex decision-making processes along the manufacturing chain.

by Vassilis Pikoulis, Christos Mavrokefalidis  (ISI, ATHENA R.C.), Georgios Keramidas (Think Silicon S.A. and Aristotle University of Thessaloniki, Greece),  Michael Birbas (University of  Patras) and Nikos Tsafas (University of  Patras) and Aris S. Lalos (ISI, ATHENA R.C.)
 
The DEEP-EVIoT project focuses on providing tools to help execute deep multimodal algorithms for scene analysis on embedded heterogeneous platforms (consisting of commercial embedded GPUs as well as dedicated hardware accelerators).

by Alkiviadis Savvopoulos, Christos Alexakos  and Athanasios Kalogeras (Industrial Systems Institute ATHENA Research Center)

Peak residential energy demand does not always coincide with peak production times. This energy imbalance is known as the “duck curve”. Variational recurrent autoencoders can normalise the duck curve, optimise consumption profile clustering, and acquire useful insights for managing energy demand.

by Enrique Garcia-Ceja, Åsmund Hugo, Brice Morin (SINTEF) and Per Olav Hansen (Unger)

Process optimisation within industry can reduce production times, as well as material and energy consumption, which translates to more efficient use of resources and money. In the chemical production industry, soft-sensing and machine learning technologies can help to optimise processes.

by Sebastian Raubitzek and Thomas Neubauer (Vienna University of Technology)

Machine learning has found its way into agricultural science for analysis and predictions, e.g., of yield or nitrogen status. Results are encouraging, but predictions in agricultural sciences are still tricky because agriculture is a highly complex system, with outcomes depending on a multitude of complex phenomena, such as weather, irrigation and soil properties. We propose future machine learning research in this sector to consider complex systems (chaos theory) and improve machine learning approaches.

by Théophile Gaudin, Oliver Schilter, Federico Zipoli and Teodoro Laino (IBM Research Europe)

In many material manufacturing processes nowadays a large amount of data is created and stored, often without utilizing them to the full potential because of their complexity. Applying state of the art deep learning techniques can be a powerful tool to extract knowledge out of them allowing to get useful insights. In this work we present autoencoder-based machine learning models to find links among composition, properties and processes applied to two prototypical industrial applications.

by Nikhil Kumar Jha, Sebastian von Enzberg and Michael Hillebrand (Fraunhofer IEM)

The use of deep learning algorithms is largely restricted to application domains where a large amount of labelled data is readily available, e.g., computer vision. Thus, applications of deep learning in autonomous systems for Industry 4.0 are rare. The application of deep learning to anomaly detection within autonomous systems for Industry 4.0 is a current research topic at Fraunhofer IEM. Our latest studies deliver some promising anomaly detection models as well as automated configuration of model hyperparameters.

by Leonardo Gutiérrez-Gómez (LIST), Alexandre Bovet and Jean-Charles Delvenne (UCLouvain)

Anomaly detection is an important problem in data mining with diverse applications in multiple domains. Anomalies, also known as outliers, can be defined as individual objects with patterns or behaviours that differ starkly from a background property. Examples of applications include fraud detection in finance, detection of faults in manufacturing, identifying fake news in social media, or web spam detection. Anomalies in real problems may lead to enormous economic, social, or political costs and are often difficult to find, mainly because they are scarce and unknown a priori. Therefore, efficient detection of anomalies may bring significant value to people, companies, and authorities.

by Péter Földesy, Imre Jánoki, Ákos Zarándy (SZTAKI and Péter Pázmány Catholic University, Budapest)

A camera and machine learning based system, developed at SZTAKI and by Péter Pázmány at Catholic University Budapest  [L1], enables continuous non-contact measurement of respiration and pulse of premature infants. It also performs high precision monitoring, immediate apnoea warnings and logging of motion activity and caring events.

by Bekir Sahin and Ahmet Soylu (NTNU)

Various global factors - including, variability in maritime regulations, technological progress, and ecological and environmental problems - have been converging, pointing to the importance of sustainability in the maritime industry. To reduce maritime accidents and the loss of life and property, sustainability needs to be factored into the design of autonomous ships. During the transition from conventional to autonomous ships, all past experience should be transferred to new systems. An anomaly detection system integrated with big data analysis, inference systems and cloud systems can become quite sensitive to maritime accidents.

by Angelica Lo Duca (IIT-CNR) and Andrea Marchetti (IIT-CNR)

The National Research Council in Pisa has been implementing a ship route prediction algorithm based on multiclass classification. The algorithm was developed within the OSIRIS project [1], which aimed to build a decision support system for maritime surveillance.

by Erwin Schoitsch (AIT Austrian Institute of Technology)

The impending highly automated and autonomous systems enabled by artificial intelligence (AI) bring with them new challenges and risks. Placing too much trust in, or misusing, machines that make decisions is risky, and the legalities are complex in terms of liability and responsibility. Autonomous systems can be grouped into three broad categories: technical systems that make decisions in “no win” hazardous situations (vehicles in traffic, collaborating robots); decision support systems in governance applications (administration, government, court, staff acquisition, etc.), which may lead to unfair decisions for humans and society; and systems that are open to deliberate misuse by providing information that can’t be proven to be true or fake, potentially influencing elections, public opinion or legal processes to an extent unknown before. These risks cannot be easily countered by conventional methods. We give an overview of the potential and risks afforded by this technology.

by Christoph Klikovits (Forschung Burgenland), Elke Szalai and Markus Tauber (FH Burgenland)

Digitisation is leading to the increased use of cyber-physical systems (CPS). A citizen participation and disaster management platform uses IoT components like sensors, which collect information about critical events in disaster scenarios. In this situation it is critical that all stakeholders can be assured of trustworthy information. We are researching an approach that takes ethical considerations into account during the development process, resulting in a secure, trustworthy framework.

by Sónia Teixeira, João Gama, Pedro Amorim and Gonçalo Figueira (University of Porto and INESC TEC, Portugal)

Algorithmic systems based on artificial intelligence (AI) increasingly play a role in decision-making processes, both in government and industry. These systems are used in areas such as retail, finances, and manufacturing. In the latter domain, the main priority is that the solutions are interpretable, as this characteristic correlates to the adoption rate of users (e.g., schedulers). However, more recently, these systems have been applied in areas of public interest, such as education, health, public administration, and criminal justice. The adoption of these systems in this domain, in particular the data-driven decision models, has raised questions about the risks associated with this technology, from which ethical problems may emerge. We analyse two important characteristics, interpretability and trustability, of AI-based systems in the industrial and public domains, respectively.

 by Martina Mara (Johannes Kepler University Linz)

As close collaborations between humans and robots increase, the latter must be programmed to be reliable, predictable and thus trustworthy for people. To make this a reality, interdisciplinary research and development is needed. The Austrian project CoBot Studio is a research initiative in which experts from different fields work together towards the common goal of human-centred collaborative robots.

by Nicolas Müller (Fraunhofer AISEC)

Machine learning based audio synthesis has made significant progress in recent years. Current techniques make it possible to clone any voice with deceptive authenticity, based on just a few seconds of reference recording. However, is this new technique more of a curse than a blessing? Its use in medicine (restoring the voice of the mute), in grief counselling or in the film and video game industry contrasts with its enormous potential for misuse (deep fakes). How can our society deal with a technology that has the potential to erode trust in (audio) media?

by Anna Leida Mölder (NTNU)

What is it that motivates researchers to advance knowledge in a particular field? What is it that makes an engineer develop a tool for one specific purpose, but not another? And how do these choices of today affect the future?

by Nena Basina, Theodore Patkos, Dimitris Plexousakis (FORTH-ICS)

Reasoning about actions, change and causality constitutes an important field of research in artificial intelligence. A visual representation of the main concepts involved while encoding logic programs can help knowledge engineers better understand the semantics. The ECAVI modelling tool aims to acquaint inexperienced modellers with the main features of common sense reasoning, guiding them during the process, through a meta-modelling platform and with the help of a state-of-the-art reasoner.

by Maarten Groen (Amsterdam University of Applied Sciences) and Nanda Piersma (Amsterdam University of Applied Sciences, CWI)

City authorities want to know how to match the charging infrastructures for electric vehicles with the demand. Using camera recognition algorithms from artificial intelligence we investigated the behavior of taxis at a charging stations and a taxi stand.

by Albert Treytl, Edith Huber, Thilo Sauter (Danube University Krems) and Peter Kieseberg (St. Pölten University of Applied Sciences)

Home automation systems (HAS) can be important attack vectors, yet research on securing sensors is sparse, especially with respect to the analogous side of these components, i.e., detecting manipulations of the sensors themselves. Metadata together with the combination of several sensor nodes can be used to thwart such manipulation attacks.

Schloss Dagstuhl – Leibniz-Zentrum für Informatik is accepting proposals for scientific seminars/workshops in all areas of computer science, in particular also in connection with other fields.