Human-machine interaction in MANTIS project

Proactive, collaborative and context-aware HMI

One of the objectives of the MANTIS project is to design and develop the human-machine interface (HMI) to deal with the intelligent optimisation of the production processes through the monitoring and management of its components. MANTIS HMI should allow intelligent, context-aware human-machine interaction by providing the right information, in the right modality and in the best way for users when needed. To achieve this goal, the user interface should be highly personalised and adapted to each specific user or user role. Since MANTIS comprises eleven distinct use cases, the design of such HMI presents a great challenge. Any unification of the HMI design may impose the constraints that could result in the HMI with a poor usability.

Our approach, therefore, focuses on the requirements that are common to most of the use cases and are specific for proactive and collaborative maintenance. A generic MANTIS HMI was specified to the extent that does not introduce any constraints for the use cases, but at the same time describes the most important features of the MANTIS HMI that should be considered when designing the HMI in individual use cases.

MANTIS HMI specifications are the result of refinement of usage scenarios provided by the industrial partners, taking the general requirements of MANTIS platform into account. Functional specifications describe the HMI functionalities, present in most use cases and abstracted from the specific situation of every single use case.

We describe a generic static model that can be used together with the requirement specifications of each individual use case to formalize the structure of the target HMI implementation. The model has been conceived, in particular, with two ideas in mind: (i) to provide means that would help to identify the HMI content elements and their relationships of a given use case and (ii) to unify (as much as possible) the HMI structure of different use cases, which is useful for comparison of implementations and exchange of good practices. When setting up the model structure we follow the concepts of descriptive models applied in task analysis and add specifics of MANTIS, denoted as MANTIS high-level tasks. For each of these high-level tasks, we provided a list of functionalities supporting them.

MANTIS human-machine interaction comprises five main aspects:

  • User interfaces;
  • Users;
  • MANTIS platform;
  • Production assets; and
  • Environment.

Through their user interfaces, several different users within the use case communicate with MANTIS platform, which in term communicates with production assets. Interaction can take place in both directions. Users can not only access the information, retrieved from production assets and stored on the platform but provide an input to the MANTIS system as well. They can initiate an operation which is then carried out by the platform, such as rescheduling maintenance task, or respond to a system triggered operation, for example, alarms. On the other hand, through the MANTIS platform, users can also communicate among themselves. In addition to the straightforward communication in terms of the textual or video chat functions, the users can also communicate via established workflows.

The last but not least main part of the interaction is also the environment. Although it can be treated neither as a direct link between the user and the system nor as a part of communication among the users, the environment can influence the human-machine interaction through the context-aware functionalities.

From the users’ point of view, the human-machine interaction within the MANTIS system supports five main high-level user tasks associated with proactive and collaborative maintenance:

  • Monitoring production assets;
  • Data analysis;
  • Maintenance tasks scheduling;
  • Reporting; and
  • Communication.

While monitoring production assets, data analysis and maintenance task scheduling are vital for proactive maintenance, reporting and communication enable collaboration among different user roles. Each of these tasks is carried out by a number of MANTIS specific functionalities that can be classified as user input, system output, user- or system- triggered operation. These functionalities should cover all the main aspects of MANTIS human-machine interaction and should also be general enough to be applicable to any MANTIS as well as potential future use case.

MANTIS HMI demonstrator

At the MANTIS meeting in Helsinki, the first version of the web based HMI demonstrator, developed in with Angular Dashboard Framework and other Javascript libraries by XLAB, was presented to the MANTIS consortium. Currently it is connected to the MIMOSA database and is demonstrating live data from the FORTUM use case. The HMI is designed as a customizable, user-dependent, responsive multi-widget dashboard, comprising basic read-only widgets, such as graphs and tables. The features of the demonstrator follow the HMI functional specifications and it is designed in the way that can be applied to any use case with MIMOSA database.

The first version of the web-based HMI demonstrator
The first version of the web-based HMI demonstrator

In the near future, many other features will be implemented, including more widget types, dashboard navigation, search function and sharing of data views. Some context-aware features, such as hidden widgets that appear when needed and suggestions of further user actions based on the usage history, will be implemented as well. In addition, general visual design recommendations such as colours, fonts and widgets positioning, described earlier in the project, will be applied.

Helsinki Consortium Meeting in May 2017, and the Conventional Energy Production Use-Case

The second (sixth overall) full consortium meeting of 2017 was held between 8th and 10th of May. This time it was hosted by VTT at their new Center for Nuclear Safety located in Espoo, Finland. The three day event gathered 65 participants from all of the participating countries. The program was more technologically oriented and contained a long open space session, where partners could present their work within the project. The tight program allowed some time to enjoy the wonderful Finnish spring weather.

The wonderful Finnish spring
The wonderful Finnish spring

Finnish use-case was prominently on display at the Open Space session at the MANTIS consortium meeting. The floor in the first open space room was dedicated to the Finnish use case. Presented were Nome, Wapice, Fortum, VTT and Lapland University of Applied Sciences (UAS). Each partner presented their work done in the Finnish use case. Wapice and Fortum presented their HMIs (IoT Ticket and TOPi respectively). Nome and VTT presented their measurement systems (NMAS and the affordable sensor research respectively) and finally Lapland UAS provided the database and REST interface that allows each partner to share and access data beyond organizational boundaries. The second room had most use cases represented. Of note was XLABs common MANTIS user interface demo that can be connected to the Finnish use case platform.

Open space session at Helsinki Consortium meeting
Open space session at Helsinki Consortium meeting

The Finnish use case is centered on a flue gas recirculation blower located in Fortum’s Järvenpää power plant. The blower is classified as a critical component in the energy production process and is monitored closely. In this use case Wapice, Nome and VTT have all provided their own sensors or virtual sensors to monitor the performance and condition of the blower. In addition, Lapland UAS has a few Wzzard sensors, made by B+B Electronics/Advantech, provide some additional measurement data bulk. However these are not related to the Järvenpää case. This measurement data is stored, using the REST interface developed by Lapland UAS, in the MANTIS database that is based on the MIMOSA data model.

Flue gas recirculation blower in Fortum’s TOPi Proview browser
Flue gas recirculation blower in Fortum’s TOPi Proview browser

The REST interface and MIMOSA database mapper provides a simple an interface, which is both easy to use and to integrate, between different applications and systems. It provides basic CRUD –functionalities and contains a mapper that maps measurement system specific data formats and structures into MIMOSA compliant data structures to ensure interoperability and compatibility with the MIMOSA data model. It is widely in use in the Finnish use case and research partners from both Slovenia and Hungary have shown interest towards utilizing MIMOSA in their use case.

A diagram of the Finnish use case
A diagram of the Finnish use case

SmartG presentation in Hannover Messe

Goizper and IK4-TEKNIKER will be present at the Hannover Messe from 24 to 28 April 2017‎ presenting Smart G, a data acquisition module for clutch-brake monitoring.

Clutch-brake systems produced by Goizper are key components in cutting, forming, folding and press machines.

The aim of this presentation is to show how incorporation of the Smart G module can convert a clutch-brake system into a monitorable smart component, which includes self-diagnostics capabilities that can provide information about the current state of the component and predict failures before they occur.

Communications modules incorporated in the Smart G component provides capabilities to:

  • Remotely monitor the component
  • Send the data to a cloud platform where all historic data are stored.

Having the data of Goizper’s clutch-brakes fleet on a cloud platform will provide the possibility to use more advanced techniques and algorithms in order to predict failures and/or remaining useful life of key components of the system.

Benefits are two-fold: Goizper will drastically improve the knowledge about their equipment to improve reliability of their products and the maintenance services provided to customers, while customers will benefit from a reduced downtime of the machines and more cost-effective maintenance strategy.

Goizper and Tekniker’s work on failure prediction and diagnosis, as well as cloud platform development, have received funding from the European Union under the MANTIS project.


Smart G concept block diagram
Figure 1. Smart G concept block diagram.


Figure 2. General status of the machine.




Figures 3 and 4. Braking and Clutching processes performance

Figure 5. Active alarms and alarms history


Figure 6. Product pictures

Classifying tool images to enhance predictive maintenance


Philips Consumer Lifestyle (PCL) is an advanced manufacturing site located in Drachten, the Netherlands. Our organization falls within the Personal Heath business cluster of Philips, and is primarily concerned with the manufacturing of personal electric shavers.

Electric shavers are comprised of two principle component ‘blocks’: a body and a shaving unit. Each shaving unit contains three metallic shaving ‘heads’, which in turn are composed of a shaving blade (the cutting element) and shaver cap (the guard). The focus of the MANTIS project at PCL falls on the production of these shaver caps.

Philips Shaver and components
Philips Shaver and components

An electro-chemical process is used in the manufacturing of shaver caps, where an electric current is passed over the raw input material, which is conductive, in order to cut this material into the desired shape. Production of the shaver caps at PCL is fully automated.

Production Line
Production Line

Precision tooling is required throughout the various stages of shaver cap manufacturing. At present, these tools are built on-site, and are required to be kept in stock so that replacements are available in the event of tooling malfunctions. Having functional tools available around the clock is essential to meet our goal of 100% ‘up-time’ for our assembly lines. However, this is an expensive approach to resolve the problem, both in terms of the additional equipment required and extensive down-time that results from manual tooling replacements. Therefore, the timely maintenance of these tools presents a challenge.

Tool maintenance

Currently the maintenance strategy on the production line for shaver caps is a mixture of reactive and preventive maintenance. In line with the Mantis goal, our goal is to transform this towards a predictive or even a prescriptive maintenance strategy. However, this comes with the need for data. In order to perform maintenance on the tooling at exactly the right moment needed, information is necessary about the tooling to make useful decisions.

The data directly related to the current state of tooling (e.g. degree of wear, damages, etc.) is hard to retrieve in some cases, due to process-specific reasons. In our use case the tooling is delicate and very precise (micron range, difficult geometries), which makes frequent measurements of the tooling difficult and expensive in a mass production environment. Currently, there is only indirect data available about the use of the tools in the production machines, but not about the actual state of the tool itself. These data can be used to estimate, for example, the remaining useful life of a tool, but in order to improve and verify the RUL prediction models, more direct data is necessary.

Tool wear sensor

To solve this matter, a collaboration between the University of Groningen and Philips Consumer Lifestyle has been started in context of the Mantis consortium, with the goal to develop a tool wear sensor based on an optical image system.  A robust setup with a high-resolution sensor will make detailed images of the individual tools.

Tool images and labelling system
Tool images and labelling system

The raw images are preprocessed, where the parts of interest of the tool will be cut out of the image and rotated to form the input for a machine learning algorithm. Next step would be to normalize the pictures so they are more or less comparable.

Since we have no baseline, we asked our maintenance engineers (they are the domain experts) to label all these individual images. Together we choose three specific labels: wear, damage and contamination. The input of the maintenance engineers is used to train the algorithm, but also to assess how well these individual pictures are labelled similar when considering multiple engineers.

Currently, over 1500 pictures are labelled in about a month. Initial results seem to indicate that simple machine learning can outperform human labeling regarding tooling deviations.

If results are good, the trained algorithm will ultimately be used with an automatic calculation engine to run new images through the algorithm. This means that we also have to change the way of work, and provide the maintenance engineers with easy-to-use tools to make these new images, as part of their regular maintenance steps. The outcome of the analysis forms an input for determining the remaining useful life of the tool, in combination with both process and quality data.

Technical workshops of the MANTIS project in Madrid

Nearly 70 participants were able to attend to the three-day MANTIS meeting organized by ACCIONA Construcción S.A. in their premises in Madrid, Spain from the 18th to 20th of January 2017.

The agenda of the meeting was designed keeping in mind the idea of having less informative sessions but more interactive ones to really get fruitful discussions and making decisions for further steps.

Technical workshops of the MANTIS project in Madrid
Technical workshops of the MANTIS project in Madrid

The meeting started with a session chaired by the Project Coordinator to let everybody get a precise idea about the status of the project. Then, most of all the use cases presented the last developments, focusing in the data availability and analytics to be used. Following this session, the Open Space took place where several posters were shown and discussed in small groups. In the afternoon, the first parallels sessions started, covering WP3 and WP5.

The second day was very intense. At the beginning, WP3 and WP5 finalized the discussions that started the day before. Then, it was the turn of WP2 and WP4. Regarding the latter, it is worth to say that there were several sessions aiming very specific technical aspects. In the evening, a joint dinner was organized in a very famous place in Madrid, where an impressive flamenco show was performed.

Technical workshops of the MANTIS project in Madrid
Technical workshops of the MANTIS project in Madrid

On the last day of the meeting, before the conclusion and wrap-up session, WP2 members kept discussing while WP8 session was running in parallel. Finally, the EB meeting took place.

PVTECH publishes 3E’s article on data mining for automatic fault detection and diagnosis from photovoltaic monitoring data

The continuous and systematic analysis of performance data from the monitoring of operational PV power plants is vital to improving the management and thus profitability of those plants over their lifetime. The article draws on an extensive programme undertaken by 3E to assess the performance of a portfolio of European PV power plants it monitors. The article illustrates 3E’s approach to automatic fault detection. It will explore the various data mining methodologies used to gain an accurate understanding of the performance of large-scale PV systems and how that intelligence can be put to the best use for the optimal management of solar assets.

3E’s work on automatic fault detection and diagnosis has received funding from the European Union under the MANTIS project.

Please click here to read the full article.

Modern Internet of Things technologies in industrial condition monitoring


Wapice is a Finnish company specialized in providing software and hardware solutions for industrial companies for wide variety of purposes. We have developed remote management and condition monitoring solutions since beginning and our knowledge of this business domain has evolved into our own Internet of Things platform called IoT-Ticket. Today IoT-Ticket is a complete industrial IoT suite that includes everything required from acquiring the data to visualizing and analyzing the asset lifetime critical information.

Why condition monitoring

In predictive maintenance the goal is to prevent unexpected equipment failures by scheduling maintenance actions optimally. When successful, it is possible to reduce unplanned stops in equipment operational usage and save money through higher utilization rate, extended equipment lifetime and personnel and spare part costs. Succeeding in this task requires deep understanding of the asset behaviour, statistical information of the equipment usage and knowledge about the wear models combined with measurements that reveal the equipment current state of health. Earlier these measurements were carried out periodically by trained experts with special equipment, but now the modern IoT technologies are making it possible to gather real time information about the field devices all the time (i.e. condition monitoring). While this increases the availability of data, it creates another challenge: How to process massive amounts of data so that right information is found in the right time. In condition monitoring process the gathered data should optimally be processed so that amount of data transferred towards the uplink decreases while the understanding of the data increases.

Correct architecture leads to process, where only relevant information is traversing uplink in condition monitoring chain
Correct architecture leads to process, where only relevant information is traversing uplink in condition monitoring chain

This article describes how modern IoT technologies help in condition monitoring related processes and how data aggregation solutions makes it possible to share condition monitoring related information between different vendors. This further improves operational efficiency by enabling real time condition monitoring not only in asset level but also in plant or fleet level, where service operators must understand the behaviour and available lifetime of assets coming from different manufacturers.

WRM247+ data collector for edge analysis

The first link in the condition monitoring chain is the hardware and sensors. In order to measure the physical phenomena behind the wear of the asset a set of sensors is required to sample and capture the data from monitored devices. This data must be buffered locally, pre-processed and finally only the crucial information must be transferred to the server, where the physical phenomena can be identified from the signals. Depending on application area a different types and models of sensors are required to capture just the relevant information. Also depending on the physical phenomena a different kind of analysis methods are required. Due to these reasons the various measurement systems have so far been custom tailored according to the target. This approach of course works, but designing custom tailored measurement systems is time consuming and expensive. Our approach to overcome these problems has been to implement such IoT building blocks that adapt into wide variety of purposes and can be easily and flexibly taken into use. One of the cornerstones in our system is the flexibility and user friendliness.

In the hardware side our IoT platform offers several approaches. WRM247+ measurement and communication device is our hardware reference design that allows connecting a wide variety of industrial sensors using either wired or wireless communication methods and also provides local buffering and pre-processing of data as well as communication to the server. Examples of supported standard protocols are CAN, CANOpen, Modbus, ModbusTCP, 1-Wire and digital/analog IOs. This device is an excellent starting point for most common industrial measurement purposes.

WRM247+ Measurement and communication gateway
WRM247+ Measurement and communication gateway

In Mantis project Wapice has been investigating the interoperability of the wireless and wired sensors. In use case 3.3. Conventional Energy Production we will demonstrate the fusion of the wireless Bluetooth Low Energy technology and wired high accuracy vibration measurements. In order to achieve this we have built a support for connecting IEPE standard vibration sensors to the WRM247+ device. The device supports any industrial IEPE standard sensor, which makes it possible to select a suitable sensor according to the application area. Additionally we have also built a support for connecting a network of BLE sensors to the device. In use case the purpose of this arrangement is to gather temperature information around the flue-gas circulation blower using the wireless BLE sensors and perform vibration measurements from the rolling bearing. The temperature measurements reveal possible problems e.g. in lubrication of the bearing and possibly allow actions to be taken before a catastrophic failure happens.

In case WRM247+ device is not suitable for purpose, it is possible to integrate custom devices easily into IoT-Ticket using the REST API available. For this purpose we provide full documentation and free developer libraries for several programming languages. The list of available libraries includes for example C/C++, Python, Qt, Java and C#. Other integration methods include for example OPC or OPC UA and Libelium sensor platform, that supports e.g. wireless LoRa sensors. In addition Wapice has a long experience in designing machine-to-machine (M2M) solutions including PCB layout, embedded software design and protocol implementation, so we also offer you the possibility to get tailored Internet of Things hardware or embedded software that fully suit your needs.


Figure describes the interface options in IoT-Ticket architecture
Figure describes the interface options in IoT-Ticket architecture


Iot-Ticket portal for Back-End tools

In the back-end side IoT-Ticket provides all necessary tools for visualizing and analyzing data. Our tools are web based and require no installation: Simply login, create and explore!

The Dashboard allows users to interact securely with remote devices, check their status, view reports or get status updates on the current operational performance. It can be utilized in various scenarios – e.g. vehicle tracking, real time plant or machinery monitoring and control. As many Dashboard Pages are available the user can switch between different contexts and drill into information starting from enterprise level to sites, assets and data nodes. The Dashboard also includes two powerful tools for content creation: Interface Designer and Dataflow Editor.

Using the Interface Designer user can raw new elements or add images, gauges, charts, tables, Sankey diagrams, buttons and many other elements onto the Dashboard. Those elements can then be easily connected to data by dragging and dropping Data Tags onto them.

The Dataflow editor is an IEC 61131-3 inspired, web-based, graphical block programming editor that seamlessly integrates to the Interface Designer. A user can design the dataflow by connecting function blocks to implement complex logic operations which then can be used to execute control actions or routed to user interface elements for monitoring purposes.

In Use Case 3.3. Conventional Energy Production Wapice – together with Finnish partners – demonstrates Cloud-to-Cloud integration in Mantis platform using the IoT-Ticket platform tools. In this use case LapinAMK and VTT have jointly setup a Microsoft Azure based MIMOSA data aggregation database. The plan is to share condition monitoring related KPI information through MIMOSA database, which allows sharing data through REST API. Devices may either push data directly to MIMOSA or through local clouds.

Data sharing and aggregation in Mantis platform using Mimosa aggregation database
Data sharing and aggregation in Mantis platform using Mimosa aggregation database


IoT-Ticket allows communication to REST sources using Interface Designer graphical flow programming tools. Getting data from REST sources is done by simply creating a background server flow that contains a trigger and REST block. The REST block is configured with username and password that allow authentication to REST source, source URL and REST method that contains XML/JSON payload. From the REST response the data value is parsed and output to data charts or forwarded to further processing. Additionally virtual data tags allow forwarding the data into IoT-Ticket system. By configuring the flow to be run in server mode, the flow is run silently in background all the time. The operation interval is configured using the timer block, which fires the REST block in certain intervals. An example video below shows how Cloud-to-Cloud communication between MIMOSA and IoT-Ticket is established in Use Case 3.3. In this example video sinusoidal test data originates from LapinAMK enterprise and tachometer RPM reading from system under test using WRM247+ device.

The reporting and analytics tools add on to the platform features. The report editor integrates seamlessly into the Dashboard and offers a user the possibility to create or modify content. The user can draw new elements or add image, gauges, charts, tables, Sankey diagrams, buttons and many other elements onto the report. Those elements can then be easily connected to data by dragging and dropping Data Tags onto them. Analytics tool is also integrated to the Dashboard and supports you in understanding your data better.

Benefits of IoT in condition monitoring

Typically condition monitoring related data has been scattered around in separate information systems and it has been very hard or even impossible to create a single view of the all relevant data or correlate between information scattered in different databases. MIMOSA is an information exchange standard that allows classifying and sharing condition monitoring related data between enterprise systems. It answers the data sharing problematics by allowing aggregation of crucial information into single location in a uniform and understandable format. When interfaced with modern REST based information sharing technologies that utilize for example JSON or XML based messaging it is surprisingly easy to collect and share crucial information using single aggregation database. When accompanied with modern web based Industrial IoT tools it is then easy to visualize data, create reports or perform further analysis using only the crucial information available.

In this blog posting I have highlighted some examples how Industrial IoT building blocks help you to gather relevant condition monitoring information, create integrations between data sources and aggregate business relevant information into single location. Focusing on the crucial information allows you to understand better your assets and predict the maintenance needs. This is needed, when optimizing the value of your business!

See more examples in our web pages ( or YouTube channel



MANTIS for Compressor maintenance

With SMARTLINK monitoring program, Atlas Copco makes use of connectivity data and data intelligence to help customer to keep up their production uptime and to improve, when possible, energy efficiency.

With approximately 100,000 machines connected with SMARTLINK, Atlas Copco makes compressors in the field communicate directly with the back office and their service technicians.

Atlas Copco’s SMARTLINK technology allows for remote monitoring of compressors in the fields.
Atlas Copco’s SMARTLINK technology allows for remote monitoring of compressors in the fields.

Customers become more proactive, planning is more efficient and reliability of the compressed air installations is better than ever before.

Customers of SMARTLINK get a monthly overview of machine information, including running hours and the time left before service, thus allowing them to order a service visit at the right time, maintaining maximum uptime and energy efficiency.

With SMARTLINK they can closely follow up on machine warnings via email or SMS. With this information they can take the necessary actions to prevent a breakdown.

With the MANTIS project, Atlas Copco will take proactive maintenance to the next level, by:

  • predicting the remaining useful life of consumables and components that are subject to wear
  • detecting upcoming problems or inefficiencies before they deteriorate
  • remotely diagnosing the root cause of an unplanned shutdown
During the MANTIS project, Atlas Copco will take proactive maintenance to the next level by predicting component lifetime, by detecting anomaly and by perform remote diagnosis of the compressed air installation.
During the MANTIS project, Atlas Copco will take proactive maintenance to the next level by predicting component lifetime, by detecting anomaly and by perform remote diagnosis of the compressed air installation.

Moreover, in order to reduce communication costs, smart sensing technology is being investigated, or how local preprocessing of information can significantly reduce the amount of data to be transmitted.

A major challenge for Atlas Copco is the huge variety of compressor types and operating conditions. To process this enormous amount of information, self-learning techniques are combined with physics-based compressor models. Eventually, these will enable the discovery of new patterns in data, collected on a worldwide scale.

The ultimate goal is to translate these data into actionable information for the global service network.

Service interventions will be planned even better and will be shorter and more efficient. Problems will be fixed in one visit, as technicians will know in advance what to do and what parts to bring.

The results of the project will allow better service planning, shorter visits and first time fix, thus reducing downtime for the end customers and ensuring sustainable productivity
The results of the project will allow better service planning, shorter visits and first time fix, thus reducing downtime for the end customers and ensuring sustainable productivity

For the customer, this means no unnecessary maintenance, less planned or unplanned downtime, therefore achieving maximum productivity.

Analyzing maintenance log data to predict system failures

Cyber-Physical Systems (CPS) are often very complex and require a tight interaction between hardware and software. As it happens in almost any software systems, also CPS  generate different kinds of logs of the activities performed, including correct operations, warnings, errors, etc. Frequently, the logs generated are specific to the different subsystems and are generated independently. Such logs contains a wealth of information that needs to be extracted and that can be analyzed in different ways to understand how the single subsystem behaves and even retrieve information about the behavior of the overall system. In particular, considering the generated logs, it is possible to:

  1. Analyze the behavior of a single subsystem looking at the data generated by each one in an independent way;
  2. Analyze the overall behavior of the system looking at the correlations among the data generated by the different subsystems

Such data are very useful to understand the behavior of a system and are often used to perform post-mortem analysis when some failures happen. However, such data could also be used to understand in a more comprehensive way how the system behaves through a real-time analysis able to monitor continuously the different subsystems and their interactions. In particular, it is possible to focus on preventing failures through predictive maintenance triggered by specific analysis.

Making predictions about system failures analyzing log files is possible but such predictions are strictly related to some characteristics of such files. In particular, some very important characteristics are: data generation frequency, information details, history.

The data generation frequency needs to be related to the prediction time and the time required to take proper actions. For example, if we need to detect a failure and take proper action in a few minutes, we need to use data generated with a higher frequency (e.g., in the scale of the seconds) and we cannot use data generated with a lower one (e.g., in the scale of the hours). This requirement affects the ability to make predictions and their usefulness to implement proper maintenance actions.

The information details provided need to include proper granularity and meaningful massages. In particular, it is important to get detailed information about errors, warnings, operations performed, status of the system, etc. The specific details required are tightly connected to the specific predictions that are needed. Moreover, the finer the granularity of the information, the higher are the chances of being able to create a proper prediction model.

High quality data history is required to build proper prediction models. However, just having a large dataset is not enough. Historical data need to be representative of the operating environment and include all the possible cases that may happen during  operations. In particular, it is required to have information about the log entries and the actual behavior of the system to create a reliable model of the reality.

The requirements described are just a first step towards the definition of a proper predictive maintenance model but they are essential. Moreover, the proper approaches and algorithms need to be selected based on the specific system and the related operating conditions.

Reference Architecture of the Portuguese Mantis Pilot


The MANTIS Steel Bending Machine pilot aims at providing the use case owner – ADIRA – a worldwide remote maintenance service to its customers. The main goal is to improve its services by making available new maintenance capabilities with reduced costs, reduce response time, avoiding rework and allowing for better maintenance activities planning.

To this purpose existing ADIRA’s machines (starting with their high end machine model – the Greenbender) will be augmented with extra sensors, which together with information collected from existing sensors will be sent to the cloud to be analyzed. Results made available by the analysis process will be presented to machine operators or maintainers through a HMI interface.

adira greenbender gb-22040 MANTIS
Adira –  Greenbender GB-22040

A number of partners are involved into the development and testing of the modules, which regard the communication middleware (ISEP, UNINOVA), data  processing  and  analytics activities (INESCISEP), the HMI applications (ISEP), and a stakeholder providing a machine to be enhanced with the MANTIS innovations (ADIRA).

System Architecture

The distributed system being built responds to a reference architecture that is composed by a number of modules, the latter grouped into 4 logical blocks: the Machine under analysis, Data Analysis module, Visualization module, and the Middleware supporting inter-module communications.

architechture of the maintenance system for MANTIS
architecture of the maintenance system for MANTIS


Data regarding the machine under analysis are collected by means of sensors, which integrate with the machine itself. This logical block consists thus of data sources that will be used for failure detection, prognosis and diagnosis. This set of data sources comprises an ERP (Enterprise Resource Planning) system, data generated by the machine’s Computer Numerical Controller (CNC) and the safety programmable logical controller (PLC).


This logical block operates through two basic modules. The first is the MANTIS Embedded PC, which is basically an application that can run on a low cost computer (like a Raspeberry Pi) or directly on the CNC (if powerful enough). This module is responsible for collecting the data from the CNC I/O and transmitting it to the Data Analysis engine for processing and is implemented as a communication API. When based on an external computer, this module also connects to the new wireless MANTIS sensors placed on the machine using Bluetooth Low Energy protocol (BLE). Communications are then supported by the RabbitMQ message oriented middleware, which takes care of proper routing of messages between peers. This middleware handles both AMQP and MQTT protocols to communicate between nodes.

The I/O module is used in order to extract raw information from the machine sensors which is collected by the existing PLC, made available on the Windows-based numerical controller through shared memory and then written to files. Our software collects sensor data from these files, thus completely isolating the MANTIS applications from the numerical controller’s application and from the PLC.

Data Analysis

This logical block takes care of Data Analysis and Prediction, and it exploits three main modules. The first is a set of prediction models used for the detection, prognosis and diagnosis of the machine failures. The second is an API that allows clients to request predictions from the models, and that can respond to different paradigms such as REST or message-queue based. Finally, the third module is a basic ETL subsystem (Extraction, Transformation and Loading) that is responsible for acquiring, preparing and recording the data that will be used for model generation, selection and testing. This last module is also used to process the analytics request data as the same model generation transformations are also required for prediction.


This logical block consists of two modules, the human machine interface (HMI) and the Intelligent Maintenance DSS. The HMI is designed to be a web-based mobile application, and to be accessed via the network from any computer or tablet. The HMI is developed to work in two different modes, depending on which kind of user is accessing it. In fact, the HMI is developed to support two user types, the data analyst and the maintenance manager, allowing both of them to analyze the machine’s status, record failure and diagnostics related data. Moreover, the data analysis HMI provides an interface with the data analyst, allowing the consultation and analysis of data and results. On the other hand, the maintenance management HMI allows for consulting predicted events and suggested maintenance actions.

The second module is an Intelligent Maintenance DSS, which uses a Knowledge Base that uses diagnosis, prediction models and the data sent by sensors. On top of this Knowledge Base there is a Rule based Reasoning Engine that includes all the rules that are necessary to deduce new knowledge that helps the maintenance crew to diagnose failures.

Ongoing work

The work performed so far is well advanced and an integration event will occur in the near future where the interconnection between all systems will be tested and validated.

The demonstrator being built, will be evaluated according to the following criteria: prediction model performance (live data sets will be compared to model generation test   sets) and the applications usability (the user should access the required information easily, in order to facilitate failure detection and diagnosis).