The project

The new data-driven industrial revolution highlights the need for big data technologies to unlock the potential in various application domains.

A new high-powered stack of technologies, BigDataStack, kicked off this January 2018.

Heading the multinational, strong consortium of 14 partners, is IBM Haifa, Israel with a focus on addressing the emerging needs of providing fully efficient and optimised cluster management for data operations and data-intensive application. The project, funded under the European Commission Horizon 2020 Work Programme, will present in 36 months, a set of prototypes demonstrating a complete, high-performing, data-centric stack of technologies.


To this end, BigDataStack delivers a complete high-performant stack of technologies addressing the emerging needs of data operations and applications. The stack is based on a frontrunner infrastructure management system that drives decisions according to data aspects thus being fully scalable, runtime adaptable and performant for big data operations and data-intensive applications.

BigDataStack promotes automation and quality and ensures that the provided data are meaningful, of value and fit-for- purpose through its Data as a Service offering that addresses the complete data path with approaches for data cleaning, modelling, semantic interoperability, and distributed storage.

BigDataStack Features

   A new, distributed architecture

   Data operations characterisation and application analysis

   Data-driven & runtime adaptable decisions

   Covers the complete data path and lifecycle

   Visualization of information for the infrastructure and data analytics results

   Availability and integration

BigDataStack introduces a pioneering technique for seamless analytics which analyses data in a holistic fashion across multiple data stores and locations, handling analytics on both data in flight and at rest. Complemented with an innovative CEP running in federated environments for real-time, cross-stream processing, predictive algorithms and process mining, BigDataStack offers a complete suite for big data analytics.

BigDataStack holistic solution incorporates approaches for data-focused application analysis and dimensioning, and process modelling towards increased performance, agility and efficiency. A toolkit allowing the specification of analytics tasks in a declarative way, their integration in the data path, as well as an adaptive visualization environment, realize BigDataStack’s vision of openness and extensibility.

Use Cases

To enable data operations and data-intensive applications to fully exploit the sustainability of BigDataStack and take full advantage of the developed technologies, the consortium has brought on board three use cases that will exhibit their applicability through:


The algorithms will optimize and help cut costs on maintenance and spare parts inventory planning and dynamic routing.


This will provide retailers with optimal insights into consumer preferences and improve the effectiveness of marketing strategies for improving consumer shopping experience.


A multi-channel scenario will facilitate data analytics-powered smart insurance, providing a 360-degree view of the customer and personalized services.