This deliverable presents the Scientific Report and Prototype Description of the work carried out during the second year (Y2) of the project, within WP3, to develop the Data-Driven Infrastructure Management (DDIM) capability of the BigDataStack environment.
This is the Scientific Report and Prototype Description (Y3), reflecting the work done in the scope of the Data-Driven Infrastructure Management (DDIM) capability of the overall BigDataStack environment, including Cluster Management, Dynamic Orchestration, Realization Engine (known as ADS Ranking & Deploy in Y1 and Y2), Triple Monitoring & QoS Evaluation, and Information-Driven Networking
The Data as a Service block presents a fine set of data services which can be mapped to the major phases of Big Data processing. The architecture and the design of these data services are achieved through dedicated techniques, contextualized in the BigDataStack environment in order to run on top of the data-driven infrastructure management system and provide the required data services.
The BigDataStack project was conceived as a data centric environment, integrating approaches for Data as a Service. The data services of the environment are covered in this deliverable in terms of design specification as well as in terms of integration and experimentation outcomes (i.e. prototypes evaluations) and are naturally at the core of BigDataStack.
The BigDataStack project was conceived as a data centric environment, integrating approaches for Data as a Service (DaaS). The data services of this environment are naturally at the core of BigDataStack and are covered in this deliverable in terms of design specification as well as in terms of integration and experimentation outcomes (i.e. prototypes evaluations)
BigDataStack delivers a complete high-performant stack of technologies addressing the needs of data operations and applications. BigDataStack’s holistic solution incorporates approaches for data-focused application analysis and dimensioning, and process modelling towards increased performance, agility and efficiency. A toolkit allowing the specification of analytics tasks in a declarative way, their integration in the data path, as well as an adaptive visualization environment, realize BigDataStack’s vision of openness and extensibility.
BigDataStack delivers a complete high-performant stack of technologies addressing the needs of data operations and applications. The BigDataStack project was conceived as a data centric platform, integrating approaches for Data as a Service.