BigHPC

COMPETE 2020

A Management Framework for Consolidated Big Data and HPC.

The BigHPC project will provide a novel management framework, for Big Data and parallel computing workloads, that can be seamlessly integrated with existing HPC infrastructures and software stacks. The project will research, develop and integrate new monitoring, virtualization, and storage management components that can cope with the infrastructural scale and heterogeneity, as well as, the different workload requirements, while ensuring the best performance and resource usage for both applications and infrastructures.

In the project our team is doing research on a novel SDS solution that: 1) can cope with highly dynamic and heterogeneous applications and workloads; 2) is able to minimize the performance interference of different applications storing and retrieving information concurrently from shared resources; 3) is able to sustain both high-throughput and low-latency according to the requirements of each application.

Partners: Wavecom, INESC TEC, LIP, MACC, TACC, UT Austin

This work is financed by the ERDF – European Regional Development Fund through the Operational Programme for Competitiveness and Internationalisation - COMPETE 2020 Programme and by National Funds through the Portuguese funding agency, FCT - Fundação para a Ciência e a Tecnologia within project POCI-01-0247-FEDER-045924.