PROCESS (2017-2020)

PROCESS - PROviding Computing solutions for ExaScale ChallengeS

Duration: From 01.11.2017 to 31.10.2020
Topic: EINFRA-21-2017 Platform-driven e-infrastructure innovation

The PROCESS demonstrators will pave the way towards exascale data services that will accelerate innovation and maximise the benefits of these emerging data solutions. The main tangible outputs of PROCESS are five very large data service prototypes, implemented using a mature, modular, generalizable open source solution for user friendly exascale data. The services will be thoroughly validated in real-world settings, both in scientific research and in industry pilot deployments. To achieve these ambitious objectives, the project consortium brings together the key players in the new data-driven ecosystem: top-level HPC and big data centres, communities – such as Square Kilometre Array (SKA) project – with unique data challenges that the current solutions are unable to meet and experienced e-Infrastructure solution providers with an extensive track record of rapid application development. In addition to providing the service prototypes that can cope with very large data, PROCESS addresses the work programme goals by using the tools and services with heterogeneous use cases, including medical informatics, airline revenue management and open data for global disaster risk reduction. This diversity of user communities ensures that in addition to supporting communities that push the envelope, the solutions will also ease the learning curve for broadest possible range of user communities. In addition, the chosen open source strategy maximises the potential for uptake and reuse, together with mature software engineering practices that minimise the efforts needed to set up and maintain services based on the PROCESS software releases.

PROCESS Consortium

• LUDWIG-MAXIMILIANSUNIVERSITAET MUENCHEN LMU MUENCHEN, Germany
• UNIVERSITEIT VAN AMSTERDAM UvA, The Netherlands
• STICHTING NETHERLANDS ESCIENCE CENTER NLESC, The Netherlands
• HAUTE ECOLE SPECIALISEE DE SUISSE OCCIDENTALE HES-SO, Switzerland
• LUFTHANSA SYSTEMS GMBH & CO KG LSY, Germany
• INMARK EUROPA SA INMARK EUROPA, Spain
• USTAV INFORMATIKY, SLOVENSKA AKADEMIA VIED UISAV, Slovakia
• Cyfronet AGH Krakow, Poland

PROCESS Presentations

• M. Bubak, J. Meizner, P. Nowakowski, M. Bobák, O. Habala, L. Hluchý, V. Tran, A. S. Z. Belloum, R. Cushing, M. Höb, D. Kranzlmüller, J. Schmidt: A hybrid HPC and Cloud platform for multidisciplinary scientific application (abstract, poster, presentation - slides, recorded presentation), Supercomputing Frontiers 2020 Conference, 23-25.03.2020
• J. Kapała, J. Meizner, P. Nowakowski, P.Wójtowicz, M. Bubak, Running Workloads on the Prometheus Cluster with Singularity (abstract, presentation), KUKDM 2020 Conference planned on 5-6.03.2020
• M. Bubak, M. Kasztelnik, J. Meizner, P. Nowakowski, T. Gubała, M. Malawski: Towards a Universal Platform for Large Scale Simulations on Prometheus (abstract, presentation), KUKDM 2020 Conference planned on 5-6.03.2020
• J. Meizner, M. Bubak, J. Kapała, P. Nowakowski, P. Wójtowicz: PROCESS - Compute Platform, Workshop: Platform-driven e-infrastructure innovations, Amsterdam, The Netherlands, 29.10.2018

PROCESS Posters

• K. Rycerz, P. Nowakowski, J. Meizner, B. Wilk, J. Bujas, Ł. Jarmocik, M. Krok, P. Kurc, S. Lewicki, M. Majcher, P. Ociepka, L. Petka, K. Podsiadło, P. Skalski, W. Zagrajczuk and M. Zygmunt, M. Bubak: A Survey of Interactive Execution Environments for Extreme Large-Scale Computations (PPT, PDF), KU KDM'18, Zakopane, 7-9.03.2018

PROCESS Kick-off: Garching, 20-21 November 2017

• M. Bubak, J. Meizner and P. Nowakowski: Cyfronet AGH DICE Team in the PROCESS Project
• M. Bubak, J. Meizner and P. Nowakowski: Extreme Large Computing Service-oriented Infrastructure