[ad_1]
Jülich / Les Clayes, March 14, 2024 – The HPC research projects DEEP-SEA, IO-SEA and RED-SEA end this month after a three-year project period. The three projects worked together to develop the key technology for a European exascale supercomputer based on the Modular Supercomputing Architecture (MSA), a blueprint architecture for highly efficient and scalable heterogeneous exascale HPC systems. To achieve this goal, the three projects collaborated on system software and programming environments, data management and storage, and interconnects that fit this architecture. The results of the companies’ joint work will be presented at a co-design workshop and poster session at the EuroHPC Summit (Antwerp, March 18-21).
The future of supercomputing is exascale
DEEP-SEA, IO-SEA and RED-SEA are part of a larger research and innovation project co-funded by the EuroHPC joint venture to prepare key technologies and solutions for the ‘exascale era’ in supercomputing. Part of it. This next exascale generation can perform at least 1018 floating-point operations per second, enabling novel and more accurate scientific applications. Exascale supercomputers are much more complex than previous generations of slower systems, combining a wide range of different hardware components for specific purposes. Resources such as CPUs, GPUs, and other accelerators, communications, memory, and storage technologies must be integrated into one system that supports traditional HPC simulations, artificial intelligence, and big data analytics.
Modular supercomputing architecture for European exascale supercomputers
MSA was designed for exactly this purpose. It is based on a new system design that integrates disparate resources and technologies and meets the requirements of a wide range of application areas, from compute-intensive and highly scalable simulation codes to data-intensive artificial intelligence workflows. Different workload components run on their optimal modules, improving time-to-solution and energy efficiency. The new JUPITER supercomputer at the Jülich Supercomputing Center (JSC) is based on this architecture. The JUPITER installation will begin in 2024 and is co-funded by EuroHPC JU, the German Ministry of Education and Research, and the German Ministry of Culture and Research of North Rhine-Westphalia.
To implement, expand, and strengthen the MSA, the three SEA projects tackled a variety of tasks. DEEP-SEA was led by JSC and focused on programming environments and HPC software stacks. Led by CEA, IO-SEA has prototyped a new data management and storage platform. His RED-SEA, led by Eviden, has prepared the next generation European BXI (Bull eXascale Interconnect) and its associated software stack. Although the three SEA projects are independent, they are interlinked and work closely together to enable an efficient system for implementing MSA. These build on the results of other previous projects co-funded by the European Commission and draw on the vast network of ongoing partner projects, institutions and private companies across Europe.
EuroHPC Summit 2024 – a great opportunity to showcase your project results
An integrated software stack developed by deep sea This is one of the project’s key achievements, alongside the establishment of MSA in large-scale operational systems such as JSC’s JUWELS, Luxembourg’s MeluXina system, and soon the JUPITER system. This stack integrates the “best of breed” programming models, APIs, tools, and libraries that are also relevant for non-modular HPC systems. In particular, optimization cycle abstraction, support for hierarchical storage systems, and modern CI/CD techniques directly benefit such systems. This abstraction also applies to pioneering work in the field of malleability. This stack is freely available as open source to all interested parties.
JSC Director Professor Thomas Lippert:Building on the breakthrough results of previous DEEP projects, the robust and comprehensive HPC SW stack developed by DEEP-SEA enables systems based on Modular Supercomputing Architecture (MSA) to be used by HPC application developers and end users. ease of use for users and, therefore, the future of MSA in general and of JSC’s upcoming JUPITER Exascale system and other modular systems around the world in particular.“
Io Sea We have developed a storage and I/O stack suitable for MSA that handles data movement across tiered storage systems such as new non-volatile memories, solid-state devices, hard disk drives, and tape storage. IO-SEA has also developed the concept of short-lived “temporary storage services” that are created on demand and allow users to operate the system flexibly. This project also introduced new I/O APIs that expose the extensive use and exploitation of instrumentation and telemetry across the I/O stack, and the real-world semantics of the data.
Dr. Philippe Deniel, scientific coordinator of the IO-SEA project:Although the exascale era is a big step forward for mass storage, mass storage will face many new challenges because the storage models currently in use do not scale up and I/O operations become a critical bottleneck. It will be. The IO-SEA software stack introduces new features and paradigms to prevent this situation and provides a non-disruptive integration path for applications. The EUPEX community plans to use this stack in the future. Additionally, this stack will be integrated into his second EuroHPC Exascale machine hosted in France.“
of Red Sea This project laid the foundation for the development and industrialization of the third generation of the European BXI interconnect. This project will help bring BXI to exascale levels, increasing scalability and resiliency to reach well over 100,000 endpoints, and increasing the latency and bandwidth available to each endpoint. Much improved. RED-SEA also addressed real-world network performance using congestion management and adaptive routing mechanisms. Finally, RED-SEA achieved BXI-to-Ethernet compatibility by designing a seamless interface between BXI and Ethernet through a new low-latency gateway solution.
Laurent Cargemel, Head of BDS Strategy, Innovation and Research and Development at Eviden, said:The interconnect network is the heart and artery of a supercomputer. The larger the system, the more important its role becomes. Today, interconnected networks must also support new levels of complexity with mixed workflows and disparate systems. RED-SEA offers a European solution to these challenges. This solution may be used on the EUPEX Pilot system and also on his second EuroHPC Exascale machine hosted in France.“
The EuroHPC Summit, to be held in Antwerp, Belgium, from March 18th to 21st, will provide stakeholders with an opportunity to learn about the results. These projects jointly organized a workshop on “Co-designing the future of European HPC: green technologies, systems and software”, highlighting technology areas developed in Europe as a result of successful co-design, including SEA. ). Project results. The results of each project will be presented at a poster session.
[ad_2]
Source link
