working group - RISC2 Project https://www.risc2-project.eu Fri, 24 Feb 2023 15:36:39 +0000 en-US hourly 1 https://wordpress.org/?v=6.6.2 Towards a greater HPC capacity in Latin America https://www.risc2-project.eu/2023/02/24/towards-a-greater-hpc-capacity-in-latin-america/ Fri, 24 Feb 2023 15:36:39 +0000 https://www.risc2-project.eu/?p=2739 High-Performance Computing (HPC) has proven to be a strong driver for science and technology development, and is increasingly considered indispensable for most scientific disciplines. HPC is making a difference in key topics of great interest such as climate change, personalised medicine, engineering, astronomy, education, economics, industry and public policy, becoming a pillar for the development […]

The post Towards a greater HPC capacity in Latin America first appeared on RISC2 Project.

]]>
High-Performance Computing (HPC) has proven to be a strong driver for science and technology development, and is increasingly considered indispensable for most scientific disciplines. HPC is making a difference in key topics of great interest such as climate change, personalised medicine, engineering, astronomy, education, economics, industry and public policy, becoming a pillar for the development of any country, and to which the great powers are giving strategic importance and investing billions of dollars, in competition without limits where data is the new gold.

A country that does not have the computational capacity to solve its own problems will have no alternative but to try to acquire solutions provided by others. One of the most important aspects of sovereignty in the 21st century is the ability to produce mathematical models and to have the capacity to solve them. Today, the availability of computing power commensurate with one’s wealth exponentially increases a country’s capacity to produce knowledge. in the developed world, it is estimated that for every dollar invested in supercomputing, the return to society is of the order of US$ 44(1) and to the academic world US$ 30(2). For these reasons, HPC occupies an important place on the political and diplomatic agendas of developed countries. 

In Latin America, investment in HPC is very low compared to what’s the US, Asia and Europe are doing. In order to quantify this difference, we present the tables below, which show the accumulated computing capacity in the ranking of the 500 most powerful supercomputers in the world – the TOP500(3) – (Table 1), and the local reality (Table 2). Other data are also included, such as the population (in millions), the number of researchers per 1,000 inhabitants (Res/1000), the computing capacity per researcher (Gflops/Res) and the computing capacity per US$ million of GPD. In Table 1, we have grouped the countries by geographical area. America appears as the area with the highest computing capacity, essentially due to the USA, which has almost 45% of the world’s computing capacity in the TOP500. It if followed by Asia and then Europe. Tis TOP500 list includes mainly academic research centres, but also industry ones, typically those used in applied research (many private ones do not wish to publish such information for obvious reasons). For example, in Brazil – which shows good computing capacity with 88,175 TFlops – the vast majority is in the hands of the oil industry and only about 3,000 TFlops are used for basic research. Countries listed in the TOP500 invest in HPC from a few TFlops per million GDP (Belgium 5, Spain 7, Bulgaria 8), through countries investing in the order of hundreds (Italy 176, Japan 151, USA 138), to even thousands, as is the case in Finland with 1,478. For those countries where we were able to find data on the number of researchers, these range from a few Gflops per researcher (Belgium 19, Spain 24, Hungary 52) to close to 1,000 GFlops, i.e. 1 TFlop (USA 970, Italy 966), with Finland surpassing this barrier with 4,647. Note that, unlike what happens locally, countries with a certain degree of development invest every 3-4 years in supercomputing, so the data we are showing will soon be updated and there will be variations in the list. For example, this year a new supercomputer will come into operation in Spain(4), which, with an investment of some 150 million euros, will give Spain one of the most powerful supercomputers in Europe – and the world.

Country Rpeak 

(TFlops)

Population

(millions)

Res/1000 GFlops/Res Tflops/M US$
United States 3.216.124 335 9.9 969.7 138.0
Canada 71.911 39 8.8 209.5 40.0
Brazil 88.175 216 1.1 371.1  51.9
AMERICA 3.376.211 590      
           
China 1.132.071 1400     67.4
Japan 815.667 124 10.0 657.8 151.0
South Korea 128.264 52 16.6 148.6 71.3
Saudi Arabia 98.982 35     141.4
Taiwan 19.562 23     21.7
Singapore 15.785 6     52.6
Thailand 13.773 70     27.5
United Arab Emirates 12.164 10     15.2
India 12.082 1380     4.0
ASIA 2.248.353 3100      
           
Finland 443.391 6 15.9 4647.7 1478.0
Italy 370.262 59 6.5 965.5 176.3
Germany 331.231 85 10.1 385.8 78.9
France 251.166 65 11.4 339.0 83.7
Russia 101.737 145     59.8
United Kingdom 92.563 68 9.6 141.8 29.9
Netherlands 56.740 18 10.6 297.4 56.7
Switzerland 38.600 9 9.4 456.3 48.3
Sweden 32.727 10 15.8 207.1 54.5
Ireland 26.320 5 10.6 496.6 65.8
Luxembourg 18.291 0.6     365.8
Poland 17.099 38 7.6 59.2 28.5
Norway 17.031 6 13.0 218.3 34.1
Czech Republic 12.914 10 8.3 155.6 43.0
Spain 10.296 47 7.4 29.6 7.4
Slovenia 10.047 2 9.9 507.4 167.5
Austria 6.809 9 11.6 65.2 13.6
Bulgaria 5.942 6     8.5
Hungary 4.669 10 9.0 51.9 23.3
Belgium 3.094 12 13.6 19.0 5.2
EUROPA 1.850.934 610.6      
OTHER          
Australia 60.177 26     40.1
Morocco 5.014 39     50.1

Table 1. HPC availability per researcher and relative to GDP in the TOP500 countries (includes HPC in industry).

The local reality is far from this data. Table 2 shows data from Argentina, Brazil, Chile and Mexico. In Chile, the availability of computing power is 2-3 times less per researcher than in countries with less computing power in the OECD and up to 100 times less than a researcher in the US. In Chile, our investment measured in TFlops per million US$ of GDP is 166 times less than in the US; with respect to European countries that invest less in HPC it is 9 times less, and with respect to the European average (including Finland) it is 80 times less, i.e. the difference is considerable. It is clear that we need to close this gap. An investment go about 5 million dollars in HPC infrastructure in the next 5 years would close this gap by a factor of almost 20 times our computational capacity. However, returning to the example of Spain, the supercomputer it will have this year will offer 23 times more computing power than at present and, therefore, we will only maintain our relative distance. If we do not invest, the dap will increase by at least 23 times and will end up being huge. Therefore, we do not only need a one-time investment, but we need to ensure a regular investment. Some neighbouring countries are already investing significantly in supercomputing. This is the case in Argentina, where they are investing 7 million dollars (2 million for the datacenter and 5 million to buy a new supercomputer), which will increase their current capacities by almost 40 times(5).

Country Rpeak 

(TFlops)

Population (millions) Res/1000 GFlops/Res Tflops/M US$
Brazil* 3.000 216 1.1  12.6 1.8
Mexico 2.200 130 1.2 14.1 1.8
Argentina 400 45 1.2 7.4  0.8
Chile 250 20 1.3 9.6 0.8

Table 2. HPC availability per researcher and relative to GDP in the region (*only HPC capacity in academia is considered in this table).

For the above reasons, we are working to convince the Chilean authorities that we must have greater funding and, more crucially, permanent state funding in HPC. In relation to this, on July 6 we signed a collaboration agreement between 44 institutions with the support of the Ministry of Science to work on the creation of the National Supercomputing Laboratory(6). The agreement recognised that supercomputers are a critical infrastructure for Chile’s development, that it is necessary to centralise the requirements/resources at the national level, obtain permanent funding from the State and create a new institutional framework to provide governance. In an unprecedented inter-institutional collaboration in Chile, the competition for HPC resources at the national level is eliminated ad the possibility of direct funding from the State is opened up without generating controversy.

Undoubtedly, supercomputing is a fundamental pillar for the development of any country, where increasing investment provides a strategic advantage, and in Latin America we should not be left behind.

By NLHPC

 

References

(1) Hyperion Research HPC Investments Bring High Returns

(2) EESI-2 Special Study To Measure And Model How Investments In HPC Can Create Financial ROI And Scientific Innovation In Europe 

(3) https://top500.org/ 

(4) https://www.lavanguardia.com/ciencia/20230129/8713515/llega-superordenador-marenostrum-5-bsc-barcelona.html

(5) https://www.hpcwire.com/2022/12/15/argentina-announces-new-supercomputer-for-national-science/

(6) https://uchile.cl/noticias/187955/44-instituciones-crearan-el-laboratorio-nacional-de-supercomputacion

 

The post Towards a greater HPC capacity in Latin America first appeared on RISC2 Project.

]]>
Webinar: HPC system and job monitoring with LLview https://www.risc2-project.eu/events/webinar-4-hpc-system-and-job-monitoring-with-llview/ Tue, 26 Jul 2022 12:39:25 +0000 https://www.risc2-project.eu/?post_type=mec-events&p=2245 Date: December 7, 2022 | 4 p.m. (UTC) Speakers: Vitor Silva and Filipe Guimarães, Jülich Supercomputer Centre Moderator: Esteban Mocskos, Universidad de Buenos Aires Check the speakers’ presentation slides here.  LLview is a monitoring infrastructure developed by the Jülich Supercomputing Centre with the objective to provide an easy to use and adaptable software suite for monitoring High Performance […]

The post Webinar: HPC system and job monitoring with LLview first appeared on RISC2 Project.

]]>

Date: December 7, 2022 | 4 p.m. (UTC)

Speakers: Vitor Silva and Filipe Guimarães, Jülich Supercomputer Centre

Moderator: Esteban Mocskos, Universidad de Buenos Aires

Check the speakers’ presentation slides here. 

LLview is a monitoring infrastructure developed by the Jülich Supercomputing Centre with the objective to provide an easy to use and adaptable software suite for monitoring High Performance Computing systems. With the emergence of large heterogeneous machines, in the range of Exascale, the challenges of monitoring such huge systems increase significantly. To address that, LLview is under continuous development in order to work for a wide range of hardware systems and software interfaces with negligible overhead and at the same time providing fast, reliable access to job reports, system-wide monitoring data, and real-time system information. That information is provided to system users, project advisors, support teams and system administrators, helping the managing of jobs, identification of performance issues at many levels and also helping the system administrators to find failures and system malfunctions. This webinar gives an overview of the different LLview components and their interaction with each other and the system. Moreover, particular attention is drawn to the system monitoring views and the job reporting features, as they allow to trace the entire life cycle of a job and can help identify problems and bottlenecks at a very early stage.

 

About the Speakers:

Vitor Silva received his Computer Science degree from Universiade Federal de Minas Gerais. His M.Sc was earned in Systems and Computer Engineering from Universidade Federal do Rio de Janeiro and later received his Ph.D from Universidade Federal de Minas Gerais, this time in Nuclear Engineering. He worked as software developer in the digital image processing field, but most of his career was in the Nuclear Engineering field, mainly working with computer modeling and solving Neutronics and Thermal-hydraulics problems related to nuclear reactors. He was also the main admin of a small cluster system installed from scratch. Since 2021 he has been working at the Jülich Supercomputing Centre with monitoring tools and simulation.

Filipe Guimarães is a computational physicist. Graduated in Physics, M.Sc in Physics and Ph.D in Physics from the Universidade Federal Fluminense. He has been working with High Performance Computing since 2014 – initially from a user’s side, but moved to the support side in 2020. Since then, one of his focuses was to improve monitoring tools used and developed at the Jülich Supercomputing Centre.

About the Moderator: Esteban Mocskos is a full-time professor at Universidad de Buenos Aires (UBA) and researcher at the Center for Computer Simulation (CSC-CONICET). He received his Ph.D. in Computer Science from UBA in 2008 and was postdoc at the Protein Modelling group at UBA. His research interests include distributed systems & blockchain, computer networks, processor architecture, and parallel programming. He is part of the steering committee of the Latin-American HPC CARLA conference and onE of the committee members of Argentina’s National HPC system.

The post Webinar: HPC system and job monitoring with LLview first appeared on RISC2 Project.

]]>
RISC2 organized virtual workshop focused on High-Performance Computing (HPC), data science and scientific computing https://www.risc2-project.eu/2022/07/01/risc2-organized-virtual-workshop/ Fri, 01 Jul 2022 12:20:06 +0000 https://www.risc2-project.eu/?p=2189 The RISC2 project organized a virtual workshop dedicated to High-Performance Computing (HPC), data science and scientific computing. The workshop, which took place on June 22 and 23, was organized in the scope of the working group for a convergence between HPC, data science and large-scale scientific computing, proposed by Inria, LNCC and UFRJ/COPPE, partners of […]

The post RISC2 organized virtual workshop focused on High-Performance Computing (HPC), data science and scientific computing first appeared on RISC2 Project.

]]>
The RISC2 project organized a virtual workshop dedicated to High-Performance Computing (HPC), data science and scientific computing. The workshop, which took place on June 22 and 23, was organized in the scope of the working group for a convergence between HPC, data science and large-scale scientific computing, proposed by Inria, LNCC and UFRJ/COPPE, partners of the project.

This first online workshop gathered 20 participants each day to discuss the main challenges for such a convergence and present ongoing related works.  The workshop also aimed to foster more focused cooperation between partners.

The event was moderated by Stéphane Lanteri, from Inria, and had the participation of Daniele Lezzi, from Barcelona Supercomputing Center, António Tadeu Gomes and Kary Ocaña, from LNCC, José Moríñigo, from CIEMAT, Alvaro Coutinho, from Federal University of Rio de Janeiro, Marta Mattoso, from COPPE/Federal University of Rio de Janeiro, and Patrick Valduriez, from Inria.

 

The post RISC2 organized virtual workshop focused on High-Performance Computing (HPC), data science and scientific computing first appeared on RISC2 Project.

]]>
RISC2 Virtual Workshop: HPC, Data Science and Scientific computing https://www.risc2-project.eu/events/1st-risc2-projects-online-workshop/ Wed, 25 May 2022 13:53:57 +0000 https://www.risc2-project.eu/?post_type=mec-events&p=2117

The post RISC2 Virtual Workshop: HPC, Data Science and Scientific computing first appeared on RISC2 Project.

]]>

The post RISC2 Virtual Workshop: HPC, Data Science and Scientific computing first appeared on RISC2 Project.

]]>
RISC2 has a working group on HPC, Data Science and Scientific Computing https://www.risc2-project.eu/2022/04/04/risc2-has-a-working-group-on-hpc-data-science-and-scientific-computing/ Mon, 04 Apr 2022 09:39:56 +0000 https://www.risc2-project.eu/?p=1763 The RISC2 project has launched a working group for a convergence between High Performance Computing (HPC), Data Science (including Machine Learning and Deep Learning) and large-scale Scientific Computing. There are five domains of applications of interest to this working group:  Energy (in particular green and renewable energies), Smart Cities (AI-based modelling for the design of […]

The post RISC2 has a working group on HPC, Data Science and Scientific Computing first appeared on RISC2 Project.

]]>
The RISC2 project has launched a working group for a convergence between High Performance Computing (HPC), Data Science (including Machine Learning and Deep Learning) and large-scale Scientific Computing.

There are five domains of applications of interest to this working group:  Energy (in particular green and renewable energies), Smart Cities (AI-based modelling for the design of smart devices and IoT), Transport(green aviation), Climate (specifically climate change and weather forecast), and Health (particularly personalized medicine, epidemiology, cancer research, cardiology, drug design). Some of these domains have links with industry, while others are associated with research priorities of governmental academic organizations in Latin America and Europe.

Within this working group, there are three main actions in perspective:

-Organization of joint workshops and joint work between RISC2 partners through various bilateral programs;

-Organization of seminars and workshops with companies and research institutions to discuss their challenges, and let them know how RISC2 R&D can deliver innovative scientific solutions;

-Participation in proposals for joint projects in the Latin America area.

This working group was proposed by Inria, LNCC, UFRJ/COPPE, partners of the RISC2 project.

The post RISC2 has a working group on HPC, Data Science and Scientific Computing first appeared on RISC2 Project.

]]>