sdumont - RISC2 Project https://www.risc2-project.eu Fri, 01 Sep 2023 13:47:35 +0000 en-US hourly 1 https://wordpress.org/?v=6.6.2 Developing Efficient Scientific Gateways for Bioinformatics in Supercomputer Environments Supported by Artificial Intelligence https://www.risc2-project.eu/2023/03/20/developing-efficient-scientific-gateways-for-bioinformatics-in-supercomputer-environments-supported-by-artificial-intelligence/ Mon, 20 Mar 2023 09:37:46 +0000 https://www.risc2-project.eu/?p=2781 Scientific gateways bring enormous benefits to end users by simplifying access and hiding the complexity of the underlying distributed computing infrastructure. Gateways require significant development and maintenance efforts. BioinfoPortal[1], through its CSGrid[2]  middleware, takes advantage of Santos Dumont [3] heterogeneous resources. However, task submission still requires a substantial step regarding deciding the best configuration that […]

The post Developing Efficient Scientific Gateways for Bioinformatics in Supercomputer Environments Supported by Artificial Intelligence first appeared on RISC2 Project.

]]>
Scientific gateways bring enormous benefits to end users by simplifying access and hiding the complexity of the underlying distributed computing infrastructure. Gateways require significant development and maintenance efforts. BioinfoPortal[1], through its CSGrid[2]  middleware, takes advantage of Santos Dumont [3] heterogeneous resources. However, task submission still requires a substantial step regarding deciding the best configuration that leads to efficient execution. This project aims to develop green and intelligent scientific gateways for BioinfoPortal supported by high-performance computing environments (HPC) and specialised technologies such as scientific workflows, data mining, machine learning, and deep learning. The efficient analysis and interpretation of Big Data opens new challenges to explore molecular biology, genetics, biomedical, and healthcare to improve personalised diagnostics and therapeutics; finding new avenues to deal with this massive amount of information becomes necessary. New Bioinformatics and Computational Biology paradigms drive storage, management, and data access. HPC and Big Data advanced in this domain represent a vast new field of opportunities for bioinformatics researchers and a significant challenge. the BioinfoPortal science gateway is a multiuser Brazilian infrastructure. We present several challenges for efficiently executing applications and discuss the findings on improving the use of computational resources. We performed several large-scale bioinformatics experiments that are considered computationally intensive and time-consuming. We are currently coupling artificial intelligence to generate models to analyze computational and bioinformatics metadata to understand how automatic learning can predict computational resources’ efficient use. The computational executions are conducted at Santos Dumont, the largest supercomputer in Latin America, dedicated to the research community with 5.1 Petaflops and 36,472 computational cores distributed in 1,134 computational nodes.

By:

Carneiro, B. Fagundes, C. Osthoff, G. Freire, K. Ocaña, L. Cruz, L. Gadelha, M. Coelho, M. Galheigo, and R. Terra are with the National Laboratory of Scientific Computing, Rio de Janeiro, Brazil.

Carvalho is with the Federal Center for Technological Education Celso Suckow da Fonseca, Rio de Janeiro, Brazil.

Douglas Cardoso is with the Polytechnic Institute of Tomar, Portugal.

Boito and L, Teylo is with the University of Bordeaux, CNRS, Bordeaux INP, INRIA, LaBRI, Talence, France.

Navaux is with the Informatics Institute, the Federal University of Rio Grande do Sul, and Rio Grande do Sul, Brazil.

References:

Ocaña, K. A. C. S.; Galheigo, M.; Osthoff, C.; Gadelha, L. M. R.; Porto, F.; Gomes, A. T. A.; Oliveira, D.; Vasconcelos, A. T. BioinfoPortal: A scientific gateway for integrating bioinformatics applications on the Brazilian national high-performance computing network. Future Generation Computer Systems, v. 107, p. 192-214, 2020.

Mondelli, M. L.; Magalhães, T.; Loss, G.; Wilde, M.; Foster, I.; Mattoso, M. L. Q.; Katz, D. S.; Barbosa, H. J. C.; Vasconcelos, A. T. R.; Ocaña, K. A. C. S; Gadelha, L. BioWorkbench: A High-Performance Framework for Managing and Analyzing Bioinformatics Experiments. PeerJ, v. 1, p. 1, 2018.

Coelho, M.; Freire, G.; Ocaña, K.; Osthoff, C.; Galheigo, M.; Carneiro, A. R.; Boito, F.; Navaux, P.; Cardoso, D. O. Desenvolvimento de um Framework de Aprendizado de Máquina no Apoio a Gateways Científicos Verdes, Inteligentes e Eficientes: BioinfoPortal como Caso de Estudo Brasileiro In: XXIII Simpósio em Sistemas Computacionais de Alto Desempenho – WSCAD 2022 (https://wscad.ufsc.br/), 2022.

Terra, R.; Ocaña, K.; Osthoff, C.; Cruz, L.; Boito, F.; Navaux, P.; Carvalho, D. Framework para a Construção de Redes Filogenéticas em Ambiente de Computação de Alto Desempenho. In: XXIII Simpósio em Sistemas Computacionais de Alto Desempenho – WSCAD 2022 (https://wscad.ufsc.br/), 2022.

Ocaña, K.; Cruz, L.; Coelho, M.; Terra, R.; Galheigo, M.; Carneiro, A.; Carvalho, D.; Gadelha, L.; Boito, F.; Navaux, P.; Osthoff, C. ParslRNA-Seq: an efficient and scalable RNAseq analysis workflow for studies of differentiated gene expression. In: Latin America High-Performance Computing Conference (CARLA), 2022, Rio Grande do Sul, Brazil. Proceedings of the Latin American High-Performance Computing Conference – CARLA 2022 (http://www.carla22.org/), 2022.

[1] https://bioinfo.lncc.br/

[2] https://git.tecgraf.puc-rio.br/csbase-dev/csgrid/-/tree/CSGRID-2.3-LNCC

[3] https://https://sdumont.lncc.br

The post Developing Efficient Scientific Gateways for Bioinformatics in Supercomputer Environments Supported by Artificial Intelligence first appeared on RISC2 Project.

]]>
LNCC’s HPC Summer School provided sessions related to HPC to their community https://www.risc2-project.eu/2023/01/30/lnccs-hpc-summer-school-provided-sessions-related-to-hpc-to-their-community/ Mon, 30 Jan 2023 11:31:48 +0000 https://www.risc2-project.eu/?p=2688 LNCC, one of the RISC2 Brazilian partners, organized the HPC Summer School “Escola Supercomputador Santos Dumont,” which took place between January 16 to 24, 2023, as part of the LNCC’s Summer Program. The School aimed to provide mini-courses and talks related to programming on high-performance computers, such as parallel programming models, profiling tools, and libraries […]

The post LNCC’s HPC Summer School provided sessions related to HPC to their community first appeared on RISC2 Project.

]]>
LNCC, one of the RISC2 Brazilian partners, organized the HPC Summer School “Escola Supercomputador Santos Dumont,” which took place between January 16 to 24, 2023, as part of the LNCC’s Summer Program.

The School aimed to provide mini-courses and talks related to programming on high-performance computers, such as parallel programming models, profiling tools, and libraries for developing optimized parallel algorithms for the SDumont user community and the high-performance computing programming community.

Due to the extensive territory of Brazil and the number of research projects, it is mandatory to provide regular HPC schools for the research community. According to Carla Osthoff, one of the organizers of this school, “SDumont is the only Brazilian supercomputer dedicated to the research community that is part of the TOP 500 list. The Brazilian Ministry of Science and Technology offers free access to all Brazilian research projects in the country and foreign collaborators. Currently, we have 238 research projects from 18 research areas.  This edition of the School received 350 registrations, but we also provided online YouTube access to the community.”

The event happened remotely, and all the sessions are available on Youtube.

The post LNCC’s HPC Summer School provided sessions related to HPC to their community first appeared on RISC2 Project.

]]>
International Congress in Geophysics and High-Performance Computing https://www.risc2-project.eu/events/international-congress-in-geophysics-and-high-performance-computing/ Mon, 09 Jan 2023 12:06:17 +0000 https://www.risc2-project.eu/?post_type=mec-events&p=2645

The post International Congress in Geophysics and High-Performance Computing first appeared on RISC2 Project.

]]>

The post International Congress in Geophysics and High-Performance Computing first appeared on RISC2 Project.

]]>
LNCC participated in the 19th Brazilian Science and Technology National Week https://www.risc2-project.eu/2022/12/19/lncc-participated-in-the-19th-brazilian-science-and-technology-national-week/ Mon, 19 Dec 2022 14:09:22 +0000 https://www.risc2-project.eu/?p=2624 Carla Osthoff, LNCC’s researcher, presented the Santos Dumont Supercomputer on the 19th Brazilian Science and Technology National Week, organised by the Brazilian Ministry of Science and Technology. The talk “The Santos Dumont Supercomputer in the scenario of National and International Scientific Research” was presented on December 3, 2022, and is available here. 

The post LNCC participated in the 19th Brazilian Science and Technology National Week first appeared on RISC2 Project.

]]>
Carla Osthoff, LNCC’s researcher, presented the Santos Dumont Supercomputer on the 19th Brazilian Science and Technology National Week, organised by the Brazilian Ministry of Science and Technology.

The talk “The Santos Dumont Supercomputer in the scenario of National and International Scientific Research” was presented on December 3, 2022, and is available here. 

The post LNCC participated in the 19th Brazilian Science and Technology National Week first appeared on RISC2 Project.

]]>
HPC Summer School “Escola Supercomputador Santos Dumont 2023” https://www.risc2-project.eu/events/hpc-summer-school-escola-supercomputador-santos-dumont-2023/ Mon, 19 Dec 2022 10:38:22 +0000 https://www.risc2-project.eu/?post_type=mec-events&p=2622 LNCC is organizing the HPC summer school “Escola Supercomputador Santos Dumont 2023”. The School will take place from January 16th-24th, in remote format, and is open to the HPC research community. The school aims to provide the SDumont user community and the high performance computing programming community in general with mini-courses related to programming on […]

The post HPC Summer School “Escola Supercomputador Santos Dumont 2023” first appeared on RISC2 Project.

]]>
LNCC is organizing the HPC summer school “Escola Supercomputador Santos Dumont 2023”. The School will take place from January 16th-24th, in remote format, and is open to the HPC research community.

The school aims to provide the SDumont user community and the high performance computing programming community in general with mini-courses related to programming on high performance computers such as parallel programming models, profiling tools and libraries for the development of optimized parallel algorithms.

Know more. 

The post HPC Summer School “Escola Supercomputador Santos Dumont 2023” first appeared on RISC2 Project.

]]>
LNCC is making efforts to promote the best HPC practices https://www.risc2-project.eu/2022/11/28/lncc-is-making-efforts-to-promote-the-best-hpc-practices/ Mon, 28 Nov 2022 09:16:45 +0000 https://www.risc2-project.eu/?p=2608 Our partner LNCC participated in different events to promote interaction and exchange of knowledge and the best HPC practices between Europe and Latin America. On November 7, 2022, LNCC researchers, Carla Osthoff and Kary Ocaña, participated in a seminar in collaboration with our partner Inria, with a presentation entitle “Developing Efficient Scientific Gateways for Bioinformatics […]

The post LNCC is making efforts to promote the best HPC practices first appeared on RISC2 Project.

]]>
Our partner LNCC participated in different events to promote interaction and exchange of knowledge and the best HPC practices between Europe and Latin America.

On November 7, 2022, LNCC researchers, Carla Osthoff and Kary Ocaña, participated in a seminar in collaboration with our partner Inria, with a presentation entitle “Developing Efficient Scientific Gateways for Bioinformatics in Supercomputer Environments Supported by Artificial Intelligence”. The seminar aimed at promoting the interaction between LNCC’s and Inria’s high-performance computing researchers.

On November 18, Carla Osthoff participated in a seminar organized by the University of Campinas, where she presented the Santos Dumont Supercomputer. The event aimed to promote the exchange of the best HPC practices, promoting the interaction between computer science researchers towards the definition of a coordinated policy and a concrete roadmap for the future.

On November 23, Carla Osthoff also presented the Santos Dumont Supercomputer, on an online lecture, organized by the Research Centre in Digitalization and Intelligent Robotics of the Polytechnic Institute of Bragança, promoting the knowledge exchange between both regions.

The post LNCC is making efforts to promote the best HPC practices first appeared on RISC2 Project.

]]>
LNCC no Ciclo de Palestras do CEDRI-IPB, Portugal https://www.risc2-project.eu/2022/11/23/lncc-no-ciclo-de-palestras-do-cedri-ipb-portugal/ Wed, 23 Nov 2022 09:35:32 +0000 https://www.risc2-project.eu/?p=2604 SDumont (2nd gen) https://www.risc2-project.eu/2022/04/21/sdumont-2nd-gen/ Thu, 21 Apr 2022 15:05:55 +0000 https://www.risc2-project.eu/?p=1851 Title: SDumont (2nd gen) System name: SDumont (2nd gen) Web Location: LNCC Country: Brazil Processor architecture: Bull Sequana X1000, Xeon Gold 6252 24C 2.1GHz, NVIDIA V100 SXM2, IB EDR. Cores: 33,856. + 11,808 + 1,728 Vendor: Atos Peak performance:  TFlops (Linpack): 1,849 + 785 + 115 Access policy

The post SDumont (2nd gen) first appeared on RISC2 Project.

]]>
  • Title: SDumont (2nd gen)
  • System name: SDumont (2nd gen)
  • Web
  • Location: LNCC
  • Country: Brazil
  • Processor architecture:
    • Bull Sequana X1000, Xeon Gold 6252 24C 2.1GHz, NVIDIA V100 SXM2, IB EDR. Cores: 33,856. + 11,808 + 1,728
  • Vendor: Atos
  • Peak performance: 
    • TFlops (Linpack): 1,849 + 785 + 115
  • Access policy
  • The post SDumont (2nd gen) first appeared on RISC2 Project.

    ]]>
    SDumont https://www.risc2-project.eu/2021/12/17/sdumont/ Fri, 17 Dec 2021 17:52:30 +0000 https://www.risc2-project.eu/?p=1502 Title: SDumont System name: SDumont Hosting site: National Laboratory of Scientific Computation (LNCC), MCTIC Site location: Petrópolis, RJ Country: Brazil System overview: The Santos Dumont (SDumont) supercomputer, acquired from the French company ATOS/BULL, is located at the headquarters of the National Laboratory for Scientific Computing (LNCC), in Petrópolis-RJ, acting as a central node ( Tier-0 […]

    The post SDumont first appeared on RISC2 Project.

    ]]>
  • Title: SDumont
  • System name: SDumont
  • Hosting site: National Laboratory of Scientific Computation (LNCC), MCTIC
  • Site location: Petrópolis, RJ
  • Country: Brazil
  • System overview: The Santos Dumont (SDumont) supercomputer, acquired from the French company ATOS/BULL, is located at the headquarters of the National Laboratory for Scientific Computing (LNCC), in Petrópolis-RJ, acting as a central node ( Tier-0 ) of the National Processing System of High Performance – SINAPAD. SDumont has an installed processing capacity of 5.1 Petaflop/s (5.1 x 10 15 float-point operations per second ), presenting a hybrid configuration of computational nodes, in terms of the available parallel processing architecture.
  • Programming environment: To be completed.
  • Access policy: SDumont serves different types of projects, through different allocation programs. Projects are submitted by researchers and evaluated by SDumont’s Steering and Technical-Scientific Advisory Committees in response to regularly open calls for each of these allocation programs. Such calls are published in the lists of the main scientific societies as well as on the SINAPAD website and social media.
  • Research and application domain(s): AI, Computer science, Life science, Health, Earth science, Mathematics, Astronomy, Physics
  • Relevant project(s): To be completed.
  • Contact information: sdumont@lncc.br
  • The post SDumont first appeared on RISC2 Project.

    ]]>
    National Laboratory for Scientific Computing participated in the ISC2021 https://www.risc2-project.eu/2021/08/13/national-laboratory-for-scientific-computing-participated-in-the-isc2021/ Fri, 13 Aug 2021 09:55:06 +0000 https://www.risc2-project.eu/?p=1799 The National Laboratory for Scientific Computing (LNCC), one of the RISC2 partners from Brazil, presented two posters at the Event for High Performance Computing, Machine Learning and Data Analysis (ISC) 2021. The posters “Developing Efficient Scientific Gateways for Bioinformatics in Supercomputing Environments Supported by Artificial Intelligence” and “Scalable Numerical Method for Biphasic Flows in Heterogeneous […]

    The post National Laboratory for Scientific Computing participated in the ISC2021 first appeared on RISC2 Project.

    ]]>
    The National Laboratory for Scientific Computing (LNCC), one of the RISC2 partners from Brazil, presented two posters at the Event for High Performance Computing, Machine Learning and Data Analysis (ISC) 2021.

    The posters “Developing Efficient Scientific Gateways for Bioinformatics in Supercomputing Environments Supported by Artificial Intelligence” and “Scalable Numerical Method for Biphasic Flows in Heterogeneous Porous Media in High-Performance Computational Environments” are part of the activities of the LNCC RISC2 projects.

    According to Carla Osthoff (LNCC) , former poster presents a collaboration project that aims to develop green and intelligent scientific gateways for bioinformatics supported by high-performance computing environments (HPC) and specialized technologies such as scientific workflows, data mining, machine learning, and deep learning.  The efficient analysis and interpretation of Big Data open new challenges to explore molecular biology, genetics, biomedical, and healthcare to improve personalized diagnostics and therapeutics; then, it becomes necessary to availability of new avenues to deal with this massive amount of information. New paradigms in Bioinformatics and Computational Biology drive the storing, managing, and accessing of data. HPC and Big Data advances in this domain represent a vast new field of opportunities for bioinformatics researchers and a significant challenge. The Bioinfo-Portal science gateway is a multiuser Brazilian infrastructure for bioinformatics applications, benefiting from the HPC infrastructure. We present several challenges for efficiently executing applications and discussing the findings on how to improve the use of computational resources. We performed several large-scale bioinformatics experiments that are considered computationally intensive and time-consuming. We are currently coupling artificial intelligence to generate models to analyze computational and bioinformatics metadata to understand how automatic learning can predict computational resources’ efficient use. The computational executions are carried out at Santos Dumont Supercomputer. This is a multi-disciplinary project requiring expertise from several knowledge areas from four research institutes (LNCC, UFRGS, INRIA Bordeaux, and CENAT in Costa Rica). Finally, Brazilian funding agencies (CNPQ, CAPES) and the RISC-2 project from the European Economic and Social Committee (EESC) support the project.

    Latter poster presents a project that aims to develop a scalable numerical approach for biphasic flows in heterogeneous porous media in high-performance computing environments based on the high-performance numerical methodology. In this system, an elliptical subsystem determines the velocity field, and a non-linear hyperbolic equation represents the transport of the flowing phases (saturation equation). The model applies a locally conservative finite element method for the mixing speed. Furthermore, the model employs a high-order non-oscillatory finite volume method, based on central schemes, for the non-linear hyperbolic equation that governs phase saturation. Specifically, the project aims to build scalable codes for a high-performance environment. Identified the bottlenecks in the code, the project is now working in four different research areas. Parallel I/O routines and high-performance visualization to decrease the I/O transfers bottleneck, Parallel programming to reduce code bottlenecks for multicore and manycore architectures. and Adaptive MPI  to decrease the message communication bottleneck. The poster presents the first performance evaluation results used to guide the project research areas. This endeavor is a multi-disciplinary project requiring expertise from several knowledge areas from four research institutes (LNCC, UFRGS, UFLA in Brazil, and CENAT in Costa Rica). Finally, Brazilian funding agencies (CNPQ, CAPES) and the RISC-2 project.

    The post National Laboratory for Scientific Computing participated in the ISC2021 first appeared on RISC2 Project.

    ]]>