The usage of workflows has led to progress in many fields of science, where the need to process large amounts of data is coupled with difficulty in accessing and efficiently using High Performance Computing platforms. On the one hand, scientists are focused on their problem and concerned with how to process their data.
On top of that, the applications typically have different parts and use different tools for each part, thus complicating the distribution and the reproducibility of the simulations.
On the other hand, computer scientists concentrate on how to develop frameworks for the deployment of workflows on HPC or HTC resources; often providing separate solutions for the computational aspects and the data analytic ones.
In this paper we present an approach to support biomolecular researchers in the development of complex workflows that:
- allow them to compose pipelines of individual simulations built from different tools and interconnected by data dependencies
- run them seamlessly on different computational platforms
- scale them up to the large number of cores provided by modern supercomputing infrastructures.
Our approach is based on the orchestration of computational building blocks for Molecular Dynamics simulations through an efficient workflow management system that has already been adopted in many scientific fields to run applications on multitudes of computing backends.
Results demonstrate the validity of the proposed solution through the execution of massively parallel runs in a supercomputer facility.
Citation
Pau Andrio, Adam Hospital, Cristian Ramon-Cortes, Javier Conejero, Daniele Lezzi, Jorge Ejarque, Josep LL. Gelpi, Rosa M. Badia (2021):
Enabling the execution of large scale workflows for molecular dynamics simulations.
bioRxiv 2021.04.14.439795 (preprint)
https://doi.org/10.1101/2021.04.14.439795
