Automated, reliable, and efficient continental-scale replication of 7.3 petabytes of computational simulation data: A case study

Lukasz Lacinski, Lee Liming, Steven Turoscy, Cameron Harr, Kyle Chard, Eli Dart, Paul J. Durack, Sasha Ames, Forrest M. Hoffman, Ian T. Foster, The University of Chicago, Argonne National Laboratory, Lawrence Livermore National Laboratory, Lawrence Berkeley National Laboratory, Oak Ridge National Laboratory, Oak Ridge

The International Journal of High Performance Computing Applications

Published online on April 25, 2026

Abstract

The International Journal of High Performance Computing Applications, Volume 40, Issue 3, Page 421-433, May 2026.
We report on our experiences replicating 7.3 petabytes (PB) of Earth System Grid Federation (ESGF) computational simulation data from Lawrence Livermore National Laboratory (LLNL) in California to Argonne National Laboratory (ANL) in Illinois and Oak ...