In the past, high-performance computing wasn’t readily available to anyone but researchers and research institutions with access to large HPC clusters. Those without direct access had to write proposals and wait their turn to use the clusters. With resources scarce and many people in line ahead of them, researchers could be waiting a while for their turn and, if they made a mistake or their code didn’t run well in the large cluster environment, they might have to restart the process from the beginning.
In recent years, the cloud has transformed the data processing space, making HPC clusters…