Microsoft Azure Batch spinning up 16,000 cores (time lapse)

As part of a proof of concept, endjin created a framework for performing scale, soak and performance tests against Microsoft Azure Batch Service. In this experiment we created a scale test to spin up a pool of 16,000 A1 (1 core, 1.75 GB RAM, 2x 500 IOPS) Task Virtual Machines (TVM). The experiment took 45 minutes, this video has been compressed to 30 seconds.

👉 Yellow blocks signify TVMs that are starting up (or shutting down) - they cannot do work in this state.
👉 White blocks indicate the TVM is idle and ready to accept work.
👉 Green blocks indicate the TVM is running a workload.
👉 Red blocks indicate the TVM is in a faulted state. The Azure Batch Fabric will try to heal these TVMs automatically.

This experiment consumed 12,000 compute core hours at a cost of £660.00.

In all we conducted exhaustive tests on Azure Batch for a variety of real world business scenarios consuming over 1,000,000 compute core hours.

To read a whitepaper describing the risks and benefits of Azure Batch discovered during these experiments please contact us endjin.com/contact-us

#azure #azurebatch #bigcompute #hpc #bigdata #fintech