Simulation of Job Execution in Distributed Heterogeneous Computing Infrastructures

Execution of one computing job demonstrates that software is correctly working. But, when the same job has to be executed thousands of times, it may cause different issues. Nowadays special distributed heterogeneous computing infrastructures are widely used for this type or workload. Main issue when running big workloads on them is network limits. These limits may be imposed in different levels: server, cluster, and storage level. With limited network there is a threshold after which increment of cpu resources does not speed up jobs execution rate. The purpose of this work is creation of a software platform for simulation of job execution in distributed computing infrastructures. The purpose of the system is a prediction of job execution rate in real infrastructure. The software platform was developed and tested. Python programming language was used for development. InfluxDB is used for results storage and visualization.