TY  - CHAP
U1  - Konferenzveröffentlichung
A1  - Madan, Manav
A1  - Reich, Christoph
T1  - Comparison of Benchmarks for Machine Learning Cloud Infrastructures
T2  - CLOUD COMPUTING 2021 : The Twelfth International Conference on Cloud Computing, GRIDs, and Virtualization, April 18 - 22, 2021, Porto, Portugal
N2  - Training of neural networks requires often high computational power and large memory on Graphics Processing Unit (GPU) hardware. Many cloud providers such as Ama­zon, Azure, Google, Siemens, etc, provide such infrastructure. However, should one choose a cloud infrastructure or an on premise system for a neural network application, how can these systems be compared with one another? This paper investigates seven prominent Machine Learning benchmarks, which are MLPerf, DAWNBench, DeepBench, DLBS, TBD, AIBench, and ADABench. The recent popularity and widespread use of Deep Learning in various applications have created a need for bench­marking in this field. This paper shows that these application domains need slightly different resources and argue that there is no standard benchmark suite available that addresses these different application needs. We compare these benchmarks and summarize benchmark­related datasets, domains, and metrics. Finally, a concept of an ideal benchmark is sketched.
Y1  - 2021
UR  - https://www.thinkmind.org/index.php?view=article&articleid=cloud_computing_2021_3_10_20011
SN  - 978-1-61208-845-7
SB  - 978-1-61208-845-7
SP  - 41
EP  - 47
ER  -