Benchmarking Serverless Computing: Performance and Usability

Mubashra Sadaqat, Mary Sánchez-Gordón, Ricardo Colomo-Palacios

Source Title: Journal of Information Technology Research (JITR)15(1)

ISSN: 1938-7857|EISSN: 1938-7865|EISBN13: 9781683180340|DOI: 10.4018/JITR.299374

MLA

Sadaqat, Mubashra, et al. "Benchmarking Serverless Computing: Performance and Usability." JITR vol.15, no.1 2022: pp.1-17. http://doi.org/10.4018/JITR.299374

APA

Sadaqat, M., Sánchez-Gordón, M., & Colomo-Palacios, R. (2022). Benchmarking Serverless Computing: Performance and Usability. Journal of Information Technology Research (JITR), 15(1), 1-17. http://doi.org/10.4018/JITR.299374

Chicago

Sadaqat, Mubashra, Mary Sánchez-Gordón, and Ricardo Colomo-Palacios. "Benchmarking Serverless Computing: Performance and Usability," Journal of Information Technology Research (JITR) 15, no.1: 1-17. http://doi.org/10.4018/JITR.299374

Export Reference

Favorite Full-Issue Download

View Full Text HTML

View Full Text PDF

Abstract

With the increasing adoption of serverless computing, there is a need for a benchmark. The aim of this paper is to present such a benchmark based on performance and usability testing to better understand serverless services as well as help practitioners to select between two major clouds, namely, Amazon and Azure. Jmeter tool and system usability scale are used to conduct performance and usability testing, respectively. In addition, a replication package is provided to increase the validity and reliability of the results. The main findings revealed that the serverless platforms are different in their architecture. Even though both of them support the same serverless concept, they differ considerably in structure, development, and creations of services. Overall, both the cloud vendors under study provide the same core capabilities one would expect but, there are some differences too. In particular, usability could be improved to extend the market and capture more customers.