Abstract
Public clouds like AWS, Azure, GCP, and OCI offer a range of services including Container as a Service (CaaS) and Relational Database as a Service (RDBaaS). From the perspective of an IT system provider there is a notable lack of information on the overall performance that can be achieved when using specific configurations of these interdependent CaaS and RDBaaS services. To address this issue and avoid incorrect architectural assumptions, it was decided to empirically evaluate the combined performance offered by CaaS and RDBaaS services, considering their hardware configurations selected based on a predetermined cost constraint.
The experiments were conducted in two stages. The first stage was aimed at narrowing down the set of investigated CaaS and RDBaaS services. Using the measurements collected in the second stage, a statistical analysis was performed, comparing the performance achieved in the cloud environments with the performance obtained in the on-premise environment, taking cost constraints into account.
The experiments conducted for the cloud services provided insights into their limitations and performance, enabling informed architectural decisions during the design of complex IT systems. The results of the analysis confirmed that the performance obtained for the studied combinations of services and their associated costs significantly varied among the different cloud providers.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Version number 43863 was used in the experiments. For those interested in reproducing or expanding upon the conducted experiments, the application image and its API specification may be provided upon email request.
References
Siegel, J., Perdue, J.: Cloud services measures for global use: the service measurement index (SMI). In: Annual SRII Global Conference (2012). https://doi.org/10.1109/SRII.2012.51
Garg, S.K., Versteeg, S., Buyya, R.: A framework for ranking of cloud computing services. Future Gener. Comput. Syst. 29 (2013). https://doi.org/10.1016/j.future.2012.06.006
Cloud Mercato’s Manifesto. https://dochub.cloud-mercato.com/manifesto/. Accessed June 2023
SPEC Cloud IaaS 2018. https://www.spec.org/benchmarks.html. Accessed Aug 2023
Fraś, M., Kwiatkowski, J., Staś, M.: A study on effectiveness of processing in computational clouds considering its cost. In: Proceedings International Conference on Information Systems Architecture and Technology – ISAT 2019 (2019). https://doi.org/10.1007/978-3-030-30440-9_25
Kwiatkowski, J., Fraś, M.: A cost based approach for multiservice processing in computational clouds. In: Proceedings 22nd International Conference on Enterprise Information Systems (ICEIS) (2020). https://doi.org/10.5220/0009780304320441
Papadopoulos, A.V., et al.: Methodological principles for reproducible performance evaluation in cloud computing. IEEE Trans. Software Eng. 47(8) (2019). https://doi.org/10.1109/TSE.2019.2927908
Cloud Computing Study. Market report, Foundry, form. IDG Communications (2022)
Dimitri, N.: Pricing cloud IaaS computing services. J. Cloud Comp. 9(14) (2020). https://doi.org/10.1186/s13677-020-00161-2
Makhlouf, R.: Cloudy transaction costs: a dive into cloud computing economics. J. Cloud Comp. 9(1) (2020). https://doi.org/10.1186/s13677-019-0149-4
Stupar, I., Huljenic, D.: Model-based cloud service deployment optimisation method for minimisation of application service operational cost. J. Cloud Comp. 12(23) (2023). https://doi.org/10.1186/s13677-023-00389-8
Sumic, Z., Harrison, K.: Magic quadrant for meter data management products. Market report, Gartner (2018)
Cochran, W.G., Cox, G.M.: Experimental Designs. 2nd edn. Wiley (1957)
Satterthwaite, F.E.: An approximate distribution of estimates of variance components. Biometrics Bull. 2(6), 110–114 (1946). https://doi.org/10.2307/3002019
Mann, H., Whitney, D.: On a test of whether one of two random variables is stochastically larger than the other. Ann. Math. Stat. 18(1), 50–60 (1947). https://doi.org/10.1214/aoms/1177730491
Wilcoxon, F.: Some rapid approximate statistical procedures. Ann. N. Y. Acad. Sci. 52(6), 808–814 (1950). https://doi.org/10.1111/j.1749-6632.1950.tb53974.x
Acknowledgments
Part of this work has been funded by the European Regional Development Fund under the Smart Growth Operational Programme (contract number POIR.01.01.01-00-0112/21-00), www.sygnity.pl/dotacje.
The authors would like to thank all members of the Sygnity Spectra project for their contribution to the development of the test application, construction of research environments and conducting experiments.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 IFIP International Federation for Information Processing
About this paper
Cite this paper
Karwaczyński, P., Wasielewski, M., Kwiatkowski, J. (2023). Comparison of Performance and Costs of CaaS and RDBaaS Services. In: Papadopoulos, G.A., Rademacher, F., Soldani, J. (eds) Service-Oriented and Cloud Computing. ESOCC 2023. Lecture Notes in Computer Science, vol 14183. Springer, Cham. https://doi.org/10.1007/978-3-031-46235-1_6
Download citation
DOI: https://doi.org/10.1007/978-3-031-46235-1_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-46234-4
Online ISBN: 978-3-031-46235-1
eBook Packages: Computer ScienceComputer Science (R0)
