[go: up one dir, main page]
Skip to main content

Advertisement

SpringerLink
Log in

Infrastructure Manager: A TOSCA-Based Orchestrator for the Computing Continuum

  • Research
  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

The edge-to-cloud continuum involves heterogeneous computing resources, including low-power physical devices, Virtual Machines (VMs) in cloud management platforms and serverless computing services based on the FaaS (Functions as a Service) model. This requires novel strategies to describe and efficiently deploy complex applications that execute across the computing continuum. To this end, this paper introduces the developments in the Infrastructure Manager (IM), an open-source TOSCA-based orchestrator to provision and configure virtualized computing resources from a wide range of cloud platforms. By supplementing TOSCA with additional types, the IM can also provision from FaaS platforms across the computing continuum by leveraging public cloud services such as AWS Lambda and on-premises serverless platforms, such as OSCAR. This allows event-driven data-processing applications across multiple computing platforms and architectures. The evolution of the Infrastructure Manager is described to accommodate the definition in TOSCA of complex applications that span across the computing continuum and their automated provisioning and configuration using Infrastructure as Code (IaC) approaches. Its effectiveness is assessed through a real use case involving a machine-learning classifier application for assisting in the early diagnosis of Rheumatic Heart Disease (RHD). The results show that the new developments enable the IM to efficiently deploy complete application architectures described in TOSCA across the computing continuum, from VMs to FaaS services.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Ren, J., Yu, G., He, Y., Li, G.Y.: Collaborative cloud and edge computing for latency minimization. IEEE Trans. Veh. Technol. 68(5), 5031–5044 (2019)

    Article  Google Scholar 

  2. Jansen, M., Al-Dulaimy, A., Papadopoulos, A.V., Trivedi, A., Iosup, A.: The SPEC-RG reference architecture for the compute continuum. arXiv:2207.04159 (2022). https://doi.org/10.48550/ARXIV.2207.04159

  3. Deng, S., Zhao, H., Fang, W., Yin, J., Dustdar, S., Zomaya, A.Y.: Edge intelligence: The confluence of edge computing and artificial intelligence. IEEE Internet Things J. 7(8), 7457–7469 (2020)

    Article  Google Scholar 

  4. Schleier-Smith, J., Sreekanti, V., Khandelwal, A., Carreira, J., Yadwadkar, N.J., Popa, R.A., Gonzalez, J.E., Stoica, I., Patterson, D.A.: What serverless computing is and should become: The next phase of cloud computing. Commun. ACM 64(5), 76–84 (2021)

    Article  Google Scholar 

  5. Momcheva, I.: Working with the hubble space telescope public data on amazon eb services. Astron Data Anal Softw Syst XXVII 523, 671 (2019)

    Google Scholar 

  6. Muhammad, W., Esposito, F., Maimaitijiang, M., Sagan, V., Bonaiuti, E.: Polly: A tool for rapid data integration and analysis in support of agricultural research and education. Internet Things 9, 100141 (2020). https://doi.org/10.1016/j.iot.2019.100141

    Article  Google Scholar 

  7. Cinaglia, P., Vázquez-Poletti, J.L., Cannataro, M.: Serverless computing for rnaseq data analysis. In: 2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 2175–2181 (2022). IEEE

  8. Risco, S., Moltó, G., Blanquer, I.: Serverless workflows for containerised applications in the cloud continuum. J. Grid Comput. 19(3) (2021). https://doi.org/10.1007/s10723-021-09570-2

  9. Pérez, A., Risco, S., Naranjo, D.M., Caballer, M., Moltó, G.: On-premises serverless computing for event-driven data processing applications. In: 2019 IEEE 12th International Conference on Cloud Computing (CLOUD), pp. 414–421 (2019). https://doi.org/10.1109/CLOUD.2019.00073

  10. Pérez, A., Moltó, G., Caballer, M., Calatrava, A.: Serverless computing for container-based architectures. Futur Gener Comput Syst 83, 50–59 (2018). https://doi.org/10.1016/j.future.2018.01.022

    Article  Google Scholar 

  11. Caballer, M., Blanquer, I., Moltó, G., Alfonso, C.: Dynamic management of virtual infrastructures. J. Grid Comput. 13(1), 53–70 (2015). https://doi.org/10.1007/s10723-014-9296-5

    Article  Google Scholar 

  12. Palma, D., Rutkowski, M., Spatzier, T.: Tosca simple profile in yaml version 1.0. OASIS Comm. Spec. 1, 20 (2016)

    Google Scholar 

  13. Foundation, E.S., Academies, A.E.: The European Code of Conduct for Research Integrity. European Science Foundation, Berlin, Germany (2011)

    Google Scholar 

  14. Santana-Perez, I., Silva, R.F., Rynge, M., Deelman, E., Pérez-Hernández, M.S., Corcho, O.: Reproducibility of execution environments in computational science using semantics and clouds. Futur Gener Comput Syst 67, 354–367 (2017)

    Article  Google Scholar 

  15. Ullah, A., Dagdeviren, H., Ariyattu, R.C., DesLauriers, J., Kiss, T., Bowden, J.: Micado-edge: Towards an application-level orchestrator for the cloud-to-edge computing continuum. J. Grid Comput. 19(4), 1–28 (2021)

    Article  Google Scholar 

  16. Tusa, F., Clayman, S.: End-to-end slices to orchestrate resources and services in the cloud-to-edge continuum. Futur Gener Comput Syst 141, 473–488 (2023). https://doi.org/10.1016/j.future.2022.11.026

    Article  Google Scholar 

  17. Spătaru, A., Iuhasz, G., Panica, S.: Tufa: A tosca extension for the specification of accelerator-aware applications in the cloud continuum. In: 2022 IEEE 46th Annual Computers, Software, and Applications Conference (COMPSAC), pp. 1178–1183 (2022). IEEE

  18. Anser, Y., Gaber, C., Wary, J.-P., García, S.N.M., Bouzefrane, S.: Trails: Extending tosca nfv profiles for liability management in the cloud-to-iot continuum. In: 2022 IEEE 8th International Conference on Network Softwarization (NetSoft), pp. 321–329 (2022). IEEE

  19. Grossi,V., Trasarti, R., Dazzi, P.: Data science workflows for the cloud/edge computing continuum. In: Proceedings of the 1st Workshop on Flexible Resource and Application Management on the Edge, pp. 41–44 (2020)

  20. Wurster, M., Breitenbücher, U., Képes, K., Leymann, F., Yussupov,V.: Modeling and automated deployment of serverless applications using tosca. In: 2018 IEEE 11th Conference on Service-oriented Computing and Applications (SOCA), pp. 73–80 (2018). IEEE

  21. Yussupov, V., Soldani, J., Breitenbücher, U., Leymann, F.: Standards-based modeling and deployment of serverless function orchestrations using bpmn and tosca. Softw. Pract. Exper. 52(6), 1454–1495 (2022)

    Article  Google Scholar 

  22. Dehury, C.K., Jakovits, P., Srirama, S.N., Giotis, G., Garg, G.: Toscadata: Modeling data pipeline applications in tosca. J. Syst. Softw. 186, 111164 (2022)

    Article  Google Scholar 

  23. Caballer, M., Antonacci, M., Šustr, Z., Perniola, M., Moltó, G.: Deployment of elastic virtual hybrid clusters across cloud sites. J. Grid Comput. 19, 4 (2021). https://doi.org/10.1007/s10723-021-09543-5

    Article  Google Scholar 

  24. Caballer, M., Chatziangelou, M., Calatrava, A., Moltó, G., Pérez, A.: IM integration in the EGI VMOps Dashboard. In: EGI Conference 2017 and INDIGO Summit 2017 (2017). https://indico.egi.eu/event/3249/contributions/7473/

  25. Salomoni, D., Campos, I., Gaido, L., Lucas, J.M., Solagna, P., Gomes, J., Matyska, L., Fuhrman, P., Hardt, M., Donvito, G., et al.: Indigo-datacloud: A platform to facilitate seamless access to e-infrastructures. J. Grid Comput. 16, 381–408 (2018)

    Article  Google Scholar 

  26. Lahiff, A., Witt, S., Caballer, M., La Rocca, G., Pamela, S., Coster, D.: Running htc and hpc applications opportunistically across private, academic and public clouds. In: EPJ Web of Conferences, vol. 245, pp. 07032 (2020). EDP Sciences

  27. Caballer, M., Antonacci, M., Šustr, Z., Perniola, M., Moltó, G.: Deployment of elastic virtual hybrid clusters across cloud sites. J. Grid Comput. 19(1), 4 (2021)

    Article  Google Scholar 

  28. Caballer, M., de Alfonso, C., Alvarruiz, F., Moltó, G.: Ec3: Elastic cloud computing cluster. J. Comput. Syst. Sci. 79(8), 1341–1351 (2013). https://doi.org/10.1016/j.jcss.2013.06.005

  29. Alvarruiz, F., Alfonso, C., Caballer, M., Hern’ndez, V.: An energy manager for high performance computer clusters. In: 2012 IEEE 10th International Symposium on Parallel and Distributed Processing with Applications, pp. 231–238 (2012). https://doi.org/10.1109/ISPA.2012.38

  30. OpenFog Consortium Architecture Working Group, A., et al.: Openfog reference architecture for fog computing. OPFRA001 20817, 162 (2017)

  31. Blanquer, I., Brasileiro, F., Brito, A., Calatrava, A., Carvalho, A., Fetzer, C., Figueiredo, F., Guimarães, R.P., Marinho, L., Meira, W., Silva, A., Alberich-Bayarri, Camacho-Ramos, E., Jimenez-Pastor, A., Ribeiro, A.L.L., Nascimento, B.R., Silva, F.: Federated and secure cloud services for building medical image classifiers on an intercontinental infrastructure. Futur. Gener. Comput. Syst. 110, 119–134 (2020). https://doi.org/10.1016/j.future.2020.04.012

    Article  Google Scholar 

  32. Lopes, E.L., Beaton, A.Z., Nascimento, B.R., Tompsett, A., Dos Santos, J.P., Perlman, L., Diamantino, A.C., Oliveira, K.K., Oliveira, C.M., Nunes, Md.C.P., et al.: Telehealth solutions to enable global collaboration in rheumatic heart disease screening. J. Telemed. Teleca. 24, 101–109 (2018)

    Article  Google Scholar 

  33. Nascimento, B.R., Beaton, A.Z., Nunes, M.C.P., Diamantino, A.C., Carmo, G.A., Oliveira, K.K., Oliveira, C.M., Meira, Z.M.A., Castilho, S.R.T., Lopes, E.L., et al.: Echocardiographic prevalence of rheumatic heart disease in brazilian schoolchildren: Data from the provar study. Int. J. Cardiol. 219, 439–445 (2016)

    Article  Google Scholar 

Download references

Acknowledgements

Grant PID2020-113126RB-I00 funded by MCIN/AEI/10.13039/501100011033. Also, Project PDC2021-120844-I00 funded by MCIN/AEI/10.13039/501100011033 and by the European Union NextGenerationEU/PRTR. This work was partially supported by the project AI-SPRINT “AI in Secure Privacy-Preserving Computing Continuum” which has received funding from the European Union’s Horizon 2020 Research and Innovation Programme under Grant 101016577 and by the AI4EOSC “Artificial Intelligence for the European Open Science Cloud” that has received funding from the European Union’s Horizon Europe Research and Innovation Programme under Grant 101058593. Finally, Amanda wants to thank the support received by the Universitat Politècnica de València for the project “Extensión de modelos de computaciń en cloud en entornos confiables y altamente distribuidos”, from the PAID-10-20 postdoctoral program.

Author information

Authors and Affiliations

  1. Instituto de Instrumentación para Imagen Molecular (I3M), Centro mixto CSIC - Universitat Politècnica de València, Valencia, Spain

    Miguel Caballer, Germán Moltó, Amanda Calatrava & Ignacio Blanquer

Authors
  1. Miguel Caballer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Germán Moltó
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Amanda Calatrava
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ignacio Blanquer
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Miguel Caballer, Amanda Calatrava and Germán Moltó wrote the main manuscript text. Miguel Caballer prepared all the figures. Ignacio Blanquer and Germán Moltó reviewed the manuscript.

Corresponding author

Correspondence to Miguel Caballer.

Ethics declarations

Competing interests

The authors declare that they have no competing interests as defined by Springer, or other interests that might be perceived to influence the results and/or discussion reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Caballer, M., Moltó, G., Calatrava, A. et al. Infrastructure Manager: A TOSCA-Based Orchestrator for the Computing Continuum. J Grid Computing 21, 51 (2023). https://doi.org/10.1007/s10723-023-09686-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10723-023-09686-7

Keywords

Search

Navigation