Abstract
Monitoring Quality of Service (QoS) compliance is an important procedure in web service environment. It determines whether users’ expectations are met, and becomes the vital factor for them to decide whether to continue paying for the service or not. The monitoring is performed by checking the actual services performance against the QoS stated in Service Level Agreement (SLA). In relation to that, the need for monitoring vague QoS specifications in SLA has become more apparent nowadays. This paper reviews the published literature on web services QoS monitoring. A total of 60 selected articles were systematically analyzed. There were 23 of the articles selected through restrictive search criteria while the other 37 were selected based on unrestrictive search criteria. The review shows that little evidence exists on monitoring vague QoS specifications of web services. Providing ability for monitoring QoS that is specified vaguely in SLA could give new insights and implications to web services field. This paper concludes with some recommended future works to construct the theory and perform the empirical research.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Allenotor D, Thulasiram RK (2008) A fuzzy grid-QoS framework for obtaining higher grid resources availability. In: Proceedings of the 3rd international conference on advances in grid and pervasive computing, pp 128–139
Ameller D, Franch X (2008) Service level agreement monitor (SALMon). Seventh international conference on the composition-based software systems, ICCBSS 2008, pp 224–227
Angelov S, Grefen P (2004) The business case for B2B e-contracting. In: Proceedings of the 6th international conference on electronic commerce, pp 31–40
Artaiam N, Senivongse T (2008) Enhancing service-side QoS monitoring for web services. In: Proceedings of the ninth ACIS international conference on the software engineering, artificial intelligence, networking, and parallel/distributed computing, pp 765–770
Asadollah SA, Thiam KC (2011) Web service response time monitoring: architecture and validation. Theor Math Found Comput Sci Commun Comput Inf Sci 164: 276–282
Baazizi MA, Sebahi S, Hacid M-S, Benbernou S, Papazoglou M (2008) Monitoring web services: a database approach. Towards a service-based internet. Lect Notes Comput Sci 5377/2008: 98–109
Bacciu D, Buscemi MG, Mkrtchyan L (2010) Adaptive fuzzy-valued service selection. In: Proceedings of the 2010 ACM symposium on applied computing, pp 2467–2471
Beeri C, Eyal A, Milo T, Pilberg A (2007) Monitoring business processes with queries. In: Proceedings of the 33rd international conference on very large data bases, pp 603–614
Castillo O, Melin P (2002) A new hybrid approach for plant monitoring and diagnostics combining type-2 fuzzy logic and fractal theory. In: Proceedings of the 2002 annual meeting of the North American Fuzzy Information Processing Society, NAFIPS, pp 111–116
Chen L, Ha W, Zhang G (2009) A new web service evaluation model with fuzzy C-means artificial immune network memory classifier. In: Proceedings of the 2009 international conference on computational intelligence and security, vol 2, pp 25–29
Chen J, Jia J, Duan L (2011) DOM semantic expansion-based extraction of topical information from web pages. Lect Notes Comput Sci 6988/2011: 343–350
Cheng W, Hongbing W (2007) Uncertainty-aware QoS description and selection model for web services. In: Proceedings of the IEEE international conference on services computing, pp 154–161
Chou L-D, Chen C-C, Tseng P-C (2009) Design and implementation of a policy-based monitoring system for web services. J Inf Sci Eng 25(5): 1357–1372
Chung L, Sampaio do Prado Leite JC (2009) On non-functional requirements in software engineering. Lect Notes Comput Sci 5600/2009: 363–379
Coccoli M, Vercelli G, Vivanet G (2012) Semantic wiki: A collaborative tool for instructional content design. J E-Learn Knowl Soc 8(2): 113–122
Coles A, Coles AJ, Clark A, Gilmore S (2011) Cost-sensitive concurrent planning under duration uncertainty for service-level agreements. In: Proceedings of the 21st international conference on automated planning and scheduling, pp 34–41
Dereli T, Baykasoglu A, Altun K, Durmusoglu A, Türksen IB (2010) Industrial applications of type-2 fuzzy sets and systems: a concise review. Comput Ind 62(2): 125–137
Du R, Zhao P (2011) Subjective trust evaluation model based on preferences. Commun Comput Inf Sci 215(2): 466–472
Eze B, Kuziemsky C, Peyton L, Middleton G, Mouttham A (2010) Policy-based data integration for e-health monitoring processes in a B2B environment: experiences from Canada. J Theor Appl Electron Commer Res 5(1): 56–70
Golshan F, Barforoush AA (2009) A new approach for tracing quality attributes in service oriented architecture using graph transformation systems. In: Proceedings of the 14th international computer conference, CSICC 2009, pp 10–16
Grouès V, Naudet Y, Kao O (2011) Combining linguistic values and semantics to represent user preferences. The 6th international workshop on semantic media adaptation and personalization, pp 27–32
Guo N, Gao T, Zhang B (2008) A trusted quality of web services management framework based on six dimensional QoWS model and end-to-end monitoring. Lect Notes Comput Sci 5297:437–440
Halima RB, Guennoun K, Drira K, Jmaiel M (2008) Providing predictive self-healing for web services: a QoS monitoring and analysis-based approach. J Inf Assur Secur 3: 175–184
Halima RB, Fki E, Drira K, Jmaiel M (2010) A large-scale monitoring and measurement campaign for Web Services-based applications. Concurr Comput Pract Exp 22(10): 1207–1222
Hassanzadeh A, Namdarian L, Elahi S (2011) Developing a framework for evaluating service oriented architecture governance (SOAG). Knowl Based Syst 24(5): 716–730. doi:10.1016/j.knosys.2011.02.012
Hettne K, Soiland-Reyes S, Klyne G, Belhajjame K, Gamble M, Bechhofer S, Roos M, Corcho O (2012) Workflow forever: semantic web semantic models and tools for preserving and digitally publishing computational experiments. In: Proceedings of the 4th semantic web applications and tools for the life sciences, pp 36–37
Heward G, Müller I, Jun H, Schneider J-G, Versteeg S (2010) Assessing the performance impact of service monitoring. In: Proceedings of the 21st Australian software engineering conference, IEEE Computer Society, pp 192–201
International Data Corporation (IDC) (2012) IDC cloud research, International Data Corporation. http://www.idc.com/prodserv/idc_cloud.jsp. Accessed 21 June 2012
Jiao Y, Li L, Ye N (2011) Towards a lightweight SOA framework for enterprise cloud computing. The 15th international conference on computer supported cooperative work in design, pp 386–392
Kalavathy GM, Seethalakshmi P (2009) Parallel performance monitoring service for dynamically composed media web services. J Comput Sci 5:487–492
Keller A, Ludwig H (2003) The WSLA framework: specifying and monitoring service level agreements for web services. J Netw Syst Manag 11(1): 57–81
Khaxar M, Jalili S (2012) WSCMon: runtime monitoring of web service ochestration based on refinement checking. Serv Oriented Comput Appl 6(1): 1–17
Lee M, Kim W, Park S (2012) Searching and rankinxg method of relevant resources by user intention on the semantic web. Expert Syst Appl Int J 39(4): 4111–4121
Leff A, Rayfield JT, Dias DM (2003) Service-level agreements and commercial grids. IEEE Internet Comput 7(4): 44–50
Leitner P, Wetzstein B, Rosenberg F, Michlmayr A, Dustdar S, Leymann F (2009) Runtime prediction of service level agreement violations for composite services. In: Proceedings of the 2009 international conference on service-oriented computing, pp 176–186
Leitner P, Michlmayr A, Rosenberg F, Dustdar S (2010) Monitoring, prediction and prevention of SLA violations in composite services. In: Proceedings of the 2010 IEEE international conference on web services, pp 369–376
Liang S. (2011) The design and realization of cloud computing framework model based on SOA. Adv Mater Res 171(172): 696–701
Lim J, Lee KH (2010) Constructing composite web services from natural language requests. Web Semant 8(1): 1–13. doi:10.1016/j.websem.2009.09.007
Liu Z, Squillante MS, Wolf JL (2001) On maximizing service-level-agreement profits. In: Proceedings of the 3rd ACM conference on electronic commerce, pp 213–223
Liu G-Q, Zhu Z-L, Liu Y (2012) Quality analysis and monitoring strategy research for web service in the internet. Technol Educ Learn Adv Intell Soft Comput 136: 541–548
Lukasiewicz T, Straccia U (2008) Managing uncertainty and vagueness in description logics for the semantic web. Web Semant 6(4): 291–308
Mendel JM (2003) Fuzzy sets for words: a new beginning. In: Proceedings of the 12th IEEE international conference on fuzzy systems, vol 1, pp 37–42
Mendel JM (2007) Computing with words: Zadeh, Turing, Popper and Occam. IEEE Comput Intell Mag 2(4): 10–17
Michlmayr A, Rosenberg F, Leitner P, Dustdar S (2009) Comprehensive QoS monitoring of web services and event-based SLA violation detection. In: Proceedings of the 4th international workshop on middleware for service oriented computing, pp 1–6
Michlmayr A, Rosenberg F, Leitner P, Dustdar S (2010) End-to-end support for QoS-aware service selection, binding, and mediation in VRESCo. IEEE Trans Serv Comput 3(3): 193–205
Microsoft News Center (2012) Cloud computing to create 14 million new jobs by 2015, Microsoft. http://www.microsoft.com/en-us/news/features/2012/mar12/03-05CloudComputingJobs.aspx. Accessed 20 June 2012
Mobedpour D, Chen D (2011) User-centered design of a QoS-based web service selection system. Serv Oriented Comput Appl 1–11. doi:10.1007/s11761-011-0091-x
Modica GD, Tomarchio O, Vita L (2009) Dynamic SLAs management in service oriented environments. J Syst Softw 82(5): 759–771
Muller C, Resinas M, Ruiz-Cortes A (2009) Explaining the non-compliance between templates and agreement offers in WS-Agreement. In: Proceedings of the 7th international joint conference on service-oriented computing, pp 237–252
Nagy W, Mokhtar HMO, El-Bastawissy A (2011) A flexible tool for web service selection in service oriented architecture. Int J Adv Comput Sci Appl 2(12): 191–201
Patel SV, Pandey K (2010) Design of SOA based framework for collaborative cloud computing in wireless sensor networks. Int J Grid High Perform Comput 2(3): 60–73
Porter G, Katz RH (2006) Effective web service load balancing through statistical monitoring. Commun ACM Self Manag Syst 49(3): 48–54
Queiroz M, Moura A, Sauve J, Bartolini C, Hickey M (2009) A model for decision support in business-driven IT service portfolio management using SLA-dependent criteria and under uncertainty. In: Proceedings of the international conference on management of emergent digital ecosystems. doi:10.1145/1643823.1643874
Raimondi F, Skene J, Emmerich W, Wozna B (2007) A methodology for online monitoring non-functional specification of web-services. The first international workshop on property verification for software components and services (PROVECS’07), pp 50–59
Raimondi F, Skene J, Emmerich W (2008) Efficient online monitoring of web-service SLAs. In: Proceedings of the 16th ACM SIGSOFT international symposium on foundations of software engineering, pp 170–180
Reiff-Marganiec S, Yu HQ, Tilly M (2009) Service selection based on non-functional properties. Service-oriented computing—ICSOC 2007 workshops, pp 128–138
Rosario S, Benveniste A, Haar S, Jard C (2008) Probabilistic QoS and soft contracts for transaction-based web services orchestrations. IEEE Trans Serv Comput 1(4): 187–200
Rouached M, Perrin O, Godart C (2005) A contract-based approach for monitoring collaborative web services using commitments in the event calculus. Web Inf Syst Eng Lect Notes Comput Sci 3806/2005: 426–434
Saxena N, Goel A, Singh D (2009) A probe-based observability mechanism for monitoring of web services. Int J Recent Trends Eng 1(1): 600–602
Schaefer J (2006) An approach for fine-grained web service performance monitoring. Distrib Appl Interoperable Syst Lect Notes Comput Sci 4025/2006: 169–180
Sepulveda R, Castillo O, Melin P, Rodriguez-Diaz A, Montiel O (2007) Experimental study of intelligent controllers under uncertainty using type-1 and type-2 fuzzy logic. Inf Sci Int J 177(10): 2023–2048. doi:10.1016/j.ins.2006.10.004
Sherchan W, Loke SW, Krishnaswamy S (2006) A fuzzy model for reasoning about reputation in web services. In: Proceedings of the 2006 ACM symposium on applied computing, pp 1886–1892
Shin D-H, Lee K-H, Suda T (2009) Automated generation of composite web services based on functional semantics. Web Semant Sci Serv Agents World Wide Web 7(4): 332–343. doi:10.1016/j.websem.2009.05.001
Simmonds J, Gan Y, Chechik M, Nejati S, O’Farrell B, Litani E, Waterhouse J (2009) Runtime monitoring of web service conversations. IEEE Trans Serv Comput 2(3): 223–244
Stavropoulos TG, Vrakas D, Vlahavas I (2011) A survey of service composition in ambient intelligence environments. Artif Intell Rev 1–24. doi:10.1007/s10462-011-9283-1
Stoilos G, Stamou G, Pan JZ (2010) Fuzzy extensions of OWL: logical properties and reduction to fuzzy description logics. Int J Approx Reason 51(6): 656–679
Tao Q, Chang H-Y, Gu C-Q, Yi Y (2012) A novel prediction approach for trustworthy QoS of web services. Expert Syst Appl Int J 39(3): 3676–3681. doi:10.1016/j.eswa.2011.09.060
Tseng JCR, Wu C-H (2007) An expert system approach to improving stability and reliability of web service. Expert Syst Appl Int J 33(2): 379–388. doi:10.1016/j.eswa.2006.05.024
Wang K, Takahashi A (2012) Semantic web based innovative design knowledge modeling for collaborative design. Expert Syst Appl Int J 39(5): 5616–5624
Wang Q, Shao J, Deng F, Liu Y, Li M, Han J, Mei H (2009) An online monitoring approach for web service requirements. IEEE Trans Serv Comput 2(4): 338–351
Wang P, Chao K-M, Lo C-C (2010) On optimal decision for QoS-aware composite service selection. Expert Syst Appl Int J 37(1): 440–449. doi:10.1016/j.eswa.2009.05.070
Wetzstein B, Leitner P, Rosenberg F, Brandic I, Dustdar S, Leymann F (2009) Monitoring and analyzing influential factors of business process performance. In: Proceedings of the 2009 IEEE international enterprise distributed object computing conference (EDOC 2009), pp 141–150
Wu G, Wei J, Huang T (2008) Flexible pattern monitoring for WS-BPEL through stateful aspect extension. In: Proceedings of the 2008 IEEE international conference on web services, pp 577–584
Wu H, Li Z, Zhang H, Yang C, Shen S (2010) Monitoring and evaluating the quality of web map service resources for optimizing map composition over the internet to support decision making. Comput Geosci 37(4): 485–494
Yan S, Shang J, Liu L (2011) Design and implementation of status monitoring system for e-learning web service. Commun Comput Inf Sci 233: 158–165
Yang Y, Luo D, Zhang C (2010) A multiple system performance monitoring model for web services. Agents Data Min Interact Lect Notes Comput Sci 5980/2010: 149–161
Yeom G, Tsai W-T, Bai X, Lee Y (2009) Design of a contract-based web services QoS management system. The 29th IEEE international conference on distributed computing systems workshops, pp 306–311
Yeom G, Tsai W-T, Bai X, Lee Y (2011) A design of policy-based composite web services QoS monitoring system. Int J Crit Comput Based Syst 2(1): 79–91
Yu L (2007) Applying software wrapping on performance monitoring of web services. INFOCOMP J Comput Sci 6(3): 1–6
Zadeh LA (1975) The concept of a linguistic variable and its application to approximate reasoning—1. Inf Sci 8: 199–249
Zadeh MH, Seyyedi MA (2010) Qos monitoring for web services by time series forecasting. 2010 3rd IEEE international conference on computer science and information technology (ICCSIT), pp 659–663
Zadeh MH, Seyyedi MA (2011) Applying a predictive approach for QoS monitoring in web service. Commun Comput Inf Sci 142(1): 237–241
Zahoor E, Perrin O, Godart C (2009) An integrated declaratve approach to web services composition and monitoring. Lect Notes Comput Sci 5802:247–260
Zeng L, Lei H, Chang H (2007) Monitoring the QoS for web services. Serv Oriented Comput Lect Notes Comput Sci 4749/2007: 132–144
Zhou C, Chia L-T, Lee BS (2004) DAML-QoS ontology for web services. In: Proceedings of the IEEE international conference on web services, 2004, pp 472–479
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hasan, M.H., Jaafar, J. & Hassan, M.F. Monitoring web services’ quality of service: a literature review. Artif Intell Rev 42, 835–850 (2014). https://doi.org/10.1007/s10462-012-9358-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10462-012-9358-7