Abstract
Inter-grid is a composition of small interconnected grid domains; each has its own local broker. The main challenge is to devise appropriate job scheduling policies that can satisfy goals such as global load balancing together with maintaining the local policies of the different domains. Existing inter-grid methodologies are based on either centralised meta-scheduling or decentralised scheduling which carried is out by local brokers, but without proper coordination. Both are suitable interconnecting grid domains, but breaks down when the number of domains become large. Earlier we proposed Slick, a scalable resource discovery and job scheduling technique for broker based interconnected grid domains, where inter-grid scheduling decisions are handled by gateway schedulers installed on the local brokers. This paper presents a decentralised scheduling technique for the Slick architecture, where cross-grid scheduling decisions are made using a fuzzy-logic based algorithm. The proposed technique is tested through simulating its implementation on 512 interconnected Condor pools. Compared to existing techniques, our results show that the proposed technique is better at maintaining the overall throughput and load balancing with increasing number of interconnected grids.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Foster, I., Kesselman, C., Tuecke, S.: The anatomy of the grid: Enabling scalable virtual organizations. International J. Supercomputer Applications 15(3) (2001)
Yeo, C.S., Buyya, R., de Assuno, M.D., Yu, J., Sulistio, A., Venugopal, S., Placek, M.: Utility Computing on Global Grids, pp. 110–130. John Wiley and Sons, Inc. (2007)
Ranjan, R.: Coordinated resource provisioning in federated grids. Ph.D. dissertation, The University of Melbourne, Australia (July 2007)
Evers, X., de Jongh, J.F.C.M., Boontje, R., Epema, D.H.J., van Dantzig, R.: Condor flocking: Load sharing between pools of workstations. Department of Technical Mathematics and Informatics, Delft University of Technology, Delft, The Netherlands, Tech. Rep. (1993)
C. for High Throughput Computing, HTCondor Version 7.9.3 Manual, University of Wisconsin-Madison (January 16, 2013)
Laure, E., et al.: Programming the Grid with gLite. CERN, Geneva, Tech. Rep. (March 2006)
Frey, J., Tannenbaum, T., Livny, M., Foster, I., Tuecke, S.: Condor-g: A computation management agent for multi-institutional grids. Cluster Computing 5(3), 237–246 (2002)
Schuller, B., et al.: Chemomentum - unicore 6 based infrastructure for complex applications in science and technology. In: Bougé, L., Forsell, M., Träff, J.L., Streit, A., Ziegler, W., Alexander, M., Childs, S. (eds.) Euro-Par Workshops 2007. LNCS, vol. 4854, pp. 82–93. Springer, Heidelberg (2008)
Buyya, R., Abramson, D., Giddy, J.: Nimrod/g: An architecture for a resource management and scheduling system in a global computational grid. In: Procee. HPC ASIA 2000, pp. 283–289 (2000)
Schopf, J.: Ten actions when superscheduling. In: Global Grid Forum. (2001)
Butt, A.R., Zhang, R., Hu, Y.C.: A self-organizing flock of condors. Journal of Parallel and Distributed Computing 66(1), 145–161 (2006)
Weissman, J.B., Grimshaw, A.S.: A federated model for scheduling in wide-area systems. In: Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing, HPDC 1996, p. 542. IEEE Computer Society, Washington, DC (1996)
Shan, H., Oliker, L., Biswas, R.: Job superscheduler architecture and performance in computational grid environments. In: Proc. of the 2003 ACM/IEEE Conference on Supercomputing (SC), pp. 44–58 (2003)
Daval-Frerot, C., Lacroix, M., Guyennet, H.: Federation of resource traders in objects-oriented distributed systems. In: Proceedings of the International Conference on Parallel Computing in Electrical Engineering, PARELEC 2000, p. 84. IEEE Computer Society, Washington, DC (2000)
Lai, K., Rasmusson, L., Adar, E., Zhang, L., Huberman, B.A.: Tycoon: An implementation of a distributed, market-based resource allocation system. Multiagent Grid Syst. 1(3), 169–182 (2005)
Azab, A., Meling, H.: Slick: A coordinated job allocation technique for inter-grid architectures. In: 7th European Modelling Symposium, EMS (November 2013)
Vahdat, A., Becker, D.: Epidemic routing for partially connected ad hoc networks. Duke University, Tech. Rep. (July 2000)
Montresor, A., Jelasity, M.: PeerSim: A scalable P2P simulator. In: Proc. of the 9th Int. Conference on Peer-to-Peer (P2P 2009), Seattle, WA, pp. 99–100 (September 2009)
Litzkow, M., Livny, M., Mutka, M.: Condor - A hunter of idle workstations. In: Proceedings of the 8th International Conference of Distributed Computing Systems (June 1988)
Aiftimiei, C., Andreetto, P., Bertocco, S., Dalla Fina, S., Dorigo, A., Frizziero, E., Gianelle, A., Marzolla, M., Mazzucato, M., Sgaravatto, M., Traldi, S., Zangrando, L.: Design and implementation of the glite cream job management service. Future Gener. Comput. Syst. 26(4), 654–667 (2010)
NorduGrid: Nordic Testbed for Wide Area Computing and Data Handling, http://www.nordugrid.org/
Rowstron, A., Druschel, P.: Pastry: Scalable, decentralized object location, and routing for large-scale peer-to-peer systems. In: Guerraoui, R. (ed.) Middleware 2001. LNCS, vol. 2218, pp. 329–350. Springer, Heidelberg (2001)
Stoica, I., Morris, R., Liben-nowell, D., Karger, D.R., Kaashoek, M.F., Dabek, F., Balakrishnan, H.: Chord: A scalable peer-to-peer lookup protocol for internet applications. IEEE/ACM Transactions on Networking 11, 17–32 (2003)
Raman, R., Livny, M., Solomon, M.: Matchmaking: Distributed resource management for high throughput computing. In: Proceedings of the Seventh IEEE International Symposium on High Performance Distributed Computing (HPDC7), Chicago, IL (July 1998)
2.5 Submitting a Job, http://research.cs.wisc.edu/htcondor/manual/v7.8/
Takagi, T., Sugeno, M.: Fuzzy identification of systems and its applications to modeling and control. IEEE Transactions on Systems, Man and Cybernetics 15, 116–132 (1985)
Bode, B., Halstead, D.M., Kendall, R., Lei, Z., Jackson, D.: The portable batch scheduler and the maui scheduler on linux clusters. In: Proceedings of the 4th Annual Linux Showcase & Conference, ALS 2000, vol. 4, p. 27. USENIX Association, Berkeley (2000)
Azab, A., Meling, H.: Decentralized service allocation in a broker overlay based grid. In: Jaatun, M.G., Zhao, G., Rong, C. (eds.) Cloud Computing. LNCS, vol. 5931, pp. 200–211. Springer, Heidelberg (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 IFIP International Federation for Information Processing
About this paper
Cite this paper
Azab, A., Meling, H., Davidrajuh, R. (2014). A Fuzzy-Logic Based Coordinated Scheduling Technique for Inter-grid Architectures. In: Magoutis, K., Pietzuch, P. (eds) Distributed Applications and Interoperable Systems. DAIS 2014. Lecture Notes in Computer Science(), vol 8460. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-43352-2_14
Download citation
DOI: https://doi.org/10.1007/978-3-662-43352-2_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-43351-5
Online ISBN: 978-3-662-43352-2
eBook Packages: Computer ScienceComputer Science (R0)