[go: up one dir, main page]

Skip to main content

Advertisement

Log in

GHDC: a dual-centric data center network architecture by using multi-port servers with greater incremental scalability

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

As the volume of data keeps growing rapidly, more and more storage devices, servers, and network devices are continuously added into data center networks (DCNs) to store, manage, and analyze the data. The industry experience indicates that, instead of adding a huge number of servers into the DCNs at a time, the DCN can also be expanded gradually by adding a small number of servers from time to time. This paper proposes a new type of dual-centric data center network structure, called GHDC (Generalized Hypercube Data Center network architecture), which is constructed by using commodity switches and multi-port servers. After analyzing the shortest distance between any two vertices, a routing algorithm for GHDC is developed. To achieve incremental scalability, two incomplete GHDC structures are proposed. A small number of servers can be added into the incomplete GHDC structures while their topological properties are maintained. The analysis and experiment results show that GHDC significantly outperform the other DCN structures, such as FatTree, BCube, Platonica, FCell, FSquare, and FRectangle, in terms of the incremental scalability and robustness. The average throughput of GHDC is approximately comparable to that of FatTree, BCube, and FSquare, and is higher than that of Platonica, FCell, and FRectangle by about 130.2%, 17.45% and 25.5%. Compared with the FatTree, BCube, FCell, FRectangle, and FSquare, GHDC reduces the cost by about 68.49%, 78.04%, 10.84%, 22.85%, and 29.55%, and reduces the max energy consumption by about 69.45%, 34.48%, 11.55%, 24.31%, and 29.58%, respectively. The actual energy consumption of GHDC is much lower than that of FatTree, BCube, FCell, FRectangle, and FSquare, and is little higher than that of Platonia.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Data availability

Data will be made available on request.

References

  1. Al-Fares M, Loukissas A, Vahdat Amin (2008) A scalable, commodity data center network architecture. ACM SIGCOMM Comput Commun Rev 38(4):63–74

    Article  Google Scholar 

  2. Greenberg A, Hamilton JR, Jain N, Kandula S, Kim C, Lahiri P, Maltz DA, Patel P, Sengupta S (2009) Vl2: a scalable and flexible data center network. In: Proceedings of the ACM SIGCOMM 2009 Conference on Data Communication, pp 51–62

  3. Ahn JH, Binkert N, Davis A, McLaren M, Schreiber RS (2009) Hyperx: topology, routing, and packaging of efficient large-scale networks. In: Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, pp 1–11

  4. Mysore RN, Pamboris A, Farrington N, Huang N, Miri P, Radhakrishnan S, Subramanya V, Vahdat A (2009) Portland: a scalable fault-tolerant layer 2 data center network fabric. In: Proceedings of the ACM SIGCOMM 2009 Conference on Data Communication, pp 39–50

  5. Feng H, Deng Yuhui, Qin X, Min G (2020) Criso: an incremental scalable and cost-effective network architecture for data centers. IEEE Trans Netw Serv Manag 18(2):2016–2029

    Article  Google Scholar 

  6. Singh A, Ong J, Agarwal A, Anderson G, Armistead Ashby, Bannon R, Boving S, Desai G, Felderman B, Germano P et al (2015) Jupiter rising: a decade of clos topologies and centralized control in google’s datacenter network. ACM SIGCOMM Comput Commun Rev 45(4):183–197

    Article  Google Scholar 

  7. Singla A, Hong C-Y, Popa L, Godfrey PB (2012) Jellyfish: networking data centers randomly. In: Proceedings of the 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI), pp 225–238

  8. Guo C, Lu G, Li D, Wu H, Zhang X, Shi Y, Tian C, Zhang Y, Lu S (2009) Bcube: a high performance, server-centric network architecture for modular data centers. In: Proceedings of the ACM SIGCOMM 2009 Conference on Data Communication, pp 63–74

  9. Guo C, Wu H, Tan K, Shi L, Zhang Y, Lu S (2008) Dcell: a scalable and fault-tolerant network structure for data centers. In: Proceedings of the ACM SIGCOMM 2008 Conference on Data Communication, pp 75–86

  10. Li D, Guo C, Haitao W, Tan K, Zhang Y, Songwu L, Jianping Wu (2010) Scalable and cost-effective interconnection of data-center servers using dual server ports. IEEE/ACM Trans Netw 19(1):102–114

    Article  Google Scholar 

  11. Guo D, Li C, Jie W, Zhou X (2014) Dcube: a family of network structures for containerized data centers using dual-port servers. Comput Commun 53:13–25

    Article  Google Scholar 

  12. Li Z, Yang Yuanyuan (2015) Gbc3: a versatile cube-based server-centric network for data centers. IEEE Trans Parallel Distrib Syst 27(10):2895–2910

    Article  Google Scholar 

  13. Xie J, Deng Y, Min G, Zhou Y (2016) An incrementally scalable and cost-efficient interconnection structure for data centers. IEEE Trans Parallel Distrib Syst 28(6):1578–1592

    Article  Google Scholar 

  14. Li Z, Yang Yuanyuan (2017) A novel network structure with power efficiency and high availability for data centers. IEEE Trans Parallel Distrib Syst 29(2):254–268

    Article  MathSciNet  Google Scholar 

  15. Zhang Z, Deng Y, Min G, Xie J, Yang LT, Zhou Yongtao (2018) Hsdc: a highly scalable data center network architecture for greater incremental scalability. IEEE Trans Parallel Distrib Syst 30(5):1105–1119

    Article  Google Scholar 

  16. Nasirian S, Faghani Farhad (2019) Crystal: a scalable and fault-tolerant archimedean-based server-centric cloud data center network architecture. Comput Commun 147:159–179

    Article  Google Scholar 

  17. Chkirbene Z, Hadjidj Rachid, Foufou S, Hamila R (2020) Lascada: a novel scalable topology for data center network. IEEE/ACM Trans Netw 28(5):2051–2064

    Article  Google Scholar 

  18. Li D, Jie W, Liu Z, Zhang F (2016) Towards the tradeoffs in designing data center network architectures. IEEE Trans Parallel Distrib Syst 28(1):260–273

    Article  Google Scholar 

  19. Nasirian S, Faghani F (2021) Platonica: an efficient and high-performance dual-centric data center network architecture. Clust Comput 24(2):997–1032

    Article  Google Scholar 

  20. Ding Z-L, Guo D-K, Shen J-W, Luo A-M, Luo X-S (2011) Researching data center networking topology for cloud computing. J Natl Univ Def Technol 33(6):1–6

    Google Scholar 

  21. Greenberg A, Lahiri P, Maltz DA, Patel P, Sengupta S (2008) Towards a next generation data center architecture: scalability and commoditization. In: Proceedings of the ACM Workshop on Programmable Routers for Extensible Services of Tomorrow, pp 57–62

  22. Agache A, Deaconescu R, Raiciu C (2015) Increasing datacenter network utilisation with grin. In: Proceedings of 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15), pp 29–42

  23. Greenberg A, Hamilton J, Maltz DA, Patel P (2008) The cost of a cloud: research problems in data center networks

  24. Katseff Howard P (1988) Incomplete hypercubes. IEEE Trans Comput 37(5):604–608

    Article  Google Scholar 

  25. Tzeng N-F (1990) Structural properties of incomplete hypercube computers. In: Proceedings of 10th International Conference on Distributed Computing Systems, pp 262–269

  26. Sen A, Sengupta A, Bandyopadhyay S (1993) On some topological properties of hypercube, incomplete hypercube and supercube. In: Proceedings of the Seventh International Parallel Processing Symposium, pp 636–642

  27. Yang L, Muppala JK, Veeraraghavan M, Lin D, Hamdi M (2013) Data center networks: topologies, architectures and fault-tolerance characteristics. Springer Science & Business Media, Berlin

    Google Scholar 

  28. Sydney A, Scoglio C, Schumm P, Kooij R (2008) Elasticity: topological characterization of robustness in complex networks. arXiv preprint arXiv:0811.4040

  29. Dean J (2006) Experiences with mapreduce, an abstraction for large-scale computation

  30. Bilal K, Manzano M, Khan SU, Calle E, Li K, Zomaya AY (2013) On the characterization of the structural robustness of data center networks. IEEE Trans Cloud Comput 1(1):1–1

    Article  Google Scholar 

  31. Xie J, Deng Y (2016) Mtcloudsim: a flow-level network simulator for multi-tenant cloud. In: Proceedings of 2016 IEEE 22nd International Conference on Parallel and Distributed Systems (ICPADS), pp 332–339

  32. Al-Fares M, Radhakrishnan S, Raghavan B, Huang N, Vahdat A, et al. (2010) Hedera: dynamic flow scheduling for data center networks. In: Proceedings of the 7th USENIX Conference on Networked Systems Design and Implementation, pp 89–92

  33. Benson T, Akella A, Maltz DA (2010) Network traffic characteristics of data centers in the wild. In: Proceedings of the 10th ACM SIGCOMM Conference on Internet Measurement, pp 267–280

  34. Zol. http://www.zol.com.cn

  35. Ieee-802-3bt. https://silvertel.com/ieee-802-3bt-the-new-4-pair-standard-of-poe-current-standards/

Download references

Funding

This work has partially supported by the National Natural Science Foundation (NSF) of China under Grant (No. 61872165, No. 62072214, and No. 62172189), the Natural Science Foundation of Guangdong Province (No. 2020A1515010619), Guangdong Basic and Applied Basic Research Foundation under Grant (No. 2021B1515120048), Science and technology Program of Guangzhou (202002030372), Industry-Academia-Research Innovation Fund for Chinese Universities (No. 2020ITA05047).

Author information

Authors and Affiliations

Authors

Contributions

PZ contributed to methodology, experiment evaluation. L-XL contributed to methodology, supervision. T-JH contributed to writing—reviewing and editing. ZZ contributed to conceptualization, writing—original draft preparation.

Corresponding author

Correspondence to Zhen Zhang.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Ethical approval

This article is not a study about animal or human, and there is no any experiment about animals or humans in this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, P., Lin, L., He, T. et al. GHDC: a dual-centric data center network architecture by using multi-port servers with greater incremental scalability. J Supercomput 79, 9932–9963 (2023). https://doi.org/10.1007/s11227-023-05046-0

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-023-05046-0

Keywords

Navigation