[go: up one dir, main page]

CN110071822B - Testing device and testing method for 5G core network infrastructure - Google Patents

Testing device and testing method for 5G core network infrastructure Download PDF

Info

Publication number
CN110071822B
CN110071822B CN201910192649.0A CN201910192649A CN110071822B CN 110071822 B CN110071822 B CN 110071822B CN 201910192649 A CN201910192649 A CN 201910192649A CN 110071822 B CN110071822 B CN 110071822B
Authority
CN
China
Prior art keywords
test
module
interface
network
testing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910192649.0A
Other languages
Chinese (zh)
Other versions
CN110071822A (en
Inventor
龙雨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Next Generation Internet Key Technology And Co ltd Of Erc Of Evaluation And Test Beijing
Original Assignee
Beijing Internet Institute Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Internet Institute Co ltd filed Critical Beijing Internet Institute Co ltd
Priority to CN201910192649.0A priority Critical patent/CN110071822B/en
Publication of CN110071822A publication Critical patent/CN110071822A/en
Application granted granted Critical
Publication of CN110071822B publication Critical patent/CN110071822B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/04Network management architectures or arrangements
    • H04L41/044Network management architectures or arrangements comprising hierarchical management structures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/0876Aspects of the degree of configuration automation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/04Processing captured monitoring data, e.g. for logfile generation
    • H04L43/045Processing captured monitoring data, e.g. for logfile generation for graphical visualisation of monitoring data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/2866Architectures; Arrangements
    • H04L67/30Profiles

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Data Mining & Analysis (AREA)
  • Automation & Control Theory (AREA)
  • Environmental & Geological Engineering (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The invention belongs to the technical field of 5G communication, and particularly relates to a testing device and a testing method for 5G core network infrastructure. The test device comprises: the device comprises a main controller, and a test sub-module, a cache module, a test result display module and a Web configuration interface module which are respectively connected with the main controller, wherein a data storage module is respectively connected with the cache module and the test result display module. The main controller includes: a self-adaptive configuration module; a Web management module; a sub-module control module; and an interface calling module. The test method comprises the following steps: aiming at the function and performance test of a virtual resource pool (NFVI) of a 5G core network, the NFVI of the 5G core network is tested by adopting a micro-service architecture and a non-intrusive mode, and the method comprises the following steps: the method comprises the steps of a virtualized interface consistency test, a virtual machine VM connectivity test, an IPv6 related test, a high available HA test, a network function service chain SFC test, a network element NF life cycle management test and a two-layer and three-layer network performance test.

Description

Testing device and testing method for 5G core network infrastructure
Technical Field
The invention belongs to the technical field of 5G communication, and particularly relates to a testing device and a testing method for 5G core network infrastructure.
Background
The 3GPP confirms that the 5G system Architecture adopts a natural cloud design concept, and key characteristics thereof include Service-based Architecture (SBA), network slicing, and edge computing. The service SBA architecture divides network element functions into fine-grained network services, and a cloud NFV platform lightweight deployment unit is in 'seamless' butt joint, so that agile system architecture support is provided for differentiated service scenes. Network Function Virtualization (NFV) in the prior art is a key technology for operators to realize cloud networking and 5G.
The NFV standard of ETSI is a mainstream architecture specification in the NFV industry at present, and divides the NFV architecture into several main components, such as NFVI, VIM, MANO, OSS/BSS, and VNF, and each component communicates with each other through a protocol specification, thereby implementing agility, automation, and intelligence of the NFV. The main network service function NF network element in 5GC relies on the NFV infrastructure NFVI & VIM to provide the necessary cloud resource pool, and how to ensure that the NFV infrastructure provides a standard, stable resource pool and to effectively test it is a difficult problem in the current NFV development. The 5GC adopts an NFV virtualization architecture, a plurality of network function services (NF Service, NFS) are pulled up in an NFV cloud resource pool, each network element bears certain network functions, and the normal services of the network elements depend on the stable and normal services of the cloud resource pool, such as CPUs, storage and network services of the network elements, so that comprehensive and complete testing needs to be performed on the infrastructure of the 5 GC.
NFV decouples and functionally recombines conventional telecommunication equipment into numerous components, but none of them can be plug and play. The desire to integrate components from different suppliers and optimize their co-operation necessarily adds complexity and affects stability. In addition, there is no uniform standard in the NFV industry, and different standards organizations, open source projects, supplier and operator involvement present technical fragmentation challenges. For example, the classification according to ETSI standard NFV infrastructure nfvi (NFV infrastructure) is: a hardware layer, a virtualization layer, and a virtual resource layer. The three-layer components of the NFVI can be provided by different vendors and combined at will, so that problems such as docking failure and performance optimization inevitably occur in the process of combining the three-layer components, and meanwhile, due to the problem of non-uniform vendor implementation and interface standards, various connectivity problems also occur when the virtual resource layer provides services to the upper layer. Therefore, the difficulties that cannot be overcome by NFV infrastructure are: 1) the interconnection and intercommunication difficulties caused by the non-uniform interface standards of the NFVI virtual resource layer, and 2) the performance bottleneck limitation caused by the insufficient optimization of the NFVI. It is therefore necessary to ensure stability, functionality and performance limitations of NFVI through extensive and repetitive testing.
Disclosure of Invention
In order to solve the technical problems, the invention provides a testing device and a testing method for 5G core network infrastructure.
The test device comprises: the device comprises a main controller, and a test sub-module, a cache module, a test result display module and a Web configuration interface module which are respectively connected with the main controller, wherein a data storage module is respectively connected with the cache module and the test result display module.
The main controller includes:
the self-adaptive configuration module is responsible for configuration and analysis of the test cases;
the Web management module is responsible for analyzing the configuration information issued by the Web configuration page;
the sub-module control module is responsible for creating other micro-service containers and communicating with the micro-service containers;
and the interface calling module is responsible for calling the interface of the third-party tool.
The test submodule carries out aggregation grouping on the functions of specific tests, and comprises the following steps: the method comprises the steps of a virtualized interface consistency test, a virtual machine VM connectivity test, an IPv6 related test, a high available HA test, a network function service chain SFC test, a network element NF life cycle management test and a two-layer and three-layer network performance test.
And after the test is finished, a single functional module in the test sub-module writes a test result into the data storage module, and a first-level cache module is added to reduce the data writing pressure.
The Web configuration interface module is responsible for the configuration generation of a Web display page and test contents of the test device.
The test result display module is used for providing a humanized test result display interface after the test is finished, so that the test result can be conveniently checked, important test data can be screened, and a test report can be exported and generated.
The test device is connected with a 5GC infrastructure to be tested when in use.
The test method comprises the following steps: aiming at the function and performance test of a virtual resource pool (NFVI) of a 5G core network, the NFVI of the 5G core network is tested by adopting a micro-service architecture and a non-intrusive mode, and the method comprises the following steps: the method comprises the steps of a virtualized interface consistency test, a virtual machine VM connectivity test, an IPv6 related test, a high available HA test, a network function service chain SFC test, a network element NF life cycle management test and a two-layer and three-layer network performance test.
The micro-service architecture forms a plurality of test sub-modules by subdividing and clustering the functions of the test components, and is flexibly combined and matched according to test requirements.
And a plurality of the test sub-modules have the function of independently iteratively upgrading test contents.
The invention has the beneficial effects that:
the invention sets a universal NFVI test specification on the basis of investigating standard organizations, operator standard specifications, open source organizations and supplier realization, and aims at the test specification of the 5G core network test device and the test method, the call test of a universal interface can ensure that the compatibility problem can not occur when the basic facility is butted with other upper-layer software, the test of the basic network function ensures that the basic network function can be provided, and the performance limit of the basic facility can be obtained by aiming at the performance test.
The main controller and each test module in the test device are realized by adopting containerized micro-services, the main controller provides an adaptive configuration module for providing a web page, a command line and a third-party integrated calling interface, the test can be started through the three operation modes, the self-adaptive test case selection and configuration are carried out according to the test configuration after the test is started, and the test sub-modules are started in sequence after the content configuration of the test case is finished, so that the serial or parallel calling assembly is supported to test the 5GC infrastructure to be tested. After the test is finished, a test report is generated, log files in the test process are packaged and sent to a specified position, and meanwhile, the test result can be checked in a web interface.
The test submodule has the characteristics of optional use, after use, destruction, quick start, less occupied resources, independent upgrade and the like. The plurality of sub-modules have the function of independent iterative upgrade of test contents, and the upgrade problem caused by the upgrade of the whole test device is avoided. The micro-service architecture forms a plurality of test sub-modules by subdividing and clustering the functions of the test components, and the test sub-modules are flexibly combined and matched according to test requirements. The containerization framework is convenient for quick construction and dismantling of the test environment and parallel execution of the test, saves time, and also solves the problems of inflexible combination of test items, complex construction of the test environment and the like in the test process.
Different from 3G and 4G that implement a core network by using a black box method of physical hardware and software, in the R15 standard of 3GPP, each function of a 5G core network is split into multiple network elements, and the network elements operate in a virtualized resource pool provided by NFVI. The testing device and the testing method disclosed by the invention are also special for testing the functions and the performances of the virtual resource pool NFVI of the 5G core network. The method comprises the following steps of testing the NFVI of the 5G core network by adopting a micro-service architecture and a non-invasive mode, wherein the testing comprises the following steps: and testing a plurality of functions and performances of interface standardization of the infrastructure, basic network function service, IPv6 service, virtual machine cold/hot migration and the like.
Drawings
FIG. 1 is a diagram of a 5GC infrastructure test architecture of the present invention.
FIG. 2 is a detailed architecture diagram of the testing device of the present invention.
FIG. 3 is a flow chart of a 5GC infrastructure test of the present invention.
Detailed Description
The embodiments are described in detail below with reference to the accompanying drawings.
Fig. 1 shows a 5GC infrastructure test system architecture diagram of the present invention, whose main system architecture components include:
1) the Tester of the testing device, its framework is a master controller, control a plurality of modules, include: the test submodule is responsible for testing different functional groups; the cache module is responsible for caching test result records; the data storage module is used for storing a test result; the test result display module previews interface analysis for the test result. The testing device mainly tests 5GC infrastructure;
2) the 5GC infrastructure to be tested provides a virtualized resource pool for the 5GC, and provides services such as virtual computing, virtual network and virtual storage for network elements running on the infrastructure.
The invention describes a Tester of a 5G core network infrastructure and how the Tester tests the 5GC infrastructure NFVI & VIM through a micro service architecture, and the test comprises a test flow, result output, result preview and the like.
The main controller and each test module in the test device are implemented by adopting containerized micro-services, the main controller provides an adaptive configuration module to provide a web page, a command line and a third-party integrated calling interface, the test can be started through the three operation modes, the self-adaptive test case selection and configuration are carried out according to the test configuration after the test is started, and after the content configuration of the test case is completed, the test sub-modules are started in sequence to support serial or parallel calling components to test the 5GC infrastructure to be tested. After the test is finished, a test report is generated, log files in the test process are packaged and sent to a specified position, and meanwhile, the test result can be checked in a web interface.
FIG. 2 is a detailed structure diagram of the testing device
The detailed architecture diagram of the test fixture controller, the master controller test fixture core controller, including: the self-adaptive configuration module is responsible for configuration and analysis of the test cases; the web management module is responsible for analyzing the configuration information issued by the web configuration page; the sub-module control module is responsible for creating other micro-service containers and communicating with the micro-service containers; and the interface calling module is responsible for calling the interface of the third-party tool. The Web configuration interface is responsible for the Web display page of the testing device and the configuration generation of the testing content. The testing sub-module performs aggregation grouping on the functions of specific tests, such as test contents of IPv6 related tests, virtual machine VM connectivity tests, virtualization (openstack, vmware and the like) interface consistency tests, network element NF life cycle management, network function service chain SFC, high-availability HA and the like. The test submodule carries out test item configuration according to the content to be tested and has the characteristics of random selection and use, destruction after use, quick start, less occupied resources, independent upgrade and the like. The single module function writes the test result into the data storage module after the test is completed, and a first-level cache module is added to reduce the data writing pressure in order to avoid the situations of faster data writing and the like. The test result display module is used for providing a humanized test result display interface after the test is finished, so that the test result can be conveniently checked, important test data can be screened, and a test report can be exported and generated.
FIG. 3 is a flow chart of 5GC infrastructure test according to the present invention
Step 1-1: selecting test contents and configuring the test tool through a command line or a web page of the test tool;
step 1-2: starting a test tool, and analyzing the test content configuration file by the test tool;
step 1: 3: judging whether a database and a cache module exist or not, if not, executing the step 1-4, otherwise, executing the step 1-6;
step 1-4: downloading a needed database and a needed cache module mirror image, and then executing the step 1-5;
step 1-5: starting a database and a cache module, importing corresponding configuration files, and then executing the steps 1-6;
step 1-6: judging whether the specified test module mirror image exists, if not, executing the steps 1-7, otherwise, executing the steps 1-8;
step 1-7: downloading a mirror image of a required specified test module, and then executing the step 1-8;
step 1-8: starting a test module mirror image;
step 1-9: checking whether the test module mirror image is successfully started, if the test module mirror image is not successfully started, executing the steps 1-10, otherwise executing the steps 1-11;
step 1-10: reporting error information and error reasons to a main controller node, handing over to manual processing, and then ending the test;
step 1-11: transmitting the test configuration file to the test module;
step 1-12: the test module tests in sequence according to the specified test configuration file;
step 1-13: recording the test results in the steps 1-12, and storing log logs in the test process in a test result database on a Master node;
step 1-14: checking whether the content to be detected still exists, if so, executing the steps 1-6 in a circulating mode until the content to be detected does not exist, and if not, executing the steps 1-15;
step 1-15: outputting the test result to a test report;
step 1-16: packaging the test results includes: uploading logs, configuration files, test results and the like of the test process to a specified position; the NRF returns confirmation information after receiving the information sent in the step 1-15 and finishes the process;
step 1-17: and checking the test result in the test result web interface, and then finishing the test process.
The present invention is not limited to the above embodiments, and any changes or substitutions that can be easily made by those skilled in the art within the technical scope of the present invention are also within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (9)

1. A test apparatus for a 5G core network infrastructure, comprising: the device comprises a main controller, and a test sub-module, a cache module, a test result display module and a Web configuration interface module which are respectively connected with the main controller, wherein a data storage module is respectively connected with the cache module and the test result display module; the main controller and each test module are realized by adopting containerized micro-service;
the main controller includes:
the self-adaptive configuration module is responsible for configuration and analysis of the test cases;
the Web management module is responsible for analyzing the configuration information issued by the Web configuration page;
the sub-module control module is responsible for creating other micro-service containers and communicating with the micro-service containers;
the interface calling module is responsible for calling the interface of the third-party tool; the 5G core network NFVI is tested by adopting a micro-service architecture and a non-invasive mode.
2. The test apparatus of claim 1, wherein the test submodule groups together functions of specific tests, and comprises: the method comprises the steps of a virtualized interface consistency test, a virtual machine VM connectivity test, an IPv6 related test, a high available HA test, a network function service chain SFC test, a network element NF life cycle management test and a two-layer and three-layer network performance test.
3. The test device of claim 1, wherein a single functional module in the test sub-module writes the test result into the data storage module after the test is completed, and adds a first-level cache module to reduce the data writing pressure.
4. The testing device of claim 1, wherein the Web configuration interface module is responsible for Web presentation pages of the testing device and configuration generation of test content.
5. The testing device as claimed in claim 1, wherein the test result displaying module is configured to provide a humanized test result displaying interface for facilitating checking of the test result, screening of important test data and exporting of the test report.
6. A test device according to any one of claims 1 to 5, wherein the test device is connected in use to a 5GC infrastructure under test.
7. The testing method based on the testing apparatus of claim 6, wherein for the function and performance test of the virtual resource pool NFVI of the 5G core network, the testing of the NFVI of the 5G core network is performed by using a micro service architecture and a non-intrusive method, and includes: the method comprises the steps of a virtualized interface consistency test, a virtual machine VM connectivity test, an IPv6 related test, a high available HA test, a network function service chain SFC test, a network element NF life cycle management test and a two-layer and three-layer network performance test.
8. The method of claim 7, wherein the micro-service architecture flexibly combines and collocates the test sub-modules according to test requirements by subdividing and re-clustering the test component functions to form the plurality of test sub-modules.
9. The test method of claim 7, wherein a plurality of the test sub-modules have a test content independent iterative upgrade function.
CN201910192649.0A 2019-03-14 2019-03-14 Testing device and testing method for 5G core network infrastructure Active CN110071822B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910192649.0A CN110071822B (en) 2019-03-14 2019-03-14 Testing device and testing method for 5G core network infrastructure

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910192649.0A CN110071822B (en) 2019-03-14 2019-03-14 Testing device and testing method for 5G core network infrastructure

Publications (2)

Publication Number Publication Date
CN110071822A CN110071822A (en) 2019-07-30
CN110071822B true CN110071822B (en) 2022-03-08

Family

ID=67366135

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910192649.0A Active CN110071822B (en) 2019-03-14 2019-03-14 Testing device and testing method for 5G core network infrastructure

Country Status (1)

Country Link
CN (1) CN110071822B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111147322B (en) * 2019-12-13 2022-06-28 中盈优创资讯科技有限公司 Test system and method for micro service architecture of 5G core network
CN111597117B (en) * 2020-05-22 2022-02-25 厦门理工学院 Automated testing, monitoring and intelligent operation and maintenance system based on open source software
CN112187608B (en) * 2020-06-16 2022-04-08 浪潮云信息技术股份公司 OpenStack-based transparent mode service chain implementation method and system
CN112422330B (en) * 2020-11-06 2023-05-30 北京连星科技有限公司 Method for managing enterprise network IPv6 intergrating migration full life cycle
CN114826928B (en) * 2021-01-21 2024-11-08 中国移动通信有限公司研究院 NFV test processing method, device and related equipment
CN115278739A (en) * 2021-04-29 2022-11-01 中国移动通信集团浙江有限公司 Fault warning method, device, device and computer-readable storage medium
CN115396335B (en) * 2022-08-11 2023-05-16 重庆邮电大学 Industrial wireless network equipment access IPv6 test system and method based on micro-service
CN117785585A (en) * 2024-01-05 2024-03-29 北京卓讯科信技术有限公司 An automated testing method and device for convergence and shunt equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106789393A (en) * 2016-11-16 2017-05-31 武汉烽火网络有限责任公司 A kind of CS frameworks communication equipment automatization test system and method
CN206442390U (en) * 2017-02-22 2017-08-25 广西电网有限责任公司钦州供电局 A kind of data network test platform of the network switch
CN108353004A (en) * 2015-11-12 2018-07-31 是德科技新加坡(控股)私人有限公司 Method, system and computer-readable medium for test network virtualization of function (NFV)
CN109101373A (en) * 2017-06-20 2018-12-28 北京航空航天大学 General-utility test platform based on subscription/publication mode
CN109388530A (en) * 2018-08-22 2019-02-26 华东计算技术研究所(中国电子科技集团公司第三十二研究所) Blade server-oriented automatic test platform and test method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2523338A (en) * 2014-02-20 2015-08-26 Ng4T Gmbh Testing a virtualised network function in a network

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108353004A (en) * 2015-11-12 2018-07-31 是德科技新加坡(控股)私人有限公司 Method, system and computer-readable medium for test network virtualization of function (NFV)
CN106789393A (en) * 2016-11-16 2017-05-31 武汉烽火网络有限责任公司 A kind of CS frameworks communication equipment automatization test system and method
CN206442390U (en) * 2017-02-22 2017-08-25 广西电网有限责任公司钦州供电局 A kind of data network test platform of the network switch
CN109101373A (en) * 2017-06-20 2018-12-28 北京航空航天大学 General-utility test platform based on subscription/publication mode
CN109388530A (en) * 2018-08-22 2019-02-26 华东计算技术研究所(中国电子科技集团公司第三十二研究所) Blade server-oriented automatic test platform and test method

Also Published As

Publication number Publication date
CN110071822A (en) 2019-07-30

Similar Documents

Publication Publication Date Title
CN110071822B (en) Testing device and testing method for 5G core network infrastructure
US11630646B2 (en) Software defined network controller
US10860339B2 (en) Autonomous creation of new microservices and modification of existing microservices
US20210311858A1 (en) System and method for providing a test manager for use with a mainframe rehosting platform
US10977167B2 (en) Application monitoring with a decoupled monitoring tool
US9218231B2 (en) Diagnosing a problem of a software product running in a cloud environment
US10282502B1 (en) Flexible constraint integrated circuit implementation runs
US20170171034A1 (en) Dynamic/on-demand packaging as part of deployment
US10503630B2 (en) Method and system for test-execution optimization in an automated application-release-management system during source-code check-in
CN112162927A (en) Test method, medium and device of cloud computing platform and computing equipment
Cherrueau et al. Enoslib: A library for experiment-driven research in distributed computing
Pino et al. Validation and Benchmarking of CNFs in OSM for pure Cloud Native applications in 5G and beyond
CN113448690A (en) Monitoring method and device
US9513948B2 (en) Automated virtual machine provisioning based on defect state
CN115080135A (en) System for realizing BIOS remote automatic control based on GUI
CN114490337A (en) Commissioning method, commissioning platform, equipment and storage medium
US10983899B2 (en) Automatic configuration and deployment of environments of a system
US20170295085A1 (en) Building and testing composite virtual services using debug automation
US20240193032A1 (en) Performing ci/cd error analysis involving software products that are dependent upon each other
CN107515725B (en) Method and device for sharing disk by core network virtualization system and network management MANO system
CN114996039A (en) Cloud native system joint debugging method, system and medium based on third-party system docking
KR20010087272A (en) Application of automation and procedures to enable high-speed recovery and relocation of computer workloads
US20210141868A1 (en) Heterogeneous-computing based emulator
CN111400196A (en) Method and device for switching project information based on test environment
Pino Martínez Validation and Extension of Kubernetes-based Network Functions (KNFs) in OSM for Cloud Native (CN) applications in 5G and beyond

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20220615

Address after: Room 101, 1st floor, building 5, yard 58, Jinghai fifth road, East Road, economic and Technological Development Zone, Daxing District, Beijing 100176

Patentee after: Next Generation Internet key technology and Co.,Ltd. of ERC of evaluation and test Beijing

Address before: 100176 No.124, 1st floor, area B, No.12, Hongda North Road, Beijing Economic and Technological Development Zone, Daxing District, Beijing

Patentee before: Beijing Internet Institute Co.,Ltd.