WO2022100146A1 - 互联网性能监控方法及系统 - Google Patents
互联网性能监控方法及系统 Download PDFInfo
- Publication number
- WO2022100146A1 WO2022100146A1 PCT/CN2021/107783 CN2021107783W WO2022100146A1 WO 2022100146 A1 WO2022100146 A1 WO 2022100146A1 CN 2021107783 W CN2021107783 W CN 2021107783W WO 2022100146 A1 WO2022100146 A1 WO 2022100146A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- circuit
- leased
- grouping
- performance
- circuits
- Prior art date
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 56
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000011156 evaluation Methods 0.000 claims abstract description 54
- 238000004364 calculation method Methods 0.000 claims abstract description 16
- 239000010410 layer Substances 0.000 claims description 18
- 238000013209 evaluation strategy Methods 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 14
- 239000012792 core layer Substances 0.000 claims description 14
- 230000006855 networking Effects 0.000 claims description 11
- 238000012545 processing Methods 0.000 claims description 5
- 238000012423 maintenance Methods 0.000 abstract description 13
- 238000004891 communication Methods 0.000 description 8
- 230000002159 abnormal effect Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000002776 aggregation Effects 0.000 description 2
- 238000004220 aggregation Methods 0.000 description 2
- 230000002354 daily effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000003449 preventive effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/04—Network management architectures or arrangements
- H04L41/044—Network management architectures or arrangements comprising hierarchical management structures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0893—Assignment of logical groups to network elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0823—Errors, e.g. transmission errors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
- H04L43/0888—Throughput
Definitions
- the present application relates to the technical field of Internet operation and maintenance, and in particular, to a method and system for monitoring Internet performance.
- the present application provides an Internet performance monitoring method and system, which are used to solve the defect in the prior art that only manual monitoring of leased circuits and dedicated lines can be performed.
- the present application provides an Internet performance monitoring method, including:
- the traffic monitoring result of the leased circuit corresponding to the preset evaluation target is obtained.
- a strategy grouping on the set of leased lines to be tested based on a circuit resource grouping strategy to obtain a circuit strategy grouping which specifically includes:
- the set of leased-line circuits to be tested is divided into leased-line circuits or leased-line circuit groups.
- the extraction of the endpoint information of each circuit in the set of leased-line circuits to be tested, as well as the level information of the actual networking specifically includes:
- the device type corresponding to the generation termination point is the device of the network convergence layer, the regional core layer and the IDC device layer;
- a circuit group is generated from the uplink trunk circuit and the interconnect trunk circuit.
- dividing the set of leased-line circuits to be tested into leased-line circuits or leased-line circuit groups based on the endpoint information and the level information specifically including:
- both ends of the leased circuit are non-supercore devices, then compare the basic configuration data of the network, and divide the circuits with the same equipment and the same circuit type at both ends of the leased circuit into a group;
- the devices at both ends of the leased line circuit are grouped according to the preset special character segment;
- circuit groups are grouped and named according to the preset naming rules.
- dividing the set of leased-line circuits to be tested into leased-line circuits or leased-line circuit groups based on the endpoint information and the level information further comprising:
- the circuit group connected to the hyper-core device is divided into a first set, and the circuit group connected to the regional core layer is divided into a second set gather.
- the performance collection calculation evaluation strategy is applied to the circuit tactical grouping to obtain a set of circuit performance evaluation indicators, which specifically includes:
- the obtaining of the traffic monitoring result of the leased circuit corresponding to the preset evaluation target based on the set of circuit performance evaluation indicators specifically includes:
- the application also provides an Internet performance monitoring system, including:
- a grouping module configured to strategically group the set of leased-line circuits to be tested based on a circuit resource grouping strategy to obtain circuit strategic grouping
- an evaluation module configured to apply a performance acquisition calculation evaluation strategy to the circuit strategic grouping to obtain a set of circuit performance evaluation indicators
- the processing module is configured to obtain the traffic monitoring result of the leased circuit corresponding to the preset evaluation target based on the set of circuit performance evaluation indicators.
- the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and running on the processor, the processor implementing the program as described above when the processor executes the program. Describe the steps of the Internet performance monitoring method.
- the present application further provides a non-transitory computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the steps of any of the foregoing Internet performance monitoring methods.
- the Internet performance monitoring method and system provided by the present application can help network operation and maintenance personnel to detect the traffic of the customer leased port exceeding the preset threshold in advance through the grouping strategy and the performance monitoring strategy, so as to detect the hidden fault in advance.
- 1 is a schematic flowchart of a method for monitoring Internet performance provided by the application
- Fig. 2 is the structural representation of a kind of Internet performance monitoring system provided by the application
- FIG. 3 is a schematic structural diagram of an electronic device provided by the present application.
- the present application analyzes the complex network topology structure, the scheduling correlation information of customer leased lines, and the SLA (Service Level Agreement) monitoring indicators of customer leased lines.
- the Internet private line performance monitoring 95 traffic charging standard is the collection reference standard, and the P95 monitoring resource grouping strategy of the operator's Internet leased circuit is proposed to provide automatic and scientific means for the real-time performance early warning of leased line customers.
- the 95-traffic billing here refers to the number of leased lines that rank the top 5% of the inflow traffic of the port at the 5-minute collection point with 24 hours as the statistical interval.
- FIG. 1 is a schematic flowchart of a method for monitoring Internet performance provided by the present application, as shown in FIG. 1 , including:
- the information of leased circuits is collected within the scope of maintenance and monitoring, ranging from dozens of lines for a single user to hundreds of thousands of lines for group users.
- the circuit resource grouping strategy is applied to group the leased circuit set according to the strategy, which provides a more targeted grouping basis for the subsequent performance evaluation.
- a performance collection calculation evaluation strategy is adopted to generate a set of circuit performance evaluation indicators.
- the traffic monitoring results corresponding to the preset evaluation targets of the network are extracted from the set of circuit performance evaluation indicators obtained in the above steps, so as to provide a rationalized reference for subsequent expansion of the high-load circuit.
- the embodiment of the present application can accurately and scientifically analyze the abnormal communication failure warning of the customer's leased line circuit, which is convenient for maintenance personnel to take preventive measures in advance, so as to reduce the interruption of the customer's leased line service. risks of.
- step S2 in the method specifically includes:
- the set of leased-line circuits to be tested is divided into leased-line circuits or leased-line circuit groups.
- the extraction of the endpoint information of each circuit in the set of leased-line circuits to be tested, as well as the level information of the actual networking specifically includes:
- the device type corresponding to the generation termination point is the device of the network convergence layer, the regional core layer and the IDC device layer;
- a circuit group is generated from the uplink trunk circuit and the interconnect trunk circuit.
- the set of leased-line circuits to be tested is divided into leased-line circuits or leased-line circuit groups, specifically including:
- both ends of the leased circuit are non-supercore devices, then compare the basic configuration data of the network, and divide the circuits with the same equipment and the same circuit type at both ends of the leased circuit into a group;
- the devices at both ends of the leased line circuit are grouped according to the preset special character segment;
- circuit groups are grouped and named according to the preset naming rules.
- dividing the set of leased-line circuits to be tested into leased-line circuits or leased-line circuit groups based on the endpoint information and the level information further comprising:
- the circuit group connected to the hyper-core device is divided into a first set, and the circuit group connected to the regional core layer is divided into a second set gather.
- the leased circuit of Internet customers includes two parts: leased circuit and leased circuit group in the network operation and maintenance process, and each circuit has a starting point (A end) and a termination point (Z end)
- the equipment of the leased circuit may pass through three layers or two layers of the network aggregation layer, the regional core layer and the IDC device layer. This policy will be based on the layer of the specific network device.
- Strategize groups with circuit types The detailed strategies are divided as follows:
- the first is to set the preconditions, including: group the leased circuit A and Z terminals with the same equipment and circuit type into a group; only generate the equipment with the Z terminal equipment types as the aggregation layer, regional core layer and IDC; only the uplink Trunk circuits and interconnected trunk circuits generate circuit groups.
- the grouping strategy including: if the devices at both ends of the leased line are non-supercore devices, compare and divide according to the basic configuration data collected by the network, and directly divide the leased line with the same equipment and the same circuit type at both ends of the leased line. Group;
- the circuit group generation is relatively special, and grouping is performed according to the preset special character fields in the circuit description, such as special characters such as bjXXXX and bjX1X1;
- circuit group name is: circuit group name::A device name::Z device name::circuit type::Z device name::A device name:: circuit type;
- IDC devices that is, connected to the area core and connected to the super core device, need to divide the circuit group connected to the super core into one set, and the circuit group connected to the area core is divided into another. in a collection.
- circuit resource grouping strategy by applying the circuit resource grouping strategy, numerous circuit resources in the network are uniformly divided and classified, so as to facilitate the subsequent efficient evaluation of network load performance in a targeted manner.
- step S3 in the method specifically includes:
- the data needs to generate summary data every day according to circuit changes, and the summary data needs to meet the requirements of the 95 charging standard.
- the calculation algorithm is as follows:
- the embodiment of the present application performs network performance evaluation from multiple dimensions by applying a performance collection and calculation evaluation strategy, and obtains multiple quantitative indicators, which provides strong data support for subsequent operation and maintenance.
- the Internet performance monitoring system provided by the present application will be described below, and the Internet performance monitoring system described below and the Internet performance monitoring method described above may refer to each other correspondingly.
- FIG. 2 is a schematic structural diagram of an Internet performance monitoring system provided by the present application, as shown in FIG. 2 , including: an acquisition module 21, a grouping module 22, an evaluation module 23 and a processing module 24; wherein:
- the obtaining module 21 obtains the set of leased-line circuits to be tested; the grouping module 22 is used to strategically group the set of leased-line circuits to be tested based on the circuit resource grouping strategy to obtain a circuit tactical grouping; the evaluation module 23 is used to classify the circuit strategy The performance collection and calculation evaluation strategy is applied into groups, and a set of circuit performance evaluation indicators is obtained; the processing module 24 is configured to obtain the traffic monitoring result of the leased circuit corresponding to the preset evaluation target based on the set of circuit performance evaluation indicators.
- the embodiment of the present application can accurately and scientifically analyze the abnormal communication fault warning of the leased line circuit of the customer, which is convenient for maintenance personnel to take preventive measures in advance, so as to reduce the interruption of the customer leased line service. risks of.
- FIG. 3 illustrates a schematic diagram of the physical structure of an electronic device.
- the electronic device may include: a processor (processor) 310, a communication interface (Communications Interface) 320, a memory (memory) 330 and a communication bus 340,
- the processor 310 , the communication interface 320 , and the memory 330 communicate with each other through the communication bus 340 .
- the processor 310 can call the logic instructions in the memory 330 to execute the Internet performance monitoring method, the method includes: acquiring a set of leased lines to be tested; and performing policy grouping on the set of leased lines to be tested based on a circuit resource grouping strategy, to obtain The circuit is strategically grouped; a performance collection, calculation and evaluation strategy is applied to the circuit strategic grouping to obtain a set of circuit performance evaluation indicators; based on the set of circuit performance evaluation indicators, a traffic monitoring result of the leased circuit corresponding to a preset evaluation target is obtained.
- the above-mentioned logic instructions in the memory 330 may be implemented in the form of software functional units and may be stored in a computer-readable storage medium when sold or used as an independent product.
- the technical solution of the present application can be embodied in the form of a software product in essence, or the part that contributes to the prior art or the part of the technical solution.
- the computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application.
- the aforementioned storage medium includes: U disk, mobile hard disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes .
- the present application also provides a computer program product, the computer program product comprising a computer program stored on a non-transitory computer-readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer
- the computer can execute the Internet performance monitoring method provided by the above methods, and the method includes: acquiring a set of leased-line circuits to be tested; performing policy grouping on the set of leased-line circuits to be tested based on a circuit resource grouping strategy to obtain a circuit policy grouping; applying a performance collection, calculation and evaluation strategy to the circuit strategic grouping to obtain a set of circuit performance evaluation indicators; and based on the set of circuit performance evaluation indicators, to obtain traffic monitoring results of leased circuits corresponding to preset evaluation targets.
- the present application also provides a non-transitory computer-readable storage medium on which a computer program is stored, the computer program being implemented by a processor to execute the Internet performance monitoring methods provided above, the method comprising: Obtaining a set of leased-line circuits to be tested; performing strategic grouping on the set of leased-line circuits to be tested based on a circuit resource grouping strategy to obtain a circuit tactical grouping; applying a performance acquisition, calculation and evaluation strategy to the circuit tactical grouping to obtain a circuit performance evaluation A set of indicators; based on the set of circuit performance evaluation indicators, a traffic monitoring result of the leased circuit corresponding to a preset evaluation target is obtained.
- the device embodiments described above are only illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed over multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment. Those of ordinary skill in the art can understand and implement it without creative effort.
- each embodiment can be implemented by means of software plus a necessary general hardware platform, and certainly can also be implemented by hardware.
- the above-mentioned technical solutions can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products can be stored in computer-readable storage media, such as ROM/RAM, magnetic A disc, an optical disc, etc., includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform the methods described in various embodiments or some parts of the embodiments.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
本申请提供一种互联网性能监控方法及系统,包括:获取待测租线电路集合;基于电路资源分组策略对所述待测租线电路集合进行策略分组,得到电路策略化分组;对所述电路策略化分组应用性能采集计算评估策略,得到电路性能评估指标集合;基于所述电路性能评估指标集合,获得租线电路对应于预设评价目标的流量监控结果。本申请通过分组策略和性能监控策略可以帮助网络运维人员提早发现客户租线端口超过预设阈值的流量,进行隐性故障的提早发现。
Description
相关申请的交叉引用
本申请要求于2020年11月10日提交的申请号为202011248027.4,发明名称为“互联网性能监控方法及系统”的中国专利申请的优先权,其通过引用方式全部并入本文。
本申请涉及互联网运维技术领域,尤其涉及一种互联网性能监控方法及系统。
随着通信技术和计算机技术的高速发展,近两年视频业务和5G业务发展的如火如荼,各行各业都在积极推动自身信息化建设从而带动业务的模式升级乃至结构转型,比如移动办公、智能调度、视频会议、监测监控、企业网站、视频监控、IP电话、在线教育、异地容灾等等,而业务承载的网络也要求高带宽、高并发,大量集群处理给集团大客户专线的管理带来了新的挑战。
在“面向业务、面向客户”转型,提升网络服务质量的前提下,面对运营商复杂的网络组网,几十万的租线电路业务出租,对于单客户来说,租线也从几十条到成百条不等,运维人员的日常维护工作量繁重,手动逐一电路性能查询的运维手段已经不能满足每日的维护日常工作,如何能够满足不同客户的个性需求以及建立有效的专线网络监控成为迫在眉睫需要解决的问题,因此需要设计一种面向客户网络服务的全程性能监控方式,变被动为主动,在客户投诉之前第一时间发现高负载运行,预警隐形故障并及时定位处理,提高网络运维的效率。
发明内容
本申请提供一种互联网性能监控方法及系统,用以解决现有技术中仅能通过人工进行租线电路专线监控的缺陷。
第一方面,本申请提供一种互联网性能监控方法,包括:
获取待测租线电路集合;
基于电路资源分组策略对所述待测租线电路集合进行策略分组,得到电路策略化分组;
对所述电路策略化分组应用性能采集计算评估策略,得到电路性能评估指标集合;
基于所述电路性能评估指标集合,获得租线电路对应于预设评价目标的流量监控结果。
优选地,所述基于电路资源分组策略对所述待测租线电路集合进行策略分组,得到电路策略化分组,具体包括:
提取所述待测租线电路集合中每条电路的端点信息,以及实际组网的层级信息;
基于所述端点信息和所述层级信息,将所述待测租线电路集合划分为租线电路或租线电路组。
优选地,所述提取所述待测租线电路集合中每条电路的端点信息,以及实际组网的层级信息,具体包括:
提取每条电路的起始点信息和终止点信息,以及所述实际组网中的网络汇聚层、区域核心层和IDC设备层;
将所述起始点信息相同和所述终止点信息相同,以及电路类型相同的电路划分为一组;
生成终止点对应的设备类型为所述网络汇聚层、所述区域核心层和所述IDC设备层的设备;
将上联中继电路和互联中继电路生成电路组。
优选地,所述基于所述端点信息和所述层级信息,将所述待测租线电路集合划分为租线电路或租线电路组,具体包括:
若判断获知租线电路两端均为非超核设备,则根据网络基础配置数据进行比较,将租线电路两端设备相同和电路类型相同的电路划分为一组;
若判断获知租线电路的起始点设备为超核设备,则根据预设特殊字符段将租线电路两端的设备进行分组;
待划分完毕,按照预设命名规则进行电路组分组命名。
优选地,所述基于所述端点信息和所述层级信息,将所述待测租线电路集合划分为租线电路或租线电路组,还包括:
若判断获知IDC设备即连接了区域核心层,又连接了所述超核设备,则将连接所述超核设备的电路组划分第一集合,连接所述区域核心层的电路组划分为第二集合。
优选地,所述对所述电路策略化分组应用性能采集计算评估策略,得到电路性能评估指标集合,具体包括:
根据预设时间粒度采集电路设备的端口性能数据,并对所述端口性能数据进行存储和入库;
汇总所述端口性能数据,选择开始时间和结束时间,提取所述电路策略化分组的分组粒度;
基于所述分组粒度获取所述端口性能数据的流量汇总数据、波动图和所述预设时间粒度的明细数据;
统计所述流量汇总数据、所述波动图和所述预设时间粒度的明细数据中从高到低位于预设排名范围的数据,得到所述电路性能评估指标集合。
优选地,所述基于所述电路性能评估指标集合,获得租线电路对应于预设评价目标的流量监控结果,具体包括:
若判断获知所述电路性能评估指标集合超过所述预设评价目标的范围,则认为租线电路存在隐性故障。
第二方面,本申请还提供一种互联网性能监控系统,包括:
获取模块,获取待测租线电路集合;
分组模块,用于基于电路资源分组策略对所述待测租线电路集合进行策略分组,得到电路策略化分组;
评估模块,用于对所述电路策略化分组应用性能采集计算评估策略,得到电路性能评估指标集合;
处理模块,用于基于所述电路性能评估指标集合,获得租线电路对应于预设评价目标的流量监控结果。
第三方面,本申请还提供一种电子设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现如上述任一种所述互联网性能监控方法的步骤。
第四方面,本申请还提供一种非暂态计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现如上述任一种所述互联网性能监控方法的步骤。
本申请提供的互联网性能监控方法及系统,通过分组策略和性能监控策略可以帮助网络运维人员提早发现客户租线端口超过预设阈值的流量,进行隐性故障的提早发现。
为了更清楚地说明本申请或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是本申请提供的一种互联网性能监控方法的流程示意图;
图2是本申请提供的一种互联网性能监控系统的结构示意图;
图3是本申请提供的电子设备的结构示意图。
为使本申请的目的、技术方案和优点更加清楚,下面将结合本申请中的附图,对本申请中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
针对现有技术中对于互联网性能监控手段的不足,本申请从复杂的网络组网的拓扑结构、客户租线电路的调度关联信息、客户租线的SLA(Service Level Agreement,服务级别协议)监控指标为重要参考和准则,互联网专线性能监控95流量计费标准为采集参考标准,提出运营商互联网租线电路的P95监控资源分组策略,为租线客户的实时性能预警提供自动、科学的手段。此处的95流量计费指的是以24小时为统计区间,统计5分钟采集点的端口的流入流量排名前5%的专线数量。
图1是本申请提供的一种互联网性能监控方法的流程示意图,如图1 所示,包括:
S1,获取待测租线电路集合;
在维护监控范围内采集租线电路的信息,从单用户的几十条规模到集团用户的几十万条线路规模不等。
S2,基于电路资源分组策略对所述待测租线电路集合进行策略分组,得到电路策略化分组;
首先应用电路资源分组策略对租线电路集合进行策略分组,为后续的性能评估提供更有针对性地分组依据。
S3,对所述电路策略化分组应用性能采集计算评估策略,得到电路性能评估指标集合;
在策略分组中,采用性能采集计算评估策略,生成电路性能评估指标集合。
S4,基于所述电路性能评估指标集合,获得租线电路对应于预设评价目标的流量监控结果。
最后从上述步骤中得到的电路性能评估指标集合中提取出对应于网络预设评价目标的流量监控结果,为高负载电路的后续扩容提供合理化参考依据。
本申请实施例通过采用电路资源分组策略和性能采集计算评估策略,可准确、科学的分析出客户租线电路的通信故障异常预警,便于维护人员提前采取预防措施,以降低客户租线业务发生中断的风险。
基于上述实施例,该方法中步骤S2具体包括:
提取所述待测租线电路集合中每条电路的端点信息,以及实际组网的层级信息;
基于所述端点信息和所述层级信息,将所述待测租线电路集合划分为租线电路或租线电路组。
优选地,所述提取所述待测租线电路集合中每条电路的端点信息,以及实际组网的层级信息,具体包括:
提取每条电路的起始点信息和终止点信息,以及所述实际组网中的网络汇聚层、区域核心层和IDC设备层;
将所述起始点信息相同和所述终止点信息相同,以及电路类型相同的 电路划分为一组;
生成终止点对应的设备类型为所述网络汇聚层、所述区域核心层和所述IDC设备层的设备;
将上联中继电路和互联中继电路生成电路组。
其中,所述基于所述端点信息和所述层级信息,将所述待测租线电路集合划分为租线电路或租线电路组,具体包括:
若判断获知租线电路两端均为非超核设备,则根据网络基础配置数据进行比较,将租线电路两端设备相同和电路类型相同的电路划分为一组;
若判断获知租线电路的起始点设备为超核设备,则根据预设特殊字符段将租线电路两端的设备进行分组;
待划分完毕,按照预设命名规则进行电路组分组命名。
其中,所述基于所述端点信息和所述层级信息,将所述待测租线电路集合划分为租线电路或租线电路组,还包括:
若判断获知IDC设备即连接了区域核心层,又连接了所述超核设备,则将连接所述超核设备的电路组划分第一集合,连接所述区域核心层的电路组划分为第二集合。
具体地,在网络管理过程中,互联网客户租线电路在网络运维过程中包括租线电路和租线电路组两部分,每一条电路都有起始点(A端)和终止点(Z端)的两端信息,租线电路的设备根据实际的网络组网,可能经过网络汇聚层、区域核心层及IDC设备层三个层级或者某两个层级,本策略将根据具体的网络设备所处层级和电路类型进行策略化组,详细策略划分如下:
首先是设置前提条件,包括:将租线电路A、Z端设备相同、电路类型相同的电路分为一组;仅生成Z端设备类型为汇聚层、区域核心层和IDC的设备;只有上联中继电路和互联中继电路生成电路组。
然后应用分组策略,包括:若租线两端设备均为非超核设备,根据网络采集的基础配置数据进行比较划分,直接将租线电路两端设备相同、电路类型相同的电路专线分为一组;
若租线两端设备中,其中A端设备为超核设备,电路组生成比较特殊,根据电路描述中的预设特殊字符段,例如bjXXXX和bjX1X1等特殊字符 进行分组;
待分组完成后,采用预设命名规则进行电路组分组命名,电路组名为:电路组名称::A设备名称::Z设备名称::电路类型::Z设备名称::A设备名称::电路类型;
还有对于异常情况的处理,部分IDC设备,即连接了区核又连接了超核设备,在呈现时需要将连接超核的电路组划分到一个集合中,连接区核的电路组划分到另一个集合中。
本申请实施例通过应用电路资源分组策略,将网络中众多的线路资源进行了统一划分和归类,便于后续有针对性地进行网络负载性能的高效评估。
基于上述任一实施例,该方法中步骤S3具体包括:
根据预设时间粒度采集电路设备的端口性能数据,并对所述端口性能数据进行存储和入库;
汇总所述端口性能数据,选择开始时间和结束时间,提取所述电路策略化分组的分组粒度;
基于所述分组粒度获取所述端口性能数据的流量汇总数据、波动图和所述预设时间粒度的明细数据;
统计所述流量汇总数据、所述波动图和所述预设时间粒度的明细数据中从高到低位于预设排名范围的数据,得到所述电路性能评估指标集合。
具体地,在上述实施例的基础上,租线电路根据电路资源分组策略生成分组后,数据需要每天根据电路变化情况生成汇总数据,汇总数据需要满足95计费标准要求,计算算法如下:
从设备采集5分钟粒度的端口性能数据,然后进行存储和入库处理;根据电路数据,对性能数据进行汇总,选择开始时间和结束时间,根据电路的所处分组粒度,要能呈现该粒度的(设备、集合、电路组、电路)的流量汇总数据、波动图、5分钟粒度明细,汇总要求出统计时段内,针对5分钟采集点的值进行排序,从高值到低值排名前5%的值;在统计时段内,针对5分钟采集点的值进行排序,从高值开始的,排名前三的值;具体的性能数据的模型指标如表1所示:
表1
本申请实施例通过应用性能采集计算评估策略,从多维度进行网络性能评估,得出多个量化指标,为后续运维提供了强有力的数据支撑。
下面对本申请提供的互联网性能监控系统进行描述,下文描述的互联网性能监控系统与上文描述的互联网性能监控方法可相互对应参照。
图2是本申请提供的一种互联网性能监控系统的结构示意图,如图2所示,包括:获取模块21、分组模块22、评估模块23和处理模块24;其中:
获取模块21获取待测租线电路集合;分组模块22用于基于电路资源分组策略对所述待测租线电路集合进行策略分组,得到电路策略化分组;评估模块23用于对所述电路策略化分组应用性能采集计算评估策略,得 到电路性能评估指标集合;处理模块24用于基于所述电路性能评估指标集合,获得租线电路对应于预设评价目标的流量监控结果。
本申请实施例通过采用电路资源分组策略和性能采集计算评估策略,可准确、科学的分析出客户租线电路的通信故障异常预警,便于维护人员提前采取预防措施,以降低客户租线业务发生中断的风险。
图3示例了一种电子设备的实体结构示意图,如图3所示,该电子设备可以包括:处理器(processor)310、通信接口(Communications Interface)320、存储器(memory)330和通信总线340,其中,处理器310,通信接口320,存储器330通过通信总线340完成相互间的通信。处理器310可以调用存储器330中的逻辑指令,以执行互联网性能监控方法,该方法包括:获取待测租线电路集合;基于电路资源分组策略对所述待测租线电路集合进行策略分组,得到电路策略化分组;对所述电路策略化分组应用性能采集计算评估策略,得到电路性能评估指标集合;基于所述电路性能评估指标集合,获得租线电路对应于预设评价目标的流量监控结果。
此外,上述的存储器330中的逻辑指令可以通过软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
另一方面,本申请还提供一种计算机程序产品,所述计算机程序产品包括存储在非暂态计算机可读存储介质上的计算机程序,所述计算机程序包括程序指令,当所述程序指令被计算机执行时,计算机能够执行上述各方法所提供的互联网性能监控方法,该方法包括:获取待测租线电路集合;基于电路资源分组策略对所述待测租线电路集合进行策略分组,得到电路策略化分组;对所述电路策略化分组应用性能采集计算评估策略,得到电路性能评估指标集合;基于所述电路性能评估指标集合,获得租线电路对 应于预设评价目标的流量监控结果。
又一方面,本申请还提供一种非暂态计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现以执行上述各提供的互联网性能监控方法,该方法包括:获取待测租线电路集合;基于电路资源分组策略对所述待测租线电路集合进行策略分组,得到电路策略化分组;对所述电路策略化分组应用性能采集计算评估策略,得到电路性能评估指标集合;基于所述电路性能评估指标集合,获得租线电路对应于预设评价目标的流量监控结果。
以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性的劳动的情况下,即可以理解并实施。
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到各实施方式可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件。基于这样的理解,上述技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在计算机可读存储介质中,如ROM/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行各个实施例或者实施例的某些部分所述的方法。
最后应说明的是:以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。
Claims (10)
- 一种互联网性能监控方法,包括:获取待测租线电路集合;基于电路资源分组策略对所述待测租线电路集合进行策略分组,得到电路策略化分组;对所述电路策略化分组应用性能采集计算评估策略,得到电路性能评估指标集合;基于所述电路性能评估指标集合,获得租线电路对应于预设评价目标的流量监控结果。
- 根据权利要求1所述的互联网性能监控方法,其中所述基于电路资源分组策略对所述待测租线电路集合进行策略分组,得到电路策略化分组,具体包括:提取所述待测租线电路集合中每条电路的端点信息,以及实际组网的层级信息;基于所述端点信息和所述层级信息,将所述待测租线电路集合划分为租线电路或租线电路组。
- 根据权利要求2所述的互联网性能监控方法,其中所述提取所述待测租线电路集合中每条电路的端点信息,以及实际组网的层级信息,具体包括:提取每条电路的起始点信息和终止点信息,以及所述实际组网中的网络汇聚层、区域核心层和IDC设备层;将所述起始点信息相同和所述终止点信息相同,以及电路类型相同的电路划分为一组;生成终止点对应的设备类型为所述网络汇聚层、所述区域核心层和所述IDC设备层的设备;将上联中继电路和互联中继电路生成电路组。
- 根据权利要求2所述的互联网性能监控方法,其中所述基于所述端点信息和所述层级信息,将所述待测租线电路集合划分为租线电路或租线电路组,具体包括:若判断获知租线电路两端均为非超核设备,则根据网络基础配置数据 进行比较,将租线电路两端设备相同和电路类型相同的电路划分为一组;若判断获知租线电路的起始点设备为超核设备,则根据预设特殊字符段将租线电路两端的设备进行分组;待划分完毕,按照预设命名规则进行电路组分组命名。
- 根据权利要求4所述的互联网性能监控方法,其中所述基于所述端点信息和所述层级信息,将所述待测租线电路集合划分为租线电路或租线电路组,还包括:若判断获知IDC设备即连接了区域核心层,又连接了所述超核设备,则将连接所述超核设备的电路组划分第一集合,连接所述区域核心层的电路组划分为第二集合。
- 根据权利要求1所述的互联网性能监控方法,其中所述对所述电路策略化分组应用性能采集计算评估策略,得到电路性能评估指标集合,具体包括:根据预设时间粒度采集电路设备的端口性能数据,并对所述端口性能数据进行存储和入库;汇总所述端口性能数据,选择开始时间和结束时间,提取所述电路策略化分组的分组粒度;基于所述分组粒度获取所述端口性能数据的流量汇总数据、波动图和所述预设时间粒度的明细数据;统计所述流量汇总数据、所述波动图和所述预设时间粒度的明细数据中从高到低位于预设排名范围的数据,得到所述电路性能评估指标集合。
- 根据权利要求1所述的互联网性能监控方法,其中所述基于所述电路性能评估指标集合,获得租线电路对应于预设评价目标的流量监控结果,具体包括:若判断获知所述电路性能评估指标集合超过所述预设评价目标的范围,则认为租线电路存在隐性故障。
- 一种互联网性能监控系统,包括:获取模块,获取待测租线电路集合;分组模块,用于基于电路资源分组策略对所述待测租线电路集合进行策略分组,得到电路策略化分组;评估模块,用于对所述电路策略化分组应用性能采集计算评估策略,得到电路性能评估指标集合;处理模块,用于基于所述电路性能评估指标集合,获得租线电路对应于预设评价目标的流量监控结果。
- 一种电子设备,包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,其中所述处理器执行所述计算机程序时实现如权利要求1至7任一项所述互联网性能监控方法的步骤。
- 一种非暂态计算机可读存储介质,其上存储有计算机程序,其中所述计算机程序被处理器执行时实现如权利要求1至7任一项所述互联网性能监控方法的步骤。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011248027.4 | 2020-11-10 | ||
CN202011248027.4A CN114070707A (zh) | 2020-11-10 | 2020-11-10 | 一种互联网性能监控方法及系统 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022100146A1 true WO2022100146A1 (zh) | 2022-05-19 |
Family
ID=80233104
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/107783 WO2022100146A1 (zh) | 2020-11-10 | 2021-07-22 | 互联网性能监控方法及系统 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN114070707A (zh) |
WO (1) | WO2022100146A1 (zh) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116112387A (zh) * | 2022-12-30 | 2023-05-12 | 中国电信股份有限公司 | 通信网络的检测方法、装置、电子设备及存储介质 |
CN116112393A (zh) * | 2022-12-27 | 2023-05-12 | 天翼物联科技有限公司 | 主机网络监控快捷部署的方法、系统、装置及存储介质 |
CN116455679A (zh) * | 2023-06-16 | 2023-07-18 | 杭州美创科技股份有限公司 | 异常数据库运维流量监控方法、装置及计算机设备 |
CN118098553A (zh) * | 2024-03-11 | 2024-05-28 | 首都医科大学宣武医院 | 基于云服务的孕妇远程监测方法及系统 |
CN118467273A (zh) * | 2024-07-09 | 2024-08-09 | 微晶数实(山东)装备科技有限公司 | 一种dpu性能测试方法、系统和介质 |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116128239B (zh) * | 2023-02-10 | 2024-05-14 | 贝壳找房(北京)科技有限公司 | 策略评估方法和装置 |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1302139A (zh) * | 1999-12-30 | 2001-07-04 | 美国电报电话公司 | Ip租用线路 |
US6421319B1 (en) * | 1997-10-31 | 2002-07-16 | Nec Corporation | Network traffic monitoring system |
US6959335B1 (en) * | 1999-12-22 | 2005-10-25 | Nortel Networks Limited | Method of provisioning a route in a connectionless communications network such that a guaranteed quality of service is provided |
KR20060066463A (ko) * | 2004-12-13 | 2006-06-16 | 한국전자통신연구원 | 전용회선 서비스 품질 감시 장치 및 그 방법 |
CN101035032A (zh) * | 2007-04-02 | 2007-09-12 | 华为技术有限公司 | 虚拟租用线路的故障监听方法与装置 |
TW200840272A (en) * | 2007-03-22 | 2008-10-01 | Chunghwa Telecom Co Ltd | Service circuit warming and monitoring collaborative operative system |
CN101316195A (zh) * | 2007-05-31 | 2008-12-03 | 北京中创信测科技股份有限公司 | 实现监测系统中配置一致的方法及系统 |
CN105791144A (zh) * | 2014-12-19 | 2016-07-20 | 中兴通讯股份有限公司 | 链路流量分担的方法和装置 |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101047997B1 (ko) * | 2010-12-07 | 2011-07-13 | 플러스기술주식회사 | 네트워크 패킷을 이용한 공유 단말 구분 시스템 및 처리 방법 |
CN103036733B (zh) * | 2011-10-09 | 2016-07-06 | 上海市南电信服务中心有限公司 | 非常规网络接入行为的监测系统及监测方法 |
EP3219060B1 (en) * | 2014-11-14 | 2019-06-05 | Bigleaf Networks, LLC | Circuit-aware load balancing with dynamic quality of service |
CN106161046B (zh) * | 2015-03-18 | 2021-01-15 | 国家电网公司 | 一种面向电力光传输网的通信安全防御系统及其控制方法 |
CN106998563B (zh) * | 2016-01-25 | 2019-12-20 | 中国移动通信集团福建有限公司 | 一种基于网络性能的室分系统预警方法及装置 |
CN106506072B (zh) * | 2016-10-28 | 2019-06-07 | 瑞斯康达科技发展股份有限公司 | 一种数据采集方法和装置 |
CN108074022A (zh) * | 2016-11-10 | 2018-05-25 | 中国电力科学研究院 | 一种基于集中运维的硬件资源分析与评估方法 |
CN108429347B (zh) * | 2018-04-02 | 2020-02-18 | 广州供电局有限公司 | 配电网线路设备监控方法、装置、计算机设备及存储介质 |
CN109359810A (zh) * | 2018-09-03 | 2019-02-19 | 国网浙江省电力有限公司信息通信分公司 | 一种基于多策略均衡的电力通信传输网运行状态评估方法 |
US11210142B2 (en) * | 2018-12-28 | 2021-12-28 | Intel Corporation | Technologies for multi-tenant automatic local breakout switching and data plane dynamic load balancing |
CN110519084A (zh) * | 2019-08-07 | 2019-11-29 | 北京市天元网络技术股份有限公司 | 用于运营商传输分组传送网的电路管理方法及设备 |
CN111612149A (zh) * | 2020-05-21 | 2020-09-01 | 国网湖南省电力有限公司 | 一种基于决策树的主网线路状态检测方法、系统及介质 |
-
2020
- 2020-11-10 CN CN202011248027.4A patent/CN114070707A/zh active Pending
-
2021
- 2021-07-22 WO PCT/CN2021/107783 patent/WO2022100146A1/zh active Application Filing
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6421319B1 (en) * | 1997-10-31 | 2002-07-16 | Nec Corporation | Network traffic monitoring system |
US6959335B1 (en) * | 1999-12-22 | 2005-10-25 | Nortel Networks Limited | Method of provisioning a route in a connectionless communications network such that a guaranteed quality of service is provided |
CN1302139A (zh) * | 1999-12-30 | 2001-07-04 | 美国电报电话公司 | Ip租用线路 |
KR20060066463A (ko) * | 2004-12-13 | 2006-06-16 | 한국전자통신연구원 | 전용회선 서비스 품질 감시 장치 및 그 방법 |
TW200840272A (en) * | 2007-03-22 | 2008-10-01 | Chunghwa Telecom Co Ltd | Service circuit warming and monitoring collaborative operative system |
CN101035032A (zh) * | 2007-04-02 | 2007-09-12 | 华为技术有限公司 | 虚拟租用线路的故障监听方法与装置 |
CN101316195A (zh) * | 2007-05-31 | 2008-12-03 | 北京中创信测科技股份有限公司 | 实现监测系统中配置一致的方法及系统 |
CN105791144A (zh) * | 2014-12-19 | 2016-07-20 | 中兴通讯股份有限公司 | 链路流量分担的方法和装置 |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116112393A (zh) * | 2022-12-27 | 2023-05-12 | 天翼物联科技有限公司 | 主机网络监控快捷部署的方法、系统、装置及存储介质 |
CN116112387A (zh) * | 2022-12-30 | 2023-05-12 | 中国电信股份有限公司 | 通信网络的检测方法、装置、电子设备及存储介质 |
CN116455679A (zh) * | 2023-06-16 | 2023-07-18 | 杭州美创科技股份有限公司 | 异常数据库运维流量监控方法、装置及计算机设备 |
CN116455679B (zh) * | 2023-06-16 | 2023-09-08 | 杭州美创科技股份有限公司 | 异常数据库运维流量监控方法、装置及计算机设备 |
CN118098553A (zh) * | 2024-03-11 | 2024-05-28 | 首都医科大学宣武医院 | 基于云服务的孕妇远程监测方法及系统 |
CN118467273A (zh) * | 2024-07-09 | 2024-08-09 | 微晶数实(山东)装备科技有限公司 | 一种dpu性能测试方法、系统和介质 |
Also Published As
Publication number | Publication date |
---|---|
CN114070707A (zh) | 2022-02-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2022100146A1 (zh) | 互联网性能监控方法及系统 | |
US9838483B2 (en) | Methods, systems, and computer readable media for a network function virtualization information concentrator | |
US11012461B2 (en) | Network device vulnerability prediction | |
US8817649B2 (en) | Adaptive monitoring of telecommunications networks | |
CN109034580B (zh) | 一种基于大数据分析的信息系统整体健康度评估方法 | |
CN108989136A (zh) | 业务端到端性能监控方法及装置 | |
US11621971B2 (en) | Low-complexity detection of potential network anomalies using intermediate-stage processing | |
CN107204894A (zh) | 网络业务质量的监控方法及装置 | |
Du | Application of information communication network security management and control based on big data technology | |
CN108259263A (zh) | 数据分析方法、装置及系统 | |
CN103560919B (zh) | 一种基于语音业务的质量评估方法及设备 | |
CN117978806A (zh) | 一种实现跨集群资源调度的方法 | |
CN113037551B (zh) | 一种基于流量切片的涉敏业务快速识别定位方法 | |
CN108696371A (zh) | 网络故障确定方法及系统 | |
WO2022001480A1 (zh) | 热门应用识别方法、网络系统、网络设备及存储介质 | |
CN109039714A (zh) | 云计算系统中资源的管理方法和装置 | |
CN109683989A (zh) | 一种配置项之间关联关系的自动采集方法及装置 | |
CN210327630U (zh) | 一种边缘智能网络感知平台 | |
CN112711510A (zh) | 一种业务连续性运行监测自动适配方法及系统 | |
US11924053B2 (en) | Intelligent infrastructure management in a cloud radio access network | |
Dong et al. | Multi-party Cooperative Network Fault Management Mechanism based on Federated Learning | |
CN113890814B (zh) | 故障感知模型构建和故障感知方法与系统、设备、介质 | |
CN111180069A (zh) | 一种业务支撑系统的健康度评估方法及系统 | |
Slimani et al. | SCoRMiner: Automated Discovery of Network Service and Application Dependencies using a graph mining approach | |
CN118158056B (zh) | 基于智能评估的网络管理系统 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 29/08/2023) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21890677 Country of ref document: EP Kind code of ref document: A1 |