CN106850261B - Network equipment and data transmission method - Google Patents
Network equipment and data transmission method Download PDFInfo
- Publication number
- CN106850261B CN106850261B CN201611219344.7A CN201611219344A CN106850261B CN 106850261 B CN106850261 B CN 106850261B CN 201611219344 A CN201611219344 A CN 201611219344A CN 106850261 B CN106850261 B CN 106850261B
- Authority
- CN
- China
- Prior art keywords
- board
- lpu
- data
- port
- network
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 58
- 238000000034 method Methods 0.000 title claims abstract description 34
- 238000012545 processing Methods 0.000 claims abstract description 29
- 239000004744 fabric Substances 0.000 description 53
- 238000010586 diagram Methods 0.000 description 11
- 238000013461 design Methods 0.000 description 7
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000006855 networking Effects 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0654—Management of faults, events, alarms or notifications using network fault recovery
- H04L41/0663—Performing the actions predefined by failover planning, e.g. switching to standby network elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/12—Avoiding congestion; Recovering from congestion
- H04L47/125—Avoiding congestion; Recovering from congestion by balancing the load, e.g. traffic engineering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/40—Constructional details, e.g. power supply, mechanical construction or backplane
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/55—Prevention, detection or correction of errors
- H04L49/552—Prevention, detection or correction of errors by ensuring the integrity of packets received through redundant connections
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/55—Prevention, detection or correction of errors
- H04L49/557—Error correction, e.g. fault recovery or fault tolerance
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Small-Scale Networks (AREA)
Abstract
本发明实施例提供一种网络设备及数据传输方法。网络设备包括主控板、交换网板以及线路接口处理单元LPU单板;所述LPU单板上用于输入数据和/或输出数据的端口,与所述交换网板之间通过直连通道连接;所述主控板,与所述LPU单板和交换网板连接,用于在所述LPU单板的网络处理器NP故障的情况下,控制输入所述LPU单板上的数据,经由输入该数据的端口与交换网板之间的直连通道传输至交换网板,使网络设备能够将数据传输至交换网板,进行数据传输处理。
Embodiments of the present invention provide a network device and a data transmission method. The network equipment includes a main control board, a switching network board, and a line interface processing unit LPU single board; the LPU single board is used to input data and/or output data. The port is connected to the switching network board through a direct channel ; The main control board is connected to the LPU single board and the switching network board, and is used to control the data input on the LPU single board in the case of failure of the network processor NP of the LPU single board, via the input The direct connection channel between the port of the data and the switching network board is transmitted to the switching network board, so that the network device can transmit the data to the switching network board for data transmission processing.
Description
技术领域technical field
本发明涉及通信技术领域,尤其涉及一种网络设备及数据传输方法。The present invention relates to the field of communication technologies, and in particular, to a network device and a data transmission method.
背景技术Background technique
随着云计算、大数据、移动互联网和物联网的发展,对网络设备进行数据处理的可靠性和有效性提出了更高的要求。With the development of cloud computing, big data, mobile Internet and the Internet of Things, higher requirements are put forward for the reliability and effectiveness of data processing by network equipment.
通常,网络设备中包括交换网板(Switch Fabric Unit,SFU)和多个线路接口处理单元(Line interface processing unit,LPU)单板,多个LPU单板之间通过SFU进行数据传输。LPU单板上包括有用于控制数据传输的网络处理器(Network Processor,NP)以及用于输入数据和/或输出数据的多个端口。通过端口输入到LPU单板的数据,需经过NP才可传输至SFU,例如图1中,数据通过LPU1上的端口1输入,并经由LPU1的NP1传输至SFU,通过SFU的处理传输至LPU2,并经由LPU2的NP2后传输至LPU2上的端口2,通过端口2输出。Generally, a network device includes a switch fabric unit (Switch Fabric Unit, SFU) and multiple line interface processing unit (Line interface processing unit, LPU) boards, and data transmission is performed between the multiple LPU boards through the SFU. The LPU single board includes a network processor (Network Processor, NP) for controlling data transmission and multiple ports for inputting data and/or outputting data. The data input to the LPU board through the port can only be transmitted to the SFU through the NP. For example, in Figure 1, the data is input through the port 1 on the LPU1, and is transmitted to the SFU through the NP1 of the LPU1, and is transmitted to the LPU2 through the processing of the SFU. And it is transmitted to port 2 on LPU2 through NP2 of LPU2, and output through port 2.
通过上述描述可知,若LPU单板上的NP故障,则网络设备将不能进行数据传输处理。It can be seen from the above description that if the NP on the LPU board fails, the network device cannot perform data transmission processing.
发明内容SUMMARY OF THE INVENTION
本发明实施例提供一种网络设备及数据传输,以在LPU单板上的NP故障的情况下,使网络设备能够将数据传输至交换网板,进行数据传输处理。Embodiments of the present invention provide a network device and data transmission, so that in the case of an NP failure on an LPU board, the network device can transmit data to a switching network board for data transmission processing.
第一方面,提供一种网络设备,该网络设备包括主控板、交换网板以及LPU单板。LPU单板中包括用于输入数据和/或输出数据的端口和用于控制数据传输的网络处理器NP。所述LPU单板上用于输入数据和/或输出数据的端口,与所述交换网板之间通过直连通道连接。所述主控板与所述LPU单板和交换网板连接,用于在所述LPU单板的NP故障的情况下,控制输入所述LPU单板上的数据,经由输入该数据的端口与交换网板之间的直连通道传输至交换网板,以使使网络设备能够将数据传输至交换网板,进行数据传输处理。In a first aspect, a network device is provided. The network device includes a main control board, a switching network board, and an LPU single board. The LPU single board includes a port for inputting data and/or outputting data and a network processor NP for controlling data transmission. The port on the LPU single board for inputting data and/or outputting data is connected with the switching fabric board through a direct connection channel. The main control board is connected to the LPU board and the switching network board, and is used to control the data input on the LPU board in the case of the NP failure of the LPU board, and communicate with the LPU board through the port through which the data is input. The direct connection channel between the switch fabric boards is transmitted to the switch fabric board, so that the network device can transmit data to the switch fabric board for data transmission processing.
其中,LPU单板的数量为至少两个,每个LPU单板中包括至少一个用于输入数据和/或输出数据的端口。The number of LPU boards is at least two, and each LPU board includes at least one port for inputting data and/or outputting data.
一种可能的设计中,所述LPU单板包括第一LPU单板和第二LPU单板。所述第一LPU单板的第一NP中存储有所述第二LPU单板的第二NP中的流表项。所述第二LPU单板的第二NP中存储有所述第一LPU单板的第一NP中的流表项。In a possible design, the LPU single board includes a first LPU single board and a second LPU single board. The flow entry in the second NP of the second LPU board is stored in the first NP of the first LPU board. The flow entry in the first NP of the first LPU board is stored in the second NP of the second LPU board.
所述主控板,具体用于在第一LPU单板的第一NP故障情况下,控制输入至第一LPU单板上的数据,经由输入该数据的端口与交换网板之间的直连通道传输至交换网板,并控制所述交换网板将所述数据传输至第二LPU单板的第二NP。所述第二LPU单板,通过所述第二NP将所述数据以及所述数据匹配的流表项传输至所述交换网板。所述交换网板依据所述数据匹配的流表项转发所述数据。通过此种实施方式,可使输入至故障LPU单板的数据能够基于NP中保存的流表项进行数据传输。The main control board is specifically used to control the data input to the first LPU board when the first NP of the first LPU board fails, through the direct connection between the port through which the data is input and the switching network board The channel is transmitted to the switch fabric board, and the switch fabric board is controlled to transmit the data to the second NP of the second LPU board. The second LPU board transmits the data and the flow table entry matching the data to the switching fabric board through the second NP. The switching fabric board forwards the data according to the flow entry matching the data. Through this implementation, the data input to the faulty LPU board can be transmitted based on the flow entry stored in the NP.
其中,若根据所述数据匹配的流表项确定输出所述数据的端口为第一LPU单板的端口,则所述交换网板通过交换网板与输出该数据的端口之间的直连通道,输出所述数据至所述第一LPU单板上输出该数据的端口。若根据所述数据匹配的流表项确定输出所述数据的端口为第二LPU单板的端口,则所述交换网板通过所述第二LPU单板上与输出该数据的端口连接的第二NP,输出所述数据至所述第二LPU单板上输出该数据的端口。Wherein, if it is determined that the port that outputs the data is the port of the first LPU board according to the flow table entry matching the data, the switching network board passes the direct connection channel between the switching network board and the port that outputs the data. , and output the data to the port on the first LPU board for outputting the data. If it is determined according to the flow table entry that matches the data, the port that outputs the data is the port of the second LPU board, the switching fabric board is connected to the port that outputs the data through the first port on the second LPU board. Two NPs, outputting the data to a port on the second LPU board for outputting the data.
又一种可能的设计中,所述LPU单板中还包括第三LPU单板;所述主控板还用于:若确定第三LPU单板中的第三NP的负载小于所述第二NP,则控制所述第三LPU单板将所述流表项保存至所述第三NP中,并控制所述交换网板将所述数据传输至所述第三NP。In another possible design, the LPU single board further includes a third LPU single board; the main control board is also used for: if it is determined that the load of the third NP in the third LPU single board is smaller than that of the second LPU single board; NP, control the third LPU board to save the flow entry in the third NP, and control the switching fabric board to transmit the data to the third NP.
其中,所述主控板还用于:控制所述第二LPU单板删除所述第二NP中保存的所述第一NP的流表项,以释放第二NP的存储资源,降低第二LPU单板的负载。The main control board is further configured to: control the second LPU board to delete the flow entry of the first NP saved in the second NP, so as to release the storage resources of the second NP and reduce the second The load of the LPU board.
第二方面,提供一种数据传输方法。在该方法中,网络设备获取待传输数据。在确定传输所述待传输数据的第一线路接口处理单元LPU单板的第一NP故障情况下,通过所述第一LPU单板上输入该数据的端口与交换网板之间的直连通道传输所述待传输数据,使网络设备能够进行数据传输处理能够将数据传输至交换网板,进行数据传输处理。In a second aspect, a data transmission method is provided. In this method, the network device obtains the data to be transmitted. In the event that the first NP of the LPU board of the first line interface processing unit that transmits the data to be transmitted is determined to be faulty, use the direct connection channel between the port on the first LPU board to input the data and the switching network board The data to be transmitted is transmitted, so that the network device can perform data transmission processing and can transmit the data to the switching network board for data transmission processing.
一种可能的设计中,所述网络设备通过所述故障的LPU单板上输入该数据的端口与交换网板之间的直连通道传输所述待传输数据之后,所述网络设备将所述待传输数据传输至第二LPU单板的第二NP,使输入至故障LPU单板的数据能够基于NP中保存的流表项进行数据传输。其中,所述第二LPU单板的第二NP中存储有所述第一LPU单板的第一NP中的流表项。In a possible design, after the network device transmits the data to be transmitted through the direct channel between the port on which the data is input on the faulty LPU board and the switching network board, the network device transmits the data to be transmitted. The data to be transmitted is transmitted to the second NP of the second LPU board, so that the data input to the faulty LPU board can be transmitted based on the flow entry stored in the NP. The flow entry in the first NP of the first LPU board is stored in the second NP of the second LPU board.
另一种可能的设计中,所述网络设备通过所述第一LPU单板上输入该数据的端口与交换网板之间的直连通道传输所述待传输数据之后,若确定第三LPU单板中的第三NP的负载小于所述第二NP的负载,则在所述第三LPU单板的第三NP中保存所述所述第一LPU单板的第一NP中的流表项。所述网络设备将所述待传输数据传输至所述第三LPU单板中的第三NP,以使各LPU单板之间负载均衡。In another possible design, after the network device transmits the data to be transmitted through the direct connection channel between the port on the first LPU board for inputting the data and the switching network board, if it is determined that the third LPU single board If the load of the third NP in the board is smaller than the load of the second NP, the flow entry in the first NP of the first LPU is saved in the third NP of the third LPU board . The network device transmits the data to be transmitted to the third NP in the third LPU board, so as to balance the load among the LPU boards.
又一种可能的设计中,所述网络设备可删除第二LPU单板的第二NP中存储的所述第一LPU单板的第一NP中的流表项,以释放第二NP的存储资源,降低第二LPU单板的负载。In yet another possible design, the network device may delete the flow entry in the first NP of the first LPU that is stored in the second NP of the second LPU to release the storage of the second NP. resources to reduce the load on the second LPU board.
第三方面,提供一种数据传输装置,该数据传输装置具备实现上述负载均衡处理方法的全部功能。所述功能可以通过硬件实现,也可以通过硬件执行相应的软件实现。所述硬件或软件包括一个或多个与上述功能相对应的模块。所述模块可以是软件和/或硬件。In a third aspect, a data transmission device is provided, the data transmission device has all the functions for realizing the above load balancing processing method. The functions can be implemented by hardware, or can be implemented by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions. The modules may be software and/or hardware.
一种可能的设计中,所述数据传输装置包括接收单元和处理单元,接收单元和处理单元的功能可以和各方法步骤相对应,在此不予赘述。In a possible design, the data transmission device includes a receiving unit and a processing unit, and the functions of the receiving unit and the processing unit may correspond to the steps of each method, which will not be repeated here.
本发明实施例提供的网络设备及数据传输方法,网络设备中LPU单板上用于输入数据和/或输出数据的端口,与交换网板之间通过直连通道连接,故若LPU单板上的NP故障,则输入故障LPU单板上的数据,可经由输入该数据的端口与交换网板之间的直连通道传输至交换网板,使网络设备能够将数据传输至交换网板,进行数据传输处理。In the network device and the data transmission method provided by the embodiments of the present invention, the port on the LPU board for inputting data and/or outputting data in the network device is connected to the switching network board through a direct channel, so if the LPU board is If the NP fault occurs, the data on the input faulty LPU board can be transmitted to the switch fabric board through the direct connection channel between the port where the data is input and the switch fabric board, so that the network device can transmit the data to the switch fabric board. Data transfer processing.
附图说明Description of drawings
图1为网络设备通过NP传输数据的示意图;Fig. 1 is the schematic diagram that network equipment transmits data through NP;
图2为本发明实施例提供的组网架构的结构示意图;2 is a schematic structural diagram of a networking architecture provided by an embodiment of the present invention;
图3为本发明实施例提供的网络设备的结构示意图;3 is a schematic structural diagram of a network device provided by an embodiment of the present invention;
图4为本发明实施例提供的网络设备中数据传输路径的一种示意图;4 is a schematic diagram of a data transmission path in a network device provided by an embodiment of the present invention;
图5为本发明实施例提供的网络设备中数据传输路径的另一示意图;5 is another schematic diagram of a data transmission path in a network device according to an embodiment of the present invention;
图6为本发明实施例提供的网络设备中数据传输路径的又一示意图;6 is another schematic diagram of a data transmission path in a network device provided by an embodiment of the present invention;
图7为本发明实施例提供的一种数据传输方法流程图;7 is a flowchart of a data transmission method provided by an embodiment of the present invention;
图8为本发明实施例提供的另一种数据传输方法流程图;FIG. 8 is a flowchart of another data transmission method provided by an embodiment of the present invention;
图9为本发明实施例提供的又一种数据传输方法流程图;FIG. 9 is a flowchart of another data transmission method provided by an embodiment of the present invention;
图10为本发明实施例提供的一种数据传输装置结构示意图。FIG. 10 is a schematic structural diagram of a data transmission apparatus according to an embodiment of the present invention.
具体实施方式Detailed ways
下面将结合附图,对本发明实施例中的技术方案进行说明。The technical solutions in the embodiments of the present invention will be described below with reference to the accompanying drawings.
图2为本发明实施例提供的组网架构的结构示意图。参阅图2所示,所述组网架构包括数据发送设备110a以及110b、骨干网120、宽带远程接入服务器(broadband remoteaccess server,BRAS)130和数据接收设备140a、140b以及140c。所述骨干网120可以包括多个进行数据传输的网络设备。所述多个网络设备包括路由器120a、路由器120b、路由器120c和路由器120d。FIG. 2 is a schematic structural diagram of a networking architecture provided by an embodiment of the present invention. Referring to FIG. 2, the networking architecture includes
图2中的每个数据发送设备可以与每个数据接收设备通信。所述数据发送设备110a通过所述骨干网120中的路由器120a、路由器120b、路由器120c和路由器120d等网络设备将数据报文传输至所述BRAS 130。所述BRAS 130将所述数据转发给所述数据接收设备140a。Each data transmitting device in FIG. 2 can communicate with each data receiving device. The
图2中,骨干网120中包括的路由器120a、路由器120b、路由器120c和路由器120d等网络设备进行数据传输时,存在背景技术部分提及的“若LPU单板上的NP故障,则网络设备将不能进行数据传输处理”技术问题。In FIG. 2 , when network devices such as
本发明实施例提供一种网络设备,在该网络设备中LPU单板上用于输入数据和/或输出数据的端口,与交换网板之间通过直连通道连接,故若LPU单板上的NP故障,则网络设备可控制输入故障LPU单板上的数据,经由输入该数据的端口与交换网板之间的直连通道传输至交换网板,使网络设备能够将数据传输至交换网板,进行数据传输处理。An embodiment of the present invention provides a network device, in which a port on an LPU board for inputting data and/or outputting data is connected to a switching network board through a direct channel, so if the port on the LPU board is If the NP is faulty, the network device can control the data on the input faulty LPU board, and transmit the data to the switch fabric board through the direct connection channel between the input port and the switch fabric board, so that the network device can transmit data to the switch fabric board. , for data transmission processing.
图3示出了本发明实施例提供的网络设备100的结构示意图。参阅图3所示,网络设备100包括主控板101、交换网板102以及LPU单板103。所述LPU单板103中包括用于输入数据和/或输出数据的端口1031和用于控制数据传输的网络处理器NP1032。所述LPU单板103上用于输入数据和/或输出数据的端口1031,与所述交换网板102之间通过直连通道104连接。所述主控板101与所述LPU单板103和交换网板102连接,用于在所述LPU单板103的NP1032故障的情况下,控制输入所述LPU单板103上的数据,经由输入该数据的端口1031与交换网板102之间的直连通道104传输至交换网板102。FIG. 3 shows a schematic structural diagram of a
本发明实施例中网络设备100包括的LPU单板103的数量为至少两个,每个LPU单板103中包括至少一个用于输入数据和/或输出数据的端口1031。每个LPU单板103中用于输入数据和/或输出数据的每个端口1031与交换网板之间均通过直连通道104连接。在LPU单板103的NP故障的情况下,输入该故障的LPU单板103上的数据,经由输入该数据的端口1031与交换网板102之间的直连通道104传输至交换网板102。In the embodiment of the present invention, the number of
其中,每个LPU单板103中还包括用于控制数据传输的网络处理器NP1032,NP1032中保存有用于控制数据传输的流表项。在NP1032处于正常工作状态情况下,每个LPU单板103中用于输入数据和/或输出数据的每个端口1031与NP1032之间可通信,数据经由端口1031,通过NP1032可传输至交换网板102。Wherein, each
需要说明的是,本发明实施例图3中以LPU单板103中用于输入数据和/或输出数据的每个端口1031与交换网板102之间分别建立直连通道104进行示意性说明,实际实施过程中并不限定每个端口1031与交换网板102之间分别建立直连通道104,例如与NP1032之间能够通信的多个端口1031可通过一条直连通道104与交换网板102连接。It should be noted that, in FIG. 3 according to the embodiment of the present invention, a
本发明实施例提供的网络设备中,LPU单板上用于输入数据和/或输出数据的端口,与交换网板之间通过直连通道连接,故若LPU单板上的NP故障,则网络设备可控制输入故障LPU单板上的数据,经由输入该数据的端口与交换网板之间的直连通道传输至交换网板,使网络设备能够将数据传输至交换网板,进行数据传输处理。并且,本发明实施例中,LPU单板上的NP故障情况下,并不会占用其它LPU单板上的端口,使可用的端口数量充足。In the network device provided by the embodiment of the present invention, the port used for inputting data and/or outputting data on the LPU board is connected to the switching network board through a direct connection channel. Therefore, if the NP on the LPU board fails, the network The device can control the data on the input faulty LPU board, and transmit the data to the switch fabric board through the direct connection channel between the port where the data is input and the switch fabric board, so that the network device can transmit the data to the switch fabric board for data transmission processing. . In addition, in the embodiment of the present invention, when the NP on the LPU board fails, ports on other LPU boards are not occupied, so that the number of available ports is sufficient.
本发明实施例中,为了使输入至故障LPU单板的数据能够基于NP中保存的流表项进行数据传输,可为每个LPU单板设置备份的LPU单板,通过备份的LPU单板保存另一LPU单板中NP保存的流表项,在LPU单板的NP故障情况下,主控板可控制输入至该故障的LPU单板上的数据,经由输入该数据的端口与交换网板之间的直连通道传输至交换网板,并控制所述交换网板将所述数据传输至该故障的LPU单板的备份LPU单板的NP,然后故障的LPU单板的备份LPU单板通过备份LPU单板的NP将所述数据以及所述数据匹配的流表项传输至所述交换网板;所述交换网板依据所述数据匹配的流表项转发所述数据。In the embodiment of the present invention, in order to enable the data input to the faulty LPU board to be transmitted based on the flow table entry saved in the NP, a backup LPU board can be set for each LPU board, and the backup LPU board can be used to save the data through the backup LPU board. The flow table entry stored in the NP of another LPU board. When the NP of the LPU board is faulty, the main control board can control the data input to the faulty LPU board, through the input port and the switch fabric board. The direct connection channel between them is transmitted to the switch fabric board, and the switch fabric board is controlled to transmit the data to the NP of the backup LPU board of the faulty LPU board, and then the backup LPU board of the faulty LPU board. The data and the flow entry matching the data are transmitted to the switching fabric board through the NP of the backup LPU board; the switching fabric board forwards the data according to the flow entry matching the data.
本发明实施例以下以网络设备中的LPU单板包括第一LPU单板和第二LPU单板为例进行说明。所述第二LPU单板的第二NP中存储有所述第一LPU单板的第一NP中的流表项。所述第一LPU单板的第一NP中存储有所述第二LPU单板的第二NP中的流表项。The embodiments of the present invention are described below by taking an example that an LPU board in a network device includes a first LPU board and a second LPU board. The flow entry in the first NP of the first LPU board is stored in the second NP of the second LPU board. The flow entry in the second NP of the second LPU board is stored in the first NP of the first LPU board.
在第一LPU单板的第一NP故障情况下,所述主控板控制输入至第一LPU单板上的数据,经由输入该数据的端口与交换网板之间的直连通道传输至交换网板,并控制所述交换网板将所述数据传输至第二LPU单板的第二NP。所述第二LPU单板,通过所述第二NP将所述数据以及所述数据匹配的流表项传输至所述交换网板。所述交换网板依据所述数据匹配的流表项转发所述数据。When the first NP of the first LPU board is faulty, the main control board controls the data input to the first LPU board, and transmits the data to the switch through the direct connection channel between the port through which the data is input and the switch fabric board The network board, and controls the switching network board to transmit the data to the second NP of the second LPU board. The second LPU board transmits the data and the flow table entry matching the data to the switching fabric board through the second NP. The switching fabric board forwards the data according to the flow entry matching the data.
在第二LPU单板的第二NP故障情况下,所述主控板控制输入至第二LPU单板上的数据,经由输入该数据的端口与交换网板之间的直连通道传输至交换网板,并控制所述交换网板将所述数据传输至第一LPU单板的第一NP。所述第一LPU单板,通过所述第一NP将所述数据以及所述数据匹配的流表项传输至所述交换网板。所述交换网板依据所述数据匹配的流表项转发所述数据。When the second NP of the second LPU board fails, the main control board controls the data input to the second LPU board, and transmits the data to the switch via the direct connection channel between the port through which the data is input and the switch fabric board The network board, and controls the switching network board to transmit the data to the first NP of the first LPU board. The first LPU board transmits the data and the flow entry matching the data to the switching fabric board through the first NP. The switching fabric board forwards the data according to the flow entry matching the data.
图4中以第二LPU单板的第二NP故障为例对通过备份LPU单板(第一LPU单板)的NP(第一NP)进行数据传输过程进行示意性说明。对于第一LPU单板的第一NP故障情况下,通过第二LPU单板的第二NP进行数据传输过程类似,在此不再赘述。In FIG. 4 , a process of data transmission through the NP (first NP) of the backup LPU board (first LPU board) is schematically illustrated by taking the second NP failure of the second LPU board as an example. In the case where the first NP of the first LPU board fails, the process of data transmission through the second NP of the second LPU board is similar, and details are not described herein again.
本发明实施例中,所述交换网板依据所述数据匹配的流表项转发所述数据过程中,可根据数据匹配的流表项确定输出所述数据的端口。若根据所述数据匹配的流表项确定输出所述数据的端口为故障的LPU单板的端口,则所述交换网板通过交换网板与输出该数据的端口之间的直连通道,输出所述数据至所述故障的LPU单板上输出该数据的端口。若根据所述数据匹配的流表项确定输出所述数据的端口为故障的LPU单板的备份LPU单板的端口,则通过故障的LPU单板的备份LPU单板的NP,输出所述数据至故障的LPU单板的备份LPU单板上输出该数据的端口。In the embodiment of the present invention, in the process of forwarding the data according to the flow entry matching the data, the switching network board may determine the port for outputting the data according to the flow entry matching the data. If it is determined according to the flow table entry matching the data that the port that outputs the data is the port of the faulty LPU board, the switching network board outputs the data through the direct channel between the switching network board and the port that outputs the data. The data is sent to the port on the faulty LPU board that outputs the data. If it is determined according to the flow table entry matching the data that the port that outputs the data is the port of the backup LPU board of the faulty LPU board, the data is output through the NP of the backup LPU board of the faulty LPU board The port that outputs the data on the backup LPU of the faulty LPU.
在第一LPU单板的第一NP故障情况下,若根据所述数据匹配的流表项确定输出所述数据的端口为第一LPU单板的端口,则所述交换网板通过交换网板与输出该数据的端口之间的直连通道,输出所述数据至所述第一LPU单板上输出该数据的端口。若根据所述数据匹配的流表项确定输出所述数据的端口为第二LPU单板的端口,则所述交换网板通过所述第二LPU单板上与输出该数据的端口连接的第二NP,输出所述数据至所述第二LPU单板上输出该数据的端口。In the case where the first NP of the first LPU board is faulty, if it is determined according to the flow table entry matching the data that the port that outputs the data is the port of the first LPU board, the switch fabric board passes the switch fabric board through the switch fabric board. A direct-connected channel with the port outputting the data, and outputting the data to the port outputting the data on the first LPU single board. If it is determined according to the flow table entry that matches the data, the port that outputs the data is the port of the second LPU board, the switching fabric board is connected to the port that outputs the data through the first port on the second LPU board. Two NPs, outputting the data to a port on the second LPU board for outputting the data.
在第二LPU单板的第二NP故障情况下,若根据所述数据匹配的流表项确定输出所述数据的端口为第二LPU单板的端口,则所述交换网板通过交换网板与输出该数据的端口之间的直连通道,输出所述数据至所述第二LPU单板上输出该数据的端口。若根据所述数据匹配的流表项确定输出所述数据的端口为第一LPU单板的端口,则所述交换网板通过所述第一LPU单板上与输出该数据的端口连接的第一NP,输出所述数据至所述第一LPU单板上输出该数据的端口。When the second NP of the second LPU board is faulty, if it is determined according to the flow table entry matching the data that the port that outputs the data is the port of the second LPU board, the switching network board passes the switching network board through the switching network board. A direct-connected channel with the port outputting the data, and outputting the data to the port outputting the data on the second LPU board. If it is determined according to the flow table entry matching the data that the port that outputs the data is the port of the first LPU board, the switching fabric board is connected to the port that outputs the data through the first LPU board. An NP, outputting the data to the port on the first LPU board for outputting the data.
图5中以第二LPU单板的第二NP故障为例对交换网板依据所述数据匹配的流表项转发所述数据过程进行说明。图5中,第二LPU单板的第二NP故障,网络设备根据所述数据匹配的流表项确定输出所述数据的端口为第二LPU单板的端口,则所述交换网板通过交换网板与输出该数据的端口之间的直连通道,输出所述数据至所述第二LPU单板上输出该数据的端口。In FIG. 5 , the process of forwarding the data by the switching network board according to the flow table entry matching the data is described by taking the second NP failure of the second LPU board as an example. In FIG. 5 , the second NP of the second LPU board is faulty, and the network device determines that the port that outputs the data is the port of the second LPU board according to the flow table entry matching the data, and the switching network board passes the switching The direct connection channel between the network board and the port outputting the data outputs the data to the port outputting the data on the second LPU board.
本发明实施例中,上述通过为网络设备中每一LPU单板设置备份LPU单板的方式,使得任一LPU单板故障的情况下,均可实现基于NP中的流表项进行数据传输的处理。In the embodiment of the present invention, by setting a backup LPU board for each LPU board in the network device, in the case of any LPU board failure, the data transmission based on the flow entry in the NP can be realized. deal with.
本发明实施例中,在LPU单板的NP故障情况下,主控板控制输入至该故障的LPU单板上的数据,经由输入该数据的端口与交换网板之间的直连通道传输至交换网板,并控制所述交换网板将所述数据传输至该故障的LPU单板的备份LPU单板的NP,通过故障的LPU单板的备份LPU单板进行数据传输处理,若故障的LPU单板的备份LPU单板当前处理的业务较多,则可能会造成故障的LPU单板的备份LPU单板的转发负荷较大。本发明实施例中为使各LPU单板之间的负载均衡,网络设备的主控板,可在控制所述交换网板将所述数据传输至该故障的LPU单板的备份LPU单板的NP之前,确定各LPU单板的负载情况,若确定网络设备的LPU单板中存在负载小于故障的LPU单板的备份LPU单板负载的LPU单板,则可控制该负载小于故障的LPU单板的备份LPU单板负载的LPU单板将故障的LPU单板的NP中的流表项保存至该负载小于故障的LPU单板的备份LPU单板负载的LPU单板的NP中,并控制交换网板将故障的LPU单板的数据传输至该负载小于故障的LPU单板的备份LPU单板负载的LPU单板的NP。In the embodiment of the present invention, when the NP of the LPU board is faulty, the main control board controls the data input to the faulty LPU board, and transmits the data to the switch network board through the direct connection channel between the port through which the data is input and the switching network board. switch fabric board, and control the switch fabric board to transmit the data to the NP of the backup LPU board of the faulty LPU board, and perform data transmission processing through the backup LPU board of the faulty LPU board. The backup LPU board of the LPU board currently processes more services, which may cause a large forwarding load on the backup LPU board of the faulty LPU board. In this embodiment of the present invention, in order to balance the load among the LPU boards, the main control board of the network device may control the switching network board to transmit the data to the backup LPU board of the faulty LPU board. Before NP, determine the load of each LPU board. If it is determined that there is an LPU board whose load is smaller than the load of the backup LPU board of the faulty LPU board, you can control the load of the LPU board of the network device to be less than that of the faulty LPU board. The backup LPU board of the board The LPU board loaded by the board saves the flow entry in the NP of the faulty LPU board to the NP of the LPU board whose load is smaller than the backup LPU board of the faulty LPU board, and controls The switching fabric board transmits the data of the faulty LPU board to the NP of the LPU board whose load is smaller than that of the backup LPU board of the faulty LPU board.
本发明实施例中,主控板控制交换网板将故障的LPU单板的数据传输至该负载小于故障的LPU单板的备份LPU单板负载的LPU单板的NP后,可控制故障的LPU单板的备份LPU单板删除故障的LPU单板的备份LPU的NP中保存的故障的LPU单板的NP中的流表项,以释放第二NP的存储资源,降低第二LPU单板的负载。In the embodiment of the present invention, after the main control board controls the switching network board to transmit the data of the faulty LPU board to the NP of the LPU board whose load is smaller than the load of the backup LPU board of the faulty LPU board, it can control the faulty LPU board The backup LPU of the single board deletes the flow table entries in the NP of the faulty LPU board saved in the NP of the backup LPU of the faulty LPU board to release the storage resources of the second NP and reduce the storage resources of the second LPU board. load.
本发明实施例中以LPU单板中包括第一LPU单板、第二LPU单板和第三LPU单板为例进行说明。In the embodiment of the present invention, the LPU single board includes a first LPU single board, a second LPU single board, and a third LPU single board as an example for description.
假设,第一LPU单板的第一NP故障,第二LPU单板的第二NP中存储有所述第一LPU单板的第一NP中的流表项。所述主控板若确定第三LPU单板中的第三NP的负载小于所述第二NP,则控制所述第三LPU单板将所述流表项保存至所述第三NP中,并控制所述交换网板将所述数据传输至所述第三NP,数据传输路径示意图如图6所示。It is assumed that the first NP of the first LPU board is faulty, and the second NP of the second LPU board stores the flow entry in the first NP of the first LPU board. If the main control board determines that the load of the third NP in the third LPU board is smaller than that of the second NP, it controls the third LPU board to save the flow entry in the third NP, and control the switching fabric board to transmit the data to the third NP, and a schematic diagram of a data transmission path is shown in FIG. 6 .
本发明实施例中,网络设备的主控板还可控制所述第二LPU单板删除所述第二NP中保存的所述第一NP的流表项。In the embodiment of the present invention, the main control board of the network device may further control the second LPU board to delete the flow entry of the first NP stored in the second NP.
基于上述实施例提供的网络设备,本发明实施例提供一种数据传输方法。Based on the network device provided by the foregoing embodiment, the embodiment of the present invention provides a data transmission method.
图7示出了本发明实施例提供的数据传输方法流程示意图。如图7所示,包括:FIG. 7 shows a schematic flowchart of a data transmission method provided by an embodiment of the present invention. As shown in Figure 7, including:
S101:网络设备获取待传输数据。S101: The network device obtains data to be transmitted.
本发明实施例中网络设备可通过第一LPU单板上用于输入数据的端口获取。In this embodiment of the present invention, the network device may be obtained through a port on the first LPU board for inputting data.
S102:网络设备确定传输所述待传输数据的第一LPU单板的第一NP故障。S102: The network device determines that the first NP of the first LPU board that transmits the to-be-transmitted data is faulty.
S103:网络设备通过所述故障的第一LPU单板上输入该数据的端口与交换网板之间的直连通道传输所述待传输数据。S103: The network device transmits the to-be-transmitted data through a direct connection channel between the port on the first LPU board where the data is inputted and the switching network board.
本发明实施例提供的数据传输方法,在传输待传输数据的第一LPU单板上的第一NP故障情况下,可通过第一LPU单板上输入该数据的端口与交换网板之间的直连通道传输所述待传输数据,使网络设备能够进行数据传输处理能够将数据传输至交换网板,进行数据传输处理。In the data transmission method provided by the embodiment of the present invention, in the case of a failure of the first NP on the first LPU board that transmits the data to be transmitted, the data transmission between the port on the first LPU board and the switching network board can be used to input the data. The direct connection channel transmits the data to be transmitted, so that the network device can perform data transmission processing and can transmit the data to the switching network board for data transmission processing.
图8示出了本发明实施例提供的另一种数据传输方法流程图。图8所示的数据传输方法,在图7所示传输方法基础上还包括如下步骤:FIG. 8 shows a flowchart of another data transmission method provided by an embodiment of the present invention. The data transmission method shown in FIG. 8 further includes the following steps on the basis of the transmission method shown in FIG. 7 :
S104:网络设备将所述待传输数据传输至第二LPU单板的第二NP。其中,所述第二LPU单板的第二NP中存储有所述第一LPU单板的第一NP中的流表项。S104: The network device transmits the data to be transmitted to the second NP of the second LPU board. The flow entry in the first NP of the first LPU board is stored in the second NP of the second LPU board.
本发明实施例中,通过将所述待传输数据传输至第二LPU单板的第二NP,能够使输入至故障LPU单板的数据能够基于NP中保存的流表项进行数据传输。In the embodiment of the present invention, by transmitting the data to be transmitted to the second NP of the second LPU board, the data input to the faulty LPU board can be transmitted based on the flow entry stored in the NP.
图9示出了本发明实施例提供的另一种数据传输方法流程图。图9所示的数据传输方法,在图7所示传输方法基础上还包括如下步骤:FIG. 9 shows a flowchart of another data transmission method provided by an embodiment of the present invention. The data transmission method shown in FIG. 9 further includes the following steps on the basis of the transmission method shown in FIG. 7 :
S104:确定第三LPU单板中的第三NP的负载是否小于第二LPU单板中的第二NP的负载。S104: Determine whether the load of the third NP in the third LPU board is smaller than the load of the second NP in the second LPU board.
S105:若确定第三LPU单板中的第三NP的负载小于所述第二NP的负载,则在所述第三LPU单板的第三NP中保存所述所述第一LPU单板的第一NP中的流表项,并将所述待传输数据传输至所述第三LPU单板中的第三NP。S105: If it is determined that the load of the third NP in the third LPU board is smaller than the load of the second NP, save the load of the first LPU board in the third NP of the third LPU board flow entry in the first NP, and transmit the to-be-transmitted data to the third NP in the third LPU board.
S106:若确定第三LPU单板中的第三NP的负载小于所述第二NP,则将所述待传输数据传输至第二LPU单板的第二NP。其中,所述第二LPU单板的第二NP中存储有所述第一LPU单板的第一NP中的流表项。S106: If it is determined that the load of the third NP in the third LPU board is smaller than that of the second NP, transmit the to-be-transmitted data to the second NP of the second LPU board. The flow entry in the first NP of the first LPU board is stored in the second NP of the second LPU board.
本发明实施例在确定第三LPU单板中的第三NP的负载小于所述第二NP的负载情况下,在所述第三LPU单板的第三NP中保存所述所述第一LPU单板的第一NP中的流表项,并将所述待传输数据传输至所述第三LPU单板中的第三NP,能够降低第二LPU单板的负载,使各LPU单板之间负载均衡。In this embodiment of the present invention, when it is determined that the load of the third NP in the third LPU board is smaller than the load of the second NP, the first LPU is stored in the third NP of the third LPU board The flow table entry in the first NP of the single board, and the data to be transmitted is transmitted to the third NP of the third LPU single board, which can reduce the load of the second LPU single board and make the LPU single board load balancing between.
基于上述提供的数据传输方法,本发明实施例还提供一种数据传输装置。可以理解的是,数据传输装置为了实现上述功能,其包含了执行各个功能相应的硬件结构和/或软件模块。结合本发明中所公开的实施例描述的各示例的单元及算法步骤,本发明实施例能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。本领域技术人员可以对每个特定的应用来使用不同的方法来实现所描述的功能,但是这种实现不应认为超出本发明实施例的技术方案的范围。Based on the data transmission method provided above, an embodiment of the present invention further provides a data transmission apparatus. It can be understood that, in order to realize the above-mentioned functions, the data transmission apparatus includes corresponding hardware structures and/or software modules for executing each function. With reference to the units and algorithm steps of each example described in the embodiments disclosed in the present invention, the embodiments of the present invention can be implemented in hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of the technical solutions of the embodiments of the present invention.
本发明实施例可以根据上述方法示例对数据传输装置进行功能单元的划分,例如,可以对应各个功能划分各个功能单元,也可以将两个或两个以上的功能集成在一个处理单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。需要说明的是,本发明实施例中对单元的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。In this embodiment of the present invention, the data transmission apparatus may be divided into functional units according to the foregoing method examples. For example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units. It should be noted that, the division of units in the embodiment of the present invention is schematic, and is only a logical function division, and there may be other division manners in actual implementation.
在采用集成的单元的情况下,图10示出了一种数据传输装置的结构示意图。参阅图10所示,数据传输装置1000包括获取单元1001和处理单元1002,其中,获取单元1001用于获取待传输数据。处理单元1002用于在确定传输所述获取单元1001获取的待传输数据的第一LPU单板的第一NP故障情况下,通过所述第一LPU单板上输入该数据的端口与交换网板之间的直连通道传输所述待传输数据。In the case of using an integrated unit, FIG. 10 shows a schematic structural diagram of a data transmission device. Referring to FIG. 10, the
一种可能的实施方式中,所述处理单元1002还用于通过所述故障的LPU单板上输入该数据的端口与交换网板之间的直连通道传输所述待传输数据之后,将所述待传输数据传输至第二LPU单板的第二NP。其中,所述第二LPU单板的第二NP中存储有所述第一LPU单板的第一NP中的流表项。In a possible implementation manner, the
另一种可能的实施方式中,所述处理单元1002还用于通过所述第一LPU单板上输入该数据的端口与交换网板之间的直连通道传输所述待传输数据之后,若确定第三LPU单板中的第三NP的负载小于所述第二NP的负载,则在所述第三LPU单板的第三NP中保存所述所述第一LPU单板的第一NP中的流表项,将所述待传输数据传输至所述第三LPU单板中的第三NP。In another possible implementation manner, the
在采用硬件形式实现的情况下,数据传输装置1000可为上述实施例中涉及的网络设备。When implemented in the form of hardware, the
需要说明的是,本发明实施例提供的数据传输装置1000具备上述实施例中涉及的网络设备的功能,处理单元1002的功能可以和网络设备中的主控板的功能相对应,在此不予赘述对于本发明实施例描述不够详尽的地方,可参阅上述实施例的相关描述,本发明实施例在此不再赘述。It should be noted that the
显然,本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样,倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit and scope of the invention. Thus, provided that these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201611219344.7A CN106850261B (en) | 2016-12-26 | 2016-12-26 | Network equipment and data transmission method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201611219344.7A CN106850261B (en) | 2016-12-26 | 2016-12-26 | Network equipment and data transmission method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106850261A CN106850261A (en) | 2017-06-13 |
CN106850261B true CN106850261B (en) | 2020-09-18 |
Family
ID=59135703
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201611219344.7A Active CN106850261B (en) | 2016-12-26 | 2016-12-26 | Network equipment and data transmission method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106850261B (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108712293B (en) * | 2018-05-30 | 2021-12-07 | 新华三技术有限公司 | Single board management method and network equipment |
CN109245985B (en) * | 2018-08-24 | 2020-12-29 | 烽火通信科技股份有限公司 | Communication method and system between single disks in equipment |
CN110968806B (en) * | 2019-11-15 | 2023-06-09 | 新华三半导体技术有限公司 | Maintenance information searching method and device and network equipment |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004287811A (en) * | 2003-03-20 | 2004-10-14 | Fujitsu Ltd | Data processing circuit |
CN101848154B (en) * | 2010-05-17 | 2012-04-04 | 华为技术有限公司 | System based on advanced telecom computation architecture |
CN102143014A (en) * | 2010-11-03 | 2011-08-03 | 华为数字技术有限公司 | Single board failure detection method, single board and router |
-
2016
- 2016-12-26 CN CN201611219344.7A patent/CN106850261B/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN106850261A (en) | 2017-06-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8654630B2 (en) | Techniques for link redundancy in layer 2 networks | |
US9426546B2 (en) | Maintaining a fabric name across a distributed switch | |
US8848575B2 (en) | High availability and multipathing for fibre channel over ethernet | |
EP2961112B1 (en) | Message forwarding system, method and device | |
US11095476B2 (en) | Spanning tree protocol enabled n-node link aggregation system | |
CN103490931B (en) | The unbroken method and apparatus of agreement in a kind of non-interrupting service escalation process | |
CN103401786A (en) | Method, device and system for establishing network topology, controlling path and transmitting message | |
US9935834B1 (en) | Automated configuration of virtual port channels | |
WO2016173403A1 (en) | Routing device, load balancing device, and message distribution method and system | |
CN106453156B (en) | Communication means and device between a kind of virtual unit | |
CN106850261B (en) | Network equipment and data transmission method | |
EP3213441B1 (en) | Redundancy for port extender chains | |
CN106027287A (en) | Unified management and control platform for power distribution communication networks | |
CN105763442A (en) | PON system and method avoiding interruption of LACP aggregation link in main-standby switching process | |
US10050908B2 (en) | Synchronizing out-of-sync elements in a distributed fibre channel forwarder | |
JP2012114644A (en) | Network fabric switch system and automatic setting method for the network fabric switch system | |
CN103997422B (en) | A kind of fault handling method and device of IP interface board | |
EP3311537B1 (en) | Methods, apparatuses and computer-readable medium for scaling multiclouds in a hybrid cloud architecture | |
US11528237B2 (en) | Server, server system, and method of increasing network bandwidth of server | |
CN108667640A (en) | Communication method and equipment, network access system | |
US9804907B2 (en) | Remote procedure call for a distributed system | |
US9209928B2 (en) | Transmission device and transmission method | |
CN115048048A (en) | Data storage system, data storage method, storage medium, and electronic device | |
TWI706650B (en) | Automatic multi-chassis link aggregation configuration | |
KR102092091B1 (en) | Methods, apparatus and computer programs for providing high availability and reliability in software defined network |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |