CN113992502A

CN113992502A - A kind of FC card multi-protocol data transmission method, system, equipment and medium

Info

Publication number: CN113992502A
Application number: CN202111303888.2A
Authority: CN
Inventors: 孟祥坤
Original assignee: Suzhou Inspur Intelligent Technology Co Ltd
Current assignee: Suzhou Inspur Intelligent Technology Co Ltd
Priority date: 2021-11-05
Filing date: 2021-11-05
Publication date: 2022-01-28

Abstract

A FC card multi-protocol data transmission method comprises the following steps: acquiring a plurality of transmission protocols aggregated by the FC card on a storage node; respectively establishing a first port and a second port for each transmission protocol, and allocating a unique identifier for the first port; and distributing a data transmission task for the first port based on the unique identification. By the FC card multi-protocol data transmission method provided by the invention, the expansion of a plurality of logic ports is provided for the existing physical port, the data isolation transmission of different transmission protocols is realized, the mutually independent logic ports are used for link connection, the mutual influence of NVMe and SCSI is reduced, and the high availability of multi-protocols is ensured; in addition, when the mixed use of multiple protocols causes problems, the problems can be conveniently and quickly positioned through wpn.

Description

FC card multi-protocol data transmission method, system, device and medium

Technical Field

The invention belongs to the field of computers, and particularly relates to a method, a system, equipment and a medium for FC card multi-protocol data transmission.

Background

With the rapid development of various industries, the storage demand is increasing, and more customers adopt a large amount of storage as a core data storage medium. At present, communication protocols supported by mainstream storage include FC-scsi protocol, iscsi protocol and the like, and as the NVMe and NVMeof specifications and technical maturity are gradually enhanced, a plurality of storage manufacturers support end-to-end NVMe characteristics. Among them, the FC-scsi protocol and the FC-NVMe protocol both depend on the FC protocol topology, and how to support the multi-protocol (scsi, NVMe) under the existing FC topology is an important issue involved in storage at present. The current mainstream scheme is that NVMe and SCSI multiplex the same I/O port (as figure 1), and the disadvantage is that NVMe and SCSI use the same WWPN in the connection process, and when a problem occurs, it is difficult to distinguish which protocol causes the problem; when the multi-protocol mixed running is influenced, if one protocol I/O fault influences a link, the I/O of the two protocols can be interrupted; when the switch scribes the zone according to the WWPN, the SCSI and the NVMe cannot be isolated.

Therefore, a data transmission scheme supporting multiple protocols, which can effectively solve the above problems, is needed.

Disclosure of Invention

In order to solve the above problem, a first aspect of the present invention provides a FC card multi-protocol data transmission method, including:

acquiring a plurality of transmission protocols aggregated by the FC card on a storage node;

respectively establishing a first port and a second port for each transmission protocol, and allocating a unique identifier for the first port;

and distributing a data transmission task for the first port based on the unique identification.

In some embodiments of the invention, the method further comprises:

in response to the first port failing, assigning the unique identifier to the second port and distributing data transfer tasks for the second port based on the unique identifier.

In some embodiments of the present invention, the plurality of transport protocols aggregated by the FC card include: NVME protocol and SCSI protocol.

In some embodiments of the present invention, respectively establishing a first port and a second port for each of the transport protocols, and assigning a unique identifier to the first port, includes:

creating a drive of the NVME protocol and the SCSI protocol according to the NVME protocol and the SCSI protocol;

the driver based on the NVME protocol and the SCSI protocol respectively creates a first port and a second port for the NVME protocol and the SCSI protocol; and

and allocating a first unique identifier for the first port of the NVME protocol and allocating a second unique identifier for the first port of the SCSI protocol.

In some embodiments of the invention, further comprising: and allocating a third unique identifier to the FC card.

In some embodiments of the present invention, distributing the data transmission task for the first port based on the unique identifier comprises:

and identifying the first preset area of the unique identification according to the interface number of the first port on the FC card.

In some embodiments of the present invention, distributing the data transmission task for the first port based on the unique identifier further comprises:

and identifying the second preset area of the unique identification according to the number of the aggregation protocols.

Another aspect of the present invention further provides a FC card multiprotocol data transmission system, including:

an obtaining module configured to obtain a plurality of transport protocols aggregated by the FC card on a storage node;

the distribution module is configured to establish a first port and a second port for each transmission protocol respectively and distribute a unique identifier for the first port;

a transmission module configured to distribute a data transmission task for the first port based on the unique identifier.

Yet another aspect of the present invention provides a computer apparatus, comprising:

at least one processor; and

a memory storing computer instructions executable on the processor, the instructions when executed by the processor implementing the steps of the method of any one of the above embodiments.

The method may include:

step S1, acquiring a plurality of transmission protocols aggregated by the FC card on the storage node;

step S2, respectively establishing a first port and a second port for each transmission protocol, and allocating a unique identifier for the first port;

and step S3, distributing a data transmission task for the first port based on the unique identifier.

In some embodiments of the invention, the method further comprises:

In some embodiments of the invention, the method further comprises: and allocating a third unique identifier to the FC card.

Yet another aspect of the present invention further provides a computer-readable storage medium, which stores a computer program, wherein the computer program is configured to implement the steps of the method according to any one of the above embodiments when executed by a processor.

By the FC card multi-protocol data transmission method provided by the invention, the expansion of a plurality of logic ports is provided for the existing physical port, the data isolation transmission of different transmission protocols is realized, the mutually independent logic ports are used for link connection, the mutual influence of NVMe and SCSI is reduced, and the high availability of multi-protocols is ensured; in addition, when the mixed use of multiple protocols causes problems, the problems can be conveniently and quickly positioned through wpn.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a flowchart of a FC card multi-protocol data transmission method according to an embodiment of the present invention;

fig. 2 is a schematic structural diagram of an FC card multi-protocol data transmission system according to an embodiment of the present invention;

FIG. 3 is a schematic structural diagram of a computer device based on the method of the present invention according to an embodiment of the present invention

FIG. 4 is a schematic structural diagram of a computer storage medium based on the method of the present invention according to an embodiment of the present invention;

fig. 5 is a schematic diagram of a fault drift of an embodiment of a method for transmitting multiprotocol data of an FC card according to the present invention;

fig. 6 is a structural diagram of a logical port according to an embodiment of a method for transmitting FC card multi-protocol data according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention are described in further detail with reference to the accompanying drawings.

It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used for distinguishing two entities with the same name but different names or different parameters, and it should be noted that "first" and "second" are merely for convenience of description and should not be construed as limitations of the embodiments of the present invention, and they are not described in any more detail in the following embodiments.

As shown in fig. 1, a first aspect of the present invention provides a FC card multi-protocol data transmission method, including:

In the embodiment of the present invention, the method of the present invention is applied to a transmission unit, i.e. a fiber transmission module, hereinafter referred to as FC card, for communication between servers. The FC card used in the present invention has 4 network fiber sockets, hereinafter referred to as physical ports. I.e. 4 physical ports transmit the allocated transmission tasks independently. In addition, the server in the embodiment of the invention can be provided with a plurality of FC cards which work independently, and the transmission tasks of the FC cards do not have conflict.

In this embodiment, in step S1, the method provided by the present invention needs to determine which transport protocols transmitted by the FC card are used in the server (storage node, or other servers supporting fiber optic transmission) node where the FC card is located. I.e. the transport protocol aggregated by the FC card is obtained.

In step S2, two redundant logical transport ports (logical ports implemented by a program, not real physical ports) are set for the transport protocol aggregated on the FC card, i.e., the Host Port and the Failover Port of each transport protocol. And a WWPN (World Wide Port Name) for identifying the transmission protocol is assigned to the Host Port of the protocol. And the WWPN of the physical port on the FC card for each transport protocol is different.

In some embodiments of the present invention, redundant ports (Host Port and Failover Port) set by the aggregated transport protocols on the FC card are set for each physical Port, that is, each physical Port includes multiple sets of Host ports and Failover ports of the transport protocols. Or 4 physical ports are arranged on the FC card, and each physical Port has a plurality of pairs of Host ports and Failover ports according to the transmitted protocol.

In step S3, in transferring data, data transfer is performed according to the WWPN assigned by the Host Port in the physical Port on the FC card. That is, the physical port distributes the data to the HostPort logical port of the corresponding protocol according to the WWPN in the data after receiving the data. Different transport protocols are distinguished by the WWPN and assigned to different logical ports.

In some embodiments of the invention, the method further comprises:

In order to prevent hardware failure of a single storage server, in real-world applications, a storage cluster scheme is generally adopted. In this embodiment, when a node fails, a transmission task of the node is transferred to a peer node, specifically, corresponding WWPNs allocated to a plurality of transmission protocols of a HostPort of a plurality of physical ports of an FC card on the failed node are allocated to Failover ports of a plurality of transmission protocols included in a plurality of physical ports of an FC card on the peer node, and the failed storage node is replaced by the Failover Port to perform data transmission. The switching of the fault node can be quickly realized only by sending the WWPN of the corresponding protocol to the opposite node.

In this embodiment, the transport protocol of FC card aggregation provided in this embodiment is NVME protocol and SCSI protocol. That is, in 4 physical ports on the FC card, each physical Port aggregates data transmission tasks of the NVME protocol and the SCSI protocol, and each physical Port includes two hostports and two Failover ports, and belongs to the NVME protocol and the SCSI protocol, respectively.

In some embodiments of the present invention, as shown in fig. 5, fig. 5 shows a fault drift implementation based on NVME protocol and SCSI protocol, in which node a and NodeB only show 1 FC card, and because of the spatial relationship, only two physical ports (fibre ports) are shown on each FC card. Each physical Port of the node b node contains a HostPort and a Failover Port of SCSI protocol (b1), and a HostPort and a Failover Port of NVME protocol (b 2). Also, each physical Port on the NodeA node contains a HostPort (a1) and a Failover Port of the SCSI protocol, and a HostPort (a2) and a Failover Port of the NVME protocol. When a node A node fails, the WWPN of the SCSI protocol HostPort (a1) of each physical Port on the node A node can drift to the corresponding SCSI protocol Failover Port (b1) on the node B node, and the WWPN of the NVME protocol HostPort (a2) of each physical Port can drift to the SCSI protocol Port (b2) on the node B node. Likewise, multiple physical ports of multiple FC cards may each drift to a Failover Port on a corresponding physical Port on a corresponding FC card. When the NodeA fails, a failure drift request is sent to the NodeB, WWPN distributed by the logic ports of all transmission protocols of all ports on the NoadA is sent to the NodeB, the NodeB agent NodeA node executes a data transmission task, the original data transmission system capability of the NodeB is affected at the moment, and two additional transmission channels are added for each optical fiber physical port. But the influence of service breakdown caused by the failure of the node A node on the service can not occur, and the stability of the user service is kept.

In this embodiment, a WWPN needs to be allocated to a plurality of physical ports (4 fiber sockets) on the FC card to distinguish the physical Port from other 3 physical ports, where the WWPN is allocated to a PrimaryPort of the physical Port, and the PrimaryPort is a logical Port like a HostPort and a Failover Port, except that the PrimaryPort represents the physical Port, or is used to identify that data belongs to the physical Port during data transmission.

In this embodiment, in order to support data transmission in an isolated manner by sharing the same physical port for the two protocols, support needs to be given at the driver layer. The method specifically comprises the following steps:

and initializing the driver, wherein the driver initialization comprises loading and initialization of the SCSI and NVMe driver. Firstly, initializing an FC card (Emulex or Qlogic card) on a storage node to enable support of NVMe and SCSI; in the FC protocol interaction process, the response and the support to the FC-NVMe protocol are increased;

establishing data mapping from a kernel memory space to a PCEI link of an FC card; namely, loading a kernel device driver to create a character device, such as,/dev/emlx 2/dev/qfc1 and the like; the PCI BAR registers are mapped to virtual memory and the device file is accessible to the user space system via device memory mapping. Initializing FC card firmware, and allocating memory buffers for user space driver access and for communication with hardware.

The interface program PLIF calls a port enabling function, enables the physical port, and then drives the creation of queues for receiving data in the physical port and for assigning data to different transport protocols according to the WWPN identification in the data.

The method comprises the steps that a drive enables a physical port to register to a fabric (a remote authentication switch which is transmitted through an optical fiber and is similar to the process of acquiring an IP address during network cable transmission) so as to acquire the WWPN of a logical PrimaryPort of the physical port, and login is performed through the WWPN after the registration is successful;

after the physical port is successfully logged in, the driver enables the HostPort of the transport protocol, namely the HostPort of the NVME protocol and the SCSI protocol, and registers and logs in the fabric. Specifically, the interaction flow of the login and registration of the HostPort to the switch (fabric switch) is as follows:

firstly, a HostPort sends a request of FLOGI (FDISC), and a shock returns the reply information of an accept and returns a port id; secondly, the HostPort sends the request of PLOGI and attaches port id information, and the switch returns the reply information of the accept; thirdly, the HostPort sends the request of the SCR and attaches port id information, and the switch returns the reply information of the accept; then, the HostPort sends the request of the NS REG and attaches port id information, and the switch returns the reply information of the accept; and finally, the HostPort sends the request of the QUERY and attaches port id information, and the swing returns the reply information of the accept.

In some embodiments of the present invention, in the fault drift as shown in fig. 5, if Node a fails, the Failover trigger condition is satisfied, and HostPort a (including NVME and SCSI) on Node a needs Failover; if node A sends a message to node B, indicating that node B can not work, node B acts immediately, PLIF stops port a, and meanwhile, enables failover port B on node B; and if the node A cannot send information to the node B, waiting until the heartbeat of the node A is overtime and the lease is exhausted, informing the PLIF node A of incapability of working through CSM, and triggering the failover of the PLIF. The FailoverPort b of the NodeB registers and registers with the fabric with the WWPN of HostPort a (including NVME and SCSI).

As described above, in some embodiments of the present invention, the structure of the WWPN of the proposed solution of the present invention is shown in fig. 6, where WWPN1 represents the world unique identifier of PrimaryPort of the physical port; WWPN2 represents the world-unique identification of the HostPort of the SCSI protocol; WWPN3 represents the world unique identification of the NVME protocol.

In addition, the WWPN distribution rule occupies 64 bits, wherein 4 bits of 63-60 represent NAA (network Address authority); 24 bits of 59-36 represent OUI (organization Unit identifier) enterprise organization Unique ID; 35-24 bits represents PUI (product Unit identifier) product Unique identifier; 8 bits of 23-16 are written to 0 at the time of production, and are used by the storage software to generate unique addresses (the upper 4 bits represent slot numbers and the lower 4 bits represent port numbers); 15 bits of 15-1 represent that each control enclosure is assigned a unique value (starting with 0 and adding 1 in sequence); the 0 th bit represents a specific controller, i.e., a resonator 1(C ═ 0) and a resonator 2(C ═ 1).

In order to match the improvement of the method of the invention, 16-23 bits in the 64-bit WWPN are specified to be used for marking the HostPort of different transmission protocols, namely 8-bit data is used for distinguishing the SCSI of 4 physical ports on the FC card from the HostPort of NVME. Specifically, the high 4 bits are used for identifying 4 physical ports on the FC card, the low 4 bits are used for identifying the 3 WWPNs in a 16-system coding mode, and it is specified that PrimaryPort codes are 1-4 of 16-system, HostPort codes are 5-8 of 16-system, and NVME HostPort codes are 9, a, C, and D.

Taking the physical port on slot 3 as an example, the specific allocation of 23-16 bits is as follows:

Slot＝3	Primary port WWPN	SCSI host port WWPN	NVMe host port WWPN
				Platform port
1	3 1	3 5	3 9
				Platform port 2	3 2	3 6	3 A
Platform port 3	3 3	3 7	3 C
				Platform port 4	3 4	3 8	3 D

as shown in fig. 2, another aspect of the present invention further provides an FC card multiprotocol data transmission system, including:

an obtaining module 1, where the obtaining module 1 is configured to obtain a plurality of transport protocols aggregated by the FC card on a storage node;

the allocation module 2 is configured to establish a first port and a second port for each transport protocol, and allocate a unique identifier to the first port;

a transmission module 3, wherein the transmission module 3 is configured to distribute a data transmission task for the first port based on the unique identifier.

As shown in fig. 3, yet another aspect of the present invention also provides a computer apparatus, including:

at least one processor 21; and

a memory 22, said memory 22 storing computer instructions executable on said processor 21, said instructions when executed by said processor implementing a FC card multi-protocol data transfer method comprising:

In some embodiments of the invention, the method further comprises:

As shown in fig. 4, a further aspect of the present invention also proposes a computer-readable storage medium 401, which stores a computer program 402, and the computer program 402 implements the steps of the method according to any one of the above embodiments when being executed by a processor.

The method may include:

In some embodiments of the invention, the method further comprises:

By the FC card multi-protocol data transmission method provided by the invention, the expansion of a plurality of logic ports is provided for the existing physical port, so that the data isolation transmission of different transmission protocols is realized, the mutually independent logic ports are ensured to be used for link connection, the mutual influence of NVMe and SCSI is reduced, and the high availability of multi-protocols is ensured; in addition, when the mixed use of multiple protocols causes problems, the problems can be conveniently and quickly positioned through wpn.

Finally, it should be noted that, as one of ordinary skill in the art can appreciate that all or part of the processes in the methods of the above embodiments can be implemented by a computer program to instruct related hardware, and the program of the method for centralized server testing can be stored in a computer readable storage medium, and when executed, the program can include the processes of the embodiments of the methods as described above. The storage medium of the program may be a magnetic disk, an optical disk, a Read Only Memory (ROM), a Random Access Memory (RAM), or the like. The embodiments of the computer program may achieve the same or similar effects as any of the above-described method embodiments.

Furthermore, the methods disclosed according to embodiments of the present invention may also be implemented as a computer program executed by a processor, which may be stored in a computer-readable storage medium. Which when executed by a processor performs the above-described functions defined in the methods disclosed in embodiments of the invention.

Further, the above method steps and system elements may also be implemented using a controller and a computer readable storage medium for storing a computer program for causing the controller to implement the functions of the above steps or elements.

Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments of the present invention.

In one or more exemplary designs, the functions may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a general-purpose or special-purpose computer, or a general-purpose or special-purpose processor. Also, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (D0L), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, D0L, or wireless technologies such as infrared, radio, and microwave are all included in the definition of medium. Disk and disc, as used herein, includes Compact Disc (CD), laser disc, optical disc, Digital Versatile Disc (DVD), floppy disk, blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.

The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the present disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments of the invention may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.

It should be understood that, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.

The numbers of the embodiments disclosed in the embodiments of the present invention are merely for description, and do not represent the merits of the embodiments.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, of embodiments of the invention is limited to these examples; within the idea of an embodiment of the invention, also technical features in the above embodiment or in different embodiments may be combined and there are many other variations of the different aspects of the embodiments of the invention as described above, which are not provided in detail for the sake of brevity. Therefore, any omissions, modifications, substitutions, improvements, and the like that may be made without departing from the spirit and principles of the embodiments of the present invention are intended to be included within the scope of the embodiments of the present invention.

Claims

1. A FC card multi-protocol data transmission method is characterized by comprising the following steps:

2. The method of claim 1, further comprising:

3. The method of claim 1, wherein the plurality of transport protocols aggregated by the FC card comprises: NVME protocol and SCSI protocol.

4. The method of claim 3, wherein establishing a first port and a second port for each of the transport protocols, respectively, and assigning a unique identifier to the first port comprises:

5. The method of claim 4, further comprising: and allocating a third unique identifier to the FC card.

6. The method of claim 1, wherein distributing the data transfer task for the first port based on the unique identifier comprises:

7. The method of claim 1, wherein distributing the data transfer task for the first port based on the unique identifier further comprises:

8. An FC card multiprotocol data transfer system, comprising:

9. A computer device, comprising:

at least one processor; and

a memory storing computer instructions executable on the processor, the instructions when executed by the processor implementing the steps of the method of any one of claims 1 to 7.

10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.