CN114661239B - NVME hard disk-based data interaction system and method - Google Patents

Abstract

The invention relates to the technical field of data storage and discloses a data interaction system and method based on an NVME hard disk; in this scheme, this data interaction system includes: the system comprises a processor, a PCIE exchange unit connected with the processor, a plurality of NVME hard disks connected with the PCIE exchange unit and an NVME system management card connected with the PCIE exchange unit; the NVME hard disk in the scheme is connected with the processor through the PCIE exchange unit, so that the expansibility of the NVME hard disk can be improved; in addition, the NVME system management card in the scheme can also help the processor to finish the processing operation on the NVME hard disk, so that the occupied operation resources of the processor are reduced, and the overall operation capacity of the system is improved.

Description

A data interaction system and method based on NVME hard disk

Technical Field

The present invention relates to the technical field of data storage, and more specifically, to a data interaction system and method based on an NVME hard disk.

Background Art

As a new storage medium, NVME (Nonvolatile Memory Express) hard disk can reach the speed of PCIE Gen4 x4, and PCIE Gen5 x4 hard disk is already under development. NVME is an interface specification, which is currently used for storage devices. NVME hard disk improves system storage performance while also providing massive storage for the system. Currently, many server manufacturers are building all-flash servers, using NVME storage columns to achieve higher read and write performance. Elastic bare metal server is a physical server rental service that is purchased on demand and paid for by volume. It provides cloud-dedicated high-performance, securely isolated physical clusters for core databases, key application systems, and high-performance computing services. It provides real-time business response capabilities for enterprise customers. Compared with traditional servers built on AHCI (Advanced Host Controller Interface), storage servers based on NVME have the characteristics of low latency and high reliability, and the processing commands at the software level have also been redefined, and the SCSI (Small Computer System Interface)/ATA (AT Attachment) command specifications are no longer used. It simplifies operations, reduces latency, and improves IOPS (Input/Output Operations Per Second) and throughput.

At present, when a bare metal server interacts with an NVME hard disk, the NVME hard disk uses the PCIE (Peripheral component interconnect express, high-speed serial computer expansion bus standard) high-speed bus in the server to directly connect it to the computer's CPU (Central Processing Unit, central processing unit), which is limited by the number of CPU ports and storage rate, and NVME cannot be expanded indefinitely in a server; see Figure 1, which is a schematic diagram of NVME hard disk connection in an existing solution. It can be seen from Figure 1 that the NVME hard disk is directly connected to the CPU via PCIE, and the scalable number of NVME hard disks is taken from the number of PCIE ports of the CPU. In addition, this NVME hard disk uses PCIE to physically connect to the CPU end, which not only requires a large amount of CPU computing resources, but also increases the processing delay of client applications.

Therefore, how to improve the scalability of NVME hard disks and reduce the computing resources occupied by the CPU is a problem that technical personnel in this field need to solve.

Summary of the invention

The object of the present invention is to provide a data interaction system and method based on NVME hard disk, so as to improve the scalability of NVME hard disk and reduce the computing resources occupied by CPU.

To achieve the above object, the present invention provides a data interaction system based on NVME hard disk, the data interaction system comprising:

A processor, a PCIE switching unit connected to the processor, a plurality of NVME hard disks connected to the PCIE switching unit, and an NVME system management card connected to the PCIE switching unit;

The processor is used to: perform data exchange with the corresponding NVME hard disk through the PCIE switching unit, and send a processing task to the NVME system management card through the PCIE switching unit;

The NVME system management card is used to: receive the processing task, perform processing operations on the corresponding NVME hard disk through the PCIE switching unit, and send the corresponding processing results to the processor through the PCIE switching unit.

Wherein, the processor is specifically used to: send business data and management requirement data to the NVME system management card through the PCIE switching unit.

The processor includes: a first processor and a second processor, the first processor is connected to the second processor, and the first processor is connected to the PCIE switching unit.

The NVME system management card is specifically used to: receive the business data, perform a read operation or a write operation on the NVME hard disk according to the business data, and send the operation result to the first processor through the PCIE switching unit.

Among them, if the business data includes encryption instructions and data to be stored, the NVME system management card is specifically used to: encrypt the data to be stored according to the encryption instructions, and then store the encrypted data in the corresponding NVME hard disk.

Wherein, if the business data includes a data reading instruction, the NVME system management card is specifically used for:

The target data is read from the corresponding NVME hard disk according to the data reading instruction; if the target data is encrypted data, the target data is decrypted and then sent to the first processor through the PCIE switching unit; if the target data is not encrypted data, it is directly sent to the first processor through the PCIE switching unit.

Wherein, if the management requirement data includes a virtualization instruction, the NVME system management card is specifically used to: perform a hard disk virtualization operation on the NVME hard disk according to the virtualization instruction.

Among them, if the management demand data includes a hard disk monitoring instruction, the NVME system management card is specifically used to: query the working status of the NVME hard disk according to the hard disk monitoring instruction, and send the query result to the processor through the PCIE switching unit.

The processor is connected to the PCIE switching unit via a PCIE bus, and the PCIE switching unit is connected to the NVME system management card and the NVME hard disk via a PCIE bus.

To achieve the above object, the present invention further provides a data interaction method based on NVME hard disk, the data interaction method comprising:

The processor exchanges data with the corresponding NVME hard disk through the PCIE switching unit, and sends the processing task to the NVME system management card through the PCIE switching unit;

The NVME system management card receives the processing task, performs a processing operation on the corresponding NVME hard disk through the PCIE switching unit, and sends the corresponding processing result to the processor through the PCIE switching unit.

It can be seen from the above scheme that an embodiment of the present invention provides a data interaction system and method based on an NVME hard disk; in this scheme, the data interaction system includes: a processor, a PCIE switching unit connected to the processor, a plurality of NVME hard disks connected to the PCIE switching unit, and an NVME system management card connected to the PCIE switching unit; wherein the processor is used to perform data interaction with the corresponding NVME hard disk through the PCIE switching unit, and send processing tasks to the NVME system management card through the PCIE switching unit; the NVME system management card is used to receive processing tasks, and perform processing operations on the corresponding NVME hard disk through the PCIE switching unit, and send the corresponding processing results to the processor through the PCIE switching unit; it can be seen that the NVME hard disk in the present application is connected to the processor through the PCIE switching unit, which can improve the scalability of the NVMe hard disk; and the NVME system management card in the present application can also help the processor complete the processing operation on the NVME hard disk, reduce the computing resources occupied by the processor, and improve the overall computing power of the system.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

Figure 1 is a schematic diagram of NVME hard disk connection;

FIG2 is a schematic diagram of the structure of a data interaction system based on an NVME hard disk disclosed in an embodiment of the present invention;

FIG3 is a schematic diagram of a data interaction disclosed in an embodiment of the present invention;

FIG4 is a flow chart of a data interaction method based on an NVME hard disk disclosed in an embodiment of the present invention.

DETAILED DESCRIPTION

In the traditional solution, connecting NVME hard disks through the PCIE port of the CPU requires a large number of physical ports of the CPU, and related communications will occupy a large amount of CPU computing resources. Taking the Whitley (platform code) platform released by Intel as an example, the CPU has a total of 64 Lanes. If all are connected to NVME hard disks, it can only support 16 NVME hard disks. When there is a need to connect PCIE standard cards, the number may be reduced. For example: the server is configured with 2 100G network cards, which requires 2 PCIE x16 ports. In this way, the NVME hard disks will be reduced by 8 at a time, and only 8 NVME hard disks can be expanded under the CPU.

Therefore, the present application provides a data interaction system and method based on NVME hard disk to reduce the number of CPU physical ports used, unload the CPU computing power on the NVME hard disk, improve the node computing power, and improve the NVME hard disk data read and write rate and NVME hard disk utilization rate.

The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

2 , a schematic diagram of the structure of a data interaction system based on an NVME hard disk provided in an embodiment of the present invention, the data interaction system comprises: a processor 10, a PCIE switching unit 20 connected to the processor 10, a plurality of NVME hard disks 30 connected to the PCIE switching unit 20, and an NVME system management card 40 connected to the PCIE switching unit 20;

The processor 10 is used to: perform data exchange with the corresponding NVME hard disk 30 through the PCIE switching unit 20, and send processing tasks to the NVME system management card 40 through the PCIE switching unit 20;

The NVME system management card 40 is used to receive processing tasks, perform processing operations on the corresponding NVME hard disk 30 through the PCIE switching unit 20, and send the corresponding processing results to the processor 10 through the PCIE switching unit 20.

Specifically, the processor 10 in this embodiment includes a first processor and a second processor, the first processor is connected to the second processor, and the first processor is connected to the PCIE switching unit 20. That is to say, the server where the processor 10 in this solution is located is a dual-channel server, and the two processors are interconnected using UPI (Ultra Path Interconnect), and only one of the processors is connected to the PCIE switching unit 20, which is used to send a processing task to the NVME system management card 40 through the PCIE switching unit 20, and the processing task includes business data and management demand data. Among them, the business data refers to the data for performing a read operation or a write operation on the NVME hard disk 30. After the NVME system management card 40 receives the business data, it can perform a read operation or a write operation on the NVME hard disk 30 according to the business data, and send the operation result to the corresponding processor through the PCIE switching unit 20. The management demand data includes the specific operations that the NVME system management card 40 needs to help the processor to perform, such as: data reading, data writing, data encryption, etc., which are not specifically limited here, as long as they are operations that the NVME system management card 40 can implement.

In this embodiment, the NVME system management card 40 can be implemented by a custom-developed FPGA (Field Programmable Gate Array, Field Programmable Gate Array) card, or it can be built by a commercially available NVME management chip, which is not specifically limited here, as long as it can help the processor 10 complete the processing of the NVME hard disk 30. In addition, the processor 10 in this embodiment is specifically connected to the PCIE switching unit 20 through the PCIE bus, and the PCIE switching unit 20 is specifically connected to the NVME system management card 40 and the NVME hard disk 30 through the PCIE bus. That is: the NVME hard disk 30 in this solution is connected to the PCIE switching unit 20 through the PCIE bus, and is not strongly bound to the port of the processor 10, so that it can have better flexibility; and this solution does not limit the number of NVME hard disks, which can be set according to needs.

3 , which is a data interaction diagram provided by an embodiment of the present invention. The CPU0 in the figure is the first processor in the present solution, the CPU1 in the figure is the second processor in the present solution, and the PCIE Switch in the figure is the PCIE switching unit 20 in the present solution. It can be seen from FIG3 that the PCIE Switch connects the PCIE port of CPU0 with the NVME hard disk and the NVME management card. In this way, the CPU0 and the NVME management card can route with each other with the NVME hard disk. For example, in the dotted line portion ①, the CPU0 can interact the business data and management demand data with the NVME system management card through the PCIE Switch; in the dotted line portion ②, the CPU0 can directly route to the NVME hard disk through the PCIE Switch to read and write the NVME hard disk; in the dotted line portion ③, the NVME system management card can access the NVME hard disk through the PCIE Switch, process and process the data, and transmit the processed data back to the CPU0, thereby releasing the computing power of the CPU0.

In summary, it can be seen that the NVME hard disk in this application is connected to the processor through a PCIE switching unit, which can improve the scalability of the NVME hard disk; and the NVME system management card in this application can also help the processor complete the processing operations on the NVME hard disk, reduce the computing resources occupied by the processor, and improve the overall computing power of the system.

Based on the above embodiment, in this embodiment, the process of the NVME system management card implementing the processing operation according to the processing task sent by the processor is specifically described. It can be understood that the operation implemented by the NVME system management card can be specifically executed according to the processing task sent by the processor, and is not limited to the various processing operations described in this embodiment.

1. If the business data includes encryption instructions and data to be stored, the NVME system management card is specifically used to: encrypt the data to be stored according to the encryption instructions, and then store the encrypted data in the corresponding NVME hard disk.

Specifically, the business data in this embodiment may include data to be stored, and the data to be stored is stored in the corresponding NVME hard disk through the NVME system management card; however, in order to improve data security, the processor can also issue encryption instructions together with the data to be stored. Therefore, the NVME system management card can encrypt the data to be stored according to the encryption instruction, and store the encrypted data in the corresponding NVME hard disk; wherein the encryption instruction carries information such as encryption algorithm and encryption method; this scheme can also encrypt the data to be stored separately, such as: the data to be stored includes data to be stored stored in NVME hard disk 1 and data to be stored stored in NVME hard disk 2. Different encryption algorithms can be used to encrypt different data to be stored, thereby better ensuring data security.

2. If the business data includes a data read instruction, the NVME system management card is specifically used to: read the target data from the corresponding NVME hard disk according to the data read instruction; if the target data is encrypted data, decrypt the target data and then send it to the first processor through the PCIE switching unit; if the target data is not encrypted data, send it directly to the first processor through the PCIE switching unit.

In this embodiment, if the business data includes a data reading instruction, the NVME system management card can read data from the corresponding NVME hard disk according to the data reading instruction. If the read data is encrypted data, it needs to be decrypted and then sent to the processor through the PCIE switching unit. If the read data is not encrypted data, it can be sent directly to the processor through the PCIE switching unit to ensure that the processor can normally identify the data stored in the NVME hard disk.

3. If the management demand data includes a virtualization instruction, the NVME system management card is specifically used to: perform a hard disk virtualization operation on the NVME hard disk according to the virtualization instruction.

In this embodiment, the management demand data may include virtualization instructions, and the NVME system management card can perform hard disk virtualization operations on the NVME hard disk through the virtualization instructions; for example, if the virtualization instruction is to virtualize 4 NVME hard disks, the NVME system management card can virtualize the hard disk resources composed of the NVME hard disks into 4 NVME hard disks, thereby facilitating use.

4. If the management demand data includes a hard disk monitoring instruction, the NVME system management card is specifically used to: query the working status of the NVME hard disk according to the hard disk monitoring instruction, and send the query result to the processor through the PCIE switching unit.

In this embodiment, the management demand data may also include hard disk monitoring instructions, that is: when the processor wants to obtain the working status of each NVME hard disk, it can send the hard disk monitoring instruction to the NVME system management card. After the query, the NVME system management card can feed back the query result to the processor so that the processor can timely understand the working status of each NVME hard disk; of course, the NVME system management card can also monitor the working status of each NVME hard disk in real time. If a NVME hard disk fault is found, the fault information can be sent to the processor through the PCIE switching unit in time for the processor to process.

In summary, compared with the traditional solution, this solution has at least the following beneficial effects:

1. Strong scalability: This solution can expand more NVME hard disks under the energy consumption allowed by the whole machine through cascading PCIE switching units;

2. Improve node computing power: This solution frees up the CPU computing power spent on NVME hard disks and hands it over to the NVME system management card for processing, reducing the CPU load and thereby improving the overall computing power of the node, thereby increasing the computing power benefits of a single node;

3. Resource pooling: A large number of NVME hard disks can be virtualized into a large number of hard disk resources through the PCIE switching unit and provided to corresponding businesses.

4. Convenient topology switching. If the CPU wants to obtain a smaller delay and use the data of the NVME hard disk as a calculation cache, the CPU can directly access the NVME hard disk through the PCIE Switch; if only data is stored, the CPU can write data to the NVME system management card through the PCIE Switch, and the NVME system management card selects the optimal path for data storage through PCIE With;

5. Data security: NVME system management card can encrypt data, and has more data encryption methods and better data security than traditional system processing solutions.

Referring to FIG. 4 , a flow chart of a data interaction method based on an NVME hard disk provided by an embodiment of the present invention is shown. The data interaction method includes:

S101, the processor exchanges data with the corresponding NVME hard disk through the PCIE switching unit, and sends a processing task to the NVME system management card through the PCIE switching unit;

S102, the NVME system management card receives the processing task, performs a processing operation on the corresponding NVME hard disk through the PCIE switching unit, and sends the corresponding processing result to the processor through the PCIE switching unit.

The processor sends the processing task to the NVME system management card through the PCIE switching unit, including: the processor sends the business data and management demand data to the NVME system management card through the PCIE switching unit.

The processor includes: a first processor and a second processor, the first processor is connected to the second processor, and the first processor is connected to the PCIE switching unit.

Among them, the NVME system management card receives the processing task, performs a processing operation on the corresponding NVME hard disk through the PCIE switching unit, and sends the corresponding processing result to the processor through the PCIE switching unit, including: the NVME system management card receives the business data, and performs a read operation or a write operation on the NVME hard disk according to the business data, and sends the operation result to the first processor through the PCIE switching unit.

The NVME system management card performs write operations on the NVME hard disk according to the business data, including:

If the business data includes an encryption instruction and data to be stored, the NVME system management card encrypts the data to be stored according to the encryption instruction and stores the encrypted data in the corresponding NVME hard disk.

The NVME system management card performs a read operation on the NVME hard disk according to the business data, including:

If the business data includes a data reading instruction, the NVME system management card reads the target data from the corresponding NVME hard disk according to the data reading instruction; if the target data is encrypted data, the target data is decrypted and then sent to the first processor through the PCIE switching unit; if the target data is not encrypted data, it is directly sent to the first processor through the PCIE switching unit.

The NVME system management card receives the processing task and performs the processing operation on the corresponding NVME hard disk through the PCIE switching unit, including:

If the management requirement data includes a virtualization instruction, the NVME system management card performs a hard disk virtualization operation on the NVME hard disk according to the virtualization instruction.

The NVME system management card receives the processing task and performs the processing operation on the corresponding NVME hard disk through the PCIE switching unit, including:

If the management demand data includes a hard disk monitoring instruction, the NVME system management card queries the working status of the NVME hard disk according to the hard disk monitoring instruction, and sends the query result to the processor through the PCIE switching unit.

The processor is connected to the PCIE switching unit via a PCIE bus, and the PCIE switching unit is connected to the NVME system management card and the NVME hard disk via a PCIE bus.

The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

The above description of the disclosed embodiments enables one skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

Claims (9)

1. A data interaction system based on NVME hard disk, characterized in that the data interaction system comprises: A processor, a PCIE switching unit connected to the processor, a plurality of NVME hard disks connected to the PCIE switching unit, and an NVME system management card connected to the PCIE switching unit; The processor is used to: perform data exchange with the corresponding NVME hard disk through the PCIE switching unit, and send a processing task to the NVME system management card through the PCIE switching unit; The NVME system management card is used to: receive the processing task, perform processing operations on the corresponding NVME hard disk through the PCIE switching unit, and send the corresponding processing results to the processor through the PCIE switching unit; Among them, the processor is specifically used to: send business data and management requirement data to the NVME system management card through the PCIE switching unit; the business data includes data to be stored, encryption instructions and data reading instructions, and the management requirement data includes virtualization instructions and hard disk monitoring instructions. 2. The data interaction system according to claim 1 is characterized in that the processor comprises: a first processor and a second processor, the first processor is connected to the second processor, and the first processor is connected to the PCIE switching unit. 3. The data interaction system according to claim 2, characterized in that: The NVME system management card is specifically used to: receive the business data, perform a read operation or a write operation on the NVME hard disk according to the business data, and send the operation result to the first processor through the PCIE switching unit. 4. The data interaction system according to claim 3 is characterized in that if the business data includes encryption instructions and data to be stored, the NVME system management card is specifically used to: encrypt the data to be stored according to the encryption instructions, and then store the encrypted data in the corresponding NVME hard disk. 5. The data interaction system according to claim 3, characterized in that if the business data includes a data reading instruction, the NVME system management card is specifically used to: The target data is read from the corresponding NVME hard disk according to the data reading instruction; if the target data is encrypted data, the target data is decrypted and then sent to the first processor through the PCIE switching unit; if the target data is not encrypted data, it is directly sent to the first processor through the PCIE switching unit. 6. The data interaction system according to claim 1 is characterized in that if the management requirement data includes a virtualization instruction, the NVME system management card is specifically used to: perform a hard disk virtualization operation on the NVME hard disk according to the virtualization instruction. 7. The data interaction system according to claim 1 is characterized in that if the management requirement data includes a hard disk monitoring instruction, the NVME system management card is specifically used to: query the working status of the NVME hard disk according to the hard disk monitoring instruction, and send the query result to the processor through the PCIE switching unit. 8. The data interaction system according to any one of claims 1 to 7, characterized in that the processor is connected to the PCIE switching unit via a PCIE bus, and the PCIE switching unit is connected to the NVME system management card and the NVME hard disk via a PCIE bus. 9. A data interaction method based on NVME hard disk, characterized in that the data interaction method comprises: The processor exchanges data with the corresponding NVME hard disk through the PCIE switching unit, and sends the processing task to the NVME system management card through the PCIE switching unit; The NVME system management card receives the processing task, performs a processing operation on the corresponding NVME hard disk through the PCIE switching unit, and sends the corresponding processing result to the processor through the PCIE switching unit; Among them, the processor sends business data and management demand data to the NVME system management card through the PCIE switching unit; the business data includes data to be stored, encryption instructions and data reading instructions, and the management demand data includes virtualization instructions and hard disk monitoring instructions.