CN107797945A - A kind of storage system and its date storage method, device, system and equipment - Google Patents

Abstract

The embodiment of the present invention discloses a storage system and its data storage method, device, system, equipment and computer-readable storage medium, including receiving the write IO request sent by the host end, and encapsulating the data information in the write IO request into a Data link structure; send the data link structure to the upper cache of the peer node, so that the upper cache of the peer node stores the data information in the data link structure; receive the first response information returned by the upper cache of the peer node and The first storage address, and store the data information in the write IO request to the node; send the first storage address to the lower cache of the node, so that the lower cache of the node sends the first storage address to the peer node The lower layer cache enables the lower layer cache of the peer node to reuse the first storage address. The embodiment of the present invention saves communication link resources between nodes during use, and both the data processing efficiency and the performance of the entire storage system are improved.

Description

A storage system and its data storage method, device, system and equipment

technical field

Embodiments of the present invention relate to the technical field of storage systems, and in particular, to a storage system and its data storage method, device, system, equipment, and computer-readable storage medium.

Background technique

Typically, caches in storage systems are divided into write caches, read caches, and metadata, and the existence of caches can effectively improve storage performance. At present, the application of dual-control storage is becoming more and more extensive. In a typical dual-control storage system, the cache is divided into upper-layer cache and lower-layer cache. The data can be returned after a while, and the upper-level cache can asynchronously flush the written data to the lower-level cache of the node, thereby completing the processing at the cache level. Considering the problem of data consistency, both the upper-level cache and the lower-level cache in this node need to mirror the written data to the peer node, that is, the upper-level cache of this node sends the write data to the upper-level cache of the peer node for backup , and the lower layer cache of this node also needs to send the write data to the lower layer cache of the peer node for backup, the same write data needs to be mirrored twice, the communication link between nodes consumes more resources, and the data processing efficiency is low , thereby affecting the performance of the entire storage system.

Therefore, how to provide a storage system and its data storage method, device, system, equipment, and computer-readable storage medium to solve the above-mentioned technical problems has become a problem to be solved by those skilled in the art.

Contents of the invention

The purpose of the embodiments of the present invention is to provide a storage system and its data storage method, device, system, equipment, and computer-readable storage medium, which saves communication link resources between nodes, data processing efficiency and overall Storage system performance has been improved.

In order to solve the above technical problems, an embodiment of the present invention provides a data storage method for a storage system, including:

receiving the write IO request sent by the host, and encapsulating the data information in the write IO request into a data link structure;

Sending the data link structure to the upper cache of the peer node, so that the upper cache of the peer node stores the data information in the data link structure;

receiving the first response information and the first storage address returned by the upper layer cache of the peer node, and storing the data information in the write IO request to the node;

sending the first storage address to the lower cache of the local node, so that the lower cache of the local node sends the first storage address to the lower cache of the peer node, so that the peer node The lower layer cache multiplexes the first storage address.

Optionally, after storing the data information in the write IO request to this node, it also includes:

Obtaining the second storage address where the data information is stored in the local node, and sending the second storage address to the lower-layer cache of the local node, so that the lower-layer cache of the local node can reuse the second storage address.

Optionally, after storing the data information in the write IO request to this node, it also includes:

return the second response information to the host.

Correspondingly, an embodiment of the present invention provides a data storage device of a storage system, including:

An encapsulation module, configured to receive a write IO request sent by the host, and encapsulate the data information in the write IO request into a data link structure;

The first sending module is configured to send the data link structure to the upper cache of the peer node, so that the upper cache of the peer node stores the data information in the data link structure;

The first receiving module is configured to receive the first response information and the first storage address returned by the upper cache of the peer node;

a storage module, configured to store the data information in the write IO request into the node;

A second sending module, configured to send the first storage address to the lower-layer cache of the local node, so that the lower-layer cache of the local node sends the first storage address to the lower-layer cache of the peer node , enabling the lower layer cache of the peer node to reuse the first storage address.

Optionally, an acquisition module is also included, configured to acquire a second storage address in the local node where the data information is stored;

The second sending module is further configured to send the second storage address to the lower-layer cache of the local node, so that the lower-layer cache of the local node can reuse the second storage address.

Optionally, return module is also included;

The storage module is further configured to trigger the return module after storing the data information in the write IO request to the node;

The returning module is configured to return the second response information to the host.

An embodiment of the present invention provides a storage system, including a host and a data storage device of the storage system as described above.

An embodiment of the present invention provides a data storage device of a storage system, including:

memory for storing computer programs;

A processor configured to implement the steps of the data storage method for the storage system described above when executing the computer program.

An embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the data storage method for the storage system described above are implemented.

Embodiments of the present invention provide a storage system and its data storage method, device, system, equipment, and computer-readable storage medium, including: receiving a write IO request sent by a host, and encapsulating the data information in the write IO request into A data link structure; send the data link structure to the upper cache of the peer node, so that the upper cache of the peer node can store the data information in the data link structure; receive the first response information returned by the upper cache of the peer node and the first storage address, and store the data information in the write IO request to the node; send the first storage address to the lower cache of the node, so that the lower cache of the node can send the first storage address to the peer node The lower layer cache of the peer node multiplexes the first storage address.

In the embodiment of the present invention, when processing a write IO request, it only needs to perform a data mirroring action on the upper cache of the local node to the upper cache of the peer node, and then store the corresponding data on the peer node through the lower cache of the local node The first storage address of the information is sent to the lower-level cache of the peer node, and the lower-level cache of the peer node reuses the data information of the first storage address, thereby realizing the mirroring of the data information in the write IO request in the lower-level cache of the peer node . Since the number of bytes occupied by the first storage address is much smaller than the number of bytes of data information in the write IO request, the embodiment of the present invention reduces the occupancy of communication link resources between nodes when processing the write IO request , which saves communication link resources between nodes, and improves data processing efficiency and performance of the entire storage system.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the prior art and the accompanying drawings that need to be used in the embodiments. Obviously, the accompanying drawings in the following description are only some of the present invention. Embodiments, for those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

FIG. 1 is a schematic flowchart of a data storage method of a storage system provided by an embodiment of the present invention;

FIG. 2 is a schematic structural diagram of a data storage device of a storage system provided by an embodiment of the present invention.

Detailed ways

Embodiments of the present invention provide a storage system and its data storage method, device, system, equipment, and computer-readable storage medium, which saves communication link resources between nodes, data processing efficiency and the entire storage system during use. performance has been improved.

In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

Please refer to FIG. 1 . FIG. 1 is a schematic flowchart of a data storage method of a storage system according to an embodiment of the present invention.

The method includes:

S11: Receive the write IO request sent by the host, and encapsulate the data information in the write IO request into a data link structure;

It should be noted that the data information carried in the write IO request sent by the host usually includes multiple data blocks, wherein the size of each data block is, for example, 32k. In the embodiment of the present invention, the write IO request sent by the host will be received The node is called the local node, and the backup node corresponding to the local node is called the peer node. For example, the present node is the first node in the storage system, and the peer node is the second node in the storage system.

Specifically, after the local node (first node) in the embodiment of the present invention receives the write IO request sent by the host, the upper cache located on the local node will encapsulate each data block carried in the write IO request into A data link structure, which can effectively associate data information larger than 32k together and maintain the continuity of data information.

S12: Send the data link structure to the upper cache of the peer node, so that the upper cache of the peer node can store the data information in the data link structure;

Specifically, after the upper layer structure of this node (first node) encapsulates the data information carried in the write IO request into a data link structure, the data link structure is sent to the upper layer cache of the peer node (second node), and the After receiving the data link structure, the upper layer cache of the end node (second node) stores the data information in the data link structure into the node, and returns the first response information to the first node after the storage is successful, and at the same time The first storage address where the data information is stored is also returned to the first node.

S13: Receive the first response information and the first storage address returned by the upper cache of the peer node, and store the data information in the write IO request to the node;

It can be understood that, after receiving the first response information returned by the peer node (second node), the local node (first node) in the embodiment of the present invention stores the data information in the write IO request on the local node , that is, after the data information in the write IO request is successfully stored on the second node, the data information in the write IO request is stored on the current node. When the first response information returned by the second node is not received, it can be considered If the storage of data information on the second node fails, the operation of storing data information on this node will not be performed at this time, and the situation can also be fed back to the host to ensure data consistency and ensure that when this node fails, After the peer node takes over, it can still provide services to save resources and effectively guarantee processing efficiency.

S14: Send the first storage address to the lower cache of the local node, so that the lower cache of the local node sends the first storage address to the lower cache of the peer node, so that the lower cache of the peer node reuses the first storage address.

It should be noted that after the upper layer cache of the node stores the data information in the write IO request to the node, the upper layer cache of the node needs to flush the data to the lower layer cache. At this time, the upper layer cache of the node will The first storage address returned by the upper cache of the node is flushed to the lower cache of the node, and the lower cache of the node sends the first storage address to the lower cache of the peer node after receiving the first storage address , at this time, there is no need to send the data information to the lower layer cache of the peer node, but only need to send the first storage address of the data information stored in the peer node to the lower layer cache of the peer node, the lower layer cache of the peer node The first storage address is received and multiplexed, and directly linked to the data information stored in the node through the storage address. Since the number of bytes of the information of the first storage address is much smaller than the number of bytes of the data information, the resource occupation of the communication link between nodes will be greatly reduced and the processing speed will be improved.

It should also be noted that after the lower layer cache of the peer node (second node) reuses the first storage address, it can also return the third response information to the first node (this node), so that the first node can know the peer node in time Whether the lower layer cache of the node receives the first storage address and reuses it successfully.

In addition, when the upper-level cache in this node is flushing data to the lower-level cache in this node, you can directly flush the stored data information in the write IO request to the lower-level cache in this node. This process requires The resource of the communication link between the upper layer cache and the lower layer cache inside the node.

It should also be noted that in the storage system of the embodiment of the present invention, the data information actually stored in the first node and the second node are both one copy, that is, when the data information stored in the upper layer cache of the second node is stored by the first node When the first storage address of the information is sent to the lower-level cache in the second node, the lower-level cache can find the data information stored in the second node through the first storage address, that is, the upper-level cache and the lower-level cache in the second node Both can refer to the data information stored at the first storage address.

In the embodiment of the present invention, when processing a write IO request, it only needs to perform a data mirroring action on the upper cache of the local node to the upper cache of the peer node, and then store the corresponding data on the peer node through the lower cache of the local node The first storage address of the information is sent to the lower-level cache of the peer node, and the lower-level cache of the peer node reuses the data information of the first storage address, thereby realizing the mirroring of the data information in the write IO request in the lower-level cache of the peer node . Since the number of bytes occupied by the first storage address is much smaller than the number of bytes of data information in the write IO request, the embodiment of the present invention reduces the occupancy of communication link resources between nodes when processing the write IO request , which saves communication link resources between nodes, and improves data processing efficiency and performance of the entire storage system.

As a specific embodiment, after the data information in the write IO request is stored in the node in S13 of the above embodiment, the method may further include:

Obtaining the second storage address for storing data information in the current node, and sending the second storage address to the lower layer cache of the current node, so that the lower layer cache of the current node can reuse the second storage address.

It should be noted that when the upper-level cache in this node flushes data to the lower-level cache in this node, in addition to directly flushing the stored data information in the write IO request to the lower-level cache in this node In addition, the second storage address that stores the data information in the write IO request in the current node can also be obtained, and the second storage address can be downloaded to the lower layer cache of the current node, and the lower layer cache of the current node can be based on the second The storage address is linked to the stored data information, that is, both the upper cache of the node and the lower cache of the node can find the same data information through the second storage address. In the embodiment of the present invention, the overall processing speed can be improved by sending the second storage address without sending corresponding data information.

As a specific embodiment, after the data information in the write IO request is stored in the node in S13 of the above embodiment, the method may further include returning the second response information to the host.

Specifically, after the upper layer cache of the local node stores the data information in the write IO request to the local node, the second response information may also be returned to the host to notify the host that the write IO request is processed successfully. Of course, when the processing of the write IO request fails, the processing failure information can also be returned to the host, so that the host can perform subsequent processing.

The corresponding embodiment of the present invention also discloses a data storage device of a storage system. Please refer to FIG. 2 for details. FIG. 2 is a schematic structural diagram of a data storage device of a storage system provided by an embodiment of the present invention. On the basis of above-mentioned embodiment:

The unit includes:

Encapsulation module 1 is used to receive the write IO request sent by the host, and encapsulate the data information in the write IO request into a data link structure;

The first sending module 2 is configured to send the data link structure to the upper cache of the peer node, so that the upper cache of the peer node stores the data information in the data link structure;

The first receiving module 3 is configured to receive the first response information and the first storage address returned by the upper cache of the peer node;

The storage module 4 is used to store the data information in the write IO request to the node;

The second sending module 5 is used to send the first storage address to the lower layer cache of the node, so that the lower layer cache of the node sends the first storage address to the lower layer cache of the peer node, so that the lower layer cache of the peer node is restored Use the first memory address.

Optionally, an acquisition module is also included, configured to acquire the second storage address of the data information stored in the node;

The second sending module 5 is further configured to send the second storage address to the lower layer cache of the node, so that the lower layer cache of the node can reuse the second storage address.

Optionally, return module is also included;

The storage module 4 is also used to trigger the return module after storing the data information in the write IO request to the node;

The return module is used to return the second response information to the host.

It should be noted that, in the embodiment of the present invention, when processing a write IO request, it is only necessary to perform a data mirroring action on the upper layer cache of the local node to the upper layer cache of the peer node, and then pass the lower layer cache on the local node. The first storage address where the end node stores the corresponding data information is sent to the lower layer cache of the peer node, and the lower layer cache of the peer node reuses the data information of the first storage address, so as to implement the data information in the write IO request on the peer node A mirror image of the underlying cache. Since the number of bytes occupied by the first storage address is much smaller than the number of bytes of data information in the write IO request, the embodiment of the present invention reduces the occupancy of communication link resources between nodes when processing the write IO request , which saves communication link resources between nodes, and improves data processing efficiency and performance of the entire storage system.

In addition, for the specific introduction of the data storage method of the storage system involved in the embodiment of the present invention, please refer to the embodiment of the above method, and the present application will not repeat it here.

On the basis of the foregoing embodiments, an embodiment of the present invention provides a storage system, including a host end and a data storage device of the storage system as described above.

It should be noted that the embodiment of the present invention has higher processing efficiency during use, and the performance of the storage system is also improved. In addition, for the specific introduction of the data storage device of the storage system involved in the embodiment of the present invention, please refer to the embodiment of the above device, and the present application will not repeat it here.

On the basis of the above embodiments, an embodiment of the present invention provides a data storage device of a storage system, including:

memory for storing computer programs;

The processor is configured to implement the steps of the data storage method of the above-mentioned storage system when executing the computer program.

It should be noted that, for the specific introduction of the data storage method of the storage system involved in the embodiment of the present invention, please refer to the above method embodiment, and the present application will not repeat it here.

On the basis of the above-mentioned embodiments, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the above-mentioned data storage method of the storage system is implemented. step.

It should be noted that, for the specific introduction of the data storage method of the storage system involved in the embodiment of the present invention, please refer to the above method embodiment, and the present application will not repeat it here.

Each embodiment in this specification is described in a progressive manner, each embodiment focuses on the difference from other embodiments, and the same and similar parts of each embodiment can be referred to each other. As for the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and for the related information, please refer to the description of the method part.

It should also be noted that in this specification, relative terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that these entities or operations There is no such actual relationship or order between the operations. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.

Professionals can further realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software or a combination of the two. In order to clearly illustrate the possible For interchangeability, in the above description, the composition and steps of each example have been generally described according to their functions. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

The steps of the methods or algorithms described in connection with the embodiments disclosed herein may be directly implemented by hardware, software modules executed by a processor, or a combination of both. Software modules can be placed in random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other Any other known storage medium.

The above description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the present invention will not be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (9)

1. A data storage method for a storage system, comprising: receiving the write IO request sent by the host, and encapsulating the data information in the write IO request into a data link structure; Sending the data link structure to the upper cache of the peer node, so that the upper cache of the peer node stores the data information in the data link structure; receiving the first response information and the first storage address returned by the upper layer cache of the peer node, and storing the data information in the write IO request to the node; sending the first storage address to the lower cache of the local node, so that the lower cache of the local node sends the first storage address to the lower cache of the peer node, so that the peer node The lower layer cache multiplexes the first storage address. 2. The data storage method of the storage system according to claim 1, wherein after storing the data information in the write IO request to the node, further comprising: Obtaining the second storage address where the data information is stored in the local node, and sending the second storage address to the lower-layer cache of the local node, so that the lower-layer cache of the local node can reuse the second storage address. 3. The data storage method of the storage system according to claim 1 or 2, characterized in that, after storing the data information in the write IO request to the current node, further comprising: return the second response information to the host. 4. A data storage device of a storage system, comprising: An encapsulation module, configured to receive a write IO request sent by the host, and encapsulate the data information in the write IO request into a data link structure; The first sending module is configured to send the data link structure to the upper cache of the peer node, so that the upper cache of the peer node stores the data information in the data link structure; The first receiving module is configured to receive the first response information and the first storage address returned by the upper cache of the peer node; a storage module, configured to store the data information in the write IO request into the node; A second sending module, configured to send the first storage address to the lower-layer cache of the local node, so that the lower-layer cache of the local node sends the first storage address to the lower-layer cache of the peer node , enabling the lower layer cache of the peer node to reuse the first storage address. 5. The data storage device of the storage system according to claim 4, further comprising an acquisition module configured to acquire a second storage address in the local node where the data information is stored; The second sending module is further configured to send the second storage address to the lower-layer cache of the local node, so that the lower-layer cache of the local node can reuse the second storage address. 6. The data storage device of the storage system according to claim 4 or 5, further comprising a return module; The storage module is further configured to trigger the return module after storing the data information in the write IO request to the node; The returning module is configured to return the second response information to the host. 7. A storage system, comprising a host and a data storage device of the storage system according to any one of claims 4-6. 8. A data storage device of a storage system, comprising: memory for storing computer programs; A processor, configured to implement the steps of the data storage method of the storage system according to any one of claims 1-3 when executing the computer program. 9. A computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the storage system according to any one of claims 1-3 is implemented. The steps of the data storage method.