CN116243854A - Data storage system and data storage method - Google Patents

Abstract

The embodiment of the present application relates to the application field of storage devices, and discloses a data storage system and a data storage method. The data storage system includes: a host and a flash memory device; the host includes: a host compression module, used for writing data compression; the host decompression module is used to decompress the read data; the flash memory device includes: a flash memory compression module, which is used to perform compression on the write data of the host when it is determined that the compression decision corresponding to the write data of the host is marked as compression Compression; a flash memory decompression module, configured to decompress the read data corresponding to the read request when it is determined that the decompression decision flag corresponding to the read data corresponding to the read request is decompressed. By cooperating with the data compression and decompression of the host and the data compression and decompression of the flash memory device, the present application can improve the storage performance of the flash memory device.

Description

Data storage system and data storage method

technical field

The present application relates to the application field of storage devices, in particular to a data storage system and a data storage method.

Background technique

Flash memory devices, such as Solid State Drives (SSD), are hard disks made of arrays of solid state electronic memory chips. The solid state drives include a control unit and a storage unit (FLASH memory chip or DRAM memory chip).

Currently, the Computable Storage Architecture supports data compression and decompression inside the SSD. Specifically, the data is compressed when the data is written to the SSD. When the host-side application or file system reads data, the SSD first decompresses the data internally and then returns it to the host. Since the current solution relies on the computing resources inside the flash memory device for compression or decompression, it is easy to increase the read and write delay of the flash memory device and affect the storage performance of the flash memory device.

Based on this, the prior art needs to be improved urgently.

Contents of the invention

The embodiments of the present application provide a data storage system and a data storage method, which improve the storage performance of the flash memory device by cooperating with the data compression and decompression of the host and the data compression and decompression of the flash memory device.

The embodiment of the present application provides the following technical solutions:

In a first aspect, an embodiment of the present application provides a data storage system, including: a host and a flash memory device;

Among them, the host is connected to the flash device, and the host includes:

The host compression module is configured to compress the write data corresponding to the write request when determining that the write data corresponding to the write request is marked as compressed, so as to write the compressed write data to the flash memory device;

The host decompression module is used to decompress the read data when it is determined that the decompression decision mark corresponding to the read data of the flash memory device is decompressed;

Among them, the flash memory device is connected to the host, and the flash memory device includes:

The flash memory compression module is configured to compress the write data of the host when it is determined that the compression decision corresponding to the write data of the host is marked as compression;

The flash memory decompression module is configured to decompress the read data corresponding to the read request when it is determined that the decompression decision flag corresponding to the read data corresponding to the read request is decompressed.

In some embodiments,

Hosts also include:

The host driver module is configured to determine the compression decision flag corresponding to the write data corresponding to the write request, and/or determine the decompression decision flag corresponding to the read data of the flash memory device;

Flash devices also include:

The flash memory control module is configured to determine a compression decision flag corresponding to the write data of the host, and/or determine a decompression decision flag corresponding to the read data corresponding to the read request.

In some embodiments,

The host driver module is connected to the flash memory control module, and the host driver module and the flash memory control module perform write request or read request or data interaction.

In some embodiments, the host also includes:

The system module is connected to the host driver module, and is used to send a write request or a read request to the host driver module, so as to receive the response information corresponding to the write request or the response information corresponding to the read request returned by the host driver module, wherein the system module includes the application system and /or the file system.

In the second aspect, the embodiment of the present application provides a data storage method, which is applied to the data storage system in the first aspect, and the method includes:

After the host receives the write request, determine the compression decision mark corresponding to the write request according to the host compression control strategy;

Compressing or not compressing the write data corresponding to the write request according to the compression decision mark, so as to send the write request to the flash memory device, wherein the write request includes compressed write data or original write data;

After the flash memory device receives the write request sent by the host, it compresses or does not compress the write data in the write request according to the compression tag information in the write request, so as to write the compressed write data or the original write data flash media loaded into a flash device.

In some embodiments, according to the host compression control strategy, determining the compression decision mark corresponding to the write request includes:

If the utilization rate of the processor of the host is less than the preset utilization rate threshold, and the data compression rate of the written data corresponding to the write request is less than the preset compression rate threshold value, it is determined that the compression decision corresponding to the write request is marked as compression;

If the utilization rate of the processor of the host is not less than the preset utilization rate threshold, or the data compression rate of the written data corresponding to the write request is not less than the preset compression rate threshold value, then it is determined that the compression decision mark corresponding to the write request is not compression.

In some embodiments, the compression flag information includes compressed or uncompressed, and according to the compression flag information in the write request, the write data in the write request is compressed or uncompressed, including:

If the compression flag information is uncompressed, then determine whether to compress the write data in the write request according to the flash memory compression control strategy, wherein the flash memory compression control strategy includes:

If the utilization rate of the processor of the flash memory device is less than the preset utilization rate threshold, and the data compression rate of the write data corresponding to the write request is less than the preset compression rate threshold, it is determined to compress the write data corresponding to the write request ;

If the utilization rate of the processor of the flash memory device is not less than the preset utilization rate threshold, or the data compression rate of the write data corresponding to the write request is not less than the preset compression rate threshold, then it is determined that the write data corresponding to the write request No compression.

In the third aspect, the embodiment of the present application provides a data storage method, which is applied to the data storage system in the first aspect, and the method includes:

After the host receives the read request, it sends a read request to the flash memory device;

After the flash memory device receives the read request, if the read data corresponding to the read request is compressed data, then determine the decompression decision mark corresponding to the read data according to the decompression control strategy;

The flash memory device determines whether to decompress the read data according to the decompression decision flag, so as to return the decompressed read data or undecompressed read data to the host.

In some embodiments, according to the decompression control strategy, determining the decompression decision flag corresponding to the read data includes:

If the decompression queue in the flash memory device is not full, and the bandwidth utilization of the interface between the host and the flash memory device is less than the preset bandwidth utilization threshold, then determine that the decompression decision corresponding to the read data is marked as decompression;

If the decompression queue in the flash memory device is full, or the bandwidth utilization rate of the interface between the host and the flash memory device is not less than the preset bandwidth utilization rate threshold, it is determined that the decompression decision corresponding to the read data is marked as no decompression.

In some embodiments, the method also includes:

After the host receives the uncompressed read data sent by the flash memory device, it decompresses the uncompressed read data.

In a fourth aspect, the embodiment of the present application also provides a non-volatile computer-readable storage medium, the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to enable the data storage system to execute the second The data storage method of aspect or third aspect.

The beneficial effects of the embodiments of the present application are: different from the prior art, the data storage system provided by the embodiments of the present application includes: a host and a flash memory device; wherein, the host is connected to the flash memory device, and the host includes: host compression A module configured to compress the write data corresponding to the write request when determining that the compression decision corresponding to the write data corresponding to the write request is marked as compression, so as to write the compressed write data to the flash memory device; the host decompression module , used to decompress the read data when it is determined that the decompression decision corresponding to the read data of the flash memory device is decompressed; wherein, the flash memory device is connected to the host, and the flash memory device includes: a flash memory compression module, used to determine the host When the compression decision corresponding to the written data is marked as compressed, the written data of the host is compressed; the flash memory decompression module is used to determine that the decompression decision corresponding to the read data corresponding to the read request is marked as decompressed. Request the corresponding read data to decompress.

By cooperating with the data compression and decompression of the host and the data compression and decompression of the flash memory device, the present application can improve the storage performance of the flash memory device.

Description of drawings

One or more embodiments are exemplified by the pictures in the corresponding drawings, and these exemplifications do not constitute a limitation to the embodiments. Elements with the same reference numerals in the drawings represent similar elements. Unless otherwise stated, the drawings in the drawings are not limited to scale.

FIG. 1 is a schematic structural diagram of a data storage system provided by an embodiment of the present application;

Fig. 2 is a schematic structural diagram of another data storage system provided by an embodiment of the present application;

FIG. 3 is a schematic structural diagram of a flash memory device provided by an embodiment of the present application;

Fig. 4 is a schematic diagram of data compression and decompression of a host provided by an embodiment of the present application;

FIG. 5 is a schematic diagram of data compression and decompression of a flash memory device provided in an embodiment of the present application;

FIG. 6 is a schematic diagram of a host and a flash memory device cooperating to perform data compression and decompression provided by an embodiment of the present application;

FIG. 7 is a schematic flow diagram of a data storage method provided by an embodiment of the present application;

FIG. 8 is a detailed flowchart of step S701 in FIG. 7;

FIG. 9 is a schematic diagram of a data writing operation provided by an embodiment of the present application;

FIG. 10 is a schematic structural diagram of a firmware module of a flash memory device provided in an embodiment of the present application;

Fig. 11 is a schematic flowchart of another data storage method provided by the embodiment of the present application;

Fig. 12 is a detailed flowchart of step S112 in Fig. 11;

FIG. 13 is a schematic diagram of a data read operation provided by an embodiment of the present application.

Detailed ways

In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, not to limit the present application. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

It should be noted that, if there is no conflict, various features in the embodiments of the present application may be combined with each other, and all of them are within the protection scope of the present application. In addition, although the functional modules are divided in the schematic diagram of the device, and the logical order is shown in the flowchart, in some cases, the division of modules in the device or the sequence shown in the flowchart can be performed in different ways. or the steps described. Furthermore, words such as "first", "second", and "third" used in this application do not limit the data and execution order, but only distinguish the same or similar items with basically the same function and effect.

The technical scheme of the present application is specifically described below in conjunction with the accompanying drawings of the description:

Please refer to FIG. 1. FIG. 1 is a schematic structural diagram of a data storage system provided by an embodiment of the present application;

As shown in FIG. 1 , the data storage system 300 includes a flash memory device 100 and a host 200 , wherein the flash memory device 100 is communicatively connected to the host 200 . Wherein, the flash memory device 100 communicates with the host 200 in a wired or wireless manner to realize data and/or command and/or request interaction.

Please refer to FIG. 2 again. FIG. 2 is a schematic structural diagram of another data storage system provided by an embodiment of the present application;

As shown in FIG. 2 , the data storage system 300 includes: a flash memory device 100 and a host 200 .

Specifically, the flash memory device 100 includes: a flash memory medium 110 , a flash memory control module 120 , a flash memory decompression module 130 and a flash memory compression module 140 .

The flash memory medium 110, as the storage medium of the flash memory device 100, is also called flash memory, Flash, Flash memory or Flash particles, belongs to a kind of storage device, is a kind of non-volatile memory, and can also be used under the condition of no current supply Long-term storage of data, its storage characteristics are equivalent to hard disks, so that the flash memory medium 110 can become the basis of the storage medium of various portable digital devices.

The flash memory control module 120 is connected to the flash memory medium 110, the flash memory decompression module 130 and the flash memory compression module 140, and is used to control the internal operation of the flash memory device 100, and realize data and/or commands and/or commands between the flash memory device 100 and the host 200 or request interaction, wherein the request includes a read request and/or a write request.

In the embodiment of the present application, the flash memory control module 120 is a controller of the flash memory device, please refer to FIG. 3 again. FIG. 3 is a schematic structural diagram of a flash memory device provided in the embodiment of the present application;

As shown in FIG. 3 , the flash memory control module 120 includes: a data converter 121 , a processor 122 , a buffer 123 , a flash memory controller 124 and an interface 125 .

The data converter 121 is connected to the processor 122 and the flash memory controller 124 respectively, and the data converter 121 is used for converting binary data into hexadecimal data, and converting hexadecimal data into binary data. Specifically, when the flash memory controller 124 writes data to the flash memory medium 110 , the binary data to be written is converted into hexadecimal data by the data converter 121 , and then written into the flash memory medium 110 . When the flash controller 124 reads data from the flash medium 110, the data converter 121 converts the hexadecimal data stored in the flash medium 110 into binary data, and then reads the converted data from the binary data page register. Wherein, the data converter 121 may include a binary data register and a hexadecimal data register. Binary data registers can be used to store data converted from hexadecimal to binary, and hexadecimal data registers can be used to store data converted from binary to hexadecimal.

The processor 122 is respectively connected to the data converter 121, the cache memory 123, the flash memory controller 124 and the interface 125, wherein the processor 122 and the data converter 121, the cache memory 123, the flash memory controller 124 and the interface 125 can be connected via a bus or Connected in other ways, the processor is used to run the non-volatile software programs, instructions and modules stored in the buffer memory 123, so as to realize any method embodiment of the present application.

The cache memory 123 is mainly used for caching the read/write command sent by the host 200 and the read data or write data obtained from the flash memory medium 110 according to the read/write command sent by the host 200 .

The flash controller 124 is connected with the flash medium 110 , the data converter 121 , the processor 122 and the buffer 123 for accessing the back-end flash medium 110 and managing various parameters and data I/O of the flash medium 110 .

The interface 125 is connected to the host 200, the data converter 121, the processor 122, and the buffer 123, and is used to receive the data sent by the host 200, or receive the data sent by the processor 122, and realize the data transfer between the host 200 and the processor 122. For transmission, the interface 125 can be SATA-2 interface, SATA-3 interface, SAS interface, MSATA interface, PCI-E interface, NGFF interface, CFast interface, SFF-8639 interface and M.2NVME/SATA protocol.

The flash memory decompression module 130 is connected to the flash memory control module 120 and used for decompressing the compressed data in the flash memory medium 110 of the flash memory device 100 .

The flash memory compression module 140 is connected to the flash memory control module 120 and used for compressing the data sent by the host driver module 220 of the host 200 .

Specifically, the host 200 includes: a system module 210 , a host driver module 220 , a host compression module 230 and a host decompression module 240 .

The system module 210 is connected to the host driver module 220, and is used to send a write request or a read request to the host driver module 220, so as to receive the response information corresponding to the write request or the response information corresponding to the read request returned by the host driver module, wherein the write request Including logical address information and data to be written into the flash memory medium, the response information corresponding to the write request includes write success information or write failure information, the write request is received by the host driver module 220, so that the host driver module 220 executes the write request, the write data in the write request is written to the flash memory medium of the flash memory device; the read request includes logical address information, the response information corresponding to the read request includes the data corresponding to the read request, and the read request is received by the host drive module 220 , so that the host driver module 220 executes the write request to read corresponding data in the flash memory medium of the flash memory device. In the embodiment of the present application, the system module 210 includes an application system and/or a file system.

The host driver module 220 is connected to the system module 210, the host compression module 230 and the host decompression module 240, the host driver module 220 is used to control the internal operation of the host 200, and realize the data and/or Interaction of commands and/or requests, wherein the requests include read requests and/or write requests.

Specifically, the host driver module 220 is connected to the flash memory control module 120, and the host driver module 220 and the flash memory control module 120 perform write requests or read requests or data interaction.

The host compression module 230 is connected to the host driver module 220 and used for compressing the data sent by the system module 210 .

The host decompression module 240 is connected to the host driver module 220 for decompressing the compressed data returned by the flash memory device 100 .

In the embodiment of the present application, by setting a compression module and a decompression module in both the host computer and the flash memory device, it is possible to coordinate the processing capabilities of the host computer and the flash memory device, and improve the storage performance of the flash memory device.

The following example illustrates the processing of data compression and decompression:

Please refer to FIG. 4. FIG. 4 is a schematic diagram of data compression and decompression of a host provided by an embodiment of the present application;

As shown in Figure 4, a compression module and a decompression module are set in the host, and the host independently compresses the data on the host side, or decompresses the data on the flash device side, but the compression module and decompression module in this way are usually Based on software implementation, it has the problems of low efficiency and slow speed.

Please refer to FIG. 5 again. FIG. 5 is a schematic diagram of data compression and decompression of a flash memory device provided by an embodiment of the present application;

As shown in Figure 5, a compression module and a decompression module are set in the flash memory device, and the flash memory device independently compresses the data on the host side, or decompresses the data on the flash device side. However, the read performance of the flash memory device in this way It is severely restricted by the computing engine's decompression speed. Also, idle computing resources of the host are not utilized in the process of data compression, resulting in waste of resources and suboptimal overall system read and write performance.

In view of this, in the embodiment of the present application, by setting a compression module and a decompression module in both the host and the flash memory device, it is possible to cooperate with the processing capabilities of the host and the flash memory device, combine the data compression on the host side and the data compression inside the storage device, and make full use of the host The computing power of the computing engine of the flash memory device is used to perform data compression and decompression in a coordinated manner to achieve optimal storage performance.

Specifically, please refer to FIG. 6. FIG. 6 is a schematic diagram of a host and a flash memory device cooperating to perform data compression and decompression according to an embodiment of the present application;

As shown in FIG. 6 , the host includes a host compression module and a host decompression module, and the flash memory device includes a flash memory compression module and a flash decompression module.

Wherein, when the host writes data, the host drive module judges whether to compress the data, if so, then compresses the data through the host compression module, and sends the compressed data to the flash memory device; if not, then directly sends the compressed data to the flash memory device Send uncompressed data. After the flash memory device receives the data sent by the host, it is judged whether the data is compressed data, if so, the data is directly written into the flash memory, that is, written into the flash memory medium; This data is compressed and the compressed data is written to the flash media.

In the embodiment of the present application, the flash memory compression module supports both on-disk online compression and on-disk offline compression. Specifically, the flash memory compression module can compress the data on the data path when the data is written, and then write it to the flash memory medium, that is, online compression in the disk; or, the flash memory compression module can also first write the data into the flash memory Then take the data out of the flash media in an offline manner, compress it, and then write the compressed data back, that is, off-line compression on the disk.

Among them, when reading the data in the flash memory, the calculation engine judges whether the data is compressed data, if so, then decompress the data through the flash memory decompression module, and send the decompressed data to the host; if not, directly Send that data to the host. After the host receives the data sent by the flash memory device, it judges whether the data is compressed data, if so, decompresses it through the host decompression module, and returns the decompressed data to the file system; if not, directly returns the data to the file system.

In the embodiment of the present application, a data storage system is provided, including: a host and a flash memory device; wherein, the host is connected to the flash memory device, and the host includes: a host compression module, configured to determine the write data corresponding to the write request When the compression decision is marked as compression, the write data corresponding to the write request is compressed to write the compressed write data to the flash memory device; the host decompression module is used to determine the decompression corresponding to the read data of the flash memory device When the decision is marked as decompression, the read data is decompressed; wherein, the flash memory device is connected to the host, and the flash memory device includes: a flash memory compression module, which is used to decompress the host when the compression decision corresponding to the written data of the host is marked as compression. The written data is compressed; the flash memory decompression module is configured to decompress the read data corresponding to the read request when the decompression decision flag corresponding to the read data corresponding to the read request is determined to be decompressed.

By cooperating with the data compression and decompression of the host and the data compression and decompression of the flash memory device, the present application can improve the storage performance of the flash memory device.

Please refer to FIG. 7, which is a schematic flowchart of a data storage method provided by an embodiment of the present application;

Wherein, the data storage method is applied to the data storage system provided in the foregoing embodiments.

As shown in Figure 7, the data storage method includes:

Step S701: after the host receives the write request, determine the compression decision flag corresponding to the write request according to the host compression control strategy;

Specifically, the compression decision flag is used to determine whether to compress the written data corresponding to the write request, and the compression decision flag includes compression or no compression.

In this embodiment of the present application, the host compression control strategy is used to determine whether to compress the write data corresponding to the write request according to the utilization rate of the processor of the host and the data compression rate of the write data corresponding to the write request, specifically , according to the host compression control policy, determine the compression decision flag corresponding to the write request, including:

If the utilization rate of the processor of the host is less than the preset utilization rate threshold, and the data compression rate of the written data corresponding to the write request is less than the preset compression rate threshold value, it is determined that the compression decision corresponding to the write request is marked as compression;

If the utilization rate of the processor of the host is not less than the preset utilization rate threshold, or the data compression rate of the written data corresponding to the write request is not less than the preset compression rate threshold value, then it is determined that the compression decision mark corresponding to the write request is not compression.

Specifically, please refer to FIG. 8 again. FIG. 8 is a detailed flowchart of step S701 in FIG. 7;

As shown in Figure 8, the step S701 includes:

Step S7011: Obtain the utilization rate of the processor of the host and the data compression rate of the written data corresponding to the write request;

Step S7012: judging whether the utilization rate of the processor of the host computer is less than a preset utilization rate threshold;

Specifically, the preset utilization threshold is set according to specific needs, for example: 70%, 80%, 90% and other values, assuming that the utilization threshold is 80%, if the utilization rate of the processor of the host is less than 80%, then Go to step S7013; if the utilization rate of the processor of the host is greater than or equal to 80%, go to step S7015;

Step S7013: Determine whether the data compression rate of the written data corresponding to the write request is less than a preset compression rate threshold;

Specifically, the preset compression rate threshold is set according to specific needs, for example: 70%, 80%, 90% and other values, assuming that the compression rate threshold is 80%, if the data compression rate of the written data corresponding to the write request is less than 80%, enter step S7014; if the data compression ratio of the write data corresponding to the write request is greater than or equal to 80%, enter step S7015.

Step S7014: Determine that the compression decision corresponding to the write request is marked as compression;

It can be understood that if it is determined that the compression decision corresponding to the write request is marked as compression, it means that the host needs to compress the written data corresponding to the write request.

Step S7015: Determine that the compression decision corresponding to the write request is marked as no compression.

It can be understood that if it is determined that the compression decision corresponding to the write request is marked as no compression, it means that the host does not need to compress the written data corresponding to the write request.

Step S702: Compress or not compress the write data corresponding to the write request according to the compression decision flag, so as to send the write request to the flash memory device, wherein the write request includes compressed write data or original write data;

Specifically, if the compression decision is marked as compression, the host will compress the write data corresponding to the write request to send the write request to the flash memory device, that is, send the compressed write data in the write request to the flash memory device; if the compression decision If it is marked as no compression, the host does not compress the write data corresponding to the write request to send the write request to the flash memory device, that is, to send the original write data in the write request to the flash memory device.

Step S703: After the flash memory device receives the write request sent by the host, compress or uncompress the write data in the write request according to the compression tag information in the write request, so that the compressed write data or the original write data The input data is written to the flash media of the flash device.

Specifically, after the compression decision flag is determined, the compression flag information is added to the write request, wherein the compression flag information includes compressed or uncompressed, that is, the write request received by the flash memory device from the host contains data "compressed" or "compressed". If the data is compressed, the flash memory device will write the data into the flash memory. If the data is not compressed, the flash memory device will execute its internal compression decision logic to decide whether to compress the written data and then write flash media. It can be understood that the compression decision flag corresponds to the compression flag information. If the compression decision flag is compressed, the corresponding compression flag information is compressed, and if the compression decision flag is not compressed, the corresponding compression flag information is uncompressed.

In this embodiment of the application, the write request corresponds to a segment of commands. Adding compression flag information to the write request is equivalent to adding a flag bit to the write command. For example, in the NVMe basic specification v1.4, the 8th to 15th A byte is a reserved field, and in the embodiment of the present application, 1 can be written into the eighth byte as a mark that the written data has been compressed. If 1 is not written in the 8th byte, it indicates that the written data is not compressed. It should be noted that the example here is only used as an illustration of the implementation of the application, and does not limit the actual implementation of the application.

Specifically, according to the compression mark information in the write request, the written data in the write request is compressed or not compressed, including:

If the compression flag information in the write request is uncompressed, the flash memory device compresses the written data in the write request;

If the compression mark information in the write request is compressed, the flash memory device does not compress the written data in the write request.

It can be understood that if the flash memory device compresses the write data in the write request, then write the compressed write data into the flash memory medium of the flash memory device; if the flash memory device does not compress the write data in the write request , then write the original write data to the flash medium of the flash device.

In some embodiments, the host further includes a host compression judging module, and the host judging compression module is connected to the host driver module, wherein the host compression judging module is used to determine the compression decision flag corresponding to the write data corresponding to the write request, and set the Compression decision flags are returned to the host driver module. It can be understood that the host compression judging module may include a processor or a microprocessor for judging whether the utilization rate of the processor of the host is less than a preset utilization threshold, and judging whether the data written into the data corresponding to the write request Whether the compression rate is less than the preset compression rate threshold.

In some embodiments, the flash memory device further includes a flash memory compression judging module connected to the flash memory control module, wherein the flash memory compression judging module is used to determine whether to compress the written data in the write request. It can be understood that the flash memory compression judging module may include a processor or a microprocessor, which is used to obtain the utilization rate of the processor of the flash memory device, and accurately estimate the compression rate of the written data, and then judge the utilization rate of the processor of the flash memory device. Whether the rate is less than a preset utilization rate threshold, and determine whether the data compression rate of the written data corresponding to the write request is less than the preset compression rate threshold.

Please refer to FIG. 9 again. FIG. 9 is a schematic diagram of a data writing operation provided by an embodiment of the present application;

As shown in Figure 9, the host includes a host compression module, a host compression judgment module, a system module, and a host driver module, and the flash memory device includes a flash memory compression module, a flash memory compression judgment module, a flash memory control module, and a flash memory medium, wherein the process of data writing operation details as follows:

(1) The system module sends a write request to the host driver module, wherein the write request includes logical address information and write data. In the embodiment of the present application, the write request includes a host write command (HostCmd), and the host write command includes: an identifier (Cmd ID) of the host write command, a logical block address (Logical Block Address, Lba) and data to be written.

(2) The host driver module determines the compression decision mark corresponding to the write request according to the host compression control strategy; or, the host compression judgment module determines the compression decision mark corresponding to the write request according to the host compression control strategy, and returns the compression decision mark to Host driver module.

(3) The host driver module determines whether to invoke the host compression module to compress the written data corresponding to the write request according to the compression decision flag. If the compression decision is marked as compression, the host compression module is controlled to compress the written data; if the compression decision is marked as no compression, the host compression module is not controlled to compress the written data.

(4) The host drive module submits a write request to the flash memory control module, and the write request includes logical address information, compressed write data or original write data, and compression mark information.

(5) The flash memory control module checks the compression mark information after receiving the write request sent by the host driver module, and if the compression mark information is compressed, then writes the compressed write data to the flash memory medium; if the compression mark information is If not compressed, the flash memory control module determines whether to compress the written data in the write request according to the flash memory compression control strategy. Alternatively, the flash memory control module calls the flash memory compression judgment module to judge whether to compress the read data, so that the flash memory compression judgment module sends the judgment result to the flash memory control module.

(6) The flash memory control module determines whether to call the flash memory compression module to compress the written data according to the determination result or the judgment result, if the determined result is compressed, then the written data is compressed; if the determined result is not compressed, then no Write data for compression.

(7) The flash memory control module records the compression mark of the write address and the logical physical address mapping information in the flash memory algorithm module in its firmware module, and writes the write data corresponding to the write request to the flash memory medium.

Please refer to FIG. 10 again. FIG. 10 is a schematic structural diagram of a firmware module of a flash memory device provided by an embodiment of the present application;

Wherein, the firmware module is used to connect the host (HOST) and the flash memory medium (NAND) to realize the processing of data IO.

As shown in FIG. 10, the firmware module 10 is connected to the host computer 200 and the hardware module 20, including:

The front-end module 101, namely (Front End, FE), is used to obtain host commands to generate IO operations, wherein the front-end module is also responsible for communication protocols with the host (Host), host commands, solid-state disk command analysis and other operations ;

The flash memory algorithm module 102, i.e. the flash memory translation layer (Flash translation layer, FTL), is connected to the data processing module, and is used for mapping the IO operation to determine the flash memory medium to be issued; wherein, the flash memory algorithm module (FlashTranslation Layer, FTL) Send the IO operation to the back-end module (Back End, BE) of the solid-state disk controller, so that the back-end module of the solid-state disk controller receives the IO operation sent by the flash memory algorithm module;

The back-end module 103, i.e. (Back End, BE), is connected to the flash memory algorithm module, and is used to receive the IO operation sent by the flash memory algorithm module, so as to control the hardware module to perform read/write/erase operations on the flash memory medium;

In the embodiment of the present application, the hardware module 20, i.e. (HW Op Nand Mode), refers to the module that operates the FLASH flash memory, is connected to the back-end module 103, and is controlled by the back-end module 103 for operating the FLASH flash memory, for example: According to the IO operation, the operation is performed on the corresponding flash memory medium, that is, the operation and processing of data to the FLASH flash memory is completed, and the operation includes read operation, write operation, and erase operation.

Wherein, after the front-end module obtains the host command, it processes to generate an IO operation, and sequentially passes through the flash memory algorithm module, the back-end module and the hardware module to operate the flash memory medium. For example: when the host reads data, the host (Host) sends the host command to the flash memory device (device), and the front-end module (FE) of the flash memory device receives the host command, processes it and distributes it to the flash algorithm module (FTL), and the flash algorithm module receives After that, through logic-to-physical conversion processing, the requested NAND read operation is then sent to the back-end module (BE). After the back-end module receives the read operation, it sends the hardware instruction to the hardware module (HW Op Nand Mode), and the The hardware modules operate NAND processing in parallel.

(8) The flash memory control module returns the response information of the write request to the host driver module.

(9) The host drive module returns the response information corresponding to the write request to the system module, so that the system module returns the response information corresponding to the write request to the application program corresponding to the write request, so that the current write operation ends.

In the embodiment of the present application, the data writing process is completed through the interaction and processing between the host and each module of the flash memory device, and the processing of the host and the flash memory device can be coordinated to improve the write performance of the flash memory device.

In this embodiment of the present application, a data storage method is provided, which is applied to the data storage system of the above embodiment, and the method includes: after the host receives the write request, according to the host compression control strategy, determine the compression decision corresponding to the write request mark; according to the compression decision mark, the write data corresponding to the write request is compressed or not compressed, so as to send the write request to the flash memory device, wherein the write request includes the compressed write data or the original write data; in the flash memory device After receiving the write request sent by the host, compress or uncompress the write data in the write request according to the compression tag information in the write request, so as to write the compressed write data or the original write data to the flash memory The device's flash media. By determining the compression decision flag corresponding to the write request, according to the compression decision flag, it is determined whether to compress or not compress the written data, so as to write the compressed written data or the original written data to the flash memory medium of the flash memory device. Application can reduce write latency, thereby improving the write performance of flash memory devices.

Please refer to Fig. 11, Fig. 11 is a schematic flowchart of another data storage method provided by the embodiment of the present application;

Wherein, the data storage method is applied to the data storage system provided in the foregoing embodiments.

As shown in Figure 11, the data storage method includes:

Step S111: after the host receives the read request, send the read request to the flash memory device;

Specifically, after receiving the read request sent by the system module, the host driver module sends the read request to the flash memory control module of the flash memory device.

Step S112: After the flash memory device receives the read request, if the read data corresponding to the read request is compressed data, then determine the decompression decision flag corresponding to the read data according to the decompression control strategy;

In some embodiments, according to the decompression control strategy, determining the decompression decision flag corresponding to the read data includes:

If the decompression queue in the flash memory device is not full, and the bandwidth utilization of the interface between the host and the flash memory device is less than the preset bandwidth utilization threshold, then determine that the decompression decision corresponding to the read data is marked as decompression;

If the decompression queue in the flash memory device is full, or the bandwidth utilization rate of the interface between the host and the flash memory device is not less than the preset bandwidth utilization rate threshold, it is determined that the decompression decision corresponding to the read data is marked as no decompression.

In addition, this application can also support setting the "host decompression" flag in the read request of the host. The host decompression flag is used to notify the flash memory device that there is no need to decompress the read data, and the decompression operation will be executed on the host side after the host receives the read response. . Among them, whether the data returned to the host is compressed or uncompressed will be represented by a bitmap in the read response.

Specifically, please refer to FIG. 12 again. FIG. 12 is a detailed flowchart of step S112 in FIG. 11;

As shown in Figure 12, the step S112 includes:

Step S1121: Obtain the queue information of the decompression queue in the flash memory device and the bandwidth utilization rate of the interface between the host and the flash memory device;

Specifically, a decompression queue is maintained in the firmware module of the flash memory device, and the queue information of the decompression queue is used to identify the current state of the decompression queue, for example, the current queue length. It can be understood that the current queue length is less than or equal to the total queue length of the decompression queue.

Step S1122: judging whether the decompression queue in the flash memory device is not full;

Specifically, judging whether the decompression queue in the flash memory device is not full includes: judging whether the current queue length of the decompression queue in the firmware module of the flash memory device is less than the total length of the queue of the decompression queue, if so, then determining whether the flash memory device The decompression queue in the flash device is not filled; if not, it is determined that the decompression queue in the flash memory device is full.

If the decompression queue in the flash memory device is not full, then enter step S1123;

If the decompression queue in the flash memory device is full, go to step S1124.

Step S1123: judging whether the bandwidth utilization rate of the interface between the host and the flash memory device is less than a preset bandwidth utilization rate threshold;

Specifically, the preset bandwidth utilization threshold is set according to specific needs, for example: 70%, 80%, 90% and other values, assuming that the bandwidth utilization threshold is 80%, if the bandwidth utilization of the interface between the host and the flash memory device is less than 80%, then enter step S1124; if the bandwidth utilization rate of the interface between the host and the flash memory device is greater than or equal to 80%, then enter step S1125.

Step S1124: Determine that the decompression decision mark corresponding to the read data is decompression;

Specifically, the decompression decision flag is used to determine whether the flash memory device decompresses the read data. If the decompression decision mark is decompression, the flash memory control module in the flash memory device calls the flash memory decompression module to decompress the read data. ; If the decompression decision is marked as no decompression, the flash memory control module in the flash memory device does not call the flash memory decompression module to decompress the read data.

Step S1125: Determine that the decompression decision mark corresponding to the read data is not decompressed.

Step S113: The flash memory device determines whether to decompress the read data according to the decompression decision flag, so as to return the decompressed read data or the uncompressed read data to the host.

Specifically, if the decompression decision is marked as decompression, the flash memory control module calls the flash memory decompression module to decompress the read data, and returns the decompressed read data to the host drive module of the host;

If the decompression decision is marked as no decompression, the flash control module does not call the flash decompression module to decompress the read data, and returns the undecompressed read data to the host drive module of the host.

Please refer to FIG. 13 again. FIG. 13 is a schematic diagram of a data read operation provided by an embodiment of the present application;

As shown in Figure 13, the host includes a host decompression judgment module, a host decompression module, a system module, and a host drive module, and the flash memory device includes a flash memory decompression module, a flash memory decompression judgment module, a flash memory control module, and a flash memory medium. details as follows:

(1) The system module sends a read request to the host driver module, and the read request includes a list of logical addresses and the length of data expected to be read. In the embodiment of the present application, the read request includes a host read command (HostCmd), and the host read command includes: the identifier (Cmd ID) of the host write command, the logical block address (Logical Block Address, Lba) and the address length to be read ( Len), wherein, relative to the host, the logical block address is generally 512Byte, 4k, etc.

(2) The host drive module sends a read request to the flash memory control module.

(3) The flash memory control module queries the write address, compression mark and logical physical address mapping information recorded in the flash memory algorithm module in the firmware module, and reads the read data required by the read request from the flash memory medium.

(4) The flash memory control module determines whether the read data is compressed data according to the compression mark information corresponding to the read data, if so, the flash memory control module further judges whether the read data is decompressed; or, the flash memory The control module calls the flash memory decompression judgment module to judge whether to decompress the read data, so that the flash memory decompression judgment module sends the judgment result to the flash memory control module.

Specifically, judging whether to decompress the read data includes: determining the decompression decision flag corresponding to the read data according to the decompression control strategy, wherein, according to the decompression control strategy, determining the decompression decision corresponding to the read data tags, including:

If the decompression queue in the flash memory device is not full, and the bandwidth utilization of the interface between the host and the flash memory device is less than the preset bandwidth utilization threshold, then determine that the decompression decision corresponding to the read data is marked as decompression;

If the decompression queue in the flash memory device is full, or the bandwidth utilization rate of the interface between the host and the flash memory device is not less than the preset bandwidth utilization rate threshold, it is determined that the decompression decision corresponding to the read data is marked as no decompression.

(5) The flash memory control module determines whether the read data is decompressed according to the decompression decision mark, and if the decompression decision mark is decompressed, the flash memory control module calls the flash memory decompression module to decompress the read data; If the decompression decision is marked as no decompression, the flash memory control module does not call the flash memory decompression module to decompress the read data.

(6) The flash memory control module returns the response information corresponding to the read request to the host driver module, wherein the response information corresponding to the read request includes the read data and the compression mark of the read data, and the compression mark is used to indicate the compression mark of the read data Compression state, the compression state includes uncompressed or compressed, that is, the compression flag includes uncompressed or compressed.

(7) The host drive module checks the response information corresponding to the read request returned by the flash memory control module. If the compression mark of the read data in the response information corresponding to the read request is uncompressed, then in the host , determine that the decompression decision mark corresponding to the read data is not decompressed; if the compression mark of the read data is compressed, then in the host, determine that the decompression decision mark corresponding to the read data is decompression.

(8) The host driver module determines whether to call the host decompression module to decompress the read data according to the decompression decision flag. If the decompression decision is marked as decompression, the read data is decompressed; if the decompression decision is marked as no decompression, the written data is not decompressed. It can be understood that, after the host receives the uncompressed read data sent by the flash memory device, the host decompresses the uncompressed read data.

(9) The host drive module returns the response information corresponding to the read request to the system module, so that the system module returns the response information corresponding to the read request to the application program corresponding to the read request, so that the current read operation ends.

In the embodiment of the present application, the data read operation process is completed through the interaction and processing between the host and each module of the flash memory device, and the processing of the host and the flash memory device can be coordinated to improve the read performance of the flash memory device.

Moreover, through the unified protocol between the flash memory control module and the firmware module of the flash memory device, the traditional logical page data structure is not changed, and data status information is added to indicate whether the logical page is in a compressed state or an uncompressed state, for example: when multiple pages are included Each bit in the bitmap is used to mark whether the corresponding page is compressed or uncompressed, and the solid-state disk drive on the host side and the firmware inside the solid-state disk can be based on the compressed state when the system is running Or perform corresponding read and write processing on the written data pages in a non-compressed state, which can improve the overall performance of the flash memory device.

In addition, by using the idle computing resources of the host to increase the IOPS and bandwidth that can be achieved by the flash memory device, the read and write delay can be reduced.

In this embodiment of the present application, by providing a data storage method, which is applied to the data storage system of the above embodiment, the method includes: sending a read request to the flash memory device after the host receives the read request; After the request, if the read data corresponding to the read request is compressed data, determine the decompression decision flag corresponding to the read data according to the decompression control strategy; the flash memory device determines whether to decompress the read data according to the decompression decision flag , to return decompressed read data or uncompressed read data to the host. Determine the decompression decision mark corresponding to the read data through the decompression control strategy, and determine whether to decompress the read data according to the decompression decision mark, so as to return the decompressed read data or uncompressed read data to the host , the present application can reduce the read delay of the flash memory device, thereby improving the read performance of the flash memory device.

The embodiment of the present application also provides a non-volatile computer storage medium. The computer storage medium stores computer-executable instructions, and the computer-executable instructions are executed by one or more processors. For example, the above-mentioned one or more processors may Execute the data storage method in any of the above method embodiments, for example, execute the data storage method in any of the above method embodiments, for example, perform the steps described above.

The above-described device or device embodiments are only illustrative, wherein the unit modules described as separate components may or may not be physically separated, and the components displayed as modular units may or may not be physical units, that is It can be located in one place, or it can be distributed to multiple network module units. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a general hardware platform, and of course also by hardware. Based on this understanding, the essence of the above technical solutions or the part that contributes to related technologies can be embodied in the form of software products, and the computer software products can be stored in computer-readable storage media, such as ROM/RAM, disk , optical disk, etc., including several instructions until a computer device (which may be a personal computer, server, or network device, etc.) executes the methods of each embodiment or some parts of the embodiment.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; under the thinking of the present application, the above embodiments or technical features in different embodiments can also be combined, The steps can be performed in any order, and there are many other variations of the different aspects of the application as above, which are not presented in detail for the sake of brevity; although the application has been described in detail with reference to the preceding examples, those of ordinary skill in the art It should be understood that it is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technology of each embodiment of the application. scope of the program.

Claims (10)

1. A data storage system, comprising: a host and a flash memory device;

wherein the host is connected to the flash memory device, the host includes:

the host compression module is used for compressing the write data corresponding to the write request when the compression decision mark corresponding to the write data corresponding to the write request is determined to be compressed, so as to write the compressed write data into the flash memory device;

The host decompression module is used for decompressing the read data when the decompression decision mark corresponding to the read data of the flash memory device is determined to be decompression;

wherein the flash memory device is connected to the host, the flash memory device includes:

the flash memory compression module is used for compressing the write-in data of the host when the compression decision mark corresponding to the write-in data of the host is determined to be compression;

and the flash decompression module is used for decompressing the read data corresponding to the read request when the decompression decision mark corresponding to the read data corresponding to the read request is determined to be decompressed.

2. The system of claim 1, wherein the system further comprises a controller configured to control the controller,

the host further comprises:

the host driving module is used for determining a compression decision mark corresponding to the write data corresponding to the write request and/or determining a decompression decision mark corresponding to the read data of the flash memory device;

the flash memory device further includes:

the flash memory control module is used for determining a compression decision mark corresponding to the writing data of the host and/or determining a decompression decision mark corresponding to the reading data corresponding to the reading request.

3. The system of claim 2, wherein the system further comprises a controller configured to control the controller,

The host driving module is connected with the flash memory control module, and write requests or read requests or data interaction is carried out between the host driving module and the flash memory control module.

4. A system according to claim 2 or 3, wherein the host further comprises:

and the system module is connected with the host driving module and is used for sending a write request or a read request to the host driving module so as to receive response information corresponding to the write request or response information corresponding to the read request returned by the host driving module, wherein the system module comprises an application system and/or a file system.

5. A data storage method as claimed in any one of claims 1 to 4, applied to a data storage system, the method comprising:

after the host receives the write request, determining a compression decision mark corresponding to the write request according to a host compression control strategy;

compressing or not compressing the write data corresponding to the write request according to the compression decision mark so as to send the write request to the flash memory device, wherein the write request comprises compressed write data or original write data;

after the flash memory device receives a write request sent by a host, compressing or not compressing write data in the write request according to compression mark information in the write request, so as to write the compressed write data or original write data into a flash memory medium of the flash memory device.

6. The method of claim 5, wherein determining the compression decision flag corresponding to the write request according to the host compression control policy comprises:

if the utilization rate of the processor of the host is smaller than a preset utilization rate threshold value, and the data compression rate of the write data corresponding to the write request is smaller than a preset compression rate threshold value, determining that the compression decision mark corresponding to the write request is compression;

if the utilization rate of the processor of the host is not smaller than a preset utilization rate threshold, or the data compression rate of the write data corresponding to the write request is not smaller than a preset compression rate threshold, determining that the compression decision mark corresponding to the write request is not compressed.

7. The method of claim 5, wherein the compressed tag information comprises compressed or uncompressed, and wherein the compressing or not compressing the write data in the write request according to the compressed tag information in the write request comprises:

if the compression flag information is uncompressed, determining whether to compress the write data in the write request according to a flash compression control policy, where the flash compression control policy includes:

If the utilization rate of the processor of the flash memory device is smaller than a preset utilization rate threshold value, and the data compression rate of the write data corresponding to the write request is smaller than a preset compression rate threshold value, determining to compress the write data corresponding to the write request;

if the utilization rate of the processor of the flash memory device is not smaller than a preset utilization rate threshold, or the data compression rate of the write data corresponding to the write request is not smaller than a preset compression rate threshold, determining that the write data corresponding to the write request is not compressed.

8. A data storage method as claimed in any one of claims 1 to 4, applied to a data storage system, the method comprising:

after receiving a read request, a host sends the read request to a flash memory device;

after the flash memory device receives a read request, if the read data corresponding to the read request is compressed data, determining a decompression decision mark corresponding to the read data according to a decompression control strategy;

and the flash memory device determines whether to decompress the read data according to the decompression decision mark so as to return the decompressed read data or the uncompressed read data to the host.

9. The method of claim 8, wherein determining a decompression decision marker corresponding to the read data according to a decompression control strategy comprises:

if the decompression queue in the flash memory device is not filled, and the bandwidth utilization rate of the interface between the host and the flash memory device is smaller than a preset bandwidth utilization rate threshold, determining that the decompression decision mark corresponding to the read data is decompression;

if the decompression queue in the flash memory device is full, or the bandwidth utilization rate of the interface between the host and the flash memory device is not less than a preset bandwidth utilization rate threshold, determining that the decompression decision corresponding to the read data is marked as not decompressed.

10. The method according to claim 8 or 9, characterized in that the method further comprises:

after receiving the uncompressed read data sent by the flash memory device, the host decompresses the uncompressed read data.

Images