CN107430551B - Data caching method, storage control device and storage equipment - Google Patents

Abstract

A data caching method applied to a storage device, a control device of the storage device and the storage device are provided. The storage device includes a first cache (212) and a second cache (213). When the storage device monitors that a first data block (S301) is cached in the first cache (212), the first data block is to be deleted (S601), or the time for caching the first data block in the first cache (212) exceeds a threshold (S801), acquiring feature information of the first data block, then determining whether the first data block is stored in the second cache (213) according to the feature information of the first data block, and adjusting the elimination priority level of the first data block in the second cache (213) under the condition that the first data block is determined to be stored in the second cache (213) (S303, S603, S803) (S304, S604, S804). The response speed of the IO request is improved by coordinating data in the first cache (212) and the second cache (213) in the storage device.

Description

Data caching method, storage control device, and storage device

technical field

The present invention relates to the technical field of data storage, in particular to data caching technology.

Background technique

With the rapid development of technologies and applications such as big data, mobile internet, and cloud services, the demand for application servers to access storage servers has also increased greatly. Respond to user access needs.

In the prior art, a cache method is generally used to speed up the processing capability of I/O requests, that is, caches are set in both the application server and the storage server. The cache of the application server stores the hot data determined by the application server, and the cache of the storage server stores the data read from the hard disk.

When the application server receives the I/O request, it first accesses the data block in the cache of the application server, and if it is not hit, the I/O request is transmitted to the storage server, and if the storage server is not hit either , you need to read the data from the hard disk.

Since the storage space of the cache of the application server is smaller than that of the cache of the storage server, the data cached in the upper-level cache may be eliminated soon. After the cache of the storage server is eliminated, it can be hit in the cache of the storage server, so that the I/O request can be quickly responded.

However, there is a lack of a cooperative operation mechanism between the cache in the application server and the cache in the storage server. The problem of wasting storage resources caused by the same data being cached separately in both caches may often occur, and some hot data may often appear. The problem of data read speed delay caused by the need to read the data from the hard disk without cache in both caches.

SUMMARY OF THE INVENTION

The present application provides a data caching method, a storage device, and a data processing system to provide a cooperative operation mechanism of multi-level caching.

A first aspect of the present invention provides a data caching method. The method is applied to a storage server. The storage device includes a first cache, a second cache, and a storage unit. The first cache provides a data cache for the application server. The second cache is used to provide a data cache for the storage unit. In the case that the storage server detects the first trigger condition, acquire characteristic information of the first data block cached in the first cache, and then determine the first data block according to the characteristic information of the first data block Whether to store in the second cache; in the case of determining that the first data block is stored in the second cache, adjust the level of the elimination priority of the first data block in the second cache . The characteristic information of the first data block is determined by the data content of the first data block.

According to the data cached in the first-level cache and the second-level cache, adjust the level of the elimination priority of the data blocks cached in the second cache, so as to control the elimination order of the data cached in the second cache, and reduce the number of the first cache. and the duplicate data cached in the second cache, or prolong the cache time of hot data in the second level cache, and improve the response speed of IO requests

Optionally, the first trigger condition is: the storage server receives a data write request, and writes the first data block included in the data write request into the first cache, or the first data block is written in the first cache. The cache time of a data block in the first cache exceeds a predetermined time. Under this trigger condition, when it is determined that the first data block is stored in the second cache, the first data block can be stored in the second cache. The level of eviction priority in the second cache is increased.

In this way, when it is determined that there is a data block in the second cache that is the same as the data block newly written in the first cache, or there is a data block that is the same as the hot data in the first cache, then increase the The level of the elimination priority of the same data block in the second cache makes it eliminated first, thereby reducing the data blocks repeatedly stored in the first cache and the second cache, and increasing the total amount of data cached in the first cache and the second cache. to save storage resources.

Optionally, the first trigger condition is: the storage server receives a deletion request to delete the first data block from the first cache; under this trigger condition, after determining the first data block When the block is stored in the second cache, the level of the elimination priority of the first data block in the second cache is lowered.

In this way, when deleting a data block from the first cache, if the data block to be deleted is also stored in the second cache, the elimination priority of the data block to be deleted in the second cache is lowered, In this way, the data deleted in the first cache can be kept in the second cache for a longer period of time, and when there is an IO request to access the data block next time, it can be hit in the second cache, without the need to retrieve data from the hard disk. Get, so improve the response speed of IO requests.

Optionally, the storage device saves an index record of the second cache, and the index record of the second cache includes the data feature identifiers of the data blocks stored in the second cache, and the data stored in the second cache. The size of the data block is equal to the size of the first data block, and the data features of the data blocks stored in each of the second caches identify the data content of the data blocks stored in each of the second caches The characteristic information of the first data block is obtained according to the data content of each first data block; the index record of the second cache is queried according to the data characteristic identifier of the first data block to determine the each Whether the first data block is stored in the second cache.

By establishing an index table, it can be quickly determined whether the first data block is stored in the second cache.

Optionally, the storage device saves an address table, and the address table records the feature identifier and storage address of the second data block cached in the second cache, and after determining that the first data block is stored in the After the second cache, find the first data block in the address table according to the characteristic identifier of the first data block, and then eliminate the first data block in the second cache. level to adjust. By establishing an address table, the position of the first data block in the second cache can be quickly found, so that the level of the elimination priority of the first data block in the second cache can be adjusted.

Optionally, the second cache index record only records the data identifiers of the data blocks written into the second cache in a recent period of time. In this way, the space occupied by the index records of the second cache can be reduced, and the time for table lookup can be reduced.

Optionally, in the case that the storage server monitors the second trigger condition, obtain characteristic information of the second data block cached in the second cache, and then determine the characteristic information of the second data block according to the characteristic information of the second data block. whether the second data block is stored in the first cache; if it is determined that the second data block is stored in the first cache, adjust the size of the second data block in the second cache The level of elimination priority.

In this way, the data situation in the second cache can be monitored, and the elimination priority level of the data blocks cached in the second cache can be adjusted by judging whether the data cached in the second cache is cached in the first cache, so as to control the second cache. The elimination order of the cached data in the cache reduces the duplicate data cached in the first cache and the second cache.

Optionally, the second trigger condition is: the cache time of the second data block in the second cache exceeds a predetermined time; under this trigger condition, after it is determined that the second data block is stored in the second cache When the second data block is in the first cache, the level of the elimination priority of the second data block is increased from the second cache.

In this way, when it is determined that the same data block exists in the first cache as the data in the second cache, the level of the elimination priority of the data block in the second cache is increased to make it eliminated first, thereby reducing the The data blocks repeatedly stored in the first cache and the second cache increase the total amount of data cached in the first cache and the second cache, thereby improving the response speed of the IO request.

Optionally, if the second trigger condition is: deleting the second data block in the second cache, the method further includes:

In a case where it is determined that the second data is not stored in the first cache, the level of the elimination priority of the second data in the second cache is lowered.

In this way, when deleting a data block in the second cache, if the deleted data block is not stored in the first cache, the elimination priority of the deleted data block is increased, that is, the data block is not deleted, so that , when there is an IO request to access the data block, a hit can be made in the second cache, thereby improving the response speed of the IO request.

Optionally, the second trigger condition is: writing data including the second data block into the second cache; under this condition, after determining that the second data block is stored in the first cache In the case of being in the cache, the level of the elimination priority of the second data block in the second cache is increased.

In this way, if the data block newly cached to the second cache is also stored in the first cache, the level of the elimination priority of the newly cached data block is increased, so as to eliminate the data block newly cached to the second cache as soon as possible , reduce the duplicate data in the first cache and the second cache, increase the cache data, and improve the IO request hit rate.

Optionally, the storage device saves an index record of the first cache, and the index record of the first cache includes a data feature identifier of at least one data block stored in the first cache, and the value of each data block is The size is a predetermined size, and the data feature identifier of each data block is determined by the data content contained in each data block; the feature identifier of the second data block is obtained according to the data content contained in the second data block; When determining whether the second data block is stored in the first cache, it is determined by querying an index record of the first cache according to the data feature identifier of each second data block.

In this way, by setting the first cache index record, the same data as the data in the second cache can be quickly found in the first cache.

Optionally, the first cache index record only records data identifiers of data blocks written into the first cache in a recent period of time. In this way, the space occupied by the first cache index record can be reduced, and the time for table lookup can be reduced.

A second aspect of the present invention provides a data caching method, which is applied to a storage device. The storage device includes a first cache, a second cache, and a storage unit. The first cache provides a data cache for an application server, and the second cache provides a data cache. The cache is used to provide a data cache for the storage unit, and when the storage server monitors the second trigger condition, acquire feature information of the second data block cached in the second cache; The feature information determines whether the second data block is stored in the first cache; if it is determined that the second data block is stored in the first cache, adjust the second data block in the first cache. The level of eviction priority in the second cache.

In this way, the data situation in the second cache can be monitored, and the elimination priority level of the data blocks cached in the second cache can be adjusted by judging whether the data cached in the second cache is cached in the first cache, so as to control the second cache. The elimination sequence of cached data in the cache reduces duplicate data cached in the first cache and the second cache or delays the elimination of data in the second cache that is not stored in the first cache, thereby increasing the response speed of IO requests.

Optionally, the second trigger condition is: the cache time of the second data block in the second cache exceeds a predetermined time, and when it is determined that the second data block is stored in the first cache Next, the level of the elimination priority of the second data block in the second cache is increased.

In this way, when it is determined that the same data block exists in the first cache as the data in the second cache, the level of the elimination priority of the data block in the second cache is increased to make it eliminated first, thereby reducing the The data blocks repeatedly stored in the first cache and the second cache increase the total amount of data cached in the first cache and the second cache, saving storage resources.

Optionally, the second trigger condition is: delete the second data block in the second cache, then the storage server determines that the second data is not stored in the first cache when the second data block is not stored in the first cache and lowering the level of the elimination priority of the second data in the second cache.

In this way, when deleting a data block in the second cache, if the deleted data block is not stored in the first cache, the elimination priority of the deleted data block is increased, that is, the data block is not deleted, so that , when there is an IO request to access the data block, a hit can be made in the second cache, thereby improving the response speed of the IO request.

Optionally, if the second trigger condition is: writing data including the second data block into the second cache;

When it is determined that the second data block is stored in the first cache, the level of the elimination priority of the second data block in the second cache is increased.

In this way, if the newly cached data block in the second cache is also stored in the first cache, the priority level of the newly cached data block in the second cache is increased, so that the new cache is eliminated to the second cache as soon as possible. The data blocks in the second cache are reduced, the duplicate data in the first cache and the second cache are reduced, the cached data is increased, and storage resources are saved.

Optionally, the storage device stores an index record of the first cache, and the index record of the first cache includes data feature identifiers of data blocks stored in the first cache, and the first cache stores The size of the data block is equal to the size of the second data block, and the data characteristics of the data blocks stored in each of the second caches are identified by the data of the data blocks stored in each of the second caches. Content determination; according to the data feature identifier of each second data block, query the index record of the first cache to determine whether the second data block is stored in the first cache.

In this way, by setting the first cache index record, the same data as the data in the second cache can be quickly found in the first cache.

Optionally, the first cache index record only records data identifiers of data blocks written into the first cache in a recent period of time. In this way, the space occupied by the first cache index record can be reduced, and the time for table lookup can be reduced.

A third aspect of the present invention provides a storage control device for controlling data storage of a storage device, wherein the storage device includes a first cache, a second cache, and a storage unit, the first cache provides a data cache for an application server, so The second buffer is used to provide a data buffer for the storage unit, a first monitoring unit, a first acquisition unit, a first determination unit, and a first adjustment unit, and the first monitoring unit monitors the first trigger condition in the first monitoring unit. In this case, the first obtaining unit obtains the feature information of the first data block cached in the first cache; the first determining unit is stored in the second cache, and when the first determination unit determines that the first data block is stored in the second cache, adjust the size of the first data block in the second cache. The level of elimination priority.

In this way, according to the situation of the data cached in the first-level cache and the second-level cache, the level of the elimination priority of the data blocks cached in the second cache is adjusted, so as to control the elimination order of the data cached in the second cache, and improve the IO The response speed of the request.

In a first implementation manner of the third aspect, the first trigger condition is: writing data to be written including at least one of the first data blocks into the first cache according to a first data write request, Or, the buffering time of the first data in the first cache exceeds a predetermined time; when it is determined that the first data block is stored in the second cache, the first adjustment unit adjusts the The level of the elimination priority of the first data block in the second cache is increased.

In this way, when it is determined that there is a data block in the second cache that is the same as the data block newly written in the first cache, or there is a data block that is the same as the hot data in the first cache, then increase the The level of the elimination priority of the same data block in the second cache makes it eliminated first, thereby reducing the data blocks repeatedly stored in the first cache and the second cache, and increasing the total amount of data cached in the first cache and the second cache. amount, thereby improving the response speed of IO requests.

Optionally, the first trigger condition is: receiving a deletion request for deleting the first data block in the first cache;

In the case that the first determination unit determines that the first data block is stored in the second cache, the first adjustment unit adjusts the elimination priority of the first data block in the second cache level is lowered.

In this way, when deleting a data block from the first cache, if the data block to be deleted is also stored in the second cache, the elimination priority of the data block to be deleted in the second cache is lowered, In this way, the data deleted in the first cache can be kept in the second cache for a longer period of time, and when there is an IO request to access the data block next time, it can be hit in the second cache, without the need to retrieve data from the hard disk. Obtained, so the response speed of IO requests is improved.

Optionally, the storage device stores an index record of the second cache, and the index record of the second cache includes a data feature identifier of at least one second data block stored in the second cache, and the first cache The size of the two data blocks is equal to the size of the first data block, and the data feature identifier of each second data block is determined by the data content contained in each second data block;

The first determining unit queries the index record of the second cache according to the data characteristic identifier of the first data block, and determines whether each of the first data blocks is stored in the second cache. By establishing an index table, it can be quickly determined whether the first data block is stored in the second cache.

In a fourth implementation manner of the third aspect, the storage device stores an address table, and the address table records the feature identifier and storage address of the second data block cached in the second cache, After it is determined that the first data block is stored in the second cache, the first data block is found in the address table according to the characteristic identifier of the first data block, and then the first data block is The eviction level of blocks in the second cache is adjusted. By establishing an address table, the position of the first data block in the second cache can be quickly found, so that the level of the elimination priority of the first data block in the second cache can be adjusted.

Optionally, the second cache index record only records the data identifiers of the data blocks written into the second cache in a recent period of time. In this way, the space occupied by the index records of the second cache can be reduced, and the time for table lookup can be reduced.

Optionally, the storage control device further includes a second monitoring unit, a second acquisition unit, a second determination unit, and a second adjustment unit,

When the second monitoring unit monitors the second trigger condition, the second obtaining unit obtains the feature information of the second data block cached in the second cache; the second determining unit The characteristic information of the second data block determines whether the second data block is stored in the first cache, and in the case that the second determination unit determines that the second data block is stored in the first cache, The second adjustment unit adjusts the level of the elimination priority of the second data block in the second cache.

In this way, by monitoring the data situation in the second cache, and by judging whether the data cached in the second cache is cached in the first cache, the elimination priority level of the data blocks cached in the second cache can be adjusted, thereby controlling the first cache. The elimination order of cached data in the second cache improves the response speed of IO requests.

Optionally, the second trigger condition monitored by the second monitoring unit is: the cache time of the second data block in the second cache exceeds a predetermined time; When the second data block is stored in the first cache, the second adjustment unit

Raising the second data block from the second cache has a higher level of eviction priority.

In this way, when it is determined that the same data block exists in the first cache as the data in the second cache, the level of the elimination priority of the data block in the second cache is increased to make it eliminated first, thereby reducing the The data blocks repeatedly stored in the first cache and the second cache increase the total amount of data cached in the first cache and the second cache, thereby improving the response speed of the IO request.

Optionally, the second trigger condition monitored by the second monitoring unit is: delete the second data block in the second cache, when the second determining unit is determining the second When the data is not stored in the first cache, the second adjustment unit lowers the level of the elimination priority of the second data in the second cache.

In this way, when deleting a data block in the second cache, if the deleted data block is not stored in the first cache, the elimination priority of the deleted data block is increased, that is, the data block is not deleted, so that , when there is an IO request to access the data block, a hit can be made in the second cache, thereby improving the response speed of the IO request.

Optionally, the second trigger condition monitored by the second monitoring unit is: writing data including the second data block into the second cache; determining, in the second determining unit, the When the second data block is stored in the first cache, the second adjustment unit increases the level of the elimination priority of the second data block in the second cache.

In this way, if the data block newly cached to the second cache is also stored in the first cache, the level of the elimination priority of the newly cached data block is increased, so as to eliminate the data block newly cached to the second cache as soon as possible , reduce the duplicate data in the first cache and the second cache, increase the cache data, and improve the IO request hit rate.

Optionally, the storage device stores an index record of the first cache, and the index record of the first cache includes a data feature identifier of a data block stored in the first cache, and each of the first cache The size of the data block stored in the data block is equal to the size of the second data block, and the data feature identifier of each data block is determined by the data content of each data block;

The second confirmation unit queries the index record of the first cache according to the data feature identifier of each second data block, and determines whether the second data block is stored in the first cache.

In this way, by setting the first cache index record, the same data as the data in the second cache can be quickly found in the first cache.

Optionally, the first cache index record only records data identifiers of data blocks written into the first cache in a recent period of time. In this way, the space occupied by the first cache index record can be reduced, and the time for table lookup can be reduced.

A fourth aspect of the present invention provides a storage control device for controlling data storage of a storage device, wherein the storage device includes a first cache, a second cache, and a storage unit, the first cache provides a data cache for an application server, so The second cache is used to provide a data cache for the storage unit, and the storage control device includes: a second monitoring unit, a second acquiring unit, a second determining unit and a second adjusting unit. In the case where the second monitoring unit monitors the second trigger condition, the second obtaining unit obtains the characteristic information of the second data block buffered in the second buffer; the second determining unit according to The feature information of the second data block determines whether the second data block is stored in the first cache;

The second adjustment unit adjusts the elimination priority of the second data block in the second cache when the second determination unit determines that the second data block is stored in the first cache level.

In this way, the data situation in the second cache can be monitored, and the elimination priority level of the data blocks cached in the second cache can be adjusted by judging whether the data cached in the second cache is cached in the first cache, so as to control the second cache. The elimination order of cached data in the cache improves the response speed of IO requests.

Optionally, the second trigger condition monitored by the second monitoring unit is: the cache time of the second data block in the second cache exceeds a predetermined time;

In the case that the second determination unit determines that the second data block is stored in the first cache, the second adjustment unit adjusts the priority of the second data block to be eliminated from the second cache level increased.

In this way, when it is determined that the same data block exists in the first cache as the data in the second cache, the level of the elimination priority of the data block in the second cache is increased to make it eliminated first, thereby reducing the The data blocks repeatedly stored in the first cache and the second cache increase the total amount of data cached in the first cache and the second cache, thereby improving the response speed of the IO request.

Optionally, the second trigger condition monitored by the second monitoring unit is: delete the second data block in the second cache,

When the second determination unit determines that the second data is not stored in the first cache, the second adjustment unit adjusts the elimination priority of the second data in the second cache level is lowered.

In this way, when deleting a data block in the second cache, if the deleted data block is not stored in the first cache, the elimination priority of the deleted data block is increased, that is, the data block is not deleted, so that , when there is an IO request to access the data block, a hit can be made in the second cache, thereby improving the response speed of the IO request.

Optionally, the second trigger condition monitored by the second monitoring unit is: writing data including the second data block into the second cache;

When the second determination unit determines that the second data block is stored in the first cache, the second adjustment unit adjusts the elimination priority of the second data block in the second cache level increased.

In this way, if the data block newly cached to the second cache is also stored in the first cache, the level of the elimination priority of the newly cached data block is increased, so as to eliminate the data block newly cached to the second cache as soon as possible , reduce duplicate data in the first cache and the second cache, increase cache data, and save cache resources.

Optionally, the storage device stores an index record of the first cache, and the index record of the first cache includes the data feature identifiers of the data blocks stored in the first cache, and each first cache stores The size of the data block is equal to the size of the two data blocks, and the data feature identifier of each data block is determined by the data content of each data block;

The second confirmation unit queries the index record of the first cache according to the data characteristic identifier of each second data block, and determines whether the second data block is stored in the first cache.

In this way, by setting the first cache index record, the same data as the data in the second cache can be quickly found in the first cache.

Optionally, the first cache index record only records data identifiers of data blocks written into the first cache in a recent period of time. In this way, the space occupied by the first cache index record can be reduced, and the time for table lookup can be reduced.

A fifth aspect of the present invention provides a storage device, the storage device includes a processor, a memory, a first cache, a second cache, and a storage unit, the first cache provides a data cache for an application server, and the second cache is used for To provide a data cache for the storage unit, the memory is used to store computer-executed instructions, and when the storage device is running, the processor executes the computer-executed instructions stored in the memory, so that the storage device Execute the data caching method provided by the first aspect or the data caching method provided by the second aspect.

In the embodiment of the present invention, a first cache is set on the storage server side to cache data from the application cache of the application server, and then it is determined whether the second cache stores the same data as the first cache, and according to the judgment As a result, the data elimination priority level in the second cache is adjusted. In this way, by coordinating the data cached in the first cache and the second cache, the duplicate data in the first cache and the second cache is reduced, the cache resources are saved, and the data in the second cache that is not the same as the first cache can be temporarily eliminated. , or the same data as the data to be deleted in the first cache, thereby increasing the response speed of the IO request.

Description of drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention, and for those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.

FIG. 1 is an architecture diagram of a data processing system in which a storage server provides storage services for an application server in the prior art.

FIG. 2 is an architectural diagram of a data processing system in which a storage server provides a storage service for an application server according to an embodiment of the present invention.

3 is a flowchart of a method for performing data block coordination between a first cache and a second cache under a trigger condition according to an embodiment of the present invention.

4A and 4B are schematic diagrams of index records of the second cache.

FIG. 5 is a schematic diagram of data block coordination between the first cache and the second cache in the embodiment shown in FIG. 3 .

6 is a flowchart of a method for performing data block coordination between the first cache and the second cache under another trigger condition according to an embodiment of the present invention.

FIG. 7 is a schematic diagram of data block coordination between the first cache and the second cache in the embodiment shown in FIG. 6 .

FIG. 8 is a flowchart of a method for performing data block coordination between the first cache and the second cache under another trigger condition according to an embodiment of the present invention.

FIG. 9 is a schematic diagram of data block coordination between the first cache and the second cache in the embodiment shown in FIG. 8 .

10 is a flowchart of a method for performing data block coordination between the first cache and the second cache under another trigger condition according to an embodiment of the present invention.

FIG. 11 is a schematic diagram of data block coordination between the first cache and the second cache in the embodiment shown in FIG. 10 .

12 is a flowchart of a method for performing data block coordination between the first cache and the second cache under another trigger condition according to an embodiment of the present invention.

FIG. 13 is a schematic diagram of data block coordination between the first cache and the second cache in the embodiment shown in FIG. 12 .

FIG. 14 is a flowchart of a method for performing data block coordination between the first cache and the second cache under another trigger condition according to an embodiment of the present invention.

FIG. 15 is a schematic diagram of data block coordination between the first cache and the second cache in the embodiment shown in FIG. 14 .

FIG. 16 is a structural diagram of a storage control apparatus according to an embodiment of the present invention.

FIG. 17 is a structural diagram of another storage control apparatus provided by an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention. As shown in FIG. 1 , an architecture diagram of a data processing system 100 that provides storage services for an application server 120 for a storage server 110 in the prior art.

The application server 120 may be a shared server accessed by multiple users at the same time, such as a database server, a virtual machine management server, a desktop cloud server, and the like. The storage server 110 provides data storage services for the application server 120 .

The application server 120 includes an application processor 121, an application cache 122, an extended cache 123 and other elements. The storage server 110 includes a storage processor 111, a storage cache 112, a storage unit 113 and other elements. The application cache 122 provides a data cache for the application server 120 , and is generally a cache such as a dynamic random access memory (Dynamic Random Access Memory, DRAM), but because DRAM is relatively expensive, its capacity is generally small. The extended cache 123 is generally a solid state memory (Solid State Disk, SSD). Since the price of the SSD memory is cheaper than that of the DRAM, but the speed is relatively low, it is generally used as the extended cache of the application cache 122, that is, it is used to store data from the The application caches 122 the retired data. Since the capacity of the application cache 122 is relatively small, the data cached in the application cache 122 may be quickly eliminated. Therefore, by extending the cache 123 to cache the eliminated data of the application cache 122, the response speed of the IO request can be increased.

The storage cache 112 provides data cache for the storage unit 113 such as a hard disk, and is generally also a DRAM. The data read from the storage unit 113 may be cached, and the data written to the storage server 110 by the application server 100 may also be cached. When caching data, the same data will be cached in the storage cache 112 of the storage server 110 and the application cache 122 of the application server 120 at the same time, and the storage server 110 cannot perceive the data cached in the application cache 122 of the application server 120. This will cause the data cached in the application cache 122 and the extended cache 123 of the application server 120 to cache the same data as the storage cache 112 of the storage server 110 . In addition, when the data in the extended cache 123 is eliminated, the same data cached in the storage cache 112 as the eliminated data block may also be in a position to be eliminated soon. In this way, the data eliminated in the extended cache 123 is After the storage cache 112 is also quickly eliminated, when there is an IO request to access the eliminated data, it needs to be called from the storage unit 113, thereby affecting the response speed of the IO request.

It can be seen that in the prior art, the storage server 110 cannot know the data cached in the extended cache 123 of the application server 120, and lacks a cooperative operation mechanism of the two caches, so the response speed of IO requests is affected or the storage resources are wasted.

In the embodiment of the present invention, the cache of the application server is set on the side of the storage server, for example, the first cache on the storage server is used to cache the data of the application cache of the application server, and then it is determined that the second cache of the storage server is in the second cache. Whether the same data as in the first cache is stored, and the elimination priority level of the data in the second cache is adjusted according to different judgment results. If the cached data is the same as the data in the cache, the data in the second cache that is the same as the cached data will be eliminated first. If it is determined that the second cache has the same data as the data deleted from the first cache, The data that is the same as the deleted data in the second cache is stored preferentially. If the first cache does not cache the same data as the data to be deleted in the second-level cache, the data from the second cache is not deleted. Cache data to be deleted. In this way, by coordinating the data cached in the first cache and the second cache, the duplicate data in the first cache and the second cache can be reduced, and the pending deletion of the data in the second cache that is not the same as the data cached in the first cache can be temporarily deleted. Deleting data, or the same data as the data to be deleted in the first cache, can increase the response speed of the IO request.

The technical solutions of the present invention will be described in detail below with reference to specific embodiments.

As shown in FIG. 2 , it is an architectural diagram of a data processing system 200 in which the storage server 210 provides services for the application server 220 in the embodiment of the present invention.

In this embodiment, the application server 220 includes an application processor 221, an application cache 222, and other elements, such as a memory, etc., which are not shown in the figure because other elements are not involved in this embodiment of the present invention.

The storage server 210 includes a storage processor 211 , a first cache 212 , a second cache 213 , a storage unit 214 , a memory 215 , and other elements, which are not involved in this embodiment of the present invention and are not shown in the drawings.

Compared with the data processing system 100 in FIG. 1 , in this embodiment, the extended cache 123 in the application server 120 is removed, but a first cache 212 is added in the storage server 210 . In this embodiment of the present invention, the application server is also provided with the application cache 222, and the first cache 212 in the storage server 210 is only used to replace the extended cache 123 in FIG. 1, but actually in other embodiments of the present invention, the application The server may no longer include the application cache 222, and the first cache 212 set in the storage server 210 can completely replace various caches of the application server, because those skilled in the art can fully understand the above-mentioned extended embodiments, and the specific implementation method is not repeated here. .

The first cache 212 is provided by the storage server 210 to the application server 220 for caching data in the application server 220. For example, data deleted from the application cache 222 is cached. When the data of the application server 220 is deleted, the application processor 221 of the application server 220 sends a data cache request to the storage server 210, so that the storage server 210 caches the data deleted from the application cache 222 to the first cache 212, After the deleted data is cached in the first cache 212, the storage processor 211 returns the address of the data cached in the first cache 212 to the application processor 221 of the application server 200, then the The application processor 221 may control the data in the first cache according to the returned data address, and the control may be to read or eliminate the data blocks in the first cache 212 . When the application processor 221 wants to eliminate the data in the first cache 212, the application processor 221 sends a data elimination request to the storage server 210, where the data elimination request includes the address of the data to be eliminated, After receiving the elimination request, the storage server 210 finds the data to be eliminated in the first cache according to the address of the elimination data included in the elimination request, and performs elimination.

The second cache 213 provides data cache for the storage unit 214 .

In this way, since the data blocks cached in the first cache 212 are data blocks eliminated by the application cache 222 of the application server, the storage server 210 can know the previous data through the cached data in the first cache 212 cache the data in the application cache 222 , so that the storage processor 211 can know the data cached in the first cache 212 and coordinate the data stored in the first cache 212 and the second cache 213 In order to improve the response speed of the IO request, the method for coordinating the data in the first cache 212 and the second cache 213 will be described in detail below.

The storage processor 211 and the application processor 111 may be single-core or multi-core central processing units, or specific integrated circuits, or one or more integrated circuits configured to implement embodiments of the present invention.

The memory 215 may be a high-speed RAM memory, or a non-volatile memory (non-volatile memory), such as at least one disk memory, for storing the computer execution instructions 2151 . Specifically, the computer-executable instructions 2151 may include program codes.

When the storage server 210 is running, the storage processor 211 executes the computer execution instructions 2151 to execute the first cache 212 and the second cache 213 described in FIG. 3 , FIG. 6 , FIG. 8 , FIG. 10 , FIG. 12 and FIG. 14 . The flow of the data reconciliation method in .

The coordination methods of FIGS. 3 , 6 , 8 , 10 , 12 and 14 will be described in detail below.

In this embodiment, there are two cases. The first case is that the detection of the cached data in the first cache 212 triggers the coordination of the data cached by the first cache 212 and the second cache 213, and the second One case is that the detection of the cached data in the second cache 213 triggers the coordination of the cached data of the first cache 212 and the second cache 213 . In actual products, only the data reconciliation method in the first case can be implemented, or only the data reconciliation method in the second case can be implemented, or the data reconciliation method in both cases can be implemented simultaneously.

The following will first describe the method for data coordination between the first cache 212 and the second cache 213 in the first case. Triggered under a trigger condition, the first trigger condition may be: the storage processor 211 receives the data cache request sent by the application server 220, and stores the data included in the data cache request according to the data cache request cache to the first cache 212; the storage processor 211 receives the data deletion request sent by the application server 220; the storage processor 211 detects that the time of the data cached in the first cache exceeds a threshold.

As shown in FIG. 3 , the first trigger condition detected by the storage processor 211 is that the storage processor 211 receives a data cache request sent by the application server 220, and stores the data cache request according to the data cache request. A flowchart of a method for performing data block coordination between the first cache 212 and the second cache 212 when the data included in the data cache request is cached in the first cache 212 .

Step S301, the storage processor 211 receives the data cache request sent by the application server 220, and caches the data contained in the data cache request to the first cache 212 according to the data cache request, and obtains the data cache. The feature identifier of at least one first data block corresponding to the cache request.

In this embodiment, acquiring the feature identifier of the first data by the storage processor 211 includes: acquiring the data feature identifier of the first data block according to the data content included in the first data block.

The feature identifier of the first data block is a code that can uniquely identify the first data block and is parsed according to the data content contained in the first data block. The specific analysis method may be to perform a hash operation on the first data block itself, and use the calculated hash value as the feature identifier of the first data block, or it may be based on the data block set by the application running by the application server 220. The feature identification can uniquely identify the first data block data feature identifier, for example, when the application server is running a data block library application, the fifth to eighth data blocks of the first data block can be used. A relative data block address (RDBA) of bytes is used to uniquely identify the first data block.

Step S302, the storage processor 211 determines whether the first data block is stored in the second cache 213 according to the characteristic identifier of the first data block.

The memory 215 also stores an index record 2153 of the second cache, and the index record 2153 of the second cache includes a feature identifier of at least one second data block stored in the second cache, and the second cache The size of the data block is equal to the size of the first data block, and the method for acquiring the feature identifier of the second data block is also the same as the method for acquiring the feature identifier of the first data block, which is not repeated here.

In this way, the second cache index record 2153 can be queried according to the characteristic identifier of each first data block to determine whether each first data block is stored in the second cache 213 .

The data block identifiers stored in the second cache index record 2153 may be the feature identifiers of all the second data blocks cached by the second cache 213, or may be the feature identifiers of some second data blocks. Since the number of second data blocks cached in the second cache 213 is relatively large, if the data feature identifiers of all the second data blocks in the second cache 213 are recorded in the second cache index record 2153, This will waste storage space and increase the time for table lookup, thereby affecting performance. Therefore, in this embodiment, the index record 2153 of the second cache only maintains the data cached to the second cache 213 within a preset time period. The data block identifier of the block, for example, within 10 minutes, as shown in FIGS. 4A and 4B, the feature identifier of the second data block stored in the index record of the second cache (such as An, An-1... ...An-6) are arranged in the order of the time when the second data block is cached to the second cache, and the feature identifier of each second data block has a timestamp (eg 12:01, 12: 02...12:10), used to record the time when the second data block corresponding to the feature identifier of the second data block is cached to the second cache 213, the time period may be 10 minutes, As shown in FIG. 4A, when a second data block a is cached in the second cache 213, the storage processor 211 acquires the feature identifier (An+1) of the second data block, and stores the acquired The data identifier is added to the header position in the second cache index record 2153, a timestamp (12:00) is added at the same time, and the timing is started. As shown in FIG. 4B , if the current time is 12:10, the time of the feature identifier (An-6) of the second data block b in the second cache index record 2153 reaches a preset time period (10 minutes). ), it is deleted from the second cache index record 2153.

In this case, the data cached in the second cache will be recorded in the second cache index record, then when the second cache index record 2153 records the data with the first data block When the feature identifiers are the same, it is determined that the first data block is stored in the second cache 213 .

The second cache index record 2153 can also be a hash table, the key of the hash table is the second data block identifier, the Value is 0 or 1, and 0 indicates that the second data block corresponding to the data feature identifier does not exist In the second cache 213, 1 indicates that the data block corresponding to the data feature identifier exists in the index record. When the data block identifier is added to the index record of the second cache 213, the value is set to 1, and when the second data block corresponding to the feature identifier is deleted from the second cache, all The Value of the feature identifier corresponding to the deleted data block is set to 0.

In this case, when determining whether the first data block is stored in the second cache 213, first query whether the feature identifier of the first data block is recorded in the second cache index record 2153, When the feature identifier of the first data block is recorded in the second cache index record 2153, the corresponding Value value is determined, and when the Value value is 1, it is determined that the first data block is stored in the second cache index record 2153. Cache 213.

Step S303, when it is determined that the first data block is stored in the second cache 213, the storage processor 211 stores the data in the second cache 213 according to the data feature identifier and address table of the first data block. The first data block is found, and when it is determined that the first data block is not stored in the second cache 213, return to step S301.

The address table records the feature identifier and storage address of the second data block cached in the second cache. When a second data block is cached in the second cache 213, the storage processor 211 acquires the data feature identifier of the second data block, and establishes a relationship between the data feature identifier of the second data block and the storage address The mapping relationship between them forms the address table. When the second data block cached in the second cache 213 is eliminated, the storage processor 211 acquires the data block identifier of the second data block, and then assigns the mapping relationship corresponding to the second data block identifier It is deleted from the address table, so that the address table is updated with the change of the data blocks cached in the second cache 213 .

Step S304, after the storage processor 211 finds the first data block in the second cache 213, it increases the level of the elimination priority of the first data block in the second cache 213, It can be raised to the highest level, or it can be raised to a preset priority level. If it is raised to the highest level, the first data block can be deleted from the second cache 213 .

In this embodiment, the elimination order of each second data block is set by means of an elimination queue. The elimination queue may be a Least Recently Used (LRU) queue, or a recently frequently used algorithm (least frequently used algorithm). used, LFU) queue, or other algorithm queues that eliminate data in the cache.

As shown in FIG. 5 , if the first data block a is cached in the first cache 212, the storage processor 211 determines that the feature identifier of the first data block a is An+1, and then stores the second data block a as An+1. Find the feature identifier An+1 in the cache index record 2153, then obtain the address of the data a corresponding to the feature identifier An+1 in the address table 2154, and finally adjust the position of the data a in the LRU queue to The position to be eliminated preferentially, the position to be eliminated preferentially may be the tail of the LRU queue, or may be a position close to the opposite tail.

As shown in FIG. 6 , when the first trigger condition is that the storage processor 211 receives a data deletion request sent by the application server 220 , data block coordination is performed between the first cache 212 and the second cache 212 The flow chart of the method.

Step S601, the storage processor 211 receives the first data block deletion request sent by the application server 220, and finds the first data block in the first cache according to the address of the first data block included in the deletion request. the first data block, and obtain the feature identifier of the first data block.

Step S602, the storage processor 211 determines whether the first data block is stored in the second cache 213 according to the characteristic identifier of the first data block.

Step S603, when it is determined that the first data block is stored in the second cache 213, the storage processor 211 stores the data in the second cache 213 according to the feature identifier of the first data block and the address table 2154. If the first data block is found in the second cache 213, when it is determined that the first data block is not stored in the second cache 213, do nothing, and continue to detect the data in the first cache 212. .

Step S604, after the storage processor 211 finds the first data block in the second cache 213, lowers the elimination priority level of the first data block in the second cache, and can It can be lowered to the lowest level, or it can be lowered to the preset priority level.

As shown in FIG. 7 , if the first data block f is the data determined to be deleted from the first cache 212 according to the data deletion request, the storage processor 211 determines the first data block (this In the embodiment, the first data only includes the data feature identifier An+1 of a first data block), then find the data feature identifier An+1 in the second cache index record 2153, and then in the address Obtain the address of the data f corresponding to the data feature identifier An+1 in Table 2154, and finally adjust the position of the data f in the LRU queue to the position where it is preferentially stored, and the preferentially stored position may be in the LRU queue. The head of the team can also be close to the head of the team.

As shown in FIG. 8 , when the first trigger condition is that the time of the data cached in the first cache 212 exceeds a threshold, data blocks are performed between the first cache 212 and the second cache 212 Flowchart of the coordinated approach.

Step S801, when the storage processor 211 detects that the first data block cached in the first cache 212 exceeds a threshold, acquire the feature identifier of the first data block.

Step S802, the storage processor 211 determines whether the first data block is stored in the second cache 213 according to the characteristic identifier of the first data block.

Step S803, when it is determined that the first data block is stored in the second cache 213, the storage processor 211 stores the data in the second cache 213 according to the feature identifier of the first data block and the address table 2154. When the first data block is found in the second cache 213, the process returns to step S301 when it is determined that the first data block is not stored in the second cache 213.

Step S804, after the storage processor 211 finds the first data block in the second cache 213, it increases the elimination priority level of the first data block in the second cache. It is raised to the highest level, or it can be raised to the preset priority level.

As shown in FIG. 9 , if the data of the first data block d in the first cache 212 exceeds a threshold, the storage processor 211 determines the data characteristic identifier An of the first data block d, and then stores the data in the first data block d in the first cache 212. Find the data feature identifier An in the second cache index record, then obtain the address of the data block d corresponding to the data feature identifier An in the address table, and finally adjust the position of the data d in the LRU queue to be prioritized The eliminated position, the preferentially eliminated position may be the tail of the LRU queue, or may be a position close to the opposite tail.

The above is the first case, that is, the detection of the cached data in the first cache 212 triggers data coordination between the first cache 212 and the second cache 213. The second case will be described below, that is, the detection A method of triggering data coordination between the first cache 212 and the second cache 213 is triggered by measuring the condition of the cached data in the second cache 213 .

In the second case, the coordination of data in the first cache 212 and the second cache 213 is triggered under a second trigger condition, and the second trigger condition may be: when data is cached in the second cache; delete When the data in the second cache is stored; or the time that the data blocks in the second cache are stored in the second cache exceeds a threshold. The methods for coordinating the data of the first cache and the second cache under these two triggering conditions are described below respectively.

As shown in FIG. 10 , it is a flowchart of a method for coordinating data in the first cache and the second cache when the second trigger condition is that data is cached in the second cache.

Step S1001, the storage processor 211 caches data to the second cache according to the data cache request, the cached data is divided into at least one second data block of a predetermined size, and then acquires the characteristics of the second data block logo.

The manner of acquiring the feature identifier of the second data block is the same as the manner of acquiring the data feature of the first data block, and details are not described herein again.

Step S1002, the storage processor 211 determines whether the second data is stored in the first cache according to the feature identifier of the second data.

In this embodiment, the memory 215 further stores an index record 2152 of the first cache, and the first cache index record 2152 includes a data feature identifier of at least one first data block stored in the first cache 212, The size of the first data block is equal to the size of the second data block.

In this way, the index record 2152 of the first cache may be queried according to the characteristic identifier of each second data block to determine whether each second data block is stored in the first cache 212 .

The data block identifiers stored in the index record of the first cache 212 may be the feature identifiers of all the first data blocks cached by the first cache 212, or may be the feature identifiers of some of the first data blocks. Since the number of first data blocks cached in the first cache 212 is relatively large, if the data feature identifiers of all the first data blocks in the first cache 212 are stored in the first cache index record, then This will waste storage space and increase the time for table lookup, thereby affecting performance. Therefore, in this embodiment, the first cache index record 2153 only maintains the first data cached to the first cache 212 within a preset time period. Block feature identification, such as within 10 minutes.

In this case, the data cached in the first cache 212 will be recorded in the first cache index record 2152, then when the first cache index record 2152 is recorded with the first data When the feature identifiers of the blocks are the same, it is determined that the first data block is stored in the first cache 212 .

The first cache index record 2152 may also be a Hash table, the key of the hash table is the first data block identifier, and the Value is 0 or 1, and 0 represents the first data block corresponding to the data feature identifier. If it does not exist in the first cache 212, 1 indicates that the data block corresponding to the data feature identifier exists in the index record. When the first data block identifier is added to the index record of the first cache 212, the value is set to 1, and when the first data block corresponding to the feature identifier is deleted from the first cache, the value can be set to 1. The Value of the feature identifier corresponding to the deleted data block is set to 0.

In this case, when determining whether the second data block is stored in the first cache 212, first query whether the feature identifier of the first data block is recorded in the first cache index record 2152, When the feature identifier of the first data block is recorded in the first cache index record 2152, the corresponding Value value is determined, and when the Value value is 1, it is determined that the first data block is stored in the first data block. in cache 212.

Step S1003, when the storage processor 211 determines that the second data is stored in the first cache 212 according to the feature identifier of the second data, the second data is stored in the second cache 213 The level of the elimination priority is increased, and the increase may be to the highest level, or it may be a preset priority level. When the storage processor 211 determines that the second data is not stored in the first cache 212, the priority level of the second data is not adjusted.

As shown in FIG. 11 , the feature identifier of the second data block a1 cached in the second cache 213 is Bn+1, the first cache index record 2152 is queried, and the first cache index record 2152 is found in the first cache index record 2152 The characteristic identifier of the data block a1 indicates that the second data a1 is stored in the first cache 212, then the second data block a1 can be adjusted to the tail position of the LRU queue, or can be adjusted to near the opposite end.

As shown in FIG. 12 , when the storage processor 211 deletes data from the second cache 213 , a flowchart of a method for coordinating data in the first cache 212 and the second cache 213 is performed.

Step S1201: After determining the second data block to be deleted from the second cache 213, the storage processor 211 acquires the feature identifier of the second data block.

Step S1202, the storage processor 211 determines whether the second data block is stored in the first cache 212 according to the characteristic identifier of the second data.

Step S1203, when the storage processor 211 determines that the second data is stored in the first cache 212, delete the second data block.

Step S1204, when the storage processor 211 determines that the second data is not stored in the first cache 212, it increases the level of the elimination priority of the second data in the second cache 213 , the improvement can be to the highest level, or it can be a preset priority level. However, when the data block to be deleted is selected as the data block to be deleted again, the second data block to be deleted is directly deleted.

As shown in FIG. 13 , the second data block f1 is the determined data block to be deleted from the second cache, the acquired feature identifier of the second data block f1 is Bn-3, and the feature identifier If Bn-3 is not recorded in the first cache index record, it means that the second data block may not be stored in the first cache, and the second data block f1 is adjusted to the second cache The head position of the LRU queue in 213, or a position close to the head of the line.

As shown in FIG. 14 , when the time that the second data block in the second cache is stored in the second cache exceeds a threshold, a flowchart of a method for coordinating data in the first cache and the second cache.

Step S1401, when it is determined that the storage time of the second data block in the second cache in the second cache exceeds a threshold, acquire the feature identifier of the second data block.

Step S1402, the storage processor 211 determines whether the second data is stored in the first cache according to the feature identifier of the second data.

Step S1403 , when the storage processor 211 determines that the second data is stored in the first cache 212 , it increases the level of the elimination priority of the second data in the second cache 213 .

Step S1404, when the storage processor 211 determines that the second data is not stored in the first cache 212, it reduces the level of the elimination priority of the second data in the second cache 213 .

As shown in FIG. 15 , when the time that the second data block c1 is cached in the second cache exceeds a threshold, it is determined whether the feature identifier Bn of the second data block c1 is recorded in the first cache In the index record, when the feature identifier of the second data block c1 is recorded in the first cache index record 2152, the second data block c1 is adjusted to the end of the LRU queue, or close to the end of the queue s position.

When the time that the second data block d1 is cached in the second cache 213 exceeds a threshold, it is determined whether the feature identifier Bn-3 of the second data block d1 is recorded in the first cache index record , when the feature identifier of the second data block d1 is not recorded in the first index record, adjust the second data block d1 to the head of the LRU queue, or a position close to the head of the queue.

In other embodiments of the present invention, the application server may be application software in an electronic device, the application cache provides a data cache for the application software, and the storage server is a storage device of the electronic device for the application The software provides storage services.

As shown in FIG. 16 , a structural diagram of a storage control apparatus is provided for an embodiment of the present invention.

The storage control device includes a first monitoring unit 1601 , a first acquiring unit 1602 , a first determining unit 1603 and a first adjusting unit 1604 .

The first monitoring unit 1601 is configured to detect the condition of the buffered data in the first buffer 212 to trigger data coordination between the first buffer 212 and the second buffer 213 . There are three trigger conditions for data coordination between the first cache 212 and the second cache 213, respectively: the first monitoring unit 1601 receives the data cache request sent by the application server 220, and according to the data cache Request to cache the first data contained in the data cache request to the first cache 212; the first monitoring unit 1601 receives the data deletion request sent by the application server 220; the first monitoring unit 1601 detects The time for measuring the data buffered in the first buffer exceeds a preset threshold.

When the first monitoring unit 1601 receives the data cache request sent by the application server 220, and caches the first data included in the data cache request to the first cache 212 according to the data cache request, The acquiring unit 1602 acquires the feature identifier of the first data block that constitutes the first data. The acquisition method of the feature identifier of the first data block has been described above, and will not be repeated here.

The determining unit 1603 determines whether the first data is stored in the second cache according to the characteristic identifier of the first data. That is, the determining unit 1603 queries the index record of the second cache according to the data feature identifier of each first data block to determine whether each first data block is stored in the second cache 213 . When a second data block index record with the same data feature identifier as the first data block exists in the index record of the second cache, it is determined that the first data block is stored in the second cache 213 .

When the determining unit 1603 determines that the first data block is stored in the second cache 213, the adjusting unit 1604 stores the first data block in the second cache 213 according to the feature identifier and address table of the first data block Find the first data block, and then reduce the level of the elimination priority of the first data block in the second cache, which can be reduced to the lowest level, or can be reduced to a preset priority level level.

When the first monitoring unit 1601 detects that the first data block buffered in the first cache 212 exceeds the easy threshold, it acquires the feature identifier of the first data block.

The determining unit 1603 determines whether the first data is stored in the second cache according to the characteristic identifier of the first data.

The adjustment unit 1604 finds the first data block in the second cache 213 according to the feature identifier and address table of the first data block, and eliminates the first data block in the second cache. The priority level can be increased to the highest level, or it can be increased to the preset priority level.

As shown in FIG. 17 , the storage control device further includes a second monitoring unit 1605 , a second acquiring unit 1606 , a second determining unit 1607 and a second adjusting unit 1608 .

The second monitoring unit 1605 is configured to detect the data condition of the second cache, so as to trigger the coordination of the data cached by the first cache and the second cache. There are three trigger conditions for data coordination between the first cache 212 and the second cache 213, namely, when data is cached in the second cache; when the data in the second cache is deleted; or when the data in the second cache is deleted. The time that the data blocks are stored in the second cache exceeds a threshold.

After the second monitoring unit 1605 detects that the data is buffered into the second buffer, and the buffered data is divided into at least one second data block of a predetermined size, the characteristic identifier of the second data block is acquired.

The second determining unit 1603 is configured to determine whether the second data is stored in the first cache according to the feature identifier of the second data. The determining unit 1602 queries the index record of the first cache according to the feature identifier of the second data block to determine whether each second data block is stored in the first cache 212 . When a second data block index record with the same feature identifier as the second data block exists in the index record of the first cache, it is determined that the second data block is stored in the first cache 213 .

When the second determining unit 1603 determines that the second data is stored in the first cache 212 , the adjusting unit 1604 is configured to set the elimination priority of the second data in the second cache 213 The level of the upgrade can be raised to the highest level, or it can be a preset priority level. When the storage processor 211 determines that the second data is not stored in the first cache 212, the priority level of the second data is not adjusted.

After the second monitoring unit 1605 reaches the second data block to be deleted from the second cache 213, it acquires the feature identifier of the second data block.

The second determining unit 1605 determines whether the second data is stored in the first cache according to the feature identifier of the second data.

When the second determining unit 1605 determines that the second data is stored in the first cache, the second adjusting unit deletes the second data block, and when the second determining unit 1605 determines that the second data block is stored in the first cache When the second data is not stored in the first cache, the second adjustment unit increases the level of the elimination priority of the second data in the second cache 213 .

After the second monitoring unit 1605 detects the second data block to be deleted from the second cache 213, the second obtaining unit 1606 obtains the feature identifier of the second data block.

The second determining unit 1607 determines whether the second data is stored in the first cache according to the feature identifier of the second data.

When the second determining unit 1605 determines that the second data is stored in the first cache, the adjusting unit 1608 deletes the second data block. When the second determining unit 1605 determines that the second data is stored in the first cache, the adjustment unit adjusts the level of the elimination priority of the second data in the second cache 213 improve.

When the second monitoring unit 1605 detects that the time that the second data block in the second cache is stored in the second cache exceeds a threshold, the second obtaining unit 1606 obtains the second data block feature identification.

The second determining unit 1606 determines whether the second data is stored in the first cache according to the feature identifier of the second data.

When the second determining unit 1605 determines that the second data is stored in the first cache, the adjusting unit 1608 adjusts the level of the elimination priority of the second data in the second cache 213 improve. When the second determining unit 1605 determines that the second data is not stored in the first cache, the adjusting unit 1608 adjusts the elimination priority of the second data in the second cache 213 Level down.

An embodiment of the present invention further provides a computer-readable medium, including computer-executable instructions. When a processor of a computer executes the computer-executable instructions, the computer executes FIG. 3 , FIG. 6 , FIG. 8 , FIG. 10 , FIG. 12 , and the method flow described in FIG. 14 .

The first data block in the embodiment of the present invention, the first and the second in the second data block are only used to distinguish the data blocks stored in the first cache and the second cache respectively, and the first and the second do not contain different levels. 、 The meaning of the order is different, and it does not contain the meaning of quantity. Both the first data block and the second data block can be one data block, and can also refer to multiple data blocks.

The first and second of the first trigger condition and the second trigger condition in the embodiment of the present invention are only used to distinguish whether the data in the first cache or the data in the second cache is detected. It does not include the meaning of a different level, a different order, nor the meaning of a quantity.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium can include: ROM, RAM, magnetic disk or optical disk, etc.

The data block writing device and method provided by the embodiments of the present invention have been described in detail above. The principles and implementations of the present invention are described with specific examples in this paper. The descriptions of the above embodiments are only used to help understand the present invention. At the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation and application scope. In summary, the content of this specification should not be construed as Limitations of the present invention.

Claims (19)

1. A data caching method, applied to a storage device, wherein the storage device comprises a first cache, a second cache and a storage unit, the first cache provides a data cache for an application server, the second cache The cache is used to provide data cache for the storage unit, and the method includes: In the case of monitoring the first trigger condition, acquiring characteristic information of the first data block cached in the first cache; Determine whether the first data block is stored in the second cache according to the characteristic information of the first data block; In the case that it is determined that the first data block is stored in the second cache, adjusting the level of the elimination priority of the first data block in the second cache; The first trigger condition is: the first data block is written into the first cache according to a first data write request, or the cache time of the first data block in the first cache exceeding the scheduled time; When it is determined that the first data block is stored in the second cache, adjusting the level of the elimination priority of the first data block in the second cache includes: When it is determined that the first data block is stored in the second cache, the level of the elimination priority of the first data block in the second cache is increased; Alternatively, the first trigger condition is: receiving a deletion request for deleting the first data block in the first cache; When it is determined that the first data block is stored in the second cache, adjusting the level of the elimination priority of the first data block in the second cache includes: In the case that it is determined that the first data block is stored in the second cache, the level of the elimination priority of the first data block in the second cache is lowered. 2 . The method of claim 1 , wherein the storage device stores an index record of the second cache, and the index record of the second cache includes an index record of a data block stored in the second cache. 3 . Data feature identifier, the size of the data block saved in the second cache is equal to the size of the first data block, and the data feature identifier of each data block saved in the second cache is determined by each of the second caches. Determined by the data content of the data block stored in the; The obtaining the feature information of the first data block includes: obtaining the data feature identifier of the first data block according to the data content of each first data block; The determining whether the first data block is stored in the second cache according to the feature information of the first data block includes: querying an index record of the second cache according to the data feature identifier of the first data block , and determine whether each first data block is stored in the second cache. 3. The method of claim 1, further comprising: In the case of monitoring the second trigger condition, acquiring the feature information of the second data block cached in the second cache; Determine whether the second data block is stored in the first cache according to the characteristic information of the second data block; In the case that it is determined that the second data block is stored in the first cache, the level of the elimination priority of the second data block in the second cache is adjusted. 4. The method according to claim 3, wherein the second trigger condition is: the cache time of the second data block in the second cache exceeds a predetermined time; When it is determined that the second data block is stored in the first cache, adjusting the level of the elimination priority of the second data block in the second cache includes: In a case where it is determined that the second data block is stored in the first cache, the level of the elimination priority of the second data block is increased from the second cache. 5. The method of claim 3, wherein if the second trigger condition is: delete the second data block in the second cache, The method also includes: In a case where it is determined that the second data is not stored in the first cache, the level of the elimination priority of the second data in the second cache is lowered. 6. The method of claim 3, wherein, if the second trigger condition is: writing the second data block into the second cache; When it is determined that the second data block is stored in the first cache, adjusting the level of the elimination priority of the second data block in the second cache includes: When it is determined that the second data block is stored in the first cache, the level of the elimination priority of the second data block in the second cache is increased. 7. The method according to any one of claims 3-6, wherein the storage device saves an index record of the first cache, and the index record of the first cache includes the index records in the first cache The data feature identifier of the stored data block, the size of the data block stored in the first cache is equal to the size of the second data block, and the data feature identifier of the data block stored in the first cache is determined by each data block. The content of the data included determines; The obtaining the feature information of the second data block includes: obtaining the data feature identifier of each second data block according to the data content of each second data block; The determining whether the second data block is stored in the first cache according to the feature information of the second data block includes: querying an index record of the first cache according to the data feature identifier of the second data block , and determine whether the second data block is stored in the first cache. 8. A method for caching data, applied to a storage device, wherein the storage device comprises a first cache, a second cache and a storage unit, the first cache provides a data cache for an application server, the second cache The cache is used to provide data cache for the storage unit, and the method includes: In the case of monitoring the second trigger condition, acquiring the feature information of the second data block cached in the second cache; Determine whether the second data block is stored in the first cache according to the feature information of the second data; In the case of determining that the second data block is stored in the first cache, adjusting the level of the elimination priority of the second data block in the second cache; Wherein, the second trigger condition is: the cache time of the second data block in the second cache exceeds a predetermined time; When it is determined that the second data block is stored in the first cache, adjusting the level of the elimination priority of the second data in the second cache includes: When it is determined that the second data block is stored in the first cache, the level of the elimination priority of the second data block in the second cache is increased; Or, if the second trigger condition is: delete the second data block in the second cache, The method also includes: In the case of determining that the second data block is not stored in the first cache, reducing the level of the elimination priority of the second data block in the second cache; Or, if the second trigger condition is: writing data including the second data block into the second cache; When it is determined that the second data block is stored in the first cache, adjusting the level of the elimination priority of the second data block in the second cache includes: When it is determined that the second data block is stored in the first cache, the level of the elimination priority of the second data block in the second cache is increased. 9 . The method according to claim 8 , wherein the storage device stores an index record of the first cache, and the index record of the first cache includes the data block stored in the first cache. 10 . Data feature identifier, the size of the data block stored in the first cache is equal to the size of the second data block, and the data feature identifier of each data block stored in the second cache is determined by each of the second caches. Determined by the data content of the data block stored in the; The obtaining the feature information of the second data block includes: obtaining the data feature identifier of each second data block according to the data content contained in each second data block; The determining whether the second data block is stored in the first cache according to the feature information of the second data block includes: querying the index record of the first cache according to the data feature identifier of each second data block , and determine whether the second data block is stored in the first cache. 10. A storage control device for controlling data storage of a storage device, wherein the storage device comprises a first cache, a second cache and a storage unit, the first cache provides a data cache for an application server, and the The second cache is used to provide a data cache for the storage unit, and the storage control device includes: a first monitoring unit for monitoring the first trigger condition; a first obtaining unit, configured to obtain feature information of the first data block buffered in the first buffer when the first monitoring unit monitors the first trigger condition; a first determining unit, configured to determine whether the first data block is stored in the second cache according to feature information of the first data block; a first adjustment unit, configured to adjust the elimination priority of the first data block in the second cache when the first determination unit determines that the first data block is stored in the second cache grade level; The first trigger condition is: the first data block is written into the first cache according to a first data write request, or the first data is cached in the first cache for more than a period of time scheduled time; The first adjustment unit is specifically configured to: in the case that the first determination unit determines that the first data block is stored in the second cache, store the first data block in the second cache The level of elimination priority is increased; Alternatively, the first trigger condition is: receiving a deletion request for deleting the first data block in the first cache; The first adjustment unit is specifically configured to: in the case that the first determination unit determines that the first data block is stored in the second cache, store the first data block in the second cache The level of elimination priority is lowered. 11 . The storage control device according to claim 10 , wherein the storage device stores an index record of the second cache, and the index record of the second cache includes data stored in the second cache. 12 . The data feature identifier of the block, the size of the data block saved in the second cache is equal to the size of the first data block, and the data feature identifier of each data block saved in the second cache is determined by each of the first data blocks. 2. The data content of the data block stored in the cache is determined; The first obtaining unit is specifically configured to: obtain the data feature identifier of the first data block according to the data content of each first data block; The first determining unit is specifically configured to: query the index record of the second cache according to the data feature identifier of the first data block, and determine whether each first data block is stored in the second cache. 12. The storage control device of claim 10, further comprising: a second monitoring unit for monitoring the second trigger condition; a second acquiring unit, configured to acquire feature information of the second data block cached in the second cache when the second monitoring unit monitors the second trigger condition; a second determining unit, configured to determine whether the second data block is stored in the first cache according to the characteristic information of the second data block; a second adjustment unit, configured to adjust the priority of elimination of the second data block in the second cache when the second determination unit determines that the second data block is stored in the first cache level level. 13 . The storage control device according to claim 12 , wherein the second trigger condition monitored by the second monitoring unit is: buffering of the second data block in the second buffer. 14 . time exceeds the predetermined time; When the second determination unit determines that the second data block is stored in the first cache, the second adjustment unit is specifically configured to: Raising the second data block from the second cache has a higher level of eviction priority. 14. The storage control device according to claim 12, wherein the second trigger condition monitored by the second monitoring unit is: deleting the second data block in the second cache, When the second determination unit determines that the second data is not stored in the first cache, the second adjustment unit is specifically configured to: store the second data in the second cache The level of elimination priority is lowered. 15. The storage control device according to claim 12, wherein the second trigger condition monitored by the second monitoring unit is: writing data including the second data block into the first two cache; When the second determination unit determines that the second data block is stored in the first cache, the second adjustment unit is specifically configured to: store the second data block in the second cache The level of elimination priority is increased. 16 . The storage control apparatus according to claim 12 , wherein the storage device stores an index record of the first cache, and the index record of the first cache includes the first cache. 17 . The data feature identifier of the data block stored in the cache, the size of the data block stored in the first cache is equal to the size of the second data block, and the data feature identifier of the data block stored in the first cache is determined by each The data content contained in the data block is determined; The second obtaining unit is specifically configured to: obtain the data feature identifier of each second data block according to the data content of each second data block; The second determining unit is specifically configured to: query the index record of the first cache according to the data feature identifier of the second data block, and determine whether the second data block is stored in the first cache. 17. A storage control device for controlling data storage of a storage device, wherein the storage device comprises a first cache, a second cache and a storage unit, the first cache provides a data cache for an application server, and the The second cache is used to provide a data cache for the storage unit, and the storage control device includes: a second monitoring unit for monitoring the second trigger condition; a second acquiring unit, configured to acquire feature information of a second data block when the second monitoring unit monitors the second trigger condition, where the second data block is cached in the second cache The data; a second determining unit, configured to determine whether the second data block is stored in the first cache according to the characteristic information of the second data block; a second adjustment unit, configured to adjust the priority of elimination of the second data block in the second cache when the second determination unit determines that the second data block is stored in the first cache grade level; Wherein, the second trigger condition monitored by the second monitoring unit is: the cache time of the second data block in the second cache exceeds a predetermined time; The second adjustment unit is specifically configured to: when the second determination unit determines that the second data block is stored in the first cache, increasing the level of elimination priority of the second data block from the second cache; Or, the second trigger condition monitored by the second monitoring unit is: delete the second data block in the second cache, When the second determination unit determines that the second data is not stored in the first cache, the second adjustment unit is further configured to: store the second data in the second cache The level of the elimination priority is reduced; Alternatively, the second trigger condition monitored by the second monitoring unit is: writing data including the second data block into the second cache; When the second determination unit determines that the second data block is stored in the first cache, the second adjustment unit is specifically configured to: store the second data block in the second cache The level of elimination priority is increased. 18 . The storage control device according to claim 17 , wherein the storage device stores an index record of the first cache, and the index record of the first cache includes data stored in the first cache. 19 . The size of the data block stored in the first cache is equal to the size of the second data block, and the data feature identifier of each data block stored in the second cache is determined by each of the second cache. The data content contained in the data block saved in the cache is determined; The second obtaining unit is specifically configured to: obtain the data feature identifier of each second data block according to the data content contained in each second data block; The second determining unit is specifically configured to: query the index record of the first cache according to the data feature identifier of each second data block, and determine whether the second data block is stored in the first cache. 19. A storage device, the storage device comprising a processor, a memory, a first cache, a second cache and a storage unit, the first cache provides a data cache for an application server, and the second cache is used for the The storage unit provides a data cache, the memory is used to store computer-executed instructions, and when the storage device operates, the processor executes the computer-executed instructions stored in the memory, so that the storage device executes claim 1 -7 or the data caching method described in 8-9.

Images