CN104462403A - File intercepting method and device - Google Patents

Abstract

The invention provides a file truncation method and device. The method includes: receiving a file truncation instruction sent by a client, the instruction including an identifier of the file to be truncated, the file to be truncated including a data block, the instruction being used to instruct to release the space of the data block; determining according to the identifier The file to be truncated; locking the file to be truncated; creating a bitmap corresponding to the file to be truncated; after the bitmap is created, unlocking the file to be truncated; sending the file to the client After the instruction response message, release the space of the data block, record the identifier of the data block in the bitmap, and record that the space of the data block has been released. The file truncation method and device of the present invention can quickly return the truncation success to the user, and solve the problem that the existing file truncation process is too slow and affects other operations.

Description

File truncation method and device

technical field

The embodiment of the present invention relates to computer technology, in particular to a file truncation method and device.

Background technique

Truncation is the act of deleting data from a file without deleting the file. There are many truncation operations in the file system. For example, when editing a document, the process of inserting characters requires a truncation operation. Figure 1 is a schematic diagram of the data block structure of a file. As shown in Figure 1, the data blocks of the file system are generally organized in a tree structure, and each ellipse represents a data block. The file includes 8 data blocks (numbered 0-7 ) and 6 indirect blocks, of which 8 data blocks are also called leaf blocks. During the truncation operation, all the data blocks involved need to be released. For example, if the size of the original file is 100MB, if it is truncated to 1MB, all data blocks between 1MB and 100MB will be released; if it is truncated to 0MB, the original file will be All data blocks will be freed. When the file system receives an instruction to truncate the file shown in Figure 1 to 0, it first locks the file so that the file will not be changed during the truncation period, that is, the user cannot read and write the file during this period ;Release all data blocks and indirect blocks. The specific operation is to traverse the organizational structure of the file, find the address of the block to be released, including leaf blocks and indirect blocks, release these leaf blocks and indirect blocks, and hang them back to idle queue; the file is then unlocked and a successful truncation message is returned to the user.

It can be seen that in the truncation method of the prior art, the file is locked during the truncation period, and the locking will cause other operations to be unable to lock the file and hang up, causing the file to be inaccessible, which is inconvenient for the user to operate. It will also affect the success rate of the business, especially when the file is large, for example, the file size is tens of GB, the block release will be very slow, and other operations cannot access the file during this period. For network storage technology (Network Storage Technologies, referred to as: NAS) scenarios may cause client operations to time out, resulting in business interruption.

Contents of the invention

Embodiments of the present invention provide a file truncation method and device to overcome the problem in the prior art that file truncation takes too long and affects the success rate of other services.

In a first aspect, an embodiment of the present invention provides a file truncation method, including:

receiving a file truncation instruction sent by the client, the instruction including an identifier of the file to be truncated, the file to be truncated including a data block, and the instruction is used to instruct to release the space of the data block;

determining the file to be truncated according to the identifier;

Lock the file to be truncated;

Create a bitmap corresponding to the file to be truncated;

After the bitmap is created, unlock the file to be truncated;

After the response message of the instruction is sent to the client, the space of the data block is released, and the identifier of the data block is recorded in the bitmap, and the space of the data block is released.

In a first possible implementation manner of the first aspect, after releasing the space of the data block, the method further includes:

receiving the write data instruction sent by the client, the write data instruction includes the data to be written and the address of the data to be written, the address of the data to be written includes the identifier of the data block and the address of the data to be written write the position of the data in the data block;

determining that the space of the data block has been released according to the address of the data to be written and the bitmap;

Writing the data to be written into the storage space corresponding to the address of the data to be written.

In a second possible implementation manner of the first aspect, before releasing the space of the data block, the method further includes:

receiving the write data instruction sent by the client, the write data instruction includes the data to be written and the address of the data to be written, the address of the data to be written includes the identifier of the data block and the address of the data to be written write the position of the data in the data block;

determining that the space of the data block has not been released according to the address of the data to be written and the bitmap;

After the space of the data block is released, the data to be written is written into the storage space corresponding to the address of the data to be written.

According to the second possible implementation of the first aspect, in the third possible implementation, after releasing the space of the data block, writing the data to be written into the Before the storage space corresponding to the address of the data, it also includes:

Writing the combined data of the data to be written and all-zero data into the cache, the size of the combined data is the same as the size of the data block, the combined data includes the data to be written, The position of the data to be written in the combined data is the same as the address of the data to be written in the data block;

The writing the data to be written into the storage space corresponding to the address of the data to be written includes: reading the combined data from the cache, and writing the data into the storage where the data block is located. in space.

According to the first possible implementation of the first aspect, the fourth possible implementation further includes:

receiving a read data command sent by the client, where the read data command includes the address of the data to be written;

determining that the space of the data block has been released according to the address of the data to be written and the bitmap;

Obtaining the data to be written from the storage space corresponding to the address of the data to be written;

Send the data to be written to the client.

According to the second or third possible implementation of the first aspect, in a fifth possible implementation, it further includes:

receiving a read data command sent by the client, where the read data command includes the address of the data to be written;

determining that the space of the data block has not been released according to the address of the data to be written and the bitmap;

Sending a response message of the read data command to the client, where the response message is used to indicate that there is no data.

In a second aspect, an embodiment of the present invention provides a file truncation device, including:

The receiving module is configured to receive a file truncation instruction sent by the client, the instruction includes an identifier of the file to be truncated, the file to be truncated includes a data block, and the instruction is used to instruct to release the space of the data block;

Processing modules for:

determining the file to be truncated according to the identifier;

Lock the file to be truncated;

Create a bitmap corresponding to the file to be truncated;

After the bitmap is created, unlock the file to be truncated;

After the response message of the instruction is sent to the client, the space of the data block is released, and the identifier of the data block is recorded in the bitmap, and the space of the data block is released.

In a first possible implementation manner of the second aspect, the receiving module is further configured to: after releasing the space of the data block, receive a write data instruction sent by the client, the write data The instruction includes data to be written and an address of the data to be written, and the address of the data to be written includes an identifier of the data block and a position of the data to be written in the data block;

The processing module is also used to:

determining that the space of the data block has been released according to the address of the data to be written and the bitmap;

Writing the data to be written into the storage space corresponding to the address of the data to be written.

In a second possible implementation manner of the second aspect, the receiving module is further configured to:

Before releasing the space of the data block, receiving the write data instruction sent by the client, the write data instruction includes the data to be written and the address of the data to be written, and the address of the data to be written The address includes the identifier of the data block and the position of the data to be written in the data block;

The processing module is also used to:

determining that the space of the data block has not been released according to the address of the data to be written and the bitmap;

After the space of the data block is released, the data to be written is written into the storage space corresponding to the address of the data to be written.

According to the second possible implementation of the second aspect, in the third possible implementation, the processing module is further configured to:

Writing the combined data of the data to be written and all-zero data into the cache, the size of the combined data is the same as the size of the data block, the combined data includes the data to be written, The position of the data to be written in the combined data is the same as the address of the data to be written in the data block;

The writing the data to be written into the storage space corresponding to the address of the data to be written includes: reading the combined data from the cache, and writing the data into the storage where the data block is located. in space.

According to the first possible implementation of the second aspect, in a fourth possible implementation, the receiving module is further configured to:

receiving a read data command sent by the client, where the read data command includes the address of the data to be written;

The processing module is also used to:

determining that the space of the data block has been released according to the address of the data to be written and the bitmap;

Obtaining the data to be written from the storage space corresponding to the address of the data to be written;

It also includes a sending module, configured to send the data to be written to the client.

According to the second or third possible implementation of the second aspect, in a fifth possible implementation, the receiving module is further configured to:

receiving a read data command sent by the client, where the read data command includes the address of the data to be written;

The processing module is further configured to: determine that the space of the data block has not been released according to the address of the data to be written and the bitmap;

The sending module is further configured to: send a response message of the read data instruction to the client, where the response message is used to indicate that there is no data.

In the file truncation method and device provided by the embodiments of the present invention, the file to be truncated is unlocked after the bitmap is created, and the space of the data block is released after sending a response message of the instruction to the client. , then record the identifier of the data block in the bitmap, and record the information that the space of the data block has been released. After recording the progress of the truncation process, a message of truncation success is returned to the user, and the truncation task is transferred to the background Running, because the step of unlocking the file to be truncated is before the step of releasing the space of the data block, so that new access operations to the file can be supported during the process of actually releasing the space of the data block, so that the truncation success can be quickly returned to the user , improve the convenience, and solve the problem that the existing file system truncation process is too slow to affect other operations, and improve the convenience.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained according to these drawings without any creative effort.

Fig. 1 is a schematic diagram of a data block structure of a file;

FIG. 2 is a flow chart of Embodiment 1 of the file truncation method of the present invention;

Fig. 3 is based on the file truncation method of the present invention, the flow chart of the method embodiment of writing data when releasing the space of described data block has been completed;

4 is a flow chart of a method embodiment of writing data when releasing the space of the data block is not completed based on the file truncation method of the present invention;

FIG. 5 is a schematic diagram of the spatial distribution of an exemplary block No. 4 in the embodiment shown in FIG. 4;

6 is a flow chart of a method embodiment of reading data when releasing the space of the data block has been completed based on the file truncation method of the present invention;

7 is a flow chart of a method embodiment of reading data when releasing the space of the data block is not completed based on the file truncation method of the present invention;

FIG. 8 is a schematic structural diagram of Embodiment 1 of the file truncation device of the present invention;

Fig. 9 is a schematic structural view of Embodiment 2 of the piece cutting device of the present invention;

Fig. 10 is a schematic structural diagram of Embodiment 3 of the piece cutting device of the present invention.

Detailed ways

In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

Fig. 2 is a flowchart of Embodiment 1 of the file truncation method of the present invention. As shown in Fig. 2, the method of this embodiment may include:

Step 201: Receive a file truncation instruction sent by a client, the instruction includes an identifier of the file to be truncated, the file to be truncated includes a data block, and the instruction is used to instruct to release the space of the data block.

Step 202. Determine the file to be truncated according to the identifier.

Step 203, lock the file to be truncated.

Step 204, creating a bitmap corresponding to the file to be truncated.

Step 205, after the bitmap is created, unlock the file to be truncated.

In the prior art, it is necessary to release all the data blocks to be truncated before unlocking the file to be truncated. In this embodiment, step 205 unlocks the file to be truncated after creating the bitmap, so that other operations can be performed. Operate on the file.

Step 206, after sending the response message of the instruction to the client, release the space of the data block, record the identifier of the data block in the bitmap, and record that the space of the data block has been released .

Wherein, there is no sequence between step 203 and step 204, and these two steps can also be performed at the same time. The bitmap in step 204 is used to record the progress of the truncation process.

Optionally, after the bitmap is created in step 204, the bitmap may also be recorded in a power-saving memory, that is, stored in a non-volatile memory. Alternatively, backup processing such as mirroring may also be performed to ensure that the bitmap is not lost.

Moreover, the bitmap task needs to be persistent and updated according to the progress of data block release.

In the method of this embodiment, after the file system receives the file truncation instruction, it unlocks the file to be truncated as long as the bitmap corresponding to the file to be truncated is created or initialized, and sends the instruction to the client After the response message, release the space of the data block. Here, the operation of releasing the space of the data block may be performed in the background, and is invisible to the client. When actually performing the operation of releasing the space of the data block, record the identifier of the data block in the bitmap, and record the information that the space of the data block has been released, for example, each time the space of a data block is released, it can be Marked as 0 in the bitmap.

In the method of this embodiment, after the bitmap is created, the file to be truncated is unlocked, and after a response message of the instruction is sent to the client, the space of the data block is released, and then in the The bitmap records the identification of the data block, and records the information that the space of the data block has been released, because the step of unlocking the file to be truncated is before the step of releasing the space of the data block, so that the space of the data block is actually released The new file access operation can be supported in the process, so as to solve the problem that the truncation process of the existing file system is too slow and affect other operations, and improve the convenience.

Since the specific operation of releasing the data block has not been completed when the successful truncation message is returned, if an instruction to access the data is received when the release is performed in the background, there are two situations. In the first case, Although the entire truncation process is not completed, the data block to be accessed has been released. In this case, as long as it is confirmed that the data block has been released, the access to the data can be the same as the general data access, and no other additional processing is required; the second In this case, if the data block to be accessed has not been released, the data block to be accessed is released first, and the operation of writing data is different from the operation of reading data. The following describes the data access process in different cases to describe.

Fig. 3 is based on the file truncation method of the present invention, the flowchart of the method embodiment of writing data when releasing the space of described data block has been completed, as shown in Fig. 3, the method of this embodiment may include:

Step 301: Receive the write data instruction sent by the client, the write data instruction includes the data to be written and the address of the data to be written, and the address of the data to be written includes the identifier of the data block and the address of the data to be written. The position of the data to be written in the data block.

Generally, the space of the data block is large, and the space required for the data to be written only accounts for a part of the space of the data block. Therefore, the address of the data to be written includes the identifier of the data block and the The location of the data within the data block.

Step 302. Determine that the space of the data block has been released according to the address of the data to be written and the bitmap.

Step 303, writing the data to be written into the storage space corresponding to the address of the data to be written.

In the data writing method of this embodiment, before writing data, first query the bitmap, determine that the space of the data block has been released, and then write the data to be written into the address corresponding to the data to be written In the storage space, even when the entire file truncation process is not over, the normal progress of the writing process can be guaranteed.

Fig. 4 is based on the file truncation method of the present invention, the flowchart of the method embodiment of writing data when releasing the space of the data block is not completed, as shown in Fig. 4, the method of this embodiment may include:

Step 401: Receive the write data instruction sent by the client, the write data instruction includes the data to be written and the address of the data to be written, the address of the data to be written includes the identifier of the data block and the address of the data to be written The position of the data to be written in the data block.

Step 402. Determine according to the address of the data to be written and the bitmap that the space of the data block has not been released.

Next, after the space of the data block is released, the data to be written may be written into the storage space corresponding to the address of the data to be written.

Optionally, in specific implementation, before performing the steps of releasing the space of the data block and writing the data to be written into the storage space corresponding to the address of the data to be written, the following steps may also be performed first Optional step for 403:

Step 403, write the combined data of the data to be written and the all-zero data into the cache, the size of the combined data is the same as the size of the data block, and the combined data includes the data to be written input data, the position of the data to be written in the combined data is the same as the address of the data to be written in the data block.

At this time, after releasing the space of the data block, the step of writing the data to be written into the storage space corresponding to the address of the data to be written may specifically be:

Step 404, read the combined data from the cache, and write it into the storage space where the data block is located.

Specifically, the combined data of the data to be written and all-zero data is written into the cache, the size of the combined data is the same as the size of the data block, and the combined data includes the data to be written input data, the position of the data to be written in the combined data is the same as the address of the data to be written in the data block, which means that the data block to be written It is represented by an all-zero page and combined with the data to be written. The result of the combination can be that three pages are generated in the cache, which are: the first address of the data block to the data to be written in the data The all-zero page corresponding to the space between the positions in the block, the page corresponding to the data to be written and the space between the position of the data to be written in the data block and the end address of the data block All zero pages.

In step 404, when the cache data is written to the disk, the all-zero page will be converted into a truncation operation.

The specific operation in the case that the space of the data block to be written has not been released is described below with a specific embodiment. Assume the organizational structure of the file system as shown in Figure 1, the data blocks are 0~7, and the size of each block is 1GB. The task is carried out from the back to the front. Therefore, when truncating to 5, the truncated bitmap is 11111000. If an instruction is received at this time: write data with a size of 4KB in block 4, and the 4KB data starts at 4 The position of 128KB after the first address in the number block. At this time, the write operation can be performed as shown in FIG. 4 , wherein step 402 is specifically to detect the bitmap, and determine that block No. 4 has not been released according to the bitmap. At this time, the No. 4 block can be released first, and the operation of writing into the cache in step 403 specifically includes:

Combine the 4KB data to be written and all zero data. The cache will generate three pages: an all-zero page corresponding to the space before the data to be written, a page corresponding to the 4KB data to be written, and an all-zero page corresponding to the space after the data to be written.

Assume that the size of block No. 4 is 1GB. For example, the 1GB area represents the area from 50GB to 51GB of the file, and the 4KB data written is located at the position of 50GB+128KB. At this time, the cache generated The three pages are: [50GB, 128KB], [(50GB+128KB), 4KB], [(50GB+128KB+4K), (1GB-128KB-4KB)], where the first item in square brackets means The starting position of the region, the second item (the item after the comma) indicates the length of the region.

The spatial distribution of the No. 4 block is shown in FIG. 5 , which is a schematic diagram of the exemplary spatial distribution of the No. 4 block in the embodiment shown in FIG. 4 . Wherein, the shaded part is 4KB data to be written, and the two blank parts before and after the shaded part are two all-zero pages, and the starting position of the shaded part is that the data to be written included in the address of the data to be written is in the The position in the above data block is 50GB+128KB in this embodiment, that is, the length of the all-zero page on the left side of the shaded part is 128KB.

The all-zero page is a special page used to indicate a release action. When the cached data is stored on the disk, the all-zero page will be converted into a truncation operation, and the data block will be combined with the data block The space corresponding to the corresponding indirect block is all released. When the data in the cache is stored on the disk, special processing will be done for the all-zero page, such as [50GB, 128KB] this all-zero page means that the space allocated from the 50GB to the last 128KB area of the file will be released; [ (50GB+128KB+4K), (1GB-128KB-4KB)] means to release the area within the length of 51GB-128KB-4KB from the position of 50GB+128KB+4K of the file; [(50GB+128KB), 4KB] area It is the area where the user actually writes data. In this way, what is finally stored on the disk is 4KB of data to be written.

The method of this embodiment can be applied to the case where the data block to be accessed has not been released yet and a write data instruction is received, by releasing the data block first before writing data, and then performing a write operation to complete the write task, thus ensuring the normal progress of the write operation.

Fig. 6 is based on the file truncation method of the present invention, the flow chart of the method embodiment of reading data when releasing the space of the data block has been completed, as shown in Fig. 6, the method of this embodiment may include:

Step 601. Receive a data read command sent by the client, where the read data command includes the address of the data to be written.

Wherein, the scenario of this embodiment is when the truncation operation of a certain file is transferred to the background for execution, and the command to read data is received, and the release of the data block space of the file has not been completed at this time. The read data instruction in step 601 refers to the data written in the aforementioned embodiment corresponding to FIG. 3 or FIG. 4 , therefore, the address included in the read data instruction corresponds to the address of the data to be written in the aforementioned embodiment.

Step 602. Determine according to the address of the data to be written and the bitmap that the space of the data block has been released.

Step 603. Obtain the data to be written from the storage space corresponding to the address of the data to be written.

Step 604. Send the data to be written to the client.

Compared with the data reading method in the prior art, the data reading method of this embodiment adds the step of checking the bitmap to confirm whether the space of the data block has been released before obtaining the data required in the data reading instruction, thereby It is guaranteed that the operation of reading data can be performed even when the truncation of the entire file is not completed.

FIG. 7 is a flow chart of a method embodiment of reading data when releasing the space of the data block is not completed based on the file truncation method of the present invention. As shown in FIG. 7, the method of this embodiment may include:

Step 701. Receive a data read command sent by the client, where the read data command includes the address of the data to be written.

Wherein, the scenario of this embodiment is when the truncation operation of a certain file is transferred to the background for execution, and the command to read data is received, and the release of the data block space of the file has not been completed at this time. The read data instruction in step 701 refers to the data written in the aforementioned embodiment corresponding to FIG. 3 or FIG. 4 , therefore, the address included in the read data instruction corresponds to the address of the data to be written in the aforementioned embodiment.

Step 702. Determine according to the address of the data to be written and the bitmap that the space of the data block has not been released.

Step 703: Send a response message of the read data instruction to the client, where the response message is used to indicate that there is no data.

Compared with the data reading method in the prior art, the data reading method in this embodiment adds a step of checking the bitmap to confirm whether the space of the data block has been released before obtaining the data required in the data reading instruction. In an embodiment, since the space of the data block has not been released, an indication of no data is returned to the client.

In combination with the above-mentioned embodiments, by converting the file truncation operation into a task of releasing the space of the data block executed in the background, and recording the progress of the process of releasing the space of the data block through the bitmap, the file to be truncated can be quickly unlocked, and Sending the response message of the instruction to the client, from the perspective of user perception, speeds up the truncation operation of large files, and can respond to the application of data blocks faster; for NAS scenarios, the truncation of files with a large amount of data Commands are not easy to time out, thereby improving the success rate of business; at the same time, bitmap records, such as bitmap logs (log), are used to ensure the independence of data block space release, writing data and reading data. The execution of reading and writing data will not be affected by the data block space release process.

FIG. 8 is a schematic structural diagram of Embodiment 1 of the file truncation device of the present invention. The device of this embodiment may be installed on a computer, server, smart phone or other electronic products. As shown in FIG. 8 , the file truncation device 800 of this embodiment May include: a receiving module 801 and a processing module 802, wherein,

The receiving module 801 may be configured to receive a file truncation instruction sent by the client, the instruction includes an identifier of the file to be truncated, the file to be truncated includes a data block, and the instruction is used to instruct to release the space of the data block;

The processing module 802 can be used for:

determining the file to be truncated according to the identifier;

Lock the file to be truncated;

Create a bitmap corresponding to the file to be truncated;

After the bitmap is created, unlock the file to be truncated;

After the response message of the instruction is sent to the client, the space of the data block is released, and the identifier of the data block is recorded in the bitmap, and the space of the data block is released.

Optionally, in one scenario, the receiving module 801 is further configured to receive a write data instruction sent by the client after releasing the space of the data block, the write data instruction includes data and the address of the data to be written, the address of the data to be written includes the identification of the data block and the position of the data to be written in the data block;

The processing module 802 is also used for:

determining that the space of the data block has been released according to the address of the data to be written and the bitmap;

Writing the data to be written into the storage space corresponding to the address of the data to be written.

Optionally, in another scenario, the receiving module 801 may also be configured to receive a write data instruction sent by the client before releasing the space of the data block, the write data instruction includes Writing data and the address of the data to be written, the address of the data to be written includes the identification of the data block and the position of the data to be written in the data block;

The processing module 802 is further configured to:

determining that the space of the data block has not been released according to the address of the data to be written and the bitmap;

After the space of the data block is released, the data to be written is written into the storage space corresponding to the address of the data to be written.

Optionally, the processing module 802 may also be used to:

Writing the combined data of the data to be written and all-zero data into the cache, the size of the combined data is the same as the size of the data block, the combined data includes the data to be written, The position of the data to be written in the combined data is the same as the address of the data to be written in the data block;

The writing the data to be written into the storage space corresponding to the address of the data to be written includes: reading the combined data from the cache, and writing the data into the storage where the data block is located. in space.

The device of this embodiment can be used to implement the technical solutions of the method embodiments shown in FIGS. 2 to 4 , and its implementation principles are similar, so details are not repeated here.

The device in this embodiment unlocks the file to be truncated after the bitmap is created, and releases the space of the data block after sending a response message of the instruction to the client, and then in the bitmap Figure records the identification of the data block, and records the information that the space of the data block has been released. After recording the progress of the truncation process, a truncation success message will be returned to the user, and the truncation task will be transferred to the background. Since the file to be truncated The step of unlocking is before the step of releasing the space of the data block, so that new access operations to the file can be supported during the process of actually releasing the space of the data block, so that the truncation success can be quickly returned to the user, and the convenience is improved. It also solves the problem that the truncation process of the existing file system is too slow and affects other operations, and improves convenience. Moreover, in the process of actually releasing the space of the data block, the operation of writing data can be carried out smoothly.

FIG. 9 is a schematic structural diagram of Embodiment 2 of the file truncation device of the present invention. The file truncation device 900 of this embodiment may further include a sending module 803 on the basis of the embodiment shown in FIG. 8 .

In one scenario, the receiving module 801 may also be configured to receive a read data instruction sent by the client, where the read data instruction includes the address of the data to be written;

The processing module 802 may also be used for:

determining that the space of the data block has been released according to the address of the data to be written and the bitmap;

Obtaining the data to be written from the storage space corresponding to the address of the data to be written;

The sending module 803 may be configured to send the data to be written to the client.

Optionally, in another scenario, the receiving module 801 is further configured to:

receiving a read data command sent by the client, where the read data command includes the address of the data to be written;

The processing module 802 is further configured to: determine according to the address of the data to be written and the bitmap that the space of the data block has not been released;

The sending module 803 is further configured to: send a response message of the read data instruction to the client, where the response message is used to indicate that there is no data.

The device of this embodiment can be used to implement the technical solutions of the method embodiments shown in FIGS. 6 and 7 , and the implementation principles thereof are similar, and details are not repeated here.

The device in this embodiment unlocks the file to be truncated after the bitmap is created, and releases the space of the data block after sending a response message of the instruction to the client, and then in the bitmap Figure records the identification of the data block, and records the information that the space of the data block has been released. After recording the progress of the truncation process, a truncation success message will be returned to the user, and the truncation task will be transferred to the background. Since the file to be truncated The step of unlocking is before the step of releasing the space of the data block, so that new access operations to the file can be supported during the process of actually releasing the space of the data block, so that the truncation success can be quickly returned to the user, and the convenience is improved. It also solves the problem that the truncation process of the existing file system is too slow and affects other operations, and improves convenience. Moreover, in the process of actually releasing the space of the data block, the operation of reading data can be carried out smoothly.

FIG. 10 is a schematic structural diagram of Embodiment 3 of the file truncation device of the present invention. The file truncation device of this embodiment can be a computer, server, smart phone or other electronic products, and can be used to perform any of the tasks shown in FIGS. 2-4, 6-7. The method of a method embodiment, as shown in FIG. 10, the file truncation apparatus 1000 of this embodiment may include: an interface circuit 1001 and a processor 1002, and a memory 1003 and a bus 1004 are also shown in the figure. The processor 1002, interface The circuit 1001 and the memory 1003 are connected through a bus 1004 and communicate with each other.

The bus 1004 may be an Industry Standard Architecture (Industry Standard Architecture, ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (Extended Industry Standard Architecture, EISA) bus, etc. The bus 1004 can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in FIG. 10 , but it does not mean that there is only one bus or one type of bus.

The memory 1003 is used for storing executable program codes, and the program codes include computer operation instructions. The memory 1003 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

The processor 1002 may be a central processing unit (Central Processing Unit, CPU), or a specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention.

Wherein, the interface circuit 1001 may be configured to receive a file truncation instruction sent by the client, the instruction includes the identifier of the file to be truncated, the file to be truncated includes a data block, and the instruction is used to instruct to release the space of the data block ;

The processor 1002 can be used for:

determining the file to be truncated according to the identifier;

Lock the file to be truncated;

Create a bitmap corresponding to the file to be truncated;

After the bitmap is created, unlock the file to be truncated;

After the response message of the instruction is sent to the client, the space of the data block is released, and the identifier of the data block is recorded in the bitmap, and the space of the data block is released.

Optionally, in one scenario, the interface circuit 1001 is further configured to receive a write data instruction sent by the client after releasing the space of the data block, the write data instruction includes data to be written and The address of the data to be written, the address of the data to be written includes the identifier of the data block and the position of the data to be written in the data block;

The processor 1002 is also used for:

determining that the space of the data block has been released according to the address of the data to be written and the bitmap;

Writing the data to be written into the storage space corresponding to the address of the data to be written.

Optionally, in another scenario, the interface circuit 1001 may also be configured to receive a write data instruction sent by the client before releasing the space of the data block, the write data instruction includes waiting Writing data and the address of the data to be written, the address of the data to be written includes the identification of the data block and the position of the data to be written in the data block;

The processor 1002 is further configured to:

determining that the space of the data block has not been released according to the address of the data to be written and the bitmap;

After the space of the data block is released, the data to be written is written into the storage space corresponding to the address of the data to be written.

Optionally, the processor 1002 may also be used to:

Writing the combined data of the data to be written and all-zero data into the cache, the size of the combined data is the same as the size of the data block, the combined data includes the data to be written, The position of the data to be written in the combined data is the same as the address of the data to be written in the data block;

The writing the data to be written into the storage space corresponding to the address of the data to be written includes: reading the combined data from the cache, and writing the data into the storage where the data block is located. in space.

In one scenario, the interface circuit 1001 may also be configured to receive a read data instruction sent by the client, where the read data instruction includes the address of the data to be written;

The processor 1002 may also be used for:

determining that the space of the data block has been released according to the address of the data to be written and the bitmap;

Obtaining the data to be written from the storage space corresponding to the address of the data to be written;

The interface circuit 1001 may be configured to send the data to be written to the client.

Optionally, in another scenario, the interface circuit 1001 is also used to:

receiving a read data command sent by the client, where the read data command includes the address of the data to be written;

The processor 1001 is further configured to: determine according to the address of the data to be written and the bitmap that the space of the data block has not been released;

The interface circuit 1001 is further configured to: send a response message of the read data command to the client, where the response message is used to indicate that there is no data.

The device in this embodiment unlocks the file to be truncated after the bitmap is created, and releases the space of the data block after sending a response message of the instruction to the client, and then in the bitmap Figure records the identification of the data block, and records the information that the space of the data block has been released. After recording the progress of the truncation process, a truncation success message will be returned to the user, and the truncation task will be transferred to the background. Since the file to be truncated The step of unlocking is before the step of releasing the space of the data block, so that new access operations to the file can be supported during the process of actually releasing the space of the data block, so that the truncation success can be quickly returned to the user, and the convenience is improved. It also solves the problem that the truncation process of the existing file system is too slow and affects other operations, and improves convenience. Moreover, during the process of actually releasing the space of the data block, the operations of writing data and reading data can be carried out smoothly.

Those of ordinary skill in the art can understand that all or part of the steps for implementing the above method embodiments can be completed by program instructions and related hardware. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps including the above-mentioned method embodiments; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other various media that can store program codes.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than limiting them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: It is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the various embodiments of the present invention. scope.

Claims (12)

1. A file truncation method, characterized in that, comprising: receiving a file truncation instruction sent by the client, the instruction including an identifier of the file to be truncated, the file to be truncated including a data block, and the instruction is used to instruct to release the space of the data block; determining the file to be truncated according to the identifier; Lock the file to be truncated; Create a bitmap corresponding to the file to be truncated; After the bitmap is created, unlock the file to be truncated; After sending the response message of the instruction to the client, release the space of the data block, record the identifier of the data block in the bitmap, and record that the space of the data block has been released. 2. The method according to claim 1, characterized in that, after releasing the space of the data block, the method further comprises: receiving the write data instruction sent by the client, the write data instruction includes the data to be written and the address of the data to be written, the address of the data to be written includes the identifier of the data block and the address of the data to be written write the position of the data in the data block; determining that the space of the data block has been released according to the address of the data to be written and the bitmap; Writing the data to be written into the storage space corresponding to the address of the data to be written. 3. The method according to claim 1, wherein, before releasing the space of the data block, the method further comprises: receiving the write data instruction sent by the client, the write data instruction includes the data to be written and the address of the data to be written, the address of the data to be written includes the identifier of the data block and the address of the data to be written write the position of the data in the data block; determining that the space of the data block has not been released according to the address of the data to be written and the bitmap; After the space of the data block is released, the data to be written is written into the storage space corresponding to the address of the data to be written. 4. The method according to claim 3, characterized in that, after releasing the space of the data block, writing the data to be written into the storage space corresponding to the address of the data to be written Previously, also included: Writing the combined data of the data to be written and all-zero data into the cache, the size of the combined data is the same as the size of the data block, the combined data includes the data to be written, The position of the data to be written in the combined data is the same as the address of the data to be written in the data block; The writing the data to be written into the storage space corresponding to the address of the data to be written includes: reading the combined data from the cache, and writing the data into the storage where the data block is located. in space. 5. The method of claim 2, further comprising: receiving a read data command sent by the client, where the read data command includes the address of the data to be written; determining that the space of the data block has been released according to the address of the data to be written and the bitmap; Obtaining the data to be written from the storage space corresponding to the address of the data to be written; Send the data to be written to the client. 6. The method according to claim 3 or 4, further comprising: receiving a read data command sent by the client, where the read data command includes the address of the data to be written; determining that the space of the data block has not been released according to the address of the data to be written and the bitmap; Sending a response message of the read data command to the client, where the response message is used to indicate that there is no data. 7. A file truncation device, characterized in that, comprising: The receiving module is configured to receive a file truncation instruction sent by the client, the instruction includes an identifier of the file to be truncated, the file to be truncated includes a data block, and the instruction is used to instruct to release the space of the data block; Processing modules for: determining the file to be truncated according to the identifier; Lock the file to be truncated; Create a bitmap corresponding to the file to be truncated; After the bitmap is created, unlock the file to be truncated; After sending the response message of the instruction to the client, release the space of the data block, record the identifier of the data block in the bitmap, and record that the space of the data block has been released. 8. The device according to claim 7, wherein the receiving module is further configured to: after releasing the space of the data block, receive a write data instruction sent by the client, and the write The data instruction includes the data to be written and the address of the data to be written, and the address of the data to be written includes the identifier of the data block and the position of the data to be written in the data block; The processing module is also used to: determining that the space of the data block has been released according to the address of the data to be written and the bitmap; Writing the data to be written into the storage space corresponding to the address of the data to be written. 9. The device according to claim 7, wherein the receiving module is also used for: Before releasing the space of the data block, receiving the write data instruction sent by the client, the write data instruction includes the data to be written and the address of the data to be written, and the address of the data to be written The address includes the identifier of the data block and the position of the data to be written in the data block; The processing module is also used to: determining that the space of the data block has not been released according to the address of the data to be written and the bitmap; After the space of the data block is released, the data to be written is written into the storage space corresponding to the address of the data to be written. 10. The device according to claim 9, wherein the processing module is further used for: Writing the combined data of the data to be written and all-zero data into the cache, the size of the combined data is the same as the size of the data block, the combined data includes the data to be written, The position of the data to be written in the combined data is the same as the address of the data to be written in the data block; The writing the data to be written into the storage space corresponding to the address of the data to be written includes: reading the combined data from the cache, and writing the data into the storage where the data block is located. in space. 11. The device according to claim 8, wherein the receiving module is also used for: receiving a read data command sent by the client, where the read data command includes the address of the data to be written; The processing module is also used to: determining that the space of the data block has been released according to the address of the data to be written and the bitmap; Obtaining the data to be written from the storage space corresponding to the address of the data to be written; It also includes a sending module, configured to send the data to be written to the client. 12. The device according to claim 8 or 9, wherein the receiving module is also used for: receiving a read data command sent by the client, where the read data command includes the address of the data to be written; The processing module is further configured to: determine that the space of the data block has not been released according to the address of the data to be written and the bitmap; The sending module is further configured to: send a response message of the read data instruction to the client, where the response message is used to indicate that there is no data.