CN105808171A - Storage balancing method, device and system - Google Patents

Abstract

The present invention provides a method, device and system for balancing storage. The method includes: expanding at least one new RAID group for at least one original RAID group; Storage capacity and the storage capacity of each new RAID group in the at least one new RAID group; according to the storage capacity of each original RAID group and the storage capacity of each new RAID group, calculate the capacity ratio between each RAID group after expansion , said each RAID group includes: each original RAID group and each new RAID group; determine the storage data stored in said at least one original RAID group, and renew the storage data for each RAID group according to the capacity ratio among said each RAID group The storage data is allocated to each of the RAID groups. This solution achieves balanced storage.

Description

A method, device and system for balancing storage

technical field

The present invention relates to the technical field of storage, in particular to a method, device and system for balancing storage.

Background technique

As the amount of stored data increases, the storage space of the storage architecture is often expanded by adding a Redundant Array of Independent Disks (RAID group).

After adding disk arrays, the existing storage method is: randomly assigning data to different RAID groups, often making some disk array groups full of data, while other disk array groups still have remaining storage space, for example: RAIDGroup0 It is the original storage space, its size is 50G, the occupied storage space is 40G, and the remaining space is 10G. When expanding the original space and adding two disk array groups of 30G RAIDGroup1 and 20G RAIDGroup2 respectively, when it is necessary to store data file a with a size of 30G, the data file a is divided into three sections with data of 10G respectively VOL0, VOL1 of 5G, and VOL2 of 15G, and store VOL0, VOL1, and VOL2 in RAIDGroup0, RAIDGroup1, and RAIDGroup2 respectively, so that RAIDGroup0 is completely full, RAIDGroup1 has 35G of storage space left, and RAIDGroup2 has 5G of remaining space. Therefore, the existing This storage method causes storage imbalance.

Contents of the invention

Embodiments of the present invention provide a method, device and system for balanced storage, which realize balanced storage.

A method for balancing storage, expanding at least one new RAID group for at least one original RAID group, further comprising:

determining the storage capacity of each original RAID group in the at least one original RAID group and the storage capacity of each new RAID group in the at least one new RAID group;

According to the storage capacity of each original RAID group and the storage capacity of each new RAID group, calculate the capacity ratio between each RAID group after expansion, and each RAID group includes: each original RAID group and each new RAID group ;

Determining the storage data stored in the at least one original RAID group, and re-allocating the storage data to the various RAID groups according to the capacity ratio among the various RAID groups.

Preferably, the above method further comprises: setting at least one volume;

After the calculation of the capacity ratio among the expanded RAID groups, before the redistribution of the storage data for each of the original RAID groups and each of the new RAID groups, further comprising: according to the each The capacity ratio between RAID groups, in each RAID group, configure storage space corresponding to the capacity ratio for the at least one volume;

The re-allocating the storage data for each RAID group includes: determining the first target volume and the first target storage in each RAID group corresponding to the first target volume in the at least one volume space, storing the storage data in the first target storage space in each RAID group according to the capacity ratio among the RAID groups.

Preferably, the above method further comprises:

When a request for storing current data is received, determining a second target volume in the at least one volume and a second target storage space in each RAID group corresponding to the second target volume for the current data;

Allocating the current data to the second target storage space in each RAID group for storage according to the capacity ratio among the various RAID groups.

Preferably, the above method further comprises:

When receiving a request from the data requesting end of the peripheral device to read the target data, determine the storage situation of the target data in each RAID group;

According to the storage situation, synchronously send the target data in each RAID group to the data requesting end of the peripheral device.

A device for balancing storage, comprising:

A determination unit, configured to determine the storage capacity of each original RAID group in at least one original RAID group of the peripheral and the storage capacity of each new RAID group in at least one new RAID group of the peripheral;

A calculation unit, configured to calculate the capacity ratio between each RAID group after expansion according to the storage capacity of each original RAID group of the peripheral device determined by the determination unit and the storage capacity of each new RAID group of the peripheral device, The various RAID groups include: each original RAID group and each new RAID group;

The allocating unit is configured to determine the storage data stored in the at least one original RAID group, and re-allocate the storage data to the various RAID groups according to the capacity ratio between the various RAID groups calculated by the calculation unit.

Preferably, the above-mentioned device further includes: a setting unit, wherein,

The setting unit is configured to set at least one volume, and according to the capacity ratio between each RAID group calculated by the calculation unit, in each RAID group, configure storage space corresponding to the capacity ratio for the at least one volume ;

The allocating unit is configured to, in at least one volume set by the setting unit, determine the first target volume and the first target storage space in each RAID group corresponding to the first target volume, according to each The capacity ratio among RAID groups, storing the storage data in the first target storage space.

Preferably, the allocating unit is further configured to, when receiving a request for storing current data, determine a second target volume in the at least one volume and the respective volumes corresponding to the second target volume for the current data. The second target storage space in the RAID group; according to the capacity ratio among the various RAID groups, allocating the current data to the second target storage space in the various RAID groups for storage.

Preferably, the above device further includes: a sending unit, configured to determine the storage situation of the target data in each RAID group allocated by the allocation unit when receiving a request from the data requesting end of the peripheral device to read the target data ; According to the storage situation, synchronously send the target data in each RAID group to the data requesting end of the peripheral device.

A system for balanced storage, comprising: any of the above-mentioned balanced storage devices, at least one original RAID group and at least one new RAID group, wherein,

In the at least one original RAID group, each original RAID group is used to allocate the stored storage data to the at least one new RAID according to the capacity ratio between each RAID group calculated by the device for balancing storage Group.

In the at least one new RAID group, each new RAID group is used to receive the stored data sent by each original RAID group.

Preferably, the above system further includes: at least one data requester, wherein,

Each data requesting end is configured to send a request for reading target data to the balance storage device, and synchronously receive the target data sent by each original RAID group and each new RAID group.

Embodiments of the present invention provide a method, device and system for balancing storage. The method determines the storage capacity of each original RAID group in at least one original RAID group by expanding at least one new RAID group for at least one original RAID group. Capacity and the storage capacity of each new RAID group in at least one new RAID group; according to the storage capacity of each original RAID group and the storage capacity of each new RAID group, calculate the capacity ratio between each RAID group after expansion, and each RAID group The groups include: each original RAID group and each new RAID group; determine the storage data stored in at least one original RAID group, and re-allocate the storage data for each RAID group according to the capacity ratio between each RAID group. The method passes Calculate the capacity ratio between each RAID group, and allocate data according to the capacity ratio, so that the ratio of the amount of data stored in each RAID group to its own total storage capacity is consistent, and balanced storage is realized.

Description of drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are For some embodiments of the present invention, those skilled in the art can also obtain other drawings based on these drawings without creative work.

FIG. 1 is a flowchart of a method for balancing storage provided by an embodiment of the present invention;

Fig. 2 is a flow chart of a method for balancing storage provided by another embodiment of the present invention;

FIG. 3 is a schematic structural diagram of an expanded RAID group provided by an embodiment of the present invention;

Fig. 4 is a schematic structural diagram of a balance storage device provided by an embodiment of the present invention;

Fig. 5 is a schematic structural diagram of a balanced storage system provided by an embodiment of the present invention.

detailed description

In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work belong to the protection of the present invention. scope.

As shown in Figure 1, an embodiment of the present invention provides a method for balancing storage, which may include the following steps:

Step 101: expanding at least one new RAID group for at least one original RAID group;

Step 102: determining the storage capacity of each original RAID group in at least one original RAID group and the storage capacity of each new RAID group in at least one new RAID group;

Step 103: According to the storage capacity of each original RAID group and the storage capacity of each new RAID group, calculate the capacity ratio between each RAID group after expansion, each RAID group includes: each original RAID group and each new RAID group Group;

Step 104: Determine the storage data stored in at least one original RAID group, and re-allocate the storage data for each RAID group according to the capacity ratio among each RAID group.

In the embodiment shown in Figure 1, by extending at least one new RAID group for at least one original RAID group, the storage capacity of each original RAID group in at least one original RAID group and the storage capacity of each original RAID group in at least one new RAID group are determined. The storage capacity of each new RAID group; according to the storage capacity of each original RAID group and the storage capacity of each new RAID group, calculate the capacity ratio between each RAID group after expansion. Each RAID group includes: each original RAID group and each new RAID group; determine the storage data of at least one original RAID group storage, and redistribute storage data for each RAID group according to the capacity ratio between each RAID group, the method is by calculating the capacity ratio between each RAID group, And allocate data according to the capacity ratio, so that the amount of data stored in each RAID group accounts for the same proportion of its own total storage capacity, and balanced storage is realized.

In an embodiment of the present invention, the above method further includes: setting at least one volume; after step 103 and before step 104, further includes: configuring at least one volume in each RAID group according to the capacity ratio between each RAID group The storage space corresponding to the capacity ratio; the specific implementation of step 104, including: in at least one volume, determine the first target volume and the first target storage space in each RAID group corresponding to the first target volume, according to each RAID group The storage data is stored in the first target storage space, and the management of the RAID group is realized by dividing the volume.

In an embodiment of the present invention, the above method further includes: when a request for storing current data is received, determining a second target volume in at least one volume and a second target volume in each RAID group corresponding to the second target volume for the current data. Target storage space: according to the capacity ratio between each RAID group, the current data is allocated to the second target storage space in each RAID group for storage, that is, the storage space is still allocated according to the capacity ratio during the process of storing new data, which further improves the storage capacity. of balance.

In an embodiment of the present invention, the above method further includes: when receiving a request from the data requesting end of the peripheral device to read the target data, determining the storage conditions of the target data in each RAID group; The target data in the RAID group is synchronously sent to the data requesting end of the peripheral device. Since the data is stored in each RAID group, the rate at which each RAID group provides data at the same time is far greater than the rate at which one RAID group provides data, effectively improving improve the efficiency of reading data.

In order to make the purpose of the present invention, technical solutions and advantages clearer, take an original RAID group as an example to expand a new RAID group, expand and illustrate the method for balanced storage, as shown in Figure 2, the method may include the following steps:

Step 200: setting at least one volume;

For the front-end host, the storage space can be divided into at least one volume, which is displayed to the user, such as volume D, volume F, and so on.

Step 201: expanding at least one new RAID group for the original RAID group;

As shown in FIG. 3, the original RAID group is RAIDGroup0. In order to expand the storage capacity, two new RAID groups are extended for the RAIDGroup0, namely RAIDGroup1 and RAIDGroup2, to expand the total storage capacity.

Step 202: Determine the storage capacity of each original RAID group in the original RAID group and the storage capacity of each new RAID group in at least one new RAID group;

As shown in Figure 3, the disk size of each RAID group is 20G. Then, RAIDGroup0 is composed of 5 disks as the original RAID group, and its size is 100G; in the new RAID group, RAIDGroup1 is composed of 3 disks, and its size is 60G; RAIDGroup2 consists of 5 disks with a size of 100G; that is, the total storage capacity after expansion is 260G.

Step 203: According to the storage capacity of each original RAID group and the storage capacity of each new RAID group, calculate the capacity ratio between each RAID group after expansion;

Each RAID group mentioned in this step includes: each original RAID group and each new RAID group; as shown in Figure 3, RAIDGroup0 capacity: RAIDGroup1 capacity: RAIDGroup2 capacity=100:60:100=5:3:5 , that is, the capacity ratio of each RAID group shown in FIG. 3 is 5:3:5.

Step 204: According to the capacity ratio between each RAID group, in each RAID group, configure storage space corresponding to the capacity ratio for at least one volume;

For example: to allocate 78G storage space for the D volume set by the front-end host, according to RAIDGroup0 capacity: RAIDGroup1 capacity: RAIDGroup2 capacity = 5:3:5, configure 30G for D volume in RAIDGroup0 and 18G for D volume in RAIDGroup1 , Configure 30G for volume D in RAIDGroup2.

Step 205: Determine the storage data stored in the original RAID group;

Step 206: In at least one volume, determine the first target volume and the first target storage space in each RAID group corresponding to the first target volume;

The process of step 205 and step 206: before expanding the RAID group, for volume D, there is 26G of data in RAIDGroup0, volume D is used as the target volume, the storage space in RAIDGroup0 is 30G, and the storage space in RAIDGroup1 is 18G, The storage space in RAIDGroup2 is 30G.

Step 207: According to the capacity ratio between each RAID group, store the storage data in the first target storage space in each RAID group;

According to RAIDGroup0 capacity: RAIDGroup1 capacity: RAIDGroup2 capacity = 5:3:5, redistribute the 26G data existing in RAIDGroup0 before expansion into VOL010G, VOL16G and VOL210G; and store VOL010G in RAIDGroup0 and VOL16G in RAIDGroup1 respectively , store VOL210G in RAIDGroup2.

Step 208: When a request for storing current data is received, determine a second target volume in at least one volume and a second target storage space in each RAID group corresponding to the second target volume for the current data;

Step 209: According to the capacity ratio between each RAID group, allocate the current data to the second target storage space in each RAID group for storage;

For example: to store 13G of current data in volume D, according to RAIDGroup0 capacity: RAIDGroup1 capacity: RAIDGroup2 capacity = 5:3:5, divide 13G current data into VOL0#5G, VOL1#3G and VOL2#5G, and Store VOL0#5G in RAIDGroup0, VOL1#3G in RAIDGroup1, and VOL2#5G in RAIDGroup2, achieving balanced storage.

Step 210: When receiving a request from the data requesting end of the peripheral device to read the target data, determine the storage conditions of the target data in each RAID group;

Step 211: Synchronously send the target data in each RAID group to the data requesting end of the peripheral device according to the storage situation.

For the process of reading data in step 210 and step 211, it is worth noting that in the above storage process, a corresponding table will be generated to store the storage location of the data and the storage conditions in each RAID group, etc., then , when receiving the I/O read data, first determine the location of the data in the corresponding table, for example: to read the 13G data stored in step 209, then RAIDGroup0 provides its stored 5G data, and RAIDGroup1 provides its stored 3G data Data, RAIDGroup2 provides the 5G data it stores, and these three RAID groups can provide data synchronously, thus effectively improving the efficiency of data reading.

As shown in Figure 4, an embodiment of the present invention provides a device for balancing storage, including:

A determining unit 401, configured to determine the storage capacity of each original RAID group in at least one original RAID group of the peripheral device and the storage capacity of each new RAID group in at least one new RAID group of the peripheral device;

The calculation unit 402 is used to calculate the capacity ratio between each RAID group after expansion according to the storage capacity of each original RAID group of the peripheral device determined by the determination unit 401 and the storage capacity of each new RAID group of the peripheral device. Groups include: each original RAID group and each new RAID group;

The allocation unit 403 is configured to determine storage data stored in at least one original RAID group, and re-allocate storage data for each RAID group according to the capacity ratio between each RAID group calculated by the calculation unit 402 .

In another embodiment of the present invention, the above-mentioned device further includes: a setting unit (not shown in the figure), wherein,

A setting unit, configured to set at least one volume, and according to the capacity ratio between each RAID group calculated by the calculation unit 402, in each RAID group, configure storage space corresponding to the capacity ratio for at least one volume;

The allocating unit 403 is configured to determine the first target volume and the first target storage space in each RAID group corresponding to the first target volume in at least one volume set by the setting unit, and store the storage space according to the capacity ratio between each RAID group. The data is stored in the first target storage space.

In yet another embodiment of the present invention, the allocating unit 403 is further configured to, when receiving a request for storing current data, determine a second target volume in at least one volume for the current data and each RAID group corresponding to the second target volume The second target storage space; according to the capacity ratio between each RAID group, the current data is allocated to the second target storage space in each RAID group for storage.

In another embodiment of the present invention, the above-mentioned device further includes: a sending unit (not shown in the figure), configured to determine that the target data is allocated in the allocation unit when receiving a request from the data requesting end of the peripheral device to read the target data. The storage situation in each RAID group; according to the storage situation, the target data in each RAID group is synchronously sent to the data request end of the peripheral device.

The information exchange and execution process among the units in the above-mentioned device are based on the same concept as the method embodiment of the present invention, and the specific content can refer to the description in the method embodiment of the present invention, and will not be repeated here.

As shown in FIG. 5 , an embodiment of the present invention provides a balanced storage system, which includes: any of the above-mentioned balanced storage devices 501, at least one original RAID group 502, and at least one new RAID group 503, wherein,

In at least one original RAID group, each original RAID group 502 is configured to allocate the stored storage data to at least one new RAID group 503 according to the capacity ratio between each RAID group calculated by the device 501 for balancing storage.

In at least one new RAID group, each new RAID group 503 is used to receive storage data sent by each original RAID group 502 .

In another embodiment of the present invention, the above-mentioned system further includes: at least one data requesting end (not shown in the figure), wherein each data requesting end is used to send a request for reading target data to a device for balancing storage , and synchronously receive the target data sent by each original RAID group 502 and each new RAID group 503 .

According to the above solutions, the method, device and system for balanced storage provided by the embodiments of the present invention have at least the following beneficial effects:

1. by expanding at least one new RAID group for at least one original RAID group, determining the storage capacity of each original RAID group in the at least one original RAID group and the storage capacity of each new RAID group in the at least one new RAID group; According to the storage capacity of each original RAID group and the storage capacity of each new RAID group, calculate the capacity ratio between each RAID group after expansion. Each RAID group includes: each original RAID group and each new RAID group; determine Store data stored in at least one original RAID group, and re-allocate storage data for each RAID group according to the capacity ratio between each RAID group. This method calculates the capacity ratio between each RAID group and allocates data according to the capacity ratio. The ratio of the amount of data stored in each RAID group to its total storage capacity is consistent, and balanced storage is realized.

2. In the embodiment of the present invention, in the process of data storage, according to the capacity ratio among each RAID group, distribute the size of its storage data for each RAID group, promptly guarantee that data can be stored in each RAID group and store a part, Then, during the subsequent process of reading data, each RAID group provides a part of its stored data, that is, when reading or writing data, it can ensure that each RAID group is in a working state, thereby improving read and write performance.

3. Since the storage space allocated for the volume of the front-end host is based on the capacity ratio between each RAID group, a certain storage space is divided in each RAID group. Capacity ratio, assigning a corresponding proportion of storage data to each RAID group, ensuring that the ratio between the amount of data stored in each RAID group and the total storage capacity of each RAID group is consistent, and avoiding that a RAID group is full , the remaining small storage space of other RAID groups cannot continue to store, that is, the waste of RAID group capacity is avoided.

It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is a relationship between these entities or operations. There is no such actual relationship or sequence. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional same elements in the process, method, article or apparatus comprising said element.

Those of ordinary skill in the art can understand that all or part of the steps to realize the above method embodiments can be completed by program instructions related hardware, and the aforementioned programs can be stored in a computer-readable storage medium. When the program is executed, the It includes the steps of the above method embodiments; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other various media that can store program codes.

Finally, it should be noted that the above descriptions are only preferred embodiments of the present invention, and are only used to illustrate the technical solution of the present invention, and are not used to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present invention are included in the protection scope of the present invention.

Claims (10)

1. A method for balanced storage, characterized in that, expanding at least one new RAID group for at least one original RAID group, also includes: determining the storage capacity of each original RAID group in the at least one original RAID group and the storage capacity of each new RAID group in the at least one new RAID group; According to the storage capacity of each original RAID group and the storage capacity of each new RAID group, calculate the capacity ratio between each RAID group after expansion, and each RAID group includes: each original RAID group and each new RAID group ; Determining the storage data stored in the at least one original RAID group, and re-allocating the storage data to the various RAID groups according to the capacity ratio among the various RAID groups. 2. The method according to claim 1, further comprising: setting at least one volume; After the calculation of the capacity ratio among the expanded RAID groups, before the redistribution of the storage data for each of the original RAID groups and each of the new RAID groups, further comprising: according to the each The capacity ratio between RAID groups, in each RAID group, configure storage space corresponding to the capacity ratio for the at least one volume; The re-allocating the storage data for each RAID group includes: determining the first target volume and the first target storage in each RAID group corresponding to the first target volume in the at least one volume space, storing the storage data in the first target storage space in each RAID group according to the capacity ratio among the RAID groups. 3. The method of claim 2, further comprising: When a request for storing current data is received, determining a second target volume in the at least one volume and a second target storage space in each RAID group corresponding to the second target volume for the current data; Allocating the current data to the second target storage space in each RAID group for storage according to the capacity ratio among the various RAID groups. 4. The method according to any one of claims 1 to 3, further comprising: When receiving a request from the data requesting end of the peripheral device to read the target data, determine the storage situation of the target data in each RAID group; According to the storage situation, synchronously send the target data in each RAID group to the data requesting end of the peripheral device. 5. A device for balancing storage, comprising: A determination unit, configured to determine the storage capacity of each original RAID group in at least one original RAID group of the peripheral and the storage capacity of each new RAID group in at least one new RAID group of the peripheral; A calculation unit, configured to calculate the capacity ratio between each RAID group after expansion according to the storage capacity of each original RAID group of the peripheral device determined by the determination unit and the storage capacity of each new RAID group of the peripheral device, The various RAID groups include: each original RAID group and each new RAID group; The allocating unit is configured to determine the storage data stored in the at least one original RAID group, and re-allocate the storage data to the various RAID groups according to the capacity ratio between the various RAID groups calculated by the calculation unit. 6. The device according to claim 5, further comprising: a setting unit, wherein, The setting unit is configured to set at least one volume, and according to the capacity ratio between each RAID group calculated by the calculation unit, in each RAID group, configure storage space corresponding to the capacity ratio for the at least one volume ; The allocating unit is configured to, in at least one volume set by the setting unit, determine the first target volume and the first target storage space in each RAID group corresponding to the first target volume, according to each The capacity ratio among RAID groups, storing the storage data in the first target storage space. 7. The device of claim 6, wherein: The allocating unit is further configured to determine, for the current data, a second target volume in the at least one volume and each of the RAID groups corresponding to the second target volume when a request for storing the current data is received. The second target storage space; according to the capacity ratio among the various RAID groups, allocating the current data to the second target storage space in each RAID group for storage. 8. The device according to any one of claims 5 to 7, further comprising: The sending unit is used to determine the storage situation of the target data in each RAID group assigned by the allocation unit when receiving the request from the data requesting end of the peripheral device to read the target data; according to the storage situation, the The target data in each RAID group is synchronously sent to the data requesting end of the peripheral device. 9. A system for balanced storage, characterized in that it comprises: the device for balanced storage according to any one of claims 5 to 8, at least one original RAID group and at least one new RAID group, wherein, In the at least one original RAID group, each original RAID group is used to allocate the stored storage data to the at least one new RAID according to the capacity ratio between each RAID group calculated by the device for balancing storage Group. In the at least one new RAID group, each new RAID group is used to receive the stored data sent by each original RAID group. 10. The system according to claim 9, further comprising: at least one data requester, wherein, Each data requesting end is configured to send a request for reading target data to the balance storage device, and synchronously receive the target data sent by each original RAID group and each new RAID group.