CN111475104B - A storage device data online migration method, system, terminal and storage medium - Google Patents

Abstract

The invention provides a method, a system, a terminal and a storage medium for online migration of storage equipment data, wherein the method comprises the following steps: backing up the back-end storage data of the operating system to be migrated; unbinding the volume of the operating system to be migrated from the original storage equipment and mapping the volume of the operating system to be migrated to target storage equipment by setting an FC port of the original storage equipment; mapping the volume migrated to the target storage device to an operating system of the target storage device by scanning for external storage; transferring the multipath software of the operating system to be migrated and configuring the operating system of the target storage device; and migrating the backup data from the original storage equipment to the target storage equipment. The invention can realize the online migration of data among the storage devices, can realize the non-downtime in the data migration process, and can not cause the data loss.

Description

A storage device data online migration method, system, terminal and storage medium

technical field

The invention relates to the technical field of storage management, in particular to a storage device data online migration method, system, terminal and storage medium.

Background technique

The risk involved in data migration is very high, especially for old storage, such as the old storage more than 10 years ago, which has poor performance, poor stability, and poor scalability. The maximum number of supported hard disks does not exceed 500. The upper-layer applications all use Oracle rac or Mysql cluster applications. Therefore, the expansion of the old data center requires the use of new storage, and the deployment of new storage requires the seamless migration of data from the old storage device to the new storage. This requires careful deployment and analysis of the migration work to prevent the occurrence of Any failures and downtime, as well as any failures and downtime during the migration need to be dealt with in a timely manner to prevent data loss.

Contents of the invention

Aiming at the above shortcomings of the prior art, the present invention provides a storage device data online migration method, system, terminal and storage medium to solve the above technical problems.

In a first aspect, the present invention provides a storage device data online migration method, including:

Back up the back-end storage data of the operating system to be migrated;

Unbinding the volume of the operating system to be migrated from the original storage device by setting the FC port of the original storage device and mapping the volume of the operating system to be migrated to the target storage device;

Map the volume migrated to the target storage device to the operating system of the target storage device by scanning the external storage;

transferring the multipath software of the operating system to be migrated and configuring the operating system of the target storage device;

Migrate backup data from the original storage device to the target storage device.

Further, the unbinding the volume of the operating system to be migrated from the original storage device by setting the FC port of the original storage device and mapping the volume of the operating system to be migrated to the target storage device includes:

Set the FC port of the target storage device and the FC port of the original storage device in the same ZONE area on the switch side;

Unbinding the volume of the operating system to be migrated from the original storage device;

By modifying the FC port parameters of the original storage device according to the FC port information of the target storage device, the volume is mapped and bound to the FC port of the target storage device.

Further, mapping the volume migrated to the target storage device to the operating system of the target storage device by scanning external storage includes:

Create the corresponding host operating system of the target storage device, and set the properties of the host operating system;

Control the operating system of the target storage device to scan for external storage;

Map the scanned volume to the operating system.

Further, the transferring the multipath software of the operating system to be migrated and configuring the operating system of the target storage device includes:

Uninstall the multipath software of the original storage device;

Install multipath software on the operating system of the target storage device;

Configure the operating system of the target storage device.

In a second aspect, the present invention provides a storage device data online migration system, including:

A data backup unit configured to back up the back-end storage data of the operating system to be migrated;

The port setting unit is configured to unbind the volume of the operating system to be migrated from the original storage device by setting the FC port of the original storage device and map the volume of the operating system to be migrated to the target storage device;

A storage scanning unit configured to map the volume migrated to the target storage device to the operating system of the target storage device by scanning external storage;

A software setting unit configured to transfer the multipath software of the operating system to be migrated and configure the operating system of the target storage device;

The data migration unit is configured to migrate backup data from the original storage device to the target storage device.

Further, the port setting unit includes:

The area setting module is configured to set the FC port of the target storage device and the FC port of the original storage device in the same ZONE area at the switch end;

A port unbinding module configured to unbind the volume of the operating system to be migrated from the original storage device;

The target binding module is configured to map and bind the volume to the FC port of the target storage device by modifying the FC port parameters of the original storage device according to the FC port information of the target storage device.

Further, the storage scanning unit includes:

The host creation module is configured to configure the corresponding host operating system used to create the target storage device, and set the properties of the host operating system;

A storage scanning module configured to control the operating system of the target storage device to scan external storage;

The mapping establishment module is configured to map the scanned volume to the operating system.

Further, the software setting unit includes:

The software unloading module is configured to unload the multipath software of the original storage device;

A software installation module configured to install multipath software on the operating system of the target storage device;

The system configuration module is configured to configure the operating system used to configure the target storage device.

In a third aspect, a terminal is provided, including:

processor, memory, where,

The memory is used to store computer programs,

The processor is used for invoking and running the computer program from the memory, so that the terminal executes the above-mentioned terminal method.

In a fourth aspect, a computer storage medium is provided, and instructions are stored in the computer-readable storage medium, and when run on a computer, the computer is made to execute the methods described in the above aspects.

The beneficial effect of the present invention is that,

The storage device data online migration method, system, terminal and storage medium provided by the present invention first back up the data to be migrated, then change the mapping relationship between the volume and the storage device, change the multipath software and configure the operating system of the target storage device, and then The backed up data is migrated to the target storage device. The invention can realize the online migration of data between storage devices, and can realize no downtime and no data loss during the data migration process.

In addition, the design principle of the present invention is reliable, the structure is simple, and has very wide application prospects.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, In other words, other drawings can also be obtained from these drawings on the premise of not paying creative work.

Fig. 1 is a schematic flowchart of a method according to an embodiment of the present invention.

Fig. 2 is a schematic block diagram of a system according to one embodiment of the present invention.

FIG. 3 is a schematic structural diagram of a terminal provided by an embodiment of the present invention.

detailed description

In order to enable those skilled in the art to better understand the technical solutions in the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described The embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

Fig. 1 is a schematic flowchart of a method according to an embodiment of the present invention. Wherein, the execution subject in FIG. 1 may be a storage device data online migration system.

As shown in Figure 1, the method 100 includes:

Step 110, backing up the back-end storage data of the operating system to be migrated;

Step 120, unbinding the volume of the operating system to be migrated from the original storage device by setting the FC port of the original storage device and mapping the volume of the operating system to be migrated to the target storage device;

Step 130, mapping the volume migrated to the target storage device to the operating system of the target storage device by scanning external storage;

Step 140, transferring the multipath software of the operating system to be migrated and configuring the operating system of the target storage device;

Step 150, migrate the backup data from the original storage device to the target storage device.

In order to facilitate the understanding of the present invention, the method for online migration of storage device data provided by the present invention will be further described below based on the principle of the method for online migration of storage device data in the present invention, combined with the process of online migration of storage device data in the embodiments.

Specifically, the storage device data online migration method includes:

S1. Backup the back-end storage data of the operating system to be migrated.

Make preparations, including: planning the VSAN on the switch in advance according to the requirements; forming a VSAN planning table; counting the host name of the system to be migrated, the port number of the HBA card, the VSAN and Zone where it is located (the function of ZONE is similar to that on an Ethernet switch The VLAN function, which logically divides the devices (hosts and storage) connected in the SAN network into different areas, so that the devices in different areas cannot be directly accessed by the FC network, thereby realizing the device in the network Mutual isolation between.) information, the number of volumes stored at the back end and the capacity and actual utility of each volume; form a detailed plan table, and count the FC port numbers (FC, Fiber Channel, Network Shaped channel technology, which was first used in SAN (storage area network). FC interface is a standard form of interface for optical fiber connection. Other common types are: ST, SC, LC, MTRJ, etc. FC was developed in 1988 and was first used To improve the transmission bandwidth of the hard disk protocol, focusing on the fast, efficient and reliable transmission of data. By the end of the 1990s, FC SAN began to be widely used on a large scale.), the information of the VSAN and Zone where it is located forms a table, Make statistics on the application environment of the upper-layer operating system, plan the port numbers of the old storage devices that are planned to be migrated and use them in a table; the upper-layer application host system temporarily suspends all services and terminates all io distribution.

Back up the data stored in the backend of the system (such as the windows host) that will be migrated from the original storage device (the old storage device, which is close to its service life and needs to be replaced), to confirm that the data is fully backed up and the integrity and consistency of the backup data is complete.

S2. Unbind the volume of the operating system to be migrated from the original storage device by setting the FC port of the original storage device and map the volume of the operating system to be migrated to the target storage device.

On the switch side, divide the FC port of the corresponding new storage device (target storage device) into the same zone as the operating system host whose data has been backed up. The old storage device will unbind the volume bound to the original host; (no operation can be performed from the upper application side); modify the parameters of the FC port on the old storage device; create a host on the new storage device, and set the host properties ;The old storage device side will remap the unbound volume to the new storage port and bind it (such as Mapping andMasking); the new storage device side will take over the external volume of the old storage device (Import form); the new storage device side will take over Then the volume on the old storage device side is remapped to the operating system of the new storage device.

S3. Map the volume migrated to the target storage device to the operating system of the target storage device by scanning the external storage.

Scan external storage on the application system side of the upper host. Result 1: No volume information mapped from the new storage device is found. Result 2: Volume information mapped from the new storage device is found normally. In the case of result 1: Find the cause ; The second result is a normal situation, verification work: after the new storage device takes over, the volume on the old storage device side is remapped to the upper host system. This volume should have capacity, not an empty volume, unless it was originally an empty volume. Otherwise impossible. Verify and record the number, total capacity, and actual usage of volumes taken over by the new storage device.

S4. Transfer the multipath software of the operating system to be migrated and configure the operating system of the target storage device.

The upper host applies the multipath software corresponding to the host system of the old storage device (such as Powpath, UltraPath software is loaded into the Linux operating system in the form of a kernel module, and it is registered as a virtual device inside the operating system. This software can make the application Communication between the server and the storage system using the optimal path.) Uninstallation, to ensure successful uninstallation, a restart is generally required. Install the multipathing software on the appropriate operating system for the new storage device. Restart the upper application system, the operating system enters the normal operation state, check the information of the volume used, including the capacity, the number of volumes, the actual usage, and record, check the status of the multipath. Modify the information of the corresponding application system of the new storage device according to the specific situation, including (UUID, drive letter, bare disk mounting, etc.), so that the upper layer application of the system is completely normal and can be used.

S5. Migrate the backup data from the original storage device to the target storage device.

Start the data migration work on the new storage side. When the data migration is completed, complete the data migration work on the new storage device side. The upper layer application corresponding to the new storage device is normally available, the data is complete, and the migration is successful.

In the process of step S4 or step S5, if a task problem occurs, the backup data is restored immediately, and the restoration method is as follows:

Uninstall the multipath software of the new storage device, unbind the volume from the new storage device on the old storage device, modify the bound FC port parameters on the old storage device, and rebind the unbound volume on the old storage device An upper-layer application system, install multi-path software (such as powpath) of the old storage device in the upper-layer system, and start the upper-layer application system.

As shown in Figure 2, the system 200 includes:

The data backup unit 210 is configured to back up the back-end storage data of the operating system to be migrated;

The port setting unit 220 is configured to unbind the volume of the operating system to be migrated from the original storage device by setting the FC port of the original storage device and map the volume of the operating system to be migrated to the target storage device;

The storage scanning unit 230 is configured to map the volume migrated to the target storage device to the operating system of the target storage device by scanning external storage;

A software setting unit 240, configured to transfer the multipath software of the operating system to be migrated and configure the operating system of the target storage device;

The data migration unit 250 is configured to migrate backup data from the original storage device to the target storage device.

Optionally, as an embodiment of the present invention, the port setting unit includes:

The area setting module is configured to set the FC port of the target storage device and the FC port of the original storage device in the same ZONE area at the switch end;

A port unbinding module configured to unbind the volume of the operating system to be migrated from the original storage device;

The target binding module is configured to map and bind the volume to the FC port of the target storage device by modifying the FC port parameters of the original storage device according to the FC port information of the target storage device.

Optionally, as an embodiment of the present invention, the storage scanning unit includes:

The host creation module is configured to configure the corresponding host operating system used to create the target storage device, and set the properties of the host operating system;

A storage scanning module configured to control the operating system of the target storage device to scan external storage;

The mapping establishment module is configured to map the scanned volume to the operating system.

Optionally, as an embodiment of the present invention, the software setting unit includes:

The software unloading module is configured to unload the multipath software of the original storage device;

A software installation module configured to install multipath software on the operating system of the target storage device;

The system configuration module is configured to configure the operating system used to configure the target storage device.

FIG. 3 is a schematic structural diagram of a terminal system 300 provided by an embodiment of the present invention. The terminal system 300 can be used to execute the method for online migration of storage device data provided by an embodiment of the present invention.

Wherein, the terminal system 300 may include: a processor 310 , a memory 320 and a communication unit 330 . These components communicate through one or more buses. Those skilled in the art can understand that the structure of the server shown in the figure does not constitute a limitation to the present invention. It can be a bus structure, a star structure, or a More or fewer components than shown, or combinations of certain components, or different arrangements of components may be included.

Wherein, the memory 320 can be used to store the execution instructions of the processor 310, and the memory 320 can be realized by any type of volatile or non-volatile storage terminal or their combination, such as static random access memory (SRAM), electronic Erasable Programmable Read Only Memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic Disk or Optical Disk . When the execution instructions in the memory 320 are executed by the processor 310, the terminal 300 is enabled to perform some or all of the steps in the following above-mentioned method embodiments.

The processor 310 is the control center of the storage terminal, using various interfaces and lines to connect various parts of the entire electronic terminal, by running or executing software programs and/or modules stored in the memory 320, and calling data stored in the memory, To perform various functions of the electronic terminal and/or process data. The processor may be composed of an integrated circuit (Integrated Circuit, IC for short), for example, may be composed of a single packaged IC, or may be composed of multiple packaged ICs connected with the same function or different functions. For example, the processor 310 may only include a central processing unit (Central Processing Unit, CPU for short). In the embodiments of the present invention, the CPU may be a single computing core, or may include multiple computing cores.

The communication unit 330 is configured to establish a communication channel, so that the storage terminal can communicate with other terminals. Receive user data sent by other terminals or send user data to other terminals.

The present invention also provides a computer storage medium, wherein the computer storage medium may store a program, and the program may include part or all of the steps in the various embodiments provided by the present invention when executed. The storage medium may be a magnetic disk, an optical disk, a read-only memory (English: read-only memory, ROM for short), or a random access memory (English: random access memory, RAM for short), and the like.

Therefore, the present invention backs up the data to be migrated first, then changes the mapping relationship between the volume and the storage device, changes the multipath software and configures the operating system of the target storage device, and then migrates the backed up data to the target storage device. The present invention can realize online migration of data between storage devices, can realize no downtime during the data migration process, and will not cause data loss. The technical effects achieved by this embodiment can be found in the above description, which is not described here. Let me repeat.

Those skilled in the art can clearly understand that the technologies in the embodiments of the present invention can be implemented by means of software plus a necessary general-purpose hardware platform. Based on such an understanding, the technical solutions in the embodiments of the present invention essentially or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products are stored in a storage medium such as a USB flash drive, mobile Various media that can store program codes, such as hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk, including several instructions to make a computer terminal (It may be a personal computer, a server, or a second terminal, a network terminal, etc.) Execute all or part of the steps of the methods described in the various embodiments of the present invention.

For the same and similar parts among the various embodiments in this specification, refer to each other. In particular, for the terminal embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for relevant details, refer to the description in the method embodiment.

In the several embodiments provided by the present invention, it should be understood that the disclosed system and method can be implemented in other ways. For example, the system embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of systems or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.

Although the present invention has been described in detail in conjunction with preferred embodiments with reference to the accompanying drawings, the present invention is not limited thereto. Without departing from the spirit and essence of the present invention, those skilled in the art can make various equivalent modifications or replacements to the embodiments of the present invention, and these modifications or replacements should be within the scope of the present invention/any Those skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present invention, and all should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims (10)

1. A storage device data online migration method, characterized in that, comprising: Back up the back-end storage data of the operating system to be migrated; Unbinding the volume of the operating system to be migrated from the original storage device by setting the FC port of the original storage device and mapping the volume of the operating system to be migrated to the target storage device; Map the volume migrated to the target storage device to the operating system of the target storage device by scanning the external storage; transferring the multipath software of the operating system to be migrated and configuring the operating system of the target storage device; Migrate backup data from the original storage device to the target storage device; If a task problem occurs during the migration process, restore the backup data immediately. The recovery methods include: Uninstall the multipath software of the target storage device, unbind the volume from the target storage device on the original storage device, modify the bound FC port parameters on the original storage device, and rebind the unbound volume to the upper application system on the original storage device , install the multipath software of the old storage device in the upper application system, and start the upper application system. 2. The method according to claim 1, wherein, by setting the FC port of the original storage device, the volume of the operating system to be migrated is unbound from the original storage device and the volume of the operating system to be migrated is mapped to to target storage devices, including: Set the FC port of the target storage device and the FC port of the original storage device in the same ZONE area on the switch side; Unbinding the volume of the operating system to be migrated from the original storage device; By modifying the FC port parameters of the original storage device according to the FC port information of the target storage device, the volume is mapped and bound to the FC port of the target storage device. 3. The method according to claim 1, wherein the mapping of the volume migrated to the target storage device to the operating system of the target storage device by scanning external storage includes: Create the corresponding host operating system of the target storage device, and set the properties of the host operating system; Control the operating system of the target storage device to scan for external storage; Map the scanned volume to the operating system. 4. The method according to claim 1, wherein the transferring the multipath software of the operating system to be migrated and configuring the operating system of the target storage device comprises: Uninstall the multipath software of the original storage device; Install multipath software on the operating system of the target storage device; Configure the operating system of the target storage device. 5. A storage device data online migration system, characterized in that, comprising: A data backup unit configured to back up the back-end storage data of the operating system to be migrated; The port setting unit is configured to unbind the volume of the operating system to be migrated from the original storage device by setting the FC port of the original storage device and map the volume of the operating system to be migrated to the target storage device; A storage scanning unit configured to map the volume migrated to the target storage device to the operating system of the target storage device by scanning external storage; A software setting unit configured to transfer the multipath software of the operating system to be migrated and configure the operating system of the target storage device; A data migration unit configured to migrate backup data from the original storage device to the target storage device; If a task problem occurs during the migration process, restore the backup data immediately. The recovery methods include: Uninstall the multipath software of the target storage device, unbind the volume from the target storage device on the original storage device, modify the bound FC port parameters on the original storage device, and rebind the unbound volume to the upper application system on the original storage device , install the multipath software of the old storage device in the upper application system, and start the upper application system. 6. The system according to claim 5, wherein the port setting unit comprises: The area setting module is configured to set the FC port of the target storage device and the FC port of the original storage device in the same ZONE area at the switch end; A port unbinding module configured to unbind the volume of the operating system to be migrated from the original storage device; The target binding module is configured to map and bind the volume to the FC port of the target storage device by modifying the FC port parameters of the original storage device according to the FC port information of the target storage device. 7. The system according to claim 5, wherein the storage scanning unit comprises: The host creation module is configured to configure the corresponding host operating system used to create the target storage device, and set the properties of the host operating system; A storage scanning module configured to control the operating system of the target storage device to scan external storage; The mapping establishment module is configured to map the scanned volume to the operating system. 8. The system according to claim 5, wherein the software setting unit comprises: The software unloading module is configured to unload the multipath software of the original storage device; A software installation module configured to install multipath software on the operating system of the target storage device; The system configuration module is configured to configure the operating system used to configure the target storage device. 9. A terminal, characterized in that, comprising: processor; memory for storing instructions for execution by the processor; Wherein, the processor is configured to execute the method according to any one of claims 1-4. 10. A computer-readable storage medium storing a computer program, wherein when the program is executed by a processor, the method according to any one of claims 1-4 is implemented.

Images