WO2018058942A1 - Data processing method and backup server - Google Patents
Data processing method and backup server Download PDFInfo
- Publication number
- WO2018058942A1 WO2018058942A1 PCT/CN2017/081070 CN2017081070W WO2018058942A1 WO 2018058942 A1 WO2018058942 A1 WO 2018058942A1 CN 2017081070 W CN2017081070 W CN 2017081070W WO 2018058942 A1 WO2018058942 A1 WO 2018058942A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- backup
- virtual machine
- node
- backup node
- data storer
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
Definitions
- the present application relates to the field of computers, and in particular, to a data processing method and a backup server.
- the backup system is generally used to perform data backup on the virtual machine and back up the virtual machine data to the third-party backup storage device. .
- the virtual machine data is restored, the previously backed up data needs to be restored from the backup storage to the production environment.
- the implementation process is to simulate backup data as a network file system (English name: Network File System, NFS for short), and mount the NFS share to the production environment host and create it as NFS.
- Data storage English name: Data Store
- the NFS Data Store is set to non-persistent storage, the data written by the instant recovery virtual machine during the read and write operations is stored in the temporary storage space of the NFS DataStore.
- the industry backup server generally adopts a multi-node distributed architecture, and has a failover mechanism Failover for reliability. After the task fails, it will automatically switch to another backup node for re-execution.
- the prior art solution is an NFS share that is simulated on the backup node, that is, an address of the Internet protocol (English name: Internet Protocol, IP address) of the backup node that provides the NFS shared service address.
- the previous NFS share service is interrupted. This will result in the recovery of the instant recovery task, after switching to another backup node to re-execute, the recovery data that has been transmitted by the previous instant recovery task does not support the resume of the breakpoint, and only all of them can be resumed.
- the embodiment of the present application provides a data processing method and a backup server, which can be used to ensure data breakpoint retransmission after the instant recovery task is switched.
- an embodiment of the present application provides a data processing method, including:
- the data processing method is used for a backup server, where the backup server includes a management node, a first backup node, and a second backup node; wherein the first backup node is an execution node that is performing an immediate recovery task, and the second backup node is in the After the instant recovery task fails, the execution node of the instant recovery task is continued.
- the data processing method specifically includes the following steps: the first backup node virtualizes the backup data into a block storage device, and creates a target virtual machine according to the specification of the virtual machine carried in the backup data; the first backup node is the backup data virtual
- the generated block storage device identifier is a full identification name (English name: World Wide Name, WWN for short); the management node acquires and saves the identifier of the target virtual machine and the WWN; and when the backup server is running, the management node
- the management node sends an execution instruction for executing the instant recovery task to the second backup node; after receiving the execution instruction, the second backup node acquires temporary data storage.
- the identity of the Data Storer, the WWN, and the identity of the target virtual machine, the temporary Data Storer is pre- Setting the virtual data to the block storage device and identifying the WWN for the block storage device; the second backup node is based on the block storage device, the identifier of the temporary Data Storer, and the target virtual The identity of the machine performs this instant recovery task.
- the backup server determines backup data from the backup storage space, and selects a temporary Data Storer for storing temporary data and a target data for restoring the virtual machine. Storer.
- the identifier of the temporary Data Storer and the identifier of the target Data Storer are pre-stored in the management node of the backup server.
- the management node of the backup server determines, by the load balancing mechanism, the first backup node that first performs an immediate recovery task, and sends an instruction to the first backup node to perform an immediate recovery task.
- the first backup node obtains the metadata of the backup data determined by the backup server for verification, and the first backup node can obtain the backup data after the verification is passed.
- the second backup node and the first backup node are the same WWN as the block storage device identifier, that is, the second backup node is the same as the block storage device used by the first backup node, and
- the second backup node uses the same temporary data storer and the target virtual machine as the first backup node, so the second backup node can ensure that the instant execution is performed on the basis of the first backup node when performing the instant recovery task.
- To resume the task that is, to ensure that the resume can be resumed.
- the data processing method further includes: the first backup node mounts the block storage device to the target virtual machine by using a raw device mapping (Raw Device Mapping, RDM for short) A virtual machine VM disk file is generated at the temporary Data Storer; the first backup node migrates the VM disk file from the temporary Data Storer to a pre-set target data store Data Storer.
- a raw device mapping Raw Device Mapping, RDM for short
- the first backup node uses the data migration capability of the production environment virtualization platform to migrate the backup data to the target Data Storer for instant recovery.
- the data processing method further includes: the first backup node generates a snapshot file for the target virtual machine by using a snapshot technology, and generates a change virtual machine Delta VM disk file in the temporary data storer; the first backup node The Delta VM disk file is migrated from the temporary Data Storer to the target Data Storer.
- the first backup node uses the data migration capability of the production environment virtualization platform and the snapshot technology to migrate the read and write data generated in the instant recovery task to the target Data Storer, thereby preventing the read and write. data lost.
- the data processing method further includes: the first backup node mounts the block storage device to the target virtual machine in a manner of original device mapping RDM, and generates a virtual machine VM disk file in the temporary data storer.
- the first backup node generates a snapshot file for the target virtual machine by using a snapshot technology, and generates a change virtual machine Delta VM disk file in the temporary data storer; the first backup node selects the VM disk file and the Delta VM disk file by the first backup node
- the temporary Data Storer is migrated to the target Data Storer.
- the first backup node uses the data migration capability of the production environment virtualization platform to migrate the backup data to the target Data Storer for instant recovery.
- the first backup node utilizes the data migration capability of the production environment virtualization platform and the snapshot technology to migrate the read and write data generated in the instant recovery task to the target Data Storer, thereby preventing the read and write data from being lost.
- the first backup node migrates the VM disk file and the Delta VM disk file from the temporary Data Storer to the target Data Storer
- the first backup node deletes the snapshot file, and the target Data Storer
- the VM disk file is merged with the Delta VM disk file.
- the storage space can be effectively saved.
- the embodiment of the present application provides a backup server, which has the function of implementing the backup server in the foregoing method.
- This function can be implemented in hardware or in hardware by executing the corresponding software.
- the hardware or software includes one or more modules corresponding to the functions described above.
- the backup server includes:
- the first backup node is configured to virtualize the backup data as a block storage device, and create a target virtual machine according to the specification of the virtual machine carried in the backup data; and identify the global identifier name WWN for the block storage device;
- the management node is configured to acquire and save the identifier of the target virtual machine and the WWN; when it is determined that the instant recovery task fails, send an execution instruction for executing the instant recovery task to the second backup node;
- the second backup node is configured to obtain an identifier of the temporary data storage Data Storer, the WWN and an identifier of the target virtual machine, where the temporary Data Storer is preset; the backup data is virtualized as the block storage device, and is the block The storage device identifies the WWN; and according to the block storage device, the identifier of the temporary Data Storer and the identifier of the target virtual machine perform the instant recovery task.
- an embodiment of the present application provides a computer storage medium, where the program storage code is stored in the computer storage medium, and the program code is used to indicate that the method of the first aspect or the second aspect is performed.
- the embodiment of the present application has the following advantages: the second backup node and the first backup node are the same WWN as the block storage device identifier, that is, the second backup node and the first backup node are used.
- the block storage device is the same, and the second backup node uses the same temporary Data Storer and the target virtual machine as the first backup node, so the second backup node can guarantee the first backup node when performing the instant recovery task. On the basis of this instant recovery task, that is, to ensure that the resume can be resumed.
- FIG. 1 is a system framework diagram of a data processing method in an embodiment of the present application.
- FIG. 2 is a schematic diagram of an embodiment of a data processing method in an embodiment of the present application.
- FIG. 3 is a schematic diagram of an embodiment of a backup server in an embodiment of the present application.
- the embodiment of the present application provides a data processing method and a backup server, which can be used to ensure data breakpoint retransmission after the instant recovery task is switched.
- the data processing system framework includes a backup server, a backup storage, a production environment, and a production storage.
- the backup server includes a management node, a first backup node, a second backup node, and a third backup node. It can be understood that the backup server can include multiple backup nodes, not just the three backup nodes drawn in the figure.
- Each backup node is a backup execution node in the data processing system, and provides a backup recovery task execution function.
- the management node provides backup management and system management of the data processing system. Can also be responsible for the scheduling of backup and recovery tasks in the data processing system, providing task scheduling load balancing and failover capabilities.
- the backup storage is responsible for storing backup data for virtual machines in the production environment.
- the production environment is responsible for carrying the user's production business, usually using a virtualized infrastructure, that is, including the host and multiple virtual machines on the host.
- the production store is responsible for storing production business data in the production environment.
- Each backup node in the backup server adopts a multi-node distributed architecture, and has a reliability Failover mechanism. That is, after the task on the current backup node fails, the task is automatically switched to another backup node for re-execution.
- the NFS share simulated on the backup node that is, the address of the external NFS sharing service is the Internet protocol (English full name: Internet Protocol, IP address) of the backup node.
- IP address Internet Protocol
- the embodiment of the present application provides the following solution: the first backup node virtualizes the backup data into a block storage device, and creates a target virtual machine according to the specifications of the virtual machine carried in the backup data; the first backup a block storage device identifier WWN that is generated by the node for the backup data; the management node acquires and saves the identifier of the target virtual machine and the WWN; and when the backup node determines that the instant recovery task fails during the backup server operation, The management node sends an execution instruction for executing the instant recovery task to the second backup node; after receiving the execution instruction, the second backup node acquires the identifier of the temporary data storage Data Storer, the WWN, and the An identifier of the target virtual machine, the temporary Data Storer is set as a preview; the second backup node virtualizes the backup data as the block storage device, and identifies the WWN for the block storage device; the second backup node is according to the block storage device The identifier of the temporary Data Storer
- an embodiment of a data processing method in the embodiment of the present application includes:
- the first backup node virtualizes the backup data into a block storage device, and creates a target virtual machine according to the specifications of the virtual machine carried in the backup data.
- the first backup node is used as an execution node of the current instant recovery task. After receiving the instruction to execute the virtual machine instant recovery task, the first backup node obtains backup data from the backup storage, and virtualizes the acquired backup data. A block storage device; in addition, the first backup node creates a new target virtual machine according to the specifications of the virtual machine carried in the backup data.
- the specifications of the virtual machine include the CPU model, the size of the memory, and the size of the hard disk.
- the virtual machine carried in the backup data has a CPU of 2 cores, a memory of 3.5 gigabytes (English name: gigabyte, abbreviated as GB), and a hard disk of 500 GB, the target virtual node created by the first backup node.
- the specifications of the machine are 2 cores for the CPU, 3.5 GB for the memory, and 500 GB for the hard disk.
- the first backup node may virtualize the backup data as a block storage device based on the open source software tgt, lio or scst, and the specific manner is not limited herein.
- the backup server determines backup data from the backup storage, and selects a temporary data storage Data Storer for storing temporary data and is used for Restore the target Data Storer of the virtual machine.
- the identifier of the temporary Data Storer and the identifier of the target Data Storer are pre-stored in the management node of the backup server.
- the management node of the backup server determines, by the load balancing mechanism, the first backup node that first performs an immediate recovery task, and sends an instruction to the first backup node to perform an immediate recovery task.
- the first backup node obtains the metadata of the backup data determined by the backup server for verification, and the first backup node can obtain the backup data after the verification is passed. For example, there is a backup in the backup storage.
- the specifications of the virtual machine carried in the backup data A are default specifications; the backup server has a first backup node, a second backup node, and a third backup node. If the backup server needs to perform an instant recovery task, and the backup server determines the backup data A as the backup data of the instant recovery, the address of the temporary Data Storer and the address of the target Data Storer are determined in the production storage space.
- the first backup node After the management node determines that the first backup node is the execution node that performs the instant recovery task, the first backup node acquires the address of the temporary Data Storer and the address of the target Data Storer; the first backup node also acquires The metadata of the backup data A is checked for integrity. If the first backup node determines that the backup data A is complete, the first backup node acquires the backup data A.
- the first backup node creates a target virtual machine in the production environment according to the specification of the virtual machine (that is, the default specification) carried in the backup data A, and the specification of the target virtual machine is a default specification.
- the first backup node virtualizes the backup data A as the block storage device A.
- the first backup node is the block storage device identifier WWN.
- the WWN is marked for the block storage device.
- the first backup node labels the block storage device A with a WWN.
- the first backup node sends the identifier of the WWN and the target virtual machine to the management node.
- the first backup node sends the WWN of the block storage device and the identifier of the target virtual machine created by the first backup node to the management node.
- the first backup node sends the WWN of the block storage device A and the identifier of the target virtual machine to the management node.
- the first backup node can mount the block storage device on the target virtual machine in a raw device mapping manner. Performing an instant recovery task of the virtual machine, and the first backup node generates temporary virtual data to generate a virtual machine disk file and stores the virtual machine disk file in the temporary data storer; then the first backup node uses the virtual machine disk
- the files are migrated to the target Data Storer for storage, completing the instant recovery task.
- the first backup node may further generate the snapshot file by using the snapshot technology in the data of the target virtual machine, and store the data according to the identifier of the temporary data storer, generate the virtual machine disk file, and then virtualize the change.
- the machine disk files are migrated to the target destination Data Storer for storage.
- the first backup node may also delete the generated snapshot file after the migration is completed. In the actual application, the snapshot file may or may not be deleted.
- the management node saves the identifier of the WWN and the target virtual machine.
- the management node After receiving the identifier of the WWN and the target virtual machine, the management node saves the WWN and the identifier of the target virtual machine.
- the management node determines that the instant recovery task fails, the management node sends an instruction to perform the immediate recovery task to the second backup node.
- the management node periodically monitors the progress and real-time status of the instant recovery task during actual operation. If the management node detects that the real-time status of the instant recovery task indicates that the instant recovery task is faulty (for example, the first backup node is down) If the power, the restart, or the like fails to access the backup storage, fails to read data from the production environment, and the like, the management node determines, by the load balancing mechanism, the second backup node as an execution node that performs the instant recovery task, and sends the second backup to the second backup. The node sends an instruction to perform the instant recovery task.
- the management node sends the WWN and the identifier of the target virtual machine to the second backup node, and temporarily The identity of the Data Storer.
- the management node After the management node determines that the second backup node is the execution node of the instant recovery task, the management node sends the identifier of the WWN and the temporary Data Storer to the second backup node.
- the second backup node virtualizes the backup data as the block storage device, and identifies the WWN for the block storage device.
- the second backup node acquires the backup data after receiving the instruction sent by the management node to perform the instant recovery task, and then the second backup node virtualizes the backup data as the block storage device, and stores the device identifier for the block.
- the WWN The WWN.
- the management node before acquiring the backup data, sends the information of the backup data, the identifier of the target virtual machine, the identifier of the temporary Data Storer, and the identifier of the target Data Storer to the second backup node.
- the second backup node obtains the metadata of the backup data for verification, and the second backup node can obtain the backup data after the verification is passed. For example, after the management node determines the second backup node as the execution node that continues to execute the instant recovery task, the second backup node acquires the address of the temporary Data Storer and the address of the target Data Storer; the second backup node further Obtain the metadata of the backup data A and perform integrity check.
- the second backup node determines that the backup data A is complete, the second backup node acquires the backup data A.
- the second backup node also needs to virtualize the backup data A as the block storage device A based on the open source software tgt, lio or scst.
- the second backup node performs the instant recovery task by using the block storage device, the identifier of the temporary Data Storer, and the identifier of the target virtual machine.
- the second backup node After the second backup node acquires the block storage device, the second backup node performs the instant recovery task by using the identifier of the target virtual machine and the identifier of the temporary Data Storer.
- the second backup node stores temporary data in the temporary Data Storer, and the second backup node operates the target virtual machine as a virtual machine in a production environment.
- the steps performed are the same as those of the first backup node in performing the instant recovery task normally, and details are not described herein again.
- the second backup node and the first backup node are the same WWN as the block storage device identifier, that is, the second backup node is the same as the block storage device used by the first backup node, and the second backup is The node uses the same temporary data storer and the target virtual machine as the first backup node, so that the second backup node can perform the instant recovery task on the basis of the first backup node when performing the instant recovery task, that is, Guaranteed to resume the breakpoint.
- the data processing method in the embodiment of the present application is described above.
- the backup server in the embodiment of the present application is described below.
- an embodiment of the backup server 300 in the embodiment of the present application includes: the first backup node 301, configured to virtualize backup data as a block storage device, and according to the virtual machine carried by the backup data.
- the specification creates a target virtual machine; identifies the global identifier name WWN for the block storage device;
- the management node 302 is configured to acquire and save the identifier of the target virtual machine and the WWN; when it is determined that the instant recovery task fails, send an execution instruction for executing the instant recovery task to the second backup node;
- the second backup node 303 is configured to obtain an identifier of the temporary data storage Data Storer, the WWN and an identifier of the target virtual machine, where the temporary Data Storer is preset; the backup data is virtualized as the block storage device, and The block storage device identifies the WWN; according to the block storage device, the identifier of the temporary Data Storer and the The identity of the target virtual machine performs the instant recovery task.
- the first backup node 301 is further configured to mount the block storage device to the target virtual machine in an original device mapping RDM manner, and generate a virtual machine VM disk file in the temporary data storer. Transferring the VM disk file from the temporary Data Storer to a target data store Data Storer, the target Data Storer being preset.
- the first backup node 301 is further configured to generate a snapshot file for the target virtual machine by using a snapshot technology, and generate a change virtual machine Delta VM disk file in the temporary Data Storer; and the Delta VM disk is The file is migrated by the temporary Data Storer to the target Data Storer.
- the first backup node 301 is further configured to mount the block storage device to the target virtual machine in an original device mapping RDM manner, and generate a virtual machine VM disk file in the temporary data storer.
- the first backup node is further configured to delete the snapshot file.
- the second backup node 303 and the first backup node 301 are the same WWN as the block storage device identifier, that is, the second backup node 303 is the same as the block storage device used by the first backup node 301.
- the second backup node 303 and the first backup node 301 use the same temporary data storer and the target virtual machine, so the second backup node 303 can ensure that the first backup node 301 is based on the first backup node 301. Continue to perform the instant recovery task, that is, to ensure that the resume can be resumed.
- the disclosed system, apparatus, and method may be implemented in other manners.
- the device embodiments described above are merely illustrative.
- the division of the unit is only a logical function division.
- there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
- the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
- the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
- each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
- the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
- the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
- a computer readable storage medium A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present application.
- the foregoing storage medium includes: a U disk, a mobile hard disk, and a read only memory (ROM, Read-Only Memory), random access memory (RAM), disk or optical disk, and other media that can store program code.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Disclosed in the embodiments of the present application are a data processing method and a backup server, for being able to ensure data transmission resuming from a breakpoint after an instant recovery task has a failover. The method of the embodiments of the present application comprises: a first backup node virtualizing backup data in the form of a block storage device, and establishing a target virtual machine according to the specification of a virtual machine carried by the backup data; the first backup node identifying a block storage device with a world wide name (WWN); a management node acquiring and storing the identifier of the target virtual machine and the WWN; when the management node determines that an instant recovery task failed, the management node sending to a second backup node an execution instruction to execute the instant recovery task; the second backup node acquiring the identifier of a temporary data storer, the WWN and the identifier of the target virtual machine; the second backup node virtualizing the backup data in the form of the block storage device, and identifying the block storage device along with the WWN; and the second backup node executing the instant recovery task according to the block storage device, the identifier of the temporary data storer and the identifier of the target virtual machine.
Description
本申请涉及计算机领域,尤其涉及一种数据处理方法以及备份服务器。The present application relates to the field of computers, and in particular, to a data processing method and a backup server.
随着信息技术(英文全称:information technology,简称:IT)的不断发展,越来越多的企业将其数据中心的IT基础设施改造为虚拟化和云化环境,从而利用虚拟化技术提供计算资源的使用效率,实现弹性计算系统架构。在云计算/虚拟化环境中,为避免由于人为误删除或系统故障导致的虚拟机数据丢失,一般会引入备份系统对虚拟机进行数据备份,将虚拟机数据备份到第三方的备份存储设备上。虚拟机数据恢复的时候,需要将之前备份的数据从备份存储上恢复到生产环境中。With the continuous development of information technology (information technology, IT for short), more and more enterprises are transforming their IT infrastructure into virtualized and cloudized environments to provide computing resources using virtualization technology. The use efficiency to achieve an elastic computing system architecture. In the cloud computing/virtualization environment, in order to avoid the loss of virtual machine data caused by human error or system failure, the backup system is generally used to perform data backup on the virtual machine and back up the virtual machine data to the third-party backup storage device. . When the virtual machine data is restored, the previously backed up data needs to be restored from the backup storage to the production environment.
近年来出现一种虚拟机即时恢复技术,实现过程为将备份数据模拟为网络文件系统(英文全称:Network File System,简称:NFS)共享,将该NFS共享挂载到生产环境主机并创建为NFS数据存储(英文全称:Data Store),然后在生产环境上注册NFS Data Store中的虚拟机,最后就可以直接运行NFS DataStore中的虚拟机,上述NFS DataStore挂载及创建和虚拟机注册动作完成之后,就可以直接启动要恢复的虚拟机。由于NFS Data Store设置为非持久化存储,即时恢复出来的虚拟机进行读写操作时写入的数据保存在NFS DataStore的临时存储空间中。业界备份服务器一般采用多节点分布式架构,可靠性上具备任务失效切换机制Failover,任务失败后会自动切换到另外一个备份节点上重新执行。In recent years, a virtual machine instant recovery technology has emerged. The implementation process is to simulate backup data as a network file system (English name: Network File System, NFS for short), and mount the NFS share to the production environment host and create it as NFS. Data storage (English name: Data Store), then register the virtual machine in the NFS Data Store on the production environment, and finally run the virtual machine in the NFS DataStore directly. After the NFS DataStore mount and create and the virtual machine registration action is completed, , you can directly start the virtual machine to be restored. Since the NFS Data Store is set to non-persistent storage, the data written by the instant recovery virtual machine during the read and write operations is stored in the temporary storage space of the NFS DataStore. The industry backup server generally adopts a multi-node distributed architecture, and has a failover mechanism Failover for reliability. After the task fails, it will automatically switch to another backup node for re-execution.
现有技术方案是在备份节点上模拟出的NFS共享,即对外提供NFS共享服务的地址为备份节点的互联网协议(英文全称:Internet Protocol,简称:IP)地址。一旦发生备份任务的故障切换,即备份任务自身的执行失败故障,之前的NFS共享服务会中断。这样会导致在即时恢复任务故障后,切换到另外一个备份节点重新执行后,之前的即时恢复任务已经传输的恢复数据不支持断点续传,只能全部重新重头开始恢复。The prior art solution is an NFS share that is simulated on the backup node, that is, an address of the Internet protocol (English name: Internet Protocol, IP address) of the backup node that provides the NFS shared service address. In the event of a failover of a backup task, that is, a failure of the backup task itself, the previous NFS share service is interrupted. This will result in the recovery of the instant recovery task, after switching to another backup node to re-execute, the recovery data that has been transmitted by the previous instant recovery task does not support the resume of the breakpoint, and only all of them can be resumed.
发明内容Summary of the invention
本申请实施例提供了一种数据处理方法以及备份服务器,用于在即时恢复任务在进行切换之后,可以保证数据断点续传。The embodiment of the present application provides a data processing method and a backup server, which can be used to ensure data breakpoint retransmission after the instant recovery task is switched.
第一方面,本申请实施例提供一种数据处理方法,包括:In a first aspect, an embodiment of the present application provides a data processing method, including:
该数据处理方法用于备份服务器,该备份服务器包括管理节点,第一备份节点,第二备份节点;其中该第一备份节点为正在执行即时恢复任务的执行节点,该第二备份节点为在该即时恢复任务发生故障后,继续执行该即时恢复任务的执行节点。而该数据处理方法具体包括如下步骤:该第一备份节点将备份数据虚拟为块存储设备,并根据该备份数据携带的虚拟机的规格创建目标虚拟机;该第一备份节点为该备份数据虚拟生成的块存储设备标识全求标识名称(英文全称:World Wide Name,简称:WWN);该管理节点获取并保存该目标虚拟机的标识和该WWN;在该备份服务器运行期间,当该管理节点确定该即时恢复任务发生故障时,该管理节点向该第二备份节点发送执行该即时恢复任务的执行指令;该第二备份节点在接收到该执行指令之后,该第二备份节点获取临时数据存储Data Storer的标识、该WWN和该目标虚拟机的标识,该临时Data Storer为预
告设置;该第二备份节点将该备份数据虚拟为该块存储设备,并为该块存储设备标识该WWN;该第二备份节点根据该块存储设备、该临时Data Storer的标识以及该目标虚拟机的标识执行该即时恢复任务。The data processing method is used for a backup server, where the backup server includes a management node, a first backup node, and a second backup node; wherein the first backup node is an execution node that is performing an immediate recovery task, and the second backup node is in the After the instant recovery task fails, the execution node of the instant recovery task is continued. The data processing method specifically includes the following steps: the first backup node virtualizes the backup data into a block storage device, and creates a target virtual machine according to the specification of the virtual machine carried in the backup data; the first backup node is the backup data virtual The generated block storage device identifier is a full identification name (English name: World Wide Name, WWN for short); the management node acquires and saves the identifier of the target virtual machine and the WWN; and when the backup server is running, the management node When it is determined that the instant recovery task fails, the management node sends an execution instruction for executing the instant recovery task to the second backup node; after receiving the execution instruction, the second backup node acquires temporary data storage. The identity of the Data Storer, the WWN, and the identity of the target virtual machine, the temporary Data Storer is pre-
Setting the virtual data to the block storage device and identifying the WWN for the block storage device; the second backup node is based on the block storage device, the identifier of the temporary Data Storer, and the target virtual The identity of the machine performs this instant recovery task.
本申请实施例中,该第一备份节点在获取该备份数据之前,该备份服务器从备份存储空间中确定备份数据,并选择用于存储临时数据的临时Data Storer和用于恢复虚拟机的目标Data Storer。该临时Data Storer的标识和该目标Data Storer的标识预先存储在该备份服务器的管理节点。该备份服务器的管理节点通过负载均衡机制确定首先执行即时恢复任务的该第一备份节点,并向该第一备份节点发送执行即时恢复任务的指令。该第一备份节点获取该备份服务器确定的备份数据的元数据进行校验,在校验通过之后,该第一备份节点才可以获取到该备份数据。In the embodiment of the present application, before the first backup node obtains the backup data, the backup server determines backup data from the backup storage space, and selects a temporary Data Storer for storing temporary data and a target data for restoring the virtual machine. Storer. The identifier of the temporary Data Storer and the identifier of the target Data Storer are pre-stored in the management node of the backup server. The management node of the backup server determines, by the load balancing mechanism, the first backup node that first performs an immediate recovery task, and sends an instruction to the first backup node to perform an immediate recovery task. The first backup node obtains the metadata of the backup data determined by the backup server for verification, and the first backup node can obtain the backup data after the verification is passed.
本申请实施例提供的技术方案中,该第二备份节点与该第一备份节点为块存储设备标识相同的WWN,即该第二备份节点与该第一备份节点使用的块存储设备相同,同时该第二备份节点与该第一备份节点使用相同的临时Data Storer和目标虚拟机,因此该第二备份节点在执行即时恢复任务时,可以保证在该第一备份节点的基础上继续执行该即时恢复任务,即保证可以断点续传。In the technical solution provided by the embodiment of the present application, the second backup node and the first backup node are the same WWN as the block storage device identifier, that is, the second backup node is the same as the block storage device used by the first backup node, and The second backup node uses the same temporary data storer and the target virtual machine as the first backup node, so the second backup node can ensure that the instant execution is performed on the basis of the first backup node when performing the instant recovery task. To resume the task, that is, to ensure that the resume can be resumed.
可选的,该数据处理方法还包括如下方案:该第一备份节点将该块存储设备以原始设备映射(英文全称:Raw Device Mapping,简称:RDM)的方式挂载给该目标虚拟机,并在该临时Data Storer生成虚拟机VM磁盘文件;该第一备份节点将该VM磁盘文件由该临时Data Storer迁移到预先设置目标数据存储Data Storer。Optionally, the data processing method further includes: the first backup node mounts the block storage device to the target virtual machine by using a raw device mapping (Raw Device Mapping, RDM for short) A virtual machine VM disk file is generated at the temporary Data Storer; the first backup node migrates the VM disk file from the temporary Data Storer to a pre-set target data store Data Storer.
本申请实施例提供的技术方案中,该第一备份节点利用生产环境虚拟化平台的数据迁移能力将备份数据迁移至目标Data Storer中完成即时恢复。In the technical solution provided by the embodiment of the present application, the first backup node uses the data migration capability of the production environment virtualization platform to migrate the backup data to the target Data Storer for instant recovery.
可选的,该数据处理方法还包括如下方案:该第一备份节点利用快照技术为该目标虚拟机生成快照文件,并在该临时Data Storer生成变更虚拟机Delta VM磁盘文件;该第一备份节点将该Delta VM磁盘文件由该临时Data Storer迁移到该目标Data Storer。Optionally, the data processing method further includes: the first backup node generates a snapshot file for the target virtual machine by using a snapshot technology, and generates a change virtual machine Delta VM disk file in the temporary data storer; the first backup node The Delta VM disk file is migrated from the temporary Data Storer to the target Data Storer.
本申请实施例提供的技术方案中,该第一备份节点利用生产环境虚拟化平台的数据迁移能力以及快照技术将即时恢复任务中产生的读写数据迁移到该目标Data Storer,从而防止该读写数据丢失。In the technical solution provided by the embodiment of the present application, the first backup node uses the data migration capability of the production environment virtualization platform and the snapshot technology to migrate the read and write data generated in the instant recovery task to the target Data Storer, thereby preventing the read and write. data lost.
可选的,该数据处理方法还包括如下方案:该第一备份节点将该块存储设备以原始设备映射RDM的方式挂载给该目标虚拟机,并在该临时Data Storer生成虚拟机VM磁盘文件;该第一备份节点利用快照技术为该目标虚拟机生成快照文件,并在该临时Data Storer生成变更虚拟机Delta VM磁盘文件;该第一备份节点将该VM磁盘文件和该Delta VM磁盘文件由该临时Data Storer迁移到该目标Data Storer。Optionally, the data processing method further includes: the first backup node mounts the block storage device to the target virtual machine in a manner of original device mapping RDM, and generates a virtual machine VM disk file in the temporary data storer. The first backup node generates a snapshot file for the target virtual machine by using a snapshot technology, and generates a change virtual machine Delta VM disk file in the temporary data storer; the first backup node selects the VM disk file and the Delta VM disk file by the first backup node The temporary Data Storer is migrated to the target Data Storer.
本申请实施例提供的技术方案中,该第一备份节点利用生产环境虚拟化平台的数据迁移能力将备份数据迁移至目标Data Storer中完成即时恢复。同时该第一备份节点利用生产环境虚拟化平台的数据迁移能力以及快照技术将即时恢复任务中产生的读写数据迁移到该目标Data Storer,从而防止该读写数据丢失。In the technical solution provided by the embodiment of the present application, the first backup node uses the data migration capability of the production environment virtualization platform to migrate the backup data to the target Data Storer for instant recovery. At the same time, the first backup node utilizes the data migration capability of the production environment virtualization platform and the snapshot technology to migrate the read and write data generated in the instant recovery task to the target Data Storer, thereby preventing the read and write data from being lost.
可选的,该第一备份节点在将该VM磁盘文件和该Delta VM磁盘文件由该临时Data Storer迁移到该目标Data Storer之后,该第一备份节点删除该快照文件,该目标Data Storer将该VM磁盘文件和该Delta VM磁盘文件合并。Optionally, after the first backup node migrates the VM disk file and the Delta VM disk file from the temporary Data Storer to the target Data Storer, the first backup node deletes the snapshot file, and the target Data Storer The VM disk file is merged with the Delta VM disk file.
本申请实施例提供的技术方案中,可以有效的节省存储空间。
In the technical solution provided by the embodiment of the present application, the storage space can be effectively saved.
第二方面,本申请实施例提供了一种备份服务器,该备份服务器具有实现上述方法中备份服务器的功能。该功能可以通过硬件实现,也可以通过硬件执行相应的软件实现。该硬件或软件包括一个或多个与上述功能相对应的模块。该备份服务器包括:In a second aspect, the embodiment of the present application provides a backup server, which has the function of implementing the backup server in the foregoing method. This function can be implemented in hardware or in hardware by executing the corresponding software. The hardware or software includes one or more modules corresponding to the functions described above. The backup server includes:
该第一备份节点,用于将备份数据虚拟为块存储设备,并根据该备份数据携带的虚拟机的规格创建目标虚拟机;为该块存储设备标识全球标识名称WWN;The first backup node is configured to virtualize the backup data as a block storage device, and create a target virtual machine according to the specification of the virtual machine carried in the backup data; and identify the global identifier name WWN for the block storage device;
该管理节点,用于获取并保存该目标虚拟机的标识和该WWN;当确定该即时恢复任务发生故障时,向该第二备份节点发送执行该即时恢复任务的执行指令;The management node is configured to acquire and save the identifier of the target virtual machine and the WWN; when it is determined that the instant recovery task fails, send an execution instruction for executing the instant recovery task to the second backup node;
该第二备份节点,用于获取临时数据存储Data Storer的标识,该WWN和该目标虚拟机的标识,该临时Data Storer为预先设置;将该备份数据虚拟为该块存储设备,并为该块存储设备标识该WWN;根据该块存储设备,该临时Data Storer的标识以及该目标虚拟机的标识执行该即时恢复任务。The second backup node is configured to obtain an identifier of the temporary data storage Data Storer, the WWN and an identifier of the target virtual machine, where the temporary Data Storer is preset; the backup data is virtualized as the block storage device, and is the block The storage device identifies the WWN; and according to the block storage device, the identifier of the temporary Data Storer and the identifier of the target virtual machine perform the instant recovery task.
第三方面,本申请实施例提供一种计算机存储介质,该计算机存储介质中存储有程序代码,该程序代码用于指示执行上述第一方面或第二方面的方法。In a third aspect, an embodiment of the present application provides a computer storage medium, where the program storage code is stored in the computer storage medium, and the program code is used to indicate that the method of the first aspect or the second aspect is performed.
从以上技术方案可以看出,本申请实施例具有以下优点:该第二备份节点与该第一备份节点为块存储设备标识相同的WWN,即该第二备份节点与该第一备份节点使用的块存储设备相同,同时该第二备份节点与该第一备份节点使用相同的临时Data Storer和目标虚拟机,因此该第二备份节点在执行即时恢复任务时,可以保证在该第一备份节点的基础上继续执行该即时恢复任务,即保证可以断点续传。As can be seen from the foregoing technical solutions, the embodiment of the present application has the following advantages: the second backup node and the first backup node are the same WWN as the block storage device identifier, that is, the second backup node and the first backup node are used. The block storage device is the same, and the second backup node uses the same temporary Data Storer and the target virtual machine as the first backup node, so the second backup node can guarantee the first backup node when performing the instant recovery task. On the basis of this instant recovery task, that is, to ensure that the resume can be resumed.
为了更清楚地说明本发明实施例的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍。In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings to be used in the description of the embodiments will be briefly described below.
图1为本申请实施例中数据处理方法的系统框架图;1 is a system framework diagram of a data processing method in an embodiment of the present application;
图2为本申请实施例中数据处理方法的一个实施例示意图;2 is a schematic diagram of an embodiment of a data processing method in an embodiment of the present application;
图3为本申请实施例中备份服务器的一个实施例示意图。FIG. 3 is a schematic diagram of an embodiment of a backup server in an embodiment of the present application.
下面将结合附图,对本发明实施例中的技术方案进行清楚、完整地描述。The technical solutions in the embodiments of the present invention will be clearly and completely described in the following with reference to the accompanying drawings.
本申请实施例提供了一种数据处理方法以及备份服务器,用于在即时恢复任务在进行切换之后,可以保证数据断点续传。The embodiment of the present application provides a data processing method and a backup server, which can be used to ensure data breakpoint retransmission after the instant recovery task is switched.
本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”、“第四”等(如果存在)是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的实施例能够以除了在这里图示或描述的内容以外的顺序实施。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。The terms "first", "second", "third", "fourth", etc. (if present) in the specification and claims of the present application and the above figures are used to distinguish similar objects without having to use To describe a specific order or order. It is to be understood that the data so used may be interchanged where appropriate so that the embodiments described herein can be implemented in a sequence other than what is illustrated or described herein. In addition, the terms "comprises" and "comprises" and "the" and "the" are intended to cover a non-exclusive inclusion, for example, a process, method, system, product, or device that comprises a series of steps or units is not necessarily limited to Those steps or units may include other steps or units not explicitly listed or inherent to such processes, methods, products or devices.
请参考图1所示的数据处理系统框架图,该数据处理系统框架中包括备份服务器,备份存储,生产环境,以及生产存储。其中,备份服务器包括管理节点,第一备份节点,第二备份节点,第三备份节点。可以理解的是,该备份服务器可以包括多个备份节点,不仅仅是图中所画出的三个备份节点。各个备份节点为数据处理系统中的备份执行节点,提供备份恢复任务执行功能。该管理节点提供数据处理系统的备份管理和系统管理等功
能;同时负责数据处理系统中备份恢复任务的调度,提供任务调度负载均衡和故障切换能力。备份存储负责存储生产环境中虚拟机的备份数据。生产环境负责承载用户的生产业务,通常采用虚拟化基础设施架构,即包括主机以及主机上的多个虚拟机。生产存储负责存储生产环境中生产业务数据。Please refer to the data processing system framework diagram shown in FIG. 1. The data processing system framework includes a backup server, a backup storage, a production environment, and a production storage. The backup server includes a management node, a first backup node, a second backup node, and a third backup node. It can be understood that the backup server can include multiple backup nodes, not just the three backup nodes drawn in the figure. Each backup node is a backup execution node in the data processing system, and provides a backup recovery task execution function. The management node provides backup management and system management of the data processing system.
Can also be responsible for the scheduling of backup and recovery tasks in the data processing system, providing task scheduling load balancing and failover capabilities. The backup storage is responsible for storing backup data for virtual machines in the production environment. The production environment is responsible for carrying the user's production business, usually using a virtualized infrastructure, that is, including the host and multiple virtual machines on the host. The production store is responsible for storing production business data in the production environment.
该备份服务器中的各个备份节点采用多节点分布式架构,可靠性上具备任务Failover机制,即当前备份节点上任务失败后,该任务会自动切换到另一个备份节点上重新执行。而目前的虚拟机即时恢复技术中,该备份节点上模拟出的NFS共享,即对外提供NFS共享服务的地址为备份节点的互联网协议(英文全称:Internet Protocol,简称:IP)地址。一旦发生备份任务的故障切换,即备份任务自身的执行失败故障,之前的NFS共享服务会中断。这样会导致在即时恢复任务故障后,切换到另外一个备份节点重新执行后,之前的即时恢复任务已经传输的恢复数据不支持断点续传,只能全部重新重头开始恢复。Each backup node in the backup server adopts a multi-node distributed architecture, and has a reliability Failover mechanism. That is, after the task on the current backup node fails, the task is automatically switched to another backup node for re-execution. In the current virtual machine instant recovery technology, the NFS share simulated on the backup node, that is, the address of the external NFS sharing service is the Internet protocol (English full name: Internet Protocol, IP address) of the backup node. In the event of a failover of a backup task, that is, a failure of the backup task itself, the previous NFS share service is interrupted. This will result in the recovery of the instant recovery task, after switching to another backup node to re-execute, the recovery data that has been transmitted by the previous instant recovery task does not support the resume of the breakpoint, and only all of them can be resumed.
为了解决这一问题,本申请实施例提供了如下解决方案:该第一备份节点将备份数据虚拟为块存储设备,并根据该备份数据携带的虚拟机的规格创建目标虚拟机;该第一备份节点为该备份数据虚拟生成的块存储设备标识WWN;该管理节点获取并保存该目标虚拟机的标识和该WWN;在该备份服务器运行期间,当该管理节点确定该即时恢复任务发生故障时,该管理节点向该第二备份节点发送执行该即时恢复任务的执行指令;该第二备份节点在接收到该执行指令之后,该第二备份节点获取临时数据存储Data Storer的标识、该WWN和该目标虚拟机的标识,该临时Data Storer为预告设置;该第二备份节点将该备份数据虚拟为该块存储设备,并为该块存储设备标识该WWN;该第二备份节点根据该块存储设备、该临时Data Storer的标识以及该目标虚拟机的标识执行该即时恢复任务。In order to solve this problem, the embodiment of the present application provides the following solution: the first backup node virtualizes the backup data into a block storage device, and creates a target virtual machine according to the specifications of the virtual machine carried in the backup data; the first backup a block storage device identifier WWN that is generated by the node for the backup data; the management node acquires and saves the identifier of the target virtual machine and the WWN; and when the backup node determines that the instant recovery task fails during the backup server operation, The management node sends an execution instruction for executing the instant recovery task to the second backup node; after receiving the execution instruction, the second backup node acquires the identifier of the temporary data storage Data Storer, the WWN, and the An identifier of the target virtual machine, the temporary Data Storer is set as a preview; the second backup node virtualizes the backup data as the block storage device, and identifies the WWN for the block storage device; the second backup node is according to the block storage device The identifier of the temporary Data Storer and the identifier of the target virtual machine perform the instant recovery .
具体请参阅图2所示,本申请实施例中一种数据处理方法的一个实施例,包括:For example, as shown in FIG. 2, an embodiment of a data processing method in the embodiment of the present application includes:
201、第一备份节点将备份数据虚拟为块存储设备,并根据该备份数据携带的虚拟机的规格创建目标虚拟机。201. The first backup node virtualizes the backup data into a block storage device, and creates a target virtual machine according to the specifications of the virtual machine carried in the backup data.
该第一备份节点作为当前即时恢复任务的执行节点,在接收到执行虚拟机即时恢复任务的指令之后,该第一备份节点从备份存储中获取到备份数据,并将获取到的该备份数据虚拟为块存储设备;另外该第一备份节点根据该备份数据中携带的虚拟机的规格创建一个新的目标虚拟机。该虚拟机的规格包括CPU型号,内存的大小以及硬盘的大小。比如该备份数据中携带的虚拟机的规格为CPU为2核,内存为3.5千兆字节(英文全称:gigabyte,简称:GB),硬盘为500GB,则该第一备份节点创建的该目标虚拟机的规格为CPU为2核,内存为3.5GB,硬盘为500GB。The first backup node is used as an execution node of the current instant recovery task. After receiving the instruction to execute the virtual machine instant recovery task, the first backup node obtains backup data from the backup storage, and virtualizes the acquired backup data. A block storage device; in addition, the first backup node creates a new target virtual machine according to the specifications of the virtual machine carried in the backup data. The specifications of the virtual machine include the CPU model, the size of the memory, and the size of the hard disk. For example, the virtual machine carried in the backup data has a CPU of 2 cores, a memory of 3.5 gigabytes (English name: gigabyte, abbreviated as GB), and a hard disk of 500 GB, the target virtual node created by the first backup node. The specifications of the machine are 2 cores for the CPU, 3.5 GB for the memory, and 500 GB for the hard disk.
在实际应用中,该第一备份节点可以基于开源软件tgt、lio或scst将该备份数据虚拟为块存储设备,具体采用何种方式,此处不做限定。In an actual application, the first backup node may virtualize the backup data as a block storage device based on the open source software tgt, lio or scst, and the specific manner is not limited herein.
可以理解的是,本申请实施例中,该第一备份节点在获取该备份数据之前,该备份服务器从备份存储中确定备份数据,并选择用于存储临时数据的临时数据存储Data Storer和用于恢复虚拟机的目标Data Storer。该临时Data Storer的标识和该目标Data Storer的标识预先存储在该备份服务器的管理节点。该备份服务器的管理节点通过负载均衡机制确定首先执行即时恢复任务的该第一备份节点,并向该第一备份节点发送执行即时恢复任务的指令。该第一备份节点获取该备份服务器确定的备份数据的元数据进行校验,在校验通过之后,该第一备份节点才可以获取到该备份数据。比如,该备份存储中存在备
份数据A,备份数据B,备份数据C,该备份数据A携带的虚拟机的规格为默认规格;该备份服务器中有第一备份节点,第二备份节点,第三备份节点。若该备份服务器需要进行即时恢复任务,且该备份服务器确定备份数据A作为即时恢复的备份数据,在生产存储空间中确定了临时Data Storer的地址以及目标Data Storer的地址。该管理节点在确定该第一备份节点作为执行该即时恢复任务的执行节点之后,该第一备份节点会获取该临时Data Storer的地址和该目标Data Storer的地址;该第一备份节点也将获取该备份数据A的元数据并进行完整性校验。若该第一备份节点确定该备份数据A完整,则该第一备份节点获取该备份数据A。该第一备份节点根据该备份数据A携带的虚拟机的规格(即默认规格)在生产环境创建一个目标虚拟机,该目标虚拟机的规格为默认规格。该第一备份节点将该备份数据A虚拟为块存储设备A。It can be understood that, in the embodiment of the present application, before the first backup node acquires the backup data, the backup server determines backup data from the backup storage, and selects a temporary data storage Data Storer for storing temporary data and is used for Restore the target Data Storer of the virtual machine. The identifier of the temporary Data Storer and the identifier of the target Data Storer are pre-stored in the management node of the backup server. The management node of the backup server determines, by the load balancing mechanism, the first backup node that first performs an immediate recovery task, and sends an instruction to the first backup node to perform an immediate recovery task. The first backup node obtains the metadata of the backup data determined by the backup server for verification, and the first backup node can obtain the backup data after the verification is passed. For example, there is a backup in the backup storage.
The data A, the backup data B, and the backup data C. The specifications of the virtual machine carried in the backup data A are default specifications; the backup server has a first backup node, a second backup node, and a third backup node. If the backup server needs to perform an instant recovery task, and the backup server determines the backup data A as the backup data of the instant recovery, the address of the temporary Data Storer and the address of the target Data Storer are determined in the production storage space. After the management node determines that the first backup node is the execution node that performs the instant recovery task, the first backup node acquires the address of the temporary Data Storer and the address of the target Data Storer; the first backup node also acquires The metadata of the backup data A is checked for integrity. If the first backup node determines that the backup data A is complete, the first backup node acquires the backup data A. The first backup node creates a target virtual machine in the production environment according to the specification of the virtual machine (that is, the default specification) carried in the backup data A, and the specification of the target virtual machine is a default specification. The first backup node virtualizes the backup data A as the block storage device A.
202、该第一备份节点为该块存储设备标识WWN。202. The first backup node is the block storage device identifier WWN.
该第一备份节点在将备份数据虚拟为该块存储设备之后,为该块存储设备标注WWN。After the first backup node virtualizes the backup data as the block storage device, the WWN is marked for the block storage device.
本申请实施例中,该第一备份节点会给块存储设备A标注WWN。In the embodiment of the present application, the first backup node labels the block storage device A with a WWN.
203、该第一备份节点将该WWN和该目标虚拟机的标识发送给该管理节点。203. The first backup node sends the identifier of the WWN and the target virtual machine to the management node.
该第一备份节点将块存储设备的WWN与该第一备份节点创建的目标虚拟机的标识发送给该管理节点。The first backup node sends the WWN of the block storage device and the identifier of the target virtual machine created by the first backup node to the management node.
本申请实施例中,该第一备份节点将块存储设备A的WWN和该目标虚拟机的标识发送给该管理节点。In the embodiment of the present application, the first backup node sends the WWN of the block storage device A and the identifier of the target virtual machine to the management node.
在实际的正常的即时恢复任务中,该第一备份节点在创建好该目标虚拟机之后,该第一备份节点就可以将该块存储设备以原始设备映射的方式挂载在该目标虚拟机上进行虚拟机的即时恢复任务,同时该第一备份节点将产生的临时数据生成虚拟机磁盘文件并将该虚拟机磁盘文件存储在该临时Data Storer中;然后该第一备份节点将该虚拟机磁盘文件迁移到目标Data Storer进行存储,从而完成即时恢复任务。可选的,该第一备份节点还可以将该目标虚拟机中的数据通过快照技术生成快照文件,并根据该临时Data Storer的标识进行存储,生成为变更虚拟机磁盘文件,然后将该变更虚拟机磁盘文件迁移到目标目标Data Storer进行存储。可选的,该第一备份节点也可以在迁移完成之后将生成的快照文件进行删除。在实际应用中,该快照文件可以删除也可以不删除,具体情况此处不做限定。In the actual normal instant recovery task, after the first backup node creates the target virtual machine, the first backup node can mount the block storage device on the target virtual machine in a raw device mapping manner. Performing an instant recovery task of the virtual machine, and the first backup node generates temporary virtual data to generate a virtual machine disk file and stores the virtual machine disk file in the temporary data storer; then the first backup node uses the virtual machine disk The files are migrated to the target Data Storer for storage, completing the instant recovery task. Optionally, the first backup node may further generate the snapshot file by using the snapshot technology in the data of the target virtual machine, and store the data according to the identifier of the temporary data storer, generate the virtual machine disk file, and then virtualize the change. The machine disk files are migrated to the target destination Data Storer for storage. Optionally, the first backup node may also delete the generated snapshot file after the migration is completed. In the actual application, the snapshot file may or may not be deleted.
204、该管理节点将该WWN和该目标虚拟机的标识进行保存。204. The management node saves the identifier of the WWN and the target virtual machine.
该管理节点在接收到该WWN和该目标虚拟机的标识之后,将该WWN与该目标虚拟机的标识进行保存。After receiving the identifier of the WWN and the target virtual machine, the management node saves the WWN and the identifier of the target virtual machine.
205、当该管理节点确定该即时恢复任务出现故障时,该管理节点向第二备份节点发送执行该即时恢复任务的指令。205. When the management node determines that the instant recovery task fails, the management node sends an instruction to perform the immediate recovery task to the second backup node.
该管理节点在实际运行期间将会定期的监控该即时恢复任务的进度和实时状态,若该管理节点检测到该即时恢复任务的实时状态显示该即时恢复任务出现故障(比如该第一备份节点掉电、重启等或者访问备份存储失败、从生产环境读取数据失败等),则该管理节点通过负载均衡机制确定该第二备份节点为执行该即时恢复任务的执行节点,并向该第二备份节点发送执行该即时恢复任务的指令。The management node periodically monitors the progress and real-time status of the instant recovery task during actual operation. If the management node detects that the real-time status of the instant recovery task indicates that the instant recovery task is faulty (for example, the first backup node is down) If the power, the restart, or the like fails to access the backup storage, fails to read data from the production environment, and the like, the management node determines, by the load balancing mechanism, the second backup node as an execution node that performs the instant recovery task, and sends the second backup to the second backup. The node sends an instruction to perform the instant recovery task.
206、该管理节点向该第二备份节点发送该WWN和该目标虚拟机的标识,以及临时
Data Storer的标识。206. The management node sends the WWN and the identifier of the target virtual machine to the second backup node, and temporarily
The identity of the Data Storer.
该管理节点在确定了该第二备份节点为该即时恢复任务的执行节点之后,该管理节点向该第二备份节点发送该WWN和该临时Data Storer的标识。After the management node determines that the second backup node is the execution node of the instant recovery task, the management node sends the identifier of the WWN and the temporary Data Storer to the second backup node.
207、该第二备份节点将该备份数据虚拟为该块存储设备,并为该块存储设备标识该WWN。207. The second backup node virtualizes the backup data as the block storage device, and identifies the WWN for the block storage device.
该第二备份节点在接收到该管理节点发送的执行该即时恢复任务的指令之后获取该备份数据,然后该第二备份节点将该备份数据虚拟为该块存储设备,并为该块存储设备标识该WWN。The second backup node acquires the backup data after receiving the instruction sent by the management node to perform the instant recovery task, and then the second backup node virtualizes the backup data as the block storage device, and stores the device identifier for the block. The WWN.
本申请实施例中,该第二备份节点在获取该备份数据之前,该管理节点将该备份数据的信息、该目标虚拟机的标识、该临时Data Storer的标识和该目标Data Storer的标识发送给该第二备份节点。该第二备份节点获取该备份数据的元数据进行校验,在校验通过之后,该第二备份节点才可以获取到该备份数据。比如在该管理节点在确定该第二备份节点作为继续执行该即时恢复任务的执行节点之后,该第二备份节点获取该临时Data Storer的地址和该目标Data Storer的地址;该第二备份节点还获取该备份数据A的元数据并进行完整性校验。若该第二备份节点确定该备份数据A完整,则该第二备份节点获取该备份数据A。该第二备份节点还需要基于开源软件tgt、lio或scst将该备份数据A虚拟为块存储设备A。In the embodiment of the present application, before acquiring the backup data, the management node sends the information of the backup data, the identifier of the target virtual machine, the identifier of the temporary Data Storer, and the identifier of the target Data Storer to the second backup node. The second backup node. The second backup node obtains the metadata of the backup data for verification, and the second backup node can obtain the backup data after the verification is passed. For example, after the management node determines the second backup node as the execution node that continues to execute the instant recovery task, the second backup node acquires the address of the temporary Data Storer and the address of the target Data Storer; the second backup node further Obtain the metadata of the backup data A and perform integrity check. If the second backup node determines that the backup data A is complete, the second backup node acquires the backup data A. The second backup node also needs to virtualize the backup data A as the block storage device A based on the open source software tgt, lio or scst.
208、该第二备份节点利用该块存储设备、该临时Data Storer的标识和该目标虚拟机的标识执行该即时恢复任务。208. The second backup node performs the instant recovery task by using the block storage device, the identifier of the temporary Data Storer, and the identifier of the target virtual machine.
该第二备份节点获取该块存储设备之后,该第二备份节点利用该目标虚拟机的标识以及该临时Data Storer的标识执行该即时恢复任务。After the second backup node acquires the block storage device, the second backup node performs the instant recovery task by using the identifier of the target virtual machine and the identifier of the temporary Data Storer.
本申请实施例中,该第二备份节点将临时数据存储在该临时Data Storer中,该第二备份节点将该目标虚拟机作为生产环境中的虚拟机进行工作。该第二备份节点在正常执行该即时恢复任务时,执行的步骤与该第一备份节点在正常执行该即时恢复任务的步骤相同,此处不再赘述。In the embodiment of the present application, the second backup node stores temporary data in the temporary Data Storer, and the second backup node operates the target virtual machine as a virtual machine in a production environment. When the second backup node performs the instant recovery task normally, the steps performed are the same as those of the first backup node in performing the instant recovery task normally, and details are not described herein again.
本申请实施例中,该第二备份节点与该第一备份节点为块存储设备标识相同的WWN,即该第二备份节点与该第一备份节点使用的块存储设备相同,同时该第二备份节点与该第一备份节点使用相同的临时Data Storer和目标虚拟机,因此该第二备份节点在执行即时恢复任务时,可以保证在该第一备份节点的基础上继续执行该即时恢复任务,即保证可以断点续传。In the embodiment of the present application, the second backup node and the first backup node are the same WWN as the block storage device identifier, that is, the second backup node is the same as the block storage device used by the first backup node, and the second backup is The node uses the same temporary data storer and the target virtual machine as the first backup node, so that the second backup node can perform the instant recovery task on the basis of the first backup node when performing the instant recovery task, that is, Guaranteed to resume the breakpoint.
上面对本申请实施例中的数据处理方法进行了描述,下面对本申请实施例中的备份服务器进行描述。The data processing method in the embodiment of the present application is described above. The backup server in the embodiment of the present application is described below.
具体请参阅图3,本申请实施例中的备份服务器300的一个实施例,包括:该第一备份节点301,用于将备份数据虚拟为块存储设备,并根据该备份数据携带的虚拟机的规格创建目标虚拟机;为该块存储设备标识全球标识名称WWN;Referring to FIG. 3, an embodiment of the backup server 300 in the embodiment of the present application includes: the first backup node 301, configured to virtualize backup data as a block storage device, and according to the virtual machine carried by the backup data. The specification creates a target virtual machine; identifies the global identifier name WWN for the block storage device;
该管理节点302,用于获取并保存该目标虚拟机的标识和该WWN;当确定该即时恢复任务发生故障时,向该第二备份节点发送执行该即时恢复任务的执行指令;The management node 302 is configured to acquire and save the identifier of the target virtual machine and the WWN; when it is determined that the instant recovery task fails, send an execution instruction for executing the instant recovery task to the second backup node;
该第二备份节点303,用于获取临时数据存储Data Storer的标识,该WWN和该目标虚拟机的标识,该临时Data Storer为预先设置;将该备份数据虚拟为该块存储设备,并为该块存储设备标识该WWN;根据该块存储设备,该临时Data Storer的标识以及该
目标虚拟机的标识执行该即时恢复任务。The second backup node 303 is configured to obtain an identifier of the temporary data storage Data Storer, the WWN and an identifier of the target virtual machine, where the temporary Data Storer is preset; the backup data is virtualized as the block storage device, and The block storage device identifies the WWN; according to the block storage device, the identifier of the temporary Data Storer and the
The identity of the target virtual machine performs the instant recovery task.
可选的,所述第一备份节点301,还用于将所述块存储设备以原始设备映射RDM的方式挂载给所述目标虚拟机,并在所述临时Data Storer生成虚拟机VM磁盘文件;将所述VM磁盘文件由所述临时Data Storer迁移到目标数据存储Data Storer,所述目标Data Storer为预先设置。Optionally, the first backup node 301 is further configured to mount the block storage device to the target virtual machine in an original device mapping RDM manner, and generate a virtual machine VM disk file in the temporary data storer. Transferring the VM disk file from the temporary Data Storer to a target data store Data Storer, the target Data Storer being preset.
可选的,所述第一备份节点301,还用于利用快照技术为所述目标虚拟机生成快照文件,并在所述临时Data Storer生成变更虚拟机Delta VM磁盘文件;将所述Delta VM磁盘文件由所述临时Data Storer迁移到所述目标Data Storer。Optionally, the first backup node 301 is further configured to generate a snapshot file for the target virtual machine by using a snapshot technology, and generate a change virtual machine Delta VM disk file in the temporary Data Storer; and the Delta VM disk is The file is migrated by the temporary Data Storer to the target Data Storer.
可选的,所述第一备份节点301,还用于将所述块存储设备以原始设备映射RDM的方式挂载给所述目标虚拟机,并在所述临时Data Storer生成虚拟机VM磁盘文件;利用快照技术为所述目标虚拟机生成快照文件,并在所述临时Data Storer生成变更虚拟机Delta VM磁盘文件;将所述VM磁盘文件和所述Delta VM磁盘文件由所述临时Data Storer迁移到所述目标Data Storer。Optionally, the first backup node 301 is further configured to mount the block storage device to the target virtual machine in an original device mapping RDM manner, and generate a virtual machine VM disk file in the temporary data storer. Generating a snapshot file for the target virtual machine by using a snapshot technology, and generating a change virtual machine Delta VM disk file in the temporary Data Storer; migrating the VM disk file and the Delta VM disk file from the temporary Data Storer Go to the target Data Storer.
可选的,所述第一备份节点,还用于删除所述快照文件。Optionally, the first backup node is further configured to delete the snapshot file.
本申请实施例中,该第二备份节点303与该第一备份节点301为块存储设备标识相同的WWN,即该第二备份节点303与该第一备份节点301使用的块存储设备相同,同时该第二备份节点303与该第一备份节点301使用相同的临时Data Storer和目标虚拟机,因此该第二备份节点303在执行即时恢复任务时,可以保证在该第一备份节点301的基础上继续执行该即时恢复任务,即保证可以断点续传。In the embodiment of the present application, the second backup node 303 and the first backup node 301 are the same WWN as the block storage device identifier, that is, the second backup node 303 is the same as the block storage device used by the first backup node 301. The second backup node 303 and the first backup node 301 use the same temporary data storer and the target virtual machine, so the second backup node 303 can ensure that the first backup node 301 is based on the first backup node 301. Continue to perform the instant recovery task, that is, to ensure that the resume can be resumed.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the system, the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.
在本申请所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided by the present application, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,
Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application, in essence or the contribution to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, and a read only memory (ROM,
Read-Only Memory), random access memory (RAM), disk or optical disk, and other media that can store program code.
以上所述,以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。
The above embodiments are only used to explain the technical solutions of the present application, and are not limited thereto; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still The technical solutions described in the embodiments are modified, or the equivalents of the technical features are replaced by the equivalents. The modifications and substitutions of the embodiments do not depart from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims (10)
- 一种数据处理方法,其特征在于,运行于备份服务器,所述备份服务器包括管理节点,第一备份节点,第二备份节点;所述第一备份节点为正在执行即时恢复任务的执行节点,所述第二备份节点为在所述即时恢复任务发生故障后,继续执行所述即时恢复任务的执行节点,所述方法包括:A data processing method, characterized in that it runs on a backup server, the backup server includes a management node, a first backup node, and a second backup node; the first backup node is an execution node that is performing an immediate recovery task, The second backup node is an execution node that continues to execute the instant recovery task after the instant recovery task fails. The method includes:所述第一备份节点将备份数据虚拟为块存储设备,并根据所述备份数据携带的虚拟机的规格创建目标虚拟机;The first backup node virtualizes the backup data into a block storage device, and creates a target virtual machine according to the specifications of the virtual machine carried in the backup data;所述第一备份节点为所述块存储设备标识全球标识名称WWN;The first backup node identifies the global identifier name WWN for the block storage device;所述管理节点获取并保存所述目标虚拟机的标识和所述WWN;The management node acquires and saves an identifier of the target virtual machine and the WWN;当所述管理节点确定所述即时恢复任务发生故障时,所述管理节点向所述第二备份节点发送执行所述即时恢复任务的执行指令;When the management node determines that the instant recovery task fails, the management node sends an execution instruction for executing the instant recovery task to the second backup node;所述第二备份节点获取临时数据存储Data Storer的标识、所述WWN和所述目标虚拟机的标识,所述临时Data Storer为预先设置;The second backup node acquires an identifier of the temporary data storage Data Storer, the WWN, and an identifier of the target virtual machine, where the temporary Data Storer is preset;所述第二备份节点将所述备份数据虚拟为所述块存储设备,并为所述块存储设备标识所述WWN;The second backup node virtualizes the backup data as the block storage device, and identifies the WWN for the block storage device;所述第二备份节点根据所述块存储设备、所述临时Data Storer的标识以及所述目标虚拟机的标识执行所述即时恢复任务。The second backup node performs the instant recovery task according to the block storage device, the identifier of the temporary Data Storer, and the identifier of the target virtual machine.
- 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method of claim 1 further comprising:所述第一备份节点将所述块存储设备以原始设备映射RDM的方式挂载给所述目标虚拟机,并在所述临时Data Storer生成虚拟机VM磁盘文件;The first backup node mounts the block storage device to the target virtual machine in an original device mapping RDM manner, and generates a virtual machine VM disk file in the temporary data storer;所述第一备份节点将所述VM磁盘文件由所述临时Data Storer迁移到目标数据存储Data Storer,所述目标Data Storer为预先设置。The first backup node migrates the VM disk file from the temporary Data Storer to a target data store Data Storer, and the target Data Storer is preset.
- 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method of claim 1 further comprising:所述第一备份节点利用快照技术为所述目标虚拟机生成快照文件,并在所述临时Data Storer生成变更虚拟机Delta VM磁盘文件;The first backup node generates a snapshot file for the target virtual machine by using a snapshot technology, and generates a change virtual machine Delta VM disk file in the temporary data storer;所述第一备份节点将所述Delta VM磁盘文件由所述临时Data Storer迁移到所述目标Data Storer。The first backup node migrates the Delta VM disk file from the temporary Data Storer to the target Data Storer.
- 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method of claim 1 further comprising:所述第一备份节点将所述块存储设备以原始设备映射RDM的方式挂载给所述目标虚拟机,并在所述临时Data Storer生成虚拟机VM磁盘文件;The first backup node mounts the block storage device to the target virtual machine in an original device mapping RDM manner, and generates a virtual machine VM disk file in the temporary data storer;所述第一备份节点利用快照技术为所述目标虚拟机生成快照文件,并在所述临时Data Storer生成变更虚拟机Delta VM磁盘文件;The first backup node generates a snapshot file for the target virtual machine by using a snapshot technology, and generates a change virtual machine Delta VM disk file in the temporary data storer;所述第一备份节点将所述VM磁盘文件和所述Delta VM磁盘文件由所述临时Data Storer迁移到所述目标Data Storer。The first backup node migrates the VM disk file and the Delta VM disk file from the temporary Data Storer to the target Data Storer.
- 根据权利要求4所述的方法,其特征在于,所述方法还包括:The method of claim 4, wherein the method further comprises:所述第一备份节点删除所述快照文件。The first backup node deletes the snapshot file.
- 一种备份服务器,其特征在于,包括第一备份节点,第二备份节点,管理节点,所述备份服务器包括:A backup server, comprising: a first backup node, a second backup node, and a management node, where the backup server comprises:所述第一备份节点,用于将备份数据虚拟为块存储设备,并根据所述备份数据携带的虚拟机的规格创建目标虚拟机;为所述块存储设备标识全球标识名称WWN; The first backup node is configured to virtualize the backup data as a block storage device, and create a target virtual machine according to the specification of the virtual machine carried in the backup data; and identify the global identifier name WWN for the block storage device;所述管理节点,用于获取并保存所述目标虚拟机的标识和所述WWN;当确定所述即时恢复任务发生故障时,向所述第二备份节点发送执行所述即时恢复任务的执行指令;The management node is configured to acquire and save the identifier of the target virtual machine and the WWN; and when it is determined that the instant recovery task fails, send an execution instruction to execute the instant recovery task to the second backup node. ;所述第二备份节点,用于获取临时数据存储Data Storer的标识,所述WWN和所述目标虚拟机的标识,所述临时Data Storer为预先设置;将所述备份数据虚拟为所述块存储设备,并为所述块存储设备标识所述WWN;根据所述块存储设备,所述临时Data Storer的标识以及所述目标虚拟机的标识执行所述即时恢复任务。The second backup node is configured to acquire an identifier of the temporary data storage Data Storer, the identifier of the WWN and the target virtual machine, the temporary Data Storer is preset; and the backup data is virtualized as the block storage And identifying, by the block storage device, the WWN; performing, according to the block storage device, an identifier of the temporary Data Storer and an identifier of the target virtual machine.
- 根据权利要求6所述的备份服务器,其特征在于,A backup server according to claim 6 wherein:所述第一备份节点,还用于将所述块存储设备以原始设备映射RDM的方式挂载给所述目标虚拟机,并在所述临时Data Storer生成虚拟机VM磁盘文件;将所述VM磁盘文件由所述临时Data Storer迁移到目标数据存储Data Storer,所述目标Data Storer为预先设置。The first backup node is further configured to mount the block storage device to the target virtual machine in an original device mapping RDM manner, and generate a virtual machine VM disk file in the temporary data storer; The disk file is migrated by the temporary Data Storer to the target data store Data Storer, and the target Data Storer is preset.
- 根据权利要求6所述的备份服务器,其特征在于,A backup server according to claim 6 wherein:所述第一备份节点,还用于利用快照技术为所述目标虚拟机生成快照文件,并在所述临时Data Storer生成变更虚拟机Delta VM磁盘文件;将所述Delta VM磁盘文件由所述临时Data Storer迁移到所述目标Data Storer。The first backup node is further configured to generate a snapshot file for the target virtual machine by using a snapshot technology, and generate a change virtual machine Delta VM disk file in the temporary Data Storer; and use the Delta VM disk file by the temporary The Data Storer migrates to the target Data Storer.
- 根据权利要求6所述的备份服务器,其特征在于A backup server according to claim 6 wherein所述第一备份节点,还用于将所述块存储设备以原始设备映射RDM的方式挂载给所述目标虚拟机,并在所述临时Data Storer生成虚拟机VM磁盘文件;利用快照技术为所述目标虚拟机生成快照文件,并在所述临时Data Storer生成变更虚拟机Delta VM磁盘文件;将所述VM磁盘文件和所述Delta VM磁盘文件由所述临时Data Storer迁移到所述目标Data Storer。The first backup node is further configured to mount the block storage device to the target virtual machine in an original device mapping RDM manner, and generate a virtual machine VM disk file in the temporary data storer; Generating, by the target virtual machine, a snapshot file, and generating a change virtual machine Delta VM disk file in the temporary data storer; migrating the VM disk file and the Delta VM disk file from the temporary Data Storer to the target data Storer.
- 根据权利要求9所述的备份服务器,其特征在于,A backup server according to claim 9, wherein所述第一备份节点,还用于删除所述快照文件。 The first backup node is further configured to delete the snapshot file.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610875338.0A CN106528327B (en) | 2016-09-30 | 2016-09-30 | A kind of data processing method and backup server |
CN201610875338.0 | 2016-09-30 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018058942A1 true WO2018058942A1 (en) | 2018-04-05 |
Family
ID=58333004
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2017/081070 WO2018058942A1 (en) | 2016-09-30 | 2017-04-19 | Data processing method and backup server |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN106528327B (en) |
WO (1) | WO2018058942A1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111585806A (en) * | 2020-04-30 | 2020-08-25 | 南通凡肯电子设备研发有限公司 | Control system and control method for double-host communication |
CN112181583A (en) * | 2019-07-05 | 2021-01-05 | 中国电信股份有限公司 | Virtualization management system, method, and computer-readable storage medium |
CN112380062A (en) * | 2020-11-17 | 2021-02-19 | 上海英方软件股份有限公司 | Method and system for rapidly recovering system for multiple times based on system backup point |
CN114168267A (en) * | 2021-12-15 | 2022-03-11 | 上海英方软件股份有限公司 | A method and device for file recovery based on virtual machine backup data |
Families Citing this family (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106528327B (en) * | 2016-09-30 | 2019-06-21 | 华为技术有限公司 | A kind of data processing method and backup server |
CN108052419B (en) * | 2018-01-05 | 2021-10-26 | 哈尔滨学院 | Data disaster tolerance method |
CN110058961B (en) * | 2018-01-18 | 2023-05-05 | 伊姆西Ip控股有限责任公司 | Method and apparatus for managing storage system |
CN110209537B (en) * | 2018-02-28 | 2020-09-11 | 杭州海康威视系统技术有限公司 | Video data processing method, device and system and electronic equipment |
CN109189550A (en) * | 2018-08-03 | 2019-01-11 | 广州竞德信息技术有限公司 | A kind of control method of virtualized server |
CN110858791A (en) * | 2018-08-22 | 2020-03-03 | 华为技术有限公司 | Distributed parallel transmission method, device, equipment and storage medium |
CN111198784B (en) * | 2018-11-16 | 2024-04-23 | 杭州海康威视系统技术有限公司 | Data storage method and device |
CN112416652B (en) * | 2019-08-22 | 2024-11-29 | 华为技术有限公司 | Data backup method and data backup |
CN111722880B (en) * | 2020-05-11 | 2024-02-09 | 深圳市共进电子股份有限公司 | Equipment production method and device, terminal equipment and medium |
CN113778744B (en) * | 2021-01-05 | 2024-06-18 | 北京沃东天骏信息技术有限公司 | Task processing method, device, system and storage medium |
CN113190371B (en) * | 2021-05-18 | 2024-04-05 | 京东科技信息技术有限公司 | Task compensation method and device, electronic equipment and readable storage medium |
CN114546601A (en) * | 2022-03-17 | 2022-05-27 | 阿里巴巴(中国)有限公司 | Virtual machine management method and device |
CN117093542A (en) * | 2023-08-31 | 2023-11-21 | 济南浪潮数据技术有限公司 | Metadata snapshot rollback method, system, equipment and storage medium |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101539873A (en) * | 2009-04-15 | 2009-09-23 | 成都市华为赛门铁克科技有限公司 | Data recovery method, data node and distributed file system |
CN103516736A (en) * | 2012-06-20 | 2014-01-15 | 中兴通讯股份有限公司 | Data recovery method of distributed cache system and a data recovery device of distributed cache system |
CN105446982A (en) * | 2014-06-30 | 2016-03-30 | 国际商业机器公司 | Data storage system management method and device |
CN106528327A (en) * | 2016-09-30 | 2017-03-22 | 华为技术有限公司 | Data processing method and backup server |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030200247A1 (en) * | 2002-02-02 | 2003-10-23 | International Business Machines Corporation | Server computer and a method for accessing resources from virtual machines of a server computer via a fibre channel |
CN1306777C (en) * | 2004-10-18 | 2007-03-21 | 北京首信股份有限公司 | Method for realizing seamless changing of master and spare service module |
CN102594849B (en) * | 2011-01-06 | 2015-05-20 | 阿里巴巴集团控股有限公司 | Data backup and recovery method and device, virtual machine snapshot deleting and rollback method and device |
CN103001987B (en) * | 2011-09-16 | 2016-05-25 | 中国移动通信集团公司 | A kind of data processing method and data processing node |
CN109558273B (en) * | 2014-11-21 | 2022-06-14 | 华为技术有限公司 | Disk array backup method, electronic equipment and disk array |
-
2016
- 2016-09-30 CN CN201610875338.0A patent/CN106528327B/en active Active
-
2017
- 2017-04-19 WO PCT/CN2017/081070 patent/WO2018058942A1/en active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101539873A (en) * | 2009-04-15 | 2009-09-23 | 成都市华为赛门铁克科技有限公司 | Data recovery method, data node and distributed file system |
CN103516736A (en) * | 2012-06-20 | 2014-01-15 | 中兴通讯股份有限公司 | Data recovery method of distributed cache system and a data recovery device of distributed cache system |
CN105446982A (en) * | 2014-06-30 | 2016-03-30 | 国际商业机器公司 | Data storage system management method and device |
CN106528327A (en) * | 2016-09-30 | 2017-03-22 | 华为技术有限公司 | Data processing method and backup server |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112181583A (en) * | 2019-07-05 | 2021-01-05 | 中国电信股份有限公司 | Virtualization management system, method, and computer-readable storage medium |
CN111585806A (en) * | 2020-04-30 | 2020-08-25 | 南通凡肯电子设备研发有限公司 | Control system and control method for double-host communication |
CN112380062A (en) * | 2020-11-17 | 2021-02-19 | 上海英方软件股份有限公司 | Method and system for rapidly recovering system for multiple times based on system backup point |
CN114168267A (en) * | 2021-12-15 | 2022-03-11 | 上海英方软件股份有限公司 | A method and device for file recovery based on virtual machine backup data |
Also Published As
Publication number | Publication date |
---|---|
CN106528327B (en) | 2019-06-21 |
CN106528327A (en) | 2017-03-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2018058942A1 (en) | Data processing method and backup server | |
US11016857B2 (en) | Microcheckpointing with service processor | |
US9727429B1 (en) | Method and system for immediate recovery of replicated virtual machines | |
US10404795B2 (en) | Virtual machine high availability using shared storage during network isolation | |
US10169173B2 (en) | Preserving management services with distributed metadata through the disaster recovery life cycle | |
US9015121B1 (en) | Unified virtual machine and data storage snapshots | |
US9110693B1 (en) | VM mobility over distance | |
US8521703B2 (en) | Multiple node/virtual input/output (I/O) server (VIOS) failure recovery in clustered partition mobility | |
US8473692B2 (en) | Operating system image management | |
US10656877B2 (en) | Virtual storage controller | |
US10521315B2 (en) | High availability handling network segmentation in a cluster | |
US20150127612A1 (en) | Method and apparatus of managing application workloads on backup and recovery system | |
CN112035293A (en) | Virtual machine cluster backup | |
US8495178B1 (en) | Dynamic bandwidth discovery and allocation to improve performance for backing up data | |
US10402264B2 (en) | Packet-aware fault-tolerance method and system of virtual machines applied to cloud service, computer readable record medium and computer program product | |
US20170024232A1 (en) | Methods and systems for integrating a volume shadow copy service (vss) requester and/or a vss provider with virtual volumes (vvols) | |
US20180101551A1 (en) | Highly available cluster agent for backup and restore operations | |
US20150370657A1 (en) | Protecting virtual machines from network failures | |
CN107402839B (en) | Method and system for backing up data | |
US20200133701A1 (en) | Software service intervention in a computing system | |
US20240134761A1 (en) | Application recovery configuration validation | |
US10970181B2 (en) | Creating distributed storage during partitions | |
US10592133B1 (en) | Managing raw device mapping during disaster recovery | |
US9529679B2 (en) | Volume snapshot in a shared environment | |
CN101876920A (en) | Method for Realizing Virtual Machine Migration on Virtual Platform |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17854400 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17854400 Country of ref document: EP Kind code of ref document: A1 |