[go: up one dir, main page]

CN118585378A - A cloud host concurrent backup method and system based on snapshot - Google Patents

A cloud host concurrent backup method and system based on snapshot Download PDF

Info

Publication number
CN118585378A
CN118585378A CN202410798583.0A CN202410798583A CN118585378A CN 118585378 A CN118585378 A CN 118585378A CN 202410798583 A CN202410798583 A CN 202410798583A CN 118585378 A CN118585378 A CN 118585378A
Authority
CN
China
Prior art keywords
cloud
backup
hard disk
volume
snapshot
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202410798583.0A
Other languages
Chinese (zh)
Inventor
蒋东
叶月仙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aerospace One System Jiangsu Information Technology Co ltd
Original Assignee
Aerospace One System Jiangsu Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aerospace One System Jiangsu Information Technology Co ltd filed Critical Aerospace One System Jiangsu Information Technology Co ltd
Priority to CN202410798583.0A priority Critical patent/CN118585378A/en
Publication of CN118585378A publication Critical patent/CN118585378A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • G06F11/1464Management of the backup or restore process for networked environments
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/11File system administration, e.g. details of archiving or snapshots
    • G06F16/128Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638Organizing or formatting or addressing of data
    • G06F3/064Management of blocks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638Organizing or formatting or addressing of data
    • G06F3/0644Management of space entities, e.g. partitions, extents, pools
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0673Single storage device
    • G06F3/0674Disk device
    • G06F3/0676Magnetic disk device

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Quality & Reliability (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本发明公开了一种基于快照的云主机并发备份方法和系统,包括:获取元数据信息并上传到备份服务器,创建云硬盘快照;通过云硬盘快照创建云硬盘,将云硬盘挂载到备份代理,并添加到映射表;读取映射表后由解析模块识别是否有LVM卷组,若有则添加到设备文件并激活逻辑卷,再检查云硬盘上文件系统和卷组元数据;解析逻辑卷或分区有效数据,生成位图文件,取消激活逻辑卷,并从设备文件移除;备份服务器创建块设备,将有效数据拷贝到对应的块设备,创建块设备快照,卸载并清理云硬盘和云硬盘快照。本发明有效避免了卷组冲突导致的备份失败,也不需要对卷组做重命名操作,优化了系统备份流程,缩短了备份时间,减少了存储占用,提高备份效率。

The present invention discloses a cloud host concurrent backup method and system based on snapshot, including: obtaining metadata information and uploading it to a backup server, creating a cloud hard disk snapshot; creating a cloud hard disk through the cloud hard disk snapshot, mounting the cloud hard disk to a backup agent, and adding it to a mapping table; after reading the mapping table, the parsing module identifies whether there is an LVM volume group, if so, adds it to the device file and activates the logical volume, and then checks the file system and volume group metadata on the cloud hard disk; parses the valid data of the logical volume or partition, generates a bitmap file, cancels the activation of the logical volume, and removes it from the device file; the backup server creates a block device, copies the valid data to the corresponding block device, creates a block device snapshot, and uninstalls and cleans up the cloud hard disk and the cloud hard disk snapshot. The present invention effectively avoids backup failures caused by volume group conflicts, does not need to rename the volume group, optimizes the system backup process, shortens the backup time, reduces storage occupancy, and improves backup efficiency.

Description

一种基于快照的云主机并发备份方法和系统A cloud host concurrent backup method and system based on snapshot

技术领域Technical Field

本发明涉及云主机备份技术领域,尤其涉及一种基于快照的云主机并发备份方法和系统。The present invention relates to the technical field of cloud host backup, and in particular to a snapshot-based cloud host concurrent backup method and system.

背景技术Background Art

云主机备份一般是基于云平台的自身的快照机制来备份,通过定期创建快照,再通过快照创建云硬盘,挂载到备份代理上,由备份代理将云硬盘的数据备份到备份服务器上。目前常见的基于快照备份云主机技术方案有以下两种:方案一是对挂载的云硬盘,不解析文件系统有效数据,而是对云硬盘对应的磁盘设备做全盘备份,这样不需要关心文件系统,也可以避免LVM卷组冲突;方案二是对挂载的云硬盘,统一对云硬盘上的LVM卷组做重命名,加下特定标识如backup,再解析文件系统有效数据来备份。Cloud host backup is generally based on the cloud platform's own snapshot mechanism. Snapshots are created regularly, and cloud hard disks are created from the snapshots and mounted on the backup agent. The backup agent then backs up the cloud hard disk data to the backup server. There are currently two common cloud host backup technology solutions based on snapshots: Solution 1 is to perform a full disk backup of the disk device corresponding to the cloud hard disk without parsing the valid file system data for the mounted cloud hard disk. This way, there is no need to worry about the file system and LVM volume group conflicts can be avoided. Solution 2 is to uniformly rename the LVM volume group on the mounted cloud hard disk, add a specific identifier such as backup, and then parse the valid file system data for backup.

上述方案一,由于是对云硬盘做全量备份,处理并发备份时,不需处理LVM卷组冲突问题。但会备份磁盘上的无效数据,导致备份时间长,占用存储空间大等问题。另外,云快照保证的是崩溃一致性,方案一不能在备份前检查云硬盘文件系统是否正常,以及卷组元数据是否一致。若文件系统或卷组元数据存在问题,则需要在恢复或容灾时,才能发现。上述方案二,由于是统一对云硬盘上的LVM卷组做重命名,再解析有效数据来备份的。这样备份的数据中包含了卷组改名后的元数据,而不是原本的真实数据。故使用该备份数据做恢复或容灾前,需要先挂载到预处理代理上,将卷组名改回原来的名称,即去掉特定标识。若不执行该操作,会导致恢复机或容灾机无法正常启动。另外,方案二也没有在备份前检查云硬盘文件系统是否正常,以及卷组元数据是否一致。若文件系统或卷组元数据存在问题,则会导致备份失败。In the above solution 1, since it is a full backup of the cloud hard disk, there is no need to deal with the LVM volume group conflict problem when handling concurrent backups. However, invalid data on the disk will be backed up, resulting in long backup time and large storage space usage. In addition, cloud snapshots guarantee crash consistency. Solution 1 cannot check whether the cloud hard disk file system is normal and whether the volume group metadata is consistent before backup. If there is a problem with the file system or volume group metadata, it needs to be discovered during recovery or disaster recovery. In the above solution 2, since the LVM volume group on the cloud hard disk is renamed uniformly and then the valid data is parsed for backup. In this way, the backed up data contains the metadata of the renamed volume group, rather than the original real data. Therefore, before using the backup data for recovery or disaster recovery, it is necessary to mount it on the preprocessing agent first and change the volume group name back to the original name, that is, remove the specific identifier. If this operation is not performed, the recovery machine or disaster recovery machine cannot start normally. In addition, Solution 2 does not check whether the cloud hard disk file system is normal and whether the volume group metadata is consistent before backup. If there is a problem with the file system or volume group metadata, the backup will fail.

为此,我们设计出了一种基于快照的云主机并发备份方法和系统来解决以上问题。To this end, we have designed a snapshot-based concurrent backup method and system for cloud hosts to solve the above problems.

发明内容Summary of the invention

本发明的目的是为了解决现有技术中存在的备份磁盘上的无效数据导致备份时间长,占用存储空间大,需要在恢复或容灾时才能发现云硬盘文件系统是否正常,使用该备份数据做恢复或容灾前,需要去掉特定标识,若不执行该操作,会导致恢复机或容灾机无法正常启动,造成备份效率低易出错等缺点,而提出的一种基于快照的云主机并发备份方法和系统,其目的是基于文件系统来解析有效数据的,不会备份无效数据,缩短了备份时间,减少了存储占用;通过对卷组激活和文件系统解析等关键步骤,以及通过设备文件来控制LVM卷组来使用哪些设备,避免了并发备份下,卷组冲突导致的备份失败。The purpose of the present invention is to solve the problems in the prior art that invalid data on the backup disk leads to long backup time and large storage space occupation, and it is necessary to find out whether the cloud hard disk file system is normal during recovery or disaster recovery. Before using the backup data for recovery or disaster recovery, it is necessary to remove the specific identification. If this operation is not performed, the recovery machine or the disaster recovery machine will not be able to start normally, resulting in low backup efficiency and easy errors. A cloud host concurrent backup method and system based on snapshots is proposed, and its purpose is to parse valid data based on the file system, not to back up invalid data, shorten the backup time, and reduce storage occupancy; through key steps such as volume group activation and file system parsing, and through device files to control which devices the LVM volume group uses, backup failures caused by volume group conflicts under concurrent backup are avoided.

为了实现上述目的,本发明采用了如下技术方案:In order to achieve the above object, the present invention adopts the following technical solutions:

一种基于快照的云主机并发备份方法,包括以下步骤:A cloud host concurrent backup method based on snapshots includes the following steps:

步骤1、对所选云主机获取元数据信息并上传到备份服务器,再对云主机的所有云硬盘创建云硬盘快照;Step 1: Get metadata information for the selected cloud host and upload it to the backup server, then create cloud disk snapshots for all cloud disks of the cloud host;

步骤2、通过云硬盘快照创建云硬盘,将云硬盘挂载到备份代理,并添加到映射表;Step 2: Create a cloud disk from the cloud disk snapshot, mount the cloud disk to the backup proxy, and add it to the mapping table;

步骤3、读取映射表,获取一台云主机对应的云硬盘在备份代理上对应的磁盘设备,由解析模块识别是否有LVM卷组,若有则添加到设备文件并激活逻辑卷,再检查云硬盘上文件系统,若文件系统有LVM卷组,则再对卷组元数据做检查;Step 3: Read the mapping table to obtain the disk device corresponding to the cloud hard disk corresponding to a cloud host on the backup proxy. The parsing module identifies whether there is an LVM volume group. If so, add it to the device file and activate the logical volume. Then check the file system on the cloud hard disk. If the file system has an LVM volume group, check the volume group metadata.

步骤4、基于文件系统对云硬盘上的逻辑卷或分区解析有效数据,生成位图文件,有效数据解析成功后,若有LVM卷组则取消激活逻辑卷,并从设备文件移除;Step 4: parse the valid data of the logical volume or partition on the cloud hard disk based on the file system and generate a bitmap file. After the valid data is parsed successfully, if there is an LVM volume group, deactivate the logical volume and remove it from the device file;

步骤5、通知备份服务器创建块设备,备份代理通过云硬盘对应的位图文件将有效数据拷贝到对应的块设备,拷贝完成后,通知备份服务器更新块设备状态,并创建块设备快照,卸载云硬盘并清理云硬盘和云硬盘快照。Step 5: Notify the backup server to create a block device. The backup agent copies the valid data to the corresponding block device through the bitmap file corresponding to the cloud hard disk. After the copy is completed, notify the backup server to update the block device status and create a block device snapshot, unmount the cloud hard disk, and clean up the cloud hard disk and cloud hard disk snapshot.

作为本发明进一步优选的,步骤1中,获取元数据信息和创建云硬盘快照,由备份代理的云平台操作模块通过调用云平台API实现。As a further preferred embodiment of the present invention, in step 1, obtaining metadata information and creating a cloud hard disk snapshot are implemented by the cloud platform operation module of the backup agent by calling a cloud platform API.

作为本发明进一步优选的,步骤2中,一个备份代理备份多台云主机,当前一台云主机对应的云硬盘挂载完成,将云硬盘添加到映射表后,再对后一台云主机对应的云硬盘做挂载;所述映射表是记录云主机、云硬盘以及云硬盘在备份代理上对应的磁盘设备信息的映射表文件。As a further preferred embodiment of the present invention, in step 2, a backup proxy backs up multiple cloud hosts, and when the cloud hard disk corresponding to the current cloud host is mounted, the cloud hard disk is added to the mapping table, and then the cloud hard disk corresponding to the next cloud host is mounted; the mapping table is a mapping table file that records the cloud host, the cloud hard disk, and the disk device information corresponding to the cloud hard disk on the backup proxy.

作为本发明进一步优选的,步骤3中,所述解析模块通过读取磁盘设备或分区上的卷组元数据,或通过分区类型是否为8e来判断是否有LVM卷组;当磁盘设备或分区是物理卷时,将磁盘设备或分区的设备路径添加到设备文件,激活新发现的卷组下的逻辑卷,再通过blkid或lsblk命令获取云硬盘对应的磁盘设备所有的分区和逻辑卷,以及分区和逻辑卷上的文件系统类型,执行对应的文件系统的检查命令,通过检查模块检查文件系统,若存在文件系统错误,则对文件系统进行修复,并告警,若文件系统错误无法修复,则告警并退出,不再执行步骤4;对卷组元数据做检查,检查模块通过调用LVM管理命令检查卷组元数据是否一致,若卷组元数据不一致,则尝试修复,若修复成功,则继续执行步骤4;若修复失败,则退出备份,并告警卷组元数据异常无法修复。As a further preferred embodiment of the present invention, in step 3, the parsing module determines whether there is an LVM volume group by reading the volume group metadata on the disk device or partition, or by whether the partition type is 8e; when the disk device or partition is a physical volume, the device path of the disk device or partition is added to the device file, the logical volume under the newly discovered volume group is activated, and then all the partitions and logical volumes of the disk device corresponding to the cloud hard disk, as well as the file system types on the partitions and logical volumes are obtained through the blkid or lsblk command, and the corresponding file system check command is executed, and the file system is checked through the check module. If there is a file system error, the file system is repaired and an alarm is issued. If the file system error cannot be repaired, an alarm is issued and the system exits, and step 4 is no longer executed; the volume group metadata is checked, and the check module checks whether the volume group metadata is consistent by calling the LVM management command. If the volume group metadata is inconsistent, repair is attempted. If the repair is successful, step 4 is continued; if the repair fails, the backup is exited, and an alarm is issued that the volume group metadata is abnormal and cannot be repaired.

作为本发明进一步优选的,步骤4中,基于文件系统对云硬盘上的逻辑卷或分区解析有效数据时,解析模块查询云硬盘上的逻辑卷或分区上的文件系统类型,调用不同接口来解析对应的文件系统有效数据,并生产bitmap位图文件,解析有效数据成功后,取消激活逻辑卷,并从设备文件移除,再对下一个云硬盘做相同处理。As a further preferred embodiment of the present invention, in step 4, when parsing valid data of the logical volume or partition on the cloud hard disk based on the file system, the parsing module queries the file system type on the logical volume or partition on the cloud hard disk, calls different interfaces to parse the corresponding file system valid data, and generates a bitmap file. After successfully parsing the valid data, the logical volume is deactivated and removed from the device file, and the same process is performed on the next cloud hard disk.

作为本发明进一步优选的,步骤3和步骤4通过并发加锁处理,用来保障并发执行下,每次只有一个新增的卷组被激活,当新增的卷组解析有效数据完成并移除后,再去激活下一个新增的卷组。As a further preferred embodiment of the present invention, steps 3 and 4 are processed by concurrent locking to ensure that only one newly added volume group is activated at a time during concurrent execution. When the newly added volume group has completed parsing of valid data and removed, the next newly added volume group is activated.

作为本发明进一步优选的,步骤5中,所述块设备通过备份服务器中的虚拟块设备管理模块创建,块设备采用虚拟块设备或ceph的rbd块设备,由备份代理中的卷复制模块通过TCP协议或iSCSI协议基于位图文件将有效数据拷贝到对应块设备上,备份代理对于解析好有效数据的云硬盘,同时启动多个进程来并发备份。As a further preferred embodiment of the present invention, in step 5, the block device is created by a virtual block device management module in the backup server, the block device adopts a virtual block device or an rbd block device of Ceph, and the volume replication module in the backup agent copies the valid data to the corresponding block device based on the bitmap file through the TCP protocol or the iSCSI protocol. The backup agent starts multiple processes for concurrent backup of the cloud hard disk that has parsed the valid data.

一种应用于基于快照的云主机并发备份方法的系统,包括备份代理和备份服务器,A system for a concurrent backup method of a cloud host based on snapshots, comprising a backup agent and a backup server.

对于需要备份的云平台,上传镜像,再通过镜像创建所述备份代理,备份代理包括:For the cloud platform that needs to be backed up, upload the image, and then create the backup agent through the image. The backup agent includes:

用于创建云硬盘快照的云平台操作模块;A cloud platform operation module for creating cloud disk snapshots;

用于解析设备是否存在LVM卷组的解析模块;A parsing module used to parse whether a device has an LVM volume group;

用于检查文件系统和卷组元数据的检查模块,所述检查模块对文件系统错误和卷组元数据不一致做修复;A checking module for checking file system and volume group metadata, wherein the checking module repairs file system errors and volume group metadata inconsistencies;

用于将云硬盘中有效数据拷贝到对应的块设备的卷复制模块;A volume replication module for copying valid data in a cloud hard disk to a corresponding block device;

所述备份服务器,提供镜像和一体机两种部署方式,备份服务器包括:The backup server provides two deployment modes: mirroring and all-in-one. The backup server includes:

用于创建块设备的虚拟块设备管理模块,所述虚拟块设备管理模块对备份完成的块设备打快照来标记,创建块设备快照;A virtual block device management module for creating a block device, wherein the virtual block device management module marks the backed-up block device with a snapshot to create a block device snapshot;

用于提供Web界面给用户使用的管理程序。A management program that provides a web interface for users.

作为本发明进一步优选的,所述解析模块负责对LVM卷组的激活、取消激活、设备文件的添加和移除,以及解析分区或逻辑卷上文件系统的有效数据。As a further preferred embodiment of the present invention, the parsing module is responsible for activating and deactivating the LVM volume group, adding and removing device files, and parsing valid data of the file system on the partition or logical volume.

与现有技术相比,本发明的有益效果是:本发明基于文件系统来解析有效数据的,不会备份无效数据,缩短了备份时间,减少了存储占用;通过对云硬盘备份数据挂载,读取磁盘设备或分区上的卷组元数据,来判断是否有LVM卷组,将磁盘设备或分区的设备路径添加到设备文件,激活卷组下的逻辑卷,通过设备文件来控制LVM来使用哪些设备,避免了并发备份下,卷组冲突导致的备份失败,也不需要对卷组做重命名操作,优化了系统备份流程;本发明对云硬盘文件系统以及卷组元数据做检查,保障了备份数据的可靠性和可用性,不会出现使用备份数据恢复或容灾,才发现备份数据不可用。本发明是基于文件系统来解析有效数据的,不会备份无效数据,缩短了备份时间,提高备份效率。Compared with the prior art, the beneficial effects of the present invention are as follows: the present invention parses valid data based on the file system, does not back up invalid data, shortens the backup time, and reduces storage occupancy; by mounting the cloud hard disk backup data, reading the volume group metadata on the disk device or partition, to determine whether there is an LVM volume group, adding the device path of the disk device or partition to the device file, activating the logical volume under the volume group, and controlling which devices to use by the LVM through the device file, avoiding backup failures caused by volume group conflicts under concurrent backups, and does not need to rename the volume group, thereby optimizing the system backup process; the present invention checks the cloud hard disk file system and volume group metadata to ensure the reliability and availability of the backup data, and does not use the backup data for recovery or disaster recovery, only to find that the backup data is unavailable. The present invention parses valid data based on the file system, does not back up invalid data, shortens the backup time, and improves backup efficiency.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

图1为常见云主机LVM卷组结构示意图;Figure 1 is a schematic diagram of a common cloud host LVM volume group structure;

图2为常见云主机LVM卷组扩容后的结构示意图;FIG2 is a schematic diagram of the structure of a common cloud host LVM volume group after expansion;

图3为本发明提出的基于快照的云主机并发备份方法的流程示意图;FIG3 is a flow chart of a snapshot-based concurrent backup method for cloud hosts proposed by the present invention;

图4为本发明提出的应用于基于快照的云主机并发备份方法的系统组成示意图;FIG4 is a schematic diagram of the system composition of the snapshot-based concurrent backup method for cloud hosts proposed by the present invention;

图5为本发明提出的应用于基于快照的云主机并发备份方法的系统执行逻辑示意图。FIG5 is a schematic diagram of the system execution logic of the snapshot-based concurrent backup method for cloud hosts proposed by the present invention.

具体实施方式DETAILED DESCRIPTION

下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments.

随着云计算的快速兴起,越来越多的企业将业务部署到云平台上。对于运行业务的云主机上的数据,有了备份,恢复以及容灾的需求。目前,基于快照的云主机备份是一种常见方案,但具体实现上仍存在一些问题。大多数云平台运行云主机是Linux系统,而LVM是Linux内核所提供的逻辑卷管理功能。它是在块设备如磁盘或分区之上,文件系统之下的一个逻辑层。这个逻辑层由物理卷,卷组和逻辑卷组成,如图1所示。它对文件系统而言,屏蔽了下层的磁盘分区布局,故可以在保持现有数据不变的情况下动态调整卷组容量,再对卷组上的逻辑卷进行扩容。这种扩容方式在Linux系统是最为常见的,参见图2。With the rapid rise of cloud computing, more and more companies are deploying their businesses on cloud platforms. For the data on the cloud hosts running the business, there is a need for backup, recovery and disaster recovery. At present, snapshot-based cloud host backup is a common solution, but there are still some problems in the specific implementation. Most cloud platforms run cloud hosts on Linux systems, and LVM is a logical volume management function provided by the Linux kernel. It is a logical layer above block devices such as disks or partitions and below the file system. This logical layer consists of physical volumes, volume groups and logical volumes, as shown in Figure 1. For the file system, it shields the underlying disk partition layout, so the volume group capacity can be dynamically adjusted while keeping the existing data unchanged, and then the logical volume on the volume group can be expanded. This expansion method is the most common in Linux systems, see Figure 2.

基于快照的云主机并发备份时,会将多台云主机对应的云硬盘挂载到备份代理上。由于云主机一般为Linux相同,且大部分是通过镜像或模板统一创建的,其卷组名往往是相同的。当挂载到同一个备份代理上,卷组出现冲突,导致后续挂载的云硬盘上的卷组不会被激活,从而无法基于文件系统做有效数据解析,继而不能进行有效数据的备份。云平台上有些云主机内的卷组做过扩容的,即卷组是在两个磁盘之上的。由于云平台上的快照一般是基于磁盘级别的,故对于云主机内跨磁盘的卷组也是对其下的磁盘分别做快照的。因为磁盘之间做快照有时间差,快照数据不在一个时间点上,数据可能会不一致。故有概率出现卷组元数据不一致问题,从而导致备份失败或备份数据存在问题。备份代理未对挂载的云硬盘做数据可用性检查,而是直接备份。若云硬盘上的文件系统或卷组元数据存在问题,备份时没有第一时间发现数据问题,直到云主机故障后需要进行恢复,恢复数据后才发现数据问题,导致无可用数据恢复。When backing up cloud hosts concurrently based on snapshots, the cloud hard disks corresponding to multiple cloud hosts will be mounted on the backup proxy. Since cloud hosts are generally the same Linux and most of them are created uniformly through images or templates, their volume group names are often the same. When mounted on the same backup proxy, volume groups conflict, resulting in the volume groups on the subsequently mounted cloud hard disks not being activated, making it impossible to perform effective data parsing based on the file system, and then unable to perform effective data backup. The volume groups in some cloud hosts on the cloud platform have been expanded, that is, the volume groups are on two disks. Since snapshots on the cloud platform are generally based on the disk level, snapshots are also taken of the disks under them for the volume groups that span disks in the cloud host. Because there is a time difference between snapshots of disks, the snapshot data is not at the same time point, and the data may be inconsistent. Therefore, there is a probability that the volume group metadata is inconsistent, resulting in backup failure or problems with the backup data. The backup proxy did not check the data availability of the mounted cloud hard disk, but backed it up directly. If there is a problem with the file system or volume group metadata on the cloud hard disk, the data problem is not discovered immediately during backup. It is not discovered until the cloud host fails and needs to be restored. As a result, no available data can be recovered.

对于上述技术方案中存在的缺陷弊端,存在以下可行的替代方案:备份前需要对待备份的云主机修改引导配置文件如/boot/grub2/grub.cfg和文件系统挂载文件/etc/fstab,将文件内的设备路径改为对应的文件系统UUID;是因为文件系统的UUID不会随卷组重命名而修改,再将待备份的云主机打快照,并通过快照生成云硬盘挂载到备份代理,默认激活云硬盘卷组,若出现卷组冲突,则重命名卷组名。再基于文件系统解析有效数据来备份。此方案对卷组名也是有修改,由于对原机做处理,容灾或恢复时,不需要将卷组名改回。但直接操作原机存在一定风险,且一般用户不会让备份厂商直接操作原机。For the defects and drawbacks of the above technical solutions, there are the following feasible alternative solutions: Before backup, it is necessary to modify the boot configuration file such as /boot/grub2/grub.cfg and the file system mount file /etc/fstab of the cloud host to be backed up, and change the device path in the file to the corresponding file system UUID; this is because the UUID of the file system will not be modified with the renaming of the volume group. Then take a snapshot of the cloud host to be backed up, and use the snapshot to generate a cloud hard disk and mount it to the backup agent. The cloud hard disk volume group is activated by default. If there is a volume group conflict, the volume group name is renamed. Then back up valid data based on file system parsing. This solution also modifies the volume group name. Since the original machine is processed, the volume group name does not need to be changed back during disaster recovery or recovery. However, there are certain risks in directly operating the original machine, and general users will not let the backup vendor directly operate the original machine.

如图3所示,在本实施例提出一种较佳的解决方案:基于快照的云主机并发备份方法,该方法包括以下步骤:As shown in FIG3 , in this embodiment, a better solution is proposed: a cloud host concurrent backup method based on snapshots, the method comprising the following steps:

步骤1、选取需要备份的云主机,对所选云主机获取元数据信息并上传到备份服务器,再对云主机的所有云硬盘创建云硬盘快照。上述获取元数据信息,创建云硬盘快照,是由备份代理的云平台操作模块通过调用云平台API来实现的。Step 1: Select the cloud host to be backed up, obtain metadata information for the selected cloud host and upload it to the backup server, and then create cloud disk snapshots for all cloud disks of the cloud host. The above-mentioned acquisition of metadata information and creation of cloud disk snapshots are implemented by the cloud platform operation module of the backup agent by calling the cloud platform API.

步骤2、通过云硬盘快照创建云硬盘,再将云硬盘挂载到备份代理。由于一个备份代理可备份多台云主机,故此步骤需要加锁处理。当前一台云主机对应的云硬盘挂载完成,将云硬盘添加到映射表后,再对后一台云主机对应的云硬盘做挂载。Step 2: Create a cloud hard disk from the cloud hard disk snapshot, and then mount the cloud hard disk to the backup proxy. Since a backup proxy can back up multiple cloud hosts, this step needs to be locked. After the cloud hard disk corresponding to the current cloud host is mounted, add the cloud hard disk to the mapping table, and then mount the cloud hard disk corresponding to the next cloud host.

上述通过云硬盘快照创建云硬盘和挂载云硬盘到备份代理,也是由备份代理的云平台操作模块通过调用云平台API来实现的。挂载云硬盘到备份代理加锁是为了确保查询得到的挂载云硬盘在备份代理上对应的磁盘设备是唯一的,不会出错。再由备份代理将云主机,云硬盘以及云硬盘对应的磁盘设备等记录到映射表,映射表是记录云主机、云硬盘以及云硬盘在备份代理上对应的磁盘设备信息的映射表文件。The above creation of cloud hard disks through cloud hard disk snapshots and mounting cloud hard disks to backup agents are also implemented by the cloud platform operation module of the backup agent by calling the cloud platform API. The purpose of locking the cloud hard disk mounted to the backup agent is to ensure that the disk device corresponding to the mounted cloud hard disk obtained by the query on the backup agent is unique and error-free. The backup agent then records the cloud host, cloud hard disk, and the disk device corresponding to the cloud hard disk in the mapping table. The mapping table is a mapping table file that records the cloud host, cloud hard disk, and the disk device information corresponding to the cloud hard disk on the backup agent.

步骤3、读取映射表,获取一台云主机对应的云硬盘在备份代理上对应的磁盘设备,由解析模块识别是否有LVM卷组,若有LVM卷组,则添加到设备文件并激活逻辑卷。再对云硬盘上文件系统做检查,若有LVM卷组,则再对卷组元数据做检查。Step 3: Read the mapping table to obtain the disk device corresponding to the cloud hard disk corresponding to a cloud host on the backup proxy. The parsing module identifies whether there is an LVM volume group. If there is an LVM volume group, add it to the device file and activate the logical volume. Then check the file system on the cloud hard disk. If there is an LVM volume group, check the volume group metadata.

解析模块通过读取磁盘或分区上的卷组元数据或通过分区类型是否为8e(LVM分区类型)来判断是否有LVM卷组。若有LVM卷组,则将卷组对应物理卷添加到设备文件内。此处需要说明的是,备份代理的系统是做处理的,即LVM管理程序仅对设备文件内的物理卷做扫描,故云硬盘挂载到备份代理是不会自动激活逻辑卷的,这个也是为了避免卷组冲突。当有新的物理卷加到设备文件后,解析模块会重新扫描卷组,将新发现的卷组下的逻辑卷激活。检查模块通过blkid命令或lsblk命令可以获取云硬盘对应的磁盘设备所有的分区和逻辑卷,以及上面的文件系统类型如ext4。检查模块通过调用不同文件系统对应的文件系统检查命令如fsck.ext4来检查分区或逻辑卷上的文件系统,若存在文件系统错误,则对文件系统进行修复,并告警。若文件系统错误无法修复,则告警并退出,不再执行步骤4。The parsing module determines whether there is an LVM volume group by reading the volume group metadata on the disk or partition or by checking whether the partition type is 8e (LVM partition type). If there is an LVM volume group, the physical volume corresponding to the volume group is added to the device file. It should be noted here that the backup agent system is processed, that is, the LVM management program only scans the physical volume in the device file, so the cloud hard disk mounted on the backup agent will not automatically activate the logical volume, which is also to avoid volume group conflicts. When a new physical volume is added to the device file, the parsing module will rescan the volume group and activate the logical volume under the newly discovered volume group. The check module can obtain all the partitions and logical volumes of the disk device corresponding to the cloud hard disk, as well as the above file system types such as ext4 through the blkid command or lsblk command. The check module checks the file system on the partition or logical volume by calling the file system check command corresponding to different file systems, such as fsck.ext4. If there is a file system error, the file system is repaired and an alarm is issued. If the file system error cannot be repaired, an alarm is issued and exited, and step 4 is not executed.

对于云主机做过扩容,其卷组是在两个磁盘之上的。由于,云平台快照是磁盘级别的,故有概率出现卷组元数据不一致的问题。检查模块通过调用LVM管理命令可以检查到卷组元数据是否一致。若卷组元数据不一致,则尝试修复。若修复成功,则继续执行步骤4;若修复失败,则退出备份,并告警卷组元数据异常无法修复。The cloud host has been expanded, and its volume group is on two disks. Since the cloud platform snapshot is at the disk level, there is a probability that the volume group metadata is inconsistent. The inspection module can check whether the volume group metadata is consistent by calling the LVM management command. If the volume group metadata is inconsistent, try to repair it. If the repair is successful, continue to step 4; if the repair fails, exit the backup and warn that the volume group metadata is abnormal and cannot be repaired.

步骤4、对云硬盘上的逻辑卷或分区,基于文件系统来解析有效数据,生成位图文件。有效数据解析成功后,若有LVM卷组则取消激活逻辑卷,并从设备文件移除。Step 4: For the logical volume or partition on the cloud hard disk, the valid data is parsed based on the file system and a bitmap file is generated. After the valid data is parsed successfully, if there is an LVM volume group, the logical volume is deactivated and removed from the device file.

卷解析模块对云硬盘上的逻辑卷或分区,查询其上的文件系统类型,调用不同接口来解析对应的文件系统有效数据,并生产bitmap位图文件。解析有效数据成功后,即可取消激活逻辑卷,并从设备文件移除。再对下一个云硬盘做相同处理。The volume parsing module queries the file system type on the logical volume or partition on the cloud hard disk, calls different interfaces to parse the corresponding file system valid data, and generates a bitmap file. After successfully parsing the valid data, the logical volume can be deactivated and removed from the device file. The same process is then performed on the next cloud hard disk.

步骤5、通知备份服务器创建块设备,备份代理通过云硬盘对应的位图文件将有效数据拷贝到对应的块设备。拷贝完成后,通知备份服务器更新块设备状态,并创建块设备快照。同时,卸载云硬盘并清理云硬盘和云硬盘快照。Step 5: Notify the backup server to create a block device. The backup agent copies the valid data to the corresponding block device through the bitmap file corresponding to the cloud hard disk. After the copy is completed, notify the backup server to update the block device status and create a block device snapshot. At the same time, unmount the cloud hard disk and clean up the cloud hard disk and cloud hard disk snapshot.

上述备份服务器通过虚拟块设备管理模块创建块设备,可以是自研的虚拟块设备,也可以是ceph的rbd块设备。块设备大小需要和备份的云硬盘相同或大一些。由备份代理中的卷复制模块通过TCP协议或iSCSI协议基于位图文件将有效数据写到对应块设备上。备份代理对于解析好有效数据的云硬盘,可同时启动多个进程来并发备份。The above backup server creates a block device through the virtual block device management module, which can be a self-developed virtual block device or a ceph rbd block device. The block device size needs to be the same as or larger than the cloud hard disk to be backed up. The volume replication module in the backup agent writes valid data to the corresponding block device based on the bitmap file through the TCP protocol or iSCSI protocol. For the cloud hard disk that has parsed the valid data, the backup agent can start multiple processes at the same time to perform concurrent backup.

如图4所示,本实施例基于上述内容提出一种应用于基于快照的云主机并发备份方法的系统,该系统主要包括了备份代理和备份服务器,其中在备份代理中又包含有云平台操作模块、解析模块、检查模块以及卷复制模块;在备份服务器中包含有虚拟块设备管理模块和管理程序。As shown in FIG4 , this embodiment proposes a system for a snapshot-based concurrent backup method for cloud hosts based on the above content. The system mainly includes a backup agent and a backup server, wherein the backup agent includes a cloud platform operation module, a parsing module, a checking module, and a volume replication module; and the backup server includes a virtual block device management module and a management program.

备份代理通过镜像提供,对于需要备份的云平台,上传镜像,再通过镜像创建备份代理;The backup proxy is provided through the image. For the cloud platform that needs to be backed up, upload the image and then create a backup proxy through the image.

云平台操作模块用于创建云主机快照和云硬盘;卷解析模块用于解析设备是否存在LVM卷组,同时卷解析模块也负责对卷组的激活,取消激活,设备文件的添加和移除等,并包括解析分区或逻辑卷上文件系统的有效数据。检查模块用于检查文件系统和卷组元数据,同时检查模块对于常见文件系统错误,卷组元数据不一致做修复。The cloud platform operation module is used to create cloud host snapshots and cloud hard disks; the volume parsing module is used to parse whether the device has an LVM volume group. The volume parsing module is also responsible for activating and deactivating the volume group, adding and removing device files, and parsing the valid data of the file system on the partition or logical volume. The inspection module is used to check the file system and volume group metadata. At the same time, the inspection module repairs common file system errors and inconsistent volume group metadata.

卷复制模块用于将云硬盘中有效数据拷贝到对应的块设备,可通过位图来备份云硬盘的有效数据。The volume replication module is used to copy the valid data in the cloud hard disk to the corresponding block device, and can back up the valid data of the cloud hard disk through a bitmap.

本实施例中的备份服务器提供镜像和一体机两种部署方式。备份服务器包括:用于创建块设备的虚拟块设备管理模块,备份代理中的卷复制模块通过TCP协议或iSCSI协议将备份数据写入备份服务器块设备上;同时虚拟块设备管理模块对备份完成的块设备,打快照来标记,完成创建块设备快照。管理程序在备份服务器中的作用是提供Web界面给用户使用。The backup server in this embodiment provides two deployment modes: mirroring and all-in-one. The backup server includes: a virtual block device management module for creating block devices, and a volume replication module in the backup agent writes the backup data to the backup server block device through the TCP protocol or the iSCSI protocol; at the same time, the virtual block device management module marks the block device after the backup is completed with a snapshot to complete the creation of the block device snapshot. The role of the hypervisor in the backup server is to provide a Web interface for users to use.

利用上述系统执行基于快照的云主机并发备份方法时,其并发备份的逻辑如图5所示,选取三个云主机作为并发备份的实例,对所选的云主机A、云主机B和云主机C创建云硬盘快照A、云硬盘快照B和云硬盘快照C,通过云硬盘快照A、云硬盘快照B和云硬盘快照C创建生成云硬盘A、云硬盘B和云硬盘C以及云硬盘D,将其挂载到备份代理上后,添加到映射表;读取映射表,获取映射表中每一台云主机对应的云硬盘在备份代理上对应的磁盘设备,由解析模块和检查模块进行识别和检查;利用备份代理中的卷复制模块通过TCP协议将备份数据写入备份服务器块设备上,完成基于快照的云主机并发备份任务。When the above system is used to execute the snapshot-based concurrent backup method for cloud hosts, the logic of its concurrent backup is shown in FIG5 . Three cloud hosts are selected as instances of concurrent backup. Cloud hard disk snapshots A, B and C are created for the selected cloud hosts A, B and C. Cloud hard disk snapshots A, B and C are used to create and generate cloud hard disks A, B and C as well as cloud hard disk D. After mounting them on the backup agent, they are added to the mapping table. The mapping table is read to obtain the disk devices corresponding to the cloud hard disks corresponding to each cloud host in the mapping table on the backup agent, which are identified and checked by the parsing module and the checking module. The volume replication module in the backup agent is used to write the backup data to the backup server block device through the TCP protocol to complete the snapshot-based concurrent backup task for cloud hosts.

本发明通过对云硬盘备份数据挂载,卷组激活和文件系统解析等关键步骤的加锁控制,以及通过设备文件控制LVM使用哪些设备,避免了并发备份情况下,卷组名冲突导致备份失败的问题。同时,也不需要对卷组进行重命名,避免了恢复或容灾前,需要将备份数据的卷组名改回问题。The present invention avoids the problem of backup failure caused by volume group name conflict in concurrent backup by locking key steps such as cloud hard disk backup data mounting, volume group activation and file system parsing, and controlling which devices LVM uses through device files. At the same time, there is no need to rename the volume group, avoiding the need to change the volume group name of the backup data before recovery or disaster recovery.

本发明在备份前,即可对云硬盘数据做检查,检查出现问题则做修复,以确保备份的数据是可用的。当然,若文件系统出现严重错误,无法修复,则提供报错并告警,避免备份的数据不可用,保障了备份数据的可靠性和可用性,不会出现使用备份数据恢复或容灾,才发现备份数据不可用。本发明是基于文件系统来解析有效数据的,不会备份无效数据,缩短了备份时间,减少了存储占用。The present invention can check the cloud hard disk data before backing up, and repair it if any problem is found to ensure that the backed up data is available. Of course, if a serious error occurs in the file system and cannot be repaired, an error report and an alarm are provided to avoid the unavailability of the backed up data, thereby ensuring the reliability and availability of the backup data, and preventing the backup data from being used for recovery or disaster recovery, only to find that the backup data is unavailable. The present invention parses valid data based on the file system, does not back up invalid data, shortens the backup time, and reduces storage usage.

以上所述,仅为本发明较佳的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,根据本发明的技术方案及其发明构思加以等同替换或改变,都应涵盖在本发明的保护范围之内。The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent replacements or changes according to the technical scheme and inventive concept of the present invention within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims (9)

1. A cloud host concurrent backup method based on snapshot is characterized by comprising the following steps:
Step 1, acquiring metadata information from a selected cloud host, uploading the metadata information to a backup server, and creating a cloud hard disk snapshot for all cloud hard disks of the cloud host;
step 2, creating a cloud hard disk through a cloud hard disk snapshot, mounting the cloud hard disk to a backup agent, and adding the cloud hard disk to a mapping table;
Step 3, reading a mapping table, obtaining disk equipment corresponding to a cloud hard disk corresponding to a cloud host on a backup agent, identifying whether an LVM volume group exists by an analysis module, adding to equipment files and activating a logic volume if the LVM volume group exists, checking a file system on the cloud hard disk, and checking volume group metadata if the file system exists in the LVM volume group;
Step 4, analyzing the effective data of the logical volumes or the partitions on the cloud hard disk based on the file system, generating a bitmap file, and after the effective data is successfully analyzed, deactivating the logical volumes and removing the logical volumes from the equipment file if the LVM volume group exists;
And 5, notifying a backup server to create block equipment, copying the effective data to the corresponding block equipment by the backup agent through the bitmap file corresponding to the cloud hard disk, notifying the backup server to update the state of the block equipment after copying is completed, creating a block equipment snapshot, unloading the cloud hard disk, and cleaning the cloud hard disk and the cloud hard disk snapshot.
2. The snapshot-based cloud host concurrent backup method according to claim 1, wherein in step 1, metadata information is acquired and a cloud hard snapshot is created, and the cloud platform operation module of the backup agent is implemented by calling a cloud platform API.
3. The method for concurrent backup of cloud hosts based on snapshots as defined in claim 1, wherein in step 2, a backup agent backs up a plurality of cloud hosts, and mounts a cloud hard disk corresponding to a previous cloud host after completing the mounting of the cloud hard disk corresponding to the previous cloud host, and mounts a cloud hard disk corresponding to a next cloud host after adding the cloud hard disk to the mapping table; the mapping table is a mapping table file for recording disk equipment information corresponding to the cloud host, the cloud hard disk and the cloud hard disk on the backup agent.
4. The snapshot-based cloud host concurrent backup method according to claim 1, wherein in step 3, the parsing module determines whether there is an LVM volume group by reading volume group metadata on a disk device or a partition, or by whether a partition type is 8 e; when the disk device or the partition is a physical volume, adding a device path of the disk device or the partition to a device file, activating a logic volume under a newly found volume group, acquiring all partitions and logic volumes of the disk device corresponding to the cloud hard disk and file system types on the partitions and the logic volumes through blkid or lsblk commands, executing a corresponding file system checking command, checking the file system through a checking module, repairing the file system if a file system error exists, alarming, and if the file system error cannot be repaired, alarming and exiting, and not executing the step 4; checking the volume component data, wherein the checking module checks whether the volume component data is consistent by calling an LVM management command, if the volume component data is inconsistent, the repairing is tried, and if the repairing is successful, the step 4 is continuously executed; if the restoration fails, the backup is exited, and the abnormal volume component data cannot be restored.
5. The method for concurrent backup of a cloud host based on snapshot as claimed in claim 1, wherein in step 4, when the valid data is analyzed on a logical volume or a partition on a cloud hard disk based on a file system, the analysis module queries a file system type on the logical volume or the partition on the cloud hard disk, calls different interfaces to analyze the corresponding valid data of the file system, produces bitmap files, and after the valid data is successfully analyzed, deactivates the logical volume, removes the valid data from the device files, and performs the same process on the next cloud hard disk.
6. The method for concurrent backup of a snapshot-based cloud host of claim 1, wherein step 3 and step 4 are used to ensure that only one newly added volume group is activated at a time under concurrent execution through concurrent locking processing, and when the analysis of valid data by the newly added volume group is completed and removed, the next newly added volume group is deactivated.
7. The snapshot-based cloud host concurrent backup method according to claim 1, wherein in step 5, the block device is created through a virtual block device management module in a backup server, the block device adopts a virtual block device or ceph rbd block device, a volume copy module in a backup agent copies valid data to a corresponding block device based on bitmap files through TCP protocol or iSCSI protocol, and the backup agent simultaneously starts a plurality of processes for a cloud hard disk with resolved valid data to perform concurrent backup.
8. A system for concurrent backup method based on snapshot cloud host as in any one of claims 1-7, comprising a backup agent and a backup server,
And uploading the mirror image to the cloud platform needing to be backed up, and creating the backup agent through the mirror image, wherein the backup agent comprises:
the cloud platform operation module is used for creating a cloud hard disk snapshot;
the analyzing module is used for analyzing whether the LVM volume group exists in the equipment or not;
a checking module for checking file system and volume component metadata, the checking module repairing file system errors and volume component metadata inconsistencies;
The volume copying module is used for copying the valid data in the cloud hard disk to the corresponding block equipment;
The backup server provides two deployment modes of a mirror image and an all-in-one machine, and comprises:
the virtual block device management module is used for creating block devices, marking the snapshot of the block devices with which the backup is completed, and creating the snapshot of the block devices;
And a hypervisor for providing a Web interface for use by a user.
9. The system of snapshot-based cloud-host concurrent backup method of claim 8, wherein the parsing module is responsible for activation, deactivation of volume groups, addition and removal of device files, and parsing valid data of a file system on a partition or logical volume.
CN202410798583.0A 2024-06-20 2024-06-20 A cloud host concurrent backup method and system based on snapshot Pending CN118585378A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202410798583.0A CN118585378A (en) 2024-06-20 2024-06-20 A cloud host concurrent backup method and system based on snapshot

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202410798583.0A CN118585378A (en) 2024-06-20 2024-06-20 A cloud host concurrent backup method and system based on snapshot

Publications (1)

Publication Number Publication Date
CN118585378A true CN118585378A (en) 2024-09-03

Family

ID=92538141

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202410798583.0A Pending CN118585378A (en) 2024-06-20 2024-06-20 A cloud host concurrent backup method and system based on snapshot

Country Status (1)

Country Link
CN (1) CN118585378A (en)

Similar Documents

Publication Publication Date Title
US7152184B2 (en) Storage device, backup method and computer program code of this storage device
US8732121B1 (en) Method and system for backup to a hidden backup storage
JP4321705B2 (en) Apparatus and storage system for controlling acquisition of snapshot
US7356657B2 (en) System and method for controlling storage devices
US7376865B2 (en) Mapping apparatus for backup and restoration of multi-generation recovered snapshots
US7200626B1 (en) System and method for verification of a quiesced database copy
US7613806B2 (en) System and method for managing replication sets of data distributed over one or more computer systems
US8074035B1 (en) System and method for using multivolume snapshots for online data backup
US7840838B2 (en) Rapid regeneration of failed disk sector in a distributed database system
US8775861B1 (en) Non-disruptive storage device migration in failover cluster environment
US6944789B2 (en) Method and apparatus for data backup and recovery
JP2004038938A (en) Method and system for restoring data on primary data volume
US7216210B2 (en) Data I/O system using a plurality of mirror volumes
US20090070539A1 (en) Automated File Recovery Based on Subsystem Error Detection Results
JPH1049308A (en) Host base raid-5 and nv-ram integrated system
EP0483174B1 (en) A method of operating a data processing system
US5421003A (en) Disk storage system with fault tolerant media maintenance
US20070033361A1 (en) Apparatus, system, and method for fastcopy target creation
CN118585378A (en) A cloud host concurrent backup method and system based on snapshot
US7529973B2 (en) Method of and apparatus for taking back-up and checking alteration of data, and computer product
CN114253765B (en) A data recovery method and related equipment
Steigerwald Imposing order
JP2853527B2 (en) Automatic file failure recovery system
JP4878113B2 (en) Link library recovery method and program for DASD failure
CN120371597A (en) A data processing method and related device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination