[go: up one dir, main page]

CN104317531A - Method and system for realizing multi-volume remote copy data consistency - Google Patents

Method and system for realizing multi-volume remote copy data consistency Download PDF

Info

Publication number
CN104317531A
CN104317531A CN201410584735.3A CN201410584735A CN104317531A CN 104317531 A CN104317531 A CN 104317531A CN 201410584735 A CN201410584735 A CN 201410584735A CN 104317531 A CN104317531 A CN 104317531A
Authority
CN
China
Prior art keywords
data
distributor
described data
disk
encapsulation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410584735.3A
Other languages
Chinese (zh)
Inventor
张延枫
徐艳秋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur Beijing Electronic Information Industry Co Ltd
Original Assignee
Inspur Beijing Electronic Information Industry Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Beijing Electronic Information Industry Co Ltd filed Critical Inspur Beijing Electronic Information Industry Co Ltd
Priority to CN201410584735.3A priority Critical patent/CN104317531A/en
Publication of CN104317531A publication Critical patent/CN104317531A/en
Pending legal-status Critical Current

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本发明提供一种实现多卷远程复制数据一致性方法及系统,包括以下步骤:将更新数据写入本地对应的磁盘的多个巻后,将更新数据通过数据组合器按照时间顺序进行封装;将封装后的更新数据包通过数据传输器传递给数据分发器后,所述数据分发器根据时间顺序,依次将封装后的更新数据包中的数据分发至对应的远端磁盘的多个巻中。本发明将多个卷中的更新数据以组为单位,按照时间先后进行数据封装,然后发送到远端,从而实现多个卷的远程复制数据一致性。

The present invention provides a method and system for realizing consistency of multi-volume remote replication data, comprising the following steps: after writing update data into multiple volumes of corresponding local disks, encapsulating the update data in chronological order through a data combiner; After the encapsulated update data packet is delivered to the data distributor through the data transmitter, the data distributor sequentially distributes the data in the encapsulated update data packet to multiple volumes of the corresponding remote disk according to the time sequence. The invention encapsulates the updated data in multiple volumes in units of groups according to time, and then sends them to the remote end, so as to realize the consistency of remote replication data of multiple volumes.

Description

一种实现多卷远程复制数据一致性方法及系统A method and system for realizing multi-volume remote replication data consistency

技术领域technical field

本发明属于计算机存储领域,尤其涉及一种实现多卷远程复制数据一致性方法及系统。The invention belongs to the field of computer storage, and in particular relates to a method and a system for realizing consistency of multi-volume remote replication data.

背景技术Background technique

目前,数据备份与恢复机制是提高数据安全性和可用性的重要手段,数据备份是指将本地源数据通过网络复制到远端,当本地源数据不可用时,由远端的数据恢复到本地,或者由远端的数据直接提供给上层应用使用,使业务重新正常运行。远程复制是数据管理中抗击大规模物理灾害的重要手段,主要包括面向应用的文件级复制和面向磁盘阵列/面向逻辑卷的块级复制两大类方法,前者更靠近上层应用,容易实现、控制简单,但通用性差;后者则由于对应用透明,具有较强的通用性,不影响主机的正常业务,尤其在较大规模数据复制的应用需求中更有优势。At present, the data backup and recovery mechanism is an important means to improve data security and availability. Data backup refers to copying local source data to the remote end through the network. When the local source data is unavailable, the remote data is restored to the local, or The data from the remote end is directly provided to the upper-layer application for use, so that the business can resume normal operation. Remote replication is an important means of combating large-scale physical disasters in data management. It mainly includes two methods: application-oriented file-level replication and disk array/logical volume-oriented block-level replication. The former is closer to the upper application and is easier to implement and control Simple, but poor in versatility; the latter has strong versatility because it is transparent to applications, and does not affect the normal business of the host, especially in the application requirements of large-scale data replication.

在大中型数据库应用中,数据和日志、修改信息、控制信息等存储在磁盘阵列的不同逻辑卷中,如果一个卷上的数据出错,将会导致多个卷上的整体数据失效,无法使用;同时,如果远端的数据更新顺序发生改变,那么就会造成远端数据和本地数据不一致,从而造成远端数据是不可恢复的。In large and medium-sized database applications, data and logs, modification information, control information, etc. are stored in different logical volumes of the disk array. If the data on one volume is wrong, the overall data on multiple volumes will become invalid and unusable; At the same time, if the update order of the remote data changes, the remote data will be inconsistent with the local data, making the remote data unrecoverable.

发明内容Contents of the invention

本发明提供一种实现多卷远程复制数据一致性方法及系统,以解决上述问题。The present invention provides a method and system for realizing data consistency of multi-volume remote replication to solve the above problems.

本发明提供一种实现多卷远程复制数据一致性方法。上述方法包括以下步骤:The invention provides a method for realizing multi-volume remote replication data consistency. The above method comprises the following steps:

将更新数据写入本地对应的磁盘的多个巻后,将更新数据通过数据组合器按照时间顺序进行封装;After the update data is written into multiple volumes of the local corresponding disk, the update data is encapsulated in chronological order by the data combiner;

将封装后的更新数据包通过数据传输器传递给数据分发器后,所述数据分发器根据时间顺序,依次将封装后的更新数据包中的数据分发至对应的远端磁盘的多个巻中。After the encapsulated update data packet is delivered to the data distributor through the data transmitter, the data distributor sequentially distributes the data in the encapsulated update data packet to multiple volumes of the corresponding remote disk according to the time sequence .

本发明还提供一种实现多卷远程复制数据一致性系统,包括数据组合器,数据传输器,数据分发器;其中,所述数据组合器通过所述数据传输器与所述数据分发器相连;The present invention also provides a system for realizing multi-volume remote replication data consistency, including a data combiner, a data transmitter, and a data distributor; wherein, the data combiner is connected to the data distributor through the data transmitter;

所述数据组合器,用于将更新数据按照时间顺序进行封装后发送至所述数据传输器;The data combiner is configured to encapsulate the update data in chronological order and send it to the data transmitter;

所述数据传输器,用于将封装后的更新数据包传递给数据分发器;The data transmitter is configured to deliver the encapsulated update data packet to the data distributor;

所述数据分发器,用于根据时间顺序,依次将封装后的更新数据包中的数据分发至对应的远端磁盘的多个巻中。The data distributor is configured to sequentially distribute the data in the packaged update data package to multiple volumes of the corresponding remote disk according to the sequence of time.

相较于先前技术,根据本发明提供的一种实现多卷远程复制数据一致性方法及系统,将多个卷中的更新数据以组为单位,按照时间先后进行数据封装,然后发送到远端,从而实现多个卷的远程复制数据一致性。Compared with the prior art, according to the method and system for realizing multi-volume remote replication data consistency provided by the present invention, the update data in multiple volumes is grouped as a unit, and the data is encapsulated in chronological order, and then sent to the remote end , so as to achieve remote replication data consistency of multiple volumes.

附图说明Description of drawings

此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:The accompanying drawings described here are used to provide a further understanding of the present invention and constitute a part of the application. The schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations to the present invention. In the attached picture:

图1所示为本发明实施例1的实现多卷远程复制数据一致性系统结构图;FIG. 1 is a structural diagram of a system for realizing multi-volume remote replication data consistency in Embodiment 1 of the present invention;

图2所示为本发明实施例2的实现多卷远程复制数据一致性方法处理流程图。FIG. 2 is a flowchart of a method for realizing data consistency of multi-volume remote replication according to Embodiment 2 of the present invention.

具体实施方式Detailed ways

下文中将参考附图并结合实施例来详细说明本发明。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。Hereinafter, the present invention will be described in detail with reference to the drawings and examples. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.

图1所示为本发明实施例1的实现多卷远程复制数据一致性系统结构图,该系统包括:本地磁盘LD1、LD2、LD3…LDn,数据组合器1,数据传输器2,数据分发器3,远端磁盘RD1、RD2、RD3…RDn;其中:所述数据组合器通过所述数据传输器与所述数据分发器相连;所述本地磁盘LD1、LD2、LD3…LDn与所述数据组合器相连;所述远端磁盘RD1、RD2、RD3…RDn与所述数据分发器相连;Figure 1 is a structural diagram of a system for realizing multi-volume remote replication data consistency in Embodiment 1 of the present invention. The system includes: local disks LD1, LD2, LD3...LDn, data combiner 1, data transmitter 2, and data distributor 3. Remote disks RD1, RD2, RD3...RDn; wherein: the data combiner is connected to the data distributor through the data transmitter; the local disks LD1, LD2, LD3...LDn are combined with the data connected to the device; the remote disks RD1, RD2, RD3...RDn are connected to the data distributor;

所述本地磁盘LD1、LD2、LD3…LDn,用于将接收的更新数据写入本地对应的磁盘的多个巻中后,将更新数据发送至所述数据组合器1;The local disks LD1, LD2, LD3...LDn are used to write the received update data into multiple volumes of the corresponding local disks, and then send the update data to the data combiner 1;

数据组合器1,是远程复制系统中作用于本地磁盘的一个模块,负责数据的统一组合管理,主要包括:更新数据的封装、时间顺序保证;通过数据传输器2向远端的数据分发器3发送封装后的更新数据包。所述数据组合器1,用于将更新数据按照时间顺序进行封装并写入时间标记后发送至所述数据传输器2;Data combiner 1 is a module that acts on the local disk in the remote replication system and is responsible for the unified combination management of data, mainly including: encapsulation of updated data and time order guarantee; Send the encapsulated update packet. The data combiner 1 is configured to encapsulate the update data in chronological order and write it into a time stamp and then send it to the data transmitter 2;

数据传输器2,是远程复制系统中的数据发送及接受返回结果的模块。主要功能为:向数据分发器3发送封装后的更新数据包;传递数据写入卷的返回结果。所述数据传输器2,还用于将封装后的更新数据包通过IP网络或者光纤网络传递给数据分发器3。所述数据传输器2,还用于接收所述数据分发器3返回的写入结果后,向本地对应的磁盘返回写入结果。The data transmitter 2 is a module for sending data and receiving returned results in the remote replication system. The main functions are: sending the encapsulated update data packet to the data distributor 3; delivering the returned result of data writing into the volume. The data transmitter 2 is further configured to transmit the encapsulated update data packet to the data distributor 3 through the IP network or the optical fiber network. The data transmitter 2 is further configured to return the writing result to the corresponding local disk after receiving the writing result returned by the data distributor 3 .

数据分发器3,是远程复制系统中作用于远端磁盘的一个模块,负责数据的统一分发管理。主要功能包括:接收数据传输器2发送过来的封装后的更新数据包后,向远端对应的磁盘进行分发;接收远端磁盘反馈的写入结果。The data distributor 3 is a module that acts on the remote disk in the remote replication system and is responsible for the unified distribution and management of data. The main functions include: receiving the encapsulated update data packet sent by the data transmitter 2, and then distributing it to the corresponding remote disk; receiving the writing result fed back by the remote disk.

所述远端磁盘RD1、RD2、RD3…RDn,用于接收所述数据分发器3按照时间顺序分发的封装后的更新数据包中的数据后,写入多个巻中;还用于向所述数据分发器3返回写入结果。The remote disks RD1, RD2, RD3...RDn are used to write data in multiple volumes after receiving the data in the encapsulated update packets distributed by the data distributor 3 in chronological order; The data distributor 3 returns the writing result.

图2所示为本发明实施例2的实现多卷远程复制数据一致性方法处理流程图,包括以下步骤:FIG. 2 is a flow chart of a method for realizing multi-volume remote replication data consistency in Embodiment 2 of the present invention, including the following steps:

步骤201:将更新数据写入本地对应的磁盘LD(local disk)的多个巻中;Step 201: write update data in multiple volumes of the local corresponding disk LD (local disk);

步骤202:在多个巻的更新数据写入成功后,将更新数据通过数据组合器按照时间顺序进行封装并写入时间标记;Step 202: After the update data of multiple volumes is successfully written, the update data is encapsulated in chronological order by the data combiner and written into a time stamp;

步骤203:将封装后的更新数据包发送至数据传输器后,数据传输器将封装后的更新数据包通过IP网络或者光纤网络传递给数据分发器;Step 203: After sending the encapsulated update data packet to the data transmitter, the data transmitter transmits the encapsulated update data packet to the data distributor through the IP network or optical fiber network;

步骤204:数据分发器根据时间顺序,依次将封装后的更新数据包中的数据分发至对应的远端磁盘RD(remote disk)的多个巻中;Step 204: the data distributor distributes the data in the encapsulated update data packet to multiple volumes of the corresponding remote disk RD (remote disk) in sequence according to the time sequence;

步骤205:数据写入对应的远端磁盘RD后,向数据分发器返回写入结果;数据分发器向数据传输器返回写入结果;数据传输器向本地对应的磁盘返回写入结果。Step 205: After the data is written to the corresponding remote disk RD, return the writing result to the data distributor; the data distributor returns the writing result to the data transmitter; and the data transmitter returns the writing result to the corresponding local disk.

相较于先前技术,根据本发明提供的一种实现多卷远程复制数据一致性方法及系统,将多个卷中的更新数据以组为单位,按照时间先后进行数据封装,然后发送到远端,从而实现多个卷的远程复制数据一致性。Compared with the prior art, according to the method and system for realizing multi-volume remote replication data consistency provided by the present invention, the update data in multiple volumes is grouped as a unit, and the data is encapsulated in chronological order, and then sent to the remote end , so as to achieve remote replication data consistency of multiple volumes.

以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (9)

1. realize a multireel consistency of remote copy data method, it is characterized in that, comprise the following steps:
After multiple volumes of disk corresponding for more new data write this locality, will more be encapsulated according to time sequencing by data binner by new data;
After more new data packets after encapsulation is passed to data distributor by data link, described data distributor according to time sequencing, successively by the Data dissemination in the more new data packets after encapsulation in multiple volumes of corresponding far-end disk.
2. method according to claim 1, is characterized in that: by multiple volumes of disk LD corresponding for more new data write this locality; After more new data is written to merit of multiple volume, more encapsulation will be carried out by data binner according to time sequencing and the write time marks by new data.
3. method according to claim 2, is characterized in that: by the renewal Packet Generation after encapsulation to data link, and the more new data packets after encapsulation is passed to data distributor by IP network or fiber optic network by described data link.
4. the method according to any one of claim 1-3, is characterized in that: after the far-end disk that data write is corresponding, return write result to described data distributor; Described data distributor returns write result to described data link; Described data link returns write result to local corresponding disk.
5. realize a multireel consistency of remote copy data system, it is characterized in that, comprise data binner, data link, data distributor; Wherein, described data binner is connected with described data distributor by described data link;
Described data binner, for being more sent to described data link by new data after encapsulating according to time sequencing;
Described data link, for by encapsulation after renewal data packet delivery to data distributor;
Described data distributor, for according to time sequencing, successively by multiple volumes of far-end disk extremely corresponding for the Data dissemination in the more new data packets after encapsulation.
6. system according to claim 5, is characterized in that, also comprises local terminal disk, far-end disk; Wherein, described local terminal disk is connected with described data binner; Described far-end disk is connected with described data distributor;
Described local terminal disk, after in multiple volumes of the disk that the more new data write this locality for receiving is corresponding, more will be sent to described data binner by new data;
Described far-end disk, after receiving the data in the more new data packets after encapsulation that described data distributor distributes according to time sequencing, writes in multiple volume; Also for returning write result to described data distributor.
7. system according to claim 5, is characterized in that: described data binner, also for more carrying out encapsulation and write time mark according to time sequencing by new data.
8. system according to claim 5, its spy is being: described data link, also for the more new data packets after encapsulation is passed to data distributor by IP network or fiber optic network.
9. system according to claim 5, is characterized in that: described data distributor, also for receiving the write result that far-end disk returns; Described data link, also for after receiving write result that described data distributor returns, returns write result to local corresponding disk.
CN201410584735.3A 2014-10-27 2014-10-27 Method and system for realizing multi-volume remote copy data consistency Pending CN104317531A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410584735.3A CN104317531A (en) 2014-10-27 2014-10-27 Method and system for realizing multi-volume remote copy data consistency

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410584735.3A CN104317531A (en) 2014-10-27 2014-10-27 Method and system for realizing multi-volume remote copy data consistency

Publications (1)

Publication Number Publication Date
CN104317531A true CN104317531A (en) 2015-01-28

Family

ID=52372767

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410584735.3A Pending CN104317531A (en) 2014-10-27 2014-10-27 Method and system for realizing multi-volume remote copy data consistency

Country Status (1)

Country Link
CN (1) CN104317531A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108052419A (en) * 2018-01-05 2018-05-18 哈尔滨学院 A kind of method of data disaster tolerance

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1495612A (en) * 2002-08-07 2004-05-12 �Ҵ���˾ Method for updating timing information of retaining buffer stored data object and system
US7472173B2 (en) * 2004-03-18 2008-12-30 Hitachi, Ltd. Remote data copying among storage systems
CN102761615A (en) * 2012-06-29 2012-10-31 浪潮(北京)电子信息产业有限公司 Method and device for realizing data synchronism of long-distance duplication system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1495612A (en) * 2002-08-07 2004-05-12 �Ҵ���˾ Method for updating timing information of retaining buffer stored data object and system
US7472173B2 (en) * 2004-03-18 2008-12-30 Hitachi, Ltd. Remote data copying among storage systems
CN102761615A (en) * 2012-06-29 2012-10-31 浪潮(北京)电子信息产业有限公司 Method and device for realizing data synchronism of long-distance duplication system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108052419A (en) * 2018-01-05 2018-05-18 哈尔滨学院 A kind of method of data disaster tolerance

Similar Documents

Publication Publication Date Title
US8898409B1 (en) Journal-based replication without journal loss
US9069709B1 (en) Dynamic granularity in data replication
US9336094B1 (en) Scaleout replication of an application
US8954796B1 (en) Recovery of a logical unit in a consistency group while replicating other logical units in the consistency group
US9367260B1 (en) Dynamic replication system
US9910621B1 (en) Backlogging I/O metadata utilizing counters to monitor write acknowledgements and no acknowledgements
US10496487B1 (en) Storing snapshot changes with snapshots
US9411534B2 (en) Time stamp generation for virtual disks
US9495409B1 (en) Techniques for performing data validation
US9632881B1 (en) Replication of a virtual distributed volume
US9483205B2 (en) Writing to a storage platform including a plurality of storage clusters
US9798489B2 (en) Cloning a virtual disk in a storage platform
US9110914B1 (en) Continuous data protection using deduplication-based storage
US9558085B2 (en) Creating and reverting to a snapshot of a virtual disk
CA2905355C (en) Synchronous mirroring in non-volatile memory systems
TW454120B (en) Flexible remote data mirroring
US9383937B1 (en) Journal tiering in a continuous data protection system using deduplication-based storage
US8996460B1 (en) Accessing an image in a continuous data protection using deduplication-based storage
US9158630B1 (en) Testing integrity of replicated storage
US9189341B1 (en) Method and apparatus for multi-copy replication using a multi-splitter
US7149919B2 (en) Disaster recovery system with cascaded resynchronization
US20220171557A1 (en) Aggregate inline deduplication with volume granular encryption
US10235087B1 (en) Distributing journal data over multiple journals
US9684576B1 (en) Replication using a virtual distributed volume
US10558565B2 (en) Garbage collection implementing erasure coding

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20150128

WD01 Invention patent application deemed withdrawn after publication