CN104317531A - Method and system for realizing multi-volume remote copy data consistency - Google Patents
Method and system for realizing multi-volume remote copy data consistency Download PDFInfo
- Publication number
- CN104317531A CN104317531A CN201410584735.3A CN201410584735A CN104317531A CN 104317531 A CN104317531 A CN 104317531A CN 201410584735 A CN201410584735 A CN 201410584735A CN 104317531 A CN104317531 A CN 104317531A
- Authority
- CN
- China
- Prior art keywords
- data
- distributor
- described data
- disk
- encapsulation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 16
- 238000005538 encapsulation Methods 0.000 claims description 11
- 238000012163 sequencing technique Methods 0.000 claims 7
- 239000000835 fiber Substances 0.000 claims 2
- 230000010076 replication Effects 0.000 abstract description 21
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 238000013523 data management Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
本发明提供一种实现多卷远程复制数据一致性方法及系统,包括以下步骤:将更新数据写入本地对应的磁盘的多个巻后,将更新数据通过数据组合器按照时间顺序进行封装;将封装后的更新数据包通过数据传输器传递给数据分发器后,所述数据分发器根据时间顺序,依次将封装后的更新数据包中的数据分发至对应的远端磁盘的多个巻中。本发明将多个卷中的更新数据以组为单位,按照时间先后进行数据封装,然后发送到远端,从而实现多个卷的远程复制数据一致性。
The present invention provides a method and system for realizing consistency of multi-volume remote replication data, comprising the following steps: after writing update data into multiple volumes of corresponding local disks, encapsulating the update data in chronological order through a data combiner; After the encapsulated update data packet is delivered to the data distributor through the data transmitter, the data distributor sequentially distributes the data in the encapsulated update data packet to multiple volumes of the corresponding remote disk according to the time sequence. The invention encapsulates the updated data in multiple volumes in units of groups according to time, and then sends them to the remote end, so as to realize the consistency of remote replication data of multiple volumes.
Description
技术领域technical field
本发明属于计算机存储领域,尤其涉及一种实现多卷远程复制数据一致性方法及系统。The invention belongs to the field of computer storage, and in particular relates to a method and a system for realizing consistency of multi-volume remote replication data.
背景技术Background technique
目前,数据备份与恢复机制是提高数据安全性和可用性的重要手段,数据备份是指将本地源数据通过网络复制到远端,当本地源数据不可用时,由远端的数据恢复到本地,或者由远端的数据直接提供给上层应用使用,使业务重新正常运行。远程复制是数据管理中抗击大规模物理灾害的重要手段,主要包括面向应用的文件级复制和面向磁盘阵列/面向逻辑卷的块级复制两大类方法,前者更靠近上层应用,容易实现、控制简单,但通用性差;后者则由于对应用透明,具有较强的通用性,不影响主机的正常业务,尤其在较大规模数据复制的应用需求中更有优势。At present, the data backup and recovery mechanism is an important means to improve data security and availability. Data backup refers to copying local source data to the remote end through the network. When the local source data is unavailable, the remote data is restored to the local, or The data from the remote end is directly provided to the upper-layer application for use, so that the business can resume normal operation. Remote replication is an important means of combating large-scale physical disasters in data management. It mainly includes two methods: application-oriented file-level replication and disk array/logical volume-oriented block-level replication. The former is closer to the upper application and is easier to implement and control Simple, but poor in versatility; the latter has strong versatility because it is transparent to applications, and does not affect the normal business of the host, especially in the application requirements of large-scale data replication.
在大中型数据库应用中,数据和日志、修改信息、控制信息等存储在磁盘阵列的不同逻辑卷中,如果一个卷上的数据出错,将会导致多个卷上的整体数据失效,无法使用;同时,如果远端的数据更新顺序发生改变,那么就会造成远端数据和本地数据不一致,从而造成远端数据是不可恢复的。In large and medium-sized database applications, data and logs, modification information, control information, etc. are stored in different logical volumes of the disk array. If the data on one volume is wrong, the overall data on multiple volumes will become invalid and unusable; At the same time, if the update order of the remote data changes, the remote data will be inconsistent with the local data, making the remote data unrecoverable.
发明内容Contents of the invention
本发明提供一种实现多卷远程复制数据一致性方法及系统,以解决上述问题。The present invention provides a method and system for realizing data consistency of multi-volume remote replication to solve the above problems.
本发明提供一种实现多卷远程复制数据一致性方法。上述方法包括以下步骤:The invention provides a method for realizing multi-volume remote replication data consistency. The above method comprises the following steps:
将更新数据写入本地对应的磁盘的多个巻后,将更新数据通过数据组合器按照时间顺序进行封装;After the update data is written into multiple volumes of the local corresponding disk, the update data is encapsulated in chronological order by the data combiner;
将封装后的更新数据包通过数据传输器传递给数据分发器后,所述数据分发器根据时间顺序,依次将封装后的更新数据包中的数据分发至对应的远端磁盘的多个巻中。After the encapsulated update data packet is delivered to the data distributor through the data transmitter, the data distributor sequentially distributes the data in the encapsulated update data packet to multiple volumes of the corresponding remote disk according to the time sequence .
本发明还提供一种实现多卷远程复制数据一致性系统,包括数据组合器,数据传输器,数据分发器;其中,所述数据组合器通过所述数据传输器与所述数据分发器相连;The present invention also provides a system for realizing multi-volume remote replication data consistency, including a data combiner, a data transmitter, and a data distributor; wherein, the data combiner is connected to the data distributor through the data transmitter;
所述数据组合器,用于将更新数据按照时间顺序进行封装后发送至所述数据传输器;The data combiner is configured to encapsulate the update data in chronological order and send it to the data transmitter;
所述数据传输器,用于将封装后的更新数据包传递给数据分发器;The data transmitter is configured to deliver the encapsulated update data packet to the data distributor;
所述数据分发器,用于根据时间顺序,依次将封装后的更新数据包中的数据分发至对应的远端磁盘的多个巻中。The data distributor is configured to sequentially distribute the data in the packaged update data package to multiple volumes of the corresponding remote disk according to the sequence of time.
相较于先前技术,根据本发明提供的一种实现多卷远程复制数据一致性方法及系统,将多个卷中的更新数据以组为单位,按照时间先后进行数据封装,然后发送到远端,从而实现多个卷的远程复制数据一致性。Compared with the prior art, according to the method and system for realizing multi-volume remote replication data consistency provided by the present invention, the update data in multiple volumes is grouped as a unit, and the data is encapsulated in chronological order, and then sent to the remote end , so as to achieve remote replication data consistency of multiple volumes.
附图说明Description of drawings
此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:The accompanying drawings described here are used to provide a further understanding of the present invention and constitute a part of the application. The schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations to the present invention. In the attached picture:
图1所示为本发明实施例1的实现多卷远程复制数据一致性系统结构图;FIG. 1 is a structural diagram of a system for realizing multi-volume remote replication data consistency in Embodiment 1 of the present invention;
图2所示为本发明实施例2的实现多卷远程复制数据一致性方法处理流程图。FIG. 2 is a flowchart of a method for realizing data consistency of multi-volume remote replication according to Embodiment 2 of the present invention.
具体实施方式Detailed ways
下文中将参考附图并结合实施例来详细说明本发明。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。Hereinafter, the present invention will be described in detail with reference to the drawings and examples. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.
图1所示为本发明实施例1的实现多卷远程复制数据一致性系统结构图,该系统包括:本地磁盘LD1、LD2、LD3…LDn,数据组合器1,数据传输器2,数据分发器3,远端磁盘RD1、RD2、RD3…RDn;其中:所述数据组合器通过所述数据传输器与所述数据分发器相连;所述本地磁盘LD1、LD2、LD3…LDn与所述数据组合器相连;所述远端磁盘RD1、RD2、RD3…RDn与所述数据分发器相连;Figure 1 is a structural diagram of a system for realizing multi-volume remote replication data consistency in Embodiment 1 of the present invention. The system includes: local disks LD1, LD2, LD3...LDn, data combiner 1, data transmitter 2, and data distributor 3. Remote disks RD1, RD2, RD3...RDn; wherein: the data combiner is connected to the data distributor through the data transmitter; the local disks LD1, LD2, LD3...LDn are combined with the data connected to the device; the remote disks RD1, RD2, RD3...RDn are connected to the data distributor;
所述本地磁盘LD1、LD2、LD3…LDn,用于将接收的更新数据写入本地对应的磁盘的多个巻中后,将更新数据发送至所述数据组合器1;The local disks LD1, LD2, LD3...LDn are used to write the received update data into multiple volumes of the corresponding local disks, and then send the update data to the data combiner 1;
数据组合器1,是远程复制系统中作用于本地磁盘的一个模块,负责数据的统一组合管理,主要包括:更新数据的封装、时间顺序保证;通过数据传输器2向远端的数据分发器3发送封装后的更新数据包。所述数据组合器1,用于将更新数据按照时间顺序进行封装并写入时间标记后发送至所述数据传输器2;Data combiner 1 is a module that acts on the local disk in the remote replication system and is responsible for the unified combination management of data, mainly including: encapsulation of updated data and time order guarantee; Send the encapsulated update packet. The data combiner 1 is configured to encapsulate the update data in chronological order and write it into a time stamp and then send it to the data transmitter 2;
数据传输器2,是远程复制系统中的数据发送及接受返回结果的模块。主要功能为:向数据分发器3发送封装后的更新数据包;传递数据写入卷的返回结果。所述数据传输器2,还用于将封装后的更新数据包通过IP网络或者光纤网络传递给数据分发器3。所述数据传输器2,还用于接收所述数据分发器3返回的写入结果后,向本地对应的磁盘返回写入结果。The data transmitter 2 is a module for sending data and receiving returned results in the remote replication system. The main functions are: sending the encapsulated update data packet to the data distributor 3; delivering the returned result of data writing into the volume. The data transmitter 2 is further configured to transmit the encapsulated update data packet to the data distributor 3 through the IP network or the optical fiber network. The data transmitter 2 is further configured to return the writing result to the corresponding local disk after receiving the writing result returned by the data distributor 3 .
数据分发器3,是远程复制系统中作用于远端磁盘的一个模块,负责数据的统一分发管理。主要功能包括:接收数据传输器2发送过来的封装后的更新数据包后,向远端对应的磁盘进行分发;接收远端磁盘反馈的写入结果。The data distributor 3 is a module that acts on the remote disk in the remote replication system and is responsible for the unified distribution and management of data. The main functions include: receiving the encapsulated update data packet sent by the data transmitter 2, and then distributing it to the corresponding remote disk; receiving the writing result fed back by the remote disk.
所述远端磁盘RD1、RD2、RD3…RDn,用于接收所述数据分发器3按照时间顺序分发的封装后的更新数据包中的数据后,写入多个巻中;还用于向所述数据分发器3返回写入结果。The remote disks RD1, RD2, RD3...RDn are used to write data in multiple volumes after receiving the data in the encapsulated update packets distributed by the data distributor 3 in chronological order; The data distributor 3 returns the writing result.
图2所示为本发明实施例2的实现多卷远程复制数据一致性方法处理流程图,包括以下步骤:FIG. 2 is a flow chart of a method for realizing multi-volume remote replication data consistency in Embodiment 2 of the present invention, including the following steps:
步骤201:将更新数据写入本地对应的磁盘LD(local disk)的多个巻中;Step 201: write update data in multiple volumes of the local corresponding disk LD (local disk);
步骤202:在多个巻的更新数据写入成功后,将更新数据通过数据组合器按照时间顺序进行封装并写入时间标记;Step 202: After the update data of multiple volumes is successfully written, the update data is encapsulated in chronological order by the data combiner and written into a time stamp;
步骤203:将封装后的更新数据包发送至数据传输器后,数据传输器将封装后的更新数据包通过IP网络或者光纤网络传递给数据分发器;Step 203: After sending the encapsulated update data packet to the data transmitter, the data transmitter transmits the encapsulated update data packet to the data distributor through the IP network or optical fiber network;
步骤204:数据分发器根据时间顺序,依次将封装后的更新数据包中的数据分发至对应的远端磁盘RD(remote disk)的多个巻中;Step 204: the data distributor distributes the data in the encapsulated update data packet to multiple volumes of the corresponding remote disk RD (remote disk) in sequence according to the time sequence;
步骤205:数据写入对应的远端磁盘RD后,向数据分发器返回写入结果;数据分发器向数据传输器返回写入结果;数据传输器向本地对应的磁盘返回写入结果。Step 205: After the data is written to the corresponding remote disk RD, return the writing result to the data distributor; the data distributor returns the writing result to the data transmitter; and the data transmitter returns the writing result to the corresponding local disk.
相较于先前技术,根据本发明提供的一种实现多卷远程复制数据一致性方法及系统,将多个卷中的更新数据以组为单位,按照时间先后进行数据封装,然后发送到远端,从而实现多个卷的远程复制数据一致性。Compared with the prior art, according to the method and system for realizing multi-volume remote replication data consistency provided by the present invention, the update data in multiple volumes is grouped as a unit, and the data is encapsulated in chronological order, and then sent to the remote end , so as to achieve remote replication data consistency of multiple volumes.
以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.
Claims (9)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410584735.3A CN104317531A (en) | 2014-10-27 | 2014-10-27 | Method and system for realizing multi-volume remote copy data consistency |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410584735.3A CN104317531A (en) | 2014-10-27 | 2014-10-27 | Method and system for realizing multi-volume remote copy data consistency |
Publications (1)
Publication Number | Publication Date |
---|---|
CN104317531A true CN104317531A (en) | 2015-01-28 |
Family
ID=52372767
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410584735.3A Pending CN104317531A (en) | 2014-10-27 | 2014-10-27 | Method and system for realizing multi-volume remote copy data consistency |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104317531A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108052419A (en) * | 2018-01-05 | 2018-05-18 | 哈尔滨学院 | A kind of method of data disaster tolerance |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1495612A (en) * | 2002-08-07 | 2004-05-12 | �Ҵ���˾ | Method for updating timing information of retaining buffer stored data object and system |
US7472173B2 (en) * | 2004-03-18 | 2008-12-30 | Hitachi, Ltd. | Remote data copying among storage systems |
CN102761615A (en) * | 2012-06-29 | 2012-10-31 | 浪潮(北京)电子信息产业有限公司 | Method and device for realizing data synchronism of long-distance duplication system |
-
2014
- 2014-10-27 CN CN201410584735.3A patent/CN104317531A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1495612A (en) * | 2002-08-07 | 2004-05-12 | �Ҵ���˾ | Method for updating timing information of retaining buffer stored data object and system |
US7472173B2 (en) * | 2004-03-18 | 2008-12-30 | Hitachi, Ltd. | Remote data copying among storage systems |
CN102761615A (en) * | 2012-06-29 | 2012-10-31 | 浪潮(北京)电子信息产业有限公司 | Method and device for realizing data synchronism of long-distance duplication system |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108052419A (en) * | 2018-01-05 | 2018-05-18 | 哈尔滨学院 | A kind of method of data disaster tolerance |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8898409B1 (en) | Journal-based replication without journal loss | |
US9069709B1 (en) | Dynamic granularity in data replication | |
US9336094B1 (en) | Scaleout replication of an application | |
US8954796B1 (en) | Recovery of a logical unit in a consistency group while replicating other logical units in the consistency group | |
US9367260B1 (en) | Dynamic replication system | |
US9910621B1 (en) | Backlogging I/O metadata utilizing counters to monitor write acknowledgements and no acknowledgements | |
US10496487B1 (en) | Storing snapshot changes with snapshots | |
US9411534B2 (en) | Time stamp generation for virtual disks | |
US9495409B1 (en) | Techniques for performing data validation | |
US9632881B1 (en) | Replication of a virtual distributed volume | |
US9483205B2 (en) | Writing to a storage platform including a plurality of storage clusters | |
US9798489B2 (en) | Cloning a virtual disk in a storage platform | |
US9110914B1 (en) | Continuous data protection using deduplication-based storage | |
US9558085B2 (en) | Creating and reverting to a snapshot of a virtual disk | |
CA2905355C (en) | Synchronous mirroring in non-volatile memory systems | |
TW454120B (en) | Flexible remote data mirroring | |
US9383937B1 (en) | Journal tiering in a continuous data protection system using deduplication-based storage | |
US8996460B1 (en) | Accessing an image in a continuous data protection using deduplication-based storage | |
US9158630B1 (en) | Testing integrity of replicated storage | |
US9189341B1 (en) | Method and apparatus for multi-copy replication using a multi-splitter | |
US7149919B2 (en) | Disaster recovery system with cascaded resynchronization | |
US20220171557A1 (en) | Aggregate inline deduplication with volume granular encryption | |
US10235087B1 (en) | Distributing journal data over multiple journals | |
US9684576B1 (en) | Replication using a virtual distributed volume | |
US10558565B2 (en) | Garbage collection implementing erasure coding |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150128 |
|
WD01 | Invention patent application deemed withdrawn after publication |