CN103973727B - Method of data synchronization and device - Google Patents
Method of data synchronization and device Download PDFInfo
- Publication number
- CN103973727B CN103973727B CN201310032868.5A CN201310032868A CN103973727B CN 103973727 B CN103973727 B CN 103973727B CN 201310032868 A CN201310032868 A CN 201310032868A CN 103973727 B CN103973727 B CN 103973727B
- Authority
- CN
- China
- Prior art keywords
- data
- synchronization
- failure
- data block
- record
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 230000001360 synchronised effect Effects 0.000 claims abstract description 65
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims abstract description 64
- 238000000605 extraction Methods 0.000 claims description 14
- 238000001514 detection method Methods 0.000 claims description 7
- 239000000284 extract Substances 0.000 claims description 4
- 108010001267 Protein Subunits Proteins 0.000 claims 1
- 238000012217 deletion Methods 0.000 claims 1
- 230000037430 deletion Effects 0.000 claims 1
- 230000000116 mitigating effect Effects 0.000 abstract description 6
- 230000008021 deposition Effects 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 8
- 238000009825 accumulation Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Landscapes
- Hardware Redundancy (AREA)
Abstract
The invention discloses a kind of method of data synchronization and devices, belong to computer field.The described method includes: the data block in source data is synchronized to copy data；Detect the data block whether synchronization failure；If it is detected that the data block synchronization failure, the corresponding Data Identification of the data block is added into synchronization failure flowing water；Continue next not synchronous data block in the source data being synchronized to the copy data；Re-synchronization is carried out to the data block according to the synchronization failure flowing water in a subsequent predetermined point of time.The present invention passes through in the data block synchronization failure for detecting current sync, the corresponding mark of the data block is added into synchronization failure flowing water, continue to synchronize next not synchronous data block simultaneously, it solves in the prior art, the problem of request bulk deposition is retried caused by when being retried at once after detecting data block synchronization failure, mitigation system pressure is reached, the purpose for avoiding loss of data risk from aggravating.
Description
Technical field
The present invention relates to computer field, in particular to a kind of method of data synchronization and device.
Background technique
It, can be by user data in order to solve the problems, such as that user data is surprisingly lost with the continuous development of network application
It is synchronized in different equipment or system.When progress high-volume data are synchronous, due to failure or network fluctuation etc.,
Often have a certain proportion of failure of data synchronization.
Existing method of data synchronization, when being synchronized to a data block, detect the data block whether synchronization failure, when
When detecting the data block synchronization failure, the synchronized process of the data block is retried at once, until the data block synchronizes success.
In the implementation of the present invention, the inventor finds that the existing technology has at least the following problems:
Method of data synchronization used by the prior art, in the feelings that failure or network fluctuation problem cannot be resolved in time
Under condition, it will cause and retry request bulk deposition, system pressure increases, and is further exacerbated by loss of data risk.
Summary of the invention
When in order to solve failure of data synchronization in the prior art, request bulk deposition is retried, increases system pressure, data are lost
It goes wrong dangerous the problem of aggravating, the embodiment of the invention provides a kind of method of data synchronization and devices.The technical solution is as follows:
On the one hand, a kind of method of data synchronization is provided, which comprises
A data block in source data is synchronized to copy data；
Detect the data block whether synchronization failure；
If it is detected that the data block synchronization failure, is added into synchronization failure for the corresponding Data Identification of the data block
In flowing water；
Continue next not synchronous data block in the source data being synchronized to the copy data；
Re-synchronization is carried out to the data block according to the synchronization failure flowing water in a subsequent predetermined point of time.
On the other hand, a kind of data synchronization unit is provided, described device includes:
First synchronization module, for the data block in source data to be synchronized to copy data；
Detection module, for detect the data block whether synchronization failure；
Flow Record module, if detecting that the synchronous data block of first synchronization module is synchronous for the detection module
The corresponding Data Identification of the data block, then be added into synchronization failure flowing water by failure；
First synchronization module, for after the data block in source data is synchronized to copy data, continue by
Next not synchronous data block in the source data is synchronized to the copy data；
Second synchronization module is used in a subsequent predetermined point of time according to the synchronization failure flowing water to the data block
Carry out re-synchronization.
Technical solution provided in an embodiment of the present invention has the benefit that
By the way that in the data block synchronization failure for detecting current sync, the corresponding mark of the data block is added into synchronous mistake
Flowing water is lost, while continuing to synchronize next not synchronous data block, solves in the prior art, is detecting data block synchronization failure
The problem of request bulk deposition is retried caused by when being retried at once afterwards, has reached mitigation system pressure, has avoided loss of data
The purpose of risk aggravation；Also by being carried out again according to the synchronization failure flowing water to the data block in a subsequent predetermined point of time
It is synchronous, it solves the problems, such as to reach because data are inconsistent caused by once not retrying the data block of synchronization failure
Final accurate synchronization all data, the purpose for being consistent copy data and source data.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for
For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings other
Attached drawing.
Fig. 1 is the method flow diagram for the method for data synchronization that the embodiment of the present invention one provides；
Fig. 2 is the method flow diagram of method of data synchronization provided by Embodiment 2 of the present invention；
Fig. 3 is the process flow diagram of method of data synchronization provided by Embodiment 2 of the present invention；
Fig. 4 is the apparatus structure schematic diagram for the data synchronization unit that the embodiment of the present invention three provides；
Fig. 5 is the apparatus structure schematic diagram for the data synchronization unit that the embodiment of the present invention four provides.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached drawing to embodiment party of the present invention
Formula is described in further detail.
Embodiment one
Referring to FIG. 1, the method flow diagram of the method for data synchronization provided it illustrates the embodiment of the present invention one.The data
Synchronous method may include:
Step 102, the data block in source data is synchronized to copy data；
Step 104, detect the data block whether synchronization failure；
Step 106, if it is detected that the data block synchronization failure, is added into synchronization for the corresponding Data Identification of the data block
In failure flowing water；
Step 108, continue next not synchronous data block in the source data being synchronized to the copy data；
Step 110, re-synchronization is carried out to the data block according to the synchronization failure flowing water in a subsequent predetermined point of time.
In conclusion the method for data synchronization that the embodiment of the present invention one provides, by the data for detecting current sync
When block synchronization failure, the corresponding mark of the data block is added into synchronization failure flowing water, while continuing to synchronize next not synchronous number
According to block, solve in the prior art, when being retried at once after detecting data block synchronization failure caused by retry request big
The problem of amount accumulation, mitigation system pressure is reached, the purpose for avoiding loss of data risk from aggravating；The embodiment of the present invention one provides
Method of data synchronization, also by a subsequent predetermined point of time according to the synchronization failure flowing water to the data block carry out again
It is synchronous, it solves the problems, such as to reach because data are inconsistent caused by once not retrying the data block of synchronization failure
Final accurate synchronization all data, the purpose for being consistent copy data and source data.
Embodiment two
Referring to FIG. 2, it illustrates the method flow diagrams of method of data synchronization provided by Embodiment 2 of the present invention.As base
In the particularly preferred embodiment that embodiment one provides, which may include:
Step 202, the data block in source data is synchronized to copy data by data synchronization unit；
Specifically, the copy of the data block in the available source data of data synchronization unit, and the data block that will acquire
Replica updating copy data in corresponding data block.
Step 204, data synchronization unit detect the data block whether synchronization failure；
Specifically, data synchronization unit after a data block is synchronized to copy data, can wait the number of copies to be received
The synchronization success response or synchronization failure response corresponding to the data block returned according to place device；If receiving correspondence
It is responded in the synchronization failure of the data block, or is not received by synchronizes success corresponding to the data block within a predetermined period of time
Any one of response or synchronization failure response, then confirmation detects the data block synchronization failure.
Step 206, if it is detected that the data block synchronization failure, data synchronization unit is by the corresponding data mark of the data block
Knowledge is added into synchronization failure flowing water；
Specifically, the synchronization failure flowing water is made of a series of failure record.Failure record, which includes at least, the failure
The Data Identification of the data block of the record time and synchronization failure of record, such as the data ID(Identity of the data block, sequence
Number), in addition, can also include in user information corresponding with the data block, action type and data in the failure record
The information such as appearance.
If it is detected that the data block synchronization failure, data synchronization unit is generated according to the corresponding Data Identification of the data block
One failure record, and the failure record of generation is added in synchronization failure flowing water.
Step 208, data synchronization unit continues next not synchronous data block in the source data being synchronized to the copy
Data；
Data synchronization unit the data block to synchronization failure will not carry out at once when being tested with data block synchronization failure
It retries, but first by the data identity record of the data block of the synchronization failure to synchronization failure flowing water, and continue to synchronize next
Not synchronous data block.
Step 210, data synchronization unit in a subsequent predetermined point of time according to the synchronization failure flowing water to the data block
Carry out re-synchronization.
Specifically, retried caused by order to avoid cannot be resolved in time because of failure or network fluctuation problem process after
The problem of continuous failure, data synchronization unit after this is subsynchronous, do not need to extract at once synchronization failure flowing water carry out it is again same
Step, but the synchronization failure flowing water is extracted in a subsequent predetermined point of time, and according to the number in the synchronization failure flowing water of extraction
According to mark, re-synchronization is carried out to the data block of synchronization failure.
Wherein, the predetermined point of time be preset specific time point, according to predetermined period determine time point or
The time point determined according to network condition；Specifically, data synchronization unit can extract synchronous mistake according to scheduled time point
Flowing water is lost, for example, it is again same to be predefined in the data block progress that 0 point of daily morning extraction synchronization failure flowing water comes to synchronization failure
Step；Alternatively, data synchronization unit can be every certain synchronization failure flowing water of periodicity extraction, for example, extracting every 4 hours
Synchronization failure flowing water to carry out re-synchronization to the data block of synchronization failure；Also or, data synchronization unit can also be
It detects and synchronization failure flowing water is extracted to carry out re-synchronization to the data block of synchronization failure when present network conditions are preferable.
In addition, data synchronization unit before the data block to synchronization failure carries out re-synchronization, can also lose to synchronous
It loses the identical failure record of Data Identification in flowing water to merge, carries out multiple re-synchronization to avoid to same data block.Its
In, can have much to the method that the identical failure record of Data Identification merges in synchronization failure flowing water, it is specific for example, number
It can be extracted in the identical failure record of Data Identification according to synchronizing device, record time and the immediate failure of current time
Record, and the Data Identification in the failure record of extraction is added into miss data identification list；Data synchronization unit is according to this
Data Identification in miss data identification list carries out re-synchronization to the data block of the synchronization failure.
Specifically, data synchronization unit is according to the Data Identification in the miss data identification list, to the synchronization failure
The specific steps that data block carries out re-synchronization can be such that
Data synchronization unit judges the data block of synchronization failure in source according to the Data Identification in miss data identification list
It whether there is in data.If judging, the data block of synchronization failure exists in source data, and data synchronization unit is by the source number
The data block re-synchronization of the synchronization failure present in is to copy data, and by the number of synchronization failure present in the source data
Write-in copy data is covered according to block.If judging, the data block of synchronization failure is not present in source data, data synchronization unit
The data block of synchronization failure in copy data is deleted.
As the preferred of above-mentioned steps, Data Identification of the data synchronization unit in the synchronization failure flowing water according to extraction,
After carrying out re-synchronization to the data block of synchronization failure, this synchronization failure flowing water extracted can be emptied or be deleted, with
When avoiding extracting synchronization failure flowing water next time, the synchronization failure flowing water of extracted mistake is carried out to repeat extraction.
In addition, it is necessary to explanation, generally requires to carry out between different devices since data synchronize, this hair
Equipment where the data synchronization unit that bright embodiment two provides is not fixed.Data synchronization unit can be deployed in source number
According to place equipment, it can also be deployed in equipment where copy data, alternatively, data synchronization unit, which has, can also be deployed in third party
Relay device, even, the disparate modules in the data synchronization unit can be respectively deployed in different equipment, in this regard, this hair
Bright embodiment two is not especially limited.
Further, the purposes of the copy data synchronized with source data can be divided into two kinds: one is as source number
According to backup, source data lose when, can be restored according to copy data；Another kind is as the number being equal with source data
According to source, to improve the speed for reading or loading in reading data or load.But regardless of which kind of purposes, require copy
Data and source data are completely the same just available, and therefore, data synchronization unit can be arranged one uniquely for each copy data
Status indication, when the status indication of a copy data is arranged to available, which just can be used as source data
Backup or the data source same with source data.
In order to be described further to above-mentioned method of data synchronization, referring to FIG. 3, it illustrates above-mentioned method of data synchronization
Process flow diagram in practical applications.At the moment 1, the data block 1-5 in source data is synchronized to copy by data synchronization unit
Data, wherein data block 1,3,5 synchronizes success, and the synchronization failure of data block 2 and 4；Data synchronization unit is according to synchronization failure
The Data Identification of data block 2 and 4 generates synchronization failure flowing water.At the subsequent a certain moment 2, data synchronization unit extracts synchronous lose
Flowing water is lost, and re-synchronization is carried out according to data block 2 and 4 of the synchronization failure flowing water to synchronization failure, if this moment data block 2
Exist in source data, then by 2 re-synchronization of data block in source data to copy data, if this moment data block 4 is in source
Data are not present, then delete the data block 4 in copy data.In addition, if in re-synchronization process, and synchronization failure occurs
Situation then continues to generate synchronization failure flowing water.
When data synchronization unit starts to synchronize a copy data, first by the status indication of the copy data
Be set as unavailable, when synchronously completing, and detect in source data all data blocks all it is synchronous with the copy data successfully when, then
Set available for the status indication of the copy data.
In conclusion method of data synchronization provided by Embodiment 2 of the present invention, by the data for detecting current sync
When block synchronization failure, the corresponding mark of the data block is added into synchronization failure flowing water, while continuing to synchronize next not synchronous number
According to block, solve in the prior art, when being retried at once after detecting data block synchronization failure caused by retry request big
The problem of amount accumulation, mitigation system pressure is reached, the purpose for avoiding loss of data risk from aggravating；Second embodiment of the present invention provides
Method of data synchronization, also by a subsequent predetermined point of time according to the synchronization failure flowing water to the data block carry out again
It is synchronous, it solves the problems, such as to reach because data are inconsistent caused by once not retrying the data block of synchronization failure
Final accurate synchronization all data, the purpose for being consistent copy data and source data；In addition, the embodiment of the present invention two mentions
The method of data synchronization of confession, also by the Data Identification in the synchronization failure flowing water according to extraction, to the data of synchronization failure
Before block carries out re-synchronization, the identical failure record of Data Identification in synchronization failure flowing water is merged, is solved same
There are in the case where the identical failure record of a plurality of Data Identification in step failure flowing water, same data block is carried out repeatedly again same
The problem of step, has achieved the purpose that reduce the read-write step in synchronizing process.
Embodiment three
Referring to FIG. 4, the structure drawing of device of the data synchronization unit provided it illustrates the embodiment of the present invention three, the device
May include:
First synchronization module 301, for the data block in source data to be synchronized to copy data；
Detection module 302, for detect the synchronous data block of the first synchronization module 301 whether synchronization failure；
Flow Record module 303, if the data block synchronization failure is detected for detection module 302, by the data block
Corresponding Data Identification is added into synchronization failure flowing water；
First synchronization module 301, for continuing source after the data block in source data is synchronized to copy data
Next not synchronous data block in data is synchronized to copy data；
Second synchronization module 304 is used in a subsequent predetermined point of time according to the synchronization failure flowing water to the data block
Carry out re-synchronization.
In conclusion the data synchronization unit that the embodiment of the present invention three provides, by the data for detecting current sync
When block synchronization failure, the corresponding mark of the data block is added into synchronization failure flowing water, while continuing to synchronize next not synchronous number
According to block, solve in the prior art, when being retried at once after detecting data block synchronization failure caused by retry request big
The problem of amount accumulation, mitigation system pressure is reached, the purpose for avoiding loss of data risk from aggravating；In addition, the embodiment of the present invention
Three provide data synchronization units, also by a subsequent predetermined point of time according to the synchronization failure flowing water to the data block into
Row re-synchronization is solved and is asked because data are inconsistent caused by not retrying at once to the data block of synchronization failure
Topic, has reached all data of final accurate synchronization, the purpose for being consistent copy data and source data.
Example IV
Referring to FIG. 5, the structure drawing of device of the data synchronization unit provided it illustrates the embodiment of the present invention four.As base
In embodiment three provide particularly preferred embodiment, the apparatus may include:
First synchronization module 301, for the data block in source data to be synchronized to copy data；
Detection module 302, for detect the synchronous data block of the first synchronization module 301 whether synchronization failure；
Flow Record module 303, it is if detecting data block synchronization failure for detection module 302, data block is corresponding
Data Identification be added into synchronization failure flowing water；
First synchronization module 301, for continuing source after the data block in source data is synchronized to copy data
Next not synchronous data block in data is synchronized to copy data；
Second synchronization module 304 is used in a subsequent predetermined point of time according to the synchronization failure flowing water to the data block
Carry out re-synchronization.
In addition, the second synchronization module 304 includes:
Day-to-day drawing unit 3041, for extracting the same of the record of Flow Record module 303 in a subsequent predetermined point of time
Step failure flowing water, the predetermined point of time are preset specific time point, according to predetermined period determining time point or root
The time point determined according to network condition；
Synchronization unit 3042, the Data Identification in synchronization failure flowing water for being extracted according to day-to-day drawing unit 3041,
Re-synchronization is carried out to the data block of synchronization failure.
Wherein, synchronization unit 3042 includes:
Judgment sub-unit 3042a, the data mark in synchronization failure flowing water for being extracted according to day-to-day drawing unit 3041
Knowledge judges that the data block of synchronization failure whether there is in source data；
Synchronous subelement 3042b, if judging the data block of synchronization failure in source data for judgment sub-unit 3042a
In the presence of then by the data block re-synchronization of synchronization failure present in source data to copy data；
Subelement 3042c is deleted, if judging the data block of synchronization failure in source data for judgment sub-unit 3042a
It is not present, then deletes the data block of the synchronization failure in copy data.
Wherein, Flow Record module 303, comprising:
Record generation unit 3031, for generating a failure record according to the corresponding Data Identification of data block；
Adding unit 3032 is recorded, the failure record for generating record generation unit 3031 is added to synchronization failure stream
Water.
It also include the record time in the failure record；Second synchronization module 304 further include:
Record extraction unit 3043, the synchronization for extracting in judgment sub-unit 3042a according to day-to-day drawing unit 3041
Before Data Identification in failure flowing water judges that the data block of synchronization failure whether there is in source data, Data Identification phase is extracted
In same failure record, record time and the immediate failure record of current time；
Wherein, data synchronization unit records extraction unit before the data block to synchronization failure carries out re-synchronization
3043 can merge the identical failure record of Data Identification in synchronization failure flowing water, carry out to avoid to same data block
Multiple re-synchronization.
List adding unit 3044, for the addition of the Data Identification in the failure record that extraction unit 3043 extracts will to be recorded
Enter miss data identification list；
Judgment sub-unit 3042a, for judging the number of synchronization failure according to the Data Identification in miss data identification list
It whether there is in source data according to block.
It should be noted that the data synchronization unit that the embodiment of the present invention four provides, can be deployed in where source data
Equipment can also be deployed in equipment where copy data, alternatively, the data synchronization unit, which has, can also be deployed in third party's transfer
Equipment, in this regard, the embodiment of the present invention three is not especially limited.
In conclusion the data synchronization unit that the embodiment of the present invention four provides, by the data for detecting current sync
When block synchronization failure, the corresponding mark of the data block is added into synchronization failure flowing water, while continuing to synchronize next not synchronous number
According to block, solve in the prior art, when being retried at once after detecting data block synchronization failure caused by retry request big
The problem of amount accumulation, mitigation system pressure is reached, the purpose for avoiding loss of data risk from aggravating；The embodiment of the present invention four provides
Data synchronization unit, also by a subsequent predetermined point of time according to the synchronization failure flowing water to the data block carry out again
It is synchronous, it solves the problems, such as to reach because data are inconsistent caused by once not retrying the data block of synchronization failure
Final accurate synchronization all data, the purpose for being consistent copy data and source data；In addition, the embodiment of the present invention four mentions
The data synchronization unit of confession, also by the Data Identification in the synchronization failure flowing water according to extraction, to the data of synchronization failure
Before block carries out re-synchronization, the identical failure record of Data Identification in synchronization failure flowing water is merged, is solved same
There are in the case where the identical failure record of a plurality of Data Identification in step failure flowing water, same data block is carried out repeatedly again same
The problem of step, has achieved the purpose that reduce the read-write step in synchronizing process.
It should be understood that data synchronization unit provided by the above embodiment carry out data it is synchronous when, only with above-mentioned each
The division progress of functional module can according to need and for example, in practical application by above-mentioned function distribution by different function
Energy module is completed, i.e., the internal structure of device is divided into different functional modules, to complete whole described above or portion
Divide function.In addition, data synchronization unit provided by the above embodiment and method of data synchronization embodiment belong to same design, have
Body realizes that process is detailed in embodiment of the method, and which is not described herein again.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Those of ordinary skill in the art will appreciate that realizing that all or part of the steps of above-described embodiment can pass through hardware
It completes, relevant hardware can also be instructed to complete by program, the program can store in a kind of computer-readable
In storage medium, storage medium mentioned above can be read-only memory, disk or CD etc..
The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all in spirit of the invention and
Within principle, any modification, equivalent replacement, improvement and so on be should all be included in the protection scope of the present invention.
Claims (3)
1. a kind of method of data synchronization, which is characterized in that the described method includes:
A data block in source data is synchronized to copy data；Detect the data block whether synchronization failure；
If it is detected that the data block synchronization failure, generates one according to the corresponding Data Identification of the data block and unsuccessfully remembers
Record；The failure record of generation is added to synchronization failure flowing water；Continue next not synchronous number in the source data
The copy data is synchronized to according to block；
It include the record time in the failure record；Before the data block to synchronization failure carries out re-synchronization, number is extracted
According to identifying in identical failure record, the record time and the immediate failure record of current time；
Data Identification in the failure record of extraction is added into miss data identification list；In a subsequent predetermined time
Point extracts the miss data identification list, and the predetermined point of time is preset specific time point, according to predetermined period
Determining time point or the time point determined according to network condition；
Judge the data block of the synchronization failure in the source data according to the Data Identification in the miss data identification list
In whether there is；
If judging, the data block of the synchronization failure exists in the source data, will be described present in the source data
The data block re-synchronization of synchronization failure is to the copy data；If judging the data block of the synchronization failure in the source number
It is not present, then deletes the data block of the synchronization failure in the copy data in；
After by the data block re-synchronization to the copy data of the synchronization failure present in the source data, institute is deleted
State synchronization failure flowing water；
The method also includes:
When starting to synchronize the data block, down state is set by the status indication of the copy data；
When synchronously completing, and detect in the source data all data blocks all it is synchronous with the copy data successfully when, by institute
The status indication for stating copy data is set as available mode.
2. a kind of data synchronization unit, which is characterized in that described device includes:
First synchronization module, for the data block in source data to be synchronized to copy data；
Detection module, for detect the synchronous data block of first synchronization module whether synchronization failure；
Flow Record module, comprising:
Record generation unit, for generating a failure record according to the corresponding Data Identification of the data block；
Adding unit is recorded, the failure record for generating the record generation unit is added to synchronization failure flowing water；
First synchronization module, for after the data block in source data is synchronized to copy data, continuing will be described
Next not synchronous data block in source data is synchronized to the copy data；
For to synchronization failure data block carry out re-synchronization before, it is identical to Data Identification in the synchronization failure flowing water
Failure record merge, obtain the module of miss data identification list；
Second synchronization module is used in a subsequent predetermined point of time according to the miss data identification list to the data block
Carry out re-synchronization；
It also include the record time in the failure record；It is described for synchronization failure data block carry out re-synchronization it
Before, the identical failure record of Data Identification in the synchronization failure flowing water is merged, miss data identification list is obtained
Module, comprising:
Extraction unit is recorded, for extracting in the identical failure record of Data Identification, the record time most connects with current time
A close failure record；
List adding unit, the Data Identification in the failure record for extracting the record extraction unit are added into institute
State miss data identification list；
Second synchronization module includes:
Day-to-day drawing unit, for extracting the miss data identification list, the pre- timing in a subsequent predetermined point of time
Between point be preset specific time point, according to predetermined period determine time point or according to network condition determine time
Point；
Synchronization unit, for according to the Data Identification in the miss data identification list, to the data block of the synchronization failure
Carry out re-synchronization；
The synchronization unit includes:
Judgment sub-unit, for judging the data of the synchronization failure according to the Data Identification in the miss data identification list
Block whether there is in the source data；
Synchronous subelement, if judging that the data block of the synchronization failure is deposited in the source data for the judgment sub-unit
Then by the data block re-synchronization of the synchronization failure present in the source data to the copy data；
Subelement is deleted, if judging the data block of the synchronization failure in the source data not for the judgment sub-unit
In the presence of then by the data block deletion of the synchronization failure in the copy data；
The synchronization unit further includes for by the data block re-synchronization of the synchronization failure present in the source data
After to the copy data, the subelement of the synchronization failure flowing water is deleted；
Described device further includes module for performing the following operations:
When starting to synchronize the data block, down state is set by the status indication of the copy data；
When synchronously completing, and detect in the source data all data blocks all it is synchronous with the copy data successfully when, by institute
The status indication for stating copy data is set as available mode.
3. a kind of computer readable storage medium, which is characterized in that be stored with program, institute in the computer readable storage medium
Program is stated for realizing method of data synchronization as described in claim 1.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310032868.5A CN103973727B (en) | 2013-01-28 | 2013-01-28 | Method of data synchronization and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310032868.5A CN103973727B (en) | 2013-01-28 | 2013-01-28 | Method of data synchronization and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103973727A CN103973727A (en) | 2014-08-06 |
| CN103973727B true CN103973727B (en) | 2019-03-19 |
Family
ID=51242772
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310032868.5A Active CN103973727B (en) | 2013-01-28 | 2013-01-28 | Method of data synchronization and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103973727B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105450682B (en) * | 2014-08-08 | 2019-12-06 | 阿里巴巴集团控股有限公司 | Method, device and system for synchronously storing data and synchronizing data to client |
| CN105282253A (en) * | 2015-11-04 | 2016-01-27 | 湖南御家科技有限公司 | Data document synchronization method and system |
| CN105760415A (en) * | 2015-12-30 | 2016-07-13 | 深圳市鼎芯无限科技有限公司 | Data processing method and device |
| CN109561126B (en) * | 2017-09-27 | 2022-01-28 | 北京国双科技有限公司 | Data synchronization method and device, storage medium and processor |
| CN107948318B (en) * | 2017-12-27 | 2021-02-19 | 世纪龙信息网络有限责任公司 | Method and system for synchronizing cache among multiple nodes |
| CN109561151B (en) * | 2018-12-12 | 2021-09-17 | 北京达佳互联信息技术有限公司 | Data storage method, device, server and storage medium |
| CN113886497A (en) * | 2021-10-09 | 2022-01-04 | 北京房江湖科技有限公司 | Bidirectional real-time data monitoring method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101018113A (en) * | 2007-01-24 | 2007-08-15 | 华为技术有限公司 | The method for synchronizing data and obtaining the data synchronization result and its system and HLR |
| CN101216832A (en) * | 2007-12-28 | 2008-07-09 | 腾讯科技（深圳）有限公司 | Data synchronization process and device |
| US7804838B2 (en) * | 2004-01-09 | 2010-09-28 | Thomson Licensing | Time synchronizing device and process and associated products |
| CN102447742A (en) * | 2011-11-24 | 2012-05-09 | 中兴通讯股份有限公司 | Dynamic data active and standby synchronization method and system as well as metadata server |
| CN102594874A (en) * | 2008-06-20 | 2012-07-18 | 华为技术有限公司 | Synchronization processing method and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101719149B (en) * | 2009-12-03 | 2012-02-08 | 联动优势科技有限公司 | Data synchronization method and device |
-
2013
- 2013-01-28 CN CN201310032868.5A patent/CN103973727B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7804838B2 (en) * | 2004-01-09 | 2010-09-28 | Thomson Licensing | Time synchronizing device and process and associated products |
| CN101018113A (en) * | 2007-01-24 | 2007-08-15 | 华为技术有限公司 | The method for synchronizing data and obtaining the data synchronization result and its system and HLR |
| CN101216832A (en) * | 2007-12-28 | 2008-07-09 | 腾讯科技（深圳）有限公司 | Data synchronization process and device |
| CN102594874A (en) * | 2008-06-20 | 2012-07-18 | 华为技术有限公司 | Synchronization processing method and device |
| CN102447742A (en) * | 2011-11-24 | 2012-05-09 | 中兴通讯股份有限公司 | Dynamic data active and standby synchronization method and system as well as metadata server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103973727A (en) | 2014-08-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103973727B (en) | Method of data synchronization and device | |
| CN109165229B (en) | Method, device, equipment and storage medium for checking local block synchronization | |
| CN106302806B (en) | A kind of method of data synchronization, system, synchronous obtaining method and relevant apparatus | |
| CN105376277B (en) | A kind of method of data synchronization and device | |
| CN104504062B (en) | Master/slave data storehouse method of data synchronization and device | |
| CN105843702B (en) | A kind of method and device for data backup | |
| KR101662212B1 (en) | Database Management System providing partial synchronization and method for partial synchronization thereof | |
| CN106354583B (en) | A kind of heat backup method and system of MySQL database | |
| CN106445414B (en) | Method and system for expanding available storage space of terminal equipment | |
| CN105068856A (en) | Mirror image snapshooting based on virtual machine backup system and backup method | |
| CN111651523B (en) | MySQL data synchronization method and system of Kubernetes container platform | |
| CN109933632B (en) | Data migration method, device and equipment for database | |
| RU2004105884A (en) | METHOD FOR MANAGING FILE REPLICATION IN APPLICATIONS | |
| JP2001356945A (en) | Data backup recovery system | |
| CN103678044B (en) | The data reconstruction method of the RAID5 under EXT3 file system and device | |
| EP3178022A1 (en) | Data storage upon database failure | |
| CN106202365A (en) | Method, system and the data-base cluster that database update synchronizes | |
| CN106802895A (en) | For repair data storehouse for database data method and apparatus | |
| CN109656992A (en) | A kind of data transmission account checking method, device and equipment | |
| CN105550230B (en) | The method for detecting and device of distributed memory system node failure | |
| CN104636218B (en) | Data reconstruction method and device | |
| CN105893176A (en) | Management method and device of network storage system | |
| CN110825758B (en) | Transaction processing method and device | |
| CN103581262A (en) | Master-and-backup data synchronizing method, device and system | |
| CN109005246B (en) | A data synchronization method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |