CN105404701B - A kind of heterogeneous database synchronization method based on peer-to-peer network - Google Patents

Abstract

The invention discloses a method for synchronizing heterogeneous databases based on a peer-to-peer network. The method is implemented on a heterogeneous database synchronization device, including routing nodes and global agent services; the steps of the method are as follows: database information is changed and fed back to the global agent service; the global proxy service broadcasts the changed information to the routing proxy in each node; through the global proxy server, update the resource information of each node, record the updated information with a time stamp, and update it to the blockchain: update the node’s The agent synchronizes the state, records the timestamp and the information to be changed, and feeds the updated state back to the global agent. The device of the present invention can greatly improve the reliability and availability of database synchronization through decentralization and self-management of each node. The method of the present invention is based on block chain technology, has complete data exchange records, and solves the non-traceability of data exchange in the traditional central mode.

Description

A Synchronization Method for Heterogeneous Databases Based on Peer-to-Peer Network

technical field

The invention belongs to the field of information technology, and in particular relates to a method for synchronizing heterogeneous databases based on a peer-to-peer network.

Background technique

The development of information technology in Guanmin is changing with each passing day. Many information systems were built in different periods and designed by different manufacturers, which makes the platforms of these systems often show heterogeneity, resulting in data inconsistency. If data information is not effectively shared, these independent data systems will become "information islands"; in addition, with the vigorous development of enterprise business and the continuous improvement of informatization, the data exchange between various application systems is also increasingly Frequently, it will bring such a problem: the demand for data exchange and data synchronization between different platforms and data sources in different formats is becoming more and more extensive. But in terms of data exchange, since there is no standard data exchange and synchronization tool, it is very difficult to realize data exchange and synchronization. Therefore, enterprises are eager to integrate data in various information, eliminate "information islands", ensure smooth information exchange between information systems, ensure the consistency and security of data transmission, and truly realize data sharing. Therefore, how to flexibly and effectively process the information in these heterogeneous databases and realize the synchronization of heterogeneous database information has become a research issue that has attracted much attention.

The heterogeneity of the heterogeneous database system is mainly reflected in the use of different hardware platforms, operating systems and database systems on each node of the database system, which can be summarized as heterogeneity of computer architecture, heterogeneity of operating system and heterogeneity of DBMS. construct these three aspects.

Each participating database runs on computers with different architectures such as mainframes, minicomputers, workstations, PCs or embedded systems, which is called heterogeneous computer architecture.

Each database system running on different operating systems such as Unix, Windows NT, Linux, etc. is regarded as the heterogeneity of the basic operating system.

The heterogeneity of DBMS can be divided into two types according to the database model: one is composed of several different databases such as Oracle and SQL Server, but both are relational database systems; the other is composed of databases with different data models, such as relational, A heterogeneous database system composed of schema, hierarchy, network, object-oriented, and functional databases. The differences between DBMSs are mainly manifested in two aspects: expression structure and restriction, and semantics. In terms of expression structure and restrictions: different data models provide different structural primitives, for example, the same information is expressed by relations in the relational model, but by record types in the network model; different data models may support different restrictions, different The data models of the database usually correspond to different database languages, even if the data models are the same, they can have different languages. Data semantics: including data logic representation and database interoperability, where data logic representation involves the data schema and data type used.

The defect of the current synchronization method is that when hardware, network or database fails, the reliability and availability of database data synchronization cannot be guaranteed.

The Chinese invention patent (publication number 102063502A) discloses a method for realizing data synchronization of heterogeneous databases. Wherein the heterogeneous database includes database A and database B, database A is the database used by the user application, the database access interface uses the JDBC interface, and database B is the purpose database for data synchronization; it also includes the JDBC driver AB that conforms to the SUN specification, and the driver AB contains the JDBC driver package of A and the JDBC driver package of B; the function calls on the driver AB are passed to the JDBC driver of the database A as they are, and the function calls with changes to the database are converted by sql syntax mapping and then The JDBC driver passed to database B. The disadvantage of this method is that when a certain database fails, the heterogeneous database synchronization method will fail.

Chinese invention patent (publication number 102129478A) discloses a database synchronization method and system. The method includes: capturing the change information of the data in the source database and the transaction corresponding to the data change in real time, and storing the captured change information and the transaction in the intermediate database; determining the target database to be synchronized according to the change information stored in the intermediate database ; converting the change information into target data corresponding to the target database; simultaneously updating all target data corresponding to the same transaction into the target database. The invention can realize data synchronization between different types of databases and heterogeneous data tables, reduce the consumption of system resources in the synchronization process, and ensure the reliability of the synchronization process. The disadvantage of this method is: when the hardware or the network fails, the consistency between the source database and the target database cannot be resolved.

Contents of the invention

The purpose of the present invention is to provide a heterogeneous database synchronization method based on a peer-to-peer network in view of the deficiencies of the prior art. Realize the sharing of information resources through direct interconnection without relying on the support of centralized servers.

Blockchain is a series of data blocks associated with each other using cryptographic methods. Each data block contains the information of a Bitcoin network transaction, which is used to verify the validity of its information (anti-counterfeiting) and generate the next block. The method of the present invention records database change information and time stamps by means of block chain technology, and each node on the network maintains a unified block chain.

The heterogeneous database synchronization method provided by the present invention comprises the following steps:

(1) If the database information changes, it will be fed back to the global proxy service;

(2) The global agent service broadcasts the changed information to the routing agents in each node; each database information change record must be broadcast to all nodes managed by the global agent;

(3) Update the resource information of each node through the global proxy server; record the time stamp of the updated information and update it into the blockchain;

The global proxy server performs a random hash on a set of data in the form of a block and adds a timestamp, and broadcasts the random hash; each timestamp should incorporate the previous timestamp into its random hash value, and each Subsequent timestamps are all enhancements to previous timestamps, thus forming a blockchain.

(4) Update the agent synchronization status of each node, record the time stamp and the information to be changed, and feed back the update status to the global agent: each node incorporates the received change information into a block, if and only if it is included in All the change information in the block is valid and has not existed before, and other nodes agree to the validity of the block; other nodes accept the block, and at the same time follow the end of the block to generate a new block to extend the block chain, and the hash value of the accepted block is used as the random hash value of the new block.

The heterogeneous database synchronization device provided by the present invention is as follows:

The device is deployed in a local area network environment, and each database corresponds to a routing node of the proxy layer, and the routing node monitors the information changes of the corresponding database; the global proxy service records the status of each node, and maintains the blockchain of database changes.

(1) Routing node: monitor whether the database changes, and notify the global proxy service if there is a change.

(2) Global proxy service: The global proxy service notifies every routing node in the network of the message packet of the database change.

The beneficial effects of the present invention are:

1. The present invention provides a heterogeneous database synchronization device. Through decentralization and self-management of each node, the reliability and availability of database synchronization can be greatly improved.

2. The present invention provides a peer-to-peer network method, which is based on blockchain technology and has complete data exchange records, which solves the untraceability of data exchange in the traditional center mode.

Description of drawings

Fig. 1 is the flow chart of heterogeneous database synchronization method of the present invention;

Fig. 2 is a schematic diagram of a device for synchronizing heterogeneous databases according to the present invention.

Detailed ways

The present invention will be described in further detail below in conjunction with the accompanying drawings and specific embodiments.

As shown in Figure 1 below, the heterogeneous database synchronization method provided by the present invention includes the following steps:

(1) When the database information changes, it will be fed back to the global proxy service

The block node structure of each database information change is as follows:

data item paraphrase Version block version number Previous blockhash 256-bit HASH value of the previous block Next block hash 256-bit HASH value of the next block Merkleroot Based on the 256-bit HASH value of all transactions in a block Time timestamp Bits The current target HASH value of the compressed format Confirmations The number of confirmations for data changes in the block Contents change content

(2) The global agent service broadcasts the change information to the routing agents in each node: every record of database information change must be broadcast to all nodes managed by the global agent.

(3) Update the resource information of each node through the global agent: record the updated information with a timestamp and update it to the blockchain. The blockchain is a linked list structure, and the block node structure is the node information of the blockchain.

(4) Update the synchronization status of each node, record the time stamp and the resources to be updated, and feed back the update status to the global agent; if the information synchronization of the node is successful, the synchronization status is 1, otherwise it is 0; each node maintains the zone Block chain information, when the block chain information of the node is incomplete, wait for the next global proxy service to notify the update operation, and the block chain of the node needs to be synchronized before the next update operation.

As shown in Figure 2, the heterogeneous database synchronization device provided by the present invention is as follows:

The device is deployed in a local area network environment, and each database corresponds to a routing node of the proxy layer, and the routing node monitors the information changes of the corresponding database; the global proxy service records the status of each node, and maintains the blockchain of database changes.

(1) Routing node: monitor whether the database changes, and notify the global proxy service if there is a change.

(2) Global proxy service: The global proxy service notifies every routing node in the network of the message packet of the database change.

Claims (1)

1. a kind of heterogeneous database synchronization method based on peer-to-peer network, which is characterized in that this method is synchronized in heterogeneous database It is realized on device, which is deployed under LAN environment, including routing node and global proxy server；Each database pair A routing node of Agent layer, the routing node is answered to monitor the information change of correspondence database；Global proxy server record The state of each routing node safeguards the block chain of databases comparison；This approach includes the following steps：

(1) database information changes, and feeds back to global proxy server；

(2) global proxy server is broadcast to the information of change the route agent in each routing node；Each database letter Cease change record, it is necessary to be broadcast to all routing nodes of global proxy server management；

(3) by global proxy server, the resource information of each routing node is updated, by newer information logging timestamp, And it updates into block chain：When global proxy server is implemented random hash to existing one group of data in block form and is added Between stab, which is broadcasted；Previous timestamp should be included in its random hash value by each timestamp, each Subsequent timestamp all enhances timestamp before, just forms block chain in this way；

(4) route agent's synchronous regime of each routing node, logging timestamp and information to be changed are updated, and more new state Feed back to global proxy server：The modification information received is included in a block by each routing node, and if only if packet Being contained in the area all modification informations in the block is all effective and did not existed before that other routing nodes just accept the block Validity；The expression of other routing nodes receives the block, while at the end of the block, generating new block to extend the area Block chain, and random hash value of the hashed value as new block that block will be received.