CN105338075A - Method and system for sharing data between nodes in cluster - Google Patents

Abstract

Embodiments of the present invention provide a data sharing method and system among nodes in a cluster, wherein the method includes: each node detects whether its own data information changes, and if it changes, determines the changed change information, and stores the changed information sent to other nodes; when each node receives the change information sent by other nodes, it updates its own data information according to the change information sent by the other nodes to ensure that the data information of all nodes in the cluster is the same. Each node only transmits the changed data information to each other, and those data information that has not changed within a certain period of time will not be transmitted in the network again, canceling the transmission of repeated data in the network, and avoiding the waste of network bandwidth , reducing the network bandwidth load, thereby ensuring the real-time data transmission in the network and the reliability of data in each node.

Description

A method and system for sharing data between nodes in a cluster

technical field

The invention relates to the technical field of cluster node data processing, in particular to a data sharing method and system among nodes in a cluster.

Background technique

In the cluster, each node realizes data sharing by transmitting data information between each other. If a node finds that its own data information has changed, the node will send the changed data information to other nodes. After the changed data information is obtained, the data information of itself is updated to make the data information of all nodes in the cluster the same. Among them, the changed data information, that is, the data information transmitted between each node, includes some data information in the node that will not change within a specific period of time, such as the total capacity of the hard disk of the node, memory size and CPU The data information such as the number of data, the data information between the nodes in the cluster is transmitted in the network, and the data information that will not change within a specific period of time is transmitted in the network, and a large amount of duplicate data will be transmitted in the network, causing the network The waste of bandwidth, and the more nodes in the cluster, the greater the amount of data transmitted, the more network bandwidth consumption, the greater the waste of network bandwidth, and may cause network congestion in severe cases. At the same time, due to the transmission of data between nodes through UDP, if network congestion occurs, the probability of UDP packet loss will increase under severe network congestion conditions, which will cause data information between nodes to not be shared in time, and affect the internal network of each node. reliability of data information.

Contents of the invention

In view of this, the embodiment of the present invention provides a data sharing method among the nodes in the cluster to solve the problem of the data information transmitted between the nodes in the prior art, including that some of the nodes do not change within a specific period of time. In severe cases, it may cause network congestion, causing data information between nodes to not be shared in time, and affecting the accuracy of data information in each node.

In order to achieve the above purpose, embodiments of the present invention provide the following technical solutions:

A data sharing method among nodes in a cluster, comprising:

Each node detects whether its own data information changes, and if it changes, determines the changed change information, and sends the change information to other nodes;

When each node receives the change information sent by other nodes, it updates its own data information according to the change information sent by the other nodes, so as to ensure that the data information of all nodes in the cluster is the same.

Wherein, after each node sends the change information to other nodes, it also includes:

sending said change information to a data monitoring device;

The data monitoring device sends the change information to a database for storage.

Wherein, after the data monitoring device sends the change information to the database for saving, it also includes:

The database draws a resource graph according to the change information, and sends the resource graph to a display for display.

Wherein, each node detects whether its own data information changes as follows:

Each node detects whether its own data information has changed every preset time interval;

And/or, each node detects whether its own data information changes when receiving the monitoring instruction.

Wherein, each node detecting whether its own data information changes at a preset time interval includes:

Each node obtains its own current data information after the preset time for obtaining its own previous data information;

Each node judges whether its own current data information is the same as its own previous data information;

If they are not the same, it is determined that the data information of the self has changed, and the changed change information is determined;

If they are the same, it is determined that the self-data information has not changed, and the next self-data information is obtained after the preset time interval.

Wherein, when each node detects whether its own data information changes when receiving the monitoring instruction, it includes:

Each node judges whether the detection instruction is received, and if received, each node obtains its own current data information;

Each node judges whether its own current data information is the same as its own previous data information;

If they are not the same, it is determined that the data information of the self has changed, and the changed change information is determined;

If they are the same, it is determined that the self-data information has not changed, and it is determined whether the next detection instruction is received.

A data sharing system among nodes in a cluster, comprising: at least two nodes, wherein each node comprises: a detection module, a first sending module, and a receiving module; wherein,

The detection module is used to detect whether its own data information has changed, and if it has changed, determine the changed change information;

The first sending module is configured to send the change information to other nodes;

The receiving module is configured to update its own data information according to the change information sent by other nodes when receiving the change information sent by other nodes, so as to ensure that the data information of all nodes in the cluster is the same.

Wherein, the node further includes: a second sending module, configured to send the change information to the data monitoring device;

The system also includes: data monitoring equipment and a database, wherein,

The data monitoring device is configured to receive the change information sent by the second sending module, and send the send change information to the database;

The database includes a receiving unit and a storage unit, wherein the receiving unit is configured to receive the change information sent by the data monitoring device, and the storage unit stores the change information.

Wherein, the database further includes: a drawing unit and a sending unit, wherein the drawing unit is used to draw a resource graph according to the change information, and the sending unit is used to send the resource graph to a display;

The system further includes: a display, configured to receive the resource curve sent by the database and display the resource curve.

Wherein, the detection module includes a first detection unit and/or a second detection unit; wherein,

The first detection unit is used for each node to detect whether its own data information has changed every preset time interval;

The second detection unit is used for each node to detect whether its own data information changes when receiving the monitoring instruction.

Based on the above technical solution, the embodiments of the present invention provide a data sharing method and system among nodes in a cluster. The cluster includes at least two nodes, and each node detects whether its own data information has changed. If it detects that its own data information has changed, then Determine the change information that has changed in its own data information, and send the change information to other nodes. When each node receives the change information sent by other nodes, it will update its own data information according to the change information sent by the other nodes. Update to ensure that the data information of all nodes in the cluster is the same. Each node only transmits the changed data information to each other, and those data information that has not changed within a certain period of time will not be transmitted in the network again, canceling the transmission of repeated data in the network, and avoiding the waste of network bandwidth , reducing the network bandwidth load, thereby ensuring the real-time data transmission in the network and the reliability of data in each node.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only It is an embodiment of the present invention, and those skilled in the art can also obtain other drawings according to the provided drawings without creative work.

FIG. 1 is a flowchart of a data sharing method among nodes in a cluster provided by an embodiment of the present invention;

FIG. 2 is a flow chart of a method for saving change information in a data sharing method among nodes in a cluster provided by an embodiment of the present invention;

3 is a flow chart of a method for displaying a resource graph in a data sharing method among nodes in a cluster provided by an embodiment of the present invention;

4 is a flowchart of a method for each node to detect whether its own data information has changed at a preset time interval in the data sharing method among nodes in a cluster provided by an embodiment of the present invention;

5 is a flowchart of a method for each node to detect whether its own data information has changed when receiving a monitoring instruction in the data sharing method among nodes in the cluster provided by an embodiment of the present invention;

FIG. 6 is a system block diagram of a data sharing system among nodes in a cluster provided by an embodiment of the present invention;

FIG. 7 is another system block diagram of a data sharing system among nodes in a cluster provided by an embodiment of the present invention;

FIG. 8 is another system block diagram of a data sharing system among nodes in a cluster provided by an embodiment of the present invention;

FIG. 9 is a structural block diagram of a detection module 110 in a data sharing system among nodes in a cluster provided by an embodiment of the present invention.

detailed description

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

Figure 1 is a flow chart of the data sharing method among the nodes in the cluster provided by the embodiment of the present invention. The nodes only transmit the changed data information to each other, and the data information that has not changed within a specific period of time will not Then transmit in the network, cancel the transmission of repeated data in the network, avoid the waste of network bandwidth, reduce the load of network bandwidth, and then ensure the real-time data transmission in the network and the reliability of data in each node; refer to Figure 1 , the data sharing methods between nodes in the cluster may include:

Step S100: Each node detects whether its own data information changes, and if it changes, determines the changed change information, and sends the change information to other nodes;

The cluster includes at least 2 nodes, and each node detects whether its own data information has changed. If it detects that its own data information has changed, it determines the changed change information, and then sends the determined change information to other nodes. Make other nodes update their own data information after receiving the change information, and ensure that the data information of other nodes is also changed accordingly after the data information of the node whose data information changes changes, ensuring that all nodes in the cluster The data information is the same.

Optionally, in order to obtain the resource transfer status among the nodes in the cluster, after each node detects that its own node information has changed, in addition to sending the confirmed change information to other nodes, the determined change information can also be Send it to the data monitoring device, and then the data monitoring device will send the change information to the database for saving after obtaining the change information.

Optionally, in order to visually observe the resource transfer situation among the nodes in the cluster, the database can draw a resource curve graph according to the change information after receiving the change information sent by the data monitoring device, and send the resource curve graph to the display to display.

Optionally, each node may detect whether its own data information has changed every preset time interval, or detect whether its own data information has changed when receiving a monitoring instruction, or both every preset time interval It detects whether the self-data information changes once, and detects whether the self-data information changes each time a monitoring instruction is received.

Optionally, each node can obtain its own current data information after the preset time of acquiring its own previous data information, and judge whether its own current data information is the same as its own previous data information, and if not, determine that its own data information has occurred Change, continue to the next step, determine the changed change information, if the same, determine that the data information has not changed, and obtain the next data information of itself after the preset time interval, so as to realize the detection of each node every preset time interval Whether the self-data information has changed.

Optionally, each node can judge whether the detection instruction is received. If received, each node obtains its own current data information, and each node judges whether its own current data information is the same as its own previous data information. If not, then judge If the self-data information changes, continue to the next step to determine the changed change information. If it is the same, determine that the self-data information has not changed, and judge whether the next detection instruction is received, so as to realize that each node receives the monitoring instruction. Detect whether its own data information has changed.

Step S110: When each node receives the change information sent by other nodes, it updates its own data information according to the change information sent by the other nodes to ensure that the data information of all nodes in the cluster is the same.

In addition to detecting whether its own data information has changed, each node also needs to detect whether it has received the change information sent by other nodes. If it receives the change information sent by other nodes, it means that the data information of other nodes has changed. It is necessary to update its own data information according to the change information sent by other nodes to ensure that its own data information is the same as the data information of the node whose data information has changed, so as to ensure that the data information of all nodes in the cluster is the same.

Among them, if the data information of the node where the data information changes is changed to data increase, that is, if the change information is to add data information, after each node receives the increased change information, each node updates its own data information according to the change information. Updating is to add the change information to its own data information to ensure that the data information of each node is the same as the data information of the node whose data information has changed.

If the data information of the node where the data information changes is changed to data reduction, that is, if the change information is reduced data information, after each node receives the increased change information, each node will perform data processing on its own data information according to the change information. Updating is to delete the change information from its own data information, so as to ensure that the data information of each node is the same as the data information of the node whose data information has changed.

If the data information of the node where the data information changes is changed to data change, that is, if the change information is changed data information, after each node receives the added change information, each node will perform a process on its own data information according to the change information. Updating means to modify the data information corresponding to the change information to be the same as the change information, and ensure that the data information of each node is the same as the data information of the node whose data information has changed.

Based on the above technical solution, the embodiment of the present invention provides a data sharing method among nodes in a cluster. The cluster includes at least two nodes, and each node detects whether its own data information has changed. If it detects that its own data information has changed, it will determine its own The change information that has changed in the data information is sent to other nodes. When each node receives the change information sent by other nodes, it updates its own data information according to the change information sent by the other nodes. Ensure that the data information of all nodes in the cluster is the same. Each node only transmits the changed data information to each other, and those data information that has not changed within a certain period of time will not be transmitted in the network again, canceling the transmission of repeated data in the network, and avoiding the waste of network bandwidth , reducing the network bandwidth load, thereby ensuring the real-time data transmission in the network and the reliability of data in each node.

Optionally, FIG. 2 shows a flow chart of a method for saving change information in the data sharing method among nodes in a cluster provided by an embodiment of the present invention. Referring to FIG. 2 , the method for saving change information may include:

Step S200: Send the change information to the data monitoring device;

Optionally, in order to obtain the resource transfer status among the nodes in the cluster, after each node detects that its own node information has changed, in addition to sending the confirmed change information to other nodes, the determined change information can also be Send to data monitoring equipment.

Step S210: the data monitoring device sends the change information to a database for storage.

After obtaining the change information sent by each node, the data monitoring device sends the change information to the database, and the database saves the change data.

Optionally, FIG. 3 shows a flowchart of a method for displaying a resource graph in the data sharing method among nodes in a cluster provided by an embodiment of the present invention. Referring to FIG. 3, the method for displaying a resource graph may include:

Step S300: the database draws a resource graph according to the change information;

In order to intuitively observe the resource transfer situation among the nodes in the cluster, the database can draw a resource curve graph according to the change information after receiving the change information sent by the data monitoring device.

Step S310: Send the resource graph to a display for display.

After the database draws the resource curve according to the change information, it sends the resource curve to the display, and the display displays the resource curve for the user to watch.

Optionally, FIG. 4 shows a flowchart of a method for each node to detect whether its own data information has changed at a preset time interval in the data sharing method among nodes in a cluster provided by an embodiment of the present invention. Referring to FIG. 4 , each The method for each node to detect whether its own data information has changed at a preset time interval may include:

Step S400: judging whether the preset time interval is reached;

Step S410: If reached, each node obtains its own data information;

When each node detects whether its own data information has changed every preset time interval, because each node detects whether its own data information has changed every preset time interval, therefore, each node collects its own data information every preset time interval , after obtaining the last self-data information, if the preset time interval is reached, the current self-data information is obtained.

Step S420: Each node judges whether the self-data information obtained this time is the same as the self-data information obtained last time;

Each node judges whether the self-data information obtained this time is the same as the self-data information obtained last time, that is, each node judges whether the current self-data information obtained is the same as the previous self-data information.

Step S430: If not the same, determine that the data information of the self has changed, and determine the changed change information;

If the current self-data information obtained by a node is different from the previous self-data information, it can be determined that the self-data information of the node has changed, and the next step can be continued to determine the changed change information.

Step S440: If they are the same, it is determined that the self-data information has not changed, and return to step S400.

If the current self-data information acquired by a node is the same as the previous self-data information, it can be determined that the node's self-data information has not changed, and returns to step S400 to obtain the next self-data information after a preset time interval.

Optionally, FIG. 5 shows a flowchart of a method for each node to detect whether its own data information has changed when a monitoring instruction is received in the method for sharing data among nodes in a cluster provided by an embodiment of the present invention. Referring to FIG. 5 , it should receive The method for each node to detect whether its own data information has changed when the monitoring instruction is received may include:

Step S500: Each node judges whether a detection instruction is received;

When each node detects whether its own data information has changed when receiving the monitoring command, when the user needs each node to detect its own data information, it will send a detection command to each node. Therefore, each node can determine whether it has received the detection command. Whether to detect its own data information.

Step S510: If received, each node obtains its own data information;

If a detection instruction is received, each node obtains its own data information.

Step S520: Each node judges whether the self-data information obtained this time is the same as the self-data information obtained last time;

After each node obtains its own data information, the self-data information obtained this time is the current self-data information, and the self-data information obtained last time is the previous self-data information. By judging the self-data information obtained this time and the last time Whether the obtained self-data information is the same is used to determine whether the self-data information has changed.

Step S530: If not the same, determine that the data information of the self has changed, and determine the changed change information;

If the current self-data information obtained by a node is different from the previous self-data information, it can be determined that the self-data information of the node has changed, and the next step can be continued to determine the changed change information.

Step S540: If they are the same, it is determined that the self-data information has not changed, and return to step S500.

If the current self-data information acquired by a node is the same as the previous self-data information, it can be determined that the node's self-data information has not changed, and returns to step S400 to obtain the next self-data information after a preset time interval.

In the data sharing method among the nodes in the cluster provided by the embodiment of the present invention, each node only transmits the changed data information to each other, and those data information that has not changed within a specific period of time will not be transmitted in the network again. It cancels the transmission of repeated data in the network, avoids the waste of network bandwidth, reduces the load of network bandwidth, and then ensures the real-time data transmission in the network and the reliability of data in each node.

The following describes the data sharing system among the nodes in the cluster provided by the embodiment of the present invention. The data sharing system among the nodes in the cluster described below and the data sharing method among the nodes in the cluster described above can be used for mutual reference.

FIG. 6 is a system block diagram of a data sharing system among nodes in a cluster provided by an embodiment of the present invention. Referring to FIG. : detection module 110, first sending module 120 and receiving module 130; wherein,

The detection module 110 is used to detect whether the self-data information has changed, and if there is a change, determine the changed change information;

The first sending module 120 is configured to send the change information to other nodes;

The receiving module 130 is configured to update its own data information according to the change information sent by other nodes when receiving the change information sent by other nodes, so as to ensure that the data information of all nodes in the cluster are the same.

Optionally, FIG. 7 shows another system block diagram of a data sharing system among nodes in a cluster provided by an embodiment of the present invention. Referring to FIG. 7 , each node 100 may further include: a second sending module 140 .

The second sending module 140 is configured to send the change information to the data monitoring device;

Referring to FIG. 7 , another system block diagram of the data sharing system among the nodes in the cluster provided by the embodiment of the present invention, the data sharing system among the nodes in the cluster may also include: a data monitoring device 200 and a database 300; wherein,

The data monitoring device 200 is configured to receive the change information sent by the second sending module 140, and send the change information to the database 300;

The database 300 is configured to receive the change information sent by the data monitoring device 200 and store the change information.

Referring to FIG. 7 , another system block diagram of a data sharing system among nodes in a cluster provided by an embodiment of the present invention, the database 300 may include: a receiving unit 310 and a storage unit 320; wherein,

a receiving unit 310, configured to receive the change information sent by the data monitoring device;

The storage unit 320 is configured to store the change information.

Optionally, FIG. 8 shows another system block diagram of a data sharing system among nodes in a cluster provided by an embodiment of the present invention. Referring to FIG. 8, the database 300 may further include: a drawing unit 330 and a sending unit 340; wherein,

A drawing unit 330, configured to draw a resource graph according to the change information;

A sending unit 340, configured to send the resource graph to a display.

Referring to FIG. 8 , another system block diagram of a data sharing system among nodes in a cluster provided by an embodiment of the present invention, the data sharing system among nodes in a cluster may further include: a display 400 .

The display 400 is configured to receive the resource graph sent by the database 300 and display the resource graph.

Optionally, FIG. 9 shows a structural block diagram of a detection module 110 in a data sharing system among nodes in a cluster provided by an embodiment of the present invention. Referring to FIG. 9 , the detection module 110 may include: a first detection unit 111 and/or The second detection unit 112; wherein,

The first detection unit 111 is used for each node to detect whether its own data information has changed every preset time interval;

The second detection unit 112 is configured for each node to detect whether its own data information changes when receiving the monitoring instruction.

In the data sharing system among the nodes in the cluster provided by the embodiment of the present invention, each node only transmits the changed data information to each other, and those data information that has not changed within a specific period of time will not be transmitted in the network again. It cancels the transmission of repeated data in the network, avoids the waste of network bandwidth, reduces the load of network bandwidth, and then ensures the real-time data transmission in the network and the reliability of data in each node.

Each embodiment in this specification is described in a progressive manner, each embodiment focuses on the difference from other embodiments, and the same and similar parts of each embodiment can be referred to each other. As for the system disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and for the related information, please refer to the description of the method part.

The above description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the present invention will not be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. A data sharing method between nodes in a cluster, characterized in that, comprising: Each node detects whether its own data information changes, and if it changes, determines the changed change information, and sends the change information to other nodes; When each node receives the change information sent by other nodes, it updates its own data information according to the change information sent by the other nodes, so as to ensure that the data information of all nodes in the cluster is the same. 2. The method for sharing data between nodes in the cluster according to claim 1, wherein each node further includes after sending the change information to other nodes: sending said change information to a data monitoring device; The data monitoring device sends the change information to a database for storage. 3. The method for sharing data between nodes in the cluster according to claim 2, wherein after the data monitoring device sends the change information to the database for storage, it further includes: The database draws a resource graph according to the change information, and sends the resource graph to a display for display. 4. The method for sharing data between nodes in the cluster according to claim 1, wherein each node detects whether its own data information changes as follows: Each node detects whether its own data information has changed every preset time interval; And/or, each node detects whether its own data information changes when receiving the monitoring instruction. 5. The method for sharing data between nodes in the cluster according to claim 4, wherein the detection of whether each node's own data information changes at each preset time interval comprises: Each node obtains its own current data information after the preset time for obtaining its own last data information; Each node judges whether its own current data information is the same as its own previous data information; If they are not the same, it is determined that the data information of the self has changed, and the changed change information is determined; If they are the same, it is determined that the self-data information has not changed, and the next self-data information is obtained after the preset time interval. 6. The data sharing method among the nodes in the cluster according to claim 4, characterized in that, when the monitoring instruction is received, each node detects whether its own data information has changed comprising: Each node judges whether the detection instruction is received, and if received, each node obtains its own current data information; Each node judges whether its own current data information is the same as its own previous data information; If they are not the same, it is determined that the data information of the self has changed, and the changed change information is determined; If they are the same, it is determined that the self-data information has not changed, and it is determined whether the next detection instruction is received. 7. A data sharing system between nodes in a cluster, characterized in that it includes: at least two nodes, wherein each node includes: a detection module, a first sending module and a receiving module; wherein, The detection module is used to detect whether its own data information has changed, and if it has changed, determine the changed change information; The first sending module is configured to send the change information to other nodes; The receiving module is configured to update its own data information according to the change information sent by other nodes when receiving the change information sent by other nodes, so as to ensure that the data information of all nodes in the cluster is the same. 8. The data sharing system between nodes in the cluster according to claim 7, wherein: The node also includes: a second sending module, configured to send the change information to a data monitoring device; The system also includes: data monitoring equipment and a database, wherein, The data monitoring device is configured to receive the change information sent by the second sending module, and send the send change information to the database; The database includes a receiving unit and a storage unit, wherein the receiving unit is configured to receive the change information sent by the data monitoring device, and the storage unit stores the change information. 9. The data sharing system among the nodes in the cluster according to claim 8, characterized in that, The database further includes: a drawing unit and a sending unit, wherein the drawing unit is used to draw a resource graph according to the change information, and the sending unit is used to send the resource graph to a display; The system further includes: a display, configured to receive the resource curve sent by the database and display the resource curve. 10. The data sharing system among nodes in the cluster according to claim 7, wherein the detection module comprises a first detection unit and/or a second detection unit; wherein, The first detection unit is used for each node to detect whether its own data information has changed every preset time interval; The second detection unit is used for each node to detect whether its own data information changes when receiving the monitoring instruction.