CN106777344A - The back end extended method and device of a kind of data-base cluster - Google Patents

Abstract

The invention discloses the back end extended method and device of a kind of Postgres XL data-base clusters, including：Obtain the nodal information of multiple back end to be added；By the nodal information of each back end, corresponding container is stored in respectively according to information type；The total node number amount of statistics back end to be added, corresponding node addition instruction is generated according to total nodal point number amount, is added instruction by the node and is repeatedly called the add_datanode interfaces to carry out the addition of node；It can be seen that, in this programme, user is by after the nodal information unification addition of multiple back end to be added, just node addition instruction can be generated according to total node number amount, just can adding data in batches node according to node addition instruction, realize when back end extends by performing a subcommand, cluster just can be made to increase node automatically, greatly reduce cost of labor.

Description

A data node expansion method and device for a database cluster

technical field

The invention relates to the technical field of data node expansion, and more specifically, to a data node expansion method and device for a Postgres-XL database cluster.

Background technique

Postgres-XL is a horizontally scalable open source SQL database cluster based on PostgreSQL database, which is flexible enough to handle different database workloads. When using a Postgres-XL-based database cluster, if you want to add a data node, you can only add a node by manually executing the add_datanode interface when the information of the node to be added is determined to be correct. Only one data node can be added at a time, that is to say , Native clusters do not support adding data nodes in batches, and can only be added multiple times through commands, which not only slows the adding speed, but also increases labor costs.

Therefore, how to add data nodes in batches and reduce labor costs is a problem to be solved by those skilled in the art.

Contents of the invention

The purpose of the present invention is to provide a method and device for expanding data nodes of a Postgres-XL database cluster, so as to realize adding data nodes in batches and reduce labor costs.

In order to achieve the above object, the embodiment of the present invention provides the following technical solutions:

A method for expanding data nodes of a Postgres-XL database cluster, comprising:

Obtain node information of multiple data nodes to be added;

Store the node information of each data node in the corresponding container according to the information type;

Count the total number of data nodes to be added, generate corresponding node addition instructions according to the number of summary points, and call the add_datanode interface multiple times through the node addition instructions to add nodes.

Wherein, the node information of each data node is stored in the corresponding container according to the information type, including:

Store the node address information of each data node into the node address container, store the port number information of each data node into the port number container, and store the node name information of each data node into the node name container; wherein, the same data node The node address information, port number information, and node name information of the corresponding container are the same.

Wherein, the generation of corresponding node addition instructions according to the number of summary points includes:

If the number of summary points is N, the generated node addition instruction is: execute the add_datanode function N times, so as to realize adding N data nodes; wherein, N is a positive integer.

Wherein, the adding of nodes by calling the add_datanode interface multiple times through the node adding instruction includes:

Obtain node information corresponding to the target data node to be added from each container;

Judging whether the node information corresponding to the target data node is correct;

If so, call the add_datanode interface to add the target node, select the next target data node to be added, and continue to execute the step of obtaining the node information corresponding to the target data node to be added from each container;

If not, a node information error prompt is issued, the next target data node to be added is selected, and the step of obtaining node information corresponding to the target data node to be added from each container is continued.

A data node expansion device of a Postgres-XL database cluster, comprising:

An acquisition module, configured to acquire node information of multiple data nodes to be added;

The storage module is used to store the node information of each data node into the corresponding container according to the information type;

An instruction generation module, configured to count the total number of nodes of the data nodes to be added, and generate corresponding node addition instructions according to the number of summary points;

The node adding module is used to call the add_datanode interface multiple times through the node adding command to add nodes.

Wherein, the storage module stores the node address information of each data node into the node address container, stores the port number information of each data node into the port number container, and stores the node name information of each data node into the node name container ; Among them, the node address information, port number information, and node name information of the same data node have the same subscript in the corresponding container.

Wherein, if the number of summary points is N, the node adding instruction generated by the instruction generating module is: execute the add_datanode function N times, thereby realizing adding N data nodes; wherein, N is a positive integer.

Wherein, the node adding module includes:

a node information acquisition unit, configured to acquire node information corresponding to the target data node to be added from each container;

a judging unit, configured to judge whether the node information corresponding to the target data node is correct;

The first adding unit is used to determine that when the node information corresponding to the target data node is correct, call the add_datanode interface to add the target node, select the next target data node to be added, and trigger the node information acquisition unit;

The second adding unit is configured to issue a node information error prompt when determining that the node information corresponding to the target data node is incorrect, select the next target data node to be added, and trigger the node information acquiring unit.

It can be seen from the above scheme that the data node expansion method of a Postgres-XL database cluster provided by the embodiment of the present invention includes: obtaining the node information of multiple data nodes to be added; Store in the corresponding container respectively; count the total number of nodes of the data nodes to be added, generate corresponding node addition instructions according to the number of summary points, and call the add_datanode interface multiple times through the node addition instructions to add nodes;

It can be seen that in this solution, after the user adds the node information of the multiple data nodes to be added, the node addition command can be generated according to the total number of nodes, and the data nodes can be added in batches according to the node addition command, realizing the in-data When the node is expanded, by executing a command once, the cluster can automatically add nodes, greatly reducing labor costs; the invention also discloses a data node expansion device for a Postgres-XL database cluster, which can also achieve the above-mentioned technical effects.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

Fig. 1 is a schematic flow chart of a data node expansion method of a Postgres-XL database cluster disclosed by an embodiment of the present invention;

Fig. 2 is the data node expansion method of Postgres-XL database cluster in the prior art;

Fig. 3 is a schematic flow chart of a data node expansion method of a specific Postgres-XL database cluster disclosed by an embodiment of the present invention;

FIG. 4 is a schematic structural diagram of a data node expansion device for a Postgres-XL database cluster disclosed by an embodiment of the present invention.

detailed description

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

The embodiment of the present invention discloses a data node expansion method and device of a Postgres-XL database cluster, so as to implement adding data nodes in batches and reduce labor costs.

Referring to Fig. 1, a kind of data node expansion method of Postgres-XL database cluster that the embodiment of the present invention provides, comprises:

S101. Obtain node information of multiple data nodes to be added;

Specifically, referring to FIG. 2 , the data node expansion method in the prior art provided by this embodiment can only manually execute the add_datanode interface when adding nodes, and this interface only supports adding one data node at a time. Therefore, referring to Figure 3, in this solution, the information about adding data nodes is first stored in a temporary function. After analyzing the node information, the temporary function counts the number of nodes to be added, such as the number of nodes If it is n, execute the add_datanode function n times, thereby adding n nodes, realizing the function of adding multiple nodes with one command.

S102. Store the node information of each data node in a corresponding container according to the information type;

Wherein, the node information of each data node is stored in the corresponding container according to the information type, including:

Store the node address information of each data node into the node address container, store the port number information of each data node into the port number container, and store the node name information of each data node into the node name container; wherein, the same data node The node address information, port number information, and node name information of the corresponding container are the same.

It should be noted that in the native cluster algorithm, when adding a data node through the add_datanode interface, it is necessary to pass in node information, such as node address, port number, etc., so that the step of adding data nodes can be automatically executed through the information of these nodes. On this basis, in this embodiment, the function of information statistics is added, and the node information input from the client each time is classified and stored in different containers, such as node address container, port number container, node name container, etc. , the subscript of the node information in each container is the offset between the number of the data node to be added and the maximum number of the existing data node number, so that the automatic addition of data nodes can be realized.

S103. Count the total number of data nodes to be added, generate corresponding node addition instructions according to the number of summary points, and call the add_datanode interface multiple times through the node addition instructions to add nodes.

Wherein, the generation of corresponding node addition instructions according to the number of summary points includes:

If the number of summary points is N, the generated node addition instruction is: execute the add_datanode function N times, so as to realize adding N data nodes; wherein, N is a positive integer.

Wherein, the adding of nodes by calling the add_datanode interface multiple times through the node adding instruction includes:

Obtain node information corresponding to the target data node to be added from each container;

Judging whether the node information corresponding to the target data node is correct;

If so, call the add_datanode interface to add the target node, select the next target data node to be added, and continue to execute the step of obtaining the node information corresponding to the target data node to be added from each container;

If not, a node information error prompt is issued, the next target data node to be added is selected, and the step of obtaining node information corresponding to the target data node to be added from each container is continued.

Specifically, after the number N of summary points is counted in this embodiment, the corresponding node addition command is generated, and the node information is obtained from different containers. After judging that the information is not empty and correct, the add_datanode interface is called to realize the increase Data node, and after receiving the message that the previous node has been added, it will continue to execute the next call to add the next data node until the obtained node information is empty, so that through this method, it is achieved in the cluster The purpose of adding data nodes in batches.

It should be noted that the data node expansion method of the Postgres-XL database cluster in this embodiment is mainly aimed at: during the operation of the cluster, if it is necessary to add data nodes to expand the cluster, the native cluster does not support batch addition , it can only be repeated multiple times through the command, adding a data node each time. In this embodiment, through the secondary development of the core algorithm of the expansion module, the number of nodes can be customized and increased during expansion. After executing a command, the cluster automatically increases nodes, which greatly reduces labor costs.

The data node expansion device provided by the embodiment of the present invention is introduced below, and the data node expansion device described below and the data node expansion method described above may refer to each other.

Referring to FIG. 4, a data node expansion device of a Postgres-XL database cluster provided by an embodiment of the present invention includes:

An acquisition module 100, configured to acquire node information of multiple data nodes to be added;

The storage module 200 is used to store the node information of each data node into the corresponding container according to the information type;

The instruction generation module 300 is used to count the total number of nodes of the data nodes to be added, and generate corresponding node addition instructions according to the number of summary points;

The node adding module 400 is configured to call the add_datanode interface multiple times through the node adding instruction to add nodes.

Wherein, the storage module stores the node address information of each data node into the node address container, stores the port number information of each data node into the port number container, and stores the node name information of each data node into the node name container ; Among them, the node address information, port number information, and node name information of the same data node have the same subscript in the corresponding container.

Wherein, if the number of summary points is N, the node adding instruction generated by the instruction generating module is: execute the add_datanode function N times, so as to realize adding N data nodes; wherein, N is a positive integer.

Wherein, the node adding module includes:

a node information acquisition unit, configured to acquire node information corresponding to the target data node to be added from each container;

a judging unit, configured to judge whether the node information corresponding to the target data node is correct;

The first adding unit is used to determine that when the node information corresponding to the target data node is correct, call the add_datanode interface to add the target node, select the next target data node to be added, and trigger the node information acquisition unit;

The second adding unit is configured to issue a node information error prompt when determining that the node information corresponding to the target data node is incorrect, select the next target data node to be added, and trigger the node information acquiring unit.

A data node expansion method of a Postgres-XL database cluster provided by an embodiment of the present invention includes: obtaining node information of multiple data nodes to be added; storing the node information of each data node into the corresponding container; counting the total number of nodes of the data nodes to be added, generating corresponding node addition instructions according to the number of summary points, and calling the add_datanode interface multiple times through the node addition instructions to add nodes;

It can be seen that in this solution, after the user adds the node information of the multiple data nodes to be added, the node addition command can be generated according to the total number of nodes, and the data nodes can be added in batches according to the node addition command, realizing the in-data When the node is expanded, by executing a command once, the cluster can automatically add nodes, greatly reducing labor costs; the invention also discloses a data node expansion device for a Postgres-XL database cluster, which can also achieve the above-mentioned technical effects.

Each embodiment in this specification is described in a progressive manner, each embodiment focuses on the difference from other embodiments, and the same and similar parts of each embodiment can be referred to each other.

The above description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the present invention will not be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (8)

1. a data node expansion method of Postgres-XL database cluster, it is characterized in that, comprising: Obtain node information of multiple data nodes to be added; Store the node information of each data node in the corresponding container according to the information type; Count the total number of data nodes to be added, generate corresponding node addition instructions according to the number of summary points, and call the add_datanode interface multiple times through the node addition instructions to add nodes. 2. The data node expansion method according to claim 1, wherein the node information of each data node is stored in the corresponding container according to the information type, including: Store the node address information of each data node into the node address container, store the port number information of each data node into the port number container, and store the node name information of each data node into the node name container; wherein, the same data node The node address information, port number information, and node name information of the corresponding container are the same. 3. The data node expansion method according to claim 2, wherein the generating corresponding node addition instructions according to the number of summary points includes: If the number of summary points is N, the generated node addition instruction is: execute N times add_datanode function to add N data nodes; where N is a positive integer. 4. The data node expansion method according to claim 3, wherein the adding of nodes by calling the add_datanode interface multiple times through the node adding instruction includes: Obtain node information corresponding to the target data node to be added from each container; Judging whether the node information corresponding to the target data node is correct; If so, call the add_datanode interface to add the target node, select the next target data node to be added, and continue to execute the step of obtaining the node information corresponding to the target data node to be added from each container; If not, a node information error prompt is issued, the next target data node to be added is selected, and the step of obtaining node information corresponding to the target data node to be added from each container is continued. 5. a data node expansion device of Postgres-XL database cluster, is characterized in that, comprises: An acquisition module, configured to acquire node information of multiple data nodes to be added; The storage module is used to store the node information of each data node into the corresponding container according to the information type; An instruction generation module, configured to count the total number of nodes of the data nodes to be added, and generate corresponding node addition instructions according to the number of summary points; The node adding module is used to call the add_datanode interface multiple times through the node adding command to add nodes. 6. The data node expansion method according to claim 5, wherein: The storage module stores the node address information of each data node into the node address container, stores the port number information of each data node into the port number container, and stores the node name information of each data node into the node name container; wherein , the node address information, port number information, and node name information of the same data node have the same subscript in the corresponding container. 7. The data node expansion method according to claim 6, characterized in that, If the number of summary points is N, the node adding instruction generated by the instruction generating module is: execute the add_datanode function N times, so as to realize adding N data nodes; wherein, N is a positive integer. 8. The data node expansion method according to claim 7, wherein the node adding module comprises: a node information acquisition unit, configured to acquire node information corresponding to the target data node to be added from each container; a judging unit, configured to judge whether the node information corresponding to the target data node is correct; The first adding unit is used to determine that when the node information corresponding to the target data node is correct, call the add_datanode interface to add the target node, select the next target data node to be added, and trigger the node information acquisition unit; The second adding unit is configured to issue a node information error prompt when determining that the node information corresponding to the target data node is incorrect, select the next target data node to be added, and trigger the node information acquiring unit.