CN106790692A - A kind of load-balancing method and device of many clusters - Google Patents

Abstract

The embodiment of the present application discloses a kind of load-balancing method and device of many clusters, in transaction processing system, it is that multiple middleware clusters distribute external request by same Load Balance Unit, realize load balancing, wherein when the Load Balance Unit obtains external request, Load Balance Unit is according to configuration file, find and corresponding target cluster is identified entrained by the external request, one in i.e. the plurality of middleware cluster, Load Balance Unit can be determined according to default load balancing rule from multiple nodes of the target cluster can process the destination node of the external request, and the external request is sent to by the destination node according to the positional information of the destination node, it is achieved thereby that for multiple middleware clusters need to only configure a Load Balance Unit, reduce the consumption of system resource, reduce system cost.

Description

A multi-cluster load balancing method and device

technical field

The present application relates to the field of data processing, in particular to a multi-cluster load balancing method and device.

Background technique

With the development of the Internet and computer technology, the business processing system for enterprises is highly complex and needs to handle a large amount of business. Therefore, middleware clusters are used in general business processing systems. A middleware cluster refers to a cluster (Cluster) composed of multiple nodes as middleware, and the nodes as middleware can be processing devices located between platforms (such as hardware and operating systems) and applications or users. A node can be a server, or a device such as a database.

Since a middleware cluster includes multiple nodes, in order to improve processing efficiency when providing services to users through the middleware cluster, the load of each node in a middleware cluster needs to be balanced. Therefore, under normal circumstances, it will be a The middleware cluster is equipped with a load balancing unit, which receives external requests from the user side, and distributes the external requests to each node in the middleware cluster for processing through a certain load balancing strategy.

Contents of the invention

However, since some business processing systems with large business volume generally include multiple middleware clusters, if a load balancing unit needs to be separately configured for each middleware cluster, the system cost will be increased.

In order to solve the above technical problems, the present application provides a multi-cluster load balancing method and device, which realizes that only one load balancing unit needs to be configured for multiple middleware clusters, and reduces system cost.

The embodiment of the application discloses the following technical solutions:

In the first aspect, the embodiment of the present application provides a multi-cluster load balancing method, which is applied to a business processing system, and the business processing system includes multiple middleware clusters, and the multiple middleware clusters are connected to a load balancing unit , the method includes:

The load balancing unit acquires an external request, the external request carries an identifier of a target cluster, and the target cluster is a middleware cluster among the plurality of middleware clusters;

The load balancing unit searches for a configuration file according to the identifier of the target cluster, and determines a plurality of node location information corresponding to the identifier of the target cluster;

The load balancing unit distributes the external request to a target node, and the target node is selected by the load balancing unit from the plurality of node location information according to preset rules.

Optionally, also include:

The load balancing unit pre-collects the location information of each node in the multiple middleware clusters and the identifier of the middleware cluster to which they belong;

The load balancing unit configures the configuration file according to the corresponding relationship between the location information of each node and the identifier of the middleware cluster to which it belongs.

Optionally, the location information of the target node includes the IP address and port information of the target node, and the identifier of the middleware cluster to which the target node belongs includes an application access key provided by the target cluster.

Optionally, the load balancing unit receives external requests through a port.

Optionally, the load balancing unit is an Apache proxy server.

In the second aspect, a multi-cluster load balancing device is characterized in that it is applied to a business processing system, and the business processing system includes multiple middleware clusters, and the multiple middleware clusters are connected to a load balancing unit, so The above device includes an acquisition unit, a search unit and a distribution unit:

The acquiring unit is configured to acquire an external request, where the external request carries an identifier of a target cluster, and the target cluster is a middleware cluster among the plurality of middleware clusters;

The search unit is configured to search for a configuration file according to the identifier of the target cluster, and determine a plurality of node location information corresponding to the identifier of the target cluster;

The distribution unit is configured to distribute the external request to a target node selected by the load balancing unit from the plurality of node location information according to preset rules.

Optionally, also include collection unit and hive:

The collection unit is configured to pre-collect the location information of each node in the plurality of middleware clusters and the identifier of the middleware cluster to which they belong;

The configuration unit is configured to configure the configuration file according to the corresponding relationship between the location information of each node and the identifier of the middleware cluster to which it belongs.

Optionally, the location information of the target node includes the IP address and port information of the target node, and the identifier of the middleware cluster to which the target node belongs includes an application access key provided by the target cluster.

Optionally, the load balancing unit receives external requests through a port.

Optionally, the load balancing unit is an Apache proxy server.

It can be seen from the above technical solutions that in the business processing system, the same load balancing unit distributes external requests for multiple middleware clusters to achieve load balancing. When the load balancing unit obtains external requests, the load balancing unit according to the configuration file, find the target cluster corresponding to the identification carried by the external request, that is, one of the multiple middleware clusters, and the load balancing unit can determine from the multiple nodes of the target cluster according to the preset load balancing rules Process the target node of the external request, and send the external request to the target node according to the location information of the target node, so that only one load balancing unit needs to be configured for multiple middleware clusters, reducing the consumption of system resources, Reduced system cost.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present application. Those skilled in the art can also obtain other drawings based on these drawings without any creative effort.

FIG. 1 is a schematic diagram of the connection relationship between multiple middleware clusters and load balancing units in a service processing system provided by an embodiment of the present application;

FIG. 2 is a method flow chart of a multi-cluster load balancing method provided in an embodiment of the present application;

FIG. 3 is a device structure diagram of a multi-cluster load balancing device provided by an embodiment of the present application.

detailed description

Embodiments of the present application are described below in conjunction with the accompanying drawings.

In a business processing system that performs business processing through middleware clusters, it is generally necessary to configure a load balancing unit for each middleware cluster to achieve load balancing and distribute external requests to nodes in the middleware cluster. For example, a business processing system has If there are ten middleware clusters, ten load balancing units need to be configured for the ten middleware clusters.

However, many business processing systems will set up a large number of middleware clusters due to the large amount of business that needs to be processed. If a load balancing unit is configured for each middleware cluster, maintaining a large number of load balancing units will improve the performance of the business processing system. Build costs.

To this end, the embodiment of the present application provides a multi-cluster load balancing method and device. In the business processing system, the same load balancing unit distributes external requests for multiple middleware clusters to achieve load balancing. When the load When the balance unit obtains an external request, the load balance unit finds the target cluster corresponding to the identifier carried by the external request according to the configuration file, that is, one of the multiple middleware clusters, and the load balance unit can use the preset load balance rule Determine the target node that can handle the external request from the multiple nodes of the target cluster, and send the external request to the target node according to the location information of the target node, so as to realize the configuration for multiple middleware clusters A load balancing unit reduces system resource consumption and system cost.

In the business processing system of the embodiment of the present application, its system composition and connection structure are different from traditional business processing systems. The business processing system of this application includes multiple middleware clusters, and each middleware cluster includes multiple nodes, which is different from the traditional way in which one middleware cluster is configured with one load balancing unit. In this application, multiple intermediate One load balancing unit is uniformly configured for each middleware cluster. This application does not limit all middleware clusters included in a business processing system to be configured with the same load balancing unit. It only needs to have multiple middleware clusters uniformly configured in one load balancing unit. That is, for example, if a business processing system includes ten middleware clusters, one load balancing unit may be uniformly configured for the ten middleware clusters. In this case, the business processing system includes one load balancing unit. It is also possible to uniformly configure a load balancing unit for six middleware clusters among the ten middleware clusters, and configure another load balancing unit for the remaining four middleware clusters. In this case, the business processing system includes two Load balancing unit. It is also possible to uniformly configure a load balancing unit for eight middleware clusters among the ten middleware clusters, and independently configure a load balancing unit for the remaining two middleware clusters. In this case, the business processing system includes three Load balancing unit. That is to say, by implementing the technical solution of the embodiment of the present application, in the business processing system in the embodiment of the present application, the number of load balancing units is obviously smaller than the number of middleware clusters.

FIG. 1 is a schematic diagram of the connection relationship between multiple middleware clusters and load balancing units in a business processing system provided by an embodiment of the present application. For the convenience of display, shown in Fig. 1 are three middleware clusters in the business processing system, these three middleware clusters 100 are connected with a load balancing unit 200, by this load balancing unit 200 for these three middleware clusters 100 provides services of distributing external requests and returning to the outside the response content processed according to the external requests. In FIG. 1, the load balancing unit 200 may be a hardware device, such as an Apache proxy server, and the load balancing unit 200 may also be a program or software installed on a data processing device such as a server, such as software capable of implementing a load balancing function.

Next, the implementation process of load balancing in the embodiment of the present application is described. FIG. 2 is a method flow chart of a multi-cluster load balancing method provided in the embodiment of the present application, which can be applied to, for example, the business processing system shown in FIG. 1 . The methods include:

S201: The load balancing unit acquires an external request, where the external request carries an identifier of a target cluster, and the target cluster is a middleware cluster in the plurality of middleware clusters.

The external requests mentioned here mainly refer to requests from outside the business processing system. Such external requests need to be processed by the nodes of the middleware cluster in the business processing system. In some cases, they need to be returned to the sender of the external request according to the processing results. The corresponding content (response). The external request may include, for example, a request generated by a user to access a certain webpage, and the corresponding content returned through processing may be the content of the webpage stored on the node.

Since the external request is generally generated according to a certain purpose or access requirement, when the load balancing unit receives the external request, it can be determined through the identification carried by the external request that the external request wants to access the server connected to the load balancing unit. Which middleware cluster, or specifically which middleware cluster needs to receive the external request is which one of the middleware clusters connected to the load balancing unit.

The external request may be sent by a user, such as any one of user A, user B, and user C in FIG. 1 .

S202: The load balancing unit searches for a configuration file according to the identifier of the target cluster, and determines a plurality of node location information corresponding to the identifier of the target cluster.

For example, the load balancing unit has a preset configuration file, which includes the middleware clusters connected to the load balancing unit and the relevant information of each node in these middleware clusters, so the load balancing unit can The file finds the target cluster that can receive the external request, and the location information of each node in the target cluster.

The configuration file may be acquired by the load balancing unit by default, or may be pre-collected and configured by the load balancing unit. The embodiment of the present application provides a way to acquire the configuration file in advance. Optionally, the load balancing unit pre-collects the location information of each node in the plurality of middleware clusters and the identification of the middleware cluster to which it belongs; Configure the configuration file for the corresponding relationship.

Wherein, the position information of each node in the middleware cluster is used to identify the position of the node in the network or local area network, for example, may include the IP address and port information of the node, and the identification of the middleware cluster may be used to identify the middleware cluster to distinguish For other middleware clusters, for example, it may be an application access keyword.

Take the three middleware clusters in Figure 1 as an example, respectively Cluster1, Cluster2 and Cluster3, each middleware cluster includes two nodes, then the middleware pre-collected by the load balancing unit connected to these three middleware clusters The relevant information of the cluster can be shown in Table 1:

Table 1

The load balancing unit can use the collected above information to configure a configuration file. When the load balancing unit is specifically an Apache proxy server, the configuration file can be http.conf. If the collected information is the content in Table 1, then http.conf can be configured according to the following format:

LoadModule proxy_module modules/mod_proxy.so

LoadModule proxy_balancer_module modules/mod_proxy_balancer.so

LoadModule proxy_http_module modules/mod_proxy_http.so

And you can add the following content at the end of the http.conf file:

S203: The load balancing unit distributes the external request to a target node, and the target node is selected by the load balancing unit from the plurality of node location information according to preset rules.

The preset rule may be a preset load balancing rule, for example, it may distribute external requests to nodes in turn, or it may distribute external requests of the same type to the same node, etc., which is not limited in this application. In short, the load balancing unit can determine a node for receiving the external request from the target cluster according to preset rules, that is, the target node. Correspondingly, the location information of the target node is pre-collected in S202, which may include the IP address and port information of the target node, and the identifier of the middleware cluster to which the target node belongs includes the application access key provided by the target cluster.

After the location information of the target node is determined from the configuration file, the external request can be distributed to the target node according to the location information, and the external request is processed by the target node.

It can be seen that in the business processing system, the same load balancing unit distributes external requests for multiple middleware clusters to achieve load balancing. When the load balancing unit obtains an external request, the load balancing unit finds the The target cluster corresponding to the identification carried by the external request is one of the multiple middleware clusters, and the load balancing unit can determine the target that can process the external request from multiple nodes of the target cluster according to the preset load balancing rules Node, and send the external request to the target node according to the location information of the target node, so that only one load balancing unit needs to be configured for multiple middleware clusters, reducing the consumption of system resources and system cost.

It should be noted that since the load balancing unit can distinguish which middleware cluster the received external request is processed by using the configuration file, the load balancing unit can only receive external requests through one port. As a result, multiple middleware clusters only need to provide access to one port, which reduces the risk of servers configured with load balancing units and servers configured with middleware clusters being exposed on the public network, and fundamentally improves server security. .

Fig. 3 is a device structure diagram of a multi-cluster load balancing device provided by an embodiment of the present application, which is applied to a business processing system, and the business processing system includes multiple middleware clusters, and the multiple middleware clusters are connected to a load The equalization unit is connected, and the device includes an acquisition unit 301, a search unit 302 and a distribution unit 303:

The acquiring unit 301 is configured to acquire an external request, where the external request carries an identifier of a target cluster, and the target cluster is a middleware cluster in the plurality of middleware clusters.

The searching unit 302 is configured to search a configuration file according to the identifier of the target cluster, and determine a plurality of node location information corresponding to the identifier of the target cluster.

The distribution unit 303 is configured to distribute the external request to a target node selected by the load balancing unit from the plurality of node location information according to preset rules.

Optionally, also include collection unit and hive:

The collection unit is configured to pre-collect the location information of each node in the plurality of middleware clusters and the identifier of the middleware cluster to which they belong;

The configuration unit is configured to configure the configuration file according to the corresponding relationship between the location information of each node and the identifier of the middleware cluster to which it belongs.

Optionally, the location information of the target node includes the IP address and port information of the target node, and the identifier of the middleware cluster to which the target node belongs includes an application access key provided by the target cluster.

Optionally, the load balancing unit receives external requests through a port.

Optionally, the load balancing unit is an Apache proxy server.

It can be seen that in the business processing system, the same load balancing unit distributes external requests for multiple middleware clusters to achieve load balancing. When the load balancing unit obtains an external request, the load balancing unit finds the The target cluster corresponding to the identification carried by the external request is one of the multiple middleware clusters, and the load balancing unit can determine the target that can process the external request from multiple nodes of the target cluster according to the preset load balancing rules Node, and send the external request to the target node according to the location information of the target node, so that only one load balancing unit needs to be configured for multiple middleware clusters, reducing the consumption of system resources and system cost.

It should be noted that since the load balancing unit can distinguish which middleware cluster the received external request is processed by using the configuration file, the load balancing unit can only receive external requests through one port. As a result, multiple middleware clusters only need to provide access to one port, which reduces the risk of servers configured with load balancing units and servers configured with middleware clusters being exposed on the public network, and fundamentally improves server security. .

Those of ordinary skill in the art can understand that all or part of the steps to realize the above method embodiments can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the execution includes: The steps of the above-mentioned method embodiments; and the aforementioned storage medium can be at least one of the following media: read-only memory (English: read-only memory, abbreviation: ROM), RAM, magnetic disk or optical disk, etc. can store medium for program code.

It should be noted that each embodiment in this specification is described in a progressive manner, the same and similar parts of each embodiment can be referred to each other, and each embodiment focuses on the differences from other embodiments. place. In particular, for the device and system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and for relevant parts, please refer to part of the description of the method embodiments. The device and system embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network elements. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. It can be understood and implemented by those skilled in the art without creative effort.

The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person familiar with the technical field can easily think of changes or Replacement should be covered within the protection scope of this application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims (10)

1. A multi-cluster load balancing method, characterized in that it is applied to a business processing system, and the business processing system includes a plurality of middleware clusters, and the plurality of middleware clusters are connected to a load balancing unit, the method include: The load balancing unit acquires an external request, the external request carries an identifier of a target cluster, and the target cluster is a middleware cluster among the plurality of middleware clusters; The load balancing unit searches for a configuration file according to the identifier of the target cluster, and determines a plurality of node location information corresponding to the identifier of the target cluster; The load balancing unit distributes the external request to a target node, and the target node is selected by the load balancing unit from the plurality of node location information according to preset rules. 2. The method according to claim 1, further comprising: The load balancing unit pre-collects the location information of each node in the multiple middleware clusters and the identifier of the middleware cluster to which they belong; The load balancing unit configures the configuration file according to the corresponding relationship between the location information of each node and the identifier of the middleware cluster to which it belongs. 3. The method according to claim 2, wherein the location information of the target node includes the IP address and port information of the target node, and the identifier of the middleware cluster to which the target node belongs includes the The provided application access key. 4. The method according to claim 1, wherein the load balancing unit receives an external request through a port. 5. The method according to claim 1, wherein the load balancing unit is an Apache proxy server. 6. A multi-cluster load balancing device, characterized in that it is applied to a business processing system, and the business processing system includes a plurality of middleware clusters, and the plurality of middleware clusters are connected to a load balancing unit, and the device Including acquisition unit, lookup unit and distribution unit: The acquiring unit is configured to acquire an external request, where the external request carries an identifier of a target cluster, and the target cluster is a middleware cluster among the plurality of middleware clusters; The search unit is configured to search for a configuration file according to the identifier of the target cluster, and determine a plurality of node location information corresponding to the identifier of the target cluster; The distribution unit is configured to distribute the external request to a target node selected by the load balancing unit from the plurality of node location information according to preset rules. 7. The device according to claim 6, further comprising a collection unit and a configuration unit: The collection unit is configured to pre-collect the location information of each node in the plurality of middleware clusters and the identifier of the middleware cluster to which they belong; The configuration unit is configured to configure the configuration file according to the corresponding relationship between the location information of each node and the identifier of the middleware cluster to which it belongs. 8. The method according to claim 7, wherein the location information of the target node includes the IP address and port information of the target node, and the identifier of the middleware cluster to which the target node belongs includes the The provided application access key. 9. The device according to claim 6, wherein the load balancing unit receives an external request through a port. 10. The device according to claim 6, wherein the load balancing unit is an Apache proxy server.