Summary of the invention
The application's is designed to provide a kind of distributed objects storage cluster and its request responding method, system and one kind
Computer readable storage medium improves the high availability and Information Security of distributed objects storage cluster.
To achieve the above object, this application provides a kind of distributed objects storage clusters, including Haproxy server set
Group, keystone authentication module, Metadata Service cluster and object storage cluster;
The Haproxy server cluster includes multiple Haproxy server nodes;Each Haproxy server section
Heartbeat inspecting and resource take-over are realized by Keepalived between point;
The client that the keystone authentication module is used to send service request carries out authentication.
Wherein, each Haproxy server node is connected with multiple responsive nodes;
The responsive node is used to respond the client according to the Metadata Service cluster and the object storage cluster
The service request at end.
To achieve the above object, this application provides a kind of distributed objects storage cluster request responding methods, comprising:
When receiving the service request of client, identity is carried out to the client by keystone authentication module and is recognized
Card;
After authentication passes through, the service request is distributed to target response by target Haproxy server node
Node, so that the target response node holds Metadata Service cluster and/or object storage cluster according to the service request
The corresponding operation of row.
Wherein, the corresponding operation includes any one of user account management, data storage management and data management
Or appoint multinomial combination.
Wherein, further includes:
Heartbeat inspecting is carried out to each Haproxy server node in Haproxy server cluster by Keepalived,
And judge whether there is failure Haproxy server node;
If so, by the resource transfers in the failure Haproxy server node to the Haproxy server cluster
In other Haproxy server nodes.
Wherein, by the resource transfers in the failure Haproxy server node into the Haproxy server cluster
Other Haproxy server nodes, comprising:
It is selected according to the current load situation of other Haproxy server nodes in the Haproxy server cluster
Target Haproxy server node;
By the resource transfers in the failure Haproxy server node to the target Haproxy server node.
To achieve the above object, this application provides a kind of distributed objects storage clusters to request response system, comprising:
Authentication module, for when receiving the service request of client, by keystone authentication module to the visitor
Family end carries out authentication;
Respond module after passing through for authentication, is divided the service request by target Haproxy server node
Be assigned to target response node, so as to the target response node according to the service request to Metadata Service cluster and/or right
As storage cluster executes corresponding operation.
Wherein, further includes:
Monitoring modular, for passing through Keepalived to each Haproxy server node in Haproxy server cluster
Heartbeat inspecting is carried out, and judges whether there is failure Haproxy server node;
Shift module, for when there are failure Haproxy server node, by the failure Haproxy server section
Other Haproxy server nodes of resource transfers into the Haproxy server cluster in point.
Wherein, the shift module includes:
Selection unit, for according to the current of other Haproxy server nodes in the Haproxy server cluster
Loading condition selection target Haproxy server node;
Buanch unit, for by the resource transfers in the failure Haproxy server node to the target Haproxy
Server node.
To achieve the above object, this application provides a kind of computer readable storage medium, the computer-readable storages
It is stored with computer program on medium, is realized when the computer program is executed by processor such as above-mentioned distributed objects storage collection
The step of group's request responding method.
By above scheme it is found that a kind of distributed objects storage cluster provided by the present application, including Haproxy server
Cluster, keystone authentication module, Metadata Service cluster and object storage cluster;The Haproxy server cluster includes
Multiple Haproxy server nodes;Between each Haproxy server node by Keepalived realize heartbeat inspecting and
Resource take-over;The client that the keystone authentication module is used to send service request carries out authentication.
Distributed objects storage cluster provided by the present application passes through on the basis of traditional objects storage cluster
The unified certification of keystone, legitimate user could be saved by the DNS Server after haproxy and keepalived setting
Point is realized to the data manipulation based on object storage cluster.Unified keystone Verification System guarantees the safety of user data
And isolation, effectively promote the handling capacity of service request.Multiple Haproxy server nodes are disposed respectively simultaneously, as right
As the interface of storage cluster, in the case that Parallel Service requests sharp increase, the mistake of data parallel access can be effectively reduced
Number of request is lost, realizes the high availability of entire object storage cluster.Disclosed herein as well is a kind of distributed objects storage clusters
Request responding method, system and a kind of computer readable storage medium, are equally able to achieve above-mentioned technical effect.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of embodiments of the present application, instead of all the embodiments.It is based on
Embodiment in the application, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall in the protection scope of this application.
The embodiment of the present application discloses a kind of distributed objects storage cluster, improves the height of distributed objects storage cluster
Availability and Information Security.
Referring to Fig. 1, a kind of structure chart of distributed objects storage cluster disclosed in the embodiment of the present application, as shown in Figure 1, packet
Include Haproxy server cluster 200, keystone authentication module 100, Metadata Service cluster 300 and object storage cluster
400;
The Haproxy server cluster 200 includes multiple Haproxy server nodes;Each Haproxy server
Heartbeat inspecting and resource take-over are realized by Keepalived between node;
The client that the keystone authentication module 100 is used to send service request carries out authentication.
In specific implementation, it is the high availability for realizing distributed objects storage cluster, disposes multiple Haproxy servers
Interface of the node as object storage cluster.To include that two Haproxy server nodes are in Haproxy server cluster
Example, distributed objects storage cluster overall architecture provided in this embodiment are as shown in Figure 2.
The cluster ecosystem is a complete object storage system, realizes the storage of user data in object storage cluster
And management.Librados is abstracted and is encapsulated to RADOS, is provided API to upper layer, is met the application and development need based on RADOS
It asks.RADOSGW provides the upper layer that abstraction hierarchy is higher, is more convenient for applying or client uses on the basis of the library librados and connects
Mouthful.RADOSGW is one and provides the gateway of the RESTful API compatible with Amazon S3 and Swift, passes through design
RADOS-GW come provide object storage application and development, such as the authentication system of user, the management of user, quotas administered, object
Operation etc..Haproxy1 and Haproxy2 is the node that RADOSGW is arranged in entire storage cluster.Each Haproxy server
Node is connected with multiple responsive nodes, which is used for according to Metadata Service cluster and object storage cluster customer in response
The service request at end.
Data user's control all in the file system of most of clients and intelligence are in the file system source of kernel
It is executed in itself.Cluster monitor can also be set in object storage cluster, for executing function for monitoring.When object storage is set
It is standby to break down or when new equipment adds, cluster monitor just detect and safeguard that an effective cluster maps.Object storage
The various request of data that each memory node cooperation responsive node customer in response end in cluster issues.Meta data server is for delaying
It deposits and filename is changed into index node, file size with synchronous distributed meta data, meta data server, be used for file I/O
Segment data layout.
Frame for above-mentioned object storage cluster is as shown in figure 3, in the state that object storage cluster is healthy, Yong Hutong
Crossing DNS Server node visit object storage cluster can set in entire object storage cluster according to actual production demand
The RADOSGW for counting object storage cluster forms huge multizone accessed node, realizes the multi-region domain browsing mould of user's access
Formula meets the interaction and operation of different user under actual production environment.Keystone authentication module unified certification realizes that user visits
The safety asked and the isolation to storing data.Object storage cluster can be operated and manage by the user of unified certification,
Such as the service such as data storage, data management, integration of data.
Realization for high availability is as shown in figure 4, Haproxy1 and Haproxy2 provides pair in object storage cluster
As storage service.Fault detection is constantly carried out on haproxy1 and haproxy2 node by the way that keepalived is arranged, and is guaranteed
Object storage cluster provides normal cloud storage service.In DNS Server node installation and configuration Haproxy, user can lead to
It crosses access DNS Server and realizes the poll access stored to object, when network access quantity sharp increase, can effectively solve
The certainly I/O bottleneck of network mitigates the pressure of server node.
Distributed objects storage cluster provided by the embodiments of the present application passes through on the basis of traditional objects storage cluster
The unified certification of keystone, legitimate user could be saved by the DNS Server after haproxy and keepalived setting
Point is realized to the data manipulation based on object storage cluster.Unified keystone Verification System guarantees the safety of user data
And isolation, effectively promote the handling capacity of service request.Multiple Haproxy server nodes are disposed respectively simultaneously, as right
As the interface of storage cluster, in the case that Parallel Service requests sharp increase, the mistake of data parallel access can be effectively reduced
Number of request is lost, realizes the high availability of entire object storage cluster.
Distributed objects storage cluster request responding method is present embodiments provided, specific:
Referring to Fig. 5, a kind of flow chart of distributed objects storage cluster request responding method provided by the embodiments of the present application,
As shown in Figure 5, comprising:
S101: when receiving the service request of client, the client is carried out by keystone authentication module
Authentication;
In specific implementation, in DNS Server node installation and configuration Haproxy, user can be accessed by client
DNS Server realizes the service request to object storage cluster.Only recognized with the user by the identity of keystone authentication module
After card, which can just be assigned to responsive node and be responded, and realize the safety of user's access and to storing data
Isolation.
S102: after authentication passes through, the service request is distributed to target by target Haproxy server node
Responsive node, so that the target response node collects Metadata Service cluster and/or object storage according to the service request
Group executes corresponding operation.
Wherein, corresponding operation may include user account management, data storage management and data management etc. herein.
Distributed objects storage cluster request responding method provided by the embodiments of the present application, in traditional objects storage cluster
On the basis of, by the unified certification of keystone, legitimate user could be by after haproxy and keepalived setting
DNS Server node is realized to the data manipulation based on object storage cluster.Unified keystone Verification System guarantees user
The safety and isolation of data effectively promote the handling capacity of service request.Dispose multiple Haproxy servers respectively simultaneously
Node can be effectively reduced data simultaneously in the case that Parallel Service requests sharp increase as the interface of object storage cluster
The failure request number of row access, realizes the high availability of entire object storage cluster.
The high availability implementation method of distributed objects storage cluster provided in this embodiment is described below, specific:
Referring to Fig. 6, the process of another kind distributed objects storage cluster request responding method provided by the embodiments of the present application
Figure, as shown in Figure 6, comprising:
S201: heartbeat is carried out to each Haproxy server node in Haproxy server cluster by Keepalived
Monitoring, and judge whether there is failure Haproxy server node;If so, into S202;
S202: by the resource transfers in the failure Haproxy server node into the Haproxy server cluster
Other Haproxy server nodes.
In specific implementation, the operating status of the continuous test object storage cluster of Keepalived, if Haproxy1 is serviced
Device crashes or work is broken down, then by the resource transfers in Haproxy1 server to other Haproxy server nodes, and
Haproxy1 server is restarted, after its is working properly, Haproxy1 server is added to pair by keepalived automatically
As not needing artificial interference in storage cluster, the high availability of whole system ensure that.
This step includes: according to other in the Haproxy server cluster as a preferred implementation manner,
The current load situation selection target Haproxy server node of Haproxy server node;The failure Haproxy is taken
The resource transfers being engaged in device node are to the target Haproxy server node.
It is understood that it is lighter to can choose present load to make all Haproxy server node load balancing
Haproxy server node as target Haproxy server node, and extremely by the resource transfers in Haproxy1 server
On target Haproxy server node.
A kind of distributed objects storage cluster request response system provided by the embodiments of the present application is introduced below, under
A kind of distributed objects storage cluster request response system of text description and a kind of above-described distributed objects storage cluster
Request responding method can be cross-referenced.
Referring to Fig. 7, a kind of structure chart of distributed objects storage cluster request response system provided by the embodiments of the present application,
As shown in fig. 7, comprises:
Authentication module 701, for when receiving the service request of client, by keystone authentication module to described
Client carries out authentication;
Respond module 702 after passing through for authentication, is asked the service by target Haproxy server node
Ask distribution to target response node, so as to the target response node according to the service request to Metadata Service cluster and/
Or object storage cluster executes corresponding operation.
Distributed objects storage cluster request responding method provided by the embodiments of the present application, in traditional objects storage cluster
On the basis of, by the unified certification of keystone, legitimate user could be by after haproxy and keepalived setting
DNS Server node is realized to the data manipulation based on object storage cluster.Unified keystone Verification System guarantees user
The safety and isolation of data effectively promote the handling capacity of service request.Dispose multiple Haproxy servers respectively simultaneously
Node can be effectively reduced data simultaneously in the case that Parallel Service requests sharp increase as the interface of object storage cluster
The failure request number of row access, realizes the high availability of entire object storage cluster.
On the basis of the above embodiments, as a preferred implementation manner, further include:
Monitoring modular, for passing through Keepalived to each Haproxy server node in Haproxy server cluster
Heartbeat inspecting is carried out, and judges whether there is failure Haproxy server node;
Shift module, for when there are failure Haproxy server node, by the failure Haproxy server section
Other Haproxy server nodes of resource transfers into the Haproxy server cluster in point.
On the basis of the above embodiments, the shift module includes: as a preferred implementation manner,
Selection unit, for according to the current of other Haproxy server nodes in the Haproxy server cluster
Loading condition selection target Haproxy server node;
Buanch unit, for by the resource transfers in the failure Haproxy server node to the target Haproxy
Server node.
Present invention also provides a kind of computer readable storage medium, the storage medium may include: USB flash disk, mobile hard disk,
Read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic
The various media that can store program code such as dish or CD.Computer program, the calculating are stored on the storage medium
Machine program realizes the distributed objects storage cluster request responding method that any of the above-described embodiment provides when being executed by processor
Step.
Each embodiment is described in a progressive manner in specification, the highlights of each of the examples are with other realities
The difference of example is applied, the same or similar parts in each embodiment may refer to each other.For system disclosed in embodiment
Speech, since it is corresponded to the methods disclosed in the examples, so being described relatively simple, related place is referring to method part illustration
?.It should be pointed out that for those skilled in the art, under the premise of not departing from the application principle, also
Can to the application, some improvement and modification can also be carried out, these improvement and modification also fall into the protection scope of the claim of this application
It is interior.
It should also be noted that, in the present specification, relational terms such as first and second and the like be used merely to by
One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation
Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning
Covering non-exclusive inclusion, so that the process, method, article or equipment for including a series of elements not only includes that
A little elements, but also including other elements that are not explicitly listed, or further include for this process, method, article or
The intrinsic element of equipment.In the absence of more restrictions, the element limited by sentence "including a ...", is not arranged
Except there is also other identical elements in the process, method, article or apparatus that includes the element.