CN119718684B - Resource management method, device, equipment, medium and program product - Google Patents

Abstract

The invention provides a resource management method which can be applied to the field of cloud computing. The resource management method comprises the steps of obtaining historical resource consumption data of a plurality of service nodes in a server cluster, wherein the service nodes comprise compound nodes, the compound nodes are service nodes integrated with a resource management function, determining service duration of the service nodes capable of continuously providing service under the condition that the service nodes maintain consumption speed matched with the consumption change rule by current available resource quantity based on consumption change rules obtained by analyzing the historical resource consumption data of the service nodes for each service node, and performing resource allocation on a first target node determined from the service nodes by utilizing the resource management function according to the service duration of each service node. The invention also provides a resource management device, equipment, a storage medium and a program product.

Description

Resource management method, device, apparatus, medium and program product

Technical Field

The present invention relates to the field of cloud computing, and in particular, to a resource management method, apparatus, device, medium, and program product.

Background

In a full flash memory system, resources are typically allocated for each node in a service cluster in a pre-allocation manner. To ensure that the nodes maintain load balancing as they handle traffic, the system typically utilizes a load balancer to dynamically adjust the allocation of resources. The load balancer monitors the load state of each node in real time, and if the load of a certain node is too high, tasks are distributed to the nodes with lower loads, so that reasonable utilization of system resources is realized.

In the process of realizing the inventive concept, the inventor finds that at least the following problems exist in the related art, and because of the large number of nodes in the service cluster, frequent interaction between the nodes and the load balancer is needed to realize dynamic allocation of resources. Such frequent interactions can significantly increase the consumption of communication resources, thereby affecting the overall performance of the system.

Disclosure of Invention

In view of the foregoing, the present invention provides a resource management method, apparatus, device, medium, and program product.

According to a first aspect of the present invention, there is provided a resource management method, comprising obtaining historical resource consumption data of each of a plurality of service nodes including a composite node in a server cluster, wherein the composite node is a service node integrated with a resource management function, determining, for each of the service nodes, a service duration in which the service node can continuously provide a service while maintaining a consumption rate matching the consumption rate with a current available resource amount based on a consumption rate change rule obtained by analyzing the historical resource consumption data of the service node, and performing resource allocation on a first target node determined from the plurality of service nodes by using the resource management function according to the service duration of each of the plurality of service nodes.

The second aspect of the invention provides a resource management device, which comprises a data acquisition module, a time length determination module and a resource allocation module, wherein the data acquisition module is used for acquiring historical resource consumption data of a plurality of service nodes including a compound node in a server cluster, the compound node is a service node integrated with a resource management function, the time length determination module is used for determining, for each service node, a service time length for which the service node can continuously provide service under the condition that the current available resource quantity maintains a consumption speed matched with the consumption change rule based on a consumption change rule obtained by analyzing the historical resource consumption data of the service node, and the resource allocation module is used for performing resource allocation on a first target node determined from the plurality of service nodes according to the service time length of each service node.

A third aspect of the invention provides an electronic device comprising one or more processors and a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the method.

A fourth aspect of the invention also provides a computer readable storage medium having stored thereon a computer program or instructions which when executed by a processor performs the steps of the above method.

The fifth aspect of the invention also provides a computer program product comprising a computer program or instructions which, when executed by a processor, carries out the steps of the method described above.

According to the embodiment of the invention, the resource management function of the composite node is used for distributing resources, so that the separation of the control side and the service side is realized. In the distribution process, the sustainable service duration of the service node is predicted according to the consumption change rule of the service node, and the consumption change rule is determined based on historical resource consumption data dynamically generated by the service node in service operation, so that the service side and the control side can know the resource condition without frequent interaction. The resource allocation is carried out by the determined service duration, so that service interruption caused by space exhaustion is reduced, real-time dependence on a control side is reduced because the resource allocation depends on local historical resource consumption data, and interaction frequency between the control side and a service side is obviously reduced, and therefore resource allocation efficiency and system stability are improved.

Drawings

The foregoing and other objects, features and advantages of the invention will be apparent from the following description of embodiments of the invention, which is to be read in connection with the accompanying drawings.

FIG. 1 illustrates an application scenario diagram of a resource management method, apparatus, device, medium and program product according to an embodiment of the present invention.

Fig. 2 shows a flow chart of a resource management method according to an embodiment of the invention.

Fig. 3 shows a workflow diagram of a service node in a resource management method according to an embodiment of the invention.

Fig. 4 shows a schematic diagram of the working principle of the resource management method according to an embodiment of the present invention.

Fig. 5 shows a trend diagram of consumption change rules in the resource management method according to an embodiment of the present invention.

Fig. 6 is a schematic diagram illustrating a data synchronization process in a resource management method according to an embodiment of the present invention.

Fig. 7 shows a block diagram of a resource management device according to an embodiment of the present invention.

Fig. 8 shows a block diagram of an electronic device adapted to implement a resource management method according to an embodiment of the invention.

Detailed Description

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. It should be understood that the description is only illustrative and is not intended to limit the scope of the invention. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the invention. It may be evident, however, that one or more embodiments may be practiced without these specific details. In addition, in the following description, descriptions of well-known structures and techniques are omitted so as not to unnecessarily obscure the present invention.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The terms "comprises," "comprising," and/or the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.

All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It should be noted that the terms used herein should be construed to have meanings consistent with the context of the present specification and should not be construed in an idealized or overly formal manner.

Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a convention should be interpreted in accordance with the meaning of one of skill in the art having generally understood the convention (e.g., "a system having at least one of A, B and C" would include, but not be limited to, systems having a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).

In the technical scheme of the invention, the related user information (including but not limited to user personal information, user image information, user equipment information, such as position information and the like) and data (including but not limited to data for analysis, stored data, displayed data and the like) are information and data authorized by a user or fully authorized by all parties, and the related data are collected, stored, used, processed, transmitted, provided, disclosed, applied and the like, all comply with related laws and regulations and standards, necessary security measures are adopted, no prejudice to the public order is provided, and corresponding operation entries are provided for the user to select authorization or rejection.

The embodiment of the invention provides a resource management method, which comprises the steps of obtaining historical resource consumption data of a plurality of service nodes including a compound node in a server cluster, wherein the compound node is a service node integrated with a resource management function, determining service duration of a service node capable of continuously providing the service under the condition that the service node maintains a consumption speed matched with the consumption variation rule by the current available resource amount based on the consumption variation rule obtained by analyzing the historical resource consumption data of the service node for each service node, and performing resource allocation on a first target node determined from the plurality of service nodes by utilizing the resource management function according to the service duration of each service node.

FIG. 1 illustrates an application scenario diagram of a resource management method, apparatus, device, medium and program product according to an embodiment of the present invention.

As shown in fig. 1, an application scenario 100 according to this embodiment may include a first terminal device 101, a second terminal device 102, a third terminal device 103, a network 104, and a server 105. The network 104 is a medium used to provide a communication link between the first terminal device 101, the second terminal device 102, the third terminal device 103, and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.

The user may interact with the server 105 via the network 104 using the first terminal device 101, the second terminal device 102, the third terminal device 103, to receive or send messages etc. Various communication client applications, such as a shopping class application, a web browser application, a search class application, an instant messaging tool, a mailbox client, social platform software, etc. (by way of example only) may be installed on the first terminal device 101, the second terminal device 102, and the third terminal device 103.

The first terminal device 101, the second terminal device 102, the third terminal device 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smartphones, tablets, laptop and desktop computers, and the like.

The server 105 may be a server providing various services, such as a background management server (by way of example only) providing support for websites browsed by the user using the first terminal device 101, the second terminal device 102, and the third terminal device 103. The background management server may analyze and process the received data such as the user request, and feed back the processing result (e.g., the web page, information, or data obtained or generated according to the user request) to the terminal device.

It should be noted that, the resource management method provided by the embodiment of the present invention may be generally executed by the server 105. Accordingly, the resource management device provided by the embodiment of the present invention may be generally disposed in the server 105. The resource management method provided by the embodiment of the present invention may also be performed by a server or a server cluster that is different from the server 105 and is capable of communicating with the first terminal device 101, the second terminal device 102, the third terminal device 103 and/or the server 105. Accordingly, the resource management device provided by the embodiment of the present invention may also be provided in a server or a server cluster, which is different from the server 105 and is capable of communicating with the first terminal device 101, the second terminal device 102, the third terminal device 103 and/or the server 105.

It should be understood that the number of terminal devices, networks and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.

The resource management method of the embodiment will be described in detail below with reference to fig. 2 to 6 based on the scenario described in fig. 1.

Fig. 2 shows a flow chart of a resource management method according to an embodiment of the invention.

As shown in FIG. 2, the embodiment includes operations S210-S230.

In operation S210, historical resource consumption data of each of a plurality of service nodes including a composite node in a server cluster is acquired, wherein the composite node is a service node integrated with a resource management function.

In operation S220, for each service node, based on the consumption change rule obtained by analyzing the historical resource consumption data of the service node, the service node is able to continuously provide the service duration of the service while determining that the service node maintains the consumption speed matching the consumption change rule with the current available resource amount.

In operation S230, a resource is allocated to a first target node determined from the plurality of service nodes using a resource management function according to the service duration of each of the plurality of service nodes.

In an all-flash system, the distributed architecture is a core design that supports its high performance and scalability, according to embodiments of the present invention. The architecture achieves load balancing and high availability by storing data across multiple service nodes. These service nodes are typically organized in clusters of servers, each service node in the cluster independently processing data requests and performing computing tasks.

According to an embodiment of the present invention, each service node mainly includes two modules, namely a space allocation unit and a space reclamation unit (the working logic of which is shown in fig. 3). The space allocation unit is responsible for managing and allocating the space in the service node, so that resources can be allocated timely when the brushing operation is executed, and the writing requirement of data is met. During operation of the service node, the space of the service node is typically managed at the granularity of data blocks (the size of the data blocks is defined according to the actual system implementation). Therefore, the space allocation unit can manage and allocate the data blocks, and can track the use condition of the recorded data blocks so as to ensure that the data blocks cannot be reused.

According to the embodiment of the invention, the space recycling unit is responsible for recycling the used data blocks, and is generally realized by a garbage recycling mechanism in a full flash system, and mainly recycling the data blocks which are distributed and have little effective data back for the space distribution unit to continue to use.

Specifically, as shown in fig. 3, the workflow of the service node in this embodiment includes operations S310 to S370.

In operation S310, load data is received. In operation S320, aggregation and brushing processes are performed on the load data. In operation S330, the processed data is written into the data block. In operation S340, it is confirmed that the data has completed the disc writing operation. In operation S350, the used data block is reclaimed. In operation S360, the reclaimed data block is released. The released data block is reallocated for subsequent use in operation S370.

According to the embodiment of the invention, the automation of data processing and resource management is realized by systematically receiving, processing, writing, confirming, recycling, releasing and reallocating the data blocks of the load data, and meanwhile, the cyclic utilization of resources is promoted, and the operation efficiency and the utilization rate of storage resources are effectively improved.

According to the embodiment of the invention, the plurality of service nodes of the server cluster further comprise a composite node for resource management, and the composite node and other service nodes can perform service processing. The compound node is arbitrated and selected from a plurality of service nodes according to preset rules. The compound node can monitor the load change and the resource consumption condition of each service node in the server cluster, and dynamically allocate resources for a plurality of service nodes including the compound node based on the information so as to meet the running requirement of the system.

In the practical system design, as shown in fig. 4, the server where the composite node is located includes four main modules, namely a capacity monitoring unit 410, a trend predicting unit 420, a space scheduling unit 430 and a space management unit 440. The capacity monitoring unit 410 is mainly responsible for monitoring the capacity of each service node in the server cluster, and providing reference data for subsequent resource allocation. The trend prediction unit 420 is mainly responsible for analyzing whether the capacity of each service node meets the service operation requirement, whether resource allocation is needed, and the like, and is a core module of the whole load balancing scheduling. The space scheduling unit 430 is configured to perform a task allocated to a resource of each service node, and belongs to a task execution unit. And when the data block migration is required, the data block is in butt joint with the corresponding service node, so that the resource transfer is completed. The space management unit 440 is mainly responsible for storing records for tracking the attribution relation of the record resources. The composite node realizes the resource management function based on the four modules, thereby distributing the resources to each service node.

According to an embodiment of the present invention, as shown in fig. 4, the composite node obtains historical resource consumption data of each service node in the server cluster. In the process of acquisition, data is generally acquired in a periodic sampling manner. Specifically, at least three records of time points are required to be kept in the historical resource consumption data. The obtained historical resource consumption data comprises records of a plurality of monitoring index items in the service node. The monitoring index items respectively comprise the total capacity of the service node, the current available resource quantity, the resource release rate and the like. It should be noted that these items are basic indexes to be monitored, and if the regulation is finer, more indexes, such as the utilization rate of the processor, etc., can also be monitored.

According to an embodiment of the present invention, the historical resource consumption data of the service node is generated based on actual operations of allocation and release of resources inside the service node. As shown in fig. 4, the space allocation unit 450 and the space reclamation unit 460 within the service node cooperate through an internal circulation mechanism. When the service node has completed its task and freed up storage space, space reclamation unit 460 reclaims the space and places it back into the pool of available space. Subsequently, the space allocation unit 450 can extract space from the pool to be allocated to the new service node. This looping ensures efficient utilization of storage resources and continuous optimized management.

According to the embodiment of the invention, the historical resource consumption data of each service node is analyzed to determine the consumption change rule of the resources. These consumption change laws are used to describe the resource consumption characteristics exhibited by the service node in performing the internal cyclic resource allocation and release process. As shown in fig. 5, the consumption change rule may be divided into seven main trends, namely, a first trend 501 indicating that the consumption of resources tends to be stable, a second trend 502 indicating that the consumption of resources steadily increases, a third trend 503 indicating that the consumption of resources is slowly increased, a fourth trend 504 indicating that the consumption of resources is quickly increased, a fifth trend 505 indicating that the consumption of resources steadily decreases, a sixth trend 506 indicating that the consumption of resources is quickly decreased, and a seventh trend 507 indicating that the consumption of resources is slowly decreased.

According to the embodiment of the invention, after the current available resource amount of the service node is determined, the service node can continuously provide the service duration of the service under the condition that the consumption speed matched with the consumption change rule is determined according to the consumption change rule. And evaluating the urgency of each service node to the space requirement according to the service duration of each service node. In this case, the serving node having the shortest service duration, i.e., the first target node, should obtain the priority resource allocation right.

According to the embodiment of the invention, the resource management function of the composite node is used for distributing resources, so that the separation of the control side and the service side is realized. In the distribution process, the sustainable service duration of the service node is predicted according to the consumption change rule of the service node, and the consumption change rule is determined based on historical resource consumption data dynamically generated by the service node in service operation, so that the service side and the control side can know the resource condition without frequent interaction. The resource allocation is carried out by the determined service duration, so that service interruption caused by space exhaustion is reduced, real-time dependence on a control side is reduced because the resource allocation depends on local historical resource consumption data, and interaction frequency between the control side and a service side is obviously reduced, and therefore resource allocation efficiency and system stability are improved.

According to the embodiment of the invention, based on the consumption change rule obtained by analyzing the historical resource consumption data of the service node, under the condition that the service node maintains the consumption speed matched with the consumption change rule by the current available resource amount, the service node can continuously provide the service duration of the service, and the method comprises the steps of quantifying the consumption change rule by using a discrete difference method based on the acquisition period of the historical resource consumption data to obtain the consumption characteristic parameter; performing differential analysis on the current available resource quantity and the historical resource remaining quantity in the historical resource consumption data, introducing consumption characteristic parameters, and calibrating analysis results to obtain the consumption speed of the service node on the resources; and determining the service duration of continuously providing the service under the condition that the consumption speed is maintained by the service node under the current available resource quantity.

According to an embodiment of the present invention, an acquisition cycle for historical resource consumption data is determined, assuming that the acquisition cycle isAnd quantifying the consumption change rule by using a discrete difference method to obtain the consumption characteristic parameters. Specifically, assume that the current available resource amounts corresponding to the three sampling times of the service node are A1, A2, and A3, respectively. According to the acquisition cycle of the dataAnd quantifying the consumption change rule by using the formula (1).

Wherein P represents the consumption characteristic parameters obtained after quantization.

According to an embodiment of the present invention, a difference analysis is performed on the current amount of available resources and the historical resource remaining amount in the historical resource consumption data. The historical resource remaining amount used in the difference analysis process is the available resource amount corresponding to the sampling point closest to the current moment. For example, when the current available resource amount is A3, the historical resource remaining amount is selected to be A2. By selecting adjacent continuous data, the prediction result is more accurate.

According to the embodiment of the invention, after the analysis result is obtained, the consumption characteristic parameters are introduced to calibrate the analysis result so that the analysis result accords with the consumption change rule. And calculating the service duration for which the service node can continuously provide service under the current available resource amount based on the consumption speed of the resources obtained after calibration. The urgency degree of each service node to the resource requirement can be known by calculating the service time length, so that the resources can be preferentially allocated for the service time with the shortest service time, the allocation of the resources is more reasonable, and the service interruption of the service nodes caused by the resource exhaustion is reduced.

According to the embodiment of the invention, difference analysis is carried out on the current available resource quantity and the historical resource residual quantity in the historical resource consumption data, and the analysis result is calibrated by introducing the consumption characteristic parameter, so that the consumption speed of the service node on the resource is obtained.

According to the embodiment of the invention, in the process of calculating the consumption speed of the resource, the change rate of the resource quantity in the acquisition period is determined, and then the change rate is calibrated by using the consumption characteristic parameters, so that the consumption speed is obtained. A service duration for which the service node can continue to provide service at the current amount of available resources is calculated based on the consumption rate. The specific calculation mode is shown in a formula (2) and a formula (3).

Where W represents the consumption rate, and T represents the service duration during which the service node can continue to provide the service while maintaining the consumption rate W at the current available resource amount A3. If W is less than or equal to zero, the current resource consumption is indicated to be in a negative increasing trend, and the service duration is theoretically approaching infinity. However, during actual use, this often means that there is redundancy in resource allocation or a low traffic load, which may lead to resource under-utilization.

According to the embodiment of the invention, the sustainable service duration of the service node is predicted based on the consumption change rule of the service node, and the resource is allocated by taking the sustainable service duration as an allocation basis, so that service interruption caused by space exhaustion is effectively reduced.

According to the embodiment of the invention, the resource management function is utilized to allocate resources to the first target node determined from the plurality of service nodes according to the service duration of each of the plurality of service nodes, wherein the first target node is determined from the plurality of service nodes based on the service duration of each of the plurality of service nodes, and the service duration of the first target node is the shortest; and allocating resources for the first target node by utilizing a resource management function based on the idle data blocks of the reserved space in the server cluster and the idle data blocks of other service nodes except the first target node in the server cluster.

According to the embodiment of the invention, as each sampling period detects the condition of the service node on the resource, if the service duration of a certain service node is shorter, the condition that the service node has a larger requirement on the resource is indicated, and the resource allocation is needed. In the process of selecting the service node, the service node also can carry out resource allocation in the service node in the process of running the service. Therefore, in the process of utilizing the resource management function to allocate resources, the resource allocation is not required to be performed for a plurality of service nodes at a time, and only the first target node with the shortest service duration is determined from the plurality of service nodes to perform the resource allocation.

According to the embodiment of the invention, in the process of resource allocation, the allocation can be performed based on the idle data blocks of the reserved space in the service cluster and the idle data blocks of other service nodes except the first target node in the server cluster. In particular, the allocation source of the free data blocks may be selected according to the resource margin of the reserved space in the service cluster. But two sources can be utilized simultaneously in the resource allocation process, for example, resources are preferentially allocated from reserved space in the server cluster, and if the reserved space is insufficient, the allocation is supplemented from other service nodes. By performing resource allocation in stages, the utilization of resources can be made more efficient.

According to the embodiment of the invention, resources are allocated to a first target node by utilizing a resource management function based on idle data blocks of a reserved space in a server cluster and idle data blocks of other service nodes except the first target node in the server cluster, wherein the method comprises the steps of utilizing the resource management function to transfer the idle data blocks of a first preset data quantity in the reserved space to the first target node when the resource allowance of the reserved space in the server cluster is determined to be larger than a preset threshold value, and utilizing the resource management function to allocate resources to the first target node based on the idle data blocks of other service nodes except the first target node in the plurality of service nodes when the resource allowance of the reserved space in the server cluster is determined to be smaller than or equal to the preset threshold value.

According to embodiments of the present invention, as a composite node migrates free data blocks from a headspace in a server cluster to a first target node, the headspace in the server cluster may be gradually consumed. Once the resource margin of the reserved space in the server cluster is below a certain preset threshold (e.g. 10%), it is determined that it is difficult for the reserved space of the current server cluster to continue to provide resource allocation. Therefore, the source of the calling idle data block in the resource allocation is changed, and resources are allocated to the first target node based on the idle data blocks of other service nodes except the first target node in the plurality of service nodes.

According to the embodiment of the invention, when the idle data block is migrated to the first target node by utilizing the resource management function, the idle data block is provided for the service node from the internal space of the service node according to the consumption change rule under the condition that the service node generates the resource demand trend. Therefore, in the process of resource allocation, excessive space is not required to be allocated for the first target node at a time, so that the situation that resources cannot be allocated to other service nodes in time later is reduced. Specifically, the first preset data amount involved in the resource allocation procedure may be set according to the service processing capability of the service node, for example, to 5 data blocks or more. By selecting different allocation strategies at different stages, the demand fluctuation of the resources can be effectively treated, and service interruption or performance degradation caused by insufficient resources can be reduced.

According to the embodiment of the invention, resources are allocated to a first target node by utilizing a resource management function based on idle data blocks of other service nodes except the first target node in a plurality of service nodes, the resource management function comprises the steps of calculating the resource release rate of each service node based on historical resource consumption data of the plurality of service nodes, determining a second target node from the other service nodes except the first target node in the plurality of service nodes, and calling the idle data blocks with second preset data quantity in the second target node to the first target node by utilizing the resource management function.

According to the embodiment of the invention, the core of the composite node for judging whether the resource allocation is needed is whether the current available resource quantity in each service node can support the service consumption of the service node. If it is determined that a certain service node has an insufficient amount of currently available resources or is at risk of exhaustion, the service node is considered to have insufficient space and needs to be allocated more resources. In contrast, if it is determined that the free space of a certain service node increases, the space of that service node is considered to be abundant, and if there is a risk of insufficient space in other service nodes, a part of the space is appropriately recovered from the service node having a relatively abundant space, and is finally allocated to the service node having an insufficient space.

According to the embodiment of the invention, based on the rule, when analyzing the space free degree of each service node, the resource release rate of each service node is checked first. Generally, the higher the resource release rate, the greater the load pressure on the serving node. The resource release rate of each service node is analyzed, and although the resources of each service node are determined to be in a consumption state, the situation that some service nodes consume faster and other service nodes consume slower may occur, so that the load is unbalanced may occur. Thus, once an individual service node is found to have a higher resource release rate than other service nodes and the number of free data blocks in that service node is significantly less than in the case of other service nodes, free data blocks can be transferred from that service node to the other service nodes.

According to the embodiment of the invention, if the resource allowance of the reserved space is determined to be lower than the preset threshold value, it can be known that enough resources are not available for allocation in the current reserved space. And determining a second target node with lower resource release rate from other service nodes except the first target node in the plurality of service nodes so as to transfer the idle data block of the second target node to the first target node. And calling the idle data block with the second preset data quantity in the second target node to the first target node by utilizing a resource management function. As above, the second preset data amount involved in the resource allocation process may be set according to the service processing capability of the service node. And selecting the second target node based on the resource release rate, so that the selection result meets the service operation requirement better.

According to the embodiment of the invention, the second target node is determined from the other service nodes except the first target node in the plurality of service nodes, and comprises the steps of matching the resource release rate of each service node with a preset division range respectively, so as to determine the resource allowance level of each service node according to a preset mapping relation between the preset division range and the resource allowance level, extracting a plurality of target service nodes with the resource allowance level of the preset level from the plurality of service nodes, and determining the second target node from the plurality of target service nodes according to the service duration of each target service node, wherein the second target node is the node with the longest service duration in the plurality of target service nodes, and the resource allowance level of the second target node is lower than that of the first target node.

According to the embodiment of the invention, when the resource release rate is analyzed, the range to which the current resource release rate belongs is generally determined according to the threshold value in the preset dividing range. And determining the resource allowance level of each service node according to a preset mapping relation between a preset dividing range and the resource allowance level. The resource allowance level comprises three levels, namely a first level, a second level and a third level. The first level characterizes space shortage, the second level characterizes space moderation, and the third level characterizes space abundance.

According to the embodiment of the invention, aiming at the target service node with the third grade of the resource allowance grade, a second target node with the longest service duration is determined from a plurality of target service nodes according to the service duration of each target service node. In addition, the resource margin level of the second target node is lower than that of the first target node, which is typically the first level. The resource allowance grade of the service node is determined according to the resource release rate, so that the second target node is obtained through screening according to the service duration, the screening result is more accurate, and the node with the space allowance can be preferentially selected for resource allocation.

The resource management method further comprises the steps of monitoring the increase rate of available resource allowance in each service node to determine a third target node with the highest increase rate from the plurality of service nodes, releasing a preset number of occupied data blocks from the third target node into a reserved space by utilizing a resource management function, and updating the resource allowance in the reserved space, wherein the occupied data blocks comprise invalid data with preset proportion.

According to the embodiment of the invention, if the reserved space of the server cluster is lower than the preset threshold, the composite node tries to recover part of the resources from a certain service node and redos the reserved space as the reserved space of the server cluster. In the resource recycling mode, the resource allocation process is opposite, the composite node detects the increase rate of the available resource allowance in each service node, and for the service node with higher increase rate (if the service node with increased available resource allowance exists), the space scheduling unit of the composite node is informed to return the occupied data blocks with preset number in the service node to the reserved space.

According to the embodiment of the invention, the occupied data block comprises invalid data with preset proportion, and the resource utilization rate can be effectively improved by recycling the resources of the occupied data block. After releasing the resources, the resource allowance in the reserved space is updated, so that the subsequent continuous allocation of the resources is facilitated.

According to the embodiment of the invention, in the actual system operation process, each service node is likely to be in a consumed state, and at this time, no service node with increased available resource allowance exists. In this case, no returnable resources are considered, and no forced release of resources is performed, so that the situation that the composite node and the service node repeatedly release and allocate resources is reduced.

According to the embodiment of the invention, the resource management method further comprises the step of releasing the occupied data blocks except the occupied data blocks in the third target node under the condition that the occupied data blocks in the preset number are determined to comprise the occupied data blocks, wherein the occupied data blocks are the forced occupied and unreleasable data blocks in the third target node.

According to the embodiment of the invention, the compound node also ensures that the minimum space is reserved in each service node according to the total capacity information of each service node provided by the capacity monitoring unit. These spaces will be forced by each service node and cannot be transferred to other service nodes, thus ensuring that each service node will pre-allocate a minimum database to meet the data flushing requirements.

According to the embodiment of the invention, if the occupied data blocks of the preset number which need to be released include the occupied data blocks in the process of releasing the resources, the data blocks except the occupied data blocks are released. On the premise of releasing resources, a strong data block is reserved for each service node, and the normal operation of the service node is ensured to a certain extent.

According to the embodiment of the invention, the resource management method further comprises the step of responding to the received system operation instruction, evenly distributing the storage space except for the reserved space in the server cluster in the occupied space of the system to a plurality of service nodes in the server cluster, wherein the storage space is used for storing data generated by operation on the service nodes.

According to the embodiment of the invention, since the written data is less in the initial stage of the system operation, the space of the system is more abundant, and the service balance of each service node in the subsequent system operation cannot be judged, so that each service node is defaulted to be in a load balance state. At this time, the composite node may divide 20% -30% of the space as a reserved space of the server cluster, and the remaining storage space may be pre-allocated to all the service nodes in the server cluster in an equal division manner.

According to the embodiment of the invention, the storage space allocated to the service nodes is managed by each service node, and tasks such as resource calling and migration can be performed only when the risk of insufficient space exists in some service nodes later occurs. By pre-allocating the storage space for the service node, the need for dynamic allocation of storage resources by the service node during operation is reduced, thereby reducing delay caused by allocation and recovery of storage resources and improving the overall performance of the system.

According to an embodiment of the invention, the resource management method further comprises determining the capacity of the predominance data blocks allocated for each service node from the storage space based on the number of the plurality of service nodes in the server cluster and the capacity of the resources in the occupied space of the system.

According to the embodiment of the invention, the capacity of the strong occupying data blocks in the service nodes is required to be determined according to the specific design of the system, and the general principle is that the capacity corresponding to the strong occupying data blocks should not exceed 1/N of the capacity of the resources of the occupied space of the system (i.e. the space occupied inside the system and the space not shown outside), wherein N is the number of the service nodes in the server cluster.

According to the embodiment of the invention, the capacity of the to-be-allocated strong data block in the storage space is calculated based on the number of a plurality of service nodes in the server cluster and the resource capacity in the occupied space of the system. The predominance data blocks in the storage space are equally distributed to the respective service nodes based on the capacity of the predominance data blocks. The normal operation of the service node is ensured to a certain extent by calculating and distributing the capacity of the occupied data block.

According to the embodiment of the invention, the resource management method further comprises the steps of sending allocation information corresponding to the idle data blocks to the first target node to inform the first target node of receiving the resources under the condition that the resources are allocated to the first target node, and sending release information corresponding to the occupied data blocks to the third target node to inform the third target node of releasing the resources under the condition that the resources are recovered from the third target node.

According to the embodiment of the invention, when the resource needs to be allocated to the first target node, the corresponding capacity is selected from the reserved space of the server cluster or the second target node according to the capacity of the resource needing to be allocated once. And sending allocation information to the first target node based on the capacity to inform the first target node of resource reception and simultaneously inform a space management unit in the composite node of finishing information updating.

According to an embodiment of the present invention, when resources need to be reclaimed from the third target node, the space scheduling unit in the composite node notifies the third target node of the number of returned databases. And sending release information to the third target node based on the quantity to inform the third target node to release resources, and then waiting for a space recovery unit in the third target node to finish space preparation with corresponding capacity. And returning the resources released by the third target node to the reserved space of the server cluster, and updating the resource allowance in the reserved space. The resource allocation and recovery are carried out in an information interaction mode, so that the service node can timely carry out resource management.

According to the embodiment of the invention, the resource management method further comprises the steps of acquiring the resource distribution data in each service node under the condition that the completion of resource distribution is determined, and synchronizing the resource distribution data into each service node.

According to the embodiment of the invention, the resource distribution data is recorded and updated under the condition that the completion of the resource allocation is determined. Wherein the recording of the resource distribution data can be generally accomplished in the form of an array or a table. As shown in fig. 6, in the case where the resource distribution data of the composite node 610 is changed, the space management units 611 of the composite node 610 need to synchronize the resource distribution data to the respective space management units of the other service nodes 620, respectively.

According to the embodiment of the invention, since the compound node only selects one service node in the server cluster to act, other service nodes only play a role in backup, and the update is only completed after the synchronization of all information is completed. By synchronizing the resource distribution data to each service node, other service nodes are facilitated to take over the resource management work of the composite node.

According to the embodiment of the invention, the resource management method further comprises the step of determining a new composite node from other service nodes except the composite node according to preset rules associated with node identifiers of the service nodes in the server cluster under the condition that the composite node is detected to be faulty, wherein the new composite node can execute a resource management function based on synchronous resource distribution data.

According to the embodiment of the invention, if the composite node is detected to be faulty in the system operation, a new composite node is selected from the rest of service nodes, and the new composite node continues to execute the resource management function according to the self-backed up resource distribution data. Specifically, the new composite node is selected based on preset rules associated with the respective node identities of the serving nodes. The node identifier may be an ID of each server, and the preset rule may elect a service node with the largest or smallest ID as a new composite node.

According to the embodiment of the invention, if the failed composite node is recovered, the current new composite node also needs to synchronize the resource distribution data to the new composite node, and the service node recovered after the failure can join the system and provide service to the outside only after the complete synchronization of the resource distribution data is completed. When the composite node fails, the failure condition can be timely dealt with through the switching of the nodes.

According to the embodiment of the invention, the resource management method further comprises the steps of determining a fourth target node from the plurality of service nodes according to the consumption change rule of the service nodes, wherein the consumption change rule of the fourth target node accords with the growth rule, carrying out resource allocation for the fourth target node to update the current available resource quantity of the fourth target node, and determining the service duration of each service node capable of continuously providing service based on the current available resource quantity of each service node comprising the fourth target node.

According to the embodiment of the invention, before the service duration of each service node is calculated, a fourth target node conforming to the growth rule can be determined from a plurality of service nodes. Wherein the growing trend of the fourth target node growing rule is most remarkable among a plurality of service nodes in the service cluster. And in the resource allocation process, a certain number of idle data blocks are allocated to the fourth target node in advance. After the allocation, the current available resource amount of the fourth target node is updated, and then service duration of a plurality of service nodes including the fourth target node is calculated.

According to the embodiment of the invention, the allocation of the resources is split into two times in each monitoring period, so that the amount of the resources allocated for a single time can be effectively reduced on the premise of controlling the access times, and the allocation of the idle data blocks is more reasonable. In the same monitoring period, resource allocation can be realized for two different service nodes, and normal operation of the service is effectively maintained.

According to the embodiment of the invention, a fourth target node is determined from a plurality of service nodes according to the consumption change rule of the service nodes, and the method comprises the steps of calculating the growth rate of a plurality of monitoring indexes of the service nodes in historical resource consumption data for each service node, carrying out weighted summation on the respective growth rates of the plurality of monitoring indexes based on preset weights corresponding to each monitoring index to obtain the comprehensive growth rate representing the consumption change rule of the service node, and sequencing the comprehensive growth rates of the plurality of service nodes to determine the fourth target node with the highest comprehensive growth rate from the plurality of service nodes.

According to the embodiment of the invention, in the process of determining the fourth target node, the growth rate of a plurality of monitoring indexes of the service node in the historical resource consumption data can be calculated, so that the consumption change rule is determined according to the plurality of growth rates. Specifically, the plurality of monitoring index items respectively include a total capacity of the service node, a current available resource amount, a resource release rate, and the like. And carrying out weighted summation on the plurality of growth rates according to preset weights corresponding to each monitoring index to obtain the comprehensive growth rate representing the consumption change rule. And the fourth target node is determined according to each monitoring index, so that the determination result is more comprehensive and accurate.

According to the embodiment of the invention, the consumption change rule can be determined according to the current available resource quantity at each sampling point. Specifically, the sampling time of a plurality of sampling points and the corresponding available resource amount are marked on a rectangular coordinate system, and the consumption change rule is determined by using a curve fitting mode. When the fourth target node is selected, the fourth target node may be selected based on the change rate of the curve at different moments, and specifically, a plurality of selection conditions may be determined to be set, for example, the change rate at the last moment reaches a first threshold, and the average change rate of a plurality of sampling points reaches a second threshold, etc. The determination result is more real-time and dynamic by determining the fourth target node according to the current available resource amounts of the plurality of sampling points.

Based on the resource management method, the invention also provides a resource management device. The device will be described in detail below in connection with fig. 7.

Fig. 7 shows a block diagram of a resource management device according to an embodiment of the present invention.

As shown in fig. 7, the resource management device 700 of this embodiment includes a data acquisition module 710, a duration determination module 720, and a resource allocation module 730.

The data obtaining module 710 is configured to obtain historical resource consumption data of each of a plurality of service nodes including a composite node in the server cluster, where the composite node is a service node integrated with a resource management function. In an embodiment, the data acquisition module 710 may be configured to perform the operation S210 described above, which is not described herein.

The duration determining module 720 is configured to determine, for each service node, a service duration of the service that the service node can continuously provide the service when the service node maintains a consumption rate matching the consumption rate with the current available resource amount based on the consumption rate obtained by analyzing the historical resource consumption data of the service node. In an embodiment, the duration determining module 720 may be configured to perform the operation S220 described above, which is not described herein.

The resource allocation module 730 is configured to allocate resources to a first target node determined from the plurality of service nodes by using a resource management function according to service durations of the plurality of service nodes. In an embodiment, the resource allocation module 730 may be configured to perform the operation S230 described above, which is not described herein.

According to an embodiment of the present invention, the duration determination module 720 includes a rule quantization sub-module, a difference analysis sub-module, and a duration determination sub-module.

And the law quantization sub-module is used for quantizing the consumption change law by using a discrete difference method based on the acquisition period of the historical resource consumption data to obtain the consumption characteristic parameters.

And the difference analysis sub-module is used for carrying out difference analysis on the current available resource quantity and the historical resource remaining quantity in the historical resource consumption data, introducing consumption characteristic parameters and calibrating analysis results to obtain the consumption speed of the service node on the resources.

And the duration determination submodule is used for determining the service duration of continuously providing the service under the condition that the consumption speed is maintained by the service node under the current available resource quantity.

According to an embodiment of the invention, the difference analysis submodule comprises a change calculation unit and a change calibration unit.

And a change calculation unit for calculating a change rate of the amount of resources in the acquisition period based on a difference between the current amount of available resources and the historical amount of resources remaining.

And the change calibration unit is used for adding the consumption characteristic parameter and the change rate to calibrate the change rate so as to obtain the consumption speed.

According to an embodiment of the present invention, the resource allocation module 730 includes a first target determination sub-module and a resource allocation sub-module.

And the first target determining submodule is used for determining the first target node from the plurality of service nodes based on the service duration of each of the plurality of service nodes, wherein the service duration of the first target node is shortest.

The resource allocation sub-module is used for allocating resources for the first target node by utilizing a resource management function based on idle data blocks of reserved space in the server cluster and idle data blocks of other service nodes except the first target node in the server cluster.

According to an embodiment of the invention, the resource allocation submodule comprises a resource migration unit and a resource allocation unit.

And the resource migration unit is used for migrating the idle data blocks with the first preset data quantity in the reserved space to the first target node by utilizing the resource management function under the condition that the resource allowance of the reserved space in the server cluster is determined to be larger than the preset threshold value.

And the resource allocation unit is used for allocating resources for the first target node by utilizing a resource management function based on idle data blocks of other service nodes except the first target node in the plurality of service nodes under the condition that the resource allowance of the reserved space in the server cluster is smaller than or equal to a preset threshold value.

According to an embodiment of the invention, the resource allocation unit comprises a release calculation subunit, a second target determination subunit and a resource calling subunit.

And the release calculation subunit is used for calculating the resource release rate of each service node based on the historical resource consumption data of the plurality of service nodes.

And a second target determination subunit configured to determine a second target node from the service nodes other than the first target node among the plurality of service nodes.

And the resource calling subunit is used for calling the idle data block with the second preset data quantity in the second target node to the first target node by utilizing the resource management function.

According to an embodiment of the present invention, the release calculation subunit includes a range matching component, a node extraction component, and a second target determination component.

The range matching component is used for matching the resource release rate of each service node with a preset division range respectively so as to determine the resource allowance level of each service node according to a preset mapping relation between the preset division range and the resource allowance level.

And the node extraction component is used for extracting a plurality of target service nodes with the resource allowance level of a preset level from the plurality of service nodes.

And the second target determining component is used for determining a second target node from the plurality of target service nodes according to the service duration of each target service node, wherein the second target node is the node with the longest service duration in the plurality of target service nodes, and the resource allowance level of the second target node is lower than that of the first target node.

According to an embodiment of the present invention, the resource management device 700 further includes a third targeting module, a resource release module, and a margin update module.

And the third target determining module is used for monitoring the increase rate of the available resource allowance in each service node so as to determine a third target node with the highest increase rate from the plurality of service nodes.

And the resource release module is used for releasing the occupied data blocks with preset quantity from the third target node to the reserved space by utilizing the resource management function.

And the surplus updating module is used for updating the resource surplus in the reserved space, wherein the occupied data block comprises invalid data with preset proportion.

According to an embodiment of the invention, the resource management device 700 further comprises a preemption release module.

And the preemption releasing module is used for releasing the occupied data blocks except the preempted data blocks in the third target node under the condition that the preempted data blocks in the preset number are determined to be included in the preempted data blocks, wherein the preempted data blocks are forcedly occupied and unreleasable data blocks in the third target node.

According to an embodiment of the present invention, the resource management device 700 further comprises a storage allocation module.

And the storage allocation module is used for responding to the received system operation instruction, averagely allocating the storage space except the reserved space in the server cluster in the occupied space of the system to a plurality of service nodes in the server cluster, wherein the storage space is used for storing data generated by operation business on the service nodes.

According to an embodiment of the invention, the resource management device 700 further comprises a preemption determination module.

And the preemption determination module is used for determining the capacity of the preemption data block allocated for each service node in the storage space based on the number of the plurality of service nodes in the server cluster and the resource capacity in the occupied space of the system.

According to an embodiment of the present invention, the resource management device 700 further includes an allocation notification module and a release notification module.

And the allocation notification module is used for sending allocation information corresponding to the idle data block to the first target node under the condition of allocating the resource to the first target node so as to notify the first target node to receive the resource.

And the release notification module is used for sending release information corresponding to the occupied data blocks to the third target node under the condition of recovering the resources from the third target node so as to notify the third target node to release the resources.

According to an embodiment of the present invention, the resource management device 700 further includes a distribution acquisition module and a data synchronization module.

And the distribution acquisition module is used for acquiring the resource distribution data in each service node under the condition of determining that the resource distribution is completed.

And the data synchronization module is used for synchronizing the resource distribution data to each service node.

According to an embodiment of the invention, the resource management device 700 further comprises a composite determination module.

And the compound determining module is used for determining a new compound node from other service nodes except the compound node according to a preset rule associated with the node identification of each of the plurality of service nodes in the server cluster under the condition that the compound node is detected to be faulty, and the new compound node can execute a resource management function based on the synchronous resource distribution data.

According to an embodiment of the present invention, the resource management device 700 further includes a fourth targeting module, a resource update module, and a duration update module.

And the fourth target determining module is used for determining a fourth target node from the plurality of service nodes according to the consumption change rule of the service nodes, wherein the consumption change rule of the fourth target node accords with the growth rule.

And the resource updating module is used for carrying out resource allocation for the fourth target node so as to update the current available resource quantity of the fourth target node.

And the duration updating module is used for determining the service duration of which each service node can continuously provide the service based on the current available resource quantity of each service node comprising the fourth target node.

According to an embodiment of the invention, the fourth object determination module comprises an growth calculation sub-module, an integrated calculation sub-module and a fourth object determination sub-module.

And the growth calculation sub-module is used for calculating the growth rate of a plurality of monitoring indexes of the service node in the historical resource consumption data aiming at each service node.

And the comprehensive summation operator module is used for carrying out weighted summation on the respective growth rates of the plurality of monitoring indexes based on preset weights corresponding to each monitoring index, so as to obtain the comprehensive growth rate representing the consumption change rule of the service node.

And the fourth target determining submodule is used for sequencing the comprehensive growth rates of the plurality of service nodes so as to determine a fourth target node with the highest comprehensive growth rate from the plurality of service nodes.

Any of the data acquisition module 710, the duration determination module 720, and the resource allocation module 730 may be combined in one module to be implemented, or any of the modules may be split into a plurality of modules, according to an embodiment of the present invention. Or at least some of the functionality of one or more of the modules may be combined with, and implemented in, at least some of the functionality of other modules. According to embodiments of the invention, at least one of the data acquisition module 710, the duration determination module 720, and the resource allocation module 730 may be implemented at least in part as hardware circuitry, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system-on-chip, a system-on-substrate, a system-on-package, an Application Specific Integrated Circuit (ASIC), or in hardware or firmware, such as any other reasonable way of integrating or packaging the circuitry, or in any one of or a suitable combination of three of software, hardware, and firmware. Or at least one of the data acquisition module 710, the duration determination module 720 and the resource allocation module 730 may be at least partially implemented as computer program modules which, when executed, perform the corresponding functions.

Fig. 8 shows a block diagram of an electronic device adapted to implement a resource management method according to an embodiment of the invention.

As shown in fig. 8, an electronic device 800 according to an embodiment of the present invention includes a processor 801 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 802 or a program loaded from a storage section 808 into a Random Access Memory (RAM) 803. The processor 801 may include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or an associated chipset and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), or the like. The processor 801 may also include on-board memory for caching purposes. The processor 801 may comprise a single processing unit or multiple processing units for performing the different actions of the method flows according to embodiments of the invention.

In the RAM 803, various programs and data required for the operation of the electronic device 800 are stored. The processor 801, the ROM 802, and the RAM 803 are connected to each other by a bus 804. The processor 801 performs various operations of the method flow according to the embodiment of the present invention by executing programs in the ROM 802 and/or the RAM 803. Note that the program may be stored in one or more memories other than the ROM 802 and the RAM 803. The processor 801 may also perform various operations of the method flow according to embodiments of the present invention by executing programs stored in one or more memories.

According to an embodiment of the invention, the electronic device 800 may further comprise an input/output (I/O) interface 805, the input/output (I/O) interface 805 also being connected to the bus 804. The electronic device 800 may also include one or more of an input portion 806 including a keyboard, a mouse, etc., an output portion 807 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), etc., and a speaker, etc., a storage portion 808 including a hard disk, etc., and a communication portion 809 including a network interface card such as a LAN card, a modem, etc., connected to an input/output (I/O) interface 805. The communication section 809 performs communication processing via a network such as the internet. The drive 810 is also connected to an input/output (I/O) interface 805 as needed. A removable medium 811 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 810 as needed so that a computer program read out therefrom is mounted into the storage section 808 as needed.

The present invention also provides a computer-readable storage medium that may be included in the apparatus/device/system described in the above embodiments, or may exist alone without being assembled into the apparatus/device/system. The computer-readable storage medium carries one or more programs which, when executed, implement methods in accordance with embodiments of the present invention.

According to embodiments of the invention, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example, but is not limited to, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. For example, according to embodiments of the invention, the computer-readable storage medium may include ROM 802 and/or RAM 803 and/or one or more memories other than ROM 802 and RAM 803 described above.

Embodiments of the present invention also include a computer program product comprising a computer program containing program code for performing the method shown in the flowcharts. The program code means for causing a computer system to carry out the resource management method provided by the embodiments of the present invention when the computer program product is run on the computer system.

The above-described functions defined in the system/apparatus of the embodiment of the present invention are performed when the computer program is executed by the processor 801. The systems, apparatus, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the invention.

In one embodiment, the computer program may be based on a tangible storage medium such as an optical storage device, a magnetic storage device, or the like. In another embodiment, the computer program may also be transmitted, distributed, and downloaded and installed in the form of a signal on a network medium, and/or from a removable medium 811 via a communication portion 809. The computer program may comprise program code that is transmitted using any appropriate network medium, including but not limited to wireless, wireline, etc., or any suitable combination of the preceding.

In such an embodiment, the computer program may be downloaded and installed from a network via the communication section 809, and/or installed from the removable media 811. The above-described functions defined in the system of the embodiment of the present invention are performed when the computer program is executed by the processor 801. The systems, devices, apparatus, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the invention.

According to embodiments of the present invention, program code for carrying out computer programs provided by embodiments of the present invention may be written in any combination of one or more programming languages, and in particular, such computer programs may be implemented in high-level procedural and/or object-oriented programming languages, and/or in assembly/machine languages. Programming languages include, but are not limited to, such as Java, c++, python, "C" or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

Those skilled in the art will appreciate that the features recited in the various embodiments of the invention can be combined and/or combined in a variety of ways, even if such combinations or combinations are not explicitly recited in the present invention. In particular, the features recited in the various embodiments of the invention can be combined and/or combined in various ways without departing from the spirit and teachings of the invention. All such combinations and/or combinations fall within the scope of the invention.

The embodiments of the present invention are described above. These examples are for illustrative purposes only and are not intended to limit the scope of the present invention. Although the embodiments are described above separately, this does not mean that the measures in the embodiments cannot be used advantageously in combination. Various alternatives and modifications can be made by those skilled in the art without departing from the scope of the invention, and such alternatives and modifications are intended to fall within the scope of the invention.

Claims (20)

1. A resource management method, characterized in that the method comprises: Acquire historical resource consumption data of each of a plurality of service nodes including a composite node in the server cluster, wherein the composite node is a service node integrated with a resource management function, and the historical resource consumption data of the service node is generated based on actual operations of resource allocation and release within the service node; For each of the service nodes, based on a consumption variation law obtained by analyzing historical resource consumption data of the service node, determine the service duration for which the service node can continuously provide services when the service node maintains a consumption speed matching the consumption variation law with the current available resource amount, wherein the consumption variation law is used to describe the resource consumption characteristics exhibited by the service node in the process of executing resource allocation and release; According to the service durations of the plurality of service nodes, and utilizing the resource management function, resources are allocated to a first target node determined from the plurality of service nodes. 2. The method according to claim 1 is characterized in that the determining, based on the consumption variation law obtained by analyzing the historical resource consumption data of the service node, the service duration for which the service node can continuously provide services when the service node maintains a consumption speed matching the consumption variation law with the current available resource amount comprises: Based on the acquisition cycle of the historical resource consumption data, the consumption change law is quantified using discrete difference method to obtain consumption characteristic parameters; Performing a difference analysis on the current available resource amount and the historical resource remaining amount in the historical resource consumption data, and introducing the consumption characteristic parameter to calibrate the analysis result to obtain the resource consumption speed of the service node; Determine the service time duration for which the service node continues to provide services while maintaining the consumption speed under the current available resource amount. 3. The method according to claim 2, characterized in that the difference analysis is performed on the current available resource amount and the historical resource remaining amount in the historical resource consumption data, and the consumption characteristic parameter is introduced to calibrate the analysis result to obtain the resource consumption speed of the service node, including: Calculating the rate of change of the resource quantity during the acquisition cycle based on the difference between the current available resource quantity and the historical resource remaining quantity; The consumption characteristic parameter is added to the change rate to calibrate the change rate to obtain the consumption speed. 4. The method according to claim 1, characterized in that the resource management function is used to allocate resources to the first target node determined from the plurality of service nodes according to the service durations of the plurality of service nodes, comprising: Determine a first target node from the plurality of service nodes based on respective service durations of the plurality of service nodes, wherein the service duration of the first target node is the shortest; Based on the free data blocks in the reserved space in the server cluster and the free data blocks of other service nodes in the server cluster except the first target node, the resource management function is used to allocate resources to the first target node. 5. The method according to claim 4, characterized in that the allocating resources to the first target node by using the resource management function based on the free data blocks in the reserved space in the server cluster and the free data blocks of other service nodes in the server cluster except the first target node comprises: When it is determined that the resource margin of the reserved space in the server cluster is greater than a preset threshold, using the resource management function to migrate free data blocks of a first preset data volume in the reserved space to the first target node; When it is determined that the resource margin of the reserved space in the server cluster is less than or equal to the preset threshold, the resource management function is used to allocate resources to the first target node based on the free data blocks of other service nodes among the multiple service nodes except the first target node. 6. The method according to claim 5, characterized in that the allocating resources to the first target node by using the resource management function based on the idle data blocks of other service nodes except the first target node among the plurality of service nodes comprises: Calculating the resource release rate of each of the service nodes based on historical resource consumption data of the plurality of service nodes; and determining a second target node from other service nodes among the plurality of service nodes except the first target node; By using the resource management function, the free data blocks of the second preset data volume in the second target node are called to the first target node. 7. The method according to claim 6, wherein determining the second target node from other service nodes in the plurality of service nodes except the first target node comprises: Matching the resource release rate of each of the service nodes with the preset division range respectively, so as to determine the resource margin level of each of the service nodes according to the preset mapping relationship between the preset division range and the resource margin level; Extracting a plurality of target service nodes whose resource margin levels are at a preset level from the plurality of service nodes; According to the service duration of each of the target service nodes, the second target node is determined from the multiple target service nodes, wherein the second target node is the node with the longest service duration among the multiple target service nodes, and the resource margin level of the second target node is lower than that of the first target node. 8. The method according to claim 4, characterized in that the method further comprises: Monitoring the growth rate of the available resource margin in each of the service nodes to determine the third target node with the highest growth rate from the plurality of service nodes; By utilizing the resource management function, a preset number of occupied data blocks are released from the third target node to the reserved space; and the resource margin in the reserved space is updated, wherein the occupied data blocks include a preset proportion of invalid data. 9. The method according to claim 8, characterized in that the method further comprises: When it is determined that the preset number of occupied data blocks includes a forced data block, other occupied data blocks in the third target node except the forced data block are released, wherein the forced data block is a data block in the third target node that is forcibly occupied and cannot be released. 10. The method according to claim 9, characterized in that the method further comprises: In response to the received system operation instruction, the storage space in the system occupied space except the reserved space in the server cluster is evenly distributed to multiple service nodes in the server cluster, and the storage space is used to store data generated by running business on the service nodes. 11. The method according to claim 10, characterized in that the method further comprises: Based on the number of the plurality of service nodes in the server cluster and the resource capacity in the occupied space of the system, the capacity of the occupied data block allocated from the storage space to each of the service nodes is determined. 12. The method according to any one of claims 8 to 11, characterized in that the method further comprises: In the case of allocating resources to the first target node, sending allocation information corresponding to the free data block to the first target node to notify the first target node to receive the resources; In the case of reclaiming resources from the third target node, release information corresponding to the occupied data block is sent to the third target node to notify the third target node to release the resources. 13. The method according to claim 1, characterized in that the method further comprises: When it is determined that resource allocation is completed, obtaining resource distribution data in each of the service nodes; The resource distribution data is synchronized to each of the service nodes. 14. The method according to claim 13, characterized in that the method further comprises: When a failure of the composite node is detected, a new composite node is determined from other service nodes other than the composite node according to preset rules associated with the node identifiers of each of the multiple service nodes in the server cluster, and the new composite node is capable of performing the resource management function based on the synchronized resource distribution data. 15. The method according to claim 1, further comprising: Determine a fourth target node from the plurality of service nodes according to a consumption variation law of the service node, wherein the consumption variation law of the fourth target node conforms to an increasing law; Allocating resources for the fourth target node to update the current available resource amount of the fourth target node; The service duration for which each of the service nodes can continuously provide services is determined based on currently available resource amounts of each of the service nodes including the fourth target node. 16. The method according to claim 15, characterized in that the determining of the fourth target node from the plurality of service nodes according to the consumption variation rule of the service node comprises: For each of the service nodes, calculating growth rates of multiple monitoring indicators of the service node in historical resource consumption data; Based on the preset weight corresponding to each of the monitoring indicators, weighted sum is performed on the growth rates of the plurality of monitoring indicators to obtain a comprehensive growth rate that characterizes the consumption change rule of the service node; The comprehensive growth rates of the plurality of service nodes are sorted to determine a fourth target node with the highest comprehensive growth rate from the plurality of service nodes. 17. A resource management device, characterized in that the device comprises: A data acquisition module, used to acquire historical resource consumption data of each of a plurality of service nodes including a composite node in a server cluster, wherein the composite node is a service node integrated with a resource management function, and the historical resource consumption data of the service node is generated based on actual operations of resource allocation and release within the service node; a duration determination module, configured to determine, for each of the service nodes, a service duration for which the service node can continuously provide services if the service node maintains a consumption speed matching the consumption variation law with the current available resource amount based on a consumption variation law obtained by analyzing the historical resource consumption data of the service node, wherein the consumption variation law is used to describe the resource consumption characteristics exhibited by the service node in the process of executing resource allocation and release; The resource allocation module is used to allocate resources to a first target node determined from the plurality of service nodes by using the resource management function according to the service durations of the plurality of service nodes. 18. An electronic device comprising: one or more processors; a memory for storing one or more computer programs, It is characterized in that the one or more processors execute the one or more computer programs to implement the steps of the method according to any one of claims 1 to 16. 19. A computer-readable storage medium having a computer program or instruction stored thereon, wherein the computer program or instruction, when executed by a processor, implements the steps of the method according to any one of claims 1 to 16. 20. A computer program product, comprising a computer program, characterized in that when the computer program is executed by a processor, the computer program implements the method according to any one of claims 1 to 16.