CN118733252A - Cluster resource scheduling method and device, storage medium and electronic device - Google Patents
Cluster resource scheduling method and device, storage medium and electronic device Download PDFInfo
- Publication number
- CN118733252A CN118733252A CN202410706194.0A CN202410706194A CN118733252A CN 118733252 A CN118733252 A CN 118733252A CN 202410706194 A CN202410706194 A CN 202410706194A CN 118733252 A CN118733252 A CN 118733252A
- Authority
- CN
- China
- Prior art keywords
- cluster
- resource
- current
- threshold
- resource usage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 75
- 230000000875 corresponding effect Effects 0.000 claims abstract description 55
- 230000002596 correlated effect Effects 0.000 claims abstract description 15
- 230000015654 memory Effects 0.000 claims description 67
- 238000004590 computer program Methods 0.000 claims description 29
- 238000010586 diagram Methods 0.000 description 14
- 238000012545 processing Methods 0.000 description 9
- 238000004891 communication Methods 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 6
- 230000008859 change Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000001960 triggered effect Effects 0.000 description 6
- 238000004422 calculation algorithm Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 238000012544 monitoring process Methods 0.000 description 5
- 230000000007 visual effect Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000004927 fusion Effects 0.000 description 3
- 238000009499 grossing Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 101100233916 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) KAR5 gene Proteins 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000008451 emotion Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 239000000047 product Substances 0.000 description 2
- 101001121408 Homo sapiens L-amino-acid oxidase Proteins 0.000 description 1
- 101000827703 Homo sapiens Polyphosphoinositide phosphatase Proteins 0.000 description 1
- 102100026388 L-amino-acid oxidase Human genes 0.000 description 1
- 102100023591 Polyphosphoinositide phosphatase Human genes 0.000 description 1
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
- G06F9/5072—Grid computing
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Mathematical Physics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
本申请实施例提供了一种集群资源调度方法及装置、存储介质及电子设备,其中,该方法包括:获取当前周期内集群的集群资源使用率,得到当前集群资源使用率;基于当前集群资源使用率和资源调度阈值范围,确定与当前集群资源使用率对应的当前资源调度阈值,其中,集群的集群资源使用率与对集群进行资源调度所使用的资源调度阈值负相关;通过比较一组主机中的主机的资源使用率和当前资源调度阈值,确定一组主机中待调度的目标主机,并对目标主机执行调度操作。通过本申请,解决了相关技术中的集群资源调度方法存在集群资源利用率较低的问题。
The embodiment of the present application provides a cluster resource scheduling method and device, a storage medium and an electronic device, wherein the method includes: obtaining the cluster resource utilization rate of the cluster in the current period to obtain the current cluster resource utilization rate; determining the current resource scheduling threshold value corresponding to the current cluster resource utilization rate based on the current cluster resource utilization rate and the resource scheduling threshold range, wherein the cluster resource utilization rate of the cluster is negatively correlated with the resource scheduling threshold value used for resource scheduling of the cluster; determining the target host to be scheduled in the group of hosts by comparing the resource utilization rate of the host in a group of hosts with the current resource scheduling threshold value, and performing a scheduling operation on the target host. Through the present application, the problem of low cluster resource utilization rate in the cluster resource scheduling method in the related art is solved.
Description
技术领域Technical Field
本申请实施例涉及云计算技术领域,具体而言,涉及一种集群资源调度方法及装置、存储介质及电子设备。The embodiments of the present application relate to the field of cloud computing technology, and in particular to a cluster resource scheduling method and device, a storage medium, and an electronic device.
背景技术Background Art
为提升集群资源利用率,虚拟化集群会在集群资源利用率较低时将部分主机上的虚拟机迁出并关闭主机,在集群资源利用率较高时打开关闭的主机的电源并合理分配虚拟机。To improve cluster resource utilization, the virtualization cluster will migrate virtual machines from some hosts and shut down the hosts when cluster resource utilization is low. When cluster resource utilization is high, it will power on the shut down hosts and allocate virtual machines appropriately.
相关技术中的集群资源调度方法通常通过设定集群资源阈值,将集群资源使用率与集群资源阈值进行比较来判断集群资源的使用情况,并适应性地调度集群资源,以达到提升集群资源利用率的效果。The cluster resource scheduling method in the related art usually sets a cluster resource threshold, compares the cluster resource usage rate with the cluster resource threshold to determine the cluster resource usage, and adaptively schedules the cluster resources to achieve the effect of improving the cluster resource utilization rate.
上述集群资源阈值在设定后无法根据集群资源的实际使用情况实时变化,集群资源阈值设定的过高会导致频繁触发集群资源调度,集群资源阈值设定的过低会导致长时间无法触发集群资源调度。因此,相关技术中的集群资源调度方法,存在集群资源利用率较低的问题。After being set, the above cluster resource threshold cannot change in real time according to the actual usage of cluster resources. If the cluster resource threshold is set too high, cluster resource scheduling will be triggered frequently. If the cluster resource threshold is set too low, cluster resource scheduling will not be triggered for a long time. Therefore, the cluster resource scheduling method in the related art has the problem of low cluster resource utilization.
发明内容Summary of the invention
本申请实施例提供了一种集群资源调度方法及装置、存储介质及电子设备,以至少解决相关技术中的集群资源调度方法存在集群资源利用率较低的问题。The embodiments of the present application provide a cluster resource scheduling method and device, a storage medium, and an electronic device to at least solve the problem of low cluster resource utilization in the cluster resource scheduling method in the related art.
根据本申请实施例的一个方面,提供了一种集群资源调度方法,包括:获取当前周期内集群的集群资源使用率,得到当前集群资源使用率,其中,所述集群包括一组主机,所述集群的集群资源使用率是根据所述当前周期内所述一组主机中的主机的资源使用率确定的,所述一组主机中的主机的资源使用率用于表征所述一组主机中的主机的工作负载情况;基于所述当前集群资源使用率和资源调度阈值范围,确定与所述当前集群资源使用率对应的当前资源调度阈值,其中,所述资源调度阈值范围是对所述集群进行资源调度所使用的资源调度阈值的范围,对所述集群进行资源调度所使用的资源调度阈值是所述一组主机中的主机的资源使用率的阈值,对所述集群进行资源调度所使用的资源调度阈值用于确定所述一组主机中待调度主机,所述集群的集群资源使用率与对所述集群进行资源调度所使用的资源调度阈值负相关;通过比较所述一组主机中的主机的资源使用率和所述当前资源调度阈值,确定所述一组主机中待调度的目标主机,并对所述目标主机执行调度操作。According to one aspect of an embodiment of the present application, a cluster resource scheduling method is provided, comprising: obtaining a cluster resource usage rate of a cluster in a current period to obtain a current cluster resource usage rate, wherein the cluster includes a group of hosts, and the cluster resource usage rate of the cluster is determined according to the resource usage rate of the hosts in the group of hosts in the current period, and the resource usage rate of the hosts in the group of hosts is used to characterize the workload of the hosts in the group of hosts; based on the current cluster resource usage rate and a resource scheduling threshold range, determining a current resource scheduling threshold corresponding to the current cluster resource usage rate, wherein the resource scheduling threshold range is a range of resource scheduling thresholds used for resource scheduling of the cluster, the resource scheduling threshold used for resource scheduling of the cluster is a threshold of the resource usage rate of the hosts in the group of hosts, the resource scheduling threshold used for resource scheduling of the cluster is used to determine a host to be scheduled in the group of hosts, and the cluster resource usage rate of the cluster is negatively correlated with the resource scheduling threshold used for resource scheduling of the cluster; by comparing the resource usage rate of the hosts in the group of hosts with the current resource scheduling threshold, determining a target host to be scheduled in the group of hosts, and performing a scheduling operation on the target host.
根据本申请实施例的另一个方面,提供了一种集群资源调度装置,包括:获取单元,用于获取当前周期内集群的集群资源使用率,得到当前集群资源使用率,其中,所述集群包括一组主机,所述集群的集群资源使用率是根据所述当前周期内所述一组主机中的主机的资源使用率确定的,所述一组主机中的主机的资源使用率用于表征所述一组主机中的主机的工作负载情况;确定单元,用于基于所述当前集群资源使用率和资源调度阈值范围,确定与所述当前集群资源使用率对应的当前资源调度阈值,其中,所述资源调度阈值范围是对所述集群进行资源调度所使用的资源调度阈值的范围,对所述集群进行资源调度所使用的资源调度阈值是所述一组主机中的主机的资源使用率的阈值,对所述集群进行资源调度所使用的资源调度阈值用于确定所述一组主机中待调度主机,所述集群的集群资源使用率与对所述集群进行资源调度所使用的资源调度阈值负相关;第一执行单元,用于通过比较所述一组主机中的主机的资源使用率和所述当前资源调度阈值,确定所述一组主机中待调度的目标主机,并对所述目标主机执行调度操作。According to another aspect of an embodiment of the present application, a cluster resource scheduling device is provided, comprising: an acquisition unit, configured to acquire a cluster resource usage rate of a cluster in a current period to obtain a current cluster resource usage rate, wherein the cluster includes a group of hosts, and the cluster resource usage rate of the cluster is determined according to the resource usage rates of the hosts in the group of hosts in the current period, and the resource usage rates of the hosts in the group of hosts are used to characterize the workload of the hosts in the group of hosts; a determination unit, configured to determine a current resource scheduling threshold corresponding to the current cluster resource usage rate based on the current cluster resource usage rate and a resource scheduling threshold range, wherein the resource scheduling threshold range is a range of resource scheduling thresholds used for resource scheduling of the cluster, the resource scheduling threshold used for resource scheduling of the cluster is a threshold of the resource usage rate of the hosts in the group of hosts, the resource scheduling threshold used for resource scheduling of the cluster is used to determine a host to be scheduled in the group of hosts, and the cluster resource usage rate of the cluster is negatively correlated with the resource scheduling threshold used for resource scheduling of the cluster; a first execution unit, configured to determine a target host to be scheduled in the group of hosts by comparing the resource usage rates of the hosts in the group of hosts with the current resource scheduling threshold, and perform a scheduling operation on the target host.
根据本申请的又一个实施例,还提供了一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机程序,其中,所述计算机程序被设置为运行时执行上述任一项方法实施例中的步骤。According to another embodiment of the present application, a computer-readable storage medium is provided, in which a computer program is stored, wherein the computer program is configured to execute the steps of any of the above method embodiments when running.
根据本申请的又一个实施例,还提供了一种电子设备,包括存储器和处理器,所述存储器中存储有计算机程序,所述处理器被设置为运行所述计算机程序以执行上述任一项方法实施例中的步骤。According to another embodiment of the present application, an electronic device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.
根据本申请的又一个实施例,还提供了一种计算机程序产品,包括计算机程序,所述计算机程序被处理器执行时实现上述任一项方法实施例中的步骤。According to another embodiment of the present application, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the steps in any of the above method embodiments are implemented.
通过本申请,获取当前周期内集群的集群资源使用率,得到当前集群资源使用率,其中,集群包括一组主机,集群的集群资源使用率是根据当前周期内一组主机中的主机的资源使用率确定的,一组主机中的主机的资源使用率用于表征一组主机中的主机的工作负载情况;基于当前集群资源使用率和资源调度阈值范围,确定与当前集群资源使用率对应的当前资源调度阈值,其中,资源调度阈值范围是对集群进行资源调度所使用的资源调度阈值的范围,对集群进行资源调度所使用的资源调度阈值是一组主机中的主机的资源使用率的阈值,对集群进行资源调度所使用的资源调度阈值用于确定一组主机中待调度主机,集群的集群资源使用率与对集群进行资源调度所使用的资源调度阈值负相关;通过比较一组主机中的主机的资源使用率和当前资源调度阈值,确定一组主机中待调度的目标主机,并对目标主机执行调度操作,集群资源使用率与资源调度阈值负相关,在集群资源使用率较高时,资源调度阈值相对较低,可以减少待调度的目标主机的数量,提供了充足的主机资源,在集群资源使用率较低时,资源调度阈值相对较高,可以增加待调度的目标主机的数量,提高了剩余工作主机的资源利用率,降低了集群资源的损耗,进而解决了相关技术中的集群资源调度方法存在集群资源利用率较低的问题。Through the present application, the cluster resource utilization rate of the cluster in the current cycle is obtained to obtain the current cluster resource utilization rate, wherein the cluster includes a group of hosts, and the cluster resource utilization rate of the cluster is determined according to the resource utilization rate of the hosts in the group of hosts in the current cycle, and the resource utilization rate of the hosts in a group of hosts is used to characterize the workload of the hosts in a group of hosts; based on the current cluster resource utilization rate and the resource scheduling threshold range, the current resource scheduling threshold corresponding to the current cluster resource utilization rate is determined, wherein the resource scheduling threshold range is the range of the resource scheduling threshold used for resource scheduling of the cluster, the resource scheduling threshold used for resource scheduling of the cluster is the threshold of the resource utilization rate of the hosts in a group of hosts, and the resource scheduling threshold used for resource scheduling of the cluster is used to determine the workload of the hosts in a group of hosts For the host to be scheduled, the cluster resource utilization rate of the cluster is negatively correlated with the resource scheduling threshold used for resource scheduling of the cluster; by comparing the resource utilization rate of the host in a group of hosts and the current resource scheduling threshold, the target host to be scheduled in a group of hosts is determined, and the scheduling operation is performed on the target host. The cluster resource utilization rate is negatively correlated with the resource scheduling threshold. When the cluster resource utilization rate is high, the resource scheduling threshold is relatively low, which can reduce the number of target hosts to be scheduled and provide sufficient host resources. When the cluster resource utilization rate is low, the resource scheduling threshold is relatively high, which can increase the number of target hosts to be scheduled, improve the resource utilization rate of the remaining working hosts, and reduce the loss of cluster resources, thereby solving the problem of low cluster resource utilization in the cluster resource scheduling method in the related technology.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1是根据本申请实施例的一种可选的集群资源调度方法的硬件环境示意图;FIG1 is a schematic diagram of a hardware environment of an optional cluster resource scheduling method according to an embodiment of the present application;
图2是根据本申请实施例的一种可选的集群资源调度方法的流程示意图;FIG2 is a schematic diagram of a flow chart of an optional cluster resource scheduling method according to an embodiment of the present application;
图3是根据本申请实施例的一种可选的集群资源调度方法的示意图;FIG3 is a schematic diagram of an optional cluster resource scheduling method according to an embodiment of the present application;
图4是根据本申请实施例的另一种可选的集群资源调度方法的示意图;FIG4 is a schematic diagram of another optional cluster resource scheduling method according to an embodiment of the present application;
图5是根据本申请实施例的又一种可选的集群资源调度方法的示意图;FIG5 is a schematic diagram of another optional cluster resource scheduling method according to an embodiment of the present application;
图6是根据本申请实施例的又一种可选的集群资源调度方法的示意图;FIG6 is a schematic diagram of another optional cluster resource scheduling method according to an embodiment of the present application;
图7是根据本申请实施例的一种可选的集群资源调度装置的结构框图;FIG7 is a structural block diagram of an optional cluster resource scheduling device according to an embodiment of the present application;
图8是根据本申请实施例的一种可选的电子设备的计算机系统的结构框图。FIG8 is a structural block diagram of a computer system of an optional electronic device according to an embodiment of the present application.
具体实施方式DETAILED DESCRIPTION
为了使本技术领域的人员更好地理解本申请方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分的实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本申请保护的范围。In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.
需要说明的是,本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
本申请实施例中所提供的方法实施例可以在服务器、移动终端、计算机终端或者类似的运算装置中执行。以运行在服务器上为例,图1是根据本申请实施例的一种集群资源调度方法的硬件环境示意图。如图1所示,服务器可以包括一个或多个(图1中仅示出一个)处理器102(处理器102可以包括但不限于微处理器MCU或可编程逻辑器件FPGA等的处理装置)和用于存储数据的存储器104,其中,上述服务器还可以包括用于通信功能的传输设备106以及输入输出设备108。本领域普通技术人员可以理解,图1所示的结构仅为示意,其并不对上述服务器的结构造成限定。例如,服务器还可包括比图1中所示更多或者更少的组件,或者具有与图1所示不同的配置。The method embodiment provided in the embodiment of the present application can be executed in a server, a mobile terminal, a computer terminal or a similar computing device. Taking running on a server as an example, FIG. 1 is a hardware environment schematic diagram of a cluster resource scheduling method according to an embodiment of the present application. As shown in FIG. 1, the server may include one or more (only one is shown in FIG. 1) processors 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, wherein the above-mentioned server may also include a transmission device 106 and an input and output device 108 for communication functions. It can be understood by those of ordinary skill in the art that the structure shown in FIG. 1 is only for illustration, and it does not limit the structure of the above-mentioned server. For example, the server may also include more or fewer components than those shown in FIG. 1, or have a configuration different from that shown in FIG. 1.
存储器104可用于存储计算机程序,例如,应用软件的软件程序以及模块,如本申请实施例中的集群资源调度方法对应的计算机程序,处理器102通过运行存储在存储器104内的计算机程序,从而执行各种功能应用以及数据处理,即实现上述的方法。存储器104可包括高速随机存储器,还可包括非易失性存储器,如一个或者多个磁性存储装置、闪存、或者其他非易失性固态存储器。在一些实例中,存储器104可进一步包括相对于处理器102远程设置的存储器,这些远程存储器可以通过网络连接至移动终端。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the cluster resource scheduling method in the embodiment of the present application. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, to implement the above method. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories may be connected to the mobile terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
传输设备106用于经由一个网络接收或者发送数据。上述的网络具体实例可包括计算机终端的通信供应商提供的无线网络。在一个实例中,传输设备106包括一个网络适配器(Network Interface Controller,简称为NIC),其可通过基站与其他网络设备相连从而可与互联网进行通讯。在一个实例中,传输设备106可以为射频(Radio Frequency,简称为RF)模块,其用于通过无线方式与互联网进行通讯。The transmission device 106 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of a computer terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.
可选地,本实施例中的集群资源调度方法可以是服务器执行的,这里,服务器指的是服务器整体,包括服务器内需要执行集群资源调度方法的相关部件以及处理器等;本实施例中的集群资源调度方法也可以是由处理器102执行的。在本实施例的部分示例中,集群资源调度方法以由服务器执行为例进行说明。Optionally, the cluster resource scheduling method in this embodiment may be executed by a server, where the server refers to the server as a whole, including relevant components and processors in the server that need to execute the cluster resource scheduling method; the cluster resource scheduling method in this embodiment may also be executed by the processor 102. In some examples of this embodiment, the cluster resource scheduling method is described by taking the execution of the server as an example.
本实施例中的集群资源调度方法可以应用到为集群资源调度提供建议的场景。在云计算或虚拟化平台的使用过程中,为了提升集群资源利用率并优化集群与数据中心的资源消耗,多数虚拟化集群会提供一种DRS(Distributed Resource Scheduler,分布式资源调度策略)策略,此策略可在集群资源利用率较低时,将主机上的虚拟机迁出并关闭主机,在集群资源利用率较高时,打开主机电源并合理分配虚拟机;DPM(Dynamic Power,Management,分布式电源管理)一般配合分布式资源调度策略使用,为资源调度提供调度建议。The cluster resource scheduling method in this embodiment can be applied to the scenario of providing suggestions for cluster resource scheduling. In the process of using cloud computing or virtualization platform, in order to improve cluster resource utilization and optimize cluster and data center resource consumption, most virtualization clusters will provide a DRS (Distributed Resource Scheduler) strategy, which can migrate virtual machines on the host and shut down the host when the cluster resource utilization is low, and turn on the host power and reasonably allocate virtual machines when the cluster resource utilization is high; DPM (Dynamic Power, Management) is generally used in conjunction with the distributed resource scheduling strategy to provide scheduling suggestions for resource scheduling.
相关技术中的DPM策略通常通过设定集群资源阈值,将集群资源使用率与集群资源阈值进行比较来判断集群资源的使用情况,并适应性地调度集群资源,以达到提升集群资源利用率的效果;然而,相关技术中的集群资源阈值在设定后无法根据集群资源的实际使用情况实时变化,集群资源阈值设定的过高会导致频繁触发集群资源调度,集群资源阈值设定的过低会导致长时间无法触发集群资源调度,导致对集群资源产生了浪费,集群资源利用率较低。The DPM strategy in the related technology usually determines the usage of cluster resources by setting a cluster resource threshold, comparing the cluster resource usage rate with the cluster resource threshold, and adaptively scheduling cluster resources to achieve the effect of improving cluster resource utilization; however, the cluster resource threshold in the related technology cannot change in real time according to the actual usage of cluster resources after being set. If the cluster resource threshold is set too high, it will cause cluster resource scheduling to be triggered frequently. If the cluster resource threshold is set too low, it will cause cluster resource scheduling to fail to be triggered for a long time, resulting in a waste of cluster resources and low cluster resource utilization.
在本实施例中,综合考虑上述情况,在集群资源调度过程中集群资源阈值根据集群资源的实际使用情况实时变化,以解决相关技术中的集群资源调度方法存在集群资源利用率较低的问题。参见图2,图2是根据本申请实施例的一种可选的集群资源调度方法的流程示意图,如图2所示,上述方法包括以下步骤:In this embodiment, taking the above situation into consideration, the cluster resource threshold changes in real time according to the actual usage of the cluster resources during the cluster resource scheduling process to solve the problem of low cluster resource utilization in the cluster resource scheduling method in the related art. Referring to FIG. 2 , FIG. 2 is a flow chart of an optional cluster resource scheduling method according to an embodiment of the present application. As shown in FIG. 2 , the method includes the following steps:
步骤S202,获取当前周期内集群的集群资源使用率,得到当前集群资源使用率,其中,集群包括一组主机,集群的集群资源使用率是根据当前周期内一组主机中的主机的资源使用率确定的,一组主机中的主机的资源使用率用于表征一组主机中的主机的工作负载情况。Step S202, obtaining the cluster resource utilization rate of the cluster in the current cycle, and obtaining the current cluster resource utilization rate, wherein the cluster includes a group of hosts, and the cluster resource utilization rate of the cluster is determined based on the resource utilization rate of the hosts in the group of hosts in the current cycle, and the resource utilization rate of the hosts in the group of hosts is used to characterize the workload of the hosts in the group of hosts.
集群是指由多台计算机或服务器组成的一个网络或集合,在本实施例中,集群包括一组主机;集群的集群资源使用率是根据当前周期内一组主机中的主机的资源使用率确定的,这里,集群的集群资源使用率可以是计算当前周期内一组主机中的主机的资源使用率的平均值得到;一组主机中的主机的资源使用率用于表征一组主机中的主机的工作负载情况,主机的资源使用率可以包括但不限于主机的内存使用率、CPU(Central ProcessingUnit、中央处理器)使用率、磁盘使用率、IO(Input,Output,指数据在计算机的存储器或其他设备之间的流动)使用率等。A cluster refers to a network or collection composed of multiple computers or servers. In this embodiment, the cluster includes a group of hosts. The cluster resource utilization rate of the cluster is determined based on the resource utilization rates of the hosts in the group of hosts in the current cycle. Here, the cluster resource utilization rate of the cluster can be obtained by calculating the average resource utilization rate of the hosts in the group of hosts in the current cycle. The resource utilization rate of the hosts in a group of hosts is used to characterize the workload of the hosts in the group of hosts. The resource utilization rate of the host may include but is not limited to the host's memory utilization rate, CPU (Central Processing Unit, central processing unit) utilization rate, disk utilization rate, IO (Input, Output, referring to the flow of data between the computer's memory or other devices) utilization rate, etc.
参见图3,图3是一种可选的集群资源调度方法的示意图,本实施例的集群资源调度方法是在当前时间点执行的,当前时间点是在当前周期之后的时间点,当前周期是距离当前时间点最近的已经历过的完整的时间周期。See Figure 3, which is a schematic diagram of an optional cluster resource scheduling method. The cluster resource scheduling method of this embodiment is executed at the current time point, which is a time point after the current cycle. The current cycle is the complete time cycle that has passed closest to the current time point.
可以理解地,通过获取当前周期内集群的集群资源使用率,得到的当前集群资源使用率,可以确定集群在当前周期内一组主机的资源使用率的实际情况,进而提高了后续的集群资源调度方法的准确性。It can be understood that by obtaining the cluster resource utilization rate of the cluster in the current cycle, the actual resource utilization rate of a group of hosts in the cluster in the current cycle can be determined, thereby improving the accuracy of subsequent cluster resource scheduling methods.
步骤S204,基于当前集群资源使用率和资源调度阈值范围,确定与当前集群资源使用率对应的当前资源调度阈值,其中,资源调度阈值范围是对集群进行资源调度所使用的资源调度阈值的范围,对集群进行资源调度所使用的资源调度阈值是一组主机中的主机的资源使用率的阈值,对集群进行资源调度所使用的资源调度阈值用于确定一组主机中待调度主机,集群的集群资源使用率与对集群进行资源调度所使用的资源调度阈值负相关。Step S204, based on the current cluster resource utilization and the resource scheduling threshold range, determine the current resource scheduling threshold corresponding to the current cluster resource utilization, wherein the resource scheduling threshold range is the range of the resource scheduling threshold used for cluster resource scheduling, the resource scheduling threshold used for cluster resource scheduling is the threshold of the resource utilization of a host in a group of hosts, the resource scheduling threshold used for cluster resource scheduling is used to determine a host to be scheduled in a group of hosts, and the cluster resource utilization of the cluster is negatively correlated with the resource scheduling threshold used for cluster resource scheduling.
资源调度阈值范围是对集群进行资源调度所使用的资源调度阈值的范围,即,基于当前集群资源使用率和资源调度阈值范围,确定的当前资源调度阈值应落入资源调度阈值范围之内;对集群进行资源调度所使用的资源调度阈值是一组主机中的主机的资源使用率的阈值,对集群进行资源调度所使用的资源调度阈值用于确定一组主机中待调度主机,即,在对一组主机中的主机进行资源调度时,基于对集群进行资源调度所使用的资源调度阈值,判断是否需要对一组主机中的主机执行调度操作。The resource scheduling threshold range is the range of the resource scheduling threshold used for cluster resource scheduling, that is, based on the current cluster resource utilization and the resource scheduling threshold range, the current resource scheduling threshold determined should fall within the resource scheduling threshold range; the resource scheduling threshold used for cluster resource scheduling is the threshold of the resource utilization of a host in a group of hosts, and the resource scheduling threshold used for cluster resource scheduling is used to determine a host to be scheduled in a group of hosts, that is, when performing resource scheduling on a host in a group of hosts, it is determined whether a scheduling operation needs to be performed on a host in a group of hosts based on the resource scheduling threshold used for cluster resource scheduling.
基于当前集群资源使用率和资源调度阈值范围,确定与当前集群资源使用率对应的当前资源调度阈值,这里,当前集群资源使用率与当前资源调度阈值之间可以是成线性负相关的,例如,当前资源调度阈值=a-b*当前集群资源使用率,这里,a,b均为常数,且a,b均为正数;当前资源调度阈值的确定方式还可以是判断当前集群资源使用率所在的区间,存在区间x,y,z,区间x的最大值为区间y的最小值,区间y的最大值为区间z的最小值,当前集群资源使用率分别位于区间x、区间y以及区间z时,当前资源调度阈值的取值依次降低。Based on the current cluster resource utilization and the resource scheduling threshold range, determine the current resource scheduling threshold corresponding to the current cluster resource utilization. Here, the current cluster resource utilization and the current resource scheduling threshold may be linearly negatively correlated. For example, the current resource scheduling threshold = a-b*current cluster resource utilization. Here, a and b are both constants, and a and b are both positive numbers. The current resource scheduling threshold may also be determined by judging the interval in which the current cluster resource utilization is located. There are intervals x, y, and z. The maximum value of interval x is the minimum value of interval y, and the maximum value of interval y is the minimum value of interval z. When the current cluster resource utilization is respectively in interval x, interval y, and interval z, the value of the current resource scheduling threshold decreases in sequence.
步骤S206,通过比较一组主机中的主机的资源使用率和当前资源调度阈值,确定一组主机中待调度的目标主机,并对目标主机执行调度操作。Step S206, by comparing the resource usage rates of the hosts in the group of hosts with the current resource scheduling threshold, a target host to be scheduled in the group of hosts is determined, and a scheduling operation is performed on the target host.
目标主机指的是一组主机中的主机的资源使用率小于当前资源调度阈值的主机;调度操作指的是将目标主机调整至待机状态,即,断开目标主机与集群的连接,并将目标主机上运行的虚拟机调度到一组主机中的非目标主机上。The target host refers to a host in a group of hosts whose resource usage is less than the current resource scheduling threshold; the scheduling operation refers to adjusting the target host to the standby state, that is, disconnecting the target host from the cluster and scheduling the virtual machine running on the target host to a non-target host in the group of hosts.
可以理解地,集群资源使用率与资源调度阈值负相关,在集群资源使用率较高时,资源调度阈值相对较低,可以减少待调度的目标主机的数量,保证了集群充足的主机资源,避免因为调度的主机数量过多,导致出现集群的主机数量不够,集群负载超标的情况出现;在集群资源使用率较低时,资源调度阈值相对较高,可以增加待调度的目标主机的数量,提高了剩余的非目标主机的资源使用率,降低了集群资源的损耗。It can be understood that the cluster resource utilization rate is negatively correlated with the resource scheduling threshold. When the cluster resource utilization rate is high, the resource scheduling threshold is relatively low, which can reduce the number of target hosts to be scheduled, ensure sufficient host resources in the cluster, and avoid the situation where the number of cluster hosts is insufficient and the cluster load exceeds the standard due to too many hosts being scheduled. When the cluster resource utilization rate is low, the resource scheduling threshold is relatively high, which can increase the number of target hosts to be scheduled, improve the resource utilization rate of the remaining non-target hosts, and reduce the loss of cluster resources.
通过本申请提供的实施例,获取当前周期内集群的集群资源使用率,得到当前集群资源使用率,其中,集群包括一组主机,集群的集群资源使用率是根据当前周期内一组主机中的主机的资源使用率确定的,一组主机中的主机的资源使用率用于表征一组主机中的主机的工作负载情况;基于当前集群资源使用率和资源调度阈值范围,确定与当前集群资源使用率对应的当前资源调度阈值,其中,资源调度阈值范围是对集群进行资源调度所使用的资源调度阈值的范围,对集群进行资源调度所使用的资源调度阈值是一组主机中的主机的资源使用率的阈值,对集群进行资源调度所使用的资源调度阈值用于确定一组主机中待调度主机,集群的集群资源使用率与对集群进行资源调度所使用的资源调度阈值负相关;通过比较一组主机中的主机的资源使用率和当前资源调度阈值,确定一组主机中待调度的目标主机,并对目标主机执行调度操作,解决了相关技术中的集群资源调度方法存在集群资源利用率较低的问题,提高了集群资源利用率。Through the embodiments provided by the present application, the cluster resource utilization rate of the cluster in the current cycle is obtained to obtain the current cluster resource utilization rate, wherein the cluster includes a group of hosts, the cluster resource utilization rate of the cluster is determined according to the resource utilization rate of the hosts in the group of hosts in the current cycle, and the resource utilization rate of the hosts in the group of hosts is used to characterize the workload of the hosts in the group of hosts; based on the current cluster resource utilization rate and the resource scheduling threshold range, the current resource scheduling threshold corresponding to the current cluster resource utilization rate is determined, wherein the resource scheduling threshold range is the range of the resource scheduling threshold used for resource scheduling of the cluster, the resource scheduling threshold used for resource scheduling of the cluster is the threshold of the resource utilization rate of the hosts in the group of hosts, the resource scheduling threshold used for resource scheduling of the cluster is used to determine the hosts to be scheduled in the group of hosts, and the cluster resource utilization rate of the cluster is negatively correlated with the resource scheduling threshold used for resource scheduling of the cluster; by comparing the resource utilization rate of the hosts in the group of hosts with the current resource scheduling threshold, determining the target host to be scheduled in the group of hosts, and performing the scheduling operation on the target host, the problem of low cluster resource utilization rate in the cluster resource scheduling method in the related art is solved, and the cluster resource utilization rate is improved.
作为一种可选的方案,基于当前集群资源使用率和资源调度阈值范围,确定与当前集群资源使用率对应的当前资源调度阈值,包括:As an optional solution, based on the current cluster resource usage and the resource scheduling threshold range, a current resource scheduling threshold corresponding to the current cluster resource usage is determined, including:
S11,在当前集群资源使用率小于第一资源使用率阈值的情况下,将资源调度阈值范围的最大值,确定为与当前集群资源使用率对应的当前资源调度阈值;S11, when the current cluster resource usage is less than the first resource usage threshold, determining the maximum value of the resource scheduling threshold range as the current resource scheduling threshold corresponding to the current cluster resource usage;
S12,在当前集群资源使用率大于第二资源使用率阈值的情况下,将资源调度阈值范围的最小值,确定为与当前集群资源使用率对应的当前资源调度阈值;S12, when the current cluster resource usage is greater than the second resource usage threshold, determining the minimum value of the resource scheduling threshold range as the current resource scheduling threshold corresponding to the current cluster resource usage;
S13,在当前集群资源使用率大于或者等于第一资源使用率阈值、且小于或者等于第二资源使用率阈值的情况下,基于当前集群资源使用率、第一资源使用率阈值和第二资源使用率阈值之间的相对关系,从资源调度阈值范围中确定出当前资源调度阈值;S13, when the current cluster resource usage is greater than or equal to the first resource usage threshold and less than or equal to the second resource usage threshold, determine the current resource scheduling threshold from the resource scheduling threshold range based on a relative relationship between the current cluster resource usage, the first resource usage threshold and the second resource usage threshold;
其中,第一资源使用率阈值小于第二资源使用率阈值。The first resource usage rate threshold is smaller than the second resource usage rate threshold.
在本实施例中,提供了一种可选的基于当前集群资源使用率和资源调度阈值范围,确定与当前集群资源使用率对应的当前资源调度阈值的实施方式,参见图4,图4是另一种可选的集群资源调度方法的示意图。In this embodiment, an optional implementation method for determining a current resource scheduling threshold corresponding to the current cluster resource usage based on the current cluster resource usage and the resource scheduling threshold range is provided. See FIG. 4 , which is a schematic diagram of another optional cluster resource scheduling method.
在当前集群资源使用率小于第一资源使用率阈值的情况下,将资源调度阈值范围的最大值,确定为与当前集群资源使用率对应的当前资源调度阈值;在当前集群资源使用率大于第二资源使用率阈值的情况下,将资源调度阈值范围的最小值,确定为与当前集群资源使用率对应的当前资源调度阈值;在当前集群资源使用率大于或者等于第一资源使用率阈值、且小于或者等于第二资源使用率阈值的情况下,基于当前集群资源使用率、第一资源使用率阈值和第二资源使用率阈值之间的相对关系,从资源调度阈值范围中确定出当前资源调度阈值,这里,当前资源调度阈值与当前集群资源使用率负相关。When the current cluster resource utilization rate is less than the first resource utilization rate threshold, the maximum value of the resource scheduling threshold range is determined as the current resource scheduling threshold corresponding to the current cluster resource utilization rate; when the current cluster resource utilization rate is greater than the second resource utilization rate threshold, the minimum value of the resource scheduling threshold range is determined as the current resource scheduling threshold corresponding to the current cluster resource utilization rate; when the current cluster resource utilization rate is greater than or equal to the first resource utilization rate threshold and less than or equal to the second resource utilization rate threshold, based on the relative relationship between the current cluster resource utilization rate, the first resource utilization rate threshold and the second resource utilization rate threshold, the current resource scheduling threshold is determined from the resource scheduling threshold range, where the current resource scheduling threshold is negatively correlated with the current cluster resource utilization rate.
可以理解地,通过为资源调度阈值设置资源调度阈值范围,可以避免在极端情况下,资源调度阈值出现极大或极小的情况,进而导致对集群资源的稳定性产生影响,例如,资源调度阈值过小时,可能会出现长时间无法触发调度操作的情况出现;资源调度阈值过大时,可能会出现频繁触发调度操作的情况出现;上述两种情况均会影响集群资源的稳定性。It can be understood that by setting a resource scheduling threshold range for the resource scheduling threshold, it is possible to avoid the resource scheduling threshold being extremely large or extremely small in extreme cases, which in turn affects the stability of cluster resources. For example, if the resource scheduling threshold is too small, the scheduling operation may not be triggered for a long time; when the resource scheduling threshold is too large, the scheduling operation may be triggered frequently; the above two situations will affect the stability of cluster resources.
通过本申请提供的实施例,基于当前集群资源使用率和资源调度阈值范围,确定与当前集群资源使用率对应的当前资源调度阈值,可以提高当前资源调度阈值确定的合理性。Through the embodiments provided in the present application, based on the current cluster resource usage and the resource scheduling threshold range, the current resource scheduling threshold corresponding to the current cluster resource usage is determined, which can improve the rationality of determining the current resource scheduling threshold.
作为一种可选的方案,基于当前集群资源使用率、第一资源使用率阈值和第二资源使用率阈值之间的相对关系,从资源调度阈值范围中确定出当前资源调度阈值,包括:As an optional solution, based on the relative relationship between the current cluster resource usage, the first resource usage threshold and the second resource usage threshold, the current resource scheduling threshold is determined from the resource scheduling threshold range, including:
S21,将当前集群资源使用率与第一资源使用率阈值的差值乘以指定比值得到目标值,将资源调度阈值范围的最大值减去目标值所得到的值,确定为当前资源调度阈值,其中,指定比值为资源调度阈值范围的最大值减去资源调度阈值范围的最小值得到的差值与第二资源使用率阈值减去第一资源使用率阈值所得到的差值之间的比值。S21, multiplying the difference between the current cluster resource utilization and the first resource utilization threshold by a specified ratio to obtain a target value, and determining the value obtained by subtracting the target value from the maximum value of the resource scheduling threshold range as the current resource scheduling threshold, wherein the specified ratio is the ratio of the difference obtained by subtracting the minimum value of the resource scheduling threshold range from the maximum value of the resource scheduling threshold range to the difference obtained by subtracting the first resource utilization threshold from the second resource utilization threshold.
为了使集群的集群资源使用率与对集群进行资源调度所使用的资源调度阈值负相关,在本实施例中,提供了一种可选的实施例以基于当前集群资源使用率、第一资源使用率阈值和第二资源使用率阈值之间的相对关系,从资源调度阈值范围中确定出当前资源调度阈值。In order to make the cluster resource utilization of the cluster negatively correlated with the resource scheduling threshold used for resource scheduling of the cluster, in this embodiment, an optional embodiment is provided to determine the current resource scheduling threshold from the resource scheduling threshold range based on the relative relationship between the current cluster resource utilization, the first resource utilization threshold and the second resource utilization threshold.
具体的,资源调度阈值范围的最大值减去资源调度阈值范围的最小值得到的差值与第二资源使用率阈值减去第一资源使用率阈值所得到的差值之间的比值确定为指定比值,将当前集群资源使用率与第一资源使用率阈值的差值乘以指定比值得到目标值,将资源调度阈值范围的最大值减去目标值所得到的值,确定为当前资源调度阈值,通过本实施例的步骤得到的当前资源调度阈值与当前集群资源使用率负相关。Specifically, the ratio of the difference obtained by subtracting the minimum value of the resource scheduling threshold range from the maximum value of the resource scheduling threshold range and the difference obtained by subtracting the first resource utilization threshold from the second resource utilization threshold is determined as the specified ratio, the difference between the current cluster resource utilization and the first resource utilization threshold is multiplied by the specified ratio to obtain the target value, and the value obtained by subtracting the target value from the maximum value of the resource scheduling threshold range is determined as the current resource scheduling threshold. The current resource scheduling threshold obtained through the steps of this embodiment is negatively correlated with the current cluster resource utilization.
通过本申请提供的实施例,提供了一种获取当前资源调度阈值的方法,提高了获取的当前资源调度阈值的准确性。Through the embodiments provided in the present application, a method for obtaining a current resource scheduling threshold is provided, thereby improving the accuracy of the obtained current resource scheduling threshold.
作为一种可选的方案,获取当前周期内集群的集群资源使用率,得到当前集群资源使用率,包括:As an optional solution, obtain the cluster resource usage of the cluster in the current period to obtain the current cluster resource usage, including:
S31,获取当前周期内集群的一组历史集群资源使用率,并将一组历史集群资源使用率的平均值,确定为历史集群资源使用率均值,其中,一组历史集群资源使用率中的每个历史集群资源使用率为集群在当前周期的一个历史时间点的集群资源使用率,集群在一个历史时间点的集群资源使用率为一组主机中的主机在一个历史时间点的资源使用率的平均值,当前集群资源使用率包括历史集群资源使用率均值;S31, obtaining a group of historical cluster resource usages of the cluster in the current period, and determining the average value of the group of historical cluster resource usages as the average value of the historical cluster resource usages, wherein each historical cluster resource usage in the group of historical cluster resource usages is the cluster resource usage of the cluster at a historical time point in the current period, the cluster resource usage of the cluster at a historical time point is the average value of resource usages of hosts in a group of hosts at a historical time point, and the current cluster resource usage includes the average value of the historical cluster resource usages;
S32,根据一组历史集群资源使用率对当前周期的下一个周期的集群资源使用率进行预测,得到一组预测集群资源使用率,并将一组预测集群资源使用率的平均值,确定为预测集群资源使用率均值,其中,一组预测集群资源使用率中的每个预测集群资源使用率为预测的、集群在下一个周期的一个未来时间点的集群资源使用率,当前集群资源使用率包括预测集群资源使用率。S32, predicting the cluster resource usage of the next cycle of the current cycle based on a set of historical cluster resource usages to obtain a set of predicted cluster resource usages, and determining the average value of the set of predicted cluster resource usages as the predicted cluster resource usage mean, wherein each predicted cluster resource usage in the set of predicted cluster resource usages is a predicted cluster resource usage of the cluster at a future time point in the next cycle, and the current cluster resource usage includes the predicted cluster resource usage.
参见图3,本实施例的步骤在当前时间点执行;当前周期内集群的集群资源使用率是一组历史集群资源使用率的平均值,即,当前周期包括一组历史时间点,通过获取一组历史时间点中每个时间点的历史集群资源使用率,并计算其均值,可以得到历史集群资源使用率均值。Referring to FIG. 3 , the steps of this embodiment are executed at the current time point; the cluster resource utilization rate of the cluster in the current period is the average value of a set of historical cluster resource utilization rates, that is, the current period includes a set of historical time points, and the historical cluster resource utilization rate average can be obtained by obtaining the historical cluster resource utilization rate of each time point in a set of historical time points and calculating the average value thereof.
根据一组历史集群资源使用率对当前周期的下一个周期的集群资源使用率进行预测,得到一组预测集群资源使用率,这里,下一个周期对应于图3中的预测周期;需要说明的是,可以采用预测算法预测下一个周期的集群资源使用率。The cluster resource utilization rate of the next cycle of the current cycle is predicted based on a set of historical cluster resource utilization rates to obtain a set of predicted cluster resource utilization rates, where the next cycle corresponds to the predicted cycle in FIG3 ; it should be noted that a prediction algorithm may be used to predict the cluster resource utilization rate of the next cycle.
可选的,预测算法可以使用二次指数平滑算法;为提高二次指数预测准确度,可以判断当前周期中一组历史集群资源使用率的稳定程度,将不稳定的数据剔除,不作为预测的依据,避免因数据骤变引起的预测不合逻辑。Optionally, the prediction algorithm may use a quadratic exponential smoothing algorithm; to improve the accuracy of quadratic exponential prediction, the stability of a set of historical cluster resource usage rates in the current cycle may be determined, and unstable data may be removed and not used as a basis for prediction, thereby avoiding illogical predictions caused by sudden changes in data.
具体的,可以对当前周期中的一组历史时间点中每个历史时间点对应的数据进行判断,将一组历史时间点划分为骤变点和稳态点,根据时间倒叙遍历,将距离当前时间点最近的一组稳态点作为预测数据。Specifically, the data corresponding to each historical time point in a group of historical time points in the current cycle can be judged, and a group of historical time points can be divided into sudden change points and steady-state points. According to the reverse chronological traversal, a group of steady-state points closest to the current time point can be used as prediction data.
可选的,骤变点判断标准:当前时间点相对于前一点变化幅度超过指定值(如5%),此标准可根据实际情况进行确定。Optionally, the sudden change point judgment standard is: the change range of the current time point relative to the previous time point exceeds a specified value (such as 5%), and this standard can be determined according to actual conditions.
可选的,稳态点判断标准:当前时间点相对于前一点变化幅度低于指定值(如5%),此标准可根据实际情况进行确定。Optionally, the steady-state point judgment standard is: the change range of the current time point relative to the previous time point is lower than a specified value (such as 5%), and this standard can be determined according to actual conditions.
需要说明的是,对于二次指数平滑算法的加权参数的确定可以包括以下步骤:对于有效数据集(即,上述实施例中的一组稳态点组成的预测数据),假设完成数据集(包含所有数据的数据集)的方差为a,去尾数据集(去除极端值的数据集)的方差为b,当a/b-1>0.05时,为了使预测值更好的衔接当前值,加权参数取0.8;反之加权参数取0.05,此二加权参数取值也可根据实际情况修改。It should be noted that the determination of the weighting parameters of the quadratic exponential smoothing algorithm may include the following steps: for a valid data set (i.e., the predicted data consisting of a set of steady-state points in the above embodiment), assuming that the variance of the complete data set (the data set containing all data) is a, and the variance of the truncated data set (the data set with extreme values removed) is b, when a/b-1>0.05, in order to make the predicted value better connect with the current value, the weighting parameter is taken as 0.8; otherwise, the weighting parameter is taken as 0.05. The values of these two weighting parameters may also be modified according to actual conditions.
通过本申请提供的实施例,基于历史集群资源使用率预测得到预测集群资源使用率,并基于这两者得到当前集群资源使用率,可以提高当前集群资源使用率的准确性。Through the embodiments provided in the present application, the predicted cluster resource usage is obtained based on the historical cluster resource usage prediction, and the current cluster resource usage is obtained based on the two, so that the accuracy of the current cluster resource usage can be improved.
作为一种可选的方案,在当前集群资源使用率小于第一资源使用率阈值的情况下,将资源调度阈值范围的最大值,确定为与当前集群资源使用率对应的当前资源调度阈值,包括:在历史集群资源使用率均值和预测集群资源使用率中的至少之一小于第一资源使用率阈值的情况下,将资源调度阈值范围的最大值,确定为与当前集群资源使用率对应的当前资源调度阈值。As an optional scheme, when the current cluster resource utilization rate is less than the first resource utilization rate threshold, the maximum value of the resource scheduling threshold range is determined as the current resource scheduling threshold corresponding to the current cluster resource utilization rate, including: when at least one of the historical cluster resource utilization rate average and the predicted cluster resource utilization rate is less than the first resource utilization rate threshold, the maximum value of the resource scheduling threshold range is determined as the current resource scheduling threshold corresponding to the current cluster resource utilization rate.
在当前集群资源使用率大于第二资源使用率阈值的情况下,将资源调度阈值范围的最小值,确定为与当前集群资源使用率对应的当前资源调度阈值,包括:在历史集群资源使用率均值和预测集群资源使用率中的至少之一大于第二资源使用率阈值的情况下,将资源调度阈值范围的最小值,确定为与当前集群资源使用率对应的当前资源调度阈值。When the current cluster resource usage is greater than the second resource usage threshold, the minimum value of the resource scheduling threshold range is determined as the current resource scheduling threshold corresponding to the current cluster resource usage, including: when at least one of the historical cluster resource usage average and the predicted cluster resource usage is greater than the second resource usage threshold, the minimum value of the resource scheduling threshold range is determined as the current resource scheduling threshold corresponding to the current cluster resource usage.
在当前集群资源使用率大于或者等于第一资源使用率阈值、且小于或者等于第二资源使用率阈值的情况下,基于当前集群资源使用率、第一资源使用率阈值和第二资源使用率阈值之间的相对关系,从资源调度阈值范围中确定出当前资源调度阈值,包括:在历史集群资源使用率均值和预测集群资源使用率均大于或者等于第一资源使用率阈值、且小于或者等于第二资源使用率阈值的情况下,基于历史集群资源使用率均值、第一资源使用率阈值和第二资源使用率阈值之间的相对关系,从资源调度阈值范围中确定出当前资源调度阈值。When the current cluster resource usage is greater than or equal to the first resource usage threshold and less than or equal to the second resource usage threshold, the current resource scheduling threshold is determined from the resource scheduling threshold range based on the relative relationship between the current cluster resource usage, the first resource usage threshold and the second resource usage threshold, including: when the historical cluster resource usage average and the predicted cluster resource usage are both greater than or equal to the first resource usage threshold and less than or equal to the second resource usage threshold, the current resource scheduling threshold is determined from the resource scheduling threshold range based on the relative relationship between the historical cluster resource usage average, the first resource usage threshold and the second resource usage threshold.
在本实施例中,基于历史集群资源使用率均值和预测集群资源使用率综合确定当前资源调度阈值的具体步骤,可以提高确定的当前资源调度阈值的准确性;可选的,可以仅基于历史集群资源使用率均值确定当前资源调度阈值,其具体步骤包括:In this embodiment, the specific step of comprehensively determining the current resource scheduling threshold based on the historical cluster resource usage average and the predicted cluster resource usage can improve the accuracy of the determined current resource scheduling threshold; optionally, the current resource scheduling threshold can be determined only based on the historical cluster resource usage average, and the specific steps include:
在历史集群资源使用率均值小于第一资源使用率阈值的情况下,将资源调度阈值范围的最大值,确定为与当前集群资源使用率对应的当前资源调度阈值。When the historical cluster resource usage average is less than the first resource usage threshold, the maximum value of the resource scheduling threshold range is determined as the current resource scheduling threshold corresponding to the current cluster resource usage.
在历史集群资源使用率均值大于第二资源使用率阈值的情况下,将资源调度阈值范围的最小值,确定为与当前集群资源使用率对应的当前资源调度阈值。When the historical cluster resource usage average is greater than the second resource usage threshold, the minimum value of the resource scheduling threshold range is determined as the current resource scheduling threshold corresponding to the current cluster resource usage.
在历史集群资源使用率均值大于或者等于第一资源使用率阈值、且小于或者等于第二资源使用率阈值的情况下,基于历史集群资源使用率均值、第一资源使用率阈值和第二资源使用率阈值之间的相对关系,从资源调度阈值范围中确定出当前资源调度阈值,这里,对于具体的计算方法,可以采用上述实施例中基于当前集群资源使用率、第一资源使用率阈值和第二资源使用率阈值之间的相对关系,从资源调度阈值范围中确定出当前资源调度阈值的步骤。When the historical cluster resource usage average is greater than or equal to the first resource usage threshold and less than or equal to the second resource usage threshold, the current resource scheduling threshold is determined from the resource scheduling threshold range based on the relative relationship between the historical cluster resource usage average, the first resource usage threshold and the second resource usage threshold. Here, for the specific calculation method, the step of determining the current resource scheduling threshold from the resource scheduling threshold range based on the relative relationship between the current cluster resource usage, the first resource usage threshold and the second resource usage threshold in the above embodiment can be adopted.
通过本申请提供的实施例,基于历史集群资源使用率均值和预测集群资源使用率综合确定当前资源调度阈值,可以提高确定的当前资源调度阈值的准确性。Through the embodiments provided in the present application, the current resource scheduling threshold is comprehensively determined based on the historical cluster resource usage average and the predicted cluster resource usage, which can improve the accuracy of the determined current resource scheduling threshold.
作为一种可选的方案,在获取当前周期内集群的集群资源使用率,得到当前集群资源使用率之后,方法还包括:As an optional solution, after obtaining the cluster resource usage rate of the cluster in the current period and obtaining the current cluster resource usage rate, the method further includes:
S61,在当前集群资源使用率大于第二资源使用率阈值的情况下,恢复一组主机中已待机的至少部分主机与集群的连接;S61, when the current cluster resource usage rate is greater than a second resource usage rate threshold, restoring the connection between at least part of the hosts in a group of hosts that are on standby and the cluster;
S62,将一组主机上运行的部分虚拟机调度到恢复连接的至少部分主机上,其中,一组主机中,处于连接状态的主机上运行有至少一个虚拟机;S62, scheduling some virtual machines running on a group of hosts to at least some hosts whose connections are restored, wherein at least one virtual machine is running on a host in a connected state among the group of hosts;
其中,对目标主机执行调度操作是指将目标主机上运行的虚拟机调度到集群中,处于连接状态的主机上,并将目标主机设置为待机状态。The scheduling operation on the target host refers to scheduling the virtual machine running on the target host to a host in the cluster that is in a connected state, and setting the target host to a standby state.
可选的,在当前集群资源使用率大于第二资源使用率阈值,且前集群资源使用率大于资源使用率极值的情况下,将集群内所有主机恢复与集群的连接,并禁止对所述集群增派新的任务,这里,资源使用率极值大于第二资源使用率阈值。Optionally, when the current cluster resource utilization is greater than the second resource utilization threshold and the previous cluster resource utilization is greater than the resource utilization extreme value, all hosts in the cluster are restored to the cluster connection and it is prohibited to add new tasks to the cluster. Here, the resource utilization extreme value is greater than the second resource utilization threshold.
通过本申请提供的实施例,在当前集群资源使用率过大的情况下,通过恢复一组主机中已待机的至少部分主机与集群的连接,可以提高集群的稳定性。Through the embodiments provided by the present application, when the current cluster resource usage is too high, the stability of the cluster can be improved by restoring the connection between at least some of the hosts in a group of hosts that are on standby and the cluster.
作为一种可选的方案,集群的集群资源使用率包括集群的计算资源使用率和集群的内存使用率,当前集群资源使用率包括当前计算资源使用率和当前内存使用率,资源调度阈值范围包括与集群的计算资源使用率对应的第一调度阈值范围和与集群的内存使用率对应的第二调度阈值范围;As an optional solution, the cluster resource usage of the cluster includes the computing resource usage of the cluster and the memory usage of the cluster, the current cluster resource usage includes the current computing resource usage and the current memory usage, and the resource scheduling threshold range includes a first scheduling threshold range corresponding to the computing resource usage of the cluster and a second scheduling threshold range corresponding to the memory usage of the cluster;
基于当前集群资源使用率和资源调度阈值范围,确定与当前集群资源使用率对应的当前资源调度阈值,包括:基于当前计算资源使用率和第一调度阈值范围,确定与当前计算资源使用率对应的当前计算资源调度阈值;基于当前内存使用率和第二调度阈值范围,确定与当前内存使用率对应的当前内存调度阈值;Based on the current cluster resource usage and the resource scheduling threshold range, determining the current resource scheduling threshold corresponding to the current cluster resource usage, including: based on the current computing resource usage and the first scheduling threshold range, determining the current computing resource scheduling threshold corresponding to the current computing resource usage; based on the current memory usage and the second scheduling threshold range, determining the current memory scheduling threshold corresponding to the current memory usage;
通过比较一组主机中的主机的资源使用率和当前资源调度阈值,确定一组主机中待调度的目标主机,包括:通过比较一组主机中的主机的计算资源使用率和当前计算资源调度阈值、以及比较一组主机中的主机的内存使用率和当前内存调度阈值,确定一组主机中待调度的目标主机,其中,目标主机满足以下至少之一的条件:目标主机的计算资源使用率小于当前计算资源调度阈值,目标主机的内存使用率小于当前内存调度阈值。Determining a target host to be scheduled in a group of hosts by comparing the resource utilization of a host in a group of hosts with a current resource scheduling threshold, including: determining a target host to be scheduled in a group of hosts by comparing the computing resource utilization of a host in a group of hosts with a current computing resource scheduling threshold, and comparing the memory utilization of a host in a group of hosts with a current memory scheduling threshold, wherein the target host satisfies at least one of the following conditions: the computing resource utilization of the target host is less than the current computing resource scheduling threshold, and the memory utilization of the target host is less than the current memory scheduling threshold.
在本实施例中,提供了一种可选的方案,集群的集群资源使用率包括集群的计算资源使用率和集群的内存使用率,这里,集群的计算资源使用率可以是集群的CPU使用率,当前集群资源使用率包括当前计算资源使用率和当前内存使用率,资源调度阈值范围包括与集群的计算资源使用率对应的第一调度阈值范围和与集群的内存使用率对应的第二调度阈值范围。In this embodiment, an optional solution is provided, in which the cluster resource utilization of the cluster includes the computing resource utilization of the cluster and the memory utilization of the cluster. Here, the computing resource utilization of the cluster may be the CPU utilization of the cluster, the current cluster resource utilization includes the current computing resource utilization and the current memory utilization, and the resource scheduling threshold range includes a first scheduling threshold range corresponding to the computing resource utilization of the cluster and a second scheduling threshold range corresponding to the memory utilization of the cluster.
通过本申请提供的实施例,集群资源使用率包括集群的计算资源使用率和集群的内存使用率,可以增加集群资源调度方法的可靠性。Through the embodiments provided in the present application, the cluster resource utilization rate includes the computing resource utilization rate of the cluster and the memory utilization rate of the cluster, which can increase the reliability of the cluster resource scheduling method.
下面结合可选示例对本申请中的集群资源调度方法进行解释说明,参见图5和图6。The cluster resource scheduling method in the present application is explained below with reference to optional examples, see FIG. 5 and FIG. 6 .
本实施例中的集群资源调度方法可以由阈值配置管理模块,DPM调度模块,集群资源监控及预测模块共同实现。The cluster resource scheduling method in this embodiment can be implemented by a threshold configuration management module, a DPM scheduling module, and a cluster resource monitoring and prediction module.
阈值管理模块(对于阈值的实际取值的示例参见图5):Threshold management module (see Figure 5 for an example of actual threshold values):
1、设定CPU使用率阈值CPULow,在集群CPU资源利用率低于此值时设定较为激进的DPM调度阈值;设定CPU使用率阈值CPUHigh,在集群CPU资源利用率高于此值时设定较为保守的DPM调度阈值。1. Set the CPU usage threshold CPULow to set a more aggressive DPM scheduling threshold when the cluster CPU resource utilization is lower than this value; set the CPU usage threshold CPUHigh to set a more conservative DPM scheduling threshold when the cluster CPU resource utilization is higher than this value.
2、设定内存使用率阈值MEMLow,在集群内存资源利用率低于此值时设定较为激进的DPM调度阈值;设定内存使用率阈值MEMHigh,在集群内存资源利用率高于此值时设定较为保守的DPM调度阈值。2. Set the memory usage threshold MEMLow to set a more aggressive DPM scheduling threshold when the cluster memory resource utilization is lower than this value; set the memory usage threshold MEMHigh to set a more conservative DPM scheduling threshold when the cluster memory resource utilization is higher than this value.
3、设定CPU和内存使用率极值CPULimit和MEMLimit,用于在集群内主机使用率达到此值时,即恢复DPM关闭的主机用于补充集群资源。3. Set the CPU and memory usage extremes CPULimit and MEMLimit. When the host usage in the cluster reaches this value, the host shut down by DPM will be restored to supplement cluster resources.
4、设定DPM调度范围阈值CPUrange和MEMrange,用于主机CPU、内存资源利用率低于此值的时候执行DPM调度,这两个值为范围取值,根据集群资源使用及预测情况,系统自行设定调度阈值。4. Set the DPM scheduling range thresholds CPUrange and MEMrange to execute DPM scheduling when the host CPU and memory resource utilization are lower than this value. These two values are range values. The system sets the scheduling thresholds automatically based on cluster resource usage and prediction.
集群资源监控及预测模块:Cluster resource monitoring and prediction module:
1、集群资源使用率监控模块,可使用常见的各种集群资源监控系统或者方法进行监控。1. Cluster resource usage monitoring module, which can be monitored using various common cluster resource monitoring systems or methods.
2、集群资源使用率预测模块,使用二次指数平滑算法预测未来一段时间内的集群资源使用率情况,用于设置不同调度阈值。2. Cluster resource utilization prediction module, which uses quadratic exponential smoothing algorithm to predict cluster resource utilization in the future, and is used to set different scheduling thresholds.
这里,DPM调度模的具体步骤结合图6进行说明。Here, the specific steps of the DPM scheduling module are described in conjunction with FIG. 6 .
DPM调度模块:DPM scheduling module:
1、DPM调度模块首先获取设定的各种阈值CPULow、MEMLow、CPUHigh、MEMHigh、CPULimit、MEMLimit、CPUrange、MEMrange。1. The DPM scheduling module first obtains the various set thresholds CPULow, MEMLow, CPUHigh, MEMHigh, CPULimit, MEMLimit, CPUrange, and MEMrange.
2、调度模块内置一个调度周期(当前周期),集群资源使用监控模块获取周期内的集群CPU和内存资源使用率情况CPUcurrent和MEMcurrent,并根据集群资源预测模块获取未来一个周期内的预测值CPUtrend和MEMtrend。2. The scheduling module has a built-in scheduling cycle (current cycle). The cluster resource usage monitoring module obtains the cluster CPU and memory resource usage CPUcurrent and MEMcurrent within the cycle, and obtains the predicted values CPUtrend and MEMtrend within a future cycle based on the cluster resource prediction module.
3、DPM调度中CPU阈值设定:3. CPU threshold setting in DPM scheduling:
1)若CPUcurrent均值和CPUtrend均值其中之一小于CPULow,设定DPM调度阈值为CPUrange(max);若CPUcurrent均值和CPUtrend均值其中之一大于CPUHigh,则设定DPM调度阈值为CPUrange(min)。1) If one of the CPUcurrent average and the CPUtrend average is less than CPULow, set the DPM scheduling threshold to CPUrange(max); if one of the CPUcurrent average and the CPUtrend average is greater than CPUHigh, set the DPM scheduling threshold to CPUrange(min).
2)若CPUcurrent均值和CPUtrend均值都在CPULow和CPUHigh之间,则设定DPM调度阈值为CPUrange(mid)=CPUrange(max)-(CPUrange(max)-CPUrange(min))*(CPUcurrent-CPULow)/(CPUHigh-CPULow)。2) If the CPUcurrent average and the CPUtrend average are both between CPULow and CPUHigh, the DPM scheduling threshold is set to CPUrange(mid)=CPUrange(max)-(CPUrange(max)-CPUrange(min))*(CPUcurrent-CPULow)/(CPUHigh-CPULow).
DPM调度中内存阈值设定:Memory threshold setting in DPM scheduling:
1)若MEMcurrent均值和MEMtrend均值其中之一小于MEMLow,设定DPM调度阈值为MEMrange(max);若MEMcurrent均值和MEMtrend均值其中之一大于MEMHigh,则设定DPM调度阈值为MEMrange(min)。1) If one of the MEMcurrent mean and the MEMtrend mean is less than MEMLow, the DPM scheduling threshold is set to MEMrange(max); if one of the MEMcurrent mean and the MEMtrend mean is greater than MEMHigh, the DPM scheduling threshold is set to MEMrange(min).
2)若MEMcurrent均值和MEMtrend均值都在MEMLow和MEMHigh之间,则设定DPM调度阈值为MEMrange(mid)=MEMrange(max)-(MEMrange(max)-MEMrange(min))*(MEMcurrent-MEMLow)/(MEMHigh-MEMLow)。2) If the mean value of MEMcurrent and the mean value of MEMtrend are both between MEMLow and MEMHigh, the DPM scheduling threshold is set to MEMrange(mid)=MEMrange(max)-(MEMrange(max)-MEMrange(min))*(MEMcurrent-MEMLow)/(MEMHigh-MEMLow).
4、根据第三、四两步设置的DPM阈值,判断当前周期内可执行DPM调度的主机,若主机CPU及内存使用率均低于设定的DPM调度阈值,则将此主机上的虚拟机全部迁移到集群内其他主机,并将此主机置于待机状态(后台直接关机),待集群资源不足时再恢复使用,或者DPM调度策略关闭后恢复使用;若其中之一不低于设定的DPM调度阈值,或者主机上存在无法迁移的开机的虚拟机,或者不符合DPM调度规则的其他限制条件(此类条件可自定义),则此主机不会触发DPM待机。之后继续进行下一个周期的调度。4. According to the DPM thresholds set in the third and fourth steps, determine the hosts that can perform DPM scheduling in the current cycle. If the CPU and memory usage of the host are both lower than the set DPM scheduling thresholds, migrate all virtual machines on this host to other hosts in the cluster, and put this host in standby mode (directly shut down in the background), and resume use when cluster resources are insufficient, or resume use after the DPM scheduling policy is turned off; if one of them is not lower than the set DPM scheduling threshold, or there are powered-on virtual machines on the host that cannot be migrated, or other restrictions that do not meet the DPM scheduling rules (such conditions can be customized), this host will not trigger DPM standby. Then continue scheduling for the next cycle.
5、当CPUcurrent或者MEMcurrent其中之一大于对应的极值CPULimit或MEMLimit时,将集群内经DPM调度待机的主机恢复连接,增加集群可用资源。5. When either CPUcurrent or MEMcurrent is greater than the corresponding extreme value CPULimit or MEMLimit, the hosts in the cluster that are scheduled to be on standby by DPM are restored to increase the available resources of the cluster.
6、之后继续从第一步骤开始进行下一个周期调度逻辑及判断。6. Then continue from the first step to perform the next cycle scheduling logic and judgment.
需要说明的是,对于前述的各方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本申请并不受所描述的动作顺序的限制,因为依据本申请,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作和模块并不一定是本申请所必须的。It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到根据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM(Read-Only Memory,只读存储器)/RAM(Random Access Memory,随机存取存储器)、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,或者网络设备等)执行本申请各个实施例所述的方法。Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM (Read-Only Memory, read-only memory)/RAM (Random Access Memory, random access memory), a disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
根据本申请实施例的又一个方面,还提供了一种集群资源调度装置,该装置用于实现上述实施例中所提供的集群资源调度方法,已经进行过说明的不再赘述。如以下所使用的,术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的。According to another aspect of the embodiments of the present application, a cluster resource scheduling device is also provided, which is used to implement the cluster resource scheduling method provided in the above embodiments, and the description has been made no further. As used below, the term "module" can be a combination of software and/or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.
图7是根据本申请实施例的一种集群资源调度装置的结构框图,如图7所示,该装置包括:FIG. 7 is a structural block diagram of a cluster resource scheduling device according to an embodiment of the present application. As shown in FIG. 7 , the device includes:
获取单元702,用于在待识别图像中不包含具有面部的人形对象的情况下,获取与待识别图像对应的图像语义特征,其中,待识别图像为待进行情感类别识别的视觉图像;The acquisition unit 702 is used to acquire image semantic features corresponding to the image to be recognized when the image to be recognized does not contain a human-shaped object with a face, wherein the image to be recognized is a visual image to be subjected to emotion category recognition;
第一提取单元704,用于对待识别图像进行视觉美学特征提取,得到与待识别图像对应的图像视觉美学特征,其中,视觉美学特征用于表征待识别图像的图像美感;The first extraction unit 704 is used to extract visual aesthetic features of the image to be identified, and obtain image visual aesthetic features corresponding to the image to be identified, wherein the visual aesthetic features are used to characterize the image aesthetics of the image to be identified;
第一执行单元706,用于对图像语义特征和图像视觉美学特征进行特征融合,得到第一融合特征,并基于得到的第一融合特征进行情感类别识别,得到待识别图像的第一识别结果。The first execution unit 706 is used to perform feature fusion on the image semantic features and the image visual aesthetic features to obtain a first fusion feature, and perform emotion category recognition based on the obtained first fusion feature to obtain a first recognition result of the image to be recognized.
需要说明的是,该实施例中的获取单元702可以用于执行上述步骤S202,该实施例中的第一提取单元704可以用于执行上述步骤S204,该实施例中的第一执行单元706可以用于执行上述步骤S206。It should be noted that the acquisition unit 702 in this embodiment can be used to execute the above step S202, the first extraction unit 704 in this embodiment can be used to execute the above step S204, and the first execution unit 706 in this embodiment can be used to execute the above step S206.
通过本申请提供的实施例,获取当前周期内集群的集群资源使用率,得到当前集群资源使用率,其中,集群包括一组主机,集群的集群资源使用率是根据当前周期内一组主机中的主机的资源使用率确定的,一组主机中的主机的资源使用率用于表征一组主机中的主机的工作负载情况;基于当前集群资源使用率和资源调度阈值范围,确定与当前集群资源使用率对应的当前资源调度阈值,其中,资源调度阈值范围是对集群进行资源调度所使用的资源调度阈值的范围,对集群进行资源调度所使用的资源调度阈值是一组主机中的主机的资源使用率的阈值,对集群进行资源调度所使用的资源调度阈值用于确定一组主机中待调度主机,集群的集群资源使用率与对集群进行资源调度所使用的资源调度阈值负相关;通过比较一组主机中的主机的资源使用率和当前资源调度阈值,确定一组主机中待调度的目标主机,并对目标主机执行调度操作,解决了相关技术中的集群资源调度方法存在集群资源利用率较低的问题,提高了集群资源利用率。Through the embodiments provided by the present application, the cluster resource utilization rate of the cluster in the current cycle is obtained to obtain the current cluster resource utilization rate, wherein the cluster includes a group of hosts, the cluster resource utilization rate of the cluster is determined according to the resource utilization rate of the hosts in the group of hosts in the current cycle, and the resource utilization rate of the hosts in the group of hosts is used to characterize the workload of the hosts in the group of hosts; based on the current cluster resource utilization rate and the resource scheduling threshold range, the current resource scheduling threshold corresponding to the current cluster resource utilization rate is determined, wherein the resource scheduling threshold range is the range of the resource scheduling threshold used for resource scheduling of the cluster, the resource scheduling threshold used for resource scheduling of the cluster is the threshold of the resource utilization rate of the hosts in the group of hosts, the resource scheduling threshold used for resource scheduling of the cluster is used to determine the hosts to be scheduled in the group of hosts, and the cluster resource utilization rate of the cluster is negatively correlated with the resource scheduling threshold used for resource scheduling of the cluster; by comparing the resource utilization rate of the hosts in the group of hosts with the current resource scheduling threshold, determining the target host to be scheduled in the group of hosts, and performing the scheduling operation on the target host, the problem of low cluster resource utilization rate in the cluster resource scheduling method in the related art is solved, and the cluster resource utilization rate is improved.
可选的,确定单元包括:Optionally, the determining unit includes:
第一确定模块,用于在当前集群资源使用率小于第一资源使用率阈值的情况下,将资源调度阈值范围的最大值,确定为与当前集群资源使用率对应的当前资源调度阈值;A first determination module is used to determine the maximum value of the resource scheduling threshold range as the current resource scheduling threshold corresponding to the current cluster resource usage when the current cluster resource usage is less than the first resource usage threshold;
第二确定模块,用于在当前集群资源使用率大于第二资源使用率阈值的情况下,将资源调度阈值范围的最小值,确定为与当前集群资源使用率对应的当前资源调度阈值;a second determination module, configured to determine, when the current cluster resource usage is greater than a second resource usage threshold, a minimum value of the resource scheduling threshold range as a current resource scheduling threshold corresponding to the current cluster resource usage;
第三确定模块,用于在当前集群资源使用率大于或者等于第一资源使用率阈值、且小于或者等于第二资源使用率阈值的情况下,基于当前集群资源使用率、第一资源使用率阈值和第二资源使用率阈值之间的相对关系,从资源调度阈值范围中确定出当前资源调度阈值;A third determination module is used to determine the current resource scheduling threshold from the resource scheduling threshold range based on the relative relationship between the current cluster resource usage, the first resource usage threshold and the second resource usage threshold when the current cluster resource usage is greater than or equal to the first resource usage threshold and less than or equal to the second resource usage threshold;
其中,第一资源使用率阈值小于第二资源使用率阈值。The first resource usage rate threshold is smaller than the second resource usage rate threshold.
可选的,第三确定模块包括:Optionally, the third determination module includes:
第一确定子模块,用于将当前集群资源使用率与第一资源使用率阈值的差值乘以指定比值得到目标值,将资源调度阈值范围的最大值减去目标值所得到的值,确定为当前资源调度阈值,其中,指定比值为资源调度阈值范围的最大值减去资源调度阈值范围的最小值得到的差值与第二资源使用率阈值减去第一资源使用率阈值所得到的差值之间的比值。The first determination submodule is used to multiply the difference between the current cluster resource utilization and the first resource utilization threshold by a specified ratio to obtain a target value, and determine the value obtained by subtracting the target value from the maximum value of the resource scheduling threshold range as the current resource scheduling threshold, wherein the specified ratio is the ratio between the difference obtained by subtracting the minimum value of the resource scheduling threshold range from the maximum value of the resource scheduling threshold range and the difference obtained by subtracting the first resource utilization threshold from the second resource utilization threshold.
可选的,获取单元包括:Optionally, the acquisition unit includes:
第四确定模块,用于获取当前周期内集群的一组历史集群资源使用率,并将一组历史集群资源使用率的平均值,确定为历史集群资源使用率均值,其中,一组历史集群资源使用率中的每个历史集群资源使用率为集群在当前周期的一个历史时间点的集群资源使用率,集群在一个历史时间点的集群资源使用率为一组主机中的主机在一个历史时间点的资源使用率的平均值,当前集群资源使用率包括历史集群资源使用率均值;a fourth determination module, configured to obtain a group of historical cluster resource usages of the cluster in the current period, and determine an average value of the group of historical cluster resource usages as the historical cluster resource usage average value, wherein each historical cluster resource usage in the group of historical cluster resource usages is the cluster resource usage of the cluster at a historical time point in the current period, the cluster resource usage of the cluster at a historical time point is the average value of resource usages of hosts in a group of hosts at a historical time point, and the current cluster resource usage includes the historical cluster resource usage average value;
第一执行模块,用于根据一组历史集群资源使用率对当前周期的下一个周期的集群资源使用率进行预测,得到一组预测集群资源使用率,并将一组预测集群资源使用率的平均值,确定为预测集群资源使用率均值,其中,一组预测集群资源使用率中的每个预测集群资源使用率为预测的、集群在下一个周期的一个未来时间点的集群资源使用率,当前集群资源使用率包括预测集群资源使用率。The first execution module is used to predict the cluster resource utilization of the next cycle of the current cycle based on a set of historical cluster resource utilizations to obtain a set of predicted cluster resource utilizations, and determine the average value of the set of predicted cluster resource utilizations as the predicted cluster resource utilization mean, wherein each predicted cluster resource utilization in the set of predicted cluster resource utilizations is a predicted cluster resource utilization of the cluster at a future time point in the next cycle, and the current cluster resource utilization includes the predicted cluster resource utilization.
可选的,第一确定模块包括:第二确定子模块,用于在历史集群资源使用率均值和预测集群资源使用率中的至少之一小于第一资源使用率阈值的情况下,将资源调度阈值范围的最大值,确定为与当前集群资源使用率对应的当前资源调度阈值;Optionally, the first determination module includes: a second determination submodule, configured to determine a maximum value of the resource scheduling threshold range as a current resource scheduling threshold corresponding to the current cluster resource usage when at least one of the historical cluster resource usage average and the predicted cluster resource usage is less than the first resource usage threshold;
第二确定模块包括:第三确定子模块,用于在历史集群资源使用率均值和预测集群资源使用率中的至少之一大于第二资源使用率阈值的情况下,将资源调度阈值范围的最小值,确定为与当前集群资源使用率对应的当前资源调度阈值;The second determination module includes: a third determination submodule, configured to determine the minimum value of the resource scheduling threshold range as the current resource scheduling threshold corresponding to the current cluster resource usage rate when at least one of the historical cluster resource usage rate mean value and the predicted cluster resource usage rate is greater than the second resource usage rate threshold value;
第三确定模块包括:第四确定子模块,用于在历史集群资源使用率均值和预测集群资源使用率均大于或者等于第一资源使用率阈值、且小于或者等于第二资源使用率阈值的情况下,基于历史集群资源使用率均值、第一资源使用率阈值和第二资源使用率阈值之间的相对关系,从资源调度阈值范围中确定出当前资源调度阈值。The third determination module includes: a fourth determination sub-module, which is used to determine the current resource scheduling threshold from the resource scheduling threshold range based on the relative relationship between the historical cluster resource utilization average, the first resource utilization threshold and the second resource utilization threshold when the historical cluster resource utilization average and the predicted cluster resource utilization are both greater than or equal to the first resource utilization threshold and less than or equal to the second resource utilization threshold.
可选的,上述装置还包括:Optionally, the above device further includes:
第二执行单元,用于在获取当前周期内集群的集群资源使用率,得到当前集群资源使用率之后,在当前集群资源使用率大于第二资源使用率阈值的情况下,恢复一组主机中已待机的至少部分主机与集群的连接;A second execution unit is used to obtain the cluster resource usage rate of the cluster in the current cycle, and after obtaining the current cluster resource usage rate, if the current cluster resource usage rate is greater than a second resource usage rate threshold, restore the connection between at least part of the hosts in a group of hosts that are on standby and the cluster;
第二执行单元,用于将一组主机上运行的部分虚拟机调度到恢复连接的至少部分主机上,其中,一组主机中,处于连接状态的主机上运行有至少一个虚拟机;A second execution unit is used to schedule some virtual machines running on a group of hosts to at least some hosts whose connections are restored, wherein at least one virtual machine is running on a host in a connected state among the group of hosts;
其中,对目标主机执行调度操作是指将目标主机上运行的虚拟机调度到集群中,处于连接状态的主机上,并将目标主机设置为待机状态。The scheduling operation on the target host refers to scheduling the virtual machine running on the target host to a host in the cluster that is in a connected state, and setting the target host to a standby state.
可选的,集群的集群资源使用率包括集群的计算资源使用率和集群的内存使用率,当前集群资源使用率包括当前计算资源使用率和当前内存使用率,资源调度阈值范围包括与集群的计算资源使用率对应的第一调度阈值范围和与集群的内存使用率对应的第二调度阈值范围;Optionally, the cluster resource usage of the cluster includes the computing resource usage of the cluster and the memory usage of the cluster, the current cluster resource usage includes the current computing resource usage and the current memory usage, and the resource scheduling threshold range includes a first scheduling threshold range corresponding to the computing resource usage of the cluster and a second scheduling threshold range corresponding to the memory usage of the cluster;
确定单元包括:第一执行模块,用于基于当前计算资源使用率和第一调度阈值范围,确定与当前计算资源使用率对应的当前计算资源调度阈值;基于当前内存使用率和第二调度阈值范围,确定与当前内存使用率对应的当前内存调度阈值;The determination unit includes: a first execution module, configured to determine a current computing resource scheduling threshold corresponding to the current computing resource usage rate based on the current computing resource usage rate and the first scheduling threshold range; and determine a current memory scheduling threshold corresponding to the current memory usage rate based on the current memory usage rate and the second scheduling threshold range;
第一执行单元包括:第二执行模块,用于通过比较一组主机中的主机的计算资源使用率和当前计算资源调度阈值、以及比较一组主机中的主机的内存使用率和当前内存调度阈值,确定一组主机中待调度的目标主机,其中,目标主机满足以下至少之一的条件:目标主机的计算资源使用率小于当前计算资源调度阈值,目标主机的内存使用率小于当前内存调度阈值。The first execution unit includes: a second execution module, which is used to determine a target host to be scheduled in a group of hosts by comparing the computing resource utilization of a host in the group of hosts with a current computing resource scheduling threshold, and comparing the memory utilization of a host in the group of hosts with a current memory scheduling threshold, wherein the target host satisfies at least one of the following conditions: the computing resource utilization of the target host is less than the current computing resource scheduling threshold, and the memory utilization of the target host is less than the current memory scheduling threshold.
根据本申请实施例的又一个方面,还提供了一种计算机可读的存储介质,计算机可读的存储介质包括存储的程序,其中,程序运行时执行上述任一项方法实施例中的步骤。According to another aspect of the embodiments of the present application, a computer-readable storage medium is provided. The computer-readable storage medium includes a stored program, wherein the program executes the steps of any of the above method embodiments when it is run.
在一个示例性实施例中,上述计算机可读存储介质可以包括但不限于:U盘、只读存储器(Read-Only Memory,简称为ROM)、随机存取存储器(Random Access Memory,简称为RAM)、移动硬盘、磁碟或者光盘等各种可以存储计算机程序的介质。In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to, various media that can store computer programs, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk.
根据本申请实施例的又一方面,还提供了一种电子设备,包括存储器和处理器,存储器中存储有计算机程序,处理器被设置为通过计算机程序执行上述任一项方法实施例中的步骤。According to another aspect of the embodiments of the present application, there is further provided an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to execute the steps in any one of the above method embodiments through the computer program.
在一个示例性实施例中,上述电子设备还可以包括传输设备以及输入输出设备,其中,该传输设备和上述处理器连接,该输入输出设备和上述处理器连接。In an exemplary embodiment, the electronic device may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
本实施例中的具体示例可以参考上述实施例及示例性实施方式中所描述的示例,本实施例在此不再赘述。For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail herein.
根据本申请实施例的又一个方面,提供了一种计算机程序产品,该计算机程序产品包括计算机程序/指令,该计算机程序/指令包含用于执行流程图所示的方法的程序代码。在这样的实施例中,参考图8,该计算机程序可以通过通信部分809从网络上被下载和安装,和/或从可拆卸介质811被安装。在该计算机程序被中央处理器801执行时,执行本申请实施例提供的各种功能。上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。According to another aspect of an embodiment of the present application, a computer program product is provided, the computer program product comprising a computer program/instruction, the computer program/instruction comprising a program code for executing the method shown in the flowchart. In such an embodiment, with reference to FIG8, the computer program can be downloaded and installed from the network via a communication portion 809, and/or installed from a removable medium 811. When the computer program is executed by a central processing unit 801, various functions provided by the embodiment of the present application are executed. The above-mentioned serial numbers of the embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments.
参考图8,图8是根据本申请实施例的一种可选的电子设备的计算机系统的结构框图。Refer to FIG. 8 , which is a structural block diagram of a computer system of an optional electronic device according to an embodiment of the present application.
图8示意性地示出了用于实现本申请实施例的电子设备的计算机系统结构框图。如图8所示,计算机系统800包括中央处理器801(Central Processing Unit,CPU),其可以根据存储在只读存储器802(Read-Only Memory,ROM)中的程序或者从存储部分808加载到随机访问存储器803(Random Access Memory,RAM)中的程序而执行各种适当的动作和处理。在随机访问存储器803中,还存储有系统操作所需的各种程序和数据。中央处理器801、在只读存储器802以及随机访问存储器803通过总线804彼此相连。输入/输出接口805(Input/Output接口,即I/O接口)也连接至总线804。Fig. 8 schematically shows a computer system structure block diagram of an electronic device for implementing an embodiment of the present application. As shown in Fig. 8, computer system 800 includes a central processing unit 801 (Central Processing Unit, CPU), which can perform various appropriate actions and processes according to the program stored in a read-only memory 802 (Read-Only Memory, ROM) or the program loaded from a storage part 808 into a random access memory 803 (Random Access Memory, RAM). In the random access memory 803, various programs and data required for system operation are also stored. The central processing unit 801, the read-only memory 802 and the random access memory 803 are connected to each other through a bus 804. An input/output interface 805 (Input/Output interface, i.e., an I/O interface) is also connected to the bus 804.
以下部件连接至输入/输出接口805:包括键盘、鼠标等的输入部分806;包括诸如阴极射线管(Cathode Ray Tube,CRT)、液晶显示器(Liquid Crystal Display,LCD)等以及扬声器等的输出部分807;包括硬盘等的存储部分808;以及包括诸如局域网卡、调制解调器等的网络接口卡的通信部分809。通信部分809经由诸如因特网的网络执行通信处理。驱动器810也根据需要连接至输入/输出接口805。可拆卸介质811,诸如磁盘、光盘、磁光盘、半导体存储器等等,根据需要安装在驱动器810上,以便于从其上读出的计算机程序根据需要被安装入存储部分808。The following components are connected to the input/output interface 805: an input section 806 including a keyboard, a mouse, etc.; an output section 807 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 808 including a hard disk, etc.; and a communication section 809 including a network interface card such as a local area network card, a modem, etc. The communication section 809 performs communication processing via a network such as the Internet. A drive 810 is also connected to the input/output interface 805 as needed. A removable medium 811, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 810 as needed so that a computer program read therefrom is installed into the storage section 808 as needed.
特别地,根据本申请的实施例,各个方法流程图中所描述的过程可以被实现为计算机软件程序。例如,本申请的实施例包括一种计算机程序产品,其包括承载在计算机可读介质上的计算机程序,该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中,该计算机程序可以通过通信部分809从网络上被下载和安装,和/或从可拆卸介质811被安装。在该计算机程序被中央处理器801执行时,执行本申请的系统中限定的各种功能。In particular, according to an embodiment of the present application, the process described in each method flow chart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer readable medium, and the computer program contains a program code for executing the method shown in the flow chart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 809, and/or installed from the removable medium 811. When the computer program is executed by the central processor 801, various functions defined in the system of the present application are executed.
需要说明的是,图8示出的电子设备的计算机系统800仅是一个示例,不应对本申请实施例的功能和使用范围带来任何限制。It should be noted that the computer system 800 of the electronic device shown in FIG. 8 is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
显然,本领域的技术人员应该明白,上述的本申请实施例的各模块或各步骤可以用通用的计算装置来实现,它们可以集中在单个的计算装置上,或者分布在多个计算装置所组成的网络上,它们可以用计算装置可执行的程序代码来实现,从而,可以将它们存储在存储装置中由计算装置来执行,并且在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤,或者将它们分别制作成各个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样,本申请实施例不限制于任何特定的硬件和软件结合。Obviously, those skilled in the art should understand that the modules or steps of the above-mentioned embodiments of the present application can be implemented by a general computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in a different order from that herein, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. In this way, the embodiments of the present application are not limited to any specific combination of hardware and software.
以上仅为本申请的优选实施例而已,并不用于限制本申请实施例,对于本领域的技术人员来说,本申请实施例可以有各种更改和变化。凡在本申请实施例的原则之内,所作的任何修改、等同替换、改进等,均应包含在本申请实施例的保护范围之内。The above are only preferred embodiments of the present application and are not intended to limit the embodiments of the present application. For those skilled in the art, the embodiments of the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the principles of the embodiments of the present application shall be included in the protection scope of the embodiments of the present application.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410706194.0A CN118733252A (en) | 2024-05-31 | 2024-05-31 | Cluster resource scheduling method and device, storage medium and electronic device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410706194.0A CN118733252A (en) | 2024-05-31 | 2024-05-31 | Cluster resource scheduling method and device, storage medium and electronic device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN118733252A true CN118733252A (en) | 2024-10-01 |
Family
ID=92856228
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202410706194.0A Pending CN118733252A (en) | 2024-05-31 | 2024-05-31 | Cluster resource scheduling method and device, storage medium and electronic device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN118733252A (en) |
-
2024
- 2024-05-31 CN CN202410706194.0A patent/CN118733252A/en active Pending
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2399183B1 (en) | Energy-aware server management | |
Beloglazov et al. | Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers | |
US9104498B2 (en) | Maximizing server utilization within a datacenter | |
US8402140B2 (en) | Methods and apparatus for coordinated energy management in virtualized data centers | |
Hieu et al. | Virtual machine consolidation with usage prediction for energy-efficient cloud data centers | |
US20150058844A1 (en) | Virtual computing resource orchestration | |
CN112559182B (en) | Resource allocation method, device, equipment and storage medium | |
JP2021521518A (en) | Virtual machine scheduling method and equipment | |
CN112579304A (en) | Resource scheduling method, device, equipment and medium based on distributed platform | |
WO2019036084A1 (en) | Systems and methods for provision of a guaranteed batch | |
Żotkiewicz et al. | Minimum dependencies energy-efficient scheduling in data centers | |
CN111625080B (en) | Server energy saving method and device, electronic equipment and storage medium | |
Cao et al. | Energy efficient allocation of virtual machines in cloud computing environments based on demand forecast | |
CN112527509A (en) | Resource allocation method and device, electronic equipment and storage medium | |
Duggan et al. | An autonomous network aware vm migration strategy in cloud data centres | |
CN117971499B (en) | Resource allocation method, device, electronic equipment and storage medium | |
US20230229216A1 (en) | System and methods for server power management | |
CN113032102A (en) | Resource rescheduling method, device, equipment and medium | |
CN110806918A (en) | Virtual machine operation method and device based on deep learning neural network | |
KR101608859B1 (en) | Cloud based intelligent power control system | |
Panneerselvam et al. | An approach to optimise resource provision with energy-awareness in datacentres by combating task heterogeneity | |
CN103488538A (en) | Application extension device and application extension method in cloud computing system | |
CN112463361A (en) | Method and equipment for distributing elastic resources of distributed computation | |
Li et al. | A strategy game system for QoS-efficient dynamic virtual machine consolidation in data centers | |
CN116048791B (en) | Regulation and control method and device of test node, electronic equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |