[go: up one dir, main page]

CN111858013A - Workflow job scheduling control method - Google Patents

Workflow job scheduling control method Download PDF

Info

Publication number
CN111858013A
CN111858013A CN202010865834.4A CN202010865834A CN111858013A CN 111858013 A CN111858013 A CN 111858013A CN 202010865834 A CN202010865834 A CN 202010865834A CN 111858013 A CN111858013 A CN 111858013A
Authority
CN
China
Prior art keywords
job
jobs
priority
executable
workflow
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010865834.4A
Other languages
Chinese (zh)
Inventor
谭光明
汤瑞
邵恩
张春明
段勃
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Western Institute Of Advanced Technology Institute Of Computing Chinese Academy Of Sciences
Original Assignee
Western Institute Of Advanced Technology Institute Of Computing Chinese Academy Of Sciences
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Western Institute Of Advanced Technology Institute Of Computing Chinese Academy Of Sciences filed Critical Western Institute Of Advanced Technology Institute Of Computing Chinese Academy Of Sciences
Publication of CN111858013A publication Critical patent/CN111858013A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/48Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806Task transfer initiation or dispatching
    • G06F9/4843Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • G06F9/4881Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/5038Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/4557Distribution of virtual machine instances; Migration and load balancing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/45595Network integration; Enabling network access in virtual machine instances
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/48Indexing scheme relating to G06F9/48
    • G06F2209/484Precedence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/50Indexing scheme relating to G06F9/50
    • G06F2209/5021Priority

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention provides a workflow job scheduling control method, which comprises the following steps: traversing all the jobs in the workflow of the job control module, and recording the number of the predecessor dependent jobs of each job and the job number thereof; determining executable jobs from the workflow; determining the priority of the executable job, and sending the executable job and the priority thereof to a job control queue; the job control queue divides the jobs into different priority levels according to the priority levels of the jobs, and the selected jobs are executed from a high priority level to a low priority level in each priority level.

Description

Workflow job scheduling control method
Technical Field
The invention relates to the field of computers, in particular to a workflow job scheduling control method.
Background
Scientific computing, deep learning, big data jobs have become the most common job types in data centers and cloud computing centers. The existing data center and cloud computing center are diversified in operation type, and meanwhile, hardware resources are developed towards diversification and isomerization. Besides the common X86 CPU and GPU, the machine resources also comprise an NPU (advanced peripheral Unit) for deep learning operation training (such as an AI chip for deep learning model inference), various FPGA chips with special functions, open-source Arm, MIPS, RISK-V processors and the like. And different types of heterogeneous computing resources are clouded, so that the method becomes the best choice for solving the diversity of the operation load and the heterogeneity of the computing resources. The existing container arrangement management system (such as Kubernets) becomes an important core for operating and managing container operation. The container arrangement management system not only meets the requirement of providing a uniform operating environment for diversified operation loads, but also shields the difference of hardware for application developers. The application developer can only focus on the development process of the application and does not need to focus on system environment configuration maintenance. And system research and development workers do not need to provide compatibility support for various applications, and only need to perform compatibility adaptation on a Kubernetes unified application operation environment container.
But the support of the container arrangement management system on scientific calculation, deep learning and big data operation is still not ideal. This is because existing generic container orchestration management systems are initially stateless web services oriented. Support for stateful services such as scientific computing, deep learning, big data jobs, and caching, databases, etc. is insufficient. Typically, a deep learning operation has multiple steps, such as: the method comprises the following steps of data acquisition, data processing, data conversion, data segmentation, model training, parameter tuning, model verification, model online monitoring and log acquisition. However, in a load with "workflow" features, each step needs to wait for the completion of the previous step before it can be executed.
However, the job scheduler in the current container scheduling management system still adopts a first-come first-serve scheduling policy, and cannot meet the load characteristics of the "workflow" type job load. For example, in a multi-tenant scenario, multiple users submit multiple workflow jobs. The later submitted workflow jobs are delayed for a long time and the quality of service of each workflow cannot be guaranteed.
Therefore, in order to solve the above technical problems, it is necessary to provide a new technical means for solving the problems.
Disclosure of Invention
In view of the above, an object of the present invention is to provide a method for controlling job scheduling of a workflow, which can dynamically adjust the execution priority of jobs in the workflow and dynamically adjust the execution order of each job in the same priority, thereby effectively improving the service quality of the jobs, improving the resource utilization rate, and reducing the overall completion time of the jobs.
The invention provides a workflow job scheduling control method, which comprises the following steps:
s1, traversing all the jobs in the workflow of the job control module, and recording the number of predecessor dependent jobs and job numbers of each job;
s2, determining executable operation from the workflow;
s3, determining the priority of the executable job, and sending the executable job and the priority thereof to a job control queue;
and S4, the job control queue divides the jobs into different priority levels according to the priority levels of the jobs, and in each priority level, the selected jobs are executed from a high priority level to a low priority level.
Further, in step S2, the executable job determination process in the workflow is as follows:
s21, judging whether the operation i is the operation of the workflow according to the operation number of the operation i, if so, entering the next step, and if not, ending;
s22, recording the operation time of the predecessor dependent operation of the operation i, including the operation completion time TreceiveAnd a work start time TsendCalculating the actual execution time T of the predecessor dependent job of job iexecute
Texecute=Treceive-Tsend
S23, each time the predecessor dependent operation of the operation i is executed, the number of the dependent operations of the operation i is reduced by 1, and the earliest executable time T of the operation i is updatedi,start
Ti,start=max{Tpre,finishIn which T ispre,finishRelying on the completion time of the job, T, for the remaining predecessors of job ipre,finish=Texecute+Tstart,TstartRelying on the start time of the job for the remaining predecessors of job i; if the number of dependent jobs of job i is 0, job i is an executable job.
Further, the priority of the executable job is determined by:
determining an actual start time T for an executable jobi,startWorking time T set by systemi,systemA difference of (d);
determining priority D of executable job ii:Di={Ti,send-Ti,start0 }; wherein:
if T isi,send≤Ti,startSince it is described that operation i has not been delayed, the priority is set to 0, and if T is seti,system>Ti,startIt is explained that the job has been delayed, and the priority is larger the longer the delayed time is.
Further, in step S4, the priority level is determined according to the following method:
high priority level:
Figure BDA0002649705810000031
medium priority level:
Figure BDA0002649705810000032
low priority level:
Figure BDA0002649705810000033
wherein D ═ Dmax-Dmin;DmaxAs the maximum value of the priority of all executable jobs, DminIs the minimum of the priorities of all executable jobs.
Further, in step S4, the selected job is determined by:
and (3) constructing an execution profit equation:
f(i,j)=max{f(i-1,j),f(i-1,j-vi)+wi}; wherein f (i, j) represents the maximum gain that can be achieved by the whole cluster if the machine resource is j under the condition of considering the first i jobs, f (i-1, j) represents the maximum gain that can be achieved by the whole cluster if the machine resource is j under the condition of considering the first i-1 jobs, and f (i-1, j-v)i) Represents the maximum benefit, w, that the entire cluster can achieve with machine resources j-vi, considering the first i-1 jobsi=tmax-ti,tmaxRepresents the execution time, t, of the job having the longest execution time among all the jobsiIndicates the current job execution time, f (i-1, V-V)i) Represents the maximum benefit that can be achieved for the entire cluster with machine resources V-vi, V @, given the first i-1 jobs considerediRepresenting the request quantity of the job i to all the resources V of the system;
traversing the job queues with three priority levels, and judging whether f (i, V) is equal to f (i-1, V-V)i)+wiIf the two are the same, the operation i is selected, otherwise, the operation i is not selectedWherein f (i, V) considers the maximum gain that the whole cluster can achieve under all the resources V of the system under the first i job conditions; f (i-1, V-V)i) Representing a system resource of V-V under consideration of i-1 job conditionsiThe maximum gain that can be achieved by the whole cluster.
The invention has the beneficial effects that: by the method and the device, the execution priority of the jobs in the workflow can be dynamically adjusted, and the execution sequence of each job in the same priority can be dynamically adjusted, so that the service quality of the jobs can be effectively improved, the resource utilization rate can be improved, and the total completion time of the jobs can be reduced.
Drawings
The invention is further described below with reference to the following figures and examples:
FIG. 1 is a flow chart of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings of the specification:
the invention provides a workflow job scheduling control method, which comprises the following steps:
s1, traversing all the jobs in the workflow of the job control module, and recording the number of predecessor dependent jobs and job numbers of each job;
s2, determining executable operation from the workflow;
s3, determining the priority of the executable job, and sending the executable job and the priority thereof to a job control queue;
and S4, the job control queue divides the jobs into different priority levels according to the priority levels of the jobs, and the selected jobs are executed from a high priority level to a low priority level in each priority level.
In this embodiment, in step S2, the executable job determination process in the workflow is as follows:
s21, judging whether the operation i is the operation of the workflow according to the operation number of the operation i, if so, entering the next step, and if not, ending;
s22, recording the operation time of the predecessor dependent operation of the operation i, including the operation completion time TreceiveAnd a work start time TsendCalculating the actual execution time T of the predecessor dependent job of job iexecute
Texecute=Treceive-Tsend
S23, each time the predecessor dependent operation of the operation i is executed, the number of the dependent operations of the operation i is reduced by 1, and the earliest executable time T of the operation i is updatedi,start
Ti,start=max{Tpre,finishIn which T ispre,finishRelying on the completion time of the job, T, for the remaining predecessors of job ipre,finish=Texecute+Tstart,TstartRelying on the start time of the job for the remaining predecessors of job i; if the number of dependent jobs of the job i is 0, the job i is an executable job, wherein the predecessor dependent job of the job i indicates that the job i is to be executed, and the job i must be executed after the jobs such as i1, i2, …, im and the like are completed, wherein i1, i2, …, im indicates that m predecessor dependent jobs of the job i are executed, and each time the predecessor dependent job of the job i is executed, m is reduced by 1 until the m predecessor dependent job is 0.
In this embodiment, the priority of the executable job is determined by the following method:
determining an actual start time T for an executable jobi,startWorking time T set by systemi,systemA difference of (d);
determining priority D of executable job ii:Di={Ti,send-Ti,start0 }; wherein:
if T isi,send≤Ti,startSince it is described that operation i has not been delayed, the priority is set to 0, and if T is seti,system>Ti,startIt is explained that the job has been delayed, and the priority is larger the longer the delayed time is.
In this embodiment, in step S4, the priority level is determined according to the following method:
high priority level:
Figure BDA0002649705810000061
medium priority level:
Figure BDA0002649705810000062
low priority level:
Figure BDA0002649705810000063
wherein D ═ Dmax-Dmin;DmaxAs the maximum value of the priority of all executable jobs, DminIs the minimum of the priorities of all executable jobs.
Specifically, the method comprises the following steps: in step S4, the selected job is determined by:
and (3) constructing an execution profit equation:
f(i,j)=max{f(i-1,j),f(i-1,j-vi)+wi}; wherein f (i, j) represents the maximum gain that can be achieved by the whole cluster if the machine resource is j under the condition of considering the first i jobs, f (i-1, j) represents the maximum gain that can be achieved by the whole cluster if the machine resource is j under the condition of considering the first i-1 jobs, and f (i-1, j-v)i) Represents the maximum benefit, w, that the entire cluster can achieve with machine resources j-vi, considering the first i-1 jobsi=tmax-ti,tmaxRepresents the execution time, t, of the job having the longest execution time among all the jobsiIndicates the current job execution time, f (i-1, V-V)i) Represents the maximum benefit that can be achieved for the entire cluster with machine resources V-vi, V @, given the first i-1 jobs considerediRepresenting the request quantity of the job i to all the resources V of the system;
go throughThree priority levels of job queue, and determining whether f (i, V) is equal to f (i-1, V-V)i)+wiIf so, indicating that the job i is selected, otherwise, not selecting the job i, wherein f (i, V) considers the maximum benefit which can be achieved by the whole cluster under the condition of all the resources V of the system under the condition of the first i jobs; f (i-1, V-V)i) Representing a system resource of V-V under consideration of i-1 job conditionsiThe maximum gain that can be achieved by the whole cluster.
In the prior art, the job which is always submitted first in the scheduling control of the job always occupies system resources, and the job which is submitted later cannot be executed and is blocked for a long time.
Finally, the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting, although the present invention has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions may be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, and all of them should be covered in the claims of the present invention.

Claims (5)

1. A workflow job scheduling control method is characterized in that: the method comprises the following steps:
s1, traversing all the jobs in the workflow of the job control module, and recording the number of predecessor dependent jobs and job numbers of each job;
s2, determining executable operation from the workflow;
s3, determining the priority of the executable job, and sending the executable job and the priority thereof to a job control queue;
and S4, the job control queue divides the jobs into different priority levels according to the priority levels of the jobs, and in each priority level, the selected jobs are executed from a high priority level to a low priority level.
2. The workflow job scheduling control method according to claim 1, wherein: in step S2, the executable job determination process in the workflow is as follows:
s21, judging whether the operation i is the operation of the workflow according to the operation number of the operation i, if so, entering the next step, and if not, ending;
s22, recording the operation time of the predecessor dependent operation of the operation i, including the operation completion time TreceiveAnd a work start time TsendCalculating the actual execution time T of the predecessor dependent job of job iexecute
Texecute=Treceive-Tsend
S23, each time the predecessor dependent operation of the operation i is executed, the number of the dependent operations of the operation i is reduced by 1, and the earliest executable time T of the operation i is updatedi,start
Ti,start=max{Tpre,finishIn which T ispre,finishRelying on the completion time of the job, T, for the remaining predecessors of job ipre,finish=Texecute+Tstart,TstartRelying on the start time of the job for the remaining predecessors of job i; if the number of dependent jobs of job i is 0, job i is an executable job.
3. The workflow job scheduling control method according to claim 2, wherein: the priority of the executable job is determined by the following method:
determining an actual start time T for an executable jobi,startWorking time T set by systemi,systemA difference of (d);
determining priority D of executable job ii:Di={Ti,send-Ti,start0 }; wherein:
if T isi,send≤Ti,startSince it is described that operation i has not been delayed, the priority is set to 0, and if T is seti,system>Ti,startIt is explained that the job has been delayed, and the priority is larger the longer the delayed time is.
4. The workflow job scheduling control method according to claim 3, wherein: in step S4, the priority level is determined according to the following method:
high priority level:
Figure FDA0002649705800000021
medium priority level:
Figure FDA0002649705800000022
low priority level:
Figure FDA0002649705800000023
wherein D ═ Dmax-Dmin;DmaxAs the maximum value of the priority of all executable jobs, DminIs the minimum of the priorities of all executable jobs.
5. The workflow job scheduling control method according to claim 4, wherein: in step S4, the selected job is determined by:
and (3) constructing an execution profit equation:
f(i,j)=max{f(i-1,j),f(i-1,j-vi)+wi}; wherein f (i, j) represents the maximum gain that can be achieved by the whole cluster if the machine resource is j under the condition of considering the first i jobs, f (i-1, j) represents the maximum gain that can be achieved by the whole cluster if the machine resource is j under the condition of considering the first i-1 jobs, and f (i-1, j-v)i) Represents the maximum benefit, w, that the entire cluster can achieve with machine resources j-vi, considering the first i-1 jobsi=tmax-ti,tmaxRepresents the execution time, t, of the job having the longest execution time among all the jobsiIndicates the current job execution time, f (i-1, V-V)i) Represents the maximum benefit that can be achieved for the entire cluster with machine resources V-vi, V @, given the first i-1 jobs considerediRepresenting the request quantity of the job i to all the resources V of the system;
traversing the job queues with three priority levels, and judging whether f (i, V) is equal to f (i-1, V-V)i)+wiIf so, indicating that the job i is selected, otherwise, not selecting the job i, wherein f (i, V) considers the maximum benefit which can be achieved by the whole cluster under the condition of all the resources V of the system under the condition of the first i jobs; f (i-1, V-V)i) Representing a system resource of V-V under consideration of i-1 job conditionsiThe maximum gain that can be achieved by the whole cluster.
CN202010865834.4A 2020-06-19 2020-08-25 Workflow job scheduling control method Pending CN111858013A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010567938 2020-06-19
CN2020105679387 2020-06-19

Publications (1)

Publication Number Publication Date
CN111858013A true CN111858013A (en) 2020-10-30

Family

ID=72967173

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010865834.4A Pending CN111858013A (en) 2020-06-19 2020-08-25 Workflow job scheduling control method

Country Status (1)

Country Link
CN (1) CN111858013A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114035930A (en) * 2021-11-29 2022-02-11 重庆大学 Method and apparatus for task scheduling, electronic device, and readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102981904A (en) * 2011-09-02 2013-03-20 阿里巴巴集团控股有限公司 Task scheduling method and system
CN106371918A (en) * 2016-08-23 2017-02-01 北京云纵信息技术有限公司 Task cluster scheduling management method and apparatus
CN108509603A (en) * 2018-04-02 2018-09-07 焦点科技股份有限公司 A kind of adaptive dynamic dispatching method and system of data warehouse
CN110096345A (en) * 2019-03-16 2019-08-06 平安科技(深圳)有限公司 Intelligent task dispatching method, device, equipment and storage medium
US20200125962A1 (en) * 2018-10-19 2020-04-23 CA Software Österreich GmbH Runtime prediction for a critical path of a workflow

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102981904A (en) * 2011-09-02 2013-03-20 阿里巴巴集团控股有限公司 Task scheduling method and system
CN106371918A (en) * 2016-08-23 2017-02-01 北京云纵信息技术有限公司 Task cluster scheduling management method and apparatus
CN108509603A (en) * 2018-04-02 2018-09-07 焦点科技股份有限公司 A kind of adaptive dynamic dispatching method and system of data warehouse
US20200125962A1 (en) * 2018-10-19 2020-04-23 CA Software Österreich GmbH Runtime prediction for a critical path of a workflow
CN110096345A (en) * 2019-03-16 2019-08-06 平安科技(深圳)有限公司 Intelligent task dispatching method, device, equipment and storage medium

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
JIA YU 等: "Workflow Scheduling Algorithms for Grid Computing", 《METAHEURISTICS FOR SCHEDULING IN DISTRIBUTED COMPUTING ENVIRONMENTS》, vol. 146, pages 173 - 214, XP055654048, DOI: 10.1007/978-3-540-69277-5_7 *
伍复慧: "云计算工作流调度算法研究", 《中国博士学位论文全文数据库 信息科技辑》, no. 2, pages 138 - 6 *
陈兰 等: "机群环境中一种基于工作流关系的作业调度算法", 信息工程大学学报, vol. 8, no. 02, pages 227 - 230 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114035930A (en) * 2021-11-29 2022-02-11 重庆大学 Method and apparatus for task scheduling, electronic device, and readable storage medium
CN114035930B (en) * 2021-11-29 2024-05-10 重庆大学 Method and device for task scheduling, electronic equipment and readable storage medium

Similar Documents

Publication Publication Date Title
EP3853731B1 (en) Commitment-aware scheduler
CN111431961B (en) Energy-saving task allocation method for cloud data center
US8332862B2 (en) Scheduling ready tasks by generating network flow graph using information receive from root task having affinities between ready task and computers for execution
US7734676B2 (en) Method for controlling the number of servers in a hierarchical resource environment
US8752059B2 (en) Computer data processing capacity planning using dependency relationships from a configuration management database
WO2021159638A1 (en) Method, apparatus and device for scheduling cluster queue resources, and storage medium
US20050283786A1 (en) Optimizing workflow execution against a heterogeneous grid computing topology
US20050125582A1 (en) Methods and apparatus to dispatch interrupts in multi-processor systems
WO2024021489A1 (en) Task scheduling method and apparatus, and kubernetes scheduler
WO2020248226A1 (en) Initial hadoop computation task allocation method based on load prediction
CN111026553A (en) Resource scheduling method for offline mixed part operation and server system
US20230161620A1 (en) Pull mode and push mode combined resource management and job scheduling method and system, and medium
CN104820616A (en) Task scheduling method and device
CN113032102A (en) Resource rescheduling method, device, equipment and medium
CN117687759A (en) Task scheduling method, device, processing equipment and readable storage medium
CN116010064A (en) Method, system and device for DAG job scheduling and cluster management
CN113391911B (en) Dynamic scheduling method, device and equipment for big data resources
CN109189581B (en) Job scheduling method and device
CN111858013A (en) Workflow job scheduling control method
CN110928659B (en) Numerical value pool system remote multi-platform access method with self-adaptive function
US11954518B2 (en) User-defined metered priority queues
CN117827428A (en) Cloud service initialization method and system based on rule engine and token bucket algorithm
CN117608850A (en) A multi-task computing resource allocation method and device for neural network processors
CN113900824B (en) Cloud platform virtual resource high-speed scheduling method
CN116303132A (en) Data caching method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20201030