CN114610489B - Batch file processing method and device - Google Patents
Batch file processing method and device Download PDFInfo
- Publication number
- CN114610489B CN114610489B CN202210237282.1A CN202210237282A CN114610489B CN 114610489 B CN114610489 B CN 114610489B CN 202210237282 A CN202210237282 A CN 202210237282A CN 114610489 B CN114610489 B CN 114610489B
- Authority
- CN
- China
- Prior art keywords
- processing
- file
- time
- batch
- files
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/505—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
- G06F9/5016—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5083—Techniques for rebalancing the load in a distributed system
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a batch file processing method and device, which can be used in the financial field, wherein the method comprises the steps of obtaining a file processing basic information table and a file processing record table, scanning the file processing record table, if the file processing state in the file processing record table is the number of in-process states being less than the preset number, determining the residual processing time of each file according to the required processing completion time and the file arrival time corresponding to each file, determining the residual available time of each file according to the residual processing time and the longest processing time, and performing batch file processing according to the residual available time of each file. The invention can process batch files and avoid the problems of memory overflow and unbalanced batch progress work distribution.
Description
Technical Field
The invention relates to the field of finance, in particular to a batch file processing method and device. It should be noted that the batch file processing method and apparatus of the present invention may be used in the financial field, and may be used in any field other than the financial field.
Background
This section is intended to provide a background or context to the embodiments of the invention that are recited in the claims. The description herein is not admitted to be prior art by inclusion in this section.
The SME network financial service platform is provided with at least 20 files of different types, batch files to be processed are required to be received from the DCDS system, and the system calls the service of each type of file in the background in a daemon mode to carry out batch processing.
However, the time and the file size of the DCDS file are not determined, and the existing file processing method scans the FTP directory file issued by the DCDS file every three minutes, and the file starts to be processed if the file exists, but the method has the following problems:
1. when excessive files issued simultaneously appear, a plurality of file processing threads are called up simultaneously, the threads of the files processed by the memory are many, and the situation of memory overflow exists for many times;
2. The file processing size and the processing time are not comprehensively arranged, the time window of server batch processing is not reasonably utilized, and the situations of excessive busy or idle peak processing and idle processing often exist and are processed, so that batch work is unbalanced.
Accordingly, there is a need for a batch document processing scheme that overcomes the above-described problems.
Disclosure of Invention
The embodiment of the invention provides a batch file processing method, which is used for processing batch files and avoiding the problems of memory overflow and unbalanced batch progress work distribution, and comprises the following steps:
Obtaining a file processing basic information table and a file processing record table, wherein the file processing basic information table comprises time for completing processing and longest processing time, the file processing record table comprises file arrival time and file processing state, and the file processing state comprises a processing in-progress state and an arrival state;
And scanning the file processing record table, if the number of the file processing states in the file processing record table is the number of the in-process states of processing and is smaller than the preset number, determining the residual processing time of each file according to the required processing completion time and the file arrival time corresponding to each file, determining the residual available time of each file according to the residual processing time and the longest processing time, and carrying out batch file processing according to the residual available time of each file.
The embodiment of the invention provides a batch file processing device, which is used for processing batch files and avoiding the problems of memory overflow and unbalanced batch progress work distribution, and comprises the following components:
The information table obtaining module is used for obtaining a file processing basic information table and a file processing record table, wherein the file processing basic information table comprises time for completing processing and longest processing time, the file processing record table comprises file arrival time and file processing state, and the file processing state comprises a processing in-progress state and an arrival state;
And the batch file processing module is used for scanning the file processing record table, if the file processing state in the file processing record table is the number of in-process states being less than the preset number, determining the residual processing time of each file according to the required processing completion time and the file arrival time corresponding to each file for a plurality of files with the file processing states being in the arrival state, determining the residual available time of each file according to the residual processing time and the longest processing time, and carrying out batch file processing according to the residual available time of each file.
The embodiment of the invention also provides computer equipment, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the batch file processing method is realized when the processor executes the computer program.
The embodiment of the invention also provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program, and the computer program realizes the batch file processing method when being executed by a processor.
The embodiment of the invention also provides a computer program product, which comprises a computer program, and the computer program realizes the batch file processing method when being executed by a processor.
Compared with the technical scheme of carrying out batch file processing by scanning FTP directory files issued by DCDS files every three minutes in the prior art, the embodiment of the invention is characterized in that a file processing basic information table and a file processing record table are obtained, wherein the file processing basic information table comprises a required processing completion time and a longest processing time, the file processing record table comprises a file arrival time, a file processing state comprises a processing in-progress state and an arrival state, the file processing record table is scanned, if the file processing state in the file processing record table is the number of the processing in-progress states which is smaller than the preset number, the file processing state is a plurality of files in the arrival state, the residual processing time of each file is determined according to the required processing completion time and the file arrival time corresponding to each file, the residual available time of each file is determined according to the residual processing time and the longest processing time, and batch file processing is carried out according to the residual available time of each file. According to the embodiment of the invention, the file processing state is analyzed through the file processing basic information table and the file processing record table, if the file processing state in the file processing record table is the number of in-process states being less than the preset number, the residual processing time of each file is determined according to the required processing completion time and the file arrival time corresponding to each file, the residual available time of each file is further determined according to the residual processing time and the longest processing time, batch processing is carried out according to the residual available time, the problems of simultaneous arrival processing conflict of the files, insufficient CPU and memory are avoided, resources can be evenly distributed, the system processing stability is ensured, and the situations of busy or idle are avoided.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art. In the drawings:
FIG. 1 is a schematic diagram of a batch file processing method according to an embodiment of the present invention;
FIGS. 2-3 are flowcharts of batch file processing in an embodiment of the invention;
FIG. 4 is a block diagram of a batch file processing apparatus according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a computer device according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the embodiments of the present invention will be described in further detail with reference to the accompanying drawings. The exemplary embodiments of the present invention and their descriptions herein are for the purpose of explaining the present invention, but are not to be construed as limiting the invention.
First, technical terms in the embodiment of the present invention will be described:
the DCDS is used for realizing batch collection of service system data (avoiding repeated data collection), downloading the data to the downloading platform, performing text-level data processing on the data text, namely simple verification, encryption and decryption, temporary storage, compression, transmission and storage.
Source system refers to application system for batch generation of download data file.
Data file refers to a text file formed directly from the data of a data table in the source system.
Data application system-refers to an application system that receives and uses data files.
SME, medium and small enterprise network financial service platform.
In order to perform batch file processing and avoid the problems of memory overflow and unbalanced batch progress work allocation, an embodiment of the present invention provides a batch file processing method, as shown in fig. 1, the method may include:
step 101, obtaining a file processing basic information table and a file processing record table, wherein the file processing basic information table comprises time for completing processing and longest processing time, the file processing record table comprises file arrival time and file processing state, and the file processing state comprises a processing in-progress state and an arrival state;
And 102, scanning the file processing record table, if the number of the file processing states in the file processing record table is the number of the in-process states of processing and is smaller than the preset number, determining the remaining processing time of each file according to the required processing completion time and the file arrival time corresponding to each file, determining the remaining available time of each file according to the remaining processing time and the longest processing time, and performing batch file processing according to the remaining available time of each file.
As can be seen from FIG. 1, compared with the technical scheme of batch file processing by scanning FTP directory files issued by DCDS files every three minutes in the prior art, the embodiment of the invention has the advantages that the file processing basic information table and the file processing record table are obtained, wherein the file processing basic information table comprises the time required to be processed and the longest processing time, the file processing record table comprises the file arrival time, the file processing state comprises the processing in-progress state and the arrival state, the file processing record table is scanned, if the number of the file processing states in the file processing record table is smaller than the preset number, the file processing states are the files in the arrival state, the residual processing time of each file is determined according to the required processing completion time and the file arrival time corresponding to each file, the residual available time of each file is determined according to the residual processing time and the longest processing time, and batch file processing is performed according to the residual available time of each file. According to the embodiment of the invention, the file processing state is analyzed through the file processing basic information table and the file processing record table, if the file processing state in the file processing record table is the number of in-process states being less than the preset number, the residual processing time of each file is determined according to the required processing completion time and the file arrival time corresponding to each file, the residual available time of each file is further determined according to the residual processing time and the longest processing time, batch processing is carried out according to the residual available time, the problems of simultaneous arrival processing conflict of the files, insufficient CPU and memory are avoided, resources can be evenly distributed, the system processing stability is ensured, and the situations of busy or idle are avoided.
In step 101, a file processing basic information table and a file processing record table are obtained, wherein the file processing basic information table comprises time for completing processing and longest processing time, the file processing record table comprises file arrival time and file processing state, and the file processing state comprises a processing in-progress state and an arrival state.
In step 102, the file processing record table is scanned, if the number of file processing states in the file processing record table is the number of in-process states being less than the preset number, then the remaining processing time of each file is determined according to the required processing completion time and the file arrival time corresponding to each file, the remaining available time of each file is determined according to the remaining processing time and the longest processing time, and batch file processing is performed according to the remaining available time of each file.
In one embodiment, batch file processing based on the remaining available time for each file includes:
Ranking the remaining available time for the plurality of files;
if the remaining available time of the plurality of files is not equal, the file with the shortest remaining available time is preferentially processed.
In one embodiment, the file processing base information table further includes a processing priority;
and carrying out batch file processing according to the residual available time of each file, and further comprising carrying out batch file processing according to the processing priority of each file if the residual available time of a plurality of files is equal, wherein the file with the highest priority is processed preferentially.
In one embodiment, the file processing base information table further includes an average processing time;
and carrying out batch file processing according to the residual available time of each file, and further comprising carrying out batch file processing according to the average processing time of each file if the residual available time and the processing priority of a plurality of files are equal, wherein the file with the shortest average processing time is processed preferentially.
A specific embodiment is given below to illustrate a specific application of batch file processing in an embodiment of the present invention. As shown in fig. 2 to 3, the file processing basic information table needs to be maintained, which includes field file types, processing priorities, processing completion time, average processing time, minimum processing time, longest processing time, and service interfaces. The file processing basic information table can be used for judgment input of the file priority processing thereafter. The average processing time and the longest processing time need to be updated later, and the serial number, the file name, the time for processing completion and the service interface are service configuration data. For example, 6 files need to be processed, and the corresponding file names, processing priorities, time which needs to be completed, average processing time, longest processing time and corresponding service scheduling interfaces are shown in table 1.
TABLE 1
The FTP directory (file processing basic information table) is scanned every three minutes, a file processing record table (file arrival time, file start processing time, processing completion time, file processing state (arrival state, processing in-progress state, completion state, processing abnormality state, processing data amount) is updated, the arrival time is recorded, and the processing state is the arrival state.
And running a background daemon service process-file processing scheduler, namely scanning a file record table once every minute, searching whether files in processing are more than or equal to 3, and if the files are more than or equal to 3, not performing any processing. If the number of files in processing is smaller than 3, the number of reprocessable files=3—in processing the number of files, the files ranked in front are acquired by ranking from small to large (remaining available time-longest processing time), priority from high to low, and average processing time from small to large in combination with the file processing base information table and the file processing record table.
In Table 2, there are three files in process, and no redundant processes are performed to process sequence numbers 4,5, and 6.
TABLE 2
When the 3:00 processing is completed, one resource is released, and then the priority scheduling file can be judged 4, 5 and 6 according to the priority and time requirements to process. And sorting the files in a mode of (the residual available time-the longest processing time) from small to large, and the priority from high to low and the average processing time from small to large, and acquiring files sorted in the front.
Since K01, NJ6, PCL all require processing to be completed within 12 hours, and 1 hour has elapsed since the file was received, the remaining processing time is 11 hours. The PCL files are processed preferentially according to (remaining available time-longest processing time), priority, and average processing time ordering. That is, the first processing with the shortest remaining available time is selected, and when the remaining available time is equal, the first processing with the highest priority is selected, and when both the first and second processing are the same, the processing with the shortest average processing time is selected, as shown in table 3.
TABLE 3 Table 3
| File name | Remaining available time-longest processing time | Priority level | Average processing time |
| PCL | 11-2=9 | 2 | 1 |
| NJ6 | 11-2=9 | 2 | 2 |
| K01 | 11-1.5=9.5 | 3 | 1 |
After the file processing is completed, updating the current processing time, processing state and calculating the time required by the file processing of the file processing record table, (calculating the time required by the file processing+the average time before)/2, comparing the longest processing time and the smallest processing time, and updating the average processing time, the smallest processing time and the longest processing time of the file processing basic information table.
The embodiment of the invention considers the high concurrency risk of the existing immediate file processing mode, the high processing pressure of the memory and the CPU, the situation of memory overflow in production for many times, and the uneven distribution of tasks in batch processing progress and the situation of peak and idle are considered, so that the most needed file is obtained for processing by combining comprehensive judgment of the number of files being processed, the priority of file processing, the time of file processing and the like. The number of the file processing queues can be 3 at most, and scheduling complement is performed when the resources are released. The scheduling selection principle is that the number of files which can be processed is selected according to the sequence of (the remaining available time-the file processing time length) from small to large, the file priority from high to low and the file processing time length from small to large.
When the method is implemented, the files are scanned every three minutes, when new files exist, the files are moved to the to-be-processed file catalogue, information is maintained to a file processing record table, and the file state is that the files arrive. The file processing record table is scanned every minute to see if the number of files being processed is greater than 3, and if so, no processing is performed. If the number of files in processing is less than 3, the number of reprocessable files=3—in processing the number of files, the files in the front of the order are obtained by sorting the files in a manner that the remaining available time-the longest processing time is from small to large, the priority is from high to low, and the average processing time is from small to large in combination with the file processing base information table and the file processing record table. And calling the file processing service according to the service interface of the file in the file processing basic information table. Processing the file and recording the file start processing time, and when completed, recording the file completion time. When an abnormality exists, recording the state as processing abnormality, and recording a key abnormality log. And calculating file processing time, processing data number, longest processing time, smallest processing time and average processing time, and updating a file processing record table and a file processing basic information table. And calculating average duration through historical data, and then calculating file service which is scheduled preferentially by combining the information such as minimum completion time, maximum completion time, required processing completion time point, priority and the like. At the same time, at most three files can be operated, and memory overflow caused by excessive file processing is avoided. The files which are most required to be processed and can be rapidly processed are selected for processing by the residual available time, the longest processing time, the average processing time, the priority and the sorting, so that the backlog of a queue is reduced, and the resources are released. The problems of conflict in simultaneous file arrival and insufficient CPU and memory are avoided, resources can be evenly distributed, system processing stability is guaranteed, and the situations of too busy or too idle are avoided.
Based on the same inventive concept, the embodiment of the invention also provides a batch file processing device, as described in the following embodiment. Since the principles of solving the problems are similar to those of the batch document processing method, the implementation of the batch document processing apparatus can refer to the implementation of the method, and the repetition is omitted.
FIG. 4 is a block diagram of a batch document processing apparatus according to an embodiment of the present invention, as shown in FIG. 4, the batch document processing apparatus includes:
The information table obtaining module 401 is configured to obtain a file processing basic information table and a file processing record table, where the file processing basic information table includes a time for processing to be completed and a longest processing time, the file processing record table includes a file arrival time and a file processing state, and the file processing state includes a processing in-progress state and an arrival state;
And the batch file processing module 402 is configured to scan the file processing record table, determine a remaining processing time of each file according to a required processing completion time and a file arrival time corresponding to each file, determine a remaining available time of each file according to the remaining processing time and the longest processing time, and perform batch file processing according to the remaining available time of each file if the file processing state in the file processing record table is the number of in-process states being processed and is less than the preset number.
In one embodiment, batch file processing module 402 is further configured to:
Ranking the remaining available time for the plurality of files;
if the remaining available time of the plurality of files is not equal, the file with the shortest remaining available time is preferentially processed.
In one embodiment, the file processing basic information table further comprises a processing priority;
The batch file processing module 402 is further configured to perform batch file processing according to a processing priority of each file if the remaining available time of the plurality of files is equal, where the file with the highest priority is preferentially processed.
In one embodiment, the file processing basic information table further comprises average processing time;
the batch file processing module 402 is further configured to perform batch file processing according to the average processing time of each file if the remaining available time and the processing priority of the plurality of files are equal, where the file with the shortest average processing time is preferentially processed.
Based on the foregoing inventive concept, as shown in fig. 5, an embodiment of the present invention further provides a computer device 500, including a memory 510, a processor 520, and a computer program 530 stored in the memory 510 and capable of running on the processor 520, where the processor 520 implements the batch file processing method described above when executing the computer program 530.
Based on the foregoing inventive concept, an embodiment of the present invention also provides a computer-readable storage medium storing a computer program which when executed by a processor implements the batch file processing method described above.
The embodiment of the invention also provides a computer program product, which comprises a computer program, and the computer program realizes the batch file processing method when being executed by a processor.
Compared with the technical scheme of carrying out batch file processing by scanning FTP directory files issued by DCDS files every three minutes in the prior art, the embodiment of the invention is characterized in that a file processing basic information table and a file processing record table are obtained, wherein the file processing basic information table comprises a required processing completion time and a longest processing time, the file processing record table comprises a file arrival time, a file processing state comprises a processing in-progress state and an arrival state, the file processing record table is scanned, if the file processing state in the file processing record table is the number of the processing in-progress states which is smaller than the preset number, the file processing state is a plurality of files in the arrival state, the residual processing time of each file is determined according to the required processing completion time and the file arrival time corresponding to each file, the residual available time of each file is determined according to the residual processing time and the longest processing time, and batch file processing is carried out according to the residual available time of each file. According to the embodiment of the invention, the file processing state is analyzed through the file processing basic information table and the file processing record table, if the file processing state in the file processing record table is the number of in-process states being less than the preset number, the residual processing time of each file is determined according to the required processing completion time and the file arrival time corresponding to each file, the residual available time of each file is further determined according to the residual processing time and the longest processing time, batch processing is carried out according to the residual available time, the problems of simultaneous arrival processing conflict of the files, insufficient CPU and memory are avoided, resources can be evenly distributed, the system processing stability is ensured, and the situations of busy or idle are avoided.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing description of the embodiments has been provided for the purpose of illustrating the general principles of the invention, and is not meant to limit the scope of the invention, but to limit the invention to the particular embodiments, and any modifications, equivalents, improvements, etc. that fall within the spirit and principles of the invention are intended to be included within the scope of the invention.
Claims (7)
1. A batch document processing method, comprising:
Obtaining a file processing basic information table and a file processing record table, wherein the file processing basic information table comprises time for completing processing and longest processing time, the file processing record table comprises file arrival time and file processing state, and the file processing state comprises a processing in-progress state and an arrival state;
scanning the file processing record table, if the number of the file processing states in the file processing record table is the number of the in-process states of processing and is smaller than the preset number, determining the remaining processing time of each file according to the required processing completion time and the file arrival time corresponding to each file, determining the remaining available time of each file according to the remaining processing time and the longest processing time, and performing batch file processing according to the remaining available time of each file;
The file processing basic information table also comprises a processing priority;
If the remaining available time of the plurality of files is equal, carrying out batch file processing according to the processing priority of each file, wherein the file with the highest priority is processed preferentially;
The file processing basic information table also comprises average processing time;
and carrying out batch file processing according to the residual available time of each file, and further comprising carrying out batch file processing according to the average processing time of each file if the residual available time and the processing priority of a plurality of files are equal, wherein the file with the shortest average processing time is processed preferentially.
2. The batch document processing method according to claim 1, wherein the batch document processing according to the remaining available time of each document comprises:
Ranking the remaining available time for the plurality of files;
if the remaining available time of the plurality of files is not equal, the file with the shortest remaining available time is preferentially processed.
3. A batch document processing apparatus, comprising:
The information table obtaining module is used for obtaining a file processing basic information table and a file processing record table, wherein the file processing basic information table comprises time for completing processing and longest processing time, the file processing record table comprises file arrival time and file processing state, and the file processing state comprises a processing in-progress state and an arrival state;
The batch file processing module is used for scanning the file processing record table, if the file processing state in the file processing record table is the number of in-process states being less than the preset number, determining the residual processing time of each file according to the required processing completion time and the file arrival time corresponding to each file for a plurality of files with the file processing states being the arrival states, determining the residual available time of each file according to the residual processing time and the longest processing time, and carrying out batch file processing according to the residual available time of each file;
The file processing basic information table also comprises a processing priority;
The batch file processing module is further used for processing batch files according to the processing priority of each file if the residual available time of the files is equal, wherein the files with the highest priority are processed preferentially;
The file processing basic information table also comprises average processing time;
And the batch file processing module is further used for processing the batch files according to the average processing time of each file if the residual available time and the processing priority of the plurality of files are equal, wherein the files with the shortest average processing time are preferentially processed.
4. The batch document processing device of claim 3, wherein the batch document processing module is further to:
Ranking the remaining available time for the plurality of files;
if the remaining available time of the plurality of files is not equal, the file with the shortest remaining available time is preferentially processed.
5. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method of any of claims 1 to 2 when executing the computer program.
6. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program which, when executed by a processor, implements the method of any of claims 1 to 2.
7. A computer program product, characterized in that the computer program product comprises a computer program which, when executed by a processor, implements the method of any of claims 1 to 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210237282.1A CN114610489B (en) | 2022-03-10 | 2022-03-10 | Batch file processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210237282.1A CN114610489B (en) | 2022-03-10 | 2022-03-10 | Batch file processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114610489A CN114610489A (en) | 2022-06-10 |
| CN114610489B true CN114610489B (en) | 2025-04-18 |
Family
ID=81863235
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210237282.1A Active CN114610489B (en) | 2022-03-10 | 2022-03-10 | Batch file processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114610489B (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110222016A (en) * | 2019-05-20 | 2019-09-10 | 平安银行股份有限公司 | A kind of document handling method and device |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3511693B1 (en) * | 2003-03-28 | 2022-08-24 | Inguran, LLC | Apparatus for detecting the breakoff point of a droplet generation system |
| CN107977206B (en) * | 2017-11-14 | 2020-11-27 | 北京思特奇信息技术股份有限公司 | Method and device for processing batch service data files |
| CN110221914B (en) * | 2019-05-20 | 2024-05-17 | 平安银行股份有限公司 | File processing method and device |
| US20210072027A1 (en) * | 2019-09-09 | 2021-03-11 | Caci, Inc. - Federal | Systems and methods for providing localization and navigation services |
| CN111680693A (en) * | 2020-05-28 | 2020-09-18 | 泰康保险集团股份有限公司 | Method and device for batch processing of claim settlement services |
| CN112184138B (en) * | 2020-08-17 | 2024-05-24 | 北京来也网络科技有限公司 | Power grid work order processing method and device combining RPA and AI and electronic equipment |
| CN112131188B (en) * | 2020-09-29 | 2023-11-21 | 中国银行股份有限公司 | Batch file distribution processing method and device |
-
2022
- 2022-03-10 CN CN202210237282.1A patent/CN114610489B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110222016A (en) * | 2019-05-20 | 2019-09-10 | 平安银行股份有限公司 | A kind of document handling method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114610489A (en) | 2022-06-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113535367B (en) | Task scheduling method and related device | |
| CN110648054B (en) | Task parallel processing method and device for robot flow automation | |
| CN106802826B (en) | A thread pool-based business processing method and device | |
| CN112181645B (en) | A method, device, equipment and storage medium for resource scheduling | |
| US7681196B2 (en) | Providing optimal number of threads to applications performing multi-tasking using threads | |
| US20110202504A1 (en) | Backing up objects to a storage device | |
| CN111143331B (en) | Data migration method, device and computer storage medium | |
| CN113010310A (en) | Job data processing method and device and server | |
| CN111858055A (en) | Task processing method, server and storage medium | |
| US8458136B2 (en) | Scheduling highly parallel jobs having global interdependencies | |
| CN112685158A (en) | Task scheduling method and device, electronic equipment and storage medium | |
| CN111258774A (en) | Process processing method, device, computer equipment and storage medium | |
| US9424078B2 (en) | Managing high performance computing resources using job preemption | |
| CN112559179A (en) | Job processing method and device | |
| CN110413393B (en) | Cluster resource management method and device, computer cluster and readable storage medium | |
| CN111143210A (en) | Test task scheduling method and system | |
| TWI554945B (en) | Routine task allocating method and multicore computer using the same | |
| CN115511292B (en) | Production scheduling method, system, intelligent terminal and storage medium | |
| CN106775975B (en) | Process scheduling method and device | |
| CN114610489B (en) | Batch file processing method and device | |
| CN112364005A (en) | Data synchronization method and device, computer equipment and storage medium | |
| CN105786917B (en) | Method and device for concurrent warehousing of time series data | |
| CN107239328B (en) | Task allocation method and device | |
| CN116702225B (en) | Method, system, equipment and medium for fast verifying electronic archive file based on hash parallel computing | |
| CN112150035A (en) | Data processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |