CN112015537A - Method, system, terminal device and storage medium for executing data processing task - Google Patents
Method, system, terminal device and storage medium for executing data processing task Download PDFInfo
- Publication number
- CN112015537A CN112015537A CN202010918728.8A CN202010918728A CN112015537A CN 112015537 A CN112015537 A CN 112015537A CN 202010918728 A CN202010918728 A CN 202010918728A CN 112015537 A CN112015537 A CN 112015537A
- Authority
- CN
- China
- Prior art keywords
- data processing
- processing task
- execution
- task
- executing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/5038—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/5011—Pool
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/548—Queue
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to the technical field of service development, and discloses a method, a system, terminal equipment and a computer storage medium for executing a data processing task, wherein the method comprises the following steps: receiving data processing tasks and detecting target data processing tasks executed by agents in the data processing tasks; carrying out asynchronous persistence processing on the target data processing task to obtain a persistent data processing task; and extracting and executing the persistent data processing task according to the preset delay message. In addition, the invention also relates to a block chain technology, and when the execution of the data processing task fails, the execution strategy according to which the data processing task is repeatedly executed can be stored in the block chain. The invention avoids the phenomenon of error loss of the data processing task caused by the memory problem of the task execution terminal or the error restarting problem of the terminal, and can also realize the delayed execution of the data processing task to simplify the operation of service developers and improve the execution efficiency of the data processing task.
Description
Technical Field
The present invention relates to the field of service development technologies, and in particular, to a method, a system, a terminal device, and a computer storage medium for executing a data processing task.
Background
In the present invention, for a service scenario where a data processing task is executed highly concurrently, asynchronous execution of each data processing task is an indispensable solution, and in addition, there are also rich application scenarios for performing delayed execution of the data processing task.
However, in the existing scheme for implementing asynchronous execution of data processing tasks, the corresponding tasks are typically executed asynchronously based on manually defining a thread pool, so that under the condition of high concurrency of the data processing tasks, due to the pressure of the thread pool in executing the tasks, problems of memory accumulation, even memory overflow, triggering a rejection policy of the thread pool, and the like may exist, thereby causing a loss phenomenon of the data processing tasks. In addition, although the delay processing for implementing task execution based on the increased distributed task scheduling can relieve the pressure of the thread pool to some extent, the pressure of the database is further increased based on the distributed scheduling, and the overall complexity of service development is inevitably increased.
In summary, the conventional method for implementing asynchronous and delayed execution of the data processing task easily causes task loss, and the execution efficiency of the task processing is low.
Disclosure of Invention
The invention mainly aims to provide a method, a system, a terminal device and a computer storage medium for executing a data processing task, and aims to solve the technical problems that the existing mode for realizing asynchronous and delayed execution of the data processing task easily causes task loss and has low execution efficiency on task processing.
In order to achieve the above object, an embodiment of the present invention provides a method for executing a data processing task, where the method for executing the data processing task includes:
receiving data processing tasks and detecting target data processing tasks executed by agents in the data processing tasks;
carrying out asynchronous persistence processing on the target data processing task to obtain a persistent data processing task;
and extracting and executing the persistent data processing task according to the preset delay message.
Preferably, before the step of receiving the data processing tasks and detecting a target data processing task executed by the agent in the data processing tasks, the method further comprises:
generating a task execution agent identifier based on preset agent mechanism configuration so as to add a task execution agent for the data processing task;
the step of receiving data processing tasks and detecting target data processing tasks executed by agents in the data processing tasks includes:
receiving a data processing task and calling the proxy mechanism to detect whether the data processing task carries the task execution proxy identification;
and if so, determining that the data processing task is a target data processing task executed by the agent.
Preferably, the step of performing asynchronous persistence processing on the target data processing task to obtain a persistent data processing task further includes:
converting the target data processing task into format data;
packaging the format data to a delay message queue for asynchronous persistent storage;
and taking the format data which is persistently stored in the delay message queue as a persistent data processing task.
Preferably, the step of extracting and executing the persistent data processing task according to a preset delay message includes:
receiving a preset delay message pushed by the delay message queue in sequence, wherein the persistent data processing task is encapsulated in the preset delay message;
converting the persistent data processing task to obtain a target data processing task;
and acquiring task execution information corresponding to the persistent data processing task, and executing the target data processing task according to the task execution information.
Preferably, after the step of extracting and executing the persistent data processing task according to the preset delay message, the method further includes:
if the persistent data processing task is successfully executed, executing a preset first callback strategy;
if the execution of the persistent data processing task fails, judging whether the persistent data processing task needs to be executed repeatedly;
reading an execution policy to repeatedly execute the persistent data processing task upon determining that repeated execution is required;
and executing the preset second callback strategy when the repeated execution is not needed.
Preferably, the step of reading the execution policy to repeatedly execute the persistent data processing task when it is determined that repeated execution is required comprises:
reading an execution strategy when the repeated execution is determined to be needed, wherein the execution strategy at least comprises a delay strategy;
determining the execution time for repeatedly executing the persistent data processing task according to the delay strategy;
and re-receiving the preset delay message encapsulated with the persistent data processing task at the execution time so as to repeatedly execute the persistent data processing task.
Preferably, the execution policy is stored in a blockchain, and the step of reading the execution policy when it is determined that the execution needs to be repeated includes:
and reading the execution strategy from the block chain when the repeated execution is determined to be needed.
In addition, to achieve the above object, the present invention further provides an execution system of a data processing task, including:
the detection module is used for receiving data processing tasks and detecting target data processing tasks executed by agents in the data processing tasks;
the persistence module is used for carrying out asynchronous persistence processing on the target data processing task to obtain a persistent data processing task;
and the execution module is used for extracting and executing the persistent data processing task according to the preset delay message.
In addition, to achieve the above object, the present invention also provides a terminal device, including: a memory, a processor, a communication bus and an executive of data processing tasks stored on said memory,
the communication bus is used for realizing communication connection between the processor and the memory;
the processor is used for executing the executive program of the data processing task to realize the following steps:
receiving data processing tasks and detecting target data processing tasks executed by agents in the data processing tasks;
carrying out asynchronous persistence processing on the target data processing task to obtain a persistent data processing task;
and extracting and executing the persistent data processing task according to the preset delay message.
Further, to achieve the above object, the present invention also provides a computer storage medium storing one or more programs executable by one or more processors for:
receiving data processing tasks and detecting target data processing tasks executed by agents in the data processing tasks;
carrying out asynchronous persistence processing on the target data processing task to obtain a persistent data processing task;
and extracting and executing the persistent data processing task according to the preset delay message.
The execution method, the execution system, the terminal equipment and the computer-readable storage medium of the data processing task provided by the invention receive the data processing task and detect the target data processing task executed by the agent in the data processing task; carrying out asynchronous persistence processing on the target data processing task to obtain a persistent data processing task; and extracting and executing the persistent data processing task according to the preset delay message.
The invention adds the execution agent aiming at the data processing task under the high concurrency scene, thereby asynchronously carrying out persistence processing aiming at the target data processing task when the received data processing task is the target data processing task executed by the agent, then extracting the persistent data processing task obtained through persistence processing according to the preset delay message pushed by the message queue, and really starting to execute the data processing task.
The invention realizes the persistence processing of the highly concurrent data processing tasks, avoids the phenomenon of error loss of the data processing tasks caused by the memory problem of the terminal for executing the tasks or the error restarting problem of the terminal, and realizes the delayed execution aiming at the data processing tasks by combining the message queue to push the delayed messages, thereby simplifying the operation of service developers, improving the execution efficiency of the data processing tasks, and promoting the execution of the data processing tasks to be better suitable for the highly concurrent service scenes.
Drawings
Fig. 1 is a schematic structural diagram of a hardware operating environment of a terminal device according to a method of an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a method for performing data processing tasks according to an embodiment of the present invention;
FIG. 3 is a functional block diagram of a system for executing data processing tasks according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The main solution of the embodiment of the invention is as follows: receiving data processing tasks and detecting target data processing tasks executed by agents in the data processing tasks; carrying out asynchronous persistence processing on the target data processing task to obtain a persistent data processing task; and extracting and executing the persistent data processing task according to the preset delay message.
Due to the highly concurrent service scenario (for example, after the user successfully places an order, a short message is pushed to the user) for executing the data processing tasks, asynchronous execution of each data processing task is an indispensable solution, and in addition, there are also rich application scenarios (for example, the order to be paid is closed within 30 minutes) for performing the data processing tasks with a delay.
However, the existing scheme for implementing asynchronous execution of data processing tasks is generally based on manually defining a thread pool to execute corresponding tasks asynchronously, or is further based on @ Async annotation encapsulated by using a Spring framework (created due to complexity of software development, Spring uses basic javabeans to complete things that can only be completed by EJBs before), but the bottom layer of the Spring framework still uses the thread pool, so that under the condition of high concurrency of data processing tasks, due to pressure of the thread pool to execute tasks, problems of memory accumulation and even memory overflow, trigger rejection strategies of the thread pool and the like may exist, and further, the data processing tasks are lost, and in addition, under the condition of abnormal restart of a server, all data processing tasks waiting to be executed in a memory are lost.
In addition, although the delay processing for implementing task execution based on the increased distributed task scheduling can relieve the pressure of the thread pool to some extent, the pressure of the database is further increased based on the distributed scheduling, and the overall complexity of service development is inevitably increased.
In summary, the conventional method for implementing asynchronous and delayed execution of the data processing task easily causes task loss, and the execution efficiency of the task processing is low.
The solution provided by the invention is based on adding the execution agent aiming at the data processing task under the high concurrency scene, so that when the received data processing task is the target data processing task executed by the agent, the target data processing task is asynchronously subjected to persistence processing, then the persistent data processing task obtained through persistence processing is extracted according to the preset delay message pushed by the message queue, and the execution of the data processing task is really started.
The invention realizes the persistence processing of the highly concurrent data processing tasks, avoids the phenomenon of error loss of the data processing tasks caused by the memory problem of the terminal for executing the tasks or the error restarting problem of the terminal, and realizes the delayed execution aiming at the data processing tasks by combining the message queue to push the delayed messages, thereby simplifying the operation of service developers, improving the execution efficiency of the data processing tasks, and promoting the execution of the data processing tasks to be better suitable for the highly concurrent service scenes.
As shown in fig. 1, fig. 1 is a schematic device structure diagram of a hardware operating environment of a terminal device according to an embodiment of the present invention.
The terminal equipment of the embodiment of the invention can be an intelligent customer service robot, and can also be terminal equipment such as a PC, a smart phone, a tablet personal computer and a portable computer.
As shown in fig. 1, the terminal device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Optionally, the terminal device may further include a camera, a Radio Frequency (RF) circuit, a sensor, an audio circuit, a WiFi module, and the like. Such as light sensors, motion sensors, and other sensors. In particular, the light sensor may include an ambient light sensor that adjusts the brightness of the display screen based on the ambient light level and a proximity sensor that turns off the display screen and/or backlight when the device is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when the device is stationary, and can be used for applications of recognizing the device posture (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; of course, the mobile terminal may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which are not described herein again.
Those skilled in the art will appreciate that the device architecture shown in fig. 1 does not constitute a limitation of the terminal device, and in other embodiments, the terminal device may include more or fewer components than shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and an execution program of a data processing task.
In the terminal device shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to invoke an executive of the data processing tasks stored in the memory 1005 and perform the following steps:
receiving data processing tasks and detecting target data processing tasks executed by agents in the data processing tasks;
carrying out asynchronous persistence processing on the target data processing task to obtain a persistent data processing task;
and extracting and executing the persistent data processing task according to the preset delay message.
Further, the processor 1001 may be configured to call an execution program of the data processing task stored in the memory 1005, and before executing the received data processing task and detecting a target data processing task executed by the agent in the data processing task, further perform the following steps:
generating a task execution agent identifier based on preset agent mechanism configuration so as to add a task execution agent for the data processing task;
the processor 1001 may be configured to invoke an executive of the data processing tasks stored in the memory 1005, and further perform the steps of:
receiving a data processing task and calling the proxy mechanism to detect whether the data processing task carries the task execution proxy identification;
and if so, determining that the data processing task is a target data processing task executed by the agent.
Further, the processor 1001 may be configured to invoke an executive of the data processing tasks stored in the memory 1005, and further perform the following steps:
converting the target data processing task into format data;
packaging the format data to a delay message queue for asynchronous persistent storage;
and taking the format data which is persistently stored in the delay message queue as a persistent data processing task.
Further, the processor 1001 may be configured to invoke an executive of the data processing tasks stored in the memory 1005, and further perform the following steps:
receiving a preset delay message pushed by the delay message queue in sequence, wherein the persistent data processing task is encapsulated in the preset delay message;
converting the persistent data processing task to obtain a target data processing task;
and acquiring task execution information corresponding to the persistent data processing task, and executing the target data processing task according to the task execution information.
Further, the processor 1001 may be configured to call an executive program of the data processing task stored in the memory 1005, and after executing the persistent data processing task according to the preset latency message, further execute the following steps:
if the persistent data processing task is successfully executed, executing a preset first callback strategy;
if the execution of the persistent data processing task fails, judging whether the persistent data processing task needs to be executed repeatedly;
reading an execution policy to repeatedly execute the persistent data processing task upon determining that repeated execution is required;
and executing the preset second callback strategy when the repeated execution is not needed.
Further, the processor 1001 may be configured to invoke an executive of the data processing tasks stored in the memory 1005, and further perform the following steps:
reading an execution strategy when the repeated execution is determined to be needed, wherein the execution strategy at least comprises a delay strategy;
determining the execution time for repeatedly executing the persistent data processing task according to the delay strategy;
and re-receiving the preset delay message encapsulated with the persistent data processing task at the execution time so as to repeatedly execute the persistent data processing task.
Further, the execution policy is stored in the blockchain, the data-embedded common model is stored in the blockchain, and the processor 1001 may be configured to invoke an execution program of the data processing task stored in the memory 1005, and further perform the following steps:
and reading the execution strategy from the block chain when the repeated execution is determined to be needed.
The specific embodiment of the terminal device related to the method for executing the data processing task of the present invention is substantially the same as each specific embodiment of the method for executing the data processing task described below, and details thereof are not described herein.
The invention provides a method for executing a data processing task.
Referring to fig. 2, fig. 2 is a flowchart illustrating a first embodiment of a method for executing a data processing task according to the present invention, wherein the method for executing the data processing task includes:
step S100, receiving data processing tasks and detecting target data processing tasks executed by agents in the data processing tasks;
the terminal equipment starts to receive data processing tasks continuously generated in a service development scene in the process of starting operation, and then the terminal equipment performs code level detection on the received data processing tasks one by one based on a preset proxy mechanism, so that target data processing tasks executed by the preset proxy mechanism in the received data processing tasks are determined.
It should be noted that, in this embodiment, the preset proxy mechanism may specifically be a proxy mechanism based on a spring frame, so that at a starting stage of the terminal device, the proxy mechanism may scan a code corresponding to a data processing task received by the terminal device, and when a task execution proxy identifier (specifically, a core annotation @ AsyncRun generated based on the spring frame design) exists in some methods where the code corresponds to some types of objects and is configured in advance, it is immediately determined that the data processing task corresponding to the code is a target data processing task executed by the proxy.
Further, in a possible embodiment, before step S100, the method for executing a data processing task according to the present invention may further include:
step S400, generating a task execution agent identifier based on preset agent mechanism configuration so as to add a task execution agent for the data processing task;
it should be noted that, in this embodiment, the task execution agent identifier may specifically be the annotation @ AsyncRun. The service development staff designs a core annotation @ AsyncRun based on a proxy mechanism mature in a spring framework, so that codes of received data processing tasks are scanned in a starting stage of terminal equipment by means of the proxy mechanism of the spring framework, and the annotation @ AsyncRun is detected on some methods (partial codes) of a certain class of objects (data processing tasks), namely the class of objects is confirmed to be proxied.
The terminal equipment receives configuration information input by service development staff, and generates a task execution agent identifier based on a preset agent mechanism, so that a task execution agent is added for a data processing task received by the terminal equipment in a starting stage.
Specifically, for example, a service development worker may design a core annotation @ AsyncRun based on a proxy mechanism mature in a current spring framework, then, the service development worker transmits a design configuration file of the annotation @ AsyncRun to a terminal device, the terminal device receives the design configuration file, and generates the core annotation @ AsyncRun by directly configuring in a proxy mechanism operating the spring framework at a local terminal based on parsing the design configuration file, so that when it is detected that a data processing task carries the annotation @ AsyncRun, a task execution proxy is immediately added to the data processing task by the proxy mechanism of the spring framework.
Further, in a possible embodiment, the step S100 of receiving the data processing task and detecting the target data processing task executed by the agent in the data processing task may include:
step S101, receiving a data processing task and calling the proxy mechanism to detect whether the data processing task carries the task execution proxy identification;
the terminal equipment carries out scanning detection of a code layer aiming at the received data processing task based on calling an agent mechanism operated by a local terminal in a starting stage so as to detect whether a code corresponding to the data processing task carries a task execution agent identifier which is configured and generated in advance.
And step S102, if yes, determining that the data processing task is a target data processing task executed by the agent.
If the terminal device scans and detects that a code corresponding to the data processing task received by the terminal device at the starting stage carries a task execution agent identifier which is generated in a pre-configuration mode through calling a proxy mechanism operated by the terminal device, the terminal device immediately determines the current data processing task as a target data processing task of a proxy execution task with the proxy mechanism.
Specifically, for example, in a high-concurrency service scene where the terminal device is located, scanning detection of a code layer is performed on a data processing task received by the terminal device at a starting stage through an agent mechanism of a spring frame operated at a local terminal, so that when the agent mechanism of the spring frame detects that a pre-configured generated annotation @ AsyncRun exists in a code corresponding to the data processing task currently received by the terminal device, it is immediately determined that the data processing task currently received by the terminal device is a target data processing task of task execution agent performed by the agent mechanism of the spring frame.
Further, in another possible embodiment, if the proxy mechanism of the spring framework detects that the pre-configured generated annotation @ AsyncRun does not exist in the code corresponding to the data processing task currently received by the terminal device, the terminal device may skip determining the currently received data processing task as a target data processing task for performing task execution proxy by the proxy mechanism of the spring framework.
Step S200, carrying out asynchronous persistence processing on the target data processing task to obtain a persistent data processing task;
after the terminal device determines the target data processing task executed by the preset proxy mechanism in the received data processing tasks through the preset proxy mechanism, the terminal device immediately enters an asynchronous stage, the target data processing task is added into a delay message queue in the asynchronous stage, asynchronous persistence processing aiming at the target data processing task is achieved by asynchronously pushing a delay message based on the delay message queue, and then the target data processing task persistently stored in the delay message queue is marked as a persistent data processing task by the terminal device.
It should be noted that, in this embodiment, the delay message queue may specifically be a rocktmq message queue, where the rocktmq is a message middleware of a queue model, and has the characteristics of high performance, high reliability, high real-time performance, and distributed performance. In a high-concurrency service scene where a terminal device is located, if a target data processing task which is received by the terminal device and has been subjected to persistence processing is called, if an agent mechanism of a spring frame immediately starts to take effect, at this time, the agent mechanism is not a real method logic for executing the target data processing task, but is based on that the terminal device is used as a delayer to schedule the target data processing task, namely, the terminal device firstly generates a context (target data processing task) which comprises class objects, methods, entries, execution time, whether delay is needed, a delay policy, a retry policy and other information, then the terminal device serializes a protocol into binary data based on kryo (a fast serialization/deserialization tool which uses a byte code generation mechanism (the bottom layer depends on an ASM library) and therefore has a relatively good operation speed), finally, the terminal device packages the serialized binary data into a rocketmq message and pushes the message out, and when pushing the rocketmq message, the terminal device sends the delay message synchronously according to whether the target data processing task actually needs delay processing (for example, when the target data processing task fails to be executed for the first time, the target data processing task needs to be executed repeatedly according to the generated delay strategy).
Further, in a possible embodiment, the step S200 may include:
step S201, converting the target data processing task into format data;
it should be noted that, in this embodiment, the format data may specifically be binary data, and based on different design requirements of practical applications, in other embodiments, data of other binary types or other data types may also be used, and it should be understood that the execution method of the data processing task of the present invention is not specifically limited to the type of the format data.
The proxy mechanism becomes effective when the target processing task is invoked, whereby the proxy mechanism generates a context based on the target data processing task with the terminal device as a delay, and then serializes the context protocol into binary data.
Specifically, for example, in a high-concurrency service scenario where the terminal device is located, if a target data processing task that is received by the terminal device and has been subjected to persistence processing is called, if an agent mechanism of the spring framework immediately starts to take effect, at this time, the agent mechanism is not a real method logic for executing the target data processing task, but schedules the target data processing task based on that the terminal device serves as a delayer, that is, the terminal device first generates a context (target data processing task) including information such as a class object, a method, an entry parameter, an execution time, whether a delay is needed, a delay policy, a retry policy, and the like, and then the terminal device serializes the context protocol into binary data based on a kryo serialization protocol.
Step S202, packaging the format data to a delay message queue for asynchronous persistent storage;
step S203, the format data which is stored in the delay message queue persistently is taken as a persistent data processing task.
After the terminal device serializes the context generated based on the target data processing task into binary data, the terminal device further encapsulates the binary data as a delay message to be added into a delay message queue, so that the delay message is asynchronously pushed based on the delay message queue to realize asynchronous persistent storage of the binary data, and then the terminal device takes the binary data persistently stored in the delay message queue as a persistent data processing task.
Specifically, for example, after the spring architecture-based proxy mechanism serializes the context generated based on the target data processing task into binary data by using the terminal device as a delayer, the terminal device encapsulates the binary data into a rocktmq message to add the binary data into a rocktmq message queue, and asynchronously pushes the rocktmq message based on the rocktmq message queue to implement asynchronous persistent storage for the binary data. Then, the terminal device serving as a delayer marks the binary data persistently stored in the pocket tmq message queue as a persistent data processing task obtained through persistence processing.
And step S300, extracting and executing the persistent data processing task according to the preset delay message.
The method comprises the steps that a terminal device adds a target data processing task into a delay message queue in an asynchronous stage, after asynchronous persistence processing aiming at the target data processing task is realized by asynchronously pushing a delay message based on the delay message queue, the terminal device immediately enters an execution stage of the data processing task, receives a preset delay message asynchronously pushed by the delay message queue in the execution stage, deserializes the preset delay message and marks the task as the persistent data processing task to obtain the context of the target data processing task, and then starts to really execute the target data processing task by reading task execution information of the target data processing task and according to the task execution information.
It should be noted that, in this embodiment, the preset delay message may specifically be a rocktmq message, and a terminal device serving as a delay device subscribes in advance a topic (theme, rule) of a rocktmq message queue to asynchronously send the rocktmq message, so that the terminal device may receive the rocktmq message, which is pushed by the rocktmq message queue and is encapsulated with binary data obtained by protocol serialization, in time, after receiving the rocktmq message, the terminal device obtains a context generated in advance based on a target data processing task based on deserialization, reads a class object, a method, and an entry parameter to be executed when the target data processing task is executed in the context, and starts to actually execute a service code (i.e., execute the target data processing task).
Further, in a possible embodiment, the step S300 may include:
step S301, receiving a preset delay message pushed by the delay message queue in sequence, wherein the persistent data processing task is encapsulated in the preset delay message;
step S302, converting the persistent data processing task to obtain a target data processing task;
step S303, acquiring task execution information corresponding to the persistent data processing task, and executing the target data processing task according to the task execution information.
The method comprises the steps of persistently storing a delay message queue of a target data processing task, packaging format data corresponding to the target data processing task in a preset delay message, asynchronously sending the preset delay message according to the sequence of accessing the format data by each queue, and receiving the preset delay message by a terminal device to analyze to obtain the target data processing task.
After receiving the preset delay message asynchronously pushed by the delay message queue, the terminal device performs deserialization on format data which is encapsulated in the preset delay message and marked as a persistent data processing task, so as to obtain a context generated in advance based on a target data processing task.
After the terminal device obtains the context generated based on the target data processing task by performing deserialization on the format data encapsulated in the preset delay message, the terminal device reads task execution information such as a class object, a method and a parameter from the context to execute the target data processing task, and then the terminal device starts executing the information according to the task to really execute the target data processing task.
It should be noted that, in this embodiment, the task execution information includes, but is not limited to: class objects, methods, entries, execution time, whether a deferral is needed, deferral policy, and retry policy.
In this embodiment, the terminal device starts to receive data processing tasks continuously generated in a service development scene during the process of starting operation, and then performs code level detection on the received data processing tasks one by one based on a preset proxy mechanism, so as to determine a target data processing task executed by the preset proxy mechanism in the received data processing tasks; after the terminal device determines a target data processing task executed by a preset proxy mechanism in the received data processing tasks through the preset proxy mechanism, the terminal device immediately enters an asynchronous stage, the target data processing task is added into a delay message queue in the asynchronous stage, asynchronous persistence processing aiming at the target data processing task is realized by asynchronously pushing a delay message based on the delay message queue, and then the terminal device marks the target data processing task persistently stored in the delay message queue as a persistent data processing task; the method comprises the steps that a terminal device adds a target data processing task into a delay message queue in an asynchronous stage, after asynchronous persistence processing aiming at the target data processing task is realized by asynchronously pushing a delay message based on the delay message queue, the terminal device immediately enters an execution stage of the data processing task, receives a preset delay message asynchronously pushed by the delay message queue in the execution stage, deserializes the preset delay message and marks the task as the persistent data processing task to obtain the context of the target data processing task, and then starts to really execute the target data processing task by reading task execution information of the target data processing task and according to the task execution information.
The invention realizes that the execution agent is added based on the data processing task under the high concurrency scene, so that when the received data processing task is the target data processing task executed by the agent, the target data processing task is asynchronously subjected to persistence processing, then the persistent data processing task obtained through persistence processing is extracted according to the preset delay message pushed by the message queue, and the execution of the data processing task is really started. Therefore, the invention carries out persistence processing on the highly concurrent data processing task, avoids the phenomenon of error loss of the data processing task caused by the memory problem of the terminal for executing the task or the error restarting problem of the terminal, and in addition, realizes the delay execution aiming at the data processing task by combining the message queue to push the delay message, simplifies the operation of service developers, improves the execution efficiency of the data processing task, and promotes the execution of the data processing task to be better suitable for the highly concurrent service scene.
Further, on the basis of the first embodiment of the method for executing a data processing task of the present invention, a second embodiment of the method for executing a data processing task is provided, in this embodiment, after the step S300 extracts and executes the persistent data processing task according to the preset delay message, the method for executing a data processing task of the present invention may further include:
step 500, if the persistent data processing task is successfully executed, executing a preset first callback strategy;
it should be noted that, in this embodiment, the preset first callback policy is a callback policy executed based on a successful callback function after the data processing task is successfully executed. In addition, executing the callback policy based on the successful callback function is a mature technical operation in the field, and therefore, the content of the callback policy executed by the terminal device according to the successful callback function will not be described again in this embodiment.
And when the terminal equipment finishes executing the target data processing task according to the task execution information, the terminal equipment immediately detects the execution condition of the target data processing task, and if the task is successfully executed, the terminal equipment further detects a successful callback function to execute a callback strategy.
Specifically, for example, after the terminal device executes the target data processing task according to the task execution information such as the class object, the method, the entry parameter, and the like, if the terminal device detects that the target data processing task is successfully executed, the terminal device starts to further detect whether a successful callback function exists, so that the terminal device executes the callback policy based on the successful callback function when detecting that the successful callback function exists.
Further, in another possible embodiment, if the terminal device does not detect that a successful callback function exists when further detecting whether the successful callback function exists, the terminal device immediately stops executing the callback function.
Step S600, if the execution of the persistent data processing task fails, judging whether the persistent data processing task needs to be executed repeatedly;
when the terminal device finishes executing the target data processing task according to the task execution information, if the terminal device detects that the task is failed to execute by detecting the execution condition of the target data processing task, the terminal device starts to further detect an abnormal strategy and a retry strategy corresponding to the target data processing task to judge whether repeated execution needs to be carried out on the target data processing task.
It should be noted that, in this embodiment, the exception policy and the retry policy corresponding to the target data processing task may be specifically generated by the terminal device synchronously according to the configuration file input by the service development worker when generating the context based on the target data processing task.
Specifically, for example, after the terminal device executes the target data processing task according to the task execution information such as the class object, the method, and the entry parameter, if the terminal device detects that the target data processing task fails to execute, the terminal device starts to further detect an exception output by the target data processing task when the task fails to execute, then determines that retry is required based on the exception and an exception policy corresponding to the target data processing task, if it determines that retry is required, the terminal device continues to detect a retry policy in the context of the target data processing task to determine whether the number of retries for the target data processing task has reached an upper limit, and thus, when it is detected that the number of retries has not reached the upper limit, it is determined that repeat execution needs to be performed for the target data processing task.
In addition, if the terminal device determines that retry is not required based on the exception output by the target data processing task when the task fails to be executed and the exception policy corresponding to the target data processing task, or if the terminal device determines that retry is required but the number of retries for the target data processing task has reached the upper limit, the terminal device may determine that it is not necessary to execute the target data processing task repeatedly.
Step S700, when the repeated execution is judged to be needed, reading an execution strategy to repeatedly execute the persistent data processing task;
when the terminal equipment judges that the repeated execution is needed to be carried out aiming at the target data processing task, the terminal equipment reads the execution strategy corresponding to the target data processing task, and encapsulates the format data marked as the persistent data processing task into the delay message again by the delay message queue according to the execution strategy and carries out asynchronous pushing so as to realize the repeated execution aiming at the target data processing task.
It should be noted that, in this embodiment, the execution policy corresponding to the target data processing task at least includes a delay policy, and the delay policy may be generated synchronously with the configuration file input by the service development worker when the terminal device generates the context based on the target data processing task, where in the delay policy generated by the terminal device, the delay time interval may be increased by default along with the increase of the number of execution failures of the current data processing task.
Further, in a possible embodiment, the step S700 may include:
step S701, reading an execution strategy when repeated execution is determined to be needed, wherein the execution strategy at least comprises a delay strategy;
it should be noted that, in this embodiment, in order to ensure that the execution policy generated by the terminal device based on the configuration file input by the service development staff is not erroneously modified or removed, the generated execution policy may be synchronously stored in a node of a block chain, so as to ensure not only the stability of the execution policy, but also the response aggressiveness in the subsequent reading of the execution policy, and the accuracy of repeatedly executing the target data processing task by using the execution policy, thereby further improving the overall efficiency of task execution.
Further, the step S701 includes:
step S7011, when it is determined that the execution needs to be repeated, reads the execution policy from the block chain.
Specifically, for example, when the terminal device determines that retry is required based on an exception thrown when the execution of the target data processing task fails and an exception policy corresponding to the target data processing task, but detects a retry policy in the context of the target data processing task and determines that the number of retries for the target data processing task has not reached the upper limit, so as to determine that repeated execution is also required for the target data processing task, the terminal device synchronizes from nodes of a block chain pre-specified by a service developer, and extracts an execution policy generated in advance by the terminal device based on a configuration file input by the service developer.
Step S702, determining the execution time for repeatedly executing the persistent data processing task according to the delay strategy;
it should be noted that, in this embodiment, because the terminal device defaults that the delay time interval is increased along with the increase of the number of times of execution failure of the target data processing task when generating the execution policy-delay policy based on the configuration file input by the service development staff, after obtaining the delay policy corresponding to the target data processing task by reading, the terminal device needs to further match the delay time interval corresponding to the current number of times from the delay policy according to the number of times of current execution failure of the target data processing task, and then increase the delay time interval in the current time to determine the execution time for repeatedly executing the target data processing task.
Step S702, re-receiving the preset delay message encapsulated with the persistent data processing task at the execution time to repeatedly execute the persistent data processing task.
When detecting that the current time reaches the determined execution time for repeatedly executing the target data processing task, the terminal device generates a context based on the target data processing task again, then serializes the context protocol into binary data, packages the binary data to a delay message by a delay message queue to perform pushing based on asynchronization, so that the terminal device performs deserialization on the binary data carried in the delay message after receiving the delay message to obtain the context, and further reads task execution information to actually start executing the target data processing task corresponding to the context again.
And step S800, executing a preset second callback strategy when the repeated execution is not needed.
It should be noted that, in this embodiment, after the second callback policy is preset as a callback policy executed by the data processing task, the terminal device executes the callback policy based on the failed callback function when determining that the terminal device does not need to execute repeatedly on the data processing task. In addition, executing the callback policy based on the failure callback function is a mature technical operation in the field, and therefore, the content of returning to the function execution callback policy by the terminal device according to the failure will not be described in this embodiment again.
When the terminal equipment finishes executing the target data processing task according to the task execution information, the terminal equipment immediately detects the execution condition of the target data processing task, and if the task fails to be executed and the terminal equipment further judges that the target data processing task does not need to be executed repeatedly, the terminal equipment detects a failure callback function to execute a callback strategy.
Specifically, for example, after the terminal device executes the target data processing task according to the task execution information such as the class object, the method, the entry parameter, and the like, if the terminal device detects that the target data processing task fails to be executed, and the terminal device determines that retry is not required based on the abnormality output by the target data processing task when the task fails to be executed and the abnormality policy corresponding to the target data processing task, that is, after it is determined that repeated execution is not required for the target data processing task, the terminal device detects whether a failure callback function exists, so that the terminal device executes the callback policy based on the failure callback function when detecting that the failure callback function exists.
Further, in another possible embodiment, if the terminal device further detects whether there is a failed callback function, and does not detect that there is the failed callback function, the terminal device immediately stops executing the callback policy.
In the embodiment, when the terminal device finishes executing the target data processing task according to the task execution information, the terminal device immediately detects the execution condition of the target data processing task, and if the task is successfully executed, the terminal device further detects a successful callback function to execute a callback strategy; if the terminal device detects that the task execution fails, the terminal device starts to further detect an abnormal strategy and a retry strategy corresponding to the target data processing task to judge whether repeated execution needs to be carried out on the target data processing task; when the terminal equipment judges that the repeated execution is needed to be carried out aiming at the target data processing task, the terminal equipment reads the execution strategy corresponding to the target data processing task, and encapsulates the format data marked as the persistent data processing task into the delay message and asynchronously pushes the delay message again by the delay message queue according to the execution strategy so as to realize the repeated execution aiming at the target data processing task; in addition, when the terminal device judges that repeated execution is not needed for the target data processing task, the terminal device detects a failure callback function to execute a callback strategy.
The method and the device have the advantages that the service development staff can define the success and/or failure callback function independently, so that the callback is carried out when the execution data processing task is successful or failed, in addition, the service development staff can also define the execution strategies such as abnormity, retry and delay independently, so that the data processing task can be determined to be executed repeatedly automatically when the execution data processing task is failed, the operation of the service development staff is simplified to a great extent, and the overall execution efficiency of the data processing task is further improved.
In addition, the present invention also provides an execution system of a data processing task, please refer to fig. 3, fig. 3 is a functional module schematic diagram of the execution system of the data processing task of the present invention, and the execution system of the data processing task includes:
the detection module 101 is configured to receive a data processing task and detect a target data processing task executed by an agent in the data processing task;
the persistence module 102 is configured to perform asynchronous persistence processing on the target data processing task to obtain a persistent data processing task;
and the execution module 103 is configured to extract and execute the persistent data processing task according to a preset delay message.
Preferably, the system for executing a data processing task of the present invention further includes:
the proxy adding module is used for generating a task execution proxy identifier based on preset proxy mechanism configuration so as to add a task execution proxy for the data processing task;
a detection module 101 comprising:
a code detection unit, configured to receive a data processing task and call the proxy mechanism to detect whether the data processing task carries the task execution proxy identifier;
a first determining unit, configured to determine that the data processing task is a target data processing task executed by an agent.
Preferably, the persistence module 102, comprises:
the first conversion unit is used for converting the target data processing task into format data;
the encapsulation storage unit is used for encapsulating the format data to a delay message queue for asynchronous persistent storage;
and the marking unit is used for taking the format data which is persistently stored in the delay message queue as a persistent data processing task.
Preferably, the execution module 103 includes:
a receiving unit, configured to receive a preset delay message pushed by the delay message queue in sequence, where the persistent data processing task is encapsulated in the preset delay message;
the second conversion unit is used for converting the persistent data processing task to obtain a target data processing task;
and the execution unit is used for acquiring task execution information corresponding to the persistent data processing task and executing the target data processing task according to the task execution information.
Preferably, the system for executing a data processing task of the present invention further includes:
the first callback module is used for executing a preset first callback strategy if the persistent data processing task is successfully executed;
the judging module is used for judging whether repeated execution is needed or not if the execution of the persistent data processing task fails;
the repeated execution module is used for reading the execution strategy to repeatedly execute the persistent data processing task when the repeated execution is judged to be needed;
and the second callback module is used for executing a preset second callback strategy when the second callback module judges that repeated execution is not needed.
Preferably, the repeatedly executing module includes:
the reading unit is used for reading an execution strategy when the repeated execution is judged to be needed, wherein the execution strategy at least comprises a delay strategy;
a second determining unit, configured to determine, according to the delay policy, an execution time for repeatedly executing the persistent data processing task;
and the repeated execution unit is used for re-receiving the preset delay message encapsulated with the persistent data processing task at the execution time so as to repeatedly execute the persistent data processing task.
Preferably, the execution policy is stored in a blockchain, and the reading unit of the repeated execution module of the execution system of the data processing task of the present invention is further configured to read the execution policy from the blockchain when it is determined that repeated execution is required.
Furthermore, the present invention also provides a computer storage medium storing one or more programs, the one or more programs further executable by one or more processors for:
receiving data processing tasks and detecting target data processing tasks executed by agents in the data processing tasks;
carrying out asynchronous persistence processing on the target data processing task to obtain a persistent data processing task;
and extracting and executing the persistent data processing task according to the preset delay message.
Further, the one or more programs are also executable by the one or more processors to:
and generating a task execution agent identifier based on preset agent mechanism configuration so as to add a task execution agent for the data processing task.
Further, the one or more programs are also executable by the one or more processors to:
if the persistent data processing task is successfully executed, executing a preset first callback strategy;
if the execution of the persistent data processing task fails, judging whether the persistent data processing task needs to be executed repeatedly;
reading an execution policy to repeatedly execute the persistent data processing task upon determining that repeated execution is required;
and executing the preset second callback strategy when the repeated execution is not needed.
Further, the one or more programs are also executable by the one or more processors to:
reading an execution strategy when the repeated execution is determined to be needed, wherein the execution strategy at least comprises a delay strategy;
determining the execution time for repeatedly executing the persistent data processing task according to the delay strategy;
and re-receiving the preset delay message encapsulated with the persistent data processing task at the execution time so as to repeatedly execute the persistent data processing task.
Further, the execution policy is stored in a blockchain, the one or more programs further executable by the one or more processors to:
and reading the execution strategy from the block chain when the repeated execution is determined to be needed.
The specific implementation of the computer storage medium of the present invention is substantially the same as the embodiments of the data processing task executing method, and is not described herein again.
It should be noted that the blockchain in the present invention is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, consensus mechanism, and encryption algorithm. A block chain (Blockchain), which is essentially a decentralized database, is a series of data blocks associated by using a cryptographic method, and each data block contains information of a batch of network transactions, so as to verify the validity (anti-counterfeiting) of the information and generate a next block. The blockchain may include a blockchain underlying platform, a platform product service layer, an application service layer, and the like. Further, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. An execution method of a data processing task, the execution method of the data processing task comprising:
receiving data processing tasks and detecting target data processing tasks executed by agents in the data processing tasks;
carrying out asynchronous persistence processing on the target data processing task to obtain a persistent data processing task;
and extracting and executing the persistent data processing task according to the preset delay message.
2. The method of executing a data processing task of claim 1, wherein prior to the steps of receiving a data processing task and detecting a target data processing task of the data processing task that is executed by an agent, the method further comprises:
generating a task execution agent identifier based on preset agent mechanism configuration so as to add a task execution agent for the data processing task;
the step of receiving data processing tasks and detecting target data processing tasks executed by agents in the data processing tasks includes:
receiving a data processing task and calling the proxy mechanism to detect whether the data processing task carries the task execution proxy identification;
and if so, determining that the data processing task is a target data processing task executed by the agent.
3. The method of performing a data processing task according to claim 1, wherein the step of performing asynchronous persistence processing on the target data processing task to obtain a persistent data processing task further comprises:
converting the target data processing task into format data;
packaging the format data to a delay message queue for asynchronous persistent storage;
and taking the format data which is persistently stored in the delay message queue as a persistent data processing task.
4. The method of claim 3, wherein said step of extracting and executing said persistent data processing task based on a predetermined delay message comprises:
receiving a preset delay message pushed by the delay message queue in sequence, wherein the persistent data processing task is encapsulated in the preset delay message;
converting the persistent data processing task to obtain a target data processing task;
and acquiring task execution information corresponding to the persistent data processing task, and executing the target data processing task according to the task execution information.
5. The method of performing a data processing task of claim 1, wherein after the step of extracting and performing the persistent data processing task according to a preset latency message, the method further comprises:
if the persistent data processing task is successfully executed, executing a preset first callback strategy;
if the execution of the persistent data processing task fails, judging whether the persistent data processing task needs to be executed repeatedly;
reading an execution policy to repeatedly execute the persistent data processing task upon determining that repeated execution is required;
and executing the preset second callback strategy when the repeated execution is not needed.
6. The method of executing a data processing task according to claim 5, wherein the step of reading an execution policy to repeatedly execute the persistent data processing task when it is determined that repeated execution is required comprises:
reading an execution strategy when the repeated execution is determined to be needed, wherein the execution strategy at least comprises a delay strategy;
determining the execution time for repeatedly executing the persistent data processing task according to the delay strategy;
and re-receiving the preset delay message encapsulated with the persistent data processing task at the execution time so as to repeatedly execute the persistent data processing task.
7. The method of claim 6, wherein the execution policy is stored in a blockchain, and wherein the step of reading the execution policy when it is determined that repeated execution is required comprises:
and reading the execution strategy from the block chain when the repeated execution is determined to be needed.
8. A system for executing a data processing task, the system comprising:
the detection module is used for receiving data processing tasks and detecting target data processing tasks executed by agents in the data processing tasks;
the persistence module is used for carrying out asynchronous persistence processing on the target data processing task to obtain a persistent data processing task;
and the execution module is used for extracting and executing the persistent data processing task according to the preset delay message.
9. A terminal device, characterized in that the terminal device comprises: a memory, a processor, a communication bus and an executive of data processing tasks stored on said memory,
the communication bus is used for realizing communication connection between the processor and the memory;
the processor is used for executing the executing program of the internet-based data processing task to realize the steps of the executing method of the data processing task according to any one of claims 1 to 7.
10. A computer storage medium, characterized in that the computer storage medium has stored thereon an execution program of a data processing task, which when executed by a processor implements the steps of the execution method of the data processing task according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010918728.8A CN112015537A (en) | 2020-09-03 | 2020-09-03 | Method, system, terminal device and storage medium for executing data processing task |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010918728.8A CN112015537A (en) | 2020-09-03 | 2020-09-03 | Method, system, terminal device and storage medium for executing data processing task |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112015537A true CN112015537A (en) | 2020-12-01 |
Family
ID=73515815
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010918728.8A Pending CN112015537A (en) | 2020-09-03 | 2020-09-03 | Method, system, terminal device and storage medium for executing data processing task |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112015537A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113296898A (en) * | 2021-05-26 | 2021-08-24 | 北京京东振世信息技术有限公司 | Asynchronous task processing method and device, electronic equipment and storage medium |
| CN114020464A (en) * | 2021-11-05 | 2022-02-08 | 江苏安超云软件有限公司 | Method, device and storage medium for dynamically processing virtualized resources |
| CN116861200A (en) * | 2023-09-05 | 2023-10-10 | 中国民航信息网络股份有限公司 | Block chain-based luggage data processing method, device and equipment |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019196244A1 (en) * | 2018-04-10 | 2019-10-17 | 平安科技（深圳）有限公司 | Real-time order callback method and system |
| CN111104235A (en) * | 2019-12-06 | 2020-05-05 | 江苏苏宁物流有限公司 | Queue-based asynchronous processing method and device for service requests |
-
2020
- 2020-09-03 CN CN202010918728.8A patent/CN112015537A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019196244A1 (en) * | 2018-04-10 | 2019-10-17 | 平安科技（深圳）有限公司 | Real-time order callback method and system |
| CN111104235A (en) * | 2019-12-06 | 2020-05-05 | 江苏苏宁物流有限公司 | Queue-based asynchronous processing method and device for service requests |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113296898A (en) * | 2021-05-26 | 2021-08-24 | 北京京东振世信息技术有限公司 | Asynchronous task processing method and device, electronic equipment and storage medium |
| CN113296898B (en) * | 2021-05-26 | 2024-05-17 | 北京京东振世信息技术有限公司 | Asynchronous task processing method and device, electronic equipment and storage medium |
| CN114020464A (en) * | 2021-11-05 | 2022-02-08 | 江苏安超云软件有限公司 | Method, device and storage medium for dynamically processing virtualized resources |
| CN114020464B (en) * | 2021-11-05 | 2022-11-01 | 江苏安超云软件有限公司 | Method, device and storage medium for dynamically processing virtualized resources |
| CN116861200A (en) * | 2023-09-05 | 2023-10-10 | 中国民航信息网络股份有限公司 | Block chain-based luggage data processing method, device and equipment |
| CN116861200B (en) * | 2023-09-05 | 2023-12-29 | 中国民航信息网络股份有限公司 | Block chain-based luggage data processing method, device and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7734583B2 (en) | Transparent virtual machine for mobile applications | |
| US7920852B2 (en) | Compression of data transmitted between server and mobile device | |
| CN109558290B (en) | Server, interface automatic test method and storage medium | |
| CN112015537A (en) | Method, system, terminal device and storage medium for executing data processing task | |
| US20030060896A9 (en) | Software, devices and methods facilitating execution of server-side applications at mobile devices | |
| CN107729014B (en) | Page jump method and structure based on Android | |
| CN114640727B (en) | Protocol analysis method, device and computer readable storage medium | |
| CN112019609B (en) | Equipment monitoring method, device, equipment and computer medium based on Internet of things | |
| CN113168332A (en) | Data processing method and device and mobile terminal | |
| CN114168460A (en) | Remote debugging method, device and storage medium for front-end code in hybrid development | |
| CN113179269B (en) | Protocol data analysis method, system and medium based on Internet of things | |
| CN112954717A (en) | Household appliance network distribution method and device based on H5 page | |
| KR101117165B1 (en) | Web platform unit for mobile terminal connectioned web-application program in heterogeneous operating system | |
| US7784048B2 (en) | Mobile communication terminal and application control method | |
| CN114706621B (en) | Method for starting fast application and related device | |
| CN101964742B (en) | Method, system and device for using network open ability | |
| CN110839079B (en) | BI node execution method, device, equipment and medium in workflow system | |
| CN108984375B (en) | Content capture method, device and system and storage medium | |
| CN111427770B (en) | Resource testing method and related equipment | |
| CN114064429A (en) | Audit log acquisition method and device, storage medium and server | |
| CN117724726B (en) | Data processing method and related device | |
| CN115905272B (en) | Automatic index updating method, automatic index updating device, equipment and medium | |
| CN113032010B (en) | Command transmission control method, terminal and computer readable storage medium | |
| CN113934618A (en) | Interface test case generation method, device, generator and readable storage medium | |
| CN113279154B (en) | Instruction execution method and device of sewing equipment, terminal equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |