CN103617493B - A kind of task processing method and device - Google Patents

Abstract

The present application provides a task processing method and device. Firstly, the real-time data and/or data processing results in the real-time processing module are used to analyze the data conversion and intelligent analysis modules to obtain the analysis results, and then the obtained analysis results are used as real-time The reference value of the processing module is returned to the real-time processing module for use when the real-time processing module processes data, so that real-time processing and intelligent analysis can carry out effective scheduling and data interaction, thereby ensuring intelligent power consumption in multiple time scales and business scenarios. Timeliness and accuracy in the process.

Description

Method and device for task processing

technical field

The present application relates to the technical field of smart grid, in particular to a task processing method and device.

Background technique

Smart power consumption is an important pillar and one of the six major links in building a strong smart grid. It is the basis and physical carrier for realizing various functions of a strong smart grid, and it is the focus and foothold of building a strong smart grid.

According to different business scenarios and time scales, smart power consumption is divided into two data processing methods: real-time processing and intelligent analysis. Real-time processing is dedicated to the processing of real-time data and event streams, ensuring the immediacy of processing, and is applicable to the field of smart power consumption. Online event monitoring and real-time decision-making services; intelligent analysis focuses on the high-level mining of massive historical data. Due to the complexity of its analysis, it often takes a certain amount of time to complete the analysis, which is suitable for post-event diagnosis processing and in-depth utilization services in the field of intelligent power consumption.

It is also because real-time processing generally supports complex online detection, analysis and real-time decision-making on multi-event information flow, and cannot make full use of the potential knowledge of historical data. However, when an intelligent analysis system performs business processing, due to the large amount of data and complex algorithms, its The corresponding analysis and processing time is long, and it cannot be displayed immediately upon request, resulting in the inability to perform effective scheduling and data interaction between the two, which in turn cannot guarantee the timeliness and accuracy of smart power consumption in multi-time scales and in the process of business scenario processing.

Contents of the invention

In view of this, the embodiment of the present application provides a task processing method and device to solve the problem that in the process of intelligent power consumption in the prior art, real-time processing and intelligent analysis cannot perform effective scheduling and data interaction, which leads to the inability to ensure the intelligent power consumption in multiple Issues of time scale and timeliness and accuracy in the processing of business scenarios.

In order to achieve the above objectives, the technical solutions provided in the embodiments of the present application are as follows:

A task processing method, comprising:

In response to the task request signal, the original data corresponding to the task request signal is respectively obtained from the first database and/or the second database, wherein the first database is used to store real-time data, and the real-time data is processed immediately The data sent by the terminal acquisition device received by the module in real time, the second database is used to store the data processing results in the instant processing module;

Converting the original data into target data to control the intelligent analysis module to analyze the target data according to the algorithm corresponding to the task request signal to obtain an analysis result, wherein the target data conforms to the intelligent analysis module Algorithm requirements of the algorithm corresponding to the task request signal in

The analysis result is used as a reference value of the immediate processing module, and returned to the instant processing module.

Preferably, the task configuration file is preset, and the task configuration file includes at least one task and attributes related to each task, the attributes include task running time,

The method also includes:

Judging one by one whether the task running time in the attributes of each task in the task configuration file is the same as the current running time of the system;

When the task running time of the existing task is the same as the current running time of the system, a task request signal corresponding to the task is sent.

Preferably, the attributes include task priority,

The method also includes:

When there are at least two tasks whose task running time is the same as the current system running time, a task request signal corresponding to a task with a higher task priority is sent.

Preferably, the original data is converted into purpose data, wherein the purpose data meets the algorithm requirements of the algorithm corresponding to the task request signal in the intelligent analysis module, including:

According to the algorithm requirements of the algorithm corresponding to the task request signal in the intelligent analysis module, the original data is summarized and filtered to generate the target data.

Preferably, the generation process of the first database is:

Set a task in the task configuration file, and attributes related to the task, the attributes include task running time and task running frequency corresponding to the storage space of the immediate processing module;

According to the task running time and the task running frequency, the real-time data in the instant processing module is obtained; the real-time data is the data sent in real time by the terminal acquisition device received by the instant processing module;

The acquired real-time data is stored to generate a first database.

Preferably, the generation process of the second database is:

Set a task in the task configuration file, and attributes related to the task, the attributes include task running time, task acquisition scope and task running frequency,

According to the task running time and the task running frequency, obtain the data processing result of the instant processing module corresponding to the task acquisition range;

The acquired data processing results are stored to generate a second database.

Preferably, the method further includes: at least one second database is provided, and each database is respectively used to store the data processing results of the immediate processing modules corresponding to different task acquisition ranges.

Preferably, the terminal collection device is an interruptible terminal collection device and/or an uninterruptible terminal collection device.

A task processing device, comprising: a raw data acquisition module, a control analysis module and a result return module, wherein,

The raw data acquisition module is used to respond to the task request signal, and obtain the original data corresponding to the task request signal in the first database and the second database respectively, wherein the first database is used to store real-time data, and the The real-time data is the data sent in real time by the terminal acquisition device received by the instant processing module, and the second database is used to store the data processing results in the instant processing module;

The control analysis module is connected with the original data acquisition module, and is used to convert the original data into target data, so as to control the intelligent analysis module to process the target data according to the algorithm corresponding to the task request signal Perform analysis to obtain analysis results, wherein the purpose data meets the algorithm requirements of the algorithm corresponding to the task request signal in the intelligent analysis module;

The result returning module is connected to the control analysis module, and is used to return the analysis result to the immediate processing module as a reference value of the immediate processing module.

Preferably, a task configuration file is preset, and the task configuration file includes at least one task and attributes related to each task, the attributes include task running time,

The device also includes: a running time judging module and a task request signal sending module, wherein,

The running time judging module is used to judge one by one whether the task running time in the attributes of each task in the task configuration file is the same as the current running time of the system;

The task request signal sending module is connected to the running time judging module, and is used for sending a task request signal corresponding to the task when the task running time of the existing task is the same as the current running time of the system.

The present application provides a task processing method and device. Firstly, the real-time data and/or data processing results in the real-time processing module are used to analyze the data conversion and intelligent analysis modules to obtain the analysis results, and then the obtained analysis results are used as real-time The reference value of the processing module is returned to the real-time processing module for use when the real-time processing module processes data, so that real-time processing and intelligent analysis can carry out effective scheduling and data interaction, thereby ensuring intelligent power consumption in multiple time scales and business scenarios. Timeliness and accuracy in the process.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments described in this application. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

FIG. 1 is a flowchart of a task processing method provided in Embodiment 1 of the present application;

FIG. 2 is a schematic structural diagram of a task processing device provided in Embodiment 2 of the present application.

detailed description

In order to enable those skilled in the art to better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described The embodiments are only some of the embodiments of the present application, but not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the scope of protection of this application.

Embodiment one:

FIG. 1 is a flowchart of a task processing method provided in Embodiment 1 of the present application.

S101. In response to a task request signal, acquire raw data corresponding to the task request signal from the first database and the second database respectively.

In the embodiment of the present application, a first database and a second database are preset, wherein the first database is used to store real-time data, and the real-time data is the data sent in real time by the terminal acquisition device received by the real-time processing module, and the second database is used for Store the data processing results in the real-time processing module.

In the embodiment of the present application, preferably but not limited to, the terminal collection device is an interruptible terminal collection device and/or an uninterruptible terminal collection device, and the inventor can arbitrarily set the terminal data collection device according to his own needs.

In response to the task request signal, the original data corresponding to the task request signal are obtained in the first database and the second database respectively. It can be seen that the original data is respectively stored in the first database and/or the second database according to the needs of the task request signal data obtained directly.

Preferably, in the embodiment of the present application, the generation process of the first database is: setting a task and attributes related to the task in the task configuration file, wherein the attributes include the task execution corresponding to the storage space of the instant processing module time and how often the task runs. The task running time here is set according to the storage space of the real-time processing module, that is, the task running time is set according to the ability of the real-time processing module to store data.

When the task running time of the task is the same as the current running time of the system, send a task request signal corresponding to the task, obtain real-time data in the instant processing module, store the obtained real-time data, and generate a first database, and The real-time data is the real-time data sent by the terminal collection device received by the real-time processing module.

In the embodiment of the present application, not only the task running time of the task is set, but also the task running frequency is set, that is, how often the task is executed, and the task is executed according to the set task running time and task running frequency.

Preferably, in the embodiment of the present application, the generation process of the second database is as follows: setting a task in the task configuration file and attributes related to the task, the attributes include task running time, task acquisition scope and task running frequency.

When the task running time of the task is the same as the current running time of the system, send a task request signal corresponding to the task, and obtain the data processing result of the instant processing module corresponding to the task acquisition range according to the task running time and task running frequency , and store the obtained data processing results to generate a second database.

Preferably, in the embodiment of the present application, at least one second database is included, and each database is respectively used to store the data processing results of the real-time processing modules corresponding to different task acquisition ranges.

S102. Convert the original data into target data, so as to control the intelligent analysis module to analyze the target data according to the algorithm corresponding to the task request signal, and obtain an analysis result.

According to the algorithm requirements of the algorithm corresponding to the task request signal in the intelligent analysis module, the original data is summarized and filtered to generate the target data, and the intelligent analysis module is controlled to analyze the target data according to the algorithm corresponding to the task request signal, and the analysis result is obtained.

In the embodiment of this application, the method of summarizing and filtering the original data to generate the target data is preferably but not limited to, by directly calling the database statement generation and/or by inputting parameters, and then calling the corresponding database statement generation, the inventor can according to You can set the generation method arbitrarily according to your own needs, so I won't go into details here.

S103. Return the analysis result to the instant processing module as a reference value of the instant processing module.

In the embodiment of the present application, when the control intelligence analysis module analyzes the target data according to the algorithm corresponding to the task request signal to obtain the analysis result, it will use the obtained analysis result as a reference value of the instant processing module and return it to the instant processing module. So that the real-time processing module processes the data according to the received reference value.

Further, the task processing method provided in the embodiment of the present application also includes:

In this embodiment of the present application, a configuration file is preset, and the configuration file includes at least one task and attributes related to each task, and the attributes include task running time. Judge one by one whether the task running time in the attributes of each task in the task configuration file is the same as the current running time of the system, and when the task running time of the existing task is the same as the current running time of the system, send a task request signal corresponding to the task, so that It is used to respond to the sent task request signal and perform corresponding task processing.

Further, the task processing method provided in the embodiment of the present application also includes:

In this embodiment of the application, the attribute of the task may also include the attribute of task priority. When there are at least two tasks in the task configuration file whose task running time is the same as the current running time of the system, the task priority is sent. The task request signal corresponding to the task.

When the running time of at least two tasks in the task configuration file is the same as the current running time of the system, and the task priority is not set in the attributes of the at least two tasks or the set task priority is the same, then according to the current running time situation, automatically select a task to execute.

The embodiment of the present application provides a task processing method. First, the real-time data and/or data processing results in the real-time processing module are used for analysis by the data conversion and intelligent analysis module to obtain the analysis results, and then the obtained analysis results are used as real-time The reference value of the processing module is returned to the real-time processing module for use when the real-time processing module processes data, so that real-time processing and intelligent analysis can carry out effective scheduling and data interaction, thereby ensuring intelligent power consumption in multiple time scales and business scenarios. Timeliness and accuracy in the process.

Embodiment two:

FIG. 2 is a schematic structural diagram of a task processing device provided in Embodiment 2 of the present application.

As shown in Figure 2, the device includes: an original data acquisition module 1, a control analysis module 2 and a result return module 3, and the original data acquisition module 1, the control analysis module 2 and the result return module 3 are connected in sequence.

Wherein, the original data acquisition module 1 is used to respond to the task request signal, and respectively acquires the original data corresponding to the task request signal in the first database and the second database, wherein, the first database is used to store real-time data, and the real-time data is real-time The processing module receives the data sent by the terminal collection device in real time, and the second database is used to store the data processing results in the real-time processing module.

The control analysis module 2 is connected with the original data acquisition module 1, and is used to convert the original data into target data, so as to control the intelligent analysis module to analyze the target data according to the algorithm corresponding to the task request signal, and obtain the analysis results, wherein, the target The data conforms to the algorithm requirements of the algorithm corresponding to the task request signal in the intelligent analysis module.

The result return module 3 is connected with the control analysis module 2, and is used to return the analysis result to the immediate processing module as a reference value of the immediate processing module.

Further, the task processing device provided in the embodiment of the present application further includes: a running time judging module and a task request signal sending module.

Wherein, the running time judging module is used to judge one by one whether the task running time in the attribute of each task in the task configuration file is the same as the current running time of the system.

The task request signal sending module is connected with the running time judging module, and is used for sending a task request signal corresponding to the task when the task running time of the existing task is the same as the current running time of the system.

An embodiment of the present application provides a task processing device, including: a raw data acquisition module, a control analysis module, and a result return module. The raw data acquisition module acquires real-time data and/or data processing results in the instant processing module, and then controls The module performs data conversion on the real-time data and/or data processing results and controls the intelligent analysis module to analyze the converted data to obtain the analysis results, and returns the obtained analysis results as the reference value of the instant processing module to the instant processing through the result return module The module is used by the real-time processing module to process data, so that real-time processing and intelligent analysis can carry out effective scheduling and data interaction, thereby ensuring the timeliness and accuracy of intelligent power consumption in multi-time scale and business scene processing.

Each embodiment in this specification is described in a progressive manner, each embodiment focuses on the difference from other embodiments, and the same and similar parts of each embodiment can be referred to each other. As for the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and for the related part, please refer to the description of the method part.

The above are only preferred embodiments of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the application. Therefore, the present application will not be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. a task processing method, it is characterised in that described task processing method processes for the task requests in intelligent power is performed task, and described task processing method includes:

Response task requests signal, the initial data corresponding with described task requests signal is obtained respectively in the first data base and/or the second data base, wherein, described first data base is used for storing real time data, described real time data is the data that the terminal acquisition that instant processing module receives sends in real time, and described second data base is for storing the data processed result in described instant processing module；Wherein, described instant processing module is used for processing real time data, flow of event；

Convert described initial data to purpose data, according to the algorithm corresponding with described task requests signal, described purpose data are analyzed controlling intelligent analysis module, obtain analyzing result, wherein, the algorithm requirement of the algorithm of corresponding task requests signal in described purpose data fit intelligent analysis module；Wherein, described intelligent analysis module is for highly excavating historical data；

Using the described analysis result reference value as described instant processing module, return to described instant processing module.

2. method according to claim 1, it is characterised in that pre-setting task configuration file, include at least one task and attribute relevant to each task respectively in described task configuration file, described attribute includes Runtime,

The method also includes:

Judge that whether the Runtime in the attribute of each task in described task configuration file is identical with system current run time one by one；

When the Runtime that there is task is identical with system current run time, send the task requests signal corresponding with described task.

3. method according to claim 2, it is characterised in that described attribute includes task priority,

The method also includes:

When the Runtime that there is at least two task is identical with system current run time, send the task requests signal that the task high with task priority is corresponding.

4. method according to claim 1, it is characterised in that convert described initial data to purpose data, wherein, the algorithm requirement of the algorithm of corresponding task requests signal in described purpose data fit intelligent analysis module, including:

The algorithm requirement of the algorithm according to described task requests signal corresponding in intelligent analysis module, is undertaken described initial data collecting, filtering generation purpose data.

5. method according to claim 3, it is characterised in that the generation process of described first data base is:

Setting a task and the attribute relevant to described task in described task configuration file, described attribute includes the Runtime corresponding with the memory space of instant processing module and task run frequency；

According to described Runtime and task run frequency, obtain the real time data in instant processing module；Described real time data is the data that the terminal acquisition that described instant processing module receives sends in real time；

The described real time data got is stored, generates the first data base.

6. method according to claim 3, it is characterised in that the generation process of described second data base is:

Setting a task and the attribute relevant to described task in described task configuration file, described attribute includes Runtime, task obtains scope and task run frequency,

According to described Runtime and task run frequency, obtain the data processed result obtaining the corresponding instant processing module of scope with described task；

The described data processed result got is stored, generates the second data base.

7. method according to claim 6, it is characterised in that also include: be provided with at least one second data base, described each data base is respectively used to store the data processed result obtaining the corresponding instant processing module of scope from different tasks.

8. the method according to claim 1-7 any one, it is characterised in that described terminal acquisition is for can interrupt terminal acquisition and/or can not interrupt terminal acquisition.

9. a Task Processing Unit, it is characterised in that described Task Processing Unit processes for the task requests in intelligent power is performed task, and described Task Processing Unit includes: initial data acquisition module, control analysis module and result return module, wherein,

Described initial data acquisition module is used for responding task requests signal, the initial data corresponding with described task requests signal is obtained respectively in the first data base and the second data base, wherein, described first data base is used for storing real time data, described real time data is the data that the terminal acquisition that instant processing module receives sends in real time, and described second data base is for storing the data processed result in described instant processing module；Wherein, described instant processing module is used for processing real time data, flow of event；

Described control analysis module is connected with described initial data acquisition module, for converting described initial data to purpose data, according to the algorithm corresponding with described task requests signal, described purpose data are analyzed controlling intelligent analysis module, obtain analyzing result, wherein, the algorithm requirement of the algorithm of corresponding task requests signal in described purpose data fit intelligent analysis module；Wherein, described intelligent analysis module is for highly excavating historical data；

Described result returns module and is connected with described control analysis module, is used for, using the described analysis result reference value as described instant processing module, returning to described instant processing module.

10. device according to claim 9, it is characterised in that being previously provided with task configuration file, include at least one task and attribute relevant to each task respectively in described task configuration file, described attribute includes Runtime,

This device also includes: run time judgment module and task requests signal transmitting module, wherein,

Described operation time judgment module is for judging that whether the Runtime in the attribute of each task in described task configuration file is identical with system current run time one by one；

Described task requests signal transmitting module is connected with described operation time judgment module, for when the Runtime that there is task is identical with system current run time, sending the task requests signal corresponding with described task.