[go: up one dir, main page]

CN118468164B - A big data real-time analysis and processing device based on deep learning - Google Patents

A big data real-time analysis and processing device based on deep learning Download PDF

Info

Publication number
CN118468164B
CN118468164B CN202410920021.9A CN202410920021A CN118468164B CN 118468164 B CN118468164 B CN 118468164B CN 202410920021 A CN202410920021 A CN 202410920021A CN 118468164 B CN118468164 B CN 118468164B
Authority
CN
China
Prior art keywords
data
analysis
transmission
unit
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202410920021.9A
Other languages
Chinese (zh)
Other versions
CN118468164A (en
Inventor
龙文
焦建军
徐�明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guizhou University of Finance and Economics
Original Assignee
Guizhou University of Finance and Economics
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guizhou University of Finance and Economics filed Critical Guizhou University of Finance and Economics
Priority to CN202410920021.9A priority Critical patent/CN118468164B/en
Publication of CN118468164A publication Critical patent/CN118468164A/en
Application granted granted Critical
Publication of CN118468164B publication Critical patent/CN118468164B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/243Classification techniques relating to the number of classes
    • G06F18/2431Multiple classes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/10Pre-processing; Data cleansing
    • G06F18/15Statistical pre-processing, e.g. techniques for normalisation or restoring missing data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/213Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/044Recurrent networks, e.g. Hopfield networks
    • G06N3/0442Recurrent networks, e.g. Hopfield networks characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0464Convolutional networks [CNN, ConvNet]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/06Energy or water supply
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Mathematical Physics (AREA)
  • Molecular Biology (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Business, Economics & Management (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Economics (AREA)
  • Primary Health Care (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Medical Informatics (AREA)
  • General Business, Economics & Management (AREA)
  • Tourism & Hospitality (AREA)
  • Strategic Management (AREA)
  • Marketing (AREA)
  • Human Resources & Organizations (AREA)
  • Water Supply & Treatment (AREA)
  • Public Health (AREA)
  • Probability & Statistics with Applications (AREA)
  • Supply And Distribution Of Alternating Current (AREA)
  • Wind Motors (AREA)

Abstract

本发明涉及大数据分析技术领域,具体涉及一种基于深度学习的大数据实时分析处理装置,包括:若干数据采集单元以及若干采集识别单元,若干数据传输单元以及若干传输识别单元,若干数据分析单元以及若干分析识别单元,若干数据处理单元以及若干处理识别单元,数据可视化模块,用于接收第一分析数据的分析结果和第一处理数据的处理结果。本发明,对于需要紧急分析处理被提取的紧急数据,在大数据实时分析处理的过程中,确保其能够被高效的被传输进行分析和处理,从而确保大数据实时分析处理过程中的紧急数据能够被快速提取反馈。

The present invention relates to the field of big data analysis technology, and specifically to a big data real-time analysis and processing device based on deep learning, comprising: a plurality of data acquisition units and a plurality of acquisition and identification units, a plurality of data transmission units and a plurality of transmission identification units, a plurality of data analysis units and a plurality of analysis and identification units, a plurality of data processing units and a plurality of processing and identification units, and a data visualization module, which is used to receive the analysis results of first analysis data and the processing results of first processing data. The present invention ensures that the urgent data that needs to be urgently analyzed and extracted can be efficiently transmitted for analysis and processing during the process of big data real-time analysis and processing, thereby ensuring that the urgent data in the process of big data real-time analysis and processing can be quickly extracted and fed back.

Description

一种基于深度学习的大数据实时分析处理装置A big data real-time analysis and processing device based on deep learning

技术领域Technical Field

本发明涉及大数据分析技术领域,具体涉及一种基于深度学习的大数据实时分析处理装置。The present invention relates to the technical field of big data analysis, and in particular to a big data real-time analysis and processing device based on deep learning.

背景技术Background Art

在能源领域中,风电系统也称为风力发电系统,是一种利用风力来产生电能的系统。风电系统运行过程中的故障监测至关重要,若风电系统运行过程中的故障信息未及时被检测到,可能会导致风力转换效率降低,影响发电量;导致停机甚至损坏,影响风机的正常运行;甚至导致风机的稳定性和安全性下降,产生安全事故。In the energy field, a wind power system, also known as a wind power generation system, is a system that uses wind power to generate electricity. Fault monitoring during the operation of a wind power system is crucial. If fault information during the operation of a wind power system is not detected in a timely manner, it may lead to reduced wind power conversion efficiency, affecting power generation; causing downtime or even damage, affecting the normal operation of the wind turbine; and even causing reduced stability and safety of the wind turbine, resulting in safety accidents.

风电系统运行过程中会产生大量的数据,主要包括环境数据(风速、风向、温度、湿度等)、性能数据(发电量、功率曲线等)、运行数据(转速、电流、电压、频率、湍流强度等)、监控数据(压力、振动、油位等)。这些数据均与风电系统的运行状态息息相关,从这些数据种能够用于诊断当前风电系统运行是否存在故障。但是由于数据量较大,传统的大数据处理技术难以满足对风电系统数据处理和分析的需求。通常需要借助大数据分析处理系统进行故障诊断,旨在从海量的风电系统运行数据中提炼出有用的信息,并为诊断决策提供支持。A large amount of data is generated during the operation of the wind power system, mainly including environmental data (wind speed, wind direction, temperature, humidity, etc.), performance data (power generation, power curve, etc.), operation data (speed, current, voltage, frequency, turbulence intensity, etc.), and monitoring data (pressure, vibration, oil level, etc.). These data are closely related to the operating status of the wind power system, and these data can be used to diagnose whether there is a fault in the current operation of the wind power system. However, due to the large amount of data, traditional big data processing technology is difficult to meet the needs of wind power system data processing and analysis. It is usually necessary to use a big data analysis and processing system for fault diagnosis, aiming to extract useful information from the massive wind power system operation data and provide support for diagnostic decisions.

然而现有的大数据分析处理系统,在风电系统运行数据采集的过程中缺乏对数据类型的识别分析,通常按照预设链路传输所采集或预处理后的风电系统运行数据。但风电系统运行数据中可能会存在部分紧急数据,例如:提示、故障、预警的用的相关数据,这些数据通常还因其个体差异具有不同的紧急程度,对于这些紧急数据若采用传统的采集分析、处理以及传输方式,则无法确保这些紧急数据被快速提取并分析处理,导致风电系统运行故障无法被及时获取,无法及时生成故障排除策略。However, the existing big data analysis and processing system lacks the identification and analysis of data types in the process of wind power system operation data collection, and usually transmits the collected or pre-processed wind power system operation data according to the preset link. However, there may be some emergency data in the wind power system operation data, such as: related data for prompts, faults, and warnings. These data usually have different levels of urgency due to their individual differences. If traditional collection, analysis, processing and transmission methods are used for these emergency data, it is impossible to ensure that these emergency data can be quickly extracted and analyzed, resulting in the inability to obtain wind power system operation faults in a timely manner and to generate troubleshooting strategies in a timely manner.

综合上述,亟需一种能够对风电系统运行数据进行快速分类识别,并确保风电系统运行数据中存在的紧急数据能够被高效分析处理的一种基于深度学习的大数据实时分析处理装置。In summary, there is an urgent need for a big data real-time analysis and processing device based on deep learning that can quickly classify and identify wind power system operation data and ensure that the emergency data existing in the wind power system operation data can be efficiently analyzed and processed.

发明内容Summary of the invention

为解决上述问题,本发明提供一种基于深度学习的大数据实时分析处理装置,用于对所采集的风电系统运行数据进行分类识别,并对紧急数据合理的分配传输、分析和处理路径,确保紧急数据能够被高效分析处理,诊断风电系统运行情况。To solve the above problems, the present invention provides a big data real-time analysis and processing device based on deep learning, which is used to classify and identify the collected wind power system operation data, and reasonably allocate transmission, analysis and processing paths for emergency data, to ensure that the emergency data can be efficiently analyzed and processed, and to diagnose the operation status of the wind power system.

为了实现上述目的,本发明的技术方案如下:一种基于深度学习的大数据实时分析处理装置,包括:In order to achieve the above object, the technical solution of the present invention is as follows: A big data real-time analysis and processing device based on deep learning, comprising:

若干数据采集单元以及若干采集识别单元,数据采集单元用于对风电系统运行数据进行采集,采集识别单元用于对数据采集单元采集的风电系统运行数据进行分类识别,数据采集单元还用于根据风电系统运行数据的分类识别结果对所采集的风电系统运行数据进行标识,生成第一采集数据;A plurality of data acquisition units and a plurality of acquisition and identification units, wherein the data acquisition units are used to acquire wind power system operation data, the acquisition and identification units are used to classify and identify the wind power system operation data acquired by the data acquisition units, and the data acquisition units are further used to identify the acquired wind power system operation data according to the classification and identification results of the wind power system operation data to generate first acquisition data;

若干数据传输单元以及若干传输识别单元,数据传输单元用于接收第一采集数据,传输识别单元用于对数据传输单元接收的第一采集数据进行分类识别,数据传输单元还用于根据第一采集数据的分类识别结果对第一采集数据进行标识,生成第一传输数据;A plurality of data transmission units and a plurality of transmission identification units, the data transmission unit is used to receive the first collected data, the transmission identification unit is used to classify and identify the first collected data received by the data transmission unit, and the data transmission unit is further used to identify the first collected data according to the classification and identification result of the first collected data to generate first transmission data;

若干数据分析单元以及若干分析识别单元,数据分析单元用于接收第一传输数据,分析识别单元用于对数据分析单元接收的第一传输数据进行分类识别,数据分析单元用于根据第一传输数据的分类识别结果对第一传输数据进行标识,生成第一分析数据,并对第一分析数据进行分析;A plurality of data analysis units and a plurality of analysis and identification units, the data analysis unit is used to receive the first transmission data, the analysis and identification unit is used to classify and identify the first transmission data received by the data analysis unit, the data analysis unit is used to identify the first transmission data according to the classification and identification result of the first transmission data, generate first analysis data, and analyze the first analysis data;

若干数据处理单元以及若干处理识别单元,数据处理单元用于接收第一分析数据,处理识别单元用于对数据处理单元接收的第一分析数据进行分类识别,数据处理单元用于根据第一分析数据的分类识别结果对第一分析数据进行标识,生成第一处理数据,并对第一处理数据进行处理;A plurality of data processing units and a plurality of processing identification units, the data processing units are used to receive first analysis data, the processing identification units are used to classify and identify the first analysis data received by the data processing units, the data processing units are used to identify the first analysis data according to the classification and identification results of the first analysis data, generate first processing data, and process the first processing data;

数据可视化模块,用于接收并可视化第一分析数据的分析结果和第一处理数据的处理结果,基于第一分析数据的分析结果和第一处理数据的处理结果诊断风电系统运行状态;a data visualization module, configured to receive and visualize an analysis result of the first analysis data and a processing result of the first processing data, and diagnose an operating state of the wind power system based on the analysis result of the first analysis data and the processing result of the first processing data;

采集识别单元、传输识别单元、分析识别单元和处理识别单元用于接收预设的分类识别规则,并分别根据分类识别规则分别对采集的风电系统运行数据、第一采集数据、第一传输数据和第一分析数据进行紧急程度识别,当采集的风电系统运行数据、第一采集数据、第一传输数据或第一分析数据被标识为紧急数据时,对应的识别单元生成数据传输路径信息,数据采集模块、数据传输模块、数据分析模块和数据处理模块用于根据传输路径信息进行紧急数据的传输。The collection and identification unit, the transmission and identification unit, the analysis and identification unit and the processing and identification unit are used to receive preset classification and identification rules, and identify the urgency of the collected wind power system operation data, the first collection data, the first transmission data and the first analysis data according to the classification and identification rules respectively. When the collected wind power system operation data, the first collection data, the first transmission data or the first analysis data is identified as emergency data, the corresponding identification unit generates data transmission path information, and the data collection module, the data transmission module, the data analysis module and the data processing module are used to transmit emergency data according to the transmission path information.

进一步,采集识别单元基于深度学习模型构建,采集识别单元用于根据预设的分类识别规则对采集的风电系统运行数据进行分类,并基于预设的紧急程度特征值对采集的风电系统运行数据进行紧急程度判断,当紧急程度特征值大于阈值时,采集识别单元将采集的风电系统运行数据标识为采集紧急数据。Furthermore, the collection and identification unit is constructed based on a deep learning model. The collection and identification unit is used to classify the collected wind power system operation data according to preset classification and identification rules, and to judge the urgency of the collected wind power system operation data based on a preset urgency characteristic value. When the urgency characteristic value is greater than a threshold value, the collection and identification unit identifies the collected wind power system operation data as collection emergency data.

进一步,还包括监测模块,监测模块与采集识别单元、传输识别单元、分析识别单元、处理识别单元以及数据传输单元信号连接,监测模块用于获取被采集识别单元标识的采集紧急数据,并监测数据传输单元是否接收对应的采集紧急数据,若采集紧急数据未被数据传输单元接收,则将对应的采集紧急数据传输至运行负荷低于阈值的数据传输单元。Furthermore, it also includes a monitoring module, which is connected to the collection and identification unit, the transmission identification unit, the analysis and identification unit, the processing identification unit and the data transmission unit signal. The monitoring module is used to obtain the collection emergency data identified by the collection and identification unit, and monitor whether the data transmission unit receives the corresponding collection emergency data. If the collection emergency data is not received by the data transmission unit, the corresponding collection emergency data is transmitted to the data transmission unit whose operating load is lower than the threshold.

进一步,监测模块还与数据分析单元和数据处理单元信号连接;Further, the monitoring module is also signal-connected to the data analysis unit and the data processing unit;

监测模块用于监测采集紧急数据对应的第一传输数据是否被对应的数据分析单元接收,若采集紧急数据对应的第一传输数据未被对应的数据分析单元接收,则将采集紧急数据对应的第一传输数据传输至运行负荷低于阈值的数据分析单元;The monitoring module is used to monitor whether the first transmission data corresponding to the collected emergency data is received by the corresponding data analysis unit, and if the first transmission data corresponding to the collected emergency data is not received by the corresponding data analysis unit, the first transmission data corresponding to the collected emergency data is transmitted to the data analysis unit whose operating load is lower than the threshold;

监测模块用于监测采集紧急数据对应的第一分析数据是否被数据处理单元接收,若采集紧急数据对应的第一分析数据未被对应的数据处理单元接收,则将采集紧急数据对应的第一分析数据传输至运行负荷低于阈值的数据处理单元。The monitoring module is used to monitor whether the first analysis data corresponding to the collected emergency data is received by the data processing unit. If the first analysis data corresponding to the collected emergency data is not received by the corresponding data processing unit, the first analysis data corresponding to the collected emergency data is transmitted to the data processing unit whose operating load is lower than the threshold.

进一步,监测模块用于在预设的时间间隔内监测到多个被标识为采集紧急数据时,监测模块用于在采集紧急数据对应的采集识别单元内获取采集紧急数据的紧急等级,并按照紧急等级依次生成多个采集紧急数据对应的数据传输路径信息。Furthermore, when the monitoring module detects multiple data identified as collected emergency data within a preset time interval, the monitoring module is used to obtain the urgency level of the collected emergency data in the collection identification unit corresponding to the collected emergency data, and generate multiple data transmission path information corresponding to the collected emergency data in sequence according to the urgency level.

进一步,监测模块还用于对采集紧急数据被传输识别单元传输的进度、采集紧急数据对应的第一传输数据被数据分析模块分析的进度以及采集紧急数据对应的第一分析数据被数据处理模块处理的进度进行监测,并分别生成第一进度信息、第二进度信息以及第三进度信息;Further, the monitoring module is also used to monitor the progress of the collected emergency data being transmitted by the transmission identification unit, the progress of the first transmission data corresponding to the collected emergency data being analyzed by the data analysis module, and the progress of the first analysis data corresponding to the collected emergency data being processed by the data processing module, and generate first progress information, second progress information and third progress information respectively;

监测模块用于接收第一处理速度阈值,并基于第一进度信息、第二进度信息以及第三进度信息获取采集紧急数据、采集紧急数据对应的第一传输数据或采集紧急数据对应的第一分析数据被传输、分析或处理的速度,并在传输、分析或处理的速度低于第一处理速度阈值时,发出提示信号。The monitoring module is used to receive a first processing speed threshold, and obtain the speed at which the collected emergency data, the first transmission data corresponding to the collected emergency data, or the first analysis data corresponding to the collected emergency data are transmitted, analyzed or processed based on the first progress information, the second progress information and the third progress information, and send a prompt signal when the transmission, analysis or processing speed is lower than the first processing speed threshold.

进一步,监测模块还用于接收第二处理速度阈值,并在采集紧急数据、采集紧急数据对应的第一传输数据或采集紧急数据对应的第一分析数据被传输、分析或处理的速度低于第二处理速度阈值时,生成切换信号;Further, the monitoring module is further used to receive a second processing speed threshold, and generate a switching signal when the speed at which the emergency data, the first transmission data corresponding to the emergency data, or the first analysis data corresponding to the emergency data are transmitted, analyzed, or processed is lower than the second processing speed threshold;

数据传输单元、数据分析单元和数据处理单元用于监听切换信号,并在监听到所属的切换信号时,停止数据传输、分析或处理,并提取未处理完的采集紧急数据、采集紧急数据对应的第一传输数据或采集紧急数据对应的第一分析数据,并将未处理完的采集紧急数据、采集紧急数据对应的第一传输数据或采集紧急数据对应的第一分析数据传输至其他运行负荷低于阈值数据传输单元、数据分析单元或数据处理单元。The data transmission unit, the data analysis unit and the data processing unit are used to monitor the switching signal, and when the corresponding switching signal is monitored, stop data transmission, analysis or processing, and extract the unprocessed collected emergency data, the first transmission data corresponding to the collected emergency data, or the first analysis data corresponding to the collected emergency data, and transmit the unprocessed collected emergency data, the first transmission data corresponding to the collected emergency data, or the first analysis data corresponding to the collected emergency data to other data transmission units, data analysis units or data processing units whose operating load is lower than the threshold.

进一步,还包括状态采集模块,状态采集模块与数据传输单元、数据分析单元和数据处理单元信号连接,状态采集模块用于收集各数据传输单元、数据分析单元和数据处理单元的运行负荷;Furthermore, it also includes a state acquisition module, which is connected to the data transmission unit, the data analysis unit and the data processing unit by signal, and is used to collect the operation load of each data transmission unit, the data analysis unit and the data processing unit;

数据传输单元、数据分析单元和数据处理单元均用于在运行负荷低于阈值时反馈数据处理需求至状态采集模块。The data transmission unit, the data analysis unit and the data processing unit are all used to feed back the data processing requirements to the status acquisition module when the operating load is lower than the threshold.

进一步,监测模块用于在各数据传输单元运行负荷均不小于阈值时,将采集紧急数据暂存,并在各数据传输单元之间切换进行采集紧急数据传输,直至具有数据传输单元运行负荷均小于阈值或采集紧急数据被数据传输单元接收。Furthermore, the monitoring module is used to temporarily store the collected emergency data when the operating load of each data transmission unit is not less than a threshold, and switch between the data transmission units to transmit the collected emergency data until the operating load of the data transmission unit is less than the threshold or the collected emergency data is received by the data transmission unit.

进一步,数据采集单元用于为被标识为采集紧急数据的第一采集数据增加时间戳;Further, the data collection unit is used to add a timestamp to the first collected data identified as collected urgent data;

数据传输单元用于计算实际传输完成被标识为采集紧急数据的第一采集数据的时间与时间戳之间的时延,监测模块用于根据时延判断数据传输速度是否低于第一处理速度阈值和第二处理速度阈值。The data transmission unit is used to calculate the delay between the time when the first collected data marked as collected urgent data is actually transmitted and the timestamp, and the monitoring module is used to determine whether the data transmission speed is lower than the first processing speed threshold and the second processing speed threshold according to the delay.

采用上述方案有以下有益效果:The above scheme has the following beneficial effects:

1、本发明,在风电系统运行状态获取过程中的数据采集阶段、数据传输阶段、数据分析阶段以及数据处理阶段均进行数据的分类识别,相较于现有技术,对于需要紧急分析处理被提取的紧急数据(提示、故障、预警的用的相关数据等),在大数据实时分析处理的过程中,确保其能够被高效的被传输进行分析和处理,从而确保大数据实时分析处理过程中的紧急数据能够被快速提取,及时的获取风电系统的异常运行状态。1. The present invention classifies and identifies data in the data collection stage, data transmission stage, data analysis stage and data processing stage in the process of acquiring the operating status of the wind power system. Compared with the prior art, for the emergency data (relevant data for prompts, faults, warnings, etc.) that need to be urgently analyzed and processed, it is ensured that they can be efficiently transmitted for analysis and processing during the real-time analysis and processing of big data, thereby ensuring that the emergency data in the real-time analysis and processing of big data can be quickly extracted and the abnormal operating status of the wind power system can be acquired in time.

2、本发明,采用多层次的分类识别,对于部分需要紧急传输而不需要紧急分析和处理的数据,在传输阶段实现紧急传输;对于部分需要紧急分析而不需要紧急处理的数据,在传输阶段紧急传输,在分析阶段紧急分析;对于需要紧急处理的数据,则在传输阶段紧急传输,在分析阶段紧急分析,在处理阶段紧急处理,相较于现有技术,确保风电系统运行数据获取过程中,不同类型需求的风电系统运行数据能够自适应的被高效分配,满足数据需求。2. The present invention adopts multi-level classification and identification. For some data that need urgent transmission but do not need urgent analysis and processing, urgent transmission is realized in the transmission stage; for some data that need urgent analysis but do not need urgent processing, urgent transmission is realized in the transmission stage, and urgent analysis is realized in the analysis stage; for data that need urgent processing, urgent transmission is realized in the transmission stage, urgent analysis is realized in the analysis stage, and urgent processing is realized in the processing stage. Compared with the prior art, it ensures that in the process of acquiring wind power system operation data, wind power system operation data with different types of requirements can be adaptively and efficiently allocated to meet data requirements.

3、本发明,通过各单元端的主动处理结合监测端的协同分配,充分利用该装置对风电系统运行数据实时分析处理的能力,相较于现有技术,提高了风电系统运行数据分析处理装置内各单元之间的数据处理均衡性,平衡部分单元的数据处理负荷,并确保分类识别后的各类风电系统运行数据能够被正常有效的反馈,用于风电系统运行状态的获取。3. The present invention, through active processing at each unit end combined with coordinated allocation at the monitoring end, fully utilizes the device's ability to analyze and process wind power system operation data in real time. Compared with the prior art, it improves the data processing balance between the units in the wind power system operation data analysis and processing device, balances the data processing load of some units, and ensures that various types of wind power system operation data after classification and identification can be fed back normally and effectively for obtaining the operating status of the wind power system.

本发明的附加方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本发明的实践了解到。Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

图1为本发明基于深度学习的大数据实时分析处理装置实施例的结构示意图;FIG1 is a schematic diagram of the structure of an embodiment of a device for real-time analysis and processing of big data based on deep learning according to the present invention;

图2为本发明基于深度学习的大数据实时分析处理装置实施例的监测模块结构示意图;FIG2 is a schematic diagram of the monitoring module structure of an embodiment of a big data real-time analysis and processing device based on deep learning of the present invention;

图3为本发明基于深度学习的大数据实时分析处理装置实施例的状态采集模块示意图;FIG3 is a schematic diagram of a state acquisition module of an embodiment of a big data real-time analysis and processing device based on deep learning of the present invention;

图4为本发明基于深度学习的大数据实时分析处理装置实施例的各识别单元基于深度学习模型的构建流程图;FIG4 is a flowchart of the construction of each recognition unit based on the deep learning model in an embodiment of the big data real-time analysis and processing device based on deep learning of the present invention;

图5为本发明基于深度学习的大数据实时分析处理装置实施例的数据处理流程图。FIG5 is a data processing flow chart of an embodiment of a big data real-time analysis and processing device based on deep learning of the present invention.

具体实施方式DETAILED DESCRIPTION

下面将结合附图对本发明的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solution of the present invention will be described clearly and completely below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

下面通过具体实施方式进一步详细说明:The following is further described in detail through specific implementation methods:

实施例1:Embodiment 1:

如附图1-附图3所示:一种基于深度学习的大数据实时分析处理装置,用于风电系统运行过程中的数据采集,主要由数据采集模块、数据采集模块、数据分析模块、数据处理模块和数据可视化模块组成,数据采集模块、数据采集模块、数据分析模块、数据处理模块和数据可视化模块依次交互通信。As shown in Figures 1 to 3: A big data real-time analysis and processing device based on deep learning is used for data collection during the operation of a wind power system. It is mainly composed of a data collection module, a data collection module, a data analysis module, a data processing module and a data visualization module. The data collection module, the data collection module, the data analysis module, the data processing module and the data visualization module interact and communicate in sequence.

其中,数据采集模块包括若干数据采集单元以及若干采集识别单元,采集识别单元与数据采集单元一一对应设置;数据采集单元用于对风电系统运行数据进行实时采集,实时采集的风电系统运行数据主要包括:环境数据(风速、风向、温度、湿度等)、性能数据(发电量、功率曲线等)、运行数据(转速、电流、电压、频率、湍流强度等)、监控数据(压力、振动、油位等)。Among them, the data acquisition module includes several data acquisition units and several acquisition and identification units, and the acquisition and identification units are set one by one with the data acquisition units; the data acquisition unit is used to collect the operation data of the wind power system in real time, and the real-time collected operation data of the wind power system mainly includes: environmental data (wind speed, wind direction, temperature, humidity, etc.), performance data (power generation, power curve, etc.), operation data (speed, current, voltage, frequency, turbulence intensity, etc.), and monitoring data (pressure, vibration, oil level, etc.).

采集识别单元用于对数据采集单元采集的风电系统运行数据进行分类识别,数据采集单元还用于根据风电系统运行数据的分类识别结果对采集的风电系统运行数据进行标识,生成第一采集数据。数据采集模块作为风电系统运行数据采集的前端,对于风电系统运行数据类型的判断至关重要,对于风电系统运行数据的紧急需求进行获取,能够确保所采集的风电系统运行数据后续能够被高效传输、分析或处理。The collection and identification unit is used to classify and identify the wind power system operation data collected by the data collection unit. The data collection unit is also used to identify the collected wind power system operation data according to the classification and identification results of the wind power system operation data to generate the first collection data. As the front end of the wind power system operation data collection, the data collection module is crucial for determining the type of wind power system operation data, and for obtaining the urgent needs of the wind power system operation data, so as to ensure that the collected wind power system operation data can be efficiently transmitted, analyzed or processed later.

结合附图4所示,本实施例的采集识别单元基于深度学习模型构建,其构建步骤如下:As shown in FIG. 4 , the acquisition and recognition unit of this embodiment is constructed based on a deep learning model, and the construction steps are as follows:

数据采集与获取,确定需要分析的数据源,即风电系统运行数据,主要为风电系统运行过程中的环境数据、性能数据、运行数据以及监控数据,具体地数据内容与上述实时采集的风电系统运行数据相同;Data collection and acquisition, determining the data source that needs to be analyzed, namely, wind power system operation data, mainly environmental data, performance data, operation data and monitoring data during the operation of the wind power system. The specific data content is the same as the above-mentioned real-time collected wind power system operation data;

数据预处理,处理无效的风电系统运行数据、缺失值、异常值等,确保风电系统运行数据质量;对风电系统运行数据进行降维、标准化,根据分析任务,选择和提取有用的特征;Data preprocessing: processing invalid wind power system operation data, missing values, outliers, etc. to ensure the quality of wind power system operation data; reducing the dimension and standardizing the wind power system operation data, and selecting and extracting useful features according to the analysis task;

模型选择与构建,根据任务类型选择适当的深度学习模型,可采用卷积神经网络(CNN)、循环神经网络(RNN)、长短期记忆网络(LSTM)等,本实施例主要用于对风电系统运行数据进行识别,具有大量的风电系统运行数据作为训练集,因此,采用长短期记忆网络(LSTM),其在处理风电系统运行数据这类具有长期依赖性的序列数据方面表现出色;Model selection and construction: Select an appropriate deep learning model according to the task type. Convolutional neural network (CNN), recurrent neural network (RNN), long short-term memory network (LSTM), etc. can be used. This embodiment is mainly used to identify wind power system operation data. There is a large amount of wind power system operation data as a training set. Therefore, the long short-term memory network (LSTM) is used, which performs well in processing sequence data with long-term dependencies such as wind power system operation data;

模型训练,将预处理后的风电系统运行数据划分为训练集、验证集和测试集,利用训练数据来优化模型的权重和参数,以使模型能够更好地拟合数据。Model training: divide the preprocessed wind power system operation data into training set, validation set and test set, and use the training data to optimize the model's weights and parameters so that the model can better fit the data.

此外,能够即时识别分析采集模块最新采集的风电系统运行数据。具体地,采集识别单元用于根据预设的分类识别规则对采集的风电系统运行数据进行分类,并基于预设的紧急程度特征值对采集的风电系统运行数据进行紧急程度判断,当紧急程度特征值大于阈值时标识为采集紧急数据。其中,紧急程度特征值为风电系统运行数据中包含的紧急信息,例如,风电系统运行数据中包含的电压过高或过低、电流过高或过低、频率过高或过低等。但由于采集的风电系统运行数据中可能常包括有部分异常数据(例如:频率长期处于波动状态,但正常运行情况下波动量维持在一定范围内),为了避免所采集的风电系统运行数据被误识别为紧急数据,因此,通过设置阈值,能够有效的筛选出真正需要紧急被分析处理的风电系统运行数据。In addition, the wind power system operation data newly collected by the collection module can be identified and analyzed in real time. Specifically, the collection and identification unit is used to classify the collected wind power system operation data according to the preset classification and identification rules, and to judge the urgency of the collected wind power system operation data based on the preset urgency characteristic value. When the urgency characteristic value is greater than the threshold, it is marked as collecting emergency data. Among them, the urgency characteristic value is the emergency information contained in the wind power system operation data, for example, the voltage contained in the wind power system operation data is too high or too low, the current is too high or too low, the frequency is too high or too low, etc. However, since the collected wind power system operation data may often include some abnormal data (for example: the frequency is in a state of fluctuation for a long time, but the fluctuation amount is maintained within a certain range under normal operation), in order to avoid the collected wind power system operation data from being mistakenly identified as emergency data, therefore, by setting a threshold, the wind power system operation data that really needs to be urgently analyzed and processed can be effectively screened out.

相应地,数据传输模块包括若干数据传输单元以及若干传输识别单元,传输识别单元与数据传输单元一一对应设置;数据传输单元用于接收第一采集数据,传输识别单元用于对数据传输单元接收的第一采集数据进行分类识别,数据传输单元还用于根据第一采集数据的分类识别结果对第一采集数据进行标识,生成第一传输数据。其中,传输识别单元同样基于深度学习模型构建(构建方法与采集识别单元类似,此处不再赘述),传输识别单元对风电系统运行数据类型进行第二次识别,其目的在于确认风电系统运行数据是否需要紧急分析或紧急处理。Accordingly, the data transmission module includes a plurality of data transmission units and a plurality of transmission identification units, and the transmission identification units are arranged in a one-to-one correspondence with the data transmission units; the data transmission unit is used to receive the first collected data, and the transmission identification unit is used to classify and identify the first collected data received by the data transmission unit, and the data transmission unit is also used to identify the first collected data according to the classification and identification result of the first collected data to generate the first transmission data. Among them, the transmission identification unit is also constructed based on the deep learning model (the construction method is similar to that of the collection and identification unit, which will not be repeated here), and the transmission identification unit performs a second identification on the wind power system operation data type, the purpose of which is to confirm whether the wind power system operation data requires emergency analysis or emergency processing.

相应地,数据分析模块和数据处理模块同样采用与数据采集模块和数据传输模块相同的架构,数据分析模块包括若干数据分析单元以及若干分析识别单元,分析识别单元与数据分析单元一一对应设置;数据分析单元用于接收第一传输数据,分析识别单元用于对数据分析单元接收的第一传输数据进行分类识别,数据分析单元用于根据第一传输数据的分类识别结果对第一传输数据进行标识,生成第一分析数据,并对第一分析数据进行分析。对第一分析数据进行分析主要是对风电系统运行数据进行判断其是否会导致风电系统运行异常,以及异常的类型,例如:系统内部温度、系统内部振动频率等异常数据,可能导致的异常类型包括风机叶片异常、轴承异常、发电机异常等;电流、电压、频率等异常数据,可能导致的异常类型包括电网故障、电网频率或电压异常等。Correspondingly, the data analysis module and the data processing module also adopt the same architecture as the data acquisition module and the data transmission module. The data analysis module includes a plurality of data analysis units and a plurality of analysis and identification units, and the analysis and identification units are arranged one by one with the data analysis units; the data analysis unit is used to receive the first transmission data, and the analysis and identification unit is used to classify and identify the first transmission data received by the data analysis unit, and the data analysis unit is used to identify the first transmission data according to the classification and identification result of the first transmission data, generate the first analysis data, and analyze the first analysis data. The analysis of the first analysis data is mainly to judge whether the wind power system operation data will cause abnormal operation of the wind power system, and the type of abnormality, for example: abnormal data such as the internal temperature of the system, the internal vibration frequency of the system, etc., which may cause abnormal types including abnormal fan blades, bearings, generators, etc.; abnormal data such as current, voltage, frequency, etc., which may cause abnormal types including power grid failure, power grid frequency or voltage abnormality, etc.

数据处理模块包括若干数据处理单元以及若干处理识别单元,数据处理单元与处理识别单元一一对应设置;数据处理单元用于接收第一分析数据,处理识别单元用于对数据处理单元接收的第一分析数据进行分类识别,数据处理单元用于根据第一分析数据的分类识别结果对第一分析数据进行标识,生成第一处理数据,并对第一处理数据进行处理。对第一处理数据进行处理主要是根据风电系统运行数据进行制定故障排除策略。The data processing module includes a plurality of data processing units and a plurality of processing identification units, and the data processing units and the processing identification units are arranged in a one-to-one correspondence; the data processing unit is used to receive the first analysis data, and the processing identification unit is used to classify and identify the first analysis data received by the data processing unit, and the data processing unit is used to identify the first analysis data according to the classification and identification result of the first analysis data, generate the first processing data, and process the first processing data. The processing of the first processing data is mainly to formulate a troubleshooting strategy based on the operation data of the wind power system.

分析识别单元和处理识别单元同样基于深度学习模型构建,分析识别单元对风电系统运行数据类型进行第三次识别,其目的在于确认风电系统运行数据是否需要紧急处理;处理识别单元对数据类型进行第四次识别,其目的在于确认风电系统运行数据是否需要紧急进行可视化。通过上述多个阶段的风电系统运行数据类型识别,确保所采集的风电系统运行数据高效的满足数据的采集、传输、分析、处理和可视化需求。The analysis and identification unit and the processing and identification unit are also built based on the deep learning model. The analysis and identification unit performs a third identification on the wind power system operation data type, the purpose of which is to confirm whether the wind power system operation data needs to be urgently processed; the processing and identification unit performs a fourth identification on the data type, the purpose of which is to confirm whether the wind power system operation data needs to be urgently visualized. Through the above-mentioned multiple stages of wind power system operation data type identification, it is ensured that the collected wind power system operation data efficiently meets the data collection, transmission, analysis, processing and visualization requirements.

数据可视化模块用于接收并可视化第一分析数据的分析结果和第一处理数据的处理结果,数据采集模块通常为移动终端,移动终端一方面提供数据展示平台,另一方面提供用户人机操控平台。The data visualization module is used to receive and visualize the analysis results of the first analysis data and the processing results of the first processing data. The data acquisition module is usually a mobile terminal. The mobile terminal provides a data display platform on the one hand and a user human-computer control platform on the other hand.

对于多阶段的数据分类识别,具体通过,采集识别单元、传输识别单元、分析识别单元和处理识别单元分别接收预设的分类识别规则,并分别根据分类识别规则对采集的风电系统运行数据、第一采集数据、第一传输数据和第一分析数据进行紧急程度识别,当采集的风电系统运行数据、第一采集数据、第一传输数据或第一分析数据被标识为紧急数据时,对应的识别单元生成数据传输路径信息,数据采集模块、数据传输模块、数据分析模块和数据处理模块用于根据传输路径进行紧急数据的传输。For multi-stage data classification and identification, specifically, the collection and identification unit, the transmission and identification unit, the analysis and identification unit and the processing and identification unit respectively receive preset classification and identification rules, and respectively identify the urgency of the collected wind power system operation data, the first collection data, the first transmission data and the first analysis data according to the classification and identification rules. When the collected wind power system operation data, the first collection data, the first transmission data or the first analysis data is identified as emergency data, the corresponding identification unit generates data transmission path information, and the data collection module, the data transmission module, the data analysis module and the data processing module are used to transmit the emergency data according to the transmission path.

其中,传输路径信息主要包括风电系统运行数据的下一阶段传输路径或后续多个阶段的传输路径,具体则是根据采集识别单元、传输识别单元、分析识别单元和处理识别单元对风电系统运行数据类型的判断,例如:需要紧急分析和处理的风电系统运行数据,则在采集识别单元将其标识为采集紧急数据后,即生成风电系统运行数据经过数据传输模块和数据分析模块的传输路径。Among them, the transmission path information mainly includes the transmission path of the next stage or the transmission paths of subsequent multiple stages of the wind power system operation data. Specifically, it is based on the judgment of the type of wind power system operation data by the acquisition identification unit, the transmission identification unit, the analysis identification unit and the processing identification unit. For example, if the wind power system operation data needs to be urgently analyzed and processed, after the acquisition identification unit identifies it as emergency data, the transmission path of the wind power system operation data through the data transmission module and the data analysis module is generated.

对风电系统运行数据类型进行识别后,则通过监测模块实现对风电系统运行数据的监测传输、分析、处理及可视化,监测模块与采集识别单元、传输识别单元、分析识别单元、处理识别单元以及数据传输单元信号连接,监测模块用于获取被采集识别单元标识的采集紧急数据,并监测数据传输单元是否接收对应的采集紧急数据,若采集紧急数据未被数据传输单元接收,则将对应的采集紧急数据传输至运行负荷低于阈值的数据传输单元。同样地,数据分析模块和数据处理模块中未被对应数据分析单元分析或数据处理单元处理的数据,则将与采集紧急数据对应的第一传输数据或第一分析数据传输至运行负荷低于阈值的数据分析单元或数据处理单元,确保需要紧急传输、分析、处理或可视化的风电系统运行数据能够被高效处理。After the wind power system operation data type is identified, the monitoring module is used to realize the monitoring, transmission, analysis, processing and visualization of the wind power system operation data. The monitoring module is connected with the acquisition identification unit, the transmission identification unit, the analysis identification unit, the processing identification unit and the data transmission unit. The monitoring module is used to obtain the acquisition emergency data identified by the acquisition identification unit, and monitor whether the data transmission unit receives the corresponding acquisition emergency data. If the acquisition emergency data is not received by the data transmission unit, the corresponding acquisition emergency data is transmitted to the data transmission unit whose operating load is lower than the threshold. Similarly, the data in the data analysis module and the data processing module that has not been analyzed by the corresponding data analysis unit or processed by the data processing unit, the first transmission data or the first analysis data corresponding to the acquisition emergency data is transmitted to the data analysis unit or the data processing unit whose operating load is lower than the threshold, to ensure that the wind power system operation data that needs to be urgently transmitted, analyzed, processed or visualized can be efficiently processed.

对于各数据传输单元、数据分析单元、数据处理单元的运行负荷则通过状态采集模块获取,状态采集模块与数据传输单元、数据分析单元和数据处理单元信号连接,状态采集模块用于收集各数据传输单元、数据分析单元和数据处理单元的运行负荷(主动获取)。数据传输单元、数据分析单元和数据处理单元均用于在运行负荷低于阈值时反馈数据处理需求至状态采集模块(被动获取)。The operating load of each data transmission unit, data analysis unit, and data processing unit is obtained through the state acquisition module, which is connected to the data transmission unit, data analysis unit, and data processing unit signals. The state acquisition module is used to collect the operating load of each data transmission unit, data analysis unit, and data processing unit (active acquisition). The data transmission unit, data analysis unit, and data processing unit are all used to feedback the data processing requirements to the state acquisition module when the operating load is lower than the threshold (passive acquisition).

结合附图5所示,对本实施例的风电系统运行数据实时处理流程进行简述。首先,对风电系统运行数据进行数据采集,采集后,进行采集分类识别所采集的风电系统运行数据是否为紧急数据,若为紧急数据则进行传输路径规划,若为非紧急(常规)数据则按照原传输路径进行传输;随后,重复上述类似步骤依次对第一采集数据进行传输分类识别、对第一传输数据进行分析分类识别、对第一分析数据进行处理分类识别,过程中,对于紧急数据均重新规划传输路径,对于非紧急(常规)数据则均按照原传输路径进行传输。最终的数据分析和数据处理结果进行数据可视化,便于技术人员及时准确的获取到风电系统运行状态是否存在异常,并及时制定故障排除策略。In conjunction with FIG5 , the real-time processing flow of the wind power system operation data of this embodiment is briefly described. First, the wind power system operation data is collected. After the collection, the collected wind power system operation data is classified to identify whether it is emergency data. If it is emergency data, the transmission path is planned. If it is non-emergency (conventional) data, it is transmitted according to the original transmission path; then, the above-mentioned similar steps are repeated to sequentially perform transmission classification identification on the first collected data, analysis classification identification on the first transmission data, and processing classification identification on the first analysis data. During the process, the transmission path is re-planned for emergency data, and non-emergency (conventional) data is transmitted according to the original transmission path. The final data analysis and data processing results are visualized to facilitate technical personnel to timely and accurately obtain whether there are abnormalities in the operation status of the wind power system, and to formulate troubleshooting strategies in a timely manner.

实施例2:Embodiment 2:

与实施例1的不同之处在于,对于被标识为紧急数据的风电系统运行数据,还需根据其紧急程度满足其传输、分析、处理或可视化需求。具体地,监测模块用于在预设的时间间隔内监测到多个被标识为采集紧急数据时,监测模块用于在采集紧急数据对应的采集识别单元内获取采集紧急数据的紧急等级,并按照紧急等级依次生成多个采集紧急数据对应的数据传输路径信息。The difference from Example 1 is that, for wind power system operation data identified as emergency data, it is also necessary to meet its transmission, analysis, processing or visualization requirements according to its urgency. Specifically, when the monitoring module detects multiple data identified as collected emergency data within a preset time interval, the monitoring module is used to obtain the urgency level of the collected emergency data in the collection identification unit corresponding to the collected emergency data, and sequentially generate multiple data transmission path information corresponding to the collected emergency data according to the urgency level.

例如,所采集到的风电系统运行数据包括风电系统设备的故障信息,故障信息中包括有导致风电系统设备运行波动的数据以及导致风电系统设备运行错误的数据,则根据风电系统运行数据的紧急程度,通常情况下,对于可能导致风电系统设备运行错误的数据紧急等级更高,因此需要优先进行传输、分析、处理或可视化。For example, the collected wind power system operation data includes fault information of wind power system equipment, and the fault information includes data that causes fluctuations in the operation of the wind power system equipment and data that causes operational errors of the wind power system equipment. Based on the urgency of the wind power system operation data, generally, data that may cause operational errors of the wind power system equipment has a higher urgency level and therefore needs to be transmitted, analyzed, processed or visualized first.

此外,监测模块用于在各数据传输单元运行负荷均不小于阈值时,将采集紧急数据暂存,并在各数据传输单元之间切换进行采集紧急数据传输,直至具有数据传输单元运行负荷均小于阈值或采集紧急数据被数据传输单元接收,确保被分类为紧急的风电系统数据能够被快速传输、分析、处理或可视化。In addition, the monitoring module is used to temporarily store the collected emergency data when the operating load of each data transmission unit is not less than the threshold, and switch between the data transmission units to collect emergency data transmission until the operating load of the data transmission unit is less than the threshold or the collected emergency data is received by the data transmission unit, ensuring that the wind power system data classified as emergency can be quickly transmitted, analyzed, processed or visualized.

实施例3:Embodiment 3:

与实施例2的不同之处在于,监测模块用于对采集紧急数据被传输识别单元传输的进度、采集紧急数据对应的第一传输数据被数据分析模块分析的进度以及采集紧急数据对应的第一分析数据被数据处理模块处理的进度进行监测,并分别生成第一进度信息、第二进度信息以及第三进度信息。The difference from Example 2 is that the monitoring module is used to monitor the progress of the collected emergency data being transmitted by the transmission identification unit, the progress of the first transmission data corresponding to the collected emergency data being analyzed by the data analysis module, and the progress of the first analysis data corresponding to the collected emergency data being processed by the data processing module, and generate first progress information, second progress information and third progress information respectively.

监测模块用于接收第一处理速度阈值,并基于第一进度信息、第二进度信息以及第三进度信息获取采集紧急数据、采集紧急数据对应的第一传输数据或采集紧急数据对应的第一分析数据被传输、分析或处理的速度,并在传输、分析或处理的速度低于第一处理速度阈值时,发出提示信号。The monitoring module is used to receive a first processing speed threshold, and obtain the speed at which the collected emergency data, the first transmission data corresponding to the collected emergency data, or the first analysis data corresponding to the collected emergency data are transmitted, analyzed or processed based on the first progress information, the second progress information and the third progress information, and send a prompt signal when the transmission, analysis or processing speed is lower than the first processing speed threshold.

监测模块还用于接收第二处理速度阈值,并在采集紧急数据、采集紧急数据对应的第一传输数据或采集紧急数据对应的第一分析数据被传输、分析或处理的速度低于第二处理速度阈值时,生成切换信号。The monitoring module is also used to receive a second processing speed threshold and generate a switching signal when the speed at which the emergency data, the first transmission data corresponding to the emergency data, or the first analysis data corresponding to the emergency data is transmitted, analyzed or processed is lower than the second processing speed threshold.

数据传输单元、数据分析单元和数据处理单元用于监听切换信号,并在监听到所属的切换信号时,停止数据传输、分析或处理,并提取未处理完的采集紧急数据、采集紧急数据对应的第一传输数据或采集紧急数据对应的第一分析数据,并将未处理完的采集紧急数据、采集紧急数据对应的第一传输数据或采集紧急数据对应的第一分析数据传输至其他运行负荷低于阈值数据传输单元、数据分析单元或数据处理单元。The data transmission unit, the data analysis unit and the data processing unit are used to monitor the switching signal, and when the corresponding switching signal is monitored, stop data transmission, analysis or processing, and extract the unprocessed collected emergency data, the first transmission data corresponding to the collected emergency data, or the first analysis data corresponding to the collected emergency data, and transmit the unprocessed collected emergency data, the first transmission data corresponding to the collected emergency data, or the first analysis data corresponding to the collected emergency data to other data transmission units, data analysis units or data processing units whose operating load is lower than the threshold.

基于上述可以明确,本实施例通过设定第一处理速度阈值和第二处理速度阈值,对于处理速度大于第一处理速度阈值的风电系统数据则不做进一步干涉,对于处理速度位于第一处理速度阈值和第二处理速度阈值之间的风电系统数据,则需要优先给予用户提示,让用户获知该情况的存在,对于处理速度小于第二处理速度阈值的风电系统数据,则需要进行单元的切换,确保其能够被有效传输、分析、处理或可视化。Based on the above, it can be clearly seen that this embodiment sets the first processing speed threshold and the second processing speed threshold, and does not further interfere with the wind power system data whose processing speed is greater than the first processing speed threshold. For the wind power system data whose processing speed is between the first processing speed threshold and the second processing speed threshold, it is necessary to give priority to the user prompt to let the user know the existence of this situation. For the wind power system data whose processing speed is less than the second processing speed threshold, it is necessary to switch the unit to ensure that it can be effectively transmitted, analyzed, processed or visualized.

对于风电系统数据处理速度的判断则通过如下方式进行:通过数据采集单元为被标识为采集紧急数据的第一采集数据增加时间戳,数据传输单元计算实际传输完成被标识为采集紧急数据的第一采集数据的时间与时间戳之间的时延,监测模块用于根据时延判断数据传输速度是否低于第一处理速度阈值和第二处理速度阈值。对于数据分析单元与数据传输单元之间的数据,则通过数据传输单元为被标识为采集紧急数据对应的第一传输数据增加时间戳,数据分析单元计算实际分析完成被标识为采集紧急数据对应的第一传输数据的时间与时间戳之间的时延。对于数据处理单元与数据分析单元之间的风电系统数据,则同理。The judgment of the data processing speed of the wind power system is carried out in the following manner: the data acquisition unit adds a timestamp to the first collected data identified as collecting emergency data, the data transmission unit calculates the time delay between the time when the first collected data identified as collecting emergency data is actually transmitted and the timestamp, and the monitoring module is used to judge whether the data transmission speed is lower than the first processing speed threshold and the second processing speed threshold according to the time delay. For the data between the data analysis unit and the data transmission unit, the data transmission unit adds a timestamp to the first transmission data corresponding to the identified as collecting emergency data, and the data analysis unit calculates the time delay between the time when the first transmission data identified as collecting emergency data is actually analyzed and the timestamp. The same is true for the wind power system data between the data processing unit and the data analysis unit.

显然,上述实施例仅仅是为清楚地说明所作的举例,而并非对实施方式的限定。对于所属领域的普通技术人员来说,在上述说明的基础上还可以做出其它不同形式的变化或变动。这里无需也无法对所有的实施方式予以穷举。而由此所引伸出的显而易见的变化或变动仍处于本发明创造的保护范围之中。Obviously, the above embodiments are merely examples for the purpose of clear explanation, and are not intended to limit the implementation methods. For those skilled in the art, other different forms of changes or modifications can be made based on the above description. It is not necessary and impossible to list all the implementation methods here. The obvious changes or modifications derived therefrom are still within the scope of protection of the invention.

Claims (9)

1.一种基于深度学习的大数据实时分析处理装置,其特征在于,包括:1. A big data real-time analysis and processing device based on deep learning, characterized by comprising: 数据采集模块,包括若干数据采集单元以及若干采集识别单元,数据采集单元用于对风电系统运行数据进行采集,风电系统运行数据包括环境数据、性能数据、运行数据和监控数据,采集识别单元用于对数据采集单元采集的风电系统运行数据进行分类识别,数据采集单元还用于根据风电系统运行数据的分类识别结果对所采集的风电系统运行数据进行标识,生成第一采集数据;A data acquisition module, comprising a plurality of data acquisition units and a plurality of acquisition and identification units, wherein the data acquisition units are used to acquire wind power system operation data, the wind power system operation data including environmental data, performance data, operation data and monitoring data, and the acquisition and identification units are used to classify and identify the wind power system operation data acquired by the data acquisition units, and the data acquisition units are further used to identify the acquired wind power system operation data according to the classification and identification results of the wind power system operation data, and generate first acquisition data; 数据传输模块,包括若干数据传输单元以及若干传输识别单元,数据传输单元用于接收第一采集数据,传输识别单元用于对数据传输单元接收的第一采集数据进行分类识别,数据传输单元还用于根据第一采集数据的分类识别结果对第一采集数据进行标识,生成第一传输数据;The data transmission module includes a plurality of data transmission units and a plurality of transmission identification units, wherein the data transmission unit is used to receive the first collected data, the transmission identification unit is used to classify and identify the first collected data received by the data transmission unit, and the data transmission unit is further used to identify the first collected data according to the classification and identification result of the first collected data to generate the first transmission data; 数据分析模块,包括若干数据分析单元以及若干分析识别单元,数据分析单元用于接收第一传输数据,分析识别单元用于对数据分析单元接收的第一传输数据进行分类识别,数据分析单元用于根据第一传输数据的分类识别结果对第一传输数据进行标识,生成第一分析数据,并对第一分析数据进行分析;The data analysis module includes a plurality of data analysis units and a plurality of analysis and identification units, wherein the data analysis unit is used to receive the first transmission data, the analysis and identification unit is used to classify and identify the first transmission data received by the data analysis unit, the data analysis unit is used to identify the first transmission data according to the classification and identification result of the first transmission data, generate first analysis data, and analyze the first analysis data; 数据处理模块,包括若干数据处理单元以及若干处理识别单元,数据处理单元用于接收第一分析数据,处理识别单元用于对数据处理单元接收的第一分析数据进行分类识别,数据处理单元用于根据第一分析数据的分类识别结果对第一分析数据进行标识,生成第一处理数据,并对第一处理数据进行处理;The data processing module includes a plurality of data processing units and a plurality of processing identification units, wherein the data processing unit is used to receive the first analysis data, the processing identification unit is used to classify and identify the first analysis data received by the data processing unit, the data processing unit is used to identify the first analysis data according to the classification and identification result of the first analysis data, generate first processing data, and process the first processing data; 数据可视化模块,用于接收并可视化第一分析数据的分析结果和第一处理数据的处理结果,基于第一分析数据的分析结果和第一处理数据的处理结果诊断风电系统运行状态;a data visualization module, configured to receive and visualize an analysis result of the first analysis data and a processing result of the first processing data, and diagnose an operating state of the wind power system based on the analysis result of the first analysis data and the processing result of the first processing data; 采集识别单元、传输识别单元、分析识别单元和处理识别单元用于接收预设的分类识别规则,并分别根据分类识别规则分别对采集的风电系统运行数据、第一采集数据、第一传输数据和第一分析数据进行紧急程度识别,当采集的风电系统运行数据、第一采集数据、第一传输数据或第一分析数据被标识为紧急数据时,对应的识别单元生成数据传输路径信息,数据采集模块、数据传输模块、数据分析模块和数据处理模块用于根据传输路径信息进行紧急数据的传输;The collection identification unit, the transmission identification unit, the analysis identification unit and the processing identification unit are used to receive preset classification identification rules, and identify the urgency of the collected wind power system operation data, the first collection data, the first transmission data and the first analysis data according to the classification identification rules. When the collected wind power system operation data, the first collection data, the first transmission data or the first analysis data is identified as emergency data, the corresponding identification unit generates data transmission path information, and the data collection module, the data transmission module, the data analysis module and the data processing module are used to transmit the emergency data according to the transmission path information; 其中,采集识别单元基于深度学习模型构建,采集识别单元用于将所采集的风电系统运行数据标识为采集紧急数据后,生成传输路径信息,传输路径信息包括被标识为采集紧急数据的风电系统运行数据的下一阶段传输路径或后续多个阶段的传输路径;The acquisition and identification unit is constructed based on a deep learning model, and is used to identify the collected wind power system operation data as collected emergency data, and then generate transmission path information, wherein the transmission path information includes the next stage transmission path or subsequent multiple stage transmission paths of the wind power system operation data identified as collected emergency data; 采集识别单元还用于并基于预设的紧急程度特征值对采集的风电系统运行数据进行紧急程度判断,当紧急程度特征值大于阈值时,采集识别单元将采集的风电系统运行数据标识为采集紧急数据,其中,紧急程度特征值为风电系统运行数据中长期处于波动状态的数据,阈值为判断运行长期处于波动状态的数据是否为紧急信息的依据。The collection and identification unit is also used to judge the urgency of the collected wind power system operation data based on a preset urgency characteristic value. When the urgency characteristic value is greater than a threshold value, the collection and identification unit will identify the collected wind power system operation data as collection emergency data, wherein the urgency characteristic value is data in a long-term fluctuating state in the wind power system operation data, and the threshold value is the basis for judging whether the data in a long-term fluctuating state is emergency information. 2.根据权利要求1所述的基于深度学习的大数据实时分析处理装置,其特征在于,还包括监测模块,监测模块与采集识别单元、传输识别单元、分析识别单元、处理识别单元以及数据传输单元信号连接,监测模块用于获取被采集识别单元标识的采集紧急数据,并监测数据传输单元是否接收对应的采集紧急数据,若采集紧急数据未被数据传输单元接收,则将对应的采集紧急数据传输至任意一个运行负荷低于阈值的数据传输单元。2. According to the deep learning-based big data real-time analysis and processing device according to claim 1, it is characterized in that it also includes a monitoring module, which is signal-connected to the collection and identification unit, the transmission identification unit, the analysis and identification unit, the processing identification unit and the data transmission unit. The monitoring module is used to obtain the collection emergency data identified by the collection and identification unit, and monitor whether the data transmission unit receives the corresponding collection emergency data. If the collection emergency data is not received by the data transmission unit, the corresponding collection emergency data is transmitted to any data transmission unit whose operating load is lower than the threshold. 3.根据权利要求2所述的基于深度学习的大数据实时分析处理装置,其特征在于,监测模块还与数据分析单元和数据处理单元信号连接;3. The big data real-time analysis and processing device based on deep learning according to claim 2, characterized in that the monitoring module is also signal-connected to the data analysis unit and the data processing unit; 监测模块用于监测采集紧急数据对应的第一传输数据是否被对应的数据分析单元接收,若采集紧急数据对应的第一传输数据未被对应的数据分析单元接收,则将采集紧急数据对应的第一传输数据传输至任意一个运行负荷低于阈值的数据分析单元;The monitoring module is used to monitor whether the first transmission data corresponding to the collected emergency data is received by the corresponding data analysis unit, and if the first transmission data corresponding to the collected emergency data is not received by the corresponding data analysis unit, the first transmission data corresponding to the collected emergency data is transmitted to any data analysis unit whose operating load is lower than a threshold; 监测模块用于监测采集紧急数据对应的第一分析数据是否被数据处理单元接收,若采集紧急数据对应的第一分析数据未被对应的数据处理单元接收,则将采集紧急数据对应的第一分析数据传输至任意一个运行负荷低于阈值的数据处理单元。The monitoring module is used to monitor whether the first analysis data corresponding to the collected emergency data is received by the data processing unit. If the first analysis data corresponding to the collected emergency data is not received by the corresponding data processing unit, the first analysis data corresponding to the collected emergency data is transmitted to any data processing unit whose operating load is lower than the threshold. 4.根据权利要求3所述的基于深度学习的大数据实时分析处理装置,其特征在于,监测模块用于在预设的时间间隔内监测到多个被标识为采集紧急数据时,监测模块用于在采集紧急数据对应的采集识别单元内获取采集紧急数据的紧急等级,并按照紧急等级依次生成多个采集紧急数据对应的数据传输路径信息。4. According to the deep learning-based big data real-time analysis and processing device of claim 3, it is characterized in that the monitoring module is used to monitor multiple data identified as collected emergency data within a preset time interval, and the monitoring module is used to obtain the urgency level of the collected emergency data in the collection identification unit corresponding to the collected emergency data, and generate multiple data transmission path information corresponding to the collected emergency data in sequence according to the urgency level. 5.根据权利要求2所述的基于深度学习的大数据实时分析处理装置,其特征在于,监测模块还用于对采集紧急数据被传输识别单元传输的进度、采集紧急数据对应的第一传输数据被数据分析模块分析的进度以及采集紧急数据对应的第一分析数据被数据处理模块处理的进度进行监测,并分别生成第一进度信息、第二进度信息以及第三进度信息;5. The big data real-time analysis and processing device based on deep learning according to claim 2 is characterized in that the monitoring module is also used to monitor the progress of the collected emergency data being transmitted by the transmission identification unit, the progress of the first transmission data corresponding to the collected emergency data being analyzed by the data analysis module, and the progress of the first analysis data corresponding to the collected emergency data being processed by the data processing module, and respectively generate the first progress information, the second progress information and the third progress information; 监测模块用于接收第一处理速度阈值,并基于第一进度信息、第二进度信息以及第三进度信息获取采集紧急数据、采集紧急数据对应的第一传输数据或采集紧急数据对应的第一分析数据被传输、分析或处理的速度,并在传输、分析或处理的速度低于第一处理速度阈值时,发出提示信号。The monitoring module is used to receive a first processing speed threshold, and obtain the speed at which the collected emergency data, the first transmission data corresponding to the collected emergency data, or the first analysis data corresponding to the collected emergency data are transmitted, analyzed or processed based on the first progress information, the second progress information and the third progress information, and send a prompt signal when the transmission, analysis or processing speed is lower than the first processing speed threshold. 6.根据权利要求5所述的基于深度学习的大数据实时分析处理装置,其特征在于,监测模块还用于接收第二处理速度阈值,并在采集紧急数据、采集紧急数据对应的第一传输数据或采集紧急数据对应的第一分析数据被传输、分析或处理的速度低于第二处理速度阈值时,生成切换信号;6. The big data real-time analysis and processing device based on deep learning according to claim 5 is characterized in that the monitoring module is also used to receive a second processing speed threshold, and generate a switching signal when the speed at which the emergency data, the first transmission data corresponding to the emergency data, or the first analysis data corresponding to the emergency data are transmitted, analyzed, or processed is lower than the second processing speed threshold; 数据传输单元、数据分析单元和数据处理单元用于监听切换信号,并在监听到所属的切换信号时,停止数据传输、分析或处理,并提取未处理完的采集紧急数据、采集紧急数据对应的第一传输数据或采集紧急数据对应的第一分析数据,并将未处理完的采集紧急数据、采集紧急数据对应的第一传输数据或采集紧急数据对应的第一分析数据传输至其他运行负荷低于阈值数据传输单元、数据分析单元或数据处理单元。The data transmission unit, the data analysis unit and the data processing unit are used to monitor the switching signal, and when the corresponding switching signal is monitored, stop data transmission, analysis or processing, and extract the unprocessed collected emergency data, the first transmission data corresponding to the collected emergency data, or the first analysis data corresponding to the collected emergency data, and transmit the unprocessed collected emergency data, the first transmission data corresponding to the collected emergency data, or the first analysis data corresponding to the collected emergency data to other data transmission units, data analysis units or data processing units whose operating load is lower than the threshold. 7.根据权利要求2所述的基于深度学习的大数据实时分析处理装置,其特征在于,还包括状态采集模块,状态采集模块与数据传输单元、数据分析单元和数据处理单元信号连接,状态采集模块用于收集各数据传输单元、数据分析单元和数据处理单元的运行负荷;7. The big data real-time analysis and processing device based on deep learning according to claim 2 is characterized in that it also includes a state acquisition module, the state acquisition module is connected to the data transmission unit, the data analysis unit and the data processing unit by signal, and the state acquisition module is used to collect the operation load of each data transmission unit, the data analysis unit and the data processing unit; 数据传输单元、数据分析单元和数据处理单元均用于在运行负荷低于阈值时反馈数据处理需求至状态采集模块。The data transmission unit, the data analysis unit and the data processing unit are all used to feed back the data processing requirements to the status acquisition module when the operating load is lower than the threshold. 8.根据权利要求7所述的基于深度学习的大数据实时分析处理装置,其特征在于,监测模块用于在各数据传输单元运行负荷均不小于阈值时,将采集紧急数据暂存,并在各数据传输单元之间切换进行采集紧急数据传输,直至具有数据传输单元运行负荷均小于阈值或采集紧急数据被数据传输单元接收。8. The big data real-time analysis and processing device based on deep learning according to claim 7 is characterized in that the monitoring module is used to temporarily store the collected emergency data when the operating load of each data transmission unit is not less than a threshold value, and switch between the data transmission units to transmit the collected emergency data until the operating load of the data transmission unit is less than the threshold value or the collected emergency data is received by the data transmission unit. 9.根据权利要求6所述的基于深度学习的大数据实时分析处理装置,其特征在于,数据采集单元用于为被标识为采集紧急数据的第一采集数据增加时间戳;9. The big data real-time analysis and processing device based on deep learning according to claim 6, characterized in that the data acquisition unit is used to add a timestamp to the first collected data identified as collected urgent data; 数据传输单元用于计算实际传输完成被标识为采集紧急数据的第一采集数据的时间与时间戳之间的时延,监测模块用于根据时延判断数据传输速度是否低于第一处理速度阈值和第二处理速度阈值。The data transmission unit is used to calculate the delay between the time when the first collected data marked as collected urgent data is actually transmitted and the timestamp, and the monitoring module is used to determine whether the data transmission speed is lower than the first processing speed threshold and the second processing speed threshold according to the delay.
CN202410920021.9A 2024-07-10 2024-07-10 A big data real-time analysis and processing device based on deep learning Active CN118468164B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202410920021.9A CN118468164B (en) 2024-07-10 2024-07-10 A big data real-time analysis and processing device based on deep learning

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202410920021.9A CN118468164B (en) 2024-07-10 2024-07-10 A big data real-time analysis and processing device based on deep learning

Publications (2)

Publication Number Publication Date
CN118468164A CN118468164A (en) 2024-08-09
CN118468164B true CN118468164B (en) 2024-10-18

Family

ID=92157779

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202410920021.9A Active CN118468164B (en) 2024-07-10 2024-07-10 A big data real-time analysis and processing device based on deep learning

Country Status (1)

Country Link
CN (1) CN118468164B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116030604A (en) * 2022-12-21 2023-04-28 浙江方大智控科技有限公司 Intelligent monitoring alarm system
CN117575332A (en) * 2024-01-12 2024-02-20 唐山伟仁建筑工程有限公司 Road construction safety monitoring method and system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3278480A4 (en) * 2015-04-02 2018-10-03 Sedonasys Systems Ltd. Systems and methods for managing multi-layer communication networks

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116030604A (en) * 2022-12-21 2023-04-28 浙江方大智控科技有限公司 Intelligent monitoring alarm system
CN117575332A (en) * 2024-01-12 2024-02-20 唐山伟仁建筑工程有限公司 Road construction safety monitoring method and system

Also Published As

Publication number Publication date
CN118468164A (en) 2024-08-09

Similar Documents

Publication Publication Date Title
CN108562854B (en) An online warning method for motor abnormal state
CN114819415B (en) Power equipment fault prediction system based on data analysis
CN108376298A (en) A kind of Wind turbines generator-temperature detection fault pre-alarming diagnostic method
CN108347352B (en) Method for diagnosing performance of information system and equipment in power system
CN118101429B (en) A method and system for diagnosing communication faults in a distribution network
CN116820014B (en) Intelligent monitoring and early warning method and system for traffic electromechanical equipment
CN114255784A (en) A fault diagnosis method and related device for substation equipment based on voiceprint recognition
CN119030151A (en) A real-time monitoring method for abnormal operation status of energy storage power generation system
CN115977855A (en) Hydropower station fault diagnosis system based on artificial intelligence
CN118589997A (en) A method and system for predicting faults of photovoltaic inverters
CN119625953B (en) An abnormal early warning system for power equipment used in mobile terminals
CN113177646A (en) Power distribution equipment online monitoring method and system based on self-adaptive edge proxy
CN118937873B (en) Fault diagnosis system and method suitable for micro-grid
CN111456915A (en) Fault diagnosis device and method for internal components of fan engine room
CN118468164B (en) A big data real-time analysis and processing device based on deep learning
CN114487705A (en) Power grid equipment fault positioning detection method
CN118568630A (en) Intelligent monitoring system for running state of converter based on data analysis
CN118842177A (en) Power supply service command auxiliary decision-making system and method based on database
CN117878931A (en) An emergency energy dispatching system and method for a new energy power station
CN114997333B (en) Fault diagnosis method and device for wind driven generator
CN113591909B (en) Abnormality detection method for power system, abnormality detection device, and storage medium
CN119148017B (en) High-voltage cable monitoring method of split structure
CN113608074B (en) Automatic online monitoring method and system for multi-epitope withstand voltage test device
CN118536974A (en) Intelligent monitoring method and system for operation state of electrical equipment
CN120256244A (en) Distributed energy data monitoring method, device, equipment and medium based on cloud platform

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant