CN117632636A - Data quality diagnosis method and system based on composite channel state - Google Patents
Data quality diagnosis method and system based on composite channel state Download PDFInfo
- Publication number
- CN117632636A CN117632636A CN202311463347.5A CN202311463347A CN117632636A CN 117632636 A CN117632636 A CN 117632636A CN 202311463347 A CN202311463347 A CN 202311463347A CN 117632636 A CN117632636 A CN 117632636A
- Authority
- CN
- China
- Prior art keywords
- channel
- real
- data
- item
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000002131 composite material Substances 0.000 title claims abstract description 32
- 238000003745 diagnosis Methods 0.000 title claims abstract description 30
- 238000000034 method Methods 0.000 title claims abstract description 27
- 238000012544 monitoring process Methods 0.000 claims abstract description 128
- 238000012545 processing Methods 0.000 claims description 39
- 238000004891 communication Methods 0.000 claims description 24
- 238000002405 diagnostic procedure Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 6
- 230000000153 supplemental effect Effects 0.000 claims description 5
- 238000001914 filtration Methods 0.000 claims description 3
- 230000001502 supplementing effect Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 4
- 230000000295 complement effect Effects 0.000 description 3
- 230000007547 defect Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001902 propagating effect Effects 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3041—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is an input/output interface
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Quality & Reliability (AREA)
- Computational Linguistics (AREA)
- Mathematical Physics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
A data quality diagnosis method and system based on composite channel state. The method includes selecting a main channel from a plurality of channels according to channel status and channel priority; acquiring an effective time configuration value, collecting real-time monitoring data packets of each channel, and calculating a Key value; inquiring an item associated with the Key value in a lookup table, and updating the item based on the channel information and the effective time configuration value of the real-time monitoring data packet; scanning a lookup table, setting a backup channel supplementary mark for a table item which comes from the backup channel and exceeds an effective time configuration value, writing the table item into a real-time monitoring database, and generating real-time alarm information; and displaying the real-time alarm information. The scheme of the invention can effectively avoid the occurrence of the missing monitoring event and improve the quality of the monitoring data.
Description
Technical Field
The invention belongs to the field of computer monitoring, and particularly relates to a data quality diagnosis method and system based on a composite channel state.
Background
The substation equipment centralized monitoring system is an intelligent monitoring technical support system for power transformation equipment, provides technical support for operation monitoring, operation and control, monitoring assistants, service management, remote intelligent inspection and other services of the equipment, and is a specific application of the computer monitoring system in the power industry.
The front data acquisition is the throat part of the centralized monitoring system of the substation equipment, and almost all on-site real-time monitoring data needs to enter the centralized monitoring system of the substation equipment through the front data acquisition subsystem, so that the scalability and usability of the front data acquisition subsystem are very important. In addition, the number of substations accessed and monitored by the centralized monitoring system of the substation equipment is numerous, and the access capability of the front data acquisition subsystem becomes an important technical index of the centralized monitoring system of the substation equipment. In the front-end data acquisition subsystem, the front-end acquisition server is responsible for communicating with RTUs (Remote Terminal Unit remote terminal units) accessed by all substations, and collecting and processing the uploaded real-time monitoring data.
In order to increase stability and reliability of collecting real-time monitoring data packets of a transformer substation, a centralized monitoring system of transformer substation equipment adopts a plurality of (usually 4) communication channels to simultaneously connect two RTUs of the transformer substation, and simultaneously collects real-time monitoring data of the transformer substation. In the scheme adopted by the prior art, one main channel is generally selected from a plurality of communication channels, other communication channels are hot standby, real-time monitoring data acquired by the main channel are used for monitoring substation equipment, and only when the main channel is abnormal and cannot normally communicate, one channel is selected from the hot standby channels to serve as the main channel. This means that essentially only one active communication channel is collecting, thus possibly resulting in a missing supervision event.
Disclosure of Invention
In order to solve the defects in the prior art, the invention provides a data quality diagnosis method and a data quality diagnosis system based on a composite channel state, so as to solve the problem of full utilization of a standby channel real-time monitoring data packet.
In order to solve the technical problems, the invention adopts the following technical scheme.
The invention firstly discloses a data quality diagnosis method based on a composite channel state, which comprises the following steps:
step 1, selecting a main channel from a plurality of channels of a centralized monitoring system of substation equipment according to channel states and channel priorities of the channels, and taking other channels as standby channels;
step 2, acquiring an effective time configuration value, acquiring real-time monitoring data packets of all channels, and calculating Key values of the real-time monitoring data packets, wherein the effective time configuration value represents the maximum time deviation value of the same monitoring data packet sent by a main channel and a standby channel;
step 3, inquiring an item associated with the Key value in a preset lookup table, and performing an item updating operation based on the channel information of the real-time monitoring data packet and the effective time configuration value, wherein the channel information of the real-time monitoring data packet comprises the main channel or the standby channel;
step 4, scanning the lookup table according to a preset period, setting a backup channel supplementary mark for the table items which come from the backup channel and exceed the effective time configuration value, and writing all the current table items in the lookup table into a real-time monitoring database to generate real-time alarm information with the backup channel supplementary mark;
and step 5, writing the real-time alarm information into a history database and displaying the real-time alarm information.
The invention further comprises the following preferable schemes:
the step 1 further comprises:
the communication channels with the channel states which are not input and are not refreshed are filtered, and the communication channels with the filtered states which are input form a channel queue according to the order of the channel priorities from high to low;
sequentially adding the communication channels which are not refreshed after the filtering into the channel queue according to the channel priority;
sequentially adding the filtered channels into the channel queue according to the channel priority;
and selecting the head channel in the channel queue as a main channel, and the other channels are standby channels.
In step 2, the calculating the Key value of the real-time monitoring data packet further includes:
collecting RTU ID, channel ID, data point number, main channel, data value, quality code, data uploading time mark, data point ID, data point component number of the real-time monitoring data packet, and calculating Key value by using RTU ID and data point number:
key=rtu ID 100000+ data point number.
In step 3, the step of querying an entry associated with the Key value in a preset lookup table, and performing an entry update operation based on the channel information of the real-time monitoring data packet and the valid time configuration value, further includes:
the lookup table map_reinf is a C++ STLmap container, namely std is map < Key, item > and is used for storing a Key value pair < Key, item >;
if the item associated with the Key is not found in the lookup table map_reinf, converting the real-time monitoring data packet into item and storing the item into a value associated with the Key in map_reinf;
if the item associated with the Key is found in the map_reinf, judging channel information in a real-time monitoring data packet;
when channel information in the real-time monitoring data packet indicates that the data packet is from a main channel, converting the real-time monitoring data packet into item, and updating and replacing item associated with the Key value in map_reinf;
when the channel information in the real-time monitoring data packet indicates that the data packet comes from the standby channel, further judging the data validity period, and if the item associated with the Key value is main channel data and within the validity period, namely the difference between the current time mark of the operating system and the uploading time mark in the item is smaller than the valid time configuration value, not processing the channel real-time monitoring data packet; otherwise, converting the real-time monitoring data packet into item, and updating and replacing item associated with Key value in map_reinf.
In step 4, the step of scanning the lookup table according to a preset period, and setting a backup channel supplementary flag for a table entry from the backup channel and exceeding a valid time configuration value, further includes:
scanning all table item items in the map_reinf, if the table item is backup channel data and exceeds the valid period, namely the difference between the current time mark of the operating system and the uploading time mark in the item is not smaller than the valid time configuration value, converting the item into a data object DiWithTm, storing the data object DiWithTm in a container vec_cos, and setting item.valid to 0; wherein the data object DiWithTm comprises a data value, a quality code, a data upload time stamp, a data point ID, and a data point component number, and the quality code comprises a backup channel supplemental mark.
The invention also discloses a data quality diagnosis system based on the composite channel state by utilizing the data quality diagnosis method based on the composite channel state, which comprises a main channel diagnosis module, a data quality diagnosis module, a data processing module and an alarm processing module.
The main channel diagnosis module is used for selecting a main channel from a plurality of channels of the substation equipment centralized monitoring system according to channel states and channel priorities of the plurality of channels, and taking other channels as standby channels;
the data quality diagnosis module is used for acquiring effective time configuration values, collecting real-time monitoring data packets of all channels, and calculating Key values of the real-time monitoring data packets, wherein the effective time configuration values represent maximum time deviation values of the same monitoring data packet sent by the main channel and the standby channel; inquiring an item associated with the Key value in a preset lookup table, and performing an item updating operation based on the channel information of the real-time monitoring data packet and the effective time configuration value, wherein the channel information of the real-time monitoring data packet comprises the main channel or the standby channel;
the data processing module is used for scanning the lookup table according to a preset period, setting a backup channel supplementary mark for the table items which come from the backup channel and exceed the effective time configuration value, writing all the current table items in the lookup table into a real-time monitoring database, and generating real-time alarm information with the backup channel supplementary mark;
and the alarm processing module is used for writing the real-time alarm information into a historical database and displaying the real-time alarm information.
Correspondingly, the application also discloses a terminal, which comprises a processor and a storage medium;
the storage medium is used for storing instructions;
the processor is operative in accordance with the instructions to perform the steps of the data quality diagnostic method in accordance with the composite channel state described previously.
Accordingly, the present application also discloses a computer readable storage medium having stored thereon a computer program which when executed by a processor implements the steps of the aforementioned composite channel state-based data quality diagnostic method.
Compared with the prior art, the invention provides the data quality diagnosis method and the system based on the composite channel state, which are used for diagnosing the real-time monitoring data sent by a plurality of communication channels of the same transformer substation, diagnosing the communication quality of the main channel of the transformer substation, monitoring by utilizing the real-time monitoring data received by the hot standby channel when the main channel loses the monitoring data under the condition of no interruption, supplementing the real-time monitoring data lost by the main communication channel, and supplementing special marks by the backup channel when the supplemented real-time monitoring data quality code is provided, thereby effectively avoiding the occurrence of missing monitoring events, providing auxiliary decisions for the overhaul of the communication channel and improving the quality of the monitoring data.
Drawings
Fig. 1 is a schematic diagram of a data quality diagnostic system based on a composite channel state in the present invention.
Fig. 2 is a flow chart of a data quality diagnostic method based on a composite channel status in the present invention.
Fig. 3 is a detailed flowchart of a data quality diagnosis method according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.
The embodiments described herein are merely some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art without making any inventive effort, are within the scope of the present invention.
Aiming at the defects of the prior art, the invention provides a data quality diagnosis method and a system based on a composite channel state, which are used for collecting multi-channel real-time monitoring data, gathering and comparing all channel data by selecting a main channel and using the same data point numbers, reserving and using standby channel real-time monitoring data meeting the conditions, avoiding the occurrence of a missing monitoring event and providing an auxiliary decision for channel overhaul.
As shown in fig. 1, the general architecture of the present invention includes a main channel diagnosis module, a data quality diagnosis module, a data processing module, and an alarm processing module. The main channel diagnostic module selects a main channel from a plurality of channels based on each channel status and priority. The data quality diagnosis module receives real-time monitoring data of each channel, wherein the real-time monitoring data comprises a data point number, an RTU ID, a main channel, a numerical value, a current time scale, a quality code and the like, the RTU ID and the data point number are used for calculating a Key value, and the data of the corresponding point number is stored in a map_reinf associated with the Key value. If the data of the main channel does not exist in the preset time range, the data is set to be provided with the channel to supplement the quality code, and then the data is sent to the data processing module through a message. The data processing module receives and processes the information, updates the real-time monitoring database after processing, comprises a backup channel supplementing quality code, and sends alarm information and the backup channel supplementing mark. The alarm processing module processes the generated alarm information, processes the alarm information and the backup channel supplementary mark, stores the processed alarm information and the backup channel supplementary mark into the historical database, displays an alarm window, and displays the backup channel supplementary mark. The man-machine interface can intuitively diagnose that the main channel has quality defects according to the auxiliary channel supplementary marks, and provides basis for channel overhaul.
Referring to fig. 1, the data quality diagnosis method based on the composite channel state disclosed by the invention comprises the following steps:
step 1: and selecting a main channel from the channels according to the channel states and the channel priorities of the channels of the substation equipment centralized monitoring system, and taking other channels as standby channels.
A main channel is selected from a plurality of channels according to channel states and channel priorities of the respective channels. Wherein the channel states are non-negative integer values, each valid non-negative integer value corresponding to a unique channel state. The channel priority is a non-negative integer value, the smaller the value the higher the priority it represents.
Specifically, the communication channels with the channel states not being 'input' and not being 'not refreshed' are filtered, the communication channels with the filtered states being 'input' are formed into a channel queue according to the order of the channel priority from high to low, the communication channels with the filtered states being 'not refreshed' are sequentially added into the channel queue according to the channel priority, the filtered channels are sequentially added into the channel queue according to the channel priority, the first channel in the channel queue is selected as a main channel, and other channels are all standby channels.
Step 2: acquiring an effective time configuration value, acquiring real-time monitoring data packets of all channels, and calculating Key values of the real-time monitoring data packets, wherein the effective time configuration value represents the maximum time deviation value of the same monitoring data packet sent by the main channel and the standby channel.
Firstly, analyzing a configuration file, and analyzing and extracting the maximum time deviation value of the same data sent by a globally unique main and standby channel from the configuration file. Specifically, the method includes analyzing a configuration file, and extracting an effective time configuration value interval from the configuration file, wherein the unit is seconds.
Analyzing and collecting real-time monitoring data packets of all channels, wherein the real-time monitoring data packets comprise RTU ID, channel ID, data point number, whether a main channel exists, a data value, a quality code, a data uploading time mark, data point ID, data point component number and the like, and calculating Key value by using the RTU ID and the data point number.
According to a specific embodiment, the formula for calculating the Key value is:
key=rtu ID 100000+ data point number
Step 3: inquiring an item associated with the Key value in a preset lookup table, and performing an item updating operation based on the channel information of the real-time monitoring data packet and the effective time configuration value, wherein the channel information of the real-time monitoring data packet comprises the main channel or the standby channel.
And searching whether a table item associated with the Key exists in a preset lookup table map_reinf by using the Key. The lookup table map_reinf is a C++ STLmap container, namely std is that map < Key, item > is used for storing a Key value pair < Key, item >, and the value type is the same as the item type. item is a unique data object that contains valid, RTU ID, channel ID, data point number, data value, quality code, data upload time stamp, data point ID, data point component number, etc.
If the item associated with the Key is not found in the map_reinf, which indicates that the data packet is sent for the first time, converting the channel real-time monitoring data packet into the item and storing the item into the value associated with the Key in the map_reinf. The item-valid is set according to the information value of the data item 'whether the main channel' in the channel real-time monitoring data packet, if the channel is the main channel information, the item-valid is set to 0, otherwise, the item-valid is set to 1.
In a specific embodiment, converting the channel real-time monitoring data packet into items further includes directly assigning member values in the channel real-time monitoring data objects to members of the same name in the object item.
If the item associated with the Key is found in the map_reinf, judging channel information in the real-time monitoring data packet, namely a main channel field.
When the field of 'main channel' in the channel real-time monitoring data packet is 'yes', the data packet is from the main channel, and after the channel real-time monitoring data packet is converted into item, the item associated with the Key value in the map_reinf is updated and replaced.
Otherwise, when the channel real-time monitoring data packet is in the 'no' state of the 'main channel' field, further judging the data validity period. If item associated with Key value is main channel data and the difference between the current time scale of the operating system and the uploading time scale in item is smaller than interval in the effective period, not processing channel real-time monitoring data packet; otherwise, if the item associated with the Key value is standby channel data or is not in the validity period, after the channel real-time monitoring data packet is converted into the item, updating and replacing the item associated with the Key value in the map_reinf.
Step 4: and scanning the lookup table according to a preset period, setting a backup channel supplementary mark for the table items which come from the backup channel and exceed the effective time configuration value, writing all the current table items in the lookup table into a real-time monitoring database, and generating real-time alarm information with the backup channel supplementary mark.
Scanning all item items in map_reinf in 1 second period, if the item is backup channel data and exceeds the validity period, indicating that the main channel data is missing, and the difference between the current time scale of the operating system and the time scale of the item, which is sent up, is not smaller than interval, the item is converted into DiWithTm and then stored in a container vec_cos, and item.valid is set to 0. DiWithTm is a unique data object comprising a data value, a quality code, a data upload time stamp, a data point ID, a data point component number, etc., wherein the quality code comprises a backup channel supplemental tag.
Preferably, converting the item to DiWithTm further comprises assigning a member value in the item object directly to a member of the same name in the object DiWithTm, the member of the quality code in DiWithTm adding a backup channel supplemental quality tag.
If the host is the master pre-node, all elements in the container vec_cos are sent to the data processing module through a message, and all contents in the container vec_cos are emptied.
The data processing module receives and processes the information, the processing logic comprises processing for adding the backup channel complementary quality code on the basis of the conventional processing logic, the processing result and the backup channel complementary quality code are written into the real-time monitoring database, and the generated corresponding alarm information comprises the backup channel complementary quality code and is sent to the alarm processing module through the information;
step 5: and writing the real-time alarm information into a historical database and displaying the real-time alarm information.
The alarm processing module receives and processes the information, the processing logic comprises processing of adding the spare channel supplementary quality code on the basis of the conventional processing logic, the processing result and the spare channel supplementary mark are written into the history database, the generated corresponding real-time alarm information is displayed on the real-time alarm window, and the alarm information comprises the spare channel supplementary quality code.
Compared with the prior art, the invention provides the data quality diagnosis method and the system based on the composite channel state, which are used for diagnosing the real-time monitoring data sent by a plurality of communication channels of the same transformer substation, diagnosing the communication quality of the main channel of the transformer substation, monitoring by utilizing the real-time monitoring data received by the hot standby channel when the main channel loses the monitoring data under the condition of no interruption, supplementing the real-time monitoring data lost by the main communication channel, and supplementing special marks by the backup channel when the supplemented real-time monitoring data quality code is provided, thereby effectively avoiding the occurrence of missing monitoring events, providing auxiliary decisions for the overhaul of the communication channel and improving the quality of the monitoring data.
The present invention may be a system, method, and/or computer program product. The invention also discloses a data quality diagnosis system based on the composite channel state based on the data quality diagnosis method based on the composite channel state, which comprises a main channel diagnosis module, a data quality diagnosis module, a data processing module and an alarm processing module.
The main channel diagnosis module is used for selecting a main channel from a plurality of channels of the substation equipment centralized monitoring system according to channel states and channel priorities of the plurality of channels, and taking other channels as standby channels;
the data quality diagnosis module is used for acquiring effective time configuration values, collecting real-time monitoring data packets of all channels, and calculating Key values of the real-time monitoring data packets, wherein the effective time configuration values represent maximum time deviation values of the same monitoring data packet sent by the main channel and the standby channel; inquiring an item associated with the Key value in a preset lookup table, and performing an item updating operation based on the channel information of the real-time monitoring data packet and the effective time configuration value, wherein the channel information of the real-time monitoring data packet comprises the main channel or the standby channel;
the data processing module is used for scanning the lookup table according to a preset period, setting a backup channel supplementary mark for the table items which come from the backup channel and exceed the effective time configuration value, writing all the current table items in the lookup table into a real-time monitoring database, and generating real-time alarm information with the backup channel supplementary mark;
and the alarm processing module is used for writing the real-time alarm information into a historical database and displaying the real-time alarm information.
Based on the spirit of the present invention, one skilled in the art can readily appreciate that a computer program product is available based on the aforementioned composite channel state-based data quality diagnostic method. The computer program product may include a computer readable storage medium having computer readable program instructions embodied thereon for causing a processor to implement aspects of the present disclosure. The application also comprises a terminal, which comprises a processor and a storage medium; the storage medium is used for storing instructions; the processor is operative in accordance with the instructions to perform the steps of the data quality diagnostic method in accordance with the composite channel state described previously.
The computer readable storage medium may be a tangible device that can hold and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: portable computer disks, hard disks, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static Random Access Memory (SRAM), portable compact disk read-only memory (CD-ROM), digital Versatile Disks (DVD), memory sticks, floppy disks, mechanical coding devices, punch cards or in-groove structures such as punch cards or grooves having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media, as used herein, are not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., optical pulses through fiber optic cables), or electrical signals transmitted through wires.
The computer readable program instructions described herein may be downloaded from a computer readable storage medium to a respective computing/processing device or to an external computer or external storage device over a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmissions, wireless transmissions, routers, firewalls, switches, gateway computers and/or edge servers. The network interface card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium in the respective computing/processing device.
Computer program instructions for performing the operations of the present disclosure can be assembly instructions, instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, c++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer readable program instructions may be executed entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of remote computers, the remote computer may be connected to the user computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (e.g., connected through the internet using an internet service provider). In some embodiments, aspects of the present disclosure are implemented by personalizing electronic circuitry, such as programmable logic circuitry, field Programmable Gate Arrays (FPGAs), or Programmable Logic Arrays (PLAs), with state information of computer readable program instructions, which can execute the computer readable program instructions.
Finally, it should be noted that the above embodiments are only for illustrating the technical solution of the present invention and not for limiting the same, and although the present invention has been described in detail with reference to the above embodiments, it should be understood by those skilled in the art that: modifications and equivalents may be made to the specific embodiments of the invention without departing from the spirit and scope of the invention, which is intended to be covered by the claims.
Claims (12)
1. The data quality diagnosis method based on the composite channel state is characterized by comprising the following steps of:
step 1, selecting a main channel from a plurality of channels of a centralized monitoring system of substation equipment according to channel states and channel priorities of the channels, and taking other channels as standby channels;
step 2, acquiring an effective time configuration value, acquiring real-time monitoring data packets of all channels, and calculating Key values of the real-time monitoring data packets, wherein the effective time configuration value represents the maximum time deviation value of the same monitoring data packet sent by a main channel and a standby channel;
step 3, inquiring an item associated with the Key value in a preset lookup table, and performing an item updating operation based on the channel information of the real-time monitoring data packet and the effective time configuration value, wherein the channel information of the real-time monitoring data packet comprises the main channel or the standby channel;
step 4, scanning the lookup table according to a preset period, setting a backup channel supplementary mark for the table items which come from the backup channel and exceed the effective time configuration value, and writing all the current table items in the lookup table into a real-time monitoring database to generate real-time alarm information with the backup channel supplementary mark;
and step 5, writing the real-time alarm information into a history database and displaying the real-time alarm information.
2. The method for diagnosing data quality based on the composite channel state as set forth in claim 1, wherein said step 1 further includes:
the communication channels with the channel states which are not input and are not refreshed are filtered, and the communication channels with the filtered states which are input form a channel queue according to the order of the channel priorities from high to low;
sequentially adding the communication channels which are not refreshed after the filtering into the channel queue according to the channel priority;
sequentially adding the filtered channels into the channel queue according to the channel priority;
and selecting the head channel in the channel queue as a main channel, and the other channels are standby channels.
3. The method for diagnosing data quality based on a composite channel state according to claim 2, wherein in step 2, the calculating the Key value of the real-time monitoring packet further comprises:
collecting RTU ID, channel ID, data point number, main channel, data value, quality code, data uploading time mark, data point ID, data point component number of the real-time monitoring data packet, and calculating Key value by using RTU ID and data point number:
key=rtu ID 100000+ data point number.
4. The method for diagnosing data quality based on a composite channel state according to claim 3, wherein in step 3, the step of querying an entry associated with the Key value in a preset lookup table, performing an entry update operation based on the channel information of the real-time monitoring data packet and the valid time configuration value, further comprises:
if the item associated with the Key is not found in a lookup table map_reinf, converting the real-time monitoring data packet into item and storing the item into a value associated with the Key in the map_reinf, wherein the lookup table map_reinf is a C++ STLmap container, namely std, map < Key, item > and is used for storing a Key value pair < Key, item >;
if the item associated with the Key is found in the map_reinf, judging channel information in a real-time monitoring data packet;
when channel information in the real-time monitoring data packet indicates that the data packet is from a main channel, converting the real-time monitoring data packet into item, and updating and replacing item associated with the Key value in map_reinf;
when the channel information in the real-time monitoring data packet indicates that the data packet comes from the standby channel, further judging the data validity period, and if the item associated with the Key value is main channel data and within the validity period, namely the difference between the current time mark of the operating system and the uploading time mark in the item is smaller than the valid time configuration value, not processing the channel real-time monitoring data packet; otherwise, converting the real-time monitoring data packet into item, and updating and replacing item associated with Key value in map_reinf.
5. The method according to claim 4, wherein in step 4, the step of scanning the lookup table according to a preset period sets a backup channel supplementary flag for an entry from the backup channel and exceeding a valid time configuration value, further comprising:
scanning all table item items in the map_reinf, if the table item is backup channel data and exceeds the valid period, namely the difference between the current time mark of the operating system and the uploading time mark in the item is not smaller than the valid time configuration value, converting the item into a data object DiWithTm, storing the data object DiWithTm in a container vec_cos, and setting item.valid to 0; wherein the data object DiWithTm comprises a data value, a quality code, a data upload time stamp, a data point ID, and a data point component number, and the quality code comprises a backup channel supplemental mark.
6. A composite channel state based data quality diagnostic system utilizing the composite channel state based data quality diagnostic method of any of claims 1-5, comprising a main channel diagnostic module, a data quality diagnostic module, a data processing module, and an alarm processing module, characterized by:
the main channel diagnosis module is used for selecting a main channel from a plurality of channels of the substation equipment centralized monitoring system according to channel states and channel priorities of the plurality of channels, and taking other channels as standby channels;
the data quality diagnosis module is used for acquiring effective time configuration values, collecting real-time monitoring data packets of all channels, and calculating Key values of the real-time monitoring data packets, wherein the effective time configuration values represent maximum time deviation values of the same monitoring data packet sent by the main channel and the standby channel; inquiring an item associated with the Key value in a preset lookup table, and performing an item updating operation based on the channel information of the real-time monitoring data packet and the effective time configuration value, wherein the channel information of the real-time monitoring data packet comprises the main channel or the standby channel;
the data processing module is used for scanning the lookup table according to a preset period, setting a backup channel supplementary mark for the table items which come from the backup channel and exceed the effective time configuration value, writing all the current table items in the lookup table into a real-time monitoring database, and generating real-time alarm information with the backup channel supplementary mark;
and the alarm processing module is used for writing the real-time alarm information into a historical database and displaying the real-time alarm information.
7. The composite channel state-based data quality diagnostic system of claim 6, wherein the main channel diagnostic module is further configured to:
the communication channels with the channel states which are not input and are not refreshed are filtered, and the communication channels with the filtered states which are input form a channel queue according to the order of the channel priorities from high to low;
sequentially adding the communication channels which are not refreshed after the filtering into the channel queue according to the channel priority;
sequentially adding the filtered channels into the channel queue according to the channel priority;
and selecting the head channel in the channel queue as a main channel, and the other channels are standby channels.
8. The composite channel state based data quality diagnostic system of claim 7, wherein the data quality diagnostic module is further configured to:
collecting RTU ID, channel ID, data point number, main channel, data value, quality code, data uploading time mark, data point ID, data point component number of the real-time monitoring data packet, and calculating Key value by using RTU ID and data point number:
key=rtu ID 100000+ data point number.
9. The composite channel state based data quality diagnostic system of claim 8, wherein the data quality diagnostic module is further configured to:
if the item associated with the Key is not found in a lookup table map_reinf, converting the real-time monitoring data packet into item and storing the item into a value associated with the Key in the map_reinf, wherein the lookup table map_reinf is a C++ STLmap container, namely std is map < Key, item > and is used for storing a Key value pair < Key, item >;
if the item associated with the Key is found in the map_reinf, judging channel information in a real-time monitoring data packet;
when channel information in the real-time monitoring data packet indicates that the data packet is from a main channel, converting the real-time monitoring data packet into item, and updating and replacing item associated with the Key value in map_reinf;
when the channel information in the real-time monitoring data packet indicates that the data packet comes from the standby channel, further judging the data validity period, and if the item associated with the Key value is main channel data and within the validity period, namely the difference between the current time mark of the operating system and the uploading time mark in the item is smaller than the valid time configuration value, not processing the channel real-time monitoring data packet; otherwise, converting the real-time monitoring data packet into item, and updating and replacing item associated with Key value in map_reinf.
10. The composite channel state based data quality diagnostic system of claim 9, wherein the data processing module is further configured to:
scanning all table item items in the map_reinf, if the table item is backup channel data and exceeds the valid period, namely the difference between the current time mark of the operating system and the uploading time mark in the item is not smaller than the valid time configuration value, converting the item into a data object DiWithTm, storing the data object DiWithTm in a container vec_cos, and setting item.valid to 0; wherein the data object DiWithTm comprises a data value, a quality code, a data upload time stamp, a data point ID, and a data point component number, and the quality code comprises a backup channel supplemental mark.
11. A terminal comprising a processor and a storage medium; the method is characterized in that:
the storage medium is used for storing instructions;
the processor is operative according to the instructions to perform the steps of the composite channel state-based data quality diagnostic method according to any one of claims 1-5.
12. A computer readable storage medium having stored thereon a computer program, characterized in that the program when executed by a processor realizes the steps of the composite channel state based data quality diagnostic method according to any of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311463347.5A CN117632636A (en) | 2023-11-06 | 2023-11-06 | Data quality diagnosis method and system based on composite channel state |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311463347.5A CN117632636A (en) | 2023-11-06 | 2023-11-06 | Data quality diagnosis method and system based on composite channel state |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117632636A true CN117632636A (en) | 2024-03-01 |
Family
ID=90031241
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311463347.5A Pending CN117632636A (en) | 2023-11-06 | 2023-11-06 | Data quality diagnosis method and system based on composite channel state |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117632636A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118626279A (en) * | 2024-08-12 | 2024-09-10 | 东方电子股份有限公司 | Path decision method for urban rail transit communication front-end |
-
2023
- 2023-11-06 CN CN202311463347.5A patent/CN117632636A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118626279A (en) * | 2024-08-12 | 2024-09-10 | 东方电子股份有限公司 | Path decision method for urban rail transit communication front-end |
| CN118626279B (en) * | 2024-08-12 | 2024-11-29 | 东方电子股份有限公司 | Urban rail transit communication front-end processor path decision method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR100901319B1 (en) | Power distribution system and method | |
| CN112114230A (en) | Distribution network monitoring system for low-voltage distribution area and distribution area topology identification method | |
| US20210390422A1 (en) | Knowledge-Base Information Sensing Method And System For Operations And Maintenance Of Data Center | |
| US20120089384A1 (en) | Historic storage of dual layer power grid connectivity model | |
| CN111431754A (en) | Fault analysis method and system for power distribution and utilization communication network | |
| CN104486673A (en) | Fault handling platform system and fault handling method | |
| CN117632636A (en) | Data quality diagnosis method and system based on composite channel state | |
| CN115033657A (en) | Inquiry method, device and equipment based on knowledge graph and storage medium | |
| CN115208059A (en) | Transformer substation power and environment monitoring alarm processing system and method | |
| CN114020560A (en) | Method and device for collecting monitoring data, storage medium and electronic equipment | |
| CN115280741A (en) | System and method for autonomous monitoring and recovery in hybrid energy management | |
| CN113590437A (en) | Alarm information processing method, device, equipment and medium | |
| CN113392145A (en) | Automatic generation device and generation method for distribution network terminal point table | |
| CN114422555B (en) | CIM platform based method for self-defined configuration of IoT data analysis | |
| CN103684812A (en) | Remote equipment management method and device | |
| CN114844920A (en) | Internet of things equipment checking method and device, electronic equipment and storage medium | |
| CN113515413A (en) | Data management method and device, electronic equipment and storage medium | |
| Liu et al. | The design and implementation of the enterprise level data platform and big data driven applications and analytics | |
| CN117573473A (en) | Operation and maintenance system, operation and maintenance method and corresponding equipment for equipment in electric power system machine room | |
| CN112101422B (en) | Typical case self-learning method for power system fault case | |
| CN110855003A (en) | Method and device for calling and comparing self-adaptive configuration of main station | |
| CN111221454A (en) | Power grid service data processing method, device, equipment and storage medium | |
| US20160217188A1 (en) | Method and device for displaying browser resources and computer readable storage medium | |
| CN111159237B (en) | System data distribution method and device, storage medium and electronic equipment | |
| CN116111716A (en) | Power distribution equipment with communication function |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |