Disclosure of Invention
The technical problems to be solved by the invention are as follows: aiming at the problems in the prior art, the invention provides the intelligent substation patrol system based on the image recognition and the application method thereof.
In order to solve the technical problems, the invention adopts the technical scheme that:
the utility model provides a transformer substation intelligence system of patrolling based on image identification, includes online monitoring sub-station, online monitoring main website, intelligence fortune dimension main website, image recognition server and removes fortune dimension terminal, link to each other in proper order through the network between online monitoring sub-station, online monitoring main website, the intelligence fortune dimension main website, the image recognition server links to each other through the network between the intelligence fortune dimension main website, remove fortune dimension terminal and link to each other through the network between, the input of online monitoring sub-station links to each other with the secondary equipment who is monitored and sends the state monitoring data of the secondary equipment that constitutes with the secondary equipment state of gathering, warning information for online monitoring main website, the online monitoring main website gathers the state monitoring data of the secondary equipment of each online monitoring sub-station and then pushes to intelligence fortune dimension main website, intelligence fortune dimension main website is used for calling the image recognition server according to the image that removes fortune dimension terminal collection and carries out image identification and combines secondary equipment The state monitoring data generate a patrol result and output the patrol result to the mobile operation and maintenance terminal.
Preferably, the system further comprises an information safety area with three physical spaces separated, namely an information safety area I, an information safety area II and an information safety area III, the online monitoring substation and the monitored secondary equipment are located in the information safety area I, the online monitoring main station is located in the information safety area II, and the intelligent operation and maintenance main station, the image recognition server and the mobile operation and maintenance terminal are located in the information safety area III.
Preferably, the network among the online monitoring substation, the online monitoring main station and the intelligent operation and maintenance main station is in communication connection by adopting an MMS communication protocol, and the input end of the online monitoring substation is in communication connection with the monitored secondary equipment by adopting the MMS communication protocol.
Preferably, the intelligent operation and maintenance master station and the mobile operation and maintenance terminal are connected through a power wireless private network.
Preferably, the intelligent operation and maintenance master station and the image recognition server communicate with each other by adopting a private protocol.
In addition, the invention also provides an application method of the transformer substation intelligent patrol system based on the image recognition, which comprises the following implementation steps:
1) selecting target secondary equipment, wherein an intelligent operation and maintenance main station collects state monitoring data of the target secondary equipment through an online monitoring substation and an online monitoring main station, and automatically selects a corresponding secondary equipment state library according to the current operation state of the secondary equipment, wherein the secondary equipment state library comprises the current state of the target secondary equipment; the mobile operation and maintenance terminal acquires a field inspection image for the target secondary equipment by using a camera of the mobile operation and maintenance terminal and transmits the inspection image to the intelligent operation and maintenance master station through a network;
2) the intelligent operation and maintenance master station sends the patrol image to an image identification server;
3) the image recognition server performs image recognition on the patrol image to obtain an image recognition object state for recognizing the secondary equipment, and returns an image recognition result to the intelligent operation and maintenance master station;
4) the intelligent operation and maintenance master station determines the image recognition object state of the target secondary equipment according to the image recognition object state of the recognition secondary equipment obtained by image recognition, and checks the state information of the image recognition object state of the target secondary equipment and a secondary equipment state library corresponding to the image recognition object state, if the image recognition object state is consistent with the state of the secondary equipment state library, the automatic inspection result is judged to be normal, otherwise, the automatic inspection result is judged to be abnormal;
5) the intelligent operation and maintenance master station pushes the automatic inspection result to the mobile operation and maintenance terminal, and field personnel perform next secondary equipment inspection or manual confirmation of the current secondary equipment inspection result according to the automatic inspection result.
Preferably, the step 1) is preceded by a step of establishing a secondary device state library, and the step of establishing the secondary device state library specifically includes one or a combination of the following two modes: aiming at each state of the target secondary equipment, a secondary equipment state library of the target secondary equipment in the state is obtained by manually establishing the secondary equipment and confirming the state of the secondary equipment; the method II comprises the following steps: and acquiring an image of the on-site secondary equipment by on-site personnel aiming at each state of the target secondary equipment, and automatically inputting the states of the secondary equipment and the secondary equipment by image recognition to obtain a secondary equipment state library of the target secondary equipment in the state.
Preferably, the step of determining the image recognition object state of the target secondary device according to the image recognition object state of the recognition secondary device obtained by image recognition in step 4) includes:
4.1) acquiring an object rectangular frame for identifying the secondary equipment and a rectangular frame for identifying characters in the image identification result;
4.2) matching and corresponding the rectangular object frame and the rectangular character frame for identifying the secondary equipment to obtain the rectangular object character for identifying the secondary equipment;
and 4.3) matching each recognition secondary device and the object characters thereof with the target secondary device to obtain an image recognition result formed by the object rectangular frame and the object characters of the target secondary device.
Preferably, the detailed steps of step 4.2) include: and traversing the rectangular frame of the identification character around the rectangular frame according to the coordinates of the rectangular frame of the object of the identification secondary equipment, and judging that the identification character is the object character for identifying the identification secondary equipment from the rectangular frame of the identification character closest to the rectangular frame of the object of the identification secondary equipment.
Preferably, the detailed steps of step 4.3) include: and matching each recognition secondary device and the object characters thereof with the target secondary device, thereby obtaining an image recognition result formed by the object rectangular frame and the object characters of the target secondary device.
Compared with the prior art, the invention has the following advantages: the input end of the on-line monitoring substation is connected with the secondary equipment to be monitored so as to send the state monitoring data of the secondary equipment, which is composed of the state of the secondary equipment and alarm information, to the on-line monitoring main station, the on-line monitoring main station collects the state monitoring data of the secondary equipment of each on-line monitoring substation and then pushes the collected state monitoring data to the intelligent operation and maintenance main station, and the intelligent operation and maintenance main station is used for calling an image recognition server according to an image collected by a mobile operation and maintenance terminal to perform image recognition and generating an inspection result by combining the state monitoring data of the secondary equipment and outputting the inspection result to the mobile operation and maintenance terminal.
Detailed Description
The following describes the transformer substation intelligent patrol system based on image recognition and the application method thereof in further detail with reference to specific embodiments and the accompanying drawings.
As shown in fig. 1 and fig. 2, the transformer substation intelligent patrol system based on image recognition in this embodiment includes an online monitoring substation 1, an online monitoring master station 2, an intelligent operation and maintenance master station 3, an image recognition server 4 and a mobile operation and maintenance terminal 5, where the online monitoring substation 1, the online monitoring master station 2 and the intelligent operation and maintenance master station 3 are sequentially connected through a network, the intelligent operation and maintenance master station 3 and the image recognition server 4 are connected through a network, the intelligent operation and maintenance master station 3 and the mobile operation and maintenance terminal 5 are connected through a network, an input end of the online monitoring substation 1 is connected with a monitored secondary device to send state monitoring data of the secondary device composed of collected secondary device state and alarm information to the online monitoring master station 2, the online monitoring master station 2 summarizes the state monitoring data of the secondary device of each online monitoring substation 1 and then pushes the summarized state monitoring data to the intelligent operation and maintenance master station 3, the intelligent operation and maintenance master station 3 is used for calling the image recognition server 4 to perform image recognition according to the image collected by the mobile operation and maintenance terminal 5, generating a patrol result by combining the state monitoring data of the secondary equipment, and outputting the patrol result to the mobile operation and maintenance terminal 5.
As shown in fig. 1, the present embodiment further includes an information security I area, an information security II area, and an information security III area, where the three physical spaces are isolated to form an information security region, the online monitoring substation 1 and the monitored secondary device thereof are located in the information security I area, the online monitoring master station 2 is located in the information security II area, and the intelligent operation and maintenance master station 3, the image recognition server 4, and the mobile operation and maintenance terminal 5 are located in the information security III area.
In this embodiment, the network among the online monitoring substation 1, the online monitoring main station 2, and the intelligent operation and maintenance main station 3 is in communication connection by using an MMS communication protocol, and the input end of the online monitoring substation 1 is in communication connection with the monitored secondary device by using the MMS communication protocol, so that the online monitoring substation is compatible with various monitored secondary devices of the existing transformer substation.
In this embodiment, the intelligent operation and maintenance master station 3 and the mobile operation and maintenance terminal 5 are connected through a power wireless private network, the mobile operation and maintenance terminal 5 adopts the power wireless private network to send the acquired data to the intelligent operation and maintenance master station 3, and the intelligent operation and maintenance master station 3 adopts the power wireless private network to send the inspection result to the mobile operation and maintenance terminal 5.
In this embodiment, the intelligent operation and maintenance master station 3 and the image recognition server 4 communicate with each other by using a private protocol, the image recognition server 4 can be protected by using the above method, and the private protocol can be implemented by using a specific encryption method for communication data.
In this embodiment, the online monitoring substation 1 mainly realizes communication with the secondary equipment in the information security I area, online collects the state of the secondary equipment in real time, and sends the collected state of the secondary equipment and alarm information to the online monitoring master station in the information security II area;
in this embodiment, the online monitoring master station 2 mainly integrates the online monitoring substation state monitoring data in the information security I area, and pushes the online state monitoring data to the intelligent operation and maintenance master station in the information security III area;
referring to fig. 3, the intelligent operation and maintenance master station 3 in this embodiment should include the following functional modules:
the secondary equipment state base establishing module is used for realizing the establishment of the patrol secondary equipment state, and is a basis for automatically judging the patrol result;
the secondary equipment identification object and identification character matching module is used for realizing the quick matching of the secondary equipment identification and identification characters and establishing a complete secondary equipment identification object;
the image identification object and actual secondary equipment matching module is used for realizing the matching corresponding relation between the secondary equipment identification object and the object to be patrolled;
the inspection result analysis module is used for automatically judging and outputting the inspection result of the secondary equipment according to the established secondary equipment state library and the actual inspection state of the secondary equipment;
and the communication module is used for realizing communication service between the intelligent operation and maintenance master station and the online monitoring master station, the image recognition server and the mobile operation and maintenance terminal.
Wherein, the secondary equipment state base establishing module, the secondary equipment object and character identifying matching module, the image identifying object and actual secondary equipment matching module and the inspection result analyzing module are program modules, the secondary equipment state base establishing module is used for establishing a secondary equipment state base, the secondary equipment object and character identifying matching module is used for executing the step 4.2), the image identifying object and actual secondary equipment matching module is used for executing the step 4.3), and the secondary equipment object and character identifying matching method comprises the following steps: and matching and corresponding the secondary equipment object rectangular frame with the identification character rectangular frame, traversing the identification character rectangular frame around the secondary equipment object rectangular frame according to the coordinates of the identification character rectangular frame, and judging that the identification character is the identification secondary equipment object character when the character rectangular frame closest to the identification secondary equipment object rectangular frame is the identification character. The image recognition object and actual secondary equipment matching method comprises the following steps: and traversing and matching the secondary equipment object to be patrolled by taking the identification characters as the unique identification for identifying the secondary equipment object. The patrol result analysis method of the patrol result analysis module comprises the following steps: according to the running state of each secondary device of the transformer substation pushed by the online monitoring main station, a secondary device state library which is currently applicable to the transformer substation is automatically selected, state information checking is carried out on the basis of the secondary device state library and actually acquired secondary device images, the inspection result of the secondary devices with consistent state information is normal, and the inspection result of the secondary devices with inconsistent state information is abnormal. The communication module is a hardware module and is used for realizing data communication with the online monitoring master station 2, the image recognition server 4 and the mobile operation and maintenance terminal 5 respectively, and the communication module specifically comprises a plurality of communication interface modules. The intelligent operation and maintenance master station 3 pushes the automatic inspection result to the mobile operation and maintenance terminal 5 through the communication interface module, and the field personnel perform next secondary equipment inspection or manually confirm the current secondary equipment inspection result according to the inspection result of the intelligent operation and maintenance master station 3.
In this embodiment, the image recognition server 4 is provided with a pattern recognition engine having a function of classifying secondary device images and their corresponding secondary device states, and can perform image recognition based on the patrol image to obtain an image recognition object state for recognizing the secondary device. The pattern recognition engine can adopt the existing machine learning classification model according to the requirement, and improves the pattern recognition precision of the machine learning classification model through pre-training.
In this embodiment, the image recognition server 4 should include the following functional modules:
the secondary equipment identification module is integrated with the pattern identification engine and is used for realizing identification of secondary equipment of the transformer substation and identification of the state of the secondary equipment;
the character recognition module is used for recognizing the associated characters of the secondary equipment of the transformer substation;
and the communication module is used for realizing the communication between the image identification server and the intelligent operation and maintenance master station and sending the image identification result to the intelligent operation and maintenance master station for patrol service processing.
In this embodiment, the mobile operation and maintenance terminal 5 should include the following functional modules:
the image acquisition module is used for acquiring images of the actual running state of the secondary equipment of the transformer substation;
the communication module is used for realizing the communication between the mobile operation and maintenance terminal and the intelligent operation and maintenance master station and sending the image of the actual operation state of the secondary equipment to the intelligent operation and maintenance master station for intelligent patrol service processing;
and the inspection result output module is used for realizing automatic inspection result display of the mobile operation and maintenance terminal and displaying the service processing result of the intelligent operation and maintenance master station in the mobile operation and maintenance terminal for operation and maintenance personnel to check.
The on-line monitoring substation and the on-line monitoring main station are part of an intelligent operation and inspection system of the transformer substation, and the on-site secondary equipment state is acquired in real time and on-line as the basis of operation, maintenance and inspection operation.
As shown in fig. 4, this embodiment further provides an application method of the foregoing transformer substation intelligent patrol system based on image recognition, and the implementation steps include:
1) selecting target secondary equipment, wherein the intelligent operation and maintenance main station 3 collects state monitoring data of the target secondary equipment through the online monitoring substation 1 and the online monitoring main station 2, and automatically selects a corresponding secondary equipment state library according to the current operation state of the secondary equipment, wherein the secondary equipment state library comprises the current state of the target secondary equipment; the mobile operation and maintenance terminal 5 acquires a field patrol image for the target secondary equipment by using a camera provided by the mobile operation and maintenance terminal, and transmits the patrol image to the intelligent operation and maintenance master station 3 through a network;
2) the intelligent operation and maintenance master station 3 sends the patrol image to the image identification server 4;
3) the image recognition server 4 performs image recognition on the patrol image to obtain an image recognition object state for recognizing the secondary equipment, and returns an image recognition result to the intelligent operation and maintenance master station 3;
4) the intelligent operation and maintenance master station 3 determines the image recognition object state of the target secondary equipment according to the image recognition object state of the recognition secondary equipment obtained by image recognition, checks the image recognition object state of the target secondary equipment and the state information of the secondary equipment state library corresponding to the image recognition object state, judges that the automatic inspection result is normal if the image recognition object state is consistent with the state of the secondary equipment state library, and judges that the automatic inspection result is abnormal if the image recognition object state is not consistent with the state of the secondary equipment state library;
5) the intelligent operation and maintenance master station 3 pushes the automatic inspection result to the mobile operation and maintenance terminal 5, and the field personnel performs the next secondary equipment inspection or the current secondary equipment inspection result manual confirmation according to the automatic inspection result.
Referring to fig. 4, before step 1) in this embodiment, a step of establishing a secondary device state library is further included, and establishing the secondary device state library specifically includes one or a combination of two ways, namely: aiming at each state of the target secondary equipment, a secondary equipment state library of the target secondary equipment in the state is obtained by manually establishing the secondary equipment and confirming the state of the secondary equipment; the method II comprises the following steps: and acquiring an image of the on-site secondary equipment by on-site personnel aiming at each state of the target secondary equipment, and automatically inputting the states of the secondary equipment and the secondary equipment by image recognition to obtain a secondary equipment state library of the target secondary equipment in the state. Through one or the combination of the first mode and the second mode, the secondary equipment state library can be edited and stored on the intelligent operation and maintenance main station 3 and is used as a basis for the analysis of the inspection result.
As an optional implementation manner, the secondary device types recorded in the secondary device status library in this embodiment include: air switch, pressure plate, device indicator light, etc.
In the step 1), the online monitoring substation 1 is connected to the online monitoring main station 2, and the online monitoring main station 2 is connected to the intelligent operation and maintenance main station 3, so that the intelligent operation and maintenance main station 3 is ensured to acquire the operation state of the secondary equipment in real time, and the intelligent operation and maintenance main station 3 automatically selects a secondary equipment state library according to the current operation state of the secondary equipment.
In this embodiment, the step of determining the image recognition object state of the target secondary device according to the image recognition object state of the recognition secondary device obtained by image recognition in step 4) includes:
4.1) acquiring an object rectangular frame for identifying the secondary equipment and a rectangular frame for identifying characters in the image identification result;
4.2) matching and corresponding the rectangular object frame and the rectangular character frame for identifying the secondary equipment to obtain the rectangular object character for identifying the secondary equipment;
and 4.3) matching each recognition secondary device and the object characters thereof with the target secondary device to obtain an image recognition result formed by the object rectangular frame and the object characters of the target secondary device.
In this embodiment, the detailed steps of step 4.2) include: and traversing the rectangular frame of the identification character around the rectangular frame according to the coordinates of the rectangular frame of the object of the identification secondary equipment, and judging that the identification character is the object character for identifying the identification secondary equipment from the rectangular frame of the identification character closest to the rectangular frame of the object of the identification secondary equipment.
In this embodiment, the detailed steps of step 4.3) include: and matching each recognition secondary device and the object characters thereof with the target secondary device, thereby obtaining an image recognition result formed by the object rectangular frame and the object characters of the target secondary device.
In summary, in the application method of the transformer substation intelligent patrol system based on image recognition in this embodiment, the secondary device state library is established on the intelligent operation and maintenance master station 3, the intelligent operation and maintenance master station 3 acquires the operation state of the secondary device on line through the online monitoring substation 1 and the online monitoring master station 2, the current patrol secondary device state library is automatically selected according to the online operation state of the secondary device, and the field patrol personnel adopt the mobile operation and maintenance terminal 5 to acquire the field secondary device state image and upload the secondary device image to the intelligent operation and maintenance master station 3. The intelligent operation and maintenance master station 3 sends the secondary equipment image to the image recognition server 4, the image recognition server 4 returns the image recognition result to the intelligent operation and maintenance master station 3, the intelligent operation and maintenance master station 3 automatically judges the inspection result by combining the inspection secondary equipment state library and the image recognition result, and the inspection result is pushed to the mobile operation and maintenance terminal 5, so that the inspection efficiency and quality can be effectively improved.
The above description is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments, and all technical solutions belonging to the idea of the present invention belong to the protection scope of the present invention. It should be noted that modifications and embellishments within the scope of the invention may occur to those skilled in the art without departing from the principle of the invention, and are considered to be within the scope of the invention.