CN111952883B - Power transmission line fault recognition system and method based on three-dimensional laser radar - Google Patents
Power transmission line fault recognition system and method based on three-dimensional laser radar Download PDFInfo
- Publication number
- CN111952883B CN111952883B CN202010863796.9A CN202010863796A CN111952883B CN 111952883 B CN111952883 B CN 111952883B CN 202010863796 A CN202010863796 A CN 202010863796A CN 111952883 B CN111952883 B CN 111952883B
- Authority
- CN
- China
- Prior art keywords
- transmission line
- power transmission
- aircraft
- microcomputer
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 149
- 238000000034 method Methods 0.000 title claims abstract description 29
- 230000007547 defect Effects 0.000 claims abstract description 45
- 238000007689 inspection Methods 0.000 claims abstract description 43
- 238000013135 deep learning Methods 0.000 claims abstract description 12
- 238000012549 training Methods 0.000 claims abstract description 12
- 238000013527 convolutional neural network Methods 0.000 claims abstract description 10
- 238000004891 communication Methods 0.000 claims description 25
- 238000012806 monitoring device Methods 0.000 claims description 13
- 238000001931 thermography Methods 0.000 claims description 12
- 238000007726 management method Methods 0.000 claims description 9
- 238000013523 data management Methods 0.000 claims description 7
- 238000013500 data storage Methods 0.000 claims description 6
- 238000009877 rendering Methods 0.000 claims description 6
- 230000003993 interaction Effects 0.000 claims description 5
- 230000005855 radiation Effects 0.000 claims description 5
- 230000001360 synchronised effect Effects 0.000 claims description 5
- 238000012216 screening Methods 0.000 claims description 4
- 238000012544 monitoring process Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 description 10
- 238000012545 processing Methods 0.000 description 8
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000012423 maintenance Methods 0.000 description 3
- 230000002950 deficient Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000002679 ablation Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000009529 body temperature measurement Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02G—INSTALLATION OF ELECTRIC CABLES OR LINES, OR OF COMBINED OPTICAL AND ELECTRIC CABLES OR LINES
- H02G1/00—Methods or apparatus specially adapted for installing, maintaining, repairing or dismantling electric cables or lines
- H02G1/02—Methods or apparatus specially adapted for installing, maintaining, repairing or dismantling electric cables or lines for overhead lines or cables
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
- G01S17/894—3D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/13—Satellite images
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Remote Sensing (AREA)
- Astronomy & Astrophysics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Electromagnetism (AREA)
- Radar, Positioning & Navigation (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
Abstract
The invention discloses a power transmission line fault recognition system and method based on a three-dimensional laser radar, wherein the system comprises the following steps: the aircraft is provided with a double-optical camera, a switch and a microcomputer; the dual-optical camera comprises a visible light camera and an infrared light camera; the microcomputer fuses a scene picture of the power transmission line and an infrared thermograph to generate an inspection image based on a convolutional neural network algorithm, matches features in the inspection image to identify a lead of the power transmission line based on a deep learning training algorithm, and generates line defect data. The invention can automatically identify the characteristics in the inspection image and automatically diagnose the defects, thereby greatly improving the working efficiency.
Description
Technical Field
The invention relates to the technical field of power line maintenance, in particular to a power transmission line fault identification system and method.
Background
When the power transmission line is affected by natural disasters and external force damage, faults of different degrees can be caused, and if the line faults are not processed in time, accidents such as short circuit, fire, power interruption, communication interruption and the like can be caused. The line inspection can effectively reduce the line fault rate, and can timely find and timely solve the defects of the power transmission line. The autonomous inspection of the power transmission line by adopting the aircraft gradually becomes a research hotspot, the aircraft-mounted camera can collect line pictures or videos for later-stage fault identification processing, but a large number of normal or defective pictures are generated after each autonomous inspection, the defective pictures need to be manually screened, heavier workload is increased for workers, and meanwhile, the working efficiency is low and errors caused by human negligence easily occur.
Meanwhile, in the prior art, the power transmission line is shot through the camera, and a picture is generated, and in the natural environment, a plurality of target objects in the picture are difficult to distinguish the wire of the power transmission line and the wire is identified, so that the problems of large error and low working efficiency are caused.
In addition, in the prior art, the transmission image is in a line transmission mode, which results in low image transmission speed and asynchronous time of arriving at the ground and the aircraft processing module respectively, so that real-time observation of the inspection image and defect identification cannot be synchronous, the working efficiency is low, and loss is brought to inspection and maintenance of the power transmission line.
Disclosure of Invention
The invention provides a three-dimensional laser radar-based power transmission line fault identification system and method, which are used for solving the technical problems of heavy workload, low working efficiency and high fault rate of workers by fusing a shot power transmission line picture and a corresponding thermal image through an algorithm technology, identifying a lead in a line and judging the defect of the lead.
Therefore, the invention provides a power transmission line fault recognition system based on a three-dimensional laser radar, which comprises: the aircraft is provided with a double-optical camera, a switch and a microcomputer;
the double-optical camera comprises a visible light camera and an infrared camera, the visible light camera is used for shooting a scene picture of the power transmission line, and the infrared camera is used for acquiring an infrared thermal image of the power transmission line by sensing infrared radiation energy of the power transmission line;
the microcomputer is used for fusing a scene picture of the power transmission line with an infrared thermography to generate a routing inspection image based on a convolutional neural network algorithm, matching features in the routing inspection image based on a deep learning training algorithm to identify a lead of the power transmission line, judging whether the temperature corresponding to the lead exceeds a preset temperature threshold value, generating line defect data when the temperature corresponding to the lead exceeds the preset temperature threshold value, and meanwhile, the microcomputer is used for generating and storing a routing inspection report which comprises the line defect data;
the switch is used for establishing connection between the dual-optical camera and the microcomputer and the aircraft respectively so as to realize synchronous data interaction.
Preferably, the aircraft is provided with an RTK navigation positioning system for acquiring coordinate points of the aircraft and a data management module for storing aircraft patrol data;
the machine patrol data comprises coordinate points of towers in the power transmission line;
and the microcomputer is used for respectively acquiring coordinate points corresponding to the current coordinate point of the aircraft and the nearest two-end tower corresponding to the lead based on the RTK navigation positioning system and the machine patrol data after the temperature corresponding to the lead exceeds a preset temperature threshold value, so as to calculate the coordinate point of the lead.
Preferably, the aircraft is further provided with a three-dimensional laser radar, a radar driving board, an RS232 communication module and a power module;
the radar driving board is connected with the three-dimensional laser radar and used for driving the three-dimensional laser radar to work;
the three-dimensional laser radar is used for detecting and acquiring point cloud data of the power transmission line;
the microcomputer is in communication connection with the radar driving board through the RS232 communication module;
the microcomputer calculates a coordinate point of the power transmission line based on the acquired point cloud data of the power transmission line, and simultaneously calculates a relative distance between the aircraft and the power transmission line by comparing the coordinate point of the power transmission line and the coordinate point of the aircraft based on a PID control algorithm, and controls the relative distance between the aircraft and the power transmission line to be kept within a preset distance range;
and the power supply module is used for supplying power to the three-dimensional laser radar and the microcomputer.
Preferably, the system further comprises a ground monitoring device, wherein the ground monitoring device is in wireless communication connection with the aircraft and is used for controlling the aircraft and acquiring the aircraft data.
Preferably, a transmission antenna is arranged on the aircraft;
the transmission antenna is in wireless communication connection with the ground monitoring device, and links in wireless communication connection comprise a 2.4G wireless communication link for image transmission and a 5.8G wireless communication link for command transmission.
Preferably, the aircraft is provided with a three-axis anti-shake pan-tilt for controlling the three-dimensional rotation of the dual-optical camera.
Preferably, the ground monitoring apparatus comprises a remote controller and a display device;
the double-optical camera is provided with an image stream push flow processor, and the image stream push flow processor is used for superposing and rendering the scene picture of the power transmission line and the infrared thermography to generate a rendered image so as to realize single-line transmission of the image;
the remote controller is used for controlling the working states of the aircraft and the dual-light camera;
the display device is used for receiving and displaying the rendering image.
Preferably, the microcomputer comprises a defect management module, a report set module and a data storage module;
the defect management module is used for screening and classifying the line defect data after the microcomputer generates the line defect data, and adding the line defect data into a report set;
the report set module is used for receiving the report set and generating a patrol report;
the data storage module is used for storing the line defect data, the routing inspection report and the machine routing inspection data.
On the other hand, the invention also provides a power transmission line fault identification method based on the three-dimensional laser radar, which is applied to the power transmission line fault identification system based on the three-dimensional laser radar, and comprises the following steps:
step S101: controlling the aircraft to fly to a power transmission line operation site to be inspected through a ground monitoring device;
step S102: shooting the power transmission line through a double-optical camera to obtain a scene picture and an infrared thermal image containing the power transmission line;
step S103: transmitting the scene picture and the infrared thermal image of the power transmission line to a microcomputer and the aircraft through a local area network;
step S104: fusing the scene picture of the power transmission line and the infrared thermography to generate a patrol image based on a convolutional neural network algorithm through the microcomputer;
step S105: matching features in the inspection image based on a deep learning training algorithm through the microcomputer so as to identify a lead of the power transmission line, judging whether the temperature corresponding to the lead exceeds a preset temperature threshold value, and generating line defect data when the temperature corresponding to the lead exceeds the preset temperature threshold value;
step S106: generating and storing a patrol report by the microcomputer, the patrol report including the line defect data.
Preferably, after the step S101, the step S102 further includes a step S201:
the method comprises the steps of detecting point cloud data of the power transmission line through a three-dimensional laser radar, transmitting the point cloud data of the power transmission line to a microcomputer, calculating a coordinate point of the power transmission line through the microcomputer, and controlling the relative distance between the aircraft and the power transmission line to be kept within a preset distance range based on a PID control algorithm.
According to the technical scheme, the invention has the following advantages:
the embodiment of the invention provides a power transmission line fault recognition system based on a three-dimensional laser radar, which comprises: the aircraft is provided with a double-optical camera, a switch and a microcomputer; the double-optical camera comprises a visible light camera and an infrared camera, the visible light camera is used for shooting a scene picture of the power transmission line, and the infrared camera is used for acquiring an infrared thermal image of the power transmission line by sensing infrared radiation energy of the power transmission line; the microcomputer is used for fusing a scene picture of the power transmission line with an infrared thermography to generate a routing inspection image based on a convolutional neural network algorithm, matching features in the routing inspection image based on a deep learning training algorithm to identify a lead of the power transmission line, judging whether the temperature corresponding to the lead exceeds a preset temperature threshold value, generating line defect data when the temperature corresponding to the lead exceeds the preset temperature threshold value, and meanwhile, the microcomputer is used for generating and storing a routing inspection report which comprises the line defect data; the switch is used for establishing connection between the dual-optical camera and the microcomputer and the aircraft respectively so as to realize synchronous data interaction.
The embodiment of the invention fuses the scene picture of the power transmission line acquired by the double-optical camera and the thermal image based on the convolutional neural network algorithm to generate the inspection image, the method can be matched with the characteristic identification transmission line conducting wire in the inspection image, so that the scene picture and the thermal image of the transmission line do not need to be respectively subjected to characteristic identification and matching, the working efficiency is improved, and whether the temperature obtained by judging the thermal image corresponding to the wire exceeds a preset temperature threshold (namely a preset normal temperature threshold), so that the defects of the wire can be identified in real time in the flying inspection process without subsequent screening and identification, the working efficiency is improved, the workload and the error rate of workers are reduced, meanwhile, the patrol inspection report can be stored in real time through the microcomputer, the ground background storage space is compressed, the working efficiency is improved, and the purposes of saving manpower and time cost are achieved.
Meanwhile, the double-optical camera is respectively connected with the aircraft and the microcomputer through the local area network, and the aircraft is wirelessly connected with the ground monitoring device, so that the inspection image shot by the double-optical camera is transmitted to the aircraft and the microcomputer in a broadcasting mode, the transmission speed is improved, and the inspection process and the defects of the line can be synchronously and conveniently monitored in real time.
The power transmission line fault identification method based on the three-dimensional laser radar provided by the invention has the same beneficial effects as the system, and is not repeated herein.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without inventive exercise.
Fig. 1 is a schematic structural diagram of a first embodiment of a three-dimensional laser radar-based power transmission line fault identification system and method according to the present invention;
fig. 2 is a flowchart of a third embodiment of the system and method for identifying a power transmission line fault based on a three-dimensional laser radar of the present invention.
Detailed Description
In order to make the objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the embodiments described below are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example one
Referring to fig. 1, the system for identifying a power transmission line fault based on a three-dimensional laser radar in an embodiment of the present invention includes an aircraft 1 and a ground monitoring device;
further, the aircraft 1 is provided with the dual-optical camera 2 and the electric cabinet, wherein the electric cabinet comprises a microcomputer 7, the aircraft 1 adopts a four-rotor aircraft 1, the bottom of the aircraft 1 is provided with a first mounting rack 4, and the top of the aircraft 1 is provided with a second mounting rack 5;
the double-optical camera 2 is fixed on the first mounting frame 4, the double-optical camera 2 comprises a visible light camera and an infrared light camera, and the visible light camera and the infrared light camera of the double-optical camera 2 work simultaneously in a working state so as to directly display a power transmission line picture after visible light and infrared light are overlaid and rendered in the subsequent process;
the infrared camera is used for acquiring an infrared thermal image of the power transmission line by sensing infrared radiation energy of the power transmission line, and the visible light camera is used for shooting a scene picture of the power transmission line;
it should be noted that, the temperature measurement process of the infrared camera is as follows: firstly, a wire radiation power signal in the power transmission line is converted into an electric signal by an infrared camera, and when the electric signal is output, an infrared temperature image is output to imaging equipment.
Further, the aircraft 1 is also provided with a switch for providing a local area network, the dual-optical camera 2 is respectively connected with the microcomputer 7 and the aircraft 1 through the switch to realize synchronous data interaction, so that the dual-optical camera 2 can transmit image data in a broadcasting mode, and the aircraft 1 and the microcomputer 7 can simultaneously receive the image data to improve the data transmission speed and can synchronously monitor the inspection process and process images in real time.
Further, the microcomputer 7 fuses the acquired scene picture of the power transmission line and the infrared thermography to generate a patrol image based on a convolutional neural network algorithm;
it should be noted that, the convolutional neural network algorithm is the prior art, and is not described herein again;
it can be understood that the scene picture of the power transmission line and the infrared thermography are fused to generate the inspection image, so that the matching of the lead and the corresponding temperature is facilitated, meanwhile, the defect is identified only aiming at one inspection image, and the working efficiency is greatly improved.
Further, the microcomputer 7 matches features in the inspection image based on a deep learning training algorithm to identify a lead of the power transmission line, judges whether the temperature corresponding to the lead exceeds a preset temperature threshold, and generates line defect data when the temperature corresponding to the lead exceeds the preset temperature threshold;
it can be understood that, because too many target objects are in the inspection image, the lead of the power transmission line can be better identified by establishing a deep learning training model, and whether the temperature corresponding to the lead exceeds a preset normal temperature threshold value can be judged through the temperature obtained from the infrared thermography, and if the temperature exceeds the preset normal temperature threshold value, the lead is indicated to have defects;
further, the microcomputer 7 has an NVIDIA processing chip built therein, and the NVIDIA processing chip is used for packaging the deep learning training algorithm.
It can be understood that, in the prior art, an algorithm system is adopted to perform a deep learning training algorithm, and the algorithm system needs to be completed on the ground, but in the embodiment, by arranging the NVIDIA processing chip in the microcomputer 7, the inspection image line defects can be directly identified on the aircraft 1 in real time through the deep learning training algorithm, so that the image processing efficiency is improved.
Furthermore, an RTK navigation positioning system for acquiring a coordinate point of the aircraft 1 and a data management module for storing aircraft patrol data are arranged on the aircraft 1;
the machine patrol data comprises coordinate points of towers in the power transmission line, and the towers are used for connecting wires;
further, the microcomputer 7 is used for respectively acquiring coordinate points corresponding to the current coordinate point of the aircraft 1 and the two nearest end towers corresponding to the lead based on the RTK navigation positioning system and the machine patrol data after the temperature corresponding to the lead exceeds the preset temperature threshold, and calculating the coordinate point of the corresponding lead with the temperature exceeding the preset temperature threshold in real time through the coordinate point of the aircraft 1 and the coordinate point of the two nearest end towers corresponding to the lead, so that quick and accurate positioning is performed, and subsequent maintenance is facilitated.
Further, the ground monitoring device is in wireless communication connection with the aircraft 1 and is used for controlling the aircraft 1 and acquiring aircraft data;
furthermore, the aircraft 1 is also provided with a transmission antenna which is in wireless communication connection with the ground monitoring device and is used for realizing data interaction between the ground monitoring device and the aircraft 1; meanwhile, the links of the wireless communication connection include a 2.4G wireless communication link for image transmission and a 5.8G wireless communication link for command transmission.
Further, the ground monitoring apparatus includes a remote controller 10 and a display device;
the double-optical camera 2 is provided with an image stream push processor, and the image stream push processor is used for superposing and rendering the scene picture of the power transmission line and the infrared thermography to generate a rendered image so as to realize single-line transmission of the image, so that the fast transmission is facilitated, and the working efficiency is improved;
the remote controller 10 is used for controlling the working states of the aircraft 1 and the dual-optical camera 2 so as to ensure that the aircraft 1 flies safely and can shoot clear pictures of the power transmission line, and meanwhile, the remote controller 10 also controls the dual-optical camera 2 to execute shooting work;
and the display device is used for receiving and displaying the rendering image.
Furthermore, the aircraft 1 is provided with a three-axis anti-shake pan-tilt for controlling the three-dimensional rotation of the dual-optical camera 2, and meanwhile, the dual-optical camera 2 can be prevented from shaking in the rotation process, and the three-axis anti-shake pan-tilt comprises an X axis, a Y axis and a Z axis;
the X axis is used for controlling the transverse angle rotation of the dual-optical camera 2, the Y axis is used for controlling the longitudinal angle rotation of the dual-optical camera 2, and the Z axis is used for controlling the deflection angle rotation of the dual-optical camera 2;
the three-axis anti-shake holder comprises holder motors which are respectively arranged on an X axis, a Y axis and a Z axis and are used for providing power for rotation at corresponding angles;
it can be understood that, when the aircraft 1 flies, the three-axis anti-shake pan-tilt can be adjusted so that the two-optical camera 2 shoots the picture of the power transmission line.
Further, the electric cabinet is arranged on the second mounting frame 5 and comprises a radar driving plate 6, a three-dimensional laser radar 3, an RS232 communication module 8 and a power module 9;
the radar driving board 6 is connected with the three-dimensional laser radar 3 and is used for driving the three-dimensional laser radar 3 to work;
the three-dimensional laser radar 3 is used for detecting and acquiring point cloud data of the power transmission line and transmitting the point cloud data of the power transmission line to the microcomputer 7;
the microcomputer 7 calculates a coordinate point of the power transmission line based on the acquired point cloud data of the power transmission line, and simultaneously calculates a relative distance between the aircraft 1 and the power transmission line by comparing the coordinate point of the power transmission line with the coordinate point of the aircraft 1 based on a PID control algorithm, and controls the relative distance between the aircraft 1 and the power transmission line to be kept within a preset distance range, so that the aircraft 1 can keep a safe distance in a cruising process and the double optical cameras 2 can shoot inspection images with good quality.
It should be noted that, in this embodiment, the preset distance range is 4-5 meters.
Further, the three-dimensional laser radar 3 is provided with a plurality of laser emission ports, in this embodiment, the number of the laser emission ports is 16, and 16 laser beams can be emitted simultaneously, so that the distance between the aircraft 1 and the power transmission line can be measured more accurately.
The three-dimensional laser radar 3 is provided with a central shaft for 360-degree laser scanning, and a laser emission port rotates relative to the central shaft.
The power module 9 is electrically connected with the radar drive board 6 and the microcomputer 7 respectively and used for supplying power to the three-dimensional laser radar 3 and the microcomputer 7.
Example two
In the second embodiment, on the basis of the first embodiment, the microcomputer 7 further includes a defect management module, a report set module and a data storage module;
the system comprises a fault management module, a report set and a fault diagnosis module, wherein the fault management module is used for screening and classifying line fault data after the microcomputer generates the line fault data, and adding the line fault data into the report set;
specifically, the defect management module stores and records position information of the identified line defect data in the inspection image, and can classify and screen the line defect data according to the defect conditions of strand breakage, strand scattering, ablation and the like;
and further, the report set module is used for receiving the report set, checking defects in the report set and generating the inspection report.
Further, the data management module is used for calculating the sag value of the power transmission line in the patrol image and the relative distance between the power transmission line and an obstacle below the power transmission line, and modeling the working environment in the scanning range of the three-dimensional laser radar 3;
specifically, the RTK positioning system is used for determining the coordinate and the elevation data of the wire of the power transmission line, acquiring a drooping curvature image of the power transmission wire between towers in the power transmission line by combining the double optical cameras 2, and transmitting the coordinate, the elevation data and the curvature image of the wire to the data management module for fitting and calculating a sag value so as to judge whether a defect exists;
in this embodiment, the three-dimensional laser radar 3 may also scan surrounding obstacles, so as to obtain a clearance distance between the power transmission line and the obstacles, and the obstacles (such as trees) below the power transmission line have a relatively large threat to the power transmission line, and the clearance distance measurement may be implemented by the three-dimensional laser radar 3, and transmitted to the data management module to determine whether the clearance distance is within a reasonable range;
in addition, the three-dimensional laser radar 3 transmits point cloud data, IMU inertial navigation data and RTK data obtained by scanning surrounding obstacles to the data management module, and can perform calculation modeling, so that whether the surrounding environment threatens the power transmission line is judged.
And further, the data storage module is used for storing the inspection data, the line defect data, the normal sample information, the defect sample information and the inspection report.
The embodiment can realize rapid classification, intelligent identification and automatic report generation of the defects of the power transmission line, greatly improve the working efficiency of line operators, greatly reduce the operation cost of a power grid and overcome the difficulty of large redundant data processing and management workload compared with the traditional manual data processing.
EXAMPLE III
In a third embodiment, on the basis of the first embodiment or the second embodiment, a method for identifying a fault of a power transmission line based on a three-dimensional laser radar 3 is provided, with reference to fig. 2, including:
step S101: controlling the aircraft to fly to a power transmission line operation site to be inspected through a ground monitoring device;
step S102: shooting the power transmission line through a double-optical camera to obtain a scene picture and an infrared thermal image containing the power transmission line;
step S103: transmitting the scene picture and the infrared thermal image of the power transmission line to the microcomputer and the aircraft through the local area network;
step S104: fusing a scene picture of the power transmission line and the infrared thermography to generate a patrol image based on a convolutional neural network algorithm through a microcomputer;
step S105: matching features in the inspection image based on a deep learning training algorithm through a microcomputer so as to identify a lead of the power transmission line, judging whether the temperature corresponding to the lead exceeds a preset temperature threshold value, and generating line defect data when the temperature corresponding to the lead exceeds the preset temperature threshold value;
step S106: generating and storing a patrol inspection report through a microcomputer, wherein the patrol inspection report contains line defect data.
Further, after step S101, step S102 is preceded by step S201:
the method comprises the steps of detecting point cloud data of the power transmission line through a three-dimensional laser radar, transmitting the point cloud data of the power transmission line to a microcomputer, calculating a coordinate point of the power transmission line through the microcomputer, and controlling the relative distance between an aircraft and the power transmission line to be kept within a preset distance range based on a PID control algorithm.
It can be understood that, for convenience and brevity of description, it can be clearly understood by those skilled in the art that the specific working processes of the system and the module described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is merely a logical division, and in actual implementation, there may be other divisions, for example, multiple modules or components may be combined or integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or modules, and may be in an electrical, mechanical or other form.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (9)
1. The utility model provides a transmission line fault identification system based on three-dimensional laser radar which characterized in that includes: the aircraft is provided with a double-optical camera, a switch and a microcomputer;
the double-optical camera comprises a visible light camera and an infrared camera, the visible light camera is used for shooting a scene picture of the power transmission line, and the infrared camera is used for acquiring an infrared thermal image of the power transmission line by sensing infrared radiation energy of the power transmission line;
the microcomputer is used for fusing a scene picture of the power transmission line with an infrared thermography to generate a routing inspection image based on a convolutional neural network algorithm, matching features in the routing inspection image based on a deep learning training algorithm to identify a lead of the power transmission line, judging whether the temperature corresponding to the lead exceeds a preset temperature threshold value, generating line defect data when the temperature corresponding to the lead exceeds the preset temperature threshold value, and meanwhile, the microcomputer is used for generating and storing a routing inspection report which comprises the line defect data;
the microcomputer comprises a defect management module and a report set module;
the defect management module is used for screening and classifying the line defect data after the microcomputer generates the line defect data, and adding the line defect data into a report set;
the report set module is used for receiving the report set and generating a patrol report;
the switch is used for respectively connecting the dual-optical camera with the microcomputer and the aircraft to realize synchronous data interaction;
the aircraft is provided with an RTK navigation positioning system for acquiring a coordinate point of the aircraft and a data management module for storing aircraft patrol data;
the machine patrol data comprises coordinate points of towers in the power transmission line;
and the microcomputer is used for respectively acquiring coordinate points corresponding to the current coordinate point of the aircraft and the nearest two-end tower corresponding to the lead based on the RTK navigation positioning system and the machine patrol data after the temperature corresponding to the lead exceeds a preset temperature threshold value, so as to calculate the coordinate point of the lead.
2. The power transmission line fault identification system based on the three-dimensional laser radar as claimed in claim 1, wherein the aircraft is further provided with the three-dimensional laser radar, a radar driving plate, an RS232 communication module and a power supply module;
the radar driving board is connected with the three-dimensional laser radar and used for driving the three-dimensional laser radar to work;
the three-dimensional laser radar is used for detecting and acquiring point cloud data of the power transmission line;
the microcomputer is in communication connection with the radar driving board through the RS232 communication module;
the microcomputer calculates a coordinate point of the power transmission line based on the acquired point cloud data of the power transmission line, and simultaneously calculates a relative distance between the aircraft and the power transmission line by comparing the coordinate point of the power transmission line and the coordinate point of the aircraft based on a PID control algorithm, and controls the relative distance between the aircraft and the power transmission line to be kept within a preset distance range;
and the power supply module is used for supplying power to the three-dimensional laser radar and the microcomputer.
3. The three-dimensional lidar based power transmission line fault identification system of claim 1, further comprising a ground monitoring device in wireless communication with the aircraft for controlling the aircraft and obtaining the aircraft data.
4. The three-dimensional lidar based power transmission line fault identification system of claim 3, wherein a transmission antenna is provided on the aerial vehicle;
the transmission antenna is in wireless communication connection with the ground monitoring device, and links in wireless communication connection comprise a 2.4G wireless communication link for image transmission and a 5.8G wireless communication link for command transmission.
5. The three-dimensional lidar based power transmission line fault identification system of claim 1, wherein the aerial vehicle is provided with a three-axis anti-shake pan-tilt for controlling the three-dimensional rotation of the dual-optical camera.
6. The three-dimensional lidar based power transmission line fault identification system of claim 4, wherein the ground monitoring apparatus comprises a remote controller and a display device;
the double-optical camera is provided with an image stream push flow processor, and the image stream push flow processor is used for superposing and rendering the scene picture of the power transmission line and the infrared thermography to generate a rendered image so as to realize single-line transmission of the image;
the remote controller is used for controlling the working states of the aircraft and the dual-light camera;
the display device is used for receiving and displaying the rendering image.
7. The three-dimensional lidar based power transmission line fault identification system of claim 1, wherein the microcomputer comprises a data storage module;
the data storage module is used for storing the line defect data, the routing inspection report and the machine routing inspection data.
8. A power transmission line fault identification method based on a three-dimensional laser radar is applied to the power transmission line fault identification system based on the three-dimensional laser radar in any one of claims 1 to 7, and is characterized by comprising the following steps:
step S101: controlling the aircraft to fly to a power transmission line operation site to be inspected through a ground monitoring device;
step S102: shooting the power transmission line through a double-optical camera to obtain a scene picture and an infrared thermal image containing the power transmission line;
step S103: transmitting the scene picture and the infrared thermal image of the power transmission line to a microcomputer and the aircraft through a local area network;
step S104: fusing the scene picture of the power transmission line and the infrared thermography to generate a patrol image based on a convolutional neural network algorithm through the microcomputer;
step S105: matching features in the inspection image based on a deep learning training algorithm through the microcomputer so as to identify a lead of the power transmission line, judging whether the temperature corresponding to the lead exceeds a preset temperature threshold value, and generating line defect data when the temperature corresponding to the lead exceeds the preset temperature threshold value;
step S106: generating and storing a patrol report by the microcomputer, the patrol report including the line defect data.
9. The method for identifying the transmission line fault based on the three-dimensional laser radar as claimed in claim 8, wherein after the step S101, before the step S102, the method further comprises the step S201:
the method comprises the steps of detecting point cloud data of the power transmission line through a three-dimensional laser radar, transmitting the point cloud data of the power transmission line to a microcomputer, calculating a coordinate point of the power transmission line through the microcomputer, and controlling the relative distance between the aircraft and the power transmission line to be kept within a preset distance range based on a PID control algorithm.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010863796.9A CN111952883B (en) | 2020-08-25 | 2020-08-25 | Power transmission line fault recognition system and method based on three-dimensional laser radar |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010863796.9A CN111952883B (en) | 2020-08-25 | 2020-08-25 | Power transmission line fault recognition system and method based on three-dimensional laser radar |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111952883A CN111952883A (en) | 2020-11-17 |
| CN111952883B true CN111952883B (en) | 2022-03-29 |
Family
ID=73367509
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010863796.9A Active CN111952883B (en) | 2020-08-25 | 2020-08-25 | Power transmission line fault recognition system and method based on three-dimensional laser radar |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111952883B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113160150B (en) * | 2021-04-01 | 2022-12-06 | 西安科技大学 | AI (Artificial intelligence) detection method and device for invasion of foreign matters in wire mesh |
| CN113591574B (en) * | 2021-06-29 | 2024-02-27 | 山东信通电子股份有限公司 | Power transmission line inspection method and device based on laser radar |
| CN113286129B (en) * | 2021-07-23 | 2021-10-22 | 北京图知天下科技有限责任公司 | Inspection method and system for photovoltaic power station |
| CN113808081A (en) * | 2021-08-16 | 2021-12-17 | 广西电网有限责任公司河池供电局 | A system for detecting defects in small-sized fittings of transmission lines |
| CN113872024A (en) * | 2021-12-01 | 2021-12-31 | 中国工程物理研究院电子工程研究所 | Intelligent fault diagnosis method for multi-source physical monitoring quantity of optical fiber laser system |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108037770A (en) * | 2017-11-22 | 2018-05-15 | 国网山东省电力公司济宁供电公司 | Unmanned plane power transmission line polling system and method based on artificial intelligence |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101833099B (en) * | 2010-05-25 | 2012-12-05 | 广州科易光电技术有限公司 | Locked tracking method of helicopter in the inspection process of electric power circuits |
| US8275570B2 (en) * | 2011-03-02 | 2012-09-25 | Utility Risk Management Corporation, Llc | Thermal powerline rating and clearance analysis using local thermal sensor |
| CN102941920A (en) * | 2012-12-05 | 2013-02-27 | 南京理工大学 | High-tension transmission line inspection robot based on multi-rotor aircraft and method using robot |
| CN107491781A (en) * | 2017-07-21 | 2017-12-19 | 国家电网公司 | A kind of crusing robot visible ray and infrared sensor data fusion method |
| CN108039680B (en) * | 2017-11-13 | 2020-07-03 | 国网山东省电力公司荣成市供电公司 | Automatic cruise power line detection unmanned aerial vehicle and detection method thereof |
| CN109885083A (en) * | 2019-03-06 | 2019-06-14 | 国网陕西省电力公司检修公司 | Transmission line of electricity fining inspection flying platform and method for inspecting based on laser radar |
| CN110765948A (en) * | 2019-10-24 | 2020-02-07 | 长沙品先信息技术有限公司 | Target detection and identification method and system based on unmanned aerial vehicle |
-
2020
- 2020-08-25 CN CN202010863796.9A patent/CN111952883B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108037770A (en) * | 2017-11-22 | 2018-05-15 | 国网山东省电力公司济宁供电公司 | Unmanned plane power transmission line polling system and method based on artificial intelligence |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111952883A (en) | 2020-11-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111952883B (en) | Power transmission line fault recognition system and method based on three-dimensional laser radar | |
| CN109961157B (en) | Inspection method and system of solar photovoltaic power generation system | |
| CN112360699A (en) | Intelligent inspection and diagnosis analysis method for blades of full-automatic wind generating set | |
| CN111198004A (en) | Electric power inspection information acquisition system based on unmanned aerial vehicle | |
| CN110888457A (en) | System and method for carrying out three-dimensional inspection on power transformation equipment by using unmanned aerial vehicle and robot | |
| CN111311967A (en) | Unmanned aerial vehicle-based power line inspection system and method | |
| CN110850890A (en) | Photovoltaic power station UAV inspection system and its control method | |
| CN108957240A (en) | Electric network fault is remotely located method and system | |
| CN105700544A (en) | UAV tour inspection system and implementation method for electrical equipment of photovoltaic power station | |
| CN112039215A (en) | Three-dimensional inspection system and inspection method for transformer substation | |
| KR101634937B1 (en) | System for automatic vision inspection, method using the same | |
| CN110207832A (en) | High-tension line cruising inspection system and its method for inspecting based on unmanned plane | |
| CN106026393A (en) | Intelligent line-cruising and operational safety risk prediction system and method for power grid linef | |
| CN111244822B (en) | Fixed-wing unmanned aerial vehicle line patrol method, system and device in complex geographic environment | |
| CN115755946A (en) | Power inspection method, device and system based on digital twinning | |
| CN112067137A (en) | An automatic temperature measurement method for power lines based on UAV line patrolling | |
| CN114418285A (en) | An intelligent alarm system and method for power transmission and distribution inspection data | |
| CN107885229A (en) | A kind of unmanned plane and its electric power line inspection method of achievable power line automatic detecting | |
| CN207268846U (en) | Electric inspection process robot | |
| CN108171291A (en) | Inspection operation method and system based on unmanned aerial vehicle | |
| CN110967600A (en) | Composite insulator degradation diagnosis method based on unmanned aerial vehicle infrared detection | |
| CN113031462A (en) | Port machine inspection route planning system and method for unmanned aerial vehicle | |
| CN208384644U (en) | Unmanned plane Power Line Inspection System | |
| CN207636515U (en) | A drone detection device for insulator defects | |
| CN202885975U (en) | Three-dimensional infrared temperature measurement monitoring system of transformer substation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |