CN118092462A - Gas pipeline risk identification method and early warning system based on unmanned aerial vehicle and AI - Google Patents
Gas pipeline risk identification method and early warning system based on unmanned aerial vehicle and AI Download PDFInfo
- Publication number
- CN118092462A CN118092462A CN202311830942.8A CN202311830942A CN118092462A CN 118092462 A CN118092462 A CN 118092462A CN 202311830942 A CN202311830942 A CN 202311830942A CN 118092462 A CN118092462 A CN 118092462A
- Authority
- CN
- China
- Prior art keywords
- drone
- route
- preset
- gas pipeline
- risk identification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 22
- 238000007689 inspection Methods 0.000 claims abstract description 35
- 238000001514 detection method Methods 0.000 claims description 29
- 238000013459 approach Methods 0.000 claims description 12
- 238000012549 training Methods 0.000 claims description 11
- 239000013589 supplement Substances 0.000 claims description 7
- 238000012423 maintenance Methods 0.000 abstract description 5
- VNWKTOKETHGBQD-UHFFFAOYSA-N methane Chemical compound C VNWKTOKETHGBQD-UHFFFAOYSA-N 0.000 description 8
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 101001121408 Homo sapiens L-amino-acid oxidase Proteins 0.000 description 2
- 102100026388 L-amino-acid oxidase Human genes 0.000 description 2
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Landscapes
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
Abstract
本发明提供基于无人机与AI的燃气管道风险识别方法与预警系统,其中方法包括:基于小区对应的预设的燃气管网模型,规划飞行检测路线;基于所述飞行检测路线,控制无人机对小区进行燃气管道检测;持续获取所述无人机回传的检测数据;基于所述检测数据、预设的AI风险识别模型,确定燃气管道风险;输出预警所述燃气管道风险。本发明基于规划的飞行检测路线,控制无人机对小区进行燃气管道检测,基于无人机回传的检测数据以及AI风险识别模型确定燃气管道风险,自动、自适应完成小区内的燃气管网风险识别,无需燃气检修人员人工完成,极大程度降低了人力成本,另外,提升了燃气管道风险识别的效率。
The present invention provides a gas pipeline risk identification method and early warning system based on drones and AI, wherein the method includes: planning a flight inspection route based on a preset gas pipeline network model corresponding to a community; based on the flight inspection route, controlling a drone to perform gas pipeline inspection on the community; continuously acquiring the inspection data sent back by the drone; determining the gas pipeline risk based on the inspection data and a preset AI risk identification model; and outputting an early warning of the gas pipeline risk. The present invention controls a drone to perform gas pipeline inspection on a community based on a planned flight inspection route, determines the gas pipeline risk based on the inspection data sent back by the drone and the AI risk identification model, and automatically and adaptively completes the gas pipeline network risk identification in the community, without the need for gas maintenance personnel to complete it manually, which greatly reduces the labor cost and improves the efficiency of gas pipeline risk identification.
Description
技术领域Technical Field
本发明涉及燃气管道风险识别技术领域,特别涉及基于无人机与AI的燃气管道风险识别方法与预警系统。The present invention relates to the technical field of gas pipeline risk identification, and in particular to a gas pipeline risk identification method and early warning system based on drones and AI.
背景技术Background technique
为保证小区内的燃气使用安全,需要对燃气管道进行风险识别。一般的,对燃气管道进行风险识别均是由燃气检修人员人工完成,在小区内挨家挨户进行,工作量较大,人力成本较大;另外,燃气管道多布设于小区楼栋外墙上,特别是高层楼栋,燃气检修人员的工作难度较大,影响工作效率。因此,亟需一种解决办法。In order to ensure the safety of gas use in the community, it is necessary to identify the risks of gas pipelines. Generally, the risk identification of gas pipelines is done manually by gas maintenance personnel, who go door to door in the community, which is a large workload and has high labor costs. In addition, gas pipelines are mostly laid on the outer walls of community buildings, especially high-rise buildings, which makes the work of gas maintenance personnel more difficult and affects work efficiency. Therefore, a solution is urgently needed.
发明内容Summary of the invention
本发明目的之一在于提供了基于无人机与AI的燃气管道风险识别方法,基于规划的飞行检测路线,控制无人机对小区进行燃气管道检测,基于无人机回传的检测数据以及AI风险识别模型确定燃气管道风险,自动、自适应完成小区内的燃气管网风险识别,无需燃气检修人员人工完成,极大程度降低了人力成本,另外,提升了燃气管道风险识别的效率。One of the purposes of the present invention is to provide a gas pipeline risk identification method based on drones and AI. Based on the planned flight inspection route, the drone is controlled to conduct gas pipeline inspection in the community. The gas pipeline risk is determined based on the inspection data sent back by the drone and the AI risk identification model. The gas pipeline network risk identification in the community is automatically and adaptively completed without the need for manual completion by gas maintenance personnel, which greatly reduces the labor cost. In addition, the efficiency of gas pipeline risk identification is improved.
本发明实施例提供的基于无人机与AI的燃气管道风险识别方法,包括:The gas pipeline risk identification method based on drone and AI provided in the embodiment of the present invention includes:
基于小区对应的预设的燃气管网模型,规划飞行检测路线;Plan flight inspection routes based on the preset gas pipeline network model corresponding to the community;
基于飞行检测路线,控制无人机对小区进行燃气管道检测;Based on the flight inspection route, control the drone to inspect the gas pipeline in the community;
持续获取无人机回传的检测数据;Continuously obtain the detection data sent back by the drone;
基于检测数据、预设的AI风险识别模型,确定燃气管道风险;Determine gas pipeline risks based on detection data and preset AI risk identification models;
输出预警燃气管道风险。Output warning of gas pipeline risks.
优选的,基于无人机与AI的燃气管道风险识别方法,还包括:Preferably, the gas pipeline risk identification method based on drones and AI also includes:
从飞行检测路线中确定符合第一局部路线条件的第一局部路线;Determine a first partial route that meets the first partial route condition from the flight detection route;
当无人机沿第一局部路线飞行时,控制无人机检测最近预设的第一时间内进入无人机周边预设的第一范围内的靠近人员的靠近移动路线;When the drone flies along the first local route, the drone is controlled to detect a moving route of a person approaching the drone within a first preset range within a first preset time period;
基于靠近移动路线、第一局部路线,确定避离方向;从靠近移动路线的路线终点出发向避离方向的射线与第一局部路线之间无交点、且射线与第一局部路线之间的最短距离大于等于预设的距离阈值;Based on the approaching moving route and the first partial route, determining the avoiding direction; there is no intersection between the ray from the route end point of the approaching moving route to the avoiding direction and the first partial route, and the shortest distance between the ray and the first partial route is greater than or equal to a preset distance threshold;
基于避离方向、靠近移动路线,确定投影区域;投影区域为预设的1/N圆、1/N圆的圆心为路线终点且1/N圆被射线平分;N大于2;Based on the avoidance direction and the approach movement route, the projection area is determined; the projection area is a preset 1/N circle, the center of the 1/N circle is the end point of the route and the 1/N circle is bisected by the ray; N is greater than 2;
控制无人机持续检测靠近人员的眼部位置、眼部朝向;Control the drone to continuously detect the eye position and eye direction of the person approaching;
基于眼部位置、眼部朝向,构建第一方向向量;Constructing a first direction vector based on the eye position and the eye orientation;
基于无人机的投射位置、由投射位置向投影区域投影的投射方向,构建第二方向向量;Constructing a second direction vector based on the projection position of the UAV and the projection direction from the projection position to the projection area;
当第一方向向量与第二方向向量之间的向量夹角持续落入预设的夹角区间内的持续时长大于等于预设的时长阈值时,控制无人机向投影区域投射避离方向对应的预设的避离提示图案;When the vector angle between the first direction vector and the second direction vector continues to fall within the preset angle interval for a duration greater than or equal to a preset duration threshold, the drone is controlled to project a preset avoidance prompt pattern corresponding to the avoidance direction to the projection area;
其中,第一局部路线条件包括:Among them, the first local route conditions include:
第一局部路线的第一平均飞行高度小于等于预设的第一高度阈值;A first average flight altitude of the first local route is less than or equal to a preset first altitude threshold;
第一局部路线途经的第一小区设施类型存在于预设的第一标准设施类型库中。The first cell facility type passed by the first local route exists in a preset first standard facility type library.
优选的,基于无人机与AI的燃气管道风险识别方法,还包括:Preferably, the gas pipeline risk identification method based on drones and AI also includes:
从飞行检测路线中确定符合第二局部路线条件的第二局部路线;Determine a second partial route that meets the second partial route condition from the flight detection route;
当无人机沿第二局部路线飞行时,控制无人机检测最近预设的第二时间内进入无人机周边预设的第二范围内的室内人员的人员状态变化;When the drone flies along the second local route, the drone is controlled to detect changes in the status of indoor personnel who have entered a second preset range around the drone within a recent second preset time;
当人员状态变化符合预设的变化条件时,控制无人机检测室内人员的人员画像、视窗区域;When the status change of the person meets the preset change conditions, the drone is controlled to detect the person portrait and window area of the indoor person;
基于人员画像,确定作业提示音频;Determine the audio of the operation prompt based on the personnel portrait;
从第二局部路线中确定符合第三局部路线条件的第三局部路线;determining a third partial route from the second partial routes that meets the third partial route conditions;
当无人机沿第三局部路线飞行时,控制无人机播报作业提示音频;When the UAV flies along the third local route, the UAV is controlled to broadcast the operation prompt audio;
其中,第二局部路线条件包括:Among them, the second local route conditions include:
第二局部路线的第二平均飞行高度大于等于预设的第二高度阈值;The second average flight altitude of the second local route is greater than or equal to a preset second altitude threshold;
第二局部路线途经的第二小区设施类型存在于预设的第二标准设施类型库中;The second community facility type passed by the second local route exists in the preset second standard facility type library;
其中,第三局部路线条件包括:Among them, the third local route conditions include:
无人机未来预设的第三时间内会沿第三局部路线飞行;The drone will fly along the third local route within a preset third time in the future;
无人机沿第三局部路线飞行时,无人机持续靠近视窗区域。As the drone flies along the third local route, the drone continues to approach the window area.
优选的,基于无人机与AI的燃气管道风险识别方法,还包括:Preferably, the gas pipeline risk identification method based on drones and AI also includes:
控制无人机对燃气管道风险进行风险跟踪。Control drones to track gas pipeline risks.
优选的,基于无人机与AI的燃气管道风险识别方法,还包括:Preferably, the gas pipeline risk identification method based on drones and AI also includes:
补充训练AI风险识别模型。Supplement training of AI risk identification model.
本发明实施例提供的基于无人机与AI的燃气管道风险识别系统,包括:The gas pipeline risk identification system based on drone and AI provided by the embodiment of the present invention includes:
路线规划模块,用于基于小区对应的预设的燃气管网模型,规划飞行检测路线;Route planning module, used to plan flight inspection routes based on the preset gas pipeline network model corresponding to the community;
第一控制模块,用于基于飞行检测路线,控制无人机对小区进行燃气管道检测;The first control module is used to control the drone to perform gas pipeline inspection in the community based on the flight inspection route;
数据获取模块,用于持续获取无人机回传的检测数据;Data acquisition module, used to continuously acquire detection data sent back by the drone;
风险确定模块,用于基于检测数据、预设的AI风险识别模型,确定燃气管道风险;The risk determination module is used to determine the gas pipeline risk based on the detection data and the preset AI risk identification model;
风险预警模块,用于输出预警燃气管道风险。The risk warning module is used to output warnings of gas pipeline risks.
优选的,基于无人机与AI的燃气管道风险识别系统,还包括:Preferably, the gas pipeline risk identification system based on drones and AI also includes:
第二控制模块,用于包括:The second control module is configured to include:
从飞行检测路线中确定符合第一局部路线条件的第一局部路线;Determine a first partial route that meets the first partial route condition from the flight detection route;
当无人机沿第一局部路线飞行时,控制无人机检测最近预设的第一时间内进入无人机周边预设的第一范围内的靠近人员的靠近移动路线;When the drone flies along the first local route, the drone is controlled to detect a moving route of a person approaching the drone within a first preset range within a first preset time period;
基于靠近移动路线、第一局部路线,确定避离方向;从靠近移动路线的路线终点出发向避离方向的射线与第一局部路线之间无交点、且射线与第一局部路线之间的最短距离大于等于预设的距离阈值;Based on the approaching moving route and the first partial route, determining the avoiding direction; there is no intersection between the ray from the route end point of the approaching moving route to the avoiding direction and the first partial route, and the shortest distance between the ray and the first partial route is greater than or equal to a preset distance threshold;
基于避离方向、靠近移动路线,确定投影区域;投影区域为预设的1/N圆、1/N圆的圆心为路线终点且1/N圆被射线平分;N大于2;Based on the avoidance direction and the approach movement route, the projection area is determined; the projection area is a preset 1/N circle, the center of the 1/N circle is the end point of the route and the 1/N circle is bisected by the ray; N is greater than 2;
控制无人机持续检测靠近人员的眼部位置、眼部朝向;Control the drone to continuously detect the eye position and eye direction of the person approaching;
基于眼部位置、眼部朝向,构建第一方向向量;Constructing a first direction vector based on the eye position and the eye orientation;
基于无人机的投射位置、由投射位置向投影区域投影的投射方向,构建第二方向向量;Constructing a second direction vector based on the projection position of the drone and the projection direction from the projection position to the projection area;
当第一方向向量与第二方向向量之间的向量夹角持续落入预设的夹角区间内的持续时长大于等于预设的时长阈值时,控制无人机向投影区域投射避离方向对应的预设的避离提示图案;When the vector angle between the first direction vector and the second direction vector continues to fall within the preset angle interval for a duration greater than or equal to a preset duration threshold, the drone is controlled to project a preset avoidance prompt pattern corresponding to the avoidance direction to the projection area;
其中,第一局部路线条件包括:Among them, the first local route conditions include:
第一局部路线的第一平均飞行高度小于等于预设的第一高度阈值;A first average flight altitude of the first local route is less than or equal to a preset first altitude threshold;
第一局部路线途经的第一小区设施类型存在于预设的第一标准设施类型库中。The first cell facility type passed by the first local route exists in a preset first standard facility type library.
优选的,基于无人机与AI的燃气管道风险识别系统,还包括:Preferably, the gas pipeline risk identification system based on drones and AI also includes:
第三控制模块,用于包括:The third control module is used to include:
从飞行检测路线中确定符合第二局部路线条件的第二局部路线;Determine a second partial route that meets the second partial route condition from the flight detection route;
当无人机沿第二局部路线飞行时,控制无人机检测最近预设的第二时间内进入无人机周边预设的第二范围内的室内人员的人员状态变化;When the drone flies along the second local route, the drone is controlled to detect changes in the status of indoor personnel who have entered a second preset range around the drone within a recent second preset time;
当人员状态变化符合预设的变化条件时,控制无人机检测室内人员的人员画像、视窗区域;When the status change of the person meets the preset change conditions, the drone is controlled to detect the person portrait and window area of the indoor person;
基于人员画像,确定作业提示音频;Determine the audio of the operation prompt based on the personnel portrait;
从第二局部路线中确定符合第三局部路线条件的第三局部路线;determining a third partial route from the second partial routes that meets the third partial route conditions;
当无人机沿第三局部路线飞行时,控制无人机播报作业提示音频;When the UAV flies along the third local route, the UAV is controlled to broadcast the operation prompt audio;
其中,第二局部路线条件包括:Among them, the second local route conditions include:
第二局部路线的第二平均飞行高度大于等于预设的第二高度阈值;The second average flight altitude of the second local route is greater than or equal to a preset second altitude threshold;
第二局部路线途经的第二小区设施类型存在于预设的第二标准设施类型库中;The second community facility type passed by the second local route exists in the preset second standard facility type library;
其中,第三局部路线条件包括:Among them, the third local route conditions include:
无人机未来预设的第三时间内会沿第三局部路线飞行;The drone will fly along the third local route within a preset third time in the future;
无人机沿第三局部路线飞行时,无人机持续靠近视窗区域。As the drone flies along the third local route, the drone continues to approach the window area.
优选的,基于无人机与AI的燃气管道风险识别系统,还包括:Preferably, the gas pipeline risk identification system based on drones and AI also includes:
风险跟踪模块,用于控制无人机对燃气管道风险进行风险跟踪。The risk tracking module is used to control the drone to track gas pipeline risks.
优选的,基于无人机与AI的燃气管道风险识别系统,还包括:Preferably, the gas pipeline risk identification system based on drones and AI also includes:
补充训练模块,用于补充训练AI风险识别模型。Supplementary training module, used to supplement the training of AI risk identification model.
本发明的其它特征和优点将在随后的说明书中阐述,并且,部分地从说明书中变得显而易见,或者通过实施本发明而了解。本发明的目的和其他优点可通过在所写的说明书、权利要求书、以及附图中所特别指出的结构来实现和获得。Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description, claims, and drawings.
下面通过附图和实施例,对本发明的技术方案做进一步的详细描述。The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
附图用来提供对本发明的进一步理解,并且构成说明书的一部分,与本发明的实施例一起用于解释本发明,并不构成对本发明的限制。在附图中:The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:
图1为本发明实施例中基于无人机与AI的燃气管道风险识别方法的示意图;FIG1 is a schematic diagram of a gas pipeline risk identification method based on drones and AI in an embodiment of the present invention;
图2为本发明实施例中基于无人机与AI的燃气管道风险识别系统的示意图。FIG2 is a schematic diagram of a gas pipeline risk identification system based on drones and AI in an embodiment of the present invention.
具体实施方式Detailed ways
以下结合附图对本发明的优选实施例进行说明,应当理解,此处所描述的优选实施例仅用于说明和解释本发明,并不用于限定本发明。The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.
本发明实施例提供了基于无人机与AI的燃气管道风险识别方法,如图1所示,包括:The embodiment of the present invention provides a gas pipeline risk identification method based on drones and AI, as shown in FIG1 , including:
步骤S1:基于小区对应的预设的燃气管网模型,规划飞行检测路线;Step S1: planning a flight inspection route based on a preset gas pipeline network model corresponding to the community;
步骤S2:基于飞行检测路线,控制无人机对小区进行燃气管道检测;Step S2: Based on the flight detection route, control the drone to perform gas pipeline detection in the community;
步骤S3:持续获取无人机回传的检测数据;Step S3: Continuously obtain the detection data sent back by the drone;
步骤S4:基于检测数据、预设的AI风险识别模型,确定燃气管道风险;Step S4: Determine the gas pipeline risk based on the detection data and the preset AI risk identification model;
步骤S5:输出预警燃气管道风险。Step S5: Output warning gas pipeline risk.
上述方案中,燃气管网模型为小区的三维建模模型,其上标记有小区内燃气管网的布设位置;基于燃气管网模型可以规划无人机对小区进行燃气管道检测的飞行检测路线,飞行检测路线途经飞行检测路线上的每一路线点;当无人机对小区进行燃气管道检测时,无人机上配备的激光甲烷遥测仪、甲烷传感器等会开始工作,检测并回传检测数据;AI风险识别模型为将大量的代表出现燃气风险的激光甲烷遥测仪、甲烷传感器等的检测数据作为训练样本对神经网络模型训练至收敛后的人工智能模型;AI风险识别模型可以根据检测数据识别燃气管道风险;当确定到燃气管道风险后,输出预警。In the above scheme, the gas pipeline network model is a three-dimensional model of the community, on which the layout of the gas pipeline network in the community is marked; based on the gas pipeline network model, a flight inspection route for drones to conduct gas pipeline inspections in the community can be planned, and the flight inspection route passes through each route point on the flight inspection route; when the drone conducts gas pipeline inspections in the community, the laser methane telemeter, methane sensor, etc. equipped on the drone will start working, detect and send back the detection data; the AI risk identification model is an artificial intelligence model that uses a large amount of detection data from laser methane telemeters, methane sensors, etc. representing gas risks as training samples to train the neural network model until convergence; the AI risk identification model can identify gas pipeline risks based on the detection data; when the gas pipeline risk is determined, an early warning is output.
本申请基于规划的飞行检测路线,控制无人机对小区进行燃气管道检测,基于无人机回传的检测数据以及AI风险识别模型确定燃气管道风险,自动、自适应完成小区内的燃气管网风险识别,无需燃气检修人员人工完成,极大程度降低了人力成本,另外,提升了燃气管道风险识别的效率。This application controls drones to conduct gas pipeline inspections in residential areas based on planned flight inspection routes, determines gas pipeline risks based on the inspection data sent back by drones and AI risk identification models, and automatically and adaptively completes gas pipeline network risk identification in the residential area. This eliminates the need for manual work by gas maintenance personnel, greatly reducing labor costs. In addition, it improves the efficiency of gas pipeline risk identification.
在一个实施例中,基于无人机与AI的燃气管道风险识别方法,还包括:In one embodiment, the gas pipeline risk identification method based on drones and AI further includes:
从飞行检测路线中确定符合第一局部路线条件的第一局部路线;Determine a first partial route that meets the first partial route condition from the flight detection route;
当无人机沿第一局部路线飞行时,控制无人机检测最近预设的第一时间内进入无人机周边预设的第一范围内的靠近人员的靠近移动路线;第一时间可以为,比如:100秒;第一范围为无人机周边半径长度为15米的圆形范围;靠近人员可以为小区内的居民等;靠近移动路线为靠近人员的脚部在地面移动产生的路线;靠近移动路线可以通过无人机配备的摄像机、毫米波雷达传感器等获取;When the drone flies along the first local route, the drone is controlled to detect the approach movement route of the approaching person who enters the first preset range around the drone within the latest preset first time; the first time may be, for example, 100 seconds; the first range is a circular range with a radius of 15 meters around the drone; the approaching person may be a resident in a residential area, etc.; the approach movement route is the route generated by the feet of the approaching person moving on the ground; the approach movement route may be obtained by a camera, a millimeter wave radar sensor, etc. equipped by the drone;
基于靠近移动路线、第一局部路线,确定避离方向;从靠近移动路线的路线终点出发向避离方向的射线与第一局部路线之间无交点、且射线与第一局部路线之间的最短距离大于等于预设的距离阈值;距离阈值可以为,比如:0.5米;射线与第一局部路线之间无交点、射线与第一局部路线之间的最短距离大于等于距离阈值可以保证靠近人员向避离反向避离时,未来不会与无人机发生碰撞等;Based on the approaching moving route and the first partial route, the avoidance direction is determined; there is no intersection between the ray from the end point of the approaching moving route to the avoidance direction and the first partial route, and the shortest distance between the ray and the first partial route is greater than or equal to a preset distance threshold; the distance threshold may be, for example, 0.5 meters; there is no intersection between the ray and the first partial route, and the shortest distance between the ray and the first partial route is greater than or equal to the distance threshold, which can ensure that when the approaching person avoids in the avoidance direction, there will be no collision with the drone in the future, etc.;
基于避离方向、靠近移动路线,确定投影区域;投影区域为预设的1/N圆、1/N圆的圆心为路线终点且1/N圆被射线平分;N大于2;靠近移动路线为靠近人员的脚部在地面移动产生的路线,则靠近移动路线的路线终点为地面上,射线平分1/N圆,则投影区域则在地面上;The projection area is determined based on the avoidance direction and the approaching movement route; the projection area is a preset 1/N circle, the center of the 1/N circle is the route end point and the 1/N circle is bisected by the ray; N is greater than 2; the approaching movement route is the route generated by the feet of the approaching person moving on the ground, then the route end point of the approaching movement route is on the ground, and the ray bisected the 1/N circle, then the projection area is on the ground;
控制无人机持续检测靠近人员的眼部位置、眼部朝向;眼部位置、眼部朝向可以通过无人机配备的摄像机获取;Control the drone to continuously detect the eye position and eye orientation of the person approaching; the eye position and eye orientation can be obtained through the camera equipped on the drone;
基于眼部位置、眼部朝向,构建第一方向向量;Constructing a first direction vector based on the eye position and the eye orientation;
基于无人机的投射位置、由投射位置向投影区域投影的投射方向,构建第二方向向量;Constructing a second direction vector based on the projection position of the UAV and the projection direction from the projection position to the projection area;
当第一方向向量与第二方向向量之间的向量夹角持续落入预设的夹角区间内的持续时长大于等于预设的时长阈值时,控制无人机向投影区域投射避离方向对应的预设的避离提示图案;夹角区间可以为30度到180度;时长阈值可以为,比如:2秒;避离提示图案可以为指示避离方向的箭头动画;向量夹角落入夹角区间内时,可以保证无人机开始向投影区域投影时,靠近人员可以通过视觉感知到,从而会看向投影区域,看到避离提示图案,得到避离提示,提升避离提示效果、精准性;投射可通过无人机配备的投影装置实现;When the vector angle between the first direction vector and the second direction vector continuously falls within the preset angle interval for a duration greater than or equal to a preset duration threshold, the drone is controlled to project a preset avoidance prompt pattern corresponding to the avoidance direction to the projection area; the angle interval can be 30 degrees to 180 degrees; the duration threshold can be, for example: 2 seconds; the avoidance prompt pattern can be an arrow animation indicating the avoidance direction; when the vector angle falls within the angle interval, it can be ensured that when the drone starts to project to the projection area, the nearby personnel can perceive it through vision, so that they will look at the projection area, see the avoidance prompt pattern, and get the avoidance prompt, thereby improving the avoidance prompt effect and accuracy; the projection can be achieved through the projection device equipped by the drone;
其中,第一局部路线条件包括:Among them, the first local route conditions include:
第一局部路线的第一平均飞行高度小于等于预设的第一高度阈值;第一高度阈值可以为,比如:3米;第一平均飞行高度为第一局部路线上各个路线点的飞行高度的平均值;The first average flight height of the first partial route is less than or equal to a preset first height threshold; the first height threshold may be, for example, 3 meters; the first average flight height is an average of the flight heights of the route points on the first partial route;
第一局部路线途经的第一小区设施类型存在于预设的第一标准设施类型库中。第一标准设施类型库中有大量的第一标准设施类型,第一标准设施类型为小区内设施上人员可能会与低空飞行的无人机发生碰撞的设施类型,比如:滑滑梯等。The first community facility type that the first partial route passes through exists in a preset first standard facility type library. The first standard facility type library contains a large number of first standard facility types, which are facility types where people on the facilities in the community may collide with low-flying drones, such as slides.
当无人机在小区内燃气管道检测作业时,为避免影响小区居民休息,多在白天进行,白天时,小区内走动的居民会较多,当看到无人机时,居民出于好奇等心理会靠近查看,但是,居民不知道无人机未来移动到哪个位置,可能会来不及躲避从而发生碰撞事故;另外,由于无人机位于空中,无法投射出自己未来的飞行路线,居民没有获知渠道。本发明实施例可以解决这两个问题:控制无人机检测靠近人员,合理确定投射区域,进行避离提示图案的投射,对靠近人员进行避离提示,极大程度上提升无人机燃气管道检测作业的安全性,提升了无人机在小区内作业的适用性;另外,引入第一局部路线条件,确定第一局部路线,自动触发无人机进行避离提示,减少了无人机的工作资源,提升避离提示效率。When drones are inspecting gas pipelines in a residential area, they are usually carried out during the day to avoid affecting the rest of the residents. During the day, there will be more residents walking around in the community. When they see a drone, they will get closer to check it out out of curiosity. However, residents do not know where the drone will move to in the future, and may not have time to avoid it, resulting in a collision accident. In addition, since the drone is in the air, it cannot project its future flight route, and residents have no way to learn about it. The embodiments of the present invention can solve these two problems: control the drone to detect approaching personnel, reasonably determine the projection area, project an avoidance prompt pattern, and give avoidance prompts to approaching personnel, which greatly improves the safety of drone gas pipeline inspection operations and improves the applicability of drone operations in the community. In addition, the first local route condition is introduced, the first local route is determined, and the drone is automatically triggered to give an avoidance prompt, which reduces the working resources of the drone and improves the efficiency of the avoidance prompt.
在一个实施例中,基于无人机与AI的燃气管道风险识别方法,还包括:In one embodiment, the gas pipeline risk identification method based on drones and AI further includes:
从飞行检测路线中确定符合第二局部路线条件的第二局部路线;Determine a second partial route that meets the second partial route condition from the flight detection route;
当无人机沿第二局部路线飞行时,控制无人机检测最近预设的第二时间内进入无人机周边预设的第二范围内的室内人员的人员状态变化;第二时间可以为,比如:40秒;第二范围为无人机周边半径长度为5米的圆形范围;人员状态变化包括:室内人员的动作变化等;人员状态变化可以通过无人机配备的摄像机进行获取;室内人员可以为厨房内的人员等;When the drone flies along the second local route, the drone is controlled to detect changes in the status of indoor personnel who enter a second preset range around the drone within a recent preset second time; the second time may be, for example, 40 seconds; the second range is a circular range with a radius of 5 meters around the drone; changes in the status of personnel include: changes in the movements of indoor personnel, etc.; changes in the status of personnel may be obtained by a camera equipped with the drone; indoor personnel may be personnel in the kitchen, etc.;
当人员状态变化符合预设的变化条件时,控制无人机检测室内人员的人员画像、视窗区域;变化条件为人员状态变化代表室内人员受无人机影响、好奇无人机的合法性等的动作变化,比如:打开窗户注视无人机等;人员画像包括:性别、预测年龄区间等;视窗区域为室内人员所处房间的窗户的区域,比如:厨房窗户区域等;人员画像、视窗区域可以通过无人机配备的摄像机进行获取;When the change of the person's status meets the preset change conditions, the drone is controlled to detect the person's portrait and window area of the indoor person; the change condition is that the change of the person's status represents the change of the action of the indoor person being affected by the drone, curious about the legality of the drone, etc., such as opening the window to look at the drone, etc.; the person's portrait includes: gender, predicted age range, etc.; the window area is the area of the window of the room where the indoor person is located, such as: the kitchen window area, etc.; the person's portrait and window area can be obtained through the camera equipped by the drone;
基于人员画像,确定作业提示音频;作业提示音频用于提示无人机为合法作业请室内人员无需担心的语音音频,作业提示音频适配人员画像,比如:人员画像为性别女、预测年龄区间为40至50岁,则作业提示音频为“阿姨您好,我正在进行燃气管道检修,请勿担心,我检修完就走啦!”Based on the personnel portrait, the operation prompt audio is determined; the operation prompt audio is used to remind the indoor personnel that the drone is operating legally and there is no need to worry. The operation prompt audio is adapted to the personnel portrait. For example, if the personnel portrait is female and the predicted age range is 40 to 50 years old, the operation prompt audio is "Hello, Auntie, I am inspecting the gas pipeline. Don't worry, I will leave after the inspection!"
从第二局部路线中确定符合第三局部路线条件的第三局部路线;determining a third partial route from the second partial routes that meets the third partial route conditions;
当无人机沿第三局部路线飞行时,控制无人机播报作业提示音频;When the UAV flies along the third local route, the UAV is controlled to broadcast the operation prompt audio;
其中,第二局部路线条件包括:Among them, the second local route conditions include:
第二局部路线的第二平均飞行高度大于等于预设的第二高度阈值;第二高度阈值可以为,比如:10米;第二平均飞行高度为第二局部路线上各个路线点的飞行高度的平均值;The second average flight height of the second partial route is greater than or equal to a preset second height threshold; the second height threshold may be, for example, 10 meters; the second average flight height is an average of the flight heights of the route points on the second partial route;
第二局部路线途经的第二小区设施类型存在于预设的第二标准设施类型库中;第二标准设施类型库中有大量的第二标准设施类型,第二标准设施类型为小区内设施内人员可能会受高空飞行的无人机影响的设施,比如:厨房等;The second community facility type that the second local route passes through exists in the preset second standard facility type library; the second standard facility type library contains a large number of second standard facility types, and the second standard facility type is a facility in the community where people may be affected by high-altitude drones, such as a kitchen, etc.;
其中,第三局部路线条件包括:Among them, the third local route conditions include:
无人机未来预设的第三时间内会沿第三局部路线飞行;第三时间可以为,比如:20秒;The drone will fly along the third local route within a preset third time in the future; the third time may be, for example, 20 seconds;
无人机沿第三局部路线飞行时,无人机持续靠近视窗区域。As the drone flies along the third local route, the drone continues to approach the window area.
一般的,无人机对小区进行燃气管道风险识别时,会在小区楼道外墙的入户燃气管道处飞行,可能会靠近居民的厨房等,此时居民若在厨房内,居民可能出于担心无人机非法飞行泄露隐私、是否会有安全威胁等对无人机进行监视,影响居民的正常生活,甚至有居民会进行报警等,特别是以往没有进行过无人机飞行进行燃气管道风险识别的小区。本发明实施例可以解决这一问题:当确定室内人员受无人机飞行影响时,合理确定作业提示音频进行播报,提示室内人员无需担心;另外,引入第二局部路线,确定第二局部路线,自动触发无人机进行作业提示,减少了无人机的工作资源,提升作业提示效率;其次,引入Generally, when drones are identifying gas pipeline risks in a residential area, they will fly at the entrance gas pipelines on the outer wall of the residential corridor, and may get close to residents' kitchens, etc. If residents are in the kitchen at this time, they may monitor the drones out of concern that the drones may leak their privacy or pose a security threat due to illegal flight, affecting their normal lives. Some residents may even call the police, etc. This is especially true in residential areas that have never used drones to identify gas pipeline risks. An embodiment of the present invention can solve this problem: when it is determined that indoor personnel are affected by drone flight, an operation prompt audio is reasonably determined to be broadcast to remind indoor personnel that there is no need to worry; in addition, a second local route is introduced, and the second local route is determined to automatically trigger the drone to issue an operation prompt, thereby reducing the drone's working resources and improving the efficiency of the operation prompt; secondly, the introduction of
第三局部路线条件,可以保证室内人员有一种无人机飞行迎来针对性提示自己的感觉,提升作业提示精准性、效率。The third local route conditions can ensure that indoor personnel have a feeling that the drone flight is receiving targeted prompts, thereby improving the accuracy and efficiency of operation prompts.
在一个实施例中,基于无人机与AI的燃气管道风险识别方法,还包括:In one embodiment, the gas pipeline risk identification method based on drones and AI further includes:
控制无人机对燃气管道风险进行风险跟踪。Control drones to track gas pipeline risks.
还可以控制无人机对燃气管道风险进行风险跟踪,比如:控制无人机持续在出现燃气管道风险的位置进行监测,并回传监测数据。Drones can also be controlled to track gas pipeline risks. For example, drones can be controlled to continuously monitor locations where gas pipeline risks occur and send back monitoring data.
在一个实施例中,基于无人机与AI的燃气管道风险识别方法,还包括:In one embodiment, the gas pipeline risk identification method based on drones and AI further includes:
补充训练AI风险识别模型。Supplement training of AI risk identification model.
还可以补充训练AI风险识别模型,提升AI风险识别模型的燃气风险的识别能力。It is also possible to supplement the training of the AI risk identification model to enhance its ability to identify gas risks.
本发明实施例提供了基于无人机与AI的燃气管道风险识别系统,如图2所示,包括:The embodiment of the present invention provides a gas pipeline risk identification system based on drones and AI, as shown in FIG2 , including:
路线规划模块1,用于基于小区对应的预设的燃气管网模型,规划飞行检测路线;Route planning module 1, used to plan a flight inspection route based on a preset gas pipeline network model corresponding to the community;
第一控制模块2,用于基于飞行检测路线,控制无人机对小区进行燃气管道检测;The first control module 2 is used to control the drone to perform gas pipeline inspection in the community based on the flight inspection route;
数据获取模块3,用于持续获取无人机回传的检测数据;Data acquisition module 3, used to continuously acquire the detection data sent back by the drone;
风险确定模块4,用于基于检测数据、预设的AI风险识别模型,确定燃气管道风险;Risk determination module 4, used to determine gas pipeline risks based on detection data and a preset AI risk identification model;
风险预警模块5,用于输出预警燃气管道风险。The risk warning module 5 is used to output warning gas pipeline risks.
基于无人机与AI的燃气管道风险识别系统,还包括:The gas pipeline risk identification system based on drones and AI also includes:
第二控制模块,用于包括:The second control module is configured to include:
从飞行检测路线中确定符合第一局部路线条件的第一局部路线;Determine a first partial route that meets the first partial route condition from the flight detection route;
当无人机沿第一局部路线飞行时,控制无人机检测最近预设的第一时间内进入无人机周边预设的第一范围内的靠近人员的靠近移动路线;When the drone flies along the first local route, the drone is controlled to detect a moving route of a person approaching the drone within a first preset range within a first preset time period;
基于靠近移动路线、第一局部路线,确定避离方向;从靠近移动路线的路线终点出发向避离方向的射线与第一局部路线之间无交点、且射线与第一局部路线之间的最短距离大于等于预设的距离阈值;Based on the approaching moving route and the first partial route, determining the avoiding direction; there is no intersection between the ray from the route end point of the approaching moving route to the avoiding direction and the first partial route, and the shortest distance between the ray and the first partial route is greater than or equal to a preset distance threshold;
基于避离方向、靠近移动路线,确定投影区域;投影区域为预设的1/N圆、1/N圆的圆心为路线终点且1/N圆被射线平分;N大于2;Based on the avoidance direction and the approach movement route, the projection area is determined; the projection area is a preset 1/N circle, the center of the 1/N circle is the end point of the route and the 1/N circle is bisected by the ray; N is greater than 2;
控制无人机持续检测靠近人员的眼部位置、眼部朝向;Control the drone to continuously detect the eye position and eye direction of the person approaching;
基于眼部位置、眼部朝向,构建第一方向向量;Constructing a first direction vector based on the eye position and the eye orientation;
基于无人机的投射位置、由投射位置向投影区域投影的投射方向,构建第二方向向量;Constructing a second direction vector based on the projection position of the UAV and the projection direction from the projection position to the projection area;
当第一方向向量与第二方向向量之间的向量夹角持续落入预设的夹角区间内的持续时长大于等于预设的时长阈值时,控制无人机向投影区域投射避离方向对应的预设的避离提示图案;When the vector angle between the first direction vector and the second direction vector continues to fall within the preset angle interval for a duration greater than or equal to a preset duration threshold, the drone is controlled to project a preset avoidance prompt pattern corresponding to the avoidance direction to the projection area;
其中,第一局部路线条件包括:Among them, the first local route conditions include:
第一局部路线的第一平均飞行高度小于等于预设的第一高度阈值;A first average flight altitude of the first local route is less than or equal to a preset first altitude threshold;
第一局部路线途经的第一小区设施类型存在于预设的第一标准设施类型库中。The first cell facility type passed by the first local route exists in a preset first standard facility type library.
基于无人机与AI的燃气管道风险识别系统,还包括:The gas pipeline risk identification system based on drones and AI also includes:
第三控制模块,用于包括:The third control module is used to include:
从飞行检测路线中确定符合第二局部路线条件的第二局部路线;Determine a second partial route that meets the second partial route condition from the flight detection route;
当无人机沿第二局部路线飞行时,控制无人机检测最近预设的第二时间内进入无人机周边预设的第二范围内的室内人员的人员状态变化;When the drone flies along the second local route, the drone is controlled to detect changes in the status of indoor personnel who have entered a second preset range around the drone within a recent second preset time;
当人员状态变化符合预设的变化条件时,控制无人机检测室内人员的人员画像、视窗区域;When the status change of the person meets the preset change conditions, the drone is controlled to detect the person portrait and window area of the indoor person;
基于人员画像,确定作业提示音频;Determine the audio of the operation prompt based on the personnel portrait;
从第二局部路线中确定符合第三局部路线条件的第三局部路线;determining a third partial route from the second partial routes that meets the third partial route conditions;
当无人机沿第三局部路线飞行时,控制无人机播报作业提示音频;When the UAV flies along the third local route, the UAV is controlled to broadcast the operation prompt audio;
其中,第二局部路线条件包括:Among them, the second local route conditions include:
第二局部路线的第二平均飞行高度大于等于预设的第二高度阈值;The second average flight altitude of the second local route is greater than or equal to a preset second altitude threshold;
第二局部路线途经的第二小区设施类型存在于预设的第二标准设施类型库中;The second community facility type passed by the second local route exists in the preset second standard facility type library;
其中,第三局部路线条件包括:Among them, the third local route conditions include:
无人机未来预设的第三时间内会沿第三局部路线飞行;The drone will fly along the third local route within a preset third time in the future;
无人机沿第三局部路线飞行时,无人机持续靠近视窗区域。As the drone flies along the third local route, the drone continues to approach the window area.
基于无人机与AI的燃气管道风险识别系统,还包括:The gas pipeline risk identification system based on drones and AI also includes:
风险跟踪模块,用于控制无人机对燃气管道风险进行风险跟踪。The risk tracking module is used to control the drone to track gas pipeline risks.
基于无人机与AI的燃气管道风险识别系统,还包括:The gas pipeline risk identification system based on drones and AI also includes:
补充训练模块,用于补充训练AI风险识别模型。Supplementary training module, used to supplement the training of AI risk identification model.
显然,本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样,倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202311830942.8A CN118092462A (en) | 2023-12-28 | 2023-12-28 | Gas pipeline risk identification method and early warning system based on unmanned aerial vehicle and AI |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202311830942.8A CN118092462A (en) | 2023-12-28 | 2023-12-28 | Gas pipeline risk identification method and early warning system based on unmanned aerial vehicle and AI |
Publications (1)
Publication Number | Publication Date |
---|---|
CN118092462A true CN118092462A (en) | 2024-05-28 |
Family
ID=91164505
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202311830942.8A Pending CN118092462A (en) | 2023-12-28 | 2023-12-28 | Gas pipeline risk identification method and early warning system based on unmanned aerial vehicle and AI |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN118092462A (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070192910A1 (en) * | 2005-09-30 | 2007-08-16 | Clara Vu | Companion robot for personal interaction |
CN104460682A (en) * | 2014-10-29 | 2015-03-25 | 深圳九星智能航空科技有限公司 | Unmanned aerial vehicle with wireless stereo function |
WO2017065107A1 (en) * | 2015-10-16 | 2017-04-20 | 株式会社プロドローン | Information transmission device |
US9747901B1 (en) * | 2015-02-27 | 2017-08-29 | Amazon Technologies, Inc. | Speech interaction for unmanned aerial vehicles |
CN112810807A (en) * | 2021-02-10 | 2021-05-18 | 北京京东乾石科技有限公司 | Unmanned aerial vehicle and control method thereof |
CN116859019A (en) * | 2023-06-27 | 2023-10-10 | 广州燃气集团有限公司 | Safety detection method, system and device for resident fuel gas and storage medium |
-
2023
- 2023-12-28 CN CN202311830942.8A patent/CN118092462A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070192910A1 (en) * | 2005-09-30 | 2007-08-16 | Clara Vu | Companion robot for personal interaction |
CN104460682A (en) * | 2014-10-29 | 2015-03-25 | 深圳九星智能航空科技有限公司 | Unmanned aerial vehicle with wireless stereo function |
US9747901B1 (en) * | 2015-02-27 | 2017-08-29 | Amazon Technologies, Inc. | Speech interaction for unmanned aerial vehicles |
WO2017065107A1 (en) * | 2015-10-16 | 2017-04-20 | 株式会社プロドローン | Information transmission device |
CN112810807A (en) * | 2021-02-10 | 2021-05-18 | 北京京东乾石科技有限公司 | Unmanned aerial vehicle and control method thereof |
CN116859019A (en) * | 2023-06-27 | 2023-10-10 | 广州燃气集团有限公司 | Safety detection method, system and device for resident fuel gas and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111337028B (en) | Method and system for fire extinguishing guidance and personnel evacuation in complex building body | |
US11875670B2 (en) | Emergency incident detection, response, and mitigation using autonomous drones | |
KR101925094B1 (en) | Driving license test system for unmanned air vehicle | |
CN109760837B (en) | A cable trench and tunnel inspection drone system | |
CN105913604B (en) | Assay method and its device occur for the fire based on unmanned plane | |
CN105812733B (en) | A kind of scene monitoring guiding system of air traffic control | |
US20180356241A1 (en) | System and method for aiding responses to an event detected by a monitoring system | |
CN111047814A (en) | An intelligent evacuation system and method suitable for fire alarm in subway stations | |
CN109724610A (en) | A kind of method and device of full information real scene navigation | |
US20230070772A1 (en) | Active threat tracking and response | |
CN112331015A (en) | Power equipment unmanned aerial vehicle inspection virtual simulation training system and method | |
CN106355809A (en) | Early warning and emergent processing system for forest fire | |
CN109819043A (en) | 3 D intelligent emergency fire control platform system and its operating method | |
KR102011342B1 (en) | Fire Safety Inspecting Method and System | |
Hsiao et al. | Real-time fire protection system architecture for building safety | |
JP2019208197A (en) | Monitoring device, monitoring program, storage medium, and monitoring method | |
CN113268075A (en) | Unmanned aerial vehicle control method and system | |
CN116576860A (en) | Method for guiding fire escape in building and related equipment | |
CN118092462A (en) | Gas pipeline risk identification method and early warning system based on unmanned aerial vehicle and AI | |
JP7441067B2 (en) | Mobile crack detection device and crack detection method | |
KR20220129791A (en) | Environmental Pollution Management System Using Drones | |
CN111330185A (en) | Ancient building decoration fire prevention method and system | |
CN110650177A (en) | Edge computing platform and method for servicing special hybrid vehicle | |
CN117592802A (en) | Emergency processing method, device, equipment and storage medium | |
Tomita et al. | Development of UAV indoor flight technology for building equipment works |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |