[go: up one dir, main page]

CN112623919B - An intelligent monitoring and management system for escalators based on computer vision - Google Patents

An intelligent monitoring and management system for escalators based on computer vision Download PDF

Info

Publication number
CN112623919B
CN112623919B CN202011499776.4A CN202011499776A CN112623919B CN 112623919 B CN112623919 B CN 112623919B CN 202011499776 A CN202011499776 A CN 202011499776A CN 112623919 B CN112623919 B CN 112623919B
Authority
CN
China
Prior art keywords
escalator
module
unit
behavior
early warning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011499776.4A
Other languages
Chinese (zh)
Other versions
CN112623919A (en
Inventor
姚振
杨超宇
刘秀
花道永
徐宁
闫凯船
尚松行
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Anhui University of Science and Technology
Original Assignee
Anhui University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Anhui University of Science and Technology filed Critical Anhui University of Science and Technology
Priority to CN202011499776.4A priority Critical patent/CN112623919B/en
Publication of CN112623919A publication Critical patent/CN112623919A/en
Application granted granted Critical
Publication of CN112623919B publication Critical patent/CN112623919B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66BELEVATORS; ESCALATORS OR MOVING WALKWAYS
    • B66B27/00Indicating operating conditions of escalators or moving walkways
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66BELEVATORS; ESCALATORS OR MOVING WALKWAYS
    • B66B25/00Control of escalators or moving walkways
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66BELEVATORS; ESCALATORS OR MOVING WALKWAYS
    • B66B29/00Safety devices of escalators or moving walkways

Landscapes

  • Escalators And Moving Walkways (AREA)

Abstract

The invention discloses an escalator intelligent monitoring management system based on computer vision, which comprises: the system comprises a plurality of fixed vision sensing devices, a plurality of infrared vision sensors, a tracking vision sensing device, a photographic device, a 5G communication device and a terminal processor. The invention relates to an escalator intelligent monitoring system through a 5G communication device, and environmental parameters and unsafe behaviors of people of the escalator are monitored in real time through a fixed visual sensing device, a tracking visual sensing device and a photographic device which are arranged near the escalator, so that the linkage management of the monitoring system is realized, and the intelligent level of the system is improved; the early warning level of the escalator is determined by collecting environmental information data in the escalator area in real time and identifying unsafe behaviors of people in real time, and when the early warning level of the escalator is an abnormal level, the alarm module, the early warning prompt module and the safety early warning module can send out alarm signals, so that accurate early warning of abnormal operation of the escalator is realized, and safety accidents of the escalator can be effectively prevented.

Description

Escalator intelligent monitoring management system based on computer vision
Technical Field
The invention belongs to the technical field of escalator safety monitoring, and particularly relates to an escalator intelligent monitoring management system based on computer vision.
Background
In recent years, the number of safety accidents of escalators is increasing, and the safe operation of escalators is closely related to the life and property safety of people and is highly valued by safety supervision departments in all circles of society all the time. Many escalators are operated all-weather for 24 hours, and carried passenger and article weight are difficult to the restriction, and escalator's component trouble can lead to the operation unusual, and because personnel fall down etc. artificial factors lead to the incident also can take place at any time, consequently, need establish one set of intelligent monitoring system, the all kinds of environmental information data of real time monitoring escalator to guarantee escalator's normal operating.
In order to reduce the safety accidents of the escalator, a plurality of monitoring systems such as video monitoring, load monitoring and the like are configured in a plurality of units. However, the existing monitoring systems cannot be linked and are independent of each other, the informatization and intellectualization levels of the systems are low, the identification and early warning of personnel behaviors are not accurate enough, and the safety accidents of the escalator cannot be prevented well.
In conclusion, the escalator safety monitoring system in the prior art has the problems of low overall intelligent level and inaccurate identification and early warning of unsafe behaviors of people.
Disclosure of Invention
The embodiment of the invention provides an escalator intelligent monitoring and management system based on computer vision, which is used for solving the problems of low overall intelligentization level and inaccurate identification and early warning of unsafe behaviors of people in the prior art.
The embodiment of the invention provides an escalator intelligent monitoring and management system based on computer vision, which comprises: the system comprises a plurality of fixed visual sensing devices (1), a plurality of infrared visual sensors (2), a tracking type visual sensing device (3), a photographic device (4), a 5G communication device (5) and a terminal processor (6), wherein each fixed visual sensing device (1) is electrically connected with the infrared visual sensors (2) in the corresponding area, the fixed visual sensing devices (1) are electrically connected with the tracking type visual sensing device (3), and the fixed visual sensing devices (1), the tracking type visual sensing device (3) and the photographic device (4) are electrically connected with the terminal processor (6) through the 5G communication device (5);
a plurality of the fixed visual sense sensing devices (1) are respectively arranged on the ceiling near the escalator, and the fixed visual sense sensing devices (1) comprise: the system comprises a monitoring sensing module (11), a moving target detection module (12), a moving target tracking module (13), a tumbling detection module (14) and an alarm module (15);
the monitoring sensing module (11) is used for monitoring various types of environmental information data around the escalator, comparing the acquired various types of environmental information data with the safety set values of the corresponding environmental information data respectively, and determining whether the corresponding types of environmental information data are in abnormal states; the moving target detection module (12) is used for processing the problems of slow moving of the moving target on the escalator and reduction of time delay of background sudden change, and detecting the moving target on the escalator; the fall detection module (14) is used for solving the problems of separation, adhesion and missed detection of moving targets on the escalator, accurately and stably tracking the targets on the escalator, and improving the reliability of extracting target characteristics; the alarm module (15) is used for sending out an early warning signal to personnel in a corresponding area when the environmental information safety data of the area where the monitoring sensing module (11) is located is abnormal;
the infrared vision sensors (2) are respectively arranged on the walls around the escalator, and the infrared vision sensors (2) are used for collecting position signals of people and articles;
track formula vision sensing device (3) are laid respectively on the ceiling directly over the automatic escalator, just track formula vision sensing device (3) include: the system comprises a foreground image extraction module (31), a pedestrian abnormal behavior detection module (32), an article abnormal behavior detection module (33) and an early warning prompt module (34); the foreground image extraction module (31) is used for removing the shadow of the foreground area generated along with the movement of the target; the pedestrian abnormal behavior detection module (32) is used for extracting the abnormal behavior characteristics of the personnel, so that the recognition rate of the real-time online detection of the abnormal behavior of the personnel is improved; the article abnormal behavior detection module (33) is used for extracting the article abnormal behavior characteristics, so that the identification rate of real-time online detection of the article abnormal behavior is improved; the early warning prompt module (34) is used for judging whether the escalator is in an abnormal state according to the environmental information safety data in the escalator area and sending an early warning prompt signal to personnel;
the photographic device (4) is arranged on the side wall of the inner side of the escalator and used for acquiring images of the environment where the personnel in the escalator area are located;
and the 5G communication device (5) is used for communication of the fixed visual sensing device (1), the tracking visual sensing device (3), the photographing device (4) and the terminal processor (6).
The terminal processor (6) comprises: the system comprises a falling behavior feature library construction module (61), a monitoring video offline analysis module (62), a behavior analysis matching module (63), a crowd crowding degree analysis module (64), an escalator control module (65) and a safety early warning module (66);
the fall behavior feature library construction module (61) comprises: an action behavior analysis unit (611), a characteristic value extraction unit (612) and a building and perfecting behavior model unit (613); the action behavior analysis unit (611) is used for processing a plurality of images which are continuous in time and realizing rapid and efficient behavior analysis by mining the incidence relation among the images; the characteristic value extraction unit (612) is used for extracting key frames in the video in real time, and can effectively extract image characteristics and finish classification identification; the building and perfecting behavior model unit (613) is used for building a standard library for normal and unsafe behaviors of people commonly seen in the escalator environment and comparing the standard library with the behaviors of people appearing in a real-time video;
the surveillance video offline analysis module (62) comprises: a monitoring video offline analysis unit (621), a picture and video analysis unit (622) and a characteristic value extraction unit (623); the monitoring video off-line analysis unit (621) is used for processing a plurality of images simultaneously through a convolutional neural network with a memory unit to complete the rapid and efficient analysis of mass behavior data; the picture and video analysis unit (622) is used for realizing background modeling through a statistical graph model, fusing the model with a convolutional neural network, realizing event detection under the background cutting-out condition and effectively improving the event detection rate and the event recognition rate; the characteristic value extraction unit (623) is used for extracting key frames in an offline video, and can effectively extract image characteristics and finish classification identification;
the behavior analysis matching module (63) is used for judging whether the escalator normally operates or not by comparing the behavior characteristics extracted from the real-time video or the historical video, and sending an electric signal to the safety early warning module (66) when unsafe behaviors occur; the crowd crowding degree analysis model (64) is used for calculating the personnel density of the escalator region so as to judge whether the escalator normally runs or not, and when the personnel density exceeds a normal range, an electric signal is sent to the safety early warning module (66);
the escalator control module (65) comprises a PLC control unit (651) and an escalator brake unit (652); the PLC control unit (651) is used for controlling the operation of the escalator; the escalator brake unit (652) is used for braking in an emergency state and preventing personnel from being injured when the escalator is in abnormal operation;
the safety early warning module (66) comprises a voice early warning unit (661), a display early warning unit (662) and a control room terminal early warning unit (663); the voice early warning unit (661) is used for sending out a voice early warning signal; the display early warning unit (662) is used for displaying the environmental information data of the personnel in the escalator area in real time and determining the early warning level of the corresponding environmental data type; and the control room terminal early warning unit (663) is used for judging the early warning level of the corresponding environment data type according to the environment data information of the personnel in the escalator region and sending out corresponding early warning information according to the corresponding early warning level.
Preferably, the tracking type vision sensing device (3) is arranged in a shock absorption protection bracket, and a flash lamp, a motor and an infrared receiver are arranged on the shock absorption protection bracket.
Preferably, the monitoring sensing module (11) comprises: the device comprises a sound sensor (111), a speed sensor (112), a power consumption monitor (113), a displacement sensor (114) and a vibration sensor (115).
Preferably, the early warning level includes: the escalator brake unit (652) comprises: a motor and a transmission system.
Preferably, the early warning level includes: a normal level and an exception level.
Compared with the prior art, the invention has the beneficial effects that:
the invention relates to an escalator intelligent monitoring system through a 5G communication device, and environmental parameters and unsafe behaviors of people of the escalator are monitored in real time through a fixed visual sensing device, a tracking visual sensing device and a photographic device which are arranged near the escalator, so that the linkage management of the monitoring system is realized, and the intelligent level of the system is improved; the early warning level of the escalator is determined by collecting environmental information data in the escalator area in real time and identifying unsafe behaviors of people in real time, and when the early warning level of the escalator is an abnormal level, the alarm module, the early warning prompt module and the safety early warning module can send out alarm signals, so that accurate early warning of abnormal operation of the escalator is realized, and safety accidents of the escalator can be effectively prevented.
Drawings
Fig. 1 is an overall schematic block diagram of an escalator intelligent monitoring management system based on computer vision according to an embodiment of the present invention;
FIG. 2 is a schematic block diagram of a stationary visual sensing apparatus according to an embodiment of the present invention;
FIG. 3 is a schematic block diagram of a tracking vision sensing apparatus according to an embodiment of the present invention;
FIG. 4 is a block diagram of a terminal processor according to an embodiment of the present invention;
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, an escalator intelligent monitoring and management system based on computer vision provided by an embodiment of the present invention includes: the system comprises a plurality of fixed visual sensing devices (1), a plurality of infrared visual sensors (2), a tracking type visual sensing device (3), a photographic device (4), a 5G communication device (5) and a terminal processor (6), wherein each fixed visual sensing device (1) is electrically connected with the infrared visual sensors (2) in the corresponding area, the fixed visual sensing devices (1) are electrically connected with the tracking type visual sensing device (3), and the fixed visual sensing devices (1), the tracking type visual sensing device (3) and the photographic device (4) are electrically connected with the terminal processor (6) through the 5G communication device (5);
the invention relates to an escalator intelligent monitoring system through a 5G communication device, and environmental parameters and unsafe behaviors of people of the escalator are monitored in real time through a fixed visual sensing device 1, a tracking visual sensing device 3 and a photographic device 4 which are arranged near the escalator, so that the linkage management of the monitoring system is realized, and the intelligent level of the system is improved.
Referring to fig. 2, a plurality of the fixed visual sensing devices (1) in the embodiment of the present invention are respectively disposed on the ceiling near the escalator, and the fixed visual sensing devices (1) include: the system comprises a monitoring sensing module (11), a moving target detection module (12), a moving target tracking module (13), a tumbling detection module (14) and an alarm module (15).
It should be noted that the monitoring and sensing module (11) includes: the device comprises a sound sensor (111), a speed sensor (112), a power consumption monitor (113), a displacement sensor (114) and a vibration sensor (115). The tracking type vision sensing device (3) is arranged in a shock absorption protection support, and a flash lamp, a motor and an infrared receiver are arranged on the shock absorption protection support.
The specific functions of the modules in the fixed visual sensor device 1 are described as follows:
the monitoring sensing module (11) is used for monitoring various types of environmental information data around the escalator, comparing the acquired various types of environmental information data with the safety set values of the corresponding environmental information data respectively, and determining whether the corresponding types of environmental information data are in abnormal states; the moving target detection module (12) is used for processing the problems of slow moving of the moving target on the escalator and reduction of time delay of background sudden change, and detecting the moving target on the escalator; the fall detection module (14) is used for solving the problems of separation, adhesion and missed detection of moving targets on the escalator, accurately and stably tracking the targets on the escalator, and improving the reliability of extracting target characteristics; the alarm module (15) is used for sending out an early warning signal to personnel in a corresponding area when the environmental information safety data of the area where the monitoring sensing module (11) is located is abnormal;
it should be noted that the early warning levels include: a normal level and an exception level.
According to the invention, the early warning level of the escalator is determined by monitoring the environmental parameters and unsafe behaviors of people in the escalator area in real time, and when the early warning level of the escalator is an abnormal level, the alarm module, the early warning prompt module and the safety early warning module can send out alarm signals, so that the accurate early warning of abnormal operation of the elevator is realized, and the safety accident of the escalator can be effectively prevented.
The infrared vision sensors (2) are respectively arranged on the walls around the escalator, and the infrared vision sensors (2) are used for collecting position signals of people and articles;
referring to fig. 3, the tracking type visual sensing devices (3) in the embodiment of the present invention are respectively disposed on the ceiling right above the escalator, and the tracking type visual sensing devices (3) include: the system comprises a foreground image extraction module (31), a pedestrian abnormal behavior detection module (32), an article abnormal behavior detection module (33) and an early warning prompt module (34); the foreground image extraction module (31) is used for removing the shadow of the foreground area generated along with the movement of the target; the pedestrian abnormal behavior detection module (32) is used for extracting the abnormal behavior characteristics of the personnel, so that the recognition rate of the real-time online detection of the abnormal behavior of the personnel is improved; the article abnormal behavior detection module (33) is used for extracting the article abnormal behavior characteristics, so that the identification rate of real-time online detection of the article abnormal behavior is improved; and the early warning prompt module (34) is used for sending an early warning prompt signal to personnel when judging that the escalator is in an abnormal state according to the environmental information safety data in the escalator area.
It should be noted that the tracking type visual sensing device (3) is arranged in a shock absorption protection bracket, and a flash lamp, a motor and an infrared receiver are arranged on the shock absorption protection bracket.
According to the invention, the tracking type visual sensing device (3) arranged on the ceiling right above the escalator can effectively remove shadows generated by the movement of a foreground region along with a target, can extract abnormal behavior characteristics of personnel, classifies the extracted falling characteristics by using a support vector machine, trains a classifier, and displays the recognition rate of online monitoring of the personnel and articles in real time, so that the effective recognition and accurate early warning of unsafe behaviors of the personnel are realized, and the device is convenient and practical.
The photographic device (4) is arranged on the side wall of the inner side of the escalator and used for acquiring images of the environment where the personnel in the escalator area are located;
and the 5G communication device (5) is used for communication of the fixed visual sensing device (1), the tracking visual sensing device (3), the photographing device (4) and the terminal processor (6).
Referring to fig. 4, the terminal processor (6) includes: the system comprises a falling behavior feature library construction module (61), a monitoring video offline analysis module (62), a behavior analysis matching module (63), a crowd crowding degree analysis module (64), an escalator control module (65) and a safety early warning module (66);
the specific functions of the modules in the terminal processor (6) are described as follows:
the fall behavior feature library construction module (61) comprises: an action behavior analysis unit (611), a characteristic value extraction unit (612) and a building and perfecting behavior model unit (613); the action behavior analysis unit (611) is used for processing a plurality of images which are continuous in time and realizing rapid and efficient behavior analysis by mining the incidence relation among the images; the characteristic value extraction unit (612) is used for extracting key frames in the video in real time, and can effectively extract image characteristics and finish classification identification; the building and perfecting behavior model unit (613) is used for building a standard library for normal and unsafe behaviors of people commonly seen in the escalator environment and comparing the standard library with the behaviors of people appearing in a real-time video;
the surveillance video offline analysis module (62) comprises: a monitoring video offline analysis unit (621), a picture and video analysis unit (622) and a characteristic value extraction unit (623); the monitoring video off-line analysis unit (621) is used for processing a plurality of images simultaneously through a convolutional neural network with a memory unit to complete the rapid and efficient analysis of mass behavior data; the picture and video analysis unit (622) is used for realizing background modeling through a statistical graph model, fusing the model with a convolutional neural network, realizing event detection under the background cutting-out condition and effectively improving the event detection rate and the event recognition rate; the characteristic value extraction unit (623) is used for extracting key frames in an offline video, and can effectively extract image characteristics and finish classification identification;
the behavior analysis matching module (63) is used for judging whether the escalator normally operates or not by comparing the behavior characteristics extracted from the real-time video or the historical video, and sending an electric signal to the safety early warning module (66) when unsafe behaviors occur; the crowd crowding degree analysis model (64) is used for calculating the personnel density of the escalator region so as to judge whether the escalator normally runs or not, and when the personnel density exceeds a normal range, an electric signal is sent to the safety early warning module (66);
the escalator control module (65) comprises a PLC control unit (651) and an escalator brake unit (652); the PLC control unit (651) is used for controlling the operation of the escalator; the escalator brake unit (652) is used for braking in an emergency state and preventing personnel from being injured when the escalator is in abnormal operation;
the safety early warning module (66) comprises a voice early warning unit (661), a display early warning unit (662) and a control room terminal early warning unit (663); the voice early warning unit (661) is used for sending out a voice early warning signal; the display early warning unit (662) is used for displaying the environmental information data of the personnel in the escalator area in real time and determining the early warning level of the corresponding environmental data type; and the control room terminal early warning unit (663) is used for judging the early warning level of the corresponding environment data type according to the environment data information of the personnel in the escalator region and sending out corresponding early warning information according to the corresponding early warning level.
The invention collects the environmental information data of the personnel and the articles entering the escalator area through the computer vision technology and the radio frequency technology, can monitor various environmental information data of the escalator, can display the identification rate of the online monitoring of the personnel in real time, improves the accuracy rate of the identification of unsafe behaviors of the personnel, and carries out real-time monitoring and early warning on various types of environmental information data related to the escalator, the corresponding early warning level, the unsafe behaviors of the personnel, the abnormal falling of the articles and the abnormal operation of the escalator through visibility, thereby improving the monitoring accuracy rate and realizing the rapid, intelligent and linkage management of an escalator monitoring system.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (5)

1.一种基于计算机视觉的自动扶梯智能监控管理系统,其特征在于:包括:多个固定式视觉传感装置(1)、多个红外视觉传感器(2)、追踪式视觉传感装置(3)、摄影装置(4)、5G通信装置(5)和终端处理器(6),每个所述固定式视觉传感装置(1)分别与对应区域的多个红外视觉传感器(2)电连接,多个固定式视觉传感装置(1)均与追踪式视觉传感装置(3)电连接,以及所述固定式视觉传感装置(1)、所述追踪式视觉传感装置(3)和所述摄影装置(4)均通过所述5G通信装置(5)与终端处理器(6)电连接;1. A computer vision-based escalator intelligent monitoring and management system, characterized in that: comprising: a plurality of fixed visual sensing devices (1), a plurality of infrared visual sensors (2), a tracking visual sensing device (3) ), a photographing device (4), a 5G communication device (5) and a terminal processor (6), each of the fixed visual sensing devices (1) is electrically connected to a plurality of infrared visual sensors (2) in the corresponding area respectively , a plurality of fixed visual sensing devices (1) are electrically connected to the tracking visual sensing device (3), and the fixed visual sensing device (1), the tracking visual sensing device (3) and the photographing device (4) is electrically connected to the terminal processor (6) through the 5G communication device (5); 多个所述固定式视觉传感装置(1)分别布设在自动扶梯附近的天花板上,且所述固定式视觉传感装置(1)包括:监控传感模块(11)、运动目标检测模块(12)、运动目标跟踪模块(13)、摔倒检测模块(14)和报警模块(15);A plurality of the fixed visual sensing devices (1) are respectively arranged on the ceiling near the escalator, and the fixed visual sensing devices (1) include: a monitoring sensing module (11), a moving target detection module ( 12), a moving target tracking module (13), a fall detection module (14) and an alarm module (15); 所述监控传感模块(11),用于监控自动扶梯周围多种类型的环境信息数据,用于将采集的多种类型的环境信息数据分别与对应的环境信息数据的安全设定值进行比较,并确定对应类型的环境信息数据是否处于异常状态;所述运动目标检测模块(12),用于处理自动扶梯上的运动目标移动缓慢和减少背景突变时延问题,并对自动扶梯上的运动目标进行检测;所述摔倒检测模块(14),用于处理自动扶梯上的运动目标分割、粘连和漏检问题,并对扶梯上目标进行准确和稳定的跟踪,提高了提取目标特征的可靠性;所述报警模块(15),用于当所述监控传感模块(11)所在区域的环境信息安全数据存在异常情况时,向对应区域的人员发出预警信号;The monitoring and sensing module (11) is used for monitoring various types of environmental information data around the escalator, and is used for comparing the collected various types of environmental information data with the safety setting values of the corresponding environmental information data respectively , and determine whether the corresponding type of environmental information data is in an abnormal state; the moving target detection module (12) is used to deal with the slow movement of the moving target on the escalator and reduce the background mutation time delay, and to detect the movement on the escalator. The target is detected; the fall detection module (14) is used to deal with the problem of moving target segmentation, adhesion and missed detection on the escalator, and to accurately and stably track the target on the escalator, which improves the reliability of extracting target features. The alarm module (15) is used to issue an early warning signal to the personnel in the corresponding area when there is an abnormal situation in the environmental information security data of the area where the monitoring sensor module (11) is located; 多个所述红外视觉传感器(2)分别布设在自动扶梯四周的墙壁上,且所述红外视觉传感器(2),用于采集人员和物品的位置信号;A plurality of the infrared vision sensors (2) are respectively arranged on the walls around the escalator, and the infrared vision sensors (2) are used to collect position signals of persons and items; 所述追踪式视觉传感装置(3)分别布设在自动扶梯正上方的天花板上,且所述追踪式视觉传感装置(3)包括:前景图像提取模块(31)、行人异常行为检测模块(32)、物品异常行为检测模块(33)和预警提示模块(34);所述前景图像提取模块(31),用于去除前景区域随目标运动产生的阴影;所述行人异常行为检测模块(32),用于对人员异常行为特征进行提取,提高了人员异常行为的实时在线检测的识别率;所述物品异常行为检测模块(33),用于对物品异常行为特征进行提取,提高了物品异常行为的实时在线检测的识别率;所述预警提示模块(34),用于根据自动扶梯区域内的环境信息安全数据判别自动扶梯处于异常状态时向人员发出预警提示信号;The tracking type visual sensing device (3) is respectively arranged on the ceiling directly above the escalator, and the tracking type visual sensing device (3) comprises: a foreground image extraction module (31), a pedestrian abnormal behavior detection module ( 32), an item abnormal behavior detection module (33) and an early warning prompt module (34); the foreground image extraction module (31) is used to remove the shadow generated by the foreground area with the movement of the target; the pedestrian abnormal behavior detection module (32) ), used to extract the abnormal behavior characteristics of people, and improve the recognition rate of real-time online detection of abnormal behavior of people; the item abnormal behavior detection module (33) is used to extract the abnormal behavior characteristics of items, which improves the abnormal behavior of items. The recognition rate of real-time online detection of behavior; the early warning prompting module (34) is used for judging that the escalator is in an abnormal state according to the environmental information safety data in the escalator area, and sends an early warning prompt signal to the personnel; 所述摄影装置(4)设在自动扶梯内侧的侧壁上,用于获取自动扶梯区域人员所在环境的图像;The photographing device (4) is arranged on the side wall of the inner side of the escalator, and is used to obtain an image of the environment where the personnel in the escalator area are located; 所述5G通信装置(5),用于所述固定式视觉传感装置(1)、追踪式视觉传感装置(3)、摄影装置(4)和终端处理器(6)的通信;The 5G communication device (5) is used for the communication of the fixed visual sensing device (1), the tracking visual sensing device (3), the photographing device (4) and the terminal processor (6); 所述终端处理器(6)包括:摔倒行为特征库构建模块(61)、监控视频离线分析模块(62)、行为分析匹配模块(63)、人群拥挤度分析模块(64)、自动扶梯控制模块(65)和安全预警模块(66);The terminal processor (6) comprises: a falling behavior feature library building module (61), an offline monitoring video analysis module (62), a behavior analysis matching module (63), a crowd crowding degree analysis module (64), an escalator control module a module (65) and a safety warning module (66); 所述摔倒行为特征库构建模块(61)包括:动作行为分析单元(611)、特征值提取单元(612)和构建和完善行为模型单元(613);所述动作行为分析单元(611),用于处理时间上连续的若干张图像并通过挖掘图像间的关联关系,实现快速高效的行为分析;所述特征值提取单元(612),用于实时提取视频中的关键帧,可以有效提取图像特征并完成分类识别;所述构建和完善行为模型单元(613),用于为自动扶梯环境中常见的人员正常及不安全行为建立标准库,用于与实时视频中出现的人员行为进行比对;The falling behavior feature library building module (61) includes: an action behavior analysis unit (611), a feature value extraction unit (612), and a building and perfecting behavior model unit (613); the action behavior analysis unit (611), It is used to process several images that are continuous in time and realize fast and efficient behavior analysis by mining the correlation between the images; the feature value extraction unit (612) is used to extract key frames in the video in real time, and can effectively extract images feature and complete classification and identification; the building and perfecting behavior model unit (613) is used to establish a standard library for normal and unsafe behaviors of people common in the escalator environment, which is used to compare with the behavior of people appearing in real-time video ; 所述监控视频离线分析模块(62)包括:监控视频离线分析单元(621)、图片和视频分析单元(622)和特征值提取单元(623);所述监控视频离线分析单元(621),用于通过带有记忆单元的卷积神经网络同时处理若干张图像完成海量行为数据的快速高效分析;所述图片和视频分析单元(622),用于通过统计图模型实现背景建模,并将该模型与卷积神经网络相融合,实现背景剪除条件下的事件检测,有效提高了事件检测率和事件识别率;所述特征值提取单元(623),用于提取离线视频中的关键帧,可以有效提取图像特征并完成分类识别;The monitoring video offline analysis module (62) includes: a monitoring video offline analysis unit (621), a picture and video analysis unit (622), and a feature value extraction unit (623); the monitoring video offline analysis unit (621), using In order to complete the fast and efficient analysis of massive behavior data by processing several images simultaneously through the convolutional neural network with memory unit; the picture and video analysis unit (622) is used to realize background modeling through statistical graph model, and the The model is integrated with the convolutional neural network to realize the event detection under the condition of background clipping, which effectively improves the event detection rate and the event recognition rate; the feature value extraction unit (623) is used to extract the key frames in the offline video, which can Effectively extract image features and complete classification and recognition; 所述行为分析匹配模块(63),用于通过与实时视频或历史视频中提取出的行为特征进行比对,从而判断出自动扶梯是否正常运行,当出现不安全行为时向安全预警模块(66)发送电信号;所述人群拥挤度分析模块(64),用于自动扶梯区域人员密度计算,从而判断出自动扶梯是否正常运行,当人员密度超出正常范围时向安全预警模块(66)发送电信号;The behavior analysis matching module (63) is used to compare with the behavioral features extracted from the real-time video or historical video, thereby judging whether the escalator is running normally, and alerting the safety warning module (66) when unsafe behavior occurs. ) to send an electrical signal; the crowd congestion degree analysis module (64) is used to calculate the density of people in the escalator area, thereby judging whether the escalator is running normally, and when the density of people exceeds the normal range, sends an electrical signal to the safety warning module (66). Signal; 所述自动扶梯控制模块(65),包括PLC控制单元(651)和自动扶梯制动单元(652);所述PLC控制单元(651),用于控制自动扶梯的运行;所述自动扶梯制动单元(652),用于紧急状态下的制动,防止自动扶梯异常运行时人员受伤;The escalator control module (65) includes a PLC control unit (651) and an escalator braking unit (652); the PLC control unit (651) is used to control the operation of the escalator; the escalator brakes The unit (652) is used for braking in an emergency to prevent personal injury when the escalator operates abnormally; 所述安全预警模块(66),包括语音预警单元(661)、显示器预警单元(662)和控制室终端预警单元(663);所述语音预警单元(661),用于发出语音预警信号;所述显示器预警单元(662),用于实时显示自动扶梯区域人员的环境信息数据并确定对应的环境数据类型的预警级别;所述控制室终端预警单元(663),用于根据自动扶梯区域人员的环境数据信息判定对应的环境数据类型的预警级别,并根据对应的预警级别发出对应的预警信息。The safety pre-warning module (66) includes a voice pre-warning unit (661), a display pre-warning unit (662) and a control room terminal pre-warning unit (663); the voice pre-warning unit (661) is used to issue a voice pre-warning signal; The display pre-warning unit (662) is used to display the environmental information data of the personnel in the escalator area in real time and determine the pre-warning level of the corresponding environmental data type; the control room terminal pre-warning unit (663) is used to display the environmental information data of the personnel in the escalator area in real time; The environmental data information determines the early warning level of the corresponding environmental data type, and sends out corresponding early warning information according to the corresponding early warning level. 2.根据权利要求1所述的一种基于计算机视觉的自动扶梯智能监控管理系统,其特征在于,所述追踪式视觉传感装置(3)设置在减震保护支架内,所述减震保护支架上设置有闪光灯、马达和红外线接收器。2. A computer vision-based escalator intelligent monitoring and management system according to claim 1, characterized in that, the tracking type visual sensing device (3) is arranged in a shock-absorbing protection bracket, and the shock-absorbing protection A flashlight, a motor and an infrared receiver are arranged on the bracket. 3.根据权利要求1所述的一种基于计算机视觉的自动扶梯智能监控管理系统,其特征在于,所述监控传感模块(11)包括:声音传感器(111)、速度传感器(112)、电量消耗监控器(113)、位移传感器(114)和震动传感器(115)。3. A computer vision-based escalator intelligent monitoring and management system according to claim 1, wherein the monitoring and sensing module (11) comprises: a sound sensor (111), a speed sensor (112), an electric quantity Consumption monitor (113), displacement sensor (114) and shock sensor (115). 4.根据权利要求1所述的一种基于计算机视觉的自动扶梯智能监控管理系统,其特征在于,所述自动扶梯制动单元(652)包括:电机和传动系统。4. The computer vision-based intelligent monitoring and management system for escalators according to claim 1, wherein the escalator braking unit (652) comprises: a motor and a transmission system. 5.根据权利要求1所述的一种基于计算机视觉的自动扶梯智能监控管理系统,其特征在于,所述预警级别包括:正常级别和异常级别。5 . The computer vision-based intelligent monitoring and management system for escalators according to claim 1 , wherein the warning level includes: a normal level and an abnormal level. 6 .
CN202011499776.4A 2020-12-18 2020-12-18 An intelligent monitoring and management system for escalators based on computer vision Active CN112623919B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011499776.4A CN112623919B (en) 2020-12-18 2020-12-18 An intelligent monitoring and management system for escalators based on computer vision

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011499776.4A CN112623919B (en) 2020-12-18 2020-12-18 An intelligent monitoring and management system for escalators based on computer vision

Publications (2)

Publication Number Publication Date
CN112623919A CN112623919A (en) 2021-04-09
CN112623919B true CN112623919B (en) 2022-02-25

Family

ID=75316898

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011499776.4A Active CN112623919B (en) 2020-12-18 2020-12-18 An intelligent monitoring and management system for escalators based on computer vision

Country Status (1)

Country Link
CN (1) CN112623919B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115900808A (en) * 2021-08-19 2023-04-04 中核武汉核电运行技术股份有限公司 A safety auxiliary device for operation in a limited space environment of a nuclear power plant
CN113697652A (en) * 2021-09-23 2021-11-26 佛山市和众电梯技术有限公司 Escalator and moving sidewalk safe operation monitoring device and monitoring method
CN114998828B (en) * 2022-05-18 2023-04-07 慧之安信息技术股份有限公司 Offshore platform personnel stair ascending and descending management method based on Internet of things platform
CN117557949A (en) * 2023-04-12 2024-02-13 无锡八英里电子科技有限公司 An escalator safety device based on image recognition edge computing
CN116434145B (en) * 2023-04-21 2024-04-16 北京日立电梯工程有限公司 Escalator passenger dangerous behavior analysis and monitoring system based on image recognition
CN116206266B (en) * 2023-05-06 2023-08-15 济宁盛世照明电器有限公司 Vision counterpoint system based on capper
CN118314505B (en) * 2024-06-11 2024-10-11 中国电子系统工程第二建设有限公司 Non-contact on-line monitoring linkage management system and method based on visual recognition

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1013599A1 (en) * 1998-12-21 2000-06-28 Inventio Ag Safety device for an escalator or a moving walkway
CN207632306U (en) * 2017-08-03 2018-07-20 深圳市天俊智能卡有限公司 A kind of escalator Monitoring System
JP2019018993A (en) * 2017-07-21 2019-02-07 三菱電機ビルテクノサービス株式会社 Passenger conveyor alarm system
CN110002329A (en) * 2018-12-29 2019-07-12 广州地铁设计研究院股份有限公司 A kind of escalator on-line monitoring early warning system and method based on cloud platform
CN110203803A (en) * 2019-06-06 2019-09-06 快意电梯股份有限公司 Automatic escalator safety protection method and device based on AI intelligent monitoring
CN111517204A (en) * 2020-05-08 2020-08-11 广东省特种设备检测研究院佛山检测院 Escalator safety monitoring method, device, equipment and readable storage medium
CN111731979A (en) * 2020-07-03 2020-10-02 安徽理工大学 A computer vision-based fall recognition system for escalator passengers

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1013599A1 (en) * 1998-12-21 2000-06-28 Inventio Ag Safety device for an escalator or a moving walkway
JP2019018993A (en) * 2017-07-21 2019-02-07 三菱電機ビルテクノサービス株式会社 Passenger conveyor alarm system
CN207632306U (en) * 2017-08-03 2018-07-20 深圳市天俊智能卡有限公司 A kind of escalator Monitoring System
CN110002329A (en) * 2018-12-29 2019-07-12 广州地铁设计研究院股份有限公司 A kind of escalator on-line monitoring early warning system and method based on cloud platform
CN110203803A (en) * 2019-06-06 2019-09-06 快意电梯股份有限公司 Automatic escalator safety protection method and device based on AI intelligent monitoring
CN111517204A (en) * 2020-05-08 2020-08-11 广东省特种设备检测研究院佛山检测院 Escalator safety monitoring method, device, equipment and readable storage medium
CN111731979A (en) * 2020-07-03 2020-10-02 安徽理工大学 A computer vision-based fall recognition system for escalator passengers

Also Published As

Publication number Publication date
CN112623919A (en) 2021-04-09

Similar Documents

Publication Publication Date Title
CN112623919B (en) An intelligent monitoring and management system for escalators based on computer vision
CN112132045B (en) Community personnel abnormal behavior monitoring scheme based on computer vision
US20090195382A1 (en) Video sensor and alarm system and method with object and event classification
JP5473801B2 (en) Monitoring device
CN113076856B (en) Bus safety guarantee system based on face recognition
JP5917327B2 (en) Escalator monitoring system
CN109867186B (en) Elevator trapping detection method and system based on intelligent video analysis technology
CN111523386B (en) High-speed railway platform door monitoring and protecting method and system based on machine vision
CN112757300A (en) Robot protection system and method
KR20180081645A (en) Embedded vision system for real-time detection of safety anomaly in subway screen door and method thereof
CN110597165B (en) Steel piling monitoring system and steel piling monitoring method
CN115019463B (en) Water area supervision system based on artificial intelligence technology
KR101407952B1 (en) Elevator crime prvent system and method of controlling the same
JP5064846B2 (en) Monitoring system
CN110809137A (en) Campus safety trampling prevention monitoring system and method
CN111062238A (en) Escalator flow monitoring method and system based on human skeleton information and multi-target tracking
CN114445990A (en) Monitoring video access system for cell
CN110956792B (en) Method used to convert alerts
CN112623920A (en) Intelligent monitoring management system for escalator
CN114314243A (en) Lift overload alarm system and overload alarm method based on video recognition technology
CN118918697B (en) Method and device for alarming abnormality of gas-elimination equipment based on real-time data analysis
CN119205419B (en) Intelligent building site online monitoring method and system based on Internet of things and AI algorithm
KR102463498B1 (en) Monitoring system based on radar sensor for enhancing collision protecting efficiency of two-wheeled movable means
CN117649736A (en) Video management method and system based on AI video management platform
CN115937771A (en) Monitoring and early warning method for electric vehicle entering elevator

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant