JP2021044692A - Monitoring system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique capable of reducing a work load of a monitor in a monitoring system for monitoring intrusion into a predetermined area. SOLUTION: The monitoring system of this example responds to an alarm of an installation object sensor 10 attached to an installation object surrounding a predetermined area, an image pickup device 20 for photographing an area including the installation object, and an installation object sensor 10. It includes a server 40 that analyzes an image captured by the image pickup device 20 and detects an object that appears in the image, and a monitoring terminal device 60 that notifies the alarm of the installation object sensor 10. The server 40 determines whether or not the detected object is an intruder based on the positional relationship between the installed object and the detected object in the video and the area of the detected object in the video, and displays the determination result on the monitoring terminal device 60. [Selection diagram] Fig. 1

Description

The present invention relates to a monitoring system that monitors intrusion into a predetermined area by using an installation sensor and an imaging device.

Conventionally, a monitoring system has been put into practical use in which a fence sensor is installed on a fence surrounding the outer periphery of a facility, an alarm is issued when the fence sensor detects an abnormality, and a monitoring terminal device is used to notify the observer. Such monitoring systems help prevent intruders into critical equipment such as airports, power plants, and prisons. Fence sensors include an infrared sensor installed on the top of the fence that detects an intruder trying to pass over the fence, one that detects that an intruder has applied force to the wire stretched over the fence, and one that is attached to the fence. There is a cable-shaped vibration sensor (sensor cable) that detects vibration when an intruder touches the fence.

In recent years, systems that use surveillance cameras to monitor fences have also been studied. For example, Patent Document 1 discloses an invention in which a plurality of landmarks are installed on an upper portion or a side surface of a fence, and an intruder is detected from a shaking state of the landmarks photographed by a surveillance camera.

Japanese Unexamined Patent Publication No. 2016-152525

In the conventional technology, the following problems are assumed.
・ There is a possibility of false alarms due to small animals or natural phenomena (for example, wind, earthquake, etc.).
-When a large number of fence sensors over a wide range simultaneously issue a report due to the influence of natural phenomena, it takes time to confirm the alarm.
-If the timing of a large number of fence sensors in a wide range and the timing of a fence sensor responding to an actual intruder overlap due to the influence of natural phenomena, an intruder may be overlooked.

The present invention has been made in view of the above-mentioned conventional circumstances, and provides a technique capable of reducing the workload of a monitor in a monitoring system that monitors intrusion into a predetermined area. The purpose.

In the present invention, in order to achieve the above object, the monitoring system is configured as follows.
That is, the monitoring system according to the present invention includes an installation object sensor attached to an installation object surrounding a predetermined area, an image pickup device that photographs an area including the installation object, and the image pickup in response to an alarm from the installation object sensor. A server that analyzes an image taken by the device and detects an object appearing in the image is provided, and the server includes a positional relationship between the installation object and the object in the image and an area of the object in the image. Based on the above, it is characterized in that it is determined whether or not the object is an intruder.

Here, as an example of configuration, when the server has at least a part of the object in the vicinity of the boundary line of the lower end or the upper end of the installation object in the video and the area of the object is equal to or larger than the threshold value. The object may be determined to be an intruder.

In this case, the server determines whether or not the contour of the moving object that detects the contour of the object in the video and the contour of the object detected by the moving object contour detecting unit are in the vicinity of the boundary line. A boundary line determination unit may be provided.

Further, the server compares the area of the moving body area measuring unit that measures the area inside the contour of the object detected from the video with the area of the object measured by the moving body area measuring unit with the threshold value. It may be provided with a part.

Further, as a configuration example, a monitoring terminal device for notifying the alarm of the installed object sensor is further provided, and the monitoring terminal device is in a notification mode according to a determination result of whether or not the object is an intruder by the server. May be configured to change.

According to the present invention, it is possible to reduce the workload of the observer in the monitoring system that monitors the intrusion into the predetermined area.

It is a figure which shows the schematic configuration example of the monitoring system which concerns on one Embodiment of this invention. It is a figure explaining the installation mode of the image pickup apparatus. It is a figure which shows the example of the case where the vibration sensor is used as a fence sensor. It is a figure which shows the example of the monitoring screen in the monitoring system of FIG. It is a figure which shows the example of the processing flow by the server of the monitoring system of FIG. It is a figure which shows the example of the case where the infrared sensor is used as a fence sensor.

A monitoring system according to an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 shows a schematic configuration example of a monitoring system according to an embodiment of the present invention. The monitoring system of this example includes a fence sensor 10, an imaging device 20, a recording device 30, a server 40, and a monitoring terminal device 60, which are connected via a network.

The fence sensor 10 is attached to a fence surrounding the outer periphery of the facility to be monitored, and outputs a warning signal in response to the detection of a predetermined abnormality. As illustrated in FIG. 3, in this example, a cable-shaped vibration sensor (sensor cable) is used as the fence sensor 10. That is, the fence sensor 10 of this example outputs a warning signal in response to detecting the vibration of the fence. The identification information (for example, the sensor number) of the fence sensor 10 is added to the alarm signal. The number of fence sensors 10 installed is arbitrary, and the more fences there are, the more fence sensors 10 are installed.

The image pickup apparatus 20 photographs an area including the fence (for example, the fence and its surroundings) from the inside of the fence (that is, the facility side). Since the fence has transparency, even if the image pickup device 20 is arranged inside the fence, it is possible to photograph the outside of the fence. As illustrated in FIG. 3, in this example, the image pickup apparatus 20 is installed so as to take a picture from a position facing the fence surface and looking down on the fence (a position higher than the fence). The number of image pickup devices 20 installed is arbitrary, and the more fences there are, the more image pickup devices 20 are installed. As illustrated in FIG. 2, it is conceivable to install the image pickup device at the same height as the fence so that the image is taken from the position where the fence surface is viewed in the horizontal direction (horizontal direction). It is difficult to determine whether the detected object (for example, a human) is at the position P1 near the fence or at the position P2 away from the fence only by the image. Therefore, it is preferable to install the image pickup device 20 at a position higher than the fence as shown in FIG. 3 so that it can be easily determined whether or not the detected object is close to the fence.

In this example, for the sake of simplification of the description, a configuration in which one imaging device 20 is installed corresponding to one fence sensor 10 will be described as an example. A plurality of imaging devices 20 may be installed corresponding to one fence sensor 10, or one imaging device 20 may be installed corresponding to a plurality of fence sensors 10.

The recording device 30 stores the video data captured by the imaging device 20. Further, in response to a request from the outside, the stored video data is read out and transmitted to the request source (for example, the monitoring terminal device 60).

The server 40 analyzes the image taken by the image pickup device 20 in response to the alarm of the fence sensor 10, detects an object (moving object) appearing in the vicinity of the fence, and determines whether or not it is an intruder. The server 40 of this example includes a sensor alarm receiving unit 41, a video receiving unit 42, an object contour extracting unit 43, a boundary line determination unit 44, an object area measuring unit 45, a camera / sensor registration unit 46, and the like. It includes a fence boundary line registration unit 47, an area threshold registration unit 48, an area comparison unit 49, and an alarm information transmission unit 50.

The camera / sensor registration unit 46 stores data indicating the correspondence between the preset fence sensor 10 and the image pickup device 20. That is, the relationship between the fence sensor 10 and the image pickup apparatus 20 including the fence to which the fence sensor 10 is attached is stored in the photographing range.

The fence boundary line registration unit 47 stores the data of the preset boundary line (that is, the boundary line between the fence and the ground) B1 at the lower end of the fence. The boundary line B1 at the lower end of the fence is used to determine whether or not an object detected from the image captured by the image pickup apparatus 20 exists in the immediate vicinity of the fence. This means that an intruder trying to cross the fence will rock the fence while standing on the ground near the fence, in which case it is assumed that the intruder's feet are near the border at the bottom of the fence. Is based on. The boundary line B1 at the lower end of the fence is set for each fence to which the fence sensor 10 is attached.

The area threshold registration unit 48 stores preset area threshold data. The area threshold is
It is a threshold value regarding the area of an object detected from the image captured by the image pickup apparatus 20 in the image, and is used to determine whether the detected object is a human being (that is, an intruder) or another object (for example, a small animal). used.

The sensor alarm receiving unit 41 receives the alarm signal output from the fence sensor 10. Since the identification information of the fence sensor 10 that is the transmission source is added to the alarm signal, it is possible to identify which fence sensor 10 has detected the abnormality.

The video receiving unit 42 transmits a video request signal to the image pickup device 20 corresponding to the fence sensor 10 which is the transmission source of the alarm signal in response to the sensor alarm receiving unit 41 receiving the alarm signal. , Acquire video data from the image pickup device 20. The image pickup device 20 corresponding to the fence sensor 10 that is the transmission source of the alarm signal can be identified by referring to the data registered in the camera sensor registration unit 46.

The object contour extraction unit 43 analyzes the video data received by the video reception unit 42 and extracts the contour of the object (detected object) appearing in the video. The contour of the detected object can be obtained by various known methods. For example, the contour of the detected object may be acquired by detecting the edge component from the difference image between the reference image and the captured image prepared in advance.

The boundary line determination unit 44 compares the contour of the detected object extracted by the object contour extraction unit 43 with the boundary line B1 at the lower end of the fence registered in the fence boundary line registration unit 47, and the detected object is immediately after the fence. Determine if it exists nearby. That is, when at least a part of the contour of the detected object is within a predetermined distance from the boundary line B1 (including the case where it overlaps), it is determined that the detected object is in the immediate vicinity of the fence, and the detection object is not. In that case, it is determined that the detected object is not present in the immediate vicinity of the fence. As the distance between the contour of the detected object and the boundary line B1, for example, the number of pixels between the lower end of the contour of the detected object and the boundary line B1 can be used.

The object area measuring unit 45 measures the area inside the contour of the detected object extracted by the object contour extracting unit 43 when the boundary line determining unit 44 determines that the detected object exists in the immediate vicinity of the fence. To do. The area inside the contour can be measured by various known methods. For example, the number of pixels inside the contour may be used as the area inside the contour. Since the distance between the image pickup device 20 and the fence is constant, the area inside the contour of the detected object measured by the object area measuring unit 45 represents the size of the detected object at almost the same position as the fence. Become.

The area comparison unit 49 compares the area inside the contour of the detected object measured by the object area measurement unit 45 with the area threshold value registered in the area threshold registration unit 48, and the detected object is a human (that is, an intruder). ) Whether or not. That is, if the area inside the contour is larger than the area threshold, it is determined that the detected object is likely to be human, and if not, the detected object is determined to be likely to be another object (for example, a small animal). To do.

The alarm information transmission unit 50 transmits alarm information according to the determination results of the boundary line determination unit 44 and the area comparison unit 49 to the monitoring terminal device 60. Specifically, when the boundary line determination unit 44 determines that the detected object does not exist in the immediate vicinity of the fence, warning information indicating that there is a high possibility of false alarm due to a natural phenomenon such as wind (hereinafter referred to as alarm information). Alarm A) is sent. Further, when the boundary line determination unit 44 determines that the detected object exists in the immediate vicinity of the fence, it is highly likely that the detected object is a small animal according to the determination result by the area comparison unit 49. The indicated alarm information (hereinafter, alarm B) or the detected object transmits alarm information (hereinafter, alarm C) indicating that there is a high possibility of being a human being. The alarm information includes an alarm type, identification information of the fence sensor 10 that has detected an abnormality (for example, a sensor number), identification information of an imaging device corresponding to the fence sensor 10 (for example, a camera number), and the like.

The monitoring terminal device 60 notifies the alarm of the fence sensor 10 based on the alarm information transmitted from the server 40. The monitoring terminal device 60 of this example includes a video display unit 61, an alarm information receiving unit 62, and an alarm information display unit 63.

The alarm information receiving unit 62 receives the alarm information transmitted from the server 40.
The alarm information display unit 63 displays the alarm information received by the alarm information receiving unit 62 on the monitor of the monitoring terminal device 60.
The video display unit 61 requests the imaging device 10 (or the recording device 30) to transmit the captured video in response to the operation by the user of the monitoring terminal device 60, and displays the received video on the monitor of the monitoring terminal device 60.

FIG. 4 shows an example of a monitoring screen displayed on the monitor of the monitoring terminal device 60.
The monitoring screen 70 shown in FIG. 4 includes a video display area 71, a playback control button 72, a map area 73, an alarm information display area 74, an alarm confirmation button 75, a buzzer sound stop button 76, and an alarm history display area. Has 77 and.

The image display area 71 is an area for displaying the image received from the image pickup device 10 (or the recording device 30). The image captured by the imaging device 10 can be switched by the user operating the map display area 73. When the alarm information is received from the server 40, the display of the captured image by the imaging device 10 corresponding to the alarm information is automatically switched. In addition, a frame surrounding the detected object is displayed so that the user can easily find the detected object in the video. Further, the display mode is changed according to the type of the alarm information so that the user can easily determine the type of the alarm information. For example, the color of the area around the image display area 71 is changed to green for alarm A, yellow for alarm B, and red for alarm C.

The playback control button 72 is an operation unit that receives from the user a playback operation for the video displayed in the video display area 71. By operating the playback control button 72, the user can control playback, pause, fast forward, rewind, and the like of the video in the video display area 71.

The map display area 73 is an area for displaying a map of the facility to be monitored, and a camera icon is displayed at a position corresponding to the installation location of the image pickup device 20. The user selects a camera icon at a position where he / she wants to display an image, and the image captured by the imaging device 10 corresponding to the camera icon is displayed in the image display area 71. When the alarm information is received from the server 40, the mode of the corresponding camera icon is changed so that the user can easily identify the image pickup device 10 corresponding to the alarm information. For example, the color of the camera icon is changed to green for alarm A, yellow for alarm B, and red for alarm C.

The alarm information display area 74 is an area for displaying alarm information and related information received from the server 40. In the alarm information display area 74, for example, the number and size of detected intruders, emergency instructions, and the like are displayed.

The alarm confirmation button 75 is a button for canceling the alarm. After confirming the alarm information received from the server 40 and the image captured by the imaging device 10, the user operates the alarm confirmation button 75 to cancel the alarm.

The buzzer sound stop button 76 is a button for stopping the buzzer sound that sounds according to the type of alarm information received from the server 40. The output of the buzzer sound is started, for example, when the alarm C (highly likely to be an intruder) is issued, and the output is stopped when the user operates the buzzer sound stop button 76.

The alarm history display area 77 is an area for displaying the history of alarm information received so far. In the alarm history display area 77, for example, items such as an alarm issuance date and time, an intruder detection location, and an alarm type are displayed in a list format. The sort order (display order) of the alarm history display area 77 can be switched according to the user's operation. Further, by selecting the history of any of the alarm information, the video at that time can be acquired from the recording device 30 and displayed in the video display area 71.

FIG. 5 shows an example of a processing flow by the server 40. The server 40 performs the following processing in response to the alarm of the fence sensor 10.
First, the sensor alarm receiving unit 41 receives the alarm signal from the fence sensor 10 (step S11). Next, the video receiving unit 42 acquires video data from the image pickup device 20 corresponding to the fence sensor 10 that is the source of the alarm signal (step S12). Next, the object contour extraction unit 43 analyzes the video data and extracts the contour of the detected object in the video (step S13). Next, the boundary line determination unit 44 compares the contour of the detected object with the boundary line B1 at the lower end of the fence to determine whether the detected object is present in the immediate vicinity of the fence (step S14).

When it is determined that the detected object does not exist in the immediate vicinity of the fence (step S14: No), it is determined that there is a high possibility of false alarm due to a natural phenomenon (step S17), and the alarm information transmission unit. 50 issues an alarm A indicating that fact (step S18).
On the other hand, when it is determined that the detected object exists in the immediate vicinity of the fence (step S14: Yes), the object area measuring unit 45 measures the area inside the contour of the detected object (step S15). Next, the area comparison unit 49 compares the area inside the contour of the detected object with the area threshold value to determine whether the detected object is a human (intruder) or a small animal (step S16).

When the area inside the contour is not larger than the area threshold value (step S16: No), it is determined that the detected object is likely to be a small animal (step S19), and the alarm information transmitting unit 50 issues an alarm B indicating that fact. The alarm is issued (step S20).
On the other hand, when the area inside the contour is larger than the area threshold value (step S16: Yes), it is determined that the detected object is likely to be a human being (step S21), and the alarm information transmitting unit 50 indicates the alarm C. Is issued (step S22).

FIG. 6 shows an example in which an infrared sensor is used instead of the sensor cable as another embodiment. In the example shown in FIG. 6, the infrared sensor 12 is installed on the upper part of the fence. This is effective in detecting an object passing over the fence. In this case, the boundary line B2 at the upper end of the fence may be set in advance and registered in the fence boundary line registration unit 47. As a result, it is possible to determine the type of the detected object near the upper end of the fence by the same method as when the boundary line B1 at the lower end of the fence is used.

As described above, in the monitoring system of this example, the fence sensor 10 attached to the fence surrounding the predetermined area, the image pickup device 20 for photographing the area including the fence, and the image pickup device 20 in response to the alarm of the fence sensor 10. It is provided with a server 40 that analyzes the image taken by the user and detects an object appearing in the image, and a monitoring terminal device 60 that notifies the alarm of the fence sensor 10. Then, the server 40 determines whether or not the detected object is an intruder based on the positional relationship between the fence and the detected object in the image and the area of the detected object in the image, and causes the monitoring terminal device 60 to display the determination result. It is configured as follows.

As described above, in the monitoring system of this example, whether or not the detected object is an intruder is automatically determined based on the positional relationship between the detected object and the fence in the video, so that the observer (monitoring terminal device 60) The workload of the user) can be reduced. As a result, it becomes easy to confirm when a large number of fence sensors 10 over a wide range simultaneously issue a report due to a natural phenomenon, and when an intruder is detected at the same timing, and the confirmation work time is expected to be shortened.

Further, in the monitoring system of this example, the server 40 has at least a part of the detected object in the vicinity of the boundary line B1 at the lower end of the fence (or the boundary line B2 at the upper end of the fence) in the video, and the area of the detected object is a threshold value. In the above cases, the detected object is configured to be determined as an intruder. In this way, it is possible to determine whether or not the detected object is an intruder by a simple method, so that the processing load on the server 40 is reduced. In addition, the cost of constructing a monitoring system can be suppressed.

Further, in the monitoring system of this example, the monitoring terminal device 60 is configured to change the notification mode according to the determination result of whether or not the detected object by the server 40 is an intruder. Therefore, the observer can easily and concretely determine whether or not the detected object is an intruder.

In the above description, the image of the fence sensor 10 at the time of issuance is analyzed, but it is possible to make a more accurate determination by analyzing the image within a predetermined period before and after the issuance of the alarm. Make it possible. In short, it suffices to be able to analyze an image (an image at the time when the detected object is near the fence) that captures the site when the fence sensor 10 issues a report due to an object such as a human or a small animal.

Here, in the monitoring system of this example, a fence sensor attached to a fence is given as an example as an installation sensor, but it does not necessarily have to be a fence sensor. That is, the installation object sensor according to the present invention is attached to an installation object (for example, a net, a wall, a fence, a wall, etc.) installed at the boundary of a predetermined area such as a facility or a site, and senses a predetermined physical action. It is possible to use various types of sensors (eg, infrared sensor, tension sensor, vibration sensor, accelerometer, etc.) that issue an alarm according to the situation.

Further, in the monitoring system of this example, the image pickup device 20 is provided inside the installation object, but it does not necessarily have to be inside the installation object, and may be installed on the installation object line or outside the installation object. That is, the imaging device 20 may be installed in any place as long as the positional relationship between the detected object and the installed object, the contour / area of the detected object, and the like can be detected from the image.

Although the present invention has been described in detail above, it goes without saying that the present invention is not limited to the above configuration and may be realized by a configuration other than the above.
Further, the present invention provides, for example, a method or method for executing a process according to the present invention, a program for realizing such a method or method by a computer having hardware resources such as a processor or memory, and such a program. It can also be provided as a storage medium for storage.

The present invention can be used in a monitoring system that monitors intrusion into a predetermined area by using an installation sensor and an imaging device.

10: Fence sensor, 20: Imaging device, 30: Recording device, 40: Server, 41: Sensor alarm receiving unit, 42: Video receiving unit, 43: Object contour extraction unit, 44: Boundary line determination unit, 45: Object Area measurement unit, 46: Camera / sensor registration unit, 47: Fence boundary line registration unit, 48: Area threshold registration unit, 49: Area comparison unit, 50: Alarm information transmission unit, 60: Monitoring terminal device, 61: Video display Unit, 62: Alarm information receiving unit, 63: Alarm information display unit

Claims (5)

An installation sensor attached to an installation that surrounds a given area,
An image pickup device that photographs the area including the installation object, and
It is provided with a server that analyzes the image taken by the image pickup device in response to the alarm of the installation object sensor and detects an object appearing in the image.
The server is a monitoring system characterized in that it determines whether or not the object is an intruder based on the positional relationship between the installation object and the object in the video and the area of the object in the video. In the monitoring system according to claim 1,
The server determines the object as an intruder when there is at least a part of the object in the vicinity of the boundary line of the lower end or the upper end of the installation object in the video and the area of the object is equal to or larger than the threshold value. A monitoring system characterized by that. In the monitoring system according to claim 2,
The server determines whether or not the contour of the object detected by the moving object contour detecting unit in the video is in the vicinity of the boundary line and the moving object contour detecting unit detects the contour of the object. A monitoring system characterized by having a department. In the monitoring system according to claim 2,
The server includes a moving body area measuring unit that measures the area inside the contour of the object detected from the video, and an area comparing unit that compares the area of the object measured by the moving body area measuring unit with the threshold value. A monitoring system characterized by being equipped with. In the monitoring system according to any one of claims 1 to 4.
Further equipped with a monitoring terminal device for notifying the alarm of the installed object sensor,
The monitoring terminal device is a monitoring system characterized in that the notification mode is changed according to a determination result of whether or not the object is an intruder by the server.

Images