JP6066650B2 - Monitoring device - Google Patents

Description

  The present invention relates to a monitoring device for imaging a subject within a predetermined monitoring target area and monitoring the subject from the captured image.

  Conventionally, as a device for monitoring the movement of a subject using a camera, the subject is automatically detected by detecting the position and motion status of the subject and automatically adjusting the camera direction and zoom magnification based on the detection result. An automatic moving image shooting system for shooting is known (see, for example, Patent Document 1).

  In addition, the apparatus includes a plurality of cameras including a tracking camera that performs panning and tilting operations and a monitoring camera that captures the entire monitoring target area, detects a monitoring target person based on the captured image of the monitoring camera, and performs tracking There is also known a moving body imaging system configured to track a person to be monitored while zooming in and out on a captured image with a camera (for example, see Patent Document 2).

JP 2003-274257 A JP 2004-28979 A

  In the devices described in Patent Documents 1 and 2, the subject can be photographed by automatically zooming in / out in accordance with the state of the subject, but a sensor for detecting the state of the subject is necessary, There was a problem that multiple cameras were required.

  Further, as in the apparatus described in Patent Document 2, in order to track a subject using a monitoring camera and a tracking camera, it is necessary to place each camera in a specific monitoring target area such as a classroom. There is also a problem that the imaging system cannot be moved.

  The present invention has been made in view of these problems, and can monitor an area to be monitored with a single camera, automatically detect a moving object to be monitored from the captured image, and zoom in on the moving object. An object is to provide an apparatus.

The monitoring device according to claim 1, which is made to achieve such an object,
An imaging means for imaging a moving image of the entire monitoring target area;
A moving body detecting means for detecting a moving body moving in the captured image and detecting a position and a size of the moving body in the captured image from a temporal change of the captured image captured by the imaging section;
When the moving object detected by the moving object detecting means stops in the captured image, the moving object becomes a predetermined size in the display screen of the display device based on the size of the moving object in the captured image. Magnification setting means for setting a magnification for enlarging the captured image;
Based on the magnification set by the magnification setting means, the captured image is magnified and displayed on the display screen of the display device by enlarging the captured image centered on a stop position of the moving object in the captured image. An enlarged image generating means for generating an enlarged image for
When the magnified image is generated by the magnified image generating means, the magnified image is output as a monitoring image of the monitoring target area. If the magnified image is not generated by the magnified image generating means, the imaging is performed. Monitoring image output means for outputting a captured image by the means as the monitoring image;
Movement determining means for determining whether or not the moving object has moved beyond a predetermined display maintenance frame in the display screen when the enlarged image is generated by the enlarged image generating means;
When the movement determining means determines that the moving object has moved beyond a predetermined display maintenance frame in the display screen, the enlarged image generating means stops the enlarged image generating operation, and the monitoring is performed. Enlarged image output stopping means for outputting the captured image as the monitoring image from an image output means;
It is provided with.

The invention according to claim 2 is the monitoring device according to claim 1,
The monitoring image output means transmits a monitoring image composed of the enlarged image or the captured image to an external network terminal via a network.

The invention according to claim 3 is the monitoring device according to claim 1 or 2,
The magnification setting means sets the magnification according to the amount of activity of the moving body so that the magnification is small when the amount of activity of the moving body is large and the magnification is large when the amount of activity is small. To do.

Moreover, invention of Claim 4 is the monitoring apparatus of any one of Claims 1-3. In the monitoring apparatus of Claim 1,
The magnification setting means determines that the moving object has stopped in the captured image, and once sets a magnification for enlarging the captured image, then the moving object is set to a predetermined value in the display screen of the display device. The magnification is periodically updated so that the size is maintained.

The invention according to claim 5 is the monitoring device according to any one of claims 1 to 4,
The movement determination unit uses the movement determination unit to determine the movement of the moving object so that the display maintenance frame becomes small when the activity amount is large and the display maintenance frame becomes large when the activity amount is small according to the activity amount of the moving object. The display maintenance frame setting means for setting the display maintenance frame is provided.

The invention according to claim 6 is the monitoring device according to any one of claims 1 to 5,
The magnification setting means includes
When the moving object detected by the moving object detecting means stops in the captured image, the size of the moving object detected by the moving object detecting means and the magnification for setting the previous enlarged image are set. Compare the size of the moving body used,
If the size of the moving object detected by the moving object detecting means is within a predetermined range including the size of the moving object used when the magnification was set last time, the moving object detecting means detected the Set the magnification based on the size of the moving object,
If the size of the moving object detected by the moving object detection means is not within the predetermined range, the magnification is set based on the size of the moving object used when the magnification was set last time.
It is characterized by that.

  According to the monitoring apparatus of the present invention, the moving object detection unit detects a moving object that moves in the captured image from a temporal change in the captured image captured by the imaging unit, and the moving object in the captured image of the moving object. Detect position and size.

  When the moving object detected by the moving object detection unit stops in the captured image, the magnification setting unit determines that the moving object has a predetermined size in the display screen of the display device based on the size of the moving object in the captured image. The magnification for enlarging the captured image is set.

  Then, the enlarged image generation means enlarges the captured image on the display screen of the display device by enlarging the captured image with the stop position in the captured image of the moving object as the center based on the set magnification. Generate an enlarged image.

When an enlarged image is generated by the enlarged image generating unit, the monitoring image output unit outputs the generated enlarged image as a monitoring image of the monitoring target area.
If the enlarged image is not generated by the enlarged image generation unit, the monitoring image output unit outputs the image captured by the imaging unit as a monitoring image.

Further, when the enlarged image is generated by the enlarged image generating means, the movement determining means determines whether or not the moving object has moved beyond a predetermined display maintenance frame in the display screen.
When the movement determining means determines that the moving object has moved beyond the predetermined display maintenance frame in the display screen, the enlarged image output stopping means stops the enlarged image generating operation by the enlarged image generating means. Then, the monitor image output means outputs the image picked up by the image pickup means as the monitor image.

  As described above, according to the monitoring device of the first aspect, the movement of the moving object in the monitoring target region is monitored by processing the captured image picked up by the image pickup unit, and when the moving object stops, The monitoring image output to the outside is changed from a normal captured image to an enlarged image so that the moving object can be enlarged (zoomed in).

  Therefore, according to the monitoring device of the first aspect, the monitoring image can be automatically zoomed in / out in accordance with the movement of the moving object that is the subject, and the zooming in / out is performed by one imaging unit. Can be used.

  In addition, the monitoring apparatus includes a single camera constituting the imaging unit, a moving object detection unit, a magnification setting unit, an enlarged image generation unit, a monitoring image output unit, a movement determination unit, and an image as an enlarged image output stop unit. Since it can be configured with an image processing apparatus that performs processing, it can be easily carried and can be easily installed at a desired location.

  Here, the monitoring image output means may output a signal corresponding to the monitoring image to the external device via the signal line, but more preferably, the monitoring image output means may be configured as described in claim 2.

That is, in the monitoring device according to claim 2, the monitoring image output means transmits the monitoring image to an external network terminal via the network.
For this reason, the user of the monitoring device can check the monitoring image by using the network terminal wherever the user is. For example, if there is a pet as a moving object in the monitoring target area, The behavior can be confirmed on the go.

  Next, the magnification setting means sets a magnification for enlarging the captured image so that the moving object has a predetermined size in the display screen of the display device. If this is done, it is conceivable that when the moving body moves actively, the monitoring image can be switched from the enlarged image to the normal monitoring image in a short time.

  In other words, when a moving object moves actively, even if the moving object stops once and generates an enlarged image, if the magnification of the moving object is large, the moving object can easily move out of the display maintenance frame on the display screen. The image is switched to a normal captured image in a short time.

  On the other hand, in order to prevent such switching, if the magnification of the captured image at the time of generating the enlarged image is reduced, even if the enlarged image is output as the monitoring image, the user can move the moving object on the display screen based on the enlarged image. This causes a problem that it becomes impossible to confirm the state (for example, the facial expression of a pet) in detail.

  Therefore, when the moving object to be monitored is an object whose activity amount changes greatly, such as a pet, for example, the magnification setting means, as described in claim 3, when the activity amount of the moving object is large, The magnification may be set so that the magnification is large when the activity amount is small and the activity amount is small.

  That is, in this way, for example, when a moving object is moving around and the amount of activity is large, the moving object is displayed on the display screen after the monitoring image is switched to an enlarged image by reducing the magnification. It is possible to lengthen the time until the monitoring image is returned to the normal captured image beyond the maintenance frame.

  In addition, when the amount of activity of the moving object is small (for example, when a pet falls asleep), the magnification of the enlarged image when the moving object stops is increased to display the enlarged image on the display device. The moving object can be displayed large on the display screen to make it easier for the user to monitor the state of the moving object.

  Next, the magnification of the enlarged image set by the magnification setting means may be maintained at a constant magnification until the moving object exceeds the display maintenance frame in the display screen. When the moving object approaches the image capturing unit during the enlarged image generation, the moving object increases on the display screen. Conversely, when the moving object moves away from the image capturing unit, the moving object decreases on the display screen.

  For this reason, as described in claim 4, the magnification setting means determines that the moving object has stopped in the captured image, and once sets a magnification for enlarging the captured image, thereafter, the display screen of the display device The magnification may be periodically updated so that the moving body is maintained at a predetermined size.

  In this way, by outputting the enlarged image as the monitoring image, the moving object can be displayed in an almost constant size on the external display device, and the user can display the moving image on the display screen. Thus, the state of the moving body can be grasped well.

  Next, the movement determining means determines whether or not the moving object has moved beyond the predetermined display maintenance frame in the display screen when the enlarged image is generated by the enlarged image generating means. The display maintenance frame used in the above may also be set according to the amount of activity of the moving object, similarly to the magnification at the time of generating the enlarged image.

  For this purpose, a display maintenance frame setting unit is provided as described in claim 5, and the display maintenance frame setting unit becomes small when the activity amount is large according to the activity amount of the moving object. The display maintenance frame may be set so that the display maintenance frame becomes large when the amount of activity is small.

  In other words, in this way, for example, when the amount of activity of the moving object is large and the moving object is likely to be off the display screen, the monitor image can be quickly returned to the normal captured image by reducing the display maintenance frame. Can be prevented from being displayed on the display screen.

  In addition, when the amount of activity of the moving object is small (for example, when the pet is sleeping), the monitoring image can be restored to the normal captured image with a slight movement of the moving object by increasing the display maintenance frame. Can be suppressed.

  Next, since the moving object detection unit detects the moving object from the temporal change of the captured image captured by the imaging unit without using a sensor or the like, although the apparatus configuration can be simplified as described above, For example, when a part of a moving object to be monitored such as a pet's tail is moving, the part may be detected as the moving object.

  In this case, the moving object detection unit recognizes the position and size of the detected moving object on the basis of the moving part on the captured image. Therefore, when the moving object stops on the captured image, the magnification setting is performed. The means sets a magnification for displaying a part of the moving body that should be monitored in a predetermined size.

  Then, when the magnification is set in this way, the enlarged image generating means generates an enlarged image in which a part of the moving object to be monitored (for example, the tail of the pet) is enlarged. Cannot be monitored normally.

Therefore, in order to prevent such a problem, the magnification setting means may be configured as described in claim 6.
That is, in the monitoring device according to claim 6, when the moving object detected by the moving object detecting unit stops in the captured image, the magnification setting unit determines the size of the moving object detected by the moving object detecting unit and the previous enlarged image. Is compared with the size of the moving object used when the magnification is set to generate.

  If the size of the moving object detected by the moving object detection means is within a predetermined range including the size of the moving object used when the previous magnification was set, the size of the moving object detected by the moving object detection means If the size of the moving object detected by the moving object detection means is not within the predetermined range, the magnification is set based on the size of the moving object used when the previous magnification was set.

  That is, in the monitoring device according to claim 6, when the moving object stops in the captured image, the magnification setting unit greatly changes the size of the moving object from the size of the moving object when the previous magnification was set. In this case, the moving object detection means determines that a part of the moving object that should be monitored is detected as a moving object, and sets the magnification based on the size of the moving object when the previous magnification was set.

  Therefore, according to the monitoring device of the sixth aspect, when the moving object detection unit detects a part of the moving object that should be monitored as the moving object, the enlarged image generation unit detects the part of the moving object. Generation of an enlarged image for enlarged display can be prevented, and the entire moving object can be enlarged and displayed satisfactorily.

It is a front view showing the appearance of a monitoring device of an embodiment. It is a block diagram showing the circuit structure of a monitoring apparatus. It is explanatory drawing explaining the imaging operation of the moving body by a monitoring apparatus. It is a flowchart showing the moving body detection process and enlarged display process which are performed in the control part of imaging operation. FIG. 10 is an explanatory diagram for explaining a magnification setting operation of Modification 1; 10 is a flowchart illustrating a magnification setting process according to a first modification. FIG. 10 is an explanatory diagram illustrating a size adjustment operation of a moving object during enlarged display of Modification Example 2. 10 is a flowchart illustrating a magnification update process according to a second modification. It is explanatory drawing explaining the display maintenance frame setting operation | movement of the modification 3. FIG. 14 is a flowchart illustrating a display maintenance frame setting process according to Modification 3. It is explanatory drawing of a display screen when a part of to-be-photographed object is misdetected as a moving body. 10 is a flowchart illustrating an enlarged display process of Modification Example 4. 15 is a flowchart illustrating another example of the enlarged display process of Modification 4.

Embodiments of the present invention will be described below with reference to the drawings.
[Embodiment]
The monitoring device 10 of this embodiment is installed in a desired room in a building such as a house, and monitors a pet kept in the room as a subject when a resident of the room is out. It is used for.

  As shown in FIG. 1, the monitoring device 10 is configured by housing various components shown in FIG. 2 in a housing that can be installed on a shelf or a desk. Are provided with a pyroelectric infrared sensor 12, a CMOS camera 14 as an imaging means, an illuminance sensor 16, and a display unit 18.

  As shown in FIG. 2, the monitoring apparatus 10 includes a wireless communication unit (so-called slave unit) 20 for connecting to a base unit of a wireless LAN in addition to the above-described units, and a building via a communication line. A wired communication unit 22 for connecting to a LAN installed in the network, an operation unit 24 including a switch for wireless LAN connection and a switch for initializing a monitoring device, a card slot 26 for installing a memory card, A power supply unit 28 that supplies power to each unit and a control unit 30 are provided.

The power supply unit 28 has a built-in chargeable / dischargeable battery and includes a DC jack 29 for charging the battery by receiving power supply from an external AC adapter.
Next, the control part 30 is comprised with the microcomputer (microcomputer) which consists of CPU, ROM, RAM, etc., and each said part is connected.

  The control unit 30 operates according to various commands input from an external network terminal via the wireless communication unit 20 or the wired communication unit 22, and for example, when a pet monitoring command is input, The image (moving image) captured by the camera 14 is simply processed and transmitted to the external network terminal that has transmitted the monitoring command.

  As an external network terminal (hereinafter referred to as an external terminal), an information terminal such as a personal computer directly connected to a LAN (local area network) connected via the wireless communication unit 20 or the wired communication unit 22, a LAN Information terminals on the Internet connected through routers and ISPs (Internet service providers), mobile terminals such as mobile phones and smart phones connected to the Internet via wireless communication networks such as mobile phone lines, etc. be able to.

Hereinafter, this monitoring operation will be described.
The control unit 30 reads an image captured by the camera 14 and transmits the captured image as it is to the external terminal as a monitoring image when the moving body 32 that is a pet is moving as shown in FIG.

  Further, as shown in FIG. 3B, when the moving body 32 stops in the captured image, the moving body 32 becomes the center position of the display screen, and the size (vertical / horizontal) of the moving body 32 is set on the display screen. The captured image is enlarged (zoomed in) so as to be ½ in the vertical and horizontal directions, and the enlarged image (enlarged image) is transmitted to the external terminal as a monitoring image (see FIG. 3C).

This operation is realized by a moving object detection process and an enlarged display process that are periodically and repeatedly executed by the control unit 30.
As shown in FIG. 4, in the moving object detection process, a captured image is read from the camera 14 in S100 (S represents a step), and a motion vector generated around the moving object 32 on the captured image is read in S110. The moving body 32 (in other words, a pet) is detected, and a frame (moving body surrounding frame) 34 surrounding the moving body 32 is generated in S120.

  On the other hand, in the enlarged display process, first, in S200, the latest moving object surrounding frame 34 generated in the moving object detection process is read, and in subsequent 210, whether the moving object 32 has stopped due to the change of the moving object surrounding frame 34. By judging whether or not, it waits for the moving body 32 to stop.

  If it is determined in S210 that the moving object 32 has stopped, the process proceeds to S220, and the moving object surrounding frame size n frames (moving objects including the latest moving object surrounding frame 34 detected in the past in the moving object detection process). The size of n surrounding frames, n: a plurality of values) is read, and the average size (specifically, the average moving object surrounding frame size) is calculated.

In subsequent S220, the display maintenance frame 36 is set around the latest moving body surrounding frame 34 read in S200.
The display maintenance frame 36 is set to a predetermined value times the moving object surrounding frame 34, and the magnification of the display maintenance frame 36 is an outer frame (hereinafter referred to as an enlargement) of the display screen when the display maintenance frame 36 enlarges and displays the moving object 32. It is set to be smaller than 38).

  Next, in S240, the captured image is resized so that the average moving object surrounding frame size (vertical / horizontal) is 1/2 of the vertical / horizontal of the enlarged display frame 38, and the resized image is processed in S250. The display area in the captured image (that is, the enlarged display frame 38) is set so that the center of the moving body 32 in FIG.

In S260, the image data in the set enlarged display frame 38 is output as image data for enlarged display of the moving object 32 on the external terminal, thereby starting the enlarged display.
Note that after the processing in S260, the image data (that is, the enlarged image) in the enlarged display frame 38 set in S250 among the captured images from the camera 14 is continuously output to the external terminal as a monitoring image. It will be. For this reason, on the external terminal side, it is possible to enjoy an enlarged image (moving image) zoomed in on the pet that is the moving body 32.

  Further, the switching of the monitoring image to the enlarged image in S260 is performed after a predetermined time (for example, 1 second) has elapsed since it was determined in S210 that the moving body 32 has stopped, and the moving body is displayed while the predetermined time has elapsed. If 32 has moved, the process proceeds to S200.

  Next, after starting the enlarged display in S260, the process proceeds to S270, and the moving object surrounding frame 34 generated in the moving object detection process is read. In subsequent S280, it is determined whether or not the read moving object surrounding frame 34 has moved out of the display maintenance frame 36 set in S230.

  If it is determined in S280 that the moving object surrounding frame 34 is not out of the display maintaining frame 36, the process proceeds to S270 again, and it is determined in S280 that the moving object surrounding frame 34 is out of the display maintaining frame 36. Then, it is determined that the moving body 32 has moved greatly, and the process proceeds to S290 to end the enlarged display.

  Note that the enlarged display is ended by switching the monitoring image to be transmitted to the external terminal from the enlarged image to the image captured by the camera 14. On the external terminal side, the normal monitoring in which the display screen is zoomed out from the pet is performed. It will change to an image.

  As described above, according to the monitoring apparatus 10 of the present embodiment, the moving body detection frame 34 that surrounds the moving body 32 on the captured image is detected from the motion vector of the captured image in the moving body detection process. By generating, information indicating the position and size of the moving body 32 is generated.

  In the enlarged display process, it is determined whether or not the moving body 32 has stopped based on the change of the moving body surrounding frame 34. If the moving body 32 has stopped, the moving body surrounding frame 34 has a predetermined size within the display screen. Then, an enlarged display image (enlarged image) in which the moving body 32 becomes the center position of the display screen is generated and output to the external terminal.

  For this reason, according to the monitoring apparatus 10 of the present embodiment, the monitoring image can be automatically zoomed in / out in accordance with the movement of the moving body 32, and the zoom in / out is performed using one camera 14. Can be done.

  In addition, the monitoring image to be transmitted to the external terminal can be generated by the camera 14 and the control unit (microcomputer) 30 that processes the image captured by the camera 14, and detects that the pet that is the moving body 32 has moved. Since it is not necessary to provide a separate sensor or the like, the apparatus configuration can be simplified. Moreover, since the device configuration is simplified, the monitoring device 10 can be easily carried and installed at a desired location.

  In this embodiment, the camera 14 corresponds to the imaging unit of the present invention, the wireless communication unit 20 and the wired communication unit 22 correspond to the monitoring image output unit of the present invention, and the control unit 30 corresponds to the present invention. , Moving object detection means, magnification setting means, enlarged image generation means, movement determination means, and enlarged image output stop means.

  Further, in the control unit 30, the function as the moving object detection means is realized by the moving object detection process shown in FIG. 4, and the functions as the magnification setting means and the enlarged image generation means are performed in the processes of S210 to S260 shown in FIG. The function as the movement determination means is realized by the processing of S270 and S280 shown in FIG. 4, and the function as the enlarged image output stop means is realized by the processing of S290 shown in FIG.

As mentioned above, although one Embodiment of this invention was described, this invention is not limited to the said embodiment, In the range which does not deviate from the summary of this invention, a various aspect can be taken.
Then, next, the four modification with respect to the said embodiment is demonstrated as another example of embodiment of this invention.

Modification 1 described below corresponds to Claim 3 of the present application, Modification 2 corresponds to Claim 4 of the present application, Modification 3 corresponds to Claim 5 of the present application, and Modification 4 corresponds to Claim 6 of the present application. Corresponding to
(Modification 1)
“Adjusting the magnification according to the amount of activity of the subject”
In the above-described embodiment, the magnification of the captured image when the moving object 32 is enlarged and displayed is described as being set so that the moving object 32 has a size of 1/2 in the vertical and horizontal directions with respect to the display screen. If the magnification is too large, the switching interval from the enlarged image of the monitoring image to the captured image becomes short, and it becomes difficult for the user to monitor the moving object 2 on the display screen.

  In order to prevent such a problem, if the magnification of the captured image at the time of generating the enlarged image is reduced, even if the enlarged image is output as the monitoring image, the user can move the moving object on the display screen based on the enlarged image. It becomes impossible to grasp the state (such as a pet's facial expression) in detail.

For this reason, the magnification at the time of displaying the moving body 32 in an enlarged manner may be set according to the amount of activity of the subject.
In other words, when the subject moves actively, the magnification is set so that the moving object surrounding frame 34 is 1/3 in the vertical and horizontal directions (area ratio 1/9) of the enlarged display frame 38 as illustrated in FIG. When the subject does not move much, the moving object surrounding frame 34 is 2/3 in the vertical and horizontal directions (area ratio 4/9) of the enlarged display frame 38, as illustrated in FIG. 5B. The magnification is set.

And in order to do in this way, when the control part 30 performs the process of S240 shown in FIG. 4, what is necessary is just to perform the magnification setting process shown in FIG.
That is, in the magnification setting process, the center coordinate of the moving object surrounding frame 34 is acquired (S300), and the activity amount X of the moving object 32 is calculated from the change of the center coordinate (S310), and the activity amount X is within the standard range. If there is (S320-YES), the magnification is set to the standard value (area ratio 1/4) (S330).

  When the activity amount X is smaller than the standard range (S340-YES), the magnification is set to the maximum value (area ratio 4/9) (S350), and when the activity amount X is larger than the standard range (S340). -NO), the magnification is set to the minimum value (area ratio 1/9) (S360).

  In this way, when the amount of activity of the moving object 32 is large, the monitoring image is switched to the enlarged image by reducing the magnification, and then the moving object 32 exceeds the display maintenance frame 36 and the monitoring image is displayed. The time until returning to a normal captured image can be lengthened.

Further, when the amount of activity of the moving body 32 is small, by increasing the magnification, the moving body 32 can be displayed larger on the external terminal, and the user can easily monitor the state of the moving body 32.
(Modification 2)
“Adjusting the magnification when the subject moves within the display maintenance frame after zooming in”
Next, the magnification for enlarged display may be maintained at a constant magnification until the moving body 32 exceeds the display maintenance frame 36 in the display screen. When the moving body 32 approaches the camera 14, the moving body 32 becomes larger on the display screen.

  That is, in this case, on the display screen of the external terminal, as shown in FIGS. 7A and 7B, the moving body 32 changes from the standard size immediately after generating the enlarged image to an enlarged size close to the display maintenance frame 36. To do.

Conversely, when the moving body 32 moves away from the camera 14, the moving body 32 becomes smaller on the display screen, making it difficult for the user to monitor the moving body 32.
For this reason, after starting the output of the enlarged image in S260 described above, as shown in FIG. 7C, the moving body 32 is enlarged so as to be displayed in a substantially constant size in the display screen of the external terminal. The magnification for image generation may be updated periodically.

  For this purpose, after the enlarged display is started in the process of S260 in the control unit 30, the magnification update process shown in FIG. 8 is executed to update the magnification of the captured image when the enlarged image is generated. What should I do?

  That is, this magnification update process is a process periodically executed during the enlarged display of the moving object 32. In S400, it is determined whether or not the moving object 32 has moved. The process of 490 is executed.

  In S410, the size of the moving object surrounding frame 34 of the latest n frames generated by the moving object detection process during the enlarged display is obtained, and in S420, the amount of change in the moving object surrounding frame size between each frame is the threshold value. It is determined whether or not:

  If it is determined in S420 that the amount of change in the size of the moving object surrounding frame between the frames is less than or equal to the threshold value, it is determined that the size of the moving object 32 has not changed rapidly, and the process proceeds to S430. After shifting and waiting for the first set time (1 s), the process shifts to S440.

  In S420, if at least one of the change amounts of the moving object peripheral frame size between the frames exceeds the threshold value, it is determined that the size of the moving object 32 is changing rapidly, and S435 is determined. And after waiting for the first set time (0.5 s), the process proceeds to S440.

  In S440, the latest number of pixels a in the horizontal direction of the moving object surrounding frame 34 obtained by the moving object detection process is acquired. In S450, the latest number of pixels b in the horizontal direction of the moving object surrounding frame 34 is acquired.

  In subsequent S460, a reference moving object size Z (a preset predetermined value, for example, vertical and horizontal 1/2 of the display screen), which is a reference size of the moving object surrounding frame 34 to be displayed in the enlarged image, is read. Migrate to

In S470, an adjustment magnification d (d = (a / b) · Z) is calculated based on the parameters a, b, and Z. In S480, the captured image is resized with the adjustment magnification d.
Finally, in S490, the display area in the captured image is set so that the center of the subject (moving body 32) in the resized captured image becomes the center of the display screen.

As a result, when the moving object 32 that is the subject is enlarged and displayed on the external terminal, the moving object 32 is displayed in substantially the same size in the center of the display screen.
(Modification 3)
"Adjusting the display maintenance frame according to the amount of activity of the subject"
In the above embodiment, the display maintenance frame 36 used to determine whether or not to return the monitoring image transmitted to the external terminal from the enlarged image to the normal captured image during the enlarged display of the moving object 32 is the moving object surrounding frame 34. Although described as being set to a predetermined value multiple, this display maintenance frame 36 may also be set according to the amount of activity of the moving object 32, as with the magnification at the time of enlarged image generation.

  That is, when the moving body 32 moves actively, the display maintenance frame 36 is reduced as shown in FIG. 9A, and the moving body 32 does not move so much (at night or when the moving body 32 is aged). In other words, the display maintenance frame 36 is enlarged as shown in FIG.

In addition, the size of the display maintenance frame 36 may be changed manually by the user or automatically by the control unit 30.
In order for the control unit 30 to automatically change the size of the display maintenance frame 36, when the control unit 30 executes the process of S230, the display maintenance frame setting process shown in FIG. 10 is executed. You just have to do it.

  That is, in this display maintenance frame setting process, in S500, the center coordinates of the moving object surrounding frame 34 generated a plurality of times in the past in the moving object detection process are acquired, and in S510, the time series of the acquired plurality of center coordinates is obtained. The amount of activity X of the moving body 32 is calculated from the change.

  In the subsequent S520, it is determined whether or not the calculated activity amount X is within the standard range. If the activity amount X is within the standard range, the display maintaining frame 36 with respect to the moving object surrounding frame 34 is determined in S530. Set the magnification to the standard value.

  If it is determined in S520 that the activity amount X is not within the standard range, the process proceeds to S540, where it is determined whether or not the activity amount X is smaller than the standard range. If smaller, the process proceeds to S550, and the magnification of the display maintenance frame 36 with respect to the moving object surrounding frame 34 is set to a predetermined enlargement value.

  If it is determined in S540 that the activity amount X is greater than or equal to the standard range (that is, if the activity amount X is greater than the standard range), the process proceeds to S560 and the moving object of the display maintenance frame 36 is moved. The magnification for the surrounding frame 34 is set to a predetermined reduction value.

  According to the third modification, when the activity amount X of the moving object 32 is large and the moving object 32 is likely to be detached from the display screen, the display maintenance frame 36 is reduced to make the monitoring image faster than the normal captured image. It is possible to prevent the moving object from being displayed on the display screen.

When the amount of activity X of the moving body 32 is small (for example, when the pet is sleeping), the monitoring image is changed to a normal captured image with a slight movement of the moving body 32 by increasing the display maintenance frame 36. It can be suppressed from being returned.
(Modification 4)
“Function to prevent a part of a subject from being mistakenly detected as a whole subject when part of the subject moves”
Next, in the above embodiment, as shown in FIG. 11A, when a part of the moving body 32 (for example, the tail of the pet) moves during the enlarged display of the moving body 32, the part is used as the moving body 32 ′. It may be erroneously detected.

In this case, when the erroneously detected moving body 32 ′ stops, it is conceivable that the moving body surrounding frame 34 ′ is set for the moving body 32 ′, and the moving body 32 ′ is enlarged and displayed.
Therefore, in order to prevent such a problem, the enlarged display process may be executed according to the procedure shown in FIG.

  That is, in the enlarged display process shown in FIG. 12, when it is detected in S210 that the moving body 32 has stopped due to the change in the moving body surrounding frame 34, the size of the moving body surrounding frame 34 is acquired in S212, and a memory such as a RAM. To remember.

  In the subsequent S214, the size of the moving object surrounding frame 34 acquired in S212 is within a predetermined range (for example, 0.3 times to 1.7 times the size of the moving object surrounding frame 34 stored in the previous S212). If it is within the predetermined range, the process proceeds to S230 as it is, and if it is not within the predetermined range (that is, if the size of the moving object surrounding frame 34 is suddenly changed), S218 is performed. The previous value is set as the size of the moving object surrounding frame 34, and the process proceeds to S230.

  In S230, the display maintenance frame 36 is set around the moving object surrounding frame 34 based on the currently set size of the moving object surrounding frame 34, and thereafter, the processing after S240 is executed in the same manner as in the above embodiment. .

  In this way, when the size of the moving object surrounding frame 34 changes abruptly, the moving object 32 so far is enlarged and displayed as it is without changing the moving object surrounding frame 34. It is possible to prevent the portion from being erroneously detected as the moving body 32 ′ and enlarged display.

The enlarged display process shown in FIG. 13 is different in that S216 is executed instead of the process of S214 in FIG.
That is, in S216, it is determined whether or not the size of the moving object surrounding frame 34 is smaller than the previous value. If the size of the moving object surrounding frame 34 is equal to or larger than the previous value, the process proceeds to S230 as it is. If the size is smaller than the previous value, in S218, the previous value is set as the size of the moving object surrounding frame 34, and then the process proceeds to S230.

  Even in this case, it is possible to prevent a part of the moving body 32 from being erroneously detected as the moving body 32 ′ and being displayed in an enlarged manner.

  DESCRIPTION OF SYMBOLS 2 ... Moving body, 10 ... Monitoring apparatus, 12 ... Pyroelectric infrared sensor, 14 ... Camera (CMOS camera, 16 ... Illuminance sensor, 18 ... Display part, 20 ... Wireless communication part, 22 ... Wired communication part, 24 ... Operation part , 26 ... card slot, 28 ... power supply unit, 29 ... DC jack, 30 ... control unit, 32 ... moving object, 34 ... moving object surrounding frame, 36 ... display maintenance frame, 38 ... enlarged display frame.

Claims (6)

An imaging means for imaging a moving image of the entire monitoring target area;
A moving body detecting means for detecting a moving body moving in the captured image and detecting a position and a size of the moving body in the captured image from a temporal change of the captured image captured by the imaging section;
When the moving object detected by the moving object detecting means stops in the captured image, the moving object becomes a predetermined size in the display screen of the display device based on the size of the moving object in the captured image. Magnification setting means for setting a magnification for enlarging the captured image;
Based on the magnification set by the magnification setting means, the captured image is magnified and displayed on the display screen of the display device by enlarging the captured image centered on a stop position of the moving object in the captured image. An enlarged image generating means for generating an enlarged image for
When the magnified image is generated by the magnified image generating means, the magnified image is output as a monitoring image of the monitoring target area. If the magnified image is not generated by the magnified image generating means, the imaging is performed. Monitoring image output means for outputting a captured image by the means as the monitoring image;
Movement determining means for determining whether or not the moving object has moved beyond a predetermined display maintenance frame in the display screen when the enlarged image is generated by the enlarged image generating means;
When the movement determining means determines that the moving object has moved beyond a predetermined display maintenance frame in the display screen, the enlarged image generating means stops the enlarged image generating operation, and the monitoring is performed. Enlarged image output stopping means for outputting the captured image as the monitoring image from an image output means;
A monitoring device comprising:   The monitoring apparatus according to claim 1, wherein the monitoring image output unit transmits a monitoring image including the enlarged image or the captured image to an external network terminal via a network.   The magnification setting means sets the magnification according to the amount of activity of the moving body so that the magnification is small when the amount of activity of the moving body is large and the magnification is large when the amount of activity is small. The monitoring apparatus according to claim 1 or 2.   The magnification setting means determines that the moving object has stopped in the captured image, and once sets a magnification for enlarging the captured image, then the moving object is set to a predetermined value in the display screen of the display device. The monitoring apparatus according to claim 1, wherein the magnification is periodically updated so as to be maintained in a size.   The movement determination unit uses the movement determination unit to determine the movement of the moving object so that the display maintenance frame becomes small when the activity amount is large and the display maintenance frame becomes large when the activity amount is small according to the activity amount of the moving object. The monitoring apparatus according to claim 1, further comprising a display maintenance frame setting unit configured to set the display maintenance frame. The magnification setting means includes
When the moving object detected by the moving object detecting means stops in the captured image, the size of the moving object detected by the moving object detecting means and the magnification for setting the previous enlarged image are set. Compare the size of the moving body used,
If the size of the moving object detected by the moving object detecting means is within a predetermined range including the size of the moving object used when the magnification was set last time, the moving object detecting means detected the Set the magnification based on the size of the moving object,
If the size of the moving object detected by the moving object detection means is not within the predetermined range, the magnification is set based on the size of the moving object used when the magnification was set last time.
The monitoring apparatus according to any one of claims 1 to 5, wherein:

Images