JP2020092427A - Apparatus and program - Google Patents

Abstract

To provide an apparatus etc. capable of acquiring a captured image which enables a user to easily check the contents of photographing before and after the occurence of an event.SOLUTION: The apparatus comprises: event detection means which detects information indicating the occurence of an event generated by an imaging target; and control means which has a function of, with the detection of the information indicating the occurrence of the event by the event detection means as a trigger, storing captured images in a record period including before and after the moment of detecting the information indicating the occurrence of the event, in a storage medium.SELECTED DRAWING: Figure 4

Description

The present invention relates to a device, a program, and the like.

There has been proposed a surveillance camera that includes a lens unit and stores image data captured by the lens unit in a removable storage medium (see, for example, Patent Document 1).

JP, 2013-197902, A

Normally, with such a surveillance camera, the object to be monitored is constantly imaged, so in order to check the shooting contents in the event of an abnormality, a long video is played back from the beginning, and the problem scene can be played back quickly. I had to find and confirm. Therefore, the confirmation work took a very long time.

Therefore, it is an object of the present invention to provide a device or the like capable of acquiring a captured image that allows easy confirmation of the captured content before and after an event occurs, for example.

(1) In order to solve the above problems, the present invention is triggered by an event detection unit that detects information indicating the occurrence of an event emitted by an imaging target and that the event detection unit detects information indicating the occurrence of the event. It is preferable that the device includes a control unit having a function of storing a captured image in a recording medium in a recording period including temporally before and after the time when the information indicating the occurrence of the event is detected.

In this way, in response to the information indicating the occurrence of the event emitted by the imaging target, it is easy to confirm the content of the image captured before and after the time when the event occurs. For example, in order to confirm the image, it is preferable to include a reproducing unit that reproduces the stored captured image so that the user can visually recognize it. The reproducing means may be provided integrally with the control means or may be provided separately. Further, in the present invention, it is preferable that the image pickup means be provided together with the control means. The image capturing means may always capture an image regardless of the occurrence of an event and temporarily store a captured image for a predetermined time. Then, when the control unit detects the information indicating the occurrence of the event, the control unit may control so as to store the picked-up images picked up before and after the predetermined time in the storage medium. Further, in the present invention, the storage medium may be built in the device in which the control means is provided, but may be detachably provided in the device, for example, in the form of a memory card, a hard disk drive, or the like.

The “event” may occur, for example, when an abnormality occurs. For example, it may be various events, and in particular, it may occur due to a failure of a machine tool operating in a factory production line, a change or abnormality in a state detected by an external sensor, or the like. The event may be automatic recovery from an abnormal state.

The “information indicating the occurrence of an event” may be, for example, information indicating a change in state or the occurrence of an abnormality. Specifically, for example, when the imaging target is a machine tool, the information generated when the machine tool detects a work failure may be “information indicating the occurrence of an event”. It is particularly preferable that the alarm signal or the alert signal generated when the machine tool detects a work failure is “information indicating the occurrence of an event”. Further, for example, a signal from a signal light connected to the machine tool (for example, a status signal indicating that the signal light is lit) or a drive signal for blinking the signal light may be used as the “information indicating the occurrence of an event”. Further, the “information indicating the occurrence of an event” may be an external output signal for notifying the occurrence of an event such as an abnormality in the device to be imaged. Then, the control means may control the storage of the captured image captured by the image capturing means in response to a change in these signals. Further, the “information indicating the occurrence of an event” may have a configuration not only for detecting a signal or the like received from the outside but also for detecting the occurrence of an event inside the device. For example, the life and deterioration degree of the storage medium may be determined inside the device, and when a predetermined determination such as the approaching life is approached, it may be treated as the occurrence of an event.

The “time when the event occurs” may be, for example, the time immediately after detecting the information indicating the occurrence of the event.

The “captured image” is preferably captured as an imaging range in which the cause of the occurrence of the event can be pursued.

The “image” may be, for example, a still image, but is particularly preferably a moving image. The image may be, for example, a 2D image or a 3D image. For example, it may be a monochrome image or a color image.

(2) The object to be imaged is preferably a device that performs control for notifying a human of the occurrence of an event when the event occurs. For example, in a site such as a factory, a distribution warehouse, or an automated warehouse, a machine tool, an automatic carrier, or any other machine that performs some automatic processing may be an imaging target. Further, a device such as an automatic teller machine (so-called ATM) or a self-checkout, which is supposed to be used by a general user even if it is not automated, may be the imaging target. Then, the control means may detect information generated by the control of these devices for notifying the occurrence of the event as information indicating the occurrence of the event.

(3) The information indicating the occurrence of the event may be an electrical or optical signal emitted by the device when the abnormality occurs.

The "electrical or optical signal transmitted to the device" may be any signal as long as it is a signal emitted by the device when an abnormality occurs. For example, a binary signal indicating a status such as ON/OFF, An audio signal for transmitting analog voice, a pulse train, or the like is preferable, and a signal in which a predetermined pattern is repeated is particularly preferable. By doing so, it is possible to reliably receive and detect the information indicating the occurrence of the event.

(4) The information indicating the occurrence of the event may be a signal that is recognizable to humans when the device has an abnormality. For example, when the information indicating the occurrence of the event is visual information, the information indicating the occurrence of the event may be detected by the imaging unit.

The “signal recognizable to humans” may be, for example, auditory information such as siren, beep sound, melody, visual information such as light emission and image, motion information such as vibration and impact, and the like.

An alarm or the like issued to a person mounted on the device can be used as a function indicating the occurrence of an event, and images before and after the occurrence of an abnormality can be recorded. In particular, when visual information or auditory information is detected as information indicating the occurrence of an event, cumbersome work such as branching a signal when installing the device is not necessary, and the device can be easily installed and removed.

(5) The imaging target emits different information depending on the type of event that has occurred, and the control device stores in advance different recording periods corresponding to the identified information. It is preferable to identify the event that has occurred based on the event and store the captured image in the recording period corresponding to the identified event in the storage medium. For example, when the device detects an electrical or optical signal generated due to the occurrence of an abnormality as information indicating the occurrence of an event, the control device may identify the information indicating the occurrence of the event based on the type of the signal, the pattern, and the like. .. For example, an existing signal for the device may be branched and used.

By doing so, it is possible to identify a plurality of types of information according to the event that has occurred and to set an appropriate recording period according to the type of event. For example, for information that indicates the occurrence of an event that requires analysis and identification of the cause of the event, it is advisable to set a long recording period before the moment when the information is detected. For the information indicating the occurrence of, the recording period may be provided longer than the moment when the information is detected. The imaging device may control the recording period to be different for each type of information indicating the occurrence of an event, and may store the recording period in advance in association with the type of event.

(6) The control means may be capable of executing control such that a predetermined period of time from the moment when the information indicating the occurrence of the event is detected is a non-reaction period in which the information indicating the occurrence of the new event is not reacted. (7) When the information indicating the occurrence of the event is continuously issued after the occurrence of the event, the control means sets a predetermined time after the information indicating the occurrence of the event that was continuously issued is stopped. It is preferable to be able to execute control for a non-responsive period that does not react to information indicating the occurrence of a new event.

The "non-reaction period" may be set to a period sufficient to confirm that the continuation of the information indicating the occurrence of the event has stopped. For example, the pulse train in which the information indicating the occurrence of the event is continuously and repeatedly emitted in a predetermined pattern. In case of, it is better to be longer than the time of the longest row in the pattern.

By providing the invalid reaction period in this way, it is possible to prevent a plurality of records from remaining when information indicating the occurrence of a plurality of events is detected in a short period of time. For example, when the information indicating the occurrence of a plurality of events is issued for an event to be grasped as one event, unnecessary recording can be suppressed.

(8) The control means sets a predetermined time immediately after the recording period as a monitoring period, and when detecting information indicating the occurrence of a new event within the monitoring period, sets the end of the monitoring period to the occurrence of the new event. It is preferable to be able to execute control that treats the indicated information as the moment when it is detected. (9) The monitoring period may be provided such that the recording period based on the end of the monitoring period overlaps with the immediately preceding recording period.

When the information indicating the occurrence of the next event is detected immediately after the end of the recording period, the recording time combined with the previous recording period can be lengthened while suppressing the overlapping of the recording periods.

(10) The control means sequentially records a series of captured images over a predetermined period in the past at consecutive addresses in the recording area of the storage medium, and records the captured image recorded for each captured image. It is advisable to perform control to increase the overwrite count value, which indicates the number of times data is overwritten to the address to be written.

By recording the overwrite count value indicating the number of overwrites in this way, it becomes possible to determine the life of a storage medium in which a failure occurs as the number of writes increases, such as in a NAND flash memory. In addition, the control of sequentially recording to consecutive addresses in the recording area makes it unnecessary to search for the next writing area in the recording process, shortens the writing time, and allows the addresses in the storage area to be used without any bias. This makes it possible to avoid using a large part of the storage area.

(11) The control unit detects, in the storage area of the storage medium, a captured image whose overwrite count value is different from the overwrite count value recorded for the immediately previous captured image, and overwrites the detected captured image. Then, it is preferable to perform control to record the next image pickup increase.

By doing so, it becomes possible to specify the address to be written without separately storing the address to which the captured image is to be written next. Further, by writing the next captured image from the address specified in this way, it is possible to use the addresses in the storage area without bias, and avoid using a large part of the storage area. ..

(12) The control means holds a format count master value indicating the number of times the storage medium has been initialized in a management area different from the storage area in which the captured image is stored in the storage medium, and the storage area of the storage medium is continuously stored. When the captured image is recorded in the address, the format count master value is transferred as the format count value for each captured image, and the data of the captured image in which the format count value different from the current format count master value is recorded is erased. It should be treated as an item.

By doing so, the time required for formatting can be shortened. Further, in the case of a storage medium whose deterioration is promoted by physically erasing the stored data, it is possible to complete the formatting by updating only the format master count value. It is possible to prevent the life from being shortened.

(13) With the program of the present invention, a computer may be caused to function as any of the above devices.

It is a schematic diagram showing the imaging device 100 together with the machine tool 2. 6 is a schematic diagram showing an outline of an operation sequence when an event occurs in the machine tool 2. FIG. FIG. 3 is a schematic diagram showing an appearance of the image pickup apparatus 100. 3 is a block diagram showing the configuration of the imaging device 100 together with the memory card 200. FIG. 6 is a schematic diagram showing an example of a recording format of the memory card 200. FIG. FIG. 6 is a diagram showing a relationship between the occurrence of an event and the recording of a captured image in the first embodiment. FIG. 9 is a diagram showing a relationship between the occurrence of an event and the recording of a captured image in the second embodiment. FIG. 13 is a diagram showing the relationship between the occurrence of an event and the recording of a captured image in the third embodiment. It is a figure which shows the normal recording control when a trigger is recognized immediately after the end of the recording period. It is a figure which shows the relationship between the occurrence of an event and the recording of a captured image in the fourth embodiment. It is a figure which shows the relationship between the occurrence of an event and the recording of a captured image in the fifth embodiment.

[First Embodiment]
On-site such as factories, distribution warehouses, and automated warehouses, machines that perform some automatic processing, such as machine tools and automatic transporters, are used. In addition, a machine such as an automatic teller machine (so-called ATM) or a self-checkout machine, which is supposed to be used by a person who is not automated but is not accustomed to using the machine, is used in a general store or the like. ing. When any abnormality occurs, these machines generally have a function of notifying a person such as a manager or a monitor of the equipment of the occurrence of abnormality by a lamp, an alarm sound, or the like. However, even if the administrator rushes to the site after an abnormality has occurred and only the situation after the abnormality has occurred can be seen, the cause of the abnormality can be determined and the occurrence of the abnormality can be prevented. It may be difficult to take measures. For this reason, it has been practiced to take a video of mechanical equipment with a video camera or the like before the occurrence of the abnormality and to check the recorded video to check the situation before and after the occurrence of the abnormality.

For example, assume a situation in which a factory has newly constructed a production line that uses machine tools. When the production line is just constructed, the machine tools that make up the line cause various troubles for a period of 3 to 4 months, so monitor the machine tools and perform improvement activities to eliminate the cause of the trouble. is necessary. For example, a screw may be dropped on the screw tightening line, or the screw may fall over, which may cause a trouble. We will work to eliminate the causes of such troubles, reduce the troubles to almost zero, and ensure that the products are completed properly. In the past, when a machine tool was constantly photographed with a video camera, and if something abnormal was found later in the data recorded by the machine tool, the operator would see the image taken from the beginning. Was there.

The image capturing apparatus 100, which is an embodiment of the present invention described below with reference to the drawings, can be suitably used for capturing an image of such mechanical equipment. The imaging device 100 of the present embodiment is a device that records an image of the machine tool 2 in order to monitor the work content of the machine tool 2 operating in the factory production line. FIG. 1 is a schematic diagram showing the imaging device 100 together with the machine tool 2. FIG. 2 is a schematic diagram showing an outline of the operation sequence when an event occurs in the machine tool 2. The image pickup apparatus 100 is temporarily installed near the machine tool 2 on a tripod.

The machine tool 2 to be monitored in the present embodiment is assumed to perform screw tightening work on the manufacturing line. The machine tool 2 repeatedly executes this screw tightening work at every predetermined work cycle (for example, 30 seconds). When the machine tool 2 detects a failure in the work performed by itself or an abnormality in the equipment, the machine tool 2 outputs an alert signal indicating the occurrence of the abnormality. A transition from a normal state to a state different from the normal state such as a work failure or a device abnormality is called an “event”. The machine tool 2 keeps the alert signal low during normal times. On the other hand, when an event occurs, a pulse that alternately repeats high and low is continuously output. The alert signal is input to the laminated signal lamp 21 as a lighting control signal. The laminated signal light 21 is, for example, a display in which signal lights of a plurality of colors such as red, yellow, and blue can be independently turned on/off. The signal lamp of each color is turned off when the signal level of the corresponding control signal is low, and is turned on when the signal level of the corresponding control signal is high. In this embodiment, the red light in the laminated signal light 21 is controlled by the alert signal. In this embodiment, the alert signal is input to the stacked signal light 21 as a control signal for turning on/off the red light of the stacked signal light 21, and the red light blinks in response to the alert signal. After outputting the alert signal, the machine tool 2 stops the work, eliminates the defective product, restarts the work, stops the pulse of the alert signal, and returns to the normal state as a low state. A series of processes starting from the detection of these failures, alerting, stopping the work, restarting the work after eliminating defective products may be completed within the work cycle in which the failure was detected, but it is not completed within the work cycle. In some cases, the pulse of the alert signal is continuously output without being stopped until the completion. In the imaging apparatus 100, the occurrence of an event is first detected from the change of the alert signal from low to high, and an image of a recording period including temporally before and after the moment of event occurrence is captured and recorded.

The video image recorded by the image pickup apparatus 100 is reproduced by a dedicated browser which is display/browsing software operating on a personal computer. The dedicated browser is a program that is executed by the CPU of the personal computer, and is installed in the personal computer of the management department that is separate from the factory where the imaging device 100 is installed. With the dedicated browser, in addition to playing back the video recorded by the image capturing apparatus 100, various settings such as the frame rate, image quality, recording method, and whether or not overwriting can be performed, and formatting of the memory card 200 for the image capturing apparatus 100 can be performed.

FIG. 3 is a schematic diagram showing the appearance of the image pickup apparatus 100, and FIG. 4 is a block diagram showing the configuration of the image pickup apparatus 100 together with the memory card 200. The imaging device 100 includes a controller 105, an imaging unit 120, an event input terminal 130, a memory card slot 160, and an image signal output terminal 180 inside a substantially cylindrical casing 105. A screw hole (not shown) for attaching the imaging device to a tripod platform or a shooting location is provided on a part of the cylindrical side surface of the housing 105. The imaging unit 120 is arranged inside the housing 105 such that the direction in which the screw hole is provided is the lower side.

The controller 110 is an example of the control means of the present invention. The controller 110 is configured to include a CPU (not shown), main body memory such as ROM and RAM, and a microcomputer including a timer. The ROM of the controller 30 stores an image processing program for saving an image captured by the imaging unit 120 in the main body memory or the memory card 200 inserted in the memory card slot 160, and various programs such as an OS (Operation System). .. The CPU of the controller 110 performs various controls according to these control programs. The controller 110 also detects an alert signal, which is information indicating the occurrence of an event, that is input to the event input terminal 130, and executes control according to the event.

The image pickup unit 120 corresponds to the image pickup means of the present invention. The imaging unit 120 is provided at one end of the substantially cylindrical casing 105 in the longitudinal direction with the longitudinal direction of the casing 105 as the optical axis. The image pickup unit 120 includes a lens unit 122 and an image pickup element 124. The lens unit 122 includes a zoom lens, and the angle of view can be set according to the size of the shooting target and the distance to the shooting target. The image sensor 124 is a CCD, a CMOS image sensor, or the like, and acquires the image of the imaging target formed by the lens unit 122 as a captured image.

The event input terminal 130 is a signal input terminal provided on the side surface of the housing 105. Connected to the event input terminal 130 is a wiring obtained by branching a connection line for transmitting an alert signal for turning on the laminated signal lamp 21 for abnormality notification by an electrotap or the like when the machine tool 2 detects a work failure, The alert signal is received as a trigger signal indicating the occurrence of an event. The trigger signal is transmitted to the controller 110 and detected as information indicating the occurrence of an event.

An existing machine tool or other device is provided with a notification function for notifying a person that an event (for example, a device abnormality) has occurred. The laminated signal light 21 described above is an example thereof. In addition, a revolving light, a buzzer, a siren, etc. are also given as examples of the notification function. The image pickup apparatus 100 of the present embodiment receives a trigger signal via the event input terminal by diverting the signal used in the notification function of the device, for example.

The image signal output terminal 180 is a terminal for outputting an image signal for displaying an image picked up by the image pickup unit 120 on an external monitor. In the present embodiment, an HDMI (High-Definition Multimedia Interface, registered trademark) terminal is used. Be done.

The memory card slot 160 is provided at the end of the housing 105 opposite to the imaging unit 120. The memory card 200 corresponding to the storage medium of the present invention is inserted into the memory card slot 160. Under the control of the control controller 110, a file storing a captured image captured by the image capturing unit 120 is recorded in the memory card 200.

As shown in FIG. 5, the memory card 200 is divided into a file system area 210 and an imaging recording area 220 for use. The file system area 210 is a file system that can be read and written by the OS of the personal computer like a general recording medium of a personal computer, and is a partition in the FAT32 format in this embodiment. Software of a dedicated browser is stored in the file system area 210. When the recorded contents of the memory card 200 are reproduced on the personal computer, and the personal computer does not have the dedicated browser installed, the dedicated browser can be installed on the personal computer from the file system area 210. The imaging recording area 220 is a partition of a unique format that cannot be read or written by the OS of the personal computer. The imaging recording area 220 is divided into an always recording area 222 and an event recording area 224 for use.

The constant recording area 222 includes a management area 222A and a storage area 222B. The management area 222A is an area in which various setting information is recorded by the dedicated browser, and when the captured image is recorded by the imaging device 100, the management area 222A is not recorded. By doing so, the setting data of the management area 222A is not lost even if the power is cut off during shooting. In the management area 222A, the overwrite count master value MUC, the format count master value MFC, the overwrite upper limit value UL, etc. are recorded. The overwrite count master value MUC indicates the maximum number of overwrites performed on each storage unit of the constant recording area 222. The overwrite count master value MUC is updated to the same value as the maximum overwrite count value UC in the storage area 222B when the setting information is recorded in the management area 222A of the memory card by the dedicated browser. The format count master value MFC indicates the number of times the constant recording area 222 has been formatted. Further, the overwrite upper limit value UL indicates a guideline for the number of overwrites at which a failure of the memory card 200 occurs, and this overwrite upper limit value UL is a guideline for determining the life (that is, how many more times can be overwritten). Available as The overwrite upper limit value UL differs depending on the type of memory card. The user records the overwrite upper limit value UL in the management area 222A by specifying the model number of the memory card to be used or by directly entering the value when formatting the memory card using the dedicated browser.

The storage area 222B is an area for storing a captured image captured by the image capturing apparatus 100. A header and footer are provided for the captured image of one frame, and additional information for the captured image of the frame is recorded in the header and footer. The combined recording size of the captured image and the additional information is larger than 1 byte, which is the address assignment unit of the memory card, so one frame of the captured image and additional information is recorded at a plurality of consecutive addresses. In the example shown in FIG. 5, 32768 bytes (32 kilobytes) are recorded per frame.

The additional information to be recorded in the header or footer of each frame includes the image capturing time CT of the captured image of the frame, the format count value FC, the overwrite count value UC (“1” at the time of first writing), and the timing at which the occurrence of an event is recognized. The trigger flag TF and the like indicating that the image is captured in step S4 is recorded. The format count value FC is a value indicating the number of formatting processes performed on the memory card 200. The overwrite count value UC is a value indicating the number of times data has been written to the address. The format count value FC and the overwrite count value UC are used for life management of the memory card 200, recording control, and the like. The information recorded in the header and footer may have non-overlapping contents or completely the same contents, but it is particularly preferable that only a part of them overlap as in the example shown in FIG. By overlapping the contents of the header and footer only partially, it is possible to increase the degree of tampering with the data including the additional information.

The controller 110 of the image capturing apparatus 100 sequentially stores the captured images, which are constantly captured, in the storage area 222B in the order in which they were captured at consecutive addresses. Specifically, when the captured image is recorded in the storage area 222B for the first time, recording is sequentially started from the head address of the storage area 222B. For example, as shown in FIG. 5, the first frame has addresses 0 to 32767, the second frame has addresses 32768 to 65535, and the consecutive images in the storage area 222B are used to record the captured images in the order of image capturing. .. When the end address of the storage area 222B is reached, the head address of the storage area 222B is restored, and recording is continued while overwriting the already written data. At the time of recording after the second round, a value obtained by incrementing the overwrite count value UC by 1 from the current value is recorded.

The event recording area 224 also includes a management area 224A and a storage area 224B, like the constant recording area 222. The format count master value MFC, the overwrite count master value MUC, the overwrite upper limit value UL, and the like are recorded in the management area 224A. In addition, in the storage area 224B, captured images captured before and after the occurrence of an event are recorded together with additional information. The management area 224A and the storage area 224B store the same information as the management area 222A and the storage area 222B, respectively. The additional information recorded here is the same as the additional information stored in the storage area 224B of the constant recording area 222.

When the controller 110 detects the alert signal received by the event input terminal 130, the controller 110 stores, in the storage area 224B, a captured image captured by the image capturing unit 120 during a recording period including temporally before and after the moment the alert signal is detected. In the same manner as the recording in the storage area 222B, the data is sequentially stored at consecutive recording addresses. The recording period before and after the event occurrence will be described later.

By the recording method as described above, the continuous writing in the recording areas (222B, 224B) is performed cyclically. As a result, the newest overwrite count value UC is recorded in the additional information of the frame that has been written most recently, and the overwrite count value UC that is one less is recorded in the additional information of the next frame. The control controller 110 finds a frame in which the overwrite count value UC switches for consecutive addresses in the recording areas (222B, 224B), and performs control to perform the next writing from that frame. By doing so, recording can be performed while overwriting the oldest data at any time. Moreover, the oldest data can be overwritten at any time by finding a frame in which the above-mentioned overwrite count value UC is switched and performing the next writing from that frame, without requiring other complicated control. .. In addition, since the number of times of overwriting the recorded imaging data is recorded and can be confirmed at the time of reproduction, the overwriting count value UC (and other additional information) should be used to verify whether the data has been tampered with. You can Further, the recording areas (222B, 224B) can be used without unevenness, and it is possible to prevent the location where the number of overwrites is locally large from becoming a bottleneck and shortening the life of the memory card itself.

In the memory card 200 adopting the above-mentioned recording method, the format processing in which the data already recorded in the recording areas (222B, 224B) are collectively erased is displayed by the captured image recorded by the above-mentioned method. -Use a dedicated browser that is software that runs on a computer for browsing. The format process is performed by incrementing the format count master value MFC recorded in the management area (222A, 224A) by one. On the other hand, during the formatting process, neither writing nor erasing process is performed on the storage areas (222B, 224B). In the imaging apparatus 100, a frame in which a format count value FC smaller than the format count master value MFC recorded in the management area (222A, 224A) is recorded as additional information is treated as data erased. .. Specifically, when writing a new captured image in an area in which an old captured image is stored, the controller 110 of the image capturing apparatus 100 sets the format count value FC recorded as additional information in the old captured image to the management area. It is compared with the format count master value MFC recorded in (222A, 224A). If the format count value FC is smaller than the format count master value MFC, the old captured image data (or data fragment) is erased and may be overwritten, and is written in the area. I do. By such control, it is not necessary to perform control (for example, application of high voltage) for erasing data to the elements in the recording areas (222B, 224B) at the time of formatting, and it is possible to extend the life of the elements and to perform the formatting process. It can contribute to speeding up.

The imaging device 100 configured as described above is installed so as to photograph the machine tool 2 as shown in FIG. The imaging device 100 is attached to a tripod via a platform using a screw hole provided in the lower part of the housing 105. The angle of view of the lens unit 122 included in the imaging apparatus 100 is adjusted so that a captured image can be recorded by including a range in which the cause of occurrence of an event can be pursued in the imaging field of view. When adjusting the imaging range, the image signal output terminal 180 of the imaging device 100 and the monitor 3 are connected to display the captured image captured by the imaging device 100 on the screen of the monitor 3 as it is (so-called through image display). ), make adjustments while checking the range displayed on the screen.

A cable for transmitting an alert signal from the machine tool 2 is connected to the event input terminal 130 of the imaging device 100. With such a connection, the imaging apparatus 100 can receive the alert signal, which is the information indicating the occurrence of the event.

Hereinafter, a specific operation when executing the monitoring function of the imaging device 100 will be described. It should be noted that, in the following description, the operation of each component is based on the control of the controller 110, unless otherwise specified.

6A and 6B are diagrams showing the relationship between the occurrence of an event and the recording of a captured image. The image capturing unit 120 of the image capturing apparatus 100 always captures a moving image regardless of the occurrence of an event. The controller 110 controls to record the captured images from the start of recording to the latest in the constant recording area 222 of the memory card 200 inserted in the memory card slot 160.

As described above, when a failure occurs in the work performed by the machine tool 2 in the state where the moving image is constantly captured, the machine tool 2 detects this failure and periodically outputs high and low as an alert signal. Output a repeating waveform. Then, this alert signal is input to the stacked signal light 21 as a control signal for turning on/off the red light of the stacked signal light 21, and the red light blinks in response to the alert signal. Further, the alert signal is branched and also input to the event input terminal 130 of the imaging device 100. When the alert signal, which has continued to be in the low state, first changes to high, the control controller 110 detects the time at which the event occurs (that is, the alert signal first changes from low to high). Control is performed to store the captured image captured by the image capturing unit 120 in the event recording area 224 of the memory card 200 during a recording period from a predetermined time before the predetermined time) to a predetermined time after the event occurrence time. At this time, for the captured image corresponding to the time when the event occurred, a trigger flag indicating that the event occurred at the captured time of the captured image is recorded as additional information.

By the control as described above, an event such as a work failure goes through a process of causing an event of failure, occurrence of failure, detection of failure, and transmission of information indicating event occurrence (for example, change of alert signal). Since this occurs, it is necessary to check the image before the occurrence of the event in order to investigate the cause of the failure. According to the present embodiment, the image before the occurrence of the event can be confirmed.

The above “predetermined time” may be, for example, one working cycle of the machine tool 2 (for example, 30 seconds). In this way, it is possible to store a captured image including the start to end of the cycle in which the event has occurred, regardless of the event occurrence timing within one cycle of the work cycle. Since the captured images taken from the start to the end of the cycle including the time when the event occurs can be stored without omission, it is possible to easily confirm the cause of the work failure and the subsequent processing. That is, the cause of the failure can be grasped by checking the image before the event occurrence in the cycle in which the event occurs. Further, by confirming the image after the event has occurred in the cycle in which the event has occurred, it is possible to confirm whether the process after the event has been properly performed.

The control controller 110 controls the recording of the captured image in the constant recording area 222 in parallel with the control of recording the captured image in the recording period in the event recording area 224. Also for the captured image recorded in the constant recording area 222, the trigger flag is recorded as additional information in the captured image corresponding to the time when the event occurs.

In addition, after the end of the recording period, the control controller 110 keeps a new period for a predetermined non-reaction period (for example, 30 seconds) after the alert signal, which periodically repeats high and low, changes to low last. Even if the alert signal changes to high, it does not react to the change to high and is controlled not to be treated as the occurrence of an event. For example, when the alert signal continues to change even after the recording period ends, as shown in FIG. 6A, from the end of the recording period until the alert signal finally goes low until a predetermined period elapses. Is the non-reaction period. Further, when the change of the alert signal is interrupted during the recording period as shown in FIG. 6B, the non-reaction period starts when the alert signal finally becomes low, and when a predetermined period elapses after the start. Ends with. The non-reaction period may be a period sufficient to confirm that the change in the alert signal has stopped. In the above example, multiple rising edges of the alert signal are generated consecutively for an event that should be understood as one event (for example, work failure), but the moment when the event occurs is the first Is the rising edge of. In such a case, by providing the above-mentioned "non-reaction period", it is possible to prevent duplicate recording of the same event. As described above, in the first embodiment, control is performed such that the next trigger is not detected unless the pulse detection time elapses more than the predetermined time period during or after the event recording. Such an operation is called a pulse cancel trigger.

A captured image recorded by the image capturing apparatus 100 triggered by the occurrence of an event is reproduced by a dedicated browser that is display browsing software that operates on a personal computer. This dedicated browser is capable of reading the captured image recording area 220, and various information (for example, a trigger flag indicating that an event has occurred, captured time, etc.) recorded as additional information together with the captured image is displayed in the image being reproduced. Display in association with each other. Further, the dedicated browser has a function of searching for a file to be reproduced by using these additional information as keys. With such a dedicated browser, it becomes easy to investigate the cause of the event and confirm the post-processing.

In addition, the dedicated browser displays guidance regarding the life of the memory card 200 based on the overwrite upper limit value recorded in the management area (222A, 224A) and the overwrite count value recorded as additional information of the captured image. Specifically, when the overwrite count value has reached 80% of the overwrite upper limit value, guidance is displayed that the replacement time of the memory card 200 is approaching. When the memory card 200 uses an element such as a so-called NAND flash memory that has a property of causing a failure as the number of times of rewriting increases, the above-mentioned guide can notify when replacement is necessary, It is possible to prevent a situation in which a captured image cannot be recorded/played back due to a malfunction of the memory card 200.

When the manufacturing line has just been constructed, for example, for a period of about 3 to 4 months, the machine tool frequently causes troubles, so it is necessary to monitor the machine tool and perform improvement activities to eliminate the cause of the trouble. On the other hand, after the frequency of troubles decreases and the production line operates stably, it may not be necessary to perform monitoring. On the contrary, in a production line that has been operating stably, if the frequency of troubles increases, it may be necessary to monitor the existing equipment after the fact. Therefore, it is desirable that the image pickup apparatus 100 can be easily installed and removed. The image pickup apparatus 100 of the present embodiment described above can be easily installed and removed without providing a special configuration for outputting a trigger signal on the device side such as the machine tool 2 to be imaged. It is possible.

In the first embodiment, the recording period is from a predetermined time before the event occurrence time to a predetermined time after the event occurrence time, and a predetermined period after the alert signal last changed to low is a non-reaction period. However, the captured image in the recording period is recorded in the event recording area 224. Regarding the control at the time of event occurrence, depending on the device to be imaged, information indicating the occurrence of a given event, the characteristics of the focused event, etc. Therefore, various modifications are possible. Below, 2nd Embodiment-6th Embodiment are demonstrated as the modification. The configuration of the image pickup apparatus according to the second embodiment to the sixth embodiment is the same as that of the image pickup apparatus 100 according to the first embodiment with respect to the portions that are not described, and thus redundant description will be omitted. The points different from the embodiment will be mainly described.

[Second Embodiment]
The second embodiment is an operation called a so-called single trigger. With a single trigger, control is performed so that the next trigger is not detected for a predetermined time after the trigger is detected. As shown in FIG. 7, as information indicating the occurrence of an event, a device or the like that is an imaging target outputs a pulse of an alert signal at the timing of event occurrence. This alert signal is input to the event input terminal 130 of the imaging device 100. When the alert signal, which has continued to be in the low state, changes to high, the control controller 110 sets the time when the event occurs (that is, the time when the alert signal changes from low to high). Control is performed to store the captured image captured by the image capturing unit 120 in the event recording area 224 of the memory card 200 during a recording period from a predetermined time before to a predetermined time after the event occurrence time.

When the device to be imaged outputs a plurality of pulses for one event, the control controller 110 newly adds a pulse for a predetermined non-reaction period (for example, 30 seconds) from the time when the event occurs. Even if the alert signal changes to high, it does not react to the change to high and is controlled not to be treated as the occurrence of an event. By thus providing the "non-reaction period", it is possible to prevent the same event from being recorded in duplicate.

When the device to be imaged does not output a plurality of pulses for one event, the non-reaction period may not be provided. It is also possible to store the imaging data of the recording period corresponding to each event in the recording area, assuming that the event has occurred by the number of pulses of the alert signal.

[Third Embodiment]
The third embodiment is a so-called multi-trigger operation. With the multi-trigger, when the next trigger is detected during event recording, control is performed to extend the event recording time. As shown in FIGS. 8A and 8B, as the information indicating the occurrence of an event, a device or the like which is an imaging target outputs a single pulse of an alert signal at the timing of event occurrence. This alert signal is input to the event input terminal 130 of the imaging device 100. When the alert signal, which has continued to be in the low state, changes to high, the control controller 110 sets the time when the event occurs (that is, the time when the alert signal changes from low to high). Control is performed to store the captured image captured by the image capturing unit 120 in the event recording area 224 of the memory card 200 during a recording period from a predetermined time before to a predetermined time after the event occurrence time.

The above control is the same as that of the second embodiment, but as shown in FIG. 8B, when a single pulse of the alert signal is further input to the event input terminal 130 during the recording period, the control controller 110. Extends the end of the recording period to a predetermined time after the time when a new event occurs.

It is possible to combine a plurality of events that have occurred in a short period of time into one event record, to prevent a plurality of event records with overlapping recording periods from being performed, and to save the storage capacity. If the device to be imaged continues to generate alert signal pulses while the anomaly continues and stops when the anomaly is resolved, an error will occur. A series of captured images from the time until the abnormality is resolved can be recorded as one event. As a specific example, when taking an image to confirm whether a series of corresponding procedures from the start of blinking the signal light with the occurrence of an abnormality to the operation by the administrator to stop the blinking of the signal light is appropriate, A series of captured images can be recorded as one event by detecting the drive signal to be blinked as a signal indicating the occurrence of an event and extending the recording period while the drive signal repeatedly turns on and off.

[Fourth Embodiment]
FIG. 9 shows a case where when the next trigger is recognized immediately after the end of the recording period associated with the pulse P1 of the first alert signal, the event recording is performed in the normal recording period based on the timing of recognizing the trigger. Shows the operation of. As shown in this example, the shorter the time from the end of the previous recording period to the recognition of the next trigger, the longer the overlapping period of the two event recordings, and the more redundant the recording becomes. On the other hand, in the fourth embodiment, when the next trigger is recognized immediately after the end of the recording period, control for shifting the timing of event occurrence is performed. FIG. 10 shows the operation. As information indicating the occurrence of an event, a device or the like that is an imaging target outputs a single pulse P1 of an alert signal at the timing of event occurrence. This alert signal is input to the event input terminal 130 of the imaging device 100. When the alert signal, which has continued to be in the low state, changes to high, the control controller 110 sets the time when the event occurs (that is, the time when the alert signal changes from low to high). Control is performed to store the captured image captured by the image capturing unit 120 in the event recording area 224 of the memory card 200 during a recording period from a predetermined time before to a predetermined time after the event occurrence time. The above control is the same as in the second embodiment.

Then, a predetermined time immediately after the recording period accompanying the pulse P1 is set as a monitoring period, and the controller 110 further outputs a single pulse P2 of the alert signal to the event input terminal as information indicating the occurrence of a new event within the monitoring period. When input, the end of the monitoring period is treated as the occurrence of a new event, not the time when the pulse P2 is actually detected, and the imaging data of the recording period corresponding to the new event is stored in the recording area. .. That is, the trigger flag TF is added as additional information to the frame recorded at the end of the monitoring period, and the recording period accompanying the pulse P2 is from a predetermined time before the monitoring period ends to a predetermined time after.

The monitoring period may be shorter than the time before the event occurrence time in the recording period. By doing so, the recording period based on the end of the monitoring period overlaps with the immediately preceding recording period, and it is possible to make it easier to understand the phenomenon imaged in the two recording periods. The individual event records recorded with the occurrence of events are basically not continuous in time, but there is a slight overlap with the previous recording period, so each file was viewed with a dedicated browser etc. Sometimes it becomes easier to understand what is happening. On the other hand, if the files do not overlap slightly, it is difficult to see when viewing the image. On the other hand, it is advisable to reduce the overlapping period so as not to cause difficulty in understanding and increase the time for recording as an event. The overlap between the recording periods before and after may be such that the connection of images can be recognized, for example, about 2 seconds.

When the above-described recording is performed, it is preferable that a dedicated browser or the like be provided with a function of continuously reproducing a plurality of such recorded recordings temporally. The dedicated browser may refer to the imaging time CT recorded as the additional information of each frame in the recording area 224B of the memory card to reproduce a plurality of recordings temporally continuously. Further, when such recording is performed, it is preferable to have a function of displaying a relationship between a plurality of recordings having such recording on a dedicated browser or the like. In order to display such a relationship between a plurality of records on a dedicated browser, the imaging apparatus 100 records additional information indicating the event relevance with respect to a frame recorded during a recording period of a related event. Good to do. The additional information indicating the relevance of events may be a common symbol between related events such as “A” and “B”. Also, in the dedicated browser, for example, thumbnails of each record may be displayed with a symbol indicating a relationship such as "A-1" or "A-2", or each related record may be displayed. The records may be displayed side by side in a predetermined direction such as a horizontal direction, and records that are not related may be displayed in another column. Further, the thumbnails displayed side by side may be displayed in such a manner that the thumbnails are surrounded by a predetermined frame such as colored one. By displaying in this way, it is possible to make it easier to understand the event captured in the two recording periods as one event.

As described above, in the present embodiment, for the trigger immediately after the event recording, the trigger portion is shifted for a short time. For example, when recording 10 seconds before, 10 seconds before, and 10 seconds after the trigger recognition, the trigger is recognized for 5 seconds after the end of 10 seconds, but the recording is 10 seconds after the trigger in the previous recording period. After 5 seconds have elapsed, 10 seconds before and 10 seconds after are recorded as the next event record.

[Fifth Embodiment]
The fifth embodiment is similar to the fourth embodiment, but when the next trigger is recognized immediately after the end of the recording period, the timing of event occurrence is the timing at which the trigger is actually recognized, but before and after the event occurrence. The recording period of is controlled to be different from that during normal trigger recognition. Specifically, as shown in FIG. 11, the trigger at the event occurrence time is not changed, and the recording period before the event is shortened and the recording period after the event is extended.

As in the fourth embodiment, a predetermined time immediately after the recording period associated with the pulse P1 is set as the monitoring period, and the controller 110 further sets the single pulse P2 of the alert signal as information indicating the occurrence of a new event within the monitoring period. Is input to the event input terminal, the trigger flag TF is recorded for the frame recorded at that timing. Further, the recording period before the trigger recognition time is shortened so that the recording period associated with the pulse P2 and the recording period associated with the pulse P1 overlap with each other for a predetermined time (for example, 2 seconds). In addition, the recording period after the trigger recognition time is extended by a time corresponding to this shortened time. The trigger flag TF is added as additional information to the frame recorded at the end of the monitoring period, and the recording period associated with the pulse P2 is from a predetermined time before the end of the monitoring period to a predetermined time after. The overlap between the recording periods before and after may be such that the connection of images can be recognized, for example, about 2 seconds. The recording period after the trigger recognition may not be extended.

In addition, when recording is performed as described above, it is possible to provide a function to reproduce a plurality of recordings temporally continuously in a dedicated browser or the like by the same method as described in the fourth embodiment. Good. Further, it is preferable to have a function of displaying the relationship between a plurality of records on a dedicated browser or the like.

The control at the time of event occurrence in the first to fifth embodiments described above may be set to be selectively executable by one imaging device 100 by setting. For example, it is preferable that a setting related to control at the time of event occurrence is recorded in the management area 222A of the memory card 200 using a dedicated browser or the like, and the imaging device controls the event occurrence corresponding to the setting.

[Sixth Embodiment]
The imaging device 100 according to the sixth embodiment identifies the type of event and performs different control depending on the type of event. The device or the like that is the imaging target outputs an alert signal having a different pattern depending on the type of event as information indicating the occurrence of the event at the timing when the event occurs. The imaging apparatus 100 stores the pattern of the alert signal in the storage unit 140 in advance, and stores the event setting information that defines the control when the event occurs in the storage unit 140 in association with the pattern. The operation at the time of event occurrence may be the control or the combination thereof in the first to fifth embodiments described above, and the recording period, the non-reaction period, the length of the monitoring period, the start period, the end period, and the like in each embodiment. Can be set arbitrarily.

In the imaging apparatus 100 in which the operation at the time of event occurrence is defined, when the alert signal of the pattern in the event input terminal 130 is input, the controller 110 stores the input alert signal pattern in the storage unit 140. Inquiry is performed, and according to the event setting information corresponding to the pattern, control is performed to record the captured image in the recording period including the time before and after the event occurs in the event recording area 224 of the memory card 200.

The control of the event recording performed by the imaging device 100 when an event occurs may vary depending on the characteristics of the event, the content of interest, the mode of information indicating the occurrence of the event emitted by the device, and the like. Event recording can be performed by control defined in advance according to the type of event.

The imaging device 100 may record information indicating the type of event together with the captured image during the recording period. The information indicating the type of event may be recorded as additional information of a captured image corresponding to the event occurrence, for example. Even when different control is not performed depending on the type of event as in the first to fifth embodiments, it is preferable to identify the event that has occurred and record the information indicating the type of event together with the captured image.

According to the imaging device 100 described above, it is possible to eliminate the need to manually input information indicating the type of event. Therefore, when an image stored by a device located in a factory at a remote place is sent to an administrative department or the like at a time and the contents of the image are confirmed by the administrative department, the imaging device 100 captures the image. On the side of transmitting the obtained file, the file in which the information indicating the type of event is automatically recorded can be transmitted as it is. Also, on the side that confirms the transmitted image, the information indicating the type of event can be reliably recorded and the file can be handled. Therefore, the labor can be reduced on both the transmitting side and the receiving side.

When the corresponding pattern is not stored in the storage unit 140, it is preferable to perform a predetermined control (for example, the control of the first embodiment) that is set in advance.

When the above-described recording is performed, it is preferable to display information indicating the type of event corresponding to the captured image being displayed on a dedicated browser or the like that displays/views the captured image. By displaying in this way, it is possible to make it easier to understand the phenomenon that appears in the video.
[Modification of Embodiment]

The present invention is not limited to the above embodiments, and combinations, modifications, improvements, etc. are included in the present invention. For example, the lengths of the recording period, the non-reaction period, and the monitoring period described in each of the above embodiments are arbitrary, and may be freely set by the user.

In each of the above-described embodiments, the imaging target may be any device that performs control for notifying a human of the occurrence of an event such as some kind of abnormality. The most excellent effect is obtained when the image is taken by 100. It should be noted that, for example, at a site such as a factory, a distribution warehouse, or an automated warehouse, a machine tool, an automatic carrier, or another machine that performs some automatic processing may be an imaging target. In particular, the imaging apparatus described in each of the embodiments causes various problems when constructing and starting up such a mechanism of automatic processing, and performs improvement activities to solve them. It is suitable as a system for recording video until the cause of the problem is resolved in order to find its cause.

Further, a device such as an automatic teller machine (so-called ATM) or a self-checkout, which is supposed to be used by a general user even if it is not automated, may be the imaging target. For example, when a user makes a mistake in the usage method, or when an unauthorized use is made, an alarm or the like is used as information indicating the occurrence of an event to check the usage status at the time of error, record the status of fraud, etc. It can be utilized and is suitable. However, rather than an automatic teller machine (so-called ATM) that is mass-produced and operates independently, multiple cashier machines and a management system, such as a self-checkout machine, are linked to each other depending on customers or places such as stores. Excellent effect for different specifications.

In particular, when a certain abnormality occurs, a system having a function of notifying a person such as a manager or a monitor of the device by a lamp or an alarm sound that the abnormality has occurred is particularly effective. In the first embodiment, a function of outputting a new event signal by branching and utilizing a connection line to a device for notifying such an abnormality of a person to a person by a branch wiring such as an electrotap. It is possible to record an image including an abnormal state of the device without adding the device to the device. It should be noted that the image pickup apparatus 100 may recognize the occurrence of the event by using an optical signal or the like used by the device for the function of notifying the occurrence of an abnormality, or information that a human can visually or visually recognize. In particular, it is preferable that the device determines the occurrence of an event from a signal line to a device for notifying a person.

In each of the above-mentioned embodiments, any information may be configured to be received as information indicating the occurrence of an event. However, a signal to the laminated signal light 21 connected to the machine tool 2 is branched as the information indicating the occurrence of the event. It is particularly preferable to configure to receive. Note that other information may be information indicating the occurrence of an event. For example, when the device to be imaged has a function of outputting an external output signal for notifying the occurrence of an event such as an abnormality to the outside, this external output signal may be used as information indicating the occurrence of the event. When the branched signal or the external output signal is used as the information indicating the occurrence of the event, the signal is received by the physically connected wiring or the like, so that the imaging apparatus 100 can reliably detect the information indicating the occurrence of the event. it can. This is particularly preferable when the image pickup apparatus 100 is permanently installed and there is little labor for installation and removal.

When a branched signal or an external output signal is used as information indicating the occurrence of an event, the signal may be ON or OFF in addition to a continuous pulse as in the first embodiment or a single pulse as in the second embodiment. A status signal (for example, a binary value of high and low) indicating the state of, a pulse train repeated in a predetermined pattern, an analog signal such as a voice signal, or the like may be used.

In the case of performing control such that a non-responsive period is provided as in the second embodiment, when a pulse train repeated in a predetermined pattern is detected as an alert signal indicating the occurrence of an event, the non-responsive period is the longest in the pulse train pattern. It is better to provide longer than the low time. By doing so, it is possible to prevent the occurrence of a new event from being recognized while the alert signal continues.

When receiving a pulse train that repeats in a predetermined pattern as an alert signal indicating the occurrence of an event, the predetermined pattern is stored in advance, and a pulse train having a pattern that matches the stored pattern is input. When it occurs, it may be detected as the occurrence of an event. In this case, the pattern to be stored in advance may be manually input by the user, but it is particularly preferable to provide a learning mode in which the pattern of the alert signal actually input to the event input terminal 130 is learned and stored. Good. By providing such a learning mode, the work of registering the pattern in the imaging device 100 becomes easy, and the installation of the imaging device 100 becomes easy.

The image capturing apparatus 100 may be installed so that a plurality of devices are within the field of view captured by the image capturing unit 120, and the event input terminal 130 may receive the logical sum of alert signals from the plurality of devices. By doing so, it becomes possible to image the state at the time of an event occurrence in a plurality of devices by using one imaging device 100.

Further, the image pickup device 100 may be provided with a light receiving element for detecting the light emission of the signal light, and the light emission of the signal light may be detected as the information indicating the occurrence of the event. The imaging device 100 may be installed so that the signal light is within the field of view of the imaging unit 120, and the light emission of the signal light may be detected by the imaging unit 120 as information indicating the occurrence of an event. In this case, the controller 110 may analyze the captured image as needed to detect the light emission of the signal lamp. As described above, in the configuration in which the visual information is detected as the information indicating the occurrence of the event, a troublesome work such as branching a signal when installing the imaging device is unnecessary, the installation is easy, and the removal is also easy. .. When the information indicating the occurrence of the event is detected in the captured image, no special configuration such as a sensor is required on the imaging device side, and therefore the installation is easy. Therefore, it is particularly preferable when the image pickup apparatus 100 is temporarily installed, for example, in a period until the trouble on the newly started up production line is resolved.

Further, when an image of a device that emits an alarm sound such as a siren or a buzzer sound is captured when an abnormality occurs, a microphone that detects the alarm sound is provided in the image capturing apparatus 100, and the alarm sound of the rotating lamp is detected as information indicating the occurrence of the event. You may do so. As described above, in the configuration in which the audio information is detected as the information indicating the occurrence of the event, a troublesome work such as branching a signal when installing the imaging device is not necessary, the installation is easy, and the removal is also easy. .. Therefore, it is particularly preferable when the image pickup apparatus 100 is temporarily installed, for example, in a period until the trouble on the newly started up production line is resolved.

Further, in the configuration in which different control is performed depending on the type of event that has occurred, as in the sixth embodiment, the method of identifying an event is not limited to the method described in the sixth embodiment. For example, when the device to be imaged has a function of outputting information indicating the type of event such as an error code indicating the type of abnormality to the outside, the image pickup apparatus 100 inputs the information indicating the type of event. It may be configured to include an event identification information input terminal for. Then, the event that occurred may be identified based on the information input to the event identification information input terminal.

As another example, when the device to be imaged outputs a plurality of types of external output signals in the imaging device 100, the imaging device may identify the type of event according to the received external signal. Specifically, the type of event may be identified according to the signal that controls each color (red, yellow, blue) of the stacked signal light. By doing this, for example, when a signal for turning on the red signal light is generated, it is determined that a serious abnormality has occurred, the recording period is set so that the period before lighting is relatively long, and the signal for turning on the yellow signal light is set. When occurs, it is advisable to set the recording period so that the period after lighting is relatively long, since there is a possibility that an abnormality will occur subsequently.

In a configuration in which visual information such as the lighting of a signal lamp is detected as information indicating the occurrence of an event, the type of event may be identified by color, position, temporal light emission pattern, or the like.

In the sixth embodiment, the information indicating the event type may be recorded in any form, but it is particularly preferable to record the information indicating the event type as additional information of the captured image. The method of recording the information indicating the type of event is not limited to this. For example, information indicating the type of event may be used as part of the file name. Since the file name includes the information indicating the type of event, it is possible to easily understand the content of the captured image stored in the file without reading the file into the dedicated browser. Also, an error code is embedded in the header of the frame when an event occurs in the moving image to be recorded. By searching for the frame in which the error code is embedded during playback, you can quickly check the image at the moment when the event occurred. For example, information indicating the type of event may be embedded in the image as a watermark. By doing so, it is possible to embed the information indicating the type of event without increasing the size of the file and without visually affecting the image. Further, it is possible to make it difficult to tamper with the information indicating the type of event. As another example, information indicating the type of event may be embedded as characters superimposed on the image.

In each of the above embodiments, the image capturing unit 120 captures a moving image as an image, but it may capture a still image, for example. The image may be, for example, a 2D image or a 3D image. Further, it may be a monochrome image or a color image. The lens unit included in the imaging unit 120 may be a short focus lens instead of the zoom lens.

In the above embodiments, any storage medium may be used, but it is particularly preferable to use the memory card 200 inserted into the memory card slot 160. Further, instead of the memory card, another storage device such as a hard disk drive may be used. Further, the storage medium is not limited to being removable, and may be built in the housing 105 in a non-removable manner. Further, the captured image may be stored in a storage area provided on the communication network as a storage medium. However, the best configuration is that the image is stored in a storage medium such as the memory card 200 that is detachably provided in the image pickup apparatus 100. Especially when the production line is just built in the factory, it can be easily installed without constructing a large-scale system in the case of temporary installation such as when monitoring troubles for a period of 3 to 4 months. Can be recorded at. Further, when checking the recorded picked-up image, it is possible to remove the memory card or the like from the image pick-up device and play it back by a personal computer or the like, so that it is possible to save the trouble of re-installing each time the checking is performed. Further, not only in the case of temporary installation, but also in the case where events do not occur very often, it is possible to easily photograph the situation at the time of abnormality of the machine tool without performing large-scale system construction.

In the above-described embodiment, the recording destination for temporarily recording the captured image is arbitrary. For example, the captured image is temporarily recorded in a storage element such as an SDRAM included in the image capturing apparatus 100, and when the event occurs, the storage is performed. The captured image temporarily recorded in the element may be finally recorded in the event recording area 224 of the memory card 200. However, as in the above-described embodiment, the captured image constantly captured by the image capturing unit 120 is recorded in the constant recording area 222 of the memory card 200, and the captured image captured when an event occurs is recorded in the event recording area 224 of the memory card 200. It is especially good to record in.

Also, the captured image after a predetermined time has elapsed from the time of shooting is always stored in the recording area 222 while the storage size is reduced by a low frame rate (for example, one frame per second), low resolution, and monochromeization. You can By doing so, it is possible to save the storage capacity per unit time required for constant recording in which no event has occurred.

In the above embodiment, whether or not to always record is arbitrary, but when the captured image of the recording period accompanying the occurrence of an event is recorded in the event recording area and the always captured image is recorded in the constant recording area. Especially good. In addition, the captured image recorded when an event occurs has a higher frame rate, a lower compression rate (or no compression) of the image file, and a higher image quality (for example, HD (High Definition) than the captured image which is always recorded. ) Image), color image, etc., so that an image with a large amount of information may be recorded. On the contrary, the imaged image that is always recorded is a monochrome image that reduces the frame rate, increases the compression rate of the image file, lowers the image quality of the image file (for example, VGA image), as compared with the imaged image that is recorded when an event occurs. , Etc. may reduce the amount of information.

In the above-described first embodiment, an example in which a dedicated browser executed on a personal computer separate from the image pickup apparatus 100 is used as the display/browsing means has been described. It is also possible to integrally provide a reproducing means for reproducing and displaying the.

In the first embodiment, the method of fixing the imaging device 100 may be any method, but it is particularly preferable to use a simple method. In particular, it is preferable to fix with a fixing means such as a clip, a clamp, a velcro, an adhesive mat, etc., which can be easily attached/removed. When the image pickup apparatus 100 is temporarily installed, such as during the period until the trouble in a newly started production line or the like is converged, it is particularly preferable to fix the image pickup apparatus 100 by such fixing means that can be easily attached/removed. Further, the attachment destination by the fixing means may be an existing structure such as a protective frame or a column provided around the device to be imaged. By doing so, the image pickup device can be easily temporarily installed and can be easily removed.

In the first embodiment, the example in which the format count master value indicating the number of times the memory card has been formatted is recorded in the management area of the memory card has been described. However, a memory that can identify an individual by unique identification information or the like. If it is a card, the format count master value is recorded in the personal computer that executes the program of the dedicated browser that formats the memory card, and the format count master value stored in the personal computer is saved each time the memory card is formatted. The number may be increased by one.

In the first embodiment described above, the method of updating the overwrite count master value recorded in the management area of the memory card is arbitrary, but it is particularly preferable to update it by a dedicated browser. The image capturing apparatus 100 may update the overwrite count master value. By doing so, the latest overwrite count master value can be recorded in the management area without using a dedicated browser.

In the first embodiment, the method of notifying the guide regarding the life of the memory card is arbitrary, but the guide regarding the life of the memory card is sent to the dedicated browser by using the overwrite count value and the upper limit upper limit recorded in the memory card. It is especially good to display. Further, such guidance regarding the life may be notified by the imaging device. For example, when the image pickup device has a liquid crystal screen, it is preferable to display guidance regarding the life on the liquid crystal screen. Further, when the image pickup apparatus includes a monitor lamp indicating the operating state, it is preferable to notify the guidance regarding the life by lighting or blinking the monitor lamp. Further, when the image pickup apparatus includes a sound source such as a buzzer, it is preferable to emit a sound from the sound source to notify the information about the life.

The imaging device may give any timing for notifying the guidance regarding the life. For example, the power may be turned on, or the information may be constantly monitored and notified. However, when the frequency of overwriting is not high, the overwriting count value and the overwriting count value are periodically (for example, once a week). It is particularly preferable to compare the upper limit value and notify when the condition is satisfied. Further, when the imaging device recognizes that the condition for notifying the guidance regarding the life is satisfied, it treats that the condition for notifying the guidance regarding the life is satisfied as the occurrence of an event, and the captured image is stored in the event recording area. It may be recorded, and information indicating the type of event indicating that the condition for notifying the guidance regarding the life is satisfied may also be recorded. In this way, the captured image resulting from the event that occurred in the device to be captured will be mixed with the captured image resulting from satisfying the condition to notify the guidance regarding the lifetime. It becomes easier for administrators and others to notice that is approaching.

In the first embodiment, the overwrite count value may be any condition for guiding the life, but it is particularly preferable to display the life guidance when the overwrite count value reaches 80% of the overwrite upper limit value. Further, for example, the index indicating the degree of wear may be calculated using the overwrite count value and the format count value, and this may be guided regarding the life according to the overwrite upper limit value and the comparison result. For example, if the storage area of the memory card is stressed by formatting and deterioration is accelerated compared to normal overwriting, weighting is performed so that the format count value is more important than the overwrite count value. It is preferable to calculate an index indicating.

In the first embodiment, the method of specifying the overwrite upper limit value indicating the guideline of the life of the memory card is arbitrary, but the user specifies the overwrite upper limit value of the memory card to be used, and the management area (222A, 224A) It is especially good if it is stored in. When the recording medium is used in advance as holding information regarding the life, this information may be used to provide guidance regarding the life.

The recording method for the memory card described in connection with the first embodiment can also be applied to a drive recorder for a vehicle. In this case, it is advisable to record the image in front of the vehicle at all times and record the event triggered by a shock or acceleration corresponding to the occurrence of an accident.

1 Imaging System 2 Machine Tool 3 Monitor 100 Imaging Device 105 Housing 110 Control Controller 120 Imaging Unit 130 Event Input Terminal 160 Memory Card Slot 200 Memory Card

Claims (5)

When the occurrence of an event is detected, a control means for storing a captured image of an object related to the event in a storage medium during a period including a time when the event occurs,
And a control unit for sequentially recording the captured images of the target at consecutive addresses in a recording area of the storage medium and updating an overwrite count value indicating the number of times data is overwritten at the addresses at which the captured images are recorded. apparatus. The control means is
The next captured image is recorded by overwriting on a captured image whose overwrite count value is different from the overwrite count value recorded for the immediately previous captured image in the storage area of the storage medium. apparatus. The control means is
In a management area different from the storage area for storing the captured image in the storage medium, hold as a format count master value indicating the number of times the storage medium has been initialized,
For each address, transfer the format count master value as the format count value,
3. The device according to claim 1, wherein data at an address in which a format count value different from the current format count master value is recorded is treated as erased. The dedicated browser is
A function of notifying a guide regarding the life of the storage medium based on the overwrite count value recorded in the recording medium in which the captured image and the overwrite count value are recorded by the device according to any one of claims 1 to 3. A device having. A program for causing a computer to function as the device according to claim 1.