JP2019041322A - Imaging apparatus - Google Patents

Abstract

To provide an imaging apparatus capable of easily setting a mode of superimposing a display plate image to be combined with a captured image on the captured image.SOLUTION: An imaging apparatus 1 includes an imaging unit 20 that acquires a captured image, a display image processing unit 115 that generates a display image based on the captured image and causes a display unit to display a display image, an instruction means detection unit 111 that detects a specific instruction means from the captured image, an overlap scheduled area setting unit 112 that sets an overlap scheduled area on a captured image for generating a composite image in which a display plate image on which the content of shooting is described is superimposed on the captured image. The overlap scheduled area setting unit changes the overlap scheduled area according to the specific instruction means detected by the instruction means detection unit.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an imaging apparatus that synthesizes and records information related to captured content with a captured image.

  In business field photography, from the viewpoint of recording the contents of photography, information relating to a photographed subject is combined with a photographed image and recorded. The photographing content is, for example, construction summary information at a construction site, information on an accident situation at an accident site, or a comment on photographing. Below, an example of a construction site will be described as a representative.

  Recently, with the widespread use of digital cameras, it has become possible to easily capture and manage thousands of images. Photographing the construction status at a construction site is frequently used as evidence that construction is being performed correctly. It's being used. At present, in the construction management such as process management, finished shape management, and quality management, evidence maintenance and management by image photographing is one of important processes.

  On the other hand, from the time when photography was performed with a silver salt camera, for construction management, a display board (also called a small blackboard) describing the situation on the site was placed on the construction site and photographed. This is because the contents described on the display board can surely grasp the contents of the photograph.

  When shooting such a construction site image with a small blackboard, it is necessary to rewrite the information to be written on the small blackboard every time depending on the shooting location, and this work was a burden on the site workers. Also, it is necessary for another person to hold the blackboard at the time of photographing so that the information written on the small blackboard can be read correctly. Furthermore, there is a possibility that characters on the small blackboard cannot be read due to conditions such as on-site exposure, so it is also necessary to change the installation conditions of the small blackboard and shoot some pictures, which is a burden for the workers on the site. It was expensive work.

  Therefore, in recent years, in accordance with the spread of digital cameras, it has been proposed to shoot construction site images using a so-called electronic small blackboard, in which a small blackboard is replaced with an image image. In shooting construction site images with an electronic small blackboard, if you create an electronic small blackboard image in advance, rewrite the blackboard information as described above, the worker holding the small blackboard, the characters listed on the small blackboard It is no longer necessary to check whether or not the image can be read, and it is possible to significantly reduce the work when photographing the construction site image. As a technique for providing an electronic small blackboard to such a construction site image, for example, the technique of Patent Document 1 has been proposed.

Japanese Patent Laid-Open No. 2006-189199

  Since the shooting position is limited by a scaffold or the like at the shooting site, it is necessary to frequently change the position of the small blackboard according to the site. The same applies even if the small blackboard is replaced with an electronic small blackboard. In the digital camera, the display unit for displaying a photographed image or the like is configured to be small in order to reduce the size of the apparatus with priority on portability. It is not easy to finely adjust the display position and size of a display board image such as an electronic small blackboard while viewing a live view image with a digital camera whose display unit is not sufficiently large. Furthermore, since the operator generally wears gloves or the like at the construction site, it is difficult to adjust the position or the like of the display plate image on the display unit of the digital camera by a touch operation. However, it is not desirable to collectively perform the work of combining the display plate image with the photographed image after the photographing is completed in order to guarantee the reliability and accuracy of the trail image.

  In view of the above circumstances, an object of the present invention is to provide an imaging apparatus that can easily set a superposition mode of a display board image combined with a captured image on a captured image.

  In order to achieve the above object, the imaging apparatus includes an imaging unit that acquires a captured image, a display image processing unit that generates a display image based on the captured image, and displays the display image on the display unit, An instruction means detection unit for detecting a specific instruction means from the photographed image, and a superimposition on the photographed image for generating a composite image in which a display board image describing the contents of photographing is superimposed on the photographed image. A superimposition plan area setting unit that sets a plan area, and the superimposition plan area setting unit changes the superimposition plan area according to the specific instruction means detected by the instruction means detection unit.

  ADVANTAGE OF THE INVENTION According to this invention, the imaging device which can set easily the superimposition aspect to the picked-up image of the display board image synthesize | combined with a picked-up image can be provided.

It is a figure which shows the mode of imaging | photography in the conventional construction site. It is a functional block diagram of the imaging device concerning an embodiment of the invention. It is a hardware block diagram of an imaging device. It is the flowchart 1 explaining the procedure of the process which produces the synthesized image with which the display board image was superimposed on the picked-up image. It is the flowchart 2 explaining the procedure of the process which produces the synthesized image with which the display board image was superimposed on the picked-up image. It is a subroutine explaining the procedure of the process which acquires a display board image from an external apparatus. It is a subroutine explaining the procedure of a superimposition plan area change process. It is an example of a screen until a superimposition plan area is displayed in field shooting mode. It is a figure which shows a mode that the specific operation by an operator is detected. It is a figure which shows a mode that a superimposition plan area | region is changed by specific operation by an operator. It is a figure which shows the example of the synthesized image by which the display board image was synthesize | combined with the picked-up image.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing a state of photographing at a conventional construction site. The worker 500 places a display board 410 called a small blackboard on a part of the construction site 400 and photographs the construction site 400 with the imaging device 1000. On the display board 410, the worker 500 describes the corresponding construction details for each shooting. The construction content includes, for example, a construction name, construction type, construction location, construction date, remarks, and the like. The display board 410 is placed by the operator 500 at a position that does not hide the object to be photographed at the construction site. Alternatively, the display board 410 is supported by an assistant.

  FIG. 2 is a functional block diagram illustrating a configuration example of the imaging apparatus 1 according to the embodiment of the present invention. The imaging apparatus 1 includes a control unit 10, an imaging unit 20, an image processing unit 30, an auxiliary light emitting unit 40, a display unit 50, an operation unit 60, a storage unit 70, and a communication IF 80.

  The control unit 10 comprehensively controls the entire imaging apparatus 1. Details of the control unit 10 will be described later. The imaging unit 20 includes a photographing optical unit 20a and a signal processing unit 20b, and acquires a photographed image.

  The photographing optical unit 20a includes a lens unit (not shown) that forms a subject image and an image sensor (not shown) that photoelectrically converts the formed subject image. The lens unit includes a zoom lens for adjusting the angle of view, a focus lens for adjusting the focal position, an aperture for adjusting the exposure amount and depth of field, a shutter for adjusting the exposure time, and an actuator such as a motor corresponding to each. included.

  The signal processing unit 20b amplifies the photoelectric conversion signal obtained by the image sensor, converts the captured image into a digital signal, and outputs it as image data. The image processing unit 30 performs predetermined image processing such as interpolation processing, γ processing, and WB on the captured image converted into image data.

  The auxiliary light emitting unit 40 is a light emitting mechanism for supplementing luminance when the luminance of the subject or the like is low. The auxiliary light emitting unit 40 includes, for example, a strobe or an LED and is attached to the body top surface of the imaging device 1 or the like.

  The display unit 50 displays a moving image or a still image such as a live view image, a rec view image for shooting confirmation, or a recorded shot image (recorded image). The display unit 50 is configured by an LED or an organic EL (Electroluminescence), and is provided on the back surface of the main body of the imaging device 1.

  The operation unit 60 is an input member that inputs an instruction to the imaging apparatus 1. For example, the operation unit 60 is a cross-shaped operation key, and selection is determined by performing an operation according to a guide displayed on the display unit 50. The operation unit 60 may include a touch panel integrated with the display unit 50. An operation is performed by touching the touch panel.

  The storage unit 70 is a non-volatile memory for storing images. The storage unit 70 is, for example, a flash memory. The storage unit 70 stores display plate image data 70a and a recorded image 70b. The display board image data 70a is image data constituting a display board image. The recorded image 70b is a captured still image or moving image. The recorded image 70b includes a captured image obtained by synthesizing the display board image.

  The communication IF 80 exchanges data with the external device 300. The communication IF 80 transmits and receives data to and from the external device 300 via, for example, a local area network (LAN) or a wide area network (WAN).

  The external device 300 is, for example, a server or a PC (Personal Computer). The external device 300 stores display panel image data 70a. Display board image data 70 a is transmitted from the external device 300 according to an instruction from the imaging apparatus 1, and the display board image data 70 a is received by the communication IF 80 and stored in the storage unit 70.

  The control unit 10 includes an imaging control unit 100, a composite image control unit 110, and a recording control unit 120.

  The imaging control unit 100 controls the imaging unit 20. Specifically, the imaging control unit 100 controls the zoom lens of the imaging optical unit 20a in accordance with the zoom operation by the operation unit 60. In addition, the imaging control unit 100 performs AF (Autofocus) processing and moves the focus lens of the imaging optical unit 20a to the in-focus position. Further, the imaging control unit 100 performs AE (Automatic Exposure) processing to control the aperture, shutter, and the like of the imaging optical unit 20a. Further, the imaging control unit 100 controls the auxiliary light emitting unit 40 according to the result of the AE process.

  The composite image control unit 110 controls processing for combining the display board image with the captured image. The composite image control unit 110 includes an instruction means detection unit 111, a superimposition plan area setting unit 112, a warning unit 113, a composite image generation unit 114, a display image processing unit 115, and a display board image control unit 116.

  The instruction means detection unit 111 detects, as “specific instruction means”, a hand sign (instruction by hand or finger) that is deceived in and around the region to be superimposed on the captured image (live view image). The instruction means detection unit 111 detects a change or mode of the hand sign and notifies the superimposition scheduled region setting unit 112 of the change. The instruction means detection unit 111 detects a subject in the region to be superimposed (referred to as a specific subject), and determines whether the detected specific subject corresponds to a “specific instruction means” registered in advance. Furthermore, the instruction unit detection unit 111 detects the content of a specific change instruction from the specific mode of the “specific instruction unit”.

  The superimposition plan area setting unit 112 sets a superimposition plan area of the display board image on the captured image. That is, the superimposition plan area setting unit 112 changes the superimposition plan area in accordance with the specific instruction unit detected by the instruction unit detection unit 111. Note that the scheduled overlapping area setting unit 112 sets the scheduled overlapping area to the default position and size until the setting is made by the operator 500. The superimposition plan area setting unit 112 notifies the composite image generation unit 114 and the display image processing unit 115 of the set superimposition plan area.

  In addition, the instruction unit detection unit 111 reads the setting state of the imaging unit 20 from the imaging control unit 100, and determines whether the setting of the imaging unit 20 is in a state suitable for detecting a specific instruction unit.

  For example, the instruction unit detection unit 111 determines that the state is not suitable for detecting a specific instruction unit when the angle of view of the photographing optical unit 20a is equal to or less than a certain value. This is because if the zoom position is set to the tele side and the angle of view is narrower than a certain value, the hand sign may be outside the screen.

  In addition, the instruction unit detection unit 111 determines that the state is not suitable for detecting a specific instruction unit when the depth of field of the photographing optical unit 20a is equal to or less than a certain value. For example, when the aperture is set to open and the depth of field is narrower than a certain value, an image of a hand sign at a close distance may become unclear.

  When the instruction unit detection unit 111 determines that the setting of the imaging unit 20 is not appropriate as described above, the instruction unit detection unit 111 notifies the warning unit 113 of the setting. The warning unit 113 issues a warning to the display unit 50 and the like that a specific instruction means cannot be detected.

  The composite image generation unit 114 generates a composite image in which a portion of the planned overlapping region in the captured image is replaced with a display board image. The composite image generation unit 114 reads the display board image data 70a from the storage unit 70 when the imaging operation is performed in a state where the superimposition plan area is displayed on the display unit 50 by the superimposition plan area setting unit 112, and superimposition is performed. A portion of the planned area is replaced with a display board image to generate a composite image.

  The display image processing unit 115 generates a display image based on the captured image, and causes the display unit 50 to display the generated display image. The display image processing unit 115 displays the live view image on the display unit 50 during live view display. The display image processing unit 115 causes the display unit 50 to display the recorded image 70b read from the storage unit 70 when the imaging apparatus 1 is set to the reproduction mode.

  The display board image control unit 116 controls storage and reading of the display board image data 70a in the storage unit 70. The display panel image control unit 116 stores the display panel image data 70 a received from the external device 300 in the storage unit 70. When the operator 500 selects a display board image corresponding to the photographed image, the display board image control unit 116 reads the display board image data 70a, and the read display board image data 70a is read by the display image processing unit 115. It is displayed on the display unit 50. When the composite image is generated, the display board image control unit 116 reads the display board image data 70 a from the storage unit 70, and the read display board image data 70 a is combined with the captured image by the composite image generation unit 114. .

  When there is a shooting execution instruction from the operator 500, the recording control unit 120 compresses the captured image data including the composite image and records it as a recorded image 70 b in the storage unit 70.

  FIG. 3 is a hardware block diagram of the imaging apparatus 1. The imaging device 1 includes an imaging unit 20, a display unit 50, an operation unit 60, a communication IF 80, a CPU 200, an internal memory 210, and an image memory 220. Since the imaging unit 20, the display unit 50, the operation unit 60, and the communication IF 80 have already been described, descriptions thereof are omitted.

  A CPU (Central Processing Unit) 200 reads a control program from the internal memory 210 and comprehensively controls the imaging apparatus 1 according to the read program. The control unit 10 is realized by software processing by the CPU 200. The internal memory 210 includes a RAM (Random Access Memory) 210a and a ROM (Read Only Memory) 210b. The RAM 210a provides a working area for temporarily storing control programs and various data. The ROM 210b is a flash memory, for example, and stores the control program in a nonvolatile manner. In addition, the ROM 210b stores a default value of the superimposition scheduled area.

  The image memory 220 is a flash memory, for example, and stores image data in a nonvolatile manner. The storage unit 70 is realized by the image memory 220.

  FIGS. 4A and 4B are flowcharts 1 and 2 for explaining the procedure of processing for creating a composite image in which a display board image is superimposed on a captured image. The imaging control unit 100 determines whether the operator 500 has instructed the selection of the imaging mode (step S10). When the imaging control unit 100 determines that an instruction to select a shooting mode has been given by the worker 500 (YES in step S10), the imaging control unit 100 selects the shooting mode instructed by the worker 500 (step S12). If the imaging control unit 100 determines that the operator 500 has not instructed the selection of the imaging mode (NO in step S10), the imaging control unit 100 proceeds to step S14.

  The imaging control unit 100 determines whether the shooting mode is the on-site shooting mode (step S14). When the imaging control unit 100 determines that the shooting mode is not the on-site shooting mode (NO in step S14), the imaging control unit 100 executes normal shooting (step S16). When the imaging control unit 100 determines that the shooting mode is the on-site shooting mode (YES in step S14), the composite image control unit 110 determines whether a display board image is acquired (step S18). If it is determined that the display board image has not been acquired (NO in step S18), the composite image control unit 110 acquires the display board image (step S20).

  FIG. 5 is a subroutine for explaining a processing procedure for acquiring a display board image from the external device 300. The composite image control unit 110 performs communication with a predetermined external device 300 that stores the display board image data 70a, and determines whether communication with the external device 300 has been established (step S100). If the composite image control unit 110 determines that communication with the external device 300 cannot be established (NO in step S100), it displays on the display unit 50 that the display board image cannot be acquired as an error occurrence, and the on-site shooting mode. Terminate the process.

  If the composite image control unit 110 determines that communication with the external device 300 has been established (YES in step S100), the composite image control unit 110 determines whether the display device image data 70a exists in the external device 300 (step S102). The composite image control unit 110 inquires of the external device 300 whether the display board image data 70a exists.

  If the composite image control unit 110 determines from the response from the external device 300 that the external device 300 does not have the display board image data 70a (NO in step S102), it indicates that the display board image cannot be acquired as an error. It displays on the display part 50, and the process of field imaging | photography mode is complete | finished.

  When the composite image control unit 110 determines from the response from the external device 300 that the external device 300 has the display plate image data 70a (YES in step S102), the composite image control unit 110 instructs the external device 300 to transmit the display plate image data 70a. To do. The composite image control unit 110 receives the display board image data 70a (step S104), and the display board image control unit 116 records the display board image data 70a in the storage unit 70 (step S106).

  The display board image data 70a may be a display board image in which specific construction contents are written, or may be main body data of a display board image in which specific construction contents are not written. A data format in which specific construction contents are attached as metadata may be used.

  Further, the display board image data 70a is not limited to image data. The external device 300 may separately store text data indicating specific construction details and a display plate image template on which no specific construction details are described. This is because text data can be communicated in a short time because the amount of data is small. If the imaging apparatus 1 has a display board image template, only the text data indicating the specific construction content is received, and the text data is combined with the display board image template inside the imaging apparatus 1. Therefore, communication does not take time.

  Returning to FIG. 4A. The composite image control unit 110 determines whether a display board image is selected by the worker 500 (step S22). The worker 500 needs to select or designate a display board image on which the work content corresponding to the current photographed image is described. When the composite image control unit 110 determines that the operator 500 has not selected a display board image (NO in step S22), the composite image control unit 110 prompts the operator 500 to select a display board image. For example, the composite image control unit 110 causes the display unit 50 to display a list of display board images, and causes the operator 500 to select a display board image of the construction content corresponding to the current shooting content from among them. The display board image control unit 116 creates a list of display board images. The list of display board images displayed on the display unit 50 may be only text information indicating the construction content, and the display board image itself may not be displayed.

  The display board image control part 116 selects the display board image which the operator 500 selected as a display board image synthesize | combined with this picked-up image (step S26).

  If the composite image control unit 110 determines that the operator 500 has selected the display board image (YES in step S22), the composite image control unit 110 determines whether or not the operator 500 has instructed switching of the display board image (step S24). ). If the composite image control unit 110 determines that an instruction to switch the display board image has been given by the operator 500 (YES in step S24), the process proceeds to step S26 described above to select a new display board image. The composite image control unit 110 proceeds to step S28 after step S26 or when it is determined that the operator 500 has not instructed switching of the display plate image (NO in step S24).

  The superimposition plan area setting unit 112 determines whether the superimposition plan area has been set (step S28). For example, if a superimposition plan area has been set in the previous shooting, it is determined that it has been set. When determining that the superimposition plan area has been set (YES in step S28), the superimposition plan area setting unit 112 sets the set superimposition plan area as the current superimposition plan area (step S30). When determining that the superimposition plan area has not been set (NO in step S28), the superimposition plan area setting unit 112 sets a default superimposition plan area (step S32).

  The display image processing unit 115 generates a live view image indicating the set superimposition scheduled region (step S40) and displays it on the display unit 50 (step S42). In the display of the region to be superimposed, only the outer frame may be displayed with a line (or a broken line), or the inner frame region may be represented with a colored translucent region or the like together with the outer frame display. Even other display methods may be used as long as they can be easily distinguished from each other.

  FIG. 7 is an example of a screen until a superimposition plan area is displayed in the field shooting mode. FIG. 7 is a rear view of the main body of the imaging apparatus 1. A cross-shaped operation key included in the operation unit 60 is arranged on the right side of the display unit 50. An auxiliary light emitting unit 40 is provided on the main body of the imaging apparatus 1.

  FIG. 7A is a diagram showing a shooting mode selection screen displayed on the display unit 50. That is, this is a screen when the on-site shooting mode described in step S14 is selected. FIG. 7B is a diagram showing a live view image LV displayed on the display unit 50 when the normal shooting mode is selected. This is a live view image LV displayed in the normal shooting mode in step S16 described above.

  FIG. 7C is a diagram showing a live view image LV when the on-site shooting mode is selected. A mark M1 indicating the on-site shooting mode is displayed on the upper left corner of the screen of the display unit 50, and a superimposition area P is displayed on the lower left corner of the screen so as to be superimposed on the captured image. The superimposition plan area P is displayed with an outer frame of a broken line and a semi-transparent area. FIG. 7C is a live view image LV displayed in the on-site shooting mode in step S42 described above.

  Returning to FIG. 4B. The instruction means detection unit 111 determines whether or not there is a subject in and around the set superimposition plan area (step S44). When the instruction means detection unit 111 determines that there is a subject in the set superimposition plan area (YES in step S44), a process for changing the superimposition plan area is performed (step S46). The superimposition plan area changing process is performed by the instruction means detection unit 111, the superimposition plan area setting unit 112, the warning unit 113, and the like. Hereinafter, the subject in the superimposition plan area is referred to as a specific subject.

  FIG. 6 is a subroutine for explaining the procedure of the process for changing the overlap scheduled area. The instruction means detection unit 111 determines whether the specific subject can be determined (step S200). If the instruction means detection unit 111 determines that the specific subject cannot be determined (NO in step S200), whether the angle of view is greater than a certain value (step S202) or whether the depth of field is greater than a certain value (step S204). ). The instruction means detection unit 111 acquires information on the angle of view and the depth of field from the imaging control unit 100.

  When the instruction means detection unit 111 determines that the angle of view is greater than or equal to a certain value (YES in step S202) and the depth of field is greater than a certain value (YES in step S204), the imaging control unit 100 The imaging optical unit 20a is controlled so as to change the in-focus position to the subject at (step S206).

  When the instruction means detection unit 111 determines that the angle of view is not equal to or greater than a certain value (NO in step S202) or the depth of field is not equal to or greater than a certain value (NO in step S204), the instruction unit detection unit 111 notifies the warning unit 113. The warning unit 113 displays a warning (step S216), and the composite image control unit 110 performs an error end process.

  The instruction means detection unit 111 determines the specific subject when determining that the specific subject can be determined (YES in step S200) and after step S206 (step S208). The instruction means detection unit 111 determines whether the specific subject has been determined (step S210).

  If the instruction means detection unit 111 determines that the specific subject cannot be determined (NO in step S210), the imaging control unit 100 controls the auxiliary light emitting unit 40 to emit auxiliary light (step S212). The instruction means detection unit 111 determines whether or not the specific subject can be determined by the auxiliary light emission (step S214). If the instruction means detection unit 111 determines that the specific subject cannot be determined even by the auxiliary light emission (NO in step S214), the process proceeds to step S216 described above, and the warning unit 113 displays a warning.

  If the instruction means detection unit 111 determines that the specific subject can be determined by the auxiliary light emission (YES in step S214), the process proceeds to step S218. If the instruction means detection unit 111 determines that the specific subject has been determined (YES in step S210), the process proceeds to step S218.

  The instruction means detection unit 111 determines whether the detected specific subject is a specific instruction means (step S218). The specific instruction means is a hand sign as described above. If the instruction means detection unit 111 determines that the detected specific subject is a specific instruction means (YES in step S218), it next determines whether the detected specific subject indicates a specific operation (step S218). S220).

  The specific operation is, for example, an operation for moving without changing the shape of one's hand (slide operation) or an operation for expanding or narrowing the thumb and forefinger of one's hand (pinch operation). The position on the screen of the superimposition plan area is changed by the slide operation. By the pinch operation, the size is changed on the screen of the superimposition plan area.

  The instruction means detection unit 111 triggers the slide operation and the pinch operation when the fingertip is present in a part of the region to be superimposed (for example, near any of the four corners of the region to be superimposed). You may make it detect. Further, the instruction means detection unit 111 may detect, for example, a slow operation when the operation speed of the hand exceeds a certain threshold value.

  If the instruction means detection unit 111 determines that the detected specific subject indicates a specific operation (YES in step S220), the process proceeds to step S222.

  The instruction means detection unit 111 detects the direction and amount of the detected slide operation when the slide operation is detected as the specific operation. Similarly, the instruction means detection unit 111 detects the direction and amount of the detected pinch operation when the pinch operation is detected as the specific operation.

  When the specific operation is a pinch operation, the instructing means detection unit 111 determines whether the size of the superposed overlapping area after the change is within a certain range (predetermined range) based on the detected direction and amount of the pinch operation ( Step S222). When the instruction means detection unit 111 detects an operation for enlarging or reducing the size of the superimposition plan area more than necessary, it determines that the operation is an error and displays an error (step S224). In addition, even in other operations, the instruction means detection unit 111 may display an error as invalid when detecting an operation in which the size or position of the post-change superimposition area becomes inappropriate. The composite image control unit 110 returns to step S44 after displaying the error. The instruction means detection unit 111 notifies the superimposition scheduled area setting unit 112 of the direction and amount of the slide operation or pinch operation detected as valid.

  The superimposition plan area setting unit 112 changes the mode of the superimposition plan area according to the direction and amount of the slide operation or the pinch operation (step S226).

  In addition, when the instruction unit detection unit 111 determines that the detected specific subject is not a specific instruction unit (NO in step S218), or when it determines that the specific subject does not indicate a specific operation (step S218). (NO in S220), the process proceeds to step S228.

  The composite image control unit 110 controls the imaging control unit 100 to return the focus position from the position of the specific subject to the original position (step S228).

  FIG. 8 is a diagram illustrating a state in which specific instruction means by the worker 500 is detected. FIG. 8A shows a situation where the worker 500 takes an image of the construction site 400 with the imaging device 1 without arranging the display plate 410 on the construction site 400.

  FIG. 8B is a screen similar to that shown in FIG. 7C on which a live view image LV on which the superimposition plan area P is displayed is displayed. This is a state before the specific instruction means by the worker 500 is detected.

  FIG. 8C is a live view image LV in a state where the worker 500 puts the thumb 510a and the index finger 510b of the left hand 510 in the peripheral region of the region P to be superimposed. The instruction means detection unit 111 detects the thumb 510a and the index finger 510b present in the surrounding area of the scheduled overlapping area P as specific subjects. Further, the instruction means detection unit 111 detects a hand sign by the thumb 510a and the index finger 510b as a specific instruction means.

  FIG. 9 is a diagram illustrating a state in which the superimposition plan area is changed by a specific operation by the worker 500. FIG. 9A is a diagram illustrating a state in which the position of the overlap scheduled region P is changed by a slide operation. When the thumb 510a and the index finger 510b of the left hand 510 are slid in the right direction (N1) as they are, the instruction means detection unit 111 detects the amount of slide operation on the screen. The detected slide operation amount is notified to the overlap scheduled area setting unit 112. The position of the superimposition plan area P is changed by the superimposition plan area setting unit 112 to the right by the amount of slide operation on the screen. The display image processing unit 115 changes the position of the superimposition scheduled area P on the live view image LV according to the slide operation.

  FIG. 9B is a diagram illustrating a state in which the size of the overlap scheduled area P is enlarged and changed by a pinch operation. When the thumb 510a and the index finger 510b of the left hand 510 are pinched in the N2 direction, the instruction means detection unit 111 detects the amount of pinch operation on the screen. The detected pinch operation amount is notified to the overlap scheduled area setting unit 112. By the superimposition plan area setting unit 112, the size of the superimposition plan area P is enlarged by the amount of pinch operation on the screen. The display image processing unit 115 changes the size of the superimposition plan area P on the live view image LV according to the pinch operation. Note that the size is reduced in the case of a pinch operation in a direction in which the thumb 510a and the index finger 510b approach each other.

  Proceed to step S48 in FIG. 4B. The imaging control unit 100 determines whether an imaging instruction has been given by the operator 500 from the operator 500 (step S48). If the imaging control unit 100 determines that no imaging instruction has been given (NO in step S48), the imaging control unit 100 returns to step S40.

  When the imaging control unit 100 determines that an imaging instruction has been given (YES in step S48), the composite image generation unit 114 generates a composite image (step S50). In other words, the composite image generation unit 114 generates a composite image by combining the selected display board image with the photographed image in the superimposition plan area set by the superimposition plan area setting unit 112.

  Then, the recording control unit 120 records the generated composite image as the recording image 70b in the storage unit 70 (step S52). FIG. 10 is a diagram illustrating an example of a combined image in which a display board image is combined with a captured image. As shown in FIG. 10A, a composite image is displayed on the imaging device 1 as a REC view image RV after shooting. The display board image Q is combined with the superimposition plan area set on the captured image. FIG. 10B is an enlarged view of the display board image Q. The display board image Q displays construction details.

  The imaging control unit 100 determines whether or not an imaging end instruction has been given by the operation unit 60 from the operator 500 (step S54). If the imaging control unit 100 determines that the imaging end instruction has not been given (NO in step S54), the process returns to step S10. If the imaging control unit 100 determines that an instruction to end shooting has been given (YES in step S54), the shooting process ends.

<effect>
-By displaying a superimposition plan area | region on a display part, the operator can grasp | ascertain intuitively the area | region where a display board image is superimposed. Moreover, since the superimposition plan area is displayed as a live view image in a transparent or translucent manner, the position and size of the superimposition plan area can be easily confirmed.

Since the display panel image is automatically combined with the image captured in the “field shooting mode” and is generated as a composite image, it is possible to easily create an image serving as a trail in the field. In addition, since the superimposition plan area is displayed only in the “field shooting mode”, it is easy to grasp the shooting mode.

-By detecting specific instruction means within and around the superimposition planned area, it is determined that the user has an intention to give an operation instruction, and superimposition is performed based on the specific contents indicated by the specific instruction means based on the determination result. The display mode of the scheduled area can be changed.
-By limiting the change of the display mode of the superimposition plan area to the change of the position of the superimposition plan area or the enlargement / reduction of the display area, it is possible to prevent a specific instruction means from being detected as an erroneous instruction.

-When the imaging device has a zoom mechanism, if the zoom lens of the photographic optical unit is adjusted close to the telephoto end, certain indication means (hand signs, etc.) do not fall within the angle of view, and false detection is likely to occur. Become. When the angle of view is equal to or smaller than a certain value, a warning that the specific instruction means cannot be detected is issued, so that erroneous detection can be prevented.
When the depth of field of the imaging device is shallow, specific instruction means (such as a hand sign) located at a close distance is not focused and erroneous detection is likely to occur. When the depth of field is equal to or less than a certain value, a warning that the specific instruction means cannot be detected is issued, so that erroneous detection can be prevented.
-When the superimposition plan area is instructed beyond a certain size, there is no room for displaying the on-site subject. On the other hand, when the superimposition plan area is designated too small, it becomes difficult to decode the characters. Since such a region designation operation is warned to be invalid, an inappropriate size setting is prevented in advance.

When the specific instruction means is detected in the superimposition scheduled area, the specific instruction means is focused, so that the detection accuracy of the specific instruction means can be improved. In addition, after the specific instruction means finishes the detection, the in-focus position is returned to the original position, so there is no deterioration in the image quality of the captured image.
Since the auxiliary light mounted on the imaging device is emitted and detected as necessary, the detection accuracy of the instruction means can be improved.

<Modification>
In the above description, as an embodiment, when a display board image describing construction details is combined and recorded on a construction image, the position of the display board image is adjusted on the photographed image as an example. However, the present invention is not limited to this. . It can also be used for images such as explanations of sightseeing spots, explanations of facilities, or explanations of experiments.
・ Shooting is not limited to still images. The present embodiment can also be applied to the case where a display board image is synthesized during moving image shooting.
In the above description, the horizontal shooting is taken as an example. However, when the vertical shooting is performed, the size and orientation of the display board image may be displayed corresponding to the vertical shooting.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, all the constituent elements shown in the embodiments may be appropriately combined. Furthermore, constituent elements over different embodiments may be appropriately combined. It goes without saying that various modifications and applications can be made without departing from the spirit of the invention.

1 Imaging device
10 Control unit
20 Imaging unit
20a Imaging optics
20b Signal processor
30 Image processing unit
40 Auxiliary light emitter
50 display section
60 Operation unit
70 storage unit
70a Display board image data
70b Recorded image
80 Communication IF
100 Imaging Control Unit 110 Composite Image Control Unit
111 Instructing means detection unit 112 Superimposition plan area setting unit 113 Warning unit
114 Composite Image Generation Unit
115 Display image processing unit
116 Display board image controller
120 Recording control unit
300 External equipment

Claims (14)

An imaging unit for acquiring a captured image;
A display image processing unit that generates a display image based on the captured image and displays the display image on a display unit;
An instruction means detector for detecting a specific instruction means from the captured image;
A superimposition plan area setting unit that sets a superimposition plan area on the photographed image for generating a composite image in which a display board image on which the content of photographing is described is superimposed on the photographed image;
The superimposition plan area setting unit changes the superimposition plan area according to the specific instruction means detected by the instruction means detection unit,
An imaging apparatus characterized by that. The display image processing unit causes the display unit to display the superimposition plan area on the captured image,
The instruction means detection unit detects an instruction by a finger that is deceived in the vicinity of the superimposition plan area as the specific instruction means.
The imaging apparatus according to claim 1. The display image processing unit causes the display unit to display the superimposition plan area on the captured image in a transparent or translucent form.
The imaging apparatus according to claim 1 or 2, wherein The display image processing unit displays the region to be superimposed on the captured image when a mode for combining the display board image with the captured image is designated.
The imaging apparatus according to any one of claims 1 to 3, wherein The superimposition plan area setting unit changes the superimposition plan area on the captured image according to the detected specific instruction unit when the specific instruction unit is detected in the vicinity of the superimposition plan area. ,
The image pickup apparatus according to claim 1, wherein the image pickup apparatus is an image pickup apparatus. The superimposition plan area setting unit changes the position of the superimposition plan area on the captured image or enlarges / reduces the area of the superimposition plan area on the captured image according to the specific instruction means.
The imaging apparatus according to any one of claims 1 to 5, wherein A composite image generating unit that generates a composite image by superimposing the display board image on the superimposition plan area of the captured image;
A recording control unit for recording the composite image,
The image pickup apparatus according to claim 1, wherein the image pickup apparatus is an image pickup apparatus. A warning unit that issues a warning when the angle of view of the imaging optical unit of the imaging apparatus is equal to or less than a certain value;
The image pickup apparatus according to claim 1, wherein the image pickup apparatus is an image pickup apparatus. A warning unit that issues a warning when the depth of field of the imaging optical unit of the imaging device is a value less than or equal to a certain value;
The image pickup apparatus according to claim 1, wherein the image pickup apparatus is an image pickup apparatus. A warning unit that issues a warning when the size of the region to be superimposed on the display unit is not included in a predetermined range by the specific instruction unit;
The image pickup apparatus according to claim 1, wherein the image pickup apparatus is an image pickup apparatus. An imaging control unit for controlling the imaging unit;
The imaging control unit controls the imaging unit to change a focus position to the detected specific instruction unit when the specific instruction unit is detected in the superimposition plan area by the instruction unit detection unit. Control,
The imaging apparatus according to claim 1. An imaging control unit for controlling the emission of auxiliary light mounted in the imaging device;
The imaging apparatus according to claim 1, wherein the imaging control unit emits the auxiliary light when the specific instruction unit cannot be detected by the instruction unit detection unit. The imaging apparatus according to claim 1, wherein the photographed image is a photographed image of a construction site, and the display board image describes construction details. In a control method in an imaging apparatus including an imaging unit,
A display step of causing the display unit to display a display image based on the captured image captured by the imaging unit;
An instruction means detecting step for detecting a specific instruction means from the captured image;
A superimposition plan area setting step for setting a superimposition plan area on the photographed image for generating a composite image obtained by superimposing a display board image on which the content of photographing is superimposed on the photographed image,
The superimposition plan area setting step changes the superimposition plan area according to the specific instruction means detected by the instruction means detection step.
And a method of controlling the imaging apparatus.