JP2010263324A - Image capturing apparatus, display device and imaging system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image capturing apparatus, a display device, and an imaging system, which enable a user to view an image equivalent to an image on a large screen independently of a peripheral environment and are superior in ease of operation. <P>SOLUTION: When the user operates the image capturing apparatus 1 that is operated by contact from the outside on a display unit, a display device (FMD 2) that is mounted on the head of a person and displays an image in the vicinity of the eyes of the person mounted with the display device displays button images for operation and displays, over the button images, a contact position of an object in contact with a display unit 13 of the image capturing apparatus 1. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an imaging device that captures an image of a subject, a display device that displays an image captured by the imaging device, and an imaging system that includes the imaging device and the display device.

  In recent years, in electronic devices such as digital cameras, devices having high performance while being small are becoming widespread. Under such circumstances, as a display device that can be connected to an electronic device and display an image stored in the electronic device, the display device can be worn on the user's head and displayed near the user's eyes. A display device is known (see, for example, Patent Documents 1 and 2). According to this technology, when the user wears a display device, the display screen is arranged near the eyes, so that the user can see an image equivalent to a large screen even in an environment where the surroundings are bright and the display on the electronic device is difficult to see. Can do.

  Here, more specific contents of the above-described prior art will be described. Patent Document 1 discloses a technique related to an optical device using an optical characteristic variable optical element with a large amount of light. In this technology, it is assumed that the display device is applied as a finder of a digital camera or a digital video camera, or is applied as a display of a portable personal computer, a mobile phone, a PDA (Personal Digital Assistants) or the like.

  Patent Document 2 discloses a technique related to a display system in which a head-mounted display device is connected to a digital camera via a cable. In this technology, in addition to transferring image information of a digital camera and displaying it on a display device, the digital camera is operated by inputting an operation signal from an operation unit provided in the display device.

JP 2001-209037 A JP 2008-85854 A

  However, in the two prior arts described above, the display device displays the same content as that displayed by the connected electronic device, and when the electronic device is actually operated, the actual electronic device is displayed. It was necessary to use an operation input unit provided in the device or to operate a separate operation unit. For this reason, when the display device is mounted, the field of view is blocked, and for the user, wearing the display device has become an obstacle to the operation.

  The present invention has been made in view of the above, and provides an imaging device, a display device, and an imaging system that allow a user to view an image equivalent to a large screen regardless of the surrounding environment and that is excellent in operability. The purpose is to do.

  In order to solve the above-described problems and achieve the object, an imaging apparatus according to the present invention includes an imaging unit that images a subject and generates digital image data, and an image corresponding to the image data generated by the imaging unit. A display unit that displays an input of an operation signal based on contact of an object on the display unit, a contact position detection unit that detects a contact position of the object on the display unit, and the contact position detection unit An operation determination unit that determines an operation signal input according to the detected contact position of an object, and a display device that can be mounted on a person's head and displays an image in the vicinity of the eye of the mounted person. The image data, the contact position of the object detected by the contact position detection unit, and a button display instruction signal for instructing an operation button to be displayed on the display device are transmitted to the display device from the display device. An imaging side communication unit that receives a display state signal indicating a display state, a matching unit that collates the operation signal determined by the operation determination unit and the display state signal received by the imaging side communication unit from the display device, When the operation signal and the display state signal correspond normally as a result of the verification by the verification unit, processing according to the operation signal is performed.

  In addition, an imaging apparatus according to the present invention includes an imaging unit that images a subject and generates digital image data, a display unit that displays an image corresponding to the image data generated by the imaging unit, and an object in the display unit An input unit that receives an input of an operation signal based on the contact, a contact position detection unit that detects a contact position of the object on the display unit, and an input according to the contact position of the object detected by the contact position detection unit An operation determination unit that determines an operation signal and an object that can be worn on the head of a person and that is displayed on the display device that displays an image in the vicinity of the eye of the worn person. A button display instruction signal for instructing an operation button to be displayed on the display device and an operation content information corresponding to the operation signal determined by the operation determination unit. An imaging-side communication unit that receives a collation result between the operation content information and the display state on the display device, and the operation content information from the display device and the display state on the display device correspond to each other normally. When a collation result indicating that the operation signal is received, processing according to the operation signal is performed.

  In the imaging device according to the present invention, in the above invention, the display unit includes a liquid crystal unit in which a liquid crystal and a plurality of pixels are stacked, a backlight that irradiates light to the liquid crystal unit, and an interior of the liquid crystal unit. And a plurality of optical sensors that respectively detect reflected light from the outside of the display unit of the irradiation light from the backlight, and the contact position detection unit outputs a sensor signal output from the optical sensor. Based on this, the contact position of the object on the display unit is detected.

  The imaging device according to the present invention further includes a storage unit that stores image data in the above invention, and when the image corresponding to the image data stored in the storage unit is reproduced, the display unit displays a plurality of images. The arranged thumbnail display is performed, and the imaging side communication unit transmits image data of an image displayed at a position where the contact position detection unit detects contact of an object.

  In the image pickup apparatus according to the present invention, in the above invention, the operation determination unit determines a pressing force of the contact position detected by the contact position detection unit while the display unit performs the thumbnail display. According to the determined pressing force, information on the size of the image to be displayed by the display device is added to the image data.

  The imaging apparatus according to the present invention further includes a vertical / horizontal determination unit that determines a direction substantially parallel to a bottom surface of the imaging apparatus among the horizontal direction and the vertical direction in the above-described invention, and the imaging-side communication unit includes: The determination result of the vertical / horizontal determination unit is transmitted to the display device together with the contact position and the button display instruction signal.

  The display device according to the present invention is a display device that can be worn on the head of a person and displays an image in the vicinity of the eyes of the worn person, the image display unit displaying an image, and the image display A button image storage unit that stores a button image of an operation button to be superimposed on the unit, an imaging unit that captures a subject and generates digital image data, a display unit that displays an image captured by the imaging unit, An input unit that receives an input of an operation signal based on contact of an object on the display unit, a contact position detection unit that detects a contact position of the object on the display unit, and an object contact position detected by the contact position detection unit An operation determination unit that determines an operation signal input in response to the image data, the contact position of the object detected by the contact position detection unit, and the display device A display-side communication unit that receives a button display instruction signal indicating a button and transmits a display state signal indicating a display state in the image display unit to the imaging device, and the image display unit includes the display side The image corresponding to the image data received by the communication unit and the contact position of the object detected by the contact position detection unit are read from the button image storage unit based on the button display instruction signal received by the display side communication unit. A button image is displayed.

  The display device according to the present invention is a display device that can be worn on the head of a person and displays an image in the vicinity of the eyes of the worn person, the image display unit displaying an image, and the image display A button image storage unit that stores a button image of an operation button to be superimposed on the unit, an imaging unit that captures a subject and generates digital image data, a display unit that displays an image captured by the imaging unit, An input unit that receives an input of an operation signal based on contact of an object on the display unit, a contact position detection unit that detects a contact position of the object on the display unit, and an object contact position detected by the contact position detection unit An operation determination unit that determines an operation signal input in response to the image data, the contact position of the object detected by the contact position detection unit, and the operation determined by the operation determination unit. A display side communication unit that receives operation content information corresponding to the signal and a button display instruction signal for instructing a button to be displayed on the display device, operation content information received by the display side communication unit, and display content on the display unit The image display unit, together with the image corresponding to the image data received by the display side communication unit and the contact position of the object detected by the contact position detection unit, the display side The button image read from the button image storage unit is displayed based on the button display instruction signal received by the communication unit, and the display-side communication unit transmits a verification result in the verification unit to the imaging device. To do.

  In the display device according to the present invention as set forth in the invention described above, the display-side communication unit can communicate with the two imaging devices, and the image display unit corresponds to image data received from each imaging device. Are displayed side by side.

  Further, in the display device according to the present invention, in the above invention, the two imaging devices can capture images in cooperation with each other, and the two image data respectively received from the two imaging devices are compared to each other. A 3D determination unit that determines whether or not 3D shooting by two imaging devices is possible is provided.

  The imaging system according to the present invention can be mounted on an imaging device that captures a subject and a person's head and can transmit and receive information to and from the imaging device. An imaging system including a display device for displaying, wherein the imaging device displays an image corresponding to the image data generated by the imaging unit and an imaging unit that images a subject and generates digital image data A display unit; an input unit that receives input of an operation signal based on contact of the object on the display unit; a contact position detection unit that detects a contact position of the object on the display unit; and an object detected by the contact position detection unit An operation determination unit that determines an operation signal input according to the contact position of the image, the image data, the contact position of the object detected by the contact position detection unit, and the operation to be displayed on the display device. An imaging side communication unit that transmits a display state signal indicating a display state on the display device from the display device, and an operation signal determined by the operation determination unit, while transmitting a button display instruction signal indicating a button to the display device And a collation unit that collates the display state signal received from the display device by the imaging-side communication unit. As a result of the collation by the collation unit, the operation signal and the display state signal correspond to each other normally. And performing processing according to the operation signal, the display device displaying an image, a button image storage unit storing a button image of an operation button to be superimposed on the image display unit, A button display instruction signal for instructing the image data, the contact position of the object detected by the contact position detector and the button to be displayed on the display device is received from the imaging device. A display-side communication unit that transmits a display state signal indicating a display state in the image display unit to the imaging device, wherein the image display unit corresponds to the image data received by the display-side communication unit. The button image read from the button image storage unit based on the button display instruction signal received by the display side communication unit is displayed together with the image and the contact position of the object detected by the contact position detection unit.

  The imaging system according to the present invention can be mounted on an imaging device that captures a subject and a person's head and can transmit and receive information to and from the imaging device. An imaging system including a display device for displaying, wherein the imaging device displays an image corresponding to the image data generated by the imaging unit and an imaging unit that images a subject and generates digital image data A display unit; an input unit that receives input of an operation signal based on contact of the object on the display unit; a contact position detection unit that detects a contact position of the object on the display unit; and an object detected by the contact position detection unit An operation determination unit that determines an operation signal that is input according to the contact position, the image data, the contact position of the object detected by the contact position detection unit, and the operation signal that the operation determination unit determines. And a button display instruction signal for instructing an operation button to be displayed on the display device is transmitted to the display device, while the operation content information is collated from the display device with a display state on the display device. An imaging-side communication unit for receiving a result, and when receiving a collation result indicating that the operation content information and the display state on the display device normally correspond from the display device, The display device performs an appropriate process, and the display device displays an image, a button image storage unit that stores a button image of an operation button to be superimposed on the image display unit, the image data, and the contact position The contact position of the object detected by the detection unit, operation content information corresponding to the operation signal determined by the operation determination unit, and buttons to be displayed on the display device A display-side communication unit that receives a button display instruction signal to be displayed from the imaging device, and a collation unit that collates operation content information received by the display-side communication unit with display content on the display unit, The display unit, based on the button display instruction signal received by the display side communication unit, together with the image corresponding to the image data received by the display side communication unit and the contact position of the object detected by the contact position detection unit The button image read from the button image storage unit is displayed, and the display-side communication unit transmits a verification result in the verification unit to the imaging device.

  The imaging system according to the present invention is characterized in that, in the above invention, the imaging system includes two imaging devices, and the image display unit displays images corresponding to image data received from the imaging devices side by side.

  In the imaging system according to the present invention, in the above invention, the two imaging devices can capture images in cooperation with each other, and the display device receives the reception-side communication unit from the two imaging devices, respectively. The image processing apparatus includes a 3D determination unit that determines whether or not 3D shooting by the two imaging devices is possible by comparing the two image data.

  According to the present invention, when operating an imaging device capable of performing an operation by external contact on the display unit, the image can be mounted on a person's head, and an image can be displayed in the vicinity of the mounted person's eyes. Since the display device to display displays the button image for operation and also displays the contact position of the object in contact with the display unit of the imaging device in an overlapping manner, the user can perform operation input while looking at the display device. . Therefore, the user can not only view an image equivalent to a large screen regardless of the surrounding environment, but also enjoy excellent operability.

FIG. 1 is a block diagram showing a configuration of an imaging system according to Embodiment 1 of the present invention. FIG. 2 is a perspective view showing the configuration of the back side of the imaging apparatus according to Embodiment 1 of the present invention. FIG. 3 is a diagram schematically illustrating a configuration of a main part of the display unit of the imaging apparatus according to Embodiment 1 of the present invention. FIG. 4 is a diagram schematically illustrating the operation of the optical sensor included in the display unit of the imaging apparatus according to Embodiment 1 of the present invention. FIG. 5 is a diagram schematically illustrating a situation before and after the input of the operation signal performed on the display unit included in the imaging apparatus according to Embodiment 1 of the present invention. FIG. 6 is a perspective view showing the external configuration (the shutter is closed) of the display device according to Embodiment 1 of the present invention. FIG. 7 is a diagram showing an internal configuration (a state in which the shutter is closed) of the display device according to Embodiment 1 of the present invention. FIG. 8 is a perspective view showing an external configuration (a state in which the shutter is opened) of the display device according to Embodiment 1 of the present invention. FIG. 9 is a diagram showing an internal configuration (a state in which the shutter is opened) of the display device according to Embodiment 1 of the present invention. FIG. 10 is a diagram illustrating a situation where a user performs shooting using the imaging system according to Embodiment 1 of the present invention. FIG. 11 is a diagram illustrating a state in which the user is holding the imaging apparatus according to Embodiment 1 of the present invention while the thumb is in contact with the display unit. FIG. 12 is a diagram showing a display example (first example) of a screen on the liquid crystal display unit of the display device when the imaging device is set to the shooting mode in the imaging system according to Embodiment 1 of the present invention. . FIG. 13 is a diagram showing a display example (second example) of the screen on the liquid crystal display unit of the display device when the imaging device is set to the shooting mode in the imaging system according to Embodiment 1 of the present invention. . FIG. 14 is a diagram illustrating a situation in which the user wears the display device with the shutter of the display device opened in the imaging system according to Embodiment 1 of the present invention. FIG. 15 is a diagram illustrating a display example of a screen on the liquid crystal display unit of the display device when the imaging device is set to the reproduction mode in the imaging system according to Embodiment 1 of the present invention. FIG. 16 is a flowchart showing an outline of processing when the imaging apparatus according to Embodiment 1 of the present invention is set to the shooting mode. FIG. 17 is a flowchart showing an outline of processing when the imaging apparatus according to Embodiment 1 of the present invention is set to the playback mode. FIG. 18 is a flowchart showing an outline of processing of the display device according to Embodiment 1 of the present invention. FIG. 19 is a block diagram showing a configuration of an imaging system according to Embodiment 2 of the present invention. FIG. 20 is a flowchart illustrating an outline of processing when the imaging apparatus according to Embodiment 2 of the present invention is set to the shooting mode. FIG. 21 is a flowchart showing an outline of processing when the imaging apparatus according to Embodiment 2 of the present invention is set to the playback mode. FIG. 22 is a diagram illustrating a display example of thumbnails on the display unit included in the imaging apparatus according to Embodiment 2 of the present invention. FIG. 23 is a flowchart showing an outline of processing of the display device according to Embodiment 2 of the present invention. FIG. 24 is a diagram illustrating a display example on the liquid crystal display unit of the reproduced image received from the imaging device by the display device in the imaging device according to Embodiment 2 of the present invention. FIG. 25 is a block diagram illustrating a configuration of an imaging apparatus according to a modification of the second embodiment of the present invention. FIG. 26 is a flowchart illustrating an outline of processing when the imaging apparatus according to the modification of the second embodiment of the present invention is set to the playback mode. FIG. 27 is a diagram illustrating a display example on the liquid crystal display unit of the reproduced image received by the display device from the imaging device in the imaging system according to the modification of the second embodiment of the present invention. FIG. 28 is a block diagram showing a configuration of an imaging system according to Embodiment 3 of the present invention. FIG. 29 is a diagram illustrating a situation in which a user performs shooting using the imaging system according to Embodiment 3 of the present invention. FIG. 30 is a view of a situation in which the user has an imaging apparatus according to Embodiment 3 of the present invention as viewed from the user. FIG. 31 is a diagram illustrating a display example of the liquid crystal display unit of the display device when the imaging device is set to the shooting mode in the imaging system according to Embodiment 3 of the present invention. FIG. 32 is a flowchart showing an outline of processing when the imaging apparatus according to Embodiment 3 of the present invention is set to the shooting mode. FIG. 33 is a flowchart showing an outline of processing of the display device according to Embodiment 3 of the present invention. FIG. 34 is a block diagram showing a configuration of an imaging system according to Embodiment 4 of the present invention. FIG. 35 is a diagram showing an external configuration and functions of a display device according to Embodiment 4 of the present invention. FIG. 36 shows a display example of an initial image that is initially displayed on the liquid crystal display unit of the display device when the two imaging devices are set to the cooperative shooting mode in the imaging system according to Embodiment 4 of the present invention. FIG. FIG. 37 shows an image pickup system according to Embodiment 4 of the present invention, in which two image pickup devices are set to the cooperative shooting mode, and the liquid crystal display unit of the display device is in a state where the user touches the display unit of each image pickup device. It is a figure which shows the example of a display of the image displayed on (1st example). FIG. 38 shows a liquid crystal display unit of a display device in a state where two imaging devices are set to the cooperative shooting mode and the user touches the display unit of each imaging device in the imaging system according to Embodiment 4 of the present invention. It is a figure which shows the example of a display of the image displayed on (2nd example). FIG. 39 is a flowchart showing an outline of processing when the imaging apparatus according to Embodiment 4 of the present invention is set to the shooting mode. FIG. 40 is a flowchart showing an outline of processing of the display device according to Embodiment 4 of the present invention.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the accompanying drawings.

(Embodiment 1)
FIG. 1 is a block diagram showing a configuration of an imaging system according to Embodiment 1 of the present invention. The imaging system 100 shown in FIG. 1 captures a subject in a predetermined field of view and generates digital image data. The imaging system 100 can communicate with the imaging apparatus 1 and includes information captured by the imaging apparatus 1. And a face-mounted display device (hereinafter referred to as “FMD”) 2.

  The imaging device 1 collects light from a subject included in a predetermined visual field region, forms an image, and generates digital image data from an image signal obtained by photoelectrically converting the formed subject image. Unit 11, image processing unit 12 that performs image processing on image data generated by imaging unit 11, display unit 13 that displays an image corresponding to the image data processed by image processing unit 12, and imaging It consists of various buttons provided on the surface of the device 1, and detects the state of the visual field region of the imaging unit 11 including the input unit 14 that accepts input of operation signals and the like of the imaging device 1 and the posture and brightness of the imaging device 1. Information of a predetermined communication method between the sensor unit 15, a clock 16 having a shooting date determination function and a timer function, a storage unit 17 that stores image data of an image captured by the imaging unit 11, and the FMD 2. It includes an imaging-side communication unit 18 for receiving, a control unit 19 for controlling the operation of the imaging apparatus 1 according to the operation signal input from the detection result and the input unit 14 of the sensor portion 15, a.

  The imaging unit 11 is composed of one or a plurality of lenses, and includes an optical system that collects light from a subject existing in a predetermined visual field area, a diaphragm that adjusts the amount of incident light collected by the optical system, and a release. An image sensor such as a CCD (Charge Coupled Device) that receives an image formed by passing through an aperture and a shutter and receives an image formed through an aperture and a shutter, and an analog signal output from the image sensor And a signal processing circuit for generating digital image data by performing A / D conversion after performing signal processing such as amplification and white balance.

  FIG. 2 is a perspective view showing the configuration of the back side of the imaging apparatus 1. Various buttons such as a release button 14 a constituting the display unit 13 and the input unit 14 are provided on the back side of the imaging apparatus 1. The display unit 13 is provided over substantially the entire area excluding the buttons of the input unit 14 on the back surface of the imaging device 1. FIG. 3 is a diagram schematically illustrating a configuration of a main part of the display unit 13. The display unit 13 includes a liquid crystal unit 131 having a plurality of drive circuits each including a liquid crystal, a glass substrate, a color filter, and a plurality of pixels, and a backlight 132 that irradiates the liquid crystal unit 131 with light. The liquid crystal unit 131 includes a plurality of optical sensors 133 that are provided in the vicinity of the plurality of drive circuits and detect light reflected by the object when an object such as a finger contacts the liquid crystal unit 131 from the outside.

  FIG. 4 is a diagram schematically illustrating the operation of the optical sensor 133. When the user's finger f is placed on the surface of the liquid crystal unit 131, a part of the irradiation light L1 irradiated from the backlight 132 and transmitted through the liquid crystal unit 131 is reflected by the finger f. The optical sensor 133 located in the vicinity of the finger f receives this reflected light L2. When receiving the reflected light L2, the optical sensor 133 transmits a sensor signal corresponding to the received reflected light L2 to the control unit 19.

  FIG. 5 is a diagram schematically showing the situation before and after the input of the operation signal performed on the display unit 13. The user inputs a predetermined input signal by pressing the surface of the display unit 13 more strongly with the finger f. At this time, since the cross-sectional shape of the finger f becomes a shape spreading laterally, the number of the optical sensors 133 that receive the reflected light L2 is larger than that before the input of the input signal.

  In addition to the release button 14a, the input unit 14 includes a power button, a mode switching button for switching between various operation modes that can be set by the imaging apparatus 1, a control button that includes instructions for reproducing and editing image data, and the like.

  The sensor unit 15 includes a gyro sensor that detects the attitude of the imaging apparatus and a photometric sensor that performs exposure calculation.

  The storage unit 17 includes an image data storage unit 171 that stores image data of an image captured by the imaging unit 11 and a program storage unit 172 that stores various programs executed by the imaging device 1. The storage unit 17 is realized using a semiconductor memory such as a flash memory or a DRAM (Dynamic Random Access Memory) that is fixedly provided inside the imaging apparatus 1. Note that the storage unit 17 may be provided with a function as a recording medium interface for reading information recorded on a recording medium while recording information on a computer-readable recording medium such as a memory card mounted from the outside. Good.

  The imaging-side communication unit 18 performs wireless communication such as wireless LAN (Local Area Network), infrared communication, or non-contact communication with the FMD 2. Note that communication between the imaging-side communication unit 18 and the FMD 2 may be realized by wire.

  The control unit 19 includes a contact position detection unit 191 that detects a contact position of the object on the display unit 13 based on a sensor signal output from the optical sensor 133, and a display unit 13 based on a change in output mode of the plurality of optical sensors 133. The operation determination unit 192 that determines the content of the operation signal input via the operation collation is performed with the operation signal determined by the operation determination unit 192 and the display state signal indicating the display state of the image display unit 22 sent from the FMD 2 And a collation unit 193 for The control unit 19 is realized using a CPU (Central Processing Unit) or the like, and is connected to each component of the imaging device 1 that is a control target via a bus line.

  Next, the configuration of the FMD 2 will be described with reference to FIG. The FMD 2 includes a display-side communication unit 21 that transmits and receives various types of information including image data to and from the imaging device 1, an image display unit 22 that displays information such as images sent from the imaging device 1, and various types of information. And a control unit 24 for controlling the operation of the FDM 3. The storage unit 23 includes a button image storage unit 231 that stores images of various buttons to be superimposed on the image display unit 22.

  FIG. 6 is a perspective view showing an external configuration of the FMD 2. FIG. 7 is a diagram schematically showing the internal configuration of the FMD 2. The FMD 2 has a shape in which a pair of nose pads are provided and glasses are halved. The lens portion of the glasses is provided with a shutter 221 that can be opened and closed under the control of the control unit 24. 6 and 7 show a state in which the shutter 221 is closed. As shown in FIG. 7, an optical system 223 that has a liquid crystal display unit 222 and a plurality of lenses inside the shutter 221 and transmits light from the outside while reflecting an image displayed by the liquid crystal display unit 222. And are provided.

  The optical system 223 is joined to a substantially curved free-form prism 223a, a substantially concave mirror-shaped half mirror coat 223b coated on the free-form curved prism 223a, and a half mirror coat 223b, and transmits through the half mirror coat 223b. And a substantially wedge-shaped correction prism 223c for correcting the power of light.

When an image is displayed on the liquid crystal display unit 222, the shutter 221 is closed so that light from the outside does not pass through the optical system 223 as shown in FIG. In this case, the light emitted from the liquid crystal display unit 222 is sequentially reflected by the free-form surface prism 223a and the half mirror coat 223b, then passes through the free-form surface prism 223a and reaches the eyes of the user wearing the FMD2. Thereby, the user can recognize the image displayed on the liquid crystal display unit 222.
Since this image is displayed near the eyes, the user can obtain the same feeling as viewing the image on a large screen.

  FIG. 8 is a perspective view showing an external configuration of the FMD 2 with the shutter 221 open. FIG. 9 is a diagram schematically showing the internal configuration of the image display unit 22 in the state shown in FIG. When an image is not displayed on the liquid crystal display unit 222, light from the outside is transmitted to the optical system 223 by opening the shutter 221. By opening the shutter 221 in this way, the user can obtain a natural field of view also on the eye wearing the FMD 2.

  FIG. 10 is a diagram illustrating a situation where the user performs shooting using the imaging system 100 having the above configuration. When the sensor unit 15 detects that the posture of the imaging device 1 is in the shooting state with the imaging device 1 set to the shooting mode, the imaging device 1 controls the FMD 2 to close the shutter 221. Send. The FMD 2 that has received the control signal for closing the shutter 221 from the imaging device 1 closes the shutter 221 based on the control signal. FIG. 11 is a diagram illustrating a state in which the user is holding the imaging apparatus 1 and the finger f is in contact with the display unit 13. In this state, the contact position detection unit 191 determines the contact position of the finger f, transmits the contact position information to the FMD 2, and transmits image data of an image (through image) captured by the imaging unit 11 to the FMD 2. Send to.

  FIG. 12 is a diagram showing a display example of the screen displayed by the liquid crystal display unit 222 in the state shown in FIG. The liquid crystal display unit 222 includes a zoom-in button SI1 and a zoom-out button as shooting instruction input buttons in addition to the through image 222a captured by the imaging unit 11 and the finger position display image 222b indicating the contact position of the finger f on the display unit 13. Superimpose SI2. For example, when the user moves the finger f so as to come over the zoom-out button SI2, as shown in FIG. 13, the finger position display image 222b overlaps the zoom-out button SI2, and the zoom-out button SI2 is displayed in the selected state. Switch. When the pressing force with the finger f is increased in the state shown in FIG. 13, the imaging apparatus 1 performs zoom-out processing. When the user does not place the finger f on the display unit 13, the liquid crystal display unit 222 does not display the finger position display image 222b, the zoom-in button SI1, and the zoom-out button SI2. In addition, as buttons for photographing, other buttons for switching the shutter speed, correcting the exposure, turning on / off the strobe, and the like can be displayed.

  Up to this point, the state in which the imaging apparatus 1 is set to the imaging mode and the user holds the imaging apparatus 1 has been described. However, when the user does not hold the imaging apparatus 1 in the imaging mode, the shutter 221 is configured as shown in FIG. As shown in FIG. 3, the image pickup apparatus 1 is open regardless of the setting mode. Therefore, in this state, the user can see the outside with both eyes.

  FIG. 15 is a diagram illustrating a display example of the screen on the liquid crystal display unit 222 when the imaging apparatus 1 is set to the reproduction mode. In this case, in the FMD 2, the shutter 221 is closed regardless of the posture of the imaging device 1. In FIG. 15, the liquid crystal display unit 222 displays a reproduction instruction input button (in addition to the reproduction image 222c and the finger position display image 222b corresponding to the selected image data among the image data stored in the image data storage unit 171). As a reproduction button), a forward movement button SI3, a backward movement button SI4, and an erase button SI5 are superimposed. When the user presses the finger f so that the button indicating the desired operation and the finger position display image 222b overlap each other and then increases the pressing force, the imaging device 1 performs processing corresponding to the pressed portion. Also in this case, the selected playback button is switched to the display of the selected state. In addition, as a reproduction button, a button for turning on / off a slide show and a rotation button for changing a reproduction image instantaneously and continuously may be provided.

  As described above, in the first embodiment, display on the display unit 13 of the imaging apparatus 1 is performed by the FMD 2 and the user takes the predetermined attitude in the shooting mode and holds the imaging apparatus 1 or sets the playback mode. In such a case, since the operation instruction input position and the finger position on the display unit 13 are displayed, the user can easily perform the operation. In particular, by using the FMD 2, even when the display unit 13 is difficult to see outdoors or the like, the user can view the image enlarged on the liquid crystal display unit 222 without being affected by the external brightness. It is possible to easily check or edit a photographed or reproduced image.

  FIG. 16 is a flowchart illustrating an outline of processing when the imaging apparatus 1 is set to the shooting mode. In this case, as a result of the sensor unit 15 detecting the attitude of the imaging device 1, when the imaging device 1 is in a predetermined photographing enabled state (step S <b> 1: Yes), the imaging device 1 performs exposure calculation (step S <b> 2) and focus adjustment (step S <b> 2). Step S3) is performed, and a through image is displayed on the display unit 13 (step S4). In step S1, when the imaging device 1 is not ready for photographing (step S1: No), the imaging device 1 proceeds to step S23 described later.

  The “photographable state” in step S1 means, for example, a situation where the user holds the imaging device 1 near his / her face. Such a situation can be determined based on the posture of the imaging device 1 detected by the sensor unit 15. Note that when communication between the imaging apparatus 1 and the FMD 2 is performed by non-contact communication, the photographing enabled state may be determined using the fact that communication is established when both of them approach a predetermined distance. Further, when communication between the imaging device 1 and the FMD 2 is performed by a wireless LAN, for example, a radio wave may be transmitted when the user half-presses the release button 14a.

  Subsequent to step S4, the imaging device 1 transmits a control signal for closing the shutter 221 to the FMD 2 (step S5), and transmits image data of a through image to the FMD 2 (step S6).

  After that, when the contact position detection unit 191 detects an object such as a finger that contacts the display unit 13 and the contact position of the object (step S7: Yes), the imaging device 1 instructs the display of the shooting button to be displayed. The display instruction signal and the object contact position information are transmitted to the FMD 2 (step S8). On the other hand, when the contact position detection unit 191 does not detect an object in contact with the display unit 13 (step S7: No), the imaging device 1 proceeds to step S23 described later.

  After step S8, when a user operation is performed on the display unit 13 (step S9: Yes), the imaging apparatus 1 sends a display state request signal for requesting the FMD 2 to transmit the display state of the liquid crystal display unit 222. It transmits to FMD2 (step S10). On the other hand, after step S8, when the operation by the user is not performed on the display unit 13 (step S9: No), the imaging device 1 transmits the shooting button display instruction signal and the contact position information to the FMD 2. When a predetermined time has elapsed since the start (step S11: Yes), the imaging device 1 proceeds to step S23. When no operation is performed by the user on the display unit 13 (step S9: No), when a predetermined time has not elapsed since the imaging device 1 transmitted the shooting button display instruction signal and the contact position information to the FMD 2 ( Step S11: No), the imaging apparatus 1 returns to Step S9.

  When the imaging apparatus 1 receives the display state signal indicating the display state of the liquid crystal display unit 222 from the FMD 2 within a predetermined time after the imaging apparatus 1 transmits the display state request signal to the FMD 2 in Step S10 (Step S12: Yes), the verification unit 193 Collates the operation signal and the display state signal (step S13). As a result of the collation by the collation unit 193, when the operation signal and the display state signal normally correspond (hereinafter, the collation result is “normal”) (step S14: Yes), the imaging device 1 responds to the operation signal. The process is performed (step S15), and a process reflection display instruction signal for instructing display reflecting the process contents is transmitted to the FMD 2 (step S16).

  When the imaging device 1 does not receive the display state signal from the FMD 2 within a predetermined time after the imaging apparatus 1 transmits the display state request signal to the FMD 2 in step S10 (step S12: No), and the collation result collated by the collation unit 193 in step S13 Is not “normal” (step S14: No), the imaging apparatus 1 transmits an error signal to the FMD 2 (step S17), and proceeds to step S23.

  After step S16, when an operation by the user is performed on the display unit 13 (step S18: Yes), the imaging device 1 returns to step S10. On the other hand, when the user does not perform an operation on the display unit 13 (step S18: No), when the release button 14a is pressed (step S19: Yes), the imaging unit 11 captures an image (step S20). Thereafter, the image data of the photographed image is recorded in the image data storage unit 171 (step S21) and transmitted to the FMD 2 (step S22).

  When a photographing end signal is input by the input unit 14 within a predetermined time after step S22 (step S23: Yes), the imaging apparatus 1 transmits a control signal for opening the shutter 221 to the FMD 2 (step S24), and a series of steps. The process ends. On the other hand, after step S22, when the imaging end signal is not input by the input unit 14 within a predetermined time (step S23: No), the imaging apparatus returns to step S1.

  If the release button 14a is not pressed in step S19 (step S19: No) and a predetermined time has elapsed since the imaging device 1 transmitted the process reflection display instruction signal to the FMD 2 (step S25: Yes), the imaging device 1 Control goes to step S23. On the other hand, if the release button 14a of the input unit 14 is not pressed (step S19: No), and a predetermined time has not elapsed since the imaging device 1 transmitted the process reflection instruction signal to the FMD 2 (step S25: No). The imaging device 1 returns to step S18.

  FIG. 17 is a flowchart illustrating an outline of processing when the imaging apparatus 1 is set to the reproduction mode. In this case, the imaging apparatus 1 transmits a control signal for closing the shutter 221 to the FMD 2 (step S31). Subsequently, the imaging apparatus 1 displays the reproduced image on the display unit 13 (step S32) and transmits the image data of the reproduced image to the FMD 2 (step S33).

  The processes in steps S34 to S44 sequentially correspond to the processes in steps S7 to S17 in FIG. However, in step S35, a playback button display instruction signal is transmitted instead of the shooting button display instruction signal. In step S38, when a predetermined time has elapsed since the imaging device 1 transmitted the reproduction button display instruction signal and the contact position information (step S38: Yes), the imaging device 1 proceeds to step S45. In addition, after the imaging device 1 transmits an error signal to the FMD 2 in step S44, the imaging device 1 proceeds to step S45.

  After step S43, when a signal for ending reproduction is input by the input unit 14 within a predetermined time (step S45: Yes), the imaging apparatus 1 transmits a control signal for opening the shutter 221 to the FMD 2 (step S46). A series of processing ends. On the other hand, after step S43, when the signal for ending reproduction is not input by the input unit 14 (step S45: No), the imaging device 1 returns to step S32.

  FIG. 18 is a flowchart showing an outline of the processing of FMD2. In the following description, it is assumed that the FMD 2 is turned on. When the FMD 2 receives a control signal for closing the shutter from the imaging apparatus 1 (step S51: Yes), the FMD 2 closes the shutter 221 (step S52). On the other hand, when the control signal for closing the shutter 221 is not received from the imaging device 1 (step S51: No), the FMD 2 repeats step S51.

  After step S52, when the FMD 2 receives image data of a through image from the imaging device 1 within a predetermined time (step S53: Yes), the FMD 2 displays the through image on the liquid crystal display unit 222 (step S54).

  Subsequently, when the FMD 2 receives the shooting button display instruction signal and the contact position information of the object from the imaging device 1 (step S55: Yes), for example, as shown in FIG. 12, the shooting button (zoom-in button SI1, zoom-out) The button SI2) and the contact position of the object (finger position display image 222b) are displayed superimposed on the through image 222a (step S56). On the other hand, when the FMD 2 does not receive the shooting button display instruction signal and the object contact position information from the imaging apparatus 1 (step S55: No), the process returns to step S53. In this case, the predetermined time of step S53 is measured by the clock 16 after the display of the through image 222a or the like is started.

  After step S56, when a display state request signal is received from the imaging device 1 (step S57: Yes), the FMD 2 transmits a display state signal to the imaging device 1 (step S58). On the other hand, when the FMD 2 does not receive the display state request signal from the imaging device 1 (step S57: No), the FMD 2 returns to step S53.

  When the FMD 2 receives a process reflection display instruction signal from the imaging apparatus 1 within a predetermined time after the display state signal is transmitted from the FMD 2 to the imaging apparatus 1 (step S59: Yes), the FMD 2 displays liquid crystal according to the received process reflection display instruction signal. The display content of the display unit 222 is updated (step S60). On the other hand, when the FMD 2 does not receive the process reflection display instruction signal from the imaging device 1 within a predetermined time after the display status signal is transmitted from the FMD 2 to the imaging device 1 (step S59: No), the FMD 2 displays an error display on the liquid crystal display unit 222. This is done (step S61), and the series of processing is terminated.

  After step S60, when image data of a captured image is received from the imaging device 1 (step S62: Yes), the liquid crystal display unit 222 displays the received captured image (step S63).

  Thereafter, when a control signal for opening the shutter is received from the image pickup apparatus 1 (step S64: Yes), the FMD 2 opens the shutter (step S65), and the series of processing ends.

  When the image data of the captured image is not received from the imaging device 1 (step S62: No) and when the control signal for opening the shutter is not received from the imaging device 1 (step S64: No), the imaging device 1 returns to step S53.

  Next, a case where the image data of the through image is not received within a predetermined time after the FMD 2 transmits the display state signal to the imaging device 1 (step S53: No) will be described. In this case, when the FMD 2 receives the reproduced image data from the imaging device 1 within a predetermined time (step S66: Yes), the FMD 2 displays the received reproduced image (step S67).

  After that, when the reproduction button display instruction signal and the object contact position information are received from the imaging device 1 (step S68: Yes), the FMD 2 superimposes the reproduction button and the object contact position on the reproduction image on the liquid crystal display unit 222. Displayed (step S69), the process proceeds to step S57. On the other hand, when the reproduction button display instruction signal and the finger position display instruction signal are not received in step S68 (step S68: No), the FMD 2 returns to step S51.

  When the FMD 2 does not receive the image data of the reproduced image from the imaging device 1 within the predetermined time in Step S66 (Step S66: No), the FMD 2 proceeds to Step S61.

  According to the first embodiment of the present invention described above, when operating the imaging device 1 that can be operated by external contact on the display unit 13, it can be worn on the head of a person. Since the FMD 2 that displays an image in the vicinity of the eye of the person wearing it displays an operation button image and also displays the contact position of the object that is in contact with the display unit 13 of the imaging device 1, the user can display the FMD 2. Operation input can be performed while looking at the screen. Therefore, the user can not only view an image equivalent to a large screen regardless of the surrounding environment, but also enjoy excellent operability.

  Further, according to the first embodiment, it is possible to perform shooting while confirming an operation on a large screen without providing an extra operation button on the imaging device 1 or the FMD 2.

  Moreover, according to this Embodiment 1, since the confirmation on the large screen projected on FMD2 can be performed without confirming the screen of the display part 13 of the imaging device 1, the display part 13 is seen outdoors. A clear image can be seen even under difficult circumstances. In addition, by performing display with FMD2, a user with presbyopia or hyperopia can easily perform shooting and reproduction.

(Embodiment 2)
FIG. 19 is a block diagram showing a configuration of an imaging system according to Embodiment 2 of the present invention. An imaging system 200 shown in FIG. 1 captures an image of a predetermined visual field and generates digital image data. The imaging system 200 can communicate with the imaging device 3 and includes information captured by the imaging device 3. FMD4 for displaying. In the second embodiment, the FMD 4 collates the operation signal input to the imaging device 3 and the display state displayed by the FMD 4. For this reason, the imaging device 3 has the same configuration as that of the imaging device 1 described above except for the configuration of the control unit 31. The FMD 4 has the same configuration as the FMD 2 described above except for the configuration of the control unit 41. Specifically, the control unit 31 does not include a verification unit, while the control unit 41 includes a verification unit 411.

  FIG. 20 is a flowchart illustrating an outline of processing when the imaging apparatus 3 is set to the shooting mode. The processes in steps S71 to S78 in this case correspond to the processes in steps S1 to S8 in FIG. In addition, when the object which contacts the display part 13 is not detected in step S77 (step S77: No), the imaging device 3 transfers to step S91 mentioned later. Hereinafter, the processing after step S79 will be described.

  In step S79, when an operation by the user is performed on the display unit 13 (step S79: Yes), the imaging device 3 transmits operation content information corresponding to the input operation signal (step S80). On the other hand, if no operation is performed by the user on the display unit 13 (step S79: No), a predetermined time has elapsed since the imaging device 3 transmitted the imaging button display instruction signal and the object contact position information to the FMD 4. (Step S81: Yes), the imaging device 3 proceeds to step S91. If the predetermined time has not elapsed since the imaging device 3 transmitted the imaging button display instruction signal and the object contact position information to the FMD 4 in step S81 (step S81: No), the imaging device 3 returns to step S79.

  When the imaging device 3 receives the collation result between the operation content information and the display content on the liquid crystal display unit 222 from the FMD 4 within a predetermined time after transmitting the operation content information to the FMD 4 (step S82: Yes), the received collation When the result is “normal” (step S83: Yes), the imaging apparatus 3 performs a process according to the operation signal (step S84), and transmits a process reflection display instruction signal to the FMD 4 (step S85).

  When the imaging device 3 does not receive the collation result from the FMD 4 within a predetermined time after the imaging apparatus 3 transmits the display state request signal to the FMD 4 in Step S82 (Step S82: No), and the collation result received from the FMD 4 is not “normal” (Step S83: No), the FMD 4 proceeds to Step S92.

  After step S85, when an operation by the user is performed on the display unit 13 (step S86: Yes), the imaging device 3 returns to step S80. On the other hand, when the user does not perform an operation on the display unit 13 (step S86: No), when the release button 14a is pressed (step S87: Yes), the imaging unit 11 captures an image (step S88). . Thereafter, the imaging device 3 records the captured image in the image data storage unit 171 (step S89) and transmits it to the FMD 4 (step S90).

  If a shooting end signal is input by the input unit 14 within a predetermined time after step S90 (step S91: Yes), the imaging apparatus 1 transmits a control signal for opening the shutter 221 to the FMD 4 (step S92), and a series of steps. The process ends. On the other hand, after step S90, when the imaging end signal is not input by the input unit 14 within the predetermined time (step S91: No), the imaging apparatus returns to step S71.

  If the release button 14a is not pressed in step S87 (step S87: No) and a predetermined time has elapsed after the imaging device 3 transmits the process reflection display instruction signal to the FMD 4 (step S93: Yes), the imaging device 3 Control goes to step S91. On the other hand, if the release button 14a is not pressed in step S87 (step S87: No), and the predetermined time has not elapsed since the imaging device 3 transmitted the process reflection instruction signal to the FMD 4 (step S93: No), imaging is performed. The apparatus 3 returns to step S86.

  FIG. 21 is a flowchart illustrating an outline of processing when the imaging apparatus 3 is set to the reproduction mode. In this case, the imaging device 3 transmits a control signal for closing the shutter 221 to the FMD 2 (step S101). Subsequently, the imaging device 3 displays the thumbnail of the reproduced image designated by the input unit 14 on the display unit 13 (step S102). FIG. 22 is a diagram illustrating a display example of thumbnails on the display unit 13. In the thumbnail TN shown in the figure, a maximum of 16 captured images are displayed. The user can select an image by touching and pressing a desired image on the desired image from the thumbnail TN on the display unit 13.

  When an image is selected by the user (step S103: Yes), the imaging device 3 transmits the image data of the selected image to the FMD 4 (step S104). On the other hand, when an image is not selected by the user (step S103: No), the imaging apparatus 3 proceeds to step S105 described later.

  After step S104, when a signal to end reproduction is input by the input unit 14 within a predetermined time (step S105: Yes), the imaging device 3 transmits a control signal for opening the shutter 221 to the FMD 4 (step S106). A series of processing ends. On the other hand, after step S104, when a signal for ending reproduction is not input by the input unit 14 within a predetermined time (step S105: No), the imaging device 3 returns to step S102.

  FIG. 23 is a flowchart showing an overview of the processing of FMD4. In the following description, it is assumed that the FMD 4 is turned on. In FIG. 23, the processing of steps S111 to S116 sequentially corresponds to the processing of steps S51 to S56 of FIG. Hereinafter, the processing after step S117 will be described.

  In step S117, when the FMD 4 receives the operation content information from the imaging device 3 (step S117: Yes), the collation unit 411 collates the operation content information with the display state on the liquid crystal display unit 222 (step S118), and the imaging device. The verification result is transmitted to 3 (step S119).

  Subsequently, when the collation result of the collation unit 411 is “normal” (step S120: Yes), when the process reflection display instruction signal is received from the imaging device 3 within a predetermined time after the FMD 4 transmits the collation result ( In step S121: Yes, the FMD 4 updates the display content of the liquid crystal display unit 222 in accordance with the received process reflection display instruction signal (step S122).

  Thereafter, when image data of a captured image is received from the imaging device 3 (step S123: Yes), the liquid crystal display unit 222 displays the received captured image (step S124). Thereafter, when a control signal for opening the shutter is received from the imaging device 1 (step S125: Yes), the FMD 4 opens the shutter (step S126), and the series of processing ends.

  When the image data of the captured image is not received from the imaging device 3 (step S123: No) and when the control signal for opening the shutter is not received from the imaging device 1 (step S125: No), the imaging device 3 returns to step S113.

  In step S120, if the collation result of the collation unit 411 is not “normal” (step S120: No), and the FMD 4 transmits the collation result to the imaging device 3, the processing reflected display signal is transmitted from the imaging device 1 within a predetermined time. If not received (step S121: No), the FMD 4 displays an error on the liquid crystal display unit 222 (step S127), and proceeds to step S125.

  Next, a case where the FMD 4 does not receive a through image from the imaging device 3 within a predetermined time in step S113 (step S113: No) will be described. In this case, when the FMD 4 receives the image data of the reproduced image from the imaging device 1 within a predetermined time after the shutter 221 is closed (step S128: Yes), the liquid crystal display unit 222 displays the reproduced image (step S129). . FIG. 24 is a diagram showing a display example of a reproduced image on the liquid crystal display unit 222 in this case. The reproduced image 222d shown in the figure is a display example when the user selects the image TN1 in the thumbnail TN shown in FIG. 22 by pressing it with a finger.

  Thereafter, when the reproduction button display instruction signal and the object contact position information are received from the imaging device 3 (step S130: Yes), the FMD 4 superimposes the reproduction button and the object contact position information on the reproduction image on the liquid crystal display unit 222. Are displayed (step S131), and the process proceeds to step S117.

  When the FMD 4 does not receive the playback button display instruction signal and the contact position information of the object (step S130: No), the FMD 4 returns to step S111.

  According to the second embodiment of the present invention described above, when operating the imaging device 3 that can be operated by external contact on the display unit 13, it can be worn on the head of a person. Since the FMD 4 that displays an image in the vicinity of the eye of the person wearing it displays an operation button image and also displays the contact position of the object that is in contact with the display unit 13 of the imaging device 3, the user can display the FMD 4. Operation input can be performed while looking at the screen. Therefore, the user can not only view an image equivalent to a large screen regardless of the surrounding environment, but also enjoy excellent operability.

  Further, according to the second embodiment, since the image selected by the user from the plurality of images displayed as thumbnails by the imaging device 3 can be enlarged and displayed by the FMD 4, an image difficult to see on the display unit 13 can be displayed on the liquid crystal display unit 222. Can be seen clearly.

  Further, according to the second embodiment, since the FMD 4 collates the operation signal input from the imaging device 3 and the display state of the FMD 4, the configuration of the imaging device 3 can be simplified.

  FIG. 25 is a block diagram illustrating a configuration of an imaging apparatus according to a modification of the second embodiment. The imaging apparatus 5 shown in the figure is different from the imaging apparatus 3 described above in the configuration of the control unit 51. Specifically, in addition to the contact position detection unit 191 and the operation determination unit 192, the control unit 51 calculates the area change of the object that contacts the display unit 13 based on the sensor signal from the optical sensor 133. A touch level determination unit 511 that determines a touch level based on the pressing force of the object is provided. In this modification, the display method of the image displayed on the FMD 4 when the playback mode is set differs depending on the determination result of the touch level determination unit 511.

  FIG. 26 is a flowchart illustrating an outline of processing when the imaging device 5 is set to the reproduction mode. In this case, the imaging device 5 transmits a control signal for closing the shutter 221 to the FMD 4 (step S141). Subsequently, the imaging device 5 displays the thumbnail of the reproduced image designated by the input unit 14 on the display unit 13 (step S142).

  Thereafter, when the touch position determination unit 191 detects that an image is selected from the thumbnail-displayed images (step S143: Yes), the touch level determination unit 511 determines that the touch level is a light level. (Step S144: Yes), the imaging device 5 transmits the image data of the selected image and the thumbnail display instruction signal to the FMD 4 (Step S145). FIG. 27 is a diagram illustrating a display example of a playback image of the FMD 4 according to the thumbnail display instruction signal. In this case, the liquid crystal display unit 222 displays the reproduced image 222e at the same position as the display position on the display unit 13.

  On the other hand, when the touch position determination unit 191 detects that an image is selected from the thumbnail-displayed images (step S143: Yes), the touch level determination unit 511 determines that the touch level is the heavy level. (Step S144: No), the imaging device 5 transmits the image data of the selected reproduction image and the enlarged display instruction signal to the FMD 4 (Step S146). In this case, the image displayed on the liquid crystal display unit 222 is the reproduced image 222d shown in FIG.

  A process performed by the imaging device 5 when no image is selected in step S143 (step S143: No) or after step S145 or S146 will be described. In this case, when a signal for ending reproduction is input by the input unit 14 (step S147: Yes), the imaging device 5 transmits a control signal for closing the shutter 221 to the FMD 4 (step S148), and ends a series of processing. . On the other hand, when the signal to end reproduction is not input by the input unit 14 (step S147: No), the imaging device 5 returns to step S132.

  According to the modified example of the second embodiment described above, in addition to the same effects as those of the second embodiment described above, the display according to the touch level can be performed by the FMD 4, and the user can change the display mode according to the touch level. It can be adjusted and displayed in a desired form.

(Embodiment 3)
FIG. 28 is a block diagram showing a configuration of an imaging system according to Embodiment 3 of the present invention. The imaging system 300 shown in the figure includes two imaging devices 6 and an FMD 4 that can communicate with each imaging device 6 and displays information including an image captured by each imaging device 6.

  The imaging device 6 has the same configuration as that of the imaging device 1 described above except for the configuration of the control unit 61. The control unit 61 includes a contact position detection unit 191, an operation determination unit 192, and a vertical / horizontal determination unit 611 that determines a direction substantially parallel to the bottom surface of the imaging device 6 among the horizontal direction and the vertical direction.

  FIG. 29 is a diagram illustrating a situation where the user performs shooting using the imaging system 300 having the above configuration. In the third embodiment, the user photographs the imaging device 6 side by side. In FIG. 29, the imaging device 6 positioned on the right side when viewed from the user is described as “imaging device 6R”, while the imaging device 6 positioned on the left side when viewed from the user is described as “imaging device 6L”.

FIG. 30 is a diagram of a situation where the user has two imaging devices 6R and 6L as viewed from the user. FIG. 31 is a diagram showing a display example of an image displayed on the liquid crystal display unit 222 under the situation shown in FIG. As shown in FIG. 30, when the user holds the display unit 13R of the imaging device 6R and the display unit 13L of the imaging device 6L with the right and left thumbs in contact with each other, the liquid crystal display unit 222 is Release button SI-R together with through image 222R of 6R, through image 222L of imaging device 6L, right finger position display image f _R indicating the contact position of the right finger, and left finger position display image f _L indicating the contact position of the left finger , SI-L is superimposed. The user moves the right thumb so that the right finger position display image f _R matches the release button SI-R while viewing the image shown in FIG. while performing, after the left finger position display image f _L moves the left thumb to match the release button SI-L, it performs photographing by the imaging device 6L by pressing.

  FIG. 32 is a flowchart illustrating an outline of processing when the imaging device 6 is set to the shooting mode. As a result of detecting the attitude of the imaging device 6 by the sensor unit 15, when the imaging device 6 is in a shootable state (step S 151: Yes), the imaging device 6 transmits a control signal for closing the shutter to the FMD 4 (step S 152).

  Subsequently, the vertical / horizontal determination unit 611 performs vertical / horizontal determination of the orientation of the imaging device 6 (step S153). Here, the vertical / horizontal determination unit 611 calculates, for example, each angle between the bottom surface of the imaging device 6 and the horizontal direction and the vertical direction, and determines that the calculated angle is held in a small direction. Subsequently, the imaging device 6 performs exposure calculation (step S154) and focus adjustment (step S155).

  After that, when the contact position detection unit 191 detects an object such as a finger that contacts the display unit 13 and the contact position of the object (step S156: Yes), the imaging device 6 displays the vertical / horizontal information indicating the determination result by the vertical / horizontal determination unit 611. The object contact position information and the image data of the through image are transmitted to the FMD 4 (step S157). On the other hand, when the contact position detection unit 191 does not detect the position of the object in contact with the display unit 13 (step S156: No), the imaging device 6 proceeds to step S158 described later.

  If the release button 14a is pressed in step S158 (step S158: Yes), the imaging device 6 transmits release operation information indicating that the release button 14a has been pressed to the FMD 4 (step S159). On the other hand, when the release button 14a is not pressed in step S158 (step S158: No), the imaging device 6 proceeds to step S165 described later.

  When the collation result between the release operation information and the display state is received from the FMD 4 within a predetermined time after the release operation information is transmitted to the FMD 4 (step S160: Yes), when the collation result is “normal” (step S160). In step S161: Yes), the imaging device 6 captures an image (step S162), and then records the captured image in the image data storage unit 171 (step S163) and transmits it to the FMD 4 (step S164).

  If a photographing end signal is input by the input unit 14 within a predetermined time after step S164 (step S165: Yes), the imaging device 6 transmits a control signal for opening the shutter 221 to the FMD 4 (step S166), and a series of steps. The process ends. On the other hand, after step S164, when the imaging end signal is not input by the input unit 14 within the predetermined time (step S165: No), the imaging device 6 returns to step S151.

  When the collation result between the release operation information and the display state is not received from the FMD 4 within a predetermined time after transmitting the release operation information (step S160: No), and the collation result received from the FMD 4 is not “normal” (Step S161: No), the imaging device 6 proceeds to Step S166.

  FIG. 33 is a flowchart showing an outline of the processing of FMD4. In the following description, it is assumed that the FMD 4 is turned on. When the FMD 4 receives a control signal for closing the shutter from the two imaging devices 6R and 6L (step S171: Yes), the FMD 4 closes the shutter 221 (step S172).

  In steps S173 to S189, the FMD 4 performs processes based on communication with the imaging devices 6R and 6L simultaneously in parallel. Hereinafter, the through image displayed on the display unit 13R of the imaging device 6R is referred to as a “right through image”, and the through image displayed on the display unit 13L of the imaging device 6L is referred to as a “left through image”. The release operation information transmitted from the imaging device 6R to the FMD 4 is referred to as “right release operation information”, and the release operation information transmitted from the imaging device 6L to the FMD 4 is referred to as “left release operation information”. An image captured by the imaging device 6R is referred to as a “right captured image”, and an image captured by the imaging device 6L is referred to as a “left captured image”.

  When the FMD 4 receives the image data of the right through image, the contact position information of the object, and the vertical / horizontal information (step S173: Yes), the liquid crystal display unit 222 displays the right through image and the contact position of the object (finger position display image) and the release. The button SI-R is displayed in an overlapping manner (step S174).

  Thereafter, when the right release operation information is received from the imaging device 6R (step S175: Yes), the collation unit 411 collates the right release operation information with the display state (step S176), and transmits the collation result to the imaging device 6R. (Step S177).

  When the collation result by the collation unit 411 is “normal” (step S178: Yes), when the image data of the right photographed image is received within a predetermined time after the collation result is transmitted to the imaging device 6R (step S179: Yes), the liquid crystal display unit 222 displays the right captured image received from the imaging device 6R (step S180). Thereafter, the FMD 4 proceeds to step S190 described later.

  When the FMD 4 has not received the image data of the right through image, the contact position information of the object, and the vertical / horizontal information of the imaging device 6R (step S173: No), and has not received the right release operation information from the imaging device 6R ( In step S175: No), the FMD 4 proceeds to step S190.

  When the collation result by the collation unit 411 is not “normal” (step S178: No), and when the image data of the right photographed image is not received from the imaging device 6R within a predetermined time after the collation result is transmitted (step S179). : No), the liquid crystal display unit 222 performs error display in the area where the right through image is displayed (step S181). Thereafter, the FMD 4 proceeds to step S190.

  So far, the processing (steps S173 to S180) performed by the FMD 4 based on communication with the imaging device 6R has been described, but the processing (steps S182 to S189) performed by the FMD 4 based on communication with the imaging device 6L is the same. is there.

  The process after step S190 is demonstrated. In step S190, when the control signal for opening the shutter 221 is received from the imaging devices 6R and 6L (step S190: Yes), the FMD 4 opens the shutter 221 (step S191), and the series of processing ends. On the other hand, when the control signal for opening the shutter 221 is not received from at least one of the imaging devices 6R and 6L (step S190: No), the FMD 4 returns to the position before steps S173 and S182.

  According to Embodiment 3 of the present invention described above, when operating the imaging device 6 that can be operated by external contact on the display unit 13, it can be worn on the head of a person. Since the FMD 4 that displays an image in the vicinity of the eye of the person wearing it displays an operation button image and also displays the contact position of the object that is in contact with the display unit 13 of the imaging device 6, the user can display the FMD 4. Operation input can be performed while looking at the screen. Therefore, the user can not only view an image equivalent to a large screen regardless of the surrounding environment, but also enjoy excellent operability.

  Further, according to the third embodiment, when the two imaging devices 6L and 6R are photographed at the same time, the FMD 4 can shoot while comparing the images photographed by the imaging devices 6L and 6R. A variety of images can be taken.

(Embodiment 4)
FIG. 34 is a block diagram showing a configuration of an imaging system according to Embodiment 4 of the present invention. The imaging system 400 shown in the figure includes two imaging devices 7 and an FMD 8 that can communicate with each imaging device 7 and displays information including an image captured by the imaging device 7. The imaging system 400 has a function of performing 3D imaging using the two imaging devices 7. Specifically, the two imaging devices 7 can communicate with each other, and can set a cooperative shooting mode in which the other imaging device 7 also performs shooting in accordance with a release signal input from one imaging device 7.

  The imaging device 7 includes an imaging unit 11, an image processing unit 12, a display unit 13, an input unit 14, a sensor unit 15, a clock 16, a storage unit 17, a control unit 31, and an imaging side communication unit 71. The imaging side communication unit 71 can communicate with the FMD 8 and can also communicate with other imaging devices 7.

  The FMD 8 includes a display side communication unit 21, an image display unit 81, a storage unit 82, and a control unit 83. The storage unit 82 includes a button image storage unit 231 and an image data storage unit 821 that stores image data. The control unit 83 compares the comparison unit 411, the comparison unit 831 that compares the exposure calculation results transmitted from the two imaging devices 7, and the image data of the captured images transmitted from the two imaging devices 7. A 3D determination unit 832 that determines whether or not 3D shooting is possible.

  FIG. 35 is a diagram showing an external configuration and functions of the FMD 8. As shown in FIG. The image display unit 81 of the FMD 8 includes a right display unit 8R provided on the right eye side and a left display unit 8L provided on the left eye side. Among these, the right display unit 8R includes a shutter 811R, a liquid crystal display unit 812R, and an optical system 813R. The left display unit 8L includes a shutter 811L, a liquid crystal display unit 812L, and an optical system 813L. The liquid crystal display units 812R and 812L have the same configuration as the liquid crystal display unit 222, and the optical systems 813R and 813L have the same configuration as the optical system 223 (see FIG. 7). The control unit 83 is connected to the right display unit 8R and the left display unit 8L. The left display portion 8L is rotatable with respect to the frame 8f. At the time of shooting, as shown in the lower drawing of FIG. 35, the left display portion 8L is rotated upward with the upper side portion of the frame 8f as the rotation axis. By fixing in the lifted state, the left eye can directly see the outside.

  FIG. 36 is a diagram illustrating a display example of an initial image that is first displayed by the liquid crystal display unit 812R when the two imaging devices 7 are set to the cooperative shooting mode. In FIG. 36, it is assumed that the user's finger is not in contact with the display units 13R and 13L. In the state shown in FIG. 36, the liquid crystal display unit 812R superimposes the display buttons SI-R2 and SI-L2 as photographic buttons on the screen at symmetrical positions.

FIG. 37 is a diagram illustrating a display example of a screen displayed on the liquid crystal display unit 812R in a state where the user holds the two imaging devices 7 respectively. The case shown in FIG. 37, in the imaging device 7 user is poised with the left hand, since the left finger position display image f _L overlaps the display button SI-L2, are displayed left through image 812RL. In contrast, in the image pickup device 7 user is poised with the right hand, the right finger position display image f _R, since does not overlap with the display button SI-R2, right through image is not displayed.

When the right finger position display image f _R is adjusted to the position of the display button SI-R2 by moving the right finger from the state shown in FIG. 37, the liquid crystal display unit 812R also displays right through image 812RR. When the liquid crystal display unit 812R displays the left through image 812RL and the right through image 812RR, the comparison unit 831 determines whether the left through image 812RL and the right through image 812RR are suitable for the 3D image. As a result of this determination, when the left through image 812RL and the right through image 812RR are suitable for 3D images, the liquid crystal display unit 812R displays a message “3DOK” at the lower center of the screen. FIG. 38 is a diagram illustrating a state where the liquid crystal display unit 812R displays a message “3DOK” together with two through images.

  FIG. 39 is a flowchart illustrating an outline of processing when the imaging device 7 is set to the cooperative shooting mode. As a result of detecting the attitude of the imaging device 7 by the sensor unit 15, when the imaging device 7 is in a photographing enabled state (step S <b> 201: Yes), the imaging device 7 transmits a control signal for closing the shutter to the FMD 8 (step S <b> 202). Subsequently, the imaging device 7 performs exposure calculation (step S203) and focus adjustment (step S204). Thereafter, the imaging device 7 transmits the exposure calculation result to the FMD 8 (step S205).

  If an exposure control signal is received from the FMD 8 within a predetermined time after transmitting the exposure calculation result (step S206: Yes), the imaging device 7 corrects the exposure based on the received exposure control signal (step S207). On the other hand, if the exposure control signal is not received from the FMD 8 within a predetermined time after transmitting the exposure calculation result (step S206: No), the imaging device 7 proceeds to step S208 described later.

  In step S208, when the contact position detection unit 191 detects an object such as a finger that contacts the display unit 13 and the contact position of the object (step S208: Yes), the imaging device 7 detects the contact position information of the object and the through image. The image data is transmitted to the FMD 8 (step S209). On the other hand, when the contact position detection unit 191 does not detect the position of an object such as a finger that contacts the display unit 13 (step S208: No), the imaging device 7 proceeds to step S210 described later.

  In step S210, when the release button 14a is pressed (step S210: Yes), the imaging device 7 transmits a release signal to another imaging device 7 (step S211). Thereafter, the imaging device 7 captures an image (step S212), and then records the captured image in the image data storage unit 171 (step S213) and transmits it to the FMD 8 (step S214).

  If a photographing end signal is input by the input unit 14 within a predetermined time after step S214 (step S216: Yes), the imaging device 7 transmits a control signal for opening the shutter 811R to the FMD 8 (step S217), and a series of steps. The process ends. On the other hand, after step S214, when the imaging end signal is not input by the input unit 14 within a predetermined time (step S216: No), the imaging device 7 returns to step S201.

  In step S210, when the release button 14a is not pressed (step S210: No), when a release signal is received from another imaging device 7 (step S215: Yes), the imaging device 7 proceeds to step S212.

  When the imaging device 7 is not ready for photographing in step S201 (step S201: No), and when no release signal is received from another imaging device in step S215 (step S215: No), the imaging device 7 performs step S216. Migrate to

  FIG. 40 is a flowchart showing an outline of the processing of FMD8. In the following description, it is assumed that the FMD 8 is turned on. When the FMD 8 receives control signals for closing the shutters 811R and 811L from the two imaging devices 7 (step S221: Yes), the FMD 8 closes the shutters 811R and 811L (step S222), and the display button SI-R1 as shown in FIG. , SI-R2 is displayed (step S223). On the other hand, when the control signals for closing the shutters 811R and 811L are not received from the two imaging devices 7 (step S221: No), the FMD 8 repeats step S221.

  Thereafter, when the exposure calculation results are received from the two imaging devices 7 (step S224: Yes), the comparison unit 831 compares the two exposure calculation results (step S225). Subsequently, the FMD 8 transmits an exposure control signal generated based on the exposure calculation result to the two imaging devices 7 (step S226).

  Subsequently, when the image data of the through image and the contact position information of the object are received from the two imaging devices 7 (step S227: Yes), the contact position of the object, the contact position (finger position display image), and the display button are displayed. The through image on the overlapping side is displayed overlapping the display buttons SI-R1 and SI-R2 (step S228). For example, when the contact position and the display button overlap only in the left imaging device 7, an image as shown in FIG. 37 is displayed.

  When two through images are displayed in step S228 (step S229: Yes), the 3D determination unit 832 determines whether 3D shooting is possible by comparing the two through images (step S230). As a result of the determination, when the two through images satisfy the conditions for 3D shooting (step S231: Yes), the liquid crystal display unit 812R displays an OK display (step S232).

  When at least one of the two through images is not displayed in step S228 (step S229: No), if a predetermined time has elapsed since the start of step S228 (step S233: Yes), the imaging device 7 performs the step Return to S224. On the other hand, if the predetermined time has not elapsed since the start of step S228 (step S233: No), the imaging device 7 returns to step S228.

  Subsequent to step S232, when image data of a captured image is received from the two imaging devices 7 (step S234: Yes), the liquid crystal display unit 812R displays the received captured image (step S235), and the received captured image Image data is recorded in the image data storage unit 821 (step S236).

  After that, when control signals for opening the shutters 811R and 811L are received from the two imaging devices 7 (step S237: Yes), the FMD 8 opens the shutters 811R and 811L (step S238), and the series of processing ends. On the other hand, when the control signal for opening the shutters 811R and 811L is not received from at least one of the two imaging devices 7 (step S237: No), the FMD 8 returns to step S224.

  As a result of the determination by the 3D determination unit 832 in step S230, when at least one of the two through images does not satisfy the condition for performing 3D shooting (step S231: No), the liquid crystal display unit 812R performs error display (step S231). S239). Thereafter, the imaging device 7 proceeds to step S237.

  When image data of a captured image is not received from at least one of the two imaging devices 7 in step S234 (step S234: No), the imaging device 7 proceeds to step S237.

  Next, the case where the exposure calculation results are not received from the two imaging devices 7 (step S224: No) will be described. In this case, when a reproduction image display request is received from one of the imaging devices 7 (step S240: Yes), the FMD 8 reads a pair of image data stored in the storage unit 82, and each of the corresponding liquid crystal display units 812R, Displayed individually at 812L (step S241). At this time, the user changes the state of the FMD 8 to the state shown in the upper diagram of FIG. 35, that is, the state where the right display unit 8R and the left display unit 8L are positioned in front of the right eye and the left eye, respectively. Thereby, the user can see different images with both eyes, and can experience 3D display.

  On the other hand, when a reproduction image display request is not received from any of the imaging devices 7 (step S240: No), the FMD 8 proceeds to step S237.

  According to Embodiment 4 of the present invention described above, when operating the imaging device 7 that can be operated by external contact on the display unit 13, it can be worn on the head of a person. Since the FMD 8 that displays an image in the vicinity of the eyes of the person wearing it displays an operation button image and also displays the contact position of the object that is in contact with the display unit 13 of the imaging device 7, the user can display the FMD 8. Operation input can be performed while looking at the screen. Therefore, the user can not only view an image equivalent to a large screen regardless of the surrounding environment, but also enjoy excellent operability.

  Further, according to the fourth embodiment, 3D imaging using the two imaging devices 7 can be easily and reliably performed according to the display of the FMD 8.

(Other embodiments)
The embodiments for carrying out the present invention have been described in detail so far, but the present invention should not be limited only by the above-described four embodiments. For example, an imaging apparatus according to the present invention uses a transparent resistance film or the like for a display unit using a conventionally known liquid crystal, organic EL, plasma, or the like instead of including the above-described display unit with a built-in optical sensor. It is also possible to have a configuration in which touch panels realized in this way are stacked.

1, 3, 5, 6, 6L, 6R, 7 Imaging device 2, 4, 8 FMD
8f frame 8R right display unit 8L left display unit 11 imaging unit 12 image processing unit 13, 13L, 13R display unit 14 input unit 14a release button 15 sensor unit 16 clock 17, 23, 82 storage unit 18, 71 imaging side communication unit 19 , 24, 31, 41, 51, 61, 83 Control unit 21 Display side communication unit 22, 81 Image display unit 100, 200, 300, 400 Imaging system 131 Liquid crystal unit 132 Backlight 133 Optical sensor 171, 821 Image data storage unit 172 program storage unit 191 the contact position detection unit 192 operation determining unit 193,411 collating unit 221,811L, 811R shutter 222,812L, 812R liquid crystal display unit 222a, 222L, 222R through image 222b, f _L, f _R finger position display image 222c, 222d, 222e Raw images 223, 813L, 813R Optical system 223a Free-form surface prism 223b Half mirror coat 223c Correction prism 231 Button image storage unit 511 Touch level determination unit 611 Vertical / horizontal determination unit 812RL Left through image 812RR Right through image 831 Comparison unit 832 3D determination unit

Claims (14)

An imaging unit that images a subject and generates digital image data;
A display unit for displaying an image corresponding to the image data generated by the imaging unit;
An input unit that receives an input of an operation signal based on the contact of an object in the display unit;
A contact position detection unit for detecting a contact position of an object in the display unit;
An operation determination unit that determines an operation signal input according to the contact position of the object detected by the contact position detection unit;
A display device that can be worn on the head of a person and displays an image in the vicinity of the eyes of the worn person displays the image data, the contact position of the object detected by the contact position detection unit, and the display device. An imaging side communication unit that transmits a button display instruction signal indicating a power operation button and receives a display state signal indicating a display state in the display device from the display device;
A collation unit that collates the operation signal determined by the operation determination unit and the display state signal received by the imaging-side communication unit from the display device;
With
As a result of the collation performed by the collation unit, when the operation signal and the display state signal normally correspond to each other, processing according to the operation signal is performed. An imaging unit that images a subject and generates digital image data;
A display unit for displaying an image corresponding to the image data generated by the imaging unit;
An input unit that receives an input of an operation signal based on the contact of an object in the display unit;
A contact position detection unit for detecting a contact position of an object in the display unit;
An operation determination unit that determines an operation signal input according to the contact position of the object detected by the contact position detection unit;
For the display device that can be worn on the head of a person and displays an image in the vicinity of the eyes of the wearing person, the image data, the contact position of the object detected by the contact position detection unit, and the operation determination unit determine The operation content information corresponding to the operated signal and the button display instruction signal for instructing the operation button to be displayed on the display device are transmitted, while the operation content information and the display state on the display device are collated from the display device. An imaging side communication unit that receives
With
An image pickup apparatus that performs processing according to the operation signal when a collation result indicating that the operation content information and the display state on the display apparatus normally correspond from the display apparatus is received. The display unit
A liquid crystal unit formed by laminating a liquid crystal and a plurality of pixels;
A backlight for irradiating the liquid crystal part with light;
A plurality of optical sensors that are provided inside the liquid crystal unit and detect reflected light from the outside of the display unit of light irradiated by the backlight; and
Have
The contact position detector is
The imaging apparatus according to claim 1, wherein a contact position of the object on the display unit is detected based on a sensor signal output from the optical sensor. A storage unit for storing image data;
When reproducing an image corresponding to the image data stored in the storage unit,
The display unit
Display thumbnails with multiple images arranged,
The imaging side communication unit is
The imaging apparatus according to claim 1, wherein the contact position detection unit transmits image data of an image displayed at a position where the contact of the object is detected. The operation determination unit is
The pressing force of the contact position detected by the contact position detecting unit while the display unit is performing the thumbnail display is determined, and the size of the image to be displayed by the display device is determined according to the determined pressing force. The image pickup apparatus according to claim 4, wherein information about the length is added to the image data. A vertical / horizontal determination unit that determines a direction substantially parallel to the bottom surface of the imaging device in the horizontal direction and the vertical direction,
The imaging side communication unit is
The imaging apparatus according to claim 1, wherein a determination result of the vertical / horizontal determination unit is transmitted to the display device together with the contact position of the object and the button display instruction signal. A display device that can be mounted on a person's head and displays an image in the vicinity of the eyes of the person who wears the head,
An image display unit for displaying an image;
A button image storage unit for storing a button image of an operation button to be superimposed on the image display unit;
An imaging unit that images a subject and generates digital image data; a display unit that displays an image captured by the imaging unit; an input unit that receives an input of an operation signal based on contact of an object on the display unit; An imaging apparatus comprising: a contact position detection unit that detects a contact position of an object on the display unit; and an operation determination unit that determines an operation signal input according to the contact position of the object detected by the contact position detection unit. A display state indicating a display state in the image display unit while receiving the image data, a contact position of the object detected by the contact position detection unit, and a button display instruction signal indicating a button to be displayed on the display device A display-side communication unit that transmits a signal to the imaging device;
With
The image display unit
The button image storage unit based on the button display instruction signal received by the display side communication unit together with the image corresponding to the image data received by the display side communication unit and the contact position of the object detected by the contact position detection unit A display device that displays a button image read out from the display. A display device that can be mounted on a person's head and displays an image in the vicinity of the eyes of the person who wears the head,
An image display unit for displaying an image;
A button image storage unit for storing a button image of an operation button to be superimposed on the image display unit;
An imaging unit that images a subject and generates digital image data; a display unit that displays an image captured by the imaging unit; an input unit that receives an input of an operation signal based on contact of an object on the display unit; An imaging apparatus comprising: a contact position detection unit that detects a contact position of an object on the display unit; and an operation determination unit that determines an operation signal input according to the contact position of the object detected by the contact position detection unit. From the image data, the contact position of the object detected by the contact position detection unit, the operation content information corresponding to the operation signal determined by the operation determination unit, and the button display instruction signal indicating the button to be displayed on the display device Display-side communication unit that receives
A collation unit that collates operation content information received by the display side communication unit and display content on the display unit;
With
The image display unit
The button image storage unit based on the button display instruction signal received by the display side communication unit together with the image corresponding to the image data received by the display side communication unit and the contact position of the object detected by the contact position detection unit Displays the button image read from
The display-side communication unit
A display device that transmits a verification result in the verification unit to the imaging device. The display-side communication unit
Can communicate with the two imaging devices;
The image display unit
The display device according to claim 8, wherein images corresponding to image data received from each imaging device are displayed side by side. The two imaging devices can shoot in cooperation,
A 3D determination unit that determines whether or not 3D shooting by the two imaging devices is possible by comparing two image data respectively received from the two imaging devices. Item 10. The display device according to Item 9. An imaging system comprising: an imaging device that images a subject; and a display device that can be mounted on a person's head and can transmit and receive information to and from the imaging device and display an image in the vicinity of the eyes of the person Because
The imaging device
An imaging unit that images a subject and generates digital image data;
A display unit for displaying an image corresponding to the image data generated by the imaging unit;
An input unit that receives an input of an operation signal based on the contact of an object in the display unit;
A contact position detection unit for detecting a contact position of an object in the display unit;
An operation determination unit that determines an operation signal input according to the contact position of the object detected by the contact position detection unit;
The image data, the contact position of the object detected by the contact position detection unit, and a button display instruction signal for instructing an operation button to be displayed on the display device are transmitted to the display device. An imaging-side communication unit that receives a display state signal indicating a display state;
A collation unit that collates the operation signal determined by the operation determination unit and the display state signal received by the imaging-side communication unit from the display device;
With
As a result of collation by the collation unit, when the operation signal and the display state signal normally correspond to each other, processing according to the operation signal is performed.
The display device
An image display unit for displaying an image;
A button image storage unit for storing a button image of an operation button to be superimposed on the image display unit;
The image data, the contact position of the object detected by the contact position detection unit, and a button display instruction signal indicating a button to be displayed on the display device are received from the imaging device, and the display state on the image display unit is indicated. A display-side communication unit that transmits a display state signal to the imaging device;
With
The image display unit
The button image storage unit based on the button display instruction signal received by the display side communication unit together with the image corresponding to the image data received by the display side communication unit and the contact position of the object detected by the contact position detection unit An image pickup system for displaying a button image read out from a camera. An imaging system comprising: an imaging device that images a subject; and a display device that can be mounted on a person's head and can transmit and receive information to and from the imaging device and display an image in the vicinity of the eyes of the person Because
The imaging device
An imaging unit that images a subject and generates digital image data;
A display unit for displaying an image corresponding to the image data generated by the imaging unit;
An input unit that receives an input of an operation signal based on the contact of an object in the display unit;
A contact position detection unit for detecting a contact position of an object in the display unit;
An operation determination unit that determines an operation signal input according to the contact position of the object detected by the contact position detection unit;
The image data, the contact position of the object detected by the contact position detection unit, the operation content information corresponding to the operation signal determined by the operation determination unit, and the button display instruction signal indicating the operation button to be displayed on the display device An imaging side communication unit that transmits a result of collation between the operation content information and the display state of the display device from the display device while transmitting to the display device;
With
When receiving a collation result indicating that the operation content information and the display state on the display device normally correspond from the display device, perform processing according to the operation signal,
The display device
An image display unit for displaying an image;
A button image storage unit for storing a button image of an operation button to be superimposed on the image display unit;
The image data, the contact position of the object detected by the contact position detection unit, the operation content information corresponding to the operation signal determined by the operation determination unit, and the button display instruction signal indicating the button to be displayed on the display device A display-side communication unit that receives from the imaging device;
A collation unit that collates operation content information received by the display side communication unit and display content on the display unit;
With
The image display unit
The button image storage unit based on the button display instruction signal received by the display side communication unit together with the image corresponding to the image data received by the display side communication unit and the contact position of the object detected by the contact position detection unit Displays the button image read from
The display-side communication unit
An imaging system, wherein the verification result in the verification unit is transmitted to the imaging device. Two imaging devices;
The image display unit
13. The imaging system according to claim 12, wherein images corresponding to image data received from each imaging device are displayed side by side. The two imaging devices can shoot in cooperation,
The display device
A 3D determination unit that determines whether or not 3D shooting by the two imaging devices is possible by comparing the two image data respectively received by the reception-side communication unit from the two imaging devices; The imaging system according to claim 13.

Images