JP2014165893A - Head mounted display device and method for controlling head mounted display device - Google Patents

Abstract

Provided is a head-mounted display device that allows a user to visually recognize an image represented by display image data regardless of the color or brightness in an outside scene.
A transmissive head-mounted display device generates image light based on display image data and allows the user to visually recognize the image light while being mounted on a user's head. An image display unit that transmits the outside scene; an imaging unit that images the outside scene and generates outside scene image data representing the outside scene image; and at least a part of the display image data based on the characteristics of the viewing angle of the user An image data correction unit that selects data and corrects the selected data based on the outside scene image data.
[Selection] Figure 9

Description

  The present invention relates to a head-mounted display device.

  A head-mounted display device (Head Mounted Display, HMD) that is a display device mounted on the head is known. The head-mounted display device, for example, generates image light representing an image using a liquid crystal display and a light source, and guides the generated image light to a user's eye using a projection optical system or a light guide plate This causes the user to visually recognize the virtual image. There are two types of head-mounted display devices: a transmission type in which the user can visually recognize the outside scene in addition to a virtual image, and a non-transmission type in which the user cannot visually recognize the outside scene. The transmissive head-mounted display device includes an optical transmissive type and a video transmissive type.

  For example, in the head-mounted display device described in Patent Document 1, when the image light representing the supplied original image is guided to the user's eyes, the outside scene that the user sees through is captured, A technique has been disclosed in which a corrected image in which the brightness of the captured outside scene is adjusted is generated, and the generated corrected image and the original image are synthesized so that the user can visually recognize the original image without being confused with the outside scene.

JP 2010-177788 A

  However, in the technique described in Patent Document 1, a correction image is generated based on a captured outside scene, and image processing for combining the correction image and the original image is heavy, and the correction image and the original image are combined in real time. In some cases, it is difficult for the user to visually recognize the image. In addition, since the corrected image adjusts the brightness of the captured outside scene, the color of the original image may be different from the color visually recognized by the user. In addition, the conventional head-mounted display device has been desired to be reduced in size, cost, and usability.

  SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms.

(1) According to one aspect of the present invention, a transmissive head-mounted display device is provided. This head-mounted display device generates an image light based on display image data and allows the user to visually recognize the image light while being mounted on the user's head, and allows an image to pass through the outside scene. A display unit; an imaging unit that images an outside scene and generates outside scene image data representing the outside scene image; and at least a part of the display image data is selected based on characteristics of a viewing angle of a user An image data correction unit for correcting data selected based on the outside scene image data. According to the head-mounted display device, an image representing display image data can be visually recognized by a user regardless of the color and brightness in the outside scene. In addition, the image data correction unit can quickly correct the data corresponding to the image display area and allow the user to visually recognize an image representing the display image data in real time.

(2) In the head-mounted display device of the above aspect, the data selected by the image data correction unit is data of a portion corresponding to an image display region that is a region where the image display unit generates the image light. May be. According to this form of the head-mounted display device, the user can visually recognize an image representing the display image data regardless of the color or brightness in the outside scene. Further, since the image data correction unit does not need to correct the data in the unnecessary area, the image data correction unit quickly corrects the data corresponding to the image display area, and provides the user with an image representing the display image data in real time. It can be visually recognized.

(3) In the head-mounted display device of the above aspect, the image data correction unit is arranged in a peripheral portion of the image display area and an image generation possible area that is an area where the image display section can generate image light. It is not necessary to correct the data of the corresponding part. According to the head-mounted display device of this aspect, since the data is not corrected in the peripheral portion of the image generation possible region, display image data can be generated more quickly without performing unnecessary image processing. In addition, since the user visually recognizes the image representing the display image data whose data has been corrected at the center of the image generation possible region, the satisfaction of the user is improved.

(4) In the head-mounted display device according to the above aspect, the imaging unit captures an outside scene including an assumed gaze direction that is an assumed user's gaze direction; and the image data correction unit includes: The first angle of view is within 100 degrees with respect to each of the left and right sides of the assumed line-of-sight direction in the horizontal direction, and within 50 degrees with respect to the upper side and 75 degrees with respect to the lower side in the vertical direction. If the area exceeds the first area, the data corresponding to the area exceeding the first area need not be corrected. According to the head-mounted display device of this form, the data is corrected in the range of the widest stable gazing point visual field, so that the visibility of the user is improved.

(5) In the head-mounted display device according to the above aspect, the image data correction unit is configured such that the angle of view of the imaging unit is within 45 degrees with respect to each of the left and right sides from the assumed line-of-sight direction in the horizontal direction. When the direction exceeds the second region within 35 degrees with respect to the upper and lower directions from the assumed visual line direction, the data corresponding to the region exceeding the second region need not be corrected. According to the head-mounted display device of this embodiment, since the data is corrected in the range of the narrowest stable gazing point visual field, unnecessary image processing is not performed while maintaining the visibility of the user, Data can be corrected more quickly.

(6) In the head-mounted display device of the above aspect, the image data correction unit is configured such that the angle of view of the imaging unit is within 30 degrees with respect to each of the left and right from the assumed line-of-sight direction in the horizontal direction, and When the third region within 23 degrees with respect to the upper and lower directions from the assumed visual line direction in the direction is exceeded, the data corresponding to the region exceeding the third region may not be corrected. According to the head-mounted display device of this embodiment, the data corresponding to the image display area is corrected in the effective visual field having excellent information receiving ability, and the data is not corrected in the other visual field range. Image processing is not performed, and correction can be performed more quickly.

(7) In the head-mounted display device according to the above aspect, the imaging unit includes an assumed gaze direction that is an assumed user's gaze direction, and the angle of view of the imaging unit is the assumed gaze in a horizontal direction. Capturing an outside scene including a fourth region within 15 degrees with respect to each of the left and right directions and within 10 degrees with respect to each of the vertical directions in the vertical direction; Data of a portion corresponding to a peripheral portion in the fourth area and the image display area may be corrected. According to this form of the head-mounted display device, the user can easily view the image displayed in the maximum image display area, and convenience is improved.

(8) In the head-mounted display device according to the above aspect, the image data correction unit divides the outside scene image data into a plurality of regions, and an index value representing a color of each data in the plurality of regions is within a predetermined threshold value. In this case, the index value of each data in the plurality of areas may be replaced with the same index value. According to the head-mounted display device of this aspect, it is possible to make the user visually recognize an image with less influence of the outside scene image while suppressing the burden of image processing.

(9) In the head mounted display device of the above aspect, the image data correction unit generates corrected image data based on the supplied original image data and the outside scene image data; and the image display unit Image light may be generated based on the corrected image data as the image data for use. According to the head-mounted display device of this form, the user can visually recognize an image that is substantially the same as the image representing the original image data.

  A plurality of constituent elements of each embodiment of the present invention described above are not essential, and some or all of the effects described in the present specification are to be solved to solve part or all of the above-described problems. In order to achieve the above, it is possible to appropriately change, delete, replace with another new component, and partially delete the limited contents of some of the plurality of components. In order to solve some or all of the above-described problems or achieve some or all of the effects described in this specification, technical features included in one embodiment of the present invention described above. A part or all of the technical features included in the other aspects of the present invention described above may be combined to form an independent form of the present invention.

  For example, one embodiment of the present invention can be realized as an apparatus including one or more or all of the three elements of the image display unit, the imaging unit, and the image data correction unit. That is, this apparatus may or may not have an image display unit. Further, the apparatus may or may not have an image display unit. Further, the apparatus may or may not have an imaging unit. The apparatus may or may not have an image data correction unit. For example, the image display unit may generate image light based on the display image data so that the user can visually recognize the image light and transmit the outside scene while being mounted on the user's head. For example, the imaging unit may capture an outside scene and generate outside scene image data representing the outside scene image. The image data correction unit may select at least a part of the display image data based on the characteristics of the viewing angle of the user, and correct the selected data based on the outside scene image data. Such a device can be realized as, for example, a head-mounted display device, but can also be realized as a device other than the head-mounted display device. According to such a form, it is possible to solve at least one of various problems such as improvement and simplification of the operability of the device, integration of the device, and improvement of convenience of the user who uses the device. it can. Any or all of the technical features of each form of the head-mounted display device described above can be applied to this device.

  The present invention can also be realized in various forms other than the head-mounted display device. For example, a method for controlling a head-mounted display device, a head-mounted display system, a computer program for realizing the functions of the head-mounted display system, a recording medium on which the computer program is recorded, a carrier wave including the computer program It can be realized in the form of a data signal or the like embodied therein.

2 is an explanatory diagram showing an external configuration of a head-mounted display device 100. FIG. 3 is a block diagram functionally showing the configuration of the head-mounted display device 100. FIG. It is explanatory drawing which shows a mode that image light is inject | emitted by the image light production | generation part. It is explanatory drawing which shows the flow of a correction | amendment image display process. It is explanatory drawing which shows an example of the visual field VR visually recognized by the user. It is explanatory drawing which shows image IMG0 which original image data DT0 represents. It is explanatory drawing which shows an example of the RGB data of each pixel in corresponding | compatible outside scene image data DTsh. It is explanatory drawing which shows image IMG1 which the synthetic | combination image data DTc represents. It is explanatory drawing which shows an example of the visual field VR visually recognized by the user. It is explanatory drawing which shows an example of the visual field VR which the user in the 1st modification visually recognizes. It is explanatory drawing which shows an example of the visual field VR which the user in the 2nd modification visually recognizes.

Next, embodiments of the present invention will be described in the following order based on the embodiments.
A. Embodiment:
A-1. Configuration of head mounted display device:
A-2. Corrected image display processing:
A-3. Variation of the embodiment:
B. Variations:

A. Embodiment:
A-1. Configuration of head mounted display device:
FIG. 1 is an explanatory diagram showing an external configuration of the head-mounted display device 100. The head-mounted display device 100 is a display device mounted on the head, and is also called a head mounted display (HMD). The head-mounted display device 100 of the present embodiment is an optically transmissive head-mounted display device that allows a user to visually recognize a virtual image and at the same time directly view an outside scene. In this specification, a virtual image visually recognized by the user with the head-mounted display device 100 is also referred to as a “display image” for convenience. Further, emitting image light representing an image generated based on image data is also referred to as “displaying an image”.

  The head-mounted display device 100 includes an image display unit 20 that allows a user to visually recognize a virtual image when mounted on the user's head, and a control unit 10 (controller 10) that controls the image display unit 20. I have.

  The image display unit 20 is a mounting body that is mounted on the user's head, and has a glasses shape in the present embodiment. The image display unit 20 includes a right holding unit 21, a right display driving unit 22, a left holding unit 23, a left display driving unit 24, a right optical image display unit 26, a left optical image display unit 28, and a camera 61. And. The right optical image display unit 26 and the left optical image display unit 28 are arranged so as to be positioned in front of the right and left eyes of the user when the user wears the image display unit 20, respectively. One end of the right optical image display unit 26 and one end of the left optical image display unit 28 are connected to each other at a position corresponding to the eyebrow of the user when the user wears the image display unit 20.

  The right holding unit 21 extends from the end ER which is the other end of the right optical image display unit 26 to a position corresponding to the user's temporal region when the user wears the image display unit 20. It is a member. Similarly, the left holding unit 23 extends from the end EL which is the other end of the left optical image display unit 28 to a position corresponding to the user's temporal region when the user wears the image display unit 20. It is a member provided. The right holding unit 21 and the left holding unit 23 hold the image display unit 20 on the user's head like a temple of glasses.

  The right display drive unit 22 and the left display drive unit 24 are disposed on the side facing the user's head when the user wears the image display unit 20. Hereinafter, the right holding unit 21 and the left holding unit 23 are collectively referred to simply as “holding unit”, and the right display driving unit 22 and the left display driving unit 24 are collectively referred to simply as “display driving unit”. The right optical image display unit 26 and the left optical image display unit 28 are collectively referred to simply as “optical image display unit”.

  The display driving units 22 and 24 include liquid crystal displays 241 and 242 (hereinafter referred to as “LCDs 241 and 242”), projection optical systems 251 and 252 (see FIG. 2). Details of the configuration of the display driving units 22 and 24 will be described later. The optical image display units 26 and 28 as optical members include light guide plates 261 and 262 (see FIG. 2) and a light control plate. The light guide plates 261 and 262 are formed of a light transmissive resin material or the like, and guide the image light output from the display driving units 22 and 24 to the eyes of the user. The light control plate is a thin plate-like optical element, and is arranged so as to cover the front side of the image display unit 20 which is the side opposite to the user's eye side. The light control plate protects the light guide plates 261 and 262 and suppresses damage to the light guide plates 261 and 262 and adhesion of dirt. In addition, by adjusting the light transmittance of the light control plate, it is possible to adjust the amount of external light entering the user's eyes and adjust the ease of visual recognition of the virtual image. The light control plate can be omitted.

  The camera 61 is disposed at a position corresponding to the user's eyebrow when the user wears the image display unit 20. The camera 61 captures an outside scene that is an external scenery in a direction opposite to the user's eye side, and acquires an outside scene image. For this reason, the camera 61 captures a predetermined range centered on the assumed line-of-sight direction that is the front direction of the user wearing the image display unit 20, that is, the assumed line-of-sight direction of the user. The camera 61 generates RGB data as outside scene image data DTs representing an outside scene image. The camera 61 in the present embodiment is a monocular camera, but may be a stereo camera. The angle of view of the camera 61 used in this embodiment is 40 degrees vertically and 60 degrees horizontally on the same direction as the assumed line-of-sight direction. The camera 61 corresponds to the imaging unit in the claims. In general, it is known as a characteristic of a human viewing angle that a visual field that a human can visually recognize is about 200 degrees in the horizontal direction, 50 degrees in the upward direction in the vertical direction, and 75 degrees in the downward direction in the vertical direction. In addition, the effective visual field that is particularly excellent in the ability to accept information is approximately 30 degrees in the horizontal direction and approximately 20 degrees in the vertical direction. The horizontal range is 60 to 90 degrees, and the vertical direction is 45 to 70 degrees. On the other hand, when the human viewing angle is in the range of less than about 30 degrees in the horizontal direction and less than about 20 degrees in the vertical direction, it is difficult for the user to visually recognize the image displayed on the image display unit 20. The range of the visual field that can be visually recognized by humans, the range within the lower limit of the stable gazing point visual field, the range within the upper limit of the stable gazing point visual field, and particularly the range of the effective visual field that is excellent in information accepting ability, respectively. It corresponds to a visual field, a second visual field, a third visual field, and a fourth visual field.

  The image display unit 20 further includes a connection unit 40 for connecting the image display unit 20 to the control unit 10. The connection unit 40 includes a main body cord 48, a right cord 42, a left cord 44, and a connecting member 46 that are connected to the control unit 10. The right cord 42 and the left cord 44 are codes in which the main body cord 48 is branched into two. The right cord 42 is inserted into the casing of the right holding unit 21 from the distal end AP in the extending direction of the right holding unit 21 and connected to the right display driving unit 22. Similarly, the left cord 44 is inserted into the housing of the left holding unit 23 from the distal end AP in the extending direction of the left holding unit 23 and connected to the left display driving unit 24. The connecting member 46 is provided at a branch point between the main body cord 48, the right cord 42 and the left cord 44, and has a jack for connecting the earphone plug 30. A right earphone 32 and a left earphone 34 extend from the earphone plug 30.

  The image display unit 20 and the control unit 10 transmit various signals via the connection unit 40. A connector (not shown) that fits each other is provided at each of the end of the main body cord 48 opposite to the connecting member 46 and the control unit 10. By fitting / releasing the connector of the main body cord 48 and the connector of the control unit 10, the control unit 10 and the image display unit 20 are connected or disconnected. For the right cord 42, the left cord 44, and the main body cord 48, for example, a metal cable or an optical fiber can be adopted.

  The control unit 10 is a device for controlling the head-mounted display device 100. The control unit 10 includes a determination key 11, a lighting unit 12, a display switching key 13, a track pad 14, a luminance switching key 15, a direction key 16, a menu key 17, and a power switch 18. Yes. The determination key 11 detects a pressing operation and outputs a signal for determining the content operated by the control unit 10. The lighting unit 12 notifies the operation state of the head-mounted display device 100 by its light emission state. Examples of the operating state of the head-mounted display device 100 include power ON / OFF. For example, an LED (Light Emitting Diode) is used as the lighting unit 12. The display switching key 13 detects a pressing operation and outputs a signal for switching the display mode of the content video between 3D and 2D, for example. The track pad 14 detects the operation of the user's finger on the operation surface of the track pad 14 and outputs a signal corresponding to the detected content. As the track pad 14, various track pads such as an electrostatic type, a pressure detection type, and an optical type can be adopted. The luminance switching key 15 detects a pressing operation and outputs a signal for increasing or decreasing the luminance of the image display unit 20. The direction key 16 detects a pressing operation on a key corresponding to the up / down / left / right direction, and outputs a signal corresponding to the detected content. The power switch 18 switches the power-on state of the head-mounted display device 100 by detecting a slide operation of the switch.

  FIG. 2 is a block diagram functionally showing the configuration of the head-mounted display device 100. As shown in FIG. 2, the control unit 10 includes an input information acquisition unit 110, a storage unit 120, a power source 130, a wireless communication unit 132, an operation unit 135, a CPU 140, an interface 180, and a transmission unit 51 ( Tx51) and a transmission unit 52 (Tx52). The operation unit 135 receives an operation by the user and includes an enter key 11, a display switch key 13, a track pad 14, a luminance switch key 15, a direction key 16, a menu key 17, and a power switch 18.

  The input information acquisition unit 110 acquires a signal corresponding to an operation input by the user. As a signal corresponding to the operation input, for example, there is an operation input to the track pad 14, the direction key 16, and the power switch 18. The power supply 130 supplies power to each part of the head-mounted display device 100. As the power supply 130, for example, a secondary battery can be used. The storage unit 120 stores various computer programs. The storage unit 120 is configured by a ROM, a RAM, or the like. The CPU 140 reads out and executes a computer program stored in the storage unit 120, thereby operating as an operating system 150 (OS 150), an image processing unit 160, a display control unit 190, an audio processing unit 170, and an image data processing unit 165. Function.

  The image processing unit 160 acquires an image signal included in the content. The image processing unit 160 separates synchronization signals such as the vertical synchronization signal VSync and the horizontal synchronization signal HSync from the acquired image signal. Further, the image processing unit 160 generates a clock signal PCLK using a PLL (Phase Locked Loop) circuit or the like (not shown) according to the period of the separated vertical synchronization signal VSync and horizontal synchronization signal HSync. The image processing unit 160 converts the analog image signal from which the synchronization signal is separated into a digital image signal using an A / D conversion circuit or the like (not shown). Thereafter, the image processing unit 160 stores the converted digital image signal as image data Data (RGB data) of the target image in the DRAM in the storage unit 120 for each frame. Note that the image processing unit 160 may execute image processing such as various tone correction processing such as resolution conversion processing, brightness and saturation adjustment, and keystone correction processing on the image data as necessary. .

  The image processing unit 160 transmits the generated clock signal PCLK, vertical synchronization signal VSync, horizontal synchronization signal HSync, and image data Data stored in the DRAM in the storage unit 120 via the transmission units 51 and 52, respectively. To do. The image data Data transmitted via the transmission unit 51 is also referred to as “right eye image data”, and the image data Data transmitted via the transmission unit 52 is also referred to as “left eye image data”. The transmission units 51 and 52 function as a transceiver for serial transmission between the control unit 10 and the image display unit 20.

  The display control unit 190 generates control signals for controlling the right display drive unit 22 and the left display drive unit 24. Specifically, the display control unit 190 controls driving of the right LCD 241 by the right LCD control unit 211, driving ON / OFF of the right backlight 221 by the right backlight control unit 201, and left LCD control unit according to control signals. The left LCD 242 driving ON / OFF by 212, the left backlight 222 driving ON / OFF by the left backlight control unit 202, and the like are individually controlled. Thus, the display control unit 190 controls the generation and emission of image light by the right display driving unit 22 and the left display driving unit 24, respectively. For example, the display control unit 190 may cause both the right display driving unit 22 and the left display driving unit 24 to generate image light, generate only one image light, or neither may generate image light.

  The display control unit 190 transmits control signals for the right LCD control unit 211 and the left LCD control unit 212 via the transmission units 51 and 52, respectively. In addition, the display control unit 190 transmits control signals to the right backlight control unit 201 and the left backlight control unit 202, respectively.

  The audio processing unit 170 acquires an audio signal included in the content, amplifies the acquired audio signal, and a speaker (not shown) in the right earphone 32 and a speaker (not shown) connected to the connecting member 46 ( (Not shown). For example, when the Dolby (registered trademark) system is adopted, processing on the audio signal is performed, and different sounds with different frequencies or the like are output from the right earphone 32 and the left earphone 34, for example.

  The image data processing unit 165 performs various processes on RGB data that is image data representing an image. The image data processing unit 165 generates composite image data DTc obtained by combining the outside scene image data DTs and the original image data DT0 that is the image data of the content supplied via the interface 180. The image data processing unit 165 selects at least a part of the original image data DT0 based on the viewing angle characteristics. For example, when corresponding to an effective visual field that is particularly excellent in information receiving ability, the image data of the original image data DT0 corresponding to a range within about 30 degrees in the horizontal direction and within about 20 degrees in the vertical direction in the visual field of the user. Select. The image data processing unit 165 generates corrected image data DTa obtained by correcting the image data selected in the original image data DT0 based on the outside scene image data DTs. The corrected image data DTa is image data in which the selected image data becomes the same as the original image data DT0 when combined with the outside scene image data DTs. The image data processing unit 165 generates the corresponding outside scene image data DTsh from which a part of the outside scene image data DTs is deleted according to the range of the image data selected from the original image data DT0, and then generates the corrected image data DTa. Further, the image data processing unit 165 in the present embodiment corrects the RGB data of all the pixels to the same RGB data if the RGB data of each pixel in the outside scene image data DTs or the corresponding outside scene image data DTsh is within a predetermined threshold. The corrected outside scene image data DTsa is generated. When the corrected outside scene image data DTsa is generated, the image data processing unit 165 generates the corrected image data DTa using the corrected outside scene image data DTsa instead of the outside scene image data DTs or the corresponding outside scene image data DTsh. The image data processing unit 165 corresponds to the image data correction unit in the claims. The RGB data corresponds to an index value representing a color in the claims, and each pixel corresponds to a plurality of regions in the claims.

  The interface 180 is an interface for connecting various external devices OA that are content supply sources to the control unit 10. Examples of the external device OA include a personal computer (PC), a mobile phone terminal, and a game terminal. As the interface 180, for example, a USB interface, a micro USB interface, a memory card interface, or the like can be used.

  The image display unit 20 includes a right display drive unit 22, a left display drive unit 24, a right light guide plate 261 as a right optical image display unit 26, a left light guide plate 262 as a left optical image display unit 28, and a camera 61. And.

  The right display driving unit 22 includes a receiving unit 53 (Rx53), a right backlight control unit 201 (right BL control unit 201) and a right backlight 221 (right BL221) that function as a light source, and a right LCD that functions as a display element. A control unit 211, a right LCD 241 and a right projection optical system 251 are included. The right backlight control unit 201 and the right backlight 221 function as a light source. The right LCD control unit 211 and the right LCD 241 function as display elements. The right backlight control unit 201, the right LCD control unit 211, the right backlight 221 and the right LCD 241 are collectively referred to as “image light generation unit”.

  The receiving unit 53 functions as a receiver for serial transmission between the control unit 10 and the image display unit 20. The right backlight control unit 201 drives the right backlight 221 based on the input control signal. The right backlight 221 is a light emitter such as an LED or electroluminescence (EL). The right LCD control unit 211 drives the right LCD 241 based on the clock signal PCLK, the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the right-eye image data input via the reception unit 53. The right LCD 241 is a transmissive liquid crystal panel in which a plurality of pixels are arranged in a matrix.

  The right projection optical system 251 is configured by a collimator lens that converts the image light emitted from the right LCD 241 to light beams in a parallel state. The right light guide plate 261 as the right optical image display unit 26 guides the image light output from the right projection optical system 251 to the right eye RE of the user while reflecting the image light along a predetermined optical path. The right projection optical system 251 and the right light guide plate 261 are collectively referred to as “light guide unit”.

  The left display drive unit 24 has the same configuration as the right display drive unit 22. The left display driving unit 24 includes a receiving unit 54 (Rx54), a left backlight control unit 202 (left BL control unit 202) and a left backlight 222 (left BL202) that function as a light source, and a left LCD that functions as a display element. A control unit 212 and a left LCD 242 and a left projection optical system 252 are included. The left backlight control unit 202 and the left backlight 222 function as a light source. The left LCD control unit 212 and the left LCD 242 function as display elements. The left backlight control unit 202, the left LCD control unit 212, the left backlight 222, and the left LCD 242 are also collectively referred to as “image light generation unit”. The left projection optical system 252 is configured by a collimating lens that converts the image light emitted from the left LCD 242 into a light beam in a parallel state. The left light guide plate 262 as the left optical image display unit 28 guides the image light output from the left projection optical system 252 to the left eye LE of the user while reflecting the image light along a predetermined optical path. The left projection optical system 252 and the left light guide plate 262 are collectively referred to as “light guide unit”.

  FIG. 3 is an explanatory diagram illustrating a state in which image light is emitted by the image light generation unit. The right LCD 241 changes the transmittance of the light transmitted through the right LCD 241 by driving the liquid crystal at each pixel position arranged in a matrix, thereby changing the illumination light IL emitted from the right backlight 221 into an image. Is modulated into an effective image light PL representing The same applies to the left side. As shown in FIG. 3, the backlight system is adopted in the present embodiment, but the image light may be emitted using a front light system or a reflection system.

A-2. Corrected image display processing:
FIG. 4 is an explanatory diagram showing the flow of the corrected image display process. In the corrected image display processing, corrected image data DTa is generated based on the outside scene image data DTs and original image data DT0 generated by the image data processing unit 165 by imaging, and an image representing the corrected image data DTa is displayed on the image display unit 20. It is a displayed process.

  First, the camera 61 captures an outside scene (step S310). FIG. 5 is an explanatory diagram showing an example of the visual field VR visually recognized by the user. FIG. 5 shows a visual field VR, an outside scene SC, a maximum image display area PN that is the maximum area in which an image generated by the image display unit 20 can be displayed, and an imaging range RA1 captured by the camera 61. Yes. In FIG. 5, the user's assumed gaze direction is toward the sky, and the user visually recognizes the outside scene SC based on the color of the blue sky in the sky. As shown in FIG. 5, since the imaging range RA1 is larger than the maximum image display area PN, the camera 61 can image the outside scene SC that overlaps the image displayed in the maximum image display area PN. In FIG. 5, a rectangular line that is an outer frame of the maximum image display area PN and an outer frame of the imaging range RA <b> 1 is shown. However, this line is shown for convenience of explanation, and it is shown to the user. Is not visible. The maximum image display area PN corresponds to an image generation possible area in claims.

  Next, the image data processing unit 165 deletes unnecessary data that does not correspond to the maximum image display area PN from the data of the outside scene image data DTs (step S320 in FIG. 4). The maximum image display area PN shown in FIG. 5 corresponds to a viewing angle of 30 degrees in the horizontal direction of the user, and corresponds to a viewing angle of 20 degrees in the vertical direction of the user. In the present embodiment, the image data is corrected in all areas in the maximum image display area PN, that is, the angle of view of the camera 61 is within 15 degrees in each of the left and right directions and within 10 degrees in each of the up and down directions. The image data is corrected by. In other words, the image data is not corrected when the angle of view of the camera 61 exceeds 30 degrees in each of the left and right directions and exceeds 23 degrees in each of the vertical directions. The image data processing unit 165 generates corresponding outside scene image data DTsh from which the data corresponding to the area outside the maximum image display area PN is deleted from the outside scene image data DTs.

  Next, the image data processing unit 165 specifies the area of the corresponding outside scene image data DTsh corresponding to the image display area in which the display image is displayed in the maximum image display area PN (step S330 in FIG. 4). FIG. 6 is an explanatory diagram showing an image IMG0 represented by the original image data DT0. The image IMG0 shown in FIG. 6 is displayed in the entire area of the maximum image display area PN. Therefore, the image data processing unit 165 identifies the corresponding outside scene image data DTsh, which is the outside scene image data corresponding to the entire area of the maximum image display area PN, as the image data of the correction area for generating the correction image data DTa.

  Next, the image data processing unit 165 determines whether or not the RGB data of each pixel in the corresponding outside scene image data DTsh is within a predetermined threshold (step S340 in FIG. 4). FIG. 7 is an explanatory diagram showing an example of RGB data of each pixel in the corresponding outside scene image data DTsh. FIG. 7A shows the position and name of each pixel in the corresponding outside scene image data DTsh. FIG. 7B shows RGB data of each pixel. For example, the pixel px11 is the upper leftmost pixel in the corresponding outside scene image data DTsh, and the RGB data are 245, 245, and 160, respectively. In addition, the numerical value ranges of the RGB data of each pixel in the corresponding outside scene image data DTsh are 240 to 255, 235 to 250, and 155 to 165, and the average values of the RGB data are 247, 240, and 160, respectively. . In the present embodiment, when all the differences between the maximum value and the minimum value in each of the RGB data are within 20 set as the threshold values in advance (step S340: YES in FIG. 4), the image data processing unit 165 Replaces the RGB data of each pixel in the corresponding outside scene image data DTsh with the average value 247, 240, 160 of each pixel (step S350). After the image data processing unit 165 generates the corrected outside scene image data DTsa in which the RGB data of each pixel is replaced, the image data processing unit 165 generates the composite image data DTc based on the corrected outside scene image data DTsa and the original image data DT0. Generate (step S350).

  In the process of step S340, when the difference between the maximum value and the minimum value of each of the RGB data of the corresponding outside scene image data DTsh exceeds the threshold value (step S340: NO), the image data processing unit 165 responds. The synthesized image data DTc is generated based on the corresponding outside scene image data DTsh and the original image data DT0 without replacing the RGB data of each pixel in the outside scene image data DTsh with the average value (step S350). In other embodiments, the threshold value may not be 20, but may be another value or may not be set.

  FIG. 8 is an explanatory diagram showing an image IMG1 represented by the composite image data DTc. Each pixel in the composite image data DTc in which the corrected outside scene image data DTsa and the original image data DT0 overlap is different from the RGB data of each pixel in the original image data DT0. Therefore, as shown in FIG. 8, when the image IMG0 is displayed in the maximum image display area PN, the user sees the image IMG1 instead of the image IMG0.

  Next, in order to make the user visually recognize the image IMG0, the image data processing unit 165 generates the corrected image data DTa and displays the image IMG2 representing the corrected image data DTa in the maximum image display area PN (step S370). ). When the corrected outside scene image data DTsa and the corrected image data DTa are overlapped, the image data processing unit 165 generates corrected image data DTa of RGB data that is substantially the same as the RGB data of the original image data DT0. The image display unit 20 displays the image IMG2 in the maximum image display area PN.

  FIG. 9 is an explanatory diagram illustrating an example of the visual field VR visually recognized by the user. As shown in FIG. 9, image light is generated in all areas in the maximum image display area PN based on the corrected image data DTa, and an image generated based on the outside scene representing the outside scene image data DTs and the corrected image data DTa. Light overlaps. Therefore, the user visually recognizes an image IMG0a that is substantially the same as the image IMG0.

  As described above, in the head-mounted display device 100 according to the present embodiment, the image data processing unit 165 selects at least a part of the original image data DT0 based on the viewing angle characteristics. . The image data processing unit 165 generates corrected image data DTa obtained by correcting the image data selected in the original image data DT0 based on the outside scene image data DTs. Therefore, in the head-mounted display device 100 according to the present embodiment, the user can visually recognize the image IMG0 or the image IMG0a representing the original image data DT0 regardless of the color or brightness in the outside scene. In addition, the image data processing unit 165 generates the corrected image data DTa according to the viewing angle that can be visually recognized by the user and the effective visual field that the user wants to visually recognize as necessary. Good. Therefore, in the head-mounted display device 100 according to the present embodiment, the corrected image data DTa can be quickly generated, and the user can visually recognize the image IMG0a in real time.

  In the head-mounted display device 100 according to the present embodiment, data of a portion corresponding to an area for generating image light based on the original image data DT0 in the maximum image display area PN is generated based on the outside scene image data DTs. The corrected image data DTa is corrected. Therefore, in the head-mounted display device 100 according to the present embodiment, the image data processing unit 165 corrects the corrected image data DTa only for an area where image light is generated based on the original image data DT0 in the maximum image display area PN. Therefore, it is not necessary to correct the image data of the unnecessary area. Therefore, in the head-mounted display device 100 according to the present embodiment, the corrected image data DTa can be quickly generated, and the user can visually recognize the image IMG0a in real time.

  In the head-mounted display device 100 according to the present embodiment, the angle of view of the camera 61 is 40 degrees vertically and 60 degrees horizontally on the same direction as the assumed line-of-sight direction. That is, the image data is not corrected when the angle of view of the camera 61 exceeds 30 degrees in each of the left and right directions and exceeds 23 degrees in each of the vertical directions. Therefore, in the head-mounted display device 100 according to the present embodiment, the corrected image data DTa is generated in the effective field of view with excellent information receiving ability, and the corrected image data DTa is generated in the other field of view range. The corrected image data DTa can be generated more quickly without performing the above. Further, in the head-mounted display device 100 according to the present embodiment, the corrected image data DTa is generated in a region having a viewing angle of 30 degrees or more in the horizontal direction and a viewing angle of 20 degrees or more in the vertical direction that is difficult for the user to visually recognize. Thus, the user can easily view the image displayed in the maximum image display area PN, and convenience is improved.

  Further, in the head-mounted display device 100 according to the present embodiment, when all the differences between the maximum value and the minimum value of each of the RGB data are within 20 set as threshold values in advance, the image data processing unit 165 replaces the RGB data of each pixel in the corresponding outside scene image data DTsh with the same average value of each pixel. Therefore, in the head-mounted display device 100 according to the present embodiment, it is possible to make the user visually recognize an image with less influence of the outside scene image while suppressing the burden of image processing.

A-3. Variation of the embodiment:
In the above embodiment, the maximum image display area PN corresponds to the viewing angle 30 degrees in the horizontal direction and the viewing angle 20 degrees in the vertical direction of the user, and the outside scene image data corresponding to the viewing angle not corresponding to the maximum image display area PN. Although the corrected image data is generated by deleting, the region where the corrected image data DTa is generated can be variously modified as shown in the following first and second modifications, for example.

A-3-1. First modification:
In the first modification, the angle of view of the camera 61a and the angle corresponding to the viewing angle of the user of the maximum image display area PNa are different from the embodiment, and the other configurations are the same. In the first modification, the angle of view of the camera 61a is 90 degrees vertically and 90 degrees horizontally on the same direction as the assumed line-of-sight direction. The maximum image display area PNa corresponds to a viewing angle of 150 degrees in the horizontal direction of the user and corresponds to a viewing angle of 100 degrees in the vertical direction of the user.

  FIG. 10 is an explanatory diagram illustrating an example of the visual field VR visually recognized by the user in the first modification. FIG. 10A shows an outside scene SC, a corrected image generation area CA1, and a maximum image display area PNa. The corrected image generation area CA1 corresponds to a viewing angle of 90 degrees in the horizontal direction of the user, and corresponds to a viewing angle of 70 degrees in the vertical direction of the user. In the first modification, the corrected image data DTa is generated within the corrected image generation area CA1, and the corrected image data DTa is generated outside the corrected image generation area CA1 and within the maximum image display area PNa. Is not generated. Therefore, the image IMG0a is visually recognized by the user in the corrected image generation area CA1, and the image IMG1 is visually recognized by the user outside the area of the corrected image generation area CA1 and in the area of the maximum image display area PNa.

  FIG. 10B shows an outside scene SC, a corrected image generation area CA2, and a maximum image display area PNa. The corrected image generation area CA2 corresponds to a viewing angle of 60 degrees in the horizontal direction of the user, and corresponds to a viewing angle of 45 degrees in the vertical direction of the user. In the first modification, the corrected image data DTa is generated within the corrected image generation area CA2, and the corrected image data DTa is generated outside the corrected image generation area CA2 and within the maximum image display area PNa. Is not generated. Therefore, the image IMG0a is visually recognized by the user in the corrected image generation area CA2, and the image IMG1 is visually recognized by the user outside the area of the corrected image generation area CA2 and within the area of the maximum image display area PNa.

  In FIGS. 10A and 10B, the corrected image data DTa is not generated in the periphery of the maximum image display area PNa. In the first modification, the peripheral portion of the maximum image display area PNa is a case where the maximum image display area PNa is divided into four parts in the vertical and horizontal directions, and the maximum image display area PNa is divided into 16 areas. This refers to the outer 12 regions excluding the middle 4 regions. That is, the outer 25% of the maximum image display area PNa in the upper, lower, left and right directions may be different ratios in other embodiments. When the ratio of the peripheral part in the maximum image display area PNa is reduced, the visibility of the user is improved. Therefore, the peripheral part in the maximum image display area PNa is 10% or less in each of the top, bottom, left and right of the maximum image display area PNa. And more preferred. It should be noted that the peripheral portion of the maximum image display area PNa that is an area where the corrected image data DTa is not generated is not necessarily provided vertically and horizontally, and may be provided only vertically and horizontally.

  In the head-mounted display device 100a according to the first modification, the corrected image data DTa is not generated in the peripheral portion of the maximum image display area PNa, so that the corrected image data DTa can be more quickly performed without performing unnecessary image processing. Can be generated. Further, since the image IMG0a is visually recognized by the user at the center of the maximum image display area PNa, the user's satisfaction is improved. Further, as shown in FIG. 10A, in the head-mounted display device 100a according to the first modified example, the corrected image data DTa is generated in the range of the widest stable gazing point visual field. Visibility is improved.

A-3-2. Second modification:
In the second modified example, the position of the image IMG0a in the maximum image display area PNa is different from the first modified example, and the other configurations are the same as those in the first modified example. FIG. 11 is an explanatory diagram illustrating an example of a visual field VR visually recognized by the user in the second modification. FIG. 11 shows the outside scene SC, the corrected image generation area CA3, and the maximum image display area PNa. In the second modification, the position where the image IMG0a is displayed in the maximum image display area PNa is specified, and the corrected outside scene image data DTsa is generated based only on the outside scene image data DTs corresponding to the specified position. Therefore, the head-mounted display device 100a according to the second modification can generate the corrected image data DTa more quickly without performing image processing on the pixels on which the image IMG0a is not displayed in the maximum image display area PNa.

  Further, in the head-mounted display device 100a in the second modified example, as shown in FIG. 11, the corrected image data DTa is generated in the range of the narrowest stable gazing point visual field. Thus, the corrected image data DTa can be generated more quickly without unnecessary image processing.

B. Variations:
In addition, this invention is not limited to the said embodiment, It can implement in a various aspect in the range which does not deviate from the summary, For example, the following deformation | transformation is also possible.

B1. Modification 1:
In the above embodiment, the image data processing unit 165 generates the corrected image data DTa to be displayed in the maximum image display area PN so that the user can visually recognize the image IMG0a. However, the image data processing unit 165 performs the correction. Various modifications can be made. For example, the image data processing unit 165 may perform correction for setting the transmittance of the outside scene SC transmitted by the image display unit 20 and the luminance of the image data.

  In the above embodiment, the image data processing unit 165 generates the corrected image data DTa after generating the composite image data DTc. However, the generation method of the corrected image data DTa is not limited to this, and various modifications can be made. It is. For example, the image data processing unit 165 may generate the corrected image data DTa based on the outside scene image data DTs and the original image data DT0 that are captured and generated.

B2. Modification 2:
For example, the image light generation unit may include an organic EL (Organic Electro-Luminescence) display and an organic EL control unit. Further, for example, the image generation unit may use LCOS (Liquid crystal on silicon, LCoS is a registered trademark), a digital micromirror device, or the like instead of the LCD. Further, for example, the present invention can be applied to a laser retinal projection type head mounted display. In the case of the laser retinal projection type, the “image light emitting area in the image light generation unit” can be defined as an image area recognized by the user's eyes.

  Further, for example, the head-mounted display may be a head-mounted display in which the optical image display unit covers only a part of the user's eye, in other words, the optical image display unit does not completely cover the user's eye. Good. The head mounted display may be a so-called monocular type head mounted display.

  Further, the earphone may be an ear-hook type or a headband type, or may be omitted. Further, for example, it may be configured as a head mounted display mounted on a vehicle such as an automobile or an airplane. Further, for example, it may be configured as a head-mounted display built in a body protective device such as a helmet.

B3. Modification 3:
The configuration of the head-mounted display device 100 in the above embodiment is merely an example and can be variously modified. For example, one of the direction key 16 and the track pad 14 provided in the control unit 10 may be omitted, in addition to the direction key 16 and the track pad 14, or in place of the direction key 16 and the track pad 14, etc. An operation interface may be provided. Moreover, the control part 10 is a structure which can connect input devices, such as a keyboard and a mouse | mouth, and is good also as what receives an input from a keyboard or a mouse | mouth.

  As the image display unit, instead of the image display unit 20 worn like glasses, another type of image display unit such as an image display unit worn like a hat may be adopted. The earphones 32 and 34 can be omitted as appropriate. Moreover, in the said embodiment, although LCD and a light source are utilized as a structure which produces | generates image light, it replaces with these and you may employ | adopt other display elements, such as an organic EL display. In the above embodiment, the head-mounted display device 100 is a binocular optical transmission type. However, the present invention can be applied to other types of head-mounted display such as a video transmission type and a monocular type. The same applies to the apparatus.

  In the above-described embodiment, the head-mounted display device 100 may guide image light representing the same image to the left and right eyes of the user so that the user can visually recognize the two-dimensional image. It is also possible to guide the user to view the three-dimensional image by guiding image light representing different images to the eyes.

  In the above embodiment, a part of the configuration realized by hardware may be replaced by software, and conversely, a part of the configuration realized by software may be replaced by hardware. Good. For example, in the above-described embodiment, the image processing unit 160 and the sound processing unit 170 are realized by the CPU 140 reading and executing a computer program, but these functional units may be realized by a hardware circuit. Good.

  In addition, when part or all of the functions of the present invention are realized by software, the software (computer program) can be provided in a form stored in a computer-readable recording medium. In the present invention, the “computer-readable recording medium” is not limited to a portable recording medium such as a flexible disk or a CD-ROM, but an internal storage device in a computer such as various RAMs and ROMs, a hard disk, etc. It also includes an external storage device fixed to the computer.

  Moreover, in the said embodiment, as shown in FIG. 1 and FIG. 2, the control part 10 and the image display part 20 are formed as a separate structure, However, about the structure of the control part 10 and the image display part 20, about. However, the present invention is not limited to this, and various modifications are possible. For example, all of the components formed in the control unit 10 may be formed inside the image display unit 20 or a part thereof may be formed. In addition, the power source 130 in the above embodiment may be formed independently and replaceable, or the configuration formed in the control unit 10 may be overlapped and formed in the image display unit 20. For example, the CPU 140 shown in FIG. 2 may be formed in both the control unit 10 and the image display unit 20, or a function performed by the CPU 140 formed in the control unit 10 and the CPU formed in the image display unit 20. May be configured separately.

  Further, the control unit 10 may be built in a personal computer (PC), and the image display unit 20 may be used instead of the PC monitor, or the control unit 10 and the image display unit 20 may be integrated. Further, it may be an embodiment of a wearable computer attached to a user's clothes.

  The present invention is not limited to the above-described embodiments and modifications, and can be realized with various configurations without departing from the spirit of the present invention. For example, the technical features in the embodiments and the modifications corresponding to the technical features in each form described in the summary section of the invention are to solve some or all of the above-described problems, or In order to achieve part or all of the effects, replacement or combination can be performed as appropriate. Further, if the technical feature is not described as essential in the present specification, it can be deleted as appropriate.

DESCRIPTION OF SYMBOLS 10 ... Control part 11 ... Decision key 12 ... Illumination part 13 ... Display switching key 14 ... Trackpad 15 ... Luminance switching key 16 ... Direction key 17 ... Menu key 18 ... Power switch 20 ... Image display part 21 ... Right holding part 22 ... Right display drive unit 23 ... Left holding unit 24 ... Left display drive unit 26 ... Right optical image display unit 28 ... Left optical image display unit 30 ... Earphone plug 32 ... Right earphone 34 ... Left earphone 40 ... Connection unit 42 ... Right cord 44 ... Left code 46 ... Connecting member 48 ... Body code 51 ... Transmitting part 52 ... Transmitting part 53 ... Receiving part 54 ... Receiving part 61 ... Camera (imaging part)
DESCRIPTION OF SYMBOLS 100 ... Head-mounted display apparatus 110 ... Input information acquisition part 120 ... Memory | storage part 130 ... Power supply 132 ... Wireless communication part 135 ... Operation part 140 ... CPU
150 ... Operating system 160 ... Image processing unit 165 ... Image data processing unit (image data correction unit)
170 ... Audio processing unit 180 ... Interface 190 ... Display control unit 201 ... Right backlight control unit 202 ... Left backlight control unit 211 ... Right LCD control unit 212 ... Left LCD control unit 221 ... Right backlight 222 ... Left backlight 241 ... Right LCD
242 ... Left LCD
251 ... Right projection optical system 252 ... Left projection optical system 261 ... Right light guide plate 262 ... Left light guide plate DT0 ... Original image data DTa ... Correction image data DTc ... Composite image data DTs ... Outside scene image data DTsh ... Corresponding outside scene image data DTsa ... Modified outside scene image data px11, px12, px13, px14, px51, px52... Pixel (region)
IMG0, IMG0a, IMG1, IMG2 ... image RA1 ... imaging range CA1, CA2, CA3 ... corrected image generation area OA ... external device SC ... outside scene PN ... maximum image display area (image generation possible area)
VR ... Field of view EL, ER ... End AP ... Tip part PL ... Image light IL ... Illumination light LE ... Left eye RE ... Right eye VSync ... Vertical sync signal HSync ... Horizontal sync signal PCLK ... Clock signal

Claims (10)

A transmissive head-mounted display device,
An image display unit configured to generate image light based on display image data and allow the user to visually recognize the image light while being attached to the user's head;
An imaging unit that images the outside scene and generates outside scene image data representing the outside scene image;
An image data correction unit that selects at least a portion of the display image data based on a viewing angle characteristic of a user and corrects the selected data based on the outside scene image data. Part-mounted display device. The head-mounted display device according to claim 1,
The head-mounted display device, wherein the data selected by the image data correction unit is data of a portion corresponding to an image display region that is a region where the image display unit generates the image light. The head-mounted display device according to claim 2,
The image data correction unit is a head-mounted display that does not correct data in a portion corresponding to a peripheral portion in the image display region and an image generation possible region in which the image display unit can generate image light. apparatus. The head-mounted display device according to claim 3,
The imaging unit captures an outside scene including an assumed line-of-sight direction, which is an assumed user's line-of-sight direction,
The image data correction unit is configured such that the angle of view of the imaging unit is within 100 degrees with respect to each of the left and right sides from the assumed sight line direction in the horizontal direction, and within 50 degrees with respect to the upper side from the assumed sight line direction in the vertical direction. The head-mounted display device does not correct the data corresponding to the area exceeding the first area when the first area within 75 degrees with respect to the lower side is exceeded. The head-mounted display device according to claim 4,
In the image data correction unit, the angle of view of the imaging unit is within 45 degrees with respect to each of the left and right from the assumed visual line direction in the horizontal direction, and 35 with respect to each of the upper and lower sides from the assumed visual line direction in the vertical direction. A head-mounted display device that does not correct data in a portion corresponding to a region exceeding the second region when the second region within the second range is exceeded. The head-mounted display device according to claim 5,
The image data correction unit is configured such that the angle of view of the imaging unit is within 30 degrees with respect to each of the left and right sides of the assumed sight line direction in the horizontal direction and 23 with respect to each of the upper and lower sides from the assumed sight line direction in the vertical direction. The head-mounted display device that does not correct the data corresponding to the area exceeding the third area when exceeding the third area within the range. The head-mounted display device according to any one of claims 3 to 6,
The imaging unit includes an assumed line-of-sight direction that is an assumed user's line-of-sight direction, and an angle of view of the imaging unit is within 15 degrees with respect to each of the left and right from the assumed line-of-sight direction in the horizontal direction, and In the vertical direction, image an outside scene including a fourth area within 10 degrees with respect to each of the upper and lower sides from the assumed visual line direction,
The head-mounted display device, wherein the image data correction unit corrects data in a portion corresponding to a peripheral portion in the fourth region and the image display region. The head-mounted display device according to any one of claims 1 to 7,
The image data correction unit divides the outside scene image data into a plurality of regions, and when an index value representing a color of each data in the plurality of regions is within a predetermined threshold, the data of the data in the plurality of regions A head-mounted display device that replaces an index value with the same index value. The head-mounted display device according to any one of claims 1 to 8,
The image data correction unit generates corrected image data based on the supplied original image data and the outside scene image data,
The head-mounted display device, wherein the image display unit generates image light based on the corrected image data as the display image data. An image display unit that generates image light based on display image data and allows the user to visually recognize the image light and transmits the outside scene, and captures the outside scene while being mounted on the user's head. An imaging unit that generates outside scene image data representing an image, and a control method for a transmissive head-mounted display device comprising:
A control method comprising the steps of: selecting at least a part of the display image data based on a user viewing angle characteristic and correcting the selected data based on the outside scene image data.

Images