JP2011070251A - Head mount display - Google Patents

Abstract

An object of the present invention is to provide a see-through type head mounted display in which a user can easily distinguish a content image from an external image.
A first occupancy ratio of pixels (pixels) darker than a predetermined reference value in all pixels (all pixels) forming a content image indicated by content data, and a predetermined first condition value When the first occupation ratio is larger than the first condition value (S104: Yes), a display effect is added to the content image (S106), and the content image with the display effect added is presented. (S108).
[Selection] Figure 5

Description

  The present invention relates to a see-through type head mounted display that presents a content image indicated by content data to a user's eye so as to be visible.

  2. Description of the Related Art Conventionally, a technique related to a see-through type head mounted display that presents a content image indicated by content data to a user's eye so as to be visible is proposed. For example, a head-mounted AV device having a translucent liquid crystal display panel for displaying an image and having a spectacle portion mounted on the head so that the panel comes in front of the eyes, and a work object in each work process A storage unit for storing various animation images created in advance in the form of an image, and a storage unit for a work object itself visually recognized through a liquid crystal display panel by a wearer wearing the AV device according to the order of each work process And an animation display processing function for displaying the animation image on the liquid crystal display panel so that the corresponding animation images stored in the screen overlap, and by displaying the animation image on the liquid crystal display panel according to the order of each work process, Techniques have been proposed in which the work content to be performed on the work object is shown to the wearer (for example, patent documents) Reference 1).

JP 2004-21931 A

  By the way, in a see-through type head-mounted display, a content image is presented on an external image so that it is difficult for a user to visually recognize and recognize the content image separately from the external image. For example, when a head-mounted display is used for work support such as displaying work contents as in Patent Document 1, the user's (worker) 's attention is not always directed to the content image. The user needs to pay sufficient attention to the work object and / or its surroundings from the content image. For this reason, it may be difficult for the user to distinguish and visually recognize the external image and the content image. In such a state, an image of a part, which is a content image, may be mistaken for an actual product and may not be touched even if the hand is stretched out, which may reduce work efficiency or confuse the user. Especially when the background is dark, the parts appear to be in the outside world.

  It is an object of the present invention to provide a see-through type head mounted display that allows a user to easily distinguish a content image from an external image.

  The present invention made in view of the above conventional problems presents a content image indicated by content data so as to be visible to the user's eyes, and allows a user viewing the content image to visually recognize the external image superimposed on the content image. A see-through type head-mounted display that determines the characteristics of a content image to be presented and, if determined to be a predetermined characteristic, adds a display effect to the content image, and the content image to which the display effect is added Is presented to the user's eyes.

  A first problem-solving means reflecting the present invention presents a content image indicated by content data so as to be visible to a user's eyes, and a user viewing the content image superimposes an external image on the content image. A see-through type head-mounted display that is visible and has a size of a first occupancy ratio of the pixels that are darker than a predetermined reference value in all the pixels forming the content image and a predetermined first condition value. A first determination unit configured to determine a relationship; and when the first determination unit determines that the first occupancy is greater than the first condition value, image processing is performed on the content data, and the content image Display effect adding means for adding a display effect to the content image to which the display effect is added by the display effect adding means, A head mounted display, characterized in that it comprises a content image presenting means for presenting to the eye of the serial user. According to this, a display effect can be added to the presented content image. As a result, the content image can be visually recognized with a display effect added to the external image.

  The second problem-solving means is the head-mounted display of the first problem-solving means, and when the first determining means determines that the first occupancy is greater than the first condition value, The second occupancy ratio of the pixels darker than the predetermined reference value included in the predetermined range including the center of the content image, which occupies the entire pixels darker than the predetermined reference value among all the pixels forming the content image And the second condition value determined in advance, and the display effect adding means determines that the first occupancy is greater than the first condition value and the first effect is determined by the first determining means. 2 When it is determined that the occupation ratio is smaller than the second condition value, the image processing is executed on the content data, and the display effect is added to the content image. According to this, when the brightness of the content image is bright in the central portion and dark in the outer peripheral portion, a display effect can be added to the presented content image.

  The third problem solving means is a head-mounted display of the first or second problem solving means, and includes second determination means for determining a coordinate change of the position of the object included in the content image, When the second determining unit determines that the position of the object does not change in coordinates, the determining unit determines the relationship between the first occupation ratio and the first condition value, and the display effect adding unit. If the second determination means determines that the position of the object does not change coordinates, and the first determination means determines that the first occupancy is greater than the first condition value, the content data The image processing is executed on the content image, and the display effect is added to the content image. According to this, when the coordinates of the position of the object included in the content image do not change, a display effect can be added to the presented content image.

  The fourth problem solving means is the head mounted display of the third problem solving means, and the second determination means determines that the position of the object does not change in coordinates when the content data is still image data. It is characterized by doing. According to this, when the content data is still image data, it can be determined that the coordinates of the position of the object do not change.

  The fifth problem solving means is the head mounted display according to any one of the first to fourth problem solving means, and the display effect adding means is configured to apply the content image and the external image to the content data. The display processing is added to the content image by executing the image processing for emphasizing the boundary between the content image and the content image. According to this, it is possible to distinguish between the content image and the external image.

  The sixth problem solving means is the head mounted display of the fifth problem solving means, wherein the boundary between the content image and the external image is an effective area in which the content image presenting means can present the content image. The display effect adding means adds a frame that coincides with the outer edge to the content image as the display effect. According to this, it is possible to distinguish between the content image and the external image.

  According to the present invention, it is possible to obtain a see-through type head mounted display in which a user can easily distinguish a content image from an external image.

It is a figure which shows a head mounted display. (A) is a top view of a head mounted display main body, (b) is a front view, (c) is a left side view. It is a figure which shows the functional block of a control box. It is a figure which shows the functional block of an image presentation part. It is a figure which shows the flowchart of the content image presentation process of a 1st processing form. It is a figure which shows the flowchart of the content image presentation process of a 2nd processing form. It is a figure which shows the flowchart of the content image presentation process of a 3rd processing form. It is a figure explaining the content image and external image which a user visually recognizes.

  Embodiments for implementing the above problem solving means reflecting the present invention will be described below in detail with reference to the drawings. The above-mentioned problem solving means is not limited to the configuration described below, and various configurations can be adopted in the same technical idea. For example, in each configuration described below, a predetermined configuration can be omitted. In each process described below, a predetermined step can be omitted.

(Overview of head mounted display)
A head mounted display (Head Mounted Display / hereinafter also referred to as “HMD”) 10 will be described with reference to FIGS. 1 and 2. The HMD 10 includes an HMD main body 100 and a control box 200. The HMD main body 100 is worn on the user's face and used. The control box 200 is attached to the user's waist or the like.

  The HMD main body 100 includes temples 104A and 104B each having a modern 102A and 102B that hits the user's ears attached to one end, armatures 106A and 106B coupled to the other ends of the temples 104A and 104B via hinges 112A and 112B, 106A and 106B, a front frame 108, and a nose pad 110 attached to the center of the front frame 108 and in contact with the user's nose. Each of these parts forms a skeleton part of the HMD main body 100. Temples 104A and 104B can be folded with hinges 112A and 112B formed on armor 106A and 106B. The structure of the skeleton part of the HMD main body 100 is the same as, for example, normal glasses, and the HMD main body 100 is supported on the user's face by the modern 102A and 102B and the nose pad 110 when the user wears it. . In FIG. 2B, illustration of the moderns 102A and 102B and the temples 104A and 104B is omitted.

  An image presentation unit 114 is attached to the skeleton part of the HMD main body 100 via an attachment part 122 provided near the armor 106A. The image presentation unit 114 is disposed at a position that is substantially the same height as the left eye 118 of the user wearing the HMD main body 100 in a state where the image presentation unit 114 is attached to the vicinity of the armor 106 </ b> A via the attachment unit 122. A luminance sensor 260 is attached to the upper surface of the image presentation unit 114 (not shown in FIG. 2, see FIG. 1). The image presentation unit 114 and the brightness sensor 260 are connected to the control box 200 via the signal cable 250. Although details will be described later, the control box 200 performs a reproduction process (rendering process) on the content data stored in a predetermined area, and transmits an image signal including the content image formed thereby through the signal cable 250. To the image presentation unit 114. The image presentation unit 114 acquires an image signal output from the control box 200 and optically emits a content image based on the image signal toward the half mirror 116.

  The image light 120a representing the content image emitted from the image presentation unit 114 is reflected by the half mirror 116, and the reflected image light 120b is incident on the left eye 118 of the user, in other words, presented (projected) so as to be visible. The Thereby, the user visually recognizes the content image. The half mirror 116 transmits external light representing an external image. The user can visually recognize the external image superimposed on the content image with the left eye 118 through the half mirror 116 with the HMD main body 100 mounted.

  The image presentation unit 114 scans the image light 120a and 120b in accordance with the acquired image signal in a two-dimensional direction, guides the scanned image light 120a and 120b to the user's left eye 118, and displays the content image on the retina. In addition to a retinal scanning type display that forms a liquid crystal display, a liquid crystal display, an organic EL (Organic Electroluminescence) display, and other devices may be used.

(Control box)
The control box 200 will be described with reference to FIG. The control box 200 includes a CPU 202 that controls the device itself, a program ROM 204 that stores programs for various processes including a content image presentation process described below, and a non-volatile flash ROM 206 that stores content data and other various data. And a RAM 208 as a work area. For example, the CPU 202 executes a program for content image presentation processing (see FIGS. 5 to 7) stored in the program ROM 204 on the RAM 208. In addition, the CPU 202 executes a program for reproduction processing in the content image presentation processing, and executes a program for display effect addition processing in a predetermined case. Various functional units are configured by the CPU 202 executing various programs stored in the program ROM 204 on the RAM 208.

  The control box 200 includes a video RAM 210, an HMD connection I / F controller 220, an external device connection I / F controller 230, and a peripheral I / F 240. The video RAM 210 stores content images formed by reproduction processing, content images input from an external device 400 described later, and the like. The HMD connection I / F controller 220 is connected to the HMD main body 100 via the signal cable 250 and controls input / output of various signals performed with the image presentation unit 114 of the HMD main body 100 based on a command from the CPU 202. To do. Specifically, the HMD connection I / F controller 220 outputs an image signal including a content image, a control signal for the image presentation unit 114, and the like to the image presentation unit 114.

  The external device connection I / F controller 230 is connected to the external device 400 such as a personal computer via a predetermined cable, and controls communication with the external device 400 based on a command from the CPU 202. For example, the external device connection I / F controller 230 receives an image signal input from the external device 400. The external device connection I / F controller 230 stores the content image based on the received image signal in the video RAM 210.

  The peripheral I / F 240 is a connection I / F to which the luminance sensor 260, the power switch 270, the power lamp 280, and the like are connected. The CPU 202 acquires the brightness (luminance) detected by the luminance sensor 260 via the peripheral I / F 240. The user operates on / off of the image presentation unit 114 and the control box 200 via the power switch 270. The power lamp 280 is turned on when the power switch 270 is turned on and turned off when the power switch 270 is turned off.

(Image presentation part)
The image presentation unit 114 will be described with reference to FIG. The image presentation unit 114 includes a scanned image light generation unit 3121, a collimating optical system 3122, a horizontal scanning unit 3123, a vertical scanning unit 3124, a relay optical system 3125, and a relay optical system 3126.

  The scanned image light generation unit 3121 is a device that reads the image signal output from the HMD connection I / F controller 220 for each dot clock and modulates the intensity according to the read image signal to generate scanned image light. The scanned image light generation unit 3121 includes a signal processing circuit 3211, a light source unit 3212, and a light combining unit 3213.

  The signal processing circuit 3211 is connected to the HMD connection I / F controller 220. The signal processing circuit 3211 is configured to generate B (blue), G (green), and R (red), which are elements for generating scanned image light, based on the image signal input from the HMD connection I / F controller 220. Image signals 3214 a to 3214 c are generated and output to the light source unit 3212. The signal processing circuit 3211 is connected to a horizontal scanning control circuit 3123b of the horizontal scanning unit 3123 described later. The signal processing circuit 3211 generates a horizontal drive signal 3215 based on the image signal input from the HMD connection I / F controller 220, and outputs the horizontal drive signal 3215 to the horizontal scanning control circuit 3123b. Further, the signal processing circuit 3211 is connected to a vertical scanning control circuit 3124b described later. The signal processing circuit 3211 generates a vertical drive signal 3216 based on the image signal input from the HMD connection I / F controller 220 and outputs the vertical drive signal 3216 to the vertical scanning control circuit 3124b.

  The light source unit 3212 includes a B laser driver 3212a, a G laser driver 3212b, an R laser driver 3212c, a B laser 3212d, a G laser 3212e, and an R laser 3212f. The B laser driver 3212a drives the B laser 3212d based on the B (blue) image signal 3214a output from the signal processing circuit 3211 for each dot clock. The B laser 3212d emits intensity-modulated blue laser light based on the B (blue) image signal 3214a. Similarly, the G laser 3212e and the R laser 3212f emit green laser light and red laser light, which are respectively intensity-modulated.

  Each of the lasers 3212d to 3212f includes a semiconductor laser and a solid-state laser with a harmonic generation function. When a semiconductor laser is used, the drive current is directly modulated to modulate the intensity of the laser beam. When using a solid state laser with a harmonic generation function, each of the lasers 3212d to 3212f is provided with an external modulator to modulate the intensity of the laser light. Note that the efficiency of harmonic generation is not high, and the loss of the external modulator is also added, so that the power consumption of the solid-state laser with the harmonic generation function is increased. Therefore, it is preferable to use a semiconductor laser for each of the lasers 3212d to 3212f. .

  The light combining unit 3213 includes collimating optical systems 3213a to 3213c, dichroic mirrors 3213d to 3213f, and a coupling optical system 3213g. The collimating optical systems 3213a to 3213c are arranged in front of the lasers 3212d to 3212f, respectively, and collimate the laser beams emitted from the lasers 3212d to 3212f. The dichroic mirrors 3213d to 3213f are arranged in front of the collimating optical systems 3213a to 3213c, respectively, and each laser beam paralleled by the collimating optical systems 3213a to 3213c is used only for laser beams having a wavelength in a predetermined range. Selectively reflects or transmits.

  The coupling optical system 3213g is disposed in front of the dichroic mirror 3213d. Blue laser light transmitted through the dichroic mirror 3213d and green laser light and red laser light reflected by the dichroic mirrors 3213e and 3213f are incident on the coupling optical system 3213g. The coupling optical system 3213 g condenses (mixes) the laser beams of the three primary colors and enters the optical fiber 3127. Note that white can be expressed by equalizing the intensity of each of the blue laser light, the green laser light, and the red laser light.

  In order to irradiate the laser beam incident on the optical fiber 3127 as an image, the horizontal scanning unit 3123 and the vertical scanning unit 3124 scan the laser beam in the horizontal direction and the vertical direction to generate scanning image light.

  The horizontal scanning unit 3123 includes a resonant deflection element 3123a, a horizontal scanning control circuit 3123b, and a horizontal scanning angle detection circuit 3123c. The laser light incident on the optical fiber 3127 is collimated by the collimating optical system 3122 and is incident on the resonant deflection element 3123a. The resonant deflection element 3123a has a reflection surface 3123d that is swung by the horizontal scanning control circuit 3123b, and scans the incident laser light in the horizontal direction by being reflected by the swinging reflection surface 3123d. The horizontal scanning control circuit 3123b generates a driving signal for swinging the reflecting surface 3123d of the resonant deflection element 3123a based on the horizontal driving signal 3215 output from the signal processing circuit 3211. The horizontal scanning angle detection circuit 3123c detects a swing state such as a swing range and a swing frequency of the reflection surface 3123d of the resonant deflection element 3123a based on the displacement signal output from the resonant deflection element 3123a. A signal indicating the swing state is output to the HMD connection I / F controller 220.

  The vertical scanning unit 3124 includes a deflection element 3124a, a vertical scanning control circuit 3124b, and a vertical scanning angle detection circuit 3124c. The deflection element 3124a has a reflection surface 3124d that is oscillated by the vertical scanning control circuit 3124b. The incident laser beam is reflected by the oscillating reflection surface 3124d and scanned in the vertical direction to scan two-dimensionally. The emitted image light is emitted to the relay optical system 3126. Based on the vertical drive signal 3216 output from the signal processing circuit 3211, the vertical scanning control circuit 3124b generates a drive signal for swinging the reflection surface 3124d of the deflection element 3124a. Based on the displacement signal output from the deflection element 3124a, the vertical scanning angle detection circuit 3124c detects the oscillation state such as the oscillation range and oscillation frequency of the reflecting surface 3124d of the deflection element 3124a, and detects the oscillation state. The signal shown is output to the HMD connection I / F controller 220.

  The relay optical system 3125 is disposed between the resonant deflection element 3123a and the deflection element 3124a. The relay optical system 3125 causes the laser beam scanned in the horizontal direction by the reflection surface 3123d of the resonance type deflection element 3123a to enter the reflection surface 3124d of the deflection element 3124a.

  Based on the image signal input from the HMD connection I / F controller 220, the signal processing circuit 3211 outputs a horizontal drive signal 3215 and a vertical drive signal 3216 to the horizontal scan control circuit 3123b and the vertical scan control circuit 3124b, respectively. Image light is generated by changing the scanning angle of the reflecting surfaces 3123d and 3124d.

  The scanning angles of the reflecting surfaces 3123d and 3124d thus changed are detected as detection signals by the horizontal scanning angle detection circuit 3123c and the vertical scanning angle detection circuit 3124c, and the detection signals are input to the HMD connection I / F controller 220, Feedback is provided to the drive signal 3215 and the vertical drive signal 3216.

  The relay optical system 3126 includes lens systems 3126a and 3126b having a positive refractive power. The image light emitted from the deflecting element 3124a is converted into convergent image light by the lens system 3126a, with the respective image lights having their scanning image light center lines substantially parallel to each other. The converged image light is converted into substantially parallel scanned image light by the lens system 3126b, and the center line of these scanned image light is condensed so as to converge on the pupil Ea of the user.

  In the present embodiment, laser light incident from the optical fiber 3127 is scanned in the horizontal direction by the horizontal scanning unit 3123 and then scanned in the vertical direction by the vertical scanning unit 3124. The arrangement of the vertical scanning unit 3124 may be changed, and after the vertical scanning unit 3124 is scanned in the vertical direction, the horizontal scanning unit 3123 may scan in the horizontal direction.

(Content image presentation processing)
Regarding the content image presentation processing, three processing modes will be described below. Each of the content image presentation processes described below is performed by the CPU 202 of the control box 200 executing a program for this process stored in the program ROM 204 on the RAM 208. When executing this processing, the CPU 202 uses data such as content data stored in the flash ROM 206, brightness detected by the brightness sensor 260, and content image received by the external device connection I / F controller 230.

(First processing form)
The content image presentation processing in the first processing form will be described with reference to FIG. The CPU 202 that has started this process presents a menu screen including content that can be presented via the image presentation unit 114, and allows the user to select one of the content items included in the menu screen (S100). For example, the user operates an operation unit (not shown in FIGS. 1 and 3) provided in the control box 200 to select one of the contents included in the menu screen. The CPU 202 reads content data of the content selected by the user from the flash ROM 206 and stores it in the RAM 208. The CPU 202 executes a reproduction process on the content data stored in the RAM 208 and stores the content image formed thereby in the video RAM 210. When an input from the external device 400 is selected, the CPU 202 stores the content image received via the external device connection I / F controller 230 in the video RAM 210.

  After executing S100, the CPU 202 acquires the brightness (luminance) of the outside world detected by the luminance sensor 260 via the peripheral I / F 240. Then, the CPU 202 determines a reference value for pixel (pixel) brightness determination corresponding to the acquired brightness of the outside world in accordance with a predetermined standard (S102). The reference value is defined as a value that maintains a constant relationship with the brightness of the outside world.

  In S104, the CPU 202 targets the content image stored in the video RAM 210 in accordance with S100, and occupies the pixels (pixels) darker than the reference value in S102, that is, occupies all the pixels forming the content image in S102. The relationship between the first occupancy ratio of pixels darker than the reference value and the predetermined first condition value (the occupancy reference value in the determination in S104) is determined. Specifically, the CPU 202 determines whether the first occupancy is greater than the first condition value.

  As a result of the determination in S104, if the first occupancy is larger than the first condition value (S104: Yes), the CPU 202 shifts the process to S106, in other words, the first occupancy is not greater than the first condition value. If the first occupation ratio is equal to or less than the first condition value (S104: No), the process proceeds to S108. That is, when the content image has many dark pixels (S104: Yes), the external environment (external image) is widely recognized in the field of view through the dark pixel portions that exist widely, so the content image blends into the external image. Since it is visually recognized, in the first processing mode, the display effect addition processing (image processing) of S106 described below is executed. On the other hand, when there are many bright pixels, it can be clearly distinguished from the outside world (S104: No). The display effect addition process of S106 is not executed.

  In S106, the CPU 202 reads the content image stored in the video RAM 210 onto the RAM 208, executes display effect addition processing, and adds a display effect for enhancing the boundary between the content image and the external image. Then, the CPU 202 stores the content image to which the display effect is added in the video RAM 210. Specifically, the CPU 202 adds a frame that matches the outer edge of the content image to the content image. The added frame will be described later. In S <b> 108, the CPU 202 outputs an image signal including the content image stored in the video RAM 210 and a control signal for presenting the content image to the image presentation unit 114 via the HMD connection I / F controller 220. The presentation of the content image from the presentation unit 114 is executed.

  After executing S108, the CPU 202 determines whether or not the user has operated the power switch 270 of the control box 200 to turn off the power (S110). As a result of the determination, if the power is not turned off (S110: No), the CPU 202 returns the process to S100, whereas if the power is turned off (S110: Yes), the process is terminated.

(Second processing mode)
The content image presentation processing in the second processing form will be described with reference to FIG. CPU202 which started this process presents the menu screen containing the content which can be shown through the image presentation part 114 similarly to the 1st processing form shown in FIG. 5, and performs each process of S200-S204. Here, each process of S200-S204 is a process corresponding to each process of S100-S104 of FIG. Therefore, detailed description of these processes is omitted. Note that if the result of the determination in S204 is affirmative (S204: Yes), the CPU 202 moves the process to S206, whereas if denied (S204: No), the CPU 202 moves the process to S210.

  In S206, the CPU 202 determines the ratio of the pixels that are concentrated in the central portion of the pixels that are darker than the reference value in S202, that is, out of all the pixels that form the content image stored in the video RAM 210 according to S200. A second occupancy ratio of pixels darker than the reference value of S202 included in a predetermined range including the center of the content image, and a predetermined second condition value (occupancy ratio in the determination of S206). The relationship between the size and the reference value is determined. Specifically, the CPU 202 determines whether the second occupation ratio is smaller than the second condition value.

  If the second occupancy is smaller than the second condition value as a result of the determination in S206 (S206: Yes), the CPU 202 moves the process to S208, in other words, the second occupancy is not smaller than the second condition value. If the second occupation ratio is equal to or greater than the second condition value (S206: No), the process proceeds to S210. That is, when the brightness of the content image is bright in the central part and dark in the outer peripheral part (S206: Yes), the brightly displayed central part can be distinguished from the external environment (external image), but the dark peripheral part is distinguished from the external image. Is difficult to distinguish, so that the center portion is melted and visually recognized as it approaches the outer periphery. Therefore, in the second processing mode, when the central portion is bright and the outer peripheral portion is dark (S206: Yes), the display effect addition processing of S208 is executed. On the other hand, when the central portion is relatively dark with respect to the outer peripheral portion (S206: No), the outer peripheral portion is more easily distinguished from the external image than the central portion, and therefore the display effect addition processing in S208 is not executed. .

  After executing S206, the CPU 202 sequentially executes each process of S208 to S212. Here, each process of S208-S212 is a process corresponding to each process of S106-S110 of FIG. Therefore, detailed description of these processes is omitted.

(Third processing mode)
The content image presentation processing in the third processing form will be described with reference to FIG. CPU202 which started this process presents the menu screen containing the content which can be shown through the image presentation part 114 similarly to the 1st processing form shown in FIG. 5, and performs the process of S300. Here, the process of S300 is a process corresponding to the process of S100 of FIG. Therefore, detailed description is omitted.

  In S302, the CPU 202 determines a change in the coordinates of the position of the object included in the content image for the content image stored in the video RAM 210 according to S300. Specifically, the CPU 202 determines the coordinate change of the position of the object based on the file extension of the content data indicating the content image. That is, when the content data selected by the user is read from the flash ROM 206, if the content data has a file extension indicating still image data (for example, “jpg” (Joint Photographic Experts Group)), the CPU 202 It is determined that the position of the object included in the content image does not change (S302: No). On the other hand, when the content data has a file extension indicating moving image data (for example, “mpg” (Moving Picture Experts Group)), the CPU 202 determines that the position of the object included in the content image changes in coordinates (S302). : Yes).

  As a result of the determination in S302, when the coordinate does not change (S302: No), the CPU 202 shifts the process to S304, and when the coordinate changes (S302: Yes), the process shifts to S310. That is, when the position of the object included in the content image indicated by the content data does not change coordinates (S302: No), the CPU 202 determines whether the pixel (pixel) brightness corresponding to the brightness of the external environment detected by the luminance sensor 260 in S304 is reached. A determination reference value is determined, and whether or not the display effect addition processing of S308 based on the brightness of the content image is performed or not is determined in S306. On the other hand, when the coordinates of the object position change (S302: Yes), the display effect addition process of S308 is not executed.

  For example, when a head-mounted display is used for work support such as displaying work contents, the user may pay attention to an object during work and hardly move his head. When a content image is displayed at such a time, a content image including an object whose position coordinates change can be distinguished from an external image based on this object, and the user can select a content image based on an object whose position coordinates change. A content image can be recognized. However, in the still image, the position coordinates of the object included in the content image do not change, and as a result, it is difficult to distinguish whether the object being viewed is included in the content image or the real object in the outside world. It becomes. Therefore, in the third processing mode, when the coordinate does not change (S302: No), the process proceeds to S304, and then, in S306, it is determined whether or not the display effect addition process in S308 based on the brightness of the content image is performed. It was decided to. On the other hand, if the coordinates change (S302: Yes), the process proceeds to S310, and the display effect addition process of S308 is not executed.

  After executing S302, the CPU 202 sequentially executes each process of S304 to S312. Here, each process of S304 to S312 is a process corresponding to each process of S102 and S104 to S110 of FIG. Therefore, detailed description of these processes is omitted.

(Modification)
The configuration of the present embodiment described above can also be as follows.

  (1) In the above description, the HMD body 100 and the control box 200 are separated from each other as an example. However, the HMD body 100 and the control box 200 may be integrated into an HMD. In this case, each component (see FIG. 3) of the control box 200 is accommodated in, for example, a housing (cover) that forms the image presentation unit 114.

  (2) In the above description, the configuration in which the determination in S104 in FIG. 5, S204 in FIG. 6, and S306 in FIG. 7 is determined based on whether the first occupancy is larger than the first condition value has been described as an example. However, in addition to such a configuration, it may be configured to make a determination based on whether the first occupancy is equal to or higher than the first condition value. In this case, when the first occupancy is equal to or higher than the first condition value, the CPU 202 affirms the determination (S104, S204, S306: Yes), and when the first occupancy is smaller than the first condition value, The judgment is denied (S104, S204, S306: No).

  In the above description, the configuration in which the determination in S206 of FIG. 6 is determined based on whether the second occupancy is smaller than the second condition value has been described as an example. However, in addition to such a configuration, it is also possible to make a determination based on whether the second occupation ratio is equal to or less than the second condition value. In this case, the CPU 202 affirms the determination when the second occupancy is equal to or less than the second condition value (S206: Yes), and denies the determination when the second occupancy is greater than the second condition value. (S206: No).

  (3) In the above description, the configuration in which the determination in S302 of the content image presentation processing in the third processing form illustrated in FIG. 7 is performed based on the file extension of content data has been described as an example. However, in addition to such a configuration, it is possible to execute a predetermined analysis process on the content image and directly determine whether the position of the object included in the content image has changed coordinates. For example, when the data structure of the content image is composed of a plurality of frames, the determination can be made by comparing the frames before and after.

  Further, in the content image presentation processing of the third processing form illustrated in FIG. 7, when the determination in S306 is affirmed (S306: Yes), the CPU 202 has been described as an example of a configuration in which S308 is executed. However, in addition to such a configuration, when the determination in S306 is affirmed (S306: Yes), the determination in S206 of the content image presentation processing in the second processing form illustrated in FIG. 6 may be performed. In this case, when the determination corresponding to S206 is affirmed (S206: Yes), the process proceeds to S308, and when the determination is negative (S206: No), the process proceeds to S310. To do.

(Advantageous effects of the configuration of the present embodiment)
According to the configuration of the present embodiment, the user can visually recognize the content image separately from the external image (see S106 and S108 in FIG. 5, S208 and S210 in FIG. 6, and S308 and S310 in FIG. 7). Specifically, when there is an object that is the same as or similar to the content image presented by the HMD 10 in the outside world that the user wearing the HMD main body 100 can visually recognize through the half mirror 116, the image that the user is viewing Can be easily discriminated whether it is a content image or an external image.

  As described above, when the head-mounted display is used for work support such as displaying work contents, the HMD 10 can be assembled by connecting a predetermined cable to a connector provided on the back of the server computer, for example. When used as a tool for providing a work instruction for this work, the user visually recognizes a connector image 510 representing a connector provided on the back of the server computer through the half mirror 116 as an external image. In this state, when a connector image 520 representing a connector to which a cable is to be connected is presented to the user's left eye 118 as a content image without adding a display effect (see FIG. 8A), the user However, it is assumed that the connector image 510 and the connector image 520 are misidentified.

  However, according to the configuration of the HMD 10 of the present embodiment, a frame 500 corresponding to the outer edge of the connector image 520 as a content image is added, and the user visually recognizes the connector image 520 with the frame 500 added ( (Refer FIG.8 (b)). Therefore, the user can recognize the boundary between the connector image 520 and the external image including the connector image 510 by the frame 500 added to the connector image 520, and can easily distinguish the connector image 510 from the connector image 520. .

  Here, the display effect can be set as shown in FIG. That is, as a display effect, it is possible to add a frame 502 that matches the outer edge of the effective area (maximum presentation area) in which the image presentation unit 114 can present a content image. Also by this, the same effect as described above can be obtained.

  In the content image presentation process of the third processing form shown in FIG. 7, the display effect may be directly added to the outer edge of the object whose position is determined not to change in coordinates. Based on the example shown in FIG. 8, it is also possible to adopt a configuration in which a frame 504 is added to the outer edge of the connector included in the connector image 520 as the content image (see FIG. 8D). The entire content image may be configured to add a display effect as a color different from the shade of the external image visually recognized through the half mirror 116, for example, a reddish color (hue). Also by these, the same effect as described above can be obtained. Furthermore, when the content image is a line drawing (for example, a character), a configuration in which a display effect is not added may be employed.

10 Head mounted display (HMD)
100 Head-mounted display body (HMD body)
114 Image presentation unit 116 Half mirror 200 Control box 202 CPU
204 Program ROM
206 Flash ROM
208 RAM
260 Brightness sensor 500, 502, 504 Frame 510, 520 Connector image

Claims (6)

A see-through head-mounted display that presents a content image indicated by content data so as to be visible to the user's eyes, and allows a user viewing the content image to visually recognize an external image superimposed on the content image,
First determination means for determining a relationship between a first occupancy ratio of the pixels that are darker than a predetermined reference value in all the pixels forming the content image and a predetermined first condition value;
Display effect adding means for executing image processing on the content data and adding a display effect to the content image when the first determining means determines that the first occupation ratio is greater than the first condition value. When,
A head-mounted display comprising: a content image presentation unit that presents the content image to which the display effect is added by the display effect addition unit to the eyes of the user. When the first determination unit determines that the first occupation ratio is greater than the first condition value, the first determination unit further occupies all the pixels that are darker than the predetermined reference value among all the pixels forming the content image. Determining a relationship between the second occupancy ratio of the pixels darker than the predetermined reference value included in a predetermined range including the center of the content image and a predetermined second condition value;
When the first determination unit determines that the first occupancy rate is greater than the first condition value and the second occupancy rate is less than the second condition value, the display effect adding unit determines that the content The head mounted display according to claim 1, wherein the image processing is executed on data to add the display effect to the content image. A second determination unit configured to determine a change in coordinates of the position of the object included in the content image;
The first determination unit determines a relationship between the first occupation ratio and the first condition value when the second determination unit determines that the position of the object does not change in coordinates;
The display effect adding unit is configured such that the second determining unit determines that the position of the object does not change coordinates, and the first determining unit determines that the first occupancy is greater than the first condition value. 3. The head mounted display according to claim 1, wherein the image processing is executed on the content data, and the display effect is added to the content image.   4. The head mounted display according to claim 3, wherein the second determination unit determines that the coordinates of the position of the object do not change when the content data is still image data. 5.   The display effect adding means performs the image processing for emphasizing a boundary between the content image and the external image on the content data, and adds the display effect to the content image. The head mounted display according to any one of claims 1 to 4. The boundary between the content image and the external image is an outer edge of an effective area where the content image presentation means can present the content image,
The head mounted display according to claim 5, wherein the display effect adding unit adds a frame that matches the outer edge as the display effect to the content image.