JP2016142988A - Display device and display control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display superposition information in an identifiable manner even when a display illuminance value exceeds a limit value of illuminance which can be output by a display device.SOLUTION: A display device is provided in which the display device displaying superposition information superposed on outside scenery acquires an image capturing the outside scenery, and includes: acquisition means for acquiring a luminance value of the outside scenery; a background luminance value showing luminance of the display region of the superposition information of the acquired image; a whole luminance value showing the luminance of the region including a peripheral region of the display region of the superposition information of the image; calculation means for calculating the luminance value according to the acquired luminance value; luminance setting means for setting a display luminance value based on the calculated whole luminance value, the background luminance value, and the luminance value; and color control means for controlling a color displaying the superposition information or a density of the color when the set display luminance value is determined to exceed the limit value of the luminance which can be output by the display device.SELECTED DRAWING: Figure 7

Description

  The present invention relates to a display device and a display control program.

  A technique of a head mounted display (hereinafter also referred to as “HMD (Head Mounted Display)”) that displays digital information superimposed on an external scene in the field of view is disclosed (for example, see Patent Document 1 and Patent Document 2). . In the HMD, digital information such as characters to be displayed on a glasses-type display is displayed so as to be superimposed on the outside landscape. At that time, it is possible to display a see-through video in which the scenery displayed on the back side can be seen through. In addition, the digital information displayed on the near side of the see-through video is displayed by superimposing information read from a barcode or the like affixed to an object that is actually visible using AR (augmented reality) technology. be able to. Information superimposed on the outside landscape (hereinafter also referred to as “superimposition information”) is a luminance value (hereinafter also referred to as “display luminance value”) corresponding to the illuminance of the outside world so that the brightness of the display can be easily seen. ).

Japanese Patent Laid-Open No. 08-160340 Japanese Patent Laid-Open No. 09-101477 JP 2010-177788 A

  However, a display device such as an HMD has a limit value in luminance values that can be output due to the hardware configuration. For this reason, when the set display luminance value exceeds the limit value of the luminance that can be output from the display device, the brightness of the display is darker than the set luminance value, so that the superimposition information becomes difficult to see.

  In view of this, an object of one aspect of the present invention is to display superimposition information so that it can be identified even when a display luminance value exceeds a limit value of luminance that can be output by a display device.

  In one proposal, a display device that displays superimposition information superimposed on an outside scene, obtains an image of the outside world, obtains an illuminance value of the outside world, and obtains the superimposition information of the acquired image. A luminance value corresponding to the acquired illuminance value by calculating a background luminance value indicating the luminance of the display area and an overall luminance value indicating the luminance of the area including the area around the display area of the superimposition information of the image Based on the calculated overall brightness value, the background brightness value, and the brightness value, brightness setting means for setting a display brightness value, and the display device capable of outputting the set display brightness value When it is determined that the luminance limit value is exceeded, a display device is provided that includes color control means for controlling the color or color intensity for displaying the superimposition information.

  According to one aspect, even when the display luminance value exceeds a limit value of luminance that can be output by the display device, the superimposition information can be displayed in an identifiable manner.

The figure which shows an example of the function structure of HMD concerning one Embodiment. The figure which shows an example of the superimposition information concerning one Embodiment. The figure which shows an example of the illumination intensity / luminance table concerning one Embodiment. The figure which shows an example of the transmittance | permeability / color table concerning one Embodiment. The figure which shows the example of a display of the superimposition information concerning one Embodiment. The figure which shows the example of a display of the superimposition information concerning 1st Embodiment. 5 is a flowchart illustrating an example of color control processing according to the first embodiment. 10 is a flowchart illustrating an example of color control processing according to the second embodiment. The figure which shows the example of a display of the superimposition information concerning 2nd Embodiment. The figure which shows the example of a display of the superimposition information concerning one Embodiment. The figure which shows an example of the hardware constitutions of HMD concerning one Embodiment.

  Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, the duplicate description is abbreviate | omitted by attaching | subjecting the same code | symbol.

[Functional configuration of HMD10]
First, the configuration of an HMD 10 (Head Mounted Display) according to an embodiment of the present invention will be described with reference to FIG. FIG. 1 shows an example of a functional configuration of an HMD 10 according to an embodiment. The HMD 10 according to an embodiment includes an acquisition unit 11, a reading unit 12, a superimposition information generation unit 13, a storage unit 14, a calculation unit 15, a luminance setting unit 16, a color control unit 17, and a superimposition information display unit 18.
(See-through display of overlay information)
In the HMD 10, superimposition information (character information 45 and background image 44) is superimposed on an external landscape 42 (hereinafter also referred to as “outside scene”) in the superimposition information display area 43 of the glasses-type display 40 shown in FIG. Is displayed. The HMD 10 according to the present embodiment can display a see-through video in which the outside scene 42 overlapping the superimposition information can be seen through in the superimposition information display area 43.

  An AR marker 46 is attached to the object of the outside scene 42. The HMD 10 reads the superimposition position (coordinates indicating the superimposition information display area 43) from the AR marker 46 included in the captured image, and the superimposition information read from the AR marker 46 in the display area 43 specified based on the superposition position. The character information 45 is displayed. Thereby, it is possible to display the superimposition information “loose valve” superimposed on the outside scene 42 that is actually visible using AR (augmented reality) technology.

  The HMD 10 is an example of a display device that can display the outside scene 42 so that the outside scene 42 can be seen through (see also as “see-through display”) when superimposed information is displayed on the outside scene 42. Other examples of the display device include portable devices and tablet devices capable of the see-through display.

  Returning to FIG. 1, the HMD 10 according to the present embodiment includes an imaging camera 20 and an illuminance sensor 30 in addition to the display 40. The imaging camera 20 captures an outside scene (object, landscape) around the HMD 10. The illuminance sensor 30 detects the illuminance value around the HMD 10.

  The superimposition information display unit 18 displays the superimposition information on the superimposition position read from the AR marker 46 (that is, the superimposition information display area 43) on the outside scene 42 in a see-through manner. The superimposing information display unit 18 controls the display luminance value of the display 40 according to the luminance value corresponding to the illuminance value acquired from the illuminance sensor 30. The display brightness value of the display 40 indicates the brightness of the display.

  The HMD 10 has a luminance limit value (hereinafter also referred to as “limit luminance value”) that can be output by the hardware constituting the HMD 10. Therefore, when the luminance value corresponding to the illuminance value exceeds the limit luminance value of the hardware, the superimposition information display means 18 controls the display 40 with the display luminance value calculated from the luminance value corresponding to the illuminance value. The actual brightness of the display 40 is the brightness indicated by the limit luminance value. In this case, since the brightness of the display 40 is lower than the display luminance value that should be originally controlled, it may be difficult to see the superimposed information.

  Therefore, the HMD 10 according to the present embodiment automatically controls the color or the color density of the superimposition information when the display luminance value exceeds the limit luminance value due to hardware restrictions. Thereby, it is possible to suppress the difficulty of seeing the superimposition information and display the superimposition information in an identifiable manner. Note that at least one of the color information 45 and the background image 44 in the superimposition information is automatically controlled.

  The acquisition unit 11 acquires an image captured by the imaging camera 20 and imaging parameters. Imaging parameters include aperture, shutter speed, ISO sensitivity, and the like. Imaging parameters are stored in the imaging camera 20. Therefore, the acquisition unit 11 can read the imaging parameter from the signal output from the imaging camera 20, for example.

  The acquisition unit 11 acquires the illuminance value around the HMD 10 from the illuminance sensor 30. The illuminance value indicates the intensity of light incident on the surface of the display 40 of the HMD 10. Therefore, the acquisition unit 11 acquires the intensity of light incident on the display 40 surface. On the other hand, the luminance value indicates the intensity of light emitted from the surface of the display 40 of the HMD 10. The display 40 displays information with luminance corresponding to the surrounding illuminance for easy viewing.

  The reading unit 12 reads an AR marker 46 such as a QR (Quick Response) code or a two-dimensional bar code included in the captured image, and extracts marker information.

  The superimposition information generation unit 13 receives the marker information extracted by the reading unit 12 and generates superimposition information and superposition position information. In FIG. 2, the character information 45 and the background image 44 specified by the generated superposition information are displayed in the superimposition information display area 43 specified by the generated superposition position information.

The storage unit 14 stores an illuminance / luminance table 141 and a transmittance / color table 145. FIG. 3 shows an example of the illuminance / luminance table 141 according to the embodiment. The illuminance / luminance table 141 stores the illuminance value 142 and the luminance value 143 in association with each other. The illuminance / luminance table 141 is stored in the storage unit 14 in advance. In the example of the illuminance / luminance table 141 in FIG. 3, when the illuminance value is 1000 lux or more, the luminance value is 500 (cd / m ² ). As a result, it can be seen that the luminance value of 500 (cd / m ² ) is the limiting luminance value due to hardware limitations of the HMD 10. Based on the illuminance / luminance table 141, the luminance value to be used as the illuminance value detected by the illuminance sensor 30 is calculated.

  FIG. 4 shows an example of the transmittance / color table 145 according to an embodiment. The transmittance / color table 145 stores the transmittance 146 and the background color (black) density 147 in association with each other. The transmittance / color table 145 is stored in the storage unit 14 in advance. In the example of the transmittance / color table 145 in FIG. 4, when the transmittance 146 is 0%, the background image 44 of the superimposition information has a black color as shown in FIG. (Not transparent at all).

  As the transmittance 146 increases, the background color (black) darkness 147 becomes lighter and is gradually changed from dark gray to light gray. Thereby, the outside scene 42 under the background color 44 of the superimposition information gradually becomes transparent. When the transmittance 146 becomes 0%, the density 147 of the background color (black) becomes white (all is transmitted).

  The calculating unit 15 calculates a luminance value corresponding to the acquired illuminance value based on the illuminance / luminance table 141. The calculation means 15 also calculates the brightness of the display area 41 (see FIG. 2) of the entire image (hereinafter also referred to as “total brightness value”) and the brightness of the background image 44 of the superimposition information display area 43 (see FIG. 2). (Hereinafter also referred to as “background luminance value”).

  That is, the calculation unit 15 calculates the average value of the luminance values of the respective pixels included in the display area 41 of the entire image and sets it as “total luminance value (BV AVE)”. Further, the calculation means 15 calculates the average value of the luminance values of the respective pixels included in the display area 43 of the superimposition information and sets it as “background luminance value (BB AVE)”.

  Note that the overall luminance value indicates the luminance of an area including the area around the display area 43 of the superimposition information of the image (not necessarily the entire image) in addition to the case of indicating the luminance value of the display area 41 of the entire image. Including cases.

(Example of calculation method of overall luminance value and background luminance value)
Here, a method of calculating the overall luminance value (BV AVE) and the background luminance value (BB AVE), which is executed by the calculating unit 15, will be described. Note that the following calculation method is an example, and other calculation methods may be used to calculate the overall luminance value (BV AVE) and the background luminance value (BB AVE). In the present embodiment, the overall luminance value and the background luminance value are calculated by a calculation method based on the APEX standard.

  First, the luminance (absolute luminance) of the entire captured image is calculated using Equation (1).

Here, Ba is the absolute luminance (cd / m ² ), F is the aperture value (F value), T is the shutter speed (sec), and S is the ISO sensitivity.

  Next, the luminance value l (x, y) of each pixel is calculated from the luminance (absolute luminance) of the entire captured image using Expression (2).

  Here, Y (x, y) is the Y value (luminance value) in the CIE XYZ color system, and maxY is the maximum Y value (maximum luminance value) in the image.

  With the above calculation method, the overall brightness value (BV_AVE) of the display area 41 of the entire image and the background brightness value (BB_AVE) of the display area 43 of superimposition information are obtained.

The color control unit 17 calculates the transmittance using Equation (3) so that the illuminance value of the display area 43 of the superimposition information is within the limit value of illuminance that can be supported due to hardware restrictions. The color control means 17 determines the darkness of the background color (black) that becomes the transmittance, and displays the superimposition information in that color.
τ = Et / E (3)
Here, τ is the transmittance, Et is the background illuminance (limit value of the illuminance value that can be supported due to hardware restrictions) of the display area 43 of the superimposed information after transmission, and E is the background illuminance.

  Note that the relationship between the transmittance and the darkness of the background color (black) differs depending on the optical system used in the HMD 10. Therefore, it is preferable to create a transmittance / color table 145 in advance using design values and measurement values for each type of HMD 10 and store the transmittance / color table 145 in the storage unit 14 for each type of HMD 10. Alternatively, it is preferable to set in advance a calculation formula for converting the transmittance and the darkness of the background color (black). The color control means 17 specifies the display color (darkness) for a predetermined transmittance using these tables and calculation formulas. For example, the color control unit 17 may change the color or the color density of the image of the superimposition information stepwise based on the transmittance / color table 145.

  The luminance setting unit 16 sets a display luminance value based on the overall luminance value, the background luminance value, and the luminance value calculated by the calculating unit 15. When the background brightness value (BB_AVE) is larger than the overall brightness value (BV_AVE) (that is, the superimposition information display area 43 is brighter than the surrounding area), the brightness setting unit 16 calculates the brightness value calculated from the illuminance value. To the absolute value | (BB_AVE)-(BV_AVE) | of the difference. The added luminance value becomes the display luminance value.

  The luminance setting means 16 calculates the luminance value calculated from the illuminance value when the background luminance value (BB_AVE) is lower than the overall luminance value (BV_AVE) (that is, the superimposition information display area 43 is darker than the surrounding area). Is subtracted from the absolute value | (BB_AVE) − (BV_AVE) |. The subtracted luminance value becomes the display luminance value.

  The brightness setting unit 16 determines whether the set background brightness value (BB AVE) exceeds the limit brightness that the HMD 10 can output. If the luminance setting unit 16 determines that the set background luminance value (BB AVE) exceeds the limit luminance, the color control unit 17 controls the color or color density of the image of the superimposition information. The color or color density of the superimposition information image includes at least one of the color or color density of the background image 44 of the superimposition information shown in FIG.

  The color control means 17 may change the color of the image of superimposition information or the color intensity in steps. For example, the color control unit 17 can control the color or the color density stepwise based on the transmittance based on the transmittance / color table 145.

  The color control means 17 changes the color or the color intensity of at least one of the background image 44 and the character information 45 in the superimposition information display area 43. For example, the color control means 17 may change only the color of the background image 44, may change only the color of the character information 45, or may change the colors of both the background image 44 and the character information 45. Good. The superimposition information character information 45 is an example of transmission information displayed in the superimposition information display area 43. The transmission information includes not only characters but also objects of some shape such as symbols, numerical values, and marks.

  For example, when the display brightness value is set by the brightness setting means 16 and the display brightness value exceeds the limit brightness value due to hardware restrictions, the color control means 17 shows that shown in FIG. The color of the superimposition information can be controlled as shown in FIG. Specifically, the color of the background image 44 is changed from white to black, and the color of the character information 45 is changed from black to white. This is because the color of the background image 44 is changed from the lightest (white) to the darkest (black), and the color of the character information 45 is changed from the darkest (black) to the lightest (white). I can say that.

  Similarly, for example, when the illuminance value of the background exceeds a limit illuminance value that can be supported due to hardware restrictions, the color control means 17 shows the results shown in FIGS. 6 (a) and 6 (b). As described above, the color of the background image 44 of the superimposition information may be changed from white to black, and the color of the character information 45 may be changed from black to white.

  The superimposition information display unit 18 controls the display 40 to the display luminance value set by the luminance setting unit 16. The superimposition information display means 18 displays the superimposition information in the superimposition information display area 43 in the display color controlled by the color control means 17.

Note that the reading unit 12 and the superimposing information generation unit 13 may be provided not in the HMD 10 but in a smartphone, a tablet device, a PC (personal computer), a server, or the like connected to the HMD 10.
<First Embodiment>
[Color control processing]
Next, color control processing according to the first embodiment will be described with reference to FIG. FIG. 7 is a flowchart illustrating an example of a color control process according to the first embodiment.

  First, the acquisition unit 11 acquires an illuminance value from the illuminance sensor 30 (step S10). Next, the acquisition unit 11 acquires a captured image and shooting parameters (aperture, shutter speed, ISO sensitivity, etc.) from the imaging camera 20 (step S11).

  Next, the reading unit 12 reads the AR marker 46 included in the acquired image and extracts marker information, and the superimposition information generation unit 13 obtains superimposition information and superposition position information based on the marker information extracted by the reading unit 12. Generate (step S12). The superimposition position information indicates a display area of superimposition information, and is indicated by, for example, two-dimensional coordinates with the upper left of the display screen being “0” and lengths in the horizontal direction and the vertical direction.

  Next, the calculation means 15 calculates a luminance value corresponding to the acquired illuminance value based on the illuminance / luminance table 141 (step S13). Next, the calculation means 15 calculates the overall luminance value and the background luminance value in the display area of the superimposition information from the acquired image and the shooting parameter using the equations (1) and (2) (step S14). ). Thereby, the overall luminance value (BV_AVE) and the background luminance value (BB_AVE) are obtained.

  The brightness setting means 16 determines whether the background brightness value (BB_AVE) is higher than the overall brightness value (BV_AVE) (whether the background of the display area 4 of the superimposition information is brighter than the surroundings) (step S15). If the luminance setting means 16 determines that the background luminance value is higher than the overall luminance value ((the background of the superimposition information display area 4 is brighter than the surroundings), the absolute value of the difference is added to the luminance value calculated from the illuminance value. | (BB_AVE)-(BV_AVE) | is added (step S16), and the added luminance value is the display luminance value.

  If the luminance setting means 16 determines that the background luminance value (BB_AVE) is lower than the overall luminance value (BV_AVE) (the background of the superimposition information display area 4 is darker than the surroundings), the luminance setting means 16 determines the luminance value calculated from the illuminance value. The absolute value | (BB_AVE) − (BV_AVE) | of the difference is subtracted (step S17). The subtracted luminance value is the display luminance value.

  Next, the luminance setting means 16 determines whether or not the display luminance value exceeds a limit luminance value due to hardware restrictions of the HMD 10 (step S18). If the luminance setting unit 16 determines that the display luminance value does not exceed the limit luminance value due to hardware restrictions, the luminance setting unit 16 proceeds to step S21.

  On the other hand, when the luminance setting unit 16 determines that the display luminance value exceeds the limit luminance value due to hardware restrictions, the color control unit 17 determines that the background luminance value of the superimposition information is due to hardware restrictions. The transmittance that falls within the limit luminance value is calculated using the above equation (3) (step S19). Next, the color control unit 17 determines the darkness of the display color of the background image 44 having the calculated transmittance based on the transmittance / color table 145 (step S20).

  In the present embodiment, as shown in FIG. 6, the color density of the superimposition information character information 45 is changed from black (darkest) in FIG. 6 (a) to white (lightest) in FIG. 6 (b). Has been. The display color of the background image 44 is changed from white (the lightest) in FIG. 6A to gray (somewhat light) in FIG. Thereby, in HMD10 which concerns on this embodiment, superimposition information is displayed so that identification is possible, and the visibility of superimposition information can be improved. However, other combinations may be used. For example, shades of colors other than black (for example, blue) may be controlled.

  Next, the superimposition information display means 18 displays the character information 45 and background image 44 of the superimposition information in the determined display color (darkness). At that time, the superimposition information display means 18 controls the display 40 to the brightness of the set display luminance value (step S21), and the process is thus completed.

At this time, when the display luminance value exceeds the limit luminance value due to hardware restrictions, the superimposition information is displayed in a darker state than the set display luminance value. On the other hand, according to the HMD 10 according to the present embodiment, when the display luminance value exceeds the limit luminance value due to hardware limitations of the HMD 10, the color (character information 45 or background image) for displaying the superimposition information is displayed. 44 colors) or the color intensity is changed. Accordingly, it is possible to suppress the difficulty of viewing the superimposition information by suppressing the background luminance value of the superimposition information, and to display the superimposition information so that it can be recognized.
Second Embodiment
Next, the configuration and operation of the HMD 10 according to the second embodiment will be described. In the first embodiment, an example in which the background image 44 of the superimposition information is set to black and the density is controlled has been described. On the other hand, in the second embodiment, an example in which the background image 44 of the superimposition information is controlled in consideration of the color of the outside scene 42 where the superimposition information display area 43 overlaps is shown. Specifically, the color control unit 17 changes the color of the background image 44 of the superimposition information to a color complementary to the color of the external scene 42 in consideration of the color of the external scene 42 overlapping the display area 43 of the superimposition information. Complementary color refers to a combination of related colors that are located exactly opposite in the hue circle. For example, red and green, yellow and purple, and blue and orange.

  The basic configuration in the second embodiment is the same as in FIG. The difference is that the luminance setting means 16 acquires the color information of the outside scene 42 that overlaps the display area 43 at the superimposition position and sends it to the color control means 17, and the outside scene where the color control means 17 overlaps the display area 43 at the superposition position. The color control unit 17 controls the color of the background image 44 of the superimposition information in consideration of the color of the external scene 42 to be superimposed and the point that the information is acquired in consideration of the color 42 and sent to the color control unit 17. Is a point.

[Color control processing]
Next, color control processing according to the second embodiment will be described with reference to FIG. FIG. 8 is a flowchart illustrating an example of color control processing according to the second embodiment.

  The second embodiment is different from the first embodiment shown in FIG. 7 only in that steps S30 and S31 of FIG. 8 are added. Therefore, it demonstrates centering on the process of step S30, S31, and description of each step of step S10-S21 is abbreviate | omitted.

  Similar to the first embodiment, after processing steps S10 to S17, the luminance setting unit 16 determines whether the display luminance value exceeds a limit luminance value due to hardware limitations of the HMD 10 (step S18). If the luminance setting unit 16 determines that the display luminance value does not exceed the limit luminance value due to hardware restrictions, the luminance setting unit 16 proceeds to step S21.

  On the other hand, when the luminance setting unit 16 determines that the display luminance value exceeds the limit luminance value due to hardware restrictions, the color control unit 17 determines that the background color information (display region 43) of the display region 43 for superimposition information. The display color of the portion of the outside scene 42 corresponding to the background of the image is acquired, and the average value of the background colors is calculated (step S30). Next, after processing steps S19 to S21 in FIG.

Below, an example which calculates the complementary color of each color of R / G / B in step S30 is shown. For example, when the average color R / G / B values are R: 30, G: 70, and B: 255, the maximum R / G / B value is added to the R / G / B value. Each subtracted color is a complementary color.
R: (30 + 255) -30 = 255
G: (30 + 255) -70 = 215
B: (30 + 255) −255 = 30
Next, the color control means 17 sets the complementary color for the calculated average value of the background colors as the display color of the background image 44 of the superimposition information (step S31).

  An example in which the background image 44 of the superimposition information is displayed in a complementary color is shown in FIG. In the first embodiment, as shown in FIG. 6B, the display color of the background image 44 of the superimposition information is changed to the shade of the color of the background image 44 corresponding to the transmittance. On the other hand, in the second embodiment, as shown in FIG. 9, the display color of the background image 44 is complementary to the display color of the external scene 42 in consideration of the display color of the external scene 42 in the background image 44 of the superimposition information. has been changed. Depending on the display color of the changed background image 44, the color of the character information 45 and the color density may be changed.

  According to the HMD 10 according to the present embodiment, the display luminance value is set based on the luminance value according to the illuminance value, the background luminance value, and the overall luminance value. When the display luminance value exceeds the limit luminance value due to hardware restrictions of the HMD 10, the display color of the superimposition information (the color of the character information 45 and the background image 44) and the density thereof are changed. Accordingly, it is possible to prevent the superimposition information from being difficult to see by suppressing the background luminance value in the superimposition information display area 43 and to display the superimposition information in a recognizable manner.

  In this embodiment, the display color of the superimposition information is changed in consideration of the display color of the portion corresponding to the background of the display area 43 of the superimposition information. Thereby, even when the display luminance value exceeds the limit luminance value due to hardware restrictions of the HMD 10, it is possible to further suppress the difficulty of seeing the superimposition information and increase the visibility of the superimposition information. In this embodiment, only the display color of the background image 44 of the superimposition information is changed. However, the present invention is not limited to this. The display color of at least one of the information 45 can be changed.

  Furthermore, in the first and second embodiments, the overall color of the background image 44 of the speech balloon superimposition information is controlled, but as shown in FIG. 10, only the color of the background image around the text information 45 of the superimposition information is changed. You may change and display. According to this, it is possible to minimize the range in which the outside scene 42 is difficult to see due to the superimposition information.

  The HMD 10 according to the first and second embodiments has been described above. In the above embodiment, regarding the shade of the color (in the case of black), “0” is the lightest color (white), “255” is the darkest color (black), and “1” to “254” between them. In the description, the range is gray, and the lighter gray becomes closer to “0” and the darker gray becomes closer to “255”. Similarly, when the display color is a color other than black, “0” indicates the lightest color of the color, “255” indicates the darkest color, and approaches “0” in the range of “1” to “254”. The lighter the color, the darker the color approaches “255”.

(Hardware configuration example)
Finally, the hardware configuration of the HMD 10 according to the present embodiment will be described with reference to FIG. FIG. 11 shows an example of a hardware configuration of the HMD 10 according to the present embodiment. The HMD 10 includes an input device 111, a display device 112, an external I / F 113, a RAM (Random Access Memory) 114, a ROM (Read Only Memory) 115, a CPU (Central Processing Unit) 116, a communication I / F 117, and an HDD (Hard Disk). Drive) 118 and the like are connected to each other via a bus B.

  The input device 111 includes a keyboard and a mouse, and is used to input each operation signal to the HMD 10. The display device 112 includes a display and displays various processing results. The communication I / F 117 is an interface that connects the HMD 10 to a network. Accordingly, the HMD 10 can perform data communication with other devices via the communication I / F 117.

  The HDD 118 is a nonvolatile storage device that stores programs and data. The stored programs and data include basic software and application software that control the entire HMD 10. For example, the HDD 118 may store various databases and programs.

  The external I / F 113 is an interface with an external device. The external device includes a recording medium 113a. Thereby, the HMD 10 can read and / or write to the recording medium 113 a via the external I / F 113. The recording medium 113a includes a floppy (trademark or registered trademark) disk, a CD (Compact Disk), a DVD (Digital Versatile Disk), an SD memory card, a USB memory (Universal Serial Bus memory), and the like. is there.

  The ROM 115 is a nonvolatile semiconductor memory (storage device) that can retain internal data even when the power is turned off. The ROM 115 stores programs such as network settings and data. The RAM 114 is a volatile semiconductor memory (storage device) that temporarily stores programs and data. The CPU 116 is an arithmetic device that realizes control and mounting functions of the entire apparatus by reading programs and data from the storage device (for example, “HDD 118” and “ROM 115”) onto the RAM 114 and executing processing.

  With this configuration, in the HMD 10 according to the present embodiment, the CPU 116 executes color control processing using data and programs stored in the ROM 115 and the HDD 118. The information stored in the illuminance / luminance table 141 and the transmittance / color table 145 can be stored in the RAM 114, the HDD 118, or a server on the cloud connected to the HMD 10 via the network.

  The display device and the display control program have been described in the above embodiment, but the display device and the display control program according to the present invention are not limited to the above embodiment, and various modifications and improvements are within the scope of the present invention. Is possible. In addition, when there are a plurality of the above-described embodiments and modifications, they can be combined within a consistent range.

Regarding the above description, the following items are further disclosed.
(Appendix 1)
A display device that displays superimposed information superimposed on an outside scene,
An acquisition means for acquiring an image of the outside world and acquiring an illuminance value of the outside world;
Obtain and obtain a background luminance value indicating the luminance of the display area of the superimposition information of the acquired image and an overall luminance value indicating the luminance of an area including the area around the display area of the superimposition information of the image Calculating means for calculating a luminance value according to the illuminance value,
Brightness setting means for setting a display brightness value based on the calculated overall brightness value, the background brightness value, and the brightness value;
When it is determined that the set display luminance value exceeds a limit value of luminance that can be output by the display device, a color control unit that controls a color or color intensity for displaying the superimposition information;
A display device.
(Appendix 2)
The color control means includes
Step by step to control the color or color intensity for displaying the superimposition information,
The display device according to appendix 1.
(Appendix 3)
The color control means 17
Changing the color or the color intensity of at least one of the background image and the transmission information in the display area of the superimposition information;
The display device according to appendix 1 or 2.
(Appendix 4)
The color control means 17
When changing the color of the background image of the superimposition information, the color or the color intensity of all the areas of the background area of the superimposition information or the area around the transmission information in the background area of the superimposition information is changed. ,
The display device according to any one of appendices 1 to 3.
(Appendix 5)
A display control program for causing a computer to execute processing for displaying superimposition information superimposed on an outside scene,
Get an image of the outside world, get the illuminance value of the outside world,
Obtain and obtain a background luminance value indicating the luminance of the display area of the superimposition information of the acquired image and an overall luminance value indicating the luminance of an area including the area around the display area of the superimposition information of the image Calculating a luminance value according to the illuminance value,
Based on the calculated overall brightness value, the background brightness value, and the brightness value, a display brightness value is set,
When it is determined that the set display luminance value exceeds a limit value of luminance that can be output by the display device, the color for displaying the superimposition information or the color intensity is controlled.
Display control program.
(Appendix 6)
Step by step to control the color or color intensity for displaying the superimposition information,
The display control program according to attachment 5.
(Appendix 7)
Changing the color or the color intensity of at least one of the background image and the transmission information in the display area of the superimposition information;
The display control program according to appendix 5 or 6.
(Appendix 8)
When changing the color of the background image of the superimposition information, the color or the color intensity of all the areas of the background area of the superimposition information or the area around the transmission information in the background area of the superimposition information is changed. ,
The display control program according to any one of appendices 5 to 7.

10: HMD
11: Acquisition means 12: Reading means 13: Superimposition information generation means 14: Storage means 15: Calculation means 16: Brightness setting means 17: Color control means 18: Superimposition information display means 20: Imaging camera 30: Illuminance sensor 40: Display 41 : Display area of entire image 43: Display area of superimposition information 44: Character information 45: Background image 141: Illuminance / luminance table 142: Illuminance value 143: Luminance value 145: Transmissivity / color table 146: Transmissivity 147: Background color Darkness of

Claims (5)

A display device that displays superimposed information superimposed on an outside scene,
An acquisition means for acquiring an image of the outside world and acquiring an illuminance value of the outside world;
Obtain and obtain a background luminance value indicating the luminance of the display area of the superimposition information of the acquired image and an overall luminance value indicating the luminance of an area including the area around the display area of the superimposition information of the image Calculating means for calculating a luminance value according to the illuminance value,
Brightness setting means for setting a display brightness value based on the calculated overall brightness value, the background brightness value, and the brightness value;
When it is determined that the set display luminance value exceeds a limit value of luminance that can be output by the display device, a color control unit that controls a color or color intensity for displaying the superimposition information;
A display device. The color control means includes
Step by step to control the color or color intensity for displaying the superimposition information,
The display device according to claim 1. The color control means includes
Changing the color or the color intensity of at least one of the background image and the transmission information in the display area of the superimposition information;
The display device according to claim 1. The color control means includes
When changing the color of the background image of the superimposition information, change the color of all the areas of the background area of the superimposition information or the area around the transmission information of the background area of the superimposition information,
The display apparatus as described in any one of Claims 1-3. A display control program for causing a computer to execute processing for displaying superimposition information superimposed on an outside scene,
Get an image of the outside world, get the illuminance value of the outside world,
Obtain and obtain a background luminance value indicating the luminance of the display area of the superimposition information of the acquired image and an overall luminance value indicating the luminance of an area including the area around the display area of the superimposition information of the image Calculating a luminance value according to the illuminance value,
Based on the calculated overall brightness value, the background brightness value, and the brightness value, a display brightness value is set,
When it is determined that the set display luminance value exceeds a limit value of luminance that can be output by the display device, the color for displaying the superimposition information or the color intensity is controlled.
Display control program.

Images