JP2014015127A - Information display apparatus, information display method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information display device capable of easily displaying information to be displayed.
An information display device includes a projection device that projects information on a display area of a windshield, a camera that captures a scene that a passenger sees through the display area, and a display that is displayed among images captured by the camera. A background color information acquisition unit 18 that acquires color information of a portion corresponding to a region, and a display color determination unit that determines a display color having a color difference of 101 or more with respect to the color information acquired by the background color information acquisition unit 18 20 and a display control unit 22 that controls the projection device 10 to project information using a display color in the display area.
[Selection] Figure 2

Description

  The present invention relates to an apparatus for displaying information on a windshield of a vehicle.

  In recent years, a head-up display (HUD), a windshield display (WSD), or the like has been proposed as an information presentation method in an automobile. These display information in a place where the driver who is driving the vehicle can see the vehicle without moving his line of sight from the front, so that information can be provided safely.

  Patent Document 1 discloses an invention of a vehicle display device that appropriately adjusts the brightness of a plurality of images projected to different places. In the present invention, the luminance level of the HUD is adjusted based on the illuminance o detected by the exterior illuminometer and the illuminance i detected by the interior illuminometer. Specifically, when the illuminance o is larger than the illuminance i, it is determined that the backlight is in the daytime, and the HUD display luminance level h is relatively increased corresponding to the illuminance o (Patent Document 1, paragraph [0023]). ]).

JP 2011-111123 A

  In Patent Document 1 described above, the display luminance level on the HUD is adjusted using the detected values of the illuminance outside the vehicle and the illuminance inside the vehicle.

  For example, when you are traveling on a paved road and when you are not, the background that you can see on the other side of the windshield is completely different. That is possible. In addition, for example, it is difficult to see the yellow display on a snowy road, or when the road gets wet and the tail lamp of the vehicle ahead reflects, it may be difficult to see the same color display as the tail lamp.

  Whether the information display is easy to see in this way cannot be determined only by the brightness, and the conventional technology based on the illuminance has a problem that the display is not always easy to see. SUMMARY OF THE INVENTION In view of the above background, an object of the present invention is to provide an information display device that can display information easily.

  An information display device according to the present invention includes a projection device that projects information on a predetermined display area of a vehicle window, a camera that captures a scenery that an occupant sees through the display area, and an image captured by the camera. A background color information acquisition unit that acquires color information of a portion corresponding to a display area, and a display that determines a display color having a color difference equal to or greater than a predetermined threshold with respect to the color information acquired by the background color information acquisition unit A color determination unit; and a display control unit configured to control the projection device and project the information on the display area using the display color.

  As a result of intensive research on a method for displaying information in an easy-to-see manner regardless of the background scenery that changes depending on the external environment, the present inventors have determined that the identification rate of information displayed on the vehicle window is the display of background color and information. It was found that it was related to the color difference from the color used in The present inventors have completed the present invention based on this finding. According to the present invention, information is displayed on the vehicle window using a display color having a color difference greater than or equal to a predetermined threshold value regardless of whether it is daytime or nighttime, weather, pavement state, etc. Information can be displayed in easy-to-see colors regardless of environmental changes.

  The information display device of the present invention includes a display provided on a pillar of a vehicle, a camera that captures a scene in the direction of the pillar when viewed from the occupant, and an image captured by the camera from the occupant. A display control unit that cuts out an image corresponding to the position of the display and displays the image on the display, a background color information acquisition unit that acquires color information of the cut-out image, and a color acquired by the background color information acquisition unit A display color determining unit that determines a display color having a color difference equal to or greater than a predetermined threshold for the information, and the display control unit displays the information on the display by using the display color in a superimposed manner. It has a configuration.

  With this configuration, information is displayed using an external scenery image displayed on the display and a display color having a color difference equal to or greater than a predetermined threshold, so that information can be displayed in an easy-to-see color regardless of changes in the external environment. .

  In the information display device of the present invention, the display color determination unit may determine a color having a color difference of 101 or more with respect to the color information acquired by the background color information acquisition unit as the display color.

  FIG. 1 is a diagram showing the results of one experiment conducted by the present inventors. This experiment examines how close the color difference between the two colors is to confuse the two colors, and how far apart they can distinguish the two colors, when there is an overlap between the two colors. The purpose is to examine the color difference that can easily identify the displayed information (the display is used in a vehicle, so it must be readily visible). This experiment is displayed on the HUD in primary colors (red, blue, green), secondary colors (yellow, light blue, pink), and tertiary colors (red orange, orange yellow, yellow green, blue green, blue purple, red purple). The displayed characters are displayed for 1 second, and after a random time of 1 to 5 seconds has passed, the characters are displayed using the same or different colors, and they are asked whether they are the same color or different colors, and the correct answer rate Was measured. In the experiment, 120 questions were asked to five subjects. FIG. 1 shows the relationship between the color difference and the identification result. As shown in FIG. 1, when the color difference is 101 or more, a very good identification result is obtained. When displaying information on the windshield such as HUD, the color difference is preferably 101 or more. I understood that.

In the information display device of the present invention, the display color determination unit uses the L value fgL, a value fga, and b value fgb of the display color, and the L value bgL, a value bga, and b value bgb of the background color information. The following formula may be used.

  By using such a mathematical expression, it is possible to easily obtain a display color with a high identification rate according to the background color information.

  In the information display device of the present invention, the display color determination unit obtains a combination of a plurality of display colors having a color difference equal to or greater than a predetermined threshold and a color difference from the background color is large with respect to high priority information. A display color may be assigned, and a display color having a small color difference from the background color may be assigned to low priority information.

  In the case of high-priority information that you want to notice immediately, it is possible to display information in an easier-to-see manner by using a color with a large color difference from the background color. Here, the Lab value can be used as a reference for defining the display color. For example, the predetermined threshold value can be 101.

  The information display device of the present invention has a table for converting RGB values and Lab values, and the display color determination unit and the display control unit convert RGB values and Lab values by referring to the table. Also good.

  Thus, by having a table for converting RGB values and Lab values, it is possible to quickly convert between RGB values and Lab values.

  The information display method of the present invention is a method of projecting information onto a predetermined display area of a vehicle window by an information display device, wherein the information display device captures with a camera a scene that the occupant sees through the display region. The information display device acquires color information of a portion corresponding to the display area in an image captured by the camera, and the information display device performs a predetermined process on the acquired color information. Determining a display color having a color difference equal to or greater than a threshold value, and controlling the projection device so that the information display device projects the information using the display color on the display area.

  The information display method of the present invention is a method of displaying information on a display provided on a pillar of a vehicle by an information display device, wherein the information display device uses a camera to view a landscape in the direction of the pillar as viewed from the occupant. Imaging, a step in which the information display device cuts out an image of a portion corresponding to the position of the display as viewed from an occupant from an image captured by the camera, and displays the image on the display. A step of acquiring color information of the cut-out image, and a step of determining a display color having a color difference equal to or greater than a predetermined threshold with respect to the color information acquired by the information display device by the background color information acquisition unit. And the information display device superimposes and displays the information on the display using the display color.

  The program of the present invention is a program for projecting information onto a predetermined display area of a window of a vehicle, and images a scene viewed by an occupant through the display area on a computer having a camera and a projection device. A step of acquiring color information of a portion corresponding to the display area in an image captured by the camera, and a display color having a color difference equal to or greater than a predetermined threshold with respect to the acquired color information. A step of determining, and a step of controlling the projection device to project the information using the display color on the display area.

  The program of the present invention is a program for displaying information on a display provided in a pillar of a vehicle, and images a landscape in the direction of the pillar as seen from the occupant to a computer equipped with a camera. A step of cutting out an image of a portion corresponding to the position of the display as viewed from the occupant from the image captured by the camera and displaying the image on the display; and obtaining color information of the cut out image; A step of determining a display color having a color difference equal to or greater than a predetermined threshold with respect to the color information acquired by the background color information acquisition unit, and the information is superimposed on the display using the display color. Step.

  According to the present invention, there is an effect that information can be displayed on a window of a vehicle in an easy-to-see manner regardless of changes in the external environment.

It is an experimental result which shows the relationship between the color difference of a foreground and a background, and a discrimination rate. It is a figure which shows the structure of the information display apparatus of 1st Embodiment. It is a figure which shows a mode that information was projected on the windshield. It is a flowchart which shows the operation | movement of the display color change by the information display apparatus of 1st Embodiment. It is a figure which shows the structure of the information display apparatus of 2nd Embodiment. It is a figure which shows the display provided in A pillar. It is a figure which shows the structure of the information display apparatus of 3rd Embodiment. It is a flowchart which shows the operation | movement of the display color change by the information display apparatus of 3rd Embodiment.

  Next, an information display device according to an embodiment of the present invention will be described with reference to the drawings. In the following embodiments, an information display device used by being mounted on a vehicle will be described as an example. However, the information display device is not limited to a vehicle as long as it is mounted on a vehicle and used, for example, on a bus, motorcycle, train, etc. Can also be applied.

(First embodiment)
FIG. 2 is a diagram illustrating a configuration of the information display device 1 according to the first embodiment. The information display device 1 includes a projection device 10 that displays information by projecting it onto a windshield of a vehicle, a camera 12 that images the front of the vehicle, and a control unit 14 that controls display of information.

  FIG. 3 is a diagram illustrating an example in which information is projected and displayed on the windshield by the projection device 10. In FIG. 3, guidance information A indicating that a right turn is to be made 100 m ahead is displayed (note that in FIG. 3, for the sake of convenience, a dotted line is enclosed, but the dotted line is not actually displayed). As described above, when information is displayed by the projector 10, a part of the windshield forms a display, which is called a head-up display or a windshield display. Moreover, when using as a function which displays a meter according to predetermined conditions, it may be called a pop-up meter.

  In the present specification, an area where information is displayed in the windshield is referred to as a “display area”. The camera 12 that captures the front of the vehicle includes the direction of the display area as seen from the occupant in the imaging field of view. In the present embodiment, an example of displaying on the windshield is given. However, the present invention is not necessarily limited to displaying information on the windshield, but can be applied to displaying information on the side glass or rear glass.

  The control unit 14 includes an imaging control unit 16, a background color information acquisition unit 18, a display color determination unit 20, and a display control unit 22. The imaging control unit 16 has a function of controlling the camera 12 to control imaging timing and the like.

  The background color information acquisition unit 18 has a function of acquiring color information of the scenery that the occupant sees through the display area. This color information is obtained because the scenery that the occupant sees through the display area is the background of the displayed information. As a specific process, the background color information acquisition unit 18 first detects the occupant from the captured image of the camera 12 based on the height of the occupant's eyes, the position of the display area, and the angle of view of the camera 12. Identify the image corresponding to the part you are looking through.

  Subsequently, the background color information acquisition unit 18 cuts out the specified portion from the captured image, generates a histogram of the RGB values of each pixel constituting the cut-out image, and obtains the RGB value that exists most in the specified portion. . The background color information acquisition unit 18 converts the RGB values into Lab values. Thereby, the background color information of the display area can be acquired.

  For conversion between RGB values and Lab values, a conversion table indicating the correspondence between RGB values and Lab values may be used. In this case, the background color information acquisition unit 18 performs conversion by reading Lab values corresponding to RGB values from the conversion table. Thereby, the calculation process for converting RGB values into Lab values can be reduced.

The display color determination unit 20 has a function of determining a display color used when displaying information based on the background color information acquired by the background color information acquisition unit 18. When the color information of the background color is L value bgL, a value bga, and b value bgb, the display color determination unit 20 uses the following formulas for the color information L value fgL, a value fga, and b value fgb of the information. Ask.

Here, the ranges of L value, a value, and b value are as follows.
0 ≦ L ≦ 100
−134 ≦ a ≦ 220
−140 ≦ b ≦ 122

  The display color obtained using this calculation formula has a color difference of 101 or more from the background color. The display color determination unit 20 has a difference of a predetermined threshold value or more between the background color information acquired by the background color information acquisition unit 18 and the background color information used when determining the currently used display color. In addition, the process of determining the display color of information is performed, and when the difference is less than a predetermined threshold, the current display color may be used as it is. As a result, the process of determining the display color can be performed only when the background changes greatly, and the calculation processing load for obtaining the display color can be reduced.

  The display control unit 22 has a function of controlling the projection device 10 to project and display information on the display area. The display control unit 22 displays information using the display color determined by the display color determination unit 20. Since the projector 10 designates a color using RGB values, the display control unit 22 obtains an RGB value corresponding to the Lab value of the display color and displays information using the corresponding RGB value.

  The hardware which comprises the control part 14 of the information display apparatus 1 demonstrated above is a computer which has CPU, RAM, ROM, an input part, and an output part. Each function of the control unit 14 can be realized by executing a program for displaying information stored in the ROM. Such a program is also included in the scope of the present invention.

  FIG. 4 is a flowchart illustrating the operation of changing the display color by the information display device 1 according to the first embodiment. The information display device 1 displays information on the HUD when necessary in parallel with constantly changing the display color of information according to the external environment by the operation shown in the flowchart of FIG.

  First, the information display device 1 captures the front of the vehicle with the camera 12 (S10), and acquires color information of the scenery that the occupant sees through the display area, that is, background color information, from the captured images (S12). . The information display device 1 determines whether or not there is a difference equal to or greater than a predetermined threshold compared with the background color information when the current display color is determined (S14). As a result, if it is determined that there is no difference equal to or greater than the predetermined threshold (NO in S14), the process returns to the process of capturing the front of the vehicle with the camera 12 (S10) and the above process is repeated.

  When it is determined that the acquired background color information has a difference equal to or greater than a predetermined threshold compared to the background color information when the current display color is determined (YES in S14), the information display device 1 A display color is determined (S16). Specifically, as described above, the Lab value of the display color is calculated from the Lab value of the background color using the equation (1). The information display device 1 changes the display color of the information to the determined display color (S18).

  The configuration and operation of the information display device 1 according to the first embodiment have been described above. The information display device 1 according to the first embodiment obtains color information of a background color of a display area where information display is performed by analyzing an image captured by the camera 12, and a display determined based on the background color information. Since information is displayed using colors, information can be displayed in an easy-to-see manner even when the external environment of the vehicle changes.

(Second Embodiment)
FIG. 5 is a diagram illustrating a configuration of the information display device 2 according to the second embodiment. The basic configuration of the information display device 2 of the second embodiment is the same as that of the first embodiment, but in the second embodiment, information is not projected and displayed on the front panel, but is displayed on the display 24. To display.

  FIG. 6 is a diagram illustrating an appearance of the display 24 included in the information display device 2. The display 24 is provided on the A-pillar on the driver side. The display 24 always displays the condition outside the vehicle in the direction from the driver to the A pillar. In FIG. 6, a person walking a dog is hidden in the A pillar, but is displayed on the display 24 on the A pillar. That is, by displaying the scenery of the outside world blocked by the A pillar on the display 24, it looks as if the A pillar is seen through. Hereinafter, an image displaying the situation outside the vehicle is referred to as a “background image”.

  In the information display device 2 of the second embodiment, the background color information of the background image is acquired, and the display color of the information is determined based on the background color information. Hereinafter, the information display apparatus 2 according to the second embodiment will be described focusing on differences from the first embodiment.

  The camera 12 is installed so as to capture an image of the front side of the vehicle (the direction in which the A pillar provided with the display 24 is located). The display control unit 26 has a function of cutting out an area corresponding to the position of the A pillar as viewed from the occupant from the captured image captured by the camera 12 and displaying an image (background image) of the extracted area on the display 24. ing.

  The background color information acquisition unit 18 has a function of acquiring color information of the extracted background image. The method for calculating the color information is the same as in the first embodiment. The method of determining the display color by the display color determination unit 20 and the configuration for displaying information using the determined display color are the same as in the case of the first embodiment. In FIG. 6, a mark for calling attention is displayed on the display 24 so as to be superimposed on the background image.

  The operation of changing the display color of information by the information display device 2 of the second embodiment is the same as that of the first embodiment.

  The configuration and operation of the information display device 2 according to the second embodiment have been described above. As in the first embodiment, the information display device 2 according to the second embodiment can display information in an easy-to-see manner even when the external environment of the vehicle changes.

(Third embodiment)
FIG. 7 is a diagram illustrating a configuration of the information display device 3 according to the third embodiment. In the first embodiment and the second embodiment described above, the example in which the display color for displaying information is one color has been described. However, in the third embodiment, a plurality of colors having a color difference of 101 or more are used. Will be described as a display color candidate, and an example in which the display color is changed according to the priority of the information to be displayed will be described.

  The basic configuration of the information display device 3 of the third embodiment is the same as that of the first embodiment. However, in the third embodiment, the control unit 14 includes a plurality of information based on the background color information. A display color candidate determining unit 28 that selects a display color and a display color determining unit 30 that determines a display color that matches the priority of information from the display color candidates are included.

  The display color candidate determination unit 28 has a function of determining display color candidates that have a color difference of 101 or more from the background color information. There are several methods for determining display color candidates. For example, a Lab value is selected at random, and whether or not the color difference from the Lab value of the background color is 101 or more is determined. A method of determining the Lab value as a display color candidate can be employed.

  The display color determination unit 30 determines a display color from among display color candidates according to the priority of information to be displayed. In the case of information having a high priority, a color having a large color difference from the background color is determined as a display color, and in the case of information having a low priority, a color having a small color difference from the background color is determined as a display color. The display control unit 22 displays a background image and displays information using the determined display color.

  FIG. 8 is a flowchart illustrating the operation of changing the display color by the information display device 3 according to the third embodiment. The information display device 3 displays information on the HUD when necessary in parallel with constantly changing the display color of information according to the external environment according to the flowchart shown in FIG.

  The information display device 3 first images the front of the vehicle with the camera 12 (S10), and acquires color information of the scenery that the occupant sees through the display area, that is, background color information, from the captured image (S12). . The information display device 3 determines whether or not there is a difference equal to or greater than a predetermined threshold compared with the color information when the current display color is determined (S14). As a result, when it is determined that there is no difference equal to or greater than the predetermined threshold (NO in S14), the process returns to the process of imaging the front of the vehicle with the camera 12 and the above process is repeated.

  When it is determined that the acquired background color information has a difference equal to or greater than a predetermined threshold compared to the color information when the current display color is determined (YES in S14), the information display device 3 A plurality of display colors are determined (S20). Specifically, as described above, it is determined whether the Lab value selected at random has a color difference of 101 or more with the Lab value of the background color, and if there is a color difference of 101 or more, it is determined as a display color candidate. .

  Subsequently, the information display device 3 determines a display color from the display color candidates according to the priority to be displayed (S22). If the priority is high, a candidate having a large color difference from the background color is determined as a display color, and if the priority is low, a candidate having a small color difference from the background color is determined as a display color. The information display device 3 changes the display color of the information to the determined display color (S24).

  The configuration and operation of the information display device 3 according to the third embodiment have been described above. Similar to the above-described embodiment, the information display device 3 according to the third embodiment can display information in an easy-to-see manner even when the external environment of the vehicle changes.

  In addition, since the information display device 3 of the third embodiment determines the display color of information according to the priority, if there is high priority information that the driver wants to notice immediately, the information display device 3 By displaying in a conspicuous manner with a large color difference, it is possible to prompt the driver to notice.

  As described above, the information display device according to the embodiment of the present invention has been described in detail with reference to the embodiment. However, the present invention is not limited to the above-described embodiment, and does not depart from the essence of the present invention. Various changes can be made.

  The present invention has an effect that information can be displayed on a window of a vehicle in an easy-to-see color regardless of changes in the external environment, and is useful as a HUD, WSD, or the like used in a vehicle.

1 to 3 Information display device 10 Projection device 12 Camera 14 Control unit 16 Imaging control unit 18 Background color information acquisition unit 20 Display color determination unit 22 Table control unit 24 Display 26 Display control unit 28 Display color candidate determination unit 30 Display color determination unit

Claims (10)

A projection device for projecting information onto a predetermined display area of a vehicle window;
A camera that captures the scenery that the occupant sees through the display area;
A background color information acquisition unit that acquires color information of a portion corresponding to the display area in an image captured by the camera;
A display color determination unit that determines a display color having a color difference equal to or greater than a predetermined threshold for the color information acquired by the background color information acquisition unit;
A display control unit that controls the projection device to project the information onto the display area using the display color;
An information display device comprising: A display provided on the pillar of the vehicle;
A camera that captures the scenery in the direction of the pillar as seen from the occupant;
A display control unit that cuts out an image of a portion corresponding to the position of the display as seen from the occupant from the image captured by the camera, and displays the image on the display;
A background color information acquisition unit for acquiring color information of the clipped image;
A display color determination unit that determines a display color having a color difference equal to or greater than a predetermined threshold for the color information acquired by the background color information acquisition unit;
With
The display control unit is an information display device that superimposes and displays the information on the display using the display color.   The information display device according to claim 1, wherein the display color determination unit determines a color having a color difference of 101 or more with respect to the color information acquired by the background color information acquisition unit as the display color. The display color determination unit obtains the L value fgL, the a value fga, and the b value fgb of the display color using the following formula using the L value bgL, the a value bga, and the b value bgb of the background color information. Item 4. The information display device according to any one of Items 1 to 3.

  The display color determination unit obtains a combination of a background color and a plurality of display colors having a color difference equal to or greater than a predetermined threshold, assigns a display color having a large color difference from the background color to high priority information, 4. The information display device according to claim 1, wherein a display color having a small color difference from the background color is assigned to low information. A table for converting RGB values and Lab values;
The information display device according to claim 1, wherein the display color determination unit and the display control unit convert RGB values and Lab values with reference to the table. An information display method for projecting information onto a predetermined display area of a vehicle window by an information display device,
The information display device captures with a camera a scene that the occupant sees through the display area;
The information display device acquiring color information of a portion corresponding to the display area in an image captured by the camera;
The information display device determining a display color having a color difference equal to or greater than a predetermined threshold for the acquired color information;
Controlling the projection device so that the information display device projects the information on the display area using the display color;
An information display method comprising: An information display method for displaying information on a display provided on a vehicle pillar by an information display device,
The information display device captures with a camera a scene in the direction of the pillar as seen from the occupant;
The information display device cuts out an image of a portion corresponding to the position of the display as viewed from the occupant from an image captured by the camera and displays the image on the display;
The information display device acquiring color information of the cut-out image;
The information display device determines a display color having a color difference equal to or greater than a predetermined threshold for the color information acquired by the background color information acquisition unit;
The information display device displaying the information superimposed on the display using the display color;
An information display method comprising: A program for projecting information onto a predetermined display area of a vehicle window, and a computer equipped with a camera,
Capturing an image of the scenery that the occupant sees through the display area with the camera;
Obtaining color information of a portion corresponding to the display area in an image captured by the camera;
Determining a display color having a color difference equal to or greater than a predetermined threshold with respect to the acquired color information;
Controlling a projection device to project the information using the display color on the display area;
A program that executes A program for displaying information on a display provided on a pillar of a vehicle, and a computer equipped with a camera,
Imaging the scenery in the direction of the pillar as seen from the occupant with the camera;
Cutting out an image of a portion corresponding to the position of the display as seen from the occupant from the image captured by the camera and displaying the image on the display;
Obtaining color information of the clipped image;
Determining a display color having a color difference equal to or greater than a predetermined threshold for the color information acquired by the background color information acquisition unit;
Displaying the information superimposed on the display using the display color;
A program that executes

Images