JPWO2020045330A1 - Vehicle displays, methods, and computer programs - Google Patents

Abstract

It makes it easier to recognize the image and makes it difficult for the driver's visual attention to be excessively deprived. In the processor 20, the image display unit 11 (12) displays the image 200 in a predetermined display area 100 that overlaps the foreground 300 of the vehicle 1, and the peripheral interface 14 of the foreground 300 to the vehicle 1 as the vehicle 1 advances. The approach speed is acquired, or information capable of estimating the approach speed of the foreground 300 is acquired, and the image 200 is displayed so as to approach the vehicle 1 at a first speed slower than the approach speed of the foreground 300. ..

Description

The present disclosure relates to a vehicle display device, a method, and a computer program used in a vehicle to superimpose and visually recognize an image on the foreground of the vehicle.

FIG. 5 of Patent Document 1 discloses a head-up display device (vehicle display device) that displays an image (guidance information B2) imitating a road guide sign fixed at a predetermined position.

Further, in Patent Document 2, by superimposing an image on a real object existing in the landscape in front of the own vehicle and displaying it, augmented reality (AR: Augmented Reality) in which information or the like is added / emphasized to the real object is generated, and the vehicle is used. A vehicle display device that can contribute to safe and comfortable vehicle operation by accurately providing desired information while suppressing the movement of the line of sight of the user who drives the vehicle is disclosed.

Japanese Unexamined Patent Publication No. 2012-006469 International Publication No. 2013/08810

However, in the vehicle display device of Patent Document 1, since the images are fixedly displayed at substantially the same position, the viewer may be annoyed.

Further, in the vehicle display device of Patent Document 2, since the position where the image is displayed follows the position of the real object, the image visually recognized by the viewer is displayed together with the real object when traveling at high speed. Since it moves at high speed, there is a problem that it is difficult to recognize the information shown by the image.

A summary of the particular embodiments disclosed herein is presented below. It should be understood that these aspects are presented solely to provide the reader with an overview of these particular embodiments and do not limit the scope of this disclosure. In fact, the present disclosure may include various aspects not described below.

The outline of the present disclosure relates to making the driver of the vehicle effectively recognize the information. More specifically, it contributes to the safe operation of the vehicle by making it easier to recognize the image and making it difficult for the driver's visual attention to be excessively deprived.

Therefore, the vehicle display device described herein displays an image that appears to be approaching the vehicle at a first speed that is slower than the approaching speed of the foreground as the vehicle travels. In some embodiments, the first speed at which the image approaches may vary depending on the speed of approach of the foreground, or the image appears closer at a second speed that is faster than the first speed. It may be displayed so that it can be seen as approaching at the first speed from the middle of approaching at the second speed.

It is a figure which shows the Example of the display device for a vehicle which concerns on some Embodiments. It is a block diagram of the display device for a vehicle which concerns on some embodiments. It is a figure which shows the display example of the image of the display device for a vehicle which concerns on some Embodiments. It is a figure which shows the display example of the image of the display device for a vehicle which concerns on some Embodiments. It is a figure which shows the approach path of the image of the display device for a vehicle which concerns on some embodiments. It is a flow diagram which shows the process for changing an image which concerns on some embodiments.

Hereinafter, embodiments according to the present invention will be described with reference to the drawings. The present invention is not limited to the following embodiments (including the contents of the drawings). Of course, changes (including deletion of components) can be made to the following embodiments. Further, in the following description, in order to facilitate understanding of the present invention, description of known technical matters will be omitted as appropriate.

Hereinafter, FIGS. 1 and 2 provide a description of an exemplary vehicle display device. A display example is provided in FIGS. 3, 4, and 5. FIG. 6 is a flow chart showing a process of moving an image.

See FIG. The image display unit 11 for displaying the image 200 in the vehicle display device 10 of the first embodiment is a head-up display (HUD: Head-Up Display) device provided in the dashboard 5 of the vehicle 1. The HUD device emits the display light 11a toward the front windshield 2 (an example of the projected member), displays the image 200 in the virtual display area 100, and thereby displays the image 200 through the front windshield 2. The image 200 is visually recognized by superimposing it on the foreground 300, which is a visible real space.

Further, the image display unit 12 for displaying the image 200 in the vehicle display device 10 of the second embodiment is a head-mounted display (hereinafter, HMD) device. The driver 4 attaches the HMD device to his head and sits on the seat of the vehicle 1, so that the displayed image 200 is superimposed on the foreground 300 via the front windshield 2 of the vehicle 1 and visually recognized. The display area 100 on which the vehicle display device 10 displays a predetermined image 200 is fixed at a specific position with respect to the coordinate system of the vehicle 1, and when the driver 4 faces that direction, the display area 100 is fixed at the specific position. The image 200 displayed in the displayed display area 100 can be visually recognized.

The image display units 11 and 12 include a road surface 310 existing in the foreground 300, which is a real space visually recognized through the front windshield 2 of the vehicle 1, road signs, buildings, and obstacles (pedestrians, bicycles, motorcycles) (pedestrians, bicycles, motorcycles). It is also possible to form a visual augmented reality (AR) by visually recognizing the image 200 in the vicinity of a real object such as (another vehicle) or at a position overlapping the real object.

FIG. 2 is a block diagram of the vehicle display device 10 according to some embodiments. The vehicle display device 10 includes an image display unit 11 (12), a peripheral interface 14, one or more processors 16, a storage unit 18, and an image processing circuit 20. The various functional blocks described in FIG. 2 may consist of hardware, software, or a combination of both. FIG. 2 is only one embodiment of the embodiment, and the illustrated components may be combined with a smaller number of components, or there may be additional components. For example, the image processing circuit 20 (for example, a graphic processing unit) may be included in one or more processors 16.

As shown, the processor 16 and the image processing circuit 20 are operably connected to the storage unit 18. More specifically, the processor 16 and the image processing circuit 20 operate the vehicle display device 10 by executing a program stored in the storage unit 18, for example, generating and / or transmitting image data. It can be carried out. The processor 16 and / and the image processing circuit 20 include at least one general purpose microprocessor (eg, central processing unit (CPU)), at least one application specific integrated circuit (ASIC), and at least one field programmable gate array (FPGA). , Or any combination thereof. The storage unit 18 includes any type of magnetic medium such as a hard disk, any type of optical medium such as a CD and DVD, any type of semiconductor memory such as a volatile memory, and a non-volatile memory. Volatile memory may include DRAM and SRAM, and non-volatile memory may include ROM and NVROM.

As shown, the processor 16 is operably linked to the peripheral interface 14. For example, the peripheral interface 14 uses the vehicle display device 10 as a personal area network (PAN) such as a Bluetooth (registered trademark) network, a local area network (LAN) such as an 802.1x Wi-Fi (registered trademark) network, or 4G. Alternatively, it may include a wireless communication interface that connects to a wide area network (WAN) such as an LTE® cellular network. The peripheral interface 14 can also include a wired communication interface such as, for example, a USB port, a serial port, a parallel port, an OBDII, and / or any other suitable wired communication port.

As shown in the figure, the processor 16 can exchange information with various other electronic devices connected to the vehicle display device 10 (peripheral interface 14) by being interoperably connected to the peripheral interface 14. Become. For example, the speed sensor 401, the road information database 402, the own vehicle position detection unit 403, the vehicle exterior sensor 404, the eye point detection unit 405, and the like provided in the vehicle 1 are operably connected to the peripheral interface 14. The image display units 11 and 12 are operably connected to the processor 16 and the image processing circuit 20. Therefore, the image displayed by the image display units 11 and 12 may be based on the image data received from the processor 16 and / and the image processing circuit 20. The processor 16 and the image processing circuit 20 control the images displayed by the image display units 11 and 12 based on the information obtained from the peripheral interface 14. The peripheral interface 14 may have a function of processing (converting, calculating, analyzing) information received from another electronic device or the like connected to the vehicle display device 10.

FIG. 3 is a diagram showing a foreground 300, which is visually recognized when the driver 4 faces forward, and an image 201 displayed on the vehicle display device 10 so as to be superposed on the foreground 300 and visually recognized. be. Image 201 is an image that guides the position of a feature (river, mountain, bridge, railway, building, etc.), and has a text (“○ △ station”) indicating the name of the feature and a symbol indicating the direction of the feature. (Right arrow), which is a virtual reality image that overlaps with the road surface 310 and is drawn on the surface of the road surface 310. The road surface 310 referred to here is the left end 311 of the traveling lane in which the vehicle 1 travels (for example, the left end line of the traveling lane) and the right end 312 of the traveling lane (for example, the right division of the traveling lane) in the foreground 300. The area between the line). The image 201 is a moving image that appears close to the vehicle 1, but it can be replaced by continuously changing the still image. Image 201 appears in the display area 100 as if it is gradually approaching the vehicle 1 from FIGS. 3A to 3D as the vehicle 1 progresses, and is not displayed outside the display area 100. Specifically, the image 201 is displayed only on the upper side of the lower end of the display area 100 with the lower end of the display area 100 as a boundary, and is not displayed on the lower side of the lower end. That is, the image 201 (images arranged in the order of "○", "△", "station", and "→" from a distance) displayed in FIG. 3 (a) is a vehicle as the vehicle 1 approaches. In order from the one closest to 1, the symbol (“→”) is hidden in FIG. 3 (b), the text (“station”) is hidden in FIG. 3 (c), and the text (“→”) is hidden in FIG. 3 (c). "Station") is hidden, the text ("△") is hidden in FIG. 3D, and finally everything is hidden. The image 201 can give the viewer the impression that the image 201 is approaching by changing the size according to the position by using the perspective method. The processor 16 and the image processing circuit 20 generate image data based on, for example, an instruction signal received from an ECU (not shown) provided in the vehicle 1 via the peripheral interface 14, but the processor 16 and the image processing circuit 20 are also provided in the vehicle 1. , An image based on information acquired from an external sensor 404, an in-vehicle sensor (not shown), a portable electronic device brought into the vehicle 1 (not shown), an external server (not shown), etc. via the peripheral interface 14. Data may be generated.

FIG. 4 is a diagram showing a foreground 300, which is visually recognized when the driver 4 faces forward, and an image 202, which is displayed on the vehicle display device 10 so as to be superposed on the foreground 300 and visually recognized. be. The image 202 shows the speed limit of the road on which the vehicle 1 travels, includes a text (“80”) imitating a road sign, and floats above the right end 312 of the road surface 310 (in the positive direction of the Y axis). It may be a virtual reality image as if it were.

FIG. 5 shows the movement paths 321, 322, and 323 of the foreground 300, which is visually recognized when the driver faces forward, and the image displayed on the vehicle display device 10 so as to be superposed on the foreground 300. It is a figure which shows the example of. A plurality of movement paths of the image are provided, for example, between the left end 311 of the traveling lane on which the vehicle 1 travels (for example, the white line on the left side of the traveling lane) and the right end 312 (for example, the white line on the right side of the traveling lane). The first movement path 321 that overlaps the road surface 310, the second movement path 322 above the left end 311 of the road surface 310 (in the positive direction of the Y axis), and the second above the right end 312 of the road surface 310 (in the positive direction of the Y axis). It is composed of 3 movement paths 323. The moving route of the image may be appropriately selected in addition to the one illustrated in FIG. Further, the movement path of the image may be singular.

The vehicle 1 may include a speed sensor 401 (an example of a foreground speed-related information detection unit) that detects the speed of the vehicle 1 (an example of foreground speed-related information). The processor 16 may acquire the speed of the vehicle 1 and estimate the approach speed of the foreground 300 based on this speed.

The vehicle 1 may include a road information database 402 (an example of a road shape acquisition unit) including a navigation system or the like, or may acquire road information from an externally provided road information database 402. The road information database 402 includes road information (lanes, white lines, stop lines, pedestrian crossings, road widths, number of lanes, intersections, curves, branch roads, etc.) based on the position of the vehicle 1 from the own vehicle position detection unit 403 described later. The presence / absence, position, shape, etc.) can be read out and transmitted to the processor 16. The processor 16 may acquire road information, estimate the approaching direction of the foreground 300, and determine the movement route of the image. Specifically, the processor 16 may determine the movement routes 321, 322, and 323 of the image, respectively, based on the road information.

The vehicle 1 may include a vehicle position detection unit 403 (an example of a foreground speed-related information detection unit) including a GNSS (Global Navigation Satellite System) or the like. The own vehicle position detection unit 403 continuously or intermittently acquires the position information of the vehicle 1 (an example of the foreground speed related information), and estimates the approach speed of the foreground 300 by analyzing the time change of the position information. , Can be transmitted to the processor 16. The processor 16 may be provided with a function of analyzing the position information and estimating the approaching speed of the foreground 300.

The foreground speed-related information detection unit is composed of the own vehicle position detection unit 403, and the approach speed of the foreground 300 may be estimated only by the position information from the own vehicle position detection unit 403. It may be composed of the vehicle position detection unit 403. In this case, the foreground speed-related information detection unit changes the position of the vehicle 1 along the road from the position information of the own vehicle position detection unit 403 and the road information of the road information database 402 that are continuously or intermittently acquired. By detecting the above, the approaching speed of the foreground 300 (in other words, the speed of the vehicle 1) may be estimated more accurately.

The vehicle 1 may include one or more out-of-vehicle sensors 404 that detect real objects present in the vicinity of the vehicle 1 (particularly in front of the vehicle 1). The vehicle exterior sensor 404 detects, for example, the white lines (partition lines) 311, 312 in front of the vehicle 1. The actual object detected by the vehicle exterior sensor 404 may include, for example, a pedestrian, a bicycle, a motorcycle, another vehicle (preceding vehicle, etc.), a roadside object, a building, or the like, in addition to the white line. Examples of the external world sensor include a radar sensor such as a millimeter wave radar, an ultrasonic radar, and a laser radar, and a camera sensor composed of a camera and an image processing device, which may be composed of a combination of both a radar sensor and a camera sensor. It may be composed of only one of them. Conventional well-known methods are applied to object detection by these radar sensors and camera sensors. By object detection by these sensors, the presence or absence of a real object in the three-dimensional space, the position of the real object if it exists (relative distance from the vehicle, direction (horizontal position), etc.), The size (size in the horizontal direction, height direction, etc.), type, etc. may be detected. One or more external sensors 404 detect an actual object (at least white lines 311, 312) in front of the vehicle 1 and acquire various information for each detection cycle of each sensor, and acquire an external world information signal (of the actual object). Information on the presence / absence, the position, size, type, etc. of each real object when the real object exists) can be transmitted to the processor 16. Note that these external information signals may be transmitted to the processor 16 via another device (for example, the ECU of the vehicle 1). Further, when using a camera as a sensor, an infrared camera or a near-infrared camera is desirable so that a real object can be detected even when the surroundings are dark such as at night. Further, when a camera is used as a sensor, a stereo camera capable of acquiring a distance or the like by parallax is desirable.

The vehicle exterior sensor 404 is composed of a detection unit such as a camera or a sensor and an image analysis unit, images (detects) the front of the vehicle 1, and performs image processing (signal processing) to perform optical flow (in other words, in other words) of the captured image. The movement speed (approach speed) and the movement vector indicating the direction of each region of the foreground 300 can be calculated, and the processing result can be transmitted to the processor 16. By analyzing the optical flow, it is possible to recognize the road shape such as the width and the degree of bending of the road surface 310 of the foreground 300 of the vehicle 1, and it may function as the road shape acquisition unit. The vehicle exterior sensor 404 has a first optical flow on the road surface 310 in the straight direction of the vehicle, a second optical flow on the left end 311 of the road surface 310 (a lane marking on the left side of the road surface 310), and a second optical flow on the right end 312 of the road surface 310. It is possible to calculate the upper third optical flow by a predetermined height from (the lane marking on the right side of the road surface 310). The processor 16 sets the first optical flow calculated by the vehicle exterior sensor 404 on the first movement path 321, sets the second optical flow on the second movement path 322, and sets the third optical flow on the second movement path 322. It is set to the movement path 323 of 3. In FIG. 5, only the moving direction in the optical flow is indicated by an arrow, and the size of the arrow does not reflect the magnitude of the velocity in the optical flow.

The vehicle 1 may include an eye point detection unit 405 including an infrared camera or the like that detects the position of the eyes of the driver 4. The processor 16 acquires an image captured by the infrared camera and analyzes the captured image to identify the position of the driver 4's eyes. The processor 16 may acquire information on the position of the eyes of the driver 4 identified from the image captured by the infrared camera from the peripheral interface 14. The method of acquiring the information capable of estimating the eye position of the driver 4 of the vehicle 1 or the eye position of the driver 4 is not limited to these, and a known eye point detection (estimation) technique is used. May be obtained using. The processor 16 may visually recognize the image 200 superimposed on the desired position of the foreground 300 by at least adjusting the position of the image 200 based on the position of the eyes of the driver 4.

The software components stored in the storage unit 18 include an approach speed detection module 502, an approach speed estimation module 504, a preceding vehicle detection module 506, an eye point detection module 508, and a graphic module 510.

The approach speed detection module 502 detects the approach speed toward the vehicle 1 in the foreground 300 as the vehicle 1 moves forward. The approach speed detection module 502 is used to perform various operations related to determining which speed region the foreground 300 is approaching belongs to, detecting the approaching speed of the foreground 300, and so on. Software components included. The approach speed detection module 502 receives, for example, the optical flow of the foreground 300 from the outside sensor 404, and identifies the approach speed of the foreground 300 near the movement path of the image 200.

The approach speed detection module 502 uses one or more speed thresholds to determine if the approach speed of the foreground 300 is less than a particular speed. In some embodiments, the speed threshold may be adjusted according to the condition of the vehicle 1, the driving scene of the vehicle 1, and the condition of the driver 4.

The approach speed estimation module 504 acquires foreground speed-related information (information capable of estimating the approach speed of the foreground 300) and estimates the approach speed of the foreground 300. The approach speed detection module 502 detects the speed of the vehicle 1 (foreground speed related information) from the speed sensor 401, estimates the approach speed of the foreground 300 calculated from the speed of the vehicle 1, and positions the vehicle 1 (foreground speed related information). ), And the estimation of the approach speed of the foreground 300 by analyzing the time change of the position information of the vehicle 1. Includes various software components for performing various actions related to the detection. The approach speed estimation module 504 receives, for example, the speed of the vehicle 1 (foreground speed-related information) from the speed sensor 401, and receives the position information of the vehicle 1 (foreground speed-related information) from the own vehicle position detection unit 403. , Estimate the approach speed of the region of the foreground 300 that overlaps or is close to the movement path of the image 200.

The preceding vehicle detection module 506 detects the position of the preceding vehicle (reference numeral 330 in FIG. 8) traveling in front of the vehicle 1. The preceding vehicle detection module 506 has various software configurations for executing various operations related to detecting the position of the preceding vehicle 330 and determining the presence or absence of the preceding vehicle 330 approaching within a predetermined distance of the vehicle 1. Includes elements. The preceding vehicle detection module 506 acquires the position of the actual object from, for example, the external sensor 404, and determines the presence or absence of the preceding vehicle 330 traveling in front of the vehicle 1.

The eye point detection module 508 detects the position of the eyes of the driver 4 of the vehicle 1. The eye point detection module 508 determines where the height of the driver 4's eye is in a height region provided in a plurality of stages, detects the height of the driver 4's eye (position in the Y-axis direction), and Detection of the height of the driver 4's eyes (position in the Y-axis direction) and depth (position in the Z-axis direction), detection of the position of the driver 4's eyes (position in the X, Y, Z-axis directions) Includes various software components for performing various actions related to. The eye point detection module 508 acquires, for example, the eye position of the driver 4 from the eye point detection unit 405, or obtains the eye position including the eye height of the driver (4) from the eye point detection unit 405. It receives estimable information and estimates the eye position including the eye height of the driver 4.

The graphic module 510 is a visual effect (eg, brightness, transparency, saturation, contrast, or other visual characteristic), size, display position, display distance (drivers 4 to image 200) of the displayed image 200. Includes various known software components for changing the distance). The graphic module 510 displays the image 200 so as to appear close to the vehicle 1 by changing at least the size and the display position at a speed slower than the approach speed of the foreground 300 (first speed Iv1). For example, when the image 200 is moved along the first movement path 321 that overlaps the road surface 310 shown in FIG. 5, the size of the image 200 is gradually enlarged while gradually moving the display position downward in the vertical direction. do. Further, when the image 200 is moved along the second movement path 322 overlapping the road surface 310 shown in FIG. 5, the size of the image 200 is gradually enlarged while gradually moving the display position to the left in the left-right direction. .. When the height of the second movement path 322 from the road surface 310 is set to a position lower than the height of the eyes of the driver 4, the display position of the image 200 gradually moves to the lower side in the vertical direction. do.

In some embodiments, the graphic module 510 stores data representing image elements used. A corresponding code is optionally assigned to each image element. The graphics module 510 receives from one or more processors 16 one or more codes that specify the image elements to be displayed, along with coordinate data and other property data (size, azimuth, elevation), and the image. The screen image data to be output to the display units 11 and 12 is generated. The graphic module 510 continuously changes the coordinate data and other property data (size) so that the image 200 is visually recognized as approaching the vehicle 1.

Each of the above modules corresponds to an executable instruction that performs one or more of the above functions and a method described in this application (eg, a program executed by a computer).

A part or all of the above modules are subjected to various information to the speed sensor 401, the road information database 402, the vehicle position detection unit 403, the vehicle exterior sensor 404, and the eye point detection unit 405 via the peripheral interface 14 at predetermined intervals. Send a request to send. In response to this, the peripheral interface 14 acquires various information from the speed sensor 401, the road information database 402, the own vehicle position detection unit 403, the vehicle outside sensor 404, and the eye point detection unit 405, and sends them to the processor 16. In other embodiments, some or all of the above modules may request the transmission of information only when there is a significant event (eg, the detection of the start of travel of vehicle 1).

FIG. 5 is a flow chart showing a process for displaying an image that is visually recognized as having a slower approach speed than the foreground.

The vehicle display device 10 includes an external sensor 404, an ECU (not shown), an in-vehicle sensor (not shown), a portable electronic device (not shown), and an external server (not shown) provided in the vehicle 1. An instruction signal is acquired from (not shown) or the like (step S1), the road shape on which the vehicle 1 travels is acquired (step S2), and the display content of the image 200 is determined based on the instruction signal (step S3). Further, when there are a plurality of moving routes of the image, the moving routes may be determined according to the type of the acquired instruction signal (step S3). Further, the movement route may be determined so as to follow the road shape acquired in step S110 (step S3).

Next, the vehicle display device 10 acquires the approach speed Hv of the foreground 300 to the vehicle 1 as the vehicle progresses (step S4), and determines whether the speed threshold value Hvth is faster than the speed threshold value Hvth stored in the storage unit 18 (step S4). Step S5). This speed threshold value Hvth may be variable depending on the situation of the vehicle 1, the external situation of the vehicle 1, the internal state of the vehicle 1, or a combination thereof. As another example, in step S4, information that can estimate the approach speed Hv of the foreground 300 (foreground speed-related information) may be acquired and compared with a predetermined threshold value stored in the storage unit 18 (step S5). ). The foreground speed-related information may include information that can estimate the approaching speed Hv of the foreground 300, the speed of the vehicle 1, or the information that can estimate the speed of the vehicle 1.

When it is determined that the approach speed Hv (speed of the vehicle 1) of the foreground 300 is relatively high (YES in step S5), the vehicle display device 10 displays the image 200 at the third speed Iv3 (the first speed Iv3 described later). The speed is faster than Iv1), and the image is displayed so as to gradually approach and pass from a distance (step S6). For example, the vehicle display device 10 can express the approach of the image 200 by gradually expanding the image 200 from the upper side to the lower end of the display area 100 while moving the image 200, and the lower end of the display area 100 ( When the image 200 moves to a predetermined position), the passage of the image 200 can be expressed by not displaying the image 200 below the lower end (predetermined position) of the display area 100. For example, the third speed Iv3 may be the same as the approach speed Hv of the foreground 300. That is, the image 200 may be displayed so as to appear close at the same speed as the foreground 300.

Next, the vehicle display device 10 displays the image 200 at a position recognized by the driver 4 as if it is far away (upper side of the display area 100), and displays the second speed Iv2 (the first speed Iv1 described later). (Faster), the image is displayed so as to gradually approach from a distance (step S7), and when the position L of the image 200 approaches a predetermined position Lth in the vertical direction (Y-axis direction) in the display area 100, from there. The image 200 is displayed so as to gradually approach and pass through at a first speed Iv1, which is slower than the approach speed Hv of the foreground 300 (step S8). In other words, the image 200 is displayed so as to approach from a distance at a second velocity Iv2 and approach at a first velocity Iv1 slower than the second velocity Iv2 from the middle. For example, the second velocity Iv2 may be the same as the third velocity Iv3, or may be the same as the approaching velocity Hv of the foreground 300. Further, the first speed Iv1 may be half the speed of the approach speed Hv of the foreground 300. When the image is visually recognized as if it is displayed at a distant position, the image itself is displayed small, so it is difficult to recognize the content of the image. From the time when the image is visually recognized as if it is displayed at this distant position, it takes time to recognize the content even if the moving speed of the small image is slowed down. Therefore, at a distance, the image approaches relatively quickly, and at a position closer than a specific position, the moving speed of the image is slowed down, so that the approach of the image is recognized at a distant position, which is difficult to recognize, and the amount of the approached image is fast. Only the extra time can be used to slow down the image.

On the other hand, when it is determined that the approach speed Hv (speed of the vehicle 1) of the foreground 300 is relatively slow (NO in step S5), the vehicle display device 10 displays the image 200 at a fourth speed faster than the first speed Iv1. At the speed of Iv4, the image is displayed so as to gradually approach and pass from a distance (step S9).

Understand that the specific order described for the processes in FIGS. 5 and 6 is exemplary and the order described is not intended to indicate that the process is the only order in which it can be executed. I want to be. One of ordinary skill in the art will be able to make various changes to reorder, partially add, or / and partially delete the operations described herein.

The operation of the above-mentioned information processing process can be carried out by executing one or more functional modules of an information processing device such as a general-purpose processor or a chip for a specific purpose. All of these modules, combinations of these modules, and / or combinations with common hardware that can replace their functionality are within the scope of the protection of the present invention.

The functional blocks of the vehicle display device 10 are optionally performed by hardware, software, or a combination of hardware and software in order to carry out the principles of the various embodiments described. The functional blocks described in FIG. 2 may be optionally combined or one functional block separated into two or more subblocks in order to practice the principles of the embodiments described. It will be understood by those skilled in the art. Accordingly, the description herein optionally supports any possible combination or division of functional blocks described herein.

As described above, in the present embodiment, the image display unit 11 (12) displays the image 200 in the predetermined display area 100 overlapping the foreground 300 of the vehicle 1, and is displayed from one or more peripheral interfaces 14. , The approach speed Hv of the foreground 300 to the vehicle 1 with the progress of the vehicle 1 is acquired, or the information capable of estimating the approach speed Hv of the foreground 300 is acquired, and the image 200 is slower than the approach speed Hv of the foreground 300. At the first speed Iv1, it is displayed so as to approach the vehicle 1.

Also, in some embodiments, the first velocity Iv1 may change depending on the approaching velocity Hv of the foreground 300. The speed of the image 200 may be constant from the time it is displayed in the distance until it appears to pass by in close proximity. In this case, the speed of the image 200 may be determined based on the information that can estimate the approach speed Hv or the approach speed Hv of the foreground 300 before or immediately before displaying the image 200. Further, the speed of the image 200 may be changed in real time according to the approach speed Hv of the foreground 300.

Further, in some embodiments, the second speed Iv2, which is faster than the first speed Iv1, is displayed so as to approach, and the approach is made at the first speed Iv1 from the middle of the approach at the second speed Iv2. The image 200 may be displayed so that it can be seen.

Further, in some embodiments, the timing of switching between the second speed Iv2 and the first speed Iv1 changes based on the information that can estimate the approach speed Hv of the foreground 300 or the approach speed Hv of the foreground 300. You may. For example, as the approaching speed Hv of the foreground 300 becomes faster, the timing of switching between the second speed Iv2 and the first speed Iv1 may be earlier. In other words, as the approaching speed Hv of the foreground 300 increases, the period during which the image 200 appears to move at the second speed Iv2 is shortened, and the period during which the image 200 appears to move at the first speed Iv1 is lengthened. Typically, the higher the vehicle speed, the lower the dynamic visual acuity tends to be, but when the vehicle speed is high, the dynamic visual acuity is improved by increasing the rate of moving the image at the first speed (slow speed). It is possible to make the image easier to recognize even if it is lowered.

Further, in some embodiments, the process of approaching and appearing to pass from a distance may be repeated twice or more with the image 200 having the same display content. Specifically, the image 200 may be displayed so as to approach and pass through from a distance, and then the image 200 may be displayed so as to approach and pass through from a distance again. Further, after displaying the image 200 having a predetermined display content so as to be seen by approaching from a distance, the image 200 having a display content (or related display content) similar to the passed image 200 is approached again from a distance. It may be displayed so that it can be seen through. Similar display contents (or related display contents) include that one contains information that at least partially overlaps with the other, one is text information, and the other is a symbol or image having the same meaning as the text information. One may include information that complements the other, or one may indicate the context of the other in chronological order, and of course may include information that is generally found to be similar or related.

Further, in some embodiments, when the process of approaching and appearing to pass from a distance is repeated twice or more in the image 200 having the same display content, the movement route may be different. Specifically, after displaying the image 200 so as to approach and pass along the first movement path 321 from a distance, the image 200 is then approached from a distance along the second movement path 322. It may be displayed so that it can be seen through.

Further, in some embodiments, when the process of appearing to approach and pass from a distance is repeated twice or more with the image 200 having the same display content and the movement path is changed, the preceding image 200 approaches from a distance. The display of the later image 200 may be started before it is hidden. Specifically, the image 200 is displayed along the first movement path 321 so as to be seen from a distance, and before this is hidden, the display of the next image 200 is started, and the image 200 is displayed. It may be displayed so that it can be seen by approaching from a distance along the second movement path 322.

Further, in some embodiments, when the approach of the image 200 is displayed a plurality of times, the image 200 is displayed so as to appear close at the third speed Iv3 at the n (natural number) th time, and at the next n + 1th time. , It may be displayed so as to be approached at a speed slower than this (for example, the first speed Iv1). Typically, when an image whose content is not grasped approaches from a distance at a low speed, the viewer is deprived of visual attention for a longer period of time in an attempt to grasp the content. Therefore, by approaching and passing at a third speed (fast speed) at least once, the content of the image can be roughly grasped in a short time, and even when the image approaches after the second time. Since the rough contents can be grasped, it becomes difficult for the visual attention to be directed to the image for a long time from the time when the image is displayed in the distance.

Further, in some embodiments, if there is an obstacle (for example, the preceding vehicle 330) in front of the vehicle 1, the image 200 is displayed so as to be approached at a fifth speed slower than the first speed Iv1. If there are no obstacles, the image 200 may be displayed so as to appear close at the first speed Iv1. The presence of obstacles reduces the visual attention to the image, but in such cases, the image can be made slower to make it easier to recognize.
[Modification example]

In FIG. 1, the display area 100 is provided perpendicular to the traveling direction (Z-axis direction) of the vehicle 1, but is not limited to this. The display area 100 may be provided, for example, so as to rotate around the vehicle width direction (X-axis direction) of the vehicle 1 and not to be perpendicular to the traveling direction (Z-axis direction) of the vehicle 1. Further, the display area 100 may be provided at two or more places apart from each other in the traveling direction (Z-axis direction) of the vehicle 1, for example, instead of one place. Further, the display area 100 may be a three-dimensional volume area instead of the area area. That is, the image 200 may be movable in the depth direction in the three-dimensional space. In other words, the display distance of the image 200 may be variable.

In the above embodiment, the graphic module 510 continuously changes the coordinate data and other property data (size) so that the image 200 is visually recognized as approaching the vehicle 1, but further property data. (Depression angle / elevation angle) may be gradually changed. Further, the property data (azimuth) may be gradually changed.

In the above embodiment, when the position L of the image 200 approaches a predetermined position Lth in the vertical direction (Y-axis direction) in the display area 100, the image 200 is displayed from there in the first position slower than the approach speed Hv of the foreground 300. Although the speed Iv1 was displayed so as to gradually approach and pass through (step S8), the speed of the image 200 was switched after the image 200 was displayed instead of the coordinates of the image 200 in the display area 100. It may be the elapsed time of. For example, the image 200 may be displayed so as to approach from a distance at a second speed Iv2, and after a predetermined time elapses, appear to approach at a first speed Iv1 slower than the second speed Iv2. .. Further, the speed of the image 200 may be switched according to the distance to the foreground 300 where the images 200 overlap when viewed from the driver 4. For example, a position that overlaps with the road surface (foreground 300) 80 [m] ahead when viewed from the driver 4 approaches at the second speed Iv2 and overlaps with the road surface (road surface less than 80 [m]) in front of it. At the position, it may be displayed so as to appear close at the slow first velocity Iv1.

In the above embodiment, the second speed Iv2 and the third speed Iv3 are set to be the same as the approach speed Hv of the foreground 300, but may be set faster than the approach speed Hv. Thereby, at least, it is possible to make the driver 4 quickly recognize that the image 200 is displayed or the approach of the image 200, and in addition, it is possible to make the driver quickly recognize the information indicated by the image 200. There is also sex.

1 ... Vehicle, 2 ... Front windshield, 4 ... Driver, 5 ... Dashboard, 10 ... Vehicle display device, 11 ... Image display unit, 11a ... Display light, 12 ... Image display unit, 14 ... Peripheral interface, 16 ... Processor, 18 ... Storage unit, 20 ... Image processing circuit, 100 ... Display area, 200 ... Image, 300 ... Foreground, 310 ... Road surface, 321 ... First movement path, 322 ... Second movement path, 323 ... Second 3 movement routes, 330 ... preceding vehicle, 401 ... speed sensor, 402 ... road information database, 403 ... own vehicle position detection unit, 404 ... outside sensor, 405 ... eye point detection unit, 502 ... approach speed detection module, 504 ... Approach speed estimation module, 506 ... preceding vehicle detection module, 508 ... eye point detection module, 510 ... graphic module, B2 ... guidance information, Hv ... approach speed, Hvth ... speed threshold

Claims (10)

In the vehicle display device (10)
Image display (11, 12) and
With one or more peripheral interfaces (14),
With one or more processors (20),
Memory (22) and
It comprises one or more computer programs stored in the memory (22) and configured to be executed by the one or more processors (20).
The one or more computer programs mentioned above
The image display units (11, 12) display the image (200) in a predetermined display area (100) that overlaps the foreground (300) of the vehicle (1).
From the one or more peripheral interfaces (14), the approach speed of the foreground (300) to the vehicle (1) as the vehicle (1) advances, or the approach of the foreground (300). Get information that can estimate the speed,
The image (200) is displayed so as to approach the vehicle (1) at a first speed slower than the approach speed of the foreground (300).
Vehicle display device, including instructions. The first speed changes depending on the approaching speed of the foreground (300).
The vehicle display device according to claim 1. The command to display the image (200) so as to be seen close to the vehicle (1) is
The image (200)
The second speed, which is faster than the first speed, is displayed so as to be approached.
Displaying so that it appears to approach at the first speed from the middle of the approach at the second speed.
The vehicle display device according to claim 1. The timing of switching between the second speed and the first speed changes according to claim 3, based on information that can estimate the approach speed of the foreground (300) or the approach speed of the foreground (300). Vehicle display device. The one or more computer programs issue instructions to display the image (200) so that it appears closer to the vehicle (1) twice in the image (200) with the same or similar display content. Including further instructions to repeat above,
The vehicle display device according to claim 1. In the n (natural number) th command for displaying the image (200) so as to appear close to the vehicle (1),
The image (200) is displayed so as to appear close at a third speed faster than the first speed.
In the n + 1th command for displaying the image (200) so as to appear close to the vehicle (1),
The image (200) is displayed so as to appear close at the first speed.
The vehicle display device according to claim 5. The command to display the image (200) so as to be seen close to the vehicle (1) is
It is determined whether the approaching speed of the foreground (300) is less than a specific speed, and the speed is determined.
If the approaching speed of the foreground (300) is less than a specific speed, the image (200) is displayed so as to appear approaching at a fourth speed slower than the first speed.
If the approaching speed of the foreground (300) is equal to or higher than a specific speed, the image (200) is displayed so as to appear approaching at the first speed.
The vehicle display device according to claim 1. The one or more computer programs further include instructions from the one or more peripheral interfaces (14) to detect a vehicle in front of the vehicle (1).
The command to display the image (200) so as to be seen close to the vehicle (1) is
If there is the preceding vehicle, the image (200) is displayed so as to be approached at a fifth speed slower than the first speed.
Without the preceding vehicle, the image (200) is displayed so as to appear close at the first speed.
The vehicle display device according to claim 1. In a vehicle display device (10) having an image display unit (11, 12) and one or more peripheral interfaces (14).
The image display units (11, 12) display the image (200) in a predetermined display area (100) that overlaps the foreground (300) of the vehicle (1).
From the one or more peripheral interfaces (14), the approach speed of the foreground (300) to the vehicle (1) as the vehicle (1) advances, or the approach of the foreground (300). Obtaining information that can estimate the speed and
Displaying the image (200) so as to approach the vehicle (1) at a first speed slower than the approach speed of the foreground (300).
Including methods. A computer program comprising instructions for performing the method of claim 9.

Images