JP2022139593A - Driver visibility status confirmation device - Google Patents

Abstract

To provide a driver's viewing status confirming device improved so that a viewing status of a driver can be reviewed in relation to a position on an actual travel route of a vehicle by acquiring and storing information on a viewing angle of the driver in association with position information.SOLUTION: A driver's viewing status confirming device 10 includes: a navigation device 30 as a position information acquisition unit that acquires position information of a vehicle 14; a camera sensor 26 as a line-of-sight information acquisition unit that acquires line-of-sight information of a driver; an electronic control unit 24 as a viewing angle information acquisition unit that acquires information on a viewing angle of the driver based on the line-of-sight information; storage devices 40 and 18 as a recording unit that records an actual travel route of the vehicle based on the position information of the vehicle and records the information on the viewing angle of the driver in association with the position of the vehicle when the information on the viewing angle is acquired; and a communication terminal device 22 as a display unit that displays the actual travel route and the viewing angle of the driver based on the information recorded in the recording unit.SELECTED DRAWING: Figure 1

Description

TECHNICAL FIELD The present invention relates to a driver visual confirmation situation confirmation device for a vehicle such as an automobile.

2. Description of the Related Art A driving evaluation device for evaluating a driver's driving in a vehicle such as an automobile is known. For example, Patent Literature 1 below discloses that driver line-of-sight detection data detected by an in-vehicle device is accumulated, reference value data is calculated based on the accumulated line-of-sight detection data, and reference value data and line-of-sight detection data are calculated. A driving evaluation device is described that is configured to evaluate a driver's driving based on the deviation of the . It also describes graphing deviations between reference value data and line-of-sight detection data for evaluation. According to the driving evaluation device described in Patent Document 1 below, the driving of the driver can be evaluated based on the deviation between the reference value data and the line-of-sight detection data.

JP 2019-159925 A

[Problems to be solved by the invention]
However, in the driving evaluation device described in the above publication, it is not possible to determine the visual angle of the driver in relation to the position of the vehicle on the actual traveling route, and the driver's viewing angle cannot be obtained in relation to the position of the vehicle on the actual traveling route. I can't take care of the visibility situation. Therefore, the driving evaluation device described in the above publication has room for improvement in this respect.

The main object of the present invention is to acquire and store the information on the viewing angle of the driver in association with the position information, so that the driver's viewing situation can be reviewed in relation to the position on the actual driving route of the vehicle. It is an object of the present invention to provide a driver visual recognition condition confirmation device which is improved.

[Means for Solving the Problems and Effect of the Invention]
According to the present invention, a position information acquisition unit (navigation device 30, visual control ECU 24) that acquires position information of a vehicle (14), a line-of-sight information acquisition unit (camera sensor 26) that acquires line-of-sight information of a driver, A visibility angle information acquisition unit (visibility control ECU 24) that acquires information on a driver's visibility angle (αb) based on the sight line information acquired by the sight line information acquisition unit, and an actual travel route of the vehicle based on the vehicle position information A recording unit (storage device 40) that records (60) and records information on the viewing angle of the driver in association with the position of the vehicle when the information on the viewing angle was acquired, and a situation in which the vehicle is not running a display unit (communication terminal device 22, navigation device 30) that displays the actual travel route (60) and the driver's visual angle (αb) based on the information recorded in the recording unit; A verification device (10) is provided.

According to the above configuration, information on the viewing angle of the driver is acquired based on the line-of-sight information of the driver, the actual travel route of the vehicle is recorded based on the position information of the vehicle, and information on the viewing angle is acquired. Information on the viewing angle of the driver is recorded in the recording unit in association with the position of the vehicle when the vehicle is turned on. Furthermore, when the vehicle is not traveling, the actual traveling route and the visual recognition angle of the driver are displayed based on the information recorded in the recording unit.

Therefore, in a situation in which the vehicle is not traveling, the actual traveling route displayed on the display unit and the viewing angle of the driver can be seen, so the driver's viewing situation can be reviewed in relation to the position on the actual traveling route of the vehicle. be able to. Therefore, compared to the case where the actual driving route of the vehicle is not displayed and only the viewing angle of the driver is displayed, evaluation of the validity of the driver's visual behavior in relation to the position on the actual driving route of the vehicle, Able to reflect easily and accurately.

[Aspect of the invention]
In one aspect of the present invention, the driver visibility status confirmation device (10) further communicates wirelessly with a data server (20) installed in the cloud (16) and having a storage device (18) and the data server. a communication unit (wireless communication device 42), the communication unit transmits information recorded in the recording unit (storage device 40) to the data server, and the data server stores the received information in the storage device (18). configured as follows.

According to the above aspect, the information recorded in the recording unit is transmitted by wireless communication to the data server installed in the cloud, and stored in the storage device of the data server. Therefore, the information recorded in the recording unit can be transmitted to the data server installed in the cloud by wireless communication and stored in the storage device of the data server.

In another aspect of the present invention, the display unit (communication terminal device 22) includes a first control device (56) and a first display (58) that wirelessly communicate with the data server (20), The first control device acquires the information stored in the storage device (18) from the data server by wireless communication, and displays the actual travel route (60) and the driver's visual angle (αb) on the first display. configured as follows.

According to the above aspect, the information stored in the storage device is obtained from the data server by wireless communication, and the actual travel route and the driver's viewing angle are displayed on the first display. Therefore, by wirelessly communicating with the data server through the first controller of the display unit, the actual travel route of the vehicle and the visual angle of the driver can be displayed on the first display anytime and anywhere for confirmation. .

Furthermore, in another aspect of the present invention, the driver's visibility condition confirmation device (10) further has a driver's visibility angle (αb) that is less than a preset first reference value (αs). including an image information acquisition unit (camera sensor 28) that acquires image information (76) around the vehicle (14), and a recording unit (storage device 40) stores the position of the vehicle when the image information was acquired and It is configured to record image information in association.

According to the above aspect, when the viewing angle of the driver is less than the preset first reference value, the image information of the surroundings of the vehicle is acquired, and the image information is associated with the position of the vehicle when the image information was acquired. Image information is recorded. Therefore, when the viewing angle of the driver is less than the first reference value, image information around the vehicle can be acquired, and the image information can be recorded in association with the position of the vehicle when the image information is acquired.

Furthermore, in another aspect of the present invention, the first display (58) is configured to display the viewing angle (αb) of the driver in symbols (72A-72C), and the image information (76) The symbols (72B, 72C) at which the image information was obtained are the first specific symbols different from the symbols (72A) at which the image information was not obtained.

According to the above aspect, the viewing angle of the driver is displayed as a symbol on the first display, and the symbol at the position where the image information is acquired is different from the symbol at the position where the image information is not acquired. Therefore, since the visual angle of the driver is displayed in the form of a symbol on the first display, it is possible to evaluate and reflect on the validity of the visual behavior of the driver compared to the case where the visual angle is displayed, for example, as a numerical value. can be easily done. Moreover, since the symbol at the position where the image information is acquired is different from the symbol at the position where the image information is not acquired, it is possible to easily determine whether or not the image information has been acquired.

Furthermore, in another aspect of the present invention, the first display (58) includes the first symbols (72B, 72C) displayed on the first display and a specific symbol (exclamation) corresponding thereto. When at least one of the image marks 74) is designated, the corresponding image information (76) is configured to be displayed.

According to the above aspect, when the specific symbol corresponding to the first symbol displayed on the first display is designated, the corresponding image information is displayed. Therefore, by designating a specific symbol displayed on the first display, the corresponding image information is displayed, and the situation around the vehicle when the driver's viewing angle is less than the first reference value is displayed. can be easily verified.

Furthermore, in another aspect of the present invention, the driver visual confirmation device (10) includes a position information acquisition unit (navigation device 30, visual control ECU 24) and a display unit (communication terminal device 22, navigation device 30). with a second controller (36) in communication with at least one of the recording unit (storage device 40) and the data server (20); and a second display (38).

According to the above aspect, the navigation device can communicate with at least one of the recording unit and the data server through the second control device. Therefore, it is possible to communicate with the recording unit or the data server without using a communication terminal device or the like.

In another aspect of the present invention, the second control device (36) acquires information recorded in at least one of the recording unit (storage device 40) and the data server (20) by communication, It is arranged to display the route (60) and the driver's viewing angle (αb) on the second display (38).

According to the above aspect, the information recorded in the recording unit or the data server is obtained through communication, and the actual travel route and the driver's viewing angle are displayed on the second display. Therefore, it is possible to display the actual travel route and the viewing angle of the driver on the second display of the navigation device.

Furthermore, in another aspect of the present invention, the driver's visual recognition condition confirmation device (10) further has a driver's visual recognition angle (αb) that is less than a preset second reference value (αs). including an image information acquisition unit (camera sensor 28) that acquires image information (76) around the vehicle (14) when the recording unit (storage device 40) stores the position of the vehicle when the image information was acquired and It is configured to record image information in association.

According to the above aspect, when the viewing angle of the driver is less than the preset second reference value, the image information of the surroundings of the vehicle is acquired, and the image information is associated with the position of the vehicle when the image information is acquired. Image information is recorded in the recording unit. Therefore, when the viewing angle of the driver is less than the second reference value, image information around the vehicle can be acquired, and the image information can be recorded in association with the position of the vehicle when the image information is acquired.

Furthermore, in another aspect of the present invention, the second display (38) is configured to display the viewing angle (αb) of the driver in symbols (72A-72C), and the image information (76) The symbols (72B, 72C) at which the image information was obtained are second specific symbols different from the symbols (72A) at which no image information was obtained.

According to the above aspect, the viewing angle of the driver is displayed as a symbol on the second display, and the symbol at the position where the image information is acquired is different from the symbol at the position where the image information is not acquired. Therefore, since the visual angle of the driver is displayed in the form of a symbol on the second display, it is easier to evaluate and reflect on the validity of the visual behavior of the driver than in the case where the visual angle is displayed, for example, as a numerical value. can be easily done. Moreover, since the symbol at the position where the image information is acquired is different from the symbol at the position where the image information is not acquired, it is possible to easily determine whether or not the image information has been acquired.

Furthermore, in another aspect of the present invention, the second display (38) includes the second specific symbols (72B, 72C) displayed on the second display and the corresponding specific symbols ( When at least one of the exclamation marks 74) is specified, the corresponding image information (76) is arranged to be displayed.

According to the above aspect, when the specific symbol corresponding to the second symbol displayed on the second display is designated, the corresponding image information is displayed. Therefore, by designating a specific symbol displayed on the second display, the corresponding image information is displayed, and the situation around the vehicle when the driver's viewing angle is less than the second reference value is displayed. can be easily verified.

Furthermore, in another aspect of the present invention, the visual angle information acquisition unit (visual control ECU 24) calculates the visual angle (α) of the driver at predetermined time intervals, and calculates each preset map section ( 46), a weighted average value that assigns a smaller weight to the older is calculated, and the weighted average value is used as the driver's visibility angle (αb) for the map section. to obtain the driver's viewing angle.

According to the above aspect, the visual angle of the driver is calculated at predetermined time intervals, and a weighted average value is calculated that assigns a smaller weight to the older a plurality of visual angles calculated for each of the preset map sections. be. Further, by using the weighted average value as the driver's visual angle for the map section, the driver's visual angle is obtained for each map section. Therefore, the visual angle of the driver for each map section can be calculated as a weighted average value that assigns a smaller weight to the older map section, and the visual angle of the driver can be obtained for each map section.

In the above description, in order to facilitate understanding of the present invention, names and/or symbols used in the embodiments are added in parentheses to configurations of the invention corresponding to the embodiments to be described later. However, each component of the present invention is not limited to the component of the embodiment corresponding to the parenthesized names and/or symbols. Other objects, features and attendant advantages of the present invention will be readily understood from the description of embodiments of the present invention described with reference to the following drawings.

1 is a schematic configuration diagram showing an embodiment of a driver visual recognition condition confirmation device according to the present invention; FIG. 4 is a flow chart showing a routine of driver visual recognition condition recording control in the embodiment. 4 is a flow chart showing a routine for driver visibility condition display control in the embodiment. FIG. 10 is a diagram showing an example of a reference value αs of a map section and a driver's visual angle for a crossroad; FIG. 3 is a diagram showing examples of symbols of a driver's viewing angle αb in an actual travel route of a vehicle and various checking areas; 6 is a diagram showing an example of image information displayed when the exclamation mark shown in FIG. 5 is designated; FIG. FIG. 9 is a diagram showing an example of changes in α×exp(−Δt/τ) when the driver's viewing angle α is 120 degrees;

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

<Configuration>
As shown in FIG. 1, a driver visual condition confirmation device 10 according to the embodiment is applied to a vehicle 14 having an in-vehicle control device 12 . The visibility status confirmation device 10 further includes a data server 20 installed in the cloud 16 and having a storage device 18 and a communication terminal device 22 . The vehicle-mounted control device 12 includes a visual control electronic control unit 24, which is abbreviated as an ECU (Electric Control Unit). The visual control ECU 24 includes a microcomputer (not shown), and the microcomputer includes a CPU 24A, a ROM 24B, a RAM 24C, an interface (I/F) 24D, and the like.

Connected to the visual control ECU 24 are a camera sensor 26 that captures the face of the driver (not shown in FIG. 1), a camera sensor 28 that captures the surroundings of the vehicle 14, a navigation device 30, and a vehicle sensor 32. It is Information about the driver's face captured by the camera sensor 26 is input to the visual control ECU 24, and the CPU 24A of the ECU 24 identifies the line of sight of the driver based on the information about the driver's face. Therefore, the camera sensor 26 and the ECU 24 function as a line-of-sight information acquisition unit that acquires line-of-sight information of the driver.

Camera sensor 28 may include a plurality of cameras that capture an angular range of at least about 180 degrees, preferably 360 degrees, including at least about the vehicle 14 , eg, in front of the vehicle 14 . Image information around the vehicle 14 photographed by the camera sensor 28 is input to the ECU 24 . Therefore, the camera sensor 28 functions as an image information acquisition section that acquires image information around the vehicle 14 .

The navigation device 30 includes a GNSS (Global Navigation Satellite System) receiver 34 , a control device 36 and a display 38 . The GNSS receiver 34 receives "signals from artificial satellites (eg, GNSS signals)" for detecting the current location of the vehicle 14, and acquires the current location (eg, latitude and longitude) of the vehicle 14 based on the GNSS signals. do. Therefore, the GNSS receiver 34 of the navigation device 30 functions as a positional information acquisition unit that acquires the positional information of the vehicle 14 .

The vehicle sensor 32 includes sensors for detecting the running state of the vehicle 14, such as a vehicle speed sensor for detecting the vehicle speed V, a steering angle sensor for detecting the steering angle, and a pressure sensor for detecting the master cylinder pressure as a braking operation amount. It is a general term for sensors that detect the amount of driving operation performed by a driver. Note that the vehicle speed V may be calculated as the rate of change of the current location of the vehicle 14 detected by the GNSS receiver 34 .

Furthermore, a storage device 40 and a wireless communication device 42 are connected to the ECU 24 . The storage device 40 is a storage device such as a hard disk drive capable of reading and writing information. The wireless communication device 42 wirelessly communicates with the data server 20 via the network 44, thereby functioning as a communication unit that transmits and receives various data to and from the data server 20, as will be described later in detail.

The CPU 24A of the ECU 24 calculates the change angle of the driver's line of sight in the left-right direction (the lateral direction of the vehicle 14) as the driver's visual recognition angle α. The CPU 24A functions as a viewing angle information acquisition unit that acquires information on the viewing angle α of the driver. The identification of the line of sight of the driver based on the facial information of the driver and the calculation of the viewing angle based on the line of sight of the driver may be performed in any manner known in the art. The viewing angle α may be a value in units of deg or rad, or may be a dimensionless value such as a ratio to a standard swing angle.

The CPU 24</b>A of the ECU 24 calculates the actual travel route of the vehicle based on the position information of the vehicle 14 acquired by the GNSS receiver 34 . The storage device 40 functions as a recording unit that records information on the actual travel route of the vehicle and records information on the driver's visibility angle α in association with the position of the vehicle 14 when the information on the visibility angle α was acquired. do.

In particular, in the illustrated embodiment, the CPU 24A calculates the viewing angle α every predetermined time, which is the cycle time of the flow chart shown in FIG. 2, which will be described later. The average value of the visual recognition angles α calculated within one map section (map mesh) 46 is defined as the driver's visual recognition angle αb in the map section 46 . The storage device 40 records the information of the visual angle αb of the driver in association with the positional information of the map section, for example, the information of the identification number of the map section. In FIG. 4, the thin dashed line indicates the boundary line 48 of the map section 46. As shown in FIG.

The average value αb of the visual angle α is preferably a weighted average value in which the earlier the visual angle α is calculated in one map section 46, the smaller the weight is set. For example, let τ be the time constant, let Δt be the elapsed time from the first calculation of the viewing angle α in one map section 46, and the value used for the calculation of the weighted average value is α exp(-Δt/τ ). FIG. 7 shows an example of changes in the visual recognition angle α·exp(−Δt/τ) after weighting when α is 120 degrees. It can be seen from FIG. 7 that the degree of contribution to the weighted average value increases as the viewing angle is calculated later.

The data server 20 includes a storage device 18 that stores various data and a management server 50 . The management server 50 retrieves and reads data stored in the storage device 18 . The storage device 18 stores information of each map section 46 and also stores a reference value αs for judging the magnitude of the driver's viewing angle α. Numerical values in parentheses in FIG. 4 indicate examples of reference values (unit: deg) set in advance for each map section 46 in the crossroads 52 . It should be noted that the reference value αs is applied to areas (called "confirmation areas") where the driver needs to check safety at a large visual angle, such as crossroads, T-junctions, and Y-junctions. It is set in advance for each section 46 .

The CPU 24A of the ECU 24 determines whether or not the calculated driver's visual angle αb is less than the reference value αs of the map section 46 when the vehicle 14 is traveling in the map section 46 of the confirmation area. When the CPU 24A determines that the viewing angle αb is less than the reference value αs, the camera sensor 28 takes a photograph of the surroundings of the vehicle 14, and stores the information of the photographed image around the vehicle together with the information of the position of the photographed map section 46. Store in device 40 .

When the vehicle 14 has finished traveling, the radio communication device 42 of the ECU 24 transmits the ID number of the vehicle 14, information on the actual traveling route of the vehicle, and information on the visual angle αb of each map section 46 to the data server via the network 44. 20. If there is information about the photographic image around the vehicle 14 , the wireless communication device 42 also transmits the information of the photographic image around the vehicle 14 and the position information of the corresponding map section 46 to the data server via the network 44 . 20.

The communication terminal device 22 includes a control device 56 with a built-in receiver and a display 58, and may be, for example, a smart phone, tablet, or personal computer. The receiver communicates wirelessly with data server 20 via network 44 to transmit and receive various information to and from data server 20, as will be described in greater detail below. The control device 56 displays the information received from the data server 20 on the display 58 upon request from the user.

FIG. 5 shows an example of the actual travel route of the vehicle 14 displayed on the display 58 and the magnitude of the driver's visual angle αb. In FIG. 5, S and G indicate the starting point and ending point of the vehicle 14, respectively, the thick solid line 60 indicates the actual travel route of the vehicle 14, and the thin solid line 62 indicates the contact point where the vehicle 14 is not traveling. showing the way. Reference numeral 64 indicates a Y-junction area that merges from the left side, reference numeral 66 indicates a cross-road area, and reference numerals 68 and 70 indicate T-junction areas.

Furthermore, in FIG. 5, the lengths of the rectangular symbols 72A to 72C indicate the magnitude of the visual angle α, and the lengths of the right and left symbols with respect to the actual travel route 60 are the right and left sides of the driver, respectively. It shows the magnitude of the viewing angle αb. In particular, the outline rectangular symbol 72A indicates that the viewing angle αb is greater than or equal to the reference value αs on both the right side and the left side. A filled rectangular symbol 72B indicates that the viewing angle αb is less than the reference value αs on at least one of the right side and the left side. A dashed rectangular symbol 72C indicates the magnitude of the reference value αs. In addition, the "!" (exclamation mark) 74 indicates that there is photographic image information about the vehicle 14 captured by the camera sensor 28 in the map section 46 corresponding to the symbol 72B.

Although not shown in FIG. 1, communication terminal 22 includes input devices such as a stylus, mouse, and remote touch for designating exclamation mark 74 . Therefore, the display 58 may be a touch panel display. When the exclamation mark 74 is designated, the controller 56 pops up a photographic image 76 of the surroundings of the vehicle 14 captured by the camera sensor 28, as shown in the partially enlarged view of FIG. indicate.

When the photographic image 76 is designated by the input device, an operation menu such as "enlarge", "full screen display", "close" is displayed, and when the displayed operation menu is designated, the corresponding photographic image is displayed. 76 processing may be performed. Further, when the photo image 76 is designated by the input device, a menu of "display additional information" is displayed. Information such as corners may be displayed.

The ROM 24B of the ECU 24 stores a program for driver visibility condition recording control corresponding to the flowchart shown in FIG. The CPU 24A reads the control program from the ROM to the RAM, and executes the driver visual recognition condition recording control according to the flowchart shown in FIG. 2, as will be described later in detail.

<Driver visibility record control>
Next, the routine of the driver visual recognition condition recording control in the embodiment will be described with reference to the flowchart shown in FIG. 2 is repeatedly executed by the CPU 24A at predetermined time intervals when an ignition switch (not shown in FIG. 1) is on. Also, even if the ignition switch is turned off, power to the ECU 24 is maintained until step 110 is completed.

First, in step 10, the CPU determines whether the vehicle 14 has started running, for example, by determining whether the vehicle speed V is equal to or greater than a reference value Vc (positive constant). When the CPU determines that the vehicle 14 has not started running, it executes step 10 again. On the other hand, when the CPU determines that the vehicle 14 has started running, the control proceeds to step 20 .

At step 20 , the CPU transmits the ID number of the vehicle 14 and information indicating that the vehicle has started running to the data server 20 via the wireless communication device 42 and the network 44 . When the management server 50 of the data server 20 receives the information indicating that the vehicle has started running, it reserves a storage area for the ID number, in other words, the information for the vehicle 14 in the storage device 18 .

In step 30, the CPU determines whether the vehicle 14 is traveling in a map section 46 of a verification area, such as areas 64-70 shown in FIG. When the CPU determines that the vehicle 14 is not traveling in the map section of the confirmation area, the CPU advances the control to step 50 . On the other hand, when the CPU determines that the vehicle 14 is traveling in the map section of the confirmation area, the CPU advances the control to step 40 .

At step 40 , the CPU acquires from the data server 20 via the wireless communication device 42 and the network 44 the reference value αs of the viewing angle αb set for the map section 46 on which the vehicle 14 is currently traveling. Furthermore, the CPU stores the information of the reference value αs in the storage device 40 in association with the position information of the map section 46 .

In step 50, the CPU identifies the line of sight of the driver based on the information of the driver's face photographed by the camera sensor 26, and determines the viewing angle α of the driver as the change angle of the line of sight of the driver in the horizontal direction. to calculate Furthermore, the CPU stores information on the viewing angle α of the driver together with information on the time when the driver's face was photographed in the RAM 24C.

At step 60, the CPU determines whether the vehicle 14 is in a situation to exit the current map section 46 and move to the next map section. When the CPU determines that the situation is not such that the vehicle 14 exits the map section 46 and moves to the next map section, the CPU returns control to step 50 . On the other hand, when the CPU determines that the vehicle 14 is leaving the map section 46 and moving to the next map section, the CPU advances the control to step 70 .

In step 70, the CPU calculates the driver's visual angle αb in the map section as a weighted average value of the driver's visual angle α calculated in one map section 46 before the escape in the manner described above. do. Furthermore, the CPU stores information on the visual angle αb of the driver in the storage device 40 in association with the information on the position of the map section.

At step 80, the CPU determines whether or not the driver's viewing angle αb is smaller than the reference value αs (obtained at step 40). Note that the reference value αs is a reference value set for the map section 46 for which the visual recognition angle αb has been calculated. When the CPU determines that the viewing angle αb is equal to or greater than the reference value αs for both the left and right sides of the vehicle 14, the CPU advances the control to step 100. On the other hand, when the CPU determines that the viewing angle αb for at least one of the left and right sides of the vehicle 14 is smaller than the reference value αs, the control proceeds to step 90 .

At step 90 , the CPU takes a picture of the surroundings of the vehicle 14 with the camera sensor 28 . Further, the CPU stores image information around the vehicle 14 in the storage device 40 in association with the position information of the map section 46 where the photograph was taken. Therefore, when the viewing angle αb of the driver is less than the reference value αs, the image information around the vehicle 14 is acquired, and the image information is stored in the storage device 40 in association with the position information of the vehicle when the image information is acquired. can do.

At step 100, the CPU determines whether or not the vehicle 14 has finished running. When the CPU determines that the vehicle 14 has not finished running, the CPU returns the control to step 30 . On the other hand, when the CPU determines that the vehicle 14 has finished running, the CPU advances the control to step 110 .

At step 110 , the CPU transmits the ID number of the vehicle 14 and information indicating that the vehicle has finished running to the data server 20 via the wireless communication device 42 and the network 44 . In addition to the ID number of the vehicle 14 , the CPU also transmits information such as the actual travel route 60 of the vehicle 14 stored in the storage device 40 and the visual angle αb of the driver via the wireless communication device 42 and the network 44 . Send to server 20 . Therefore, the information recorded in the storage device 40 can be transmitted by wireless communication to the data server 20 installed in the cloud 16 and stored in the storage device 18 of the data server.

The management server 50 of the data server 20 stores the received information such as the visual angle αb of the driver in a storage area corresponding to the ID number of the vehicle 14 in the storage device 18 . Further, information such as the actual travel route 60 of the vehicle 14 may be deleted from the storage device 40 after being transmitted to the data server 20, but may remain stored in the storage device 40. FIG.

<Driver visibility status display control>
Next, a routine for controlling the display of the driver's visibility status in the embodiment will be described with reference to the flowchart shown in FIG. Note that the driver visibility status display control according to the flowchart shown in FIG. 3 is performed when a switch not shown in FIG. It is repeatedly executed by the device 56 every predetermined time. Further, when a predetermined display termination operation is performed, or when the communication terminal device 22 is powered off, the control according to the flowchart shown in FIG. 3 is terminated.

First, at step 210, the control device 56 determines whether display of the actual travel route 60 of the vehicle 14, etc., is requested by operating an input device (not shown in FIG. 1). When the controller 56 determines that there is no request for display of the actual travel route or the like, it executes step 210 again. On the other hand, when the control device 56 determines that there is a request to display the actual travel route, etc., the control advances to step 220 .

In step 220, the control device 56 wirelessly communicates with the data server 20 via the network 44, and acquires information such as the ID number of the vehicle 14, the actual travel route 60, and the driver's visual angle αb from the storage device 18. . 5, the controller 56 also causes the display 58 to display the actual travel route 60 of the vehicle 14, as well as a rectangular symbol 72A indicating the driver's viewing angle αb in each map section 46. display. When there is a map section 46 for which the driver's viewing angle αb is smaller than the reference value αs, a solid rectangular symbol 72B and a dashed rectangular symbol 72C are displayed, and an exclamation mark 74 is displayed for the map section. is displayed.

At step 230, the control device 56 determines whether or not the exclamation mark 74 has been specified, ie, whether or not there is a request to display a photographic image. When the control device 56 determines that there is no request for displaying a photographic image, it once ends the driver visual recognition condition display control according to the flowchart shown in FIG. On the other hand, when the control device 56 determines that there is a request to display a photographic image, the control advances to step 240 .

At step 240, controller 56 pops up photographic image 76 to indicate where the photograph was taken, as shown, for example, in FIG. It should be noted that the above-described menu such as "enlarged display" for the photographic image may be displayed together with the photographic image 76 at the same time.

According to the driver visibility status display control in the embodiment, by wirelessly communicating with the data server 20 through the control device 56 of the communication terminal device 22, the actual travel route 60 of the vehicle 14 and the visibility angle of the driver can be viewed anytime and anywhere. A symbol indicating αb can be displayed on the display 58 and confirmed.

<Display by navigation device 30>
The display 38 of the navigation device 30 is a touch-panel display, and the navigation device 30 may display, for example, an icon "display of travel route" on the display 38 when the vehicle 14 has finished traveling. . When the icon "display travel route" is touched, the control device 36 of the navigation device 30 functions in the same manner as the control device 56 of the communication terminal 22 described above.

For example, when the icon "display driving route" is touched, the control device 36 wirelessly communicates with the data server 20 via the network 44, and displays the actual driving route 60 together with the ID number of the vehicle 14 from the storage device 18. , and the driver's visual angle αb. Furthermore, the control device 36 displays the actual driving route 60 of the vehicle 14 on the display 36 and displays a rectangular symbol 72A indicating the driver's viewing angle αb in each map section 46. FIG. When there is a map section 46 for which the driver's viewing angle αb is smaller than the reference value αs, a solid rectangular symbol 72B and a dashed rectangular symbol 72C are displayed, and an exclamation mark 74 is displayed for the map section. is displayed.

Also, when the exclamation mark 74 is touched, the controller 36 pops up a photographic image 76 so that the user can see where the photograph was taken. It should be noted that the above-described menu such as "enlarged display" for the photographic image may be displayed together with the photographic image 76 at the same time.

In addition, when the icon "display driving route" is touched, the control device 36 of the navigation device 30 communicates with the storage device 40, and displays the driver's visual angle αb and the like stored in the storage device. Information may be obtained and displayed on the display 36 .

As can be seen from the above description, according to the present embodiment, the driver's viewing angle αb is calculated for each map section 46 (steps 30 to 70). When it is determined that the visual angle αb is smaller than the reference value αs for at least one of the left and right sides of the vehicle 14, a photograph of the surroundings of the vehicle 14 is taken, and the position information of the map section 46 where the photograph was taken is linked. Image information around the vehicle 14 is stored in the storage device 40 (steps 80, 90). Furthermore, when the vehicle 14 finishes traveling, information such as the actual travel route 60 of the vehicle 14 stored in the storage device 40 and the visual angle αb of the driver is sent to the data server 20 via the wireless communication device 42 and the network 44. (step 110).

When the input device of the communication terminal device 22 is operated to request display of the actual travel route 60 and the like of the vehicle 14, information such as the actual travel route 60 and the visual angle αb of the driver is received from the storage device 18. is obtained. Further, as shown in FIG. 5, for example, the display 58 displays the actual travel route 60 of the vehicle 14 and rectangular symbols 72A to 72C indicating the driver's viewing angle αb in each map section 46. (steps 210, 220).

Therefore, when the vehicle 14 finishes traveling, the display 58 of the communication terminal device 22 can display the actual traveling route 60 of the vehicle 14 and the rectangular symbols 72A to 72C indicating the driver's visual angle αb in each map section 46. can. In addition, since the displayed actual travel route 60 and the rectangular symbols 72A to 72C indicating the driver's visual angle αb can be seen, the driver's visual angle can be reviewed in relation to the position on the actual travel route of the vehicle. can. Therefore, compared to the case where the actual driving route of the vehicle is not displayed and only the viewing angle of the driver is displayed, evaluation of the validity of the driver's visual behavior in relation to the position on the actual driving route of the vehicle, Able to reflect easily and accurately.

Further, according to the present embodiment, the visual angle αb of the driver is displayed on the displays 58 and 38 using the symbols 72A to 72C. It is possible to easily evaluate and reflect on the validity of visual recognition behavior. Further, since the symbols 72B and 72C at the position where the image information 76 is acquired are different from the symbol 72A at the position where the image information is not acquired, whether or not the viewing angle αb is less than the reference value αs and whether the image information is It can be easily determined whether or not it is acquired.

Further, according to the embodiment, when the exclamation mark 74 as a particular symbol corresponding to the first symbols 72B, 72C displayed on the displays 58, 38 is designated, the corresponding image information 76 is displayed. be done. Therefore, by designating the exclamation mark 74 displayed on the displays 58, 38, the corresponding image information 76 is displayed, and the image of the vehicle 14 when the driver's viewing angle αb is less than the reference value αs is displayed. You can easily check your surroundings.

Furthermore, according to the embodiment, the navigation device 30 can communicate with at least one of the storage device 40 and the data server 20 through the control device 36. 40 or data server 20. Further, since the information recorded in the storage device 40 or the storage device 18 of the data server 20 is acquired by communication, the display 38 of the navigation device 30 displays the actual travel route 60 and the symbol indicating the driver's visual angle αb. can do.

Furthermore, according to the embodiment, the driver's viewing angle α is calculated every predetermined time (cycle time in the flow chart shown in FIG. For angles, a weighted average value is calculated that assigns smaller weights to older angles. Furthermore, by using the weighted average value as the driver's visual angle for the map section, the driver's visual angle αb is obtained for each map section. Therefore, the visual angle of the driver for each map section can be calculated as a weighted average value that assigns a smaller weight to the older map section, and the visual angle of the driver can be obtained for each map section.

Although the present invention has been described in detail with respect to specific embodiments, the present invention is not limited to the above-described embodiments, and various other embodiments are possible within the scope of the present invention. It will be clear to those skilled in the art.

For example, in the embodiments described above, the camera sensor 28 is adapted to capture an angular range of at least about 180°, preferably 360°, including, for example, at least in front of the vehicle 14 . However, of the left and right sides of the vehicle 14, only the side on which the driver's viewing angle αb is smaller than the reference value αs may be corrected so that the angle range is, for example, 120° to 180°.

In the above-described embodiment, when the visual angle αb of the driver is smaller than the reference value αs, the exclamation mark 74 is displayed. A photographic image 76 around is displayed in a pop-up manner. However, if the display of the exclamation mark 74 is omitted and the symbol 72B or 72C is designated, the photographic image 76 around the vehicle 14 may be displayed in a pop-up manner.

In the above-described embodiment, when the visual angle αb of the driver is smaller than the reference value αs, the surroundings of the vehicle 14 are photographed by the camera sensor 28 and displayed upon request. However, the photography of the surroundings of the vehicle 14 by the camera sensor 28 and the display of the photographic image may be omitted.

Furthermore, in the above-described embodiment, the control device 56 of the communication terminal 22 wirelessly communicates with the data server 20 via the network 44, and from the storage device 18, the ID number of the vehicle 14, the actual travel route 60, and the driver's visual recognition information. Get information such as angle αb. Further, the control device 56 displays the actual travel route 60 of the vehicle 14 on the display 58 and displays a rectangular symbol 72A indicating the driver's viewing angle αb in each map section 46. FIG.

However, as indicated by the phantom lines in FIG. 1, the control device 56 of the communication terminal 22 wirelessly communicates with the wireless communication device 42 or the navigation device 30 via, for example, Bluetooth (registered trademark), and via these, the storage device By acquiring the information stored in 40, the actual travel route 60 and the like may be displayed.

Furthermore, in the above-described embodiment, the reference value αs for determining the magnitude of the driver's visual angle α is set for each map section 46 for the confirmation area where the driver needs to confirm safety at a large visual angle. is preset to Each time the vehicle 14 and other vehicles pass through the confirmation area, the information of the driver's viewing angle αb is transmitted to the data server 16, and the receiving server 50 updates the reference value αs in consideration of the received viewing angle αb. It can be like this.

Furthermore, in the above-described embodiments, information such as the actual travel route 60 and the driver's viewing angle αb is displayed on the display 58 or 36 after the vehicle 14 has finished traveling. However, if the vehicle 14 is not running, such as when the vehicle speed V is zero and the shift range of the transmission (not shown) is in the P range or the N range, the vehicle stops running. The information may be displayed even if the information is not displayed.

Further, in the above-described embodiment, the image captured by the camera sensor 28 is a still image, but a moving image is captured and the exclamation mark 74 is . If specified, an animation may be displayed.

DESCRIPTION OF SYMBOLS 10... Driver visual recognition condition confirmation apparatus, 14... Vehicle, 16... Cloud, 18... Storage device, 20... Data server, 22... Communication terminal device, 24... Visual control ECU, 26, 28... Camera sensor, 30... Navigation apparatus , 34... Control device, 36... Display, 40... Storage device, 42... Wireless communication device, 46... Map section, 56... Control device, 58... Display, 60... Actual travel route, 72A to 72C... Rectangular symbol, 76 … photo image

Claims (12)

A position information acquisition unit that acquires position information of a vehicle, a line-of-sight information acquisition unit that acquires line-of-sight information of a driver, and information on the viewing angle of the driver based on the line-of-sight information acquired by the line-of-sight information acquisition unit. A viewing angle information acquisition unit that acquires and records the actual travel route of the vehicle based on the position information of the vehicle, and the driver's visual recognition in association with the position of the vehicle when the information on the viewing angle is acquired. a recording unit that records angle information; and a display unit that displays the actual driving route and the driver's visual angle based on the information recorded in the recording unit when the vehicle is not running. Driver visibility confirmation device including. 2. The driver visual confirmation situation confirmation device according to claim 1, further comprising a data server installed in a cloud and having a storage device, and a communication unit that wirelessly communicates with the data server. 2. A driver visual confirmation situation confirmation device, wherein the communication unit transmits the information recorded in the recording unit to the data server, and the data server stores the received information in the storage device. 3. The driver's visual condition confirmation device according to claim 2, wherein the display unit includes a first control device and a first display that wirelessly communicate with the data server, and the first control device controls the data A driver visibility condition confirmation device configured to acquire information stored in the storage device from a server by wireless communication, and display the actual travel route and the visibility angle of the driver on the first display. 4. The driver's visual condition confirmation device according to claim 3, wherein the driver's visual condition confirmation device further comprises: when the visual angle of the driver is less than a preset first reference value, and the recording unit is configured to record the image information in association with the position of the vehicle when the image information was acquired. Device. 5. The driver visual recognition situation confirmation device according to claim 4, wherein the first display is configured to display the visual recognition angle of the driver with a symbol, and the symbol at the position where the image information was obtained is the A device for confirming the driver's visual recognition situation, which is a first specific symbol different from the symbol at the position where the image information is not acquired. 6. The driver's visual condition checking device according to claim 5, wherein the first display is designated with at least one of the first symbol displayed on the first display and a specific symbol corresponding thereto. and a driver visual confirmation device configured to display corresponding image information. 2. The driver's visual condition confirmation device according to claim 1, wherein the driver's visual condition confirmation device includes a navigation device that achieves part of the functions of the position information acquisition unit and the display unit. A device for confirming the visual condition of a driver, comprising: a second control device communicating with at least one of the recording unit and the data server; and a second display. 8. The driver visual confirmation situation confirmation device according to claim 7, wherein the second control device acquires information recorded in at least one of the recording unit and the data server by communication, and and a driver visibility condition confirmation device configured to display the visibility angle of the driver on the second display. 9. The driver visibility status confirmation device according to claim 8, wherein the driver visibility status confirmation device further comprises: when the visibility angle of the driver is less than a preset second reference value, and the recording unit is configured to record the image information in association with the position of the vehicle when the image information was acquired. Device. 10. The device for confirming the driver's visual condition according to claim 9, wherein the second display is configured to display the visual angle of the driver by a symbol, and the symbol at the position where the image information was acquired is the A device for confirming the driver's visual recognition situation, which is a second specific symbol different from the symbol at the position where the image information is not acquired. 11. The driver's visual condition confirmation device according to claim 10, wherein the second display is designated with at least one of the second symbol displayed on the second display and a specific symbol corresponding thereto. and a driver visual confirmation device configured to display corresponding image information. 12. The device for confirming the driver's visual status according to any one of claims 1 to 11, wherein the visual recognition angle information acquiring unit calculates the visual recognition angle of the driver at predetermined time intervals, For a plurality of visual recognition angles calculated for a section, a weighted average value is calculated that assigns a smaller weight to the older, and the weighted average value is used as the visual recognition angle of the driver for the map section. A driver visibility confirmation device configured to acquire a driver visibility angle.

Images