JP2015141432A - Vehicle operation evaluation system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To more improve the safety driving technology of a driver by evaluating a backward checking operation to be performed by a driver when turning right or left to travel or making lane change right or left or the like more precisely than a conventional manner, and providing a feedback to the driver based on the evaluation result with more suitable content in a vehicle operation evaluation system.SOLUTION: When a backward checking scene comes to an own vehicle, an image processing part 20 detects the predetermined backward checking operation of a driver and the eye-opening state in the backward checking operation on the basis of the image of a driver photographing camera 22, and grade-evaluates the driving behavior of the driver in the backward checking scene on the basis of the detection result.

Description

  The present invention relates to a vehicle driving evaluation system.

  In recent years, with the aim of improving driver's safe driving technology, vehicle behavior and operation information are collected, and the information is used for diagnosis and evaluation of safe driving, and warnings and driving advice are given at appropriate timing. There is a driving evaluation system that informs users by voice, screen display, and printed forms. In such a system, more accurate evaluation and more detailed evaluation contents are required, and it is possible to further improve the driver's safe driving technique. Also, the feedback to the driver for the evaluation needs to be made at a more suitable timing and content.

JP 2002-2111265 A

  An object of the present invention is to make it possible to perform a more detailed evaluation of the backward confirmation operation that the driver should perform when traveling left and right or changing the right and left lanes in a vehicle driving evaluation system, as compared with the conventional case. The feedback to the driver based on the evaluation result is performed with more suitable contents, and the driver's safe driving technique can be further improved.

Means for Solving the Problems and Effects of the Invention

In order to solve the above problems, the vehicle driving evaluation system of the present invention
A scene arrival identifying means for identifying the arrival of a predetermined rear confirmation scene that the driver should confirm backward while the vehicle is traveling;
In the identified rear confirmation scene, confirmation operation detection means for detecting the driver's rear confirmation operation,
Eye opening detecting means for detecting the driver's eye opening state during the backward confirmation operation;
Evaluation means for evaluating the driving behavior of the driver in the identified rear confirmation scene based on the detection result of the rear confirmation operation and the eye open state in the rear confirmation scene;
It is characterized by providing.

  According to the configuration of the present invention, only whether or not the driver (for example, a professional driver) has performed a backward confirmation operation (for example, a backward turning operation with movement of the line of sight or swinging left and right) in the backward confirmation scene. In addition, it is possible to evaluate whether or not the rear is surely visually confirmed during the backward confirmation operation from the eye open state of the driver at that time. Thereby, it is possible to make it a habit for the driver not only to confirm the backward direction but also to see the rear side for a predetermined time. In the conventional vehicle driving evaluation system, there is no technique for evaluating the driver's rear confirmation in detail by a combination of the rear confirmation operation and the eye open state.

  In the vehicle driving evaluation system of the present invention, when the arrival of the backward confirmation scene is specified by the scene arrival specifying means, one or more viewing directions to be visually observed in the backward confirmation scene are determined in advance. It is possible to provide a visual direction notifying means for informing the user. Accordingly, the correct answer in the direction to be visually checked in the rear confirmation scene is presented to the driver who receives scoring / evaluation regarding the rear confirmation. Even if the driver does not know the correct answer in the direction to be viewed at that time, the correct answer can be obtained by receiving notifications, so that it can be expected to improve the evaluation and scoring results, and thus improve the driving skill . Further, the visual direction notifying unit can be configured as a visual direction display unit (viewing direction presenting unit) provided in or around the visual direction from the driver in the rear confirmation scene, and the visual direction notifying unit can specify the arrival of the scene. When the arrival of the backward confirmation scene is specified by the means, the viewing direction display unit positioned in the viewing direction in the backward confirmation scene can be configured to shift from the non-display state to the display state. Thus, the driver can easily know the viewing direction in the rear confirmation scene. In addition, there is also an advantage that if the viewing direction display section is viewed, the viewing direction can be seen immediately without moving the line of sight. In the case of notification by voice, there are inconveniences that you will not know if you miss it once, and there are many problems such as it is troublesome to be notified repeatedly by voice, but if it is notification by display, a certain notification period is set Even if the notification state is continued, it is difficult for the driver to be bothered, so the direction can be reliably transmitted to the driver. Further, the notification state may be terminated when it is detected that the message has been transmitted. In addition, when the notification by the visual direction display (visual notification) is performed, the driver can be notified that the notification by the visual direction display has been started by voice notification of the arrival of the rear confirmation scene.

BRIEF DESCRIPTION OF THE DRAWINGS The block diagram which showed simply the vehicle driving | operation evaluation system which is one Embodiment of this invention. The flowchart which showed the process which evaluates the driving | running behavior in a driver | operator's back confirmation scene in the vehicle driving evaluation system of FIG. The flowchart which showed an example of the alerting | reporting output process in the process of FIG. The figure which showed an example of the scoring table for scoring and evaluating the driving | running | working behavior of a driver at the time of the 1st back check scene in the vehicle driving evaluation system of FIG. The figure which showed an example of the scoring table for scoring and evaluating the driving | running | working behavior of the driver | operator at the time of the 2nd back confirmation scene in the vehicle driving evaluation system of FIG. The figure which showed an example of the scoring table for scoring and evaluating the driving | running | working behavior of a driver | operator at the time of the 3rd back confirmation scene in the vehicle driving evaluation system of FIG. The figure which showed an example of the scoring table for scoring and evaluating the driving | running | working behavior of a driver | operator at the time of the 4th back confirmation scene in the vehicle driving evaluation system of FIG. The figure which showed the 1st example of the visual recognition direction in back confirmation operation | movement in the vehicle driving evaluation system of FIG. The figure which showed an example of the alerting | reporting part which shows the visual recognition direction in the back confirmation operation | movement of FIG. The figure which showed the 2nd example of the visual recognition direction in back confirmation operation | movement in the vehicle driving evaluation system of FIG. The figure which showed the 2nd example of the visual recognition direction in back confirmation operation | movement in the vehicle drive evaluation system of FIG. 1 from the viewpoint different from FIG. The figure which showed an example of the alerting | reporting part which shows the visual recognition direction in the back confirmation operation | movement of FIG. The figure which illustrated the total result which totaled the evaluation result by the predetermined item. The figure which illustrated the result of having totaled the number of times of attention reduction by a predetermined item, in order to specify the tendency of attention reduction. The figure which showed the modification of the alerting | reporting part which shows the visual recognition direction in the back confirmation operation | movement of FIG. The figure which showed the example of a change of arrangement | positioning of a driver | operator imaging | photography camera.

  An embodiment of a vehicle driving evaluation system of the present invention will be described with reference to the drawings.

  As shown in FIG. 1, the vehicle driving evaluation system 1 of this embodiment includes a storage unit (road map data storage unit) 30 that stores road map data 31 and a navigation program 32, and main control that executes the navigation program 32. And a navigation device for a vehicle having a navigation function for calculating a route to a set destination based on the road map data 31 and guiding the route.

  The road map data 31 includes map data for display, node position information corresponding to various branch points such as intersections, link information indicating connection of nodes, and accompanying information corresponding to each node and each link ( Various information such as road width, number of lanes, etc. are included.

  The main controller 10 includes various driving behavior detectors 100 such as a position detector 11, an acceleration sensor 12, a speed sensor 13, a vehicle angle sensor 14, a blinker sensor 15, a brake sensor 16, a shift position sensor 17, and a driver photographing camera 22. Connect with. Further, the main control unit 10 includes operations such as a display output unit 2 such as a liquid crystal display that outputs a map display or route guidance display, an audio output unit 3 such as a speaker, a voice input microphone, a touch panel, a remote control, a mechanical switch, and the like. Input unit 4, external output unit 5 for outputting data and the like, light emitting unit 6 formed by LEDs or LED groups, predetermined situation information (for example, time / elapsed time after start of travel, position information of own vehicle 200) , Traffic information such as traffic jam information) is connected to a situation information acquisition unit (a clock function unit, a timer, a position detection unit 11, an out-of-vehicle communication unit, etc.) 23 and an out-of-vehicle rear photographing camera 24.

  The position detection unit 11 identifies the current position of the host vehicle 200. In addition to the known geomagnetic sensor, gyroscope, and distance sensor, the position detection unit 11 is based on radio waves (GPS signals) from GPS satellites. It is a well-known device having a GPS receiver for detecting the current position. The main control unit 10 functions as a current position specifying unit and a moving direction specifying unit that specify the current position and the traveling direction of the host vehicle 200 based on the reception signal of the GPS receiver and the detection information of other sensors.

  Further, the main control unit 10 detects a driver photographing camera 22 for photographing the vicinity of the driver's face in the passenger compartment and a driver's safe driving operation (especially a safety confirmation operation) from the captured image of the camera 22. An image processing unit 20 that performs known image processing is connected.

  The driver photographing camera 22 is provided in front of the driver in the present embodiment. For example, as shown in FIGS. 8 and 10, it can be provided on a dashboard in front of the driver.

  The image processing unit 20 receives and processes the image data captured by the driver photographing camera 22, so that the visual operation information indicating the movement of the driver's face and the line of sight (gaze) and the open / closed state of the driver's eyes are displayed. Is transmitted to the main control unit 10 as detection information (detection result).

  The rear camera 24 outside the vehicle is a camera for realizing the back monitor function, and the captured image is displayed on the display output unit 2 that also serves as the back monitor screen.

  As shown in FIGS. 8 to 12, the vehicle 200 includes predetermined rear display units 2 (27), 28, and 29 that project a vehicle outside range that is behind the driver. The rear display units 2, 28 and 29 of the present embodiment are photographed by a rearview mirror (room mirror) 28 provided on the front side of the driver and a rear rear camera (photographing unit) 24 for photographing the rear rear of the vehicle. A back monitor screen (screen of the display output unit 2) 27 for displaying an image, and side mirrors (here, door mirrors) 29 provided on the left and right sides of the vehicle.

  By the way, the main control unit 10 of the present embodiment specifies the arrival of a backward confirmation scene registered in advance in the storage unit 30 based on the detection information of the various detection units 11 to 17 (scene arrival specification) while the vehicle is traveling. means). Then, in the rear confirmation scene in which arrival is specified, the image processing unit 20 confirms the rear of the driver of the host vehicle 200 based on the captured image (rear confirmation operation information and eye opening information) captured by the driver photographing camera 22. The operation (predetermined operation for confirming the vehicle exterior visual field behind the vehicle) and the eye open state of the driver during the rear confirmation operation are detected (confirmation operation detection means, eye opening detection means). The main control unit 10 evaluates and diagnoses the driving behavior of the driver in the rear confirmation scene that has arrived, for example, in the form of scoring based on the detection results of the rear confirmation operation and the open eye state (evaluation means).

  The storage unit 30 stores specific conditions for a plurality of backward confirmation scenes. Further, the storage unit 30 stores, for each of the backward confirmation scenes, the operation content of the backward confirmation operation that the driver should perform for backward confirmation and the condition of the open state that should be satisfied during the operation in association with each other. The main control unit 10 determines whether or not the detection information of the various detection units 11 to 17 satisfies the specific condition of each rear confirmation scene, and identifies which rear confirmation scene has arrived. In addition, the main control unit 10 displays an image indicating whether or not the operation content of the backward confirmation operation corresponding to the backward confirmation scene that specified the arrival has been made, and whether or not the eye opening state at the time of the operation satisfies the corresponding eye opening condition. The determination is made based on the detection result of the processing unit 20, and the driving behavior of the driver in the rear confirmation scene is evaluated and diagnosed based on the determination result.

  The backward confirmation operation in the present embodiment includes a display portion visual recognition operation for visually recognizing the rear display portions 2, 28, and 29 provided so as to be visible to the driver, and a right or left at a predetermined angle or more with respect to the front direction of the driver. There are two types of swinging visual recognition operations (backward leftward movement and backward rightward movement) in which the rear visual field outside the vehicle is directly viewed through the window glass 33 in a direction facing the vehicle.

  Here, as shown in FIGS. 8 and 9, the display portion visual recognition operation is an operation of visually recognizing the screen display portion 2 in the vehicle interior, the rearview mirror 28 in the vehicle interior, and the left and right side mirrors 29 outside the vehicle. The image processing unit 20 specifies the line-of-sight direction (viewing direction) from the driver's face image (eye image) captured by the driver photographing camera 22 by well-known image processing, and the driver displays the screen display unit 2 and the rearview mirror 28. Then, it is detected whether the display surfaces of the left and right side mirrors 29 outside the vehicle have been visually recognized. When the image processing unit 20 detects the visual recognition, the main control unit 10 specifies that the display unit visual operation has been performed.

  As shown in FIGS. 10 and 11, in order to directly see the outside of the vehicle through the window glass 33 on the rear left side, the rear right side, or the rear front, as shown in FIGS. This is accompanied by a swinging motion that changes the angle more than a predetermined angle. The image processing unit 20 identifies the movement of the facial part from the driver's face image captured by the driver photographing camera 22 by using known image processing, and the driver uses the window glass 33 on the rear left side, the rear right side, or the rear front. It is detected whether or not the face is directed to an angle at which can be visually recognized. For example, in the captured image of the driver photographing camera 22 that photographs the driver from the front, only the right eye or only the left eye (or only the right ear or only the left ear) from the face image of the driver facing the front that can identify both eyes. ) Can be specified to detect a swinging motion (backward rightward state or rearward leftward state), and the eye direction (viewing direction) is determined from the driver's eye image at that time. Detects whether or not the direction of the window glass 33 on the rear left side or the rear right side or the rear front is visually recognized. When the image processing unit 20 detects the swing motion and the visual recognition, the main control unit 10 specifies that the swing visual motion has been performed.

  The eye-open state is a state in which the driver's eyes are open, and an eye-opening condition to be satisfied in the eye-open state is determined for each backward confirmation operation. The eye opening condition here is defined as the eye opening duration. The image processing unit 20 detects the open eye state from the driver's face image (eye image) captured by the driver photographing camera 22 by known image processing, and specifies the duration of the open eye state. For example, the image processing unit 20 detects a state where the ratio between the vertical length of the driver's face and the spread width of the eyes in the vertical direction is equal to or greater than a certain value, and specifies the duration of the open state.

  In this embodiment, the rear confirmation scene includes a traffic jam approach scene in which the host vehicle 200 approaches the jammed vehicle group from behind, a right / left turn scene of the host vehicle 200, a reverse scene of the host vehicle 200, and a high speed of the host vehicle 200. This is a regular confirmation scene when driving on the road.

  The arrival of the traffic congestion approach scene is based on the acquisition information (congestion information / traffic information) acquired (received) by the situation information acquisition unit 23 that forms the outside communication unit, and the position information of the host vehicle 200 acquired by the position detection unit 11. Based on this, it is specified when the own vehicle 200 approaches within a predetermined distance to a congested vehicle (the last vehicle in a group of vehicles that are stopped or traveling at a low speed due to the congested traffic). The departure from the traffic jam approaching scene is specified based on the same information when the traffic jam is resolved or when the host vehicle 200 is separated from the jammed vehicle by a predetermined distance or more.

  The arrival of the right / left turn scene is based on the detection information of the turn signal sensor 15 that detects the ON / OFF state of the turn signal lamp that is turned on (flashing) by an operation on the turn direction operation unit. ) Is detected. The departure from the right-left turn scene is specified when the turn signal sensor 15 is turned off (the light is continuously turned off) based on the same information. The departure from the right / left turn scene may be performed by detecting the steering angle of the steering wheel and detecting the return of the steering angle equal to or greater than a predetermined angle. In addition, the arrival and departure of the right / left turn scene may be specified by approaching or leaving the point where the right / left turn is made at the time of route guidance. In this case, based on the position information of the host vehicle 200 acquired by the position detection unit 11 and the road map data 31 stored in the storage unit 30, it is possible to specify approach and departure from the right / left turn point.

  The arrival of the reverse scene is specified when the shift position is switched to the R (reverse) position based on the detection information of the shift position sensor that detects the shift position. The departure from the reverse scene is specified based on the same information when the shift position is switched from the R position to another position or when the vehicle speed is detected while the shift position remains at the R position.

  The arrival of the regular confirmation scene when driving on an expressway is the acquisition information (time count) acquired by the position information acquisition unit 23 that forms the position information of the host vehicle 200 acquired by the position detection unit 11, the road map data 31, and the timer. Based on (elapsed time information), it is specified when a predetermined time has elapsed during traveling on the expressway. In other words, the highway traveling regular confirmation scene arrives every time a predetermined time elapses after traveling on the highway. The departure from the regular confirmation scene when traveling on an expressway is specified when a predetermined time has elapsed since the arrival of the scene based on similar information.

  The backward confirmation scene may be applied in addition to the above, or a part of the above may be omitted. Other methods may be used for specifying the arrival and departure of the backward confirmation scene.

  Hereinafter, the driving behavior evaluation process of the driver in the backward confirmation scene executed by the main control unit 10 will be described with reference to FIGS. 2 and 3.

  As shown in FIG. 2, first, the main control unit 10 determines whether a rear confirmation scene registered in advance in the storage unit 30 has arrived at the host vehicle 200, and if so, which rear confirmation scene has arrived. And specifying as described above (S1: scene arrival specifying means).

  When the arrival of the host vehicle 200 to the rear confirmation scene is specified (S1: Yes), the main control unit 10 notifies the arrival of the rear confirmation scene to a predetermined notification unit (scene arrival notification unit) (S2: Scene arrival notification means). Here, the notification unit is the voice output unit 3, and the arrival of the backward confirmation scene is notified by voice. In addition, this voice notification may output a voice as to which rear confirmation scene is necessary and which rear confirmation operation is necessary. For example, “Please check the left / right / backward before turning right” or “Soon you will approach the vehicle at the end of the traffic jam. Check the rear with the rearview mirror, blink the hazard lamp and decelerate. "Etc."

  Further, when the arrival of the host vehicle 200 in the rear confirmation scene is specified (S1: Yes), the main control unit 10 determines a visual direction to be visually checked for the rear confirmation in the rear confirmation scene. (Visual direction notification unit) is notified (S3: Visual direction notification means). Here, the notification unit is a display unit (viewing direction display unit) 6 in the vehicle interior located in the viewing direction of each rear confirmation scene or in the vicinity thereof. That is, the notification unit 6 here is in a vehicle interior portion (for example, a window glass, a screen, a reflection surface) that intersects with an axis line that coincides with the viewing direction that the driver should view in each rear confirmation scene, or a peripheral portion of that portion. This is a display unit 6 provided. When the arrival of the backward confirmation scene is specified, the main control unit 10 displays all the display units 6 corresponding to each of one or more viewing directions to be visually confirmed for backward confirmation in the backward confirmation scene. A state is set (S3).

  In addition, the display part 6 of this embodiment is provided as the light emission part (for example, LED light emission part using LED (light emitting diode)) 6, and the display state is made into the blinking state. Thereby, it can grasp | ascertain from the presence position of the light emission part 6 which the direction which should be visually blinked blinks. More specifically, the display unit 6 is a light emitting unit 6 (see FIG. 12) provided in the periphery of the outer peripheral side of the window located in the viewing direction, or a rear display unit 2 that displays a rear view. It is the light emission part 6 (refer FIG. 9) provided in the outer peripheral part of the display surface of 28,29. Regarding the side mirror 29 located outside the vehicle 200, the light emitting unit 6 may be provided on the side mirror 29 itself (see FIG. 15), but instead of being provided on the side mirror 29, the driver receives the side mirror 29. The vehicle interior structure part (here, the outer peripheral part of the window glass 34 on the left and right sides of the front seat) is located in the vicinity of the viewing direction for visually observing the display and the display surface (mirror surface) of the side mirror 29 is not obstructed. The light emitting section 6 (see FIG. 9) is provided in a portion close to the side mirror 29).

  Returning to FIG. When the arrival of the host vehicle 200 in the rear confirmation scene is specified (S1: Yes), the main control unit 10 also starts shooting the driver (shooting mainly the face and its surroundings) by the driver shooting camera 22. (S3).

  Accordingly, the image processing unit 20 starts image processing for detecting a predetermined backward confirmation operation and an eye open state during the backward confirmation operation from the photographed image of the driver photographing camera 22. In the backward confirmation operation of each backward confirmation scene, a visual operation for visually confirming a visual direction to be visually confirmed for backward confirmation is defined, and the image processing unit 20 detects the visual operation and performs the visual operation at the time of the visual operation. Detection of an open eye state is started (visual motion detection means). The detection result is transmitted to the main control unit 10.

  When the arrival of the backward confirmation scene is specified, the main control unit 10 sets each display unit 6 corresponding to one or more viewing directions to be visually confirmed for backward confirmation in the backward confirmation scene. (S3: Visual direction notifying means) In the display state, based on the detection result of the image processing unit 20, the presence or absence of the visual operation of the driver is specified, and when there is a visual operation (S4: Yes), The display unit 6 corresponding to the visual direction of the visual operation is switched from the display state to the non-display state (S5: visual direction notification means). That is, according to these processes, the display part 6 in the direction visually observed by the driver is switched to the non-display state. As a result, only the viewing direction display unit 6 that is in the viewing direction that has not yet been viewed among the directions that should be viewed in the rear confirmation scene is left in the display state. If so, the driver can easily figure out which direction it is.

  Thereafter, the main control unit 10 specifies the departure of the host vehicle 200 from the rear confirmation scene in which arrival has been specified (S6: scene departure specifying unit). If the departure is not specified (S6: No), the driver's photographing by the driver photographing camera 22, the driver's backward confirmation operation and the detection of the eye open state by the image processing unit 20 are continued. In each display unit 6 as well, only the display unit 6 in the viewing direction that is not visually observed continues the display state.

  When the departure of the host vehicle 200 from the rear confirmation scene is specified (S6: Yes), the main control unit 10 ends the photographing by the driver photographing camera 22 and sets all the display units 6 to the non-display state (S7). . Then, the main control unit 10 scores a predetermined item related to the behavior (driving behavior) of the driver during the rear confirmation scene based on the photographed image photographed by the driver photographing camera 22 (S8: evaluation means). .

  There are a plurality of items to be scored, and a driver's rearward confirmation operation (operation content) and an eye opening state (eye opening condition) predetermined for each item are determined. The main control unit 10 aggregates whether or not the contents of these items have been performed, and determines a point based on the aggregation result. In the present embodiment, one of the items includes a backward confirmation operation. The driver's backward confirmation operation is determined in a form associated with each backward confirmation scene. Here, the traffic jam approach scene shown in FIG. 4, the right / left turn scene shown in FIG. 5, and the reverse scene shown in FIG. A backward confirmation operation is defined for each of the regular confirmation scenes during highway traveling shown in FIG. Furthermore, in the present embodiment, one of the items includes the continuation of the eye open state (the state where the eyes are open) for a predetermined time or more (here, 3 seconds or more) during the backward confirmation operation in each backward confirmation scene. . The main control unit 10 performs the scoring of the corresponding item in the arrived backward confirmation scene with reference to the scoring tables of FIGS. 4 to 7, and determines the score. 4 to 7, it is assumed that ○ is executed and × is not executed, and points (scoring results) are determined according to the difference between ○ and × of each item.

  Specifically, in a traffic jam approaching scene, the driver is required to check the front and rear, and as shown in FIG. 4, the rearview mirror (room mirror) 28 is visually observed as an item to be scored. A backward confirmation operation, a continuation of the eye-opening state for a predetermined time or longer (here, 1 second or more) during the operation, a forward confirmation operation for visually checking the front, and a predetermined time or longer (here) In this case, it is determined that the eye-opening state continues for 1 second or longer.

  In a right / left turn scene, the driver is required to check the rear side of the side to bend particularly, and as shown in FIG. 5, the rear side of the side mirror (door mirror) 29 on the side to be bent is visually observed. Confirmation operation, rearward confirmation operation in which the outside of the vehicle is directly observed through the window glass 33 on the side of the rear seat on the bend side, and continuation of the eye open state for a predetermined time or longer (here, 3 seconds or more) when performing both operations. Is stipulated.

  In the reverse drive scene, the driver is required to check the rear front and rear left and right, and as a scored item, as shown in FIG. During the operation, the eye-opening state continues for a predetermined time or longer (here, 1 second or longer), and further, a rearward confirmation operation in which the outside of the vehicle is directly observed through the window glass 33 on the left and right sides of the rear seat, The continuation of the eye open state for a predetermined time or longer (here, 3 seconds or longer) is determined.

  In the regular confirmation scene when driving on a highway, the driver is required to confirm the front and rear, and as shown in FIG. The confirmation operation and the continuation of the eye open state for a predetermined time or more (here, 1 second or more) during the operation are determined.

  The main control unit 10 determines whether or not a scoring item corresponding to the backward confirmation scene for which the current arrival is specified among these backward confirmation scenes has been executed by the driver. And the main control part 10 determines the scoring result of the back confirmation scene in which the present arrival is specified based on the determination result of each scoring item and the scoring tables shown in FIGS.

  Subsequently, the main control unit 10 sends notification information based on the scoring result (evaluation result) from the notification units 2 and 3 including either or both of the display output unit 2 and the voice output unit 3 to the driver. A notification is output (S9: notification means). The notification output is performed by the main control unit 10 executing the process shown in FIG.

  That is, first, the main control unit 10 determines whether or not the scoring result (evaluation result) obtained in S8 is within a predetermined normal scoring range (normal point range) (S61).

  Note that the normal scoring range is a range that is permissible if there is a slight deduction, and is defined as a safe driving range that is permissible when performed during normal operation. The normal scoring range here is determined in each rear confirmation scene, and the low scoring range (see * in FIGS. 4 to 8 is not set) that includes the highest score and is regarded as a dangerous driving action. May be the case).

  If it is within the normal score range (S61: Yes), the present process is terminated without any special notification in the present embodiment. Even within the normal scoring range, notification output may be performed with predetermined notification contents, but it is not shown here because it may be annoying because it is frequently notified.

  When the scoring result (evaluation result) obtained in S8 is not within the normal scoring range (normal evaluation result range) (S61: No), the main control unit 10 determines that the scoring result obtained in S8 is higher than the normal scoring range. It is also determined whether the reference point is lower than the reference point (reference point) set low (S62). Again, the reference points (see * 2 in FIGS. 4 to 8) are determined in each rear confirmation scene. The main control unit 10 regards a case where it is determined that the reference point is lower than the reference point as a warning target, and a safe driving operation (rear confirmation operation and eye-opening continuation state) is performed in the current rear confirmation scene as the content that is output as notification. Warning notification to notify that there is no is determined (S63). The content of the warning notification specifically points out the safe driving operation (rear checking operation and eye-opening continuation state) that was not made in the current rear confirmation scene, or such safe driving in the current scene or the same scene as this time Advice such as prompting the user to perform an action may be used.

  Next, the main control unit 10 determines whether or not the scoring result (evaluation result) obtained in S8 has decreased by a predetermined level or more than the average score (average point) of the past (which means a past fixed period here). Determine (S64). If the average score has decreased by a predetermined level or more than the past average score (S64: Yes), the main control unit 10 indicates that the driver's attention is temporarily reduced as the content of the notification output, or the attention The content for urging the reduction is determined (S65). For example, it can be a content that encourages a break. Here, the decrease above the predetermined level is defined as a change in which the scoring result obtained in S8 is (−10) or less with respect to the average score obtained by averaging past scoring results.

  Next, the main control unit 10 determines whether or not the scoring result (evaluation result) obtained in S8 is higher than the past average score (average point) by a predetermined level or more (S66). When it becomes higher than the past average score by a predetermined level or more (S66: Yes), the main control unit 10 informs the driver that safety driving technology (especially safety confirmation operation) has been improved. Is determined (S67). Here, when the scoring result obtained in S8 is higher than the average score obtained by averaging past scoring results, it is determined that the scoring result is higher than a predetermined level.

  Finally, the main control unit 10 determines the content to be finally notified based on the notification output content determined in the process so far, and the notification of the content is either the display output unit 2 or the audio output unit 3. Or let both sides do it. If a plurality of types of contents are determined as the contents of the notification output (for example, when both S63 and S65 are notified), all of the plurality of types of contents are notified (warning notification means, comparison) Notification means).

  Note that the predetermined values such as the normal score range, the reference point, the average score, and the predetermined level described above are stored in the storage unit 30, and the main control unit 10 appropriately reads out and uses them at a necessary timing. .

  Returning to FIG. When the notification output (S9) is completed, the main control unit 10 stores in the storage unit 30 the captured video of the driver imaging camera 22, the detection information of each driving behavior detection unit 100, and the scoring result (evaluation result) of S8. (S10: Evaluation result storage means). Then, the main control unit 10 ends this process by turning off the ignition switch, and returns to S1 again if it remains on.

  In the vehicle driving evaluation system 1 of the present embodiment, scoring (evaluation) is performed in the form of a combination of the backward confirmation operation and the eye-opening situation among the driver's safety confirmation operations in various backward confirmation scenes as described above. However, there are other scoring items (evaluation items). For example, in the case of a right / left turn scene, a gentle deceleration when approaching a right / left turn scene, a reliable stop at a temporary stop point, a gentle acceleration after a temporary stop, The main control unit 10 also performs scoring based on the detection result of the driving behavior detection unit 100 for items such as turn signal lighting at the time of right / left turn, lateral acceleration at the time of right / left turn, and the scoring result of each scoring item ( Evaluation result) is stored in the storage unit 30.

  All the scoring results (evaluation results) stored in the storage unit 30 can be output from the external output unit 5, for example, connected to the media 51 via the external output unit 5 and stored in the media 51. Alternatively, it may be connected to the external management device 52 via the external output unit 5 and stored in the storage unit on the management device 52 side. Further, it may be stored in the storage unit on the management device 52 side via the media 51.

  The management device 52 can statistically process the scoring results (evaluation results) and display them on the display 52a (evaluation result display means). A graph may be displayed. FIG. 13 is a scoring result regarding a certain backward confirmation scene (here, a left / right turn scene). The time and elapsed time after the start of traveling are acquired from the situation information acquisition unit 23 as situation information at the time of scoring, Accumulated points for each elapsed time after the start are accumulated and displayed.

  Although one embodiment of the present invention has been described above, this is merely an example, and the present invention is not limited to this, and the knowledge of those skilled in the art can be used without departing from the spirit of the claims. Various modifications such as addition and omission can be made based on this.

  Hereinafter, other embodiments and modifications of the present invention will be described. Note that detailed descriptions of functional units common to the above-described embodiment and similar functional units are omitted. In addition, the above-described embodiment and a plurality of modifications described below can be implemented in appropriate combination within a range that does not cause technical contradiction.

  For example, the arrival of the rear confirmation scene in S1 in the process of FIG. 2 (for example, detection of the approach of a right / left turn scene) can be performed based on a photographed image of the vehicle exterior front camera 21 that captures the vehicle exterior front. . In other words, the above-mentioned front-facing camera 21 is connected to the main control unit 10, and image data captured by the camera 21 is received and processed by the image processing unit 20. May be detected to identify the arrival of a backward confirmation scene. In this case, the front-side camera 21 outside the vehicle is a camera of the drive recorder 210, and the captured image is not only transmitted to the image processing unit 20 via the main control unit 10, but also a storage unit in the drive recorder 210. Is also stored and accumulated.

  In the above embodiment, the main control unit 10 is evaluated by the past scoring results (evaluation results) stored and accumulated in the storage unit (evaluation result storage unit) 30 and S8 by the processes of FIGS. In addition, notification information having a content to be compared with the latest scoring result (evaluation result) is output to the driver (comparison notification means). Specifically, when the latest scoring result evaluated in S8 is better than a predetermined level with respect to the average value of the past scoring results, notification information indicating the goodness is given to the driver. When a notification is output and the condition is deteriorated below a predetermined level, notification information of a content for recognizing a decrease in attentiveness is output to the driver.

  In this configuration, the main control unit 10 needs to store in the storage unit 30 the average value of the scoring results in each past confirmation scene (average evaluation information obtained by averaging the evaluation results). In this case, when the main control unit 10 is connected to the status information acquisition unit 23 and obtains the latest scoring result in S8, the latest scoring result is stored and accumulated in the storage unit 30 in the past. It is determined whether or not the state of attention reduction has deteriorated below a predetermined level with respect to the average value of the scoring results. When it is determined that the state of attention reduction has occurred, the situation information acquired by the situation information acquisition unit 23 is obtained. The storage unit (situation information storage unit) 30 can be configured to store and accumulate (attention level reduction status storage unit). Further, based on the stored / accumulated situation information, the attention reduction state having a high tendency to become the attention reduction state is specified (attention reduction state specifying means), and the situation information acquired by the situation information acquisition unit 23 indicates If the situation is a situation where attention is reduced, or if the situation has approached a predetermined level or more in a certain period in the past, notification information that alerts the attention reduction is output to the driver (attention output) (Means) can also be configured.

  For example, as shown in FIG. 14, the main control unit 10 is configured to store the time and the elapsed time after the start of travel in the storage unit 30 as situation information when it is determined that the state of attention is reduced. In addition, this is counted as the number of occurrences of reduced attention level by time zone and by elapsed time after the start of driving, and based on the totaled result, the time zone and elapsed time that tend to be low attention level are calculated. It is configured so as to be specified (attention level reduction status specifying means). Then, the main control unit 10 acquires the time and elapsed time acquired by the situation information acquisition unit 23 in a time zone in which there is a high tendency to be in a reduced attention level, or after the start of traveling that has a high tendency to be in a reduced attention level. In this case, it is also possible to configure so that the notification information of the content that alerts the attention reduction is output to the driver (attention output means). In addition, the notification output is generated at the time zone and the elapsed time acquired by the situation information acquisition unit 23 during a time zone where the attention level is likely to be low, or the elapsed time after the start of travel where the attention level is likely to be low. On the other hand, when approaching a predetermined level or more (for example, 10 minutes before, etc.), notification information of contents that alert attention reduction and notification information of contents that alert attention reduction are output to the driver ( It can also be configured as a warning output means).

  Moreover, in the said embodiment, you may comprise so that the user who becomes a driver | operator may be set (user setting means). For example, a user who becomes a driver can be selected from registered users by a predetermined operation on the operation input unit 4. In this case, the main control unit 10 causes the scoring result (evaluation result) stored in the storage unit 30 to be stored in association with the user who is the driver (evaluation result storage unit). Of the stored scoring results, the past evaluation content corresponding to the user set as the driver and the notification information of the content for comparing the latest scoring results evaluated in S8 are output to the driver ( (Comparison notification means). In this case, since the scoring result stored in the storage unit 30 can specify the correspondence with the user, the scoring result output from the external output unit 5 can also specify the correspondence with the user. For example, when the scoring result is displayed on the display 52a in the management device 52, the scoring result for each user can be displayed (evaluation result display means).

  In addition, about various back confirmation operation | movement and the duration of an open eye state, you may determine so that it may differ from the said embodiment. For example, in a right-left turn scene, the continuation of the open eye state during the left side mirror visual operation is 1.5 seconds or longer, the continuation of the open eye state during the right side mirror visual operation is 1.5 seconds or longer, It may be determined in such a manner that the continuation of the eye-opening state at the time is 1.5 seconds or more, and the continuation of the eye-opening state at the time of the right rear visual operation is 1.5 seconds or more. In addition, regarding the visual recognition operation for visually recognizing the side mirror, not only the line of sight but also the angle at which the face faces may be determined.

  In the above-described embodiment, instead of the backward confirmation operation for visually recognizing the rearview mirror 28, as a backward confirmation operation for displaying an image of the front side of the vehicle photographed by the rear-facing camera 24 on the display output unit 2 and visually recognizing the screen. Also good. In addition, for the rear confirmation operation for visually recognizing the reflection image of the mirror and the rear confirmation operation for directly viewing the rear view outside the vehicle through the window glass 33, an image of a camera that captures the same direction is displayed, for example, the display output unit 2 It may be replaced so that it is displayed on the screen and visually recognized.

  Moreover, in the said embodiment, although the driver | operator imaging | photography camera 22 is provided in the driver | operator front, you may provide in another position. However, in this case, the backward confirmation operation for directly visualizing the rear visual field outside the vehicle through the window glass 33 involves the above-described swinging motion, so the driver's eyes are photographed with the camera provided at a position other than the front of the driver. It becomes impossible to detect the direction of the line of sight. In such a case, the camera can be provided at another position where the driver's eyes can be reliably photographed even when the above-described swinging motion is performed. For example, the driver photographing camera 22 may be attached to the room mirror 28, and cameras may be arranged in the left and right directions of the driver's face to photograph the driver's face during the swinging motion.

  Further, the light emitting unit 6 provided corresponding to the rear display units 2, 28, 29 is provided not in the outer peripheral portion of the display surface (screen or mirror surface) of the rear display units 2, 28, 29 but in the display surface. May be. Moreover, the light emission part 6 provided corresponding to the window glass 33 may be provided continuously or intermittently so that the outer periphery of the window glass 33 may be surrounded. This makes it easier to understand the viewing direction. For example, it may be provided outside the four corners of the window glass 33, or may be provided so as to oppose the top and bottom or left and right of the window glass 33. In FIG. 12, it is provided so that the outer peripheral part of the square window glass 33 may be surrounded.

  In the embodiment described above, the transition condition from the display state to the non-display state of the light emitting unit 6 is determined only for viewing in the viewing direction corresponding to the rear confirmation scene. The condition that the eye-opening state continues for a predetermined time in the visual state of the above may be included. As a result, in the rear confirmation scene, when the visual inspection in the corresponding visual direction (rear confirmation operation) and the visual continuation time (open eye state) are in an OK state at the time of scoring / evaluation, light emission is performed. The unit 6 can be switched from the display state to the non-display state, and the driver can be prompted to confirm the correct rear.

1 Vehicle Driving Evaluation System 2 Display Output Unit 3 Audio Output Unit (Scene Arrival Notification Unit)
5 External output unit 6 Light emitting unit (visual direction notification unit, visual direction display unit)
DESCRIPTION OF SYMBOLS 10 Main control part 11 Position detection part 22 Driver imaging camera 23 Status information acquisition part 28 Rearview mirror 29 Side mirror 33

Claims (10)

A scene arrival identifying means for identifying the arrival of a predetermined rear confirmation scene that the driver should confirm backward while the vehicle is traveling;
In the identified rear confirmation scene, confirmation operation detection means for detecting the driver's rear confirmation operation,
Eye opening detecting means for detecting the driver's eye opening state during the backward confirmation operation;
Evaluation means for evaluating the driving behavior of the driver in the identified rear confirmation scene based on the detection result of the rear confirmation operation and the eye open state in the rear confirmation scene;
A vehicle driving evaluation system comprising: For each of the plurality of rear confirmation scenes, an operation content storage unit that stores and associates a rear confirmation operation that the driver should perform for backward confirmation,
The evaluation unit determines whether the backward confirmation operation corresponding to the backward confirmation scene specified by the scene arrival specifying unit is detected by the confirmation operation detection unit, and based on the determination result, The vehicle driving evaluation system according to claim 1, wherein the driving behavior of the driver in a confirmation scene is evaluated.   The said back confirmation operation | movement is provided so that it may be visually recognized from a driver | operator, The display part visual recognition operation | movement which visually recognizes the predetermined rear display part which projects the vehicle outside range behind a driver | operator is included. 2. The vehicle driving evaluation system according to 2.   4. The vehicle according to claim 1, wherein the backward confirmation operation includes one or both of a backward leftward operation that turns to the left by a predetermined angle or more and a backward rightward operation that turns to the right by a predetermined angle or more with respect to the front direction of the driver. The vehicle driving evaluation system described in 1.   When the arrival of the rear confirmation scene is specified by the scene arrival specifying means, a visual direction notification for informing a predetermined visual direction notification unit of a visual direction to be visually checked for backward confirmation in the rear confirmation scene. The vehicle driving evaluation system according to any one of claims 1 to 4, further comprising means.   The visual direction notifying unit is a visual direction display unit in a passenger compartment located in or around the visual direction, and the visual direction notifying unit is when the arrival of the rear confirmation scene is specified by the scene arrival specifying unit. The vehicle driving evaluation system according to claim 5, wherein the viewing direction display unit positioned in the viewing direction in the rear confirmation scene is in a display state.   The vehicle driving evaluation system according to any one of claims 1 to 6, further comprising notification means for notifying and outputting notification information based on an evaluation result by the evaluation means to the driver.   The warning means includes warning notification means for notifying and outputting to the driver notification information of contents to warn when the evaluation result evaluated by the evaluation means is worse than a predetermined result. The vehicle driving evaluation system described in 1. Evaluation result storage means for storing and accumulating evaluation results evaluated by the evaluation means in a predetermined evaluation result storage unit,
The notification means notifies the driver of notification information having a content for comparing a past evaluation result stored and accumulated in the evaluation result storage unit with a latest evaluation result evaluated by the evaluation means. The vehicle driving evaluation system according to claim 7 or 8, further comprising: a comparison notification unit that performs the following. The evaluation result storage means stores an average value of the evaluation results in the past backward confirmation scene in the evaluation result storage unit,
The comparison notification means, when the latest evaluation result evaluated by the evaluation means has deteriorated below a predetermined level with respect to the average value of past evaluation results stored and accumulated in the evaluation result storage unit, The vehicle driving evaluation system according to claim 9, wherein notification information having contents for recognizing a reduction in attention is output to the driver.

Images