JP2010015451A - Driver's state recording apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a driver status recording device capable of enlightening a driver about dangerous driving.
The information recording device 13 detects the driver's facial expression, the vehicle surroundings and the vehicle imaged by the driver state detection device 12 when the driver state detection device 12 detects that the driver feels dangerous from the biopsy. In order to record the in-vehicle environment of the host vehicle detected by the state detection device 11, the facial expression in the situation where the driver feels danger such as “smiling” or “hazy”, or the inside of the host vehicle such as vibration or voice It is possible to record the environment and to educate the driver about dangerous driving.
[Selection] Figure 1

Description

  The present invention relates to a driver state recording apparatus, and more particularly to a driver state recording apparatus that records a state when a driver feels danger.

In order to improve driving safety, there has been proposed a device that records a state when a driver of a car feels danger. For example, Patent Document 1 discloses a system in which a probe car identifies an area that a driver feels dangerous based on a change in the driver's biological information, and transmits information related to the identified dangerous area to the probe information center. Is disclosed. The probe information center collects information on the dangerous area transmitted from the probe car and generates a dangerous area map. When the driver desires driving assistance, the driving assistance device mounted on the vehicle acquires a dangerous area map corresponding to a range necessary for driving assistance from the probe information center. The driving support device detects a dangerous area on the route based on the dangerous area map provided from the probe information center. The driving assistance device performs driving assistance by notifying the driver of the presence of the detected dangerous area.
JP 2008-15561 A

  However, with the above technology, the driver can be notified of passing through the dangerous area, but the driver cannot be enlightened about dangerous driving. In general, current drive recorders record vehicle status and surrounding information, but the recorded information is only used in the event of an accident, and it is not possible to use that information to contribute to the driver's own safe driving. Not done. In order to reduce accidents caused by misrecognition where the driver himself / herself faces a dangerous situation while driving, the driver himself / herself understands that the situation is dangerous. is required. However, with the above-described technology, when the recorded dangerous situation is encountered again, the driver himself cannot instantly recall that the situation is dangerous.

  That is, most of the causes of accidents are said to be driver's recognition mistakes, but the driver's recognition and judgment are largely determined subjectively based on the driver's own experience. However, the driver will not be aware of the danger unless he / she is surprised, so he will never have the opportunity to understand the dangerous situation as dangerous, nor will he have an opportunity to understand objectively safe driving. The possibility of making a mistake is high. In particular, at the time of confronting the dangerous situation, even if the driver was surprised for a moment, the memory of the driver faded over time, and the driver no longer recognized the dangerous situation as dangerous. Easy to make mistakes. Therefore, when the driver approaches a dangerous situation, it is desired that the driver can instantly recall that the situation is dangerous and reduce the recognition error of the driver.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide a driver state recording device capable of enlightening a driver with respect to dangerous driving.

  The present invention relates to an emotion detection means for detecting an emotional state of a driver of the own vehicle from a biopsy, and when the emotion detection means detects that the driver feels dangerous, A driver state recording device including recording means for recording at least one of the in-vehicle environment.

  According to this configuration, the recording unit records at least one of the facial expression of the driver and the in-vehicle environment of the host vehicle when the emotion detecting unit detects that the driver feels dangerous from the biopsy. The driver's own awareness of dangerous driving can be recorded by recording the facial expression in the situation where the driver feels dangerous, such as “hidden” or “hazy”, or the environment inside the vehicle such as vibration and voice. Can be performed.

  In this case, it is preferable that the in-vehicle environment recorded by the recording unit is either sound or vibration in the host vehicle.

  According to this configuration, by recording the voice or vibration in the host vehicle when the driver feels dangerous, the realistic situation when the driver feels dangerous can be recorded. The effect of enlightenment can be improved.

  The recording device further includes a reproducing unit that reproduces either the facial expression or the in-vehicle environment recorded by the recording unit, and the reproducing unit has a recording frequency of either the facial expression or the in-vehicle environment recorded in the recording unit equal to or greater than a threshold value. In some cases, it is preferable to reproduce either the facial expression or the in-vehicle environment.

  According to this configuration, the reproducing unit can reproduce the situation when the user feels danger when the frequency of recording either the facial expression recorded in the recording unit or the in-vehicle environment reaches a threshold value or more. It is possible to learn dangerous situations that the driver himself / herself is not aware of, and to educate the driver about safe driving.

  In this case, the vehicle further includes odor generating means for generating an odor corresponding to the type of danger felt by the driver in the own vehicle, and the odor generating means, when the reproducing means reproduces either the facial expression or the in-vehicle environment, When an odor corresponding to the type of danger related to either facial expression or in-vehicle environment is generated in the vehicle, and the emotion detection means detects that the driver feels dangerous while the driver is driving the vehicle In addition, it is preferable to generate an odor in the host vehicle according to the type of danger felt by the driver.

  According to this configuration, the odor generating means generates an odor in the own vehicle according to the type of danger relating to either the facial expression or the in-vehicle environment when the reproducing means reproduces either the expression or the in-vehicle environment. While the driver is driving the vehicle, when the emotion detection means detects that the driver feels dangerous, in order to generate an odor in the vehicle according to the type of danger felt by the driver, It is possible to educate the driver about safe driving by learning the danger that the driver himself / herself is not aware of from the odor and generating an odor corresponding to the type of danger during actual driving.

  Further, when the host vehicle encounters a dangerous event, the vehicle further comprises a risk detection means for detecting an objective risk that is an objective severity of the dangerous event, and the emotion detection means drives the dangerous event. The subjective risk perception level, which is the degree to which the person has perceived the risk subjectively, is detected, the recording means is the objective risk level detected by the risk level detection means, the subjective risk level detected by the emotion detection means, Recorded in association with either the facial expression when the host vehicle encounters a dangerous event or the in-vehicle environment, and the reproduction means has a large difference between the objective risk recorded in association with the recording means and the subjective risk As described above, it is preferable to preferentially reproduce either the facial expression or the in-vehicle environment recorded on the recording means in association with the objective risk level and the subjective risk level.

  According to this configuration, the reproducing means records the recording means in association with the objective risk level and the subjective risk level as the difference between the objective risk level recorded in association with the recording means and the subjective risk level increases. In order to preferentially regenerate either the displayed facial expression or the in-vehicle environment, the driver can recognize his or her dangerous driving by preferentially reproducing dangerous situations that the driver is not aware of, and driving safely It becomes possible to promote the improvement of consciousness.

  According to the driver status recording apparatus of the present invention, it is possible to enlighten the driver about dangerous driving.

  Embodiments of the present invention will be described below with reference to the accompanying drawings.

  FIG. 1 is a block diagram showing a driver state recording apparatus according to the first embodiment. The driver status recording device of the present embodiment is mounted on a vehicle and configured to educate the driver about dangerous driving. As shown in FIG. 1, the driver state recording device 10 a of this embodiment includes a vehicle surrounding / vehicle state detection device 11, a driver state detection device 12, an information recording device 13, a dangerous event type determination unit 14, and a driver risk recognition degree. A determination unit 15, a recommended reproduction point determination / recording unit 16, a recommended reproduction notification unit 17, and a recorded information reproduction device 18 are provided.

  The vehicle surrounding / vehicle state detection device 11 is for detecting the surroundings of the own vehicle and the state in the own vehicle. More specifically, the vehicle surrounding / vehicle state detection device 11 is a millimeter wave radar sensor, a stereo camera sensor, and a sonar sensor that detect other vehicles, obstacles, signal types, and other vehicle surrounding conditions. Detecting vehicle speed sensor, yaw rate sensor, steering angle sensor, navigation system for detecting the shape of the road on which the vehicle travels, sound microphone, vibration sensor, and video camera for detecting conditions such as sound and vibration inside the vehicle Etc. In addition, the vehicle surrounding / vehicle state detection device 11 issues an alarm to the driver of the host vehicle with an image, sound, or the like according to the detected surroundings of the host vehicle and the state in the host vehicle. Further, the vehicle surrounding / vehicle state detection device 11 drives each actuator for automatically operating steering, braking, accelerator, etc. according to the detected surroundings of the own vehicle and the state in the own vehicle, thereby driving the driver. Support the operation.

  The driver state detection device 12 is for detecting the emotional state of the driver of the host vehicle from a biopsy, and in particular, detecting that the driver feels dangerous. Specifically, the driver state detection device 12 is a sensor or the like that detects that the driver feels dangerous from the driver's pulse, blood pressure, brain wave, and eye movement. The driver state detection device 12 is a device that detects that the driver feels dangerous by capturing the facial expression of the driver with a video camera and recognizing the captured image as a pattern. Furthermore, the driver state detection device 12 detects the driver's emotion state from the driver's operation record. The driver state detection device 12 functions as an emotion detection unit described in the claims.

  The information recording device 13 sequentially records the surroundings of the host vehicle and the situation in the host vehicle detected by the vehicle surroundings / vehicle state detection device 11 as driving records. The information recording device 13 also detects the date and time when the driver state detection device 12 detected that the driver felt dangerous, the driver's facial expression captured at that time by the driver state detection device 12, and the vehicle surrounding / vehicle state detection. The surroundings of the host vehicle at that time detected by the device 11 and the state of voice, vibration, etc. in the host vehicle are stored in association with each other. Note that the information recording device 13 indicates the type of the dangerous event in the situation determined by the dangerous event type determination unit 14 and the degree of recognition of the driver's risk in the situation determined by the driver risk recognition degree determination unit 15. Alternatively, it may be stored in association with the driver's facial expression or the state in the host vehicle. The information recording device 13 functions as recording means described in the claims.

  The dangerous event type determination unit 14 is configured to detect the sound, vibration, speed, steering angle, yaw rate, obstacle, and the like in the vehicle surroundings and in the vehicle detected by the vehicle surroundings / vehicle state detecting device 11 and the driver state detecting device 12. This is for determining the type of dangerous event that the driver felt dangerous from the state of the driver when the driver sensed danger. Further, the dangerous event type determination unit 14 determines whether the host vehicle is in the state of sound, vibration, speed, steering angle, yaw rate, obstacles, etc. in the host vehicle surroundings and in the host vehicle detected by the vehicle surrounding / vehicle state detection device 11. When a dangerous event is encountered, the objective severity (objective risk level) of the dangerous event is detected. The dangerous event type determination unit 14 functions as a risk level detection unit described in the claims.

  Specifically, the determination of the type of the dangerous event by the dangerous event type determination unit 14 is, for example, when it is detected that the steering angle or yaw rate at a speed equal to or higher than a predetermined threshold is larger than the predetermined threshold. The type determination unit 14 determines that the dangerous event is a “steep handle”. When an acceleration equal to or greater than a predetermined threshold is detected, the dangerous event type determination unit 14 determines that the dangerous event is “rapid acceleration”. If a deceleration greater than a predetermined threshold is detected, the dangerous event type determination unit 14 determines that the dangerous event is “rapid deceleration”. Furthermore, the determination of the type of dangerous event is made according to the obstacles around the host vehicle detected by the vehicle surrounding / vehicle state detection device 11, the signal type, the road shape, etc., the voice in the host vehicle, the vibration, etc. It is subdivided into “Danger crossing at intersection”, “Danger start”, “Dangerous parking”, etc. as appropriate.

  The driver danger recognition degree determination unit 15 subjectively recognizes the danger when the driver feels danger from the state when the driver feels danger detected by the driver state detection device 12. This is for determining the degree of danger recognition (subjective risk recognition degree). Specifically, the determination of the driver's risk recognition level by the driver risk level determination unit 15 is, for example, that the fluctuation of the driver's pulse, blood pressure, brain wave, and eye movement is equal to or more than a threshold set in a plurality of stages. Whether or not the driver is aware of the risk can be determined quantitatively.

  The recommended playback point determination / recording unit 16 accumulates the recommended playback points that are frequencies corresponding to the risk recognition level determined by the driver risk recognition level determination unit 15 for each type of risk event determined by the risk event type determination unit 14. It is for recording. The recommended regeneration point is, for example, the greater the difference between the severity of the danger according to the type of the dangerous event determined by the dangerous event type determination unit 14 and the risk recognition level determined by the driver risk recognition level determination unit 15, The recommended regeneration point for the type of hazardous event is enlarged and recorded.

  When the recommended regeneration point for each type of dangerous event recorded in the recommended regeneration point determination / recording unit 16 is equal to or greater than a predetermined threshold, for example, the recommended regeneration notification unit 17 Is advised to rehabilitate the dangerous situation. The notification of the recommendation of the reproduction is performed by video on a liquid crystal display or sound by a speaker.

  The recorded information reproducing device 18 extracts information on the dangerous situation recommended for reproduction by the reproduction recommendation notifying unit 17 from the information recording device 13, for example, when the engine of the own vehicle is started, the driver is driven in that situation. This is for displaying the state of the person's facial expression and the vibration, voice, etc. in the vehicle. Specifically, the recorded information reproducing device 18 can be composed of a liquid crystal display that displays the driver's facial expression, a speaker that reproduces sound in the situation, a vibration generator that reproduces vibration in the situation, and the like. The recorded information reproducing device 18 functions as reproducing means described in the claims.

  Hereinafter, the operation of the driver state recording device 10a of the present embodiment will be described. FIG. 2 is a flowchart showing the operation of the driver state recording device 10a according to the first embodiment. First, during traveling of the host vehicle, the vehicle surrounding / vehicle state detection device 11 detects the surroundings of the host vehicle and the state inside the host vehicle, and detects whether the host vehicle is in a dangerous situation from the detection result (S101). ). The situation detected by the vehicle surrounding / vehicle state detection device 11 is sequentially recorded in the information recording device 13. The vehicle surroundings / vehicle state detection device 11 presents an alarm to the driver according to the detected situation of the host vehicle, and assists the driving operation of the driver (S102).

  On the other hand, the driver state detection device 12 captures the facial expression of the driver of the host vehicle and records it in the information recording device 13, and detects the emotional state of the driver of the host vehicle from a biopsy, and the driver along with the date and time. The emotional state of whether or not the person feels dangerous is recorded in the information recording device. The driver danger recognition degree determination unit 15 is the degree to which the driver recognizes the danger when the driver feels danger from the state when the driver feels danger detected by the driver state detection device 12. The risk recognition degree is determined (S103).

  The dangerous event type determination unit 14 is configured to detect the sound, vibration, speed, steering angle, yaw rate, obstacle, and the like in the vehicle surroundings and in the vehicle detected by the vehicle surroundings / vehicle state detecting device 11 and the driver state detecting device 12. From the state of the driver when the driver sensed danger, the type of dangerous event that the driver felt dangerous was determined (S104).

  The recommended playback point determination / recording unit 16 accumulates the recommended playback points that are frequencies corresponding to the risk recognition level determined by the driver risk recognition level determination unit 15 for each type of risk event determined by the risk event type determination unit 14. And recording (S105).

  When the recommended regeneration point for each type of dangerous event recorded in the recommended regeneration point determination / recording unit 16 is equal to or greater than a predetermined threshold (S106) and when the engine of the host vehicle is being started (S107), driving is performed. It is recommended that the person be informed that the reproduction of the dangerous situation is recommended (S108).

  The recorded information reproducing device 18 extracts information on the dangerous situation recommended for reproduction by the reproduction recommendation notifying unit 17 from the information recording device 13, and gives the driver an expression of the driver in the situation and in the own vehicle. The state of vibration, voice, etc. is displayed (S109).

  According to the present embodiment, the information recording device 13 detects the driver's facial expression and the vehicle imaged by the driver state detection device 12 when the driver state detection device 12 detects that the driver feels dangerous from the biopsy. In order to record the in-vehicle environment of the host vehicle detected by the surrounding / vehicle state detection device 11, the facial expression in the situation where the driver feels danger such as “smiling” or “hazy”, or the self-expression such as vibration or voice The in-vehicle environment of the vehicle can be recorded, and the driver can be enlightened about dangerous driving.

  Further, in the present embodiment, by recording the voice or vibration in the own vehicle when the driver feels danger, the realistic situation when the driver feels danger can be recorded, and driving Can improve the enlightenment effect.

  Furthermore, according to the present embodiment, the recorded information reproducing apparatus 18 felt danger when the driver's facial expression recorded in the information recording apparatus 13 and the recorded frequency of the in-vehicle environment reached a threshold value or more. The situation of time can be reproduced, the dangerous situation that the driver himself / herself is not aware of can be learned, and the driver can be enlightened about safe driving. In other words, by reproducing the dangerous scene that the driver encountered and allowing the driver to confirm, the driver can know the dangerous scene in his / her driving experience, and the driver can re-create his / her dangerous experience. By recognizing, the experience can be sublimated into driving experience that contributes to safe driving. As a result, the driver can predict and recognize the danger during the next driving.

  In particular, according to the present embodiment, by preferentially reproducing dangerous situations that are not recognized by the driver, the driver can be made aware of his / her dangerous driving and promote an improvement in awareness of safe driving. It becomes possible.

  Hereinafter, a second embodiment of the present invention will be described. FIG. 3 is a block diagram showing a driver state recording apparatus according to the second embodiment. As shown in FIG. 3, the driver state recording device 10b of the present embodiment is different from the first embodiment in that it includes an odor selection determination unit 19 and an odor providing device 20.

  The odor selection determining unit 19 is for selecting an odor corresponding to each type of dangerous event determined by the dangerous event type determining unit 14 in a dangerous situation that the recorded information reproducing device 18 reproduces. The odor providing device 20 is for providing the driver with the odor selected by the odor selection determining unit 19 when the recorded information reproducing device 18 reproduces information dangerous to the driver. It is assumed that the odor provided to the driver can give sufficient stimulation to call attention to the driver and has little influence on the driving of the driver. The odor providing device 20 functions as odor generating means described in the claims.

  Hereinafter, the operation of the driver state recording device 10b of the present embodiment will be described. FIG. 4 is a flowchart showing the operation of the driver state recording device 10b according to the second embodiment. In the present embodiment, S101 to S108 in FIG. 2 are performed in the same manner as in the first embodiment. As shown in FIG. 4, the recorded information reproduction device 18 extracts information on the dangerous situation recommended for reproduction by the reproduction recommendation notification unit 17 from the information recording device 13, and notifies the driver of the situation in the situation. And the state of vibration, voice, etc. in the host vehicle are displayed (S109). At this time, the odor providing device 20 provides the driver with the odor selected by the odor selection determining unit 19 (S110). The odor providing device 20 records a dangerous scene reproduction confirmation flag indicating that the dangerous event has been reproduced to the driver (S112).

  While the host vehicle is traveling, the vehicle surrounding / vehicle state detection device 11 detects the surroundings of the host vehicle and the state in the host vehicle. When the vehicle surroundings / vehicle state detection device 11 detects a dangerous event corresponding to the dangerous scene regeneration confirmation flag, the odor providing apparatus 20 determines that the same kind of danger as that associated with the dangerous scene regeneration confirmation flag is encountered. (S112).

  At this time, the vehicle surroundings / vehicle state detection device 11 presents an alarm to the driver according to the detected situation of the host vehicle and assists the driver's driving operation (S113). At this time, the odor providing device 20 provides the driver with an odor corresponding to the dangerous event (S114).

  According to the present embodiment, the odor providing device 20 generates an odor corresponding to the type of danger in the host vehicle when the recorded information reproducing device 18 reproduces either the driver's facial expression or the in-vehicle environment. When the driver state detection device 12 detects that the driver feels danger while driving the driver's own vehicle, an odor corresponding to the type of danger felt by the driver is generated in the own vehicle. Therefore, it is possible to educate the driver about safe driving by learning the danger that the driver himself / herself is not aware of from the odor and generating an odor corresponding to the type of danger during actual driving.

  According to this embodiment, olfaction information based on olfaction is utilized so as not to impede the distribution of attention to the driver's surroundings to the driver's surroundings. However, even if the olfactory information is simply provided to the driver, the driver cannot recall it in connection with each dangerous event, and thus may not be used effectively as information for avoiding the danger.

  Therefore, in the present embodiment, by generating an odor corresponding to the type of danger during actual driving, the olfactory information is linked to the dangerous event so that the olfactory information can be used for the recognition and judgment of the danger. In addition, when recreating a dangerous scene, the driver gives the driver information that actively uses the five senses such as the driver's facial expressions, voice, vibration, etc. Can be known from a lot of information, and by re-recognizing his own dangerous experience, the driver can sublimate the experience into a driving experience that contributes to safe driving.

  As a result, when the same type of danger approaches again, the driver can notice the danger through the sense of smell, and can make an accurate judgment and countermeasure. In addition, it is possible to instantly recall the experience of a dangerous scene without losing the vision and hearing required for driving, and to be aware of the danger.

  It should be noted that the present invention is not limited to the above-described embodiment, and it is needless to say that various modifications can be made without departing from the gist of the present invention.

It is a block diagram which shows the driver | operator state recording device which concerns on 1st Embodiment. It is a flowchart which shows operation | movement of the driver | operator state recording device which concerns on 1st Embodiment. It is a block diagram which shows the driver | operator state recording device which concerns on 2nd Embodiment. It is a flowchart which shows operation | movement of the driver | operator state recording device which concerns on 2nd Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10a, 10b ... Driver state recording device, 11 ... Vehicle surroundings / vehicle state detection device, 12 ... Driver state detection device, 13 ... Information recording device, 14 ... Danger event type determination part, 15 ... Driver risk recognition degree determination part, 16 ... Reproduction recommendation point determination / recording unit, 17 ... Reproduction recommendation notification unit, 18 ... Recorded information reproduction device, 19 ... Odor selection determination unit, 20 ... Odor providing device.

Claims (5)

Emotion detection means for detecting the state of emotion of the driver of the own vehicle from a biopsy,
A recording means for recording at least one of the expression of the driver and the in-vehicle environment of the host vehicle when the emotion detecting means detects that the driver feels dangerous;
A driver status recording device.   The driver state recording apparatus according to claim 1, wherein the in-vehicle environment recorded by the recording unit includes any of voice and vibration in the host vehicle. Replaying means for replaying either the facial expression or the in-vehicle environment recorded by the recording means;
The reproduction means reproduces either the facial expression or the in-vehicle environment when the recorded frequency of either the facial expression or the in-vehicle environment recorded in the recording means is a threshold value or more. The driver state recording device according to 1 or 2. Further comprising odor generating means for generating an odor in the host vehicle according to the type of danger felt by the driver;
The odor generating means is
When the reproducing means reproduces either the facial expression or the in-vehicle environment, an odor corresponding to the type of danger relating to either the facial expression or the in-vehicle environment is generated in the host vehicle,
While the driver is driving the host vehicle, when the emotion detecting unit detects that the driver feels dangerous, the driver detects an odor corresponding to the type of danger felt by the driver. The driver state recording device according to claim 3, wherein the driver state recording device is generated in the vehicle. A risk detection means for detecting an objective risk that is an objective severity of the dangerous event when the host vehicle encounters a dangerous event;
The emotion detection means detects a subjective risk recognition degree that is a degree that the driver has subjectively recognized the risk for the dangerous event,
The recording means includes the objective risk detected by the risk detection means, the subjective risk detected by the emotion detection means, the facial expression when the host vehicle encounters the dangerous event, and Record in association with any of the in-vehicle environments
The reproducing means associates the recording means with the objective risk and the subjective risk as the difference between the objective risk and the subjective risk recorded in association with the recording means increases. The driver state recording device according to claim 3 or 4, wherein one of the recorded facial expression and the in-vehicle environment is preferentially reproduced.

Images