JP3477057B2 - Driver situation dependent communication device and method - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a driver situation-dependent communication device capable of receiving and transmitting necessary information in a timely manner and preventing drowsiness while ensuring safety even in a running vehicle, and a method of implementing the same. It is related to.

[0002]

2. Description of the Related Art With the development of mobile communication technology, many users can use mobile communication such as car phones, mobile phones, PHS, etc. in the car, and also use information providing media such as car navigation in the car. The social situation is such that it can be done.

Under these circumstances, when there is an incoming call from a car phone, a mobile phone, a PHS, etc. while driving a car, or when it is necessary to operate a car navigation system etc. while driving a car, An increase in accidents due to distraction caused by a call or operation while driving has become a problem, and a system that ensures driving safety even in such a case has been conventionally considered.

A conventional system for ensuring the safety of driving will be described below with reference to FIG. conventionally,
Before the car is driven, a special operation is performed on the mobile phone 22 so that when there is an incoming call during driving, the incoming call is received at the communication center 23 instead of the driver. A service is conceivable in which a message is recorded in the communication server 24 in the communication center 23 at the same time that the message "Is this?" Is transmitted.

Further, in a system having a display such as the car navigation 25, since the driver, which is a display, has a medium that attracts a great deal of attention, the car navigation system must be in the state where the side brake 26 in the vehicle is pulled. A system in which the 25 cannot be set in detail is also considered.

[0006] In addition to this, since drowsiness during driving of a driver has been a major cause of accidents from the past, a service system that detects the drowsiness of the driver by the shake of the steering wheel and issues a warning to the driver is also conceivable. There is.

[0007]

However, the above answering machine service when the mobile phone 22 is operated is as follows.
Since the communication is uniformly cut off regardless of the situation of the driver, the operability of the mobile phone 22 has been remarkably lost. In addition, it is necessary to make settings before driving, and it is also necessary to cancel the answering service after driving, which makes switching the answering service very troublesome.

Further, in the system using the car navigation system 25, the condition for enabling detailed operation is that the side brake 26 is uniformly applied. I had to pull the brakes 26 to stop the car completely.

In addition, in the system for detecting the driver's drowsiness due to the shake of the steering wheel, the judgment is made based on the indirect information from the driver's hand, so that the driver's driving operation is unexpectedly performed when the driver falls asleep. Even if the driver performs a serious driving operation, he / she may be judged to be dozing and a warning may be given, and the warning when the driver is in a normal state may cause an accident.

Here, the main objects to be solved by the present invention are as follows.

A first object of the present invention is to provide a driver situation-dependent communication device and a method thereof capable of timely and stepwise communication of a mobile communication device automatically and automatically according to the driver's situation during driving. It is what

A second object of the present invention is to provide a driver situation-dependent communication device and method capable of automatically setting automatic operation of input / output devices without uniformly stopping when driving a vehicle. .

A third object of the present invention is to provide a driver situation-dependent communication device and method for correctly judging the driver's tension when driving to reduce judgment errors.

Other objects of the present invention include the specification, drawings,
Especially, it will be apparent from the description of each claim.

[0015]

In order to solve the above problems, the present invention detects and measures the degree of tension of a driver in a vehicle based on the steering wheel operation and the gripping state, and monitors it. In this case, the communication mode is selectively controlled according to the degree of tension of the driver, and the use of the input / output device requiring the driver's operation is restricted according to the degree of tension.

More specifically, in order to solve the problem, the present invention achieves the above-mentioned object by adopting a novel characteristic constitution means or method ranging from a superordinate concept to a subordinate concept enumerated below. Done.

That is, the first feature of the device of the present invention is that the driver monitor means for sequentially detecting the driver's situation, the driver status measuring means for measuring the judgment information from the detection of the situation, and the evaluation of the judgment information. An information distribution control means for selectively controlling the distribution of the input / output means control information, and an input / output means for controlling input / output of internal / external information by the input / output means control information are provided. Is for adopting the configuration of a driver situation-dependent communication device in which the operation restriction or the operation stop of the input / output means which requires the operation of the driver in the vehicle is automatically controllable.

A second feature of the device of the present invention is that the driver monitor means in the first feature of the device of the present invention sequentially detects the handle grip position and the grip state of the driver during traveling as internal information. And a driver image monitor means for photographing and detecting the image of the driver while driving as internal information.

A third feature of the device of the present invention is that the input / output means in the first or second feature of the device of the present invention inputs / outputs internal / external information for bidirectional communication through communication means for receiving / transmitting with an external system. This is due to the adoption of the configuration of a driver situation-dependent communication device that can be freely operated.

A fourth feature of the device of the present invention is that the communication unit and the input / output unit in the third feature of the device of the present invention temporarily store and convert external information received through the communication unit, and A driver situation-dependent communication device is constituted by interposing information storage / conversion means whose transmission to the input / output means is controlled by the input / output means control information of the distribution control means.

A fifth feature of the device of the present invention is that the information delivery control means in the first, second, third or fourth feature of the device of the present invention is turned on according to the judgment information. This is to adopt a configuration of a driver situation-dependent communication device which is connected to a distribution level setting means for setting an evaluation level for selecting an output means distribution destination.

A sixth feature of the device of the present invention is that the information distribution control means in the fourth or fifth feature of the device of the present invention is
In response to the judgment information, the input / output means control information of the information distribution control means sets the evaluation level for stopping the communication of the call information from the information storage / conversion means to the input / output means by the control information. It is in the adoption of the structure of the driver situation-dependent communication device that is connected to the driver.

The seventh feature of the device of the present invention is that the driver handle monitor means according to the second, third, fourth, fifth or sixth feature of the device of the present invention is based on the interaction between the driver's hand and handle. This is the adoption of a driver situation-dependent communication device that directly measures the driver's tension.

The eighth feature of the device of the present invention is that both the communication means in the third, fourth, fifth, sixth or seventh feature of the device of the present invention are provided in a mobile phone, PHS, car phone or the like. This is in adopting the configuration of a driver situation-dependent communication device that is a communication device for communication.

A ninth feature of the device of the present invention is that the input / output means in the third, fourth, fifth, sixth, seventh or eighth feature of the device of the present invention is a sender from the external system. In this case, the driver situation-dependent communication device is configured to be output as a sound or a sound and an image.

The tenth feature of the device of the present invention is that the driver image monitor means of the second, fourth, fifth, sixth, seventh, eighth or ninth feature of the device of the present invention is a half mirror. This is because the driver situation-dependent communication device is installed behind the rearview mirror.

The eleventh feature of the device of the present invention is that the driver image monitor means according to the second, fourth, fifth, sixth, seventh, eighth, ninth or tenth feature of the device of the present invention is: C
This is in adopting the configuration of a driver situation-dependent communication device which is a CD camera.

The twelfth feature of the device of the present invention is that the first, second, third, fourth, fifth, sixth, seventh, eighth, ninth, tenth or eleventh of the above-mentioned device of the present invention. The input / output means of the features of (1) are a one-way output means provided in a speaker for presenting voice information, a two-way input / output means provided in a mobile communication device, a portable personal computer, etc., and a car navigation system for presenting voice / image information. , A one-way input / output means provided in a car television, a car radio, a car stereo, etc., and a driver situation-dependent communication device which is one-way input means provided in a microphone, etc.

The first feature of the method of the present invention is to detect the driver's situation in a running vehicle and measure the judgment information of the situation in order to secure a safe driving environment for the driver of the traveling vehicle. In selectively performing distribution control of the control information of the input / output unit according to the evaluation of the judgment information, and performing the input / output control of the distribution destination input / output unit in accordance with the status of the driver from the control information of the input / output unit, The driver's situation is taken as the driver's tension behavior when the vehicle is driving, and the evaluation of the judgment information is made dependent on whether the tension is larger or smaller than a predetermined value. By performing input / output control according to the degree of tension of the driver to the destination input / output means for inputting / outputting information to / from the external system in communication with the driver, If tone is less than a predetermined value, in the configuration adopting the driver context communication method comprising sending an announcement information indicating the driver callers from the external system which is shut off communication is in operation.

The second feature of the method of the present invention is to detect the driver's situation in the running vehicle and measure the judgment information of the situation in order to secure a safe driving environment for the driver of the traveling vehicle. When selectively controlling the distribution of the control information of the input / output means according to the evaluation of the judgment information and controlling the input / output of the distribution destination input / output means from the control information of the input / output means according to the situation of the driver. , The driver's situation is the driver's tension behavior when driving the vehicle, and the evaluation of the judgment information is made dependent on whether the tension is larger or smaller than a predetermined value. A driver situation-dependent communication method that automatically controls the input / output operation restriction or operation stop of the input / output means that requires the operation of the driver in the vehicle according to the degree of In the adopted adult.

A third feature of the method of the present invention is that the input / output control in the second feature of the method of the present invention is performed by the passenger including the driver in the vehicle and the information of the external system in communication with the external system. A driver situation-dependent communication method in which input / output means for input / output is controlled according to the degree of tension of the driver is adopted.

A fourth feature of the method of the present invention is that the external system, in which input / output control according to the third feature of the method of the present invention is interrupted when the driver's tension is smaller than a predetermined value. It is based on the adoption of a driver situation-dependent communication method that sends announcement information that the driver is driving to the caller.

A fifth feature of the method of the present invention is driver situation-dependent communication in which the communication in the first, third or fourth feature of the above-mentioned method of the present invention is two-way communication by a mobile phone, PHS, car phone or the like. It is in adopting the structure of the method.

A sixth feature of the method of the present invention is that when the input / output control in the first, third, fourth or fifth feature of the method of the present invention is such that the tension of the driver is smaller than a predetermined value. In the configuration adoption of the driver situation-dependent communication method, the external information transmission from the external system to the driver is blocked.

The seventh feature of the method of the present invention is that the driver's tension is within a predetermined range when the input / output control in the first, third, fourth, fifth or sixth feature of the method of the present invention is performed. In this case, the configuration of the driver situation-dependent communication method in which the message of the caller from the external system is notified by sound, or sound and image is adopted.

The eighth feature of the method of the present invention is that the input / output control in the first, third, fourth, fifth, sixth or seventh feature of the method of the present invention is such that the degree of tension of the driver is predetermined. When the value is larger than the value of, the driver adopts the configuration of the driver situation-dependent communication method in which bidirectional communication is performed between the caller from the external system and the driver.

The ninth characteristic of the method of the present invention is that the detection in the first, second, third, fourth, fifth, sixth, seventh or eighth characteristic of the method of the present invention is performed by the driver. It is the adoption of a driver situation-dependent communication method that detects the driver's tension through the interaction between the hand and the steering wheel.

The tenth characteristic of the method of the present invention is that the measurement in the first, second, third, fourth, fifth, sixth, seventh, eighth or ninth characteristic of the method of the present invention is: This is in the adoption of a driver situation-dependent communication method that measures tension by measuring current and voltage between the driver's arms.

The eleventh feature of the method of the present invention resides in the first, second, third, fourth, fifth, sixth, seventh, eighth, ninth or tenth feature of the above-described method of the present invention. Each of the input / output means is a one-way output means provided in a speaker or the like for presenting voice information, a two-way input / output means provided in a mobile communication device, a portable personal computer, etc., a car navigation system for presenting voice / image information, an automobile. There is a configuration adoption of a driver situation-dependent communication method, which is a one-way input / output means provided in a television, a car radio, a car stereo, etc., and a one-way input means provided in a microphone, etc.

[0040]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will now be described in order with reference to the accompanying drawings, with respect to first and second device examples thereof and first and second method examples corresponding thereto, respectively. .

(Device Example 1) FIG. 1 is a block diagram of the present device example. As shown in FIG. 1, the configuration of the present device example is such that the communication unit 1 performs communication between the system of the present device example and an external system through a communication device, and the input / output unit 2 is an appropriate device for communicating internal and external communication information. For safe driving, the driver of the vehicle is notified of the status information of the physical and mental driving behavior of the driver through the input / output device according to the media, if necessary.

The driver monitor unit 3 monitors the behavior state of the driver and outputs the driver's state information. The driver handle monitor unit 3a in the driver monitor unit 3 uses the driver-handle interaction to drive the driver. Directly monitor the status monitor information of.

The driver status measuring unit 4 measures and stores the driver's tension from the driver status information monitored by the driver monitoring unit 3, and the information storage / conversion unit 5 stores and converts the internal / external communication information. However, the information distribution control unit 6 has a server function of requesting the driver's tension information as necessary, and the information distribution control unit 6 selectively distributes device control information or input / output device corresponding control information according to the driver's tension. To do.

The distribution level setting unit 7 presets the distribution level according to the degree of the driver's tension information,
When the driver's degree of tension is smaller than a predetermined value, the tension call stop setting unit 8 sets a reference level for automatically controlling the call stop or the operation stop of the input device.

Here, for example, a mobile phone having a communication function as the bidirectional communication means of the communication section 1 and an input / output function as the bidirectional input / output means of the input / output section 2 is used.
PHS, mobile phones and other mobile communication equipment,
In some cases, it also has a storage / conversion function as the storage / conversion means of the information storage / conversion unit 5. Further, a personal computer or the like can be cited as one having the input / output function and the storage / conversion function as the bidirectional input / output means. A car navigation system, a car radio, a car stereo, etc., which has the input / output function as the one-way input / output unit, and a speaker, a display, etc., which has the output function as the one-way output unit, A microphone or the like can be given as one having an input function as one-way input means.

(Method Example 1) This method example corresponds to the above device example 1, and each device in this device example will be described with reference to FIG. First,
A case will be described in which a mobile communication device or the like is used to notify a driver of a vehicle or a caller from an external system of the driver's situation by performing control according to the driver's situation.

When a call is transmitted from an external system in a running vehicle, the communication unit 1 communicating with the external system receives the received information, and the received information is temporarily stored in the information storage / conversion unit 5. Then, the driver handle monitor unit 3a in the driver monitor unit 3 directly monitors the driver's state by the interaction between the handle and the driver's hand.

Next, from the monitored driver state, the driver state measuring unit 4 measures and stores the driver's tension, and sends it to the information distribution control unit 6, which in turn measures the tension measurement information. Is sent to the delivery level setting unit 7 and the stop call etc. setting unit 8 during tension.

The distribution level setting unit 7 provides the level of internal information to notify passengers including a driver from a predetermined level of tension and the notification device control information as input / output means control information matching the level. Returning to the delivery control unit 6, the tension call stop setting unit 8 returns to the information delivery control unit 6 communication stop information for stopping the call / communication when the tension evaluation is smaller than a predetermined set value. .

When the information distribution control unit 6 receives the notification device control information, the information distribution control unit 6 distributes the notification device control information to the information storage / conversion unit 5, and the information storage / conversion unit 5 is required. In accordance with the above, the tension level measurement information accumulated in the driver state measuring unit 4 is taken out and converted, and the received information in the information accumulation / conversion unit 5 or the information obtained by converting the received information together with the input / output unit 2 The notification device control information is distributed to the driver, the passengers including the driver are notified of the degree of tension through a notification device serving as an input / output unit in a timely manner, and the communication unit is selected so as to selectively adopt a communication output form corresponding to the level of the degree of tension. The communication is controlled through 1.

Here, the communication output form suitable for the level of the tension is not limited to real-time two-way communication with the caller of the external system, but the driver's information about the caller may be sound or sound and image. In addition to such notification, the output form is changed according to the level of the driver's tension. In addition, information transmitted from the driver can be stored in the information storage / conversion unit 5 as needed.

When the information delivery control unit 6 receives the communication stop information, the communication stop information is delivered to the information storage / conversion unit 5, and the information storage / conversion unit 5 is delivered.
Distributes the communication stop information to the input / output unit 2 together with the tension degree measurement information obtained or extracted / converted from the tension degree measurement information accumulated in the driver state measuring unit 4 as necessary, Through the communication unit 1, the external caller is notified of the communication failure and the communication is disconnected.

Since the information storage / conversion unit 5 of this device example has a server function for storing / converting received information, the load on the external system is reduced, and during communication, the vehicle enters a place where radio waves do not reach. Even in the case of contact, it is possible to output the caller's information accumulated up to that point according to the driver's situation.

Next, a description will be given of a case where automatic operation control, which is a use restriction of the operation input, is performed for the input / output device in the input / output unit 2 which requires the driver's operation such as car navigation in the vehicle according to the situation of the driver. To do. Driver status information is monitored by the driver handle monitor unit 3a, tension is measured and accumulated by the driver state measuring unit 4, and tension measurement information is distributed from the information distribution control unit 6 to a distribution level setting unit 7 and a call during tension. It is delivered to the equal stop setting unit 8.

The distribution level setting unit 7 returns the automatic control information of the input / output device according to the tension setting level to the information distribution control unit 6, and when the tension evaluation is smaller than a predetermined value, the tension is concerned. Operation stop information for stopping the operation input of the input / output device is returned to the information distribution control unit 6 by the middle call stop setting unit 8.

When the information delivery control unit 6 receives the automatic control information, it delivers the automatic control information to the information storage / conversion unit 5, and the information storage / conversion unit 5 sends the information as necessary. The automatic control information is distributed to the input / output device in the input / output unit 2 together with the tension measurement information obtained by extracting or extracting / converting the tension measurement information accumulated in the driver state measuring unit 4, and the tension is measured. The input / output device is controlled so as to select and adopt an operation control form suitable for the degree level.

Here, the operation control form suitable for the level of the degree of tension means that the stepwise automatic operation control is selected according to each input / output device, and is changed according to the level of the degree of tension of the driver. It is something to do.

When the information delivery control unit 6 receives the operation stop information, the operation stop information is delivered to the information storage / conversion unit 5, and the information storage / conversion unit 5 is delivered.
Is the operation stop information in the input / output device in the input / output unit 2 together with the tension measurement information obtained or extracted / converted from the tension measurement information accumulated in the driver state measurement unit 4 as necessary. To control the operation stop of the input / output device.

(Device Example 2) This device example is a device which judges the driver's dozing state in an image and gives a warning in a timely manner step by step. Similar to the device example 1 having the same basic parts, refer to FIG. And explain.

In FIG. 1, the driver image monitor unit 3b in the driver monitor unit 3 captures the driver's face to monitor the driver face information, and the driver state measuring unit 4 uses the driver face information to determine whether the driver is in the dozing state. Measure and judge judgment information.

The information distribution control unit 6 distributes the drowsiness determination information to the warning device, and the warning unit 9 outputs the warning information through the output device which gives a stepwise warning when the driver is in a drowsiness state. Is output.

(Method Example 2) This method example corresponds to the apparatus example 2 described above, and each apparatus in the apparatus example 2 will be described with reference to FIG.

In the running vehicle, the driver image monitor section 3b of the driver monitor section 3 obtains the driver's face information which is captured by monitoring the driver's face in an image, and the driver state measuring section 4 obtains the driver's face information. The driver dozing information is measured from the information and sent to the information distribution control unit 6.

The information distribution control section 6 sends the driver dozing information to the warning section 9, and the warning section 9 outputs the warning level corresponding to the level of the information warning the driver from the level of the drowsiness. Control is performed to control the information distribution of the output device so as to adopt a warning output form suitable for the level of the drowsiness information.

Here, the warning output form corresponding to the level of the drowsiness information is not limited to simply giving a warning by a loud sound, but can be made auditorily / visually using a stepwise sound or sound and image, or by a steering wheel. The warning is given to the driver painfully by generating an electric current and vibration, and the change is made according to the level of the drowsiness information of the driver.

[0066]

EXAMPLE Next, Example 1 based on the apparatus example 1 and the method example 1 of this embodiment, and Example 2 based on the apparatus example 2 and the method example 2 of the present invention will be described in order below.

Example 1 FIG. 2 is a configuration diagram showing Example 1 (and Example 2) which is one example of this embodiment, and FIG. 3 is a diagram for measuring the degree of tension of a driver from a steering wheel. It is a figure which shows an example of an apparatus, FIG. 4 is a figure which shows the flowchart of a present Example,
This embodiment will be described with reference to FIGS.

In FIG. 2, the driver's tension R is calculated by the driver tension calculating device 11 from the information of the current and voltage between the both hands of the driver measured directly from the steering wheel 10.
Calculate AT.

Here, in FIG. 3, the handle 10 is
Is divided into six parts by an electric circuit, and the first divided region A, the second divided region B, the third divided region C, the fourth divided region D, the fifth divided region E, and the sixth divided region of the handle 10, respectively. Let it be area F. Then, the current / voltage through the hand between the two regions in which the hand is grasped among the divided regions is measured by the same principle as the measurement of the electrocardiogram. For example, if B is held with the right hand and E is held with the left hand, B and E are used as end poles, and the current / voltage between the right and left hands is recorded.

When a person is in a tense state, a muscle generates a high-frequency potential, and a current / voltage value recorded by this potential difference is recorded as an electromyogram. When the driver's muscle is in a tense state, Is extracted by using an appropriate filter, and this is used as one of the data for calculating the driver's tension RAT by the driver tension calculation device 11.

Similarly, by monitoring the change in the resistance value between the right hand and the left hand including the change in the contact resistance between the skin and the handle, the change in the sweat condition of the driver is detected, and this is detected by the driver tension. The data is used as one of the data for calculating the driver's tension RAT by the degree calculation device 11.

Although it is assumed that the driver cannot measure the electromyogram or the resistance value by holding the steering wheel with one hand or both hands in a pile, when the driver holds the steering wheel with one hand or both hands If the driver is in a relaxed state and the resistance value cannot be measured, the driver may not be in a tension state.

Returning to FIG. 2, the driver's tension RA
T is transmitted to the controller 12. When the multimedia server 15 determines that the RAT value is smaller than the predetermined value and the incoming call is impossible, the external communication is received by the mobile phone 13 or the other communication device 14 by the control signal from the control device 12. , Tell the caller that it is driving and record the message from the caller.

On the other hand, when the RAT value is larger than the predetermined value and the incoming call is possible, the media selection unit 16 outputs the sound only or the speaker 17 or the sound and the image by the control signal from the control device. By screen 1
Select 8 to provide the driver with information. Further, when the RAT value is large enough to allow the driver to make a call, the microphone 19 enables real-time two-way communication with a caller outside the vehicle.

Next, steps S1 to S9 in FIG. 4 will be described in order of flow. The contact resistance value of the driver's hand is detected from the voltage / current value between the right and left hands of the driver holding the steering wheel (S1), and the sweat condition of the driver is detected by the change of the contact resistance value (S2). .
In parallel with this, the electromyogram of the driver is recorded by the contact resistance value from the voltage / current value between the right hand and the left hand of the driver holding the steering wheel (S3).

Next, the driver's tension RAT is calculated from the driver's electromyogram obtained in S3 and the sweat state information obtained in S2 (S4). If the value of RAT is less than the first predetermined value RAT1 (S5), the caller is informed that "the vehicle is in operation" and the caller's message is saved (S7).

When the value of RAT is equal to or larger than the first predetermined value RAT1 and is less than the second predetermined value RAT2 (> RAT1) (S6), only voice is output (S6).
8). When the RAT value is equal to or larger than the second predetermined value RAT2 (S6), all information by voice and image is presented, and bidirectional communication is performed between the caller of the external system and the driver as the case may be (S9).

In the implementation of the automatic operation control of the input / output device which requires the driver's operation, not the implementation of the above-mentioned mobile communication, the tension is measured in the same manner as described above.
For example, in the RAT, RAT1 and RAT2, R
When AT <RAT1, it is impossible to operate and the input / output device is stopped (corresponding to S7), and RAT1 <RAT <
When the RAT2 is set, the input / output device is automatically operated (S
8)), and when RAT> RAT2, a very simple operation of the input / output device is permitted (corresponding to S9), and so on.

For example, when the input / output device is a car navigation system, the screen display is stopped in S7, the map of the current location is automatically displayed in S8, and a very simple menu operation can be performed in S9. Just do it. Also,
When the input / output device is a portable personal computer which is also a mobile communication device and there is a mail from the outside, in S7, the display of the screen is stopped, and the sender of the mail automatically returns an announcement mail that the driver is driving. In S8, the sender of the e-mail may automatically reply to the announcement mail that the driver is driving to notify the driver of the automatic reply, and in S9, a very simple menu operation may be performed.

(Embodiment 2) FIG. 2 is a configuration diagram showing this embodiment, which is one embodiment of this embodiment, as in the above-mentioned embodiment 1, and FIG. 5 is a diagram showing a flow chart of this embodiment. This embodiment will be described with reference to FIGS. 2 and 5.

In FIG. 2, a CCD is provided in which the driver's face is placed behind the rearview mirror 20 which is a half mirror.
By capturing with the camera 21, recognizing the driver's eyes with the driver urgency calculation device 11, and recording the time change of the driver's white area, the time and frequency of blinking are detected, and the driver's dozing state is measured. Judge and evaluate. With such a configuration of measurement / judgment, it is possible to suppress the erroneous judgment of the dozing state and perform highly accurate judgment and evaluation.

When it is determined whether the driver is in the dozing state, the multimedia server 15 sends warning data to the media selection section 16 according to the control signal from the control device 12, and outputs only the voice according to the control signal from the control device 12. The speaker 17 for output or the screen 18 for output of sound and image is selected to notify the driver of the warning.

As a warning notification means, it is effective not only to change the car stereo volume but also to flash the screen 18 to give a warning. In addition, it is also effective to vibrate the steering wheel or send a small amount of electric current from the steering wheel to the driver's hand to give a warning.

Steps S10 to S14 in FIG. 5 will be described in order. The driver's eye information is detected from the driver's image information read by the CCD camera 21 (S10). Then, the area of the white eye in the entire area of the eye is detected (S11).

By the temporal change of the area information of the white eye,
The blinking execution time and frequency are calculated. From this calculation result, it is determined whether or not the execution time and the frequency of blinking are larger than a predetermined value to determine whether or not the person is dozing (S13),
If it is determined that the driver is falling asleep, the driver is selectively warned (S14).

If it is determined that the driver is not sleeping, the process returns to S10 to detect and measure eye information from the image information of the next driver, and subsequently monitor the driver's dozing.

Further, the more skilled the driver becomes, and the more he / she has, the more the driver tends to look at the rearview mirror, and the image information of the driver is combined with the measurement result of the tension in the first embodiment. If used as
A synergistic improvement in vehicle driving safety is expected in the entire system.

Although the embodiments of the present invention have been described above, the present invention is not necessarily limited to the above-described means and techniques, and the objects referred to in the present invention can be achieved and the effects referred to in the present invention can be achieved. Modifications can be made as appropriate within the range of possession.

[0089]

As described above, according to the present invention,
The driver's tension can be measured with higher accuracy because the driver's tension is measured directly through the steering wheel and selective and timely or real-time communication control is performed according to the driver's situation. Since it is possible to select reception / transmission of various information in a timely and stepwise manner or to perform limited and selective automatic operation control of the input / output device when strained, the driver's driving safety can be improved.

According to the present invention, the in-vehicle system itself has a server function for storing internal / external transmission / reception information, so that even if communication is disabled, the internal / external information that has been stored up to that point can be utilized. In addition, it is not necessary to set the mobile communication device, which has been performed every time before getting on the vehicle.

In addition, since the driver's dozing information is captured as an image and the warning is given stepwise according to the driver's dozing state, the driver's dozing state can be measured with higher accuracy, and the driver can adjust according to the dozing stage. As a result, a warning is given in a manner that does not affect the driving, and the driving safety of the vehicle is improved.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration example of a device according to an embodiment of the present invention.

FIG. 2 is a diagram showing a configuration of Example 1 which is an exemplary embodiment of the present invention.

FIG. 3 is a diagram showing a divided area of a handle in FIG.

FIG. 4 is a diagram showing a flowchart of an implementation method procedure of the first embodiment.

FIG. 5 is a diagram showing a configuration of Example 2 which is an exemplary embodiment of the present invention.

FIG. 6 is a diagram showing a flowchart of an implementation method procedure of the second embodiment.

[Explanation of symbols]

1 ... Communication section 2 ... I / O section 3 ... Driver monitor 3a ... Driver handle monitor section 3b ... Driver image monitor section 4 Driver status measurement unit 5 ... Information storage / conversion unit 6 ... Information distribution control unit 7 ... Delivery level setting section 8 ... Stop setting section for calls during tension 9 ... Warning section 10 ... Handle 11 ... Driver tension calculation device 12 ... Control device 13 ... Mobile phone 14 ... Communication equipment 15 ... Multimedia server 16 ... Media selection section 17 ... Speaker 18 ... Screen 19 ... Microphone 20 ... Half mirror room mirror 21 ... CCD camera 22 ... Mobile phone 23 ... Communication Center 24 ... Communication server 25 ... Car navigation 26 ... Side brake AF: handle division area

─────────────────────────────────────────────────── ─── Continuation of the front page (56) Reference JP-A-7-249197 (JP, A) JP-A-6-255516 (JP, A) JP-A-10-104007 (JP, A) JP-A-5- 189700 (JP, A) JP 8-58503 (JP, A) JP 6-127285 (JP, A) JP 9-116602 (JP, A) JP 9-113298 (JP, A) (58) Fields surveyed (Int.Cl. ⁷ , DB name) G08G 1/16 B60K 28/06 G08B 21/00

Claims (23)

(57) [Claims] 1. A driver monitoring means for sequentially detecting the driver's situation, a driver status measuring means for measuring judgment information from the detection of the situation, and a distribution of input / output means control information selectively according to the evaluation of the judgment information. The information distribution control means for controlling and the input / output means for controlling input / output of the internal / external information by the input / output means control information are provided. In addition, the information distribution control means requires the operation of a driver in the vehicle. A driver situation-dependent communication device, characterized in that the operation restriction or operation stop of the input / output means is automatically controllable. 2. The driver monitor means for sequentially detecting a driver's handle grip position and grip state during running as internal information, and a driver image for shooting and detecting an image of the driver during running as internal information. The driver situation-dependent communication device according to claim 1, further comprising a monitor means. 3. The driver situation dependency according to claim 1, wherein the input / output means allows input / output of internal / external information for bidirectional communication through a communication means for receiving / transmitting with an external system. Communication device. 4. The communication means and the input / output means temporarily store and convert external information received through the communication means, and input / output means control information of the information distribution control means inputs / outputs to / from the input / output means. The driver situation-dependent communication device according to claim 3, characterized in that information storage / conversion means whose transmission is controlled is interposed between them. 5. The information distribution control means is connected to a distribution level setting means for setting an evaluation level for selecting an input / output means distribution destination of the information distribution control means according to the judgment information. The driver situation-dependent communication device according to Item 1, 2, 3, or 4. 6. The information distribution control means suspends communication of call information from the information storage / conversion means to the input / output means in accordance with the input / output means control information of the information distribution control means according to the judgment information. The driver situation-dependent communication device according to claim 4 or 5, wherein the communication device is connected to a stop setting means such as a call during tension for setting an evaluation level. 7. The driver handle monitor means is configured such that the driver's tension can be directly measured by interaction between the driver's hand and handle, and the driver handle monitor means is characterized in that: 5. The driver situation-dependent communication device described in 5 or 6. 8. The driver situation dependent communication according to claim 3, 4, 5, 6 or 7, wherein the communication means is a two-way communication means provided in a mobile phone, a PHS, a car phone and the like. apparatus. 9. The input / output unit is configured to be able to notify a caller's message from the external system by sound or sound and image. Alternatively, the driver situation-dependent communication device according to item 8. 10. The driver image monitor means is installed behind a room mirror of a half mirror, as claimed in claim 2, 4, 5, 6, 7, 8 or 9.
Driver situation-dependent communication device described in. 11. The driver situation dependent communication device according to claim 2, wherein said driver image monitor means is a CCD camera. 12. The input / output means includes a unidirectional output means provided in a speaker for presenting audio information, a bidirectional input / output means provided in a mobile communication device, a portable personal computer, etc., and audio / image information, respectively. Presenting car navigation, car TV, car radio,
A one-way input / output unit provided in a car stereo or the like, or a one-way input unit provided in a microphone or the like.
8. The driver situation-dependent communication device according to 8, 9, 10 or 11. 13. In order to ensure a safe driving environment for a driver of a traveling vehicle, the situation of the driver is detected in the traveling vehicle, the judgment information of the situation is measured, and the judgment information is evaluated. When selectively controlling the distribution of the control information of the input / output means and controlling the input / output of the distribution destination input / output means from the control information of the input / output means according to the driver's situation, And the external system in the communication between the passenger including the driver in the vehicle and the external system by making the evaluation of the judgment information dependent on whether the driver is in the vehicle. By performing input / output control according to the degree of tension of the driver to the destination input / output means that inputs / outputs the information of the driver, the degree of tension of the driver is more than a predetermined value. When Sai,
A driver situation-dependent communication method, characterized in that announcement information indicating that the driver is driving is transmitted to the caller from the external system whose communication has been blocked. 14. In order to ensure a safe driving environment for a driver of a traveling vehicle, the situation of the driver is detected in the traveling vehicle, the judgment information of the situation is measured, and the judgment information is evaluated. When the distribution of the control information of the input / output means is selectively performed, and the input / output control of the distribution destination input / output means is performed according to the driver's status from the control information of the input / output means, the driver's status is changed to the vehicle operation. The driver's tension behavior at the same time, and the evaluation of the judgment information depends on whether the tension is larger or smaller than a predetermined value, and the input / output control is performed in the vehicle according to the magnitude of the driver's tension. A driver situation-dependent communication method, which automatically controls the input / output operation restriction or operation stop of the input / output unit that requires the operation of the driver. 15. The input / output control is performed according to the degree of tension of the driver with respect to an input / output means for inputting / outputting information to / from an external system in communication between a passenger including a driver in a vehicle and the external system. The driver situation-dependent communication method according to claim 14, wherein input / output control is performed according to the input / output control. 16. The input / output control is performed when the tension of the driver is smaller than a predetermined value.
16. The driver situation-dependent communication method according to claim 15, wherein announcement information indicating that the driver is driving is transmitted to the caller from the external system whose communication has been cut off. 17. The driver situation-dependent communication method according to claim 13, wherein the communication is a two-way communication using a mobile phone, a PHS, a car phone or the like. 18. The input / output control is such that when the degree of tension of the driver is smaller than a predetermined value,
18. The driver situation-dependent communication method according to claim 13, 15, 16 or 17, wherein transmission of external information from a sender from the external system to the driver is blocked. 19. The input / output control notifies a caller's message from the external system by a sound or a sound and an image when the driver's tension is within a predetermined range. Claims 13, 15, 16, 17 or 1
Driver situation-dependent communication method described in 8. 20. The input / output control is performed when the tension of the driver is larger than a predetermined value.
The bidirectional communication between the caller from the external system and the driver is performed.
Alternatively, the driver situation-dependent communication method according to Item 19. 21. The detection includes detecting the degree of tension of the driver by the interaction between the driver's hand and steering wheel.
The driver situation-dependent communication method according to 7, 18, 19 or 20. 22. The tension is measured by measuring current and voltage between both arms of a driver, according to claim 13, 14, 15, 16, 1.
The driver situation-dependent communication method according to 7, 18, 19, 20 or 21. 23. The input / output means includes a unidirectional output means provided in a speaker for presenting audio information, a bidirectional input / output means provided in a mobile communication device, a portable personal computer, etc., and audio / image information. Presenting car navigation, car TV, car radio,
14. One-way input / output means provided in a car stereo or the like, or one-way input means provided in a microphone or the like.
The driver situation-dependent communication method according to 7, 18, 19, 20, 21 or 22.