The method and system of tired driver early warning bio-identification
Technical field
The present invention relates to a kind of automatic driving control of automobile, especially by the early warning system of bio signal identification tired driver to motor vehicles.
Background technology
Relating to automatic vehicle control system has been prior art, wherein utilize shaft-position encoder, torque motor and action tank can controlling party to corner, road speed and brake etc.Relate to automatic vehicle control system as Chinese patent application 98122574.8, it adopts the binocular camera shooting system interior road conditions information of the preceding 1-200m of collecting cart automatically: land marking, isolation strip, anticollision barrier, Lane Mark identification, roadblock; Motor vehicle number, track distribution, distance, relative velocity and road markings board information.Systems soft ware automatic decision: automobile driving speed, automobile direct of travel and position, automatic overtaking system driving, snub, can adopt closed loop system travel direction dish control, speed controlling.It can be used for the automatic driving on the highway.
Highway, especially highway, the speed of automobile is quite high, in 80 kilometers/hour, one second moment of clock " ticktack ", the automobile rice surplus in the of 20 of advancing.If when this dozed off owing to the driver is overtired in a flash, steering wheel is out of control very easily to have an accident, and causes heavy losses, even cause the people in desperately.Especially at current dog-eat-dog, allegro market economy times, how protecting driver's driving safety in this respect on the highway is the research topic of the task of top priority.The tired driver early warning system of research invention here is exactly to protect the driver to make it the device of safe driving automatically when the fatigue that drives a car has sleepiness.Train is all the more so, its speed even reach nearly 200 kilometers.As miss the consequence that signal prompt also may be totally unfavorable because of tired driver.
Summary of the invention
The object of the invention provides a kind of fatigue by bio signal extraction identification driver, thus the early warning system that gives the alarm (comprising reminder alarm and the outside alarm of vehicle in the car) or directly motor vehicles are intervened.
The object of the present invention is achieved like this: the tired driver early warning system, comprise device and the alarm issue device formation of extracting identification driver's fatigue with bio signal, the device that bio signal extracts identification driver's fatigue comprises infrared photography or shooting face that extracts and the electrophysiology information that sleep reaches real time record for information about organically combined, output be fused into multi parameters control information with automatic control after car light, deceleration and brake.Video image sensors, electrophysiology information harvester, signal processor video image sensors, electrophysiology information harvester, signal processor, alarm signal generator, control vehicle signal output constitute.
The method of tired driver early warning bio-identification, when extracting the pupil signal from biometric image, as the signal that diminishes, eyelid signal, as the increase of catacleisis frequency, catacleisis time lengthening, mouth shape signal, signal as the deformation of yawn mouth when big is main basis for estimation, and the electric bio signals such as slow wave that occur of slack-off in conjunction with heart rate again, brain judge that comprehensively the driver enters sleep state.Thereby give the alarm and control vehicle signal.When eliminating, above-mentioned basis for estimation removes above-mentioned signal.
Sleepiness is arranged and as yet not during steering wheel out of control, this control information has been sent and stimulated alarm signal photoacoustic signal (as music or alarm song) in driver's fatigue, back car red light is bright simultaneously, reduces speed now.When driver's sleepiness disappearance under stimulus signal stimulates, aforesaid all stimulus signals all disappear.
The present invention will detect the hardware module of information of facial state (pupil size, catacleisis frequency, catacleisis time, yawn mouth shape etc.) when when the driver drives sleepiness being arranged, heart rate, brain electricity and the device systems that signal analysis and processing module, control signal module, alarm signal module constitute is called tired driver early warning system device systems.As long as the equipment or the device that are similar to this " early warning system " method for designing are arranged, all do not exceed the scope of protection of present invention.
Characteristics of the present invention are: the tired driver early warning system is novel, infrared photography face that extracts and the electrophysiology information that sleep reaches real time record are for information about organically combined, adopt advanced electronic technology and signal processing technology, be fused into multi parameters control information with automatic control after car light, deceleration and brake.Sleepiness is arranged and as yet not during steering wheel out of control, this control information has been sent and stimulated alarm signal (music or alarm song) in driver's fatigue, back car red light is bright simultaneously, reduces speed now.When driver's sleepiness disappearance under stimulus signal stimulates, aforesaid all stimulus signals all disappear, and the car red light puts out behind the automobile, and it is normal that speed is recovered.If driver drowsiness is deepened, will make direction out of control in a flash, control information can make bright, the slowing-down brake of car light behind the automobile, makes very safe the stopping of automobile, with the safety of guarantor and automobile.
Description of drawings
Fig. 1 is that tired driver early warning system of the present invention constitutes block diagram
Fig. 2 is that the present invention utilizes image processing method to extract the software programming block diagram of the flow process of sleep characteristics parameter
Fig. 3 is that the present invention utilizes the ecg analysis method to extract the flow process of sleep characteristics parameter
Fig. 4 is that the present invention utilizes image processing method to extract the flow process of sleep characteristics parameter
Fig. 5 is that the present invention utilizes brain electricity analytical method to extract the flow process of sleep characteristics parameter
Fig. 6 is that electrocardiogram (ECG) data of the present invention is handled and the software flow of analyzing in real time
Fig. 7 is that eeg data of the present invention is handled and the software flow of analyzing in real time
The specific embodiment
This " early warning system " equipment is graded and is formed by infrared camera, video image sensors, electrophysiology information harvester, signal processor, alarm signal generator, control vehicle signal efferent, as shown in Figure 1 block diagram.
1, the invention thinking of this " early warning system " equipment
The device systems that the hardware module of the information of the facial state (pupil size, catacleisis frequency, catacleisis time, yawn mouth shape etc.) when detection driver driving is had sleepiness, heart rate, brain electricity and signal analysis and processing module, control signal module, alarm signal module constitute is called tired driver early warning system device systems.As long as the equipment or the device that are similar to this " early warning system " mentality of designing are arranged, all do not exceed protection scope of the present invention.
2, this " early warning system " interpretation software inventive embodiments
(1) facial state parameter analysis
By infrared camera shooting (also can by common shooting), the face image data information of obtaining by video image sensors, adopt the characteristic information parameter that image processing techniques is extracted sleepiness: pupil size, catacleisis frequency, degree and time, the frequency of yawning and persistent period etc.The software programming block diagram utilizes image processing method to extract the flow process of sleep characteristics parameter as shown in Figure 2.Sequential image feature is handled the sleep characteristics parameter extraction.The pupil size, catacleisis frequency, degree and time, the frequency of yawning and persistent period with just often compare pupil and diminish, catacleisis increase frequency, time lengthening, the increase frequency of yawning and continued a period of time all as the foundation of sending the sleep alarm.
(2) electrophysiology information parameter
Detect electrocardio that the sleepiness time is arranged (with no sleepiness time electrocardio comparison get) by the electrocardio detection module, the electrocardio when this has sleepiness should change but its value varies with each individual.Therefore should obtain his normal EGC parameter when driver's normal condition is driven, EGC parameter subsequently all compares with it.The software programming block diagram as shown in Figure 3.Obtaining of EGC parameter with routine electrocardiogram signal extraction mode or high frequency ECG signal extraction mode.Handle in real time and the software flow of analyzing as Fig. 6 electrocardiogram (ECG) data
(3) brain electric information parameter
Detect brain wave data Lee by brain electro-detection module and analyze its frequency, when sleepiness, the θ ripple appears in brain wave, and (4~8Hz), the programming block diagram as shown in Figure 5.
The Treatment Analysis program circuit as shown in Figure 7 in real time.In the software flow that Fig. 7 eeg data is handled in real time and analyzed,, taked double sampling here.Because only need the signal of the following frequency range of 30Hz, and sample with the 1000Hz sample rate for the first time, be sampled signal, do not produce too much redundant data again, so carry out sampling again with 100Hz again after the low-pass filtering in order to recover better.Usual manner is used in obtaining of brain electrical quantity.
3, each parameter organically combines, the comprehensive discriminating
Based on facial parameters, organically combine electric-physiology parameter, responsive comprehensive discriminating sleepiness has not.Be main contents of the present invention.
The method that the control of brake and light is taked is: the automatic hydraulic oil cylinder, according to the interlock situation of brake, also can control rear portion light automatically with the rear portion brake lamp, and alarm is photoelectricity voice guard commonly used in the car.
Biometric image extracts recognition device and detects when when the driver drives sleepiness being arranged, pupil diminishes, the increase of catacleisis frequency, catacleisis time lengthening, be main basis for estimation when the deformation of yawn mouth is big, the electric bio signals such as slow wave that occur of slack-off in conjunction with heart rate again, brain judge that comprehensively the driver enters sleep state.Thereby give the alarm and control vehicle signal.When eliminating, above-mentioned basis for estimation removes above-mentioned signal.
It generally is a given biometric image with normal mental state the time that biometric image extracts recognition device: as pupil, catacleisis frequency, catacleisis time, yawn mouth shape, when monitoring identification, Biological indicators to certain limit, are sent signal than the difference of normal condition when above as 20%.