[go: up one dir, main page]

CN105286891A - Method for fatigue detection and processing based on perception aspect in Internet of vehicle - Google Patents

Method for fatigue detection and processing based on perception aspect in Internet of vehicle Download PDF

Info

Publication number
CN105286891A
CN105286891A CN201510790022.7A CN201510790022A CN105286891A CN 105286891 A CN105286891 A CN 105286891A CN 201510790022 A CN201510790022 A CN 201510790022A CN 105286891 A CN105286891 A CN 105286891A
Authority
CN
China
Prior art keywords
driver
steering wheel
information
car
sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510790022.7A
Other languages
Chinese (zh)
Inventor
沈剑
刘登志
刘琦
王保卫
付章杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing University of Information Science and Technology
Original Assignee
Nanjing University of Information Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing University of Information Science and Technology filed Critical Nanjing University of Information Science and Technology
Priority to CN201510790022.7A priority Critical patent/CN105286891A/en
Publication of CN105286891A publication Critical patent/CN105286891A/en
Pending legal-status Critical Current

Links

Landscapes

  • Traffic Control Systems (AREA)

Abstract

本发明提出了面向车载网内感知层面的疲劳检测与处理方法。该方法通过脑电波可判断出早期疲劳,然后对应采取相应提醒措施。根据驾驶员驾驶表现的判断,也就是对方向盘的角度变换状态进行判断驾驶员是否处于正常驾驶状态,若处于非正常状态则采取提醒措施。本发明中提出的对不同状态进行判定,再根据不同状态下采取不同的提醒方法,以达到有效的让驾驶员从不同困意状态中清醒。本发明提出的方法充分结合智能交通环境下车联网和通信的发展,通过远程处理中心来协助保证安全,因此实时性较高、受外界因素干扰较小的同时也保证了对应急情况发生的处理。

The invention proposes a fatigue detection and processing method oriented to the perception layer in the vehicle network. This method can judge early fatigue through brain waves, and then take corresponding reminder measures. According to the judgment of the driver's driving performance, that is to say, the angle change state of the steering wheel is used to judge whether the driver is in a normal driving state, and if it is in an abnormal state, a reminder measure is taken. The present invention proposes to judge different states, and then adopt different reminding methods according to different states, so as to effectively make the driver wake up from different sleepy states. The method proposed by the present invention fully combines the development of the Internet of Vehicles and communication under the intelligent transportation environment, and assists in ensuring safety through the remote processing center, so the real-time performance is high, and the interference from external factors is small, and it also ensures the processing of emergency situations. .

Description

The fatigue detecting of perception aspect and processing method in vehicle-mounted net
Technical field
Patent of the present invention relates to fatigue detecting and the processing method of perception aspect in vehicle-mounted net, belongs to areas of information technology.
Background technology
Along with automobile manufacturing process and expanding economy, vehicle gets more and more, and promotes economic development while facilitating people's life on the one hand, and various vehicle accident is special to be occurred again and again.Vehicle accident not only threatens the life security of driver, and the economic loss indirectly caused is also inestimable, such as secondary traffic accident, cause traffic congestion etc.The factor causing vehicle accident is a lot, show according to statistics wherein due to driver's carelessness, attention laxes, the reason such as the tired and vehicle accident brought out accounts for about 25% of vehicle accident, and anticipate because long-duration driving has the driver of about 60% all can feel tired, wherein the driver of about 37% even can be able to doze off after a period of time drives.So for driver status detection with in good time remind driver to be absorbed in driving to have become a urgent problem.
Existing fatigue detecting mainly relies on monitoring driving person's state and driving behavior performance.Wherein driver status monitoring judges mainly for face feature, as human eye detection, nozzle type detection, head bias etc.Driving behavior performance monitoring is mainly for Lane tracking and deviation.Exactly comprehensive detection determination methods is carried out for two kinds of modes in addition.Above detection determination methods is very effective for fatigue detecting, but the existing device of major part is analyzed judgement by video capture characteristics of image, will have an impact, even cannot accurately be judged under low light environment to judgement.And another defect of image recognition mode can only be worked as fatigue exactly and there occurs and just can detect, often driver's consciousness started to lax and even can not note surface conditions again this time, very easily vehicle accident occurred.Be fearful because tired driver gets into an accident, serious economic loss can be brought and threaten the life of driver.Therefore, fatigue detection method must improve or innovate.
Summary of the invention
The object of the invention is the detection method in order to provide an early stage of fatigue, the detection of driving behavior is conducive to occurring fatigue, driver attention laxes to have influence on and drives and judge, and steering wheel vibration reminding is provided, can effectively make driver from attention lax with tired situation revert to normal condition, and by the communication system of vehicle-mounted net, the status information of driver, driving information, driving information etc. can be sent to remote service center, when unintended emergency event occurs to provide helps such as yelling for help in time.
Angular displacement sensor under the present invention uses brain wave sensor and is placed in steering wheel shaft is monitored driver fatigue and state, wherein the comparing of waveform under the brain wave patterns that perceives of brain wave sensor and Normal Conscious state, what this method can occur in fatigue just can detect fatigue in first 15 minutes.Angular displacement sensor carries out Real-Time Monitoring to the performance of driving behavior during driver, compares analysis by the voltage waveform of angular displacement and the waveform of normal driving ,can judge whether driver is be in abnormal driving state.Merge with vehicle-mounted net system, driver status information and driving information can be transferred to remote control center real time monitoring driver status and provide if desired serves help simultaneously.
The fatigue detecting of perception aspect and processing method in vehicle-mounted net, technical scheme is specific as follows:
(1) early fatigue detects
Usual human brain can produce five kinds of brain wave patterns.When people feel exhausted and realize start slowly enter twilight state time, it is slack-off that the amplitude of wave form at this moment under brain wave patterns compared with normal state becomes large waveform, is now α waveform.When there is α waveform, be exactly the state of early fatigue, because this state continues 1-7 minute driver again will enter slight sleep state, the waveform of collection can judge compared with the waveform of normal condition whether the state of driver is in tired meaning A-stage.
11) brain wave sensor is placed in above driver seat, ensures that driver is sitting on driver's seat and driver's brain wave can be detected, and power supply is by power supply supply in car, and when after vehicle launch, Power supply then sensor starts the brain wave collecting driver in real time.
12) information collected of sensor, in order to ensure to transmit in real time and stability, this information is transferred in the middle of car inner treater by wire communication line in car, and processor has the ability storing and calculate.
13) processor by Real-time Collection to brain wave patterns and the waveform of normal condition carry out matching ratio comparatively.If car inner treater judges that the brain wave information collected is alpha wave shape, then this driver is in early fatigue state.
(2) detection of driving behavior state
When driver has tired meaning or other abnormal conditions time, the steering wheel operation of driver is unusual, such as rightly suddenly beats steering wheel or steering wheel is beaten on a left side, or keeps motionless even for a long time.That is under driver is in normal condition, its steering wheel change angle be little and also change frequency relatively very fast, but when driver is in improper driving condition, it is very large that its steering wheel changes angle and frequency can be relatively little, can judge whether the state of driver is in abnormal driving state compared with the angle voltage waveform of normal condition.
21) angular displacement sensor is placed in steering wheel shaft, can real-time monitor steering wheel displacement angle, and power supply is by power supply supply in car, and when after vehicle launch, Power supply then sensor starts the displacement angle information collecting steering wheel in real time.
22) information collected of sensor, in order to ensure to transmit in real time and stability, this information is transferred in the middle of car inner treater by wire communication line in car, and processor has the ability storing and calculate.
23) processor by Real-time Collection to the information of steering wheel angular displacement and normal condition compare, if steering wheel changes, angle is very large and frequency is less, can judge that driver is now in improper driving condition.
(3) prompting under driver's different conditions
31) if the result that brain wave monitors is judged driver for early fatigue, then car inner treater inspires speaker operation and sounds and remind driver to keep clear-headed in time.
32) if steering wheel angle change is judged as driver and is in abnormal condition, then car inner treater inspires the shock module work be placed on steering wheel and will note driving to remind driver.
(4) remote service is provided by vehicle-mounted Network Communication system
The method proposed in the present invention merges the communication system of vehicle-mounted net, and the driver status information that it perceives and driving information can propagate into remote control center.If be in an emergency, remote center can provide and help service in time.
41) information that car inner sensor was collected is transferred to roadside infrastructure (RSI) by wireless communications mode.
42) roadside infrastructure is by wireless or have bundle of lines information transmission to remote processing center.
43) remote processing center has the ability of calculating, storage, is in abnormal condition when the Chief Information Officer time of driver, then remote processing center can be made and promptly be helped process accordingly.
Beneficial effect
Waveform comparison analysis under the brain wave patterns that the present invention can be collected by brain wave sensor and normal condition draws the early fatigue of driver, can keep clear-headed by the timely alerting drivers of sound when early fatigue occurs, can avoid effectively in time because of driver attention lax, the generation of vehicle accident under sleepy state.The detection method that the present invention simultaneously proposes can also be monitored further for the driving condition of driver, if driving condition is abnormal, compare by the waveform under the voltage waveform of the angular displacement of steering wheel and abnormal driving state, when driver is in abnormal condition, driver can be reminded to note driving by the shock module on steering wheel, adjustment driving condition, can avoid the vehicle accident because the driving under tired or other abnormal conditions causes like this.And the method that the present invention proposes can also merge with the communication system of vehicle-mounted net, remote service center can monitor driving information, the driving condition of driver in real time, if there is urgent thunder bolt, remote center can provide and help service in time.
Accompanying drawing explanation
Fig. 1 is the network structure model of the present invention's " in vehicle-mounted net the fatigue detecting of perception aspect and processing method ".Wherein " V " represents vehicle, and " C " represents remote processing center, and " RSI " represents roadside infrastructure, and " M " represents the information that car inner sensor collects, and " R " represents the result of determination that remote processing center provides.
Fig. 2 is the flow chart of the present invention's " in vehicle-mounted net the fatigue detecting of perception aspect and processing method ".
Fig. 3 is the arrangement location drawing of " for monitoring angular displacement sensor and the vibration reminding device of driving behavior state " of the present invention.Wherein " AD " represents angular displacement sensor, and " VM " represents shock module.
Detailed description of the invention
It is carry out com-parison and analysis according to the wave character of brain wave patterns under the different conditions of people to draw, when early fatigue generation sound prompting can allow driver keep waking state fast that the early fatigue that the present invention proposes detects.Relate to simultaneously whether detect driver state with angular displacement sensor normal, be whether analyze the state that can judge driver according to comparing under the feature of the steering wheel anglec of rotation of driver under abnormal condition and frequency and normal condition normal.Remote service center can provide the service of help in emergency circumstances, because native system is under the communication system of vehicle-mounted net, so sensor senses to information can be transferred to remote center quickly, remote center can according to sensor senses to driver status information and driving information judge whether that needs are offered help and serve.Network structure model of the present invention as shown in Figure 1, automotive interior sensor acquisition is to information by being wirelessly transmitted to roadside infrastructure (RSI), and the information received can be sent to remote processing center by wired or wireless transmission means by the effect that roadside infrastructure (RSI) plays message switching.Remote processing center carries out process according to the information received and calculates, then result of determination message is returned to roadside infrastructure (RSI) again, roadside infrastructure (RSI) returns to automotive interior processor again by the mode of radio communication.The present invention propose fatigue judge and process flow as shown in Figure 2, when after automobile starting, automotive interior sensor is started working.Brain wave sensor starts to collect driver's brain electric information, and angular displacement sensor starts to monitor the voltage waveform gathering steering wheel angular displacement.Through car inner treater, the information collected when brain wave sensor judges that driver fatigue occurs, then speaker is triggered and produces sound warning.The information that in car, brain electric transducer was collected is transferred to remote processing center by vehicle-mounted net simultaneously, occurs if brain electric information is judged out crash time, and processing center can make emergency processing, other maybe can be provided to help as reported to the police.If the information that angular displacement sensor collects is judged to be driver dystropy by car inner treater, then the shock module work that processor can trigger steering wheel embedded sends vibration reminding.
(1) a kind of early fatigue detection method is provided;
11) brain wave sensor can be placed in driver seat head and rely on position, and concavity can be done in the position that head relies on to more effectively monitor driver's brain wave patterns, brain wave sensor is distributed in headrest position.Power supply is by power supply supply in car, and when after vehicle launch, Power supply then sensor starts the brain wave collecting driver in real time.Acquiring brain waves system can select the wireless brain electric system of NE, and it accurately can detect EEG brain electricity.
12) information collected of sensor, in order to ensure to transmit in real time and stability, this information is transferred in the middle of car inner treater by wire communication line in car, and processor has the ability storing and calculate.Processor can adopt 1756-L55M12 processor module.
13) processor by Real-time Collection to brain wave patterns and the waveform of normal condition carry out matching ratio comparatively.If car inner treater judges that the brain wave information collected is alpha wave shape, then this driver is in early fatigue state.
(2) a kind of detection method of driving behavior state is provided;
21) angular displacement sensor is placed in steering wheel shaft, as shown in Figure 3.Can real-time monitor steering wheel displacement angle, power supply is by power supply supply in car, and BF50-V series absolute type small-angle sensor selected by angular displacement sensor, arbitrary value between such sensor identifiable design 0-360 °.When after vehicle launch, Power supply then sensor starts the displacement angle information collecting steering wheel in real time.
22) information collected of sensor, in order to ensure to transmit in real time and stability, this information is transferred in the middle of car inner treater by wire communication line in car.Wire communication line can select common twisted-pair feeder.
23) processor by Real-time Collection to the information of steering wheel angular displacement and normal condition compare, if steering wheel changes, angle is very large and frequency is less, can judge that driver is now in improper driving condition.
(3) alerting pattern under driver's different conditions is provided;
31) if the result that brain wave monitors is judged driver for early fatigue, then car inner treater inspires speaker operation and sounds and remind driver to keep clear-headed in time.Speaker can select 1W, the speaker product of 8 Ω ± 15% types.
32) if steering wheel angle change is judged as driver and is in abnormal condition, then car inner treater inspires the shock module work be placed on steering wheel and will note driving to remind driver, and shock module deployment way as shown in Figure 3.Shock module selectively operating voltage 3.3V-5V open type rotating speed 11000 (rpm) serial shaking sensor.
(4) remote service is provided by vehicle-mounted Network Communication system;
41) information that car inner sensor was collected is transferred to roadside infrastructure (RSI) by wireless communications mode.Vehicle and roadside infrastructure (RSI) communication module adopt technical grade ZigBee wireless communication module ZM5168 series.
42) roadside infrastructure is by wireless or have bundle of lines information transmission to remote processing center.Wired directly selection Internet connection line, as twisted-pair feeder, optical fiber.Remote information switching is without line options 4G express network, and short distance can select technical grade DL4300WIFI module, technical grade ZM5168 series ZigBee wireless communication module etc.
43) remote processing center has the ability of calculating, storage, is in abnormal condition when the Chief Information Officer time of driver, then remote processing center can be made and promptly be helped process accordingly.Remote processing center processor can select Intel server level E5v3 series processors.

Claims (1)

1., towards fatigue detecting and the processing method of perception aspect in vehicle-mounted net, comprise that early fatigue detects, the detection of driving behavior state, prompting under driver's different conditions, provide remote service by vehicle-mounted Network Communication system, specific as follows:
(1) early fatigue detects
11) brain wave sensor is placed in above driver seat, ensures that driver is sitting on driver's seat and driver's brain wave can be detected, and power supply is by power supply supply in car, and when after vehicle launch, Power supply then sensor starts the brain wave collecting driver in real time;
12) information that sensor was collected is transferred in car the processor with storage and computing function by wire communication line in car;
13) processor by Real-time Collection to brain wave patterns and the waveform of normal condition carry out matching ratio comparatively, if car inner treater judges that the brain wave information collected is alpha wave shape, then this driver is in early fatigue state;
(2) detection of driving behavior state
21) angular displacement sensor is placed in steering wheel shaft, real-time monitors steering wheel displacement angle, and power supply is by power supply supply in car, and when after vehicle launch, Power supply then sensor starts the displacement angle information collecting steering wheel in real time;
22) information collected of sensor, is transferred in car the processor with storage and computing capability by wire communication line in car;
23) processor by Real-time Collection to the information of steering wheel angular displacement and normal condition compare, if steering wheel changes, angle is very large and frequency is less, then can judge that driver is now in improper driving condition;
(3) prompting under driver's different conditions
31) if the result that brain wave monitors is judged driver for early fatigue, then car inner treater inspires speaker operation and sounds, and reminds driver to keep clear-headed in time;
32) if steering wheel angle change is judged as driver be in abnormal condition, then car inner treater inspires the shock module work be placed on steering wheel, reminds driver will note driving;
(4) remote service is provided by vehicle-mounted Network Communication system
41) information that car inner sensor was collected is transferred to roadside infrastructure by wireless communications mode;
42) roadside infrastructure is by wireless or have bundle of lines information transmission to remote processing center;
43) remote processing center has the ability of calculating, storage, is in abnormal condition when the Chief Information Officer time of driver, then remote processing center can be made and promptly be helped process accordingly.
CN201510790022.7A 2015-11-17 2015-11-17 Method for fatigue detection and processing based on perception aspect in Internet of vehicle Pending CN105286891A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510790022.7A CN105286891A (en) 2015-11-17 2015-11-17 Method for fatigue detection and processing based on perception aspect in Internet of vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510790022.7A CN105286891A (en) 2015-11-17 2015-11-17 Method for fatigue detection and processing based on perception aspect in Internet of vehicle

Publications (1)

Publication Number Publication Date
CN105286891A true CN105286891A (en) 2016-02-03

Family

ID=55185217

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510790022.7A Pending CN105286891A (en) 2015-11-17 2015-11-17 Method for fatigue detection and processing based on perception aspect in Internet of vehicle

Country Status (1)

Country Link
CN (1) CN105286891A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106361308A (en) * 2016-11-08 2017-02-01 京东方科技集团股份有限公司 Method and system for detecting abnormal state
TWI616185B (en) * 2016-08-30 2018-03-01 遠東科技大學 Method and system for monitoring group's attention level by analyzing brainwave
CN116439710A (en) * 2023-04-11 2023-07-18 中国人民解放军海军特色医学中心 Ship driver fatigue detection system and method based on physiological signals

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009064473A1 (en) * 2007-11-13 2009-05-22 Wavesynch Technologies, Inc. A method for monitoring attentiveness and productivity in a subject
CN101574261A (en) * 2009-06-18 2009-11-11 金会庆 Remote monitoring early warning device for driving fatigue
CN101579232A (en) * 2008-05-14 2009-11-18 横滨橡胶株式会社 Method and system for evaluating driving conditions of a vehicle
CN101980660A (en) * 2008-09-19 2011-02-23 松下电器产业株式会社 Inattentiveness detecting device, inattentiveness detecting method, and computer program
US20130226408A1 (en) * 2011-02-18 2013-08-29 Honda Motor Co., Ltd. Coordinated vehicle response system and method for driver behavior
CN103505224A (en) * 2012-06-27 2014-01-15 东北大学 Fatigue driving remote monitoring and alarm system and method based on physiological information analysis

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009064473A1 (en) * 2007-11-13 2009-05-22 Wavesynch Technologies, Inc. A method for monitoring attentiveness and productivity in a subject
CN101579232A (en) * 2008-05-14 2009-11-18 横滨橡胶株式会社 Method and system for evaluating driving conditions of a vehicle
CN101980660A (en) * 2008-09-19 2011-02-23 松下电器产业株式会社 Inattentiveness detecting device, inattentiveness detecting method, and computer program
CN101574261A (en) * 2009-06-18 2009-11-11 金会庆 Remote monitoring early warning device for driving fatigue
US20130226408A1 (en) * 2011-02-18 2013-08-29 Honda Motor Co., Ltd. Coordinated vehicle response system and method for driver behavior
CN103505224A (en) * 2012-06-27 2014-01-15 东北大学 Fatigue driving remote monitoring and alarm system and method based on physiological information analysis

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
张希波: "基于方向盘操作的驾驶人疲劳状态实时检测方法", 《清华大学学报(自然科学版)》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI616185B (en) * 2016-08-30 2018-03-01 遠東科技大學 Method and system for monitoring group's attention level by analyzing brainwave
CN106361308A (en) * 2016-11-08 2017-02-01 京东方科技集团股份有限公司 Method and system for detecting abnormal state
CN116439710A (en) * 2023-04-11 2023-07-18 中国人民解放军海军特色医学中心 Ship driver fatigue detection system and method based on physiological signals
CN116439710B (en) * 2023-04-11 2023-10-20 中国人民解放军海军特色医学中心 Ship driver fatigue detection system and method based on physiological signals

Similar Documents

Publication Publication Date Title
CN104112334B (en) Fatigue driving method for early warning and system
CN205158585U (en) Prevention driver fatigue's smart machine and system
CN202619669U (en) Driver emotion monitoring device
CN105336105A (en) Method, intelligent device and system for preventing fatigue driving
CN104146722A (en) Driving fatigue detecting and grading early warning device and method based on head signals
CN109367539A (en) An Intelligent System for Detecting Fatigue Driving
CN106184222B (en) A kind of monitoring method and device of drunk driving
CN103258403A (en) Anti-drowsiness early warning system and method
CN106157537A (en) Anti-fatigue-driving system
CN108312964A (en) A kind of fatigue driving state identification early warning system and method
CN107585026A (en) A kind of anti-fatigue-driving system
CN107953886B (en) The safety traffic method of vehicle and vehicle
JP2012068841A (en) Awakening device for vehicle
CN105286891A (en) Method for fatigue detection and processing based on perception aspect in Internet of vehicle
CN106541915A (en) A kind of electric automobile safety pre-warning system and its method for early warning
CN106183974A (en) Electric automobile and pedestrian reminding system and method for electric automobile
CN103123749B (en) A kind of vehicle-mounted emergency alarm device based on sense of touch
CN106183975A (en) Electric automobile and pedestrian reminding system and method for electric automobile
CN202686330U (en) Antifatigue driving system of car
CN207550068U (en) The speed-reduction prompting device that a kind of vehicle passes through deceleration strip
CN103824421B (en) Active safety fatigue driving detection caution system
CN211427470U (en) Fatigue driving reminding device
CN103019221A (en) Intelligent comprehensive driving habit analyzing system
CN111086448A (en) Vehicle, vehicle equipment and driving behavior prompting method based on intelligent wearable equipment
CN202624069U (en) Automobile inner rear-view mirror with fatigue driving warning system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20160203

WD01 Invention patent application deemed withdrawn after publication