[go: up one dir, main page]

CN107909772A - A kind of intelligence vehicle-mounted fatigue monitoring method - Google Patents

A kind of intelligence vehicle-mounted fatigue monitoring method Download PDF

Info

Publication number
CN107909772A
CN107909772A CN201711164784.1A CN201711164784A CN107909772A CN 107909772 A CN107909772 A CN 107909772A CN 201711164784 A CN201711164784 A CN 201711164784A CN 107909772 A CN107909772 A CN 107909772A
Authority
CN
China
Prior art keywords
mrow
data transmission
transmission device
clouds
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711164784.1A
Other languages
Chinese (zh)
Inventor
曾丽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu Jiushidu Industrial Product Design Co Ltd
Original Assignee
Chengdu Jiushidu Industrial Product Design Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chengdu Jiushidu Industrial Product Design Co Ltd filed Critical Chengdu Jiushidu Industrial Product Design Co Ltd
Priority to CN201711164784.1A priority Critical patent/CN107909772A/en
Publication of CN107909772A publication Critical patent/CN107909772A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/06Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0002Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue
    • A61B5/14542Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue for measuring blood gases
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/168Evaluating attention deficit, hyperactivity
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/746Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • G06V40/171Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00Evaluating a particular growth phase or type of persons or animals
    • A61B2503/20Workers
    • A61B2503/22Motor vehicles operators, e.g. drivers, pilots, captains

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Developmental Disabilities (AREA)
  • General Physics & Mathematics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Child & Adolescent Psychology (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Educational Technology (AREA)
  • Hospice & Palliative Care (AREA)
  • Psychiatry (AREA)
  • Psychology (AREA)
  • Social Psychology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Optics & Photonics (AREA)
  • Emergency Management (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Physiology (AREA)
  • Image Processing (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Emergency Alarm Devices (AREA)

Abstract

The present invention provides a kind of intelligent vehicle-mounted fatigue monitoring system, it is related to field of automobile safety.It is characterized in that, the system comprises:Vehicle-mounted end, high in the clouds, users' mobile end and supervision end;The vehicle-mounted end includes:Video acquisition module, coded treatment module, algorithm processing module, sensing system, central processing unit and operation interface;The high in the clouds includes:Data transmission device, high in the clouds data sink and cloud processor;The supervision end includes:Supervision department's data transmission device and supervision department's processor;The users' mobile end includes:Mobile terminal data transmission module and mobile terminal operation interface.The invention have monitoring it is accurate, it is reliable, possess the advantages that big data analysis and monitoring function, improvement traditional algorithm, algorithm trap.

Description

A kind of intelligence vehicle-mounted fatigue monitoring method
Technical field
The present invention relates to field of automobile safety, more particularly to a kind of intelligent vehicle-mounted fatigue monitoring system.
Background technology
How for driver the weight that an effectively practical safety driving assist system is safe driving of vehicle is provided Want problem.Fatigue-driving detection technology based on machine vision at home and abroad carried out it is widely studied, wherein with driver eye The detection of portion's feature is the most extensive.
We can encounter that length of one's sleep the previous day is very few, and sleep quality is excessively poor during daily driving;The very good cause of road conditions Make surface conditions single;Run into dust storm, rain, mist, snow weather conditions;For a long time, drive a vehicle over long distances;Speed is too fast or excessively slow;Arrive Up to situations such as destination having time limitation etc., these all can be the factor for inducing your fatigue driving, or even outside vehicle itself or car Noise and serious vibration;Seat, which adjusts the reason such as improper, can all cause your fatigue driving, so as to induce traffic accident.
Occur when driving gear shift not in time, it is inaccurate, illustrate that human body is in slight fatigue state;It is dynamic when there is operation Make dull, can even forget the operation that will carry out sometimes, illustrate that human body is tired in moderate;When occur subconscious operation or When there is short time sleep phenomenon, illustrate that human body in severe fatigue, has just been bred disaster when often waking up.In emergency situation Before generation, the initial sign of fatigue driving can be detected, and the alarm tone at this moment to sound is exactly often to drive The best opportunity that member saves out from Death's hand.
Existing fatigue monitoring system is primarily present the defects of following:
1st, monitoring is inaccurate:Existing fatigue monitoring method, otherwise it is monitored using sensor, otherwise utilize merely Image procossing.And both often all there are it is certain the defects of, it is very inaccurate to frequently result in monitoring result, so as to produce wrong report It is alert.
2nd, big data analysis is lacked:Since many driver tired drivings are the processes of a chronicity, if without pin The analysis of chronicity is carried out to driver.Also lack third party to exercise supervision to driver management, cause many chronic fatigues to be driven The driver sailed cannot obtain it is watchful, so as to cannot prevent trouble before it happens.
3rd, algorithm falls behind:Existing fatigue monitoring method, mostly using old image algorithm.And due to fatigue monitoring and Common image recognition has very big otherness.If using old algorithm simply, it can directly cause monitoring result inaccuracy and algorithm Complexity, deals with very slow.
The content of the invention
In consideration of it, the present invention provides a kind of intelligent vehicle-mounted fatigue monitoring system, the invention have monitoring it is accurate, can Lean on, possess the advantages that big data analysis and monitoring function, improvement traditional algorithm, algorithm trap.The technical solution adopted by the present invention It is as follows:
A kind of intelligence vehicle-mounted fatigue monitoring system, it is characterised in that the system comprises:Vehicle-mounted end, high in the clouds, Yong Huyi Moved end and supervision end;The vehicle-mounted end includes:Video acquisition module, coded treatment module, algorithm processing module, sensor system System, central processing unit and operation interface;The high in the clouds includes:Data transmission device, high in the clouds data sink and high in the clouds processing Device;The supervision end includes:Supervision department's data transmission device and supervision department's processor;The users' mobile end includes:Move Moved end data transmission module and mobile terminal operation interface;
The video acquisition module signal is connected to coded treatment module;The coded treatment module by signal is connected to algorithm Processing module;The algorithm processing module signal is connected to central processing unit;Signal is connected to behaviour to the central processing unit respectively Make interface, sensing system, prior-warning device and data transmission device;The data transmission device signal is connected to high in the clouds data and passes Defeated device;Signal is connected to mobile terminal data transmission module, cloud processor and supervision to the high in the clouds data transmission device respectively Department's processor;The mobile terminal data transmission module signal is connected to mobile terminal operation interface;The cloud processor signal It is connected to supervision department's data transmission device;Supervision department's data transmission device signal is connected to supervision department's processor;
The video acquisition module, for gathering the facial image information of driver, the image information got is sent To coded treatment module;The coded treatment module is used to carry out the facial image information received at digital video decoding Reason, the facial image information after processing is sent to algorithm processing module;The algorithm processing module, for passing through image recognition Algorithm docks received facial image information and carries out algorithm process, judges the state of mind of driver, will determine that result send to Central processing unit;The sensing system, including:Blood oxygen transducer and acidity-basicity sensor;The blood oxygen transducer is used for real When monitor human body blood oxygenation information, the blood oxygenation information monitored is sent to central processing unit;The acidity-basicity sensor is used for The pH value on human skin is monitored, the pH value monitored is sent to central processing unit;The central processing unit, is used In judging whether driver is currently in fatigue state according to the data message received, it will determine that result is respectively sent to operate Interface, prior-warning device and data transmission device;The operation interface, for showing judging result;The prior-warning device, for root It is judged that as a result issue warning signal;
The image-recognizing method that the algorithm processing module uses comprises the following steps:
Step 1:The Face datection based on colour of skin cluster is carried out to the image information that coded treatment module sends over;
Step 2:According to Face datection as a result, being distributed according to eyes in the geometric position of face, the big position approximate of eyes is determined Put, reduce the regional extent of eyeball detection;
Step 3:In the eyeball search range of diminution, edge detection is carried out to ocular using edge detection algorithm, The marginal information of eye is extracted, and binary conversion treatment is carried out to it, then Connected component point is carried out to the ocular after binaryzation Analysis, the interference of circumference of eyes picture noise point is removed using the bianry image filtering method based on regional connectivity;
Step 4:According to improved integral projection algorithm, the distance of left and right canthus and upper palpebra inferior is calculated, determines driver Eyes open closed state;
Step 5:The flat rate of definition blink, and the detection of fatigue driving is realized accordingly.
The cloud processor, for by the data information memory that high in the clouds data transmission device sends in local, often Every some cycles, big data statistical analysis is carried out to being stored in local data message, analysis result is sent to supervision department Data transmission device;And receive the assessment result from supervision end, assessment result is stored in local, periodically ties the assessment Fruit is sent to users' mobile end.
Supervision department's processor, for the big data statistic analysis result sended over according to high in the clouds, to the driving The state of mind of personnel is artificially assessed, and assessment result is sent to cloud processor through high in the clouds data transmission device and is deposited Storage.
The users' mobile end operation interface, the assessment result for high in the clouds to be sended over are shown.
The method for detecting human face based on colour of skin cluster comprises the following steps:
Step 1:The image collected from camera is rgb format, is by RGB format conversions using equation below realization
Step 2:Equation below is recycled to detect the area of skin color of driver:
R > G&& | R-G | >=11
340≤S≤359P0≤S≤50
0.12≤T≤0.7&&0.3≤V≤1.0
Step 3:Then horizontal and vertical projection is carried out to face, determines the borderline region of face, border determines formula such as Under:
Wherein, h, w are respectively the height and width with the horizontal and vertical face area for projecting and trying to achieve.
The method that the eye area-of-interest determines comprises the following steps:
Step 1:Assuming that the human face region length detected is HF;Width is WF;
Step 2:In several vertical direction, eyes are located at more than face's half, the region of HF/5 below the crown.
Step 3:In the horizontal direction, eye borderline region must be positioned at apart from face's left margin, WF/8 go out to start to away from From the region at eye right margin WF/8.
Using above technical scheme, present invention produces following beneficial effect:
1st, monitoring is accurate:The fatigue monitoring system that the present invention uses, has monitoring accurate, and image monitoring is gathered except using Beyond main judge means, sensing system is also added as auxiliary monitoring.Two monitoring results are integrated into work To judge means, the accuracy and science of monitoring can be greatly promoted.
2nd, big data analysis:The concept of big data and cloud storage is referred to fatigue monitoring by the present invention.Except for Single fatigue driving is carried out beyond early warning, can also be directed to multiple fatigue driving data, be counted fatigue driving in a period of time Number, different degrees of early warning is sent according to these data.
3rd, algorithm is advanced:The present invention improves traditional image recognition algorithm, has been substantially carried out gathering based on the colour of skin Face datection, the eye area-of-interest of class determine, the edge detection based on Sobel operators, using improve integral projection algorithm Determine the distance of left and right canthus and upper palpebra inferior.Identify the frequency of wink of driver by these, and according to frequency of wink come The degree of fatigue of integrated judgment driver.
4th, possesses supervisory role:Big data handling result and supervision department are attached by the present invention, and supervision department can be with Analysis of the real-time reception to the long-term state of mind of driver.And the data message of some high-risk drivers is extracted, and by supervising Department provides alert, and prevention effect is just played when danger is sent.
Brief description of the drawings
Fig. 1 is a kind of intelligent vehicle-mounted fatigue monitoring system structure diagram of the present invention.
Embodiment
All features disclosed in this specification, or disclosed all methods or during the step of, except mutually exclusive Feature and/or step beyond, can combine in any way.
Any feature disclosed in this specification (including any accessory claim, summary), unless specifically stated, Replaced by other equivalent or with similar purpose alternative features.I.e., unless specifically stated, each feature is a series of An example in equivalent or similar characteristics.
A kind of intelligent vehicle-mounted fatigue monitoring system is provided in the embodiment of the present invention 1, system structure is as shown in Figure 1:
A kind of intelligence vehicle-mounted fatigue monitoring system, it is characterised in that the described method includes:Vehicle-mounted end, high in the clouds, Yong Huyi Moved end and supervision end;The vehicle-mounted end includes:Video acquisition module, coded treatment module, algorithm processing module, sensor system System, central processing unit and operation interface;The high in the clouds includes:Data transmission device, high in the clouds data sink and high in the clouds processing Device;The supervision end includes:Supervision department's data transmission device and supervision department's processor;The users' mobile end includes:Move Moved end data transmission module and mobile terminal operation interface;
The video acquisition module signal is connected to coded treatment module;The coded treatment module by signal is connected to algorithm Processing module;The algorithm processing module signal is connected to central processing unit;Signal is connected to behaviour to the central processing unit respectively Make interface, sensing system, prior-warning device and data transmission device;The data transmission device signal is connected to high in the clouds data and passes Defeated device;Signal is connected to mobile terminal data transmission module, cloud processor and supervision to the high in the clouds data transmission device respectively Department's processor;The mobile terminal data transmission module signal is connected to mobile terminal operation interface;The cloud processor signal It is connected to supervision department's data transmission device;Supervision department's data transmission device signal is connected to supervision department's processor.
The video acquisition module, for gathering the facial image information of driver, the image information got is sent To coded treatment module;The coded treatment module is used to carry out the facial image information received at digital video decoding Reason, the facial image information after processing is sent to algorithm processing module;The algorithm processing module, for passing through image recognition Algorithm docks received facial image information and carries out algorithm process, judges the state of mind of driver, will determine that result send to Central processing unit;The sensing system, including:Blood oxygen transducer and acidity-basicity sensor;The blood oxygen transducer is used for real When monitor human body blood oxygenation information, the blood oxygenation information monitored is sent to central processing unit;The acidity-basicity sensor is used for The pH value on human skin is monitored, the pH value monitored is sent to central processing unit;The central processing unit, is used In judging whether driver is currently in fatigue state according to the data message received, it will determine that result is respectively sent to operate Interface, prior-warning device and data transmission device;The operation interface, for showing judging result;The prior-warning device, for root It is judged that as a result issue warning signal.
The cloud processor, for by the data information memory that high in the clouds data transmission device sends in local, often Every some cycles, big data statistical analysis is carried out to being stored in local data message, analysis result is sent to supervision department Data transmission device;And receive the assessment result from supervision end, assessment result is stored in local, periodically ties the assessment Fruit is sent to users' mobile end.
Supervision department's processor, for the big data statistic analysis result sended over according to high in the clouds, to the driving The state of mind of personnel is artificially assessed, and assessment result is sent to cloud processor through high in the clouds data transmission device and is deposited Storage.
The users' mobile end operation interface, the assessment result for high in the clouds to be sended over are shown.
A kind of intelligent vehicle-mounted fatigue monitoring system is provided in the embodiment of the present invention 2, system construction drawing is as described in Figure 1:
A kind of intelligence vehicle-mounted fatigue monitoring system, it is characterised in that the described method includes:Vehicle-mounted end, high in the clouds, Yong Huyi Moved end and supervision end;The vehicle-mounted end includes:Video acquisition module, coded treatment module, algorithm processing module, sensor system System, central processing unit and operation interface;The high in the clouds includes:Data transmission device, high in the clouds data sink and high in the clouds processing Device;The supervision end includes:Supervision department's data transmission device and supervision department's processor;The users' mobile end includes:Move Moved end data transmission module and mobile terminal operation interface;
The video acquisition module signal is connected to coded treatment module;The coded treatment module by signal is connected to algorithm Processing module;The algorithm processing module signal is connected to central processing unit;Signal is connected to behaviour to the central processing unit respectively Make interface, sensing system, prior-warning device and data transmission device;The data transmission device signal is connected to high in the clouds data and passes Defeated device;Signal is connected to mobile terminal data transmission module, cloud processor and supervision to the high in the clouds data transmission device respectively Department's processor;The mobile terminal data transmission module signal is connected to mobile terminal operation interface;The cloud processor signal It is connected to supervision department's data transmission device;Supervision department's data transmission device signal is connected to supervision department's processor.
The video acquisition module, for gathering the facial image information of driver, the image information got is sent To coded treatment module;The coded treatment module is used to carry out the facial image information received at digital video decoding Reason, the facial image information after processing is sent to algorithm processing module;The algorithm processing module, for passing through image recognition Algorithm docks received facial image information and carries out algorithm process, judges the state of mind of driver, will determine that result send to Central processing unit;The sensing system, including:Blood oxygen transducer and acidity-basicity sensor;The blood oxygen transducer is used for real When monitor human body blood oxygenation information, the blood oxygenation information monitored is sent to central processing unit;The acidity-basicity sensor is used for The pH value on human skin is monitored, the pH value monitored is sent to central processing unit;The central processing unit, is used In judging whether driver is currently in fatigue state according to the data message received, it will determine that result is respectively sent to operate Interface, prior-warning device and data transmission device;The operation interface, for showing judging result;The prior-warning device, for root It is judged that as a result issue warning signal.
The cloud processor, for by the data information memory that high in the clouds data transmission device sends in local, often Every some cycles, big data statistical analysis is carried out to being stored in local data message, analysis result is sent to supervision department Data transmission device;And receive the assessment result from supervision end, assessment result is stored in local, periodically ties the assessment Fruit is sent to users' mobile end.
Supervision department's processor, for the big data statistic analysis result sended over according to high in the clouds, to the driving The state of mind of personnel is artificially assessed, and assessment result is sent to cloud processor through high in the clouds data transmission device and is deposited Storage.
The users' mobile end operation interface, the assessment result for high in the clouds to be sended over are shown.
The image-recognizing method that the algorithm processing module uses comprises the following steps:
Step 1:The Face datection based on colour of skin cluster is carried out to the image information that coded treatment module sends over;
Step 2:According to Face datection as a result, being distributed according to eyes in the geometric position of face, the big position approximate of eyes is determined Put, reduce the regional extent of eyeball detection;
Step 3:In the eyeball search range of diminution, edge detection is carried out to ocular using edge detection algorithm, The marginal information of eye is extracted, and binary conversion treatment is carried out to it, then Connected component point is carried out to the ocular after binaryzation Analysis, the interference of circumference of eyes picture noise point is removed using the bianry image filtering method based on regional connectivity;
Step 4:According to improved integral projection algorithm, the distance of left and right canthus and upper palpebra inferior is calculated, determines driver Eyes open closed state;
Step 5:The flat rate of definition blink, and the detection of fatigue driving is realized accordingly.
The method for detecting human face based on colour of skin cluster comprises the following steps:
Step 1:The image collected from camera is rgb format, is realized using equation below and is converted to rgb format
Step 2:Equation below is recycled to detect the area of skin color of driver:
R > G&& | R-G | >=11
340≤S≤359P0≤S≤50
0.12≤T≤0.7&&0.3≤V≤1.0
Step 3:Then horizontal and vertical projection is carried out to face, determines the borderline region of face, border determines formula such as Under:
Wherein, h, w are respectively the height and width with the horizontal and vertical face area for projecting and trying to achieve.
The method that the eye area-of-interest determines comprises the following steps:
Step 1:Assuming that the human face region length detected is HF;Width is WF;
Step 2:In several vertical direction, eyes are located at more than face's half, the region of HF/5 below the crown.
Step 3:In the horizontal direction, eye borderline region must be positioned at apart from face left margin WF/8 go out to start to away from From the region at eye right margin WF/8.
A kind of intelligent vehicle-mounted fatigue monitoring system is provided in the embodiment of the present invention 3, system structure is as shown in Figure 1:
A kind of intelligence vehicle-mounted fatigue monitoring system, it is characterised in that the described method includes:Vehicle-mounted end, high in the clouds, Yong Huyi Moved end and supervision end;The vehicle-mounted end includes:Video acquisition module, coded treatment module, algorithm processing module, sensor system System, central processing unit and operation interface;The high in the clouds includes:Data transmission device, high in the clouds data sink and high in the clouds processing Device;The supervision end includes:Supervision department's data transmission device and supervision department's processor;The users' mobile end includes:Move Moved end data transmission module and mobile terminal operation interface;
The video acquisition module signal is connected to coded treatment module;The coded treatment module by signal is connected to algorithm Processing module;The algorithm processing module signal is connected to central processing unit;Signal is connected to behaviour to the central processing unit respectively Make interface, sensing system, prior-warning device and data transmission device;The data transmission device signal is connected to high in the clouds data and passes Defeated device;Signal is connected to mobile terminal data transmission module, cloud processor and supervision to the high in the clouds data transmission device respectively Department's processor;The mobile terminal data transmission module signal is connected to mobile terminal operation interface;The cloud processor signal It is connected to supervision department's data transmission device;Supervision department's data transmission device signal is connected to supervision department's processor.
The video acquisition module, for gathering the facial image information of driver, the image information got is sent To coded treatment module;The coded treatment module is used to carry out the facial image information received at digital video decoding Reason, the facial image information after processing is sent to algorithm processing module;The algorithm processing module, for passing through image recognition Algorithm docks received facial image information and carries out algorithm process, judges the state of mind of driver, will determine that result send to Central processing unit;The sensing system, including:Blood oxygen transducer and acidity-basicity sensor;The blood oxygen transducer is used for real When monitor human body blood oxygenation information, the blood oxygenation information monitored is sent to central processing unit;The acidity-basicity sensor is used for The pH value on human skin is monitored, the pH value monitored is sent to central processing unit;The central processing unit, is used In judging whether driver is currently in fatigue state according to the data message received, it will determine that result is respectively sent to operate Interface, prior-warning device and data transmission device;The operation interface, for showing judging result;The prior-warning device, for root It is judged that as a result issue warning signal.
The cloud processor, for by the data information memory that high in the clouds data transmission device sends in local, often Every some cycles, big data statistical analysis is carried out to being stored in local data message, analysis result is sent to supervision department Data transmission device;And receive the assessment result from supervision end, assessment result is stored in local, periodically ties the assessment Fruit is sent to users' mobile end.
Supervision department's processor, for the big data statistic analysis result sended over according to high in the clouds, to the driving The state of mind of personnel is artificially assessed, and assessment result is sent to cloud processor through high in the clouds data transmission device and is deposited Storage.
The users' mobile end operation interface, the assessment result for high in the clouds to be sended over are shown.
The image-recognizing method that the algorithm processing module uses comprises the following steps:
Step 1:The Face datection based on colour of skin cluster is carried out to the image information that coded treatment module sends over;
Step 2:According to Face datection as a result, being distributed according to eyes in the geometric position of face, the big position approximate of eyes is determined Put, reduce the regional extent of eyeball detection;
Step 3:In the eyeball search range of diminution, edge detection is carried out to ocular using edge detection algorithm, The marginal information of eye is extracted, and binary conversion treatment is carried out to it, then Connected component point is carried out to the ocular after binaryzation Analysis, the interference of circumference of eyes picture noise point is removed using the bianry image filtering method based on regional connectivity;
Step 4:According to improved integral projection algorithm, the distance of left and right canthus and upper palpebra inferior is calculated, determines driver Eyes open closed state;
Step 5:The flat rate of definition blink, and the detection of fatigue driving is realized accordingly.
The method for detecting human face based on colour of skin cluster comprises the following steps:
Step 1:The image collected from camera is rgb format, is realized using equation below and is converted to rgb format
Step 2:Equation below is recycled to detect the area of skin color of driver:
R > G&& | R-G | >=11
340≤S≤359P0≤S≤50
0.12≤T≤0.7&&0.3≤V≤1.0
Step 3:Then horizontal and vertical projection is carried out to face, determines the borderline region of face, border determines formula such as Under:
Wherein, h, w are respectively the height and width with the horizontal and vertical face area for projecting and trying to achieve.
The method that the eye area-of-interest determines comprises the following steps:
Step 1:Assuming that the human face region length detected is HF;Width is WF;
Step 2:In several vertical direction, eyes are located at more than face's half, the region of HF/5 below the crown.
Step 3:In the horizontal direction, eye borderline region must be positioned at apart from face left margin WF/8 go out to start to away from From the region at eye right margin WF/8.
The fatigue monitoring system that the present invention uses, it is accurate with monitoring, mainly commented except being used as using collection image monitoring Sentence beyond means, also added sensing system as auxiliary monitoring.Two monitoring results are integrated as judge means, The accuracy and science of monitoring can be greatly promoted.
The concept of big data and cloud storage is referred to fatigue monitoring by the present invention.Except for single fatigue driving into Beyond row early warning, multiple fatigue driving data can also be directed to, the number of fatigue driving in a period of time are counted, according to these Data send different degrees of early warning.
The present invention improves traditional image recognition algorithm, has been substantially carried out the face inspection based on colour of skin cluster Survey, eye area-of-interest determine, the edge detection based on Sobel operators, using improve integral projection algorithm determine right and left eyes Angle and the distance of upper palpebra inferior.The frequency of wink of driver is identified by these, and is driven according to frequency of wink come integrated judgment The degree of fatigue for the person of sailing.
Big data handling result and supervision department are attached by the present invention, and supervision department can be with real-time reception to driver The analysis of the long-term state of mind.And the data message of some high-risk drivers is extracted, and provided alert by supervision department, endangering Prevention effect is just played when sending in danger.
The invention is not limited in foregoing embodiment.The present invention, which expands to, any in the present specification to be disclosed New feature or any new combination, and disclose any new method or process the step of or any new combination.

Claims (6)

  1. A kind of 1. intelligence vehicle-mounted fatigue monitoring system, it is characterised in that the system comprises:Vehicle-mounted end, high in the clouds, user's movement End and supervision end;The vehicle-mounted end includes:Video acquisition module, coded treatment module, algorithm processing module, sensing system, Central processing unit and operation interface;The high in the clouds includes:Data transmission device, high in the clouds data sink and cloud processor; The supervision end includes:Supervision department's data transmission device and supervision department's processor;The users' mobile end includes:Mobile terminal Data transmission module and mobile terminal operation interface;
    The video acquisition module signal is connected to coded treatment module;The coded treatment module by signal is connected to algorithm process Module;The algorithm processing module signal is connected to central processing unit;Signal is connected to operation circle to the central processing unit respectively Face, sensing system, prior-warning device and data transmission device;The data transmission device signal is connected to high in the clouds data transfer dress Put;Signal is connected to mobile terminal data transmission module, cloud processor and supervision department to the high in the clouds data transmission device respectively Processor;The mobile terminal data transmission module signal is connected to mobile terminal operation interface;The cloud processor signal connection In supervision department's data transmission device;Supervision department's data transmission device signal is connected to supervision department's processor;
    The video acquisition module, for gathering the facial image information of driver, the image information got is sent to volume Code processing module;The coded treatment module is used to the facial image information received carrying out digital video decoding processing, Facial image information after processing is sent to algorithm processing module;The algorithm processing module, for being calculated by image recognition Method docks received facial image information and carries out algorithm process, judges the state of mind of driver, will determine that result is sent into Central processor;The sensing system, including:Blood oxygen transducer and acidity-basicity sensor;The blood oxygen transducer is used for real-time The blood oxygenation information of human body is monitored, the blood oxygenation information monitored is sent to central processing unit;The acidity-basicity sensor is used to supervise The pH value on human skin is surveyed, the pH value monitored is sent to central processing unit;The central processing unit, is used for Data message according to receiving judges whether driver is currently in fatigue state, will determine that result is respectively sent to operation circle Face, prior-warning device and data transmission device;The operation interface, for showing judging result;The prior-warning device, for basis Judging result issues warning signal;
    The image-recognizing method that the algorithm processing module uses comprises the following steps:
    Step 1:The Face datection based on colour of skin cluster is carried out to the image information that coded treatment module sends over;
    Step 2:According to Face datection as a result, being distributed according to eyes in the geometric position of face, the Position Approximate of eyes, contracting are determined The regional extent of microphthalmus detection;
    Step 3:In the eyeball search range of diminution, edge detection, extraction are carried out to ocular using edge detection algorithm The marginal information of eye, and binary conversion treatment is carried out to it, then Connected component analysis is carried out to the ocular after binaryzation, adopt The interference of circumference of eyes picture noise point is removed with the bianry image filtering method based on regional connectivity;
    Step 4:According to improved integral projection algorithm, the distance of left and right canthus and upper palpebra inferior is calculated, determines driver's eyes Open closed state;
    Step 5:The flat rate of definition blink, and the detection of fatigue driving is realized accordingly.
  2. 2. intelligence vehicle-mounted fatigue monitoring system as claimed in claim 1, it is characterised in that the cloud processor, is used for By the data information memory that high in the clouds data transmission device sends in local, every some cycles, to being stored in local number It is believed that breath carries out big data statistical analysis, analysis result is sent to supervision department's data transmission device;And receive from prison The assessment result of pipe end, is stored in local by assessment result, periodically sends the assessment result to users' mobile end.
  3. 3. intelligence vehicle-mounted fatigue monitoring system as claimed in claim 2, it is characterised in that supervision department's processor, For the big data statistic analysis result sended over according to high in the clouds, the state of mind of the driver is artificially assessed, Assessment result is sent to cloud processor through high in the clouds data transmission device and is stored.
  4. 4. intelligence vehicle-mounted fatigue monitoring system as claimed in claim 3, it is characterised in that the users' mobile end operates boundary Face, the assessment result for high in the clouds to be sended over are shown.
  5. 5. intelligence vehicle-mounted fatigue monitoring system as claimed in claim 1, it is characterised in that the people based on colour of skin cluster Face detecting method comprises the following steps:
    Step 1:The image collected from camera is rgb format, is realized using equation below and is converted to rgb format
    <mrow> <msub> <mi>S</mi> <mn>1</mn> </msub> <mo>=</mo> <msup> <mi>cos</mi> <mrow> <mo>-</mo> <mn>1</mn> </mrow> </msup> <mo>{</mo> <mfrac> <mrow> <mn>0.5</mn> <mo>*</mo> <mo>&amp;lsqb;</mo> <mrow> <mo>(</mo> <mi>R</mi> <mo>-</mo> <mi>G</mi> <mo>)</mo> </mrow> <mo>+</mo> <mrow> <mo>(</mo> <mi>R</mi> <mo>-</mo> <mi>B</mi> <mo>)</mo> </mrow> <mo>&amp;rsqb;</mo> </mrow> <msqrt> <mrow> <msup> <mrow> <mo>(</mo> <mi>R</mi> <mo>-</mo> <mi>G</mi> <mo>)</mo> </mrow> <mn>2</mn> </msup> <mo>+</mo> <mrow> <mo>(</mo> <mi>R</mi> <mo>-</mo> <mi>B</mi> <mo>)</mo> </mrow> <mo>*</mo> <mrow> <mo>(</mo> <mi>G</mi> <mo>-</mo> <mi>B</mi> <mo>)</mo> </mrow> </mrow> </msqrt> </mfrac> <mo>}</mo> </mrow>
    <mrow> <mi>T</mi> <mo>=</mo> <mfrac> <mrow> <mi>M</mi> <mi>a</mi> <mi>x</mi> <mrow> <mo>(</mo> <mi>R</mi> <mo>,</mo> <mi>G</mi> <mo>,</mo> <mi>B</mi> <mo>)</mo> </mrow> <mo>-</mo> <mi>M</mi> <mi>i</mi> <mi>n</mi> <mrow> <mo>(</mo> <mi>R</mi> <mo>,</mo> <mi>G</mi> <mo>,</mo> <mi>B</mi> <mo>)</mo> </mrow> </mrow> <mrow> <mi>M</mi> <mi>a</mi> <mi>x</mi> <mrow> <mo>(</mo> <mi>R</mi> <mo>,</mo> <mi>G</mi> <mo>,</mo> <mi>B</mi> <mo>)</mo> </mrow> </mrow> </mfrac> </mrow>
    <mrow> <mi>J</mi> <mo>=</mo> <mfrac> <mrow> <mi>M</mi> <mi>a</mi> <mi>x</mi> <mrow> <mo>(</mo> <mi>R</mi> <mo>,</mo> <mi>G</mi> <mo>,</mo> <mi>B</mi> <mo>)</mo> </mrow> </mrow> <mn>255</mn> </mfrac> </mrow>
    Step 2:Equation below is recycled to detect the area of skin color of driver:
    R > G&& | R-G | >=11
    340≤S≤359P0≤S≤50
    0.12≤T≤0.7&&0.3≤V≤1.0
    Step 3:Then horizontal and vertical projection is carried out to face, determines the borderline region of face, border determines that formula is as follows:
    <mrow> <mi>h</mi> <mo>=</mo> <mfenced open = "{" close = ""> <mtable> <mtr> <mtd> <mrow> <mn>1.25</mn> <mi>w</mi> </mrow> </mtd> <mtd> <mrow> <msup> <mi>h</mi> <mo>&amp;prime;</mo> </msup> <mo>&amp;NotElement;</mo> <mo>&amp;lsqb;</mo> <mn>0.8</mn> <mi>w</mi> <mo>,</mo> <mn>1.4</mn> <mi>w</mi> <mo>&amp;rsqb;</mo> </mrow> </mtd> </mtr> <mtr> <mtd> <msup> <mi>h</mi> <mo>&amp;prime;</mo> </msup> </mtd> <mtd> <mrow> <msup> <mi>h</mi> <mo>&amp;prime;</mo> </msup> <mo>&amp;Element;</mo> <mo>&amp;lsqb;</mo> <mn>0.8</mn> <mi>w</mi> <mo>,</mo> <mn>1.4</mn> <mi>w</mi> <mo>&amp;rsqb;</mo> </mrow> </mtd> </mtr> </mtable> </mfenced> </mrow>
    Wherein, h, w are respectively the height and width with the horizontal and vertical face area for projecting and trying to achieve.
  6. 6. intelligence vehicle-mounted fatigue monitoring system as claimed in claim 1, it is characterised in that the eye area-of-interest is true Fixed method comprises the following steps:
    Step 1:Assuming that the human face region length detected is HF;Width is WF;
    Step 2:In several vertical direction, eyes are located at more than face's half, the region of HF/5 below the crown;
    Step 3:In the horizontal direction, eye borderline region must be positioned at apart from face's left margin, and WF/8, which goes out, to be started to apart from eye Region at portion right margin WF/8.
CN201711164784.1A 2016-05-31 2016-05-31 A kind of intelligence vehicle-mounted fatigue monitoring method Pending CN107909772A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711164784.1A CN107909772A (en) 2016-05-31 2016-05-31 A kind of intelligence vehicle-mounted fatigue monitoring method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711164784.1A CN107909772A (en) 2016-05-31 2016-05-31 A kind of intelligence vehicle-mounted fatigue monitoring method
CN201610379858.2A CN105894735B (en) 2016-05-31 2016-05-31 Intelligent vehicle-mounted fatigue monitoring system and method

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201610379858.2A Division CN105894735B (en) 2016-05-31 2016-05-31 Intelligent vehicle-mounted fatigue monitoring system and method

Publications (1)

Publication Number Publication Date
CN107909772A true CN107909772A (en) 2018-04-13

Family

ID=56710989

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201711164784.1A Pending CN107909772A (en) 2016-05-31 2016-05-31 A kind of intelligence vehicle-mounted fatigue monitoring method
CN201610379858.2A Active CN105894735B (en) 2016-05-31 2016-05-31 Intelligent vehicle-mounted fatigue monitoring system and method

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201610379858.2A Active CN105894735B (en) 2016-05-31 2016-05-31 Intelligent vehicle-mounted fatigue monitoring system and method

Country Status (1)

Country Link
CN (2) CN107909772A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111800508A (en) * 2020-07-06 2020-10-20 广元量知汇科技有限公司 Automatic driving fault monitoring method based on big data

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106205057A (en) * 2016-09-21 2016-12-07 成都创慧科达科技有限公司 A kind of DAS (Driver Assistant System) based on ZigBee technology and method
CN106558190A (en) * 2016-12-06 2017-04-05 天津泓耘财科技发展有限公司 A kind of motor vehicles fatigue driving prewarning monitoring system
CN106976460A (en) * 2017-05-18 2017-07-25 益阳市首航电子科技有限公司 Safe driving of vehicle TT&C system
CN107918215A (en) * 2017-11-30 2018-04-17 西安科锐盛创新科技有限公司 Prevent the glasses of fatigue driving
CN108109077A (en) * 2017-12-29 2018-06-01 海南绿色能源与环境工程技术研究院 A kind of trans-regional clean energy resource internet system
CN108875541A (en) * 2018-03-16 2018-11-23 中国计量大学 A kind of visual fatigue detection algorithm based on virtual reality technology
CN108312964A (en) * 2018-03-21 2018-07-24 华南理工大学 A kind of fatigue driving state identification early warning system and method
CN110281944A (en) * 2019-06-12 2019-09-27 浙江亚太机电股份有限公司 Driver status based on multi-information fusion monitors system
CN111784984B (en) * 2020-06-09 2022-07-19 宁波吉利汽车研究开发有限公司 Distributed early warning system, method and device

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101520455A (en) * 2009-02-24 2009-09-02 徐加彬 Intelligent human-body acid-base detector and method for detecting parameters of physical and psychological health
CN103871122A (en) * 2014-03-11 2014-06-18 深圳市朗仁科技有限公司 Driving behavior analysis method and driving behavior analysis system
CN103886717A (en) * 2014-04-12 2014-06-25 合肥天海电气技术有限公司 Lighting adaptive fatigue driving detection system and detection method thereof
CN104217298A (en) * 2014-09-16 2014-12-17 浪潮集团有限公司 GPS government vehicle management system based on cloud storage
CN104268701A (en) * 2014-09-29 2015-01-07 清华大学 Commercial vehicle driving safety evaluation system and method
CN104442989A (en) * 2014-11-24 2015-03-25 京东方科技集团股份有限公司 Automobile steering wheel
CN104875744A (en) * 2015-04-28 2015-09-02 奇瑞汽车股份有限公司 Method and system for monitoring physical conditions of driver
CN105006103A (en) * 2015-06-15 2015-10-28 深圳市欧克勒亚科技有限公司 Traffic safety warning system
CN205158585U (en) * 2015-11-30 2016-04-13 宁波力芯科信息科技有限公司 Prevention driver fatigue's smart machine and system
CN105534531A (en) * 2014-10-29 2016-05-04 上海华博信息服务有限公司 Method and system for preventing fatigue driving

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101520455A (en) * 2009-02-24 2009-09-02 徐加彬 Intelligent human-body acid-base detector and method for detecting parameters of physical and psychological health
CN103871122A (en) * 2014-03-11 2014-06-18 深圳市朗仁科技有限公司 Driving behavior analysis method and driving behavior analysis system
CN103886717A (en) * 2014-04-12 2014-06-25 合肥天海电气技术有限公司 Lighting adaptive fatigue driving detection system and detection method thereof
CN104217298A (en) * 2014-09-16 2014-12-17 浪潮集团有限公司 GPS government vehicle management system based on cloud storage
CN104268701A (en) * 2014-09-29 2015-01-07 清华大学 Commercial vehicle driving safety evaluation system and method
CN105534531A (en) * 2014-10-29 2016-05-04 上海华博信息服务有限公司 Method and system for preventing fatigue driving
CN104442989A (en) * 2014-11-24 2015-03-25 京东方科技集团股份有限公司 Automobile steering wheel
CN104875744A (en) * 2015-04-28 2015-09-02 奇瑞汽车股份有限公司 Method and system for monitoring physical conditions of driver
CN105006103A (en) * 2015-06-15 2015-10-28 深圳市欧克勒亚科技有限公司 Traffic safety warning system
CN205158585U (en) * 2015-11-30 2016-04-13 宁波力芯科信息科技有限公司 Prevention driver fatigue's smart machine and system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
孙伟,张小瑞,唐慧强,张为公: "驾驶员眼部疲劳视觉检测算法及其ARM+DSP实现", 《电子技术应用》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111800508A (en) * 2020-07-06 2020-10-20 广元量知汇科技有限公司 Automatic driving fault monitoring method based on big data
CN111800508B (en) * 2020-07-06 2021-04-23 地上铁租车(深圳)有限公司 Automatic driving fault monitoring method based on big data

Also Published As

Publication number Publication date
CN105894735B (en) 2018-02-13
CN105894735A (en) 2016-08-24

Similar Documents

Publication Publication Date Title
CN107909772A (en) A kind of intelligence vehicle-mounted fatigue monitoring method
CN105448041B (en) A kind of falling over of human body intelligence control system and its method
CN106709420B (en) Method for monitoring driving behavior of commercial vehicle driver
CN104732251B (en) A kind of trainman&#39;s driving condition detection method based on video
CN104751600B (en) Anti-fatigue-driving safety means and its application method based on iris recognition
CN1275185C (en) Driver&#39;s face image identification and alarm device and method
CN102426757A (en) Safe driving monitoring system and method based on pattern recognition
CN109147279B (en) A method and system for driver fatigue driving monitoring and early warning based on Internet of Vehicles
CN108309311A (en) A kind of real-time doze of train driver sleeps detection device and detection algorithm
CN103824420A (en) Fatigue driving identification system based on heart rate variability non-contact measuring
CN112660157A (en) Multifunctional remote monitoring and auxiliary driving system for barrier-free vehicle
CN110751051A (en) An abnormal driving behavior detection method based on machine vision
CN105956548A (en) Driver fatigue state detection method and device
CN101916496A (en) System and method for detecting driving posture of driver
CN107229922A (en) A kind of fatigue driving monitoring method and device
CN107571977A (en) A kind of autonomous life saving system in middle-size and small-size waters and lifesaving method based on FPGA
CN110147738A (en) A kind of driver fatigue monitoring and pre-alarming method and system
CN212624073U (en) Safe driving early warning system
CN203838770U (en) Automobile data recorder
CN106485880A (en) Automobile driving safe early warning vehicle intelligent terminal
CN106408877A (en) Rail traffic driver fatigue state monitoring method
CN104376684A (en) Monitoring system capable of preventing fatigue driving
CN107585026A (en) A kind of anti-fatigue-driving system
CN205405809U (en) Driver fatigue detection alarm system based on intelligence wrist -watch
CN112381871B (en) Implementation method of locomotive vigilance device based on face recognition

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20180413