CN103569084B - Driving detection device and method thereof - Google Patents

Abstract

A driving detection device and method thereof are suitable for a driving vehicle, and the driving detection device comprises: the camera shooting unit is used for sensing an image, and the image at least comprises a face image of a driver and a back image. The detection unit is used for detecting the face image of the driver to judge whether the driver falls asleep or not, judging whether the driving vehicle deviates from a lane or not according to the image behind the vehicle, and judging whether at least one nearby vehicle exists around the driving vehicle or not according to the image behind the vehicle. And the prompting unit sends out a warning signal when the detection unit judges that the driver falls asleep and the driving vehicle deviates from the lane. And a brake control unit, when the warning signal is generated by the prompting unit, the brake control unit controls the driving vehicle to brake when the driving vehicle does not have an approaching vehicle behind. The invention can give out warning for various situations in the driving process to avoid various dangers.

Description

Driving detection device and method thereof

technical field

The invention relates to a driving detection device and its method, which can be used for driving detection and image detection behind the vehicle while driving a vehicle to determine the driving state and whether it constitutes dangerous driving, so as to control the vehicle to perform automatic driving. Braking and satellite positioning records.

Background technique

In the car imaging system, a lens is often installed in the car to detect the driver's facial image, such as head sway, eye opening and closing, etc., to detect and judge whether the driver is inattentive driving, fatigue driving, drunkenness, etc. When the situation of driving and alternative driving occurs, if there is, the driver will be awakened by a warning device such as a buzzer.

However, judging whether the driver is tired or asleep only by the lens is easily affected by factors such as glasses and shooting angles. It is based on the previous technology that is supplemented by a physiological detection system to measure the driver's breath alcohol concentration, heart rate and other items. detection to increase the accuracy of driving detection.

What's more, in addition to the driving detection lens, an additional lens is added in front of the car to provide driving deviation warning and forward collision warning, so as to comprehensively judge whether a drowsy or drunk driver is causing dangerous driving. The buzzer sounds a warning.

However, in the implementation methods disclosed in the prior art, multiple lenses must be used to detect the individual situations of multiple images inside and outside the car. In addition to installing multiple lenses for detection, the required cost is also too high to meet the needs of consumers. Actual demand, in addition, warning with a buzzer can easily frighten a sleeping driver and increase the occurrence of accidents.

Therefore, based on the above-mentioned shortcomings, it is necessary to propose a device and method that only needs to use one lens to sense the images inside and behind the car. Dangerous situation and give warning to other vehicles, and can control the driving vehicle to perform automatic braking when there are no vehicles that are too close behind, so as to avoid accidents.

In addition, if it is detected that the driver is falling asleep, measures to passively wake up the driver's physiological functions are first adopted, and an active reminder method that is less likely to frighten the driver is adopted, thereby achieving the purpose of preventing accidents.

Contents of the invention

In view of the problems existing in the prior art, the present invention discloses a driving detection device and method, at least including:

A driving detection device is proposed, suitable for driving vehicles, which at least includes: a camera unit, a detection unit, a prompt unit and a brake control unit.

The camera unit is used for sensing an image, and the image at least includes a driver's face image and a vehicle rear image. The detection unit is used to detect the driver's facial image to determine whether a driver is asleep, to determine whether the vehicle has deviated from the lane according to the rear image, and to determine whether the vehicle has deviated from the vehicle rear image. Whether there is at least one passing vehicle around the driving vehicle mentioned above. The prompting unit sends out a warning signal when the detection unit determines that the driver is asleep and the driving vehicle deviates from the lane. In the braking control unit, after the warning signal is generated by the prompting unit, the braking control unit controls the driving vehicle to brake when there is no over-approaching vehicle behind the driving vehicle.

Wherein, the detection unit detects at least one feature of the driver's facial image to determine whether the feature meets a falling asleep threshold. And the detection unit judges whether the distance meets a deviation threshold according to a distance between a lane line of the image behind the vehicle and a traveling route of the driving vehicle.

Wherein, the prompt unit controls an air-conditioning control device of the driving vehicle to perform an air-conditioning cooling, or controls a window control device of the driving vehicle to open a window.

Wherein, the detecting unit judges that the driver is asleep, and the prompting unit controls a seat of the driving vehicle to remind the driver in a vibration mode or a seat belt tightening mode.

Wherein, the driving detection device further includes: an identity recognition unit, a satellite positioning unit and a network connection unit, the identity recognition unit is used to carry out a feature recognition on the driver's face image to determine a driving identity, and select at least one correspondent according to the driving identity. When the prompt unit sends out the warning signal, the satellite positioning unit records a current global satellite positioning address, and the network connection unit sends at least one emergency signal to the correspondent.

A driving detection method is proposed, which is applicable to a driving vehicle, at least including: using a camera unit to sense an image, and the image at least includes a driver's face image and a vehicle rear image. A detection unit is used to detect the driver's facial image to determine whether a driver is asleep. The detection unit is used to determine whether the driving vehicle deviates from a lane according to the rear image. Using the detection unit to determine whether there is at least one vehicle that is too close around the driving vehicle according to the image behind the vehicle. When it is judged that the driver is asleep and the vehicle deviates from the lane, a prompt unit is used to send out a warning signal. A braking control unit is used to control the braking of the driving vehicle when there is no vehicle behind the driving vehicle.

Wherein, the step of detecting the driver's facial image further includes: detecting at least one feature of the driving facial image, and judging whether the feature meets a falling asleep threshold. The step of judging whether the vehicle deviates from the lane further includes judging whether the distance meets a deviation threshold according to the distance between the lane line in the image behind the vehicle and the driving route of the vehicle, and if so, it means The vehicle deviates from the lane.

Wherein, the driving detection method of the present invention further includes: using the prompt unit to control an air-conditioning control device of the vehicle to perform an air-conditioning cooling, or control a window control device of the vehicle to open a window .

Wherein, the driving detection method of the present invention further includes: when it is judged that the driver is asleep, using the prompt unit to control a seat of the vehicle to remind in a vibration mode or a seat belt tightening mode Said driving.

Wherein, the driving detection method of the present invention further includes: using an identity recognition unit to identify at least one feature recognition of the driver's facial image to determine a driving identity, and select at least one correspondent according to the driving identity ; using a satellite positioning unit to record a global satellite positioning address when the warning signal is sent; and using a network connection unit to send at least one emergency signal to the correspondent.

The present invention can issue warnings for various situations during driving to avoid various dangers.

Description of drawings

The features and advantages of the present invention will become better understood when the following detailed description is read with reference to the accompanying drawings, in which:

FIG. 1 is a block diagram of a driving detection device of the present invention.

FIG. 2 is a block diagram of the driving detection device of the present invention.

FIG. 3 is a flow chart of the driving detection method of the present invention.

FIG. 4 is a schematic diagram of an embodiment of the driving detection device of the present invention.

FIG. 5 is a schematic diagram of another embodiment of the driving detection device of the present invention.

Explanation of the accompanying drawings:

101: camera unit; 102: image; 1021: driver's face image; 1022: rear image; 103: identification unit; 1031: falling asleep threshold; 1032: deviation threshold; 1033: too close to the vehicle; 104: Detection unit; 105: prompt unit; 106: warning signal; 107: satellite positioning unit; 1071: global satellite positioning address; 108: network connection unit; 1081: emergency signal; 1082: communication person; 109: brake control unit; 505A , 505B: lane line; 503, 504: rear vehicles; and 501: driver's face image.

Detailed ways

The detailed features and advantages of the present invention are described in detail below in the embodiments, the content of which is sufficient to enable anyone familiar with the relevant art to understand the technical content of the present invention and implement it accordingly, and according to the content disclosed in this specification, the claims of the application and the accompanying drawings , anyone skilled in the relevant art can easily understand the related objects and advantages of the present invention.

The driving detection device and method of the present invention will be described in detail below with reference to the accompanying drawings, and the same components will be denoted by the same symbols.

As shown in FIG. 1 , a block diagram of the driving detection device of the present invention. In FIG. 1 , the driving detection device of the present invention at least includes: a camera unit 101 , a detection unit 104 , a prompt unit 105 and a brake control unit 109 .

The camera unit 101 is arranged in the driving vehicle toward the rear of the driving vehicle, and at least includes a lens, a photosensitive component such as a complementary metal-oxide semiconductor component (Complementary Metal-Oxide-Semiconductor, CMOS) or a charge-coupled component (Charge- Coupled-Device (CCD), analog/digital circuit, image processor, etc. are used to sense an image 102 , and the image 102 at least includes a driver's face image 1021 and a vehicle rear image 1022 . The detection unit 104 is used to detect the driver's face image 1021, determine whether the driver is asleep, judge whether the vehicle deviates from the lane according to the rear image 1022, and judge whether there is at least one pass around the vehicle according to the rear image 1022. Near vehicle 1033. Among them, the detection of the driver's facial image 1021 is to detect information such as facial features such as eye closures, positions of organs such as nose and lips, and head angle of the driver's facial image 1021, and determine whether the driver's facial image 1021 is Meets a falling asleep threshold of 1031. The judgment of whether the vehicle deviates from the lane is based on a distance between the lane line in the image 1022 behind the vehicle and the vehicle's traveling route, and whether the distance meets a deviation threshold 1032 is judged.

If the driver's facial image 1021 meets the falling asleep threshold 1031 and the departure from the lane exceeds the departure threshold 1032, the prompt unit 105 sends a warning signal 106, which includes flashing lights or sounds to warn the surroundings. After receiving the warning signal 106, the brake control unit 109 uses the control signal to properly control the brake system and the accelerator system. When there is no over-approaching vehicle 1033, the driving vehicle is controlled to brake.

An example will be used below to illustrate the specific working principle of the driving detection device of the present invention. Please refer to Figure 2 and Figure 4 together. The driving detection device of this embodiment includes: a camera unit 101, a body recognition unit 103, a detection unit 104, a prompt unit 105, a satellite positioning unit 107, a network connection unit 108 and a brake control unit 109 .

Camera unit 101 is used for sensing an image 102, and this image 102 comprises driver's face image 1021 and car rear image 1022, prompting unit 105 can generate warning signal 106, satellite positioning unit 107 can generate global satellite positioning address 1071, network connection Unit 108 can send an emergency signal 1081 to correspondent 1082 .

In the driving detection device of this embodiment, a camera unit 101 is installed in the car for sensing an image 102, which includes a driver's facial image 1021 and a rear image 1022, as shown in FIG. 4 , the screen There is a driver's face image 501 , lane lines 505A and 505B behind the car, and a vehicle 503 behind. The identity recognition unit 103 will perform identity recognition based on the facial features of the driver's facial image 501 such as eyebrows, eyes, nose, lips, etc., confirm the current driver's identity, and select a correspondent 1082 as the one who sends the emergency signal 1081 Target. While the vehicle is moving, the detection unit 104 of the driving device detects the driver's face image 501 on the screen, and if it matches the facial features, the eyes, eyebrows, nose, and lips keep down continuously or intermittently for an indefinite period of time , Continuously or intermittently with the head tilted, that is, the driver's state meets the falling asleep threshold 1031, then it is determined that the driver is asleep. At this time, according to the lane lines 505A and 505B of the rear image 1022, the driving deviation detection is carried out. If the detected distance between the lane lines 505A, 505B and the driving route of the vehicle continues to exceed the preset deviation threshold 1032, the driving traffic is determined. The tool deviates from the lane, and the sleeping driver has met the standard of dangerous driving. At this time, the prompt unit 105 sends out a warning signal 106 outside the vehicle, such as continuously flashing lights, to remind surrounding vehicles. If the detection unit 104 judges whether there is a nearby vehicle 1033 based on the position of the rear vehicle 503 in the entire rear image 1022 frame, this is through prior image correction to know the relative position between any point in the rear image and the rear of the vehicle. distance, and then go to judge whether there is too close vehicle 1033 in the rear, if the detection unit 104 judges that there is no too close vehicle 1033 in the rear, then use the brake control unit 109, after receiving the warning signal 106, send a control signal to control the driving of the vehicle The accelerator and brake system apply the brakes to stop the dangerous driving situation of this vehicle. This driving detection device will also record the global satellite positioning address 1071 where the vehicle is at when the warning signal 106 is sent through the satellite positioning unit 107 after the warning signal 106 is sent by the prompt unit 105, and send an emergency signal 1081 to the default through the network connection unit 108. The correspondent 1082 allows others to know the satellite positioning of the vehicle and the situation of dangerous driving, so as to assist in handling as soon as possible and reduce the occurrence of accidents.

Next, another example will be used to illustrate the specific working principle of the driving detection device of the present invention. Please refer to Figure 1 and Figure 5 together.

The driving detection device of this embodiment senses an image 102 through the camera unit 101 taken from the front of the driver towards the rear of the car. This image 102 includes the driver's face image 1021 and the rear image 1022 of the car. The screen is detected, if the driver maintains a preset direction that is not facing the front view for a default period of time due to bowing his head or tilting his head, the detection unit 104 cannot detect the driver's facial features at all within the default time , that is, it is determined that the driver meets the falling asleep threshold 1031 . At this time, according to the distance between the lane lines 505A, 505B of the rear image 1022 of the vehicle and the driving route of the vehicle, the driving deviation detection is performed. Then it is determined that the driver who fell asleep has not met the standard of dangerous driving. At this time, use the prompt unit 105 to control the air-conditioning control device of the vehicle to reduce the temperature of the air conditioner in the car, or use the prompt unit 105 to control the vehicle window control device to open the window to increase the air convection in the car, so that the driver can get more. Awake with oxygen. But after a preset time, if the driver is still in the state of falling asleep threshold 1031, and according to the distance between the lane lines 505A, 505B of the rear image 1022 and the vehicle's driving route, the driving deviation detection is performed. When it is detected that the deviation distance between the lane lines 505A, 505B and the vehicle driving route meets the deviation threshold value 1032, it is determined that the driver who is asleep has met the standard of dangerous driving. At this time, the prompt unit 105 sends a warning signal 106 to the outside of the vehicle, for example Alert the surrounding vehicles with flashing warning light and continuous intermittent sound. If the detection unit 104 determines on the screen that the vehicle 504 approaching behind is already within a system default safe distance, it will continue to warn the vehicle 504 behind with a warning signal 106, and at this time no brake control will be performed until the vehicle 504 approaching behind When a system is outside the default safe distance, the brake control unit 109 is used to send a control signal to the brake and accelerator system of the vehicle to control the vehicle to brake, to reduce the accelerator function and automatically pre-pressurize the brake, etc., as much as possible Reduce the driving speed and stop the dangerous driving situation of this vehicle.

Next, another example will be used to illustrate the specific working principle of the driving detection device of the present invention, please refer to FIG. 1 and FIG. 4 together.

The driving detection device of this embodiment senses an image 102 through the camera unit 101 installed in the vehicle, which includes the driver's face image 1021 and the rear image 1022 of the vehicle behind the image 102 . Then, the detection unit 104 is used to detect the image, and if the driver's facial image 501 in the image blinks too frequently or the eyes are closed for too long, it is determined that the driver meets the falling asleep threshold 1031 . At this time, according to the distance between the lane lines 505A, 505B of the rear image 1022 and the vehicle's driving route, the vehicle deviation detection is performed. If the detected offset distance between the lane lines 505A, 505B and the vehicle's driving route does not meet the deviation threshold 1032, it is determined that the driver who is asleep has not yet met the standard of dangerous driving. At this time, the driving detection device utilizes the reminder prompt unit 105 to control the vehicle seat to remind the driver in a vibration mode or a seat belt tightening mode, such as steering wheel vibration, seat belt vibration, driver's seat vibration or seat belt tightening, etc., Allowing the driver to wake up from the state of falling asleep due to external disturbances. However, if the driver is still in the state of falling asleep threshold value 1031 after the above-mentioned reminder method, and according to the distance between the lane lines 505A, 505B of the rear image 1022 and the driving route of the vehicle, the driving deviation detection is performed. If it is detected that the offset distance between the lane lines 505A, 505B and the driving route of the vehicle meets a deviation threshold value 1032, then it is determined that the sleeping driver has met the standard of dangerous driving. At this time, the prompt unit 105 sends a warning signal 106 to the outside of the vehicle. For example, flashing warning lamps or continuous and intermittent sounds are used to remind surrounding vehicles. The detection unit 104 can know the relative distance between any point in the rear image of the car and the rear of the car through pre-image correction, which is based on the characteristics of the objects in the picture: for example, the rectangular front of the rear car, the width of the car, and the distance between the headlights are equal to the picture If it is determined that the approaching vehicle 503 is outside the default safe distance of a system, then after receiving the warning signal 106, the brake control unit 109 is used to control the brake system of the vehicle, for example, to reduce the accelerator function and automatically pre-pressurize Brake, reduce the driving speed as much as possible, and stop the dangerous driving situation of this vehicle.

Please refer to FIG. 3 , which is a flow chart of the driving detection method of this embodiment. The driving detection method according to this embodiment is applicable to a driving vehicle, which at least includes: in step S10, using a camera unit to sense an image, the image at least includes a driver's face image and a vehicle rear image . Then in step S12, a detection unit is used to detect the driver's facial image to determine whether the driver is asleep. In step S14, the detection unit is used to determine whether the driving vehicle deviates from the lane according to the image behind the vehicle. In step S16, the detection unit is used to determine whether there is at least one vehicle approaching around the vehicle according to the image behind the vehicle. In step S18, when it is judged that the driver is asleep and the vehicle deviates from the lane, a prompt unit is used to send out a warning signal. Finally, in step S20 , a brake control unit is used to control the driving vehicle to brake when there is no too close vehicle behind the vehicle.

The above description is only to illustrate the characteristics of the present invention by the embodiments, and its purpose is to enable those skilled in the art to understand the content of the present invention and implement it accordingly, rather than to limit the patent scope of the present invention. Therefore, any equivalent modifications or modifications that fail to deviate from the spirit disclosed in the present invention should still be included in the preceding claims.

Claims (6)

1. drive an arrangement for detecting, it is characterized in that, described driving arrangement for detecting at least comprises:

Image unit, described image unit sensing image, described image at least comprises image after chaufeur image of face and car;

Detecting unit, described detecting unit detect described chaufeur image of face with judge chaufeur whether sleeping, judge to drive a conveyance according to image after described car whether run-off-road and whether have at least to cross nearly vehicle arround driving a conveyance described in judging according to image after described car, described detecting unit detects at least one feature of described chaufeur image of face, to judge whether described feature meets sleeping threshold value; And described detecting unit is according to the distance between the lane mark of image after described car and the described course driven a conveyance, and judges whether described distance meets and departs from threshold value;

Tip element, described Tip element be when described in detect side unit determine described chaufeur fall asleep, and described in drive a conveyance run-off-road time, send alarm signal;

Brake control unit, described brake control unit is after producing described alarm signal when described Tip element, and drive a conveyance described in described brake control unit controls when the described rear that drives a conveyance vehicle near without described mistake brake;

Identity identification unit, described identity identification unit is used for carrying out feature identification to described chaufeur image of face and determines to drive identity, and selectes at least one communication people according to described driving identity;

Satellite positioning unit, when described Tip element sends described alarm signal, described satellite positioning unit record global positioning satellite address at that time; And

Network connection unit, when described Tip element sends described alarm signal, described network connection unit sends at least one emergency signal to described communication people.

2. drive arrangement for detecting as claimed in claim 1, it is characterized in that, the vehicle window control device that the air conditioning control device driven a conveyance described in described Tip element controls carries out driving a conveyance described in air-conditioning temperature-reducing or control carries out vehicle window unlatching.

3. drive arrangement for detecting as claimed in claim 1, it is characterized in that, described detecting unit judges that described chaufeur is fallen asleep, and the seat driven a conveyance described in described Tip element controls reminds described chaufeur with vibration mode or the safety strap mode of tightening up.

4. drive a method for detecting, it is characterized in that, described driving method for detecting at least comprises:

Use image unit sensing image, described image at least comprises image after chaufeur image of face and car;

Use detecting unit, described detecting unit is detected described chaufeur image of face and is judged whether chaufeur falls asleep, and described detecting unit detects at least one feature of described chaufeur image of face, judges whether described feature meets sleeping threshold value;

Use described detecting unit, to judge to drive a conveyance whether run-off-road according to image after described car, described detecting unit is according to lane mark in image after described car and the distance between the described course driven a conveyance, judge whether described distance meets and depart from threshold value, if so, drive a conveyance described in then representing run-off-road;

Use described detecting unit, arround driving a conveyance described in judging according to image after described car, whether have at least one to cross nearly vehicle;

Use Tip element, described Tip element be when judge described chaufeur fall asleep and described in drive a conveyance run-off-road time, send alarm signal;

Use brake control unit, described brake control unit is after receiving described alarm signal when described brake control unit, and drive a conveyance described in controlling when the described rear that drives a conveyance vehicle near without described mistake brake;

Use at least one feature identification of chaufeur image of face described in identity identification unit identification and determine to drive identity, and selecting at least one communication people according to described driving identity;

The record of use satellite positioning unit sends global positioning satellite address during described alarm signal; And

Network connection unit is used to send at least one emergency signal to described communication people.

5. drive method for detecting as claimed in claim 4, it is characterized in that, also comprise:

The vehicle window control device using the air conditioning control device driven a conveyance described in the control of described Tip element to carry out driving a conveyance described in air-conditioning temperature-reducing or control carries out vehicle window unlatching.

6. drive method for detecting as claimed in claim 4, it is characterized in that, also comprise:

When judging that described chaufeur is fallen asleep, the seat driven a conveyance described in the control of described Tip element is used to remind described chaufeur with vibration mode or the safety strap mode of tightening up.