CN101885309A - Automotive Auxiliary Video Warning Device - Google Patents

Abstract

The invention relates to an automobile auxiliary video alarm device, which mainly utilizes a plurality of image acquisition elements to respectively acquire images at various angles around an automobile and sends the images to an on-board display for playing through the switching selection of a video switching unit so as to enlarge the sight range of a driver to the outside of the automobile; and analyzing the image of the specific angle outside the automobile by using a video identification unit to judge whether a moving object appears in the image and whether the distance of the moving object changes, and automatically starting an alarm according to the judgment result to inform a driver, so that when the vehicle in the adjacent lane changes lanes or abnormally crosses the lane, an alarm prompt is automatically generated for the driver in the driving process, and the driving safety is ensured.

Description

Automotive Auxiliary Video Warning Device

technical field

The invention relates to an automobile warning device, in particular to an automobile auxiliary video warning device.

Background technique

The applicant's previous application for the invention patent No. 93101312 "Automobile Auxiliary Video Device" in Taiwan, China mainly aims to solve the following problems:

When the driver is driving a car, the situation in front of the car needs to be judged by the driver himself. This method will not cause any problems in the environment with a wide field of vision, but when driving out of a narrow alley or turning at an excessive angle, the driver will not be able to see. To the environment outside the effective field of view, if a vehicle comes from the 90° direction at the alley, it is easy to cause a traffic accident.

Please refer to Fig. 7, when the vehicle A drives out of the lane, the field of view of the left front L, the right front R, and the front F are shown in Fig. 8 respectively. People obviously can't detect the vehicles coming from the 90° direction of the alley.

Again, when automobile backs up on the road section that turning angle is too large or when exiting from relatively narrow parking space, be affected by aforementioned factors, its danger still exists. As shown in Figure 9, when the vehicle A exits from the parking space, the field of view of the left rear L, the right rear R, and the front F is shown in Figure 10, and the driver of the vehicle A is also unable to perceive the 90° direction. coming vehicles.

In order to solve the foregoing problems, the aforementioned invention patent No. 93101312 "Automobile Auxiliary Video Device" mainly aims to effectively expand the range of sight of the driver's seat. The two video switching units are connected to two displays located on both sides of the driver's seat, and the switching of the two video switching units is controlled by a control unit, which is connected with a vehicle speed detector in addition to detecting the reverse gear and turning lights on and off.

In this way, when the car is running below a certain speed limit, the control unit will send the image of the front image acquisition unit to the display through the video switching unit to provide a larger front view. The display switches to play the images collected by the rear image acquisition components to check the situation behind the vehicle. Since the image acquisition components in the headlights are facing outward, it can effectively expand the driver’s seat’s line of sight.

Since the above-mentioned patent case can effectively eliminate traffic accidents caused by limited vision by expanding the range of sight of the driver's seat, and has outstanding technical features and obvious progress, the patent was approved and announced to obtain a Taiwan patent certificate (Certificate No.: I232818).

Although the above-mentioned patent case has made outstanding contributions to solving the traffic safety effect caused by the limited sight range, there are many factors that affect traffic safety, and the existing auxiliary devices are difficult to deal with complex driving conditions:

For example: the vehicle should generally drive in the middle of the lane dividing line (as shown in Figure 11), but it is easy for the driver to deviate from the driving lane without paying attention (as shown in Figure 12 when the vehicle deviates to the right lane dividing line). A collision with a vehicle in an adjacent lane. On the other hand, even if the vehicle A is driving according to the traffic lane, if the vehicle in the adjacent lane suddenly switches lanes or crosses the line (as shown in Figure 13 and Figure 14, Figure 13 shows the normal driving state, and Figure 14 shows the vehicle on the right side of the vehicle. vehicles suddenly cross the line), still prone to collisions. In the face of the aforementioned situation, the applicant's previously approved patent case has no significant effect.

Contents of the invention

The purpose of the present invention is to solve the technical problem that it is difficult for the existing car auxiliary video device to distinguish complicated driving conditions, thereby giving reminders to the driver.

In order to achieve the aforementioned purpose, the present invention provides a car auxiliary video warning device, including:

Multiple groups of image acquisition components, which collect images of the left front, right front, left rear, right rear and front rear of the car respectively;

A video recognition unit, which has a plurality of input terminals, and is respectively connected with each image acquisition element, and recognizes moving objects or abnormal conditions in images collected by each image acquisition element;

A control unit, whose input terminal is connected with the aforementioned video identification unit;

An alarm, controlled by the aforementioned control unit, sends out an audible and visual alarm to remind the driver;

A video switching unit, having a plurality of input ends, and being respectively connected with each image acquisition element;

A vehicle-mounted display connected to the output of the aforementioned video switching unit, which is located on the instrument control panel of the driver's seat, and will automatically display the content captured by the corresponding image acquisition element when the siren warns;

The beneficial effect of the present invention is that it can not only expand the driver's sight range, but also automatically recognize the dangerous situation in driving through the video recognition technology, and remind the driver through sound, thereby avoiding possible emergencies.

With the above-mentioned design, when the vehicle is driving in a narrow alley, since some image acquisition components are installed at the front of the vehicle (left and right front), the driver can observe the vehicle coming from the 90° direction of the alley in advance, and then The video recognition unit can automatically identify moving objects and give the driver a sound reminder, so it can effectively ensure the driving safety of the driver.

And when the vehicle is reversing on a road section with an excessively large turning angle or exiting from a relatively narrow parking space, since some image acquisition components are installed at the rear of the vehicle (left rear, right rear, and directly behind), the driver can also observe in advance For vehicles coming from behind the vehicle, the video recognition unit can also automatically identify moving objects and give the driver a sound or alarm reminder.

Furthermore, if the vehicle crosses the line while driving, the position of the lane dividing line in the captured image will change. When the video recognition unit finds that the lane dividing line is too close to the vehicle, it will automatically prompt the driver.

When the vehicle is driving, if the surrounding vehicles suddenly change lanes (or: the vehicle behind suddenly accelerates to approach the vehicle), the image of the vehicle in the collected image will become larger due to the lane change. When the video recognition unit finds that the size of the vehicle in the image exceeds the safe range or when the vehicle image suddenly becomes larger in a short period of time, the monitored lane-changing vehicle will be marked prominently on the screen, and the driver will be reminded by voice or alarm sound.

When the vehicle is driving forward, if the video recognition unit analyzes that the image of the vehicle captured by the side rear or directly rear image acquisition components suddenly becomes larger in a short period of time, the monitored vehicle that changes lanes will be marked on the screen in a conspicuous manner, and at the same time Remind the driver with voice or alarm tone.

The aforementioned control unit can be further connected with a vehicle speed detector. When the vehicle speed detector detects that the vehicle speed is lower than a set value, the control unit starts the image acquisition element of the front of the vehicle; when the vehicle speed is higher than the set value, it switches Start the image acquisition components at the rear of the vehicle to monitor the rear conditions during driving.

The control unit can further detect the status of the reverse gear, and can also be connected with a reverse radar.

Description of drawings

Fig. 1 is a block diagram of the present invention;

Fig. 2 is a schematic diagram of the installation of each image acquisition element of the present invention to each specific position on the automobile;

3A to 3D are schematic diagrams of identifying road conditions in the present invention;

Fig. 4 to Fig. 6 are the monitoring scope and the schematic diagram of monitoring screen of the present invention;

Fig. 7 is the road condition schematic diagram of automobile passing through the alley;

Fig. 8 is a schematic diagram of a driver's field of view of a car passing through an alley;

Fig. 9 is a schematic diagram of a car exiting from a parking space;

Figure 10 is a schematic view of the driver's field of vision when the car exits from the parking space;

11 to 14 are schematic diagrams showing the relationship between a car running in a car formation and vehicles in adjacent lanes.

Explanation of reference signs:

10-video recognition unit; 11-15-image acquisition components; 16-vehicle speed detector; 17-alarm; 20-video switching unit; 30-control unit; 40-vehicle display.

Detailed ways

Regarding a preferred embodiment of the present invention, see also shown in Fig. 1, mainly by a plurality of image acquisition components 11～15, a video recognition unit 10, a video switching unit 20, a control unit 30, a vehicle-mounted display 40 and One siren 17 is made up; Wherein:

Please refer to Fig. 2, the image acquisition elements 11-15 are located in the left front of the front, the right front of the front, the left rear of the rear, the right rear of the rear and the rear of the rear, wherein the left and right fronts and the left and right rears The image acquisition components 11-14 are arranged at an angle slightly towards the relative outside, so as to collect images in directions such as the left front, right front, left rear, right rear, etc. of the automobile, and the image acquisition elements directly behind are used to collect images directly behind the automobile; The image capture element can be a CCD or a CMOS image sensor.

The video switching unit 20 is connected between the image acquisition components 11-15 and the on-board display 40, and is controlled by the control unit 30, and the control unit 30 controls the video switching unit 20 to switch and select one of the image acquisition components. The images collected by it are sent to the vehicle-mounted display 40 for playback.

The video recognition unit 10 has a plurality of video input interfaces (not shown in the figure), and each video input interface is connected to each image acquisition element 11-15 respectively, so as to carry out calculation and analysis on the images collected by each image acquisition element 11-15, mainly The analysis content is whether there is a moving object in the image and the size change of the moving object, and the analysis result is sent back to the control unit 30, and the video recognition unit 10 is additionally connected to the control unit 30, and the control unit 30 controls the video recognition unit 10 to select and process Which image capture components 11-15 captures the image.

The control unit 30 determines the switching of the video switching unit 20 and the analysis object of the video recognition unit 10 according to information such as the vehicle speed, whether the vehicle is moving forward or backward, whether to turn or not. In this embodiment, the control unit 30 obtains the status of the reverse gear and the turn signal through the internal system of the vehicle as a reference for controlling the video switching unit 20 and the video recognition unit 10 . Control unit 30 is also connected with a vehicle speed detector 16, and this vehicle speed detector system is in order to detect the running speed of automobile, as the basis of controlling which road video is identified, assuming that 10 kilometers per hour (10km/h) is set value , when the speed of the vehicle is lower than the set value, it means that the automobile may arrive at the intersection and decelerate. At this time, the control unit 30 orders the video recognition unit 10 to identify the image collected by the front (left front, right front). If there is an abnormal situation in the image at this time, The video recognition unit 10 sends information to the control unit 20, and the alarm is generated by the control unit 20 through the siren 17; similarly, when the speed of the vehicle is still lower than the aforementioned set value, but the control unit 30 detects that the vehicle is in a reverse state, The control unit makes the video identification unit 10 select and connect the image acquisition elements at the rear (left rear, right rear, and directly behind). If there is an abnormal situation in the image at this time, the video identification unit 10 sends the information to the control unit 30, and the control unit The unit 30 generates an alarm through the alarm 17 to warn the driver.

Again, when the vehicle speed is higher than the set value, and not in the reversing state, the control unit 30 will order the video recognition unit 10 to connect the left rear, right rear, and rear image acquisition elements to identify the left rear, right rear, and front rear of the vehicle. For the front and rear images, when there are vehicles on the left, right, or front that are too close to the vehicle or the vehicle crosses the line, an alarm message will also be generated.

Furthermore, the on-vehicle display 40 can be set on the dashboard of the driver's seat of the car, and it is connected to the output end of the aforementioned video switching unit 30 to play the image selected and output by the video switching unit 30 .

The siren 17 is arranged on the output end of the control unit 30, and is used for generating warning information in the form of sound and/or light.

As can be seen from the above, the present invention separates image acquisition components at the front and rear of the car, and is connected to the video recognition unit respectively, and the video recognition unit 10 further analyzes whether there is an abnormal situation in the collected image (including: with the relative imaging angle) Objects moving in the 90° direction, fast approaching objects and crossing the line, etc.), and then warn the driver through the control unit 30; connection, when there are moving objects in the collected images, the moving objects become larger and the vehicle crosses the line, etc., the control unit 30 will not only activate the siren 17 to give an alarm, but also display the collected images in a conspicuous manner (such as a flashing frame) Line) indicates the moving object that triggered the alarm. As for the video recognition unit 10, the method for judging that the adjacent car is approaching and crossing the line is as follows:

Please refer to FIG. 3A to FIG. 3D , the video recognition unit 10 locates the contours of other vehicles around based on the following principles:

When the position of an image acquisition element 11-15 remains unchanged, the background image captured in a short period of time will remain unchanged, while the image of the moving object will change, so the difference between adjacent consecutive pictures can be used, A changing moving picture is obtained. Please refer to Figure 3A to Figure 3D for the vehicle positioning process; where:

FIG. 3A reveals the road condition diagram when there are no vehicles around, which is restored by the video recognition unit 10 using statistical characteristics. FIG. 3B is a road condition diagram when there are moving vehicles in the collected images. After comparing FIG. 3A with FIG. 3B, FIG. 3C can be obtained, wherein The white part is the moving object defined by the calculation, and the part in Figure 3C that does not conform to the characteristics of the vehicle is deleted, that is, the outline, size (as shown in the dotted box) and position of other dynamic vehicles in Figure 3D are located. The aforementioned Figures 3A to 3D are examples of monitoring vehicles coming from behind. When the positioned vehicle approaches quickly, the size of the vehicle in the image will rapidly increase, so that the control unit 30 can generate an alarm through the alarm 17. To inform the driver that there is a possibility of a collision with a car coming from behind, so that he can be more alert.

The images collected by the image acquisition components located at the left front and right front of the car can be used to monitor whether the car is running normally in the lane. Simultaneously, the position of the lane dividing line in the image is locked, once the car deviates from the lane, and the dividing line position changes (as shown in Figure 5), then the dividing line of the changed position will be marked with a dotted line frame on the display screen of the vehicle-mounted display 40, And at the same time, the alarm information of sound or light form is produced by siren 17 to notify the driver to pay attention.

The images collected by the image acquisition elements 11-14 located at the left front, left rear or right front and right rear of the automobile are then used to monitor the approximately parallel vehicle dynamics on the adjacent lanes (as shown in Figure 6). When the vehicle suddenly approaches, the size of the moving object (vehicle) in the image captured by the corresponding image acquisition component will rapidly enlarge and its relative position to the dividing line will also change. Therefore, except marking the locked vehicle with a dotted line frame on the display screen of the vehicle-mounted display 40 for identification, the warning information of the sound or light form is also produced by the siren 17 to notify the driver to pay attention.

Another function of the image acquisition components located at the front and rear of the car is to expand the driver's line of sight: since the image acquisition components of the front of the car are installed at the front end of the car and the shooting direction is towards the front left and front right, when the front of the car reaches the alley, the driver will That is, at the same time as the front of the car, the situation in front of the alley can be grasped. As for the rear image acquisition device, when the rear of the vehicle backs out of a parking space or a narrow alley, the rear image acquisition device can capture images other than the rear of the vehicle at the first time, so that the driver can grasp the situation behind the vehicle in advance.

It can be seen from the above that the present invention mainly uses the image acquisition components installed at the front/rear of the car to assist in monitoring the surrounding conditions of the car, and uses video recognition technology to control the road conditions in advance, thereby avoiding traffic accidents.

The above description of the present invention is illustrative rather than restrictive. Those skilled in the art understand that many modifications, changes or equivalents can be made to it within the spirit and scope of the claims, but they will all fall into within the protection scope of the present invention.

Claims (6)

1. A car auxiliary video warning device, characterized in that, comprising: Multiple sets of image acquisition components; A video identification unit, which has a plurality of input terminals, and is respectively connected to the image acquisition element, and recognizes moving objects or abnormal conditions in the images collected by the image acquisition element; A video switching unit, having a plurality of input ends, and being respectively connected with each image acquisition element; A control unit, respectively connected to the video identification unit and the video switching unit; An alarm, controlled by the control unit, sends out an audible and visual alarm to remind the driver; A vehicle-mounted display is connected with the output end of the video switching unit. 2. The automobile auxiliary video warning device as claimed in claim 1, wherein the video recognition unit judges whether there is a moving object on the adjacent lane for the images collected by the image acquisition elements of the right front, right rear or left front, left rear of the car Or if a moving object gets bigger quickly. 3. The car auxiliary video warning device according to claim 2, wherein the video recognition unit judges whether there is a moving object behind the car or whether the moving object rapidly grows in size based on the image collected by the image acquisition element directly behind the car. 4. The automobile auxiliary video warning device according to claim 3, wherein the control unit is connected with a vehicle speed detector to obtain the driving speed. 5. The auxiliary video warning device for automobiles as claimed in claim 4, wherein the control unit further obtains the state of the reverse gear and the state of the turn signal from the automobile. 6. The automobile auxiliary video warning device according to claim 5, wherein the siren generates warning information in the form of sound and/or light.

Images