CN103407407A - Automobile safety distance warning device and method based on binocular stereo vision - Google Patents
Automobile safety distance warning device and method based on binocular stereo vision Download PDFInfo
- Publication number
- CN103407407A CN103407407A CN2013103831638A CN201310383163A CN103407407A CN 103407407 A CN103407407 A CN 103407407A CN 2013103831638 A CN2013103831638 A CN 2013103831638A CN 201310383163 A CN201310383163 A CN 201310383163A CN 103407407 A CN103407407 A CN 103407407A
- Authority
- CN
- China
- Prior art keywords
- distance
- camera shooting
- binocular camera
- shooting head
- automobile
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 25
- 238000012545 processing Methods 0.000 claims description 18
- 230000008569 process Effects 0.000 claims description 9
- 238000005259 measurement Methods 0.000 abstract description 9
- 238000005516 engineering process Methods 0.000 abstract description 6
- 230000008901 benefit Effects 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 7
- 206010039203 Road traffic accident Diseases 0.000 description 5
- 238000003384 imaging method Methods 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 101100001082 Arabidopsis thaliana AED1 gene Proteins 0.000 description 1
- 101100001083 Arabidopsis thaliana AED3 gene Proteins 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000007430 reference method Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 238000011524 similarity measure Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Landscapes
- Traffic Control Systems (AREA)
Abstract
本发明一种基于双目立体视觉的汽车安全车距警示装置及方法，属于安全设备领域，通过双目摄像单元获取前方、后方车辆的图像，根据标定结果和对该对图像的匹配结果，得到最小距离，该最小距离值与安全距离比较，实现车内蜂鸣器报警和车尾部LED显示警示功能；本发明双目立体视觉测距具设备在成本方面具有很大的价格优势；立体视觉测距方法能够捕获汽车的图像信息，能够获得更多的信息量；此外结合摄像头、自动光圈和自动白平衡技术，可以在夜间、隧道等可视条件较差的条件下应用；因而本发明在汽车安全距离测量领域具有广阔的前景。
The invention relates to a binocular stereo vision-based vehicle safety vehicle distance warning device and method, which belong to the field of safety equipment. The images of the front and rear vehicles are obtained through a binocular camera unit, and according to the calibration result and the matching result of the pair of images, the obtained The minimum distance, the minimum distance value is compared with the safety distance to realize the buzzer alarm in the car and the LED display warning function at the rear of the car; the binocular stereo vision distance measuring device of the present invention has a great price advantage in terms of cost; the stereo vision measurement The distance method can capture the image information of the car, and can obtain more information; in addition, in combination with the camera, automatic aperture and automatic white balance technology, it can be applied under conditions with poor visibility such as night and tunnels; thus the present invention can be used in automobiles. The field of safety distance measurement has broad prospects.
Description
Technical field
The invention belongs to security appliance field, be specifically related to a kind of distance attention device of automotive safety based on binocular stereo vision and method.
Background technology
Along with the develop rapidly of China's economy and the people's flat the improving constantly of running water, automobile has entered huge numbers of families.Yet due to the sharply rising of volume of traffic, the frequent traffic thing occurred has caused huge loss also for broad masses of the people's the security of the lives and property.According to the statistics of China Daily, China is annual dies from traffic accident over 60000 people, and more than ten years become one of country that toll on traffic is maximum in the world continuously.Have research institution's research to find, the rear-end collision accident accounts for 35% of traffic accident sum, accounts for more than sixty percent especially in expressway traffic accident.
The major cause of rear-end collision accident is because chaufeur fails to keep safe vehicle headway.In order to reduce this type of accident rate, can pass through to install at head the distance of distance measurement equipment measuring and calculating front vehicles and one's own side's vehicle, and, in the time that spacing is less than safety distance, give Ben Che driver's alarm signal, with prompting Ben Che driver, maintain safe distance; The distance of distance measurement equipment measuring and calculating front vehicle and one's own side's vehicle is installed at afterbody, and, in the time that spacing is less than safety distance, gives rear car driver alarm signal, maintain safe distance with prompting rear car car driver.
At present, the technology for the range finding of vehicle mainly contains ultrasonic ranging, microwave radar range finding, laser ranging etc.Yet the ultrasonic fault detection principle is simple, cost is low, be subjected to weather effect large, be applicable to proximity detection; The microwave radar range finding easily is subjected to the interference in magnetic field larger; The laser ranging cost is higher, and it is larger affected by inclement weather.The binocular stereo vision ranging technology, not only price is lower, closes auto iris and AWB technology in conjunction with camera, can under the poor condition of the visual conditions such as night, tunnel, apply.Thereby technique of binocular stereoscopic vision is applied to the automobile safety distance fields of measurement and has broad prospects.
Summary of the invention
For the deficiencies in the prior art, the present invention proposes a kind of distance attention device of automotive safety based on binocular stereo vision and method, reaches the poor environment practicality such as the visual condition that reduces costs, improves the tunnel at night, plays the purpose that spacing is warned, reduced traffic accident.
A kind of distance attention device of automotive safety based on binocular stereo vision, comprise buzzer phone and keyboard, also comprises LED display after LED display in car, car, front side binocular camera shooting head, rear side binocular camera shooting head and central processing unit, wherein:
Front side binocular camera shooting head: be used to gathering the image in this automobile head the place ahead;
Rear side binocular camera shooting head: be used to gathering the image at this automobile tail rear;
Central processing unit: for front side binocular camera shooting head and rear side binocular camera shooting head are demarcated, four parameters of relative distance between the focal length of relative distance, rear side binocular camera shooting head and rear side binocular camera shooting head between the focal length of acquisition front side binocular camera shooting head, front side binocular camera shooting head; And the correct image to gathering, the image slices vegetarian refreshments is mated, obtain the parallax of each pixel on image; According to the parallax of pixel on above-mentioned four parameters and image, obtain distance between this automobile and front truck and distance with the rear car;
LED display in car: for according to user's request, safety distance being set;
LED display after car: keep a safe distance be used to pointing out the rear car personnel.
Three road input ends of described central processing unit connect respectively the mouth of the front side binocular camera shooting head that is positioned over automobile head, the rear side binocular camera shooting head mouth that is positioned over automobile tail and the mouth of keyboard; Three road mouths of central processing unit connect respectively the input end that is positioned over the buzzer phone in car, be positioned over the input end of LED display after the car of car rear seat windscreen below and be positioned over LED display input end in the car in car.
The method that employing is warned based on the automotive safety distance attention device of binocular stereo vision comprises the following steps:
Absolute value and the matching process of step 4, employing pixel gray scale difference mate two corresponding pixel points on two image polar curves, and then obtain the parallax between above-mentioned two pixels;
Calculate and front automobile between as follows apart from the Z formula:
Wherein, f is the focal length of front side binocular camera shooting head; D is relative distance between the binocular camera shooting head of front side; x
lFor the abscissa value of pixel in image in the binocular camera shooting head of front side, l means left side left; x
rFor the abscissa value of pixel in another image in the binocular camera shooting head of front side, r means right side right;
Calculate and the rear automobile between as follows apart from Z ' formula:
Wherein, f ' is the focal length of rear side binocular camera shooting head; D ' is relative distance between rear side binocular camera shooting head; X '
lFor the abscissa value of pixel in image in rear side binocular camera shooting head, l means left side left; X '
rFor the abscissa value of pixel in another image in rear side binocular camera shooting head, r means right side right.
Advantage of the present invention:
By head binocular camera shooting unit, obtain the image of two width front side vehicles, according to calibration result with to this matching result to image, can obtain the minor increment of Ben Che and front truck, this lowest distance value compares with the safety distance by keyboard to set up, if be less than safety distance, buzzer warning in car, point out Ben Che driver to slow down and go slowly, and maintains safe distance; By afterbody binocular camera shooting unit, obtain the image of two width car front vehicle, according to calibration result with to this matching result to image, can obtain the minor increment of Ben Che and rear car, this lowest distance value compares with the safety distance by keyboard to set up, if be less than safety distance, the LED of tailstock section shows information warning, and prompting rear car driver is slowed down and gone slowly, and maintains safe distance; Thereby patent of the present invention not only guaranteed the safety of this car and front truck, and for rear car, information warning is arranged equally.For avoiding or reducing traffic accident, ensure that numerous drivers and friend's passenger the security of the lives and property is significant.With existing other vehicle ranging methods, compare, binocular stereo vision range finding tool equipment has very large price advantage aspect cost; The stereoscopy passive ranging method can be caught the graphicinformation of automobile, can obtain more quantity of information.In addition in conjunction with camera, auto iris and AWB technology, can under the poor condition of the visual conditions such as night, tunnel, apply.Thereby the present invention has broad prospects in the automobile safety distance fields of measurement.
The accompanying drawing explanation
Fig. 1 is the integral structure block diagram of an embodiment of the present invention;
Fig. 2 is the schematic layout pattern of the each several part of an embodiment of the present invention;
Fig. 3 is the image acquisition hardware structure diagram of an embodiment of the present invention;
Fig. 4 is the AA7113 decoding circuit figure of an embodiment of the present invention;
Fig. 5 is the DSP schematic circuit diagram of an embodiment of the present invention;
Fig. 6 is the CPLD interface circuit figure of an embodiment of the present invention;
Fig. 7 is the rank scanning formula keyboard circuit figure of an embodiment of the present invention;
Fig. 8 is the buzzer circuit figure of an embodiment of the present invention;
Fig. 9 is the interior LED display circuit figure of the car of an embodiment of the present invention;
Figure 10 is the afterbody led read-out circuit diagram of an embodiment of the present invention;
Figure 11 is the parallel Binocular Stereo Vision System range finding illustraton of model of an embodiment of the present invention;
Figure 12 is the spacing of the automotive safety based on the binocular stereo vision alarming method for power diagram of circuit of an embodiment of the present invention;
Figure 13 is that the monocular-camera of an embodiment of the present invention is demarcated diagram of circuit;
Figure 14 is the image polar curve correction principle figure of an embodiment of the present invention.
The specific embodiment
Below in conjunction with accompanying drawing, an embodiment of the present invention is described further.
As shown in Figure 1, a kind of distance attention device of automotive safety based on binocular stereo vision, comprise buzzer phone and keyboard, also comprise LED display after LED display in car, car, front side binocular camera shooting head (comprising automobile left side of head camera and automobile right side of head camera), rear side binocular camera shooting head (comprising automobile tail left side camera and automobile tail right side camera) and central processing unit, wherein: front side binocular camera shooting head is for gathering the image in this automobile head the place ahead; Rear side binocular camera shooting head is for gathering the image at this automobile tail rear; Central processing unit is used for front side binocular camera shooting head and rear side binocular camera shooting head are demarcated, four parameters of relative distance between the focal length of relative distance, rear side binocular camera shooting head and rear side binocular camera shooting head between the focal length of acquisition front side binocular camera shooting head, front side binocular camera shooting head; And the correct image to gathering, the image slices vegetarian refreshments is mated, obtain the parallax of each pixel on image; According to the parallax of pixel on above-mentioned four parameters and image, obtain distance between this automobile and front truck and distance with the rear car; In car, LED display is for arranging safety distance according to user's request; After car, LED display is for pointing out the rear car personnel to keep a safe distance.
As shown in Figure 2, in car, LED display 4, keyboard 5, DSP and peripheral circuit 1 are arranged on instrument desk.In car, buzzer phone 3 is installed on the bearing circle below.In front side binocular camera shooting head 2, the camera of two same models is parallel to be fixed on headstock section bonnet.After car, LED display 6 is installed on tailstock section windshield.In rear side binocular camera shooting head 7, the camera of two same models is parallel to be fixed on the afterbody case cover.Three road input ends of described central processing unit connect respectively the mouth of the front side binocular camera shooting head that is positioned over automobile head, the rear side binocular camera shooting head mouth that is positioned over automobile tail and the mouth of keyboard; Three road mouths of central processing unit connect respectively the input end that is positioned over the buzzer phone in car, be positioned over the input end of LED display after the car of car rear seat windscreen below and be positioned over LED display input end in the car in car.
In the embodiment of the present invention, front side binocular camera shooting head and rear side binocular camera shooting head all adopt the CCD camera that four models are IRIT-N370S; The image obtained due to CCD is the image of analog signal, and DSP can not directly read analog signal, therefore analog signal need to be decoded as to digital signal.As shown in Figure 3, in the embodiment of the present invention, the inner decoding chip adopted of central processing unit is SAA7113.A slice SAA7113 chip, can be decoded into the analog picture signal that two-way CCD camera is sent here the standardized digital signal that DSP identifies; In the embodiment of the present invention, the dsp chip model that central processor adopts is TMS320DM642; Because data volume in image processing process is very large, and this DSP on-chip memory finite capacity, therefore can not meet memory requirement in image processing process.In the embodiment of the present invention, the TMS320DM642 chip core utilizes EMIFA bus expansion external memory storage FLASH and SDRAM.In the embodiment of the present invention, having expanded two sizes is that the 32MB model is the SDRAM of HY57V283220T-H, and the FLASH memory device, when power down, can wrap significant data and the program of depositing, and the embodiment of the present invention has been expanded the FLASH memory device of a slice AM29LV033C model.
In the embodiment of the present invention, as shown in Figure 4 and Figure 5, after the SAA7113 chip decoding be connected with automobile head camera, digital signal is transported to TMS320DM642 by the VP0 mouth.After the SAA7113 chip decoding be connected with the automobile tail camera, digital signal is transported to TMS320DM642 by VP1.In Fig. 4, the power supply of SAA7113 is divided into digital power (VCC) and analog power (VCCA), and its size is+3.3V, and pin 10,3,42 connects analog power ((VCCA); Pin 18,34,29,33 connects digital power (VCC).After pin 44 connects a 1k resistance, connect digital power (VCC).In figure, the corresponding ground wire of SAA7113 also is divided into digitally and in analog.Pin 11,2,41 and 6 connects in analog, and pin 16,28,30,35,37,8 connects digitally.Pin 26 connects digitally after connecing the resistance of a 3.3k.The input clock of SAA7113 chip is provided by the external active crystal oscillator, and big or small 24.576MHz, by pin 1 input.Pin 17 is connected with the VP0CLK0 pin of TMS320DM642 in Fig. 5, and the capable locking system clock by the 27MHz of pin 17 output, send to the catch clock of the VP0CLK0 pin of TMS320DM642 in Fig. 5 as video port.Pin 23,24 passes through I
2The C bus directly is connected with SCLO, the SDAO pin of TMS320DM642 chip in Fig. 5.After video analog signal connect a 18k resistance, the 47nF electric capacity of connecting, be input to the SAA7113 chip by pin 1.After video analog signal connects a 18k resistance, connect a 5.6k resistance, be connected in analog.Pin 4,9 is connected respectively after a 47nF electric capacity, is connected in analog.Decoded digital signal is by VP0[7:0] output, pin VP0D9, VP0D8, VP0D7, VP0D6, VP0D5, VP0D4, VP0D3 and the VP0D2 of TMS320DM642 chip in pin 12,13,14,15,19,20,21,22 difference map interlinkings 5.
The I/O interface resource of TMS320DM642 is limited, and the present invention needs LED display and buzzer phone in LED display after external connection keyboard, car, car, therefore need more I/O interface.In the embodiment of the present invention, adopt the CPLD chip to expand the I/O interface of TMS320DM642, the chip model of selecting is the EPM240T100I5N that ALTERA company produces.As shown in Figure 6, this chip is comprised of 100 pins, has expanded greatly the I/O interface.In patent of the present invention, after keyboard, car, LED display, the interior LED display of car directly are not connected with the I/O of DSP with buzzer phone, but are connected with the I/O after the CPLD expansion.
TMS320DM642 realized with being connected by external interface of CPLD, with Fig. 6 pin, was connected as follows in conjunction with Fig. 5.Pin AED0, the AED1 of dsp chip, AED2, AED3, AED4, AED5, AED6, AED7, EXT_INTER4, ACEI, ASWE are connected with the pin 1,2,3,4,5,6,7,8,27,28,29 of CPLD respectively.Pin AEA3, the AEA4 of dsp chip, AEA5, AEA6, AEA7, AEA8, AEA9, AEA10 are connected with the pin 15,16,17,18,19,20,21,26 of CPLD respectively.
In the embodiment of the present invention, keyboard is the rank scanning formula keyboard of 4x4, as shown in Figure 7, is comprised of 4 lines and 4 alignments, on each point of crossing, a button is set, totally 16 buttons.4 lines of rank scanning formula keyboard are connected with the pin 68,69,70,71 of CPLD respectively.4 alignments of rank scanning formula keyboard are connected with the pin 72,73,74,75 of CPLD respectively.
As shown in Figure 8, an end of the straight polarity of buzzer phone is connected to above the 5V power supply circuit of buzzer phone, and the other end is connected to the collector terminal of aerotron, transistor emitter ground connection, and base stage is connected with the pin 33 of CPLD after connecing the resistance of a 4.7k.Aerotron is selected the positive-negative-positive aerotron.
What in car, LED display adopted is that model is 1602 LCD, and physical circuit connects as shown in Figure 9.1602 pin 4,5,6,7,8,9,10,11,12,13,14 is connected with the pin 86,87,89,85,84,83,82,81,78,77,76 of CPLD respectively.1602, are connected with the LCD VCC of supply module respectively after the pull-up resistor of a 4.7k in parallel with every connection lead of CPLD.1602 pins 1 are connected with pin 3 after connecing the resistance of a 1k, and pin 2 is connected with the LCD VCC of supply module respectively with pin 15, pin 16 ground connection.
The LED dot matrix of the 8x8 that the afterbody LED display adopts, physical circuit connects as shown in figure 10. LED display pin 9,14,8,12,1,7,2,5 connects respectively the emitter of 8 positive-negative-positive aerotrons, base stage corresponding to aerotron, after the resistance of a 4.7k of series connection, is connected with the pin 86,87,89,91,92,95,96,97 of CPLD respectively.After the collecting electrode of 8 aerotrons connects together, be connected with the 3.3V supply module. LED display pin 13,3,4,10,6,11,15,16 has been connected respectively after the resistance of 100 Ω, with the pin 85,84,83,82,76,77,78,81 of CPLD, is connected respectively.
Figure 11 is parallel Binocular Stereo Vision System range finding illustraton of model.As shown in figure 11, the parallel placement of two cameras, camera coordinate system and left side camera photocentre point O
lOverlap, the focal length of pick up camera is f, the photocentre O of left and right cameras
lWith O
rSpacing is b (parallax range).(x
Cl, y
Cl, z
Cl) for take the system of axes that the left side camera photocentre sets up as initial point, (x
Cr, y
Cr, z
Cr) for take the system of axes that right side pick up camera photocentre sets up as initial point, (u, v) is the pixel coordinate system with the foundation of image center.P(x
w, y
w, z
w) be the object point in world coordinate system in reality scene, (x
w, y
w, z
w) be the position coordinate of P in the reality scene system of axes, some p
lWith a p
rBe respectively object point P (x
w, y
w, z
w) imaging point on left image and right image.X
lAnd x
rFor the abscissa of image coordinate system middle left and right image imaging point, y
lAnd y
rFor the ordinate of image coordinate system middle left and right image imaging point, parallax is d=x
l-x
r.According to Similar Principle of Triangle, can obtain the three-dimensional coordinate of spatial point under camera coordinate system suc as formula (3):
Wherein, (x
c, y
c, z
c) be exactly space mid point P (x
w, y
w, z
w) coordinate figure in camera coordinate system; z
cFor the depth value of required object point, required target range namely.
According to formula (3), can find out, as long as ask for parallax value according to the matching point of the correspondence in the image of left and right, just can utilize parallax range, focal length to obtain the coordinate of the three dimensional space point that object point is corresponding, just can obtain target range z
c.
The method that employing is warned based on the automotive safety distance attention device of binocular stereo vision as shown in figure 12, comprises the following steps:
In the embodiment of the present invention, employing be that the plane reference method that Zhang Zhengyou proposes is carried out camera calibration, the purpose that shooting is demarcated is the inside and outside parameter that obtains pick up camera, demarcating steps is as follows:
Step 1-1, print mark chessboard calibration plate.The scaling board that the embodiment of the present invention adopts is the gridiron pattern of angle point several 6 * 4, and the gridiron pattern size is 15mm * 15mm;
Step 1-2, build the binocular stereo vision unit, the left and right camera is taken scaling board at synchronization, preserves a pair of picture.After conversion scaling board angle and distance, repeat to take 12 times, preserve 12 pairs of pictures;
Step 1-3, respectively left and right photogra head is obtained to 12 pairs of images and carry out the monocular demarcation.Figure 13 is that monocular-camera is demarcated diagram of circuit.Idiographic flow is as follows:
The number of step 1-3-1, setting image to be calibrated is 12, sets chessboard angle point several 6 * 4;
Step 1-3-2, obtain a pending picture;
Step 1-3-3, carry out image characteristic point and obtain, comprise the extraction angle point, angular-point sub-pixelization and draw angle point;
Step 1-3-3, judge whether to obtain the characteristic point information of 12 width images; If be less than the characteristic point information of 12 width images, repeating step 1-3-2 and step 1-3-3; If obtained the characteristic point information of 12 width images, performed step 1-3-4;
Step 1-3-4, operation calibration algorithm, and preserve the calibration result mistake;
Step 1-4,12 pairs of left and right image is carried out respectively to the monocular demarcation, after obtaining calibration result; Can ask for accordingly the outer parameter of two pick up cameras, namely the position relationship of two cameras; Principle is suc as formula (4):
Wherein, R
l(rotating vector), t
l(translation vector) and R
r(rotating vector), t
r(rotating vector) means respectively the relative position of the monocular demarcation right camera coordinate system of rear left and world coordinate system.Rotation amount R and translational movement T mean the relative position relation between two pick up cameras.
Before Stereo matching, in order to improve matching precision, reduce match time, reduce camera and move up and down the impact on matching algorithm, image rectification is a step very important before Stereo matching.The image rectification principle as shown in figure 14.
In Figure 14, P
lAnd P
rFor the imaging point of spatial point, O
lAnd O
rFor the left and right cameras coordinate origin.Point P, O
lAnd O
rForm triangular facet, and form intersection l with the left and right image
l, l
r, be polar curve.Wherein, l
lBe called P
rCorresponding polar curve, l
rFor P
lCorresponding polar curve, l
lAnd l
rEach other to polar curve.On triangular facet, get 1 P', this subpoint on the image of left and right is respectively P '
lAnd P
r, and P '
lAnd P
rAll, on polar curve, adopt the method, when coupling, the search coverage of matching point is narrowed down to the one dimension straight line by two bit planes, reduced search time, improved matching precision.
The purpose of Stereo matching is to obtain parallax, and asks the process of parallax can be considered as the process of template matches.In a pair of image of catching at the same time, take in left-side images centered by point to be matched and set up a size and be (2m+1) * (2n+1) window.In image right, with onesize window search, finding a corresponding point of the most similar window is exactly optimal match point along corresponding polar curve.
The similarity measure function that the embodiment of the present invention is chosen is the poor absolute value of pixel grey scale and SAD.It is little that it has calculated amount, fireballing advantage.The expression formula of SAD (pixel grey scale poor absolute value and) algorithm is formula (5):
Wherein, in formula, d is parallax, I
l(.) is the grey scale pixel value to be matched in left figure, I
r(.) is the grey scale pixel value of the matching point in right figure.The pixel number of i for moving along image transverse axis x, the pixel number of j for moving along image longitudinal axis y.Take in left-side images centered by point to be matched and set up a size and be (2m+1) * (2n+1) window, is (2m+1) total number of the capable pixel of this window, (2n+1) total number of this window column pixel.
Calculate and front automobile between as follows apart from the Z formula:
Wherein, f is the focal length of front side binocular camera shooting head; D is relative distance between the binocular camera shooting head of front side; x
lFor the abscissa value of pixel in image in the binocular camera shooting head of front side, l means left side left; x
rFor the abscissa value of pixel in another image in the binocular camera shooting head of front side, r means right side right;
Calculate and the rear automobile between as follows apart from Z ' formula:
Wherein, f ' is the focal length of rear side binocular camera shooting head; D ' is relative distance between rear side binocular camera shooting head; X '
lFor the abscissa value of pixel in image in rear side binocular camera shooting head, l means left side left; X '
rFor the abscissa value of pixel in another image in rear side binocular camera shooting head, r means right side right;
The factor that affects vehicle stopping distance has a lot, as the speed of a motor vehicle, road conditions, weather, load-carrying and driver's speed of response etc.Generally, safety distance can be selected to be consistent with speed of a motor vehicle milimeter number.For example, 40 kilometers speed of a motor vehicle keep 40 meters, and 60 kilometers speed of a motor vehicle keep 60 meters, if the speed of a motor vehicle higher than 100 kilometers, safety distance will remain on 150 to 200 meters.Thereby safety distance also is not quite similar under different conditions, need to carry out constantly to set the safety distance occurrence according to current various influence factors.
By keyboard to set up safety distance numerical value, in the embodiment of the present invention, safety distance is 40 meters, utilizes keyboard input 40, and information is passed to central process unit DSP; DSP storage safe range information, and this value is sent to LED display demonstration occurrence in car; As DSP memory allocated space storage security distance, be the value of 40 meters correspondences, this value compares for the distance value (comprising the distance value of Ben Che and front truck and the distance value of Ben Che and rear car) with actual measurement, to be confirmed whether to be less than safety distance.In order to confirm the whether input error of safety distance setting value, this value is delivered to LED display in car and show.
Central process unit DSP calculates the minor increment of front truck and this car according to the binocular stereo vision range measurement principle, and the memory allocated space, preserves this distance values.Whether the front truck that judgement calculates and the distance value of this car are less than the safety distance value by keyboard to set up, if the distance value calculated is less than the safety distance value, DSP sends actuating signal to buzzer phone in car, buzzer phone sounding in car, with caution Ben Che driver, slow down and go slowly, maintain safe distance.
Central process unit DSP calculates the minor increment of rear car and this car according to the binocular stereo vision range measurement principle, and the memory allocated space, preserves this distance values.Whether the rear car that judgement calculates and the distance value of this car are less than the safety distance value by keyboard to set up.If the distance value calculated is less than the safety distance value, DSP sends actuating signal to the afterbody LED display, and the afterbody LED display shows information warning: slow down and go slowly, maintain safe distance.With driver's deceleration after warning this, go slowly, maintain safe distance.
Claims (4)
1. distance attention device of the automotive safety based on binocular stereo vision, comprise buzzer phone and keyboard, it is characterized in that: also comprise LED display after LED display in car, car, front side binocular camera shooting head, rear side binocular camera shooting head and central processing unit, wherein:
Front side binocular camera shooting head: be used to gathering the image in this automobile head the place ahead;
Rear side binocular camera shooting head: be used to gathering the image at this automobile tail rear;
Central processing unit: for front side binocular camera shooting head and rear side binocular camera shooting head are demarcated, four parameters of relative distance between the focal length of relative distance, rear side binocular camera shooting head and rear side binocular camera shooting head between the focal length of acquisition front side binocular camera shooting head, front side binocular camera shooting head; And the correct image to gathering, the image slices vegetarian refreshments is mated, obtain the parallax of each pixel on image; According to the parallax of pixel on above-mentioned four parameters and image, obtain distance between this automobile and front truck and distance with the rear car;
LED display in car: for according to user's request, safety distance being set;
LED display after car: keep a safe distance be used to pointing out the rear car personnel.
2. the distance attention device of the automotive safety based on binocular stereo vision according to claim 1, it is characterized in that: three road input ends of described central processing unit connect respectively the mouth of the front side binocular camera shooting head that is positioned over automobile head, the rear side binocular camera shooting head mouth that is positioned over automobile tail and the mouth of keyboard; Three road mouths of central processing unit connect respectively the input end that is positioned over the buzzer phone in car, be positioned over the input end of LED display after the car of car rear seat windscreen below and be positioned over LED display input end in the car in car.
3. the method that adopts the distance attention device of the automotive safety based on binocular stereo vision claimed in claim 1 to warn is characterized in that: comprise the following steps:
Step 1, employing central processing unit are demarcated front side binocular camera shooting head and rear side binocular camera shooting head respectively, and then obtain four parameters of relative distance between the focal length of relative distance, rear side binocular camera shooting head between the focal length, front side binocular camera shooting head of front side binocular camera shooting head and rear side binocular camera shooting head, and preserve;
Step 2, employing front side binocular camera shooting head gather the image in this automobile head the place ahead, adopt rear side binocular camera shooting head to gather the image at this automobile tail rear;
Step 3, adopt the correct image of polar curve correcting mode to above-mentioned collection, and then obtain a certain measured point and correspond to respectively two polar curves that are corrected pixel place on image;
Absolute value and the matching process of step 4, employing pixel gray scale difference mate two corresponding pixel points on two image polar curves, and then obtain the parallax between above-mentioned two pixels;
Step 5, repeating step 3 are to step 4 until obtain the parallax of all pixels on image;
Step 6, according to the parallax of four parameters that obtain in step 1 and pixel, obtain between this automobile and front automobile distance and and the rear automobile between distance;
Step 7, get with the front automobile distance value in minimum distance as the distance value of final and front automobile; Get with rear automobile distance value in minimum distance as the distance value of final and rear automobile;
Step 8, the required safety distance value of setting according to the user, the distance value of judgement and front automobile whether in the safety distance scope, if, return to execution step 2, otherwise DSP sends a signal to buzzer phone, realize reporting to the police; Whether judgement and the distance value of rear automobile be in the safety distance scope, if return to execution step 2, otherwise DSP sends a signal to LED display after car, realizes the prompting to the rear car personnel.
4. the method warned based on the automotive safety distance attention device of binocular stereo vision of employing according to claim 3, it is characterized in that: step 6 described according in step 1, obtaining four parameters and the parallax of pixel, obtain between this automobile and front automobile distance and and the rear automobile between distance;
Calculate and front automobile between as follows apart from the Z formula:
Wherein, f is the focal length of front side binocular camera shooting head; D is relative distance between the binocular camera shooting head of front side; x
lFor the abscissa value of pixel in image in the binocular camera shooting head of front side, l means left side left; x
rFor the abscissa value of pixel in another image in the binocular camera shooting head of front side, r means right side right;
Calculate and the rear automobile between as follows apart from Z ' formula:
Wherein, f ' is the focal length of rear side binocular camera shooting head; D ' is relative distance between rear side binocular camera shooting head; X '
lFor the abscissa value of pixel in image in rear side binocular camera shooting head, l means left side left; X '
rFor the abscissa value of pixel in another image in rear side binocular camera shooting head, r means right side right.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013103831638A CN103407407A (en) | 2013-08-28 | 2013-08-28 | Automobile safety distance warning device and method based on binocular stereo vision |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013103831638A CN103407407A (en) | 2013-08-28 | 2013-08-28 | Automobile safety distance warning device and method based on binocular stereo vision |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103407407A true CN103407407A (en) | 2013-11-27 |
Family
ID=49600471
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2013103831638A Pending CN103407407A (en) | 2013-08-28 | 2013-08-28 | Automobile safety distance warning device and method based on binocular stereo vision |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103407407A (en) |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105716568A (en) * | 2016-01-28 | 2016-06-29 | 武汉光庭信息技术股份有限公司 | Binocular camera ranging method in automatic pilot system |
| CN105882516A (en) * | 2015-11-13 | 2016-08-24 | 乐卡汽车智能科技（北京）有限公司 | Vehicle collision early-warning method and device, and vehicle |
| CN106297409A (en) * | 2016-08-16 | 2017-01-04 | 广州小鹏汽车科技有限公司 | A kind of Intelligent traffic safety device and its implementation |
| CN106709905A (en) * | 2016-12-07 | 2017-05-24 | 成都通甲优博科技有限责任公司 | Vibration-proof hammer fault online detection and identification method based on binocular vision image |
| CN107146247A (en) * | 2017-05-31 | 2017-09-08 | 西安科技大学 | Vehicle auxiliary driving system and method based on binocular camera |
| CN107839690A (en) * | 2017-10-31 | 2018-03-27 | 珠海格力电器股份有限公司 | Driving safety distance prompting method and device |
| CN107884767A (en) * | 2017-10-31 | 2018-04-06 | 暨南大学 | A kind of method of binocular vision system measurement ship distance and height |
| CN108189757A (en) * | 2018-01-03 | 2018-06-22 | 潘荣兰 | A kind of driving safety prompt system |
| CN108528448A (en) * | 2017-03-02 | 2018-09-14 | 比亚迪股份有限公司 | Vehicle travels autocontrol method and device |
| CN108859963A (en) * | 2018-06-28 | 2018-11-23 | 深圳奥尼电子股份有限公司 | Multifunctional driving assistance method, multifunctional driving assistance device, and storage medium |
| CN108860045A (en) * | 2018-06-28 | 2018-11-23 | 深圳奥尼电子股份有限公司 | Driving support method, driving support device, and storage medium |
| CN108944765A (en) * | 2017-05-19 | 2018-12-07 | 郭宇铮 | A kind of dual camera real-time early warning car crass system |
| CN109747530A (en) * | 2017-11-02 | 2019-05-14 | 郭宇铮 | A kind of dual camera and millimeter wave merge automobile sensory perceptual system |
| CN109813277A (en) * | 2019-02-26 | 2019-05-28 | 北京中科慧眼科技有限公司 | Construction method, distance measuring method, device and the automated driving system of ranging model |
| CN109978934A (en) * | 2019-03-04 | 2019-07-05 | 北京大学深圳研究生院 | A kind of binocular vision solid matching method and system based on matching cost weighting |
| CN110738704A (en) * | 2019-10-29 | 2020-01-31 | 福建省汽车工业集团云度新能源汽车股份有限公司 | vehicle-mounted lens-free binocular imaging method and automobile thereof |
| CN113610901A (en) * | 2021-07-07 | 2021-11-05 | 江西科骏实业有限公司 | Binocular motion capture camera control device and all-in-one machine equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2003064216A1 (en) * | 2002-02-01 | 2003-08-07 | Robert Bosch Gmbh | Device for identifying the risk of a rollover |
| US20030154011A1 (en) * | 2002-02-13 | 2003-08-14 | Ford Global Technologies, Inc. | Method for operating a pre-crash sensing system in a vehicle having a countermeasure system using stereo cameras |
| US20070080968A1 (en) * | 2005-10-06 | 2007-04-12 | Fuji Jukogyo Kabushiki Kaisha | Collision determination device and vehicle behavior control device |
| CN102069770A (en) * | 2010-12-16 | 2011-05-25 | 福州名品电子科技有限公司 | Automobile active safety control system based on binocular stereo vision and control method thereof |
| CN102390370A (en) * | 2011-10-25 | 2012-03-28 | 河海大学 | Stereoscopic vision based emergency treatment device and method for running vehicles |
| CN102490673A (en) * | 2011-12-13 | 2012-06-13 | 中科院微电子研究所昆山分所 | Vehicle active safety control system based on internet of vehicles and control method of vehicle active safety control system |
-
2013
- 2013-08-28 CN CN2013103831638A patent/CN103407407A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2003064216A1 (en) * | 2002-02-01 | 2003-08-07 | Robert Bosch Gmbh | Device for identifying the risk of a rollover |
| US20030154011A1 (en) * | 2002-02-13 | 2003-08-14 | Ford Global Technologies, Inc. | Method for operating a pre-crash sensing system in a vehicle having a countermeasure system using stereo cameras |
| US20070080968A1 (en) * | 2005-10-06 | 2007-04-12 | Fuji Jukogyo Kabushiki Kaisha | Collision determination device and vehicle behavior control device |
| CN102069770A (en) * | 2010-12-16 | 2011-05-25 | 福州名品电子科技有限公司 | Automobile active safety control system based on binocular stereo vision and control method thereof |
| CN102390370A (en) * | 2011-10-25 | 2012-03-28 | 河海大学 | Stereoscopic vision based emergency treatment device and method for running vehicles |
| CN102490673A (en) * | 2011-12-13 | 2012-06-13 | 中科院微电子研究所昆山分所 | Vehicle active safety control system based on internet of vehicles and control method of vehicle active safety control system |
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105882516A (en) * | 2015-11-13 | 2016-08-24 | 乐卡汽车智能科技（北京）有限公司 | Vehicle collision early-warning method and device, and vehicle |
| CN105716568A (en) * | 2016-01-28 | 2016-06-29 | 武汉光庭信息技术股份有限公司 | Binocular camera ranging method in automatic pilot system |
| CN106297409A (en) * | 2016-08-16 | 2017-01-04 | 广州小鹏汽车科技有限公司 | A kind of Intelligent traffic safety device and its implementation |
| CN106709905A (en) * | 2016-12-07 | 2017-05-24 | 成都通甲优博科技有限责任公司 | Vibration-proof hammer fault online detection and identification method based on binocular vision image |
| CN106709905B (en) * | 2016-12-07 | 2020-03-31 | 成都通甲优博科技有限责任公司 | Vibration damper fault online detection and identification method based on binocular vision image |
| CN108528448A (en) * | 2017-03-02 | 2018-09-14 | 比亚迪股份有限公司 | Vehicle travels autocontrol method and device |
| CN108944765A (en) * | 2017-05-19 | 2018-12-07 | 郭宇铮 | A kind of dual camera real-time early warning car crass system |
| CN107146247A (en) * | 2017-05-31 | 2017-09-08 | 西安科技大学 | Vehicle auxiliary driving system and method based on binocular camera |
| CN107839690A (en) * | 2017-10-31 | 2018-03-27 | 珠海格力电器股份有限公司 | Driving safety distance prompting method and device |
| CN107884767A (en) * | 2017-10-31 | 2018-04-06 | 暨南大学 | A kind of method of binocular vision system measurement ship distance and height |
| CN109747530A (en) * | 2017-11-02 | 2019-05-14 | 郭宇铮 | A kind of dual camera and millimeter wave merge automobile sensory perceptual system |
| CN108189757A (en) * | 2018-01-03 | 2018-06-22 | 潘荣兰 | A kind of driving safety prompt system |
| CN108860045A (en) * | 2018-06-28 | 2018-11-23 | 深圳奥尼电子股份有限公司 | Driving support method, driving support device, and storage medium |
| CN108859963A (en) * | 2018-06-28 | 2018-11-23 | 深圳奥尼电子股份有限公司 | Multifunctional driving assistance method, multifunctional driving assistance device, and storage medium |
| CN108860045B (en) * | 2018-06-28 | 2021-08-17 | 深圳奥尼电子股份有限公司 | Driving support method, driving support device, and storage medium |
| CN109813277A (en) * | 2019-02-26 | 2019-05-28 | 北京中科慧眼科技有限公司 | Construction method, distance measuring method, device and the automated driving system of ranging model |
| CN109813277B (en) * | 2019-02-26 | 2021-07-16 | 北京中科慧眼科技有限公司 | Construction method of ranging model, ranging method and device and automatic driving system |
| CN109978934A (en) * | 2019-03-04 | 2019-07-05 | 北京大学深圳研究生院 | A kind of binocular vision solid matching method and system based on matching cost weighting |
| CN109978934B (en) * | 2019-03-04 | 2023-01-10 | 北京大学深圳研究生院 | Binocular vision stereo matching method and system based on matching cost weighting |
| CN110738704A (en) * | 2019-10-29 | 2020-01-31 | 福建省汽车工业集团云度新能源汽车股份有限公司 | vehicle-mounted lens-free binocular imaging method and automobile thereof |
| CN113610901A (en) * | 2021-07-07 | 2021-11-05 | 江西科骏实业有限公司 | Binocular motion capture camera control device and all-in-one machine equipment |
| CN113610901B (en) * | 2021-07-07 | 2024-05-31 | 江西科骏实业有限公司 | Binocular motion capture camera control device and all-in-one equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103407407A (en) | Automobile safety distance warning device and method based on binocular stereo vision | |
| WO2021004548A1 (en) | Vehicle speed intelligent measurement method based on binocular stereo vision system | |
| CN103150786B (en) | Non-contact type unmanned vehicle driving state measuring system and measuring method | |
| CN205138460U (en) | Motor vehicle contour dimension checking system | |
| US20190347498A1 (en) | Systems and methods for automated detection of trailer properties | |
| JP2020525809A (en) | System and method for updating high resolution maps based on binocular images | |
| CN109886308A (en) | A target-level-based dual-sensor data fusion method and device | |
| CN202424782U (en) | Vehicle-mounted terminal device | |
| CN111291676A (en) | Lane line detection method and device based on laser radar point cloud and camera image fusion and chip | |
| CN108154472B (en) | Parking space visual detection method and system integrating navigation information | |
| US20150254976A1 (en) | Traffic monitoring system and traffic monitoring method | |
| CN103112453B (en) | A kind of intelligent parking ancillary system | |
| CN201484287U (en) | Anti-rear collision safety warning device for automobile | |
| CN107133985A (en) | A kind of vehicle-mounted vidicon automatic calibration method for the point that disappeared based on lane line | |
| CN110555407B (en) | Pavement vehicle space identification method and electronic equipment | |
| CN212220188U (en) | Underground parking garage fuses positioning system | |
| JP5365792B2 (en) | Vehicle position measuring device | |
| CN109657638A (en) | Barrier localization method, device and terminal | |
| CN112136021A (en) | System and method for constructing landmark-based high-definition map | |
| CN203480561U (en) | Driving state measurement system of non-contact unmanned vehicle | |
| CN110060298A (en) | A kind of vehicle location and attitude and heading reference system based on image and corresponding method | |
| CN109407080A (en) | Vehicle distance measuring system based on binocular camera and distance measuring method thereof | |
| CN116863687B (en) | Quasi-all-weather traffic safety passing guarantee system based on vehicle-road cooperation | |
| CN108688565A (en) | A kind of high dynamic binocular CMOS camera systems and application method | |
| CN110901638A (en) | Driving assistance method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20131127 |