[go: up one dir, main page]

CN109050388B - A lane line projection system and method based on digital micromirror technology - Google Patents

A lane line projection system and method based on digital micromirror technology Download PDF

Info

Publication number
CN109050388B
CN109050388B CN201810891449.XA CN201810891449A CN109050388B CN 109050388 B CN109050388 B CN 109050388B CN 201810891449 A CN201810891449 A CN 201810891449A CN 109050388 B CN109050388 B CN 109050388B
Authority
CN
China
Prior art keywords
lane line
digital
signal
ecu
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810891449.XA
Other languages
Chinese (zh)
Other versions
CN109050388A (en
Inventor
杜小芳
罗刚
陈思同
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Weiersi Auto Parts Technology Co ltd
Wuhan University of Technology WUT
Original Assignee
Nanjing Weiersi Auto Parts Technology Co ltd
Wuhan University of Technology WUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Weiersi Auto Parts Technology Co ltd, Wuhan University of Technology WUT filed Critical Nanjing Weiersi Auto Parts Technology Co ltd
Priority to CN201810891449.XA priority Critical patent/CN109050388B/en
Publication of CN109050388A publication Critical patent/CN109050388A/en
Application granted granted Critical
Publication of CN109050388B publication Critical patent/CN109050388B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q2400/00Special features or arrangements of exterior signal lamps for vehicles
    • B60Q2400/50Projected symbol or information, e.g. onto the road or car body

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Traffic Control Systems (AREA)
  • Lighting Device Outwards From Vehicle And Optical Signal (AREA)

Abstract

本发明提出了一种基于数字微镜技术的车道线投影系统及方法。本发明系统包括摄像头模块、雷达定位模块、模数转换模块、车联网模块、ECU、DLP处理器、数字微镜数字图像驱动模块、数字微镜元件、LED光源、导光管、聚光透镜、颜色过滤器、整形透镜、投影透镜。本发明方法开启LED光源,光线经光路传播至数字微镜元件;通过摄像头模块以及雷达定位模块采集信号,通过模数转换模块转换后传输至ECU;ECU将数字图像信号通过图像预处理得到车道线投影信号,根据数字距离信号与安全距离比较调整车道线投影信号以得到虚拟车道线投影信号,并传输至DLP处理器;DLP处理器根据虚拟车道线投影信号得到虚拟车道线,通过数字微镜原件将虚拟车道线投射到地面。

Figure 201810891449

The invention provides a lane line projection system and method based on digital micromirror technology. The system of the invention includes a camera module, a radar positioning module, an analog-to-digital conversion module, a car networking module, an ECU, a DLP processor, a digital micromirror digital image driving module, a digital micromirror element, an LED light source, a light guide tube, a condenser lens, Color filters, shaping lenses, projection lenses. The method of the invention turns on the LED light source, and the light is transmitted to the digital micro-mirror element through the optical path; the signal is collected by the camera module and the radar positioning module, converted by the analog-to-digital conversion module, and then transmitted to the ECU; the ECU obtains the lane line by preprocessing the digital image signal through the image. Projection signal, adjust the lane line projection signal according to the comparison between the digital distance signal and the safety distance to obtain the virtual lane line projection signal, and transmit it to the DLP processor; the DLP processor obtains the virtual lane line according to the virtual lane line projection signal, and passes the original digital micromirror. Projects virtual lane lines to the ground.

Figure 201810891449

Description

Digital micromirror technology-based lane line projection system and method
Technical Field
The invention relates to the field of automobile headlamp systems, in particular to a lane line projection system and method based on a digital micromirror technology.
Background
The headlamp system is an important safety system of the automobile, mainly plays a role in providing illumination for a traffic environment, so that a driver can obtain accurate road information to perform corresponding driving operation, and the headlamp system is a precondition guarantee for safe driving of the automobile at night.
Traditional vehicle headlamps system can not satisfy people's demand under complicated highway section and the environment of turning, the illumination mode is not enough, adaptability regulatory ability is relatively poor, there are great traffic hidden danger scheduling problem, along with the development of technical field, the LED matrix head-light of using widely now outside, along with the birth and the technological maturity of digital micro mirror lighting technique, can use it to the head-light field, can integrate millions of light-emitting points in a car light, and can distribute car light and utilize light and surrounding environment exchange information better, utilize unique projection technique, can project corresponding road route on the road and go to the road with supplementary driver, consequently, it has important meaning to study a lane line projection system and method based on digital micro mirror technique.
Disclosure of Invention
In order to solve the problem of traffic hidden trouble of the existing headlamp system, the invention provides a lane line projection system and method based on a digital micromirror technology.
The technical scheme of the system is a lane line projection system based on the digital micromirror technology, which is characterized by comprising the following steps: the system comprises a camera module, a radar positioning module, an analog-to-digital conversion module, an internet of vehicles module, an ECU (electronic control Unit), a DLP (digital light processing) processor, a digital micromirror digital image driving module, a digital micromirror element, an LED (light-emitting diode) light source, a light pipe, a condensing lens, a color filter, a shaping lens and a projection lens;
the camera module is connected with the analog-to-digital conversion module; the radar positioning module is connected with the analog-to-digital conversion module; the analog-to-digital conversion module is connected with the ECU; the Internet of vehicles module is connected with the ECU; the ECU, the DLP processor, the digital micromirror digital image driving module and the digital micromirror element are sequentially connected in series; the LED light source, the light pipe, the condensing lens, the color filter, the shaping lens and the digital micromirror element are sequentially connected in series; the digital micromirror device is coupled to the projection lens.
Preferably, the camera module is used for collecting images of a road ahead; the radar positioning module is used for detecting the distance between the edge of the right front wheel and the edge of the road in real time; the analog-to-digital conversion module is used for respectively converting the front road image into a digital image signal and transmitting the digital image signal to the ECU, and converting the distance between the edge of the right front wheel and the edge of the road into a digital distance signal and transmitting the digital distance signal to the ECU; the vehicle networking module is used for transmitting vehicle information acquired by the ECU to the remote monitoring terminal; the ECU is used for obtaining a lane line projection signal from the digital image signal according to an image processing algorithm, comparing and adjusting the lane line projection signal according to the digital distance signal and the safe distance to obtain a virtual lane line projection signal, and transmitting the virtual lane line projection signal to the DLP processor; the DLP processor converts the virtual lane line projection signals into advanced RGB data meeting the requirements of the digital micromirror element format, converts the advanced RGB data into all plane binary data, and is used for carrying out bit division and cache on all the plane binary data and converting the all plane binary data into driving data signals corresponding to the digital micromirror digital image driving module; the digital micromirror digital image driving module controls the micromirrors in the digital micromirror element to perform driving, turning and time sequence control according to driving data signals, so as to project virtual lane lines; the digital micromirror element projects the virtual lane line to the road surface; the LED light source is used for providing a light source; the light guide pipe is used for light uniformity; the condenser lens is used for condensing the uniform light; the color filter is used for filtering out stray light from the condensed light; the shaping lens is used for projecting the light rays after the stray light is filtered to the digital micromirror element.
The technical scheme of the method is a lane line projection method based on a digital micromirror technology, which is characterized by comprising the following steps of:
step 1: turning on the LED light source, and transmitting light to the digital micromirror element through the light path;
step 2: the camera module and the radar positioning module are used for acquiring signals, and the signals are converted by the analog-to-digital conversion module and then transmitted to the ECU;
and step 3: the ECU obtains a lane line projection signal by image preprocessing the digital image signal, adjusts the lane line projection signal according to the comparison of the digital distance signal and the safe distance to obtain a virtual lane line projection signal, and transmits the virtual lane line projection signal to the DLP processor;
and 4, step 4: the DLP processor obtains a virtual lane line according to the virtual lane line projection signal, converts the virtual lane line into a digital signal conforming to the DMD drive module, and projects the virtual lane line to the ground through a digital micromirror element;
preferably, the light propagating through the optical path to the dmd in step 1 is:
the LED light source provides a light source, light is reflected by the reflecting bowl, is uniform through the light guide pipe, is condensed by the condensing lens, is filtered by the color filter to remove stray light, and is projected to the digital micromirror element through the shaping lens;
preferably, the step 2 of acquiring signals by the camera module and the radar positioning module is that:
the camera module collects front road images, and the radar positioning module collects the distance between a vehicle and a road guardrail;
the step 2 of transmitting the data converted by the analog-to-digital conversion module to the ECU is as follows:
the analog-digital conversion module converts the front road image into a digital image signal and transmits the digital image signal to the ECU, and converts the distance between the vehicle and the road guardrail into a digital distance signal and transmits the digital distance signal to the ECU;
preferably, the specific process of the ECU preprocessing the digital image signal to obtain the lane line projection signal in step 3 is as follows:
the ECU performs image gray processing on the digital image signal, a sobel operator is adopted to perform binarization processing, enhancement and denoising on the image after the gray processing, then image segmentation is performed, an image area with a lane line is extracted, edge points of the lane line are detected, and the ECU fits and synthesizes a lane line projection signal according to the edge points of the lane line;
the specific process of obtaining the virtual lane line projection signal in the step 3 is as follows:
taking the edge plane of the right front wheel of the automobile as a positioning reference for the lane line projection signal;
the left edge of the lane line projection signal is parallel to and connected with the ground projection line position of the automobile right front wheel edge plane under the condition of straight line, the digital distance signal L is compared with a safety distance L1 between the wheel edge and the road edge which is preset in an ECU according to the digital distance signal L between the right front wheel edge and the road edge which is detected by a radar positioning module in real time, when the distance between the wheel edge and the right road edge is greater than the safety distance, the ECU deviates the projection position of the lane line projection signal to the right (L-L1) by adjusting the distance, and when the distance between the wheel edge and the right road edge is less than the safety distance, the projection position of the lane line projection signal to the left (L1-L) is obtained, so that the virtual lane line projection signal is obtained to provide safety warning effect for a driver;
under the condition of a curve, the dynamic deflection direction of the right front wheel reflects the curvature change of the curve, and a straight line parallel to a projection line on the ground on the outer side plane of the right front wheel in the deflection direction is taken based on the plane of the edge of the right front wheel, the straight line is tangent to the inner side of a virtual lane line, and the lane line projection signal can be projected on a safe distance in real time to obtain the virtual lane line projection signal by changing the distance between the corresponding tangent line on the lane line projection signal and the outer side plane of the right front wheel;
preferably, the DLP processor in step 4 obtains the virtual lane line according to the virtual lane line projection signal as follows:
the DLP processor converts the virtual lane line projection signals into advanced RGB data meeting the requirements of the digital micromirror element format, converts the advanced RGB data into all plane binary data, is used for carrying out bit division and cache on all the plane binary data and converts the all plane binary data into driving data signals corresponding to the digital micromirror digital image driving module; the digital micromirror digital image driving module controls the micromirror in the digital micromirror element to drive, turn and control the time sequence according to the driving data signal, thereby projecting the virtual lane line.
Compared with the prior art, the invention utilizes the unique projection technology, can project the corresponding road route on the road to assist the driver to drive, and improves the safety of vehicle driving.
Drawings
FIG. 1: the invention is a system structure block diagram;
FIG. 2: the method of the invention is a flow chart.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a block diagram of a system structure according to the present invention, and a technical solution of a summary system according to an embodiment of the present invention is a lane line projection system based on a digital micromirror technology, including: the system comprises a camera module, a radar positioning module, an analog-to-digital conversion module, an internet of vehicles module, an ECU (electronic control Unit), a DLP (digital light processing) processor, a digital micromirror digital image driving module, a digital micromirror element, an LED (light-emitting diode) light source, a light pipe, a condensing lens, a color filter, a shaping lens and a projection lens;
the camera module is connected with the analog-to-digital conversion module; the radar positioning module is connected with the analog-to-digital conversion module; the analog-to-digital conversion module is connected with the ECU; the Internet of vehicles module is connected with the ECU; the ECU, the DLP processor, the digital micromirror digital image driving module and the digital micromirror element are sequentially connected in series; the LED light source, the light pipe, the condensing lens, the color filter, the shaping lens and the digital micromirror element are sequentially connected in series; the digital micromirror device is coupled to the projection lens.
The camera module is used for collecting a front road image; the radar positioning module is used for detecting the distance between the edge of the right front wheel and the edge of the road in real time; the analog-to-digital conversion module is used for respectively converting the front road image into a digital image signal and transmitting the digital image signal to the ECU, and converting the distance between the edge of the right front wheel and the edge of the road into a digital distance signal and transmitting the digital distance signal to the ECU; the vehicle networking module is used for transmitting vehicle information acquired by the ECU to the remote monitoring terminal; the ECU is used for obtaining a lane line projection signal from the digital image signal according to an image processing algorithm, comparing and adjusting the lane line projection signal according to the digital distance signal and the safe distance to obtain a virtual lane line projection signal, and transmitting the virtual lane line projection signal to the DLP processor; the DLP processor is used for converting the lane line projection signals into advanced RGB data meeting the requirements of the digital micromirror element format, converting the advanced RGB data into all plane binary data, and performing bit division and cache on all the plane binary data and converting the all plane binary data into driving data signals corresponding to the digital micromirror digital image driving module; the digital micromirror digital image driving module controls the micromirrors in the digital micromirror element to perform driving, turning and time sequence control according to driving data signals, so as to project virtual lane lines; the digital micromirror element projects a virtual lane line to a road surface, and the distance between the virtual lane line and a road guardrail is a safe distance; the LED light source is used for providing a light source; the light guide pipe is used for light uniformity; the condenser lens is used for condensing the uniform light; the color filter is used for filtering out stray light from the condensed light; the shaping lens is used for projecting the light rays after the stray light is filtered to the digital micromirror element.
The type of the camera module is selected to be max 96705; the radar positioning module is a Velarry laser radar in a selected type; the analog-to-digital conversion module is selected as AD 9923A; the main chip in the ECU is selected to be a DM3730 singlechip; the DLP processor is selected as DDP 200; the digital micromirror element is selected to be a single-chip DMD digital micromirror element; the LED light source is selected to be
Figure BDA0001757050800000051
MK-R2; the light pipe is a prism light pipe; the condensing lens is a convex lens; the color filter is selected to be a common color filter sheet; the shaping lens is a cylindrical optical lens; the projection lens is selected to be a plano-convex lens.
The technical scheme of the method in the embodiment of the invention is a lane line projection method based on a digital micromirror technology, which is characterized by comprising the following steps:
step 1: turning on the LED light source, and transmitting light to the digital micromirror element through the light path;
in the step 1, the light transmitted to the digital micromirror element through the light path is:
the LED light source provides a light source, light is reflected by the reflecting bowl, is uniform through the light guide pipe, is condensed by the condensing lens, is filtered by the color filter to remove stray light, and is projected to the digital micromirror element through the shaping lens;
step 2: the camera module and the radar positioning module are used for acquiring signals, and the signals are converted by the analog-to-digital conversion module and then transmitted to the ECU;
in step 2, the signal acquisition through the camera module and the radar positioning module is as follows:
the camera module collects front road images, and the radar positioning module collects the distance between a vehicle and a road guardrail;
the step 2 of transmitting the data converted by the analog-to-digital conversion module to the ECU is as follows:
the analog-digital conversion module converts the front road image into a digital image signal and transmits the digital image signal to the ECU, and converts the distance between the vehicle and the road guardrail into a digital distance signal and transmits the digital distance signal to the ECU;
and step 3: the ECU obtains a lane line projection signal by image preprocessing the digital image signal, adjusts the lane line projection signal according to the comparison of the digital distance signal and the safe distance to obtain a virtual lane line projection signal, and transmits the virtual lane line projection signal to the DLP processor;
the specific process of the ECU performing image preprocessing on the digital image signal to obtain the lane line projection signal in the step 3 is as follows:
the ECU performs image gray processing on the digital image signal, a sobel operator is adopted to perform binarization processing, enhancement and denoising on the image after the gray processing, then image segmentation is performed, an image area with a lane line is extracted, edge points of the lane line are detected, and the ECU fits and synthesizes a lane line projection signal according to the edge points of the lane line;
the specific process of obtaining the virtual lane line projection signal in the step 3 is as follows:
taking the edge plane of the right front wheel of the automobile as a positioning reference for the lane line projection signal;
the left edge of the lane line projection signal is parallel to and connected with the ground projection line position of the automobile right front wheel edge plane under the condition of straight line, according to the digital distance signal L of the right front wheel edge and the road edge detected by a radar positioning module in real time, the digital distance signal L is compared with the safety distance L1 between the wheel edge and the road edge which is preset in an ECU (electronic control unit), when the distance between the wheel edge and the right road edge is greater than the safety distance, the ECU sends an instruction to shift the projection position of the lane line projection signal to the right by a distance of (L-L1), and when the distance between the wheel edge and the right road edge is less than the safety distance, the projection position of the lane line projection signal is shifted to the left by a distance of (L1-L), so that the virtual lane line projection signal is obtained to provide a safety warning effect for a driver;
under the condition of a curve, the dynamic deflection direction of the right front wheel reflects the curvature change of the curve, and a straight line parallel to a projection line of the plane on the ground outside the right front wheel is taken by taking the plane on which the edge of the right front wheel is positioned as a reference, the straight line is tangent with the inner side of a virtual lane line, and the lane line projection signal can be projected on a safe distance in real time to obtain the virtual lane line projection signal by changing the distance between the corresponding tangent line on the lane line projection signal and the plane outside the right front wheel;
and 4, step 4: the DLP processor obtains a virtual lane line according to the virtual lane line projection signal, and projects the virtual lane line to the ground through a digital micromirror element;
in the step 4, the DLP processor obtains the virtual lane line according to the virtual lane line projection signal as follows:
the DLP processor converts the virtual lane line projection signals into advanced RGB data meeting the requirements of the digital micromirror element format, converts the advanced RGB data into all plane binary data, is used for carrying out bit division and cache on all the plane binary data and converts the all plane binary data into driving data signals corresponding to the digital micromirror digital image driving module; the digital micromirror digital image driving module controls the micromirror in the digital micromirror element to drive, turn and control the time sequence according to the driving data signal, thereby projecting the virtual lane line.
Although the terms camera module, radar positioning module, analog-to-digital conversion module, car networking module, ECU, DLP processor, digital micromirror digital image driving module, digital micromirror element, LED light source, light pipe, condenser lens, color filter, shaping lens, projection lens, etc. are used more often herein, the possibility of using other terms is not excluded. These terms are used merely to more conveniently describe the nature of the invention and they are to be construed as any additional limitation which is not in accordance with the spirit of the invention.
It should be understood that the above description of the preferred embodiments is given for clarity and not for any purpose of limitation, and that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (1)

1.一种基于数字微镜技术的车道线投影系统的车道线投影方法,其特征在于,所述数字微镜技术的车道线投影系统包括:摄像头模块、雷达定位模块、模数转换模块、车联网模块、ECU、DLP处理器、数字微镜数字图像驱动模块、数字微镜元件、LED光源、导光管、聚光透镜、颜色过滤器、整形透镜、投影透镜;1. a lane line projection method based on the lane line projection system of digital micromirror technology, is characterized in that, the lane line projection system of described digital micromirror technology comprises: camera module, radar positioning module, analog-to-digital conversion module, vehicle Networking module, ECU, DLP processor, digital micromirror digital image drive module, digital micromirror element, LED light source, light guide tube, condenser lens, color filter, shaping lens, projection lens; 所述摄像头模块与所述模数转换模块连接;所述雷达定位模块与所述模数转换模块连接;所述模数转换模块与所述ECU连接;所述车联网模块与所述ECU连接;所述的ECU、DLP处理器、数字微镜数字图像驱动模块、数字微镜元件依次串联连接;所述的LED光源、导光管、聚光透镜、颜色过滤器、整形透镜、数字微镜元件依次串联连接;所述数字微镜元件与所述投影透镜连接;The camera module is connected to the analog-to-digital conversion module; the radar positioning module is connected to the analog-to-digital conversion module; the analog-to-digital conversion module is connected to the ECU; the vehicle networking module is connected to the ECU; The ECU, the DLP processor, the digital image driving module of the digital micromirror, and the digital micromirror element are connected in series in sequence; the LED light source, the light guide tube, the condenser lens, the color filter, the shaping lens, and the digital micromirror element connected in series in sequence; the digital micromirror element is connected with the projection lens; 所述摄像头模块用于采集前方道路图像;所述雷达定位模块用于实时检测出的右前轮边缘与道路边缘的距离;所述模数转换模块用于分别将前方道路图像转换为数字图像信号并传输至所述ECU,将右前轮边缘与道路边缘的距离转换为数字距离信号并传输至所述ECU;所述车联网模块用于将ECU采集的车辆信息传输至远程监控终端;所述ECU用于将数字图像信号根据图像处理算法得到车道线投影信号,根据数字距离信号与安全距离比较调整车道线投影信号以得到虚拟车道线投影信号,并将虚拟车道线投影信号传输至DLP处理器;所述DLP处理器将虚拟车道线投影信号转换为符合数字微镜元件格式要求先进的RGB数据,并将先进的RGB数据转换为全部平面二进制数据,并用于将全部平面二进制数据进行分位以及缓存,并转化为所述数字微镜数字图像驱动模块对应的驱动数据信号;所述数字微镜数字图像驱动模块根据驱动数据信号控制所述数字微镜元件中微反射镜进行驱动翻转以及时序控制,从而投射出虚拟车道线;所述数字微镜元件将虚拟车道线投影到路面;所述LED光源用于提供光源;所述导光管用于光线均匀;所述聚光透镜用于对均匀后光线聚光;所述颜色过滤器用于将聚光后光线滤除杂色光;所述整形透镜用于将滤除杂色光后光线投射到所述数字微镜元件;The camera module is used to collect the image of the road ahead; the radar positioning module is used to detect the distance between the edge of the right front wheel and the edge of the road in real time; the analog-to-digital conversion module is used to convert the image of the road ahead into digital image signals respectively. and transmit it to the ECU, convert the distance between the edge of the right front wheel and the road edge into a digital distance signal and transmit it to the ECU; the vehicle networking module is used to transmit the vehicle information collected by the ECU to the remote monitoring terminal; the The ECU is used to obtain the lane line projection signal from the digital image signal according to the image processing algorithm, adjust the lane line projection signal according to the comparison between the digital distance signal and the safety distance to obtain the virtual lane line projection signal, and transmit the virtual lane line projection signal to the DLP processor. ; The DLP processor converts the virtual lane line projection signal into advanced RGB data that meets the requirements of the digital micromirror element format, and converts the advanced RGB data into all plane binary data, and is used to quantify all plane binary data and buffer, and convert it into a driving data signal corresponding to the digital micromirror digital image driving module; the digital micromirror digital image driving module controls the micromirror in the digital micromirror element to perform driving inversion and timing control according to the driving data signal , so as to project the virtual lane line; the digital micro-mirror element projects the virtual lane line to the road surface; the LED light source is used to provide a light source; the light guide pipe is used for uniform light; Light condensing; the color filter is used to filter the stray light after the concentrated light; the shaping lens is used to project the light after filtering the stray light to the digital micromirror element; 所述车道线投影方法,包括以下步骤:The lane line projection method includes the following steps: 步骤1:开启LED光源,光线经光路传播至数字微镜元件;Step 1: Turn on the LED light source, and the light propagates to the digital micromirror element through the optical path; 步骤2:通过摄像头模块以及雷达定位模块采集信号,通过模数转换模块转换后传输至ECU;Step 2: The signal is collected by the camera module and the radar positioning module, converted by the analog-to-digital conversion module and transmitted to the ECU; 步骤3:ECU将数字图像信号通过图像预处理得到车道线投影信号,根据数字距离信号与安全距离比较调整车道线投影信号以得到虚拟车道线投影信号,并将虚拟车道线投影信号传输至DLP处理器;Step 3: The ECU obtains the lane line projection signal from the digital image signal through image preprocessing, adjusts the lane line projection signal according to the comparison between the digital distance signal and the safety distance to obtain the virtual lane line projection signal, and transmits the virtual lane line projection signal to the DLP for processing device; 步骤4:DLP处理器根据虚拟车道线投影信号得到虚拟车道线并将其转化为符合DMD驱动模块的数字信号,通过数字微镜原件将虚拟车道线投射到地面;Step 4: The DLP processor obtains the virtual lane line according to the virtual lane line projection signal and converts it into a digital signal conforming to the DMD drive module, and projects the virtual lane line to the ground through the original digital micromirror; 步骤1中所述光线经光路传播至数字微镜元件为:In step 1, the light transmitted to the digital micromirror element through the optical path is: LED光源提供光源,光线经过反光碗反射,经过导光管进行光线均匀,经过聚光透镜聚光,经过颜色滤波器滤除杂色光,最后通过整形透镜投射到数字微镜元件;The LED light source provides the light source, the light is reflected by the reflector, the light is uniformized by the light guide tube, the light is condensed by the condenser lens, the stray light is filtered by the color filter, and finally projected to the digital micro-mirror element through the shaping lens; 步骤2中所述通过摄像头模块以及雷达定位模块采集信号为:The signals collected by the camera module and the radar positioning module described in step 2 are: 摄像头模块采集前方道路图像,雷达定位模块采集车辆与道路护栏的距离;The camera module collects the image of the road ahead, and the radar positioning module collects the distance between the vehicle and the road guardrail; 步骤2中所述通过模数转换模块转换后传输至ECU为:In step 2, the conversion to the ECU through the analog-to-digital conversion module is as follows: 模数转换模块分别将前方道路图像转换为数字图像信号并传输至ECU,将车辆与道路护栏的距离转换为数字距离信号并传输至ECU;The analog-to-digital conversion module converts the image of the road ahead into digital image signals and transmits them to the ECU, and converts the distance between the vehicle and the road guardrail into digital distance signals and transmits them to the ECU; 步骤3中所述ECU将数字图像信号通过图像预处理得到车道线投影信号具体过程为:In step 3, the ECU preprocesses the digital image signal to obtain the lane line projection signal. The specific process is as follows: ECU将数字图像信号进行图像灰度处理,采用sobel算子对灰度处理后图像进行二值化处理、增强、去噪,再进行图像分割,提取出存在车道线的图像区域以及检测出车道线边缘点,ECU根据车道线边缘点拟合并合成车道线投影信号;The ECU performs image grayscale processing on the digital image signal, and uses the sobel operator to binarize, enhance, and denoise the grayscale-processed image, and then performs image segmentation to extract the image area with lane lines and detect lane lines. Edge point, ECU fits and synthesizes the lane line projection signal according to the lane line edge point; 步骤3中所述得到虚拟车道线投影信号具体过程为:The specific process of obtaining the virtual lane line projection signal described in step 3 is as follows: 将车道线投影信号以汽车右前轮边缘平面为定位基准;The lane line projection signal is based on the edge plane of the right front wheel of the car as the positioning reference; 直线情况下车道线投影信号的左边缘与汽车右前轮边缘平面在地面投影线位置平行且相连,根据雷达定位模块实时检测出的右前轮边缘与道路边缘的数字距离信号L,将数字距离信号L与预先在ECU中设置好的车轮边缘与道路边缘的安全距离L1作比较,当车轮边缘与右侧道路边缘的距离大于安全距离时,此时ECU通过调整将车道线投影信号的投影位置向右偏出(L-L1)的距离,当车轮边缘与右侧道路边缘的距离小于安全距离时,此时将车道线投影信号的投影位置向左偏出(L1-L)的距离,从而得到虚拟车道线投影信号给驾驶员提供安全预警作用;In the case of a straight line, the left edge of the lane line projection signal is parallel and connected to the plane of the right front wheel edge plane on the ground projection line. According to the digital distance signal L between the right front wheel edge and the road edge detected by the radar positioning module in real time, the digital distance The signal L is compared with the safety distance L1 between the wheel edge and the road edge pre-set in the ECU. When the distance between the wheel edge and the right road edge is greater than the safety distance, the ECU adjusts the projection position of the lane line projection signal. The distance to the right (L-L1), when the distance between the wheel edge and the right road edge is less than the safety distance, the projection position of the lane line projection signal is shifted to the left by the distance (L1-L), so as to Get the virtual lane line projection signal to provide the driver with a safety warning function; 弯道情况下,右前轮的动态偏转方向反映着弯道曲率变化,则同样根据右前轮边缘所在平面为基准,取右前轮外侧平面在偏转方向上的在地面上的投影线相平行的直线,该直线与虚拟车道线内侧相切,通过改变车道线投影信号上对应切线和右前轮外侧平面之间的距离,即可将车道线投影信号实时投影在安全距离上以得到虚拟车道线投影信号;In the case of a curve, the dynamic deflection direction of the right front wheel reflects the curvature change of the curve, and the projection line of the outer plane of the right front wheel on the ground in the deflection direction is parallel to the plane where the edge of the right front wheel is located. The straight line is tangent to the inner side of the virtual lane line. By changing the distance between the corresponding tangent line on the lane line projection signal and the outer plane of the right front wheel, the lane line projection signal can be projected on the safety distance in real time to obtain the virtual lane. line projection signal; 步骤4中所述DLP处理器根据虚拟车道线投影信号得到虚拟车道线为:The DLP processor in step 4 obtains the virtual lane line according to the virtual lane line projection signal as: DLP处理器将虚拟车道线投影信号转换为符合数字微镜元件格式要求先进的RGB数据,并将先进的RGB数据转换为全部平面二进制数据,用于将全部平面二进制数据进行分位以及缓存,并转化为数字微镜数字图像驱动模块对应的驱动数据信号;数字微镜数字图像驱动模块根据驱动数据信号控制数字微镜元件中微反射镜进行驱动翻转以及时序控制,从而投射出虚拟车道线。The DLP processor converts the virtual lane line projection signal into advanced RGB data that meets the requirements of the digital micromirror element format, and converts the advanced RGB data into all plane binary data for quantifying and buffering all plane binary data, and It is converted into a driving data signal corresponding to the digital image driving module of the digital micromirror; the digital image driving module of the digital micromirror controls the micromirror in the digital micromirror element to perform driving inversion and timing control according to the driving data signal, thereby projecting a virtual lane line.
CN201810891449.XA 2018-08-07 2018-08-07 A lane line projection system and method based on digital micromirror technology Active CN109050388B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810891449.XA CN109050388B (en) 2018-08-07 2018-08-07 A lane line projection system and method based on digital micromirror technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810891449.XA CN109050388B (en) 2018-08-07 2018-08-07 A lane line projection system and method based on digital micromirror technology

Publications (2)

Publication Number Publication Date
CN109050388A CN109050388A (en) 2018-12-21
CN109050388B true CN109050388B (en) 2021-10-22

Family

ID=64678497

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810891449.XA Active CN109050388B (en) 2018-08-07 2018-08-07 A lane line projection system and method based on digital micromirror technology

Country Status (1)

Country Link
CN (1) CN109050388B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113942522A (en) * 2021-05-31 2022-01-18 重庆工程职业技术学院 An intelligent driving safety protection system

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016006919A1 (en) * 2016-06-07 2017-02-09 Daimler Ag Method for operating a vehicle

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102010034853A1 (en) * 2010-08-18 2012-02-23 Gm Global Technology Operations Llc (N.D.Ges.D. Staates Delaware) Motor vehicle with digital projectors
CN202419429U (en) * 2012-01-16 2012-09-05 安徽师范大学 Self-adaptive automobile headlamp device based on digital micro-mirror element
CN103832433B (en) * 2012-11-21 2016-08-10 中国科学院沈阳计算技术研究所有限公司 Deviation and front truck anti-collision alarm system and its implementation
CN105774651A (en) * 2014-12-26 2016-07-20 德尔福电子(苏州)有限公司 Vehicle lane change auxiliary system
CN112061022B (en) * 2015-04-10 2024-08-09 麦克赛尔株式会社 Vehicle with a vehicle body having a vehicle body support
US20170106793A1 (en) * 2015-10-19 2017-04-20 Ford Global Technologies, Llc Vehicle lighting system with dynamic beam pattern
CN105922991B (en) * 2016-05-27 2018-08-17 广州大学 Based on the lane departure warning method and system for generating virtual lane line
CN205836647U (en) * 2016-07-20 2016-12-28 上海小糸车灯有限公司 A kind of car lighting advertiser based on LiFi and DLP
CN107066986A (en) * 2017-04-21 2017-08-18 哈尔滨工业大学 A kind of lane line based on monocular vision and preceding object object detecting method
CN107554406A (en) * 2017-09-19 2018-01-09 合肥凯利科技投资有限公司 A kind of automatic electricity-saving formula controller for electric vehicle

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016006919A1 (en) * 2016-06-07 2017-02-09 Daimler Ag Method for operating a vehicle

Also Published As

Publication number Publication date
CN109050388A (en) 2018-12-21

Similar Documents

Publication Publication Date Title
JP5995140B2 (en) Imaging apparatus, vehicle system including the same, and image processing method
CN103959041B (en) Attachment detector and attachment detection method
US9726604B2 (en) Adhering detection apparatus, adhering substance detection method, storage medium, and device control system for controlling vehicle-mounted devices
JP6468482B2 (en) IMAGING DEVICE, OBJECT DETECTION DEVICE, AND MOBILE DEVICE CONTROL SYSTEM
CN104024827B (en) Image processing apparatus, image capture method and vehicle
JP5761143B2 (en) Imaging unit, vehicle equipped with imaging unit
CN103213540B (en) Vehicle driving environment recognition apparatus
JP2014523359A (en) Automotive camera systems
CN105830428A (en) Object detection apparatus, moving body device control system and program thereof
JP2013029451A (en) Deposit detection device and deposit detection method
JP5936098B2 (en) Imaging apparatus, object detection apparatus including the same, and optical filter
EP3002711B1 (en) Image capturing apparatus, image capturing method, carrier medium, and device control system for controlling vehicle-mounted devices
CN109899760B (en) Vehicle lamp device
CN115151955A (en) System for monitoring the environment of a motor vehicle
CN109050388B (en) A lane line projection system and method based on digital micromirror technology
JP6555569B2 (en) Image processing apparatus, mobile device control system, and image processing program
KR100836402B1 (en) High beam control device and method in a vehicle
JP7208488B2 (en) Reflected light detection device, reflected light detection method and program
WO2017138100A1 (en) Vehicular light and vehicular light system
JP2016146583A (en) Imaging device, mobile apparatus control system and program
JP2016200528A (en) Object detection device, moving body-mounted equipment control system, and object detection program
JP2013097223A (en) Imaging method and imaging unit
JP6853890B2 (en) Object detection system
CN109677326B (en) A driverless smart car
JP2016191674A (en) Detection device, mobile body equipment control system and program for detection

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant