[go: up one dir, main page]

CN112712040B - Method, device, equipment and storage medium for calibrating lane marking information based on radar - Google Patents

Method, device, equipment and storage medium for calibrating lane marking information based on radar Download PDF

Info

Publication number
CN112712040B
CN112712040B CN202011641279.3A CN202011641279A CN112712040B CN 112712040 B CN112712040 B CN 112712040B CN 202011641279 A CN202011641279 A CN 202011641279A CN 112712040 B CN112712040 B CN 112712040B
Authority
CN
China
Prior art keywords
lane line
curve
information
road
radar
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011641279.3A
Other languages
Chinese (zh)
Other versions
CN112712040A (en
Inventor
代尚猛
于永基
宫永玉
谢小忠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Weichai Power Co Ltd
Original Assignee
Weichai Power Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Weichai Power Co Ltd filed Critical Weichai Power Co Ltd
Priority to CN202011641279.3A priority Critical patent/CN112712040B/en
Publication of CN112712040A publication Critical patent/CN112712040A/en
Application granted granted Critical
Publication of CN112712040B publication Critical patent/CN112712040B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/588Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/23Clustering techniques
    • G06F18/232Non-hierarchical techniques
    • G06F18/2321Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/757Matching configurations of points or features
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T10/00Road transport of goods or passengers
    • Y02T10/10Internal combustion engine [ICE] based vehicles
    • Y02T10/40Engine management systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Multimedia (AREA)
  • Probability & Statistics with Applications (AREA)
  • Evolutionary Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Traffic Control Systems (AREA)

Abstract

The application discloses a method, a device, equipment and a storage medium for calibrating lane line information based on a radar, wherein the method comprises the following steps: acquiring static target information on two sides of a road through radar equipment installed on a vehicle; clustering the static target information, and performing curve fitting on the classified clusters; and performing feature matching on the fitted curve and the lane line information identified by the camera, if the matching is successful, executing a normal vehicle control instruction, and if the matching is unsuccessful, calibrating the lane line information according to the fitted curve. According to the method for calibrating the lane line information, the millimeter wave radar is adopted to extract the road information, and the road information can be mutually checked with the lane line information identified by the camera under the condition that a system sensor is not added, so that the accuracy rate of lane line identification is greatly improved.

Description

基于雷达校准车道线信息的方法、装置、设备及存储介质Method, device, equipment and storage medium for calibrating lane line information based on radar

技术领域technical field

本发明涉及智能汽车技术领域,特别涉及一种基于雷达校准车道线信息的方法、装置、设备及存储介质。The present invention relates to the technical field of smart cars, in particular to a method, device, equipment and storage medium for calibrating lane line information based on radar.

背景技术Background technique

准确识别道路的车道线信息,是智能驾驶汽车领域重要的技术问题。目前,LKA(Lane Keeping Assistance,车道辅助保持系统)主要基于单摄像头方案,通过车辆上布置的单摄像头识别车道线,最终计算出车辆与车道中心的偏差,通过控制转向减小此偏差达到车辆居中行驶的目的。但是此功能仅靠前向单摄像头来感知车道信息,实际道路的车道线模糊、损坏等都会对摄像头造成大的干扰,有时也会出现误识别,在高速情景下会造成很大的危险。还有基于双摄像头识别的方案,双摄像头不仅增加成本,而且两个摄像头识别的都为车道线信息,如果车道线损坏,会出现两个摄像头检测都不准的情况,所以两者不能很好的进行冗余设计。Accurately identifying the lane line information of the road is an important technical issue in the field of intelligent driving vehicles. At present, LKA (Lane Keeping Assistance) is mainly based on a single-camera solution. The single-camera on the vehicle recognizes the lane line, and finally calculates the deviation between the vehicle and the center of the lane. By controlling the steering, the deviation is reduced to achieve the centering of the vehicle. purpose of driving. However, this function only relies on a single forward-facing camera to perceive lane information. Blurred and damaged lane lines on the actual road will cause great interference to the camera, and sometimes misidentification will occur, which will cause great danger in high-speed situations. There is also a solution based on dual-camera recognition. The dual-camera not only increases the cost, but also recognizes lane line information. If the lane line is damaged, the detection of the two cameras will not be accurate, so the two cameras cannot be very good. for redundant design.

发明内容Contents of the invention

本公开实施例提供了一种基于雷达校准车道线信息的方法、装置、设备及存储介质。为了对披露的实施例的一些方面有一个基本的理解,下面给出了简单的概括。该概括部分不是泛泛评述,也不是要确定关键/重要组成元素或描绘这些实施例的保护范围。其唯一目的是用简单的形式呈现一些概念,以此作为后面的详细说明的序言。Embodiments of the present disclosure provide a method, device, device and storage medium for calibrating lane line information based on radar. In order to provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is presented below. This summary is not an overview, nor is it intended to identify key/critical elements or delineate the scope of these embodiments. Its sole purpose is to present some concepts in a simplified form as a prelude to the more detailed description that is presented later.

第一方面,本公开实施例提供了一种基于雷达校准车道线信息的方法,包括:In a first aspect, an embodiment of the present disclosure provides a method for calibrating lane line information based on radar, including:

通过车辆上安装的雷达设备获取道路两侧的静止目标信息;Obtain stationary target information on both sides of the road through the radar equipment installed on the vehicle;

对静止目标信息进行聚类,并对分类后的簇进行曲线拟合;Cluster the stationary target information and perform curve fitting on the classified clusters;

将拟合后的曲线与摄像头识别的车道线信息进行特征匹配,若匹配成功,则执行正常的车辆控制指令,若匹配不成功,根据拟合后的曲线校准车道线信息。Match the fitted curve with the lane line information identified by the camera. If the match is successful, execute the normal vehicle control command. If the match is unsuccessful, calibrate the lane line information according to the fitted curve.

在一个实施例中,通过车辆上安装的雷达设备获取道路两侧的静止目标信息之前,还包括:In one embodiment, before obtaining the stationary target information on both sides of the road through the radar equipment installed on the vehicle, it also includes:

获取车辆摄像头识别的车道线信息以及车道线的置信度信息。Obtain the lane line information recognized by the vehicle camera and the confidence level information of the lane line.

在一个实施例中,获取车辆摄像头识别的车道线信息以及车道线的置信度信息之后,还包括:In one embodiment, after obtaining the lane line information identified by the vehicle camera and the confidence information of the lane line, it further includes:

根据车道线信息判断道路类型;Determine the road type according to the lane line information;

若道路类型为直路,则不校准车道线信息,直接执行车辆控制指令;If the road type is a straight road, the lane line information is not calibrated, and the vehicle control command is directly executed;

若道路类型为弯路,则通过车辆上安装的雷达设备获取道路两侧的静止目标信息。If the road type is a curved road, the stationary target information on both sides of the road is acquired through the radar equipment installed on the vehicle.

在一个实施例中,对静止目标信息进行聚类,并对分类后的簇进行曲线拟合,包括:In one embodiment, the stationary target information is clustered, and the classified clusters are subjected to curve fitting, including:

通过基于密度生长的聚类算法对静止目标信息进行聚类;Clustering of stationary target information by clustering algorithm based on density growth;

对分类后的每一个簇进行曲线拟合,得到拟合后的三次函数曲线。Curve fitting is performed on each cluster after classification to obtain the fitted cubic function curve.

在一个实施例中,对分类后的簇进行曲线拟合之后,还包括:In one embodiment, after performing curve fitting on the classified clusters, further comprising:

根据车辆与拟合曲线的距离以及拟合曲线所在的簇中静止目标的个数确定拟合曲线的置信度;Determine the confidence of the fitting curve according to the distance between the vehicle and the fitting curve and the number of stationary objects in the cluster where the fitting curve is located;

当置信度大于等于预设第一阈值时,将拟合后的曲线与摄像头识别的车道线信息进行特征匹配,若匹配成功,则执行正常的车辆控制指令,若匹配不成功,根据拟合后的曲线校准车道线信息;When the confidence level is greater than or equal to the preset first threshold, the fitted curve is matched with the lane line information identified by the camera. If the matching is successful, the normal vehicle control command will be executed. If the matching is unsuccessful, according to the fitted The curve calibration lane line information;

当置信度小于预设第一阈值时,提取雷达与摄像头输出的障碍物信息,根据将要执行的控制指令确定车辆将要行驶的轨迹,若预设时间段内轨迹中没有障碍物,则执行控制指令,否则不执行,并发出报警信息。When the confidence level is less than the preset first threshold, the obstacle information output by the radar and the camera is extracted, and the trajectory of the vehicle is determined according to the control instruction to be executed. If there is no obstacle in the trajectory within the preset time period, the control instruction is executed. , otherwise it will not be executed and an alarm message will be issued.

在一个实施例中,将拟合后的曲线与摄像头识别的车道线信息进行特征匹配,包括:In one embodiment, feature matching is performed on the fitted curve with the lane line information identified by the camera, including:

根据摄像头识别的车道线信息确定道路的第一曲率、第一曲率变化率;Determine the first curvature and first curvature change rate of the road according to the lane line information identified by the camera;

根据拟合后的曲线确定道路的第二曲率、第二曲率变化率;determining the second curvature and the second curvature change rate of the road according to the fitted curve;

若第一曲率与第二曲率的差值小于预设第二阈值以及第一曲率变化率与第二曲率变化率的差值小于预设第三阈值,则确定匹配成功。If the difference between the first curvature and the second curvature is smaller than a preset second threshold and the difference between the first curvature change rate and the second curvature change rate is smaller than a preset third threshold, it is determined that the matching is successful.

在一个实施例中,根据拟合后的曲线校准车道线信息,包括:In one embodiment, the lane marking information is calibrated according to the fitted curve, including:

获取拟合曲线的置信度以及摄像头识别的车道线的置信度;Obtain the confidence of the fitted curve and the confidence of the lane line identified by the camera;

根据二者的置信度采用加权平均的方式对车道线的特征信息进行修正。According to the confidence of the two, the feature information of the lane line is corrected by means of weighted average.

第二方面,本公开实施例提供了一种基于雷达校准车道线信息的装置,包括:In a second aspect, an embodiment of the present disclosure provides a device for calibrating lane line information based on radar, including:

获取模块,用于通过车辆上安装的雷达设备获取道路两侧的静止目标信息;An acquisition module, configured to acquire stationary target information on both sides of the road through the radar equipment installed on the vehicle;

曲线拟合模块,用于对静止目标信息进行聚类,并对分类后的簇进行曲线拟合;A curve fitting module is used for clustering stationary target information and performing curve fitting on the classified clusters;

校准模块,用于将拟合后的曲线与摄像头识别的车道线信息进行特征匹配,若匹配成功,则执行正常的车辆控制指令,若匹配不成功,根据拟合后的曲线校准车道线信息。The calibration module is used to perform feature matching between the fitted curve and the lane line information recognized by the camera. If the matching is successful, normal vehicle control instructions will be executed. If the matching is unsuccessful, the lane line information will be calibrated according to the fitted curve.

第三方面,本公开实施例提供了一种基于雷达校准车道线信息的设备,包括处理器和存储有程序指令的存储器,处理器被配置为在执行程序指令时,执行上述实施例提供的基于雷达校准车道线信息的方法。In a third aspect, an embodiment of the present disclosure provides a device for calibrating lane line information based on radar, including a processor and a memory storing program instructions. A method for radar calibration of lane line information.

第四方面,本公开实施例提供了一种计算机可读介质,其上存储有计算机可读指令,计算机可读指令可被处理器执行以实现上述实施例提供的一种基于雷达校准车道线信息的方法。In a fourth aspect, an embodiment of the present disclosure provides a computer-readable medium on which computer-readable instructions are stored, and the computer-readable instructions can be executed by a processor to implement the radar-based calibration lane line information provided by the above-mentioned embodiments. Methods.

本公开实施例提供的技术方案可以包括以下有益效果:The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

根据本公开实施例提供的校准车道线信息的方法,采用毫米波雷达提取道路两侧的静止目标信息,利用道路护栏,树木等信息,提取道路特征,与摄像头识别的车道线信息相互校验,通过采用不同的道路信息进行校验,大大提高了校验的准确率以及系统的安全性,解决了现有技术中由于实际道路的车道线模糊、损坏等情况对摄像头车道线识别造成干扰,导致车道线识别不准确的问题。而且本公开实施例中的方法不增加系统传感器,降低了成本。According to the method for calibrating lane line information provided by the embodiments of the present disclosure, millimeter-wave radar is used to extract stationary target information on both sides of the road, road guardrails, trees and other information are used to extract road features, and the lane line information identified by the camera is mutually verified. By using different road information for verification, the accuracy of the verification and the security of the system are greatly improved. The problem of inaccurate lane line recognition. Moreover, the methods in the embodiments of the present disclosure do not increase system sensors, which reduces costs.

应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本发明。It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention.

附图说明Description of drawings

此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本发明的实施例,并与说明书一起用于解释本发明的原理。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description serve to explain the principles of the invention.

图1是根据一示例性实施例示出的一种基于雷达校准车道线信息的方法流程示意图;Fig. 1 is a schematic flowchart of a method for calibrating lane line information based on radar according to an exemplary embodiment;

图2是根据一示例性实施例示出的一种基于雷达校准车道线信息的方法流程示意图;Fig. 2 is a schematic flowchart of a method for calibrating lane line information based on radar according to an exemplary embodiment;

图3是根据一示例性实施例示出的一种对静止目标聚类的示意图;Fig. 3 is a schematic diagram showing clustering of stationary objects according to an exemplary embodiment;

图4是根据一示例性实施例示出的一种对聚类后的簇进行曲线拟合的示意图;Fig. 4 is a schematic diagram of performing curve fitting on clustered clusters according to an exemplary embodiment;

图5是根据一示例性实施例示出的一种基于雷达校准车道线信息的装置的结构示意图;Fig. 5 is a schematic structural diagram of a device for calibrating lane line information based on radar according to an exemplary embodiment;

图6是根据一示例性实施例示出的一种基于雷达校准车道线信息的设备的结构示意图;Fig. 6 is a schematic structural diagram of a device for calibrating lane line information based on radar according to an exemplary embodiment;

图7是根据一示例性实施例示出的一种计算机存储介质的示意图。Fig. 7 is a schematic diagram of a computer storage medium according to an exemplary embodiment.

具体实施方式Detailed ways

以下描述和附图充分地示出本发明的具体实施方案,以使本领域的技术人员能够实践它们。The following description and drawings illustrate specific embodiments of the invention sufficiently to enable those skilled in the art to practice them.

应当明确,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其它实施例,都属于本发明保护的范围。It should be clear that the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本发明相一致的所有实施方式。相反,它们仅是如所附权利要求书中所详述的、本发明的一些方面相一致的系统和方法的例子。When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present invention. Rather, they are merely examples of systems and methods consistent with aspects of the invention as recited in the appended claims.

在本发明的描述中,需要理解的是,术语“第一”、“第二”等仅用于描述目的,而不能理解为指示或暗示相对重要性。对于本领域的普通技术人员而言,可以具体情况理解上述术语在本发明中的具体含义。此外,在本发明的描述中,除非另有说明,“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。In the description of the present invention, it should be understood that the terms "first", "second" and so on are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance. Those of ordinary skill in the art can understand the specific meanings of the above terms in the present invention in specific situations. In addition, in the description of the present invention, unless otherwise specified, "plurality" means two or more. "And/or" describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and/or B may indicate: A exists alone, A and B exist simultaneously, and B exists independently. The character "/" generally indicates that the contextual objects are an "or" relationship.

本公开实施例提供一种辅助校验摄像头检测车道线的方法,通过车辆前向毫米波雷达,提取道路两侧静止目标信息,根据提取的信息将静止目标拟合成一条三次方程,通过此方程来校验摄像头识别的车道线信息,如果两者能够匹配,则允许系统对车辆进行大角度转向控制,否则只允许对车辆进行小范围控制。采用毫米波雷达提取道路信息,在不增加传感器的情况下能够与摄像头进行相互校验,大大提高系统的安全性,解决系统在传感器方面的功能安全瓶颈。The embodiment of the present disclosure provides a method for assisting the verification camera to detect lane lines. The vehicle's forward millimeter-wave radar is used to extract the information of stationary targets on both sides of the road, and the stationary targets are fitted into a cubic equation according to the extracted information. Through this equation To verify the lane line information identified by the camera, if the two can match, the system is allowed to control the vehicle at a large angle, otherwise it is only allowed to control the vehicle in a small range. The millimeter-wave radar is used to extract road information, and it can be mutually verified with the camera without adding sensors, which greatly improves the security of the system and solves the functional safety bottleneck of the system in terms of sensors.

下面将结合附图1-附图4,对本申请实施例提供的基于雷达校准车道线信息的方法进行详细介绍,参见图1,该方法具体包括以下步骤:The method for calibrating lane line information based on radar provided in the embodiment of the present application will be described in detail below in conjunction with accompanying drawings 1-4. Referring to FIG. 1, the method specifically includes the following steps:

S101通过车辆上安装的雷达设备获取道路两侧的静止目标信息。S101 Obtain information of stationary targets on both sides of the road through the radar equipment installed on the vehicle.

在一种可能的实现方式中,在执行步骤S101之前,还包括获取车辆上安装的前向摄像头识别的车道线信息,在现有技术中,通过车辆上安装的摄像头可以输出识别的车道线信息以及车道线的置信度。In a possible implementation, before step S101 is executed, it also includes obtaining the lane line information recognized by the forward camera installed on the vehicle. In the prior art, the recognized lane line information can be output by the camera installed on the vehicle. and the confidence of the lane line.

进一步地,根据识别出来的车道线判断道路类型,例如,根据识别出来的车道线信息计算道路的曲率,曲率越大,说明道路越弯曲,当道路曲率大于预设曲率阈值时,确定道路为弯路,本公开实施例中的曲率阈值本领域技术人员可自行设定。Further, the road type is judged according to the identified lane lines, for example, the curvature of the road is calculated according to the identified lane line information, the greater the curvature, the more curved the road is, and when the road curvature is greater than the preset curvature threshold, it is determined that the road is a curved road , the curvature threshold in the embodiments of the present disclosure can be set by those skilled in the art.

若判断出来的道路类型为直路,说明路况简单,无需进一步校验道路线信息,直接执行车辆的控制指令。若判断出来的道路类型为弯路,说明路况较为复杂,为了提高道路线信息识别的准确率,引入车辆上的雷达设备进一步校验车道线信息。If the determined road type is a straight road, it means that the road condition is simple, and there is no need to further verify the road route information, and the control command of the vehicle is directly executed. If the determined road type is a curved road, it means that the road conditions are more complicated. In order to improve the accuracy of road line information recognition, the radar equipment on the vehicle is introduced to further verify the lane line information.

具体地,可以通过车辆上安装的毫米波雷达设备获取道路两旁的信息,然后从毫米波雷达拍摄的数据中提取道路两旁的静止目标信息,包括道路两旁种植的树木信息、道路两旁的护栏信息、道路两旁的路灯信息等。Specifically, the information on both sides of the road can be obtained through the millimeter-wave radar equipment installed on the vehicle, and then the stationary target information on both sides of the road can be extracted from the data captured by the millimeter-wave radar, including information on trees planted on both sides of the road, information on guardrails on both sides of the road, Street light information on both sides of the road, etc.

本步骤通过采用车辆上本身具备的毫米波雷达获取道路两旁的静止目标信息,大大降低了系统成本,而且从不同方向提取道路信息,表现了信息的多维性。In this step, the system cost is greatly reduced by using the millimeter-wave radar on the vehicle to obtain the stationary target information on both sides of the road, and the road information is extracted from different directions, showing the multi-dimensionality of the information.

S102对静止目标信息进行聚类,并对分类后的簇进行曲线拟合。S102 clustering the stationary target information, and performing curve fitting on the classified clusters.

为了根据提取出来的静止目标信息确定道路特征,首先对静止目标信息进行聚类。在一种可能的实现方式中,通过基于密度生长的聚类算法对静止目标信息进行聚类,常用的聚类算法通常需要指定待聚类簇的个数,但是在此应用场景中,由于环境复杂,静止目标个数未知,因此确定簇数的聚类算法并不适用。在一种可能的实现方式中,根据DBSCAN聚类算法、OPTICS聚类算法、DENCLUE聚类算法以及区域生长的概念,由一个种子点开始,对其一定空间半径内的点进行处理,将符合要求的点纳入同一簇,舍弃不符合要求的点。得到聚类后的静止目标簇。In order to determine road features based on the extracted stationary object information, the stationary object information is clustered first. In a possible implementation, the stationary target information is clustered through a clustering algorithm based on density growth. Commonly used clustering algorithms usually need to specify the number of clusters to be clustered. However, in this application scenario, due to the environmental The number of complex and stationary targets is unknown, so the clustering algorithm to determine the number of clusters is not applicable. In a possible implementation, according to the DBSCAN clustering algorithm, OPTICS clustering algorithm, DENCLUE clustering algorithm and the concept of region growth, starting from a seed point, processing points within a certain spatial radius will meet the requirements The points are included in the same cluster, and the points that do not meet the requirements are discarded. Get the stationary target cluster after clustering.

图3是根据一示例性实施例示出的一种对静止目标聚类的示意图,如图3所示,左半部分是对直路两旁的静止目标进行聚类,聚类后可以得到两个簇,分别位于道路两旁。右半部分是对弯路两旁的静止目标进行聚类,通过聚类,可以得到位于道路两旁的两个簇。Fig. 3 is a schematic diagram of clustering stationary objects according to an exemplary embodiment. As shown in Fig. 3, the left half is to cluster stationary objects on both sides of a straight road, and two clusters can be obtained after clustering, are located on both sides of the road. The right half is to cluster the stationary targets on both sides of the curved road. Through clustering, two clusters located on both sides of the road can be obtained.

进一步地,为了方便地表示道路信息,对分类后的每一个簇进行曲线拟合,得到拟合后的三次函数曲线。图4是根据一示例性实施例示出的一种对聚类后的簇进行曲线拟合的示意图,如图4所示,左半部分的两条粗竖直线就是拟合出来的曲线,右半部分的弯曲的粗线也是拟合出来的曲线,拟合出来的曲线是三次函数曲线,采用方程ax3+bx2+cx+d=0表示,通过对方程求解,可以得到拟合出来的曲线的信息。Further, in order to conveniently represent road information, curve fitting is performed on each classified cluster to obtain a fitted cubic function curve. Fig. 4 is a schematic diagram of curve fitting for clustered clusters according to an exemplary embodiment. As shown in Fig. 4, the two thick vertical lines in the left half are the fitted curves, and the right Half of the curved thick line is also a fitted curve. The fitted curve is a cubic function curve, expressed by the equation ax 3 +bx 2 +cx+d=0. By solving the equation, the fitted curve can be obtained information about the curve.

S103将拟合后的曲线与摄像头识别的车道线信息进行特征匹配,若匹配成功,则执行正常的车辆控制指令,若匹配不成功,根据拟合后的曲线校准车道线信息。S103 performs feature matching on the fitted curve and the lane marking information recognized by the camera. If the matching is successful, normal vehicle control instructions are executed. If the matching is unsuccessful, the lane marking information is calibrated according to the fitted curve.

在一个实施例中,对分类后的簇进行曲线拟合之后,还包括根据车辆与拟合曲线的距离以及拟合曲线所在的簇中静止目标的个数确定拟合曲线的置信度,具体地,车辆与拟合曲线的距离越近,拟合曲线所在的簇中的静止目标的个数越多,则该条拟合曲线的置信度越高,置信度越高,说明其越能准确代表道路实际特征。In one embodiment, after performing curve fitting on the classified clusters, it also includes determining the confidence of the fitting curve according to the distance between the vehicle and the fitting curve and the number of stationary objects in the cluster where the fitting curve is located, specifically , the closer the distance between the vehicle and the fitting curve is, and the more stationary targets are in the cluster where the fitting curve is located, the higher the confidence of the fitting curve is, and the higher the confidence, it means that it can accurately represent actual characteristics of the road.

进一步地,判断拟合曲线的置信度与预设第一阈值的大小关系,其中,预设第一阈值本领域技术人员可自行设定,本公开实施例不做具体限制。当置信度小于预设第一阈值时,说明拟合曲线的可信度比较低,此时,不通过拟合曲线校准车道线信息。而是提取雷达与摄像头输出的障碍物信息,根据将要执行的转弯控制指令预描车辆将要行驶的轨迹,若预设时间段内该轨迹中没有障碍物,则执行转弯控制指令,否则不执行,并发出报警信息通知驾驶人员。Further, the relationship between the confidence degree of the fitting curve and the preset first threshold value is judged, wherein the preset first threshold value can be set by those skilled in the art by themselves, and the embodiment of the present disclosure does not specifically limit it. When the confidence level is less than the preset first threshold, it indicates that the fitting curve has a relatively low reliability. At this time, the lane line information is not calibrated through the fitting curve. Instead, it extracts the obstacle information output by the radar and the camera, and previews the trajectory of the vehicle according to the turning control command to be executed. If there is no obstacle in the trajectory within the preset time period, the turning control command is executed, otherwise it is not executed. And send an alarm message to notify the driver.

当置信度大于等于预设第一阈值时,将拟合后的曲线与摄像头识别的车道线信息进行特征匹配,若匹配成功,则执行正常的车辆控制指令。若匹配不成功,根据拟合后的曲线校准车道线信息。When the confidence level is greater than or equal to the preset first threshold, the fitted curve is matched with the lane line information identified by the camera, and if the matching is successful, normal vehicle control instructions are executed. If the matching is unsuccessful, the lane line information is calibrated according to the fitted curve.

具体地,如果拟合曲线的置信度达到阈值,说明拟合曲线的可信度较高,此时,可以根据拟合曲线信息进一步校准车道线信息。选取道路两旁置信度最高的一条拟合曲线,计算该条曲线的第二曲率、第二曲率变化率等信息,然后根据摄像头识别的车道线信息计算道路的第一曲率、第一曲率变化率等信息,将两种办法确定出来的道路特征进行特征匹配,计算第一曲率与第二曲率的差值,计算第一曲率变化率与第二曲率变化率的差值,若第一曲率与第二曲率的差值小于预设第二阈值以及第一曲率变化率与第二曲率变化率的差值小于预设第三阈值,说明差值在预设范围内,两种办法识别出来的车道信息相似,道路特征匹配。其中,第二阈值和第三阈值是一个差值范围,本领域技术人员可以自行设定。Specifically, if the confidence of the fitted curve reaches a threshold, it means that the fitted curve has a high degree of confidence. At this time, the lane marking information can be further calibrated according to the fitted curve information. Select a fitting curve with the highest confidence on both sides of the road, calculate the second curvature and second curvature change rate of the curve, and then calculate the first curvature and first curvature change rate of the road based on the lane line information recognized by the camera Information, match the road features determined by the two methods, calculate the difference between the first curvature and the second curvature, and calculate the difference between the first curvature change rate and the second curvature change rate, if the first curvature and the second curvature The curvature difference is less than the preset second threshold and the difference between the first curvature change rate and the second curvature change rate is less than the preset third threshold, indicating that the difference is within the preset range, and the lane information identified by the two methods is similar , road feature matching. Wherein, the second threshold and the third threshold are a difference range, which can be set by those skilled in the art.

若道路特征匹配,可以执行正常的车辆控制指令,可以对车辆进行大角度转向控制。若道路特征不匹配,可以根据拟合曲线信息修正摄像头识别的车道线信息。取两者融合后的结果对车辆进行控制。If the road characteristics match, normal vehicle control commands can be executed, and large-angle steering control can be performed on the vehicle. If the road features do not match, the lane line information recognized by the camera can be corrected according to the fitting curve information. Take the result of the fusion of the two to control the vehicle.

在一种可能的实现方式中,获取拟合曲线的置信度以及摄像头识别的车道线的置信度,根据二者的置信度采用加权平均的方式对车道线的特征信息进行修正。例如,根据拟合曲线计算出来的道路曲率为0.8,拟合曲线的置信度为0.7,根据摄像头识别的车道线计算出来的道路曲率为0.4,摄像头识别出来的车道线的置信度为0.3,则融合后的道路曲率为0.8*0.7+0.4*0.3=0.68,则最后的道路曲率为0.68。In a possible implementation manner, the confidence of the fitted curve and the confidence of the lane line recognized by the camera are obtained, and the characteristic information of the lane line is corrected by means of a weighted average according to the confidence of the two. For example, the road curvature calculated according to the fitting curve is 0.8, the confidence of the fitting curve is 0.7, the road curvature calculated according to the lane line recognized by the camera is 0.4, and the confidence degree of the lane line recognized by the camera is 0.3, then The fused road curvature is 0.8*0.7+0.4*0.3=0.68, so the final road curvature is 0.68.

取两者融合后的结果对车辆进行控制,例如,通过本车距离车道线的距离、道路曲率、道路曲率变化率等信息来判断车辆与两边车道线的距离,最终计算出车辆与车道中心的偏差,通过控制转向减小此偏差达到车辆居中行驶的目的。Take the result of the fusion of the two to control the vehicle, for example, judge the distance between the vehicle and the lane lines on both sides through the distance from the vehicle to the lane line, road curvature, road curvature change rate, etc., and finally calculate the distance between the vehicle and the center of the lane Deviation, by controlling the steering to reduce this deviation to achieve the purpose of the vehicle driving in the center.

根据该方法,可以进行相互校验,使用不同传感器检测道路的不同特征,提取出车道线信息,从功能安全方面讲,这是一个相互独立的系统,其相互校验能够最大化提高检验的准确性。According to this method, mutual verification can be carried out, using different sensors to detect different characteristics of the road, and extracting lane line information. From the perspective of functional safety, this is a mutually independent system, and its mutual verification can maximize the accuracy of inspection sex.

为了便于理解本申请实施例提供的车道线校准方法,下面结合附图2进行说明。如图2所示,该方法主要包括如下步骤:In order to facilitate understanding of the lane line calibration method provided by the embodiment of the present application, the following description will be made in conjunction with FIG. 2 . As shown in Figure 2, the method mainly includes the following steps:

首先,获取车辆通过摄像头识别的车道线信息,根据车道线信息对道路类型分类,若道路类型为直路,则直接执行车辆的控制指令,若道路类型为弯路,则通过车辆上的毫米波雷达获取道路两旁的数据。根据毫米波雷达提取的数据对车道线进行校准。First, obtain the lane line information identified by the vehicle through the camera, and classify the road type according to the lane line information. If the road type is a straight road, the vehicle's control command will be directly executed. If the road type is a curved road, it will be obtained through the millimeter wave radar on the vehicle Data on both sides of the road. Lane lines are calibrated based on data extracted from millimeter wave radar.

具体地,采用毫米波雷达获取道路两旁的静止目标信息,通过基于密度生长的聚类算法对静止目标信息进行聚类,对分类后的每一个簇进行曲线拟合,得到拟合后的三次函数曲线。根据车辆与拟合曲线的距离以及拟合曲线所在的簇中静止目标的个数确定拟合曲线的置信度,当置信度小于预设第一阈值时,进行障碍物与预描轨迹分析,提取雷达与摄像头输出的障碍物信息,根据将要执行的控制指令确定车辆将要行驶的轨迹,若预设时间段内轨迹中没有障碍物,则执行控制指令,否则不执行,并发出报警信息。Specifically, the millimeter-wave radar is used to obtain the stationary target information on both sides of the road, the stationary target information is clustered through the clustering algorithm based on density growth, and the curve fitting is performed on each cluster after classification to obtain the fitted cubic function curve. Determine the confidence degree of the fitting curve according to the distance between the vehicle and the fitting curve and the number of stationary objects in the cluster where the fitting curve is located. When the confidence degree is less than the preset first threshold, analyze the obstacle and the preview trajectory, and extract The obstacle information output by the radar and the camera determines the trajectory of the vehicle according to the control command to be executed. If there is no obstacle in the trajectory within the preset time period, the control command will be executed, otherwise it will not be executed and an alarm message will be issued.

当置信度大于等于预设第一阈值时,将拟合后的曲线与摄像头识别的车道线信息进行特征匹配,若匹配成功,则执行正常的车辆控制指令,若匹配不成功,则获取拟合曲线的置信度以及摄像头识别的车道线的置信度,根据二者的置信度采用加权平均的方式对车道线的特征信息进行修正,根据融合后的数据进行车辆控制。When the confidence is greater than or equal to the preset first threshold, the fitted curve is matched with the lane line information identified by the camera. If the matching is successful, the normal vehicle control command will be executed. If the matching is unsuccessful, the fitting will be obtained. The confidence of the curve and the confidence of the lane line recognized by the camera, according to the confidence of the two, the characteristic information of the lane line is corrected by weighted average, and the vehicle is controlled according to the fused data.

根据本公开实施例提供的校准车道线信息的方法,采用毫米波雷达提取道路两侧的静止目标信息,利用道路护栏,树木等信息,提取道路特征,与摄像头识别的车道线信息相互校验,通过采用不同的道路信息进行校验,大大提高了校验的准确率以及系统的安全性,解决了现有技术中由于实际道路的车道线模糊、损坏等情况对摄像头车道线识别造成干扰,导致车道线识别不准确的问题。而且本公开实施例中的方法不增加系统传感器,降低了成本。According to the method for calibrating lane line information provided by the embodiments of the present disclosure, millimeter-wave radar is used to extract stationary target information on both sides of the road, road guardrails, trees and other information are used to extract road features, and the lane line information identified by the camera is mutually verified. By using different road information for verification, the accuracy of the verification and the security of the system are greatly improved. The problem of inaccurate lane line recognition. Moreover, the methods in the embodiments of the present disclosure do not increase system sensors, which reduces costs.

本公开实施例还提供了一种基于雷达校准车道线信息的装置,该装置用于执行上述实施例的基于雷达校准车道线信息的方法,如图5所示,该装置包括:An embodiment of the present disclosure also provides a device for calibrating lane line information based on radar, which is used to implement the method for calibrating lane line information based on radar in the above embodiment, as shown in FIG. 5 , the device includes:

获取模块501,用于通过车辆上安装的雷达设备获取道路两侧的静止目标信息;An acquisition module 501, configured to acquire stationary target information on both sides of the road through radar equipment installed on the vehicle;

曲线拟合模块502,用于对静止目标信息进行聚类,并对分类后的簇进行曲线拟合;The curve fitting module 502 is used for clustering the stationary target information, and performing curve fitting on the classified clusters;

校准模块503,用于将拟合后的曲线与摄像头识别的车道线信息进行特征匹配,若匹配成功,则执行正常的车辆控制指令,若匹配不成功,根据拟合后的曲线校准车道线信息。The calibration module 503 is used to perform feature matching on the fitted curve and the lane line information identified by the camera. If the matching is successful, execute normal vehicle control instructions. If the matching is unsuccessful, calibrate the lane line information according to the fitted curve .

需要说明的是,上述实施例提供的基于雷达校准车道线信息的装置在执行基于雷达校准车道线信息的方法时,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将设备的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。另外,上述实施例提供的基于雷达校准车道线信息的装置与基于雷达校准车道线信息的方法实施例属于同一构思,其体现实现过程详见方法实施例,这里不再赘述。It should be noted that when the device for calibrating lane line information based on radar provided in the above-mentioned embodiments executes the method for calibrating lane line information based on radar, it only uses the division of the above-mentioned functional modules as an example for illustration. The above function allocation is completed by different functional modules, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the device for calibrating lane line information based on radar and the method embodiment for calibrating lane line information based on radar provided in the above embodiments belong to the same concept, and the implementation process thereof is detailed in the method embodiment, and will not be repeated here.

本公开实施例还提供一种与前述实施例所提供的基于雷达校准车道线信息的方法对应的电子设备,以执行上述基于雷达校准车道线信息的方法。Embodiments of the present disclosure further provide an electronic device corresponding to the method for calibrating lane line information based on radar provided in the foregoing embodiments, so as to execute the method for calibrating lane line information based on radar.

请参考图6,其示出了本申请的一些实施例所提供的一种电子设备的示意图。如图6所示,电子设备包括:处理器600,存储器601,总线602和通信接口603,处理器600、通信接口603和存储器601通过总线602连接;存储器601中存储有可在处理器600上运行的计算机程序,处理器600运行计算机程序时执行本申请前述任一实施例所提供的基于雷达校准车道线信息的方法。Please refer to FIG. 6 , which shows a schematic diagram of an electronic device provided by some embodiments of the present application. As shown in Figure 6, the electronic equipment includes: processor 600, memory 601, bus 602 and communication interface 603, processor 600, communication interface 603 and memory 601 are connected by bus 602; Running computer program, the processor 600 executes the method for calibrating lane line information based on radar provided in any one of the foregoing embodiments of the present application when running the computer program.

其中,存储器601可能包含高速随机存取存储器(RAM:Random Access Memory),也可能还包括非不稳定的存储器(non-volatile memory),例如至少一个磁盘存储器。通过至少一个通信接口603(可以是有线或者无线)实现该系统网元与至少一个其他网元之间的通信连接,可以使用互联网、广域网、本地网、城域网等。Wherein, the memory 601 may include a high-speed random access memory (RAM: Random Access Memory), and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory. The communication connection between the system network element and at least one other network element is realized through at least one communication interface 603 (which may be wired or wireless), and the Internet, wide area network, local network, metropolitan area network, etc. can be used.

总线602可以是ISA总线、PCI总线或EISA总线等。总线可以分为地址总线、数据总线、控制总线等。其中,存储器601用于存储程序,处理器600在接收到执行指令后,执行程序,前述本申请实施例任一实施方式揭示的基于雷达校准车道线信息的方法可以应用于处理器600中,或者由处理器600实现。The bus 602 may be an ISA bus, a PCI bus, or an EISA bus, etc. The bus can be divided into address bus, data bus, control bus and so on. Wherein, the memory 601 is used to store the program, and the processor 600 executes the program after receiving the execution instruction. The method for calibrating lane line information based on radar disclosed in any of the above-mentioned embodiments of the present application can be applied to the processor 600, or implemented by the processor 600.

处理器600可能是一种集成电路芯片,具有信号的处理能力。在实现过程中,上述方法的各步骤可以通过处理器600中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器600可以是通用处理器,包括中央处理器(Central Processing Unit,简称CPU)、网络处理器(Network Processor,简称NP)等;还可以是数字信号处理器(DSP)、专用集成电路(ASIC)、现成可编程门阵列(FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器601,处理器600读取存储器601中的信息,结合其硬件完成上述方法的步骤。The processor 600 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method may be implemented by an integrated logic circuit of hardware in the processor 600 or an instruction in the form of software. The above-mentioned processor 600 can be a general-purpose processor, including a central processing unit (Central Processing Unit, referred to as CPU), a network processor (Network Processor, referred to as NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), off-the-shelf programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. Various methods, steps, and logic block diagrams disclosed in the embodiments of the present application may be implemented or executed. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module can be located in a mature storage medium in the field such as random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, register. The storage medium is located in the memory 601, and the processor 600 reads the information in the memory 601, and completes the steps of the above method in combination with its hardware.

本申请实施例提供的电子设备与本申请实施例提供的基于雷达校准车道线信息的方法出于相同的发明构思,具有与其采用、运行或实现的方法相同的有益效果。The electronic device provided in the embodiment of the present application is based on the same inventive concept as the method for calibrating lane line information based on radar provided in the embodiment of the present application, and has the same beneficial effect as the method adopted, operated or implemented.

本申请实施例还提供一种与前述实施例所提供的基于雷达校准车道线信息的方法对应的计算机可读存储介质,请参考图7,其示出的计算机可读存储介质为光盘700,其上存储有计算机程序(即程序产品),计算机程序在被处理器运行时,会执行前述任意实施例所提供的基于雷达校准车道线信息的方法。The embodiment of the present application also provides a computer-readable storage medium corresponding to the method for calibrating lane line information based on radar provided in the foregoing embodiments, please refer to FIG. 7 , the computer-readable storage medium shown is an optical disc 700, which A computer program (that is, a program product) is stored on the computer, and when the computer program is run by the processor, it will execute the method for calibrating lane line information based on radar provided in any of the foregoing embodiments.

需要说明的是,计算机可读存储介质的例子还可以包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他光学、磁性存储介质,在此不再一一赘述。It should be noted that examples of computer-readable storage media may also include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access Memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other optical and magnetic storage media will not be repeated here.

本申请的上述实施例提供的计算机可读存储介质与本申请实施例提供的基于雷达校准车道线信息的方法出于相同的发明构思,具有与其存储的应用程序所采用、运行或实现的方法相同的有益效果。The computer-readable storage medium provided by the above-mentioned embodiments of the present application is based on the same inventive concept as the method for calibrating lane line information based on radar provided by the embodiments of the present application, and has the same method adopted, run or implemented by its stored application program beneficial effect.

以上实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the above embodiments can be combined arbitrarily. To make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be It is considered to be within the range described in this specification.

以上实施例仅表达了本发明的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对本发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干变形和改进,这些都属于本发明的保护范围。因此,本发明专利的保护范围应以所附权利要求为准。The above examples only express several implementations of the present invention, and the description thereof is relatively specific and detailed, but should not be construed as limiting the patent scope of the present invention. It should be noted that, for those skilled in the art, several modifications and improvements can be made without departing from the concept of the present invention, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the patent for the present invention should be based on the appended claims.

Claims (8)

1.一种基于雷达校准车道线信息的方法,其特征在于,包括:1. A method for calibrating lane line information based on radar, characterized in that, comprising: 通过车辆上安装的雷达设备获取道路两侧的静止目标信息;Obtain stationary target information on both sides of the road through the radar equipment installed on the vehicle; 对所述静止目标信息进行聚类,并对分类后的簇进行曲线拟合;根据车辆与拟合曲线的距离以及拟合曲线所在的簇中静止目标的个数确定拟合曲线的置信度;当所述置信度大于等于预设第一阈值时,将拟合后的曲线与摄像头识别的车道线信息进行特征匹配,若匹配成功,则执行正常的车辆控制指令,若匹配不成功,根据拟合后的曲线校准所述车道线信息,包括获取所述拟合曲线的置信度以及摄像头识别的车道线的置信度;根据二者的置信度采用加权平均的方式对所述车道线的特征信息进行修正;Clustering the stationary target information, and performing curve fitting on the classified clusters; determining the confidence of the fitting curve according to the distance between the vehicle and the fitting curve and the number of stationary targets in the cluster where the fitting curve is located; When the confidence level is greater than or equal to the preset first threshold, feature matching is performed on the fitted curve with the lane line information identified by the camera. If the matching is successful, normal vehicle control instructions are executed; The combined curve calibrates the lane line information, including obtaining the confidence of the fitted curve and the confidence of the lane line identified by the camera; according to the confidence of the two, the feature information of the lane line is calculated in a weighted average manner make corrections; 当所述置信度小于预设第一阈值时,提取雷达与摄像头输出的障碍物信息,根据将要执行的控制指令确定车辆将要行驶的轨迹,若预设时间段内所述轨迹中没有障碍物,则执行控制指令,否则不执行,并发出报警信息。When the confidence level is less than the preset first threshold, the obstacle information output by the radar and the camera is extracted, and the track to be driven by the vehicle is determined according to the control command to be executed. If there is no obstacle in the track within the preset time period, Then execute the control instruction, otherwise it will not execute and send out an alarm message. 2.根据权利要求1所述的方法,其特征在于,通过车辆上安装的雷达设备获取道路两侧的静止目标信息之前,还包括:2. The method according to claim 1, wherein, before obtaining the stationary target information on both sides of the road through the radar equipment installed on the vehicle, it also includes: 获取车辆摄像头识别的车道线信息以及所述车道线的置信度信息。The lane line information recognized by the vehicle camera and the confidence level information of the lane line are acquired. 3.根据权利要求2所述的方法,其特征在于,获取车辆摄像头识别的车道线信息以及所述车道线的置信度信息之后,还包括:3. The method according to claim 2, characterized in that after acquiring the lane line information identified by the vehicle camera and the confidence level information of the lane line, further comprising: 根据所述车道线信息判断道路类型;judging the road type according to the lane line information; 若所述道路类型为直路,则不校准车道线信息,直接执行车辆控制指令;If the road type is a straight road, the vehicle control instruction is directly executed without calibrating the lane line information; 若所述道路类型为弯路,则通过车辆上安装的雷达设备获取道路两侧的静止目标信息。If the road type is a curved road, the stationary target information on both sides of the road is acquired through the radar equipment installed on the vehicle. 4.根据权利要求1所述的方法,其特征在于,对所述静止目标信息进行聚类,并对分类后的簇进行曲线拟合,包括:4. The method according to claim 1, wherein clustering the stationary target information and performing curve fitting on the classified clusters includes: 通过基于密度生长的聚类算法对所述静止目标信息进行聚类;clustering the stationary target information through a clustering algorithm based on density growth; 对分类后的每一个簇进行曲线拟合,得到拟合后的三次函数曲线。Curve fitting is performed on each cluster after classification to obtain the fitted cubic function curve. 5.根据权利要求1所述的方法,其特征在于,将拟合后的曲线与摄像头识别的车道线信息进行特征匹配,包括:5. The method according to claim 1, characterized in that, performing feature matching on the fitted curve and the lane line information identified by the camera, comprising: 根据摄像头识别的车道线信息确定道路的第一曲率、第一曲率变化率;Determine the first curvature and first curvature change rate of the road according to the lane line information identified by the camera; 根据拟合后的曲线确定道路的第二曲率、第二曲率变化率;determining the second curvature and the second curvature change rate of the road according to the fitted curve; 若第一曲率与第二曲率的差值小于预设第二阈值以及第一曲率变化率与第二曲率变化率的差值小于预设第三阈值,则确定匹配成功。If the difference between the first curvature and the second curvature is smaller than a preset second threshold and the difference between the first curvature change rate and the second curvature change rate is smaller than a preset third threshold, it is determined that the matching is successful. 6.一种基于雷达校准车道线信息的装置,其特征在于,包括:6. A device for calibrating lane line information based on radar, characterized in that it comprises: 获取模块,用于通过车辆上安装的雷达设备获取道路两侧的静止目标信息;An acquisition module, configured to acquire stationary target information on both sides of the road through the radar equipment installed on the vehicle; 曲线拟合模块,用于对所述静止目标信息进行聚类,并对分类后的簇进行曲线拟合;A curve fitting module, configured to cluster the stationary target information and perform curve fitting on the classified clusters; 校准模块,用于根据车辆与拟合曲线的距离以及拟合曲线所在的簇中静止目标的个数确定拟合曲线的置信度;当所述置信度大于等于预设第一阈值时,将拟合后的曲线与摄像头识别的车道线信息进行特征匹配,若匹配成功,则执行正常的车辆控制指令,若匹配不成功,根据拟合后的曲线校准所述车道线信息,包括获取所述拟合曲线的置信度以及摄像头识别的车道线的置信度;根据二者的置信度采用加权平均的方式对所述车道线的特征信息进行修正;The calibration module is used to determine the confidence of the fitting curve according to the distance between the vehicle and the fitting curve and the number of stationary targets in the cluster where the fitting curve is located; when the confidence is greater than or equal to the preset first threshold, the fitting curve will be Perform feature matching on the combined curve and the lane line information identified by the camera. If the matching is successful, normal vehicle control instructions are executed. If the matching is unsuccessful, the lane line information is calibrated according to the fitted curve, including obtaining the proposed The confidence degree of the composite curve and the confidence degree of the lane line recognized by the camera; according to the confidence degree of the two, the characteristic information of the lane line is corrected by means of a weighted average; 当所述置信度小于预设第一阈值时,提取雷达与摄像头输出的障碍物信息,根据将要执行的控制指令确定车辆将要行驶的轨迹,若预设时间段内所述轨迹中没有障碍物,则执行控制指令,否则不执行,并发出报警信息。When the confidence level is less than the preset first threshold, the obstacle information output by the radar and the camera is extracted, and the track to be driven by the vehicle is determined according to the control command to be executed. If there is no obstacle in the track within the preset time period, Then execute the control instruction, otherwise it will not execute and send out an alarm message. 7.一种基于雷达校准车道线信息的设备,其特征在于,包括处理器和存储有程序指令的存储器,所述处理器被配置为在执行所述程序指令时,执行如权利要求1至5任一项所述的基于雷达校准车道线信息的方法。7. A device for calibrating lane line information based on radar, characterized in that it includes a processor and a memory storing program instructions, the processor is configured to execute the program as claimed in claims 1 to 5 when executing the program instructions. The method for calibrating lane line information based on radar according to any one of them. 8.一种计算机可读介质,其特征在于,其上存储有计算机可读指令,所述计算机可读指令可被处理器执行以实现如权利要求1至5任一项所述的一种基于雷达校准车道线信息的方法。8. A computer-readable medium, characterized in that computer-readable instructions are stored thereon, and the computer-readable instructions can be executed by a processor to implement a method based on any one of claims 1 to 5. A method for radar calibration of lane line information.
CN202011641279.3A 2020-12-31 2020-12-31 Method, device, equipment and storage medium for calibrating lane marking information based on radar Active CN112712040B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011641279.3A CN112712040B (en) 2020-12-31 2020-12-31 Method, device, equipment and storage medium for calibrating lane marking information based on radar

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011641279.3A CN112712040B (en) 2020-12-31 2020-12-31 Method, device, equipment and storage medium for calibrating lane marking information based on radar

Publications (2)

Publication Number Publication Date
CN112712040A CN112712040A (en) 2021-04-27
CN112712040B true CN112712040B (en) 2023-08-22

Family

ID=75547999

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011641279.3A Active CN112712040B (en) 2020-12-31 2020-12-31 Method, device, equipment and storage medium for calibrating lane marking information based on radar

Country Status (1)

Country Link
CN (1) CN112712040B (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113706731A (en) * 2021-07-15 2021-11-26 北京无限感测科技有限公司 ETC integrated antenna power self-adaptive adjusting method and device
CN113569800B (en) * 2021-08-09 2024-10-29 北京地平线机器人技术研发有限公司 Lane recognition verification method and device, readable storage medium and electronic equipment
CN113673438B (en) * 2021-08-23 2025-03-18 上海商汤临港智能科技有限公司 A collision warning method, device, electronic equipment and storage medium
CN113791414B (en) * 2021-08-25 2023-12-29 南京市德赛西威汽车电子有限公司 Scene recognition method based on millimeter wave vehicle-mounted radar view
CN113917446A (en) * 2021-08-31 2022-01-11 际络科技(上海)有限公司 Road guardrail prediction method, device and storage medium
CN113990052B (en) * 2021-10-29 2023-08-15 南京慧尔视防务科技有限公司 Method, device, storage medium and road protection vehicle for early warning of approaching vehicles
CN114002679A (en) * 2021-11-01 2022-02-01 无锡威孚高科技集团股份有限公司 Method, device and storage medium for obtaining road drivable area based on millimeter wave radar
CN114280582A (en) * 2021-12-31 2022-04-05 中国第一汽车股份有限公司 Calibration and calibration method and device for laser radar, storage medium and electronic equipment
CN114694121A (en) * 2022-04-25 2022-07-01 上海商汤临港智能科技有限公司 Lane line correction method, lane line correction device, electronic apparatus, storage medium, and program product
CN115116017B (en) * 2022-06-27 2025-01-24 北京旋极信息技术股份有限公司 Lane recognition method, device and storage medium
CN115236627B (en) * 2022-09-21 2022-12-16 深圳安智杰科技有限公司 Millimeter wave radar data clustering method based on multi-frame Doppler velocity dimension expansion

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108519605A (en) * 2018-04-09 2018-09-11 重庆邮电大学 Road edge detection method based on lidar and camera
CN108960183A (en) * 2018-07-19 2018-12-07 北京航空航天大学 A kind of bend target identification system and method based on Multi-sensor Fusion
CN109532826A (en) * 2017-09-21 2019-03-29 天津所托瑞安汽车科技有限公司 A kind of radar anticollision method for early warning based on the optimization of lane line Visual identification technology
CN110174113A (en) * 2019-04-28 2019-08-27 福瑞泰克智能系统有限公司 A kind of localization method, device and the terminal in vehicle driving lane
CN110962858A (en) * 2019-12-23 2020-04-07 潍柴动力股份有限公司 Target identification method and device
CN111247525A (en) * 2019-01-14 2020-06-05 深圳市大疆创新科技有限公司 Lane detection method and device, lane detection equipment and mobile platform
CN112132109A (en) * 2020-10-10 2020-12-25 北京百度网讯科技有限公司 Lane line processing and lane positioning method, device, equipment and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109532826A (en) * 2017-09-21 2019-03-29 天津所托瑞安汽车科技有限公司 A kind of radar anticollision method for early warning based on the optimization of lane line Visual identification technology
CN108519605A (en) * 2018-04-09 2018-09-11 重庆邮电大学 Road edge detection method based on lidar and camera
CN108960183A (en) * 2018-07-19 2018-12-07 北京航空航天大学 A kind of bend target identification system and method based on Multi-sensor Fusion
CN111247525A (en) * 2019-01-14 2020-06-05 深圳市大疆创新科技有限公司 Lane detection method and device, lane detection equipment and mobile platform
CN110174113A (en) * 2019-04-28 2019-08-27 福瑞泰克智能系统有限公司 A kind of localization method, device and the terminal in vehicle driving lane
CN110962858A (en) * 2019-12-23 2020-04-07 潍柴动力股份有限公司 Target identification method and device
CN112132109A (en) * 2020-10-10 2020-12-25 北京百度网讯科技有限公司 Lane line processing and lane positioning method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN112712040A (en) 2021-04-27

Similar Documents

Publication Publication Date Title
CN112712040B (en) Method, device, equipment and storage medium for calibrating lane marking information based on radar
US20220373353A1 (en) Map Updating Method and Apparatus, and Device
US11295144B2 (en) Obstacle classification method and apparatus based on unmanned vehicle, device, and storage medium
CN108596081A (en) A kind of traffic detection method merged based on radar and video camera
US11699292B2 (en) Apparatus for managing driving pattern based on object recognition, vehicle driving controlling apparatus using the same and method thereof
US20220292849A1 (en) Road Information Detection Method and Apparatus
CN115507862A (en) Lane line positioning method and device, electronic device and storage medium
CN114550142A (en) Parking space detection method based on fusion of 4D millimeter wave radar and image recognition
CN112699711A (en) Lane line detection method, lane line detection device, storage medium, and electronic apparatus
WO2021057324A1 (en) Data processing method and apparatus, chip system, and medium
WO2022062019A1 (en) Map matching method and apparatus, and electronic device and storage medium
WO2023213083A1 (en) Object detection method and apparatus and driverless car
CN111753901A (en) Data fusion method, device and system and computer equipment
CN113450389A (en) Target tracking method and device and electronic equipment
CN118552934A (en) Object detection method, device, electronic apparatus, vehicle, medium, and program product
CN115719375A (en) Target fusion method, device, electronic device, and computer-readable storage medium
CN116343148A (en) Lane line detection method, device, vehicle and storage medium
CN115042784A (en) Automobile adaptive cruise system control method, device, vehicle and storage medium
CN118675149B (en) Method, device, equipment, storage medium and vehicle for detecting stationary target
CN112733778A (en) Vehicle front guide determination method and device and computer equipment
US12217511B1 (en) Real time management of detected issues
JP2011216012A (en) Image recognition apparatus
US20240005647A1 (en) Vehicle and Control Method Thereof
CN116778278A (en) Target detection method and device and target tracking method and device
CN115691127A (en) Obstacle detection method, device, electronic device, and computer-readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant