[go: up one dir, main page]

CN110228413B - Safety warning system to avoid pedestrians getting caught under the car when a large vehicle turns - Google Patents

Safety warning system to avoid pedestrians getting caught under the car when a large vehicle turns Download PDF

Info

Publication number
CN110228413B
CN110228413B CN201910494515.4A CN201910494515A CN110228413B CN 110228413 B CN110228413 B CN 110228413B CN 201910494515 A CN201910494515 A CN 201910494515A CN 110228413 B CN110228413 B CN 110228413B
Authority
CN
China
Prior art keywords
vehicle
information
alarm device
area
early warning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201910494515.4A
Other languages
Chinese (zh)
Other versions
CN110228413A (en
Inventor
刘宏飞
周璐瑶
许洪国
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jilin University
Original Assignee
Jilin University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jilin University filed Critical Jilin University
Priority to CN201910494515.4A priority Critical patent/CN110228413B/en
Publication of CN110228413A publication Critical patent/CN110228413A/en
Application granted granted Critical
Publication of CN110228413B publication Critical patent/CN110228413B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B62LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62DMOTOR VEHICLES; TRAILERS
    • B62D13/00Steering specially adapted for trailers
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B62LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62DMOTOR VEHICLES; TRAILERS
    • B62D15/00Steering not otherwise provided for
    • B62D15/02Steering position indicators ; Steering position determination; Steering aids
    • B62D15/029Steering assistants using warnings or proposing actions to the driver without influencing the steering system

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Human Computer Interaction (AREA)
  • Traffic Control Systems (AREA)

Abstract

The invention relates to a safety early warning system for preventing pedestrians from being involved under a large vehicle during turning, which comprises a distance measuring radar sensor, a camera, a corner sensor, an information integration unit, a road dangerous area dividing unit and an alarm device. The distance measuring radar sensor collects distance information of objects around the vehicle body, the camera collects images of two sides of the vehicle, and the images are identified by using a convolutional neural network algorithm. The turning angle sensor collects vehicle turning angle information, and a K-means clustering analysis algorithm is adopted to divide the vehicle turning angle information into a dangerous area, an early warning area or a safe area. The information integration unit and the road dangerous area division unit perform information fusion, processing and analysis on the acquired data information, judge whether pedestrians exist in the dangerous area, and output the judgment result to the alarm device for early warning. The invention detects the environment of the large vehicle, judges whether pedestrians exist in the dangerous area, and transmits the judgment result to the alarm device for early warning, thereby improving the safety of road traffic.

Description

大型车辆转弯时避免行人卷入车下的安全预警系统Safety warning system to avoid pedestrians getting caught under the car when a large vehicle turns

技术领域technical field

本发明属于道路交通安全技术领域,涉及一种行人安全预警设备,具体涉及一种大型车辆转弯时避免行人卷入车下的安全预警系统。The invention belongs to the technical field of road traffic safety, and relates to a pedestrian safety early warning device, in particular to a safety early warning system for preventing pedestrians from being involved under the vehicle when a large vehicle turns.

背景技术Background technique

目前,大型车辆在转弯时由于转弯内轮差过大以及驾驶员视觉盲区等问题的存在,使得将车两侧的行人卷入车底的事故频繁发生。转弯过程中车辆旁边有行人或骑车的人员,如果驾驶人员或者行人不注意,容易将行人或骑车的人员卷入车底,一旦行人卷入车底,极大可能导致人员的伤亡,甚至可能危及生命。At present, accidents involving pedestrians on both sides of the vehicle frequently occur due to the large difference between the inner wheels and the driver's blind spot when turning a large vehicle. During the turning process, there are pedestrians or cyclists beside the vehicle. If the driver or pedestrian is not careful, the pedestrian or cyclist will easily be involved in the vehicle. May be life-threatening.

公开号为CN 108791166 A的发明专利申请公开了“一种具有在转弯道路保护行人的半挂车,包括挂车板和矩形块,包括挂车板和矩形块,挂车板的左右两侧设有收纳槽,收纳槽的左右内壁设有移动槽,矩形块的左右两端固定连接有移动板,移动板与移动槽滑动连接,矩形块的后端通过锁紧机构与收纳槽后侧壁连接,矩形块的下端设有第一存放槽,第一存放槽内部与防护机构连接”。该专利申请通过在半挂车的两侧设置防护机构,将行人隔离在半挂车的安全区域,避免被卷入车底的风险。但是该专利申请没有给行人以及驾驶员双重预警,不适用于大型车辆转弯内轮差过大以及驾驶员视觉盲区引起的事故。The invention patent application with publication number CN 108791166 A discloses "a semi-trailer capable of protecting pedestrians on a turning road, including a trailer plate and a rectangular block, including a trailer plate and a rectangular block, and the left and right sides of the trailer plate are provided with storage slots, The left and right inner walls of the receiving groove are provided with moving grooves, the left and right ends of the rectangular block are fixedly connected with moving plates, the moving plates are slidably connected with the moving grooves, and the rear end of the rectangular block is connected with the rear sidewall of the receiving groove through a locking mechanism. The lower end is provided with a first storage slot, and the inside of the first storage slot is connected with the protective mechanism." This patent application isolates pedestrians in the safe area of the semi-trailer by setting protective mechanisms on both sides of the semi-trailer to avoid the risk of being caught under the vehicle. However, the patent application does not give double warning to pedestrians and drivers, and it is not suitable for accidents caused by large vehicle turning inner wheel difference and driver's visual blind spot.

发明内容SUMMARY OF THE INVENTION

本发明的目的是提供一种大型车辆转弯时避免行人卷入车下的安全预警系统,在转弯时对车辆左右两边的环境进行检测,识别周围危险环境,给驾驶员以及两侧行人安全预警,保障车辆安全转弯以及车辆周围行人安全,提高道路交通的安全性。The purpose of the present invention is to provide a safety warning system that avoids pedestrians from being involved in the vehicle when a large vehicle turns, detects the environment on the left and right sides of the vehicle when turning, identifies the surrounding dangerous environment, and gives safety warnings to the driver and pedestrians on both sides. Ensure the safe turning of the vehicle and the safety of pedestrians around the vehicle, and improve the safety of road traffic.

本发明的技术方案是:大型车辆转弯时避免行人卷入车下的安全预警系统,包括测距雷达传感器、摄像头、转角传感器、信息集成单元、道路危险区域划分单元和报警装置。测距雷达传感器采集车体周围物体距离信息,采集到的目标距离信息输入到信息集成单元中进行分析处理。摄像头采集车辆两侧图像,运用卷积神经网络算法对图像进行识别,判断测距雷达传感器所识别的目标是否是行人,并获得识别图像中的行人的位置数据信息,传送到信息集成单元。述转角传感器采集车辆转向角信息,道路危险区域划分单元根据转角传感器采集到的信息和汽车性能参数,采用K均值聚类分析算法将大型车辆两侧的区域划分为危险区域、预警区域或安全区域。信息集成单元与道路危险区域划分单元对采集的数据信息进行信息融合、处理分析,判断危险区域内是否有行人存在,并将判断结果输出到报警装置。判断结果若存在危险,报警装置报警,提醒驾驶员,若不存在危险,报警装置不动作。The technical scheme of the present invention is: a safety early warning system for avoiding pedestrians from being involved in the vehicle when a large vehicle turns, including a ranging radar sensor, a camera, a turning angle sensor, an information integration unit, a road danger zone division unit and an alarm device. The ranging radar sensor collects the distance information of objects around the vehicle body, and the collected target distance information is input into the information integration unit for analysis and processing. The camera collects the images on both sides of the vehicle, uses the convolutional neural network algorithm to identify the image, determines whether the target identified by the ranging radar sensor is a pedestrian, and obtains the position data information of the pedestrian in the identified image, and transmits it to the information integration unit. The above-mentioned corner sensor collects vehicle steering angle information, and the road dangerous area division unit uses K-means cluster analysis algorithm to divide the areas on both sides of the large vehicle into dangerous areas, early warning areas or safety areas according to the information collected by the corner sensor and vehicle performance parameters. . The information integration unit and the road dangerous area division unit perform information fusion, processing and analysis on the collected data information, determine whether there are pedestrians in the dangerous area, and output the judgment result to the alarm device. If there is danger in the judgment result, the alarm device will alarm to remind the driver. If there is no danger, the alarm device will not act.

测距雷达传感器安装在车辆的盲区范围内的车体上,测距雷达传感器通过车辆两边区域发射无线电波,利用接收到的目标反射信号与发射信号的时间延迟测量前方目标的位置信息。摄像头安装在车辆的盲区范围的车体上方。转角传感器安装在方向盘下方的方向柱内。信息集成单元包括数据采集模块,数据处理模块、预警信息分析模块和预警信息输出模块。数据采集模块采集测距雷达传感器、转角传感器和摄像头的输出信息,信息包括危险区域内周围目标与车体之间的距离、车辆转向角和周围环境信息。数据处理模块将测距雷达传感器采集到的周围目标的位置信息与摄像头采集到的目标位置信息进行匹配,将转向角信息导入道路区域划分系统中进行区域划分。预警信息分析模块对车辆周围目标所在危险区域的判断结果以及目标是否为行人的判断结果进行分析,判定当前状态下报警装置响应等级。预警信息输出模块将响应等级结果输出给报警装置。汽车性能参数包括轮胎断面宽度、车轮外宽、轴距、前置距和前外轮转角。The ranging radar sensor is installed on the vehicle body within the blind area of the vehicle. The ranging radar sensor transmits radio waves through the areas on both sides of the vehicle, and uses the time delay between the received target reflected signal and the transmitted signal to measure the position information of the front target. The camera is installed above the vehicle body in the blind spot area of the vehicle. The angle sensor is installed in the steering column under the steering wheel. The information integration unit includes a data acquisition module, a data processing module, an early warning information analysis module and an early warning information output module. The data acquisition module collects the output information of the ranging radar sensor, the angle sensor and the camera. The information includes the distance between the surrounding target and the vehicle body in the dangerous area, the steering angle of the vehicle and the surrounding environment information. The data processing module matches the position information of the surrounding targets collected by the ranging radar sensor with the target position information collected by the camera, and imports the steering angle information into the road area division system for area division. The early warning information analysis module analyzes the judgment result of the dangerous area where the target around the vehicle is located and the judgment result of whether the target is a pedestrian, and judges the response level of the alarm device in the current state. The early warning information output module outputs the response level result to the alarm device. Vehicle performance parameters include tire section width, wheel outer width, wheelbase, front distance and front outer wheel turning angle.

采用K均值聚类分析算法对车辆两侧的区域进行等级划分,分为危险区域、预警区域和安全区域三部分,通过离线聚类得到三个离线聚类质心。K均值聚类分析过程如下:The K-means clustering analysis algorithm is used to classify the areas on both sides of the vehicle into three parts: danger area, early warning area and safety area. Three offline cluster centroids are obtained through offline clustering. The K-means cluster analysis process is as follows:

1)根据需要确定聚类个数K=3;1) Determine the number of clusters K=3 as needed;

2)初始化聚类质心,以等间距取点确定初始聚类质心;2) Initialize the cluster centroids, and take points at equal intervals to determine the initial cluster centroids;

3)设置最大迭代步数以及质心偏移量:△d=0.0001,J=1000;3) Set the maximum number of iteration steps and centroid offset: △d=0.0001, J=1000;

其中:△d为质心偏移量;J为最大迭代步数;Among them: △d is the center of mass offset; J is the maximum number of iteration steps;

4)计算每个对象与聚类质心之间的欧式距离,根据欧氏距离的数值将这些对象分别划归到与之最为相似的簇内;4) Calculate the Euclidean distance between each object and the cluster centroid, and classify these objects into the most similar clusters according to the value of the Euclidean distance;

5)根据聚类结果,重新计算3个簇的各自质心,计算方法是每个聚类各自的算术平方数;5) According to the clustering results, recalculate the respective centroids of the 3 clusters, and the calculation method is the respective arithmetic squares of each cluster;

6)重复3、4步骤,直到聚类结果不在变化;6) Repeat steps 3 and 4 until the clustering result does not change;

7)将结果输出。7) Output the result.

欧氏距离计算公式为:The formula for calculating Euclidean distance is:

假设两个n维向量为A=(a1,a2,a3……an)和B=(b1、b2、b3、……bn),则A和B之间的欧式距离为:Assuming that two n -dimensional vectors are A =( a 1 , a 2 , a 3 . The distance is:

Figure BDA0002088129640000021
Figure BDA0002088129640000021

式中:ρ(A,B)为欧式距离;In the formula: ρ(A, B) is the Euclidean distance;

a1,a2,a3……an为A的n个维度;a 1 , a 2 , a 3 ...... a n is the n dimensions of A;

利用上述方法确定车辆周围路面环境各等级区域的范围。The above method is used to determine the range of each grade area of the road environment around the vehicle.

摄像头应用卷积神经网络(CNN)算法对采集到的图像进行信息处理的过程由六层构成:The process that the camera uses the convolutional neural network (CNN) algorithm to process the collected images is composed of six layers:

第一层为输入层,输入的摄像头采集到的车两侧的图像;The first layer is the input layer, the images on both sides of the car collected by the input camera;

第二层包含两个独立的卷积层C1、C2,卷积核数均为40个;卷积层C1卷积核大小为3×3,大小为12×12×40;卷积层C2卷积核大小为7×7,大小为10×10×40;卷积层通过卷积操作对输入图像进行提取特征,卷积核相当于滤波器,第l层卷积公式为:The second layer includes two independent convolution layers C1 and C2, and the number of convolution kernels is 40; the convolution kernel size of the convolution layer C1 is 3 × 3, and the size is 12 × 12 × 40; the convolution layer C2 volume The size of the product kernel is 7×7 and the size is 10×10×40; the convolution layer extracts features from the input image through the convolution operation. The convolution kernel is equivalent to a filter. The convolution formula of the first layer is:

Figure BDA0002088129640000031
Figure BDA0002088129640000031

式中::l为层数,xm l-1为第l-1个隐层的输入,n、m为二维矩阵值,wn,m l为第l个隐层的映射权值矩阵,bi l为第l个隐层的偏置矩阵,yn l为输入层的输入图像,f为激活函数,采用ReLU函数做非线性映射,表达式为:In the formula: l is the number of layers, x m l-1 is the input of the l-1th hidden layer, n, m are the two-dimensional matrix values, wn, m l is the mapping weight matrix of the lth hidden layer , b i l is the bias matrix of the lth hidden layer, y n l is the input image of the input layer, f is the activation function, the ReLU function is used for nonlinear mapping, and the expression is:

y=max(0,x)y=max(0,x)

式中:y为输出,x为输入;In the formula: y is the output, x is the input;

每个卷积层后面一层是池化层,将图像中不同位置的特征聚合在一起,实现降低特征维度,以及对图像特征进行二次提取,选择最大池化的方式,最大池化把输入图像分割成不重叠的矩阵,每个子区域都输出最大值;The next layer of each convolutional layer is a pooling layer, which aggregates the features of different positions in the image to reduce the feature dimension and extract the image features twice. The image is divided into non-overlapping matrices, and each subregion outputs the maximum value;

第三层包含两个独立的卷积层C3、C4,卷积核数均为65个;卷积层C1卷积核大小为3×3,大小为5×5×65;卷积层C2卷积核大小为3×3,大小为4×4×65.四个卷积层步长为2;卷积公式、映射方法及池化公式与第二层相同;The third layer contains two independent convolution layers C3 and C4, and the number of convolution kernels is 65; the convolution kernel size of the convolution layer C1 is 3×3 and the size is 5×5×65; The size of the product kernel is 3×3 and the size is 4×4×65. The step size of the four convolutional layers is 2; the convolution formula, mapping method and pooling formula are the same as the second layer;

第四层为全连接层F1,该层设计有300个神经元,F1的输入来自C1、C2、C3、C4;全连接层可以增强网络非线性映射能力以及限制网络规模大小;F1全连接层的计算公式为:The fourth layer is the fully connected layer F1, which is designed with 300 neurons. The input of F1 comes from C1, C2, C3, and C4; the fully connected layer can enhance the nonlinear mapping capability of the network and limit the size of the network; the F1 fully connected layer The calculation formula is:

Figure BDA0002088129640000032
Figure BDA0002088129640000032

式中:l为层数,xi l-1为第l-1个隐层的输入,i、j为二维矩阵值,wj,i l为第l个隐层的映射权值矩阵,bj l为第l个隐层的偏置矩阵;where l is the number of layers, x i l-1 is the input of the l-1th hidden layer, i, j are the two-dimensional matrix values, w j, i l is the mapping weight matrix of the lth hidden layer, b j l is the bias matrix of the lth hidden layer;

第五层为全连接层F2,计算公式与F1相同;F1、F2采用全连接;The fifth layer is the fully connected layer F2, and the calculation formula is the same as that of F1; F1 and F2 are fully connected;

第六层为输出层,由softmax函数判断分类,softmax函数计算公式为:The sixth layer is the output layer, and the classification is judged by the softmax function. The calculation formula of the softmax function is:

Xi=wix+bX i = wi x+b

Figure BDA0002088129640000041
Figure BDA0002088129640000041

式中:θ为参数向量,i、j为二维矩阵值,T为温度参数,当T很大时,即趋于正无穷时,所有的激活值对应的激活概率趋近于相同;T很低时,即趋于0时,不同的激活值对应的激活概率差异也就很大;In the formula: θ is the parameter vector, i and j are the two-dimensional matrix values, and T is the temperature parameter. When T is large, that is, it tends to positive infinity, the activation probabilities corresponding to all activation values tend to be the same; When it is low, that is, when it tends to 0, the activation probability corresponding to different activation values is very different;

完成卷积神经网络识别行人过程。Complete the process of identifying pedestrians with a convolutional neural network.

报警装置包括车内报警装置和车外报警装置,车内报警装置由警示灯和车内报警器组成,用于提醒驾驶员注意车外危险。车外报警装置为车外报警器,用于提醒车外行人注意避让车辆。根据行人所在的危险区域等级,报警装置发出车不同等级报警信号,不同等级的报警信号,报警灯的亮度及报警器的声音强度不同。The alarm device includes an in-vehicle alarm device and an out-of-vehicle alarm device. The in-vehicle alarm device is composed of a warning light and an in-vehicle alarm, and is used to remind the driver to pay attention to the danger outside the vehicle. The exterior alarm device is an exterior alarm, which is used to remind pedestrians outside the vehicle to pay attention to avoid vehicles. According to the level of the danger area where pedestrians are located, the alarm device sends out different levels of vehicle alarm signals, different levels of alarm signals, and the brightness of the alarm lights and the sound intensity of the alarm are different.

本发明大型车辆转弯时避免行人卷入车下的安全预警系统通过测距雷达传感器、摄像头和转角传感器在转弯时对车辆左右两边的环境进行检测,识别周围危险环境,输入到信息集成单元以及道路危险区域划分系统中进行信息融合、处理分析,判断危险区域内是否有行人存在,并将判断结果输入到报警装置进行预警,给驾驶员以及两侧行人安全警示,保障了车辆安全转弯以及车辆周围行人安全,提高了道路交通的安全性。本发明实时有效地预测大型车辆转弯时周围环境是否存在危险,为解决大型车辆转弯安全问题提供了一种新的思路。The safety early warning system of the present invention, which avoids pedestrians from being involved in the vehicle when a large vehicle turns, detects the environment on the left and right sides of the vehicle when turning through the ranging radar sensor, the camera and the angle sensor, identifies the surrounding dangerous environment, and inputs the information to the information integration unit and the road. In the dangerous area division system, information fusion, processing and analysis are carried out to determine whether there are pedestrians in the dangerous area, and the judgment result is input to the alarm device for early warning, which provides safety warnings to the driver and pedestrians on both sides, ensuring the safe turning of the vehicle and the surrounding area of the vehicle. Pedestrian safety improves road traffic safety. The invention effectively predicts in real time whether the surrounding environment is dangerous when the large vehicle turns, and provides a new idea for solving the safety problem of the large vehicle turning.

附图说明Description of drawings

图1为本发明大型车辆转弯时避免行人卷入车下的安全报警装置的示意图;1 is a schematic diagram of a safety alarm device for preventing pedestrians from being involved in the vehicle when a large vehicle turns;

图2为报警等级示意图;Figure 2 is a schematic diagram of the alarm level;

其中:1—转角传感器、2—测距雷达传感器、3—摄像头、4—道路危险区域划分单元、5—集成控制单元、6—报警装置、7—数据采集模块、8—数据处理模块、9—预警信息分析模块、10—预警信息输出模块、11—车内报警器、12—警示灯、13—车外报警器。Among them: 1—angle sensor, 2—ranging radar sensor, 3—camera, 4—road dangerous area division unit, 5—integrated control unit, 6—alarm device, 7—data acquisition module, 8—data processing module, 9 - Early warning information analysis module, 10 - early warning information output module, 11 - car alarm, 12 - warning light, 13 - car alarm.

具体实施方式Detailed ways

下面结合实施例和附图对本发明进行详细说明。本发明保护范围不限于实施例,本领域技术人员在权利要求限定的范围内做出任何改动也属于本发明保护的范围。The present invention will be described in detail below with reference to the embodiments and accompanying drawings. The protection scope of the present invention is not limited to the embodiments, and any changes made by those skilled in the art within the scope defined by the claims also belong to the protection scope of the present invention.

本发明大型车辆转弯时避免行人卷入车下的安全预警系如图1所示,包括测距雷达传感器2、摄像头3、转角传感器1、信息集成单元5、道路危险区域划分单元4和报警装置6。信息集成单元5包括数据采集模块7,数据处理模块8、预警信息分析模块9和预警信息输出模块10。报警装置6包括车内报警装置和车外报警装置,车内报警装置由警示灯12和车内报警器11组成,用于提醒驾驶员注意车外危险。车外报警装置为车外报警器13,用于提醒车外行人注意避让车辆。测距雷达传感器和摄像头与数据采集模块通信连通,转角传感器通过道路危险区域划分单元与数据采集模块通信连通。道路危险区域划分单元设有汽车性能参数输入端,汽车性能参数包括轮胎断面宽度、车轮外宽、轴距、前置距和前外轮转角。数据采集模块依次与数据处理模块、预警信息分析模块和预警信息输出模块通信连通,预警信息输出模块与报警装置通信连通。测距雷达传感器采集车体周围物体距离信息,采集到的目标距离信息输入到信息集成单元中进行分析处理。摄像头采集车辆两侧图像,运用卷积神经网络算法对图像进行识别,判断测距雷达传感器所识别的目标是否是行人,并获得识别图像中的行人的位置数据信息,传送到信息集成单元。转角传感器采集车辆转向角信息,道路危险区域划分单元根据转角传感器采集到的信息和汽车性能参数,采用K均值聚类分析算法将大型车辆两侧的区域划分为危险区域、预警区域或安全区域。信息集成单元与道路危险区域划分单元对采集的数据信息进行信息融合、处理分析,判断危险区域内是否有行人存在,并将判断结果输出到报警装置。判断结果若存在危险,报警装置报警,提醒驾驶员,若不存在危险,报警装置不动作。The safety warning system of the present invention for preventing pedestrians from getting involved in the vehicle when a large vehicle turns is shown in FIG. 1 , including a ranging radar sensor 2, a camera 3, a turning angle sensor 1, an information integration unit 5, a road dangerous area division unit 4 and an alarm device 6. The information integration unit 5 includes a data acquisition module 7 , a data processing module 8 , an early warning information analysis module 9 and an early warning information output module 10 . The alarm device 6 includes an in-vehicle alarm device and an out-of-vehicle alarm device. The in-vehicle alarm device is composed of a warning light 12 and an in-vehicle alarm 11, and is used to remind the driver to pay attention to the danger outside the vehicle. The exterior alarm device is an exterior alarm 13, which is used to remind pedestrians outside the vehicle to pay attention to avoiding the vehicle. The ranging radar sensor and the camera are communicated with the data acquisition module, and the rotation angle sensor is communicated with the data acquisition module through the road dangerous area division unit. The road hazard area division unit is provided with an input end of vehicle performance parameters, and the vehicle performance parameters include tire section width, wheel outer width, wheelbase, front distance and front outer wheel turning angle. The data acquisition module communicates with the data processing module, the early warning information analysis module and the early warning information output module in sequence, and the early warning information output module communicates with the alarm device. The ranging radar sensor collects the distance information of objects around the vehicle body, and the collected target distance information is input into the information integration unit for analysis and processing. The camera collects the images on both sides of the vehicle, uses the convolutional neural network algorithm to identify the image, determines whether the target identified by the ranging radar sensor is a pedestrian, and obtains the position data information of the pedestrian in the identified image, and transmits it to the information integration unit. The corner sensor collects the vehicle steering angle information, and the road dangerous area division unit uses the K-means clustering analysis algorithm to divide the areas on both sides of the large vehicle into dangerous areas, early warning areas or safety areas according to the information collected by the corner sensors and vehicle performance parameters. The information integration unit and the road dangerous area division unit perform information fusion, processing and analysis on the collected data information, determine whether there are pedestrians in the dangerous area, and output the judgment result to the alarm device. If there is danger in the judgment result, the alarm device will alarm to remind the driver. If there is no danger, the alarm device will not act.

测距雷达传感器2安装在车辆的盲区范围内的车体上,测距雷达传感器通过车辆两边区域发射无线电波,利用接收到的目标反射信号与发射信号的时间延迟测量前方目标的位置信息。摄像头3安装在车辆的盲区范围的车体上方,转角传感器1安装在方向盘下方的方向柱内。The ranging radar sensor 2 is installed on the vehicle body within the blind area of the vehicle. The ranging radar sensor transmits radio waves through the areas on both sides of the vehicle, and uses the time delay between the received target reflected signal and the transmitted signal to measure the position information of the front target. The camera 3 is installed above the vehicle body in the blind area of the vehicle, and the corner sensor 1 is installed in the steering column below the steering wheel.

数据采集模块7采集测距雷达传感器、转角传感器和摄像头的输出信息,信息包括危险区域内周围目标与车体之间的距离、车辆转向角和周围环境信息。数据处理模块8将测距雷达传感器采集的周围目标位置信息与摄像头采集到的目标位置信息进行匹配,将转向角信息导入道路区域划分系统中进行区域划分。预警信息分析模块9对车辆周围目标所在危险区域的判断结果以及目标是否为行人的判断结果进行分析,判定当前状态下报警装置响应等级。预警信息输出模块10将响应等级结果输出给报警装置6。The data acquisition module 7 collects the output information of the ranging radar sensor, the angle sensor and the camera, and the information includes the distance between the surrounding target and the vehicle body in the dangerous area, the steering angle of the vehicle and the surrounding environment information. The data processing module 8 matches the surrounding target position information collected by the ranging radar sensor with the target position information collected by the camera, and imports the steering angle information into the road area division system for area division. The early warning information analysis module 9 analyzes the judgment result of the dangerous area where the target around the vehicle is located and the judgment result of whether the target is a pedestrian, and judges the response level of the alarm device in the current state. The early warning information output module 10 outputs the response level result to the alarm device 6 .

离线聚类的目的是对车辆两边区域进行等级划分,通过离线聚类得到离线聚类质心。将转角传感器采集到的信息和汽车性能参数输入到采用K均值聚类分析算法的道路危险区域划分单元4,将大型车辆两侧将车辆两侧的区域划分为危险区域、预警区域以及安全区域三部分,通过离线聚类得到三个离线聚类质心。K均值聚类分析过程如下:The purpose of offline clustering is to classify the areas on both sides of the vehicle, and obtain offline cluster centroids through offline clustering. The information collected by the corner sensor and the vehicle performance parameters are input into the road dangerous area division unit 4 using the K-means clustering analysis algorithm, and the areas on both sides of the large vehicle are divided into dangerous areas, early warning areas and safety areas. part, three offline cluster centroids are obtained by offline clustering. The K-means cluster analysis process is as follows:

1)根据需要确定聚类个数K=3;1) Determine the number of clusters K=3 as needed;

2)初始化聚类质心,以等间距取点确定初始聚类质心;2) Initialize the cluster centroids, and take points at equal intervals to determine the initial cluster centroids;

3)设置最大迭代步数以及质心偏移量:△d=0.0001,J=1000;3) Set the maximum number of iteration steps and centroid offset: △d=0.0001, J=1000;

其中:△d为质心偏移量;J为最大迭代步数;Among them: △d is the center of mass offset; J is the maximum number of iteration steps;

4)计算每个对象与聚类质心之间的欧式距离,根据欧氏距离的数值将这些对象分别划归到与之最为相似的簇内;4) Calculate the Euclidean distance between each object and the cluster centroid, and classify these objects into the most similar clusters according to the value of the Euclidean distance;

5)根据聚类结果,重新计算3个簇的各自质心,计算方法是每个聚类各自的算术平方数;5) According to the clustering results, recalculate the respective centroids of the 3 clusters, and the calculation method is the respective arithmetic squares of each cluster;

6)重复3、4步骤,直到聚类结果不在变化;6) Repeat steps 3 and 4 until the clustering result does not change;

7)将结果输出。7) Output the result.

欧氏距离计算公式为:The formula for calculating Euclidean distance is:

假设两个n维向量为A=(a1,a2,a3……an)和B=(b1、b2、b3、……bn),则A和B之间的欧式距离为:Assuming that two n -dimensional vectors are A =( a 1 , a 2 , a 3 . The distance is:

Figure BDA0002088129640000061
Figure BDA0002088129640000061

式中ρ(A,B)为欧式距离;where ρ(A, B) is the Euclidean distance;

a1,a2,a3……an为A的n个维度;a 1 , a 2 , a 3 ...... a n is the n dimensions of A;

利用上述方法确定车辆周围路面环境各等级区域的范围。The above method is used to determine the range of each grade area of the road environment around the vehicle.

摄像头应用卷积神经网络(CNN)算法对采集到的图像进行信息处理的过程由六层构成:The process that the camera uses the convolutional neural network (CNN) algorithm to process the collected images is composed of six layers:

第一层为输入层,输入的摄像头采集到的车两侧的图像;The first layer is the input layer, the images on both sides of the car collected by the input camera;

第二层包含两个独立的卷积层C1、C2,卷积核数均为40个;卷积层C1卷积核大小为3×3,大小为12×12×40;卷积层C2卷积核大小为7×7,大小为10×10×40;卷积层通过卷积操作对输入图像进行提取特征,卷积核相当于滤波器,第l层卷积公式为:The second layer includes two independent convolution layers C1 and C2, and the number of convolution kernels is 40; the convolution kernel size of the convolution layer C1 is 3 × 3, and the size is 12 × 12 × 40; the convolution layer C2 volume The size of the product kernel is 7×7 and the size is 10×10×40; the convolution layer extracts features from the input image through the convolution operation. The convolution kernel is equivalent to a filter. The convolution formula of the first layer is:

Figure BDA0002088129640000062
Figure BDA0002088129640000062

式中:l为层数,xm l-1为第l-1个隐层的输入,n、m为二维矩阵值,wn,m l为第l个隐层的映射权值矩阵,bi l为第l个隐层的偏置矩阵,yn l为输入层的输入图像,f为激活函数,采用ReLU函数做非线性映射,表达式为:In the formula: l is the number of layers, x m l-1 is the input of the l-1th hidden layer, n, m are the two-dimensional matrix values, wn, m l is the mapping weight matrix of the lth hidden layer, b i l is the bias matrix of the lth hidden layer, y n l is the input image of the input layer, f is the activation function, the ReLU function is used for nonlinear mapping, and the expression is:

y=max(0,x)y=max(0,x)

式中:y为输出,x为输入;In the formula: y is the output, x is the input;

每个卷积层后面一层是池化层,将图像中不同位置的特征聚合在一起,实现降低特征维度,以及对图像特征进行二次提取,选择最大池化的方式,最大池化把输入图像分割成不重叠的矩阵,每个子区域都输出最大值;The next layer of each convolutional layer is a pooling layer, which aggregates the features of different positions in the image to reduce the feature dimension and extract the image features twice. The image is divided into non-overlapping matrices, and each subregion outputs the maximum value;

第三层包含两个独立的卷积层C3、C4,卷积核数均为65个;卷积层C1卷积核大小为3×3,大小为5×5×65;卷积层C2卷积核大小为3×3,大小为4×4×65.四个卷积层步长为2;卷积公式、映射方法及池化公式与第二层相同;The third layer contains two independent convolution layers C3 and C4, and the number of convolution kernels is 65; the convolution kernel size of the convolution layer C1 is 3×3 and the size is 5×5×65; The size of the product kernel is 3×3 and the size is 4×4×65. The step size of the four convolutional layers is 2; the convolution formula, mapping method and pooling formula are the same as the second layer;

第四层为全连接层F1,该层设计有300个神经元,F1的输入来自C1、C2、C3、C4;全连接层可以增强网络非线性映射能力以及限制网络规模大小;F1全连接层的计算公式为:The fourth layer is the fully connected layer F1, which is designed with 300 neurons. The input of F1 comes from C1, C2, C3, and C4; the fully connected layer can enhance the nonlinear mapping capability of the network and limit the size of the network; the F1 fully connected layer The calculation formula is:

Figure BDA0002088129640000071
Figure BDA0002088129640000071

式中:l为层数,xi l-1为第l-1个隐层的输入,i、j为二维矩阵值,wj,i l为第l个隐层的映射权值矩阵,bj l为第l个隐层的偏置矩阵;where l is the number of layers, x i l-1 is the input of the l-1th hidden layer, i, j are the two-dimensional matrix values, w j, i l is the mapping weight matrix of the lth hidden layer, b j l is the bias matrix of the lth hidden layer;

第五层为全连接层F2,计算公式与F1相同;F1、F2采用全连接;The fifth layer is the fully connected layer F2, and the calculation formula is the same as that of F1; F1 and F2 are fully connected;

第六层为输出层,由softmax函数判断分类,softmax函数计算公式为:The sixth layer is the output layer, and the classification is judged by the softmax function. The calculation formula of the softmax function is:

Xi=wix+bX i = wi x+b

Figure BDA0002088129640000072
Figure BDA0002088129640000072

式中:θ为参数向量,i、j为二维矩阵值,T为温度参数,当T很大时,即趋于正无穷时,所有的激活值对应的激活概率趋近于相同;T很低时,即趋于0时,不同的激活值对应的激活概率差异也就很大;In the formula: θ is the parameter vector, i and j are the two-dimensional matrix values, and T is the temperature parameter. When T is large, that is, it tends to positive infinity, the activation probabilities corresponding to all activation values tend to be the same; When it is low, that is, when it tends to 0, the activation probability corresponding to different activation values is very different;

完成卷积神经网络识别行人过程。Complete the process of identifying pedestrians with a convolutional neural network.

本发明大型车辆转弯时避免行人卷入车下的安全预警系统的工作过程,步骤如下:The working process of the safety warning system for avoiding pedestrians from being involved under the vehicle when the large vehicle turns in the present invention, the steps are as follows:

⑴首先转角传感器1采集车辆转向角信息,将车辆转向角信息输入到道路危险区域划分单元4,对车辆两侧区域间性划分,分成危险区域、预警区域以及安全区域三部分;(1) First, the steering angle sensor 1 collects the vehicle steering angle information, and inputs the vehicle steering angle information into the road danger area division unit 4, and divides the areas on both sides of the vehicle into three parts: danger area, early warning area and safety area;

⑵测距雷达传感器2通过向前方区域发射无线电波,利用接收到的目标反射信号与发射信号的时间延迟测量前方目标的位置信息,将目标距离信息输入到信息集成单元5中,判定当前目标在哪一个区域内;(2) The ranging radar sensor 2 transmits radio waves to the front area, uses the time delay between the received target reflected signal and the transmitted signal to measure the position information of the front target, inputs the target distance information into the information integration unit 5, and determines that the current target is in the in which area;

⑶安装在车体上的摄像头3采集大型车辆周围的图像信息,运用卷积神经网络算法将图像信息进行结构化处理,识别测距雷达的目标是否为行人;(3) The camera 3 installed on the vehicle body collects image information around the large vehicle, and uses the convolutional neural network algorithm to structurally process the image information to identify whether the target of the ranging radar is a pedestrian;

⑷信息集成单元5与道路危险区域划分单元4对采集的数据信息进行信息融合、处理分析,判断危险区域内是否有行人存在;(4) The information integration unit 5 and the road dangerous area division unit 4 perform information fusion, processing and analysis on the collected data information, and determine whether there are pedestrians in the dangerous area;

⑸将判定结果输入到预警信息处理模块10进行分析,判断目标是否为行人;若判定结果中未识别到行人,则按照目标所在区域向报警装置输入报警等级信息;若判定结果存在行人,则按照行人所在区域的上一级报警等级信息报警;⑸ Input the judgment result to the early warning information processing module 10 for analysis, and judge whether the target is a pedestrian; if no pedestrian is identified in the judgment result, input the alarm level information to the alarm device according to the target area; The upper-level alarm level information alarm in the area where the pedestrian is located;

⑹将报警信息输送到报警装置6,若存在危险,报警装置报警,提醒驾驶员,若不存在危险,报警装置不动作。⑹ Send the alarm information to the alarm device 6. If there is danger, the alarm device will alarm to remind the driver. If there is no danger, the alarm device will not act.

本发明的报警装置采用分级报警,如图2所示,当测距雷达以及摄像头判断出当前目标以及目标所在区域后,分级报警装置响应。预警装置一共四个等级,分别为一级报警、二级报警、三级报警以及无响应。如果目标是行人,当行人在危险区域内,采取一级报警;行人在预警区域内,采取二级报警;行人在安全区域内,报警装置无响应。若目标不是行人,则报警等级比行人依次低一级,目标在危险区域内,采取二级报警;目标在预警区域内,采取三级报警,目标在安全区域内,报警装置无响应。The alarm device of the present invention adopts graded alarm. As shown in FIG. 2 , when the ranging radar and the camera determine the current target and the area where the target is located, the graded alarm device responds. There are four levels of early warning devices, which are first-level alarm, second-level alarm, third-level alarm and no response. If the target is a pedestrian, when the pedestrian is in the dangerous area, the first-level alarm will be used; if the pedestrian is in the early warning area, the second-level alarm will be used; if the pedestrian is in the safe area, the alarm device will not respond. If the target is not a pedestrian, the alarm level is one level lower than that of pedestrians. If the target is in the dangerous area, the second-level alarm will be adopted; if the target is in the early warning area, the third-level alarm will be adopted. If the target is in the safe area, the alarm device will not respond.

Claims (6)

1.一种大型车辆转弯时避免行人卷入车下的安全预警系统,其特征是:所述系统包括测距雷达传感器(2)、摄像头(3)、转角传感器(1)、信息集成单元(5)、道路危险区域划分单元(4)和报警装置(6);所述测距雷达传感器采集车体周围物体距离信息,采集到的目标距离信息输入到信息集成单元中进行分析处理;所述摄像头采集车辆两侧图像,运用卷积神经网络算法对图像进行识别,判断测距雷达传感器所识别的目标是否是行人,并获得识别图像中的行人的位置数据信息,传送到信息集成单元;所述转角传感器采集车辆转向角信息,所述道路危险区域划分单元根据转角传感器采集到的信息和汽车性能参数,采用K均值聚类分析算法将大型车辆两侧的区域划分为危险区域、预警区域或安全区域;所述信息集成单元与道路危险区域划分单元对采集的数据信息进行信息融合、处理分析,判断危险区域内是否有行人存在,并将判断结果输出到报警装置;判断结果若存在危险,报警装置报警,提醒驾驶员,若不存在危险,报警装置不动作;采用K均值聚类分析算法对车辆两侧的区域进行等级划分,分为危险区域、预警区域和安全区域三部分,通过离线聚类得到三个离线聚类质心;所述K均值聚类分析算法的过程如下:1. a safety warning system for avoiding pedestrians getting involved under the vehicle when a large vehicle turns, it is characterized in that: described system comprises ranging radar sensor (2), camera (3), angle sensor (1), information integration unit ( 5), a road dangerous area division unit (4) and an alarm device (6); the ranging radar sensor collects the distance information of objects around the vehicle body, and the collected target distance information is input into the information integration unit for analysis and processing; the The camera collects the images on both sides of the vehicle, uses the convolutional neural network algorithm to identify the image, determines whether the target identified by the ranging radar sensor is a pedestrian, and obtains the position data information of the pedestrian in the identified image, and transmits it to the information integration unit; The turning angle sensor collects vehicle steering angle information, and the road dangerous area dividing unit adopts the K-means cluster analysis algorithm to divide the areas on both sides of the large vehicle into dangerous areas, early warning areas or safe area; the information integration unit and the road danger area division unit perform information fusion, processing and analysis on the collected data information, determine whether there are pedestrians in the danger area, and output the judgment result to the alarm device; if the judgment result is dangerous, The alarm device alarms and reminds the driver that if there is no danger, the alarm device does not act; the K-means cluster analysis algorithm is used to classify the areas on both sides of the vehicle, which are divided into three parts: danger area, early warning area and safety area. Clustering obtains three offline cluster centroids; the process of the K-means cluster analysis algorithm is as follows: 1)根据需要确定聚类个数K=3;1) Determine the number of clusters K=3 as needed; 2)初始化聚类质心,以等间距取点确定初始聚类质心;2) Initialize the cluster centroids, and take points at equal intervals to determine the initial cluster centroids; 3)设置最大迭代步数以及质心偏移量:△d=0.0001,J=1000;3) Set the maximum number of iteration steps and centroid offset: △d=0.0001, J=1000; 其中:△d为质心偏移量;J为最大迭代步数;Among them: △d is the center of mass offset; J is the maximum number of iteration steps; 4)计算每个对象与聚类质心之间的欧式距离,根据欧氏距离的数值将这些对象分别划归到与之最为相似的簇内;4) Calculate the Euclidean distance between each object and the cluster centroid, and classify these objects into the most similar clusters according to the value of the Euclidean distance; 5)根据聚类结果,重新计算3个簇的各自质心,计算方法是每个聚类各自的算术平方数;5) According to the clustering results, recalculate the respective centroids of the 3 clusters, and the calculation method is the respective arithmetic squares of each cluster; 6)重复3、4步骤,直到聚类结果不在变化;6) Repeat steps 3 and 4 until the clustering result does not change; 7)将结果输出。7) Output the result. 2.根据权利要求1所述的大型车辆转弯时避免行人卷入车下的安全预警系统,其特征是:所述测距雷达传感器(2)安装在车辆的盲区范围内的车体上,测距雷达传感器通过车辆两边区域发射无线电波,利用接收到的目标反射信号与发射信号的时间延迟测量前方目标的位置信息;所述摄像头(3)安装在车辆的盲区范围的车体上方;所述转角传感器(1)安装在方向盘下方的方向柱内。2. The safety warning system for avoiding pedestrians getting involved under the vehicle when turning a large vehicle according to claim 1, is characterized in that: the ranging radar sensor (2) is installed on the vehicle body within the blind area of the vehicle, and measures The distance radar sensor transmits radio waves through the areas on both sides of the vehicle, and uses the time delay between the received target reflected signal and the transmitted signal to measure the position information of the front target; the camera (3) is installed above the vehicle body in the blind area of the vehicle; the The angle sensor (1) is installed in the steering column under the steering wheel. 3.根据权利要求1所述的大型车辆转弯时避免行人卷入车下的安全预警系统,其特征是:所述信息集成单元(5)包括数据采集模块(7),数据处理模块(8)、预警信息分析模块(9)和预警信息输出模块(10);所述数据采集模块采集测距雷达传感器、转角传感器和摄像头的输出信息,信息包括危险区域内周围目标与车体之间的距离、车辆转向角和周围环境信息;所述数据处理模块将测距雷达传感器采集的周围目标位置信息与摄像头采集到的目标位置信息进行匹配,将转向角信息导入道路区域划分系统中进行区域划分;所述预警信息分析模块对车辆周围目标所在危险区域的判断结果以及目标是否为行人的判断结果进行分析,判定当前状态下报警装置响应等级;所述预警信息输出模块将响应等级结果输出给报警装置。3. The safety warning system for avoiding pedestrians getting involved under the vehicle when turning a large vehicle according to claim 1, is characterized in that: the information integration unit (5) comprises a data acquisition module (7), a data processing module (8) , an early warning information analysis module (9) and an early warning information output module (10); the data acquisition module collects the output information of the ranging radar sensor, the angle sensor and the camera, and the information includes the distance between the surrounding target and the vehicle body in the dangerous area , vehicle steering angle and surrounding environment information; the data processing module matches the surrounding target position information collected by the ranging radar sensor with the target position information collected by the camera, and imports the steering angle information into the road area division system for area division; The early warning information analysis module analyzes the judgment result of the dangerous area where the target around the vehicle is located and the judgment result of whether the target is a pedestrian, and judges the response level of the alarm device in the current state; the early warning information output module outputs the response level result to the alarm device. . 4.根据权利要求1所述的大型车辆转弯时避免行人卷入车下的安全预警系统,其特征是:所述汽车性能参数包括轮胎断面宽度、车轮外宽、轴距、前置距和前外轮转角。4. The safety warning system for preventing pedestrians from getting involved in the vehicle when a large vehicle turns according to claim 1, wherein the vehicle performance parameters include tire section width, wheel outer width, wheelbase, front distance and front Outer wheel corner. 5.根据权利要求1所述的大型车辆转弯时避免行人卷入车下的安全预警系统,其特征是:所述欧氏距离计算公式为:5. the safety warning system that avoids pedestrians getting involved under the vehicle when the large vehicle turns according to claim 1, is characterized in that: described Euclidean distance calculation formula is: 假设两个n维向量为A=(a1,a2,a3……an)和B=(b1、b2、b3、……bn),则A和B之间的欧式距离为:Assuming that two n -dimensional vectors are A =( a 1 , a 2 , a 3 . The distance is:
Figure FDA0002497407950000021
Figure FDA0002497407950000021
式中:ρ(A,B)为欧式距离;In the formula: ρ(A, B) is the Euclidean distance; a1,a2,a3……an为A的n个维度;a 1 , a 2 , a 3 ...... a n is the n dimensions of A; 利用上述方法确定车辆周围路面环境各等级区域的范围。The above method is used to determine the range of each grade area of the road environment around the vehicle.
6.根据权利要求1所述的大型车辆转弯时避免行人卷入车下的安全预警系统,其特征是:所述报警装置(6)包括车内报警装置和车外报警装置,所述车内报警装置由警示灯(12)和车内报警器(11)组成,用于提醒驾驶员注意车外危险;所述车外报警装置为车外报警器(13),用于提醒车外行人注意避让车辆;根据行人所在的危险区域等级,报警装置发出车不同等级报警信号,不同等级的报警信号,报警灯的亮度及报警器的声音强度不同。6. The safety warning system for preventing pedestrians from getting involved under the vehicle when turning a large vehicle according to claim 1, wherein the alarm device (6) comprises an in-vehicle alarm device and an out-of-vehicle alarm device. The alarm device is composed of a warning light (12) and an in-vehicle alarm (11), and is used to remind the driver to pay attention to the danger outside the vehicle; the outer-vehicle alarm device is an out-of-vehicle alarm (13), which is used to remind pedestrians outside the vehicle to pay attention Avoid vehicles; according to the level of the dangerous area where pedestrians are located, the alarm device sends out different levels of vehicle alarm signals, different levels of alarm signals, and the brightness of the alarm lights and the sound intensity of the alarm are different.
CN201910494515.4A 2019-06-10 2019-06-10 Safety warning system to avoid pedestrians getting caught under the car when a large vehicle turns Expired - Fee Related CN110228413B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910494515.4A CN110228413B (en) 2019-06-10 2019-06-10 Safety warning system to avoid pedestrians getting caught under the car when a large vehicle turns

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910494515.4A CN110228413B (en) 2019-06-10 2019-06-10 Safety warning system to avoid pedestrians getting caught under the car when a large vehicle turns

Publications (2)

Publication Number Publication Date
CN110228413A CN110228413A (en) 2019-09-13
CN110228413B true CN110228413B (en) 2020-07-14

Family

ID=67859441

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910494515.4A Expired - Fee Related CN110228413B (en) 2019-06-10 2019-06-10 Safety warning system to avoid pedestrians getting caught under the car when a large vehicle turns

Country Status (1)

Country Link
CN (1) CN110228413B (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110936937B (en) * 2019-03-21 2021-03-30 湖南三一港口设备有限公司 Automatic braking method and system
CN111047822B (en) * 2019-12-18 2022-03-25 万翼科技有限公司 Danger early warning equipment, danger early warning method and related products thereof
US11225153B2 (en) * 2020-02-03 2022-01-18 GM Global Technology Operations LLC Intelligent vehicles with advanced vehicle camera systems for underbody hazard and foreign object detection
CN111583336B (en) * 2020-04-22 2023-12-01 深圳市优必选科技股份有限公司 Robot and inspection method and device thereof
CN111505577A (en) * 2020-04-27 2020-08-07 湖南大学 Mobile vehicle localization method based on visible light communication
CN114516299A (en) * 2022-01-21 2022-05-20 国网甘肃省电力公司综合服务中心 A vehicle alarm system and an alarm method thereof
CN115063773A (en) * 2022-05-16 2022-09-16 中汽创智科技有限公司 Vehicle blind area image processing method, device, equipment and storage medium
CN117854046B (en) * 2024-03-07 2024-05-14 北京理工大学前沿技术研究院 An integrated positioning system and device based on visual fusion
CN119296142B (en) * 2024-12-12 2025-03-14 中国铁塔股份有限公司四川省分公司 Water station anti-human interference early warning method based on lightweight pre-trained visual large model
CN119636784A (en) * 2025-01-09 2025-03-18 南京林业大学 A vehicle inner wheel difference dangerous area limit detection and early warning method, device, equipment, medium and product

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106740829A (en) * 2017-03-23 2017-05-31 吉林大学 Based on the double semi-dragging truck riding stability automatic identifications of cluster analysis and early warning system
CN107633220A (en) * 2017-09-13 2018-01-26 吉林大学 A kind of vehicle front target identification method based on convolutional neural networks
CN107862287A (en) * 2017-11-08 2018-03-30 吉林大学 A kind of front zonule object identification and vehicle early warning method
CN107985200A (en) * 2017-11-13 2018-05-04 西南交通大学 A kind of load truck right-hand bend safety pre-warning system and method
CN108629968A (en) * 2018-06-26 2018-10-09 吉林大学 A kind of pedestrian's street crossing safety control based on laser radar
CN108877261A (en) * 2017-05-10 2018-11-23 杜卡迪摩托控股有限公司 With the motorcycle for detecting the device from the close vehicle in rear
CN208498373U (en) * 2018-05-25 2019-02-15 武汉科技大学 The lateral anti-collision system of vehicle

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3508665B2 (en) * 1999-12-24 2004-03-22 株式会社豊田自動織機 Steering support device
US7893819B2 (en) * 2005-03-03 2011-02-22 Continetntal Teves AG & Co, oHG Method and device for avoiding a collision in a lane change maneuver of a vehicle
US9599706B2 (en) * 2015-04-06 2017-03-21 GM Global Technology Operations LLC Fusion method for cross traffic application using radars and camera

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106740829A (en) * 2017-03-23 2017-05-31 吉林大学 Based on the double semi-dragging truck riding stability automatic identifications of cluster analysis and early warning system
CN108877261A (en) * 2017-05-10 2018-11-23 杜卡迪摩托控股有限公司 With the motorcycle for detecting the device from the close vehicle in rear
CN107633220A (en) * 2017-09-13 2018-01-26 吉林大学 A kind of vehicle front target identification method based on convolutional neural networks
CN107862287A (en) * 2017-11-08 2018-03-30 吉林大学 A kind of front zonule object identification and vehicle early warning method
CN107985200A (en) * 2017-11-13 2018-05-04 西南交通大学 A kind of load truck right-hand bend safety pre-warning system and method
CN208498373U (en) * 2018-05-25 2019-02-15 武汉科技大学 The lateral anti-collision system of vehicle
CN108629968A (en) * 2018-06-26 2018-10-09 吉林大学 A kind of pedestrian's street crossing safety control based on laser radar

Also Published As

Publication number Publication date
CN110228413A (en) 2019-09-13

Similar Documents

Publication Publication Date Title
CN110228413B (en) Safety warning system to avoid pedestrians getting caught under the car when a large vehicle turns
US10821946B2 (en) Sensor integration based pedestrian detection and pedestrian collision prevention apparatus and method
CN106054174B (en) It is used to cross the fusion method of traffic application using radar and video camera
US11333766B2 (en) Method for assisting a driver of a vehicle/trailer combination in maneuvering with the vehicle/trailer combination, blind spot system as well as vehicle/trailer combination
US12509070B2 (en) Vehicle control method, vehicle control device, and vehicle control system including same
CN108674412A (en) A kind of vehicle active collision avoidance method merged using sensor
US9963069B2 (en) Alarm method for reversing a vehicle by sensing obstacles using structured light
CN109727273B (en) Moving target detection method based on vehicle-mounted fisheye camera
CN108263279A (en) The pedestrian detection and pedestrian impact avoiding device and method integrated based on sensor
US9950700B2 (en) Road surface condition detection with multi-scale fusion
JP7340097B2 (en) A method for tracking a remote target vehicle within a peripheral area of a motor vehicle using collision recognition means
CN112334370B (en) Automated vehicle actions for lane departure warning and associated systems and methods
CN113569778B (en) Road slippery area detection and early warning method based on multimodal data fusion
CN108960083A (en) Automatic driving target classification method and system based on multi-sensor information fusion
WO2018190362A1 (en) Method and device for detecting pedestrian around vehicle
CN115099097A (en) Perception-based vehicle damage prediction method and system, electronic equipment and vehicle
CN112498342A (en) Pedestrian collision prediction method and system
CN109455153B (en) Control method of blind spot monitoring system
US12172576B2 (en) System and method for approaching vehicle detection
CN117995022B (en) Screening method and device for crossing vehicle targets, vehicle and storage medium
CN214985318U (en) A safety protection system for driving vehicles
CN109895768A (en) Vehicle and its control method
CN112519801B (en) A safety protection system and method for a moving vehicle
CN117104274A (en) Road vehicle behavior recognition method and system
JPWO2021083464A5 (en)

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200714

Termination date: 20210610