CN115649158A - A mine vehicle anti-collision method, device and storage medium - Google Patents
A mine vehicle anti-collision method, device and storage medium Download PDFInfo
- Publication number
- CN115649158A CN115649158A CN202211411211.5A CN202211411211A CN115649158A CN 115649158 A CN115649158 A CN 115649158A CN 202211411211 A CN202211411211 A CN 202211411211A CN 115649158 A CN115649158 A CN 115649158A
- Authority
- CN
- China
- Prior art keywords
- target
- time
- data
- collision
- mine vehicle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Traffic Control Systems (AREA)
Abstract
Description
技术领域technical field
本申请涉及无人车辆技术领域,尤其涉及一种矿井车辆防碰撞方法、设备及存储介质。The present application relates to the technical field of unmanned vehicles, in particular to a mine vehicle anti-collision method, equipment and storage medium.
背景技术Background technique
地下矿井生产环境恶劣,主要依靠矿车执行运输任务。矿井运输关系着安全生产问题,据统计约1/4的矿井安全事故发生在运输环节。因而,安全运输成为当前矿井生产中越来越重要的部分。The production environment of underground mines is harsh, and mine trucks are mainly used to carry out transportation tasks. Mine transportation is related to safety production. According to statistics, about 1/4 of mine safety accidents occur in the transportation link. Therefore, safe transportation has become an increasingly important part of current mine production.
一般来说,矿井车辆都安装有相应的防碰撞系统或设备,以避免在地下黑暗环境中,车辆与障碍物之间发生碰撞。有些策略是通过无线网络发射器的信号强度来判断对面矿车的距离,执行相应的防碰撞策略。也有将lora无线通信技术、RFID技术与激光雷达相结合,或者通过视觉技术识别前方是否有障碍物。但这些方案或多或少都存在成本高、精度低、误触发、障碍物识别不准确等问题。Generally speaking, mine vehicles are equipped with corresponding anti-collision systems or equipment to avoid collisions between vehicles and obstacles in an underground dark environment. Some strategies use the signal strength of the wireless network transmitter to judge the distance of the opposite mine car, and implement the corresponding anti-collision strategy. There are also combinations of lora wireless communication technology, RFID technology and laser radar, or visual technology to identify whether there are obstacles ahead. However, these solutions more or less have problems such as high cost, low precision, false triggering, and inaccurate obstacle recognition.
发明内容Contents of the invention
本申请实施例提供了一种矿井车辆防碰撞方法、设备及存储介质,用以解决现有的矿井车辆防碰撞方案精度低、障碍物识别不准确的技术问题。The embodiment of the present application provides a mine vehicle anti-collision method, equipment and storage medium, which are used to solve the technical problems of low precision and inaccurate obstacle identification in existing mine vehicle anti-collision schemes.
一方面,本申请实施例提供了一种矿井车辆防碰撞方法,所述方法包括:On the one hand, the embodiment of the present application provides a mine vehicle anti-collision method, the method comprising:
获取多个传感器测量的数据;Obtain data measured by multiple sensors;
对所述多个传感器测量的数据进行数据预处理;performing data preprocessing on data measured by the plurality of sensors;
基于预处理后的数据,确定跟踪目标,并对所述跟踪目标进行关联与融合;Determine the tracking target based on the preprocessed data, and associate and fuse the tracking target;
根据所述矿井车辆的行驶路径筛选所述跟踪目标,确定距离最近的跟踪目标作为危险目标;Screening the tracking target according to the driving path of the mine vehicle, and determining the closest tracking target as a dangerous target;
计算所述危险目标与所述矿井车辆发生碰撞的预警时间以及制动时间,并根据所述预警时间以及制动时间控制所述矿井车辆预警或制动。Calculating the warning time and braking time of the collision between the dangerous target and the mine vehicle, and controlling the warning or braking of the mine vehicle according to the warning time and braking time.
在本申请的一种实现方式中,所述对所述多个传感器测量的数据进行数据预处理,具体包括:In an implementation manner of the present application, the performing data preprocessing on the data measured by the multiple sensors specifically includes:
获取相机拍摄的图像数据以及雷达探测的雷达数据;Obtain the image data captured by the camera and the radar data detected by the radar;
将所述图像数据以及所述雷达数据进行数据滤波,以去除无效数据;performing data filtering on the image data and the radar data to remove invalid data;
将经过数据滤波处理后的所述图像数据以及所述雷达数据进行空间同步。Space synchronization is performed on the image data and the radar data after data filtering.
在本申请的一种实现方式中,所述确定跟踪目标,具体包括:In an implementation manner of the present application, the determining the tracking target specifically includes:
基于预设恒速度模型对图像数据以及雷达数据所对应的目标的未来状态进行预测,预测公式如下所示:Based on the preset constant velocity model, the future state of the target corresponding to the image data and radar data is predicted. The prediction formula is as follows:
xk+1=Axk+vx k+1 =Ax k +v
其中,xk+1表示k+1时刻目标的状态;v是模型的过程噪声;Among them, x k+1 represents the state of the target at time k+1; v is the process noise of the model;
规划误差协方差,并计算卡尔曼滤波增益;Plan the error covariance and calculate the Kalman filter gain;
通过以下公式测量更新目标的状态量的最优值;The optimal value of the state quantity of the update target is measured by the following formula;
xk=xk(zk-Hxk)x k =x k (z k -Hx k )
其中,zk表示k时刻目标的测量值,H为观测矩阵;xk为目标在k时刻的状态量;Among them, z k represents the measured value of the target at time k, H is the observation matrix; x k is the state quantity of the target at time k;
将目标在k时刻的状态量与测量值进行匹配,以确定所述跟踪目标。The state quantity of the target at time k is matched with the measured value to determine the tracking target.
在本申请的一种实现方式中,所述对所述跟踪目标进行关联,具体包括:In an implementation manner of the present application, the associating the tracking target specifically includes:
基于全局最近邻算法,将雷达数据与图像数据进行关联,公式如下:Based on the global nearest neighbor algorithm, the radar data is associated with the image data, and the formula is as follows:
其中,ρ表示雷达数据与图像数据的相似程度;xra表示雷达数据的纵向距离;yra表示雷达数据的横向距离;xca表示图像数据的纵向距离;yca表示图像数据的横向距离。Among them, ρ represents the similarity between radar data and image data; x ra represents the longitudinal distance of radar data; y ra represents the lateral distance of radar data; x ca represents the longitudinal distance of image data; y ca represents the lateral distance of image data.
在本申请的一种实现方式中,将跟踪目标进行融合,具体包括:In one implementation of the present application, the tracking target is fused, specifically including:
将关联的雷达数据和图像数据采用加权算法进行融合,公式如下:The associated radar data and image data are fused using a weighted algorithm, the formula is as follows:
其中,XF_obj表示融合后的目标状态量,Vra表示关联后的雷达数据的目标状态量;Vca表示关联后的图像数据的目标状态量;Pca表示图像数据在目标跟踪时产生的误差协方差;Pra表示雷达数据在目标跟踪时产生的误差协方差。Among them, X F_obj represents the fused target state quantity, V ra represents the target state quantity of the associated radar data; V ca represents the target state quantity of the correlated image data; P ca represents the error generated by the image data during target tracking Covariance; P ra represents the error covariance generated by radar data during target tracking.
在本申请的一种实现方式中,所述根据所述矿井车辆的行驶路径筛选所述跟踪目标,确定距离最近的跟踪目标作为危险目标,具体包括:In an implementation manner of the present application, the screening of the tracking target according to the driving path of the mine vehicle, and determining the tracking target with the closest distance as the dangerous target specifically includes:
基于所述矿井车辆的当前行驶状态,生成所述矿井车辆的行驶路径;generating a travel path of the mine vehicle based on the current driving state of the mine vehicle;
判断多个所述跟踪目标是否位于所述行驶路径上,将位于所述行驶路径之外的跟踪目标剔除;judging whether multiple tracking targets are located on the driving path, and removing tracking targets located outside the driving path;
计算位于所述行驶路径上的多个跟踪目标与所述矿井车辆的距离,将距离最近的一个跟踪目标确定为危险目标。The distance between multiple tracking targets located on the driving path and the mine vehicle is calculated, and the tracking target with the closest distance is determined as a dangerous target.
在本申请的一种实现方式中,所述根据所述预警时间以及制动时间控制所述矿井车辆预警或制动,具体包括:In an implementation manner of the present application, the controlling the early warning or braking of the mine vehicle according to the early warning time and the braking time specifically includes:
基于预设碰撞时间算法,确定预警阈值时间、制动阈值时间以及碰撞时间;Based on the preset collision time algorithm, determine the warning threshold time, braking threshold time and collision time;
判断所述碰撞时间和所述预警阈值时间以及所述制动阈值时间之间的大小;Judging the size between the collision time and the warning threshold time and the braking threshold time;
当所述碰撞时间大于所述预警阈值时间,所述矿井车辆不会预警和制动;When the collision time is greater than the warning threshold time, the mine vehicle will not give warning and brake;
当所述碰撞时间小于所述预警阈值时间且大于所述制动阈值时间,所述矿井车辆只预警不制动;When the collision time is less than the warning threshold time and greater than the braking threshold time, the mine vehicle only gives a warning and does not brake;
当所述碰撞时间小于所述制动阈值时间,控制所述矿井车辆预警并制动。When the collision time is less than the braking threshold time, the mine vehicle is controlled to give an early warning and brake.
在本申请的一种实现方式中,所述方法还包括:In an implementation manner of the present application, the method further includes:
接收超声波数据,基于所述超声波数据确定障碍物与所述矿井车辆之间的距离;receiving ultrasonic data, determining a distance between an obstacle and the mine vehicle based on the ultrasonic data;
在所述距离小于预设的距离阈值时,控制所述矿井车辆预警和制动。When the distance is less than a preset distance threshold, the warning and braking of the mine vehicle are controlled.
本申请实施例还提供了一种矿井车辆防碰撞设备,所述设备包括:The embodiment of the present application also provides a mine vehicle anti-collision equipment, the equipment includes:
至少一个处理器;以及,at least one processor; and,
与所述至少一个处理器通信连接的存储器;其中,a memory communicatively coupled to the at least one processor; wherein,
所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够:The memory stores instructions executable by the at least one processor, the instructions being executable by the at least one processor to enable the at least one processor to:
获取多个传感器测量的数据;Obtain data measured by multiple sensors;
对所述多个传感器测量的数据进行数据预处理;performing data preprocessing on data measured by the plurality of sensors;
基于预处理后的数据,确定跟踪目标,并对所述跟踪目标进行关联与融合;Determine the tracking target based on the preprocessed data, and associate and fuse the tracking target;
根据所述矿井车辆的行驶路径筛选所述跟踪目标,确定距离最近的跟踪目标作为危险目标;Screening the tracking target according to the driving path of the mine vehicle, and determining the closest tracking target as a dangerous target;
计算所述危险目标与所述矿井车辆发生碰撞的预警时间以及制动时间,并根据所述预警时间以及制动时间控制所述矿井车辆预警或制动。Calculating the warning time and braking time of the collision between the dangerous target and the mine vehicle, and controlling the warning or braking of the mine vehicle according to the warning time and braking time.
本申请实施例还提供了一种矿井车辆防碰撞的非易失性计算机存储介质,存储有计算机可执行指令,所述计算机可执行指令设置为:获取多个传感器测量的数据;The embodiment of the present application also provides a non-volatile computer storage medium for anti-collision of mine vehicles, which stores computer-executable instructions, and the computer-executable instructions are configured to: acquire data measured by multiple sensors;
对所述多个传感器测量的数据进行数据预处理;performing data preprocessing on data measured by the plurality of sensors;
基于预处理后的数据,确定跟踪目标,并对所述跟踪目标进行关联与融合;Determine the tracking target based on the preprocessed data, and associate and fuse the tracking target;
根据所述矿井车辆的行驶路径筛选所述跟踪目标,确定距离最近的跟踪目标作为危险目标;Screening the tracking target according to the driving path of the mine vehicle, and determining the closest tracking target as a dangerous target;
计算所述危险目标与所述矿井车辆发生碰撞的预警时间以及制动时间,并根据所述预警时间以及制动时间控制所述矿井车辆预警或制动。Calculating the warning time and braking time of the collision between the dangerous target and the mine vehicle, and controlling the warning or braking of the mine vehicle according to the warning time and braking time.
本申请实施例提供的一种矿井车辆防碰撞方法、设备及存储介质,通过对多个测量目标进行数据关联融合,并进行跟踪,从而判断出矿井车辆的行驶轨迹上是否存在障碍物,并及时进行预警或制动,从而防止车辆发生碰撞,以减少地下矿井事故的发生。通过对接收到的数据进行空间同步,从而获得较为准确的数据。基于各种算法处理数据,使得系统在进行障碍物目标跟踪时获得较为准确的障碍物跟踪信息。The mine vehicle anti-collision method, equipment and storage medium provided by the embodiment of the present application can determine whether there is an obstacle on the driving track of the mine vehicle by performing data correlation and fusion on multiple measurement targets and tracking them, and timely Carry out early warning or braking to prevent vehicle collisions and reduce accidents in underground mines. By spatially synchronizing the received data, more accurate data can be obtained. Based on various algorithms to process data, the system can obtain more accurate obstacle tracking information when tracking obstacle targets.
附图说明Description of drawings
此处所说明的附图用来提供对本申请的进一步理解,构成本申请的一部分,本申请的示意性实施例及其说明用于解释本申请,并不构成对本申请的不当限定。在附图中:The drawings described here are used to provide a further understanding of the application and constitute a part of the application. The schematic embodiments and descriptions of the application are used to explain the application and do not constitute an improper limitation to the application. In the attached picture:
图1为本申请实施例提供的一种矿井车辆防碰撞方法流程图;Fig. 1 is a kind of flow chart of mine vehicle anti-collision method provided by the embodiment of the present application;
图2为本申请实施例提供的雷达传感器及相机安装示意图;Fig. 2 is a schematic diagram of the installation of the radar sensor and the camera provided by the embodiment of the present application;
图3为本申请实施例提供的雷达坐标系与车体坐标系示意图;Fig. 3 is a schematic diagram of the radar coordinate system and the vehicle body coordinate system provided by the embodiment of the present application;
图4为本申请实施例提供的相机坐标系与车体坐标系示意图;Fig. 4 is a schematic diagram of the camera coordinate system and the vehicle body coordinate system provided by the embodiment of the present application;
图5为本申请实施例提供的一种矿井车辆防碰撞设备示意图。Fig. 5 is a schematic diagram of an anti-collision device for a mine vehicle provided in an embodiment of the present application.
具体实施方式Detailed ways
为使本申请的目的、技术方案和优点更加清楚,下面将结合本申请具体实施例及相应的附图对本申请技术方案进行清楚、完整地描述。显然,所描述的实施例仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in conjunction with specific embodiments of the present application and corresponding drawings. Apparently, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.
地下矿井生产环境恶劣,主要依靠矿车执行运输任务。矿井运输关系着安全生产问题,据统计约1/4的矿井安全事故发生在运输环节。因而,安全运输成为当前矿井生产中越来越重要的部分。The production environment of underground mines is harsh, and mine trucks are mainly used to carry out transportation tasks. Mine transportation is related to safety production. According to statistics, about 1/4 of mine safety accidents occur in the transportation link. Therefore, safe transportation has become an increasingly important part of current mine production.
一般来说,矿井车辆都安装有相应的防碰撞系统或设备,以避免在地下黑暗环境中,车辆与障碍物之间发生碰撞。有些策略是通过无线网络发射器的信号强度来判断对面矿车的距离,执行相应的防碰撞策略。也有将lora无线通信技术、RFID技术与激光雷达相结合,或者通过视觉技术识别前方是否有障碍物。但这些方案或多或少都存在成本高、精度低、误触发、障碍物识别不准确等问题。Generally speaking, mine vehicles are equipped with corresponding anti-collision systems or equipment to avoid collisions between vehicles and obstacles in an underground dark environment. Some strategies use the signal strength of the wireless network transmitter to judge the distance of the opposite mine car, and implement the corresponding anti-collision strategy. There are also combinations of lora wireless communication technology, RFID technology and laser radar, or visual technology to identify whether there are obstacles ahead. However, these solutions more or less have problems such as high cost, low precision, false triggering, and inaccurate obstacle recognition.
本申请实施例提供了一种矿井车辆防碰撞方法、设备及存储介质,用以解决现有的矿井环境车辆防碰撞方案精度低、障碍物识别不准确的技术问题。The embodiment of the present application provides a mine vehicle anti-collision method, equipment and storage medium to solve the technical problems of low accuracy and inaccurate obstacle identification in existing mine environment vehicle anti-collision schemes.
下面通过附图对本申请实施例提出的技术方案进行详细的说明。The technical solutions proposed in the embodiments of the present application will be described in detail below with reference to the accompanying drawings.
图1为本申请实施例提供的一种矿井车辆防碰撞方法流程图。如图1所示,该方法主要包括以下步骤:Fig. 1 is a flowchart of a mine vehicle anti-collision method provided by an embodiment of the present application. As shown in Figure 1, the method mainly includes the following steps:
步骤101、获取多个传感器测量的数据。
本申请实施例中,对于矿井车辆的防碰撞预测,主要是基于传感器测量的数据,通过对数据的分析计算从而得到的。具体来说,矿井车辆上安装有多个毫米波雷达以及超声波雷达,分别用来获取雷达数据和超声波数据。同时矿井车辆上还安装有ADAS相机,用于获取矿井环境中的图像数据。另外,矿井车辆车还安装有摄像仪,用于获取矿井环境中实时拍摄的视频数据。In the embodiment of the present application, the anti-collision prediction of the mine vehicle is mainly obtained by analyzing and calculating the data based on the data measured by the sensor. Specifically, multiple millimeter-wave radars and ultrasonic radars are installed on mine vehicles to obtain radar data and ultrasonic data respectively. At the same time, ADAS cameras are installed on the mine vehicles to obtain image data in the mine environment. In addition, the mine vehicle is also equipped with a camera to obtain real-time video data captured in the mine environment.
步骤102、对多个传感器测量的数据进行数据预处理。
本申请实施例中,系统接收相机拍摄的图像数据以及毫米波雷达探测的雷达数据,将这些数据作为目标数据。然后对这些数据进行目标数据滤波,以去除空目标、无效目标数据。In the embodiment of the present application, the system receives the image data captured by the camera and the radar data detected by the millimeter-wave radar, and uses these data as target data. Then target data filtering is performed on these data to remove empty target and invalid target data.
进一步地,在完成图像数据以及雷达数据等目标数据滤波之后,需要将滤波之后的图像数据以及雷达数据进行空间同步。因为工程师在安装传感器的时候,并不会完全使传感器的坐标与车体坐标完全重合。因此需要使用水平测量仪和尺子测量处传感器坐标系相对于车体坐标系的偏转角度和位移,然后传感器测量的目标数据通过坐标旋转的方式转换到车体坐标系。Further, after filtering target data such as image data and radar data, it is necessary to spatially synchronize the filtered image data and radar data. Because when the engineer installs the sensor, the coordinates of the sensor will not completely coincide with the coordinates of the car body. Therefore, it is necessary to use a level measuring instrument and a ruler to measure the deflection angle and displacement of the sensor coordinate system relative to the vehicle body coordinate system, and then convert the target data measured by the sensor to the vehicle body coordinate system through coordinate rotation.
传感器以及ASDS相机在车体上的安装位置,如图2所示,可以看出传感器的坐标并未与车体的坐标完全重合,因此雷达坐标在安装时相对与车体坐标系发生了旋转与位移,雷达坐标系与车体坐标系如图3所示。因而需要将雷达的目标数据进行旋转和平移才能将雷达目标数据同步到车体坐标系下,计算公式如下:The installation position of the sensor and ASDS camera on the car body is shown in Figure 2. It can be seen that the coordinates of the sensor do not completely coincide with the coordinates of the car body, so the radar coordinates are rotated relative to the car body coordinate system during installation. Displacement, radar coordinate system and car body coordinate system are shown in Fig. 3. Therefore, it is necessary to rotate and translate the radar target data to synchronize the radar target data to the car body coordinate system. The calculation formula is as follows:
x=y′sinθ+x′cosθ+Δxx=y'sinθ+x'cosθ+Δx
y=y′cosθ-x′sinθ+Δyy=y'cosθ-x'sinθ+Δy
同理,ASDS相机在安装时相对与车体坐标系发生了旋转与位移,因此需要将相机的目标数据进行旋转和平移才能将相机的目标数据同步到车体坐标系下,ASDS相机坐标系如图4所示,相机坐标空间同步的计算公式如下:Similarly, the ASDS camera has been rotated and displaced relative to the vehicle body coordinate system during installation, so the target data of the camera needs to be rotated and translated to synchronize the target data of the camera to the vehicle body coordinate system. The ASDS camera coordinate system is as follows: As shown in Figure 4, the calculation formula for camera coordinate space synchronization is as follows:
x=x′cosθ+y′sinθx=x'cosθ+y'sinθ
y=y′cosθ-x′sinθy=y'cosθ-x'sinθ
步骤103、基于预处理后的数据,确定跟踪目标,并对所述跟踪目标进行关联与融合。Step 103: Determine the tracking target based on the preprocessed data, and perform association and fusion on the tracking target.
本申请实施例中,认为物体的运动模型服从高斯分布,然后使用卡尔曼滤波算法对目标的状态进行预测,然后通过与观察模型进行对比,根据误差对目标的运动状态进行更新。In the embodiment of this application, it is considered that the motion model of the object obeys the Gaussian distribution, and then the Kalman filter algorithm is used to predict the state of the target, and then by comparing with the observation model, the motion state of the target is updated according to the error.
具体的,基于预设恒速度模型对图像数据以及雷达数据所对应的目标的未来状态进行预测,预测公式如下所示:Specifically, based on the preset constant velocity model, the future state of the target corresponding to the image data and radar data is predicted, and the prediction formula is as follows:
xk+1=Axk+vx k+1 =Ax k +v
其中,xk+1表示k+1时刻目标的状态;v是模型的过程噪声。Among them, x k+1 represents the state of the target at time k+1; v is the process noise of the model.
进一步地,规划误差协方差值,公式如下:Further, the planning error covariance value, the formula is as follows:
Pk+1=APkAT+Q,P k+1 =AP k A T +Q,
其中,Pk+1表示k+1时刻的误差协方差,Q表示过程噪声的协方差矩阵。进一步地,计算卡尔曼滤波增益,公式如下:Among them, P k+1 represents the error covariance at time k+1, and Q represents the covariance matrix of the process noise. Further, calculate the Kalman filter gain, the formula is as follows:
Kk=PkHT(HPkHT+R)K k =P k H T (HP k H T +R)
其中,式中Kk表示k时刻的卡尔曼滤波增益;H表示观测矩阵;R表示测量噪声协方差矩阵。Among them, K k in the formula represents the Kalman filter gain at time k; H represents the observation matrix; R represents the measurement noise covariance matrix.
通过测量更新最优估计值,公式为:Update the best estimate by measurement, the formula is:
xk=xk(zk-Hxk)x k =x k (z k -Hx k )
其中,式中zk表示k时刻目标的测量值,H为观测矩阵;xk为目标在k时刻的状态量。Among them, zk in the formula represents the measured value of the target at time k, H is the observation matrix; x k is the state quantity of the target at time k.
然后,更新协方差误差,公式如下:Then, update the covariance error, the formula is as follows:
Pk=(I-KkH)Pk P k =(IK k H)P k
其中,I表示单位矩阵。Among them, I represents the identity matrix.
然后,循环计算Pk、xk,将目标在k时刻的状态量与测量值进行匹配,以确定所述跟踪目标。Then, P k and x k are calculated cyclically, and the state quantity of the target at time k is matched with the measured value to determine the tracking target.
本申请实施例中,本申请实施例中,根据全局最近邻算法,将雷达数据与图像数据进行关联,公式如下:In the embodiment of the present application, in the embodiment of the present application, the radar data is associated with the image data according to the global nearest neighbor algorithm, and the formula is as follows:
其中,ρ表示雷达数据与图像数据的相似程度;xra表示雷达数据的纵向距离;yra表示雷达数据的横向距离;xca表示图像数据的纵向距离;yca表示图像数据的横向距离。Among them, ρ represents the similarity between radar data and image data; x ra represents the longitudinal distance of radar data; y ra represents the lateral distance of radar data; x ca represents the longitudinal distance of image data; y ca represents the lateral distance of image data.
进一步地,将关联的雷达数据和图像数据采用加权算法进行融合,公式如下:Further, the associated radar data and image data are fused using a weighted algorithm, the formula is as follows:
其中,XF_obj表示融合后的目标状态量,Vra表示关联后的雷达数据的目标状态量;Vca表示关联后的图像数据的目标状态量;Pca表示图像数据在目标跟踪时产生的误差协方差;Pra表示雷达数据在目标跟踪时产生的误差协方差。Among them, X F_obj represents the fused target state quantity, V ra represents the target state quantity of the associated radar data; V ca represents the target state quantity of the correlated image data; P ca represents the error generated by the image data during target tracking Covariance; P ra represents the error covariance generated by radar data during target tracking.
本申请实施例中,分别将前述关联到一起的雷达目标和相机目标进行融合;融合采用的算法是加权算法,加权公式如下:In the embodiment of the present application, the aforementioned radar targets and camera targets associated together are fused respectively; the algorithm adopted for the fusion is a weighting algorithm, and the weighting formula is as follows:
其中,XF_obj表示融合后的目标状态量,Vra表示关联后的雷达数据的目标状态量;Vca表示关联后的图像数据的目标状态量;Pca表示图像数据在目标跟踪时产生的误差协方差;Pra表示雷达数据在目标跟踪时产生的误差协方差。Among them, X F_obj represents the fused target state quantity, V ra represents the target state quantity of the associated radar data; V ca represents the target state quantity of the correlated image data; P ca represents the error generated by the image data during target tracking Covariance; P ra represents the error covariance generated by radar data during target tracking.
步骤104、筛选所述跟踪目标,确定距离最近的跟踪目标作为危险目标。
本申请实施例中,基于所述矿井车辆的当前行驶状态,生成所述矿井车辆的行驶路径,判断多个所述跟踪目标是否位于所述行驶路径上,将位于所述行驶路径之外的跟踪目标剔除,计算位于所述行驶路径上的多个跟踪目标与所述矿井车辆的距离,将距离最近的一个跟踪目标确定为危险目标。In the embodiment of the present application, based on the current driving state of the mine vehicle, the driving path of the mine vehicle is generated, and it is judged whether multiple tracking targets are located on the driving path, and the tracking objects located outside the driving path Target elimination, calculating the distance between multiple tracking targets on the driving path and the mine vehicle, and determining the closest tracking target as a dangerous target.
步骤105、根据预警时间以及制动时间控制矿井车辆预警或制动。
本申请实施例中,防碰撞系统包含前向碰撞决策模块,根据预设碰撞时间算法,确定预警阈值时间TTCW、制动阈值时间TTCb以及碰撞时间TTC。In the embodiment of the present application, the anti-collision system includes a forward collision decision module, which determines the warning threshold time TTC W , the braking threshold time TTC b and the collision time TTC according to the preset collision time algorithm.
判断所述碰撞时间TTC和所述预警阈值时间TTCW以及所述制动阈值时间TTCb之间的大小。Judging the time between the collision time TTC and the warning threshold time TTC W and the braking threshold time TTC b .
当所述碰撞时间大于所述预警阈值时间,说明前方目标没有危险,所以矿井车辆不会预警和制动。When the collision time is greater than the warning threshold time, it means that the target ahead is not dangerous, so the mine vehicle will not give warning and brake.
当所述碰撞时间小于所述预警阈值时间且大于所述制动阈值时间,此时还没有达到制动阈值,所以矿井车辆只预警不制动。When the collision time is less than the warning threshold time and greater than the braking threshold time, the braking threshold has not been reached at this time, so the mine vehicle only warns and does not brake.
当所述碰撞时间小于所述制动阈值时间,此时已经极易发生危险,因此需要控制所述矿井车辆预警并制动。When the collision time is less than the braking threshold time, danger is very likely to occur at this time, so it is necessary to control the mine vehicle to warn and brake.
本申请实施例,还设计了后向碰撞决策模块,在矿井车辆上安装后向超声波雷达。然后设定距离阈值,当通过超声波数据测量的矿井车辆与目标障碍物之间的距离小于预设的距离阈值时,后向碰撞模块决策进行预警或制动。In the embodiment of the present application, a backward collision decision-making module is also designed, and a backward ultrasonic radar is installed on the mine vehicle. Then set the distance threshold. When the distance between the mine vehicle and the target obstacle measured by the ultrasonic data is less than the preset distance threshold, the rear collision module decides to perform early warning or braking.
除此之外,本申请实施例提出的方法,还包含了决策仲裁模块。根据当前车速、挡位、前向碰撞决策模块的输入和后向碰撞决策模块的输入,来判断是预警还是制动,决策仲裁模块主要通过以下过程实现决策仲裁:In addition, the method proposed in the embodiment of the present application also includes a decision-making arbitration module. According to the current vehicle speed, gear, the input of the forward collision decision-making module and the input of the rear collision decision-making module, it is judged whether it is early warning or braking. The decision-making arbitration module mainly realizes the decision-making arbitration through the following process:
车速(V)等于0或者挡位(G)在空档(GN)时,车不会发出警报且不会进行制动;When the vehicle speed (V) is equal to 0 or the gear (G) is in neutral (GN), the car will not issue an alarm and will not brake;
车速大于0,且有档位时,进入以下判断:When the vehicle speed is greater than 0 and there is a gear, enter the following judgment:
档位是前进档(GD),此时说明车正在前进,决策仲裁模块输出前向碰撞决策模块的结果;The gear position is a forward gear (GD), which means that the car is moving forward, and the decision-making arbitration module outputs the result of the forward collision decision-making module;
档位是倒挡(GR),此时说明车正在进行倒车,此时决策仲裁模块输出后向碰撞决策模块的结果。The gear position is the reverse gear (GR), which means that the car is running backwards. At this time, the decision-making arbitration module outputs the result of the backward collision decision-making module.
本申请实施例提供的一种矿井车辆防碰撞方法、设备及存储介质,通过对多个测量目标进行数据关联融合,并进行跟踪,从而判断出矿井车辆的行驶轨迹上是否存在障碍物,并及时进行预警或制动,从而防止车辆发生碰撞,以减少地下矿井事故的发生。通过对接收到的数据进行空间同步,从而获得较为准确的数据。基于各种算法处理数据,使得系统在进行障碍物目标跟踪时获得较为准确的障碍物跟踪信息。The mine vehicle anti-collision method, equipment and storage medium provided by the embodiment of the present application can determine whether there is an obstacle on the driving track of the mine vehicle by performing data correlation and fusion on multiple measurement targets and tracking them, and timely Carry out early warning or braking to prevent vehicle collisions and reduce accidents in underground mines. By spatially synchronizing the received data, more accurate data can be obtained. Based on various algorithms to process data, the system can obtain more accurate obstacle tracking information when tracking obstacle targets.
以上是本申请实施例提供的一种矿井车辆防碰撞方法,基于同样的发明构思,本申请实施例还提供了一种矿井车辆防碰撞设备,图5为本申请实施例提供的一种设备示意图,如图5所示,该设备主要包括:至少一个处理器501;以及,与至少一个处理器通信连接的存储器502;其中,存储器502存储有可被至少一个处理器501执行的指令,指令被至少一个处理器501执行,以使至少一个处理器501能够完成:获取多个传感器测量的数据;The above is a mine vehicle anti-collision method provided by the embodiment of the present application. Based on the same inventive concept, the embodiment of the present application also provides a mine vehicle anti-collision device. Figure 5 is a schematic diagram of a device provided by the embodiment of the present application , as shown in FIG. 5 , the device mainly includes: at least one processor 501; and a memory 502 communicatively connected to the at least one processor; wherein, the memory 502 stores instructions executable by the at least one processor 501, and the instructions are At least one processor 501 executes, so that at least one processor 501 can complete: acquiring data measured by multiple sensors;
对所述多个传感器测量的数据进行数据预处理;performing data preprocessing on data measured by the plurality of sensors;
基于预处理后的数据,确定跟踪目标,并对所述跟踪目标进行关联与融合;Determine the tracking target based on the preprocessed data, and associate and fuse the tracking target;
根据所述矿井车辆的行驶路径筛选所述跟踪目标,确定距离最近的跟踪目标作为危险目标;Screening the tracking target according to the driving path of the mine vehicle, and determining the closest tracking target as a dangerous target;
计算所述危险目标与所述矿井车辆发生碰撞的预警时间以及制动时间,并根据所述预警时间以及制动时间控制所述矿井车辆预警或制动。Calculating the warning time and braking time of the collision between the dangerous target and the mine vehicle, and controlling the warning or braking of the mine vehicle according to the warning time and braking time.
除此之外,本申请实施例还提供了一种矿井车辆防碰撞的非易失性计算机存储介质,存储有计算机可执行指令,所述计算机可执行指令设置为:获取多个传感器测量的数据;In addition, the embodiment of the present application also provides a non-volatile computer storage medium for anti-collision of mine vehicles, which stores computer-executable instructions, and the computer-executable instructions are set to: acquire data measured by multiple sensors ;
对所述多个传感器测量的数据进行数据预处理;performing data preprocessing on data measured by the plurality of sensors;
基于预处理后的数据,确定跟踪目标,并对所述跟踪目标进行关联与融合;Determine the tracking target based on the preprocessed data, and associate and fuse the tracking target;
根据所述矿井车辆的行驶路径筛选所述跟踪目标,确定距离最近的跟踪目标作为危险目标;Screening the tracking target according to the driving path of the mine vehicle, and determining the closest tracking target as a dangerous target;
计算所述危险目标与所述矿井车辆发生碰撞的预警时间以及制动时间,并根据所述预警时间以及制动时间控制所述矿井车辆预警或制动。Calculating the warning time and braking time of the collision between the dangerous target and the mine vehicle, and controlling the warning or braking of the mine vehicle according to the warning time and braking time.
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions The device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded onto a computer or other programmable data processing device, causing a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby The instructions provide steps for implementing the functions specified in the flow chart or blocks of the flowchart and/or the block or blocks of the block diagrams.
在一个典型的配置中,计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
本申请中的各个实施例均采用递进的方式描述,各个实施例之间相同相似的部分互相参见即可,每个实施例重点说明的都是与其他实施例的不同之处。尤其,对于装置实施例而言,由于其基本相似于方法实施例,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。Each embodiment in the present application is described in a progressive manner, the same and similar parts of each embodiment can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, as for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for relevant parts, please refer to part of the description of the method embodiment.
还需要说明的是,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、商品或者设备中还存在另外的相同要素。It should also be noted that the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes Other elements not expressly listed, or elements inherent in the process, method, commodity, or apparatus are also included. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.
以上所述仅为本申请的实施例而已,并不用于限制本申请。对于本领域技术人员来说,本申请可以有各种更改和变化。凡在本申请的精神和原理之内所作的任何修改、等同替换、改进等,均应包含在本申请的权利要求范围之内。The above descriptions are only examples of the present application, and are not intended to limit the present application. For those skilled in the art, various modifications and changes may occur in this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included within the scope of the claims of the present application.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211411211.5A CN115649158A (en) | 2022-11-11 | 2022-11-11 | A mine vehicle anti-collision method, device and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211411211.5A CN115649158A (en) | 2022-11-11 | 2022-11-11 | A mine vehicle anti-collision method, device and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN115649158A true CN115649158A (en) | 2023-01-31 |
Family
ID=85021478
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202211411211.5A Pending CN115649158A (en) | 2022-11-11 | 2022-11-11 | A mine vehicle anti-collision method, device and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115649158A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116610117A (en) * | 2023-04-28 | 2023-08-18 | 天宇正清科技有限公司 | A method, device, electronic equipment, and storage medium for controlling speed of an underground vehicle |
CN117734683A (en) * | 2024-02-19 | 2024-03-22 | 中国科学院自动化研究所 | Underground vehicle anti-collision safety early warning decision-making method |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102018105014A1 (en) * | 2017-03-06 | 2018-09-06 | GM Global Technology Operations LLC | FORECAST ALGORITHM FOR A VEHICLE CRASH USING A RADAR SENSOR AND A UPA SENSOR |
CN110155047A (en) * | 2019-06-19 | 2019-08-23 | 新石器慧通(北京)科技有限公司 | Anti-collision control method, device, system and vehicle |
CN110304054A (en) * | 2019-07-03 | 2019-10-08 | 国唐汽车有限公司 | A kind of automatic emergency brake method based on Multi-sensor Fusion |
CN112172775A (en) * | 2020-09-27 | 2021-01-05 | 北京中科慧眼科技有限公司 | Vehicle braking early warning method, system and device based on binocular stereo camera |
CN113514806A (en) * | 2021-04-02 | 2021-10-19 | 苏州挚途科技有限公司 | Obstacle determination method and device in automatic driving process and electronic equipment |
CN114118253A (en) * | 2021-11-23 | 2022-03-01 | 合肥工业大学 | Vehicle detection method and detection device based on multi-source data fusion |
CN114537374A (en) * | 2022-03-23 | 2022-05-27 | 浙江亚太机电股份有限公司 | Vehicle front anti-collision system based on travelable area |
-
2022
- 2022-11-11 CN CN202211411211.5A patent/CN115649158A/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102018105014A1 (en) * | 2017-03-06 | 2018-09-06 | GM Global Technology Operations LLC | FORECAST ALGORITHM FOR A VEHICLE CRASH USING A RADAR SENSOR AND A UPA SENSOR |
CN110155047A (en) * | 2019-06-19 | 2019-08-23 | 新石器慧通(北京)科技有限公司 | Anti-collision control method, device, system and vehicle |
CN110304054A (en) * | 2019-07-03 | 2019-10-08 | 国唐汽车有限公司 | A kind of automatic emergency brake method based on Multi-sensor Fusion |
CN112172775A (en) * | 2020-09-27 | 2021-01-05 | 北京中科慧眼科技有限公司 | Vehicle braking early warning method, system and device based on binocular stereo camera |
CN113514806A (en) * | 2021-04-02 | 2021-10-19 | 苏州挚途科技有限公司 | Obstacle determination method and device in automatic driving process and electronic equipment |
CN114118253A (en) * | 2021-11-23 | 2022-03-01 | 合肥工业大学 | Vehicle detection method and detection device based on multi-source data fusion |
CN114537374A (en) * | 2022-03-23 | 2022-05-27 | 浙江亚太机电股份有限公司 | Vehicle front anti-collision system based on travelable area |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116610117A (en) * | 2023-04-28 | 2023-08-18 | 天宇正清科技有限公司 | A method, device, electronic equipment, and storage medium for controlling speed of an underground vehicle |
CN117734683A (en) * | 2024-02-19 | 2024-03-22 | 中国科学院自动化研究所 | Underground vehicle anti-collision safety early warning decision-making method |
CN117734683B (en) * | 2024-02-19 | 2024-05-24 | 中国科学院自动化研究所 | A safety warning decision method for underground vehicle anti-collision |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4420011B2 (en) | Object detection device | |
JP4343536B2 (en) | Car sensing device | |
JP5410730B2 (en) | Automobile external recognition device | |
US10350999B2 (en) | Vehicle cruise control apparatus and vehicle cruise control method | |
US10366295B2 (en) | Object recognition apparatus | |
US20190176846A1 (en) | Driving intervention in vehicles | |
CN102910168B (en) | Image processing apparatus | |
CN105128836A (en) | Autonomous emergency braking system and method for recognizing pedestrian therein | |
JP7078909B2 (en) | Vehicle control device and computer program for vehicle control | |
CN107000749A (en) | The travel controlling system and travel control method of vehicle | |
García et al. | Context aided pedestrian detection for danger estimation based on laser scanner and computer vision | |
JP2018092483A (en) | Object recognition device | |
US20180012083A1 (en) | Demarcation line recognition apparatus | |
CN114523963B (en) | System and method for predicting road collisions with host vehicles | |
KR20230031344A (en) | System and Method for Detecting Obstacles in Area Surrounding Vehicle | |
CN115649158A (en) | A mine vehicle anti-collision method, device and storage medium | |
KR102712307B1 (en) | Apparatus and method for preventing vehicle collision | |
US10040449B2 (en) | Method for avoiding a rear-end collision between a first vehicle and a second vehicle and control unit | |
KR20190109622A (en) | System and method for detecting close cut-in vehicle based on free space signal | |
US12179751B2 (en) | Remote target vehicle tracking in a region surrounding a motor vehicle | |
EP3709279A1 (en) | Target detection device for vehicle | |
CN111645679A (en) | Side impact risk estimation system for vehicle | |
CN114084129A (en) | Fusion-based vehicle automatic driving control method and system | |
CN113022593B (en) | Obstacle processing method and device and traveling equipment | |
JP6663622B2 (en) | Imaging device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |