CN114459474B - A method of inertial/polarization/radar/optical flow tight combined navigation based on factor graph - Google Patents
A method of inertial/polarization/radar/optical flow tight combined navigation based on factor graph Download PDFInfo
- Publication number
- CN114459474B CN114459474B CN202210143142.8A CN202210143142A CN114459474B CN 114459474 B CN114459474 B CN 114459474B CN 202210143142 A CN202210143142 A CN 202210143142A CN 114459474 B CN114459474 B CN 114459474B
- Authority
- CN
- China
- Prior art keywords
- navigation system
- carrier
- radar
- measurement
- coordinate system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
- G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
- G01C21/16—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
- G01C21/165—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
- G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
- G01C21/16—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
- G01C21/165—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
- G01C21/1652—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments with ranging devices, e.g. LIDAR or RADAR
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
- G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
- G01C21/16—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
- G01C21/165—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
- G01C21/1656—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments with passive imaging devices, e.g. cameras
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
- G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
- G01C21/16—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
- G01C21/183—Compensation of inertial measurements, e.g. for temperature effects
- G01C21/188—Compensation of inertial measurements, e.g. for temperature effects for accumulated errors, e.g. by coupling inertial systems with absolute positioning systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/20—Instruments for performing navigational calculations
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
- G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
- G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T10/00—Road transport of goods or passengers
- Y02T10/10—Internal combustion engine [ICE] based vehicles
- Y02T10/40—Engine management systems
Landscapes
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Computer Networks & Wireless Communication (AREA)
- Electromagnetism (AREA)
- Navigation (AREA)
Abstract
Description
技术领域Technical Field
本发明属于自主导航技术的范畴,涉及一种基于因子图的惯性/偏振/雷达/光流紧组合的多传感器融合导航方法。The present invention belongs to the category of autonomous navigation technology, and relates to a multi-sensor fusion navigation method based on a tight combination of inertia/polarization/radar/optical flow of factor graphs.
背景技术Background Art
多传感器信息融合(Multi-sensor Fusion,MSF)是利用计算机技术,将来自多传感器或多源的信息和数据以一定的准则进行自动分析和综合,以完成所需的决策和估计而进行的信息处理过程。多传感器数据融合技术是近几年的研究热点方向,在军事、载人航天、自动驾驶等领域中有着广阔的应用前景。Multi-sensor Fusion (MSF) is an information processing process that uses computer technology to automatically analyze and synthesize information and data from multiple sensors or multiple sources according to certain criteria to complete the required decision-making and estimation. Multi-sensor data fusion technology has been a hot research direction in recent years and has broad application prospects in the fields of military, manned spaceflight, and autonomous driving.
与单传感器相比,运用多传感器信息融合技术在解决探测、跟踪和目标识别等问题方面,能够增强系统生存能力,提高整个系统的可靠性和鲁棒性,增强数据的可信度,提高精度,扩展系统的时间、空间覆盖率,增加系统的实时性和信息利用率等。Compared with a single sensor, the use of multi-sensor information fusion technology can enhance the system's survivability, improve the reliability and robustness of the entire system, enhance the credibility of data, improve accuracy, expand the system's time and space coverage, increase the system's real-time performance and information utilization, etc. in solving problems such as detection, tracking and target identification.
多传感器数据融合的常用方法基本上可分为两大类:随机类和人工智能类。目前多传感器数据融合的方法侧重随机类。卡尔曼滤波算法是多传感器组合系统常用的融合方法,缺点是传感器信息冗余时实时性差,未能完全利用融合历史信息,导致子系统增加时故障概率提高,降低系统的鲁棒性。基于因子图的多传感器数据融合方法通过构建系统某一时间段内的图模型,将系统状态与导航信息相关联,基于后验估计理论实现数据的融合,在给定所有可用量测值后,计算所有状态的联合概率分布函数的最大后验概率估计,能够有效地实现导航传感器的即插即用,解决多传感器观测数据异步问题,在保证精度的同时,降低了计算量。但是基于因子图的多传感器数据融合方法的导航精度也依赖于各传感器精度,当传感器受到外部干扰时(如地磁导航系统受到强烈磁干扰时),多传感器融合系统的精度下降,累积误差增多。The commonly used methods of multi-sensor data fusion can basically be divided into two categories: random and artificial intelligence. At present, the methods of multi-sensor data fusion focus on random. The Kalman filter algorithm is a commonly used fusion method for multi-sensor combination systems. Its disadvantages are poor real-time performance when sensor information is redundant, and failure to fully utilize fusion history information, resulting in an increase in the probability of failure when the subsystem is increased, reducing the robustness of the system. The multi-sensor data fusion method based on factor graphs constructs a graph model of the system within a certain period of time, associates the system state with navigation information, and realizes data fusion based on the posterior estimation theory. After all available measurement values are given, the maximum posterior probability estimate of the joint probability distribution function of all states is calculated, which can effectively realize the plug-and-play of navigation sensors, solve the asynchronous problem of multi-sensor observation data, and reduce the amount of calculation while ensuring accuracy. However, the navigation accuracy of the multi-sensor data fusion method based on factor graphs also depends on the accuracy of each sensor. When the sensor is subject to external interference (such as when the geomagnetic navigation system is subject to strong magnetic interference), the accuracy of the multi-sensor fusion system decreases and the cumulative error increases.
研究发现偏振光具有良好的自主性,能够应用于多传感器融合系统中,英国著名物理学家瑞利在1871年提出瑞利散射定律,揭示了光线散射特性,从而发现天空大气偏振分布模式,大气偏振模式关于太阳子午线、反太阳子午线呈对称的稳定分布,蕴含着重要的导航信息,应用天空大气偏振分布模式进行导航具有很难在大范围受到人为干扰,且误差不随时间积累的优点,有望成为多传感器组合导航中的重要辅助手段。Research has found that polarized light has good autonomy and can be used in multi-sensor fusion systems. In 1871, the famous British physicist Rayleigh proposed the Rayleigh scattering law, which revealed the scattering characteristics of light and thus discovered the polarization distribution pattern of the sky atmosphere. The atmospheric polarization pattern is symmetrically distributed about the solar meridian and anti-solar meridian, and contains important navigation information. Using the sky atmospheric polarization distribution pattern for navigation has the advantages of being difficult to be affected by human interference on a large scale and the error does not accumulate over time. It is expected to become an important auxiliary means in multi-sensor combined navigation.
本发明与专利“一种基于图优化的仿生偏振同步定位与构图的方法”(以下简称专利1)的区别在于以下几点:The differences between the present invention and the patent "A method for bionic polarization synchronous positioning and composition based on graph optimization" (hereinafter referred to as Patent 1) are as follows:
区别1:专利1中使用松组合因子图方法对组合导航系统状态最优值进行估计,对传感器数据利用不够充分,本发明采用紧组合因子图方法对组合导航系统状态最优值进行估计,利用更原始的传感器数据,将相邻两组合导航系统状态相关联,获得更高的导航精度。Difference 1: Patent 1 uses a loose combination factor graph method to estimate the optimal value of the combined navigation system state, and does not fully utilize the sensor data. The present invention uses a tight combination factor graph method to estimate the optimal value of the combined navigation system state, uses more original sensor data, and associates the states of two adjacent combined navigation systems to obtain higher navigation accuracy.
区别2:相比与专利1,本发明额外加入光流传感器提供速度约束,因子图在优化过程中加入新的约束,优化的最优估计值结果更加精确,即使单一传感器量测误差较大,也不会破坏整体估计结果。Difference 2: Compared with Patent 1, the present invention additionally adds an optical flow sensor to provide speed constraints, and the factor graph adds new constraints during the optimization process. The optimized optimal estimate result is more accurate, and even if the measurement error of a single sensor is large, it will not destroy the overall estimation result.
区别3:专利1基于雷达里程计量测模型建立载体的状态节点位置约束,基于偏振光相机量测模型建立状态节点航向约束,惯性导航系统运动模型建立相邻状态节点位姿变换约束;本发明基于惯性导航系统预积分模型建立当前时刻紧组合导航系统相邻节点预积分约束,基于偏振光强传感器量测模型建立紧组合导航系统相邻节点航向约束,基于雷达里程计量测模型建立相邻节点位姿变换约束,基于光流传感器量测模型建立状态节点速度约束;构建不同的相邻节点状态约束得到更高的定位与构图精度。Difference 3: Patent 1 establishes the state node position constraints of the carrier based on the radar odometer measurement model, establishes the state node heading constraints based on the polarized light camera measurement model, and establishes the adjacent state node pose transformation constraints based on the inertial navigation system motion model; the present invention establishes the adjacent node pre-integration constraints of the tightly combined navigation system at the current moment based on the inertial navigation system pre-integration model, establishes the adjacent node heading constraints of the tightly combined navigation system based on the polarized light intensity sensor measurement model, establishes the adjacent node pose transformation constraints based on the radar odometer measurement model, and establishes the state node speed constraints based on the optical flow sensor measurement model; constructing different adjacent node state constraints can obtain higher positioning and composition accuracy.
在实际的导航应用中,通过从大气偏振模式中提取偏振信息,能够输出导航角度信息。且偏振成像技术能够获取目标辐射或反射的额外偏振多维信息,具有提高目标检测精度和识别概率的能力。光流是一种基于图像的方法,通过获取图像中像素点的位移来得到载体的移动速度。光流传感器与偏振传感器在导航中相辅相成,提高导航定位精度。In actual navigation applications, by extracting polarization information from the atmospheric polarization pattern, navigation angle information can be output. Polarization imaging technology can obtain additional polarization multi-dimensional information of target radiation or reflection, and has the ability to improve target detection accuracy and recognition probability. Optical flow is an image-based method that obtains the moving speed of the carrier by obtaining the displacement of pixels in the image. Optical flow sensors and polarization sensors complement each other in navigation to improve navigation positioning accuracy.
发明内容Summary of the invention
本发明解决的技术问题:克服现有技术的不足,提供一种基于因子图的惯性/偏振/雷达/光流紧组合导航的方法,将偏振光信息与惯性导航系统信息、雷达里程计紧组合并引入光流信息,实现惯性导航系统信息、雷达里程计信息、偏振光角度信息和光流速度信息在导航中的优势互补,使用图优化方法应用到多传感器组合导航系统中以解决多传感器组合导航系统中存在的鲁棒性差、导航精度不理想、自身位置确定困难的问题。The technical problem solved by the present invention is as follows: the deficiencies of the prior art are overcome, and a method for inertial/polarization/radar/optical flow tightly integrated navigation based on a factor graph is provided, polarization light information is tightly combined with inertial navigation system information and radar odometer, and optical flow information is introduced, so as to realize the complementary advantages of inertial navigation system information, radar odometer information, polarization light angle information and optical flow speed information in navigation, and a graph optimization method is applied to a multi-sensor integrated navigation system to solve the problems of poor robustness, unsatisfactory navigation accuracy and difficulty in determining the own position in the multi-sensor integrated navigation system.
本发明要解决的技术方案:基于因子图的惯性/偏振/雷达/光流紧组合导航的方法,包括以下步骤:The technical solution to be solved by the present invention is: a method for inertial/polarization/radar/optical flow tight integrated navigation based on factor graph, comprising the following steps:
步骤1:选取世界坐标系下载体姿态、位置、速度作为惯性导航系统、偏振光强传感器、雷达里程计和光流传感器组成的k时刻惯性/偏振/雷达/光流紧组合导航系统状态,分别建立惯性导航系统预积分模型、建立偏振光强量测模型、建立雷达里程计量测模型;选取光流传感器测量的速度信息作为测量值建立光流传感器量测模型;Step 1: Select the posture, position and speed of the carrier in the world coordinate system as the state of the inertial/polarization/radar/optical flow tightly integrated navigation system composed of the inertial navigation system, polarization light intensity sensor, radar odometer and optical flow sensor at time k, and establish the inertial navigation system pre-integration model, polarization light intensity measurement model and radar odometer measurement model respectively; select the speed information measured by the optical flow sensor as the measurement value to establish the optical flow sensor measurement model;
步骤2:对惯性导航系统、偏振光强传感器、雷达里程计和光流传感器组成的惯性/偏振/雷达/光流紧组合导航系统初始化,获取所述紧组合导航系统初始状态、地图和雷达点云参考值;Step 2: Initialize the inertial/polarization/radar/optical flow tightly integrated navigation system composed of the inertial navigation system, polarization light intensity sensor, radar odometer and optical flow sensor, and obtain the initial state of the tightly integrated navigation system, map and radar point cloud reference value;
步骤3:基于惯性导航系统预积分模型建立当前时刻组合导航系统相邻状态节点预积分约束,基于偏振光强传感器量测模型建立当前时刻组合导航系统相邻状态节点航向约束,基于雷达里程计量测模型建立与雷达点云参考值当前时刻组合导航系统相邻状态节点位姿变换约束,基于光流传感器量测模型建立当前时刻组合导航系统状态节点速度约束,根据当前时刻组合导航系统相邻状态节点预积分约束、组合导航系统相邻状态节点航向约束、组合导航系统相邻状态节点位姿变换约束和组合导航系统状态节点速度约束,设计以惯性/偏振/雷达/光流紧组合导航系统状态为状态变量节点与传感器量测为因子节点的误差函数,获得待优化因子图误差函数;Step 3: Establish pre-integration constraints of adjacent state nodes of the integrated navigation system at the current moment based on the inertial navigation system pre-integration model, establish heading constraints of adjacent state nodes of the integrated navigation system at the current moment based on the polarization light intensity sensor measurement model, establish pose transformation constraints of adjacent state nodes of the integrated navigation system at the current moment with the radar point cloud reference value based on the radar odometer measurement model, establish speed constraints of state nodes of the integrated navigation system at the current moment based on the optical flow sensor measurement model, and design an error function with the inertial/polarization/radar/optical flow tight integrated navigation system state as the state variable node and the sensor measurement as the factor node according to the pre-integration constraints of adjacent state nodes of the integrated navigation system at the current moment, the heading constraints of adjacent state nodes of the integrated navigation system, the pose transformation constraints of adjacent state nodes of the integrated navigation system and the speed constraints of the state nodes of the integrated navigation system, and obtain the error function of the factor graph to be optimized;
步骤4:基于非线性求解器对因子图的误差函数进行优化,获得世界坐标系下误差函数最小的载体的姿态、位置和速度参数的最优估计值,对世界坐标系下误差函数最小的载体姿态、位置和速度的最优估计值和地图更新,同步实现载体的定位和构图。Step 4: Optimize the error function of the factor graph based on the nonlinear solver to obtain the optimal estimated values of the attitude, position and velocity parameters of the carrier with the smallest error function in the world coordinate system. Update the optimal estimated values and map of the attitude, position and velocity of the carrier with the smallest error function in the world coordinate system to simultaneously realize the positioning and composition of the carrier.
所述步骤1中,构建k时刻的紧组合导航系统的状态节点表示如下:In step 1, the state node of the tightly integrated navigation system at time k is constructed as follows:
其中:in:
xk为k时刻的紧组合导航系统的状态节点,表示载体姿态,载体姿态以欧拉角的形式表示,分别为滚转角、俯仰角和偏航角;表示k时刻载体坐标系到世界坐标系的旋转矩阵,SO(3)表示3维的特殊正交群x k is the state node of the tightly integrated navigation system at time k, Indicates the carrier posture, which is expressed in the form of Euler angles. They are roll angle, pitch angle and yaw angle respectively; represents the rotation matrix from the carrier coordinate system to the world coordinate system at time k, and SO(3) represents the 3D special orthogonal group
表示k时刻载体世界坐标系下的三维位置信息,分别表示k时刻载体世界坐标系下x,y,z三个轴方向的坐标值,T表示向量的转置; Represents the three-dimensional position information of the carrier in the world coordinate system at time k, They represent the coordinate values of the x, y, and z axes in the world coordinate system of the carrier at time k, respectively, and T represents the transpose of the vector;
表示k时刻载体世界坐标系下的三维速度,分别表示k时刻载体世界坐标系下指向x,y,z三个轴方向的速度; represents the three-dimensional velocity of the carrier in the world coordinate system at time k, They represent the velocities of the carrier pointing to the x, y, and z axes in the world coordinate system at time k respectively;
紧组合导航系统的惯性导航系统坐标系,偏振光强传感器坐标系,雷达里程计坐标系,光流传感器坐标系与载体坐标系之间存在的安装误差已进行标定与补偿,因而各传感器坐标系均与载体坐标系转换关系已知,因此在构建各传感器量测模型时无需再次加入额外的误差项;The installation errors between the inertial navigation system coordinate system, polarization light intensity sensor coordinate system, radar odometer coordinate system, optical flow sensor coordinate system and carrier coordinate system of the tightly integrated navigation system have been calibrated and compensated. Therefore, the conversion relationship between each sensor coordinate system and the carrier coordinate system is known. Therefore, there is no need to add additional error terms when constructing the measurement model of each sensor.
通过偏振、光流紧组合的形式,分别获得组合导航系统相邻状态节点的航向角和速度,在组合导航领域内是一次创新性的改进,利用偏振的强自主性使得导航系统的鲁棒性大大加强。Through the tight combination of polarization and optical flow, the heading angle and speed of adjacent state nodes of the integrated navigation system are obtained respectively. This is an innovative improvement in the field of integrated navigation. The strong autonomy of polarization is used to greatly enhance the robustness of the navigation system.
所述步骤1中,建立惯性导航系统预积分的量测模型实现如下:In step 1, the measurement model of the pre-integration of the inertial navigation system is established as follows:
选取惯性导航系统预积分测量信息作为测量值,惯性导航系统预积分的量测模型建立如下:The pre-integrated measurement information of the inertial navigation system is selected as the measurement value, and the pre-integrated measurement model of the inertial navigation system is established as follows:
zi,k+1=hi(xk,xk+1)+δvi,k+1 z i,k+1 =h i (x k ,x k+1 )+δv i,k+1
其中:in:
表示k+1时刻惯性导航系统预积分量测值,其为惯性导航系统对于位置、速度、旋转矩阵的预积分量测; represents the pre-integrated measurement value of the inertial navigation system at time k+1, Pre-integrated measurement of position, velocity, and rotation matrix for the inertial navigation system;
hi(xk,xk+1)为惯性导航系统预积分量测函数,xk,xk+1分别为k,k+1时刻内的紧组合导航系统的状态节点;h i (x k ,x k+1 ) is the pre-integrated measurement function of the inertial navigation system, x k ,x k+1 are the state nodes of the tightly integrated navigation system at time k, k+1 respectively;
分别表示[k,k+1]时刻载体世界坐标系下位置、速度、旋转矩阵的预积分量测函数;其中Rk,Rk+1分别表示k,k+1时刻载体坐标系到世界坐标系的旋转矩阵,pk+1,vk+1分别表示k+1时刻载体在世界坐标系下的位置和速度,pk,vk分别表示k时刻载体在世界坐标系下的位置和速度,g=[0 0 g]T表示世界坐标系下的重力加速度,Δtk=tk+1-tk,δvi,k+1表示惯性导航系统的位置、速度、旋转矩阵预积分量测误差;Respectively represent the pre-integrated measurement functions of the position, velocity, and rotation matrix of the carrier in the world coordinate system at time [k, k+1]; wherein R k , R k+1 represent the rotation matrix from the carrier coordinate system to the world coordinate system at time k, k+1 respectively, p k+1 , v k+1 represent the position and velocity of the carrier in the world coordinate system at time k+1 respectively, p k , v k represent the position and velocity of the carrier in the world coordinate system at time k respectively, g=[0 0 g] T represents the gravitational acceleration in the world coordinate system, Δt k =t k+1 -t k , δv i,k+1 represents the pre-integrated measurement errors of the position, velocity, and rotation matrices of the inertial navigation system;
所述步骤1中,建立偏振光强传感器量测模型实现如下:In step 1, the polarization light intensity sensor measurement model is established as follows:
选取偏振光强传感器量测的载体纵轴与太阳子午线的夹角作为量测值数据,即称为偏振光强传感器信息作为测量值,偏振光强传感器量测模型建立如下:The angle between the longitudinal axis of the carrier and the solar meridian measured by the polarization intensity sensor is selected as the measurement value data, which is called the polarization intensity sensor information as the measurement value. The polarization intensity sensor measurement model is established as follows:
zp,k+1=hp(xk,xk+1)+vp,k+1 z p,k+1 =h p (x k ,x k+1 )+v p,k+1
其中:in:
为偏振光强传感器量测的载体纵轴与太阳子午线的夹角作为量测值数据,即称为偏振光强传感器测量值;l1.k,l2.k和l1.k+1,l2.k+1分别为k,k+1时刻偏振光强传感器量测的对立通道光强比值; The angle between the longitudinal axis of the carrier and the solar meridian measured by the polarization light intensity sensor is taken as the measurement value data, which is called the polarization light intensity sensor measurement value; l 1.k , l 2.k and l 1.k+1 , l 2.k+1 are the light intensity ratios of the opposite channels measured by the polarization light intensity sensor at time k and k+1 respectively;
为载体在k时刻偏振角,太阳方位角αs通过查表计算,所述太阳方位角其中为太阳高度角,为太阳赤纬,为观测点的纬度,为太阳时角,当时,β=1,当时,β=-1;vp,k+1表示偏振光强传感器量测的高斯噪声; is the polarization angle of the carrier at time k, and the solar azimuth angle αs is calculated by looking up the table. in is the solar altitude angle, is the solar declination, is the latitude of the observation point, is the solar hour angle, when When β=1, When , β = -1; v p,k+1 represents the Gaussian noise measured by the polarization light intensity sensor;
所述步骤1中,建立雷达里程计的量测模型实现如下:In step 1, the measurement model of the radar odometer is established as follows:
选取雷达里程计获取的相邻时刻特征点云对应关系作为测量值,通过基于曲率的特征提取方法获得[k,k+1]时刻内雷达特征点云集特征点集中包含边缘特征点集合Ek+1,平面特征点集合Hk+1,点云集合为在与k时刻的投影,包含边缘特征点集合平面特征点集合将于k时刻参考特征点云集进行匹配,则雷达里程计的量测模型建立如下:The corresponding relationship of feature point clouds at adjacent moments obtained by the radar odometer is selected as the measurement value, and the radar feature point cloud set at time [k, k+1] is obtained by the curvature-based feature extraction method. Feature point set It contains the edge feature point set E k+1 , the plane feature point set H k+1 , and the point cloud set for The projection at time k contains a set of edge feature points Plane feature point set Will Reference feature point cloud at time k For matching, the measurement model of the radar odometer is established as follows:
其中:in:
匀速运动模型下,有 Under the uniform motion model, we have
为激光点云数据在[k,k+1]时刻的位姿变换矩阵分别为雷达坐标系下[k,k+1]时刻之间的滚转角、俯仰角和偏航角,分别为雷达坐标系下[k,k+1]时刻之间三个轴方向的相对位移,tk,tk+1分别为k,k+1时刻对应在时间轴上的时间,as为[k,k+1]之间的某一时刻,s∈N*,为as时刻对应在时间轴上的时间,为[k,as]之间的位姿变换矩阵; is the pose transformation matrix of the laser point cloud data at time [k, k+1] are the roll angle, pitch angle and yaw angle between the moments [k, k+1] in the radar coordinate system, are the relative displacements in the three axes between the moments [k, k+1] in the radar coordinate system, t k , t k+1 are the times on the time axis corresponding to the moments k, k+1, respectively, a s is a moment between [k, k+1], s∈N * , is the time corresponding to the moment a s on the time axis, is the pose transformation matrix between [k,a s ];
为特征点集中的特征点的坐标,表示as时刻集合中的特征点n,是雷达里程计已知的量测点,为点云集合中的特征点的坐标,为[as,k]之间的旋转矩阵; is the feature point set The coordinates of the feature points in represents the feature point n in the set at time a s , which is the known measurement point of the radar odometer. Point cloud collection The coordinates of the feature points in is the rotation matrix between [a s ,k];
为k时刻的参考特征点云集是k时刻已知的参考值,表示中边缘特征点和平面特征点与中参考点的特征距离; is the reference feature point cloud at time k is the known reference value at time k, express The edge feature points and plane feature points are The characteristic distance of the reference point in the
所述步骤1中,建立光流传感器的量测模型实现如下:In step 1, the measurement model of the optical flow sensor is established as follows:
选取光流传感器测量的速度信息作为测量值,光流传感器的量测模型建立如下:The speed information measured by the optical flow sensor is selected as the measurement value, and the measurement model of the optical flow sensor is established as follows:
zo,k=ho(xk)+vo,k z o,k =h o (x k )+v o,k
其中:in:
表示k时刻光流传感器量测值,其为光流传感器量测的指向x,y,z三个轴方向的速度; represents the optical flow sensor measurement value at time k, The speed in the directions of x, y, and z axes measured by the optical flow sensor;
ho(xk)为光流传感器量测函数,xk为k时刻的紧组合导航系统的状态节点,分别表示k时刻载体在世界坐标系下指向x,y,z三个轴方向的速度;vo,k表示光流传感器量测的高斯噪声;h o (x k ) is the measurement function of the optical flow sensor, x k is the state node of the tightly integrated navigation system at time k, They represent the velocity of the carrier pointing to the x, y, and z axes in the world coordinate system at time k; v o,k represents the Gaussian noise measured by the optical flow sensor;
采用惯性导航系统的预积分形式,获取紧组合导航系统相邻状态节点的位置、速度、旋转矩阵预积分量测,将惯性导航系统的数据进行紧组合融合,采用偏振光强传感器,获取紧组合导航系统相邻状态节点的载体纵轴与太阳子午线的夹角量测,创新性的将偏振光强传感器量测以紧组合的形式加入紧组合导航系统;采用雷达里程计获取的相邻时刻特征点云对应关系,获取紧组合导航系统相邻状态节点的载体姿态、位置量测,创新性的使用特征提取的方式将雷达点云数据加入紧组合导航系统;采用光流传感器,获取紧组合导航系统当前状态节点的载体速度量测,创新性的将光流传感器速度量测加入偏振紧组合导航系统;通过构建新型惯性/偏振/雷达/光流紧组合导航方法,提高组合导航系统自主性、鲁棒性、准确性,并且增强了偏振在遮挡环境下的导航效果。The pre-integration form of the inertial navigation system is adopted to obtain the pre-integration measurement of the position, speed and rotation matrix of the adjacent state nodes of the tightly combined navigation system, and the data of the inertial navigation system are tightly combined and fused. The polarization light intensity sensor is adopted to obtain the angle measurement between the longitudinal axis of the carrier and the solar meridian of the adjacent state nodes of the tightly combined navigation system, and the polarization light intensity sensor measurement is innovatively added to the tightly combined navigation system in the form of tight combination; the corresponding relationship of the feature point cloud at adjacent moments obtained by the radar odometer is adopted to obtain the carrier attitude and position measurement of the adjacent state nodes of the tightly combined navigation system, and the radar point cloud data is innovatively added to the tightly combined navigation system by using the feature extraction method; the optical flow sensor is adopted to obtain the carrier speed measurement of the current state node of the tightly combined navigation system, and the optical flow sensor speed measurement is innovatively added to the polarization tightly combined navigation system; by constructing a new inertial/polarization/radar/optical flow tightly combined navigation method, the autonomy, robustness and accuracy of the combined navigation system are improved, and the navigation effect of polarization in an obstructed environment is enhanced.
所述步骤2中,紧组合导航系统初始化是根据载体坐标系到世界坐标系的旋转矩阵将载体坐标系下的雷达扫描点云转换到全局坐标系下,并建立以起始位置为原点的全局地图,从而实现对本发明设计的新型紧组合导航系统状态方程进行初始化。In step 2, the compact integrated navigation system is initialized according to the rotation matrix from the carrier coordinate system to the world coordinate system The radar scanning point cloud in the carrier coordinate system is converted to the global coordinate system, and a global map with the starting position as the origin is established, thereby initializing the state equation of the new tightly integrated navigation system designed by the present invention.
所述步骤3中,获得组合导航系统相邻状态节点预积分约束的步骤如下:对当前时刻和上一时刻之间所有的惯性导航系统量测数据通过惯性导航系统运动模型进行积分,得到惯性导航系统的预积分量测,并且利用积分得到载体的姿态、速度、位置数据建立载体相邻状态节点惯性导航系统预积分约束;In step 3, the steps of obtaining the pre-integration constraints of the adjacent state nodes of the integrated navigation system are as follows: integrating all the inertial navigation system measurement data between the current moment and the previous moment through the inertial navigation system motion model to obtain the pre-integration measurement of the inertial navigation system, and using the attitude, speed, and position data of the carrier obtained by the integration to establish the pre-integration constraints of the inertial navigation system of the adjacent state nodes of the carrier;
所述步骤3中,组合导航系统相邻状态节点航向约束的步骤如下:寻找当前时刻和上一时刻的偏振光强传感器量测数据,通过偏振光强传感器量测模型和偏振光强传感器量测数据建立载体相邻状态节点航向约束;In step 3, the steps of the adjacent state node heading constraint of the integrated navigation system are as follows: finding the polarization light intensity sensor measurement data at the current moment and the previous moment, and establishing the carrier adjacent state node heading constraint through the polarization light intensity sensor measurement model and the polarization light intensity sensor measurement data;
所述步骤3中,组合导航系统相邻状态节点位姿变换约束的步骤如下:根据当前时刻和上一时刻之间所有的雷达里程计量测数据,将雷达里程计量测数据中的点云匹配全局地图中;将当前时刻的里程计量测数据与上一时刻的参考数据进行特征匹配,利用雷达里程计量测模型和雷达里程计量测数据建立载体相邻状态节点位姿变换约束;In step 3, the steps of constraining the pose transformation of adjacent state nodes of the integrated navigation system are as follows: matching the point cloud in the radar odometer measurement data to the global map according to all radar odometer measurement data between the current moment and the previous moment; performing feature matching on the odometer measurement data at the current moment and the reference data at the previous moment, and establishing the pose transformation constraints of the adjacent state nodes of the carrier using the radar odometer measurement model and the radar odometer measurement data;
所述步骤3中,当前时刻组合导航系统状态节点速度约束的步骤如下:获取当前时刻时间戳和光流传感器量测数据,通过光流传感器量测模型和光流传感器量测数据建立当前时刻载体状态节点速度约束。In step 3, the steps of constraining the speed of the node of the state of the combined navigation system at the current moment are as follows: obtaining the current time stamp and the optical flow sensor measurement data, and establishing the current time carrier state node speed constraint through the optical flow sensor measurement model and the optical flow sensor measurement data.
所述步骤4中,世界坐标系下误差函数最小的载体的姿态、位置和速度参数的最优估计值的具体步骤如下:In step 4, the specific steps of obtaining the optimal estimated values of the attitude, position and velocity parameters of the carrier with the smallest error function in the world coordinate system are as follows:
步骤(5a):构建载体(k-m+1)~k+1时刻m为正整数的状态节点误差函数:Step (5a): Construct the state node error function of carrier (k-m+1)~k+1 time m is a positive integer:
步骤(5b):根据相邻状态节点运动状态约束,建立惯性导航系统预积分量测的误差函数为:Step (5b): According to the motion state constraints of adjacent state nodes, the error function of the pre-integration measurement of the inertial navigation system is established as:
其中ei,k+1为惯性导航系统预积分量测误差,∑i,k+1为惯性导航系统预积分节点协方差矩阵;Where e i,k+1 is the pre-integrated measurement error of the inertial navigation system, ∑ i,k+1 is the pre-integrated node covariance matrix of the inertial navigation system;
步骤(5c):根据相邻状态节点航向约束,建立偏振光强传感器量测的误差函数为:Step (5c): According to the heading constraints of the adjacent state nodes, the error function of the polarization intensity sensor measurement is established as:
其中ep,k+1为偏振光强传感器量测误差,∑p,k+1为偏振光强传感器节点协方差矩阵;Where e p,k+1 is the measurement error of the polarization light intensity sensor, ∑ p,k+1 is the node covariance matrix of the polarization light intensity sensor;
步骤(5d):根据相邻状态节点特征点云匹配约束,建立雷达里程计量测的优化函数为:Step (5d): According to the matching constraints of the feature point cloud of adjacent state nodes, the optimization function of radar odometer measurement is established as:
其中el,k+1为雷达里程计的特征距离;Where e l,k+1 is the characteristic distance of the radar odometer;
步骤(5e):根据状态节点速度约束,建立光流传感器量测的误差函数为:Step (5e): According to the state node velocity constraint, the error function of the optical flow sensor measurement is established as:
其中eo,k+1为光流传感器量测误差,∑o,k+1为光流传感器节点协方差矩阵;Where e o,k+1 is the measurement error of the optical flow sensor, ∑ o,k+1 is the covariance matrix of the optical flow sensor node;
步骤(5f):根据步骤(5e)的误差函数,建立因子图优化函数,表示如下:Step (5f): Based on the error function of step (5e), a factor graph optimization function is established, which is expressed as follows:
其中X=[xk-m+1…xk+1]T,为X的最优估计;Where X=[x k-m+1 …x k+1 ] T , is the optimal estimate of X;
步骤(5g):使用高斯-牛顿法对因子图优化函数进行求解,获得误差函数最小的世界坐标系下载体姿态、位置、速度的最优估计值;Step (5g): Use the Gauss-Newton method to solve the factor graph optimization function to obtain the optimal estimated values of the body's attitude, position, and velocity in the world coordinate system with the minimum error function;
对所述误差函数最小的世界坐标系下载体姿态、位置、速度的最优估计值更新是对的状态节点的更新,并将对应的更新后的雷达里程计的点云匹配到全局地图中,再对全局地图进行更新,将全局地图中重复的雷达里程计点云去除,当前时刻更新完成的最优估计值和全局地图分别作为下一时刻的初始值和雷达点云参考值继续进行因子图优化。The optimal estimate of the body's attitude, position, and speed in the world coordinate system with the smallest error function is updated by updating the state node, and the corresponding updated radar odometer point cloud is matched to the global map, and then the global map is updated, and the repeated radar odometer point clouds in the global map are removed. The optimal estimate value updated at the current moment and the global map are used as the initial value and radar point cloud reference value at the next moment to continue factor graph optimization.
本发明的有益效果:Beneficial effects of the present invention:
(1)本发明一种基于因子图的惯性/偏振/雷达/光流紧组合的导航方法对如何确定自身位置及感知外界环境的问题,多传感器组合导航系统旨在通过系统模型,结合相应的滤波方法或优化方法完成导航定位与周围地图的绘制,本发明建立了惯性导航系统预积分模型和偏振光强量测模型、雷达里程计量测模型、光流传感器的量测模型,并且通过紧组合因子图优化算法实现载体当前位置的确定和周围地图的构建,将偏振方位角信息与光流速度信息融合,弥补了偏振传感器易受大气环境影响,只能输出角度信息、光流传感器在低照度条件下数据精确度下降的不足之处。有效的利用了偏振信息、光流信息、惯导信息和雷达里程计信息及多源信息的融合匹配互补、不易受其他外界干扰的特性,因子图优化充分考虑量测和状态的历史信息的特点,通过滑动窗口的方式对状态的历史信息进行利用,在保证精度的同时,降低了计算量。能够有效地实现导航传感器的即插即用,解决多传感器观测数据异步问题。(1) The present invention is a navigation method based on the tight combination of inertial/polarization/radar/optical flow of factor graph. The multi-sensor combined navigation system aims to complete the navigation positioning and the drawing of the surrounding map through the system model, combined with the corresponding filtering method or optimization method. The present invention establishes the pre-integration model of the inertial navigation system and the polarization light intensity measurement model, the radar odometer measurement model, and the measurement model of the optical flow sensor, and realizes the determination of the current position of the carrier and the construction of the surrounding map through the tight combination factor graph optimization algorithm, and fuses the polarization azimuth information with the optical flow velocity information, which makes up for the shortcomings of the polarization sensor being easily affected by the atmospheric environment and can only output angle information, and the optical flow sensor data accuracy decreases under low illumination conditions. The characteristics of the fusion matching complementarity of polarization information, optical flow information, inertial navigation information, radar odometer information and multi-source information and not being easily affected by other external interference are effectively utilized. The factor graph optimization fully considers the characteristics of the historical information of measurement and state, and utilizes the historical information of the state through the sliding window method, while ensuring the accuracy, reducing the amount of calculation. It can effectively realize the plug-and-play of navigation sensors and solve the asynchronous problem of multi-sensor observation data.
(2)本发明使用了偏振光流导航机制是一种非常有效的导航手段,具有鲁棒性强、精准度高、隐蔽性好等特点,能够为复杂环境下的导航任务提供新的解决途径。引入偏振方位角信息和光流速度信息,使用图优化方法在多传感器组合导航上可以提高自身位置的和构建周围地图的精确度,提升了系统抗干扰性、准确性以及自主性。(2) The polarized optical flow navigation mechanism used in the present invention is a very effective navigation method with the characteristics of strong robustness, high accuracy, good concealment, etc., and can provide a new solution for navigation tasks in complex environments. The introduction of polarization azimuth information and optical flow velocity information, and the use of graph optimization methods in multi-sensor combined navigation can improve the accuracy of its own position and the construction of surrounding maps, and enhance the system's anti-interference, accuracy and autonomy.
(3)本发明基于惯性、偏振、雷达和光流多传感器融合,信息互补,具有鲁棒性强、精度高、适用范围广等特征;传感器紧组合可实现导航精度高、抗干扰性强等功能;图优化量测和状态的历史信息特点使得环境适应性好且定位与构图精度高。(3) The present invention is based on the fusion of inertial, polarization, radar and optical flow sensors, with complementary information, and has the characteristics of strong robustness, high precision and wide application range; the tight combination of sensors can achieve functions such as high navigation accuracy and strong anti-interference; the historical information characteristics of the map optimization measurement and status make it have good environmental adaptability and high positioning and composition accuracy.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为本发明基于图优化的惯性/偏振/雷达/光流紧组合导航方法流程图;FIG1 is a flow chart of an inertial/polarization/radar/optical flow tightly integrated navigation method based on graph optimization of the present invention;
图2是本发明因子图的结构图。FIG. 2 is a structural diagram of a factor graph of the present invention.
具体实施方式DETAILED DESCRIPTION
下面结合附图详细说明本发明,其作为本说明书的一部分,通过实施来说明本发明的原理,本发明的其他方面、特征及其优点通过该详细说明将会变得一目了然。The present invention will be described in detail below in conjunction with the accompanying drawings, which serve as a part of this specification and illustrate the principles of the present invention through implementation. Other aspects, features and advantages of the present invention will become apparent from the detailed description.
本发明一种基于图优化的惯性/偏振/雷达/光流紧组合导航方法,选择世界坐标系下载体的姿态、位置、速度为惯性/偏振/雷达/光流紧组合导航系统状态向量,建立惯性导航系统预积分/偏振光强传感器/雷达里程计/光流传感器紧组合导航系统状态方程;基于惯性导航系统基本的加速度、角速度信息,建立基于惯性导航系统预积分模型,构建惯性导航系统预积分模型节点;基于偏振光强传感器输出偏振光强信息,建立偏振量测方程,构建偏振光强传感器节点;基于雷达里程计输出的点云特征信息,建立雷达里程计量测方程,构建雷达里程计节点;基于光流传感器输出速度信息,建立光流量测方程,构建光流传感器节点,使用因子图优化算法实现位姿确定和周围环境地图构建。The invention discloses an inertial/polarization/radar/optical flow tightly combined navigation method based on graph optimization. The method comprises the following steps: selecting the posture, position and speed of a carrier in a world coordinate system as the state vector of an inertial/polarization/radar/optical flow tightly combined navigation system, establishing a state equation of an inertial navigation system pre-integration/polarization light intensity sensor/radar odometer/optical flow sensor tightly combined navigation system; establishing a pre-integration model based on an inertial navigation system based on basic acceleration and angular velocity information of the inertial navigation system, and constructing a pre-integration model node of the inertial navigation system; establishing a polarization measurement equation based on polarization light intensity information output by a polarization light intensity sensor, and constructing a polarization light intensity sensor node; establishing a radar odometer measurement equation based on point cloud feature information output by a radar odometer, and constructing a radar odometer node; establishing an optical flow measurement equation based on speed information output by an optical flow sensor, and constructing an optical flow sensor node, and using a factor graph optimization algorithm to realize posture determination and surrounding environment map construction.
如图1所示,本发明的一种基于图优化的惯性/偏振/雷达/光流紧组合导航方法,具体实施的技术方案包括以下步骤:As shown in FIG1 , the present invention is a graph-optimized inertial/polarization/radar/optical flow tightly integrated navigation method, and the specific implementation of the technical solution includes the following steps:
步骤1:选取世界坐标系下载体姿态、位置、速度作为惯性/偏振/雷达/光流紧组合导航系统状态;分别建立惯性导航系统预积分模型、建立偏振光强量测模型、建立雷达里程计量测模型、建立光流传感器量测模型;Step 1: Select the carrier's attitude, position, and velocity in the world coordinate system as the state of the inertial/polarization/radar/optical flow tightly integrated navigation system; establish an inertial navigation system pre-integration model, a polarization light intensity measurement model, a radar odometer measurement model, and an optical flow sensor measurement model respectively;
步骤2:针对惯性导航系统、偏振光强传感器、雷达里程计、光流传感器、组成的惯性/偏振/雷达/光流紧组合导航系统初始化,获取初始组合导航系统状态,地图和雷达点云参考值;Step 2: Initialize the inertial/polarization/radar/optical flow integrated navigation system composed of the inertial navigation system, polarization light intensity sensor, radar odometer, and optical flow sensor, and obtain the initial integrated navigation system state, map, and radar point cloud reference values;
步骤3:分别基于惯性导航系统预积分模型建立当前时刻组合导航系统相邻节点预积分约束,基于偏振光强传感器量测模型建立组合导航系统相邻节点航向约束,基于雷达里程计量测模型建立相邻节点位姿变换约束,基于光流传感器量测模型建立状态节点速度约束;根据当前时刻载体相邻状态节点预积分约束、载体相邻状态节点航向约束、载体相邻状态节点位姿变换约束和载体状态节点速度约束设计惯性/偏振/雷达/光流紧组合导航系统状态为状态变量节点与传感器量测为因子节点的误差函数,获得待优化因子图;Step 3: Establish the pre-integration constraints of the adjacent nodes of the integrated navigation system at the current moment based on the pre-integration model of the inertial navigation system, establish the heading constraints of the adjacent nodes of the integrated navigation system based on the measurement model of the polarization light intensity sensor, establish the posture transformation constraints of the adjacent nodes based on the radar odometer measurement model, and establish the speed constraints of the state nodes based on the optical flow sensor measurement model; design the error function of the inertial/polarization/radar/optical flow tight integrated navigation system state as the state variable node and the sensor measurement as the factor node according to the pre-integration constraints of the adjacent state nodes of the carrier at the current moment, the heading constraints of the adjacent state nodes of the carrier, the posture transformation constraints of the adjacent state nodes of the carrier, and the speed constraints of the carrier state nodes, and obtain the factor graph to be optimized;
步骤4:基于非线性求解器对因子图的误差函数进行优化,获得世界坐标系下误差函数最小的载体的姿态、位置和速度等参数的最优估计值;对误差函数最小的世界坐标系下载体姿态、位置和速度的最优估计值和地图更新,同步实现载体的定位和构图;Step 4: Optimize the error function of the factor graph based on the nonlinear solver to obtain the optimal estimated values of the parameters such as the attitude, position and speed of the carrier with the minimum error function in the world coordinate system; update the optimal estimated values and map of the attitude, position and speed of the carrier in the world coordinate system with the minimum error function, and synchronously realize the positioning and composition of the carrier;
步骤5:判断是否有新最优估计值和地图数据输入,当有新最优估计值和地图数据输入,则执行步骤6;当没有新最优估计值和地图数据输入,则执行步骤7;Step 5: Determine whether there is a new optimal estimate and map data input, if there is a new optimal estimate and map data input, execute step 6; if there is no new optimal estimate and map data input, execute step 7;
步骤6:新最优估计值和地图数据输入执行步骤4;Step 6: Enter the new optimal estimate and map data and execute step 4;
步骤7:没有新最优估计值和地图数据输入结束。Step 7: No new best estimate and map data input ends.
优选实施例,本发明通过步骤1所述的紧组合导航系统状态构建k时刻的紧组合导航系统的状态节点的具体步骤如下:In a preferred embodiment, the present invention uses the state of the tightly integrated navigation system described in step 1 to construct the state node of the tightly integrated navigation system at time k, and the specific steps are as follows:
(1)、选取载体姿态、位置、速度作为紧组合导航系统状态构建状态节点;(1) Select the carrier attitude, position, and speed as the state node for building the tightly integrated navigation system state;
(2)、以起始位置为原点的世界坐标系(world系),即w系,以地理正北方向为世界坐标系的x轴的正方向,以正西方向为世界坐标系的y轴的正方向,根据右手准则确定世界坐标系的z轴正方向;(2) The world coordinate system (world system) with the starting position as the origin, that is, the w system, with the geographic north direction as the positive direction of the x-axis of the world coordinate system, and the west direction as the positive direction of the y-axis of the world coordinate system. The positive direction of the z-axis of the world coordinate system is determined according to the right-hand rule;
(3)、建立以载体中心为原点的载体坐标系,即b系,以平行于载体纵轴指向机头方向为载体坐标系x轴的正方向,以平行于载体横轴指向左方为载体坐标系y轴的正方向,根据右手准则确定载体坐标系z轴正方向;(3) Establish a carrier coordinate system with the center of the carrier as the origin, i.e., the b system. The positive direction of the x-axis of the carrier coordinate system is parallel to the longitudinal axis of the carrier and points to the direction of the machine head. The positive direction of the y-axis of the carrier coordinate system is parallel to the horizontal axis of the carrier and points to the left. The positive direction of the z-axis of the carrier coordinate system is determined according to the right-hand rule.
(4)、选取世界坐标系下的姿态、位置、速度作为紧组合导航系统状态,则构建k时刻紧组合导航系统状态如下:(4) Select the attitude, position and speed in the world coordinate system as the state of the tightly integrated navigation system, and then construct the state of the tightly integrated navigation system at time k as follows:
其中:in:
xk为k时刻的紧组合导航系统的状态节点,表示载体姿态,载体姿态以欧拉角的形式表示,分别为滚转角、俯仰角和偏航角;表示k时刻载体坐标系到世界坐标系的旋转矩阵,SO(3)表示3维的特殊正交群x k is the state node of the tightly integrated navigation system at time k, Indicates the carrier posture, which is expressed in the form of Euler angles. They are roll angle, pitch angle and yaw angle respectively; represents the rotation matrix from the carrier coordinate system to the world coordinate system at time k, and SO(3) represents the 3D special orthogonal group
表示k时刻载体世界坐标系下的三维位置信息,分别表示k时刻载体世界坐标系下x,y,z三个轴方向的坐标值,T表示向量的转置; Represents the three-dimensional position information of the carrier in the world coordinate system at time k, They represent the coordinate values of the x, y, and z axes in the world coordinate system of the carrier at time k, respectively, and T represents the transpose of the vector;
表示k时刻载体世界坐标系下的三维速度,分别表示k时刻载体世界坐标系下指向x,y,z三个轴方向的速度; represents the three-dimensional velocity of the carrier in the world coordinate system at time k, They represent the velocities of the carrier pointing to the x, y, and z axes in the world coordinate system at time k respectively;
紧组合导航系统的惯性导航系统坐标系,偏振光强传感器坐标系,雷达里程计坐标系,光流传感器坐标系与载体坐标系之间存在的安装误差已进行标定与补偿,因而各传感器坐标系均与载体坐标系假定重合。The installation errors between the inertial navigation system coordinate system, polarization light intensity sensor coordinate system, radar odometer coordinate system, optical flow sensor coordinate system and the carrier coordinate system of the tightly integrated navigation system have been calibrated and compensated, so the coordinate systems of each sensor are assumed to coincide with the carrier coordinate system.
优选实施例,本发明选取所述惯性导航系统预积分测量信息作为测量值,建立步骤1所述惯性导航系统预积分的量测模型如下:In a preferred embodiment, the present invention selects the pre-integrated measurement information of the inertial navigation system as the measurement value, and establishes the measurement model of the pre-integrated measurement of the inertial navigation system in step 1 as follows:
zi,k+1=hi(xk,xk+1)+δvi,k+1 z i,k+1 =h i (x k ,x k+1 )+δv i,k+1
其中:in:
表示k+1时刻惯性导航系统预积分量测值,其为惯性导航系统对于位置、速度、旋转矩阵的预积分量测; represents the pre-integrated measurement value of the inertial navigation system at time k+1, Pre-integrated measurement of position, velocity, and rotation matrix for the inertial navigation system;
hi(xk,xk+1)为惯性导航系统预积分量测函数,xk,xk+1分别为k,k+1时刻内的紧组合导航系统的状态节点;h i (x k ,x k+1 ) is the pre-integrated measurement function of the inertial navigation system, x k ,x k+1 are the state nodes of the tightly integrated navigation system at time k and k+1 respectively;
分别表示[k,k+1]时刻载体世界坐标系下位置、速度、旋转矩阵的预积分量测函数;其中Rk,Rk+1分别表示k,k+1时刻载体坐标系到世界坐标系的旋转矩阵,pk+1,vk+1分别表示k+1时刻载体在世界坐标系下的位置和速度,pk,vk分别表示k时刻载体在世界坐标系下的位置和速度,g=[0 0 g]T表示世界坐标系下的重力加速度,Δtk=tk+1-tk;Respectively represent the pre-integrated measurement functions of the position, velocity and rotation matrix of the carrier in the world coordinate system at time [k, k+1]; wherein R k , R k+1 represent the rotation matrix from the carrier coordinate system to the world coordinate system at time k, k+1 respectively, p k+1 , v k+1 represent the position and velocity of the carrier in the world coordinate system at time k+1 respectively, p k , v k represent the position and velocity of the carrier in the world coordinate system at time k respectively, g=[0 0 g] T represents the gravitational acceleration in the world coordinate system, Δt k =t k+1 -t k ;
δvi,k+1表示惯性导航系统的位置、速度、旋转矩阵预积分量测误差。δvi ,k+1 represents the pre-integrated measurement error of the position, velocity, and rotation matrix of the inertial navigation system.
优选实施例,建立步骤1所述偏振光强传感器量测模型如下:In a preferred embodiment, the polarized light intensity sensor measurement model described in step 1 is established as follows:
zp,k+1=hp(xk,xk+1)+vp,k+1 z p,k+1 =h p (x k ,x k+1 )+v p,k+1
其中:in:
为偏振光强传感器量测的载体纵轴与太阳子午线的夹角作为量测值数据,即称为偏振光强传感器测量值;l1.k,l2.k和l1.k+1,l2.k+1分别为k,k+1时刻偏振光强传感器量测的对立通道光强比值; The angle between the longitudinal axis of the carrier and the solar meridian measured by the polarization light intensity sensor is taken as the measurement value data, which is called the polarization light intensity sensor measurement value; l 1.k , l 2.k and l 1.k+1 , l 2.k+1 are the light intensity ratios of the opposite channels measured by the polarization light intensity sensor at time k and k+1 respectively;
为载体在k时刻偏振角,太阳方位角αs可以通过查表计算,所述太阳方位角其中为太阳高度角,为太阳赤纬,为观测点的纬度,为太阳时角,当时,β=1,当时,β=-1;vp,k+1表示偏振光相机量测的高斯噪声。 is the polarization angle of the carrier at time k, and the solar azimuth angle αs can be calculated by looking up the table. in is the solar altitude angle, is the solar declination, is the latitude of the observation point, is the solar hour angle, when When β=1, When , β = -1; v p,k+1 represents the Gaussian noise measured by the polarization camera.
优选实施例,本发明选取所述雷达里程计获取的相邻时刻特征点云对应关系作为测量值,通过基于曲率的特征提取方法获得[k,k+1]时刻内雷达特征点云集特征点集中包含边缘特征点集合Ek+1,平面特征点集合Hk+1。点云集合为在与k时刻的投影,包含边缘特征点集合平面特征点集合将于k时刻参考特征点云集进行匹配,建立步骤1所述雷达里程计的量测模型如下:In a preferred embodiment, the present invention selects the corresponding relationship of the feature point clouds at adjacent moments obtained by the radar odometer as the measurement value, and obtains the radar feature point cloud set at the moment [k, k+1] by a feature extraction method based on curvature. Feature point set Contains the edge feature point set E k+1 and the plane feature point set H k+1 . Point cloud set for The projection at time k contains a set of edge feature points Plane feature point set Will Reference feature point cloud at time k Matching is performed to establish the measurement model of the radar odometer described in step 1 as follows:
其中:in:
匀速运动模型下,有 Under the uniform motion model, we have
为激光点云数据在[k,k+1]时刻的位姿变换矩阵分别为雷达坐标系下[k,k+1]时刻之间的滚转角、俯仰角和偏航角,分别为雷达坐标系下[k,k+1]时刻之间三个轴方向的相对位移,tk,tk+1分别为k,k+1时刻对应在时间轴上的时间,as为[k,k+1]之间的某一时刻,s∈N*,为as时刻对应在时间轴上的时间。为[k,as]之间的位姿变换矩阵。 is the pose transformation matrix of the laser point cloud data at time [k, k+1] are the roll angle, pitch angle and yaw angle between the moments [k, k+1] in the radar coordinate system, are the relative displacements in the three axes between the moments [k, k+1] in the radar coordinate system, t k , t k+1 are the times on the time axis corresponding to the moments k, k+1, respectively, a s is a moment between [k, k+1], s∈N * , is the time on the timeline corresponding to moment a s . is the pose transformation matrix between [k,a s ].
为特征点集中的特征点的坐标,表示as时刻集合中的特征点n,是雷达里程计已知的量测点,为点云集合中的特征点的坐标,为[as,k]之间的旋转矩阵。 is the feature point set The coordinates of the feature points in represents the feature point n in the set at time a s , which is the known measurement point of the radar odometer. Point cloud collection The coordinates of the feature points in is the rotation matrix between [a s ,k].
为k时刻的参考特征点云集是k时刻已知的参考值,表示中边缘特征点和平面特征点与中参考点的特征距离。 is the reference feature point cloud at time k is the known reference value at time k, express The edge feature points and plane feature points are The characteristic distance of the reference point in .
优选实施例,选取所述光流传感器测量的速度信息作为测量值,建立步骤1所述光流传感器的量测模型如下:In a preferred embodiment, the speed information measured by the optical flow sensor is selected as the measurement value, and the measurement model of the optical flow sensor in step 1 is established as follows:
zo,k=ho(xk)+vo,k z o,k =h o (x k )+v o,k
其中:in:
表示k时刻光流传感器量测值,其为光流传感器量测的指向x,y,z三个轴方向的速度; represents the optical flow sensor measurement value at time k, The speed in the directions of x, y, and z axes measured by the optical flow sensor;
ho(xk)为光流传感器量测函数,xk为k时刻的紧组合导航系统的状态节点,分别表示k时刻载体世界坐标系下指向x,y,z三个轴方向的速度;vo,k表示光流传感器量测的高斯噪声。h o (x k ) is the measurement function of the optical flow sensor, x k is the state node of the tightly integrated navigation system at time k, They represent the velocities of the carrier in the x, y, and z directions in the world coordinate system at time k respectively; v o,k represents the Gaussian noise measured by the optical flow sensor.
优选实施例,本发明步骤2所述紧组合导航系统初始化是根据载体坐标系到世界坐标系的旋转矩阵,将载体坐标系下的雷达扫描点云转换到全局坐标系下,并建立以起始位置为原点的全局地图,从而实现对本发明设计的新型紧组合导航系统状态方程进行初始化。In a preferred embodiment, the initialization of the tightly integrated navigation system in step 2 of the present invention is to convert the radar scanning point cloud in the carrier coordinate system to the global coordinate system according to the rotation matrix from the carrier coordinate system to the world coordinate system, and establish a global map with the starting position as the origin, thereby initializing the state equation of the new tightly integrated navigation system designed by the present invention.
优选实施例,本发明获得步骤3所述当前时刻载体相邻状态节点预积分约束的步骤如下:对当前时刻和上一时刻之间所有的惯性导航量测数据通过惯性导航系统运动模型进行积分,得到惯性导航系统的预积分量测,并且利用积分得到载体的姿态、速度、位置数据建立载体相邻状态节点惯性导航系统预积分约束。In a preferred embodiment, the steps of obtaining the pre-integration constraints of the adjacent state nodes of the carrier at the current moment described in step 3 of the present invention are as follows: all inertial navigation measurement data between the current moment and the previous moment are integrated through the inertial navigation system motion model to obtain the pre-integration measurement of the inertial navigation system, and the attitude, speed, and position data of the carrier obtained by the integration are used to establish the pre-integration constraints of the inertial navigation system of the adjacent state nodes of the carrier.
优选实施例,本发明获得步骤3载体状态相邻状态节点航向约束的步骤如下:寻找当前时刻和上一时刻的偏振光强传感器量测数据,通过偏振光强传感器量测模型和偏振光强传感器量测数据建立载体相邻状态节点航向约束。In a preferred embodiment, the steps for obtaining the carrier state adjacent state node heading constraints in step 3 of the present invention are as follows: finding the polarization light intensity sensor measurement data at the current moment and the previous moment, and establishing the carrier adjacent state node heading constraints through the polarization light intensity sensor measurement model and the polarization light intensity sensor measurement data.
优选实施例,本发明获得步骤3所述载体相邻状态节点位姿变换约束的步骤如下:根据当前时刻和上一时刻之间所有的雷达里程计量测数据,将雷达里程计量测数据中的点云匹配全局地图中。将当前时刻的里程计量测数据与上一时刻的参考数据进行特征匹配,利用雷达里程计量测模型和雷达里程计量测数据建立载体相邻状态节点位姿变换约束。In a preferred embodiment, the steps of obtaining the pose transformation constraints of the adjacent state nodes of the carrier in step 3 are as follows: according to all the radar odometer measurement data between the current moment and the previous moment, the point cloud in the radar odometer measurement data is matched to the global map. The odometer measurement data at the current moment is feature matched with the reference data at the previous moment, and the pose transformation constraints of the adjacent state nodes of the carrier are established using the radar odometer measurement model and the radar odometer measurement data.
优选实施例,本发明获得步骤3所述当前时刻载体状态节点速度约束的步骤如下:获取当前时刻时间戳和光流传感器量测数据,通过光流传感器量测模型和光流传感器量测数据建立当前时刻载体状态节点速度约束。In a preferred embodiment, the steps of obtaining the node speed constraint of the carrier state at the current moment described in step 3 of the present invention are as follows: obtaining the current time stamp and the optical flow sensor measurement data, and establishing the node speed constraint of the carrier state at the current moment through the optical flow sensor measurement model and the optical flow sensor measurement data.
优选实施例,获得步骤4所述误差函数最小的世界坐标系下载体的姿态、位置和速度的最优估计值的具体步骤如下:In a preferred embodiment, the specific steps of obtaining the optimal estimated values of the posture, position and velocity of the object in the world coordinate system with the minimum error function in step 4 are as follows:
步骤(5a):构建载体(k-m+1)~k+1时刻m为正整数的状态节点误差函数:Step (5a): Construct the state node error function of carrier (k-m+1)~k+1 time m is a positive integer:
步骤(5b):根据相邻状态节点运动状态约束,建立惯性导航系统预积分量测的误差函数为:Step (5b): According to the motion state constraints of adjacent state nodes, the error function of the pre-integration measurement of the inertial navigation system is established as:
其中ei,k+1为惯性导航系统预积分量测误差,∑i,k+1为惯性导航系统预积分节点协方差矩阵;Where e i,k+1 is the pre-integrated measurement error of the inertial navigation system, ∑ i,k+1 is the pre-integrated node covariance matrix of the inertial navigation system;
步骤(5c):根据相邻状态节点航向约束,建立偏振光强传感器量测的误差函数为:Step (5c): According to the heading constraints of the adjacent state nodes, the error function of the polarization intensity sensor measurement is established as:
其中ep,k+1为偏振光强传感器量测误差,∑p,k+1为偏振光强传感器节点协方差矩阵;Where e p,k+1 is the measurement error of the polarization light intensity sensor, ∑ p,k+1 is the node covariance matrix of the polarization light intensity sensor;
步骤(5d):根据相邻状态节点特征点云匹配约束,建立雷达里程计量测的优化函数为:Step (5d): According to the matching constraints of the feature point cloud of adjacent state nodes, the optimization function of radar odometer measurement is established as:
其中el,k+1为雷达里程计的特征距离;Where e l,k+1 is the characteristic distance of the radar odometer;
步骤(5e):根据状态节点速度约束,建立光流传感器量测的误差函数为:Step (5e): According to the state node velocity constraint, the error function of the optical flow sensor measurement is established as:
其中eo,k+1为光流传感器量测误差,∑o,k+1为光流传感器节点协方差矩阵;Where e o,k+1 is the measurement error of the optical flow sensor, ∑ o,k+1 is the covariance matrix of the optical flow sensor node;
步骤(5f):建立因子图优化问题,表示如下:Step (5f): Establish the factor graph optimization problem, which is expressed as follows:
其中X=[xk-m+1…xk+1]T,为X的最优估计;Where X=[x k-m+1 …x k+1 ] T , is the optimal estimate of X;
步骤(5g):使用高斯-牛顿法对因子图优化问题进行求解,获得误差函数最小的世界坐标系下载体姿态、位置、速度的最优估计值;Step (5g): Use the Gauss-Newton method to solve the factor graph optimization problem and obtain the optimal estimated values of the body's attitude, position, and velocity in the world coordinate system with the minimum error function;
优选地,对所述误差函数最小的世界坐标系下载体姿态、位置、速度的最优估计值更新是对的状态节点的更新,并将对应的更新后的雷达里程计的点云匹配到全局地图中,再对全局地图进行更新,将全局地图中重复的雷达里程计点云去除。Preferably, the optimal estimate of the body's attitude, position, and velocity in the world coordinate system where the error function is minimized is updated by updating the state node, and the corresponding updated radar odometer point cloud is matched to the global map, and then the global map is updated to remove duplicate radar odometer point clouds in the global map.
如图2示出的本发明中因子图结构图,下面利用图2对本发明基于因子图的惯性/偏振/雷达/光流紧组合导航方法的因子图结构做进一步的描述:图中的光流表示光流传感器节点,惯性表示惯性导航系统节点,雷达表示雷达里程计节点,偏振表示光强传感器节点,Xk表示状态节点。As shown in Figure 2, the factor graph structure of the factor graph of the present invention is further described using Figure 2: the optical flow in the figure represents the optical flow sensor node, inertia represents the inertial navigation system node, radar represents the radar odometer node, polarization represents the light intensity sensor node, and Xk represents the state node.
第0个时刻的惯性导航系统节点与x0,x1通过惯性导航预积分0到1时刻之间的量测数据和惯性导航系统预积分量测模型,建立载体x0,x1状态节点之间的预积分约束,从而建立状态节点x0,x1与惯性导航系统预积分节点的连接关系;第0个时刻的偏振光强传感器节点与x0,x1通过偏振光强传感器0到1时刻之间的量测数据和偏振光强传感器量测模型,建立载体x0,x1状态节点之间的航向约束,从而建立状态节点x0,x1与偏振光强传感器节点的连接关系;第0个时刻的雷达里程计节点与x0,x1通过雷达里程计0到1时刻之间的量测数据和雷达里程计量测模型,建立载体x0,x1状态节点之间的位姿变换约束,从而建立状态节点x0,x1与雷达里程计节点的连接关系;第0个时刻的状态节点为x0,x0与第0个时刻的光流传感器节点通过光流传感器第0个时刻的量测数据和光流传感器量测模型、建立当前载体状态节点速度约束,从而建立状态节点x0与光流传感器节点的连接关系;The inertial navigation system node at the 0th moment establishes the pre-integration constraint between the state nodes of the carrier x 0 , x 1 through the measurement data between the inertial navigation pre-integration time 0 and 1 and the inertial navigation system pre-integration measurement model, thereby establishing the connection relationship between the state node x 0 , x 1 and the inertial navigation system pre-integration node; the polarization light intensity sensor node at the 0th moment establishes the heading constraint between the state nodes of the carrier x 0 , x 1 through the measurement data between the polarization light intensity sensor time 0 and 1 and the polarization light intensity sensor measurement model, thereby establishing the connection relationship between the state node x 0 , x 1 and the polarization light intensity sensor node; the radar odometer node at the 0th moment establishes the posture transformation constraint between the state nodes of the carrier x 0 , x 1 through the measurement data between the radar odometer time 0 and 1 and the radar odometer measurement model, thereby establishing the connection relationship between the state node x 0 , x 1 and the radar odometer node; the state node at the 0th moment is x 0 , x 0 and the optical flow sensor node at the 0th moment establish the connection relationship between the state node x 0 and the optical flow sensor node through the measurement data of the optical flow sensor at the 0th moment and the optical flow sensor measurement model, and establish the current carrier state node speed constraint;
第1个时刻的惯性导航系统节点与x1,x2通过惯性导航预积分1到2时刻之间的量测数据和惯性导航系统预积分量测模型,建立载体x1,x2状态节点之间的预积分约束,从而建立状态节点x1,x2与惯性导航系统预积分节点的连接关系;第1个时刻的偏振光强传感器节点与x1,x2通过偏振光强传感器1到2时刻之间的量测数据和偏振光强传感器量测模型,建立载体x1,x2状态节点之间的航向约束,从而建立状态节点x1,x2与偏振光强传感器节点的连接关系;第1个时刻的雷达里程计节点与x1,x2通过雷达里程计1到2时刻之间的量测数据和雷达里程计量测模型,建立载体x1,x2状态节点之间的位姿变换约束,从而建立状态节点x1,x2与雷达里程计节点的连接关系;第1个时刻的状态节点为x1,x1与第1个时刻的光流传感器节点通过光流传感器第1个时刻的量测数据和光流传感器量测模型、建立当前载体状态节点速度约束,从而建立状态节点x1与光流传感器节点的连接关系;At the first moment, the inertial navigation system node and x 1 , x 2 establish pre-integration constraints between the state nodes of the carriers x 1 , x 2 through the measurement data between the inertial navigation pre-integration 1 and 2 moments and the inertial navigation system pre-integration measurement model, thereby establishing a connection relationship between the state nodes x 1 , x 2 and the inertial navigation system pre-integration node; at the first moment, the polarization light intensity sensor node and x 1 , x 2 establish heading constraints between the state nodes of the carriers x 1 , x 2 through the measurement data between the polarization light intensity sensor 1 and 2 moments and the polarization light intensity sensor measurement model, thereby establishing a connection relationship between the state nodes x 1 , x 2 and the polarization light intensity sensor node; at the first moment, the radar odometer node and x 1 , x 2 establish posture transformation constraints between the state nodes of the carriers x 1 , x 2 through the measurement data between the radar odometer 1 and 2 moments and the radar odometer measurement model, thereby establishing a connection relationship between the state nodes x 1 , x 2 and the radar odometer node; the state node at the first moment is x 1 , x 1 and the optical flow sensor node at the first moment establish the connection relationship between the state node x 1 and the optical flow sensor node through the measurement data of the optical flow sensor at the first moment and the optical flow sensor measurement model, and establish the current carrier state node speed constraint;
第2个时刻的惯性导航系统节点与x2,x3通过惯性导航预积分2到3时刻之间的量测数据和惯性导航系统预积分量测模型,建立载体x2,x3状态节点之间的预积分约束,从而建立状态节点x2,x3与惯性导航系统预积分节点的连接关系;第2个时刻的偏振光强传感器节点与x2,x3通过偏振光强传感器2到3时刻之间的量测数据和偏振光强传感器量测模型,建立载体x2,x3状态节点之间的航向约束,从而建立状态节点x2,x3与偏振光强传感器节点的连接关系;第2个时刻的雷达里程计节点与x2,x3通过雷达里程计2到3时刻之间的量测数据和雷达里程计量测模型,建立载体x2,x3状态节点之间的位姿变换约束,从而建立状态节点x2,x3与雷达里程计节点的连接关系;第2个时刻的状态节点为x2,x2与第2个时刻的光流传感器节点通过光流传感器第2个时刻的量测数据和光流传感器量测模型、建立当前载体状态节点速度约束,从而建立状态节点x2与光流传感器节点的连接关系;At the second moment, the inertial navigation system node and x 2 , x 3 establish pre-integration constraints between the state nodes of the carrier x 2 , x 3 through the measurement data between the inertial navigation pre-integration time 2 and 3 and the inertial navigation system pre-integration measurement model, thereby establishing a connection relationship between the state nodes x 2 , x 3 and the inertial navigation system pre-integration node; at the second moment, the polarization light intensity sensor node and x 2 , x 3 establish heading constraints between the state nodes of the carrier x 2 , x 3 through the measurement data between the polarization light intensity sensor time 2 and 3 and the polarization light intensity sensor measurement model, thereby establishing a connection relationship between the state nodes x 2 , x 3 and the polarization light intensity sensor node; at the second moment, the radar odometer node and x 2 , x 3 establish posture transformation constraints between the state nodes of the carrier x 2 , x 3 through the measurement data between the radar odometer time 2 and 3 and the radar odometer measurement model, thereby establishing a connection relationship between the state nodes x 2 , x 3 and the radar odometer node; the state node at the second moment is x 2 , x 2 and the optical flow sensor node at the second moment establish the connection relationship between the state node x 2 and the optical flow sensor node through the measurement data of the optical flow sensor at the second moment and the optical flow sensor measurement model, and establish the current carrier state node speed constraint;
第k个时刻的惯性导航系统节点与xk,xk+1通过惯性导航预积分k到k+1时刻之间的量测数据和惯性导航系统预积分量测模型,建立载体xk,xk+1状态节点之间的预积分约束,从而建立状态节点xk,xk+1与惯性导航系统预积分节点的连接关系;第k个时刻的偏振光强传感器节点与xk,xk+1通过偏振光强传感器k到k+1时刻之间的量测数据和偏振光强传感器量测模型,建立载体xk,xk+1状态节点之间的航向约束,从而建立状态节点xk,xk+1与偏振光强传感器节点的连接关系;第k个时刻的雷达里程计节点与xk,xk+1通过雷达里程计k到k+1时刻之间的量测数据和雷达里程计量测模型,建立载体xk,xk+1状态节点之间的位姿变换约束,从而建立状态节点xk,xk+1与雷达里程计节点的连接关系;第k个时刻的状态节点为xk,xk与第k个时刻的光流传感器节点通过光流传感器第k个时刻的量测数据和光流传感器量测模型、建立当前载体状态节点速度约束,从而建立状态节点xk与光流传感器节点的连接关系;The inertial navigation system node at the kth moment and x k , x k+1 establish the pre-integration constraint between the state nodes of the carrier x k , x k +1 through the measurement data of the inertial navigation pre-integration between the k and k+1 moments and the pre-integration measurement model of the inertial navigation system, thereby establishing the connection relationship between the state nodes x k , x k+1 and the pre-integration node of the inertial navigation system; the polarization light intensity sensor node at the kth moment and x k , x k+1 establish the heading constraint between the state nodes of the carrier x k , x k+1 through the measurement data of the polarization light intensity sensor between the k and k+1 moments and the measurement model of the polarization light intensity sensor, thereby establishing the connection relationship between the state nodes x k , x k+1 and the polarization light intensity sensor node; the radar odometer node at the kth moment and x k , x k +1 establish the posture transformation constraint between the state nodes of the carrier x k , x k+1 through the measurement data of the radar odometer between the k and k+1 moments and the radar odometer measurement model, thereby establishing the state nodes x k , x k +1 . k+1 is connected to the radar odometer node; the state node at the kth moment is x k , and x k is connected to the optical flow sensor node at the kth moment by using the optical flow sensor's measurement data at the kth moment and the optical flow sensor measurement model to establish the current carrier state node speed constraint, thereby establishing a connection relationship between the state node x k and the optical flow sensor node;
对所公开的实施例的上述说明,使本领域专业技术人员能够实现或使用本发明。对这些实施例的多种修改对本领域的专业技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本发明的精神或范围的情况下,在其它实施例中实现。因此,本发明将不会被限制于本文所示的这些实施例,而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。The above description of the disclosed embodiments enables one skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.
Claims (6)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210143142.8A CN114459474B (en) | 2022-02-16 | 2022-02-16 | A method of inertial/polarization/radar/optical flow tight combined navigation based on factor graph |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210143142.8A CN114459474B (en) | 2022-02-16 | 2022-02-16 | A method of inertial/polarization/radar/optical flow tight combined navigation based on factor graph |
Publications (2)
Publication Number | Publication Date |
---|---|
CN114459474A CN114459474A (en) | 2022-05-10 |
CN114459474B true CN114459474B (en) | 2023-11-24 |
Family
ID=81413436
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210143142.8A Active CN114459474B (en) | 2022-02-16 | 2022-02-16 | A method of inertial/polarization/radar/optical flow tight combined navigation based on factor graph |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114459474B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115574816B (en) * | 2022-11-24 | 2023-03-14 | 东南大学 | Bionic vision multi-source information intelligent perception unmanned platform |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106197408A (en) * | 2016-06-23 | 2016-12-07 | 南京航空航天大学 | A kind of multi-source navigation data fusion method based on factor graph |
CN111045454A (en) * | 2019-12-30 | 2020-04-21 | 北京航空航天大学 | A UAV Autopilot Based on Bionic Autonomous Navigation |
CN111504312A (en) * | 2020-07-02 | 2020-08-07 | 中国人民解放军国防科技大学 | Unmanned aerial vehicle pose estimation method based on visual inertial polarized light fusion |
CN111623771A (en) * | 2020-06-08 | 2020-09-04 | 青岛智融领航科技有限公司 | Polarization inertial navigation tight combination navigation method based on light intensity |
CN112697138A (en) * | 2020-12-07 | 2021-04-23 | 北方工业大学 | Factor graph optimization-based bionic polarization synchronous positioning and composition method |
CN113066105A (en) * | 2021-04-02 | 2021-07-02 | 北京理工大学 | Positioning and mapping method and system based on fusion of laser radar and inertial measurement unit |
CN113781582A (en) * | 2021-09-18 | 2021-12-10 | 四川大学 | Synchronous positioning and map creating method based on laser radar and inertial navigation combined calibration |
-
2022
- 2022-02-16 CN CN202210143142.8A patent/CN114459474B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106197408A (en) * | 2016-06-23 | 2016-12-07 | 南京航空航天大学 | A kind of multi-source navigation data fusion method based on factor graph |
CN111045454A (en) * | 2019-12-30 | 2020-04-21 | 北京航空航天大学 | A UAV Autopilot Based on Bionic Autonomous Navigation |
CN111623771A (en) * | 2020-06-08 | 2020-09-04 | 青岛智融领航科技有限公司 | Polarization inertial navigation tight combination navigation method based on light intensity |
CN111504312A (en) * | 2020-07-02 | 2020-08-07 | 中国人民解放军国防科技大学 | Unmanned aerial vehicle pose estimation method based on visual inertial polarized light fusion |
CN112697138A (en) * | 2020-12-07 | 2021-04-23 | 北方工业大学 | Factor graph optimization-based bionic polarization synchronous positioning and composition method |
CN113066105A (en) * | 2021-04-02 | 2021-07-02 | 北京理工大学 | Positioning and mapping method and system based on fusion of laser radar and inertial measurement unit |
CN113781582A (en) * | 2021-09-18 | 2021-12-10 | 四川大学 | Synchronous positioning and map creating method based on laser radar and inertial navigation combined calibration |
Non-Patent Citations (5)
Title |
---|
LiDAR/IMU紧耦合的实时定位方法;李帅鑫等;《自动化学报》;第47卷(第6期);第1377-1389页 * |
一种偏振光/双目视觉仿生组合导航方法;褚金奎等;《一种偏振光/双目视觉仿生组合导航方法》;第50卷(第5期);第052800-1-10 * |
一种基于偏振度加权的车载仿生偏振/惯性紧组合导航方法;张青云等;《2020中国自动化大会(CAC2020)论文集》;第924-929页 * |
仿生偏振光/GPS/地磁组合导航方法设计及实现;崔帅;《中国优秀硕士学位论文全文数据库 信息科技辑》;第I136-1023 * |
基于图优化的仿生偏振光组合导航系统 SLAM 方法研究;曾云豪;《中国优秀硕士学位论文全文数据库 工程科技Ⅱ辑》(第01期);第C031-240页 * |
Also Published As
Publication number | Publication date |
---|---|
CN114459474A (en) | 2022-05-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112347840B (en) | Vision sensor laser radar integrated unmanned aerial vehicle positioning and image building device and method | |
CN112697138B (en) | A method for biomimetic polarization synchronization positioning and composition based on factor graph optimization | |
CN112649016B (en) | Visual inertial odometer method based on dotted line initialization | |
CN111504312B (en) | Unmanned aerial vehicle pose estimation method based on visual inertial polarized light fusion | |
CN111238467B (en) | Bionic polarized light assisted unmanned combat aircraft autonomous navigation method | |
Mostafa et al. | A novel GPS/RAVO/MEMS-INS smartphone-sensor-integrated method to enhance USV navigation systems during GPS outages | |
CN115574816B (en) | Bionic vision multi-source information intelligent perception unmanned platform | |
CN111366148B (en) | Target positioning method suitable for multiple observations of airborne photoelectric observing and sighting system | |
Liu et al. | Tightly coupled modeling and reliable fusion strategy for polarization-based attitude and heading reference system | |
CN113516692B (en) | SLAM method and device for multi-sensor fusion | |
CN113739795B (en) | Underwater synchronous positioning and mapping method based on polarized light/inertia/vision integrated navigation | |
CN103674021A (en) | Integrated navigation system and method based on SINS (Strapdown Inertial Navigation System) and star sensor | |
CN112781594B (en) | Laser radar iteration closest point improvement algorithm based on IMU coupling | |
CN111623773B (en) | Target positioning method and device based on fisheye vision and inertial measurement | |
CN110887473A (en) | A Bionic Polarization Autonomous Integrated Navigation Method Based on Polarization Degree Weighting | |
CN110196445A (en) | Space three-body system multisensor accurate positioning method under tether constraint | |
CN111337031A (en) | An autonomous position determination method for spacecraft landmark matching based on attitude information | |
CN114459474B (en) | A method of inertial/polarization/radar/optical flow tight combined navigation based on factor graph | |
Sun et al. | A novel visual inertial odometry based on interactive multiple model and multistate constrained Kalman filter | |
CN111207773A (en) | An Attitude Unconstrained Optimization Solution Method for Bionic Polarized Light Navigation | |
CN110779514A (en) | Hierarchical Kalman fusion method and device for auxiliary attitude determination of bionic polarization navigation | |
CN107705272A (en) | A kind of high-precision geometric correction method of aerial image | |
CN117760404A (en) | All-weather autonomous navigation method, system, computer equipment and medium based on single star orientation | |
Liu et al. | A vision-inertial interaction-based autonomous UAV positioning algorithm | |
Mirisola et al. | Trajectory recovery and 3d mapping from rotation-compensated imagery for an airship |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |