[go: up one dir, main page]

CN103186892A - Method and system for generating equal proportion live field map with aerial images - Google Patents

Method and system for generating equal proportion live field map with aerial images Download PDF

Info

Publication number
CN103186892A
CN103186892A CN201310110454XA CN201310110454A CN103186892A CN 103186892 A CN103186892 A CN 103186892A CN 201310110454X A CN201310110454X A CN 201310110454XA CN 201310110454 A CN201310110454 A CN 201310110454A CN 103186892 A CN103186892 A CN 103186892A
Authority
CN
China
Prior art keywords
image
coordinate
scene
camera
equal proportion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310110454XA
Other languages
Chinese (zh)
Other versions
CN103186892B (en
Inventor
尹志勇
苏森
明健雄
刘文君
杨光瑜
赵辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Third Affiliated Hospital of TMMU
Original Assignee
Third Affiliated Hospital of TMMU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Third Affiliated Hospital of TMMU filed Critical Third Affiliated Hospital of TMMU
Priority to CN201310110454.XA priority Critical patent/CN103186892B/en
Publication of CN103186892A publication Critical patent/CN103186892A/en
Application granted granted Critical
Publication of CN103186892B publication Critical patent/CN103186892B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Image Processing (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The invention provides a method and a system for generating equal proportion live field map with aerial images. The method comprises the following steps of: building an aerial photography platform; photographing a vertical view of the site of accident; executing geometric correction on the vertical view; performing transformation of coordinates for the vertical view, and transforming the coordinate system of the vertical view into an equal proportion live coordinate system; and extracting and marking accident essential factor information. With the method and the system, a true and fine two-dimensional equal proportion live field map can be obtained through geometric correction and transformation of coordinates for the aerial images, and each essential factor of the site of accident is restored efficiently and accurately.

Description

利用航拍图像生成等比例实景现场图的方法及系统Method and system for generating equal-scale real-scene scene map by using aerial images

技术领域technical field

本发明涉及交通事故现场信息获取技术领域,具体涉及一种利用航拍图像生成等比例实景现场图的方法及系统。The invention relates to the technical field of traffic accident scene information acquisition, in particular to a method and system for generating an equal-scale real-scene scene map by using aerial images.

背景技术Background technique

事故现场勘测和现场图的绘制是道路交通事故处理的第一环节。主要任务包括现场多种要素的测量和等比例绘制、拍摄现场照片等。在对交通事故现场的拍摄中,通常采用相机进行拍摄,拍摄出的每一张照片只能反映一个方向上的事故情况,要还原事故现场需要利用现场测量结果在坐标纸上进行手工绘制示意图,而目前事故现场测量主要依靠人工进行,因此手工绘制示意图存在以下几方面局限:(1)效率极低,测量绘制时间长,不利于交通事故现场的快速恢复;(2)人工测量精度较低,且手工绘制标准不一,较难把握车、路、痕迹的比例;(3)一些关键参数容易遗漏,且无法弥补;(4)无法对事故场景进行二次验证。在对某些有争议事故中如果对部分测量尺寸产生疑义或测量尺寸间发生矛盾时,无法进行二次验证。Accident site investigation and site map drawing are the first link in road traffic accident handling. The main tasks include the measurement and equal-scale drawing of various elements on the site, and taking pictures of the site, etc. In the shooting of the traffic accident scene, the camera is usually used for shooting, and each photo taken can only reflect the accident situation in one direction. To restore the accident scene, it is necessary to use the on-site measurement results to manually draw a schematic diagram on the coordinate paper. At present, the accident scene measurement is mainly carried out manually, so the manual drawing of the schematic diagram has the following limitations: (1) the efficiency is extremely low, and the measurement and drawing time is long, which is not conducive to the rapid recovery of the traffic accident scene; (2) the manual measurement accuracy is low, Moreover, manual drawing standards are different, and it is difficult to grasp the proportions of vehicles, roads, and traces; (3) some key parameters are easy to miss and cannot be made up; (4) it is impossible to perform secondary verification on the accident scene. In some disputed accidents, if there is doubt about some of the measured dimensions or there is a contradiction between the measured dimensions, the secondary verification cannot be carried out.

发明内容Contents of the invention

为了克服上述现有技术中存在的缺陷,本发明的目的是提供一种利用航拍图像生成等比例实景现场图的方法及系统,本发明能够利用航拍的图像通过几何校正,坐标变换得到二维等比例实景现场图,高效准确地还原事故现场各要素。In order to overcome the defects in the above-mentioned prior art, the object of the present invention is to provide a method and system for generating an equal-scale real scene map using aerial images. The present invention can use the aerial images to obtain two-dimensional, etc. Scale real scene map, efficiently and accurately restore all elements of the accident scene.

为了实现本发明的上述目的,根据本发明的第一个方面,本发明提供了一种利用航拍图像生成等比例实景现场图的方法,包括如下步骤:In order to achieve the above-mentioned purpose of the present invention, according to a first aspect of the present invention, the present invention provides a method for generating an equal-scale real-scene scene map using aerial images, comprising the following steps:

S1:构造航拍平台;S1: Construct an aerial photography platform;

S2:拍摄事故现场俯视图像;S2: Take a bird's-eye view image of the accident scene;

S3:对所述俯视图像进行几何校正;S3: Carrying out geometric correction to the bird's-eye view image;

S4:对所述俯视图像进行坐标变换,将所述俯视图像的坐标系变换至等比例实景坐标系。S4: Carry out coordinate transformation on the bird's-eye view image, and transform the coordinate system of the bird's-eye view image into an equal-scale real-scene coordinate system.

S5:在等比例实景坐标系中利用已知参考距离作为标尺对事故要素信息提取并标注。S5: Use the known reference distance as a scale to extract and mark the accident element information in the equal-scale real scene coordinate system.

本发明的利用航拍图像生成等比例实景现场图的方法能够利用航拍的图像通过几何校正,坐标变换得到真实细致的事故现场二维图像,再经过图像测量、标注生成翔实的交通事故现场图,高效准确地还原事故现场画面。与现有技术相比,本发明的测量绘制时间短、效率极高,利于交通事故现场的快速恢复;本发明能够精确标注对车、路、痕迹的位置,关键参数保存完整,测量精度高,能避免人为因素造成的测量误差且所得现场图不能被主观随意修改;另外,本发明能够存储事故现场的图像,在需要的时候进行调用,能够对事故场景进行二次验证。The method for generating an equal-scale real-scene scene map by using aerial images of the present invention can use aerial images to obtain a real and detailed two-dimensional image of the accident scene through geometric correction and coordinate transformation, and then generate a detailed traffic accident scene map through image measurement and labeling, which is highly efficient. Accurately restore the scene of the accident. Compared with the existing technology, the measurement and drawing time of the present invention is short and the efficiency is extremely high, which is beneficial to the rapid recovery of the traffic accident scene; the present invention can accurately mark the positions of vehicles, roads, and traces, the key parameters are completely preserved, and the measurement accuracy is high. The measurement error caused by human factors can be avoided and the obtained scene map cannot be modified subjectively; in addition, the present invention can store the image of the accident scene and call it when needed, and can perform secondary verification on the accident scene.

在本发明的一种优选实施方式中,所述几何校正的步骤为:In a preferred embodiment of the present invention, the step of geometric correction is:

S21:利用二维标定板对相机进行标定,构造图像映射方程,得到相机的内部参数和外部参数,所述内部参数包括畸变系数;S21: Use a two-dimensional calibration board to calibrate the camera, construct an image mapping equation, and obtain internal parameters and external parameters of the camera, the internal parameters including distortion coefficients;

S22:将畸变系数的数值调节为0,保持其它参数不变,得到新的相机的内部参数矩阵;S22: adjust the value of the distortion coefficient to 0, keep other parameters unchanged, and obtain a new internal parameter matrix of the camera;

S23:利用相机旧的内部参数代入图像映射方程,求解出失真图像像素坐标对应的成像平面坐标,再利用所述新的相机内部参数代入图像映射方程,将成像平面坐标面带入新的图像映射方程,得到校正后的图像像素坐标,再通过灰度插值实现颜色还原。S23: Substituting the old internal parameters of the camera into the image mapping equation to solve the imaging plane coordinates corresponding to the pixel coordinates of the distorted image, and then using the new camera internal parameters into the image mapping equation to bring the imaging plane coordinate plane into the new image mapping Equation to obtain the corrected image pixel coordinates, and then achieve color restoration through grayscale interpolation.

在本发明的另一种优选实施方式中,所述利用二维标定板对相机进行标定,构造图像映射方程,得到相机的内部参数和外部参数的步骤为:In another preferred embodiment of the present invention, the steps of using a two-dimensional calibration board to calibrate the camera, constructing an image mapping equation, and obtaining the internal parameters and external parameters of the camera are as follows:

S31:制备二维标定板,所述二维标定板上具有至少两个与背景对比度高、半径及行列间距固定的具有一定面积的图案;S31: Prepare a two-dimensional calibration plate, the two-dimensional calibration plate has at least two patterns with a certain area that have a high contrast with the background and have a fixed radius and row-column spacing;

S32:利用待标定相机拍摄不同角度的含有所述标定板的图像;S32: Use the camera to be calibrated to take images containing the calibration plate from different angles;

S33:利用图像识别算法对拍摄图像中的图案进行搜索和定位并提取质心坐标;S33: Using an image recognition algorithm to search and locate the pattern in the captured image and extract the centroid coordinates;

S34:利用标定板上图案的二维实际坐标与提取的所述质心坐标建立映射方程,求其最优解,得到相机内部参数和外部参数,所述映射方程为:S34: Using the two-dimensional actual coordinates of the pattern on the calibration board and the extracted centroid coordinates to establish a mapping equation, seek its optimal solution, and obtain the internal parameters and external parameters of the camera, the mapping equation is:

Pw=Pc*R+Τ;P w =P c *R+Τ;

(( uu ,, vv )) TT == ff zz cc (( xx cc ,, ythe y cc )) TT ;;

(( uu ′′ ,, vv ′′ )) TT == 22 11 ++ 11 -- 44 kk (( uu 22 ++ vv 22 )) (( uu ,, vv )) TT ;;

(( rr ,, cc )) TT == (( vv ′′ SS ythe y ++ CC ythe y ,, uu ′′ SS xx ++ CC xx )) TT ;;

其中,R为旋转矩阵,Τ为平移矩阵,所述R、Τ为相机的外部参数;Pw为世界坐标,用(xw,yw,zw)表示世界坐标内的坐标点,Pc为其变换到相机坐标系中的坐标,用(xc,yc,zc)表示相机坐标系中的坐标点;f为焦距,u、v为理想的成像平面坐标;k为畸变系数,u′、v′为实际成像平面坐标;r为像素点行数,c为像素点列数,Sx、Sy为图像中心像素坐标,Cx,Cy为主点在成像坐标系中的坐标。Among them, R is a rotation matrix, Τ is a translation matrix, and the R and Τ are external parameters of the camera; P w is the world coordinate, and (x w , y w , z w ) represent a coordinate point in the world coordinate, P c For the coordinates transformed into the camera coordinate system, use (x c , y c , z c ) to represent the coordinate points in the camera coordinate system; f is the focal length, u and v are the ideal imaging plane coordinates; k is the distortion coefficient, u′, v′ are the coordinates of the actual imaging plane; r is the number of pixel rows, c is the number of pixel columns, S x , S y are the pixel coordinates of the image center, C x , C y are the main points in the imaging coordinate system coordinate.

本发明能够校正摄像机拍摄图像的失真,得到真实的事故现场图片,高效准确地还原事故现场画面。The invention can correct the distortion of the image taken by the camera, obtain the real picture of the accident scene, and restore the scene picture of the accident efficiently and accurately.

在本发明的一种优选实施方式中,所述步骤S4中采用的坐标变换方程为:In a preferred embodiment of the present invention, the coordinate transformation equation adopted in the step S4 is:

xx ′′ ythe y ′′ == aa bb cc dd xx ythe y ++ ee ff 11 ++ uu vv xx ythe y

其中,a,b,c,d,e,f,u,v为坐标转换参数,在计算时,选取4个基准点建立8个方程,且每个基准点均需要具有二维地面坐标与对应的二维图像坐标。Among them, a, b, c, d, e, f, u, v are coordinate conversion parameters. During calculation, 4 reference points are selected to establish 8 equations, and each reference point needs to have two-dimensional ground coordinates and corresponding The two-dimensional image coordinates of .

本发明通过坐标变换得到真实细致的事故现场二维图像,再经过图像标注生成翔实的交通事故现场图。The invention obtains a real and detailed two-dimensional image of the accident scene through coordinate transformation, and then generates a detailed traffic accident scene map through image annotation.

为了实现本发明的上述目的,根据本发明的第二个方面,本发明提供了一种利用航拍图像生成等比例实景现场图的系统,包括可升空移动装置及其携带的相机,所述相机拍摄事故现场的图像并将所述图像传输给处理器,所述处理器根据本发明所述的方法对图像进行校正,得到真实的事故场景。In order to achieve the above-mentioned purpose of the present invention, according to the second aspect of the present invention, the present invention provides a system for generating an equal-scale real scene map using aerial images, including a mobile device that can be lifted into the air and a camera carried by it. Taking images of the accident scene and transmitting the images to a processor, the processor corrects the images according to the method of the present invention to obtain a real accident scene.

本发明的利用航拍图像生成数字化现场图的系统能够校正相机机拍摄的失真图像,得到真实的事故现场图片,高效准确地还原事故现场画面。The system of the present invention for generating a digitized scene map by using an aerial image can correct a distorted image taken by a camera, obtain a real picture of an accident scene, and efficiently and accurately restore the picture of the scene of the accident.

在本发明的一种优选实施方式中,所述相机通过zigbee模块将事故现场的图像传输给处理器。In a preferred embodiment of the present invention, the camera transmits the image of the accident scene to the processor through the zigbee module.

本发明的附加方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本发明的实践了解到。Additional aspects and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

附图说明Description of drawings

本发明的上述和/或附加的方面和优点从结合下面附图对实施例的描述中将变得明显和容易理解,其中:The above and/or additional aspects and advantages of the present invention will become apparent and comprehensible from the description of the embodiments in conjunction with the following drawings, wherein:

图1是本发明利用航拍图像生成等比例实景现场图的系统的结构示意图;Fig. 1 is the structural representation of the system of the present invention utilizes aerial photography image to generate equal-scale real-scene scene map;

图2是本发明利用航拍图像生成等比例实景现场图的方法的流程图。Fig. 2 is a flow chart of the method for generating an equal-scale real-scene scene map by using aerial images in the present invention.

具体实施方式Detailed ways

下面详细描述本发明的实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的,仅用于解释本发明,而不能理解为对本发明的限制。Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention.

在本发明的描述中,除非另有规定和限定,需要说明的是,术语“安装”、“相连”、“连接”应做广义理解,例如,可以是机械连接或电连接,也可以是两个元件内部的连通,可以是直接相连,也可以通过中间媒介间接相连,对于本领域的普通技术人员而言,可以根据具体情况理解上述术语的具体含义。In the description of the present invention, unless otherwise specified and limited, it should be noted that the terms "installation", "connection" and "connection" should be understood in a broad sense, for example, it can be mechanical connection or electrical connection, or two The internal communication of each element may be directly connected or indirectly connected through an intermediary. Those skilled in the art can understand the specific meanings of the above terms according to specific situations.

本发明提供了一种利用航拍图像生成等比例实景现场图的系统,如图1所示,其包括可升空移动装置2及其携带的相机1,在本实施方式,可升空移动装置2可以为但不限于遥控飞机。相机1拍摄事故现场3的图像并将图像传输给处理器4,处理器对图像进行校正,得到真实的事故场景。在本实施方式中,相机1通过zigbee模块将事故现场的图像传输给处理器4,处理器4可以实时处理相机拍摄的图像。需要说拍摄方法和处理方法与相机拍摄时一样,本发明在此不做赘述。The present invention provides a system for generating an equal-scale real scene map using aerial images, as shown in Figure 1, which includes a lift-off mobile device 2 and a camera 1 carried therein. Can be but not limited to remote control aircraft. The camera 1 takes images of the accident scene 3 and transmits the images to the processor 4, and the processor corrects the images to obtain a real accident scene. In this embodiment, the camera 1 transmits the images of the accident scene to the processor 4 through the zigbee module, and the processor 4 can process the images captured by the camera in real time. It needs to be said that the shooting method and processing method are the same as when the camera is shooting, and the present invention will not repeat them here.

本发明还提供了一种利用航拍图像生成等比例实景现场图的方法,如图2所示,包括如下步骤:The present invention also provides a method for generating an equal-scale real-scene scene map using aerial images, as shown in Figure 2, comprising the following steps:

第一步:构造航拍平台,在本实施方式中,航拍平台为能够稳定悬停并可以利用GPS定位飞行,包括可升空移动装置2及其携带的相机1。Step 1: Construct an aerial photography platform. In this embodiment, the aerial photography platform is capable of hovering stably and flying with GPS positioning, and includes a mobile device 2 that can be lifted into the air and a camera 1 that it carries.

第二步:拍摄事故现场俯视图像,在本实施方式中,可以将事故现场的某一个固定场景,例如交通标志,车辆等作为图案标志板,在本发明的更加优选的实施方式中,事故现场中可以设置有至少4个图案标志板,该图案标定板的相互距离已知,用于摄像测量比例标定。在本实施方式中,图案标志板中图案的形状为圆形。在本实施方式中,图案标定板的相互距离的大小与坐标变换的精度有关,图案标定板的相互距离越大,坐标变换的精度越高,在本实施方式中,优选的图案标定板的相邻距离为2米。本发明利用图案标志板作为坐标尺,对不同高度拍摄的图像进行坐标变换,高效准确。The second step: shoot the accident scene overlooking image, in this embodiment, can use a certain fixed scene of the accident scene, such as traffic signs, vehicles, etc. At least 4 pattern marking plates may be arranged in the center, the mutual distances of the pattern marking plates are known, and they are used for camera measurement scale calibration. In this embodiment, the shape of the pattern on the pattern sign board is circular. In this embodiment, the mutual distance between the pattern calibration plates is related to the accuracy of coordinate transformation. The larger the distance between the pattern calibration plates, the higher the accuracy of coordinate transformation. In this embodiment, the preferred pattern calibration plate relative Neighbor distance is 2 meters. The invention utilizes the pattern mark board as a coordinate ruler to carry out coordinate transformation on images taken at different heights, which is efficient and accurate.

第三步:对所述俯视图像进行几何校正。在本实施方式中,相机采用广角镜头,图像径向失真较为严重,由于要进行图像测量,因此要对失真的图像进行几何校正,利用标定板和标定程序对航拍相机进行标定,并利用更新相机内在参数后图像映射方程对图像进行几何校正。在本实施方式中,几何校正的步骤为:Step 3: Carry out geometric correction to the top view image. In this embodiment, the camera adopts a wide-angle lens, and the radial distortion of the image is relatively serious. Due to the image measurement, it is necessary to perform geometric correction on the distorted image, use the calibration board and the calibration program to calibrate the aerial camera, and use the update camera internal The post-parameter image mapping equation performs geometric correction on the image. In this embodiment, the steps of geometric correction are:

S31:利用二维标定板对相机进行标定,构造图像映射方程,得到相机的内部参数和外部参数,内部参数包括畸变系数。在本实施方式中,具体步骤为:S31: Calibrate the camera by using a two-dimensional calibration board, construct an image mapping equation, and obtain internal parameters and external parameters of the camera, where the internal parameters include a distortion coefficient. In this embodiment, the specific steps are:

首先,制备二维标定板,所述二维标定板上具有至少9个与背景对比度高、半径及行列间距固定的具有一定面积的图案,在本发明的一种优选实施方式中,图案包括彼此分离的至少9个圆形图。First, a two-dimensional calibration plate is prepared, and the two-dimensional calibration plate has at least 9 patterns with a certain area that have a high contrast with the background, a radius, and a fixed distance between rows and columns. In a preferred embodiment of the present invention, the patterns include each other Separated at least 9 circular graphs.

然后,利用待标定相机拍摄不同角度的含有所述标定板的图像,在拍摄时,保证光线充足、拍摄图案清晰。Then, use the camera to be calibrated to take images containing the calibration plate at different angles, and ensure that the light is sufficient and the shooting pattern is clear when shooting.

再后,利用图像识别算法对拍摄图像中的图案进行搜索和定位并提取质心坐标。Then, use the image recognition algorithm to search and locate the pattern in the captured image and extract the centroid coordinates.

最后,利用标定板上图案的二维实际坐标与提取的所述质心坐标建立映射方程,求其最优解,在本实施方式中,利用最小二乘法求解映射方程,得到相机内部参数和外部参数,在本实施方式中,内部参数包括焦距、畸变系数、相机主点在成像坐标系中坐标、图像中心像素坐标、图像尺寸;外部参数包括图像的旋转矩阵和平移矩阵,从而完成相机标定,在本发明的一种优选实施方式中,采用的映射方程为:Finally, use the two-dimensional actual coordinates of the pattern on the calibration plate and the extracted centroid coordinates to establish a mapping equation to find its optimal solution. In this embodiment, the least square method is used to solve the mapping equation to obtain the internal parameters and external parameters of the camera. , in this embodiment, the internal parameters include the focal length, the distortion coefficient, the coordinates of the principal point of the camera in the imaging coordinate system, the pixel coordinates of the image center, and the image size; the external parameters include the rotation matrix and translation matrix of the image, so as to complete the camera calibration. In a preferred embodiment of the present invention, the mapping equation adopted is:

Pw=Pc*R+Τ;P w =P c *R+Τ;

(( uu ,, vv )) TT == ff zz cc (( xx cc ,, ythe y cc )) TT ;;

(( uu ′′ ,, vv ′′ )) TT == 22 11 ++ 11 -- 44 kk (( uu 22 ++ vv 22 )) (( uu ,, vv )) TT ;;

(( rr ,, cc )) TT == (( vv ′′ SS ythe y ++ CC ythe y ,, uu ′′ SS xx ++ CC xx )) TT ;;

其中,R为旋转矩阵,Τ为平移矩阵,所述R、Τ为相机的外部参数;Pw为世界坐标,用(xw,yw,zw)表示世界坐标内的坐标点,Pc为其变换到相机坐标系中的坐标,用(xc,yc,zc)表示相机坐标系中的坐标点;f为焦距,u、v为理想的成像平面坐标;k为畸变系数,u′、v′为实际成像平面坐标;r为像素点行数,c为像素点列数,Sx、Sy为图像中心像素坐标,Cx,Cy为主点在成像坐标系中的坐标。Among them, R is a rotation matrix, Τ is a translation matrix, and the R and Τ are external parameters of the camera; P w is the world coordinate, and (x w , y w , z w ) represent a coordinate point in the world coordinate, P c For the coordinates transformed into the camera coordinate system, use (x c , y c , z c ) to represent the coordinate points in the camera coordinate system; f is the focal length, u and v are the ideal imaging plane coordinates; k is the distortion coefficient, u′, v′ are the coordinates of the actual imaging plane; r is the number of pixel rows, c is the number of pixel columns, S x , S y are the pixel coordinates of the image center, C x , C y are the main points in the imaging coordinate system coordinate.

S32:将畸变系数的数值调节为0,保持其它参数不变,得到新的相机的内部参数矩阵;S32: adjust the value of the distortion coefficient to 0, keep other parameters unchanged, and obtain a new internal parameter matrix of the camera;

S33:利用相机旧的内部参数代入图像映射方程,求解出失真图像像素坐标对应的成像平面坐标,再利用所述新的相机内部参数代入图像映射方程,将成像平面坐标面带入新的图像映射方程,得到校正后的图像像素坐标,再通过灰度插值实现颜色还原。在本实施方式中,灰度插值方法可以为但不限于最近邻点法,即取失真像素点周围四个邻点像素中距离最近的邻点像素灰度作为该点的灰度。S33: Substituting the old internal parameters of the camera into the image mapping equation to solve the imaging plane coordinates corresponding to the pixel coordinates of the distorted image, and then using the new camera internal parameters to substitute into the image mapping equation to bring the imaging plane coordinate plane into the new image mapping Equation to obtain the corrected image pixel coordinates, and then achieve color restoration through grayscale interpolation. In this embodiment, the grayscale interpolation method may be, but not limited to, the nearest neighbor method, that is, the grayscale of the nearest neighboring pixel among the four neighboring pixels around the distorted pixel is taken as the grayscale of the point.

本发明的利用航拍图像生成等比例实景现场图的方法能够校正摄像机拍摄图像的失真,得到真实的事故现场图片,高效准确地还原事故现场画面。The method for generating an equal-scale real-scene scene map by using the aerial photographed image of the present invention can correct the distortion of the image captured by the camera, obtain a real accident scene picture, and restore the accident scene picture efficiently and accurately.

第四步:对所述俯视图像进行坐标变换,将所述俯视图像的坐标系变换至等比例实景坐标系。Step 4: Carry out coordinate transformation on the bird's-eye view image, and transform the coordinate system of the bird's-eye view image into an equal-scale real-scene coordinate system.

在本实施方式中,利用齐次坐标变换将拍摄的俯视图像变换至等比例实景坐标系,该等比例实景坐标系与地面坐标系为平移关系,地面平面上物体的图像像素尺寸与实际尺寸成正比例关系。在本实施方式中,采用的齐次坐标变换方程为:In this embodiment, homogeneous coordinate transformation is used to transform the captured bird's-eye view image into an equal-scale real-scene coordinate system. The equal-scale real-scene coordinate system has a translation relationship with the ground coordinate system, and the image pixel size of an object on the ground plane is proportional to the actual size. Proportional relationship. In this embodiment, the homogeneous coordinate transformation equation adopted is:

xx ′′ ythe y ′′ == aa bb cc dd xx ythe y ++ ee ff 11 ++ uu vv xx ythe y

其中,a,b,c,d,e,f,u,v为坐标转换参数,在计算时,从所述图案标志板中选取4个基准点建立8个方程,且每个基准点均需要具有二维地面坐标与对应的二维图像坐标。在本实施方式中,4个基准点可以位于同一个图案标志板中,也可以位于不同图案标志板中,优选采用不同图案标志板中,在本发明更加优选的实施方式中,每一个图案标志板中选取一个基准点。Wherein, a, b, c, d, e, f, u, v are the coordinate transformation parameters, when calculating, select 4 reference points from the said pattern mark plate to set up 8 equations, and each reference point needs It has two-dimensional ground coordinates and corresponding two-dimensional image coordinates. In this embodiment, the four reference points can be located in the same pattern mark plate, or in different pattern mark plates, preferably in different pattern mark plates. In a more preferred embodiment of the present invention, each pattern mark Pick a datum point in the board.

在本实施方式中,可以采用像素填充将坐标变换前的图像的像素一次一个地映射回到坐标变换后的图像中并确定其灰度级。若坐标变换前图像的像素映射到坐标变换后图像的四个像素之间,则其灰度值由灰度级插值算法决定,优选采用最近邻点法,即取像素点周围四个邻点像素中距离最近的邻点像素灰度作为该点的灰度,从而使图像更加真实。In this embodiment, pixel filling may be used to map pixels of the image before coordinate transformation back to the image after coordinate transformation one at a time and determine its gray level. If the pixel of the image before the coordinate transformation is mapped to the four pixels of the image after the coordinate transformation, its gray value is determined by the gray level interpolation algorithm, and the nearest neighbor method is preferably used, that is, four neighboring pixels around the pixel point are taken The grayscale of the nearest neighbor pixel is used as the grayscale of the point, so that the image is more realistic.

第五步:在所述等比例实景坐标系中利用已知参考距离作为标尺对事故要素信息提取并标注。在本实施方式,可以利用图案标志板中图像的相对距离作为坐标尺,对事故要素信息提取并标注;也可以从事故现场中选择相对位置固定的实物为坐标尺,对事故要素信息提取并标注。Step 5: Using the known reference distance as a scale to extract and mark accident element information in the equal-scale real-scene coordinate system. In this embodiment, the relative distance of the image in the pattern sign board can be used as a coordinate scale to extract and mark the accident element information; it is also possible to select a physical object with a fixed relative position from the accident scene as a coordinate scale to extract and mark the accident element information .

需要说明的是,本发明不仅适用于交通事故现场,对爆破现场等场景也同样适用,具体等比例实景现场图的生成方法可参照本发明的步骤进行,这些方法都在本发明的保护范围之中。It should be noted that the present invention is not only applicable to the scene of a traffic accident, but also applicable to scenes such as a blasting scene. The method for generating a specific equal-scale real-scene scene map can refer to the steps of the present invention, and these methods are all within the protection scope of the present invention. middle.

本发明的能够利用航拍的图像通过几何校正和坐标变换得到真实细致的事故现场二维图像,再经过图像标注生成翔实的交通事故现场图,高效准确地还原事故现场画面。本发明的测量绘制时间短、效率极高,利于交通事故现场的快速恢复;本发明能够精确标注对车、路、痕迹的位置,关键参数保存完整,测量精度高,能避免人为因素造成的测量误差且所得现场图不能被主观随意修改;另外,本发明能够存储事故现场的图像,在需要的时候进行调用,能够对事故场景进行二次验证。The present invention can use the aerial photographed image to obtain a real and detailed two-dimensional image of the accident scene through geometric correction and coordinate transformation, and then generate a detailed traffic accident scene map through image annotation, so as to efficiently and accurately restore the accident scene picture. The measurement and drawing time of the present invention is short and the efficiency is extremely high, which is beneficial to the rapid recovery of the traffic accident scene; the present invention can accurately mark the positions of vehicles, roads, and traces, the key parameters are completely preserved, the measurement accuracy is high, and the measurement caused by human factors can be avoided In addition, the present invention can store the images of the accident scene, call them when needed, and perform secondary verification on the accident scene.

在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不一定指的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施例或示例中以合适的方式结合。In the description of this specification, descriptions referring to the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" mean that specific features described in connection with the embodiment or example , structure, material or characteristic is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

尽管已经示出和描述了本发明的实施例,本领域的普通技术人员可以理解:在不脱离本发明的原理和宗旨的情况下可以对这些实施例进行多种变化、修改、替换和变型,本发明的范围由权利要求及其等同物限定。Although the embodiments of the present invention have been shown and described, those skilled in the art can understand that various changes, modifications, substitutions and modifications can be made to these embodiments without departing from the principle and spirit of the present invention. The scope of the invention is defined by the claims and their equivalents.

Claims (6)

1. the utilization image of taking photo by plane generates the method for equal proportion outdoor scene scene photo, it is characterized in that, comprises the steps:
S1: construct the platform of taking photo by plane;
S2: take scene of the accident overhead view image;
S3: described overhead view image is carried out geometry correction;
S4: described overhead view image is carried out coordinate transform, with the coordinate system transformation of described overhead view image to equal proportion outdoor scene coordinate system;
S5: in described equal proportion outdoor scene coordinate system, utilize the known reference distance as scale the accident element information to be extracted and mark.
2. the utilization as claimed in claim 1 image of taking photo by plane generates the method for equal proportion outdoor scene scene photo, it is characterized in that the step of described geometry correction is:
S21: utilize two-dimentional scaling board that camera is demarcated, the construct image mapping equation obtains inner parameter and the external parameter of camera, and described inner parameter comprises distortion factor;
S22: the numerical value of distortion factor is adjusted to 0, keeps other parameter constant, obtain the inner parameter matrix of new camera;
S23: utilize the old inner parameter substitution image mapped equation of camera, solve the imaging plane coordinate of distorted image pixel coordinate correspondence, the described new camera inner parameter substitution image mapped equation of recycling, bring the imaging plane coordinate surface into new image mapped equation, image pixel coordinate after obtaining proofreading and correct is realized the color reduction by gray-level interpolation again.
3. the utilization as claimed in claim 2 image of taking photo by plane generates the method for equal proportion outdoor scene scene photo, it is characterized in that the two-dimentional scaling board of described utilization is demarcated camera, and the construct image mapping equation obtains the inner parameter of camera and the step of external parameter and is:
S31: prepare two-dimentional scaling board, have at least 9 patterns of fixing with background contrasts height, radius and ranks spacing with certain area on the described two-dimentional scaling board;
S32: utilize camera to be calibrated to take the image that contains described scaling board of different angles;
S33: utilize image recognition algorithm the pattern in the photographic images to be searched for and located and extract center-of-mass coordinate;
S34: utilize the two-dimentional actual coordinate of pattern on the scaling board and the described center-of-mass coordinate of extraction to set up mapping equation, ask its optimum solution, obtain camera inner parameter and external parameter, described mapping equation is:
P w=P c*R+Τ;
( u , v ) T = f z c ( x c , y c ) T ;
( u ′ , v ′ ) T = 2 1 + 1 - 4 k ( u 2 + v 2 ) ( u , v ) T ;
( r , c ) T = ( v ′ S y + C y , u ′ S x + C x ) T ;
Wherein, R is rotation matrix, and Τ is translation matrix, and described R, Τ are the external parameter of camera; P wBe world coordinates, with (x w, y w, z w) the interior coordinate points of expression world coordinates, P cFor it transforms to coordinate in the camera coordinates system, with (x c, y c, z c) coordinate points in the expression camera coordinates system; F is focal length, and u, v are desirable imaging plane coordinate; K is distortion factor, and u ', v ' are the actual imaging planimetric coordinates; R is the pixel line number, and c is the pixel columns, S x, S yBe picture centre pixel coordinate, C x, C yBe the coordinate of principal point in imaging coordinate system.
4. the utilization as claimed in claim 1 image of taking photo by plane generates the method for equal proportion outdoor scene scene photo, it is characterized in that the coordinate transformation equation that adopts among the described step S4 is:
x ′ y ′ = a b c d x y + e f 1 + u v x y
Wherein, a, b, c, d, e, f, u, v are coordinate transformation parameter, when calculating, choose 4 reference points and set up 8 equations, and each reference point all needs to have areal coordinate two-dimensionally and corresponding two dimensional image coordinate.
5. the utilization image of taking photo by plane generates the system of equal proportion outdoor scene scene photo, it is characterized in that, comprise the camera (1) that can go up to the air mobile device (2) and carry, described camera (1) is taken the image of the scene of the accident (3) and described image is transferred to processor (4), described processor (4) the method utilization according to claim 1 image of taking photo by plane generates the digitizing scene photo, obtains real accident scene.
6. the utilization as claimed in claim 5 image of taking photo by plane generates the system of equal proportion outdoor scene scene photo, it is characterized in that, described camera (1) is transferred to processor (4) by the zigbee module with the image of the scene of the accident.
CN201310110454.XA 2013-04-01 2013-04-01 Aerial Images is utilized to generate the method and system of equal proportion outdoor scene scene photo Expired - Fee Related CN103186892B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310110454.XA CN103186892B (en) 2013-04-01 2013-04-01 Aerial Images is utilized to generate the method and system of equal proportion outdoor scene scene photo

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310110454.XA CN103186892B (en) 2013-04-01 2013-04-01 Aerial Images is utilized to generate the method and system of equal proportion outdoor scene scene photo

Publications (2)

Publication Number Publication Date
CN103186892A true CN103186892A (en) 2013-07-03
CN103186892B CN103186892B (en) 2015-11-25

Family

ID=48678050

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310110454.XA Expired - Fee Related CN103186892B (en) 2013-04-01 2013-04-01 Aerial Images is utilized to generate the method and system of equal proportion outdoor scene scene photo

Country Status (1)

Country Link
CN (1) CN103186892B (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103366555A (en) * 2013-07-01 2013-10-23 中国人民解放军第三军医大学第三附属医院 Aerial image-based traffic accident scene image rapid generation method and system
CN103363961A (en) * 2013-07-09 2013-10-23 中国人民解放军第三军医大学第三附属医院 Aerial image-based determination method of three-dimensional information of traffic accident scene based on s
CN103400498A (en) * 2013-08-14 2013-11-20 中国人民解放军第三军医大学第三附属医院 Accident spot map generation method based on electronic map and data acquisition system
CN103400362A (en) * 2013-07-30 2013-11-20 中国人民解放军第三军医大学第三附属医院 Method for acquiring distinct scene graph by fusing accident close-range graph with aerial image
CN103473756A (en) * 2013-09-11 2013-12-25 中国人民解放军第三军医大学第三附属医院 Aerial photo image and close shot image automatic rectification fusion method
CN105550669A (en) * 2016-01-27 2016-05-04 大连楼兰科技股份有限公司 An Intelligent Accident Investigation Method Based on Image Recognition
CN106444846A (en) * 2016-08-19 2017-02-22 杭州零智科技有限公司 Unmanned aerial vehicle and method and device for positioning and controlling mobile terminal
CN108109173A (en) * 2016-11-25 2018-06-01 宁波舜宇光电信息有限公司 Vision positioning method, camera system and automation equipment
CN109163706A (en) * 2018-07-17 2019-01-08 长沙市公安局交通警察支队 Traffic accident scene diagram method for drafting and system, plotting equipment and storage medium
CN109816751A (en) * 2017-11-20 2019-05-28 南京模幻天空航空科技有限公司 Navigation channel Accident Handling Method based on unmanned plane aerial photography and Visual identification technology
CN110873863A (en) * 2018-08-29 2020-03-10 杭州海康威视数字技术股份有限公司 Target display method, radar system and electronic equipment
CN113074701A (en) * 2020-01-03 2021-07-06 南京模幻天空航空科技有限公司 Non-tower-scale traffic accident field measurement method based on machine vision and image recognition

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102254318A (en) * 2011-04-08 2011-11-23 上海交通大学 Method for measuring speed through vehicle road traffic videos based on image perspective projection transformation
US20130011069A1 (en) * 2010-01-29 2013-01-10 The Hong Kong University Of Science And Technology Architectural pattern detection and modeling in images

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130011069A1 (en) * 2010-01-29 2013-01-10 The Hong Kong University Of Science And Technology Architectural pattern detection and modeling in images
CN102254318A (en) * 2011-04-08 2011-11-23 上海交通大学 Method for measuring speed through vehicle road traffic videos based on image perspective projection transformation

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103366555A (en) * 2013-07-01 2013-10-23 中国人民解放军第三军医大学第三附属医院 Aerial image-based traffic accident scene image rapid generation method and system
CN103363961A (en) * 2013-07-09 2013-10-23 中国人民解放军第三军医大学第三附属医院 Aerial image-based determination method of three-dimensional information of traffic accident scene based on s
CN103400362A (en) * 2013-07-30 2013-11-20 中国人民解放军第三军医大学第三附属医院 Method for acquiring distinct scene graph by fusing accident close-range graph with aerial image
CN103400362B (en) * 2013-07-30 2015-11-25 中国人民解放军第三军医大学第三附属医院 Accident close-range figure and Aerial Images merge the method obtaining clear scene graph mutually
CN103400498A (en) * 2013-08-14 2013-11-20 中国人民解放军第三军医大学第三附属医院 Accident spot map generation method based on electronic map and data acquisition system
CN103400498B (en) * 2013-08-14 2015-12-09 中国人民解放军第三军医大学第三附属医院 Based on scene of the accident drawing generating method and the generation system of electronic chart and data acquisition system (DAS)
CN103473756A (en) * 2013-09-11 2013-12-25 中国人民解放军第三军医大学第三附属医院 Aerial photo image and close shot image automatic rectification fusion method
CN103473756B (en) * 2013-09-11 2016-01-20 中国人民解放军第三军医大学第三附属医院 Autoregistration merges the method for Aerial Images and close shot image
CN105550669A (en) * 2016-01-27 2016-05-04 大连楼兰科技股份有限公司 An Intelligent Accident Investigation Method Based on Image Recognition
CN106444846A (en) * 2016-08-19 2017-02-22 杭州零智科技有限公司 Unmanned aerial vehicle and method and device for positioning and controlling mobile terminal
CN108109173A (en) * 2016-11-25 2018-06-01 宁波舜宇光电信息有限公司 Vision positioning method, camera system and automation equipment
CN108109173B (en) * 2016-11-25 2022-06-28 宁波舜宇光电信息有限公司 Visual positioning method, camera system and automation equipment
CN109816751A (en) * 2017-11-20 2019-05-28 南京模幻天空航空科技有限公司 Navigation channel Accident Handling Method based on unmanned plane aerial photography and Visual identification technology
CN109163706A (en) * 2018-07-17 2019-01-08 长沙市公安局交通警察支队 Traffic accident scene diagram method for drafting and system, plotting equipment and storage medium
CN110873863A (en) * 2018-08-29 2020-03-10 杭州海康威视数字技术股份有限公司 Target display method, radar system and electronic equipment
CN113074701A (en) * 2020-01-03 2021-07-06 南京模幻天空航空科技有限公司 Non-tower-scale traffic accident field measurement method based on machine vision and image recognition

Also Published As

Publication number Publication date
CN103186892B (en) 2015-11-25

Similar Documents

Publication Publication Date Title
CN103186892A (en) Method and system for generating equal proportion live field map with aerial images
CN103366555B (en) Aerial image-based traffic accident scene image rapid generation method and system
CN111540048B (en) Fine live-action three-dimensional modeling method based on space-ground fusion
CN109115186B (en) A 360° measurable panoramic image generation method for vehicle-mounted mobile measurement system
WO2020062434A1 (en) Static calibration method for external parameters of camera
CN110889829B (en) A monocular distance measurement method based on fisheye lens
CN108107462B (en) RTK and high-speed camera combined traffic sign post attitude monitoring device and method
CN108168521A (en) One kind realizes landscape three-dimensional visualization method based on unmanned plane
CN101901501A (en) A Method of Generating Laser Color Cloud Image
CN103226840B (en) Full-view image splicing and measurement system and method
CN110806199A (en) A method and system for terrain surveying based on laser line projection instrument and unmanned aerial vehicle
CN107492069A (en) Image interfusion method based on more lens sensors
CN110532865A (en) Spacecraft structure recognition methods based on visible light and laser fusion
CN118691776B (en) A 3D real scene modeling and dynamic updating method based on multi-source data fusion
CN116182805A (en) Land Surveying and Mapping Method Based on Remote Sensing Image
CN108761271A (en) A kind of power grid screen of trees detection method and system
CN106705962A (en) Method and system for acquiring navigation data
CN103400362A (en) Method for acquiring distinct scene graph by fusing accident close-range graph with aerial image
CN103363961A (en) Aerial image-based determination method of three-dimensional information of traffic accident scene based on s
CN109631854B (en) A low-altitude unmanned aerial vehicle photography method for measuring coal mining subsidence cracks in mining areas
CN113536854B (en) A method, device and server for generating high-precision map road signs
CN107784633A (en) Suitable for the unmanned plane image calibrating method of plane survey
Li et al. High‐resolution model reconstruction and bridge damage detection based on data fusion of unmanned aerial vehicles light detection and ranging data imagery
CN105405135A (en) Two-step photography object point and image point automatic matching method based on basic configuration points
Stylianidis et al. Digital surveying in cultural heritage: the image-based recording and documentation approaches

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20151125

Termination date: 20180401

CF01 Termination of patent right due to non-payment of annual fee