CN113487675A - Rapid feature point detection method for incomplete checkerboard cooperation icon - Google Patents
Rapid feature point detection method for incomplete checkerboard cooperation icon Download PDFInfo
- Publication number
- CN113487675A CN113487675A CN202110827007.0A CN202110827007A CN113487675A CN 113487675 A CN113487675 A CN 113487675A CN 202110827007 A CN202110827007 A CN 202110827007A CN 113487675 A CN113487675 A CN 113487675A
- Authority
- CN
- China
- Prior art keywords
- checkerboard
- feature points
- feature
- points
- point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 43
- 239000011159 matrix material Substances 0.000 claims abstract description 36
- 238000000034 method Methods 0.000 claims abstract description 24
- 238000003384 imaging method Methods 0.000 claims description 17
- 238000001914 filtration Methods 0.000 claims description 7
- 238000012216 screening Methods 0.000 claims description 3
- 238000012795 verification Methods 0.000 claims description 3
- 230000007613 environmental effect Effects 0.000 abstract description 3
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 238000004364 calculation method Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000013527 convolutional neural network Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
- G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30244—Camera pose
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Artificial Intelligence (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
The invention belongs to the technical field of computer vision camera position calibration and pose estimation, and particularly relates to a rapid feature point detection method for incomplete checkerboard cooperative icons. In the method, under the condition that the checkerboard feature points are lost, the posterior detection is carried out on the initially detected checkerboard feature points to obtain posterior feature points positioned at the edges of the checkerboard, the homography matrix estimation is carried out, and then the backward positioning and the position matching are carried out on the unknown feature points, so that the one-to-one correspondence of the pixel coordinates of all the unknown feature points and the corresponding physical coordinates of the unknown feature points is realized; the scheme has the following beneficial effects: the method solves the one-to-one correspondence between the pixel coordinates and the world coordinates under the condition that the characteristic points are lost, can realize the detection of the characteristic points of the complete checkerboard and the characteristic points of the incomplete checkerboard, and has strong robustness and strong environmental interference resistance.
Description
Technical Field
The invention belongs to the technical field of computer vision camera position calibration and pose estimation, and particularly relates to a rapid feature point detection method for incomplete checkerboard cooperative icons.
Background
The checkerboard is used as a common artificial cooperation image and widely applied to calibration of internal and external parameters of a camera and estimation of position and posture. The detection of the checkerboard feature points (corner points) is an important step of camera calibration and pose estimation, and provides necessary data information for the camera calibration and pose estimation.
In general, the purpose of checkerboard feature point detection is to obtain pixel coordinates of all checkerboard feature points, and to make one-to-one correspondence between the detected pixel coordinates of the checkerboard feature points and physical coordinates thereof in a world coordinate system. Only if a one-to-one corresponding relation is established, camera calibration or pose estimation equations are established based on a camera imaging model, and the internal and external parameters of the camera or the position and pose values of the camera can be obtained through calculation.
Currently, there are many checkerboard feature point detection methods, most typically, checkerboard feature point detection methods carried by MATLAB and OPENCV applications. Both methods have respective disadvantages, the former has high calculation complexity and long calculation time; the latter needs to know the number of characteristic points of the checkerboard, and the automation degree is low. In addition, scholars at home and abroad propose improved checkerboard feature point detection methods aiming at the problems, such as checkerboard feature point detection methods based on self-correction, convolutional neural network, growth, robust Fourier transform and circle boundary detection. However, the above proposed methods all have the same drawbacks: only complete checkerboard feature points can be detected, i.e. only when all feature points of a checkerboard to be detected are detected, the one-to-one correspondence between pixel coordinates of the detected feature points and physical coordinates thereof can be established. If the feature points are lost, the corresponding relation between the pixel coordinates of the remaining detected feature points and the respective physical coordinates cannot be established because the position information of the lost feature points is not known, and further the camera calibration or pose estimation cannot be performed.
In practical application, due to the influence of external environment, including imaging light, illumination, shielding, backlight and the like, it is possible to cause unsatisfactory checkerboard imaging, and it is necessary to cause the failure of detection of characteristic points in the checkerboard, and such a situation (the checkerboard is incomplete) sometimes occurs.
Disclosure of Invention
Technical problem to be solved
The technical problem to be solved by the invention is as follows: how to provide a rapid feature point detection method for an incomplete checkerboard cooperation icon, which solves the problem that pixel coordinates of detected feature points cannot correspond to corresponding physical coordinates one by one under the interference of an external environment of the checkerboard cooperation icon, and improves the robustness and adaptability of the feature point detection of the checkerboard cooperation icon.
(II) technical scheme
In order to solve the technical problem, the invention provides a method for detecting a quick feature point of an incomplete checkerboard cooperation icon, which comprises the following steps:
step 1: carrying out initial feature point detection on the checkerboard cooperation icon by using a Harris or Hessen feature operator, and forming initial feature points of the checkerboard cooperation icon by using pixel coordinates of the detected feature points;
step 2: screening the initial characteristic points of the checkerboard cooperation icon, and filtering the false-detection non-checkerboard characteristic points;
and step 3: using the remaining filtered initial feature points of the checkerboard cooperation icons as the checkerboard feature points to form a checkerboard feature point set, and detecting to obtain all checkerboard edge feature points;
and 4, step 4: forming an edge feature point set by the detected checkerboard edge feature points, detecting feature points positioned on the edge of the same checkerboard as checkerboard posterior feature points, and forming an unknown feature point set by using the remaining feature points in the checkerboard feature point set as unknown feature points;
and 5: establishing an equation set according to the one-to-one correspondence relationship between the pixel coordinates of the posterior feature points and the physical coordinates of the posterior feature points in the world coordinate system, and solving a homography matrix of the current checkerboard cooperation icon imaging image;
step 6: and carrying out backward positioning and position matching on all unknown characteristic points in the unknown characteristic point set according to the solved homography matrix of the imaging image of the current checkerboard cooperation icon, so as to realize the one-to-one correspondence between the pixel coordinates of all unknown characteristic points and the physical coordinates thereof.
In the step 2, the initial feature points of the checkerboard cooperation icon are screened by using a checkerboard cooperation icon feature point template matching verification method, and false-detection non-checkerboard feature points are filtered.
Wherein, the step 2 specifically comprises the following steps:
step 21: establishing two checkerboard cooperation icon feature point templates, wherein each template is 10 multiplied by 10 pixels in size and is averagely divided into 4 regions, the gray values of the upper left region and the lower right region of the first template are 255, the gray values of the upper right region and the lower left region are 1, the gray values of the upper left region and the lower right region of the second template are 1, and the gray values of the upper right region and the lower left region are 255;
step 22: extracting a feature point subgraph with the same size as the feature point template by taking the initial feature point as a center, and performing convolution operation with the two checkerboard cooperation icon feature point templates respectively to obtain two similarity values between the feature point subgraph and the feature point template;
step 23: if one of the two similarity values is larger than the similarity threshold of the checkerboard feature points, the initial feature points are the checkerboard feature points, otherwise, the initial feature points are not the checkerboard feature points, and the initial feature points are deleted;
step 24: and traversing all initial feature points, and filtering all initial feature points which are not the checkerboard feature points.
In step 3, all the feature points on the edge of the checkerboard are detected and obtained by using a vector outer product detection method for the feature point set of the checkerboard.
Wherein, the step 3 comprises the following steps:
step 31: taking the remaining filtered initial feature points of the checkerboard cooperation icons as the checkerboard feature points to form a checkerboard feature point set;
step 32: establishing a vector to be detected by taking a first characteristic point in the checkerboard characteristic point set as a starting point and a second characteristic point as an end point, and sequentially calculating an outer product of the vector to be detected, the first characteristic point and other characteristic points;
step 33: if the outer product result of the vector to be detected, the first characteristic point and other characteristic points is the same positive or the same negative, then two characteristic points forming the vector to be detected are the checkerboard edge characteristic points; otherwise, selecting the next characteristic point as an end point to establish a vector to be detected, sequentially calculating the outer product of the vector to be detected, the first characteristic point and other characteristic points to form a vector, and judging again until all the characteristic points are traversed;
step 34: and with the second feature point as a starting point, continuously repeating the step 32 and the step 33, and so on until all the feature points are traversed to obtain edge feature points of all the checkerboards.
In step 4, the detected feature points on the edges of the checkerboards form an edge feature point set, and feature points on the edges of the same checkerboard are detected by using a vector outer product detection method and are used as the posterior feature points of the checkerboards.
Wherein, the step 4 comprises the following steps:
step 41: forming an edge feature point set by the detected checkerboard edge feature points;
step 42: establishing a vector to be detected by taking a first edge feature point in the set as a starting point and a second edge feature point as an end point, and sequentially calculating an outer product of the vector to be detected, the first edge feature point and other edge feature points;
step 43: if the outer product of the vector to be detected, the first edge feature point and other edge feature points is smaller than a given collinear threshold value, two edge feature points forming the vector to be detected are collinear, namely the two edge feature points are on the same checkerboard edge; otherwise, selecting the next edge feature point as an end point to establish a vector to be detected, sequentially calculating the outer product of the vector to be detected, the first edge feature point and other edge feature points to form a vector, and judging again until all edge feature points are traversed;
step 44: and (3) continuously repeating the step (42) and the step (43) by taking the second edge feature point as a starting point, repeating the steps by analogy until all edge feature points are traversed, taking the feature points with the number of the detected feature points on the same edge equal to the number of the known edge feature points as checkerboard posterior feature points, and taking the rest feature points in the checkerboard feature point set as unknown feature points to form an unknown feature point set.
Wherein, the step 5 comprises the following steps:
since the correspondence between the pixel coordinates of the posterior feature points and their physical coordinates is known, the posterior feature point pixel coordinates (u) are based onp,vp) With its physical coordinates (X) in the world coordinate systemw,Yw) The following homography matrix solution equations are established:
wherein H is a homography matrix of the imaging image of the current checkerboard cooperation icon, HijIs the ith row and the jth column element of the H matrix;
from the above formula, it can be seen that the homography matrix H has 8 unknown elements in total, two equations can be established for each pair of posterior feature point pixel coordinates and the physical coordinates thereof, and only 4 pairs of posterior feature point pixel coordinates and the physical coordinates thereof are needed to solve the 8 unknown elements of the homography matrix H.
Wherein, the step 6 comprises the following steps:
step 61: according to the homography matrix H of the current checkerboard cooperation icon imaging image, the pixel coordinate (u) of the unknown characteristic point is calculatedd,vd) Backward positioning is carried out by using the following formula, and the estimated value of the physical coordinate of the unknown characteristic point is obtained by solving
Wherein, h'ijThe ith row and the jth column of elements of an inverse matrix of the homography matrix H;
step 62: calculating the distance d between the physical coordinates of all the checkerboard feature points according to the estimated value of the physical coordinates of the unknown feature pointsij：
Wherein (X)ij,Yij) The physical coordinate of the feature point in the ith row and the jth column of the checkerboard in a world coordinate system is shown;
and step 63: will be a distance dijMinimum distance value dminThe physical coordinates of the checkerboard feature points are used as the physical coordinates of the unknown feature point pixel coordinates in the world coordinate system;
step 64: and traversing all unknown characteristic points in the unknown characteristic point set until physical coordinates corresponding to pixel coordinates of all unknown characteristic points are obtained, and completing the backward position matching of all unknown characteristic points.
The method solves the one-to-one correspondence between the pixel coordinates and the world coordinates under the condition that the characteristic points are lost, can detect the characteristic points of the complete checkerboard and the characteristic points of the incomplete checkerboard, and has strong robustness and strong environmental interference resistance.
(III) advantageous effects
Compared with the prior art, the rapid feature point detection method for the incomplete checkerboard cooperation icon, provided by the technical scheme of the invention, comprises the steps of carrying out posterior detection on initially detected checkerboard feature points under the condition that the checkerboard feature points are lost to obtain posterior feature points positioned at the edges of the checkerboards, carrying out homography matrix estimation, further carrying out backward positioning and position matching on unknown feature points, and thus realizing one-to-one correspondence between pixel coordinates of all unknown feature points and corresponding physical coordinates thereof; the scheme has the following beneficial effects:
(1) the technical scheme of the invention solves the one-to-one correspondence between the pixel coordinates and the world coordinates under the condition of the loss of the characteristic points, can realize the detection of the characteristic points of the complete checkerboard and the characteristic points of the incomplete checkerboard, has strong robustness and strong anti-environmental interference capability;
(2) the feature point detection algorithm related to the technical scheme of the invention does not need iterative computation, has low algorithm complexity, small computation amount and high real-time performance, and can realize rapid checkerboard cooperation icon feature point detection.
Drawings
FIG. 1 is a schematic diagram of a checkerboard cooperation icon feature point detection method of the present invention;
FIG. 2 is a flow chart of a checkerboard cooperation icon feature point detection method of the present invention;
FIG. 3 is a flow chart of a non-checkerboard feature point filtering method of the present invention;
FIG. 4 is a checkerboard collaboration icon feature point matching template of the present invention;
FIG. 5 is a flow chart of a checkerboard edge feature point detection method of the present invention;
FIG. 6 is a flow chart of a checkerboard posterior feature point detection method of the present invention;
FIG. 7 is a flowchart of the unknown feature point backward localization and location matching method of the present invention;
Detailed Description
In order to make the objects, contents, and advantages of the present invention clearer, the following detailed description of the embodiments of the present invention will be made in conjunction with the accompanying drawings and examples.
The technical scheme of the invention is used for estimating the current homography matrix by carrying out posterior detection on the checkerboard feature points under the condition that the checkerboard feature points are lost, and then carrying out backward positioning and position matching on the residual feature points, thereby realizing the one-to-one correspondence of the pixel coordinates of all the detected checkerboard feature points and the corresponding physical coordinates thereof.
Referring to fig. 1, the invention provides a method for detecting a fast feature point of an incomplete checkerboard cooperation icon, which has the following principle:
as shown in fig. 1, if the feature point shown in the hollow circle of the checkerboard cooperation icon is lost, since the position information of the lost feature point is unknown, the corresponding relationship between the pixel coordinates of the remaining detected feature points and the respective physical coordinates cannot be established, that is, the world coordinates in the world coordinate system corresponding to the pixel coordinates of the detected feature points are unknown. However, since the pixel coordinates of the checkerboard cooperation icon correspond to the world coordinates one to one, and the correspondence is the checkerboard imaging homography matrix. Therefore, by detecting 4 posterior feature points (c 1-c 4) of the current checkerboard cooperation icon, the corresponding relation between the posterior feature points and the physical coordinates (w 1-w 4) is known, and then calculating by using a homography estimation equation to obtain a homography matrix of the current checkerboard imaging, the pixel coordinates of the remaining detected checkerboard feature points (c 5-c 6) can be subjected to homography backward positioning, and the physical coordinates of the detected checkerboard feature points are calculated by using the homography matrix, so that the one-to-one correspondence between the pixel coordinates (c 5-c 6) of the detected checkerboard feature points and the physical coordinates (w 5-w 6) of the detected checkerboard feature points can be realized according to the position matching of the physical coordinates.
Referring to fig. 2, the invention provides a method for detecting a fast feature point of an incomplete checkerboard cooperation icon, which comprises the following steps:
step 1: carrying out initial feature point detection on the checkerboard cooperation icon by using a Harris or Hessen feature operator, and forming initial feature points of the checkerboard cooperation icon by using pixel coordinates of the detected feature points;
step 2: screening the initial characteristic points of the checkerboard cooperation icon, and filtering the false-detection non-checkerboard characteristic points;
and step 3: using the remaining filtered initial feature points of the checkerboard cooperation icons as the checkerboard feature points to form a checkerboard feature point set, and detecting to obtain all checkerboard edge feature points;
and 4, step 4: forming an edge feature point set by the detected checkerboard edge feature points, detecting feature points positioned on the edge of the same checkerboard as checkerboard posterior feature points, and forming an unknown feature point set by using the remaining feature points in the checkerboard feature point set as unknown feature points;
and 5: establishing an equation set according to the one-to-one correspondence relationship between the pixel coordinates of the posterior feature points and the physical coordinates of the posterior feature points in the world coordinate system, and solving a homography matrix of the current checkerboard cooperation icon imaging image;
step 6: and carrying out backward positioning and position matching on all unknown characteristic points in the unknown characteristic point set according to the solved homography matrix of the imaging image of the current checkerboard cooperation icon, so as to realize the one-to-one correspondence between the pixel coordinates of all unknown characteristic points and the physical coordinates thereof.
In the step 2, the initial feature points of the checkerboard cooperation icon are screened by using a checkerboard cooperation icon feature point template matching verification method, and false-detection non-checkerboard feature points are filtered.
Referring to fig. 3, the step 2 specifically includes the following steps:
step 21: establishing two checkerboard cooperation icon feature point templates, as shown in fig. 4, each template is 10 × 10 pixels in size, and is averagely divided into 4 regions, the gray values of the upper left region and the lower right region of the first template are 255 and the gray values of the upper right region and the lower left region are 1, the gray values of the upper left region and the lower right region of the second template are 1 and the gray values of the upper right region and the lower left region are 255;
step 22: extracting a feature point subgraph with the same size as the feature point template by taking the initial feature point as a center, and performing convolution operation with the two checkerboard cooperation icon feature point templates respectively to obtain two similarity values between the feature point subgraph and the feature point template;
step 23: if one of the two similarity values is larger than the similarity threshold of the checkerboard feature points, the initial feature points are the checkerboard feature points, otherwise, the initial feature points are not the checkerboard feature points, and the initial feature points are deleted;
step 24: and traversing all initial feature points, and filtering all initial feature points which are not the checkerboard feature points.
In step 3, all the feature points on the edge of the checkerboard are detected and obtained by using a vector outer product detection method for the feature point set of the checkerboard.
Referring to fig. 5, the step 3 includes the following steps:
step 31: taking the remaining filtered initial feature points of the checkerboard cooperation icons as the checkerboard feature points to form a checkerboard feature point set;
step 32: establishing a vector to be detected by taking a first characteristic point in the checkerboard characteristic point set as a starting point and a second characteristic point as an end point, and sequentially calculating an outer product of the vector to be detected, the first characteristic point and other characteristic points;
step 33: if the outer product result of the vector to be detected, the first characteristic point and other characteristic points is the same positive or the same negative, then two characteristic points forming the vector to be detected are the checkerboard edge characteristic points; otherwise, selecting the next characteristic point as an end point to establish a vector to be detected, sequentially calculating the outer product of the vector to be detected, the first characteristic point and other characteristic points to form a vector, and judging again until all the characteristic points are traversed;
step 34: and with the second feature point as a starting point, continuously repeating the step 32 and the step 33, and so on until all the feature points are traversed to obtain edge feature points of all the checkerboards.
In step 4, the detected feature points on the edges of the checkerboards form an edge feature point set, and feature points on the edges of the same checkerboard are detected by using a vector outer product detection method and are used as the posterior feature points of the checkerboards.
Referring to fig. 6, the step 4 includes the following steps:
step 41: forming an edge feature point set by the detected checkerboard edge feature points;
step 42: establishing a vector to be detected by taking a first edge feature point in the set as a starting point and a second edge feature point as an end point, and sequentially calculating an outer product of the vector to be detected, the first edge feature point and other edge feature points;
step 43: if the outer product of the vector to be detected, the first edge feature point and other edge feature points is smaller than a given collinear threshold value, two edge feature points forming the vector to be detected are collinear, namely the two edge feature points are on the same checkerboard edge; otherwise, selecting the next edge feature point as an end point to establish a vector to be detected, sequentially calculating the outer product of the vector to be detected, the first edge feature point and other edge feature points to form a vector, and judging again until all edge feature points are traversed;
step 44: and (3) continuously repeating the step (42) and the step (43) by taking the second edge feature point as a starting point, repeating the steps by analogy until all edge feature points are traversed, taking the feature points with the number of the detected feature points on the same edge equal to the number of the known edge feature points as checkerboard posterior feature points, and taking the rest feature points in the checkerboard feature point set as unknown feature points to form an unknown feature point set.
Wherein, the step 5 comprises the following steps:
since the correspondence between the pixel coordinates of the posterior feature points and their physical coordinates is known, the posterior feature point pixel coordinates (u) are based onp,vp) With its physical coordinates (X) in the world coordinate systemw,Yw) The following homography matrix solution equations are established:
wherein H is a homography matrix of the imaging image of the current checkerboard cooperation icon, HijIs the ith row and the jth column element of the H matrix;
from the above formula, it can be seen that the homography matrix H has 8 unknown elements in total, two equations can be established for each pair of posterior feature point pixel coordinates and the physical coordinates thereof, and only 4 pairs of posterior feature point pixel coordinates and the physical coordinates thereof are needed to solve the 8 unknown elements of the homography matrix H.
Referring to fig. 7, the step 6 is implemented as follows:
step 61: according to the homography matrix H of the current checkerboard cooperation icon imaging image, the pixel coordinate (u) of the unknown characteristic point is calculatedd,vd) Backward positioning is carried out by using the following formula, and the estimated value of the physical coordinate of the unknown characteristic point is obtained by solving
Wherein, h'ijThe ith row and the jth column of elements of an inverse matrix of the homography matrix H;
step 62: calculating the distance d between the physical coordinates of all the checkerboard feature points according to the estimated value of the physical coordinates of the unknown feature pointsij：
Wherein (X)ij,Yij) The physical coordinate of the feature point in the ith row and the jth column of the checkerboard in a world coordinate system is shown;
and step 63: will be a distance dijMinimum distance value dminThe physical coordinates of the checkerboard feature points are used as the physical coordinates of the unknown feature point pixel coordinates in the world coordinate system;
step 64: and traversing all unknown characteristic points in the unknown characteristic point set until physical coordinates corresponding to pixel coordinates of all unknown characteristic points are obtained, and completing the backward position matching of all unknown characteristic points.
The method solves the one-to-one correspondence between the pixel coordinates and the world coordinates under the condition that the characteristic points are lost, can detect the characteristic points of the complete checkerboard and the characteristic points of the incomplete checkerboard, and has strong robustness and strong environmental interference resistance.
The above description is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, several modifications and variations can be made without departing from the technical principle of the present invention, and these modifications and variations should also be regarded as the protection scope of the present invention.
Claims (10)
1. A quick feature point detection method for an incomplete checkerboard cooperation icon is characterized by comprising the following steps:
step 1: carrying out initial feature point detection on the checkerboard cooperation icon by using a Harris or Hessen feature operator, and forming initial feature points of the checkerboard cooperation icon by using pixel coordinates of the detected feature points;
step 2: screening the initial characteristic points of the checkerboard cooperation icon, and filtering the false-detection non-checkerboard characteristic points;
and step 3: using the remaining filtered initial feature points of the checkerboard cooperation icons as the checkerboard feature points to form a checkerboard feature point set, and detecting to obtain all checkerboard edge feature points;
and 4, step 4: forming an edge feature point set by the detected checkerboard edge feature points, detecting feature points positioned on the edge of the same checkerboard as checkerboard posterior feature points, and forming an unknown feature point set by using the remaining feature points in the checkerboard feature point set as unknown feature points;
and 5: establishing an equation set according to the one-to-one correspondence relationship between the pixel coordinates of the posterior feature points and the physical coordinates of the posterior feature points in the world coordinate system, and solving a homography matrix of the current checkerboard cooperation icon imaging image;
step 6: and carrying out backward positioning and position matching on all unknown characteristic points in the unknown characteristic point set according to the solved homography matrix of the imaging image of the current checkerboard cooperation icon, so as to realize the one-to-one correspondence between the pixel coordinates of all unknown characteristic points and the physical coordinates thereof.
2. The method as claimed in claim 1, wherein in step 2, the initial feature points of the tessellation cooperation icon are screened by using a tessellation cooperation icon feature point template matching verification method, and the false-detected non-tessellation feature points are filtered.
3. The method for detecting the quick feature points of the incomplete checkerboard cooperative icon as claimed in claim 2, wherein said step 2 specifically comprises the steps of:
step 21: establishing two checkerboard cooperation icon feature point templates, wherein each template is 10 multiplied by 10 pixels in size and is averagely divided into 4 regions, the gray values of the upper left region and the lower right region of the first template are 255, the gray values of the upper right region and the lower left region are 1, the gray values of the upper left region and the lower right region of the second template are 1, and the gray values of the upper right region and the lower left region are 255;
step 22: extracting a feature point subgraph with the same size as the feature point template by taking the initial feature point as a center, and performing convolution operation with the two checkerboard cooperation icon feature point templates respectively to obtain two similarity values between the feature point subgraph and the feature point template;
step 23: if one of the two similarity values is larger than the similarity threshold of the checkerboard feature points, the initial feature points are the checkerboard feature points, otherwise, the initial feature points are not the checkerboard feature points, and the initial feature points are deleted;
step 24: and traversing all initial feature points, and filtering all initial feature points which are not the checkerboard feature points.
4. The method as claimed in claim 1, wherein in said step 3, all feature points on the edge of the checkerboard are detected by using vector outer product detection method for said set of checkerboard feature points.
5. The method for fast detecting the feature points of the incomplete checkerboard cooperative icon as claimed in claim 4, wherein said step 3 comprises the steps of:
step 31: taking the remaining filtered initial feature points of the checkerboard cooperation icons as the checkerboard feature points to form a checkerboard feature point set;
step 32: establishing a vector to be detected by taking a first characteristic point in the checkerboard characteristic point set as a starting point and a second characteristic point as an end point, and sequentially calculating an outer product of the vector to be detected, the first characteristic point and other characteristic points;
step 33: if the outer product result of the vector to be detected, the first characteristic point and other characteristic points is the same positive or the same negative, then two characteristic points forming the vector to be detected are the checkerboard edge characteristic points; otherwise, selecting the next characteristic point as an end point to establish a vector to be detected, sequentially calculating the outer product of the vector to be detected, the first characteristic point and other characteristic points to form a vector, and judging again until all the characteristic points are traversed;
step 34: and with the second feature point as a starting point, continuously repeating the step 32 and the step 33, and so on until all the feature points are traversed to obtain edge feature points of all the checkerboards.
6. The method as claimed in claim 5, wherein in said step 4, the detected feature points on the edge of the checkerboard are grouped into edge feature point sets, and the feature points on the edge of the same checkerboard are detected by using vector outer product detection method as the posterior feature points of the checkerboard.
7. The method for fast feature point detection of incomplete checkerboard cooperative icons as claimed in claim 6, wherein said step 4 comprises the steps of:
step 41: forming an edge feature point set by the detected checkerboard edge feature points;
step 42: establishing a vector to be detected by taking a first edge feature point in the set as a starting point and a second edge feature point as an end point, and sequentially calculating an outer product of the vector to be detected, the first edge feature point and other edge feature points;
step 43: if the outer product of the vector to be detected, the first edge feature point and other edge feature points is smaller than a given collinear threshold value, two edge feature points forming the vector to be detected are collinear, namely the two edge feature points are on the same checkerboard edge; otherwise, selecting the next edge feature point as an end point to establish a vector to be detected, sequentially calculating the outer product of the vector to be detected, the first edge feature point and other edge feature points to form a vector, and judging again until all edge feature points are traversed;
step 44: and (3) continuously repeating the step (42) and the step (43) by taking the second edge feature point as a starting point, repeating the steps by analogy until all edge feature points are traversed, taking the feature points with the number of the detected feature points on the same edge equal to the number of the known edge feature points as checkerboard posterior feature points, and taking the rest feature points in the checkerboard feature point set as unknown feature points to form an unknown feature point set.
8. The method for fast detecting the feature points of the incomplete checkerboard cooperative icon as claimed in claim 7, wherein said step 5 is implemented as the following steps:
since the correspondence between the pixel coordinates of the posterior feature points and their physical coordinates is known, the posterior feature point pixel coordinates (u) are based onp,vp) With its physical coordinates (X) in the world coordinate systemw,Yw) The following homography matrix solution equations are established:
wherein H is a homography matrix of the imaging image of the current checkerboard cooperation icon, HijIs the ith row and the jth column element of the H matrix;
from the above formula, it can be seen that the homography matrix H has 8 unknown elements in total, two equations can be established for each pair of posterior feature point pixel coordinates and the physical coordinates thereof, and only 4 pairs of posterior feature point pixel coordinates and the physical coordinates thereof are needed to solve the 8 unknown elements of the homography matrix H.
9. The method for fast detecting the feature points of the incomplete checkerboard cooperative icon as claimed in claim 8, wherein said step 6 is implemented as the following steps:
step 61: according to the homography matrix H of the current checkerboard cooperation icon imaging image, the pixel coordinate (u) of the unknown characteristic point is calculatedd,vd) Backward positioning is carried out by using the following formula, and the estimated value of the physical coordinate of the unknown characteristic point is obtained by solving
Wherein, h'ijThe ith row and the jth column of elements of an inverse matrix of the homography matrix H;
step 62: calculating the distance d between the physical coordinates of all the checkerboard feature points according to the estimated value of the physical coordinates of the unknown feature pointsij：
Wherein (X)ij,Yij) The physical coordinate of the feature point in the ith row and the jth column of the checkerboard in a world coordinate system is shown;
and step 63: will be a distance dijMinimum distance value dminThe physical coordinates of the checkerboard feature points are used as the physical coordinates of the unknown feature point pixel coordinates in the world coordinate system;
step 64: and traversing all unknown characteristic points in the unknown characteristic point set until physical coordinates corresponding to pixel coordinates of all unknown characteristic points are obtained, and completing the backward position matching of all unknown characteristic points.
10. The method for rapidly detecting the feature points of the incomplete checkerboard cooperative icon as claimed in claim 1, wherein the method solves the one-to-one correspondence between the pixel coordinates and the world coordinates when the feature points are lost, can realize the detection of not only the feature points of the complete checkerboard but also the feature points of the incomplete checkerboard, and has strong robustness and strong anti-environmental interference capability.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110827007.0A CN113487675B (en) | 2021-07-21 | 2021-07-21 | Rapid feature point detection method for incomplete checkerboard cooperation icon |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110827007.0A CN113487675B (en) | 2021-07-21 | 2021-07-21 | Rapid feature point detection method for incomplete checkerboard cooperation icon |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113487675A true CN113487675A (en) | 2021-10-08 |
| CN113487675B CN113487675B (en) | 2023-04-07 |
Family
ID=77942850
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110827007.0A Active CN113487675B (en) | 2021-07-21 | 2021-07-21 | Rapid feature point detection method for incomplete checkerboard cooperation icon |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113487675B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114494316A (en) * | 2022-01-28 | 2022-05-13 | 瑞芯微电子股份有限公司 | Corner marking method, parameter calibration method, medium, and electronic device |
| CN115222825A (en) * | 2022-09-15 | 2022-10-21 | 湖南视比特机器人有限公司 | Calibration method, computer storage medium and calibration system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106504290A (en) * | 2016-10-20 | 2017-03-15 | 北京化工大学 | A kind of high-precision video camera dynamic calibrating method |
| US20200134866A1 (en) * | 2018-10-26 | 2020-04-30 | Fujitsu Limited | Position estimation system and position estimation method |
| CN111243032A (en) * | 2020-01-10 | 2020-06-05 | 大连理工大学 | An automatic detection method for checkerboard corner points |
| CN111260732A (en) * | 2020-01-10 | 2020-06-09 | 大连理工大学 | Corner point detection method based on visible light and infrared universal calibration board |
| CN111260731A (en) * | 2020-01-10 | 2020-06-09 | 大连理工大学 | Checkerboard sub-pixel level corner point self-adaptive detection method |
-
2021
- 2021-07-21 CN CN202110827007.0A patent/CN113487675B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106504290A (en) * | 2016-10-20 | 2017-03-15 | 北京化工大学 | A kind of high-precision video camera dynamic calibrating method |
| US20200134866A1 (en) * | 2018-10-26 | 2020-04-30 | Fujitsu Limited | Position estimation system and position estimation method |
| CN111243032A (en) * | 2020-01-10 | 2020-06-05 | 大连理工大学 | An automatic detection method for checkerboard corner points |
| CN111260732A (en) * | 2020-01-10 | 2020-06-09 | 大连理工大学 | Corner point detection method based on visible light and infrared universal calibration board |
| CN111260731A (en) * | 2020-01-10 | 2020-06-09 | 大连理工大学 | Checkerboard sub-pixel level corner point self-adaptive detection method |
Non-Patent Citations (2)
| Title |
|---|
| ALESSANDRO BEVILACQUA等: "Automatic Perspective Camera Calibration Based on an Incomplete Set of Chessboard Markers", 《2008 SIXTH INDIAN CONFERENCE ON COMPUTER VISION, GRAPHICS & IMAGE PROCESSING》 * |
| 洪磊等: "一种棋盘格靶标不完整角点识别的修正算法", 《计算机辅助设计与图形学学报》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114494316A (en) * | 2022-01-28 | 2022-05-13 | 瑞芯微电子股份有限公司 | Corner marking method, parameter calibration method, medium, and electronic device |
| CN115222825A (en) * | 2022-09-15 | 2022-10-21 | 湖南视比特机器人有限公司 | Calibration method, computer storage medium and calibration system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113487675B (en) | 2023-04-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112950667B (en) | Video labeling method, device, equipment and computer readable storage medium | |
| CN107451965B (en) | Distorted face image correction method, device, computer equipment and storage medium | |
| CN108388896B (en) | License plate identification method based on dynamic time sequence convolution neural network | |
| CN108960211B (en) | Multi-target human body posture detection method and system | |
| CN104408460B (en) | A kind of lane detection and tracking detection method | |
| CN112967339B (en) | Vehicle pose determining method, vehicle control method and device and vehicle | |
| CN107316326B (en) | Edge-based disparity map calculation method and device applied to binocular stereo vision | |
| US11080892B2 (en) | Computer-implemented methods and system for localizing an object | |
| CN109886124B (en) | Non-texture metal part grabbing method based on wire harness description subimage matching | |
| CN113487675B (en) | Rapid feature point detection method for incomplete checkerboard cooperation icon | |
| CN110188747A (en) | A kind of sloped correcting method of text image, device and image processing equipment | |
| CN105335952B (en) | Matching power flow computational methods and device and parallax value calculating method and equipment | |
| CN111696072B (en) | Color image straight line detection method, device, electronic equipment and storage medium | |
| CN112132874A (en) | Calibration-board-free different-source image registration method and device, electronic equipment and storage medium | |
| CN102982537A (en) | Scene change detection method and scene change detection system | |
| CN114037970A (en) | Sliding window-based lane line detection method, system, terminal and readable storage medium | |
| CN110111330A (en) | Mobile phone screen detection method | |
| CN117764977A (en) | Magnetic shoe surface defect detection method based on global feature enhancement and multi-scale fusion | |
| WO2020014913A1 (en) | Method for measuring volume of object, related device, and computer readable storage medium | |
| CN116128919A (en) | Multi-temporal image abnormal target detection method and system based on polar constraint | |
| CN107945119B (en) | Intra-image correlation noise estimation method based on Bayer pattern | |
| CN107403448B (en) | Cost function generation method and cost function generation device | |
| CN105654474A (en) | Mechanical arm positioning method based on visual guidance and device thereof | |
| CN109741370B (en) | Target tracking method and device | |
| Georgiev et al. | A fast and accurate re-calibration technique for misaligned stereo cameras |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |