[go: up one dir, main page]

CN118623760B - A method, system and device for detecting defects of a microdisplay - Google Patents

A method, system and device for detecting defects of a microdisplay Download PDF

Info

Publication number
CN118623760B
CN118623760B CN202410640727.XA CN202410640727A CN118623760B CN 118623760 B CN118623760 B CN 118623760B CN 202410640727 A CN202410640727 A CN 202410640727A CN 118623760 B CN118623760 B CN 118623760B
Authority
CN
China
Prior art keywords
coordinate parameter
image
coordinate
initial
parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202410640727.XA
Other languages
Chinese (zh)
Other versions
CN118623760A (en
Inventor
张景程
杨硕
张滨
罕方平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Seichitech Technology Co ltd
Original Assignee
Shenzhen Seichitech Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Seichitech Technology Co ltd filed Critical Shenzhen Seichitech Technology Co ltd
Priority to CN202410640727.XA priority Critical patent/CN118623760B/en
Publication of CN118623760A publication Critical patent/CN118623760A/en
Application granted granted Critical
Publication of CN118623760B publication Critical patent/CN118623760B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/002Measuring arrangements characterised by the use of optical techniques for measuring two or more coordinates
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • G01N2021/8887Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges based on image processing techniques

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)

Abstract

本申请公开了一种微显示器件的缺陷检测方法、系统及装置,用于提高微显示器的缺陷检测精度。本申请方法包括:获取微显示器的第一初始图像和第二初始图像;根据第一初始图像获取多个灯珠对应的第一初始坐标参数,以及根据第二初始图像获取多个灯珠对应的第二初始坐标参数;根据标准坐标参数获取第一初始坐标参数中的第一有效坐标参数和异常坐标参数;根据第一有效坐标参数获取异常坐标参数对应的第二有效坐标参数;根据第一有效坐标参数和第二有效坐标参数获取任一灯珠的第一物理坐标参数;根据第二初始坐标参数和标准坐标参数获取任一灯珠的第二物理坐标参数;根据第一物理坐标参数和第二物理坐标参数计算任一灯珠的坐标偏移量。

The present application discloses a defect detection method, system and device for a micro display device, which is used to improve the defect detection accuracy of the micro display. The present application method includes: obtaining a first initial image and a second initial image of the micro display; obtaining first initial coordinate parameters corresponding to a plurality of lamp beads according to the first initial image, and obtaining second initial coordinate parameters corresponding to a plurality of lamp beads according to the second initial image; obtaining first valid coordinate parameters and abnormal coordinate parameters in the first initial coordinate parameters according to the standard coordinate parameters; obtaining second valid coordinate parameters corresponding to the abnormal coordinate parameters according to the first valid coordinate parameters; obtaining first physical coordinate parameters of any lamp bead according to the first valid coordinate parameters and the second valid coordinate parameters; obtaining second physical coordinate parameters of any lamp bead according to the second initial coordinate parameters and the standard coordinate parameters; and calculating the coordinate offset of any lamp bead according to the first physical coordinate parameters and the second physical coordinate parameters.

Description

Method, system and device for detecting defects of micro-display
Technical Field
The present application relates to the field of display devices, and in particular, to a method, a system, and an apparatus for detecting defects of a micro display.
Background
The Micro display is a Micro flat display panel using Micro-LED (Micro-LIGHT EMITTING Diode) display technology or submillimeter LED (Mini-LIGHT EMITTING Diode) display technology. The Micro-LED chip and the Mini-LED chip have the characteristics of small size, high density and the like, but the surfaces of the Micro-LED chip and the Mini-LED chip are easy to be polluted, worn or other physical damage. Since any minor defect may affect the performance and reliability of Micro-LED chips or Mini-LED chips, it is important to improve the accuracy of defect detection in the manufacturing process of Micro-display devices.
At present, in order to meet the beat requirement of tension in defect detection, a high-speed camera is required to take a fly-shooting mode, capture an image in an extremely short time, and perform quick and accurate analysis so as to detect and record any defect or abnormality.
However, in the actual detection process, due to the high-speed movement of the detection platform or the camera, the acquired image may generate a larger offset, so that a plurality of lamp beads on the image cannot be accurately positioned, and thus accurate defect analysis cannot be performed according to the acquired image, and further defect detection accuracy is reduced.
Disclosure of Invention
The application provides a defect detection method, a defect detection system and a defect detection device for a micro-display, which can improve the defect detection precision of the micro-display.
The first aspect of the present application provides a defect detection method for a micro display, including:
Acquiring a first initial image and a second initial image of the micro-display, wherein the first initial image is an image acquired by a camera in a fly shooting mode, and the second initial image is an image acquired by a positioning component;
Acquiring first initial coordinate parameters corresponding to a plurality of lamp beads according to the first initial image, and acquiring second initial coordinate parameters corresponding to a plurality of lamp beads according to the second initial image;
Acquiring a first effective coordinate parameter and an abnormal coordinate parameter in the first initial coordinate parameter according to standard coordinate parameters corresponding to a plurality of lamp beads in a preset standard image;
acquiring a second effective coordinate parameter corresponding to the abnormal coordinate parameter according to the first effective coordinate parameter;
Acquiring a first physical coordinate parameter of any one of the lamp beads according to the first effective coordinate parameter and the second effective coordinate parameter;
acquiring a second physical coordinate parameter of any lamp bead according to the second initial coordinate parameter and the standard coordinate parameter;
And calculating the coordinate offset of any lamp bead according to the first physical coordinate parameter and the second physical coordinate parameter.
Optionally, the step of obtaining the first valid coordinate parameter and the abnormal coordinate parameter in the first initial coordinate parameter according to standard coordinate parameters corresponding to the plurality of lamp beads in the preset standard image includes:
acquiring the standard image of the micro display;
obtaining the standard coordinate parameters corresponding to the lamp beads according to the standard image;
Acquiring a correlation coefficient of the standard coordinate parameter and the first initial coordinate parameter;
judging whether the correlation coefficient is in a preset range or not;
If the correlation coefficient is in the preset range, judging whether the first initial coordinate parameter of each lamp bead is matched with the corresponding standard coordinate parameter;
if the first initial coordinate parameter of the lamp bead is matched with the corresponding standard coordinate parameter, determining that the first initial coordinate parameter of the lamp bead is a first effective coordinate parameter, and if the first initial coordinate parameter of the lamp bead is not matched with the corresponding standard coordinate parameter, determining that the first initial coordinate parameter of the lamp bead is an abnormal coordinate parameter.
Optionally, the step of obtaining the second valid coordinate parameter corresponding to the abnormal coordinate parameter according to the first valid coordinate parameter includes:
Acquiring the first effective coordinate parameters corresponding to the two adjacent lamp beads corresponding to the abnormal coordinate parameters;
and calculating a second effective coordinate parameter corresponding to the abnormal coordinate parameter by adopting an interpolation method.
Optionally, the step of obtaining the first physical coordinate parameter of any one of the lamp beads according to the first effective coordinate parameter and the second effective coordinate parameter includes:
acquiring a minimum circumscribed rectangle corresponding to any lamp bead according to the first effective coordinate parameter and the second effective coordinate parameter;
Obtaining a peripheral rectangle positioned at the periphery of the minimum circumscribed rectangle according to a preset interval;
Determining a transition area where the boundary of the lamp bead is located from the peripheral rectangle to the direction of the minimum circumscribed rectangle;
Threshold segmentation is carried out on the transition region, and boundary pixel points meeting preset conditions are screened;
Fitting a target rectangle corresponding to any lamp bead according to the obtained plurality of boundary pixel points;
Acquiring a coordinate value of a central pixel point positioned in the target rectangle;
and acquiring a first physical coordinate parameter of any lamp bead according to the coordinate value of the central pixel point and a preset calibration coefficient.
Optionally, the step of obtaining the second physical coordinate parameter of any one of the lamp beads according to the second initial coordinate parameter and the standard coordinate parameter includes:
Calculating the difference value between the standard coordinate parameter of any lamp bead and the corresponding second initial coordinate parameter;
And calculating a second physical coordinate parameter of any lamp bead according to the second initial coordinate parameter, the difference value and the acquired frame number value corresponding to the second initial image.
Optionally, the defect detection method further includes:
Dividing each lamp bead on the first initial image into a sub-area according to the first effective coordinate parameter and the second effective coordinate parameter;
acquiring characteristic information of the lamp beads in any one of the subareas;
calculating the reduction coordinate parameters of the lamp beads according to the characteristic information;
and acquiring a restored image according to the restored coordinate parameters.
Optionally, after the step of acquiring the restored image according to the restored coordinate parameters, the defect detection method further includes:
Differentiating the restored image and the standard image to obtain a differential image;
performing image preprocessing on the differential image;
Performing binarization processing on the difference image after image pretreatment;
carrying out connected region marking on the binarized differential image;
acquiring characteristic information of each communication area;
Judging whether the lamp beads positioned in any one of the communication areas have defects or not according to the characteristic information.
In a second aspect, the present application provides a defect detection system for a microdisplay, comprising:
The acquisition unit is used for acquiring a first initial image and a second initial image of the micro-display, wherein the first initial image is an image acquired by a camera in a fly shooting mode, the second initial image is an image acquired by a positioning component, and the acquisition unit is used for acquiring first initial coordinate parameters corresponding to a plurality of lamp beads according to the first initial image and acquiring second initial coordinate parameters corresponding to the lamp beads according to the second initial image;
The calculating unit is used for obtaining a first effective coordinate parameter and an abnormal coordinate parameter in the first initial coordinate parameter according to standard coordinate parameters corresponding to a plurality of lamp beads in a preset standard image, obtaining a second effective coordinate parameter corresponding to the abnormal coordinate parameter according to the first effective coordinate parameter, obtaining a first physical coordinate parameter of any lamp bead according to the first effective coordinate parameter and the second effective coordinate parameter, and obtaining a second physical coordinate parameter of any lamp bead according to the second initial coordinate parameter and the standard coordinate parameter, and calculating a coordinate offset of any lamp bead according to the first physical coordinate parameter and the second physical coordinate parameter.
Optionally, the defect detection system further includes a matching module, where the matching module is configured to divide each of the light beads on the first initial image into a sub-area according to the first effective coordinate parameter and the second effective coordinate parameter;
the matching module is also used for acquiring characteristic information of the lamp beads in any one of the subareas;
the matching module is also used for calculating the restoration coordinate parameters of the lamp beads according to the characteristic information;
the matching module is also used for acquiring a restored image according to the restored coordinate parameters.
Optionally, the defect detection system further includes a detection module, where the detection module is configured to differentiate the restored image from the standard image to obtain a differential image;
the detection module is also used for carrying out image preprocessing on the differential image;
The detection module is also used for carrying out binarization processing on the difference image after the image pretreatment;
the detection module is also used for marking the communication area of the difference image after binarization processing;
The detection module is also used for acquiring the characteristic information of each communication area;
The detection module is also used for judging whether the lamp beads positioned in any one of the communication areas have defects or not according to the characteristic information.
A third aspect of the present application provides a defect detection apparatus for a micro display, comprising a defect detection system for a micro display as described in the second aspect and a stage for placing a micro display to be tested.
From the above technical scheme, the application has the following effects:
The method comprises the steps of firstly obtaining a first initial image and a second initial image of a micro-display, wherein the first initial image is an image collected by a camera in a fly shooting mode, the second initial image is an image collected by a positioning component, then obtaining first initial coordinate parameters corresponding to a plurality of lamp beads according to the first initial image, wherein the first initial coordinate parameters comprise first effective coordinate parameters and abnormal coordinate parameters, and obtaining second initial coordinate parameters corresponding to a plurality of lamp beads according to the second initial image, obtaining first effective coordinate parameters and abnormal coordinate parameters in the first initial coordinate parameters according to standard coordinate parameters corresponding to a plurality of lamp beads in a preset standard image, obtaining second effective coordinate parameters corresponding to the abnormal coordinate parameters according to the first effective coordinate parameters, further obtaining first physical coordinate parameters of any lamp bead according to the first effective coordinate parameters and the second effective coordinate parameters, further obtaining second physical coordinate parameters of any lamp bead according to the second effective coordinate parameters and the standard coordinate parameters, and finally calculating coordinate offset of any lamp bead according to the first physical coordinate parameters and the second physical coordinate parameters. Through the steps, the first initial image acquired by the micro-display in the fly shooting mode can be initially positioned, first initial coordinate parameters corresponding to the lamp beads are acquired according to the initial positioning result, then a first effective coordinate parameter in the first initial coordinate parameters and a second effective coordinate parameter corresponding to the abnormal coordinate parameters are determined by utilizing a preset standard image, and then the first initial image is further positioned according to the first effective coordinate parameter and the second effective coordinate parameter in the first initial coordinate parameters, so that a first physical coordinate parameter with accurate positioning of the lamp beads is acquired. And positioning the reference points of the plurality of lamp beads according to a second initial coordinate parameter corresponding to the second initial image and a standard coordinate parameter corresponding to the standard image acquired by the positioning component to obtain a second physical coordinate parameter corresponding to the plurality of lamp beads, and finally determining coordinate offset corresponding to the plurality of lamp beads according to the first physical coordinate parameter and the second physical coordinate parameter. Therefore, the condition that the lamp beads are positioned inaccurately due to image offset can be reduced through multiple positioning, and further the defect detection precision of the micro display can be improved.
Drawings
FIG. 1 is a schematic diagram of a method for detecting defects of a micro display according to an embodiment of the present application;
FIGS. 2-1, 2-2, 2-3 and 2-4 are schematic views showing another embodiment of a method for detecting defects of a micro display according to the present application;
FIG. 3 is a schematic diagram of a defect detection system for a micro-display according to an embodiment of the present application;
FIG. 4 is a schematic diagram of a defect detection system for a micro-display according to another embodiment of the present application;
FIG. 5 is a schematic diagram of a defect detecting device for a micro-display according to an embodiment of the application.
Detailed Description
The application provides a defect detection method, a defect detection system and a defect detection device for a micro-display, which are used for improving the defect detection precision of the micro-display.
The defect detection method of the micro display described by the application is applied to a server, a system, a terminal or other devices with logic processing capability for implementation, and the application is not limited to the method. An embodiment of the present application will be described by taking a system with image analysis and processing capabilities as an example, referring to fig. 1, and an embodiment of a defect detection method of a micro display according to the present application includes:
101. the system acquires a first initial image and a second initial image of the micro-display, wherein the first initial image is an image acquired by the camera in a shooting mode, and the second initial image is an image acquired by the positioning component.
In this embodiment, the aperture focal length of the camera lens is fixed under the condition of meeting the high-speed fly-swatter mode, then the positional relationship between the detection platform and the camera is adjusted, the point light source is fixed on one side of the camera lens, and the camera parameters are stored, so as to complete the preparation work in the early stage. When the high-speed flying shooting mode is started, shooting action of the camera is triggered, image acquisition of the micro-display is completed, a first initial image of the micro-display is generated, and the first initial image is transmitted to the system. Before the first initial image is acquired by using the fly-swatting mode, the positioning component is required to acquire the image of the micro-display in the static state to obtain a second initial image.
It should be noted that, when the camera completes shooting in the fly-swatting mode, the first initial image is often degraded by interference and influence of various noises during the process of acquiring, transmitting and storing the first initial image. Therefore, in order to improve the image quality of the first initial image, it may be first subjected to noise reduction processing using a mean filtering algorithm or a gaussian filtering algorithm. When using the mean filtering algorithm, a3×3 mean filtering window may be used to filter the first initial image. When using a gaussian filtering algorithm, the signal may be weighted averaged using a gaussian function as a filter to smooth the signal and reduce noise, filtering the first initial image.
102. The system acquires first initial coordinate parameters corresponding to the plurality of lamp beads according to the first initial image, and acquires second initial coordinate parameters corresponding to the plurality of lamp beads according to the second initial image.
In this embodiment, the system performs bead feature extraction on all the beads on the first initial image, and determines a first initial coordinate parameter corresponding to each bead on the first initial image according to the extracted bead feature information. And similarly, the system extracts the lamp bead characteristics of all the lamp beads on the second initial image, and determines second initial coordinate parameters corresponding to all the lamp beads on the second initial image according to the extracted lamp bead characteristic information.
In this embodiment, the first initial coordinate parameter includes a coordinate value of a geometric center of the lamp bead and a distance from the geometric center of the lamp bead to a boundary of the lamp bead. For example, in the row direction, the distance from the geometric center of the beads to the boundary of the beads is L1, and in the column direction, the distance from the geometric center of the beads to the boundary of the beads is L2. Wherein L1 and L2 may be equal or unequal.
103. The system acquires a first effective coordinate parameter and an abnormal coordinate parameter in a first initial coordinate parameter according to standard coordinate parameters corresponding to a plurality of lamp beads in a preset standard image.
In this embodiment, because the first initial image acquired by the system in the fly-swatter mode may be offset, deformed, blurred, etc., the first initial coordinate parameter acquired by the system according to the first initial image is a rough coordinate parameter, and the first initial coordinate parameter includes a first effective coordinate parameter with higher positioning accuracy and an abnormal coordinate parameter with lower positioning accuracy. At this time, the system may select an image with good be decorated with lanterns beads, obvious features and clear background from the several finished microdisplay images as a standard image, and compare the standard image with the first initial image to determine a first effective coordinate parameter and an abnormal coordinate parameter in the first initial coordinate parameter.
104. And the system acquires a second effective coordinate parameter corresponding to the abnormal coordinate parameter according to the first effective coordinate parameter.
In this embodiment, after determining the first effective coordinate parameter and the abnormal coordinate parameter in the first initial coordinate parameter, the system needs to determine the second effective coordinate parameter corresponding to the abnormal coordinate parameter, and specifically may use an interpolation method to fit the second effective coordinate parameter corresponding to the abnormal coordinate parameter according to the known first effective coordinate parameter.
105. And the system acquires the first physical coordinate parameter of any lamp bead according to the first effective coordinate parameter and the second effective coordinate parameter.
In this embodiment, the system obtains the first effective coordinate parameter and the second effective coordinate parameter as effective coordinates of each bead on the first initial image on the image coordinate system, and the system needs to convert the effective coordinates into the first physical coordinate parameter by using a preset calibration coefficient, where the first physical coordinate parameter is a real physical coordinate of each bead on the first initial image, where the real physical coordinate is a point location of a flyswath. It can be understood that when the first effective coordinate parameter and the second effective coordinate parameter are converted into the first physical coordinate parameter, each bead can be further positioned, that is, a mode of searching an edge area by using a minimum circumscribed rectangle is used for determining a more accurate coordinate of each bead, and then the coordinate is converted into the first material coordinate parameter by using a preset calibration coefficient, so that a subsequent embodiment of a specific implementation process is described again.
106. And the system acquires the second physical coordinate parameter of any lamp bead according to the second initial coordinate parameter and the standard coordinate parameter.
In this embodiment, the system first performs a difference between the first initial coordinate parameter and the standard coordinate parameter, and then obtains a second physical coordinate parameter of each lamp bead according to the obtained difference, where the second physical coordinate parameter is a real physical coordinate of the standard point bit corresponding to each lamp bead relative to the flyswatter point.
107. And the system calculates the coordinate offset of any lamp bead according to the first physical coordinate parameter and the second physical coordinate parameter.
The system can obtain the coordinate offset corresponding to each lamp bead by differencing the calculated first physical coordinate parameter and the second physical coordinate parameter, and the coordinate offset is the real physical offset of the lamp bead.
In this embodiment, a first initial image and a second initial image of the micro-display are first acquired, where the first initial image is an image acquired by the camera in the fly-shooting mode, and the second initial image is an image acquired by the positioning component. And then acquiring first initial coordinate parameters corresponding to the plurality of lamp beads according to the first initial image, wherein the first initial coordinate parameters comprise first effective coordinate parameters and abnormal coordinate parameters, and acquiring second initial coordinate parameters corresponding to the plurality of lamp beads according to the second initial image. And acquiring a first effective coordinate parameter and an abnormal coordinate parameter in the first initial coordinate parameter according to standard coordinate parameters corresponding to a plurality of lamp beads in a preset standard image. And acquiring a second effective coordinate parameter corresponding to the abnormal coordinate parameter according to the first effective coordinate parameter. And further acquiring the first physical coordinate parameter of any lamp bead according to the first effective coordinate parameter and the second effective coordinate parameter. And further acquiring a second physical coordinate parameter of any lamp bead according to the second initial coordinate parameter and the standard coordinate parameter. And finally, calculating the coordinate offset of any lamp bead according to the first physical coordinate parameter and the second physical coordinate parameter. Through the method, the first initial image acquired by the micro-display in the fly shooting mode can be initially positioned, first initial coordinate parameters corresponding to the lamp beads are acquired according to the initial positioning result, then a first effective coordinate parameter in the first initial coordinate parameters and a second effective coordinate parameter corresponding to the abnormal coordinate parameters are determined by utilizing a preset standard image, then the first initial image is further positioned according to the first effective coordinate parameter and the second effective coordinate parameter in the first initial coordinate parameters, and the first physical coordinate parameters with accurate positioning of the lamp beads are acquired. And positioning the reference points of the plurality of lamp beads according to a second initial coordinate parameter corresponding to the second initial image and a standard coordinate parameter corresponding to the standard image acquired by the positioning component to obtain a second physical coordinate parameter corresponding to the plurality of lamp beads, and finally determining coordinate offset corresponding to the plurality of lamp beads according to the first physical coordinate parameter and the second physical coordinate parameter. Therefore, the condition that the lamp beads are positioned inaccurately due to image offset can be reduced through multiple positioning, and then the defect detection precision of the micro-display can be improved.
Referring to fig. 2-1, 2-2, 2-3 and 2-4, another embodiment of a defect detection method for a micro display according to the present application includes:
201. The system takes a first initial image and a second initial image of the micro-display, wherein the first initial image is an image acquired by the camera in a shooting mode, and the second initial image is an image acquired by the positioning component.
202. The system acquires first initial coordinate parameters corresponding to the plurality of lamp beads according to the first initial image, and acquires second initial coordinate parameters corresponding to the plurality of lamp beads according to the second initial image.
Steps 201 to 202 in this embodiment are similar to steps 101 to 102 in the embodiment shown in fig. 1, and will not be described here again.
203. The system acquires a standard image of the microdisplay.
204. And the system acquires standard coordinate parameters corresponding to the lamp beads according to the standard image.
205. The system obtains a correlation coefficient of the standard coordinate parameter and the first initial coordinate parameter.
206. The system determines whether the correlation coefficient is within a preset range, and if so, performs step 207.
207. The system determines whether the first initial coordinate parameter of each bead matches the corresponding standard coordinate parameter, if so, then step 208 is executed, and if not, then step 209 is executed.
208. The system determines a first initial coordinate parameter of the light bead as a first valid coordinate parameter.
209. The system determines the first initial coordinate parameter of the lamp bead as an abnormal coordinate parameter.
Optionally, in this embodiment, after the system acquires the standard image, the system extracts the image features of each bead on the standard image, and determines the standard coordinate coefficient corresponding to each bead according to the extracted image feature information. And sliding the standard image on the first initial image one by one along the possible position areas of each lamp bead, and calculating the correlation coefficient between the standard coordinate parameter and the first initial coordinate parameter of the current lamp bead in each sliding process. When calculating the correlation coefficient, zero-averaging is needed to be carried out on the standard coordinate parameter and the first initial coordinate parameter, and then the normalized cross-correlation between the standard coordinate parameter and the first initial coordinate parameter is calculated, specifically, the normalized cross-correlation can be calculated by adopting the following formula:
wherein (x ', y') represents a standard coordinate parameter of any one of the lamp beads on the standard image, (x, y) represents a first initial coordinate parameter of any one of the lamp beads on the first initial image, T (x+x ', y+y') represents a current pixel value of the standard image, I (x ', y') represents a current pixel value of the first initial image, Representing the average pixel value of the standard image,Representing the average pixel value of the first initial image, NCC (x, y) represents the correlation coefficient of the standard coordinate parameter with the first initial coordinate parameter. The numerator part of the formula is the covariance of the two signals and the denominator part is the product of their respective standard deviations for normalizing the cross-correlation value results to within the range of [ -1, 1]. If NCC (x, y) is close to 1, it means that the area of possible locations of the current lamp beads in the first initial image is highly similar to the standard image. If NCC (x, y) is close to-1, it indicates that the area of possible locations of the current lamp bead in the first initial image is highly opposite to the standard image. If NCC (x, y) is close to 0, it indicates that the possible location area of the current lamp bead in the first initial image has no obvious correlation with the standard image. Therefore, the standard image and all possible position areas of the lamp beads near a certain lamp bead A can be subjected to correlation coefficient calculation one by one, whether the correlation coefficient is in a preset range or not is judged, and if the correlation coefficient is in the preset range, whether the first initial coordinate parameter of the lamp bead A is matched with the corresponding standard coordinate parameter is continuously judged. If the first initial coordinate parameter of the lamp bead A is matched with the corresponding standard coordinate parameter, the first initial coordinate parameter of the lamp bead A is indicated to be a first effective coordinate parameter. If the first initial coordinate parameter of the lamp bead A is not matched with the corresponding standard coordinate parameter, the first initial coordinate parameter of the lamp bead A is an abnormal coordinate parameter.
210. The system obtains first effective coordinate parameters corresponding to two adjacent lamp beads corresponding to the abnormal coordinate parameters.
211. The system calculates a second effective coordinate parameter corresponding to the abnormal coordinate parameter by adopting an interpolation method.
Alternatively, in this embodiment, the system may first arrange all the first initial coordinate parameters according to the distribution of the lamp beads, and then select all the first initial coordinate parameters located in the same row as the abnormal coordinate parameters or all the first initial coordinate parameters located in the same column as the abnormal coordinate parameters. And selecting two first effective coordinate parameters adjacent to the abnormal coordinate parameter from all the selected first initial coordinate parameters, and finally carrying out coordinate fitting on the two first effective coordinate parameters by using an interpolation method to obtain a second effective coordinate parameter corresponding to the abnormal coordinate parameter.
212. And the system acquires the minimum circumscribed rectangle corresponding to any lamp bead according to the first effective coordinate parameter and the second effective coordinate parameter.
213. And the system acquires the peripheral rectangle positioned at the periphery of the minimum circumscribed rectangle according to the preset interval.
214. The system determines the transition area where the boundary of the lamp bead is located from the peripheral rectangle to the direction of the minimum circumscribed rectangle.
215. The system performs threshold segmentation on the transition region and screens boundary pixel points meeting preset conditions.
216. And fitting a target rectangle corresponding to any lamp bead according to the acquired plurality of boundary pixel points by the system.
217. The system acquires the coordinate value of the central pixel point positioned in the target rectangle.
218. The system acquires a first physical coordinate parameter of any lamp bead according to the coordinate value of the central pixel point and a preset calibration coefficient.
Alternatively, in this embodiment, the minimum circumscribed rectangle of the lamp beads refers to a minimum area rectangle that may contain the target lamp beads. After the system obtains the first effective coordinate parameters and the second effective coordinate parameters of all the lamp beads, the minimum circumscribed rectangle of the corresponding lamp beads can be solved according to the first effective coordinate parameters or the second effective coordinate parameters corresponding to each lamp bead, and the system can be realized by adopting a rotating shell clamping method, namely, firstly, a convex shell of a target lamp bead region is solved, then the minimum circumscribed rectangle of the convex shell is solved, and a specific minimum circumscribed rectangle solving algorithm is not limited. Each side of the minimum bounding rectangle is a vertical direction or a parallel direction, the vertical direction is a direction perpendicular to one coordinate axis in the image coordinate system of the first initial image, and the parallel direction is a direction parallel to the coordinate axis.
The minimum circumscribed rectangle is expanded by a preset interval to obtain a peripheral rectangle of the periphery, for example, 30 pixels are expanded, and specific expansion parameters are not limited here according to actual requirements. And then, taking the rectangular edge of the peripheral rectangle as a base point, and carrying out edge detection towards the direction of the minimum circumscribed rectangle so as to determine the transition area where the boundary of the lamp bead is positioned. And then, carrying out threshold segmentation on the transition region, screening out boundary pixel points meeting preset conditions, and fitting out a target rectangle corresponding to the lamp bead according to the boundary pixel points, wherein the target rectangle is the minimum circumscribed rectangle corresponding to the real outline of the lamp bead. And finally, acquiring the coordinate value of the central pixel point in the target rectangle, wherein the coordinate value of the central pixel point is the real coordinate value of the image coordinate system of any lamp bead on the first initial image. Setting the coordinate value of the central pixel point of any lamp bead asThe first physical coordinate parameter corresponding to the lamp bead is thatWherein the method comprises the steps of
219. The system calculates the difference between the standard coordinate parameter of any lamp bead and the corresponding second initial coordinate parameter.
220. And the system calculates a second physical coordinate parameter of any lamp bead according to the second initial coordinate parameter, the difference value and the frame number value corresponding to the acquired second initial image.
Optionally, in this embodiment, the second initial coordinate parameter of any one of the lamp beads is set asThe difference value between the standard coordinate parameter and the second initial coordinate parameter of the corresponding lamp bead isThe second physical coordinate parameters corresponding to the lamp beads areThe calculation formula of the second physical coordinate parameter is as follows:
wherein n is the number of frames corresponding to the current second initial image, AndThe difference between the standard coordinate parameter and the second initial coordinate parameter in the x-direction and the y-direction, respectively.
221. And the system calculates the coordinate offset of any lamp bead according to the first physical coordinate parameter and the second physical coordinate parameter.
In this embodiment, after the first physical coordinate parameter and the second physical coordinate parameter are obtained, the difference between the first physical coordinate parameter and the second physical coordinate parameter may be made, and the corresponding difference may be determined as the coordinate offset of the lamp bead. The coordinate offset of any one lamp bead is set as offset (offset x,offsety), and the corresponding calculation formula is as follows:
Wherein, An x-axis coordinate value that is a first physical coordinate parameter,A y-axis coordinate value that is a first physical coordinate parameter,An x-axis coordinate value that is a second physical coordinate parameter,Is the y-axis coordinate value of the second physical coordinate parameter.
222. And the system divides each lamp bead on the first initial image into a sub-area according to the first effective coordinate parameter and the second effective coordinate parameter.
223. The system acquires the characteristic information of the lamp beads in any sub-area.
224. And the system calculates the restoration coordinate parameters of the lamp beads according to the characteristic information.
225. And the system acquires a restored image according to the restored coordinate parameters.
Optionally, in this embodiment, in the high-speed fly-shooting mode, due to the high-speed motion of the detection platform or the industrial camera, the target image may be blurred, slightly deformed, distorted, and the like, so that the real defect on the surface of the lamp bead cannot be extracted. Therefore, the Lucas-Kanade algorithm can be adopted to correct the fine deformation of the lamp beads, so as to detect the real surface defects. The Lucas-Kanade algorithm is a method for finding the correspondence between the previous frame and the current frame by using the change of pixels in an image sequence in a time domain and the correlation between adjacent frames, so as to calculate the motion information of an object between the adjacent frames, and the basic idea is based on the following three assumptions:
1. The brightness is constant, namely, the brightness of the same point is not changed along with the change of time.
2. The motion is that the change of time does not cause the severe change of the position, and the gray level change caused by the unit position change between the front frame and the rear frame can be used for approximating the partial derivative of gray level to the position only under the condition of small motion.
3. Spatially consistent-adjacent points on a scene are projected onto the image as well as adjacent points, and the adjacent points are at a consistent speed. Since the optical flow method basic equation constraint is only one, and the velocity in the x and y directions is required, there are two unknown variables, so that n equations need to be solved continuously.
The basic constraint equation is:
Let a pixel I (x, y, t) be at the light intensity of the first frame (where t represents the time dimension in which it is located). It moves the distance (dx, dy) to the next frame, taking the dt time. Because of the same pixel, the light intensity of the pixel before and after the motion is assumed to be unchanged, namely:
I(x,y,t)=I(x+dx,y+dy,t+dt)
After the right side of the formula is unfolded by using the Taylor formula, the following steps are obtained:
let u, v be the velocity vectors of the x-axis and y-axis, respectively, namely:
Is provided with Then there are:
Ixdx+Iydy+Itdt=0
Ixu+Iyv=-It
The matrix is expressed as follows:
Finally, the least square method is utilized to obtain:
Wherein, And finally solving the optical flow.
The system cuts each lamp bead on the first initial image according to the first effective coordinate parameter or the second effective coordinate parameter corresponding to the lamp beads so as to divide each lamp bead into a sub-area. Then, the system performs feature extraction on the lamp beads in each sub-area to obtain corresponding feature information. And inputting the characteristic information into the basic constraint equation of the Lucas-Kanade algorithm, and determining the restoration coordinate parameters of the corresponding lamp beads according to the solved optical flow. And finally, mapping the restored coordinate parameters of all the lamp beads to the first initial image to obtain a restored image of the micro display.
226. And the system carries out difference on the restored image and the standard image to obtain a difference image.
227. The system performs image preprocessing on the differential image.
228. The system carries out binarization processing on the difference image after the image preprocessing.
229. And the system marks the connected region of the binarized differential image.
230. The system acquires the characteristic information of each communication area.
231. The system judges whether the lamp beads positioned in any communication area have defects or not according to the characteristic information.
Optionally, in this embodiment, the restored image and the standard image are first differentiated, and a differential image of the restored image and the standard image is obtained. Then, the obtained differential image is subjected to image preprocessing, and the image preprocessing process can comprise graying processing and denoising processing. The graying process is to convert the color image into gray image to simplify the subsequent process. The denoising process is to remove noise in the image using a filter (e.g., a gaussian filter). After the image preprocessing is completed, binarization processing is performed, and the differential image is converted into a black-and-white image, so that defects and a background can be clearly distinguished, and the binarization processing can be completed by using methods such as threshold segmentation or adaptive threshold segmentation, and the like, and the method is not limited in the specification. And then, carrying out connected region marking on the binarized differential image, identifying each connected region in the image, and finishing the connected region marking by using a connected component marking algorithm. And extracting the characteristic information of each marked connected region, such as the characteristic information of area, perimeter, shape and the like, and distinguishing the normal part from the defect part in the image through the characteristic information of the part. Finally, according to the extracted characteristic information, a proper rule or model is designed to judge whether the lamp beads of each communication area have defects or not, for example, the lamp beads can be judged according to the characteristics of the area, the perimeter and the like, and then the judgment result is analyzed and recorded to generate a lamp bead surface defect detection result of the micro-display. It is worth mentioning that after the detection of the surface defects of the lamp beads is completed, performance evaluation can be performed according to the defect detection process, wherein the performance evaluation comprises indexes such as accuracy, recall, false detection rate and the like, so as to verify the effectiveness and reliability of the lamp beads.
Referring to fig. 3, an embodiment of a defect detection system for a micro display according to the present application includes:
the acquiring unit 301 is configured to acquire a first initial image and a second initial image of the micro display, where the first initial image is an image acquired by the camera in a fly-by mode, the second initial image is an image acquired by the positioning component, and is configured to acquire a first initial coordinate parameter corresponding to the plurality of light beads according to the first initial image, and acquire a second initial coordinate parameter corresponding to the plurality of light beads according to the second initial image.
The calculating unit 302 is configured to obtain a first effective coordinate parameter and an abnormal coordinate parameter in a first initial coordinate parameter according to standard coordinate parameters corresponding to a plurality of lamp beads in a preset standard image, and obtain a second effective coordinate parameter corresponding to the abnormal coordinate parameter according to the first effective coordinate parameter, where the calculating unit is further configured to obtain a first physical coordinate parameter of any lamp bead according to the first effective coordinate parameter and the second effective coordinate parameter, and to obtain a second physical coordinate parameter of any lamp bead according to the second initial coordinate parameter and the standard coordinate parameter, and to calculate a coordinate offset of any lamp bead according to the first physical coordinate parameter and the second physical coordinate parameter.
In this embodiment, the acquiring unit 301 acquires a first initial image and a second initial image of the micro-display, where the first initial image is an image acquired by the camera in the fly-by mode, the second initial image is an image acquired by the positioning component, and is used for acquiring a first initial coordinate parameter corresponding to a plurality of beads according to the first initial image and a second initial coordinate parameter corresponding to a plurality of beads according to the second initial image, and the calculating unit 302 acquires a first effective coordinate parameter and an abnormal coordinate parameter in the first initial coordinate parameter according to standard coordinate parameters corresponding to a plurality of beads in a preset standard image, and acquires a second effective coordinate parameter corresponding to the abnormal coordinate parameter according to the first effective coordinate parameter and the second effective coordinate parameter, and is also used for acquiring a first physical coordinate parameter of any bead according to the first effective coordinate parameter and the second effective coordinate parameter, and is used for acquiring a second physical coordinate parameter of any bead according to the second physical coordinate parameter and the second physical coordinate parameter of any bead, and is used for calculating a coordinate offset of any bead according to the first physical coordinate parameter and the second physical coordinate parameter of the second physical coordinate parameter. Through the method, the first initial image acquired by the micro-display in the fly shooting mode can be initially positioned, first initial coordinate parameters corresponding to the lamp beads are acquired according to the initial positioning result, then a first effective coordinate parameter in the first initial coordinate parameters and a second effective coordinate parameter corresponding to the abnormal coordinate parameters are determined by utilizing a preset standard image, then the first initial image is further positioned according to the first effective coordinate parameter and the second effective coordinate parameter in the first initial coordinate parameters, and the first physical coordinate parameters with accurate positioning of the lamp beads are acquired. And positioning the reference points of the plurality of lamp beads according to a second initial coordinate parameter corresponding to the second initial image and a standard coordinate parameter corresponding to the standard image acquired by the positioning component to obtain a second physical coordinate parameter corresponding to the plurality of lamp beads, and finally determining coordinate offset corresponding to the plurality of lamp beads according to the first physical coordinate parameter and the second physical coordinate parameter. Therefore, the condition that the lamp beads are positioned inaccurately due to image offset can be reduced through multiple positioning, and then the defect detection precision of the micro-display can be improved.
Referring to fig. 4, another embodiment of a defect detection system of a micro display according to the present application includes:
the acquiring unit 401 is configured to acquire a first initial image and a second initial image of the micro display, where the first initial image is an image acquired by the camera in a fly-by mode, the second initial image is an image acquired by the positioning component, and is configured to acquire a first initial coordinate parameter corresponding to the plurality of light beads according to the first initial image, and acquire a second initial coordinate parameter corresponding to the plurality of light beads according to the second initial image.
The computing unit 402 is specifically configured to acquire a standard image of the micro display. And obtaining standard coordinate parameters corresponding to the lamp beads according to the standard image. And obtaining the correlation coefficient of the standard coordinate parameter and the first initial coordinate parameter. Judging whether the correlation coefficient is in a preset range. If the correlation coefficient is within the preset range, judging whether the first initial coordinate parameter of each lamp bead is matched with the corresponding standard coordinate parameter. If the first initial coordinate parameter of the lamp bead is matched with the corresponding standard coordinate parameter, determining the first initial coordinate parameter of the lamp bead as a first effective coordinate parameter, and if the first initial coordinate parameter of the lamp bead is not matched with the corresponding standard coordinate parameter, determining the first initial coordinate parameter of the lamp bead as an abnormal coordinate parameter. And obtaining a second effective coordinate parameter corresponding to the abnormal coordinate parameter according to the first effective coordinate parameter, and obtaining first effective coordinate parameters corresponding to two adjacent lamp beads corresponding to the abnormal coordinate parameter. And calculating a second effective coordinate parameter corresponding to the abnormal coordinate parameter by adopting an interpolation method. The computing unit is also specifically used for acquiring a minimum circumscribed rectangle corresponding to any lamp bead according to the first effective coordinate parameter and the second effective coordinate parameter. And acquiring a peripheral rectangle positioned at the periphery of the minimum circumscribed rectangle according to the preset interval. And determining the transition area where the boundary of the lamp bead is located from the peripheral rectangle to the direction of the minimum circumscribed rectangle. And carrying out threshold segmentation on the transition region, and screening boundary pixel points meeting preset conditions. Fitting a target rectangle corresponding to any lamp bead according to the obtained plurality of boundary pixel points. And acquiring coordinate values of a central pixel point positioned in the target rectangle. And acquiring a first physical coordinate parameter of any lamp bead according to the coordinate value of the central pixel point and a preset calibration coefficient. And the method is specifically used for calculating the difference value between the standard coordinate parameter of any lamp bead and the corresponding second initial coordinate parameter. And calculating a second physical coordinate parameter of any lamp bead according to the second initial coordinate parameter, the difference value and the frame number value corresponding to the acquired second initial image. And the coordinate offset of any lamp bead is calculated according to the first physical coordinate parameter and the second physical coordinate parameter.
The matching module 403 is configured to divide each bead on the first initial image into a sub-area according to the first effective coordinate parameter and the second effective coordinate parameter. The matching module is also used for acquiring the characteristic information of the lamp beads in any sub-area. The matching module is also used for calculating the restoration coordinate parameters of the lamp beads according to the characteristic information. The matching module is also used for acquiring a restored image according to the restored coordinate parameters.
The detection module 404 is configured to differentiate the restored image from the standard image to obtain a differential image. The detection module is also used for carrying out image preprocessing on the differential image. The detection module is also used for carrying out binarization processing on the difference image after the image preprocessing. The detection module is also used for marking the connected region of the binarized differential image. The detection module is also used for acquiring the characteristic information of each communication area. The detection module is also used for judging whether the lamp beads positioned in any communication area have defects or not according to the characteristic information.
In this embodiment, the functions of each unit and module are similar to those of steps 201 to 231 in the embodiments shown in fig. 2-1, 2-2, 2-3 and 2-4, and will not be described here again.
Referring to fig. 5, an embodiment of a defect detecting device for a micro-display of the present application includes a defect detecting system for a micro-display of the embodiment shown in fig. 3 or fig. 4 and a workbench for placing the micro-display to be detected, and specifically includes a central processing unit 502, a memory 501, an input/output interface 503, a wired or wireless network interface 504 and a power source 505.
Memory 501 is a transient memory or a persistent memory.
The central processor 502 is configured to communicate with the memory 501 and to execute the operations of the instructions in the memory 501 to perform the steps of the embodiments shown in the foregoing figures 1-2-1, 2-2, 2-3 and 2-4.
The defect detection device of the microdisplay also provides a computer readable storage medium comprising instructions that when executed on a computer cause the computer to perform the steps of the embodiments of fig. 1-2-1, 2-2, 2-3 and 2-4 described above.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, which are not repeated herein.
In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of elements is merely a logical functional division, and there may be additional divisions of actual implementation, e.g., multiple elements or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods of the embodiments of the present application. The storage medium includes a usb disk, a removable hard disk, a read-only memory (ROM), a random-access memory (RAM, random access memory), a magnetic disk, an optical disk, or other various media capable of storing program codes.

Claims (7)

1.一种微显示器的缺陷检测方法,其特征在于,包括:1. A defect detection method for a microdisplay, comprising: 获取所述微显示器的第一初始图像和第二初始图像,所述第一初始图像为相机在飞拍模式下所采集的图像,所述第二初始图像为定位组件所采集的图像,所述定位组件用于对处于静态状态下的所述微显示器进行图像采集;Acquire a first initial image and a second initial image of the microdisplay, wherein the first initial image is an image captured by a camera in a flying mode, and the second initial image is an image captured by a positioning component, wherein the positioning component is used to capture an image of the microdisplay in a static state; 根据所述第一初始图像获取多个灯珠对应的第一初始坐标参数,以及根据所述第二初始图像获取多个所述灯珠对应的第二初始坐标参数;Acquire first initial coordinate parameters corresponding to a plurality of lamp beads according to the first initial image, and acquire second initial coordinate parameters corresponding to the plurality of lamp beads according to the second initial image; 根据预设的标准图像中的多个所述灯珠对应的标准坐标参数获取所述第一初始坐标参数中的第一有效坐标参数和异常坐标参数;Acquire the first valid coordinate parameter and the abnormal coordinate parameter in the first initial coordinate parameter according to the standard coordinate parameters corresponding to the plurality of lamp beads in the preset standard image; 根据所述第一有效坐标参数获取所述异常坐标参数对应的第二有效坐标参数;Acquire a second valid coordinate parameter corresponding to the abnormal coordinate parameter according to the first valid coordinate parameter; 根据所述第一有效坐标参数和所述第二有效坐标参数获取任一所述灯珠的第一物理坐标参数;Acquire a first physical coordinate parameter of any of the lamp beads according to the first effective coordinate parameter and the second effective coordinate parameter; 根据所述第二初始坐标参数和所述标准坐标参数获取任一所述灯珠的第二物理坐标参数;Acquire a second physical coordinate parameter of any of the lamp beads according to the second initial coordinate parameter and the standard coordinate parameter; 根据所述第一物理坐标参数和所述第二物理坐标参数计算任一所述灯珠的坐标偏移量;Calculate the coordinate offset of any of the lamp beads according to the first physical coordinate parameter and the second physical coordinate parameter; 所述缺陷检测方法还包括:The defect detection method further comprises: 根据所述第一有效坐标参数和所述第二有效坐标参数将所述第一初始图像上的每一所述灯珠分别划分为一个子区域;获取任一所述子区域中的所述灯珠的特征信息;根据所述特征信息计算所述灯珠的还原坐标参数;Divide each of the lamp beads on the first initial image into a sub-region according to the first effective coordinate parameter and the second effective coordinate parameter; obtain feature information of the lamp beads in any of the sub-regions; calculate the restored coordinate parameters of the lamp beads according to the feature information; 根据所述还原坐标参数获取还原图像;Acquire a restored image according to the restored coordinate parameters; 将所述还原图像与所述标准图像进行差分,得到差分图像;对所述差分图像进行图像预处理;对图像预处理后的差分图像进行二值化处理;将二值化处理后的差分图像进行连通区域标记;获取每一所述连通区域的特征信息;根据所述特征信息判断位于任一所述连通区域的所述灯珠是否存在缺陷。The restored image is differentiated from the standard image to obtain a differential image; the differential image is preprocessed; the differential image after image preprocessing is binarized; the connected area of the differential image after binarization is marked; characteristic information of each connected area is obtained; and whether the lamp bead located in any of the connected areas is defective is determined based on the characteristic information. 2.根据权利要求1中所述的缺陷检测方法,其特征在于,所述根据预设的标准图像中的多个所述灯珠对应的标准坐标参数获取所述第一初始坐标参数中的第一有效坐标参数和异常坐标参数的步骤包括:2. The defect detection method according to claim 1, characterized in that the step of obtaining the first valid coordinate parameter and the abnormal coordinate parameter in the first initial coordinate parameter according to the standard coordinate parameters corresponding to the plurality of lamp beads in the preset standard image comprises: 获取所述微显示器的所述标准图像;Acquiring the standard image of the microdisplay; 根据所述标准图像获取多个所述灯珠对应的所述标准坐标参数;Acquire the standard coordinate parameters corresponding to the plurality of lamp beads according to the standard image; 获取所述标准坐标参数与所述第一初始坐标参数的相关系数;Obtaining a correlation coefficient between the standard coordinate parameter and the first initial coordinate parameter; 判断所述相关系数是否位于预设范围内;Determining whether the correlation coefficient is within a preset range; 若所述相关系数位于所述预设范围内,则判断每一所述灯珠的所述第一初始坐标参数与对应所述标准坐标参数是否匹配;If the correlation coefficient is within the preset range, determining whether the first initial coordinate parameter of each lamp bead matches the corresponding standard coordinate parameter; 若所述灯珠的所述第一初始坐标参数与对应的所述标准坐标参数匹配,则确定所述灯珠的所述第一初始坐标参数为第一有效坐标参数,若所述灯珠的所述第一初始坐标参数与对应的所述标准坐标参数不匹配,则确定所述灯珠的所述第一初始坐标参数为异常坐标参数。If the first initial coordinate parameter of the lamp bead matches the corresponding standard coordinate parameter, the first initial coordinate parameter of the lamp bead is determined to be a first valid coordinate parameter. If the first initial coordinate parameter of the lamp bead does not match the corresponding standard coordinate parameter, the first initial coordinate parameter of the lamp bead is determined to be an abnormal coordinate parameter. 3.根据权利要求1中所述的缺陷检测方法,其特征在于,所述根据所述第一有效坐标参数获取所述异常坐标参数对应的第二有效坐标参数的步骤包括:3. The defect detection method according to claim 1, characterized in that the step of obtaining the second valid coordinate parameter corresponding to the abnormal coordinate parameter according to the first valid coordinate parameter comprises: 获取与所述异常坐标参数对应的所述灯珠相邻的两个所述灯珠对应的所述第一有效坐标参数;Acquire the first valid coordinate parameters corresponding to the two lamp beads adjacent to the lamp bead corresponding to the abnormal coordinate parameters; 采用插值法计算所述异常坐标参数对应的第二有效坐标参数。An interpolation method is used to calculate a second valid coordinate parameter corresponding to the abnormal coordinate parameter. 4.根据权利要求1中所述的缺陷检测方法,其特征在于,所述根据所述第一有效坐标参数和所述第二有效坐标参数获取任一所述灯珠的第一物理坐标参数的步骤包括:4. The defect detection method according to claim 1, characterized in that the step of obtaining the first physical coordinate parameter of any of the lamp beads according to the first effective coordinate parameter and the second effective coordinate parameter comprises: 根据所述第一有效坐标参数和所述第二有效坐标参数获取任一所述灯珠对应的最小外接矩形;Obtain the minimum circumscribed rectangle corresponding to any of the lamp beads according to the first valid coordinate parameter and the second valid coordinate parameter; 根据预设间距获取位于所述最小外接矩形的外围的外围矩形;Acquire a peripheral rectangle located outside the minimum circumscribed rectangle according to a preset spacing; 自所述外围矩形向所述最小外接矩形的方向确定所述灯珠的边界所在的过渡区域;Determine a transition area where the boundary of the lamp bead is located in the direction from the outer rectangle to the minimum circumscribed rectangle; 对所述过渡区域进行阈值分割,并筛选符合预设条件的边界像素点;Performing threshold segmentation on the transition area and screening boundary pixel points that meet preset conditions; 根据所获取的多个所述边界像素点拟合任一所述灯珠对应的目标矩形;Fitting a target rectangle corresponding to any of the lamp beads according to the acquired multiple boundary pixel points; 获取位于所述目标矩形内的中心像素点的坐标值;Obtain the coordinate value of the center pixel point within the target rectangle; 根据所述中心像素点的坐标值和预设标定系数获取任一所述灯珠的第一物理坐标参数。The first physical coordinate parameter of any of the lamp beads is obtained according to the coordinate value of the central pixel point and a preset calibration coefficient. 5.根据权利要求1中所述的缺陷检测方法,其特征在于,所述根据所述第二初始坐标参数和所述标准坐标参数获取任一所述灯珠的第二物理坐标参数的步骤包括:5. The defect detection method according to claim 1, characterized in that the step of obtaining the second physical coordinate parameter of any of the lamp beads according to the second initial coordinate parameter and the standard coordinate parameter comprises: 计算任一所述灯珠的所述标准坐标参数与对应的所述第二初始坐标参数的差值;Calculate the difference between the standard coordinate parameter of any of the lamp beads and the corresponding second initial coordinate parameter; 根据所述第二初始坐标参数、所述差值以及所获取的所述第二初始图像对应的帧数值计算任一所述灯珠的第二物理坐标参数。The second physical coordinate parameter of any of the lamp beads is calculated according to the second initial coordinate parameter, the difference and the frame value corresponding to the acquired second initial image. 6.一种微显示器的缺陷检测系统,其特征在于,包括:6. A defect detection system for a micro display, comprising: 获取单元,用于获取所述微显示器的第一初始图像和第二初始图像,所述第一初始图像为相机在飞拍模式下所采集的图像,所述第二初始图像为定位组件所采集的图像,以及用于根据所述第一初始图像获取多个灯珠对应的第一初始坐标参数,以及根据所述第二初始图像获取多个所述灯珠对应的第二初始坐标参数,所述定位组件用于对处于静态状态下的所述微显示器进行图像采集;an acquisition unit, used to acquire a first initial image and a second initial image of the microdisplay, wherein the first initial image is an image acquired by the camera in a flying shooting mode, and the second initial image is an image acquired by the positioning component, and used to acquire first initial coordinate parameters corresponding to a plurality of lamp beads according to the first initial image, and to acquire second initial coordinate parameters corresponding to a plurality of the lamp beads according to the second initial image, wherein the positioning component is used to perform image acquisition on the microdisplay in a static state; 计算单元,用于根据预设的标准图像中的多个所述灯珠对应的标准坐标参数获取所述第一初始坐标参数中的第一有效坐标参数和异常坐标参数,并根据所述第一有效坐标参数获取所述异常坐标参数对应的第二有效坐标参数,所述计算单元还用于根据所述第一有效坐标参数和所述第二有效坐标参数获取任一所述灯珠的第一物理坐标参数以及用于根据所述第二初始坐标参数和所述标准坐标参数获取任一所述灯珠的第二物理坐标参数,并用于根据所述第一物理坐标参数和所述第二物理坐标参数计算任一所述灯珠的坐标偏移量;A calculation unit, used for obtaining a first valid coordinate parameter and an abnormal coordinate parameter in the first initial coordinate parameter according to standard coordinate parameters corresponding to a plurality of the lamp beads in a preset standard image, and obtaining a second valid coordinate parameter corresponding to the abnormal coordinate parameter according to the first valid coordinate parameter, the calculation unit is further used for obtaining a first physical coordinate parameter of any of the lamp beads according to the first valid coordinate parameter and the second valid coordinate parameter, and for obtaining a second physical coordinate parameter of any of the lamp beads according to the second initial coordinate parameter and the standard coordinate parameter, and for calculating a coordinate offset of any of the lamp beads according to the first physical coordinate parameter and the second physical coordinate parameter; 所述缺陷检测系统还包括匹配模块,所述匹配模块用于根据所述第一有效坐标参数和所述第二有效坐标参数将所述第一初始图像上的每一所述灯珠分别划分为一个子区域;The defect detection system further includes a matching module, which is used to divide each of the lamp beads on the first initial image into a sub-area according to the first effective coordinate parameter and the second effective coordinate parameter; 所述匹配模块还用于获取任一所述子区域中的所述灯珠的特征信息;The matching module is also used to obtain characteristic information of the lamp beads in any of the sub-areas; 所述匹配模块还用于根据所述特征信息计算所述灯珠的还原坐标参数;The matching module is also used to calculate the restored coordinate parameters of the lamp bead according to the characteristic information; 所述匹配模块还用于根据所述还原坐标参数获取还原图像;The matching module is also used to obtain a restored image according to the restored coordinate parameters; 所述缺陷检测系统还包括检测模块,所述检测模块用于将所述还原图像与所述标准图像进行差分,得到差分图像;The defect detection system further includes a detection module, which is used to perform a difference between the restored image and the standard image to obtain a differential image; 所述检测模块还用于对所述差分图像进行图像预处理;The detection module is also used to perform image preprocessing on the differential image; 所述检测模块还用于对图像预处理后的差分图像进行二值化处理;The detection module is also used to perform binarization processing on the difference image after image preprocessing; 所述检测模块还用于将二值化处理后的差分图像进行连通区域标记;The detection module is also used to mark the connected areas of the difference image after the binary processing; 所述检测模块还用于获取每一所述连通区域的特征信息;The detection module is also used to obtain feature information of each of the connected areas; 所述检测模块还用于根据所述特征信息判断位于任一所述连通区域的所述灯珠是否存在缺陷。The detection module is also used to determine whether the lamp bead located in any of the connected areas has defects based on the characteristic information. 7.一种微显示器的缺陷检测装置,其特征在于,包括如权利要求6所述的微显示器的缺陷检测系统以及放置待测微显示器的工作台。7. A defect detection device for a microdisplay, characterized in that it comprises the defect detection system for a microdisplay as described in claim 6 and a workbench for placing the microdisplay to be tested.
CN202410640727.XA 2024-05-22 2024-05-22 A method, system and device for detecting defects of a microdisplay Active CN118623760B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202410640727.XA CN118623760B (en) 2024-05-22 2024-05-22 A method, system and device for detecting defects of a microdisplay

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202410640727.XA CN118623760B (en) 2024-05-22 2024-05-22 A method, system and device for detecting defects of a microdisplay

Publications (2)

Publication Number Publication Date
CN118623760A CN118623760A (en) 2024-09-10
CN118623760B true CN118623760B (en) 2025-02-14

Family

ID=92607229

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202410640727.XA Active CN118623760B (en) 2024-05-22 2024-05-22 A method, system and device for detecting defects of a microdisplay

Country Status (1)

Country Link
CN (1) CN118623760B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115731156A (en) * 2021-09-01 2023-03-03 合肥欣奕华智能机器股份有限公司 Defect detection method and device for Mini LED backlight panel
CN117237316A (en) * 2023-09-28 2023-12-15 深圳市玖润光电科技有限公司 MiniLED luminescence detection method and device, electronic equipment and medium

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110031188B (en) * 2019-03-29 2021-08-27 上海华岭集成电路技术股份有限公司 Method for testing aperture of integrated circuit optical chip
CN111257348B (en) * 2020-03-27 2023-02-17 河海大学常州校区 A defect detection method of LED light guide plate based on machine vision
CN115019723A (en) * 2022-06-29 2022-09-06 京东方科技集团股份有限公司 Screen display method, screen display device, electronic apparatus, program, and medium
CN115497417B (en) * 2022-09-30 2023-07-18 南京浣轩半导体有限公司 Mini-LED compensation method, device and medium based on decimal gray scale correction
CN115546141A (en) * 2022-09-30 2022-12-30 广东工业大学 A small sample Mini LED defect detection method and system based on multi-dimensional measurement
CN115616018B (en) * 2022-11-08 2023-03-21 北京中科科仪股份有限公司 Positioning method and device for scanning electron microscope, electronic equipment and storage medium
CN115601367B (en) * 2022-12-15 2023-04-07 苏州迈创信息技术有限公司 LED lamp wick defect detection method
CN116051634A (en) * 2022-12-28 2023-05-02 深圳优艾智合机器人科技有限公司 Visual positioning method, terminal and storage medium
CN116109595A (en) * 2023-01-18 2023-05-12 深圳思谋信息科技有限公司 Panel defect detection method, device, computer equipment and storage medium

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115731156A (en) * 2021-09-01 2023-03-03 合肥欣奕华智能机器股份有限公司 Defect detection method and device for Mini LED backlight panel
CN117237316A (en) * 2023-09-28 2023-12-15 深圳市玖润光电科技有限公司 MiniLED luminescence detection method and device, electronic equipment and medium

Also Published As

Publication number Publication date
CN118623760A (en) 2024-09-10

Similar Documents

Publication Publication Date Title
CN109215063B (en) Registration method of event trigger camera and three-dimensional laser radar
JP5443435B2 (en) Tire defect detection method
US6477275B1 (en) Systems and methods for locating a pattern in an image
CA2218793C (en) Multi-modal system for locating objects in images
CN106469448B (en) Automated industrial inspection with 3D vision
WO2002077911A1 (en) Automatic detection of alignment or registration marks
CN108986129B (en) Calibration plate detection method
CN110189375A (en) An Image Target Recognition Method Based on Monocular Vision Measurement
CN108197523A (en) Vehicle detection at night method and system based on image conversion and profile neighborhood difference
JP2014067193A (en) Image processing apparatus and image processing method
CN114136975A (en) A kind of microwave bare chip surface defect intelligent detection system and method
JP2002039962A (en) Method for inspecting electronic substrate and apparatus using the same
CN115100104A (en) Defect detection method, device and equipment for glass ink area and readable storage medium
CN109816627B (en) Target detection method for weak and small defects in the ink area of flat glass components
CN114280075A (en) Online visual inspection system and method for surface defects of pipe parts
CN108510544B (en) A method of light strip location based on feature clustering
CN112184723A (en) Image processing method and device, electronic device and storage medium
CN118882520B (en) A three-dimensional detection device and method for surface defects of large-aperture curved optical elements
CN118623760B (en) A method, system and device for detecting defects of a microdisplay
CN116908185B (en) Method, device, electronic device and storage medium for detecting appearance defects of articles
CN118506338A (en) Electronic device printed character recognition and detection method based on deep learning
JPH0875418A (en) Automatic recognition method and automatic recognition device for object
CN113658089B (en) Dual-data stream fusion object identification method based on depth camera
JP7491315B2 (en) Work surface defect detection device and detection method, work surface inspection system and program
JPH08159712A (en) Pattern recognition method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant