Disclosure of Invention
The invention aims to provide a focusing evaluation method, a focusing evaluation system, focusing evaluation equipment and a focusing evaluation medium for a wafer alignment mark, so as to solve the problems in the prior art.
In order to achieve the above object, the present invention provides a focus evaluation method for a wafer alignment mark, including:
Acquiring a sequence image set of a wafer alignment mark in the defocus-focus-defocus process;
performing edge extraction on each sequence image in the sequence image set;
Performing focus evaluation on each sequence image in different directions after edge extraction based on a Brenner function and a Roberts function to obtain initial focus evaluation function values corresponding to each sequence image;
Performing variance calculation on the initial focus evaluation function value corresponding to each sequence image to obtain a final focus evaluation function value;
and judging the focusing state of the wafer alignment mark based on the final focusing evaluation function value.
Optionally, extracting edges of each sequence image in the sequence image set specifically includes:
Determining an initial sampling interval, and calculating the gray value standard deviation of each sequence image;
calculating gray value difference values of each pixel to be marked and adjacent pixel points in each sequence image, wherein the adjacent pixel points comprise pixel points positioned on the right and below the current pixel point to be marked;
And comparing the gray value standard deviation with the gray value difference of the adjacent pixel points, and determining whether the current pixel point to be marked is an edge pixel point or not based on a comparison result.
Optionally, comparing the gray value standard deviation with the gray value difference of the adjacent pixel points specifically includes:
If the gray value difference values of the adjacent pixel points are smaller than the gray value standard deviation, judging that the pixel point to be marked currently is not an edge pixel point;
If the gray value difference value larger than the gray value standard deviation exists in the gray value difference values of the adjacent pixel points, judging the current pixel point to be marked as an edge pixel point;
and after judging that the current pixel to be marked is an edge pixel, marking the current pixel to be marked and reducing the initial sampling interval.
Optionally, focus evaluation is performed on different directions of each sequence image after edge extraction based on a Brenner function and a Roberts function, which specifically includes:
Performing evaluation calculation in the directions of 0 DEG and 90 DEG of the sequence images by using a Brenner function, and adding pixel gray difference calculation in the direction of 90 DEG to obtain a first focusing evaluation function value; and (3) carrying out gray gradient calculation on the 45 DEG and 135 DEG directions of the sequence images by using a 3X 3Roberts operator to obtain a second focusing evaluation function value, and multiplying the first focusing evaluation function value and the second focusing evaluation function value to obtain an initial focusing evaluation function value.
Optionally, variance calculation is performed on the initial focus evaluation function value corresponding to each sequence image, and a specific calculation formula is as follows:
Where N is the number of sequential images, U Bre2d_Rob2d is the initial average evaluation function value of the sequential image set, and F Bre2d_Rob2d_Var is the final focus evaluation function value.
A focus evaluation system for wafer alignment marks, comprising:
The image acquisition module is used for acquiring a sequence image set of the wafer alignment mark in the defocus-focus-defocus process;
The focusing evaluation module is used for extracting edges of each sequence image in the sequence image set; performing focus evaluation on each sequence image in different directions after edge extraction based on a Brenner function and a Roberts function to obtain initial focus evaluation function values corresponding to each sequence image; performing variance calculation on the initial focus evaluation function value corresponding to each sequence image to obtain a final focus evaluation function value; and judging the focusing state of the wafer alignment mark based on the final focusing evaluation function value.
An electronic device includes a memory for storing a computer program and a processor that runs the computer program to cause the electronic device to perform the method of focus evaluation for wafer alignment marks.
A computer readable storage medium storing a computer program which when executed by a processor implements the method of focus evaluation for wafer alignment marks.
The invention has the technical effects that:
1. Aiming at the application background of the diversity change of the edge direction of the wafer alignment mark image characteristic, the invention combines the advantages of the Brenner function and the Roberts function, and can efficiently extract the edge gradient information of the mark image in multiple directions, thereby realizing high-precision focusing.
2. According to the invention, the traditional focusing evaluation function and the adaptive sampling are fused, so that the calculation complexity is improved, but the calculation amount is greatly reduced through the adaptive sampling, the efficient calculation is realized, the problems of poor noise resistance and stability of the traditional focusing evaluation function are solved, and the problems of complex calculation and poor instantaneity of the fused focusing function are solved.
3. According to the method, the variance calculation is carried out on the evaluation function, so that the problem of poor noise immunity of the airspace focusing function is improved, and better robustness is achieved.
Detailed Description
Various exemplary embodiments of the invention will now be described in detail, which should not be considered as limiting the invention, but rather as more detailed descriptions of certain aspects, features and embodiments of the invention.
It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In addition, for numerical ranges in this disclosure, it is understood that each intermediate value between the upper and lower limits of the ranges is also specifically disclosed. Every smaller range between any stated value or stated range, and any other stated value or intermediate value within the stated range, is also encompassed within the invention. The upper and lower limits of these smaller ranges may independently be included or excluded in the range.
Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Although the invention has been described with reference to a preferred method, any method similar or equivalent to those described herein can be used in the practice or testing of the present invention. All documents mentioned in this specification are incorporated by reference for the purpose of disclosing and describing the methodologies associated with the documents. In case of conflict with any incorporated document, the present specification will control.
It will be apparent to those skilled in the art that various modifications and variations can be made in the specific embodiments of the application described herein without departing from the scope or spirit of the application. Other embodiments will be apparent to those skilled in the art from consideration of the specification of the present application. The specification and examples of the present application are exemplary only.
As used herein, the terms "comprising," "including," "having," "containing," and the like are open ended terms, meaning including, but not limited to.
It should be noted that, without conflict, the embodiments of the present application and features of the embodiments may be combined with each other. The application will be described in detail below with reference to the drawings in connection with embodiments.
Example 1
As shown in fig. 1-fig. 1, in this embodiment, a focus evaluation method for a wafer alignment mark is provided, including: acquiring a sequence image set of a wafer alignment mark in the defocus-focus-defocus process; performing edge extraction on each sequence image in the sequence image set; performing focus evaluation on each sequence image in different directions after edge extraction based on a Brenner function and a Roberts function to obtain initial focus evaluation function values corresponding to each sequence image; performing variance calculation on the initial focus evaluation function value corresponding to each sequence image to obtain a final focus evaluation function value; and judging the focusing state of the wafer alignment mark based on the final focusing evaluation function value.
Performing adaptive sampling of pixel points and extraction of pixel points of marked characteristic edges on the obtained wafer alignment mark defocus-focus-defocus sequence image; then, evaluating and calculating the sampled pixel points by using an improved function combined with a Brenner function and a Roberts function to obtain an initial focus evaluation function value of each image; in order to reduce the sensitivity of the improvement function to noise, carrying out variance calculation on the initial focus evaluation function value of the image set to obtain a final focus evaluation function value; according to the focusing evaluation function curve of the image, the focal length can be regulated and controlled in real time, and an accurately focused image is obtained, so that high-precision detection of the wafer alignment mark is realized. The focusing evaluation function constructed by the embodiment has strong noise immunity, good stability and timeliness, and is suitable for automatic focusing of the wafer alignment marks with the varied edge directions.
1. Aiming at the application background of the diversity change of the edge direction of the wafer alignment mark image characteristic, the embodiment combines the advantages of the Brenner function and the Roberts function, and can efficiently extract the edge gradient information of the mark image in multiple directions, thereby realizing high-precision focusing.
2. According to the embodiment, the traditional focusing evaluation function and the adaptive sampling are fused, the calculation complexity is improved, but the calculation amount is greatly reduced through the adaptive sampling, so that efficient calculation is realized, the problems of poor noise resistance and stability of the traditional focusing evaluation function are solved, and the problems of complex calculation and poor instantaneity of the fused focusing function are solved.
3. According to the method, the variance calculation is finally carried out on the evaluation function, so that the problem of poor noise immunity of the airspace focusing function is improved, and better robustness is achieved.
The embodiment not only meets the unimodal property and unbiasedness of the focusing curve, but also has good stability and noise immunity, and also has an adaptive focusing evaluation function with high calculation efficiency, thereby realizing rapid and accurate automatic focusing of the wafer alignment mark.
The embodiment provides a self-adaptive focusing evaluation method for a wafer alignment mark aiming at the application background of the diversity change of the edge direction of the wafer alignment mark on the basis of the problems of high noise immunity, poor stability, large calculation amount of a fusion focusing evaluation function, poor instantaneity and the like of the traditional focusing evaluation function.
In order to achieve the purpose, the technical scheme adopted by the embodiment is as follows:
The adaptive focusing evaluation method for the wafer alignment mark comprises the steps of firstly, performing adaptive sampling of mark image pixel points and extraction of characteristic edge pixel points of the obtained wafer alignment mark defocusing-focusing-defocusing sequence images; then, an improvement function Brenner2d-Roberts2d is applied to evaluate and calculate the sampled pixel points, and an initial focus evaluation function value of each image is obtained; in order to reduce the sensitivity of the improved function to noise, enhance the stability and noise resistance of the improved function, variance calculation is carried out on the initial evaluation function value, and a final focus evaluation function Brenner2d-Roberts2d-Var is obtained.
The method specifically comprises the following steps:
(1) Marking image pixel adaptive sampling:
Determining different sampling intervals S 1 according to the sizes of the out-of-focus-out-of-focus sequence images of the wafer alignment marks obtained by the camera:
S1=max(X,Y)/n
Wherein X, Y is the height and width of each image; and n is the sampling times, and the sampling times are determined according to the calculation efficiency of the evaluation function and the size of the wafer alignment mark.
(2) Extracting edge pixel points of marked image features:
In order to reduce the calculated amount, the simplest gray difference is adopted to judge the characteristic edge pixel point of the alignment mark image, and the gray value standard deviation sigma of each image is firstly calculated and is used as the judging basis of whether the gray value standard deviation sigma is the edge pixel point or not:
wherein f (x, y) is the gray value of the pixel point (x, y); XY is the image pixel size; u is the average pixel value of the whole image.
Then, calculating the gray level difference value between the pixel point (x, y) and the pixel point (x+1, y) on the right side and the pixel point (x, y+1) on the lower side, judging the gray level difference value with the gray level standard deviation sigma of the image, determining whether the pixel point is an edge pixel point, and timely adjusting the self-adaptive sampling interval S:
R=|f(x,y)-f(x+1,y)
D=|f(x,y)-f(x,y+1)
Wherein R is the absolute value of the gray difference between the pixel point (x, y) and the pixel point (x+1, y) on the right; d is the absolute value of the gray difference between the pixel (x, y) and the pixel (x, y+1) to the right.
Through the judgment of the gray level difference R, D and the standard deviation sigma, if R and D are smaller than the standard deviation sigma, the pixel point is not the marked edge, sampling is continued according to the large spacing S 1, if R or D is larger than the standard deviation sigma, the pixel point is the marked edge, the sampling spacing is reduced to S 2,S2, and the pixel point is determined according to the evaluation function calculation efficiency and the wafer alignment mark size.
(3) Improved focus evaluation function:
Considering that the wafer alignment mark has a plurality of characteristic edge directions, the present embodiment intends to perform evaluation function calculation for all four directions (0 °, 45 °, 90 °, 135 °) of the mark image. First, a Brenner function, which is one of the airspace-like focus evaluation functions having the lowest calculation complexity, is selected in the 0 ° and 90 ° directions, but it calculates only the squares of pixel gradation differences in the 0 ° direction which differ by two units, so that the pixel gradation difference calculation in the 90 ° direction is increased without increasing the calculation amount:
The Roberts function is then chosen in the 45 ° and 135 ° directions, which is to calculate the gray gradient values in the diagonal direction, but since the Brenner function operator is a 3×3 matrix, the Roberts operator is adjusted from 2×2 to 3×3 matrix in order to unify the gray gradient calculation dimensions:
finally, multiplying the two functions to obtain an initial focusing evaluation function which finally satisfies four directions:
(4) Variance calculation
The number of the evaluation function is increased to 4 from the calculation direction of the evaluation function, although the problem of azimuth limitation of the traditional airspace focusing evaluation function in gray gradient calculation is solved to a certain extent, the method is better suitable for the evaluation calculation of wafer alignment mark images, the calculation result is more accurate, the focusing sensitivity is improved to some extent, but the noise sensitivity of the evaluation function is increased, and the noise resistance is greatly weakened, so that variance calculation is added on the basis of the improvement function, the stability of the evaluation function can be enhanced by the variance function, and the evaluation function is not easy to be interfered by noise:
Where N is the number of out-of-focus-out-of-focus sequence image sets, u Bre2d_Rob2d is the initial average evaluation function value from the in-focus sequence image sets, and F Bre2d_Rob2d_Var is the final focus evaluation function.
And finally, fitting a focus evaluation function curve according to a focus evaluation function value of the defocusing-focusing-defocusing sequence image, so as to realize accurate focus positioning, acquire a clear focus image and realize high-precision detection of the wafer alignment mark.
The specific application object of this embodiment, the wafer bonding alignment mark autofocus system, is by which a sequential image set of alignment mark defocus-focus-defocus is first taken, as shown in fig. 1. After the image set is acquired, the adaptive focusing evaluation method for the wafer alignment mark is calculated according to the embodiment, and the flow is shown in fig. 2.
The detailed calculation flow comprises the following steps:
(1) Determination of pixel self-adaptive sampling interval S 1 and sampling times n:
the size of the defocusing-focusing-defocusing sequence image is 1280 multiplied by 1024 according to the wafer alignment mark obtained by the camera; n is the sampling times, and the calculation efficiency of the evaluation function and the size of the wafer alignment mark are determined to be 60; sampling interval S 1 is rounded to obtain:
S1=max(X,Y)/n
=max(1280,1024)/60
≈21
(2) Determining a wafer alignment mark characteristic edge pixel point extraction threshold sigma:
Firstly, calculating the gray value standard deviation sigma of each image, and taking the gray value standard deviation sigma as a judging basis of whether the gray value standard deviation sigma is an edge pixel point or not:
wherein f (x, y) is the gray value of the pixel point (x, y); XY is the image pixel size; u is the average pixel value of the whole image.
Then, calculating the gray level difference value between the pixel point (x, y) and the pixel point (x+1, y) on the right side and the pixel point (x, y+1) on the lower side, judging the gray level difference value with the gray level standard deviation sigma of the image, determining whether the pixel point is an edge pixel point, and timely adjusting the self-adaptive sampling interval:
R=|f(x,y)-f(x+1,y)
D=|f(x,y)-f(x,y+1)
Wherein R is the absolute value of the gray difference between the pixel point (x, y) and the pixel point (x+1, y) on the right; d is the absolute value of the gray difference between the pixel (x, y) and the pixel (x, y+1) to the right.
Through the judgment of the gray value difference R, D and the standard deviation sigma, if R and D are smaller than the standard deviation sigma, the pixel point is not the marked edge, sampling is continued according to the large spacing S 1, if R or D is larger than the standard deviation sigma, the pixel point is the marked edge, the sampling spacing is reduced to S 2,S2, and the pixel point is determined to be 1 according to the calculation efficiency of the evaluation function and the size of the alignment mark structure.
(3) And carrying out convolution calculation on the sampling pixel points by utilizing a multidirectional gradient focusing evaluation function:
First, the Brenner operator is used to calculate the pixel gray difference between two units in the 0 ° and 90 ° directions:
The pixel gray difference for two diagonal units is then calculated using the modified Roberts operator in the 45 ° and 135 ° directions:
Finally, multiplying the two functions to obtain an initial focusing evaluation function which finally satisfies four directions:
(4) Performing variance operation on the focusing evaluation function of the marker sequence image set:
Wherein N is the number of the out-of-focus-out-of-focus sequence image sets of the alignment mark to be 11, u Bre2d_Rob2d is the initial average evaluation function value of the out-of-focus sequence image sets, and F Bre2d_Rob2d_Var is the final focus evaluation function.
And finally, fitting a focus evaluation function curve according to a focus evaluation function value of the out-of-focus-out-of-focus sequence image of the alignment mark, thereby realizing accurate focus positioning, obtaining a clear focus image and realizing high-precision detection of the wafer alignment mark.
To verify the performance improvement of the method of this embodiment, this embodiment and the conventional focus evaluation function: performance contrast experiments and analyses were performed on Brenner, roberts, tenengrad functions, DFT two-dimensional discrete Fourier transformed image focus evaluation functions, and on Bre d_var evaluation functions proposed in 2023, dong Zhengqiong, etc.
And respectively calculating out the defocusing-focusing-defocusing sequence images of the same wafer alignment mark by using the focusing evaluation function, and normalizing the obtained focusing evaluation value to obtain a focusing evaluation function curve comparison graph, as shown in figure 3. In order to more objectively compare and analyze the performance differences of different focusing evaluation functions, performance indexes of the steep region width W, the definition ratio R, the steep Stp and the sensitivity f sen are selected to analyze and compare the focusing evaluation functions, and as shown in table 1, the relevant indexes are as follows.
Steep zone width W: the width W of the steep region represents the width of the region with a larger curve change rate on the evaluation function curve, and is a very important parameter depending on the specific shape and change rate of the evaluation function curve, and can be used as a selection reference index of the maximum step size of the focusing process.
Sharpness ratio R: the definition ratio R represents the resolution of the focus evaluation function on images with different defocus levels, and the larger the focus ratio is, the larger the difference between the focus value of the clear image and the focus value of the blurred image is, the easier the focus function is to be resolved:
Where f max is the maximum of the focusing function and f min is the minimum of the focusing function.
Abruptness Stp: the steepness Stp represents the steepness of the focus evaluation function curve at the peak, and the greater the steepness, the greater the resolution of the function to images of different defocus levels.
Sensitivity f sen: the sensitivity f sen represents the intensity of the change near the maximum value of the focus evaluation function, and the higher the sensitivity is, the more intense the change of the function is, the better the image focusing effect is, and conversely, the more gentle the change of the function is:
Where f max is the maximum of the focusing function and f (z max +θ) is the function value when the abscissa changes by θ.
TABLE 1 focusing evaluation function Performance evaluation index summary table
As can be seen from table 1, the steep region width W index of the improved focus evaluation function of the present embodiment is the smallest compared with other evaluation functions; the sharpness ratio R is several orders of magnitude higher than the other evaluation functions; the steepness Stp is 7 times of the minimum value of other evaluation functions; the sensitivity f sen is 14 times the minimum of the other evaluation functions.
In summary, the present embodiment is an autofocus evaluation algorithm for wafer alignment mark images with strong noise immunity, good stability and timeliness, and suitable for edge direction diversity.
A focus evaluation system for wafer alignment marks, comprising:
The image acquisition module is used for acquiring a sequence image set of the wafer alignment mark in the defocus-focus-defocus process;
The focusing evaluation module is used for extracting edges of each sequence image in the sequence image set; performing focus evaluation on each sequence image in different directions after edge extraction based on a Brenner function and a Roberts function to obtain initial focus evaluation function values corresponding to each sequence image; performing variance calculation on the initial focus evaluation function value corresponding to each sequence image to obtain a final focus evaluation function value; and judging the focusing state of the wafer alignment mark based on the final focusing evaluation function value.
An electronic device includes a memory for storing a computer program and a processor that runs the computer program to cause the electronic device to perform the method of focus evaluation for wafer alignment marks.
A computer readable storage medium storing a computer program which when executed by a processor implements the method of focus evaluation for wafer alignment marks.
The present application is not limited to the above-mentioned embodiments, and any changes or substitutions that can be easily understood by those skilled in the art within the technical scope of the present application are intended to be included in the scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.