TWI452335B - Method and system for obtaining object image using confocal microscope - Google Patents
Method and system for obtaining object image using confocal microscope Download PDFInfo
- Publication number
- TWI452335B TWI452335B TW100111603A TW100111603A TWI452335B TW I452335 B TWI452335 B TW I452335B TW 100111603 A TW100111603 A TW 100111603A TW 100111603 A TW100111603 A TW 100111603A TW I452335 B TWI452335 B TW I452335B
- Authority
- TW
- Taiwan
- Prior art keywords
- light
- scanning
- unit
- image
- scanning position
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0052—Optical details of the image generation
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Optics & Photonics (AREA)
- Microscoopes, Condenser (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Life Sciences & Earth Sciences (AREA)
- Health & Medical Sciences (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
Description
本發明係關於一種應用共聚焦顯微鏡結構的被測物圖像獲取方法,特別係關於一種為了盡可能地平均化掃描到被測物的光線由於每個掃描位置表面的光學特性:反射比、粗糙度及反射角等不同而引起的獲取信號之差,由聲光偏轉器調節光強後進行掃描,以此能夠提高檢測精度的應用共聚焦顯微鏡結構的被測物圖像獲取方法及系統。The present invention relates to a method for acquiring an image of a measured object using a confocal microscope structure, and more particularly to an optical characteristic of a surface of each scanning position in order to average the light that is scanned to the object to be measured as much as possible: reflectance, roughness A method and system for acquiring an object image using a confocal microscope structure in which the difference between the acquired signals caused by the difference in degree and the angle of reflection is adjusted by the acousto-optic deflector and then scanned.
一般來說,共聚焦顯微鏡將雷射作為光源,利用從點光源(point source)出射的光線,使樣品的焦點與光電探測器的縫隙或者針孔的焦點形成共聚焦(confocal),以防止焦平面以外的部分出現在光電探測器上,因此與習知的螢光顯微鏡相比,共聚焦顯微鏡對焦平面的解析度高達1.4倍左右,而且共聚焦顯微鏡在光軸(optical axis)上設置了針孔或者縫隙掩模等,從而能在透過標本(specimen)或者在標本處反射的光線中僅選擇準確對焦的光線,以提高解析度並進行視覺化。In general, a confocal microscope uses a laser as a light source, using light emitted from a point source to cause the focus of the sample to be confocal with the gap of the photodetector or the focus of the pinhole to prevent coke. The portion outside the plane appears on the photodetector, so the resolution of the focal plane of the confocal microscope is as high as 1.4 times compared to the conventional fluorescence microscope, and the confocal microscope has a needle on the optical axis. Holes or slit masks, etc., so that only the precisely focused light can be selected in the specimen or reflected light at the specimen to improve resolution and visualization.
而且,共聚焦顯微鏡可透過預定的軟體將二維圖像重建為三維圖像或者立體圖像,因此能夠觀察以前無法觀察到的XZ截面(section)的圖像,並能透過共聚焦顯微鏡重建具有體積的構造物的形貌,以易於獲得所需方向的圖像。Moreover, the confocal microscope can reconstruct a two-dimensional image into a three-dimensional image or a stereoscopic image through a predetermined software, so that an XZ section image that could not be observed before can be observed and reconstructed by confocal microscopy. The shape of the volume of the structure is such that it is easy to obtain an image of the desired direction.
這種共聚焦顯微鏡為了使光線偏轉到樣品的XY面上需要掃描的掃描位置上,採用掃描鏡(檢流計)、MEMS(微機電系統)元件或者聲光偏轉器等光偏轉裝置。Such a confocal microscope employs a light deflection device such as a scanning mirror (galvanometer), a MEMS (Micro Electro Mechanical System) element, or an acousto-optic deflector in order to deflect light to a scanning position on the XY plane of the sample to be scanned.
其中,掃描鏡(檢流計)是在旋轉的軸上貼附鏡子(反射鏡)的裝置,具有能夠以簡單的結構進行高速驅動的優點,而MEMS(microelectromechanical system)是將這種反射鏡結構小型化、高度積體化的系統。Among them, a scanning mirror (galvanometer) is a device that attaches a mirror (mirror) to a rotating shaft, and has the advantage of being capable of high-speed driving with a simple structure, and a MEMS (microelectromechanical system) is a mirror structure. A miniaturized, highly integrated system.
此外,聲光偏轉器是為了偏轉入射光而廣為採用的手段,如圖1所示,其可由壓電轉換器(a)與介質(b)構成。Further, the acousto-optic deflector is a widely used means for deflecting incident light, and as shown in Fig. 1, it can be constituted by a piezoelectric transducer (a) and a medium (b).
如果由控制單元分配的具有一定頻率的射頻信號透過射頻調製器傳送到該壓電轉換器(a),壓電轉換器(a)就根據射頻信號並以所傳送的頻率加壓介質(b),以產生具有波長Λ且向介質(b)中傳播的聲波(c)。If a radio frequency signal of a certain frequency distributed by the control unit is transmitted to the piezoelectric transducer (a) through the radio frequency modulator, the piezoelectric transducer (a) pressurizes the medium according to the radio frequency signal and at the transmitted frequency (b) To generate an acoustic wave (c) having a wavelength Λ and propagating into the medium (b).
結果,由於所產生聲波(c)所引起的聲光效應,介質(b)中產生週期性的折射率的變化。As a result, a periodic change in refractive index occurs in the medium (b) due to the acousto-optic effect caused by the generated acoustic wave (c).
這種折射率的變化可視作衍射光柵,其如同在晶體表面的原子衍射X射線(布拉格衍射)那樣衍射所入射的光線。This change in refractive index can be regarded as a diffraction grating which diffracts the incident light like atomic diffraction X-ray (Bragd diffraction) on the surface of the crystal.
假設所產生聲波(c)的頻率為f,前進速度為v,由於v=fΛ,可以得出介質(b)中折射率變化的週期。It is assumed that the frequency of the generated acoustic wave (c) is f and the forward speed is v. Since v = f Λ, the period of the refractive index change in the medium (b) can be obtained.
即如圖2所示,假設入射光具有波長λ,由聲波(c)引起的入射光的偏轉角(0)可由以下公式表示。That is, as shown in FIG. 2, assuming that the incident light has a wavelength λ, the deflection angle (0) of the incident light caused by the acoustic wave (c) can be expressed by the following formula.
sinθ=λ/2Λ=λf/2vSin θ=λ/2Λ=λf/2v
即可知,可透過調節聲波(c)的頻率f,以改變入射光的偏轉角(θ)。如此的聲波(c)的頻率f可透過控制射頻信號的頻率來確定。That is, the deflection angle (θ) of the incident light can be changed by adjusting the frequency f of the acoustic wave (c). The frequency f of such a sound wave (c) can be determined by controlling the frequency of the radio frequency signal.
可透過以這種原理工作的聲光偏轉器,來控制入射光在需掃描的被測物的XY平面上向掃描方向偏轉,並從每個掃描位置獲取光線而獲得需掃描被測物的圖像。The acousto-optic deflector operating on this principle can be used to control the incident light to be deflected in the scanning direction on the XY plane of the object to be scanned, and to obtain light from each scanning position to obtain a map to be scanned. image.
在很多情況下,一般被測物的每一個掃描位置(單位畫素)的高度不一樣,因此在被測物的某一部分的高度上對焦後,分步驟進行掃描而完成其高度的檢測。In many cases, the height of each scanning position (unit pixel) of the general object is different, so after focusing on the height of a certain part of the object, the scanning is performed in steps to complete the detection of the height.
即如圖3所示,如果透過掃描光學系統(1)掃描的光線在被測物中掃描區域(2)的各掃描位置表面上準確地聚焦,從每個掃描位置反射的光線也能在縫隙掩模(3)的縫隙上準確地聚焦,從而透過光電探測器(4)獲得光線。That is, as shown in FIG. 3, if the light scanned by the scanning optical system (1) is accurately focused on the surface of each scanning position of the scanning area (2) in the object to be detected, the light reflected from each scanning position can also be in the gap. The slit of the mask (3) is accurately focused to obtain light through the photodetector (4).
而如圖4所示,如果在被測物(2)的每個掃描位置上沒有準確地形成光線焦點,縫隙掩模(3)的縫隙上也不會形成光線焦點,因此從光電探測器(4)所獲得光線的光強也就相對較低。As shown in FIG. 4, if the light focus is not accurately formed at each scanning position of the object (2), the light focus is not formed on the slit of the slit mask (3), so the photodetector is 4) The light intensity of the obtained light is relatively low.
因此,可透過綜合從高度互不相同的掃描位置檢測出的光線,以形成掃描區域的整體圖像來獲得整體掃描區域的高度(三維形貌)結果。Therefore, the height (three-dimensional topography) result of the entire scanning area can be obtained by integrating the light detected from the mutually different scanning positions to form an overall image of the scanning area.
然而,此時從每個掃描位置檢測出的最高信號值與最小信號值之差則根據掃描位置各部分的反射比、粗糙度及反射角等表面特性而不同。However, the difference between the highest signal value and the minimum signal value detected from each scanning position at this time differs depending on surface characteristics such as reflectance, roughness, and reflection angle of each portion of the scanning position.
結果,存在著整體掃描區域的檢測精度不夠均勻的問題。As a result, there is a problem that the detection accuracy of the entire scanning area is not uniform.
另一方面,為了解決這種問題,有人提出根據被測物中需要掃描的部分,在每個掃描位置檢測光強,並在此基礎上,對每個掃描位置進行光掃描時,直接改變光源的輸出光來進行掃描的方法。On the other hand, in order to solve such a problem, it has been proposed to detect the light intensity at each scanning position according to the portion to be scanned in the object to be tested, and on the basis of this, directly change the light source when performing light scanning for each scanning position. The method of outputting light to scan.
然而,上述方法雖然可以提高檢測精度,但進行初步掃描後,需要根據以初步掃描為基礎形成的各掃描位置的反射比,調節光源所產生的光線的強度,因此具有總體製程時間加長的問題。However, although the above method can improve the detection accuracy, after the preliminary scanning, it is necessary to adjust the intensity of the light generated by the light source according to the reflectance of each scanning position formed on the basis of the preliminary scanning, and thus there is a problem that the overall processing time is lengthened.
而且,需要在每個掃描位置改變來自光源的輸出光,因此更加增加了總體製程時間,而對每個掃描位置調節光源的光輸出也具有一定的難度。Moreover, it is necessary to change the output light from the light source at each scanning position, thereby further increasing the overall process time, and it is also difficult to adjust the light output of the light source for each scanning position.
本發明是為了解決上述習知技術中存在的問題而提出的,其目的在於提供一種應用共聚焦顯微鏡結構的被測物圖像獲取方法及系統,根據掃描區域中由於每個掃描位置表面的反射比、粗糙度及反射角等光學特性不同而導致的檢測信號之間的差所引起的圖像的亮度差,對應地根據從每個掃描位置檢測出的光強來調節掃描光的強度並獲得圖像,藉以提高掃描區域的檢測精度。The present invention has been made to solve the above problems in the prior art, and an object thereof is to provide a method and system for acquiring an object image using a confocal microscope structure, according to a reflection of a surface of each scanning position in a scanning area. The difference in brightness of the image caused by the difference between the detection signals caused by the difference in optical characteristics such as the ratio, the roughness, and the reflection angle, and the intensity of the scanning light is adjusted according to the intensity of light detected from each scanning position, and obtained The image is used to improve the detection accuracy of the scanning area.
上述目的是透過以下技術手段來實現的。本發明的一種應用共聚焦顯微鏡結構的被測物圖像的獲取方法,在被測物的上方產生光線,並採用聲光偏轉器使光線依次偏轉於掃描區域的XY平面上的同時進行掃描,以獲取圖像,其中包括下列步驟:強度資訊獲取步驟,其透過顯微鏡光源產生光線,並將此光線輸入到掃描單元的光路上,以使所產生的光線照射到整個該掃描區域上,且透過照相機獲取與分析該掃描區域的整體圖像,以獲取每個掃描位置的光強資訊;資訊設置步驟,其將所獲取的每個掃描位置的光強資訊映射到每個掃描位置的位置資訊上,以設置映射資訊;搭載步驟,其根據控制信號搭載該資訊設置步驟中儲存的映射資訊;傳送步驟,其基於所搭載的映射資訊設置聲強資訊,並將其傳送到聲光偏轉器;掃描步驟,其輸入於該聲光偏轉器後輸出的光線在輸出時,其被偏轉的同時,根據該聲強資訊,其光強被調節,而所輸出的光線透過掃描單元掃描到每個掃描位置並被反射後,反射光線則進入該掃描單元;記錄步驟,其透過光電探測器檢測由每個掃描位置反射且進入該掃描單元的光線,並記錄所檢測的光檢測信號;Z軸掃描步驟,其在Z軸方向上將該被測物與該掃描單元之間的相隔距離改變預定距離,並依次執行該傳送步驟、該掃描步驟、該記錄步驟,以記錄不同的相隔距離下每個掃描位置的光檢測信號,其中該不同的相隔距離下每個掃描位置的光檢測信號的記錄至少執行一次;圖像獲取步驟,其從透過該Z軸掃描步驟中檢測出的每個掃描位置的多個光檢測信號中選擇其中一個,並形成按該聲強資訊的每個掃描位置的圖像,以獲得該掃描區域的整體圖像。The above objectives are achieved by the following technical means. A method for acquiring an image of a measured object using a confocal microscope structure according to the present invention generates light at a position above the object to be measured, and uses an acousto-optic deflector to sequentially deflect the light onto the XY plane of the scanning area while scanning. To obtain an image, the method includes the following steps: an intensity information acquisition step of generating light through a microscope light source, and inputting the light to an optical path of the scanning unit, so that the generated light is irradiated onto the entire scanning area, and The camera acquires and analyzes an overall image of the scanned area to obtain light intensity information of each scanning position; and an information setting step of mapping the obtained light intensity information of each scanning position to position information of each scanning position To set mapping information; a loading step of loading the mapping information stored in the information setting step according to the control signal; and a transmitting step of setting the sound intensity information based on the loaded mapping information and transmitting the sound intensity information to the sound and light deflector; a step of inputting the light outputted by the acousto-optic deflector while outputting, while being deflected, according to Sound intensity information, the light intensity is adjusted, and the output light is scanned by the scanning unit to each scanning position and reflected, the reflected light enters the scanning unit; the recording step is detected by the photodetector by each scanning a light that is reflected by the position and enters the scanning unit, and records the detected light detection signal; a Z-axis scanning step that changes the distance between the object to be tested and the scanning unit by a predetermined distance in the Z-axis direction, and sequentially Performing the transmitting step, the scanning step, and the recording step, to record the light detecting signals of each scanning position at different distances, wherein the recording of the light detecting signals of each scanning position at the different distances is performed at least once; An image acquisition step of selecting one of a plurality of light detection signals transmitted through each of the scanning positions detected in the Z-axis scanning step, and forming an image of each scanning position according to the sound intensity information to obtain The overall image of the scanned area.
其中,在該圖像獲取步驟中從每個掃描位置的多個光檢測信號中選擇的光檢測信號可以是該光電探測器的電壓為最高電壓時的光檢測信號。The light detection signal selected from the plurality of light detection signals at each scanning position in the image acquisition step may be a light detection signal when the voltage of the photodetector is the highest voltage.
而且,在該資訊設置步驟中儲存的映射資訊可以是由外部輸入的資訊。該每個掃描位置表面的光學特性可以是每個掃描位置表面的反射比、粗糙度及反射角中的至少一者。Moreover, the mapping information stored in the information setting step may be information input from the outside. The optical characteristic of the surface of each scanning position may be at least one of a reflectance, a roughness, and a reflection angle of the surface of each scanning position.
本發明的上述目的可透過以下技術手段來實現,本發明的另一實施方式提供的一種應用共聚焦顯微鏡結構的被測物圖像獲取系統,其係包括:光源單元,其位於被測物的上方,用以產生光線並將其輸出到該被測物中需要掃描的掃描區域;偏轉單元,其包括聲光偏轉器,用以根據控制將光線偏轉到該掃描區域的XY平面上,該聲光偏轉器接收從該光源單元輸出的光線,並將其偏轉後輸出,所偏轉的光線根據所傳送的聲強資訊,其強度被調節後輸出;掃描單元,其用以接收透過該偏轉單元偏轉後輸出的光線,並將其掃描到每個掃描位置,且輸入從每個掃描位置反射過來的光線;顯微鏡單元,其具有產生光線的顯微鏡光源,並將所產生的光線輸入於該掃描單元的光路上,藉以使所產生的光線照射到整體該掃描區域上,以獲取該掃描區域的整體圖像;分光器,其設置在該掃描單元,用以使從該偏轉單元輸入的光線透過,並反射從每個掃描位置輸入的光線;光檢測單元,其位於該掃描單元的側方,用以檢測透過該分光單元反射的光線;控制單元,其用以控制該偏轉單元,以使光線偏轉到該掃描區域的XY平面上,並透過由該顯微鏡單元獲取的整體圖像來分析該掃描區域中每個掃描位置的光強,以設置映射資訊,且搭載該映射資訊而設置該聲強資訊,並從該光檢測單元檢測出的、在每個掃描位置的不同Z軸相隔距離下的多個光檢測信號中選擇其中一個光檢測信號,以形成每個掃描位置的圖像。The above object of the present invention can be achieved by the following technical means, and another embodiment of the present invention provides an image receiving system for an object to be measured using a confocal microscope structure, which includes: a light source unit located at the object to be tested Above, a scanning area for generating light and outputting it to the object to be scanned; a deflection unit comprising an acousto-optic deflector for deflecting light onto the XY plane of the scanning area according to the control The light deflector receives the light output from the light source unit, and deflects and outputs the light, and the deflected light is adjusted according to the transmitted sound intensity information, and the output is adjusted; the scanning unit is configured to receive the deflection through the deflection unit The output light is scanned and scanned to each scanning position, and the light reflected from each scanning position is input; the microscope unit has a microscope light source that generates light, and the generated light is input to the scanning unit. On the optical path, the generated light is irradiated onto the entire scanning area to obtain an overall image of the scanning area; the optical splitter It is disposed in the scanning unit for transmitting light input from the deflection unit and reflecting light input from each scanning position; a light detecting unit located at a side of the scanning unit for detecting transmission through the beam splitting unit a reflected light; a control unit for controlling the deflection unit to deflect light onto an XY plane of the scanning area and analyze each scanning position in the scanning area through an overall image acquired by the microscope unit The light intensity is set to map information, and the sound intensity information is set by carrying the mapping information, and is selected from a plurality of light detection signals detected by the light detecting unit at different Z-axis separation distances of each scanning position. One of the light detection signals forms an image for each scanning position.
其中,該分光器可以是半透明反射鏡(half mirror)或者偏振光束分光器(Polarizing Beam Splitter)。Wherein, the beam splitter may be a half mirror or a Polarizing Beam Splitter.
而且,該掃描單元較佳係具有分光器、掃描透鏡、鏡筒透鏡、1/4波長板及物鏡,從該光源單元輸入的光線經過該分光器、掃描透鏡、鏡筒透鏡、1/4波長板及物鏡後掃描到每個掃描位置,而在每個掃描位置反射的光線經過該物鏡、1/4波長板、鏡筒透鏡、掃描透鏡後在該分光器反射。Moreover, the scanning unit preferably has a beam splitter, a scanning lens, a lens barrel, a quarter-wave plate, and an objective lens, and the light input from the light source unit passes through the beam splitter, the scanning lens, the lens barrel, and the 1/4 wavelength. The plate and the objective lens are scanned to each scanning position, and the light reflected at each scanning position passes through the objective lens, the quarter-wave plate, the lens barrel lens, and the scanning lens, and is reflected by the beam splitter.
此外,該光檢測單元可以包括:第一聚光鏡,用以接收從該分光器反射的光線並將其匯集成聚光光束;受光罩,用以從該第一聚光鏡接收聚光光束;光電探測器.用以接收透過該受光罩的光線,並將其光強轉換為電氣信號。In addition, the light detecting unit may include: a first condensing mirror for receiving the light reflected from the beam splitter and collecting the collected light beam; and a light receiving cover for receiving the concentrated light beam from the first concentrating mirror; the photodetector It is used to receive light transmitted through the light receiving cover and convert its light intensity into an electrical signal.
而且,該受光罩可設置有縫隙或針孔,以使在該第一聚光鏡匯集形成的聚光光束透過。Moreover, the light receiving cover may be provided with slits or pinholes for transmitting the concentrated light beam formed by the collection of the first collecting mirror.
另外,該偏轉單元較佳係包含一個聲光偏轉器與一個光偏轉器,用以使光線偏轉到該掃描區域的XY平面上,且分別受到控制。In addition, the deflection unit preferably includes an acousto-optic deflector and a light deflector for deflecting light onto the XY plane of the scanning area and is separately controlled.
此外,該述光偏轉器較佳為位於從該光源單元透過該分光器的光線的光路上。Further, the light deflector is preferably located on the optical path of the light transmitted from the light source unit through the beam splitter.
而且,該光偏轉器可以是掃描鏡、檢流計或者MEMS鏡中的任何一者。Moreover, the light deflector can be any one of a scanning mirror, a galvanometer, or a MEMS mirror.
另外,該偏轉單元可由一對聲光偏振器構成,用以使光線偏轉到該掃描區域的XY平面上,且分別受到控制。Alternatively, the deflection unit may be formed by a pair of acousto-optic polarizers for deflecting light onto the XY plane of the scanning area and controlled separately.
其中,該受光罩較佳被控制成同步於透過該一對聲光偏轉器在XY平面上偏轉的光線而移動。Wherein, the light receiving cover is preferably controlled to move in synchronization with light that is deflected by the pair of acousto-optic deflectors on the XY plane.
而且,該顯微鏡單元可以包括:第一分光器,其設置在該掃描單元的該1/4波長板與該鏡筒透鏡之間,用以反射所輸入的光線,以使其照射到該掃描區域整個領域中;顯微鏡光源,用以產生並輸出光線;第二分光器,其用以將從該顯微鏡光源輸出的光線反射到該第一分光器,並使從該第一分光器反射而射入的光線透過;照相機,用以成像透過該第二分光器的光線,以形成該掃描區域的整體圖像。Moreover, the microscope unit may include: a first beam splitter disposed between the quarter-wave plate of the scanning unit and the barrel lens for reflecting the input light to be irradiated to the scanning area In the entire field; a microscope light source for generating and outputting light; and a second beam splitter for reflecting light output from the microscope light source to the first beam splitter and reflecting from the first beam splitter to be incident The light passes through; the camera images the light transmitted through the second beam splitter to form an overall image of the scanned area.
另外,該控制單元可以包括:圖像分析單元,其透過從該照相機獲取的圖像,分析並傳送該掃描區域中每個掃描位置的光強;映射資訊設置單元,其將從該圖像分析單元傳送的光強設置為每個掃描位置的光強資訊,並將其映射到每個掃描位置的位置資訊;映射資訊搭載單元,其根據外部控制信號搭載所儲存的映射資訊,並將該映射資訊傳送到該資訊設置單元;資訊設置單元,其包含聲強資訊設置單元,該聲強資訊設置單元根據所搭載的映射資訊設置聲強資訊,以調節向每個掃描位置偏轉的光強,並將該聲強資訊傳送到該聲光偏轉器;成像單元,其基於所傳送的光檢測信號,記錄每個掃描位置的圖像,以形成該掃描區域的整體圖像。In addition, the control unit may include: an image analyzing unit that analyzes and transmits the light intensity of each scanning position in the scanning area through the image acquired from the camera; and a mapping information setting unit that will analyze the image from the image The light intensity transmitted by the unit is set to the light intensity information of each scanning position, and is mapped to the position information of each scanning position; the information carrying unit is mounted, and the stored mapping information is carried according to the external control signal, and the mapping is performed. The information is transmitted to the information setting unit; the information setting unit includes a sound intensity information setting unit, and the sound intensity information setting unit sets the sound intensity information according to the loaded mapping information to adjust the light intensity deflected to each scanning position, and The sound intensity information is transmitted to the acousto-optic deflector; an imaging unit that records an image of each scan position based on the transmitted light detection signal to form an overall image of the scan area.
根據本發明,提供一種應用共聚焦顯微鏡結構的被測物圖像獲取方法及系統,其根據掃描區域中由於每個掃描位置表面的反射比、粗糙度及反射角等光學特性不同而致的檢測信號之間的差所引起的圖像的亮度差,對應地根據從每個掃描位置檢測出的光強來調節掃描光的強度並獲得圖像,從而能夠提高掃描區域的檢測精度。According to the present invention, there is provided a method and system for acquiring an image of an object to be measured using a confocal microscope structure, which is detected according to different optical characteristics such as reflectance, roughness and reflection angle of a surface of each scanning position in a scanning region. The difference in luminance of the image caused by the difference between the signals, correspondingly adjusting the intensity of the scanning light according to the intensity of light detected from each scanning position and obtaining an image, can improve the detection accuracy of the scanning region.
對本發明進行說明之前需要說明的是,在以下多個實施例中對具有相同結構的結構元件採用了相同的元件符號,並在第一實施例中進行代表性的說明,而在其餘實施例中說明與第一實施例不同的結構。Before explaining the present invention, it should be noted that in the following embodiments, the same component symbols are used for the structural elements having the same structure, and are representatively illustrated in the first embodiment, and in the remaining embodiments, A structure different from the first embodiment will be described.
下面,參照圖式對本發明的第一實施例所提供的應用共聚焦顯微鏡結構的被測物圖像獲取方法及系統進行詳細的說明。Hereinafter, a method and system for acquiring an object to be measured using a confocal microscope structure according to a first embodiment of the present invention will be described in detail with reference to the drawings.
圖5是本發明的第一實施例所提供的應用共聚焦顯微鏡結構的被測物圖像獲取系統的示意圖。FIG. 5 is a schematic diagram of a sample image acquisition system using a confocal microscope structure according to a first embodiment of the present invention.
如圖5所示,本發明的應用共聚焦顯微鏡結構的被測物圖像獲取系統包含光源單元(10)、偏轉單元(20)、掃描單元(30)、光檢測單元(40)、控制單元(50)及顯微鏡單元(60)。As shown in FIG. 5, the object image acquisition system of the present invention using a confocal microscope structure includes a light source unit (10), a deflection unit (20), a scanning unit (30), a light detecting unit (40), and a control unit. (50) and microscope unit (60).
該光源單元(10)位於被測物(T)的掃描區域上方,並可包含光源(11)與光擴散器(12)。The light source unit (10) is located above the scanning area of the object (T) and may include a light source (11) and a light diffuser (12).
其中,該被測物(T)可位於預定的平台上,該平台可透過預定的驅動手段控制為能夠在Z軸方向上移動。Wherein, the object to be tested (T) can be located on a predetermined platform, and the platform can be controlled to be movable in the Z-axis direction by a predetermined driving means.
該光源(11)是He-Ne雷射器或者二極體雷射器等用於產生光線並將此光線向被測物(T)的Z軸方向輸出的雷射器。The light source (11) is a laser for outputting light and outputting the light to the Z-axis direction of the object to be tested (T), such as a He-Ne laser or a diode laser.
該光擴散器(12)位於光源(11)的前方,用於對從光源(12)輸出的光線進行空間過濾以使光線變形及擴散後將其輸出。The light diffuser (12) is located in front of the light source (11) for spatially filtering the light output from the light source (12) to deform and diffuse the light and output it.
該偏轉單元(20)可以包含用於把入射光向X軸方向或者Y軸方向偏轉的聲光偏轉器(21)、用於向與前述的偏轉軸的方向不同的另一軸向偏轉來自該聲光偏轉器(21)的光線的光偏轉器(22)。The deflection unit (20) may comprise an acousto-optic deflector (21) for deflecting incident light in the X-axis direction or the Y-axis direction, and another axial deflection for different direction from the aforementioned yaw axis A light deflector (22) of the light of the acousto-optic deflector (21).
即,來自光源(12)的入射光可透過偏轉單元(20)偏轉到掃描區域的XY平面上。That is, incident light from the light source (12) can be deflected through the deflection unit (20) onto the XY plane of the scanning area.
和習知技術同樣地,該聲光偏轉器(21)根據由後述之控制單元(50)傳送的聲頻,由壓電壓電致動器按一定週期加壓介質,以生成預定的聲波,從而讓入射光按一定角度向第一軸方向偏轉。Similarly to the prior art, the acousto-optic deflector (21) pressurizes the medium by a piezoelectric piezoelectric actuator for a predetermined period to generate a predetermined sound wave based on the audio transmitted by the control unit (50), which will be described later. The incident light is deflected toward the first axis at an angle.
而且,可根據由控制單元(50)傳送的聲強資訊,壓電致動器按一定強度加壓介質,從而調節入射光的強度後將其輸出。Moreover, according to the sound intensity information transmitted by the control unit (50), the piezoelectric actuator pressurizes the medium with a certain intensity, thereby adjusting the intensity of the incident light and outputting it.
此時,聲光偏轉器(21)的光強(I)與所傳送聲強資訊的聲強(P)具有關聯。At this time, the light intensity (I) of the acousto-optic deflector (21) is associated with the sound intensity (P) of the transmitted sound intensity information.
即在各向同性相互作用(isotropic interaction)下,可用以下公式來進行說明。That is, under isotropic interaction, the following formula can be used for explanation.
其中,I0 是入射光的強度;I1 是輸出光的強度;P是聲強;M、H、L是聲光偏轉器的特徵係數;λ0 是入射光的波長。Where I 0 is the intensity of the incident light; I 1 is the intensity of the output light; P is the sound intensity; M, H, L are the characteristic coefficients of the acousto-optic deflector; λ 0 is the wavelength of the incident light.
另外在各向異性相互作用(anisotropic interaction)下,也可用向量形式說明與聲強資訊的聲強之間的關係。In addition, under the anisotropic interaction, the relationship between the sound intensity and the sound intensity of the sound intensity information can also be explained by the vector form.
即,這說明可以不受偏轉角與聲頻具有關聯的影響,能夠獨自地調節光強。That is, this means that it is possible to adjust the light intensity independently without being affected by the deflection angle and the audio frequency.
該光偏轉器(22)可以是掃描鏡、檢流計或者MEMS鏡中任何一個,其被配置為根據從後述之控制單元(50)傳送的預定的驅動資訊驅動而使入射光向第二軸方向偏轉。The light deflector (22) may be any one of a scanning mirror, a galvanometer or a MEMS mirror configured to drive incident light to the second axis in accordance with predetermined driving information transmitted from a control unit (50), which will be described later. Direction deflection.
透過如此的聲光偏轉器(21)與光偏轉器(22),光線能夠偏轉到掃描區域的XY平面上,尤其是,透過聲光偏轉器(21)偏轉的光線,其強度被調節後輸出。Through such an acousto-optic deflector (21) and a light deflector (22), the light can be deflected onto the XY plane of the scanning area, in particular, the light deflected by the acousto-optic deflector (21) is adjusted and output. .
該掃描單元(30)包含殼體(30A),並在該殼體(30A)的內側,從光源單元(10)方向依次設置有分光器(31)、掃描透鏡(32)、鏡筒透鏡(33)、1/4波長板(34)及物鏡(35),且能夠透過預定的驅動手段在Z軸方向上移動。The scanning unit (30) includes a housing (30A), and inside the housing (30A), a beam splitter (31), a scanning lens (32), and a lens barrel are sequentially disposed from the direction of the light source unit (10). 33), a quarter-wave plate (34) and an objective lens (35), and are movable in the Z-axis direction by a predetermined driving means.
透過聲光偏轉器(21)偏轉的光線經由分光器(31)、掃描透鏡(32)、鏡筒透鏡(33)、1/4波長板(34)及物鏡(35)後掃描到掃描區域中每個掃描位置上,而在每個掃描位置反射的光線則經由物鏡(35)、1/4波長板(34)、鏡筒透鏡(33)、掃描透鏡(32)後在分光器(31)處反射。The light deflected by the acousto-optic deflector (21) is scanned into the scanning area via the beam splitter (31), the scanning lens (32), the lens barrel (33), the quarter-wave plate (34), and the objective lens (35). At each scanning position, the light reflected at each scanning position passes through the objective lens (35), the quarter-wave plate (34), the lens barrel (33), the scanning lens (32), and then the beam splitter (31). Reflected at the place.
其中,分光器(31)可由半透明反射鏡(half mirror)或者偏振光束分光器(Polarizing Beam Splitter,PBS)中任何一個構成,並被構成為根據波長其透射率與反射率也隨之變化,藉此能夠分離兩個光線。Wherein, the beam splitter (31) may be constituted by any one of a half mirror or a polarizing beam splitter (PBS), and is configured to change its transmittance and reflectance according to the wavelength. Thereby it is possible to separate the two rays.
該分光器(31)設置在聲光偏轉器(21)與光偏轉器(22)之間,分光器(31)能夠讓從聲光偏轉器(21)經過偏轉而射入的光線透過,並讓從掃描區域射入的光線經由1/4波長板(34)的過程中其波長被改變而反射。The beam splitter (31) is disposed between the acousto-optic deflector (21) and the light deflector (22), and the beam splitter (31) can transmit light incident from the acousto-optic deflector (21) through deflection, and The light incident from the scanning area is reflected by changing its wavelength during the passage of the quarter-wave plate (34).
結果,透過分光器(31)與1/4波長板(34),可以分離從光源單元(10)射向掃描區域的光線與從掃描區域射入的光線。As a result, the light that is incident from the light source unit (10) toward the scanning area and the light that is incident from the scanning area can be separated by the spectroscope (31) and the quarter-wave plate (34).
掃描透鏡(32)被設置為可讓透過光偏轉器(22)偏轉的光線在上部平面(32a)聚焦,而在上部平面(32a)聚焦的光線經過鏡筒透鏡(33)後輸出為平行光,並傳遞到物鏡(35)。The scanning lens (32) is arranged to allow light deflected by the light deflector (22) to be focused on the upper plane (32a), and the light focused on the upper plane (32a) is output as parallel light after passing through the lens barrel (33). And passed to the objective lens (35).
透過這種聲光偏轉器(21)偏轉的光線能夠透過掃描透鏡(32)與鏡筒透鏡(33)準確地傳遞到物鏡(35)。Light deflected by such an acousto-optic deflector (21) can be accurately transmitted to the objective lens (35) through the scanning lens (32) and the lens barrel (33).
該光檢測單元(40)包含第一聚光鏡(41)、受光罩(42)及光電探測器(43),藉以檢測從掃描區域中每個掃描位置反射過來的光線。The light detecting unit (40) includes a first collecting mirror (41), a light receiving cover (42) and a photodetector (43) for detecting light reflected from each scanning position in the scanning area.
第一聚光鏡(41)接收透過前述1/4波長板(34)反射的光線,並使之成為聚光光束。The first condensing mirror (41) receives the light reflected by the 1/4 wavelength plate (34) and makes it a condensed beam.
如圖所示,受光罩(42)可以是具有縫隙(42a)的縫隙掩模,或者是具有針孔(pin hole)的針孔掩膜(未圖示),可透過該縫隙(42a)或者針孔接收來自第一聚光鏡(41)的聚光光束。As shown, the mask (42) may be a slit mask having a slit (42a) or a pinhole mask (not shown) having a pin hole through which the slit (42a) or The pinhole receives a concentrated beam from the first condenser (41).
光電探測器(43)由光電二極體等構成,其接收透過受光罩(42)的縫隙(42a)的光線,並將其光強轉換為電氣信號。The photodetector (43) is composed of a photodiode or the like which receives light transmitted through the slit (42a) of the light receiving cover (42) and converts its light intensity into an electrical signal.
該顯微鏡單元(60)包含第一分光器(61)、顯微鏡光源(62)、擴散透鏡(63)、第二分光器(64)與圖像獲取部(65)。The microscope unit (60) includes a first beam splitter (61), a microscope light source (62), a diffusion lens (63), a second beam splitter (64), and an image acquisition portion (65).
其中,第一分光器(61)與第二分光器(64)可具有與上述分光器(31)相同的結構,而在本實施例中該第一分光器由半透明反射鏡構成。The first beam splitter (61) and the second beam splitter (64) may have the same structure as the above-mentioned beam splitter (31), and in the embodiment, the first beam splitter is constituted by a semi-transparent mirror.
該第一分光器(61)設置在鏡筒透鏡(33)與1/4波長板(34)之間,用以把透過顯微鏡光源(62)輸出的光線射入掃描單元(30)的光路上,藉以對整個掃描區域照射光線,並將由掃描區域反射的光線反射,以供圖像獲取部(65)獲取。The first beam splitter (61) is disposed between the lens barrel lens (33) and the quarter-wavelength plate (34) for injecting light transmitted through the microscope light source (62) into the optical path of the scanning unit (30). Thereby, the entire scanning area is irradiated with light, and the light reflected by the scanning area is reflected for acquisition by the image acquiring unit (65).
該顯微鏡光源(62)由與該光源單元(10)的雷射部(11)等對應的部件構成,用以輸出光線,擴散透鏡(63)設置為其用以擴散來自顯微鏡光源(61)的輸出光。The microscope light source (62) is composed of a member corresponding to the laser portion (11) of the light source unit (10) for outputting light, and the diffusion lens (63) is disposed to diffuse from the microscope light source (61). Output light.
該第二分光器(64)設置為其將由顯微鏡光源(62)輸出的光線反射到第一分光器(61),並使由第一分光器(61)傳遞的光線透過。The second beam splitter (64) is arranged to reflect light output by the microscope source (62) to the first beam splitter (61) and to transmit light transmitted by the first beam splitter (61).
該圖像獲取部(65)包含用以匯集透過第二分光器(64)的光線的第二聚光鏡(65B)、以及接收所匯集的光線並獲取掃描區域的整體圖像的照相機(65A)。The image acquisition unit (65) includes a second condensing mirror (65B) for collecting light transmitted through the second beam splitter (64), and a camera (65A) that receives the collected light and acquires an overall image of the scanned area.
顯微鏡單元(60)可透過掃描單元(30)的光路對整個掃描區域照射光線,並藉此迅速地獲取掃描區域的整體圖像。The microscope unit (60) can illuminate the entire scanning area through the optical path of the scanning unit (30), and thereby quickly acquire an overall image of the scanning area.
圖6是圖5中控制單元的具體結構方塊圖。如圖5及圖6所示,該控制單元(50)包含資訊設置單元(51)、圖像分析單元(52)、映射資訊設置單元(53)、映射資訊搭載單元(54)及成像單元(55)。Figure 6 is a block diagram showing the specific structure of the control unit of Figure 5. As shown in FIG. 5 and FIG. 6, the control unit (50) includes an information setting unit (51), an image analyzing unit (52), a mapping information setting unit (53), a mapping information loading unit (54), and an imaging unit ( 55).
該資訊設置單元(51)包含聲頻資訊設置單元(51A)、聲強資訊設置單元(51B)及驅動資訊設置單元(51C)。The information setting unit (51) includes an audio information setting unit (51A), a sound intensity information setting unit (51B), and a driving information setting unit (51C).
聲頻資訊設置單元(51A)可設置聲光偏轉器(21)的偏轉角的控制信號:聲頻資訊,驅動資訊設置單元(51C)可設置光偏轉器(22)的偏轉角的控制信號:驅動資訊。The audio information setting unit (51A) can set a control signal of the deflection angle of the acousto-optic deflector (21): audio information, and the driving information setting unit (51C) can set the control signal of the deflection angle of the optical deflector (22): driving information .
聲強資訊設置單元(51B)可設置用以控制透過聲光偏轉器(21)輸出的光強的控制信號:聲強資訊。The sound intensity information setting unit (51B) may set a control signal for controlling the light intensity output through the acousto-optic deflector (21): sound intensity information.
其中,在每個設置單元設置的每個資訊可由管理者設置,或者可以被設置為,基於後述之映射資訊搭載單元(54)根據預定的控制信號所搭載的掃描區域的映射資訊,光電探測器(43)從該掃描區域的每個掃描位置上的光線所獲取的光檢測信號能夠維持在一定程度以上。Wherein, each information set in each setting unit may be set by an administrator, or may be set to be based on mapping information of a scanning area carried by the mapping information loading unit (54) according to a predetermined control signal, a photodetector (43) The light detection signal obtained from the light at each scanning position of the scanning area can be maintained at a certain level or more.
結果,聲光偏轉器(21)根據所傳送的聲頻資訊,使入射光朝X軸或者Y軸方向中任一個方向偏轉的同時,根據聲強資訊其強度被調節後。As a result, the acousto-optic deflector (21) deflects the incident light toward either of the X-axis or the Y-axis direction according to the transmitted audio information, and adjusts the intensity according to the intensity information.
而且,光偏轉器(22)根據所傳送的驅動資訊,使入射光朝與聲光偏轉器(21)引起的偏轉方向不同的軸向偏轉後將其輸出。Further, the optical deflector (22) deflects the incident light toward an axial direction different from the deflection direction caused by the acousto-optic deflector (21) based on the transmitted drive information, and outputs it.
藉此,射入偏轉單元(20)的光線能夠依次向掃描區域的XY平面偏轉的同時,其強度被調節後輸出。Thereby, the light incident on the deflection unit (20) can be sequentially deflected toward the XY plane of the scanning area, and its intensity is adjusted and output.
該圖像分析單元(52)構成為從由照相機(65A)獲取的掃描區域的全體圖像分析每個掃描位置的光強,以獲取每個掃描位置的光強資訊後,將獲取的每個掃描位置的光強資訊傳送到映射資訊設置單元(53)。The image analyzing unit (52) is configured to analyze the light intensity of each scanning position from the entire image of the scanning area acquired by the camera (65A) to acquire the light intensity information of each scanning position, and each of the acquired The light intensity information of the scanning position is transmitted to the mapping information setting unit (53).
該映射資訊設置單元(53)可被構成為將由圖像分析單元(52)傳送的每個掃描位置的光強資訊映射到每個掃描位置的位置資訊以作為映射資訊,並將其保存到預定的儲存裝置。The mapping information setting unit (53) may be configured to map light intensity information of each scanning position transmitted by the image analyzing unit (52) to position information of each scanning position as mapping information and save it to a predetermined schedule. Storage device.
該映射資訊搭載單元(54)可被構成為根據指示為搭載相應掃描區域的映射資訊的預定的外部信號或者控制信號,搭載所儲存的映射資訊,並將其傳送到該資訊設置單元(51)。The mapping information loading unit (54) may be configured to mount the stored mapping information based on a predetermined external signal or control signal indicating that the mapping information of the corresponding scanning area is mounted, and transmit the stored mapping information to the information setting unit (51). .
該成像單元(55)可被構成為其與光電探測器(43)相連接,並從該被測物(T)與該掃描單元(30)之間的Z軸相隔距離的變化過程中所檢測的每個掃描位置的多個光檢測信號中選擇其中一個,藉以形成每個掃描位置的信號強度(圖像)。The imaging unit (55) may be configured to be coupled to the photodetector (43) and detected during a change in distance from the Z-axis between the object (T) and the scanning unit (30) One of the plurality of light detecting signals at each scanning position is selected to form a signal intensity (image) of each scanning position.
其中,所選擇的光檢測信號可以是光電探測器(43)在最高電壓時的光檢測信號。The selected photodetection signal may be a photodetection signal of the photodetector (43) at the highest voltage.
結果,能夠構成為可記錄每個掃描位置的圖像,並透過預定的演算法形成掃描區域的整體圖像,該整體圖像則透過預定的顯示裝置得到顯示。As a result, it is possible to configure an image for each scanning position and form an entire image of the scanning area through a predetermined algorithm, and the entire image is displayed through a predetermined display device.
下面說明採用了上述應用共聚焦顯微鏡結構的被測物圖像獲取系統的圖像獲取方法。圖7是應用了圖5所示系統的被測物圖像獲取方法的演算法。Next, an image acquisition method using the image acquisition system of the object to which the confocal microscope structure is applied will be described. Fig. 7 is an algorithm of a method of acquiring an object image to which the system shown in Fig. 5 is applied.
如圖5至圖7所示,由顯微鏡光源(62)產生光線,並將其輸出到第二分光器(64,S10)。As shown in Figures 5 through 7, light is generated by the microscope source (62) and output to the second beam splitter (64, S10).
第二分光器(64)反射來自顯微鏡光源(62)的入射光,並將其輸入於第一分光器(61,S11)。The second beam splitter (64) reflects incident light from the microscope source (62) and inputs it to the first beam splitter (61, S11).
所輸入的光線透過第一分光器(61)反射後,透過掃描單元(30)的光路照射到整體掃描區域(S12)。The input light is reflected by the first beam splitter (61), and then transmitted through the optical path of the scanning unit (30) to the entire scanning area (S12).
由掃描區域反射的光線射入於掃描單元(30),並透過第一分光器(61)朝第二分光器(64)方向反射(S13)。The light reflected by the scanning area is incident on the scanning unit (30) and reflected toward the second beam splitter (64) through the first beam splitter (61) (S13).
由第一分光器(61)反射的光線通過第二分光器(64),而所通過的光線透過第二聚光鏡(65B)匯集後,由照相機(65A)獲取掃描區域的整體圖像(S14)。The light reflected by the first beam splitter (61) passes through the second beam splitter (64), and the passed light is collected by the second condenser (65B), and the entire image of the scanned area is acquired by the camera (65A) (S14) .
所獲取的掃描區域的整體圖像傳送到圖像分析單元(52),圖像分析單元(52)透過所傳送的整體圖像分析每個掃描位置的光線,以獲取每個掃描位置的光強資訊後將其傳送到映射資訊設置單元(53,S15)。The acquired overall image of the scanned area is transmitted to an image analyzing unit (52), and the image analyzing unit (52) analyzes the light of each scanning position through the transmitted whole image to obtain the light intensity of each scanning position. After the information is transmitted to the mapping information setting unit (53, S15).
把傳送到映射資訊設置單元(53)的每個掃描位置的光強資訊映射到每個掃描位置的位置資訊,藉以設置映射資訊後將其保存到預定的儲存裝置(S16)。The light intensity information transmitted to each scanning position of the mapping information setting unit (53) is mapped to the position information of each scanning position, whereby the mapping information is set and saved to a predetermined storage device (S16).
如此透過顯微鏡單元(60)獲取掃描區域的整體圖像而設置每個掃描位置的映射資訊的方式,與習知的對整個掃描區域進行一次掃描後,根據每個掃描位置的表面資訊設置光強並予以儲存的方式相比,更能有效而迅速地設置並儲存映射資訊。In this way, the microscopic unit (60) acquires the entire image of the scanned area and sets the mapping information of each scanning position, and after performing a scan on the entire scanning area, the light intensity is set according to the surface information of each scanning position. Compared with the way of storing, it is more efficient and quick to set and store mapping information.
接著,由設置在被測物(P)上方的光源單元(10)產生光線,並將此光線輸出到掃描區域(S20)。Next, light is generated by the light source unit (10) disposed above the object to be tested (P), and this light is output to the scanning area (S20).
然後,如果由管理者施加指示為搭載對應於掃描區域中各掃描位置的映射資訊的控制信號,由映射資訊搭載單元(54)從所儲存的映射資訊中搭載相應掃描區域的映射資訊,並將其傳送到資訊設置單元(51,S30)。Then, if a control signal indicating that the mapping information corresponding to each scanning position in the scanning area is mounted by the administrator, the mapping information loading unit (54) loads the mapping information of the corresponding scanning area from the stored mapping information, and It is transmitted to the information setting unit (51, S30).
資訊設置單元(51)基於所傳送的映射資訊設置聲頻資訊與驅動資訊,以使光線向每個掃描位置偏轉,並設置聲強資訊,以使在每個掃描位置反射並在光電探測器(43)檢測出的光強被調節為已設定的光強後被檢測(S40)。The information setting unit (51) sets the audio information and the driving information based on the transmitted mapping information to deflect the light to each scanning position, and sets the sound intensity information so as to be reflected at each scanning position and in the photodetector (43). The detected light intensity is adjusted to the set light intensity and is detected (S40).
其中,已設定的光強可由管理者進行設置。Among them, the set light intensity can be set by the administrator.
偏轉單元(20)根據所傳送的聲頻資訊與驅動資訊使入射光偏轉,尤其是,聲光偏轉器(21)在偏轉入射光的同時,根據聲強資訊調節光強後予以輸出(S50)。The deflection unit (20) deflects the incident light according to the transmitted audio information and the driving information. In particular, the acousto-optic deflector (21) adjusts the light intensity according to the sound intensity information while deflecting the incident light (S50).
然後,所輸出的光線透過掃描單元(30)掃描到每個掃描位置並被反射後重新輸入於掃描單元(30,S60)。Then, the output light is scanned by the scanning unit (30) to each scanning position and reflected and re-entered into the scanning unit (30, S60).
輸入於掃描單元(30)的光線透過分光器(31)反射後,由光電探測器(43)進行檢測,而成像單元(55)則記錄所檢測到的光檢測信號(S70)。The light input to the scanning unit (30) is reflected by the spectroscope (31), detected by the photodetector (43), and the imaging unit (55) records the detected photodetection signal (S70).
接著在z軸上,將該掃描單元(30)與該被測物(T)之間的距離改變預定距離,並依次執行步驟S60~步驟S70(S80)。Next, on the z-axis, the distance between the scanning unit (30) and the object to be tested (T) is changed by a predetermined distance, and steps S60 to S70 are sequentially performed (S80).
其中,預定距離可以由管理者設置,該步驟S80可以執行多次。Wherein, the predetermined distance can be set by the administrator, and the step S80 can be performed multiple times.
而且,成像單元(55)可在透過該步驟S80檢測出的、根據每個掃描位置在Z軸上的距離變化而獲得的多個光檢測信號中選擇任意一個,並在此基礎上形成每個掃描位置的圖像,藉此獲取掃描區域的整體圖像(S90)。Moreover, the imaging unit (55) can select any one of the plurality of light detection signals obtained by the change in the distance on the Z axis of each scanning position detected by the step S80, and form each of them on the basis of The image of the position is scanned, whereby an overall image of the scanned area is acquired (S90).
其中,所選擇的光檢測信號可以是光電探測器(43)的信號強度為最大時,即光電探測器(43)在最大電壓時的光檢測信號。The selected light detecting signal may be a light detecting signal when the signal intensity of the photodetector (43) is maximum, that is, when the photodetector (43) is at the maximum voltage.
透過這種方法,能夠盡可能地平均化根據每個掃描位置表面的光學特性:反射比、粗糙度及反射角等的不同而不同的所獲取圖像(光檢測信號)的光強之差,並藉此能提高被測物的檢測精度。In this way, it is possible to average the difference in the optical intensity of the acquired image (photodetection signal) differently depending on the optical characteristics of the surface of each scanning position, such as the reflectance, the roughness, and the reflection angle. Thereby, the detection accuracy of the measured object can be improved.
而且,能夠使透過聲光偏轉器輸出的光線偏轉的同時調節光強,因此無需設置用以調節強度的額外的控制手段,可對掃描區域進行高精度及迅速的掃描。Moreover, since the light intensity transmitted through the acousto-optic deflector can be deflected while adjusting the light intensity, it is not necessary to provide an additional control means for adjusting the intensity, and the scanning area can be scanned with high precision and speed.
另一方面,作為該映射資訊設置方法的另一例,可從外部直接輸入包含每個掃描位置光強資訊的映射資訊。On the other hand, as another example of the mapping information setting method, mapping information including light intensity information for each scanning position can be directly input from the outside.
其中,從外部輸入的映射資訊可以是含有對掃描區域的表面資訊及光強資訊的圖。The mapping information input from the outside may be a map containing surface information and light intensity information on the scanning area.
因此,當輸入圖時,能夠簡便地根據圖中各掃描位置的光強資訊,而設置及儲存映射資訊。Therefore, when the map is input, the mapping information can be easily set and stored according to the light intensity information of each scanning position in the drawing.
當提供圖的情況下,也可與其他方法同樣地由映射資訊搭載單元(54)根據預定的控制信號搭載掃描區域中每個掃描位置的映射資訊後,將其傳送到資訊設置單元(51)。When the map is provided, the mapping information loading unit (54) may load the mapping information of each scanning position in the scanning area based on the predetermined control signal, and transmit it to the information setting unit (51). .
透過上述方法能夠簡便地設置映射資訊,且以此為基礎調節光線,以最大限度地發揮光電探測器的性能後用調節後的光線進行掃描,從而提高檢測精度。Through the above method, the mapping information can be easily set, and the light is adjusted based on this, so as to maximize the performance of the photodetector and then scan with the adjusted light, thereby improving the detection accuracy.
下面為一具體例說明透過本發明的上述圖像獲取方法與習知圖像獲取方法獲取的圖像。The image obtained by the above-described image acquisition method and the conventional image acquisition method of the present invention will be described below as a specific example.
在本具體例中,係假設被測物是固定的,而只有掃描單元在Z軸方向上移動,並對同樣的掃描區域進行掃描。In this specific example, it is assumed that the object to be tested is fixed, and only the scanning unit moves in the Z-axis direction, and the same scanning area is scanned.
圖8是用以表示根據習知圖像獲取方法獲取的每個掃描位置的光檢測信號強度的曲線圖,圖9是根據圖8的曲線圖結果所獲取的圖像。8 is a graph for indicating the light detection signal intensity of each scanning position acquired according to the conventional image acquisition method, and FIG. 9 is an image acquired according to the graph result of FIG.
請參見圖8,其表示的是具有單一強度的光線掃描到掃描區域,掃描單元(30)與被測物(T)在Z軸上的相隔距離多次被調節的情況下在掃描位置1~掃描位置4上記錄的、按掃描位置的光檢測信號。Referring to FIG. 8, it is shown that the light having a single intensity is scanned into the scanning area, and the scanning unit (30) and the measured object (T) are adjusted in the Z-axis multiple times in the scanning position 1~ The light detection signal at the scanning position recorded at the scanning position 4 is scanned.
其中,對於掃描位置1與掃描位置2而言,在掃描單元與被測物之間的相隔距離為40 μm時檢測到的光強最強,而該40 μm可以認定為掃描位置1與掃描位置2的高度。Wherein, for the scanning position 1 and the scanning position 2, the detected light intensity is the strongest when the distance between the scanning unit and the object to be tested is 40 μm, and the 40 μm can be regarded as the scanning position 1 and the scanning position 2 the height of.
而且,對於掃描位置3而言,可以看出整體上處於光強過弱的狀態,對於掃描位置4而言,在40 μm~60 μm處處於光強過強的狀態。Further, as for the scanning position 3, it can be seen that the light intensity is too weak as a whole, and for the scanning position 4, the light intensity is too strong at 40 μm to 60 μm.
透過如此被檢測出之在不同的Z軸相隔距離下的光檢測信號,成像單元在光檢測信號中選擇最大電壓下的光檢測信號,並以此為基礎形成如圖9所示的每個掃描位置的圖像。Through the light detection signals thus detected at different Z-axis separation distances, the imaging unit selects the light detection signals at the maximum voltage among the light detection signals, and based on this, each scan as shown in FIG. 9 is formed. The image of the location.
即,亮處過亮,暗處過暗,從而得到在不同的掃描位置上光強的偏差嚴重的圖像,最終只能導致檢測精度下降。That is, the bright place is too bright, the dark place is too dark, and thus the image with severe deviation of the light intensity at different scanning positions is obtained, and finally the detection accuracy is only lowered.
相反地,依據本發明圖像獲取方法的結果如下。In contrast, the results of the image acquisition method according to the present invention are as follows.
圖10是用以表示根據映射資訊設置聲強資訊而獲取的、在每個掃描位置上具有不同的Z軸相隔距離的情況下獲得的光檢測信號大小的曲線圖,圖11是根據圖10中曲線圖結果而獲取的圖像。FIG. 10 is a graph showing the magnitude of the light detection signal obtained in the case where the Z-axis separation distance is obtained at each scanning position, which is obtained by setting the sound intensity information according to the mapping information, and FIG. 11 is according to FIG. The image obtained from the graph results.
如圖10所示,如果透過預定的控制信號搭載包含掃描位置1~掃描位置4的映射資訊,就能根據包含於映射資訊中的、在每個掃描位置上檢測出的光強資訊,適當地設置聲強資訊。As shown in FIG. 10, if the mapping information including the scanning position 1 to the scanning position 4 is mounted by a predetermined control signal, the light intensity information detected at each scanning position included in the mapping information can be appropriately selected. Set the sound intensity information.
如果假設包含於映射資訊中的光強資訊與基於該習知方法的、在不同的Z軸相隔距離下檢測出的光檢測信號相同,就能夠把每個掃描位置相對於Z軸相隔距離的聲強資訊設置為,整體上光檢測信號過低的掃描位置3在相應的Z軸相隔距離下顯示的光檢測信號較高,整體上光檢測信號過高的掃描位置4在相應的Z軸相隔距離下顯示的光檢測信號較低。If it is assumed that the light intensity information included in the mapping information is the same as the light detection signal detected at different Z-axis distances based on the conventional method, the sound of each scanning position separated from the Z axis can be separated. The strong information is set such that the scanning position 3 whose overall photodetection signal is too low is higher at the corresponding Z-axis separation distance, and the scanning position 4 where the photodetection signal is too high as a whole is separated by the corresponding Z-axis. The light detection signal shown below is lower.
根據如此被設置的聲強資訊,聲光偏轉器可按每個掃描位置調節光強後輸出,而隨之按每個掃描位置檢測出的光檢測信號可以如圖中所示的曲線圖。According to the sound intensity information thus set, the acousto-optic deflector can adjust the light intensity for each scanning position and output, and the light detection signal detected at each scanning position can be a graph as shown in the figure.
在如此被檢測出的按Z軸相隔距離的光檢測信號的基礎上,成像單元在光檢測信號中選擇最大電壓下的光檢測信號,並以此為基礎形成每個掃描位置的圖像,如圖11所示。On the basis of the detected light detection signals according to the Z-axis separation distance, the imaging unit selects the light detection signals at the maximum voltage among the light detection signals, and based on this, forms an image of each scanning position, such as Figure 11 shows.
即,能夠使暗處變亮一定程度以上,使亮處變暗一定程度,從而減少每個掃描位置上的光強偏差,以提高檢測精度。That is, it is possible to make the dark portion brighter to a certain extent or more, and to make the bright portion darker to a certain extent, thereby reducing the light intensity deviation at each scanning position, thereby improving the detection accuracy.
此外,根據從每個掃描位置檢測到的光強而設置聲強資訊,從而能夠調節掃描光線的光強而獲得平均化的圖像,進而能夠提升整體掃描區域的檢測精度。Further, by setting the sound intensity information based on the light intensity detected from each scanning position, it is possible to adjust the light intensity of the scanning light to obtain an averaged image, and it is possible to improve the detection accuracy of the entire scanning area.
本發明的範圍並不侷限於上述實施例,在後述之申請專利範圍內可以實施多種形態的實施例。在不脫離申請專利範圍所要求保護的本發明要旨的情況下,本發明所屬技術領域中具有通常知識者均能進行變化的範圍理應屬於本發明的保護範圍。The scope of the present invention is not limited to the above embodiments, and various embodiments of the embodiments can be implemented within the scope of the appended claims. The scope of the invention, which can be varied by those skilled in the art to which the invention pertains, is intended to be within the scope of the invention.
若採用本發明的應用共聚焦顯微鏡結構的被測物圖像獲取方法及系統,就能根據掃描區域中由於每個掃描位置表面的反射比、粗糙度及反射角等光學特性不同而致的檢測信號之間的差所引起的圖像的亮度差,對應地根據從每個掃描位置檢測出的光強來調節掃描光的強度並獲得圖像,藉以提高掃描區域的檢測精度。According to the method and system for acquiring an object image using the confocal microscope structure of the present invention, it is possible to detect the optical characteristics of the surface of each scanning position due to the difference in reflectance, roughness, and reflection angle of each scanning position. The difference in luminance of the image caused by the difference between the signals, correspondingly adjusts the intensity of the scanning light according to the intensity of light detected from each scanning position and obtains an image, thereby improving the detection accuracy of the scanning area.
1...掃描光學系統1. . . Scanning optical system
2...掃描區域2. . . Scanning area
3...縫隙掩模3. . . Gap mask
4...光電探測器4. . . Photodetector
10...光源單元10. . . Light source unit
11...光源11. . . light source
12...光擴散器12. . . Light diffuser
20...偏轉單元20. . . Deflection unit
21...聲光偏轉器twenty one. . . Acousto-optic deflector
22...光偏轉器twenty two. . . Light deflector
30...掃描單元30. . . Scanning unit
30A...殼體30A. . . case
31...分光器31. . . Splitter
32...掃描透鏡32. . . Scanning lens
32a...平面32a. . . flat
33...鏡筒透鏡33. . . Barrel lens
34...1/4波長板34. . . 1/4 wavelength plate
35...物鏡35. . . Objective lens
40...光檢測單元40. . . Light detection unit
41...第一聚光鏡41. . . First concentrating mirror
42...受光罩42. . . Photomask
42a...縫隙42a. . . Gap
43...光電探測器43. . . Photodetector
50...控制單元50. . . control unit
51...資訊設置單元51. . . Information setting unit
51A...聲頻資訊設置單元51A. . . Audio information setting unit
51B...聲強資訊設置單元51B. . . Sound intensity information setting unit
51C...驅動資訊設置單元51C. . . Drive information setting unit
52...圖像分析單元52. . . Image analysis unit
53...映射資訊設置單元53. . . Mapping information setting unit
54...映射資訊搭載單元54. . . Mapping information piggyback unit
55...成像單元55. . . Imaging unit
60...顯微鏡單元60. . . Microscope unit
61...第一分光器61. . . First beam splitter
62...顯微鏡光源62. . . Microscope light source
63...擴散透鏡63. . . Diffusion lens
64...第二分光器64. . . Second beam splitter
65...圖像獲取部65. . . Image acquisition department
65A...照相機65A. . . camera
65B...第二聚光鏡65B. . . Second concentrating mirror
a...壓電轉換器a. . . Piezoelectric converter
b...介質b. . . medium
c...聲波c. . . Sound wave
T...被測物T. . . Measured object
圖1是聲光偏轉單元的示意圖。1 is a schematic view of an acousto-optic deflection unit.
圖2是射入聲光偏轉單元的光線轉換圖。2 is a light conversion diagram of the incident sound and light deflection unit.
圖3及圖4是共聚焦顯微鏡結構的聚焦圖。3 and 4 are focus views of the confocal microscope structure.
圖5是採用了本發明第一實施例所提供的共聚焦顯微鏡結構的被測物圖像獲取系統的示意圖。Fig. 5 is a schematic diagram of an object image acquisition system using the confocal microscope structure provided by the first embodiment of the present invention.
圖6是圖5中控制單元的具體結構圖。Figure 6 is a detailed structural view of the control unit of Figure 5.
圖7是採用了圖5所示系統的被測物圖像獲取方法的演算法。Fig. 7 is an algorithm of a method for acquiring an object image using the system shown in Fig. 5.
圖8是用以表示根據習知圖像獲取方法所獲得的每個掃描位置的光檢測信號大小的曲線圖。Fig. 8 is a graph for showing the magnitude of a light detecting signal for each scanning position obtained by a conventional image capturing method.
圖9是根據圖8所示曲線圖結果而獲得的圖像。Fig. 9 is an image obtained based on the results of the graph shown in Fig. 8.
圖10是用以表示根據映射資訊設置聲強資訊而獲取的、在每個掃描位置上具有不同的Z軸相隔距離的情況下獲得的光檢測信號大小的曲線圖。Fig. 10 is a graph showing the magnitudes of photodetection signals obtained in the case where the Z-axis separation distances are obtained at each scanning position, which are obtained by setting the sound intensity information based on the mapping information.
圖11是根據圖10所示曲線圖結果所獲得的圖像。Fig. 11 is an image obtained based on the results of the graph shown in Fig. 10.
10...光源單元10. . . Light source unit
11...光源11. . . light source
12...光擴散器12. . . Light diffuser
20...偏轉單元20. . . Deflection unit
21...聲光偏轉器twenty one. . . Acousto-optic deflector
22...光偏轉器twenty two. . . Light deflector
30...掃描單元30. . . Scanning unit
30A...殼體30A. . . case
31...分光器31. . . Splitter
32...掃描透鏡32. . . Scanning lens
32a...平面32a. . . flat
33...鏡筒透鏡33. . . Barrel lens
34...1/4波長板34. . . 1/4 wavelength plate
35...物鏡35. . . Objective lens
40...光檢測單元40. . . Light detection unit
41...第一聚光鏡41. . . First concentrating mirror
42...受光罩42. . . Photomask
42a...縫隙42a. . . Gap
43...光電探測器43. . . Photodetector
60...顯微鏡單元60. . . Microscope unit
61...第一分光器61. . . First beam splitter
62...顯微鏡光源62. . . Microscope light source
63...擴散透鏡63. . . Diffusion lens
64...第二分光器64. . . Second beam splitter
65...圖像獲取部65. . . Image acquisition department
65A...照相機65A. . . camera
65B...第二聚光鏡65B. . . Second concentrating mirror
Claims (16)
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020100032383A KR101103323B1 (en) | 2010-04-08 | 2010-04-08 | Image Acquisition Method and System of Measurement Object Using Confocal Microscopy Structure |
Publications (2)
Publication Number | Publication Date |
---|---|
TW201142354A TW201142354A (en) | 2011-12-01 |
TWI452335B true TWI452335B (en) | 2014-09-11 |
Family
ID=44763353
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW100111603A TWI452335B (en) | 2010-04-08 | 2011-04-01 | Method and system for obtaining object image using confocal microscope |
Country Status (3)
Country | Link |
---|---|
KR (1) | KR101103323B1 (en) |
TW (1) | TWI452335B (en) |
WO (1) | WO2011126219A2 (en) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101383805B1 (en) | 2012-04-02 | 2014-04-10 | 주식회사 에스피바이오 | Fluorescence image documentation system using LASER beam |
TWI490542B (en) | 2013-05-07 | 2015-07-01 | Univ Nat Taiwan | A scanning lens and an interference measuring device using the scanning lens |
KR102209500B1 (en) * | 2016-08-02 | 2021-02-01 | 연용현 | Lidar apparatus |
GB201704771D0 (en) | 2017-01-05 | 2017-05-10 | Illumina Inc | Modular optical analytic systems and methods |
KR102116889B1 (en) * | 2018-10-30 | 2020-05-29 | (주)자비스 | A Transmission X-Ray Microscope with an Enhanced Guiding Property |
KR102082747B1 (en) * | 2019-01-23 | 2020-02-28 | 연세대학교 산학협력단 | Focal-length adjustable 3D imaging device and method based LED array |
CN110017783B (en) * | 2019-05-20 | 2023-09-29 | 广东理工学院 | Plate displacement on-line detection device and conveying system |
CN111610197B (en) * | 2020-06-01 | 2023-09-12 | 上海御微半导体技术有限公司 | Defect detection device and defect detection method |
KR20240177304A (en) | 2023-06-19 | 2024-12-27 | 단국대학교 산학협력단 | Image acquisition system using pinhole and image acquisition method using pinhole |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6856457B2 (en) * | 2001-03-27 | 2005-02-15 | Prairie Technologies, Inc. | Single and multi-aperture, translationally-coupled confocal microscope |
CN1662811A (en) * | 2002-05-07 | 2005-08-31 | 应用材料股份有限公司 | Dual spot phase-sensitive detection |
US20080151366A1 (en) * | 2006-12-25 | 2008-06-26 | Olympus Corporation | Laser microscope and control method for the same |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07101529B2 (en) * | 1989-07-20 | 1995-11-01 | 三洋電機株式会社 | Tape recorder mode switching device |
ATE126903T1 (en) | 1990-04-06 | 1995-09-15 | Martin Russell Harris | CONFOCAL MICROSCOPE. |
EP1051652A1 (en) | 1998-01-12 | 2000-11-15 | Wallac Oy | Confocal microscope with plural scanning beams |
JP2000098259A (en) * | 1998-09-22 | 2000-04-07 | Olympus Optical Co Ltd | Photographic device for confocal microscope |
JP2000162506A (en) * | 1998-11-30 | 2000-06-16 | Tokyo Seimitsu Co Ltd | Confocal microscope |
KR100612219B1 (en) | 2004-10-16 | 2006-08-14 | 학교법인연세대학교 | Confocal Laser Line Scanning Microscope Using Acoustic Optical Deflector and Line Scan Camera |
-
2010
- 2010-04-08 KR KR1020100032383A patent/KR101103323B1/en active IP Right Grant
-
2011
- 2011-03-14 WO PCT/KR2011/001767 patent/WO2011126219A2/en active Application Filing
- 2011-04-01 TW TW100111603A patent/TWI452335B/en not_active IP Right Cessation
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6856457B2 (en) * | 2001-03-27 | 2005-02-15 | Prairie Technologies, Inc. | Single and multi-aperture, translationally-coupled confocal microscope |
CN1662811A (en) * | 2002-05-07 | 2005-08-31 | 应用材料股份有限公司 | Dual spot phase-sensitive detection |
US20080151366A1 (en) * | 2006-12-25 | 2008-06-26 | Olympus Corporation | Laser microscope and control method for the same |
Also Published As
Publication number | Publication date |
---|---|
WO2011126219A3 (en) | 2012-01-05 |
KR101103323B1 (en) | 2012-01-11 |
KR20110113055A (en) | 2011-10-14 |
WO2011126219A2 (en) | 2011-10-13 |
TW201142354A (en) | 2011-12-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
TWI452335B (en) | Method and system for obtaining object image using confocal microscope | |
KR100721414B1 (en) | Confocal microscope, fluorescence measuring method and polarized light measuring method using confocal microscope | |
JP6346615B2 (en) | Optical microscope and microscope observation method | |
KR101819006B1 (en) | Optical measuring apparatus | |
US9086536B2 (en) | Talbot imaging devices and systems | |
JP6000010B2 (en) | Laser scanning microscope | |
JP6358577B2 (en) | Scanning optical microscope | |
KR100964251B1 (en) | Chromatic Confocal Microscope with Beam Scanning | |
JP2014508969A (en) | System and method for illumination phase control in fluorescence microscopy | |
JP2002323660A (en) | Method and apparatus for optical grasping by optical deep decomposition of a sample | |
US20210011266A1 (en) | Improved scanning optical microscope | |
US9843719B2 (en) | Confocal microscope | |
CN107710046A (en) | For the method and wide-field microscope of the spatial discrimination elevation information that sample is determined using wide-field microscope | |
JP2008286624A (en) | Measuring device | |
JP2007286379A (en) | Real-time confocal microscope using dispersive optics | |
KR20100124757A (en) | Shape measuring apparatus and method thereof | |
JP6253395B2 (en) | Image generation system | |
TWI439725B (en) | Method for obtaining object image using confocal microscope | |
CN109358004B (en) | Method and apparatus for dual wavelength differential non-label microscopic imaging | |
JP5521901B2 (en) | Nonlinear microscope and nonlinear observation method | |
JP2010025864A (en) | Interference measuring apparatus | |
JP2010266452A (en) | Scanning optical near-field microscope | |
JP2017102013A (en) | Scanning type microscope | |
JP2004177732A (en) | Optical measuring device | |
US12135412B2 (en) | Non-linear optical scanning microscope having kinematic flexure mechanism |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
MM4A | Annulment or lapse of patent due to non-payment of fees |