JP2007316433A - Enlarging observation device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an enlarging observation device capable of optimizing generating accuracy of a three-dimensional image and time required to generate the three-dimensional image. <P>SOLUTION: In order to improve the generating accuracy of three-dimensional image data, it is necessary to extract each area of an object OBJ as a focus area in any image. A maximum acquiring space (that is, the smallest number of acquired sheets) satisfying such a condition means the case that the acquired space agrees with the depth of field DOF of an imaging part. A control part decides the acquired space by acquiring the depth of field in the imaging part based on the identification information and the state signal of the imaging part. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a magnification observation apparatus that generates three-dimensional image data of an object, and more particularly to a technique for optimizing an image acquisition interval.

  In manufacturing sites and research facilities, instead of conventional microscopes, magnification observation devices are becoming popular. The magnifying observation apparatus is an apparatus that shoots an image by enlarging an object and displays the captured image. Such a magnifying observation device has advantages such as a longer subject distance, a large number of users observing an enlarged image at the same time, and recording as digital information, as compared with a conventional microscope.

  In recent years, for the purpose of further improving work efficiency, a magnification observation apparatus to which a function for generating three-dimensional image data of an object is added has been proposed. As an example of such a method for generating three-dimensional image data, a so-called focusing method is known. In the in-focus method, three-dimensional image data is generated based on focused (focused) areas (hereinafter also referred to as “focus areas”) in a plurality of images obtained by photographing an object at different subject distances. .

For example, Japanese Patent Laid-Open No. 2000-39566 (Patent Document 1) discloses that an optically magnified image of an observation object is converted into three-dimensional data, and a region to be observed of the observation object is converted into a stereoscopic image from any viewpoint, field of view, and angle. A magnification observation apparatus capable of observation is disclosed. According to this magnifying observation apparatus, the imaging means for taking an optical magnifying image, the movement positioning control means for moving and positioning the optical magnifying means to an arbitrary relative position with respect to the observation object, and the optical magnifying means for the observation object An image data input means for acquiring a plurality of image data picked up by moving to a plurality of relative positions, and a three-dimensional image data generation means for generating stereoscopic three-dimensional image data from the plurality of image data. Prepare. Then, the three-dimensional image data generating means extracts focused image data that is in focus from each image data, and generates a three-dimensional image based on the focused image data.
JP 2000-39566 A

  As described above, in the in-focus method, three-dimensional image data is generated based on focus areas in a plurality of images taken at different subject distances. It is desirable that the number of acquisitions be large.

  On the other hand, an imaging unit including an optical system such as a lens group has a unique range in which it can be focused (hereinafter also referred to as “focus”). Such a focusable range is also referred to as depth of field (DOF). That is, in each image photographed by the imaging unit, only a region corresponding to this depth of field is focused.

  Therefore, if the acquisition interval is set to an excessively small value compared to the depth of field in order to increase the number of acquired images, the difference in the focus area between successive images is reduced. That is, even if the number of acquired images is excessively increased, the effect of improving the generation accuracy is small, and conversely, the time required for shooting increases.

  However, the conventional magnification observation apparatus disclosed in Japanese Patent Laid-Open No. 2000-39566 (Patent Document 1) does not take into consideration the acquisition interval (or the number of acquired images), and the user of the magnification observation apparatus (hereinafter referred to as “the user”). Are often used at inappropriate acquisition intervals.

  Accordingly, the present invention has been made to solve such a problem, and an object of the present invention is to provide a magnifying observation apparatus that can optimize the generation accuracy and time required for generation of a three-dimensional image.

  According to the present invention, the magnification observation apparatus generates three-dimensional image data of an object based on focus areas in a plurality of images obtained by photographing the object at different subject distances. The magnification observation apparatus according to the present invention includes an imaging unit for photographing an object, subject distance changing means for changing a subject distance from the imaging unit to the object, and the subject distance sequentially at predetermined acquisition intervals. And a control unit that controls the subject distance changing means so as to be changed to an image and acquires an image photographed by the imaging unit at each changed subject distance. And a control part acquires the depth of field in an imaging part, and determines an acquisition space | interval based on the said depth of field.

  According to the present invention, the depth of field of the imaging unit is taken into account when determining the acquisition interval for acquiring a plurality of images used for generating the three-dimensional image data of the object. Therefore, since a plurality of images for extracting the focus area can be acquired at intervals suitable for the range in which the imaging unit can focus, the generation accuracy and generation of the three-dimensional image are required without excessively increasing the number of acquired images. Can be balanced with time.

  Preferably, the control unit matches the acquisition interval with the half depth of field in the imaging unit or the depth of field in the imaging unit.

  Preferably, the magnification observation apparatus is configured to be able to use an imaging unit having an arbitrary depth of field as the imaging unit.

  More preferably, the control unit acquires the depth of field of the imaging unit based on the identification information of the imaging unit.

Preferably, the imaging unit is configured to be able to change the depth of field.
More preferably, the imaging unit is configured to output a status signal corresponding to the changed depth of field, and the control unit is configured to output a subject image of the imaging unit based on the status signal output from the imaging unit. Get the depth of field.

  Preferably, the control unit acquires the cross-sectional height range of the object for generating the three-dimensional image data, and acquires the number of images acquired based on the depth of field of the imaging unit and the cross-sectional height range. To decide.

  More preferably, the control unit searches the subject distance focused by the imaging unit for each of the two start / end regions set in the image captured by the imaging unit, and the two searched subjects Based on the distance, the cross-sectional height range is determined.

  More preferably, the magnifying observation apparatus further includes a display unit configured to be able to display an image captured by the imaging unit, and the control unit is configured to be able to display the obtained number on the display unit.

  More preferably, the control unit is configured to be able to change the number of acquired sheets in response to a change command from the outside.

  Preferably, the control unit controls the subject distance changing unit to acquire the acquired number of images, then extracts a focus area in each of the images, and combines the extracted focus areas to combine the all-focus image. Is generated.

  More preferably, the control unit acquires the height information of the target object based on the pixel information of the focus area and the corresponding subject distance, and generates three-dimensional image data from the omnifocal image and the height information.

  According to the present invention, it is possible to realize a magnifying observation apparatus that can optimize the generation accuracy and generation time of a three-dimensional image.

  Embodiments of the present invention will be described in detail with reference to the drawings. Note that the same or corresponding parts in the drawings are denoted by the same reference numerals and description thereof will not be repeated.

FIG. 1 is a schematic configuration diagram of a magnification observation apparatus 100 according to an embodiment of the present invention.
Referring to FIG. 1, a magnifying observation device 100 is a magnifying observation device that magnifies and displays an image of a captured object, and includes an imaging mechanism 2, a main body unit 4, a display unit 6, and an input unit 8. Become.

  The imaging mechanism 2 includes an imaging unit 12 for capturing an object and an imaging drive unit 14 for changing a subject distance from the imaging unit 12 to the object.

  The imaging unit 12 includes an optical system such as a lens and an imaging device such as a CCD (Charge Coupled Devices), and outputs a video signal corresponding to light received from an object to the main body unit 4. Further, as will be described later, the imaging unit 12 is configured to be able to change the depth of field, and outputs a state signal corresponding to the changed depth of field to the main body unit 4.

  The imaging drive unit 14 corresponds to subject changing means for changing the subject distance from the imaging unit 12 to the object, and moves the imaging unit 12 along a predetermined direction in accordance with a movement command received from the main body unit 4. Move.

  The main body 4 includes an I / F unit 16, a control unit 18, a memory 20, and an I / O control unit 22.

  The I / F unit 16 is electrically connected to the imaging unit 12 and the imaging driving unit 14 that constitute the imaging mechanism 2, and transmits the video signal and the state signal received from the imaging unit 12 to the control unit 18, and The drive command received from 18 is transmitted to the imaging drive unit 14.

  The control unit 18 is configured by an arithmetic device such as a CPU (Central Processing Unit). Then, the control unit 18 gives a movement command to the imaging drive unit 14 so that the subject distance is sequentially changed at a predetermined acquisition interval, and controls the imaging unit 12 at each changed subject distance. The image photographed by is acquired and stored in the memory 20 or the like. Further, the control unit 18 generates 3D image data based on a focused (focused) area (focus area) in the plurality of acquired images.

  Further, the control unit 18 acquires the depth of field in the imaging unit 12 based on the identification information of the imaging unit 12 set via the input unit 8 and / or the state signal output from the imaging unit 12, Based on the acquired depth of field, an optimal acquisition interval is determined. Further, the control unit 18 acquires the cross-sectional height range of the object for generating the three-dimensional image data, and determines the number of images to be acquired based on the depth of field and the cross-sectional height range. Further, the control unit 18 can display the determined acquired number of sheets on the display unit 6, and can change the acquired number of sheets according to a change command given through the input unit 8.

  The memory 20 stores a program executed by the control unit 18, image data stored by the control unit 18, work data associated with program execution of the control unit 18, various setting data given by a user and the like.

  The I / O control unit 22 is electrically connected to the display unit 6, the input unit 8, and the like, and an enlarged image captured by the imaging unit 12, a three-dimensional image generated by the control unit 18, and a GUI (Graphical User Interface). ) Output the screen or the like to the display unit 6. In addition, the I / O control unit 22 receives a command in accordance with a user operation from the input unit 8 and transmits the command to the control unit 18.

  The display unit 6 includes, for example, a liquid crystal display (LCD), a plasma display, and an organic EL (Electro Luminescence) display, and displays an image output via the I / O control unit 22 on its display surface. To do. In the present embodiment, the display unit 6 is configured integrally with the main body unit 4.

FIG. 2 is a diagram showing an example of the appearance of main body 4 and display 6 according to the present embodiment.
Referring to FIG. 2, main body 4 is formed in a box shape, while display 6 is configured to be slidable on the upper surface of main body 4. That is, the display unit 6 is arranged so as to have an arbitrary angle with respect to the upper surface of the main body unit 4 when the magnification observation device 100 is used, and the main unit 4 is not used when the magnification observation device 100 is not used. It is arranged so as to be parallel to the upper surface and stored integrally. With such a configuration, the magnifying observation apparatus 100 according to the present embodiment can realize easy portability and space saving.

  Referring to FIG. 1 again, input unit 8 includes a keyboard, a mouse, and the like, accepts a command by a user operation, and outputs the command to main unit 4. Furthermore, as an example of the input unit 8, a touch panel formed on the display surface of the display unit 6 may be used.

(Imaging mechanism)
FIG. 3 is an example of a side view of imaging mechanism 2 according to the present embodiment.

  With reference to FIG. 3, the imaging mechanism 2 further includes a sample stage 32, a stand 34, a stand engaging member 36, and an imaging unit fixing member 38. An object is arranged on the sample stage 32, and the object is photographed by the imaging unit 12 arranged to be movable in the vertical direction of the object. The stand 34 is arranged so as to extend in the vertical direction of the sample stage 32 and determines the moving direction of the imaging unit 12.

  The stand engaging member 36 is configured to be movable along the stand 34 and to be fixed at a position (height) desired by the user. Specifically, movement and fixation are operated by a dial and a lever constituting the stand engaging member 36.

  The imaging unit fixing member 38 is connected to the imaging unit 12 on its side surface and fixes the imaging unit 12. Further, the stand engaging member 36 and the imaging unit fixing member 38 are mechanically coupled via, for example, a feed screw, and the feed screw is mechanically coupled to the imaging drive unit 14. The relative position of the stand engaging member 36 and the imaging unit fixing member 38 changes in the axial direction of the stand 34 by the rotational driving force output by the imaging drive unit 14.

  As a result, the imaging unit 12 connected to the imaging unit fixing member 38 moves in the vertical direction of the sample stage 32, and the subject distance from the imaging unit 12 to the object changes.

  As an example, the imaging drive unit 14 includes a stepping motor, a driver unit for driving the stepping motor, and the like, and can generate a rotation amount according to a drive command given from the main body unit 4. That is, since the stepping motor can be configured to rotate by 120 ° (electrical angle) with one drive pulse, for example, a control that gives the stepping motor a number of drive pulses corresponding to the desired amount of change in the subject distance. What is necessary is just to comprise a system | strain and the position control of the imaging part 12 is realizable comparatively easily.

  The magnification observation apparatus 100 according to the embodiment of the present invention is configured to be able to use an imaging unit having an arbitrary depth of field, and the imaging unit fixing member 38 includes various imaging units having a common mounting dimension. It can be freely attached and detached.

FIG. 4 is an example of a side view of imaging unit 12 according to the present embodiment.
Referring to FIG. 4, the imaging unit 12 includes a lens barrel in which an image receiving unit 40, a diaphragm unit 42, a zoom lens unit 44, a focus lens unit 50, and an objective lens unit 52 are arranged in series. . Then, the image of the object passes through the objective lens unit 52, the focus lens unit 50, the zoom lens unit 44, and the diaphragm unit 42 in order, and enters the image receiving unit 40. The image receiving unit 40 generates a video signal corresponding to the incident image. As an example, the image receiving unit 40 includes an image sensor such as a CCD.

  The objective lens unit 52 is a lens that first receives an image of an object, and is configured to ensure a relatively wide angle and a high amount of light.

  The focus lens unit 50 adjusts the focal position so that the image of the object is formed at the position of the image receiving unit 40 (focus operation). As an example, when the focus lens unit 50 is operated with a dial that is rotatably disposed on the outer periphery thereof, the relative relationship between the lenses changes, and the focus position is adjusted.

  The zoom lens unit 44 is configured by a lens group arranged so that the relative distance between the lenses can be changed. The zoom lens unit 44 changes the focal length related to the optical system of the imaging unit 12 to change the image of the object incident on the image receiving unit 40. Enlarge or reduce (zoom operation). As an example, the zoom lens unit 44 performs a zoom operation by operating a dial disposed rotatably on the outer periphery thereof. Further, the zoom lens unit 44 is configured to be latched at a position where a predetermined zoom magnification is obtained along the rotation direction of the dial. FIG. 4 illustrates a configuration that can be latched at positions such as “50 times”, “100 times”, and “150 times”. The zoom lens unit 44 is provided with a state detection unit 46 configured to output a predetermined state signal corresponding to each latch position.

  The state detection unit 46 includes, for example, a contact relay such as a micro switch, and outputs a state signal (bit signal) when the contact relay corresponding to each latch position is turned on or off according to the latch operation.

  Here, the depth of field of the imaging unit 12 dynamically changes according to the zoom magnification of the zoom lens unit 44. In other words, the fact that the zoom operation is possible means that the depth of field in the imaging unit 12 can be dynamically changed, and the state signal output from the state detection unit 46 indicates that the object field to be changed is changed. A value corresponding to the depth will be shown.

  The diaphragm unit 42 attenuates an image that passes through the zoom lens unit 44 and enters the image receiving unit 40 to a predetermined light amount, thereby suppressing the occurrence of halation and the like. As an example, the aperture of the iris mechanism disposed in the lens barrel changes by operating a dial that is rotatably arranged on the outer periphery of the aperture 42, and the aperture (attenuation) is reduced. Adjustments are made.

  As described above, the magnification observation apparatus 100 can use the imaging unit 12 having an arbitrary depth of field, and the imaging unit 12 changes the depth of field according to the zoom magnification of the zoom lens unit 44. Is possible. That is, the depth of field varies depending on the type of the imaging unit 12 (static change) and the state of the imaging unit 12 (dynamic change). Therefore, it is necessary to optimize the acquisition interval corresponding to such a change in the depth of field.

  Therefore, the control unit 18 in the main body unit 4 acquires the depth of field in the imaging unit 12 based on the identification information and the state signal of the imaging unit 12, and determines an optimal acquisition interval.

(Focus method)
FIG. 5 is a diagram illustrating an appearance when generating three-dimensional image data according to the focusing method.

  With reference to FIG. 5, the case where the three-dimensional image data about hemispherical object OBJ is produced | generated as an example is demonstrated. The object OBJ is disposed on the sample table 32 vertically below the imaging unit 12 and an image is captured.

FIG. 6 is a diagram for explaining the principle of generating three-dimensional image data according to the focusing method.
Referring to FIG. 6, control unit 18 (FIG. 1) gives and controls a movement command to imaging drive unit 14 so that the subject distance is sequentially changed at a predetermined acquisition interval. Images captured by the imaging unit 12 are acquired at each subject distance.

  Here, in order to improve the generation accuracy of the three-dimensional image data, each area of the object OBJ needs to be extracted as a focus area in one of the images. That is, when the respective focus areas extracted from the acquired image are combined, the entire area of the object OBJ must be included. The maximum acquisition interval (that is, the minimum acquisition number) that satisfies such a condition is a case where the acquisition interval matches the depth of field DOF of the imaging unit 12.

  In other words, the imaging unit 12 can focus on a region where the subject distance is within the range of the depth of field DOF. Therefore, by changing the subject distance in units of the depth of field DOF, the object OBJ Can be extracted as the focus area. Therefore, optimization of the generation accuracy of 3D image data and the time required for generation means, as one aspect thereof, matching the acquisition interval with the depth of field DOF.

  For example, if the upper surface of the sample stage 32 (FIG. 3) is the reference position BL in the vertical direction, the control unit 18 is the first at the shooting position P1 that is ½ of the depth of field DOF above the reference position BL. Get an image. Note that the shooting position indicates a narrowly defined focal position in the imaging unit 12, that is, a position where the degree of focus by the imaging unit 12 is maximized (a position where the focus is most focused).

  Thereafter, the control unit 18 gives a movement command for moving the imaging unit 12 vertically upward by the depth of field DOF to the imaging driving unit 14 and displays the image of the object OBJ at each of the imaging positions P2 to P6. get.

  In addition, the control part 18 acquires the cross-sectional height range H of a target object previously by the method mentioned later, and determines the required number of acquisition (integer value) based on depth of field DOF.

  Subsequently, the control unit 18 extracts a focus area in each acquired image. Various methods can be employed to extract a focus area, that is, a focused area from the acquired image. As an example, a method of extracting, as a focus area, an area where the brightness difference (contrast) of adjacent pixels exceeds a predetermined value with respect to the pixels constituting the image is adopted. Such extraction of the focus area is a known technique and will not be described in further detail.

FIG. 7 is a diagram for explaining the focus area to be extracted.
FIG. 7A shows the focus area FP1 extracted from the image at the photographing position P1 in FIG.

  FIG. 7B shows a focus area FP2 extracted from the image at the photographing position P2 in FIG.

  At the photographing position P1, as shown in FIG. 6, it is possible to focus on a region corresponding to the range of the depth of field DOF centered on the photographing position P1. Therefore, as shown in FIG. 7A, a focus area FP1 including a part of the object OBJ and the sample stage 32 is extracted from the image acquired at the photographing position P1.

  Further, at the photographing position P2, it is possible to focus on an area corresponding to the range of the depth of field DOF centered on the photographing position P2. Therefore, as shown in FIG. 7B, a focus area FP2 including a part of the object OBJ is extracted from the image acquired at the photographing position P2.

  Similarly, focus areas FP1 to FP6 are extracted from images acquired at the photographing positions P1 to P6, respectively. The control unit 18 combines the focus areas FP1 to FP6 thus extracted to generate an omnifocal image.

  FIG. 8 is a schematic diagram of an omnifocal image generated by combining the focus areas FP1 to FP6.

  Referring to FIG. 8, the omnifocal image is an image generated by combining focus areas FP1 to FP6. Here, since the acquisition interval coincides with the depth of field DOF of the imaging unit 12, the extracted focus areas FP1 to FP6 do not overlap each other, and the effective focus area extraction is performed. I understand that. That is, it can be said that the acquisition interval is optimized.

  Such an omnifocal image means a mapping of the object OBJ onto the imaging surface of the imaging unit 12 (corresponding to the sample table 32). In other words, it is an imaging unit with a deep depth of field (a wide focusable range). This is equivalent to an image obtained by photographing the object OBJ.

  In addition to the generation of the omnifocal image described above, the control unit 18 acquires the height information of the object OBJ based on the pixel information of the focus area and the corresponding subject distance. Here, the height information is a data group indicating the position in the imaging direction in each region of the object OBJ, and usually corresponds to the pixel arrangement (for example, 1600 × 1200 dots) of the image captured by the imaging unit 12. It is configured with. That is, the height information is represented by a matrix arranged so as to correspond to the pixel matrix of the image captured by the imaging unit 12.

  Referring to FIG. 7A again, the control unit 18 determines a value indicating the corresponding subject position (shooting position P1) as the height of each pixel constituting the extracted focus area FP1. Specifically, of the height information arranged in a matrix, position data of the shooting position P1 (for example, a relative value from the reference position BL) with respect to each element corresponding to the pixels constituting the focus area FP1. Is assigned.

  Similarly, the control unit 18 determines values indicating the corresponding subject positions (shooting positions P2 to P6) as the heights of the pixels constituting the focus areas FP2 to FP6. Through such processing, height information in which each pixel position of the image is associated with height data is generated. Each of the height data stored in the height information may be normalized (0 to 255 digits) with the cross-sectional height range H as a reference.

  Furthermore, the control unit 18 may smooth the height information uniformly determined for each focus area by numerical interpolation processing. That is, according to the above-described method, the height data at each pixel position of the image is determined to be a value indicating one of the shooting positions P1 to P6, so that six levels of height information are generated. become. Therefore, in order to obtain the shape of the object OBJ more accurately, it is desirable to perform smoothing by executing a numerical interpolation process or the like.

  FIG. 9 is an example of a diagram in which height information is imaged as a grayscale image. In FIG. 9, the higher the pixel (the pixel closer to the imaging unit 12) is, the higher the density (black) is.

  Referring to FIG. 9, since the height information is configured in association with the pixel position of the image to be captured, it can be expressed as a grayscale image having the same size.

  As described above, the control unit 18 acquires an omnifocal image and height information. As described above, the omnifocal image is a mapping of the object OBJ onto the imaging surface of the imaging unit 12, and the height information is data indicating the cross-sectional height position of each pixel of the object OBJ. Therefore, three-dimensional image data can be generated by adding height information to each pixel of the omnifocal image. In other words, three-dimensional image data is generated by projecting an omnifocal image onto a shape generated based on height information.

(Determining the acquisition interval)
The control unit 18 acquires the depth of field in the imaging unit 12, and determines an optimal acquisition interval based on the acquired depth of field. On the other hand, the magnification observation apparatus 100 can use the imaging unit 12 having an arbitrary depth of field, and the imaging unit 12 can change the depth of field according to the zoom magnification of the zoom lens unit 44. .

  Therefore, the control unit 18 acquires the depth of field that is “statically changed” according to the type of the imaging unit 12 based on the identification information of the identification information of the imaging unit 12, and Based on the state signal, the depth of field that is “dynamically changed” according to the zoom magnification of the imaging unit 12 or the like is acquired.

FIG. 10 is a diagram illustrating an example of the depth of field determination table stored in the memory 20.
Referring to FIG. 10, the depth of field determination table is defined by identification information ID (ID1, ID2,..., IDn) and state information ST (ST1, ST2,..., STn). This is a two-dimensional table, and the depth of field DOF is defined in association with the identification information ID and the state information ST. Each value of the depth of field DOF is obtained experimentally or theoretically in advance.

  In the present embodiment, as an example, the identification information ID is set by the user and stored in the memory 20. Specifically, when the imaging unit 12 is replaced, the user sets the corresponding identification information ID by operating the input unit 8. The identification information ID is preferably in a format that can specify the configuration of the optical system in the imaging unit 12 such as the diaphragm unit 42, the zoom lens unit 44, the focus lens unit 50, and the objective lens unit 52, for example. As a matter of course, the state signal output from the imaging unit 12 is configured to include the identification information ID, and the control unit 18 automatically acquires the identification information ID of the imaging unit 12 connected thereto. It may be configured. Furthermore, a wireless tag or the like that stores the identification information ID may be built in the imaging unit 12, and the control unit 18 may acquire the identification information ID from the wireless tag.

  On the other hand, the state information ST is generated based on the state signal acquired from the imaging unit 12. That is, the value of the status information ST is determined in accordance with the zoom magnification of the zoom lens unit 44 indicated by the status signal.

(Cross section height range)
As shown in FIG. 6, when generating the three-dimensional image data, it is necessary to determine in advance the cross-sectional height range H, that is, the range in the height direction of the three-dimensional image data. Therefore, the magnification observation apparatus 100 according to the present embodiment includes a semi-auto mode in which the user directly sets the cross-section height range, and a full-auto mode in which the cross-section height range is set by the control unit 18.

(I) Semi-auto mode The display unit 6 displays an image captured by the imaging unit 12. The control unit 18 gives a drive command to the imaging drive unit 14 in accordance with a movement command for the imaging unit 12 input via the input unit 8, and changes the subject distance from the imaging unit 12 to the object OBJ. Therefore, the image displayed on the display unit 6 changes according to the subject distance.

  On the other hand, the user operates the input unit 8 to move the imaging unit 12 until images corresponding to the start position and the end position for generating the three-dimensional image data are displayed. Then, when the imaging unit 12 moves to the start position or the end position, the user operates the input unit 8 to give a command indicating the start position or the end position, respectively. Then, the control unit 18 stores the subject distance at the time when the command indicating the start position or the end position is given in the memory 20, and sets the distance between the two stored subject distances as the cross-sectional height range.

(Ii) Full Auto Mode When generating three-dimensional image data, the bottom surface and top surface of the object OBJ are often known to the user in advance. In such a case, instead of the configuration in which the start position and the end position are directly set, it is more user-friendly to have a configuration in which regions that are the bottom surface and the top surface of the object OBJ are set.

  Therefore, in the full auto mode, when two start / end regions are set in the image captured by the imaging unit 12, the control unit 18 determines the cross-sectional height range.

FIG. 11 is an example of a display screen in the full auto mode.
Referring to FIG. 11, in the image displayed on display unit 6, two start / end regions LA1 and LA2 are configured to be settable. The user operates the input unit 8 (for example, a mouse) to set the start / end areas LA1 and LA2.

  After setting the start / end areas LA1 and LA2, the control unit 18 searches the subject distance to be focused on each of the start / end areas LA1 and LA2. Specifically, the control unit 18 gives a drive command to the imaging drive unit 14 and sequentially changes the subject distance from the imaging unit 12 to the object OBJ. At the same time, the control unit 18 repeatedly determines whether or not each of the start / end areas LA1 and LA2 is focused. When it is determined that the start / end regions LA1 and LA2 are focused, the subject distances at the time are stored in the memory 20, and the section height range is set between the two stored subject distances.

  Then, the control unit 18 determines the necessary number of images to be acquired (integer value) based on the acquired depth of field DOF and the cross-sectional height range H set according to the semi-auto mode or the full-auto mode.

(GUI screen)
FIG. 12 is a diagram illustrating an example of a GUI screen for displaying the determined number of acquired images.

  Referring to FIG. 12, in response to a command from the user, control unit 18 determines the number of acquired sheets in accordance with the above-described procedure, and displays the determined acquired number of sheets in number display area 62 of the GUI screen.

  Specifically, a standard button 64 and a high quality button 66 are arranged in the GUI screen. When the standard button 64 is selected (clicked) by operating the pointer 70 or the like, the control unit 18 acquires the depth of field DOF in the imaging unit 12 based on the identification information ID and the state information ST, and The acquisition interval is determined so as to coincide with the depth of field DOF. Furthermore, the control unit 18 divides the cross-sectional height range H set according to the above-described semi-auto mode or full-auto mode by the depth of field DOF, and determines the number of acquired images.

  On the other hand, when the high quality button 66 is selected (clicked), the control unit 18 acquires the depth of field DOF in the imaging unit 12 based on the identification information ID and the state information ST, and the depth of field DOF. The acquisition interval is determined so as to be equal to a half value (half value) of. Furthermore, the control unit 18 divides the cross-sectional height range H set according to the above-described semi-auto mode or full-auto mode by the depth of field DOF, and determines the number of acquired images. That is, in the “high quality” mode, in order to further improve the generation accuracy of the three-dimensional image data, the number of acquired images is determined to be a value corresponding to twice the “normal” mode.

  In the GUI screen, the number of acquired images displayed in the number display area 62 can be changed by operating the pointer 70 or the like. That is, the user can select (click) the number display area 62 by operating the pointer 70, and can also input a desired number of images by operating the input unit 8 (for example, a keyboard).

  Further, when the acquisition start button 68 in the GUI screen is selected (clicked), the control unit 18 gives a drive command to the imaging drive unit 14 and starts acquiring the number of images acquired at that time. And the control part 18 produces | generates an omnifocal image and height information from the acquired image according to the procedure mentioned above, and produces | generates three-dimensional image data.

FIG. 13 is a flowchart showing an outline of processing according to the present embodiment.
Referring to FIG. 13, control unit 18 executes a cross-section height range acquisition subroutine in order to acquire cross-section height range H (step S <b> 100). Subsequently, the control unit 18 executes a depth of field acquisition subroutine in order to acquire the current depth of field DOF (step S102).

  Thereafter, the control unit 18 displays a GUI screen (FIG. 12) on the display unit 6 (step S104). Then, the control unit 18 reads the previous value of the acquired number from the memory 20 and displays it as an initial value in the number display area 62 of the GUI screen (step S106).

  The control unit 18 determines whether the standard button 64 or the high quality button 66 on the GUI screen has been selected (step S108).

  When the standard button 64 is selected (in the case of “standard” in step S108), the control unit 18 determines that “the number of acquired images = section height range H / depth of field DOF (however, rounded up after the decimal point)”. The obtained number is updated by executing the above calculation (step S110).

  On the other hand, when the high quality button 66 is selected (in the case of “high quality” in step S108), the control unit 18 determines that “number of acquired images = 2 × section height range H / depth of field DOF (however, The obtained number is updated by executing a calculation of “rounded up after the decimal point” (step S112).

  If neither the standard button 64 nor the high quality button 66 on the GUI screen is selected (NO in step S108), the control unit 18 determines whether or not the number display area 62 on the GUI screen has been selected. (Step S114). When the number display area 62 is selected (YES in step S112), the control unit 18 updates the acquired number according to the numerical value input to the number display area 62 (step S116).

  When the acquired number is updated (when steps S110, S112, and S116 are executed), the control unit 18 displays the updated acquired number in the number display area 62 of the GUI screen (step S118). And the control part 18 repeatedly performs the process after step S108.

  If the number display area 62 is not selected (NO in step S114), the control unit 18 determines whether or not the acquisition start button 68 has been selected (step S120).

  If the acquisition start button 68 has not been selected (NO in step S120), the control unit 18 repeatedly executes the processing from step S108.

  On the other hand, when the acquisition start button 68 is selected (YES in step S120), the control unit 18 stores the number of acquisitions at that time in the memory 20 (step S122). Further, the control unit 18 gives a drive command to the imaging drive unit 14 and acquires the number of images acquired at that time (step S124).

  Specifically, the control unit 18 first gives a drive command to the imaging drive unit 14 so that the imaging position of the imaging unit 12 matches the start position of the cross-sectional height range. When the shooting position of the imaging unit 12 coincides with the start position, the control unit 18 acquires an image at that time. Subsequently, the control unit 18 gives a drive command to the imaging drive unit 14 so that the shooting position of the imaging unit 12 changes by a distance corresponding to the acquisition interval. When the change in the distance corresponding to the acquisition interval is completed, the control unit 18 acquires an image at the time point. Similarly, the control unit 18 repeats the image acquisition and the movement of the imaging unit 12 by the number of acquired sheets.

  And the control part 18 produces | generates an omnifocal image and height information from the acquired image, and produces | generates three-dimensional image data (step S126). Thereafter, the control unit 18 passes the generated three-dimensional image data or the like to another display application or the like, and ends the process.

FIG. 14 is a flowchart showing an outline of the processing of the section height range acquisition subroutine.
Referring to FIG. 14, control unit 18 determines which mode is selected (step S200).

  When the semi-auto mode is selected (in the case of “semi-auto” in step S200), the control unit 18 determines the subject distance from the imaging unit 12 to the object OBJ according to the movement command given through the input unit 8. Is changed (step S202). And the control part 18 judges whether the command which shows a start position or an end position was received (step S204).

  When receiving a command indicating the start position or the end position (YES in step S204), the control unit 18 stores the subject distance at the time in the memory 20 (step S206). Then, the control unit 18 determines whether or not subject distances corresponding to the start position and the end position are stored (step S208).

  When the subject distances corresponding to the start position and the end position are stored together (in the case of YES in step S208), the control unit 18 sets the range defined by the stored two subject distances as the cross-sectional height range. (Step S210), and the process returns to the original process.

  When the command indicating the start position or the end position has not been received (NO in step S204), or when any of the subject distances corresponding to the start position or the end position is not stored (NO in step S208) The control unit 18 repeatedly executes the processing from step S202 onward.

  When the full auto mode is selected (in the case of “full auto” in step S <b> 200), the control unit 18 responds to a command given via the input unit 8 in the image captured by the imaging unit 12. Two start / end regions are set (step S212). And the control part 18 gives a drive command to the imaging drive part 14, and changes a to-be-photographed object distance sequentially (step S214). In parallel, the control unit 18 determines whether or not each of the start / end regions is focused (step S216).

  If any start / end region is not focused (NO in step S216), control unit 18 repeatedly executes the processing in step S214 and subsequent steps.

  When any of the start / end areas is focused (YES in step S216), the control unit 18 stores the subject distance at the time in the memory 20 (step S218). Then, the control unit 18 determines whether or not both subject distances corresponding to the start position and the end position are stored (step S220).

  When the subject distances corresponding to the start position and the end position are stored together (in the case of YES in step S220), the control unit 18 sets the range defined by the stored two subject distances as the cross-sectional height range. (Step S222), and the process returns to the original process.

  If any of the subject distances corresponding to the start position or the end position is not stored (NO in step S220), the control unit 18 repeatedly executes the processes in and after step S214.

FIG. 15 is a flowchart showing an outline of the processing of the depth of field acquisition subroutine.
Referring to FIG. 15, control unit 18 determines whether or not the identification information ID of imaging unit 12 is stored in memory 20 (step S300).

  When the identification information ID of the imaging unit 12 is stored in the memory 20 (YES in step S300), the control unit 18 acquires the identification information ID from the memory 20 (step S302). And the control part 18 judges whether a status signal can be acquired from the imaging part 12 (step S304).

  If the state signal can be acquired from the imaging unit 12 (YES in step S304), the control unit 18 determines the value of the state information ST based on the acquired state signal (step S306).

  On the other hand, when the identification information ID of the imaging unit 12 is not stored in the memory 20 (NO in step S300), or when the status signal cannot be acquired from the imaging unit 12 (NO in step S304), control is performed. The unit 18 determines the identification information ID and the state information ST as predetermined values (default values) that are set in advance (step S308).

  Then, the control unit 18 acquires the depth of field DOF from the depth of field determination table (FIG. 10) using the current identification information ID and the state information ST as parameters (step S310), and returns to the original process.

  In the present embodiment, the configuration using the state signal indicating the zoom magnification in the zoom lens unit 44 of the imaging unit 12 is exemplified, but other optical elements that change the depth of field (for example, the focus lens unit, etc.) ) May be used.

  In the present embodiment, the configuration in which the imaging unit 12 is moved using the imaging drive unit 14 as an example of the “subject changing unit” has been described. However, in addition to the movement of the imaging unit 12, or the sample table alone. You may comprise so that 32 may be moved.

  According to the embodiment of the present invention, the depth of field of the imaging unit 12 is taken into account when determining the acquisition interval for acquiring a plurality of images used for generating the three-dimensional image data of the object OBJ. For this reason, since a plurality of images for extracting the focus area can be acquired at intervals suitable for the range in which the imaging unit 12 can focus, the generation accuracy and generation of the three-dimensional image can be achieved without excessively increasing the number of acquired images. It is possible to balance the time required for this. Therefore, it is possible to realize a magnifying observation apparatus that optimizes the generation accuracy and time required for generation of a three-dimensional image.

  In addition, according to the embodiment of the present invention, the depth of field at each time point is acquired and acquired according to the type of the imaging unit 12 used and the state (for example, zoom magnification) in the imaging unit 12. Update the interval automatically. For this reason, the user does not need to change the acquisition interval or the number of acquired images every time the zoom magnification of the imaging unit 12 is changed, for example, and the working efficiency can be further improved.

  According to the embodiment of the present invention, the number of acquisitions determined based on the determined acquisition interval is displayed to the user. Furthermore, the acquired number of displayed images can be changed by the user. Therefore, the user can intuitively know the degree of the 3D image generation process, and a more user-friendly magnification observation apparatus can be realized.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

It is a schematic block diagram of the magnification observation apparatus according to embodiment of this invention. It is a figure which shows an example of the external appearance of the main-body part and display part according to this Embodiment. It is an example of the side view of the imaging mechanism according to this Embodiment. It is an example of the side view of the imaging part according to this Embodiment. It is a figure which shows the external appearance at the time of the three-dimensional image data generation which concerns on a focusing method. It is a figure for demonstrating the production | generation principle of the three-dimensional image data which concerns on a focusing method. It is a figure for demonstrating the focus area | region extracted. It is a schematic diagram of the omnifocal image produced | generated by the coupling | bonding of a focus area | region. It is an example of the figure which imaged height information as a grayscale image. It is a figure which shows an example of the depth-of-field determination table stored in memory. It is an example of the display screen in full auto mode. It is a figure which shows an example of the GUI screen for displaying the acquisition number of sheets determined. It is a flowchart which shows the outline of the process according to this Embodiment. It is a flowchart which shows the outline of a process of a cross-section height range acquisition subroutine. It is a flowchart which shows the outline of a process of a depth-of-field acquisition subroutine.

Explanation of symbols

  2 imaging mechanism, 4 body unit, 6 display unit, 8 input unit, 12 imaging unit, 14 imaging drive unit, 16 I / F unit, 18 control unit, 20 memory, 22 I / O control unit, 32 sample stage, 34 Stand, 36 Stand engaging member, 38 Imaging section fixing member, 40 Image receiving section, 42 Diaphragm section, 44 Zoom lens section, 46 State detection section, 50 Focus lens section, 52 Objective lens section, 62 Number display area, 64 Standard buttons , 66 High quality button, 68 Acquisition start button, 70 pointer, 100 magnification observation device, BL reference position, DOF depth of field, FP1 to FP6 focus area, H section height range, ID identification information, LA1, LA2 start end Area, OBJ object, ST status information.

Claims (12)

A magnification observation device that generates three-dimensional image data of an object based on focus areas in a plurality of images obtained by photographing the object at different object distances,
An imaging unit for photographing the object;
Subject distance changing means for changing the subject distance from the imaging unit to the object;
A control unit that controls the subject distance changing means so that the subject distance is sequentially changed at predetermined acquisition intervals, and that acquires an image photographed by the imaging unit at each of the changed subject distances; With
The magnifying observation apparatus, wherein the control unit acquires a depth of field in the imaging unit and determines the acquisition interval based on the depth of field.   The magnification observation apparatus according to claim 1, wherein the control unit matches the acquisition interval with a depth of field in the imaging unit or a half value of a depth of field in the imaging unit.   The magnification observation device according to claim 1, wherein the magnification observation device is configured to be able to use an imaging unit having an arbitrary depth of field as the imaging unit.   The magnification observation apparatus according to claim 3, wherein the control unit acquires a depth of field of the imaging unit based on identification information of the imaging unit.   The magnification observation apparatus according to claim 1, wherein the imaging unit is configured to be able to change a depth of field. The imaging unit is configured to output a state signal corresponding to the depth of field to be changed,
The magnification observation apparatus according to claim 5, wherein the control unit acquires a depth of field of the imaging unit based on the state signal output from the imaging unit.   The control unit acquires a cross-sectional height range of the object for generating the three-dimensional image data, and acquires the number of images based on the depth of field of the imaging unit and the cross-sectional height range The magnification observation apparatus according to any one of claims 1 to 6, wherein The controller is
Searching for the subject distance focused by the imaging unit for each of the two start / end regions set in the image captured by the imaging unit;
The magnification observation apparatus according to claim 7, wherein the cross-sectional height range is determined based on the searched two subject distances. The magnification observation apparatus further includes a display unit configured to be able to display an image captured by the imaging unit,
The magnification observation apparatus according to claim 7, wherein the control unit is configured to be able to display the acquired number of sheets on the display unit.   The magnification observation device according to claim 9, wherein the control unit is configured to be able to change the number of acquired images in accordance with a change command from the outside. The controller is
Controlling the subject distance changing means to acquire the acquired number of images, and then extracting the focus area in each of the images;
The magnification observation apparatus according to any one of claims 7 to 10, wherein the extracted focus areas are combined to generate an omnifocal image. The controller is
Based on the pixel information of the focus area and the corresponding subject distance, obtain height information of the object,
The magnification observation apparatus according to claim 11, wherein the three-dimensional image data is generated from the omnifocal image and the height information.