JP5714083B2 - Ophthalmic apparatus, ophthalmic processing apparatus, ophthalmic system, tomographic image acquisition method, ophthalmic processing method, and program - Google Patents

Description

  The present invention relates to a diagnosis support apparatus, a method thereof, a program, and a recording medium, and more particularly, to a technique for efficiently performing image diagnosis of an eye part.

  Examination of the eye is widely performed for the purpose of early diagnosis of lifestyle-related diseases and various diseases that occupy the top causes of blindness. In medical examinations and the like, since it is required to find a disease in the entire eye part, an examination using an image over a wide range of the eye part (hereinafter referred to as a wide area image) is essential. The wide area image is captured using, for example, a fundus camera or a scanning laser ophthalmoscope (SLO).

  On the other hand, tomographic image acquisition devices for the eye such as optical coherence tomography (OCT) can quantify the state of the disease on an objective scale, making it possible to more accurately diagnose the disease. Expected to be useful. In general OCT, an imager determines tomographic imaging parameters (for example, target region, imaging range, level of detail, scanning method, etc.), and only the local region of the eye is imaged and analyzed based on the imaging parameters. Is done.

  As a technique for assisting an imager to capture a tomographic image, for example, Patent Document 1 discloses a technique related to a user interface that designates an imaging range of a tomographic image by OCT on a wide-area image by a fundus camera. Patent Document 2 discloses a technique related to a user interface for designating an imaging range of a tomographic image by OCT on a wide area image by SLO. According to Patent Literature 1 and Patent Literature 2, it is possible to determine a tomographic imaging range while referring to a state of a wide area image of the fundus.

JP 2007-117714 A JP 2008-029467 A

  When tomographic imaging is performed by manually specifying imaging parameters, especially when the photographer is not an ophthalmologist, the imaging parameters including the imaging region cannot always be set appropriately, and the tomographic images necessary for diagnosis are There was a problem that it could not be obtained. Further, even when the configurations of Patent Document 1 and Patent Document 2 are used, the position of a lesion that can be grasped on a wide-area image does not necessarily coincide with the site where a tomographic image is to be imaged, so that setting of imaging parameters is not always easy. There was a problem that was not.

  In addition, even if a wide range of tomographic images are taken by some method, if the diagnostician is not an ophthalmologist, it is not easy to determine which part of that should be analyzed and measured was there.

  The present invention has been made in view of the above problems, and an object thereof is to provide a technique for efficiently acquiring a tomographic image of an eye part.

In order to achieve the above object, an ophthalmologic apparatus according to the present invention comprises the following arrangement. That is,
Fundus image acquisition means for acquiring a fundus image of the eye part;
Detection means for automatically detecting the position of the optic disc on the fundus of the eye from the fundus image;
A tomographic image acquisition means for acquiring a tomographic image of the fundus of the region near the optic disc using a method of circularly scanning the region near the optic disc based on the position;
The fundus image and the tomographic image are displayed on a display unit, and the resolution corresponding to the scanning method used for acquiring the tomographic image is displayed on the display unit, and the fundus image displayed on the display unit is displayed. Display control means for causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image;
It is characterized by having.
In order to achieve the above object, an ophthalmologic apparatus according to the present invention comprises the following arrangement. That is,
Detection means for automatically detecting information relating to the optic nerve head of the fundus of the eye from the fundus image of the eye;
A tomographic image acquisition means for acquiring a tomographic image of the fundus of the region near the optic disc based on the information using a scanning method corresponding to the optic disc;
The fundus image and the tomographic image are displayed on a display unit, and the resolution corresponding to the scanning method used for acquiring the tomographic image is displayed on the display unit, and the fundus image displayed on the display unit is displayed. Display control means for causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image;
It is characterized by having.
In order to achieve the above object, an ophthalmic system according to the present invention comprises the following arrangement. That is,
A fundus camera that acquires a fundus image of the eye,
Detection means for automatically detecting the position of the optic disc on the fundus of the eye from the fundus image;
An OCT apparatus that acquires a tomographic image of the fundus of the region near the optic nerve head using a method of circularly scanning the region near the optic nerve head based on the position;
The fundus image and the tomographic image are displayed on a display unit, and the resolution corresponding to the scanning method used for acquiring the tomographic image is displayed on the display unit, and the fundus image displayed on the display unit is displayed. Display control means for causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image;
It is characterized by having.
In order to achieve the above object, an ophthalmic system according to the present invention comprises the following arrangement. That is,
Detection means for automatically detecting information relating to the optic nerve head of the fundus of the eye from the fundus image of the eye;
A tomographic image acquisition means for acquiring a tomographic image of the fundus of the region near the optic disc based on the information using a scanning method corresponding to the optic disc;
The fundus image and the tomographic image are displayed on a display unit, and the resolution corresponding to the scanning method used for acquiring the tomographic image is displayed on the display unit, and the fundus image displayed on the display unit is displayed. Display control means for causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image;
It is characterized by having.
In order to achieve the above object, a tomographic image acquisition method according to the present invention comprises the following arrangement. That is,
A tomographic image acquisition method in a tomographic image acquisition apparatus,
A fundus image acquisition step in which the fundus image acquisition means acquires a fundus image of the eye;
A detecting step of automatically detecting the position of the optic disc on the fundus of the eye part from the fundus image;
A tomographic image acquisition step for acquiring a tomographic image of the fundus of the region near the optic nerve head using a method in which a tomographic image acquisition means scans the region near the optic nerve head in a circle based on the position;
The display control means displays the fundus image and the tomographic image on the display unit, and further displays the resolution corresponding to the scanning method used to acquire the tomographic image on the display unit and is displayed on the display unit. A display control step of causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image on the fundus image;
It is characterized by having.
In order to achieve the above object, a program according to the present invention comprises the following arrangement. That is,
A fundus image acquisition step of acquiring a fundus image of the eye part;
A detection step of automatically detecting the position of the optic disc on the fundus of the eye from the fundus image;
A tomographic image acquisition step of acquiring a tomographic image of the fundus of the region near the optic disc using a method of circularly scanning the region near the optic disc based on the position;
The fundus image and the tomographic image are displayed on a display unit, and the resolution corresponding to the scanning method used for acquiring the tomographic image is displayed on the display unit, and the fundus image displayed on the display unit is displayed. A display control step of causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image;
Is executed by a computer.
Moreover, in order to achieve the said objective, the ophthalmic processing apparatus by this invention is equipped with the following structures. That is,
Detecting means for automatically detecting the position of the optic disc on the fundus of the eye from the fundus image of the eye;
Control means for controlling the OCT apparatus so as to obtain a tomographic image of the fundus of the region near the optic disc using a method of circularly scanning the region near the optic disc based on the position;
The fundus image and the tomographic image are displayed on a display unit, and the resolution corresponding to the scanning method used for acquiring the tomographic image is displayed on the display unit, and the fundus image displayed on the display unit is displayed. Display control means for causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image;
It is characterized by having.
In order to achieve the above object, a program according to the present invention comprises the following arrangement. That is,
A detection step of automatically detecting the position of the optic disc on the fundus of the eye from the fundus image of the eye;
A control step of controlling the OCT apparatus to acquire a tomographic image of the fundus of the region near the optic disc using a method of circularly scanning the region near the optic disc based on the position;
The fundus image and the tomographic image are displayed on a display unit, and the resolution corresponding to the scanning method used for acquiring the tomographic image is displayed on the display unit, and the fundus image displayed on the display unit is displayed. A display control step of causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image;
Is executed by a computer.
Moreover, in order to achieve the said objective, the ophthalmic processing method by this invention is equipped with the following structures. That is,
An ophthalmic processing method in an ophthalmic processing apparatus,
A detecting step of automatically detecting the position of the optic nerve head of the fundus of the eye part from the fundus image of the eye part;
A control step for controlling the OCT apparatus so as to acquire a tomographic image of the fundus of the region near the optic disc using a method in which the control means circularly scans the region near the optic disc based on the position;
The display control means displays the fundus image and the tomographic image on the display unit, and further displays the resolution corresponding to the scanning method used to acquire the tomographic image on the display unit and is displayed on the display unit. A display control step of causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image on the fundus image;
It is characterized by having.

  According to the present invention, it is possible to provide a technique for efficiently acquiring a tomographic image of an eye part.

It is a figure which shows the apparatus structural example of a diagnosis assistance apparatus. It is a functional block diagram which shows the function structural example of a diagnosis assistance apparatus. It is a flowchart which shows the process sequence of the diagnostic assistance process which a diagnostic assistance apparatus performs. It is a figure which shows the structural example of a wide area image imaging device. It is a figure which shows the example of the lesion candidate on the wide area image of an eye part. It is a figure which shows the structural example of a tomographic image imaging device. It is a figure which shows the example of a display of a diagnosis assistance apparatus. It is a schematic diagram which shows the example of the lesion candidate detected by the lesion candidate detection part.

  Embodiments according to the present invention will be described below in detail with reference to the accompanying drawings. However, the constituent elements described in this embodiment are merely examples, and are not intended to limit the scope of the present invention only to them. In addition, not all the combinations of features described in the present embodiment are essential for the solving means of the invention.

<< First Embodiment: Configuration for Acquiring Wide Area Image / Tomographic Image from Imaging Device >>
(Device configuration of diagnosis support device)
First, a device configuration of the diagnosis support apparatus 1 according to the present embodiment will be described. FIG. 1 is a device configuration diagram showing a diagnosis support apparatus 1 according to the present embodiment. The diagnosis support apparatus 1 of FIG. 1 includes a central processing unit (CPU) 100, a main memory 101, a magnetic disk 102, a control program 103, a display memory 104, a monitor 105, a mouse 106, a keyboard 107, and a common bus 108.

  The central processing unit (CPU) 100 mainly controls the operation of each component of the diagnosis support apparatus 1. The main memory 101 can be realized by a RAM (Random Access Memory), and stores a device control program or serves as a work area when the program is executed. The magnetic disk 102 stores an operating system (OS), a device drive of a peripheral device, a program 103 for performing various processes described later, and the like.

  The display memory 104 temporarily stores display data. The monitor 105 is, for example, a CRT monitor or a liquid crystal monitor, and displays an image based on data from the display memory 104. A mouse 106 and a keyboard 107 are used for a pointing input and a character input by a user. The above components are connected to each other by a common bus 108.

  As shown in FIG. 1, the diagnosis support apparatus 1 includes a wide-area image capturing apparatus 2, a tomographic image capturing apparatus (tomographic image acquiring apparatus) 3, and a local area network (LAN) 4 such as Ethernet (registered trademark). Connected. Note that these devices may be connected via an external interface such as USB or IEEE1394.

  The wide-area image capturing apparatus 2 is an apparatus that captures a wide-area image of the eye, and can be realized by, for example, a fundus camera or an SLO. FIG. 4 is a diagram showing a configuration of the wide-area image capturing apparatus 2 realized by SLO (scanning laser ophthalmoscope).

  The wide area image capturing apparatus 2 captures a wide area image of the eye in response to a request from the diagnosis support apparatus 1 and outputs the obtained wide area image to the diagnosis support apparatus 1. As shown in FIG. 4, the wide-area image capturing apparatus 2 controls the polygon mirror 402 and the galvanometer mirror 403 via the scanning drive mechanism 401 in order to capture a wide-area image of the eye. Then, the reflected light of the weak laser light emitted from the imaging light source 400 is received by the light receiving element 404 to capture a wide-area image of the eye. Details of the SLO device configuration and drive mechanism control are described in detail in Patent Document 2.

  The tomographic image capturing apparatus 3 is an apparatus that captures a tomographic image of the eye, and includes, for example, time domain OCT (TD-OCT) or Fourier domain OCT (FD-OCT). FIG. 6 is a diagram illustrating a configuration example of the tomographic imaging apparatus 3 when the tomographic imaging apparatus 3 is a time domain OCT. The tomographic imaging apparatus 3 inputs a parameter for instructing the contents of imaging from the diagnosis support apparatus 1 and performs tomographic imaging using the parameter. The obtained tomographic image is output to the diagnosis support apparatus 1.

  Here, the parameter for instructing the contents of imaging is a parameter for instructing a scanning method such as a tomographic image acquisition site, a spatial range of the tomographic image, a detail level such as a scan line interval, a scanning order, and a scanning direction. The tomographic imaging apparatus 3 controls the reference mirror driving mechanism 601 and the galvano mirror driving mechanism 603 according to these parameters, and drives the reference mirror 602 and the galvano mirror 604. The reflected light of the light emitted from the low-coherence light source 600 is received by the light receiving element 605, thereby capturing a tomographic image of the eye. When the tomographic imaging apparatus 3 is a Fourier domain OCT, only the galvanometer mirror 604 is controlled. Details regarding the device configuration of OCT and control of the drive mechanism are described in detail in Patent Document 1 and Patent Document 2.

(Functional configuration of diagnosis support device)
Next, the functional configuration of the diagnosis support apparatus 1 will be described with reference to FIG. FIG. 2 is a functional block diagram showing a functional configuration of the diagnosis support apparatus 1 in the present embodiment. As illustrated in FIG. 2, the diagnosis support apparatus 1 includes a wide-area image acquisition unit 200, a lesion candidate detection unit 201, a tomographic image acquisition parameter determination unit 202, a tomographic image acquisition unit 203, a display unit 204, and a data storage unit 208.

● Wide-area image acquisition unit 200
The wide-area image acquisition unit 200 requests the wide-area image capturing apparatus 2 to capture and transmit a wide-area image of the eye, and acquires the wide-area image of the eye transmitted from the wide-area image capturing apparatus 2. The wide area image acquired by the wide area image acquisition unit 200 is transmitted to the lesion candidate detection unit 201, the display unit 204, and the data storage unit 208.

-Lesion candidate detection unit 201
The lesion candidate detection unit 201 detects information related to a lesion candidate from the wide area image of the eye acquired by the wide area image acquisition unit 200 based on information such as a normal eye database and medical guidelines. Information regarding the lesion candidate detected by the lesion candidate detection unit 201 (lesion candidate detection result) is transmitted to the tomographic image acquisition parameter determination unit 202, the display unit 204, and the data storage unit 208. Details of specific processing for detecting a lesion candidate from a wide-area image will be described in detail later.

A tomographic image acquisition parameter determination unit 202
The tomographic image acquisition parameter determination unit 202 includes a determination unit 205 and a site determination unit 206. The tomographic image acquisition parameter determination unit 202 determines parameters (tomographic image imaging parameters) related to tomographic image acquisition based on information on lesion candidates detected by the lesion candidate detection unit 201 (lesion candidate detection results). The tomographic imaging parameters include a parameter for instructing whether to acquire a tomographic image and a parameter for instructing the content of imaging. The determination unit 205 determines the former, and the region determination unit 206 determines the latter. The imaging parameters determined by the tomogram acquisition parameter determination unit 202 are transmitted to the tomogram acquisition unit 203, the tomogram analysis unit 207, the display unit 204, and the data storage unit 208. The details of the specific processing for determining the imaging parameters of the tomographic image based on the detection result of the lesion candidate will be described in detail later.

Tomographic image acquisition unit 203
The tomographic image acquisition unit 203 receives a tomographic image capturing request together with a parameter for instructing the imaging content when the parameter indicating whether or not tomographic image acquisition determined by the tomographic image acquisition parameter determining unit 202 is necessary Transmit to device 3. Then, a tomographic image transmitted from the tomographic imaging apparatus 3 is acquired. The tomographic image acquired by the tomographic image acquisition unit 203 is transmitted to the tomographic image analysis unit 207, the display unit 204, and the data storage unit 208.

-Tomographic image analysis unit 207
The tomographic image analysis unit 207 analyzes the tomographic image acquired by the tomographic image acquisition unit 203 and performs image measurement related to the tomographic image or lesion candidate detection from the tomographic image. Then, the analysis result is transmitted to the display unit 204 and the data storage unit 208. The details of the specific processing for analyzing the tomographic image will be described in detail later.

● Display unit 204
The display unit 204 displays the tomographic image obtained by the tomographic image acquisition unit 203 and the image measurement or lesion candidate detection result obtained by the tomographic image analysis unit 207. In addition, the imaging parameters of the tomographic image determined by the tomographic image acquisition parameter determining unit 202 are displayed. If a tomographic image cannot be acquired, information indicating that is displayed. Furthermore, for reasons such as confirmation of the imaging region, information regarding the wide area image acquired by the wide area image acquisition unit 200 and the lesion candidate detected by the lesion candidate detection unit 201 may be presented together.

● Data storage unit 208
The data storage unit 208 associates various types of input information and stores the information as certain patient data in the magnetic disk 102. In particular,
A wide area image input from the wide area image acquisition unit 200.
Information regarding a lesion candidate input from the lesion candidate detection unit 201.
Imaging parameters for tomographic images input from the tomographic image acquisition parameter determination unit 202.
A tomogram input from the tomogram acquisition unit 203.
Image measurement or lesion candidate detection result input from the tomogram analysis unit 207.
Save. Data may be stored in an external server (not shown). In this case, the data storage unit 208 transmits these data to the external server.

(Diagnosis support processing)
Next, a specific processing procedure of the diagnosis support process executed by the diagnosis support apparatus 1 of the present embodiment will be described with reference to FIG. FIG. 3 is a flowchart showing the procedure of the diagnosis support process executed by the diagnosis support apparatus 1 according to this embodiment.

● Step S301
In step S <b> 301, the wide area image acquisition unit 200 requests the wide area image capturing apparatus 2 to capture and transmit a wide area image of the eye, and acquires the wide area image of the eye transmitted from the wide area image capturing apparatus 2. Then, the acquired wide area image is transmitted to the lesion candidate detection unit 201, the display unit 204, and the data storage unit 208.

● Step S302
Next, in step S302, the lesion candidate detection unit 201 performs image processing (analysis) on the wide area image acquired in step S301, and detects information regarding the lesion candidate. The lesion candidate detection unit 201 according to the present embodiment has, as lesion candidates, abnormal blood vessel shapes (not shown) such as an abnormal shape of the optic nerve head 501a shown in the schematic diagram 501 of FIG. 5, a nerve fiber layer defect (not shown), and an arteriovenous crossover. ), Detecting other lesion candidates such as soft drusen 501b. Then, information on the detected lesion candidate (lesion candidate detection result) is transmitted to the tomographic image acquisition parameter determination unit 202, the display unit 204, and the data storage unit 208. FIG. 5 is a diagram illustrating an example of a lesion candidate on a wide-area image of the eye detected by the lesion candidate detection unit 201.

  The information on the lesion candidate includes information on the presence / absence of the lesion candidate, the type of the lesion candidate, the range of the lesion candidate, the degree of the lesion candidate, and the like. For example, in the case of an abnormal optic nerve head shape, it indicates the presence / absence of a shape abnormality and the degree of malignancy (Cup / Disc ratio value). In the case of a blood vessel shape abnormality, it represents the presence / absence and coordinates of an abnormality candidate, and malignancy (value of vein diameter ratio). Further, in the case of other lesions such as soft drusen 501b, the presence / absence of lesion candidates, the coordinates, area, and number of lesions are indicated.

  Here, the abnormal shape of the optic nerve head and the nerve fiber layer defect can be detected by the method described in Patent Document 3, for example. Further, an abnormal blood vessel shape such as an arteriovenous crossing phenomenon can be detected by the method described in Non-Patent Document 1, for example. Further, other lesion candidates such as soft drusen can be detected by the method described in Non-Patent Document 2. In addition, the detection method of each lesion candidate is not limited to these, Any method may be used as long as it can detect each lesion candidate from the wide area image of the eye part.

[Patent Document 3] JP-A-9-313447 [Non-Patent Document 1] Ryo Takahashi et al .: “Automatic analysis of blood vessel intersection for supporting hypertension diagnosis in fundus image”, Medical Imaging Technology, Vol. 24, No. .4, pp. 270-276, 2006
[Non-Patent Document 2] Takuro Iwasaki et al .: "Examination of automatic extraction of drusen from fundus photos", IEICE Technical Report, MI 2003-100, pp. 17-22, 2004.
● Step S303
In step S303, the determination unit 205 determines whether or not tomographic image acquisition is necessary based on the information regarding the lesion candidate detected in step S302 (lesion candidate detection result). Then, the result is set as a parameter indicating whether or not tomographic image acquisition is necessary, and is transmitted to the tomographic image acquisition unit 203, the display unit 204, and the data storage unit 208. If it is determined that acquisition of a tomographic image is necessary (YES in step S303), the process proceeds to step S304. If it is determined that acquisition of a tomographic image is not necessary (NO in step S303), the process is performed in step S307. Proceed to.

  Whether or not a tomographic image needs to be acquired is determined based on information such as medical guideline or the like based on the severity of a lesion candidate set in advance or at least one of occurrence sites. Specifically, in the case of an abnormal shape of the optic nerve head, it is determined that acquisition of a tomographic image is necessary when the Cup / Disc ratio is a certain value (eg, 0.7) or more. In the case of a nerve fiber layer defect, it is determined that a tomographic image needs to be acquired when there is a defect candidate site having an area of a certain value or more. In the case of an arteriovenous crossing phenomenon, it is determined that a tomographic image needs to be acquired when (venous diameter at the crossing portion) / (venous diameter outside the crossing portion) is a constant value (less than 1.0). In the case of other lesions such as soft drusen, it is determined that a tomographic image needs to be acquired when there are one or more lesion candidates having an area larger than a certain value.

  Note that the method of determining whether tomographic image acquisition is necessary is not limited to this, and the determination may be made based on other criteria. For example, it may be determined to be necessary when the lesion candidate detection unit 201 detects any lesion candidate, and may be determined as not to be detected when not detected.

● Step S304
In step S304, the site determination unit 206 determines a parameter for instructing the content of tomographic imaging based on the information regarding the lesion candidate detected in step S302 (lesion candidate detection result). Then, the determined parameters are transmitted to the tomographic image acquisition unit 203, the tomographic image analysis unit 207, the display unit 204, and the data storage unit 208.

  The site determination unit 206 determines a parameter for instructing the content of tomographic image capture according to the type and situation (position or range) of the detected lesion candidate. Specifically, a scanning method is determined such as a lesion type, a spatial range of a tomographic image suitable for a site to be acquired, a degree of detail such as a scan line interval, a scanning order, and a scanning direction. The following are specific examples of parameters that can be set.

・ When abnormal optic disc shape is detected:
A 6 mm × 6 mm region near the optic nerve head is acquired in a circular scan with a size of 1024 × 512 × 16.

・ When a nerve fiber layer defect is detected:
Since it is necessary to quantify the nerve fiber layer thickness, a rectangular region including a defect site is acquired by raster scanning at a size of 512 × 512 × 128 so that the layer thickness can be accurately measured on a B-scan image.

・ When a retinal vascular lesion is detected:
Since there is a possibility of macular edema, a 6 mm × 6 mm region in the vicinity of the macula 501c is acquired by raster scanning at a size of 256 × 256 × 256 so as to sufficiently include a macular portion having a diameter of about 2 mm.

・ When other lesions such as soft drusen are detected:
Since age-related macular degeneration is suspected, a 6 mm x 6 mm area near macular 501c is acquired by raster scan at a size of 512 x 512 x 128 so that minute irregularities of the retinal pigment epithelium on a B-scan image can be detected To do.

  When there are a plurality of lesion candidates detected in step S302, an imaging region is determined for each lesion candidate, and an imaging parameter is determined for each. For example, when an optic disc abnormality and a nerve fiber layer defect in the vicinity of the macula are detected, parameters for instructing imaging of the optic disc and the macula are set.

● Step S305
In step S305, the tomographic image acquisition unit 203 acquires a tomographic image from the tomographic imaging apparatus 3 based on the tomographic imaging parameters determined in steps S303 and S304. That is, when a parameter indicating whether or not tomographic image acquisition is necessary is necessary, a tomographic image capturing request is transmitted to the tomographic image capturing apparatus 3 together with a parameter indicating the imaging content. Then, a tomographic image transmitted from the tomographic imaging apparatus 3 is acquired. The tomographic image acquired by the tomographic image acquisition unit 203 is transmitted to the tomographic image analysis unit 207, the display unit 204, and the data storage unit 208. In addition, when the imaging | photography regarding several site | parts was instruct | indicated in step S304, the imaging request using each imaging parameter is transmitted to the tomographic imaging device 3, and imaging is performed in multiple times.

● Step S306
In step S306, the tomogram analysis unit 207 analyzes the tomogram acquired in step S305, and performs image measurement related to the tomogram or detection of a lesion candidate from the tomogram. Then, the analysis result is transmitted to the display unit 204 and the data storage unit 208.

  For example, when a tomographic image of the macular portion is captured, the boundary of the retinal layer is detected using a known threshold process and the retinal layer thickness is measured. In addition, when a tomographic image of the optic nerve head is captured, a known threshold process is performed to detect the inner boundary film and obtain the Cup / Disc ratio. Further, the measurement site is not limited to the retinal layer boundary, and may be, for example, a blood vessel.

  In addition, the results of analysis on the eye such as the thickness of the retina are compared with the normal values of the eye shape accumulated in advance, and candidate lesions such as detecting abnormal eye shapes when they are outside the normal value range. Detection is also performed. However, the method for acquiring a lesion candidate from a tomographic image is not limited to this, and for example, a lesion candidate may be directly detected using density information or shape information in a tomographic image.

  Furthermore, for example, a graph or a map that assists in understanding the image measurement result and the lesion candidate detection result such as the distribution state of the retinal layer thickness may be created.

  If tomographic images relating to a plurality of parts are acquired in step S305, processing for each part is executed. If a tomographic image has not been acquired in step S305, the tomographic image analysis unit 207 does not execute the process of step S306.

● Step S307
In step S307, the display unit 204 performs the following processing when a tomographic image is acquired. That is, the tomographic image obtained in step S305 and the analysis result (image measurement or lesion candidate detection result) of the tomographic image obtained in step S306 are displayed on the monitor 105. Here, for reasons such as confirmation of the imaging region, the wide area image, the lesion candidate detected on the wide area image, or the acquisition range of the tomographic image on the wide area image may be presented together. Further, the imaging parameters of the tomographic image may be displayed together. If a tomographic image has not been acquired, the reason why it is not necessary to acquire a wide-area image or a tomographic image may be displayed.

  FIG. 7 shows a display example of a lesion candidate detection result by the lesion candidate detection unit 201 and an image measurement result obtained by the tomographic image analysis unit 207. In this example, a wide area image 701, a lesion candidate 701a, a tomographic image acquisition range 701b, a tomographic image 702 acquired in the upper right, and a map 703 of retinal layer thickness as a tomographic image analysis result are displayed in the lower right. .

  In this example, since soft drusen 701a is detected in the wide-area image 701, the macular portion 701b is designated as the imaging region, and the retinal layer boundary (the bold line portion of 702) is detected from the captured tomographic image 702, and the obtained retina is obtained. A layer thickness map 703 is displayed.

● Step S308
In step S308, the data storage unit 208 associates the various information input in the above steps and stores the information as certain patient data in the magnetic disk 102. Specifically, the wide-area image obtained in step S301, the lesion candidate information obtained in step S302, the tomographic imaging parameters obtained in steps S303 and S304, the tomographic image obtained in step S305, and the image obtained in step S306 Save measurement or lesion candidate detection results. Of course, the data to be stored need not be all of these.

  Note that the tomographic imaging parameter storage may be configured to be performed only when the tomographic image acquisition unit 203 cannot acquire the tomographic image for some reason in step S305. For example, when the tomographic imaging apparatus 3 is not connected to the diagnosis support apparatus 1, by storing the imaging parameters of the wide area image and the tomographic image in association with each other, the necessary tomographic image of the patient is later (manually) It becomes possible to image. In this case, the tomographic imaging parameters may be stored in the header area of the wide area image file.

  The data may be stored in an external server (not shown). In this case, the data storage unit 208 transmits these data to the external server.

  As described above, in the present embodiment, the necessity of acquiring a tomographic image and the acquisition range are automatically set from the analysis result of the wide-area image of the eye. For this reason, it is possible to efficiently acquire a tomographic image of the eye.

  Further, in the present embodiment, a wide-area image acquisition process for acquiring a wide-area image of the eye is performed, the acquired wide-area image is analyzed, a lesion candidate in the eye is detected, and the eye is based on the detection result of the lesion candidate Determine parameters for tomographic image acquisition. Then, tomographic image acquisition processing is performed for acquiring a tomographic image of the eye based on the determined parameters. As described above, in the present embodiment, the tomographic image is acquired by automatically detecting the portion where the tomographic image needs to be acquired, and thus the tomographic image of the necessary part is acquired with the allowable imaging time and analysis processing time. To do. Therefore, it is possible to efficiently acquire a tomographic image of the eye.

  As described above, a wide area image of the eye is analyzed to detect at least one of the presence / absence of a lesion candidate, the type of lesion candidate, the range of lesion candidate, and the degree of lesion candidate, Parameters relating to tomographic image acquisition may be determined based on the detection result. In this case, a site where a tomographic image should be acquired can be determined appropriately.

  Further, a parameter relating to tomographic image acquisition may be determined based on at least one of the type and range of the detected lesion candidate. Also in this case, it is possible to appropriately determine a site where a tomographic image is to be acquired.

  The parameter to be determined may include information indicating whether tomographic image acquisition is necessary. Furthermore, whether or not tomographic images need to be acquired may be determined based on at least one of a predetermined severity of a lesion candidate and an occurrence site. In this case, it is possible to appropriately determine whether to acquire a tomographic image based on this parameter.

  Further, when information indicating that the tomographic image acquisition is unnecessary is included in the parameter, the tomographic image acquisition may not be performed. In this case, it is possible to operate efficiently without acquiring an unnecessary tomographic image.

  Further, the parameter to be determined may include information indicating the portion of the tomographic image to be acquired. Alternatively, the parameters to be determined may include information indicating at least one of the spatial range of the tomographic image to be acquired, the degree of detail, and the scanning method. In this case, a site where a tomographic image is required can be determined based on these parameters.

  In addition, display control processing may be performed in which at least one of the acquired wide-area image and the acquired tomographic image is displayed on the monitor. In this case, the doctor can browse the wide area image and the tomographic image and perform an appropriate diagnosis.

  The determined parameters may be stored in a storage unit such as the magnetic disk 102 in association with the wide area image. In this case, an appropriate treatment such as obtaining a tomographic image later can be performed based on the wide area image and the parameters.

(Modification 1)
In the process of step S302, the lesion candidate detection unit 201 according to the present embodiment detects candidates for other lesions such as an abnormal shape of the optic papilla, an abnormal vascular shape such as a nerve fiber layer defect, an arteriovenous cross, and a soft drusen. Was. However, lesion candidates detected by the lesion candidate detection unit 201 are not limited to these. For example, as shown in Non-Patent Document 3, vitiligo and bleeding may be detected using a known image feature detection method based on smoothing difference processing. Any lesion candidate may be detected as long as it is a lesion candidate that can be detected from the wide-area image of the eye obtained from the wide-area image capturing apparatus 2.

  Further, detection from a wide-area image does not necessarily have to be a lesion candidate, and any information may be used as long as it is information on an eye part obtained from a wide-area image. For example, a wide area image may be processed to measure a retina shape, and a value obtained by quantifying a deviation from a standard shape may be measured.

  When the lesion candidate detection unit 201 detects a lesion candidate different from that in the above embodiment, the tomographic image acquisition parameter determination unit 202 needs to determine an imaging parameter for the lesion. For example, when detecting vitiligo as a lesion candidate, it is determined that a tomographic image must be acquired whenever a vitiligo is detected, and the site is determined to be a macular portion. When measuring the degree of deviation of the retinal shape from the standard shape, if the value is equal to or greater than a predetermined threshold, it is determined that a tomographic image needs to be acquired and the macular portion is photographed. Good.

  [Non-Patent Document 3] Yuji Hatanaka et al .: “Automatic detection method of bleeding and vitiligo in fundus image”, IEICE Technical Report, MI 2006-131, pp.181-184, 2007.

  As described above, the lesion candidates are not limited to those exemplified here, and this configuration can be applied to arbitrary lesion candidates.

(Modification 2)
Further, the imaging parameters to be determined are not limited to the above example, and any parameters can be used as long as a rule for determining imaging parameters according to the type and position of the detected lesion candidate can be described. Also good.

  For example, the parameter for instructing the content of imaging may be only the imaging site corresponding to the detected lesion. In this case, the site determination unit 206 designates a site to be imaged according to the lesion detection result in the process of step S304. For example, if an optic disc abnormality is detected, the optic disc is included; if a retinal vascular lesion is detected, the macular region; if soft drusen is detected, the macular region; if detecting a nerve fiber layer defect, the defect is included A site (optic nerve head / macular region) can be specified. Or you may determine the imaging mode showing the group of some predetermined parameters as a parameter which instruct | indicates the content of imaging. For example, when a retinal vascular lesion is detected, the imaging mode B is used for imaging the macula with a certain setting, and when soft drusen is detected, the imaging mode C is used for imaging the macular with another setting. Also good. At this time, the tomographic image acquisition device 3 may interpret a specific imaging range, a scanning method, and the like according to the designated part and imaging mode, and perform tomographic imaging based on the interpretation.

  Further, the parameter for instructing the content of imaging may be a control parameter (for example, a control parameter such as a galvano mirror angle) for controlling the drive mechanism of the tomographic image acquisition apparatus 3. In this case, the (eye part) diagnosis support apparatus 1 directly controls the tomographic image acquisition apparatus 3.

(Modification 3)
In this embodiment, a fundus camera image, an SLO image, or the like is used as a wide-area image input to the wide-area image acquisition unit 200. However, a two-dimensional image generated by projecting an OCT tomographic image that captures a wide area is generated. It may be used as an image. Further, the wide area image is not limited to a two-dimensional image, and an OCT tomographic image obtained by imaging a wide range with a low resolution may be used. An OCT image with a wide imaging range may be acquired directly from, for example, the tomographic imaging apparatus 3 with the imaging angle of view set to the maximum. In addition, a plurality of parts of the same eye may be captured in advance using the tomographic image capturing apparatus 3 and connected by image processing to acquire a wide area image.

  In this modification, the wide area image acquisition unit 200 inputs an OCT image obtained by imaging a wide range with a low resolution. The lesion candidate detection unit 201 performs processing such as detection of the nerve fiber layer boundary, measurement of the nerve layer thickness, comparison with a normal value of the nerve fiber layer thickness, and the like to detect a lesion candidate such as an abnormal nerve fiber layer thickness. Do. FIG. 8 is a schematic diagram illustrating an example of a lesion candidate detected by the lesion candidate detection unit 201. In this example, a region 801a in which the nerve fiber layer thickness in the wide area image 801 is lower than a normal value is detected as an abnormal part.

  The tomographic image acquisition parameter determination unit 202 determines the tomographic imaging parameters based on the information regarding the lesion candidates detected by the lesion candidate detection unit 201, and the tomographic image acquisition unit 203 uses the imaging parameters to perform local tomographic imaging. Take an image with high resolution. Thereby, it becomes possible to image and analyze only a necessary part with high resolution, and tomographic images of the eye can be efficiently acquired.

<< Second Embodiment: Configuration for Acquiring Wide Area Image / Tomographic Image from Storage Device >>
In the first embodiment, the configuration in which the wide-area image capturing apparatus 2 and the tomographic image capturing apparatus 3 capture a wide-area image and a tomographic image in response to an imaging request from the diagnosis support apparatus 1 has been described. However, the embodiment of the diagnosis support apparatus is not limited to this. Here, as a second embodiment, a diagnosis that obtains information for supporting diagnosis based on a wide-area image or tomographic image that has been captured and acquired from an external database or storage device The support device will be described.

  The diagnosis support apparatus 1 in the second embodiment includes a database 5 (not shown) that stores medical examination data (wide area image and tomographic image) captured by the wide area image capturing apparatus 2 and the tomographic image capturing apparatus 3 via the LAN 4. It is connected. The data may be read from various storage media including a storage device (not shown) connected to the diagnosis support apparatus 1, for example, an HD, a CD-RW drive, and a DVD drive.

  Since the flowchart showing the processing procedure of the diagnosis support apparatus 1 in this embodiment is basically the same as that in the first embodiment, specific processing contents will be described with reference to FIG. Prior to the diagnosis support apparatus 1 performing the following processing, the database 5 includes a wide-area image (fundus camera image or SLO image) of the eye of the patient to be diagnosed and a wide-range tomographic image of the eye. It is assumed that an (OCT image) is captured and accumulated in advance.

  First, in step S <b> 301, the wide area image acquisition unit 200 reads out a wide area image of the eye part of the diagnosis target patient accumulated in the database 5. Note that the images acquired at this time include not only images to be diagnosed but also images of past cases, normal cases, typical cases, similar cases, and the like.

  The processing in step S302 and step S303 is the same as that in the first embodiment.

  In step S304, the region determination unit 206 determines the acquisition parameter of the local tomographic image to be cut out based on the information regarding the lesion candidate detected in step S302 (lesion candidate detection result). As specific parameters, the data center position, matrix size, resolution, data arrangement method and the like are determined.

  In step S305, the tomographic image acquisition unit 203 uses a tomographic image acquisition parameter determined in step S304, and extracts a necessary region from the tomographic image of the eye part of the patient accumulated in the database 5. Get a statue. The image acquired at this time is not limited to an image to be diagnosed, but may be an image of a past case, a normal case, a typical case, a similar case, or the like.

  The processes in step S306 and step S307 are the same as in the first embodiment.

  As described above, in the configuration of the present embodiment, the necessity of tomographic image readout is determined from the analysis result of the wide area image of the eye, and the tomographic image readout region is automatically set. For this reason, diagnosis using a tomographic image can be supported. In addition, since the tomographic image reading and analysis processes are not performed more than necessary, diagnosis can be performed efficiently.

<< Other Embodiments >>
It goes without saying that the object of the present invention can also be achieved by executing a program code of software that realizes the functions of the above-described embodiments in a system or apparatus. In this case, the program code itself realizes the functions of the above-described embodiments, and the program code is included in the technical scope of the present invention.

  For example, the program code can be recorded on a computer-readable recording medium and supplied to the system or apparatus. The computer (or CPU or MPU) of the system or apparatus can also achieve the object of the present invention by reading and executing the program code stored in the recording medium. Therefore, the recording medium storing the program code is also included in the technical scope of the present invention.

  As a recording medium for supplying the program code, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, a DVD, or the like is used. it can.

  Note that the program code is not limited to the one having all the elements for realizing the functions of the above-described embodiments by the computer reading and executing the program code. That is, the program code includes a program code that achieves an object by cooperating with at least one of software and hardware incorporated in the computer.

  For example, even when the OS running on the computer performs part or all of the actual processing based on the instruction of the program code and the functions of the above-described embodiments are realized by the processing, the program code is It is included in the technical scope of the present invention. However, OS is an abbreviation for operating system.

  Alternatively, for example, based on an instruction of a program code, a function expansion board inserted or connected to a computer or a CPU provided in a function expansion unit performs part or all of the actual processing, and the function of the above-described embodiment is performed by the processing. May be realized. Even in such a case, the program code is included in the technical scope of the present invention. Note that the function expansion board and the function expansion unit can perform such processing by reading and executing the program code in the memory provided therein.

  In addition, the description in this Embodiment mentioned above is an example of the suitable diagnosis assistance apparatus which concerns on this invention, and this invention is not limited to this.

Claims (20)

Fundus image acquisition means for acquiring a fundus image of the eye part;
Detection means for automatically detecting the position of the optic disc on the fundus of the eye from the fundus image;
A tomographic image acquisition means for acquiring a tomographic image of the fundus of the region near the optic disc using a method of circularly scanning the region near the optic disc based on the position;
The fundus image and the tomographic image are displayed on a display unit, and the resolution corresponding to the scanning method used for acquiring the tomographic image is displayed on the display unit, and the fundus image displayed on the display unit is displayed. Display control means for causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image;
An ophthalmologic apparatus comprising: Detection means for automatically detecting information relating to the optic nerve head of the fundus of the eye from the fundus image of the eye;
A tomographic image acquisition means for acquiring a tomographic image of the fundus of the region near the optic disc based on the information using a scanning method corresponding to the optic disc;
The fundus image and the tomographic image are displayed on a display unit, and the resolution corresponding to the scanning method used for acquiring the tomographic image is displayed on the display unit, and the fundus image displayed on the display unit is displayed. Display control means for causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image;
An ophthalmologic apparatus comprising:   The ophthalmologic apparatus according to claim 2, wherein the scanning method is a method of scanning a region in the vicinity of the optic disc in a circle. The detection means detects the position of the optic disc from the fundus image,
4. The ophthalmologic apparatus according to claim 2, wherein the tomographic image acquisition unit acquires a tomographic image of the fundus in a region near the optic disc based on the position. A fundus camera that acquires a fundus image of the eye,
Detection means for automatically detecting the position of the optic disc on the fundus of the eye from the fundus image;
An OCT apparatus that acquires a tomographic image of the fundus of the region near the optic nerve head using a method of circularly scanning the region near the optic nerve head based on the position;
The fundus image and the tomographic image are displayed on a display unit, and the resolution corresponding to the scanning method used for acquiring the tomographic image is displayed on the display unit, and the fundus image displayed on the display unit is displayed. Display control means for causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image;
An ophthalmic system characterized by comprising: Detection means for automatically detecting information relating to the optic nerve head of the fundus of the eye from the fundus image of the eye;
A tomographic image acquisition means for acquiring a tomographic image of the fundus of the region near the optic disc based on the information using a scanning method corresponding to the optic disc;
The fundus image and the tomographic image are displayed on a display unit, and the resolution corresponding to the scanning method used for acquiring the tomographic image is displayed on the display unit, and the fundus image displayed on the display unit is displayed. Display control means for causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image;
An ophthalmic system characterized by comprising:   The ophthalmologic system according to claim 6, wherein the scanning method is a method of scanning a region in the vicinity of the optic disc circularly. The detection means detects the position of the optic disc from the fundus image,
The ophthalmologic system according to claim 6 or 7, wherein the tomographic image acquisition unit acquires a tomographic image of the fundus in a region near the optic disc based on the position. A fundus camera for acquiring the fundus image;
The ophthalmic system according to claim 6, wherein the tomographic image acquisition unit is an OCT apparatus. An SLO device for acquiring the fundus image,
The ophthalmic system according to claim 6, wherein the tomographic image acquisition unit is an OCT apparatus. A tomographic image acquisition method in a tomographic image acquisition apparatus,
A fundus image acquisition step in which the fundus image acquisition means acquires a fundus image of the eye;
A detecting step of automatically detecting the position of the optic disc on the fundus of the eye part from the fundus image;
A tomographic image acquisition step for acquiring a tomographic image of the fundus of the region near the optic nerve head using a method in which a tomographic image acquisition means scans the region near the optic nerve head in a circle based on the position;
The display control means displays the fundus image and the tomographic image on a display unit, and further displays the resolution set for the scanning method used for acquiring the tomographic image on the display unit. A display control step of causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image on the fundus image displayed in
A tomographic image acquisition method characterized by comprising: A fundus image acquisition step of acquiring a fundus image of the eye part;
A detection step of automatically detecting the position of the optic disc on the fundus of the eye from the fundus image;
A tomographic image acquisition step of acquiring a tomographic image of the fundus of the region near the optic disc using a method of circularly scanning the region near the optic disc based on the position;
The fundus image and the tomographic image are displayed on a display unit, and the resolution corresponding to the scanning method used for acquiring the tomographic image is displayed on the display unit, and the fundus image displayed on the display unit is displayed. A display control step of causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image;
A program that causes a computer to execute. Detecting means for automatically detecting the position of the optic disc on the fundus of the eye from the fundus image of the eye;
Control means for controlling the OCT apparatus so as to obtain a tomographic image of the fundus of the region near the optic disc using a method of circularly scanning the region near the optic disc based on the position;
The fundus image and the tomographic image are displayed on a display unit, and the resolution corresponding to the scanning method used for acquiring the tomographic image is displayed on the display unit, and the fundus image displayed on the display unit is displayed. Display control means for causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image;
An ophthalmic processing apparatus comprising: A detection step of automatically detecting the position of the optic disc on the fundus of the eye from the fundus image of the eye;
A control step of controlling the OCT apparatus to acquire a tomographic image of the fundus of the region near the optic disc using a method of circularly scanning the region near the optic disc based on the position;
The fundus image and the tomographic image are displayed on a display unit, and the resolution corresponding to the scanning method used for acquiring the tomographic image is displayed on the display unit, and the fundus image displayed on the display unit is displayed. A display control step of causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image;
A program that causes a computer to execute. An ophthalmic processing method in an ophthalmic processing apparatus,
A detecting step of automatically detecting the position of the optic nerve head of the fundus of the eye part from the fundus image of the eye part;
A control step for controlling the OCT apparatus so as to acquire a tomographic image of the fundus of the region near the optic disc using a method in which the control means circularly scans the region near the optic disc based on the position;
The display control means displays the fundus image and the tomographic image on the display unit, and further displays the resolution corresponding to the scanning method used to acquire the tomographic image on the display unit and is displayed on the display unit. A display control step of causing the display unit to display a display indicating a position corresponding to the acquisition position of the tomographic image on the fundus image;
An ophthalmic processing method characterized by comprising: The ophthalmologic apparatus according to claim 1, wherein the display control unit further causes the display unit to display a scanning method used for acquiring the tomographic image. The ophthalmologic system according to claim 5 or 6, wherein the display control unit further causes the display unit to display a scanning method used for acquiring the tomographic image. 12. The tomographic image acquisition method according to claim 11, wherein, in the display control step, the display control unit further causes the display unit to display a scanning method used for acquiring the tomographic image. The ophthalmic processing method according to claim 15, wherein, in the display control step, the display control unit further causes the display unit to display a scanning method used to acquire the tomographic image. The ophthalmic processing apparatus according to claim 13, wherein the display control unit further causes the display unit to display a scanning method used to acquire the tomographic image.

Images