JP2004024795A - Medical image composite observation apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve the problem that it is difficult to simultaneously display all the images or to specify a concerned area found on a three-dimensional image on a two-dimensional image due to increase in image data obtained by X-ray CT equipment. <P>SOLUTION: A plurality of high definition image display devices arranged adjacently are made to function as a single ultra-high definition image display device to display the three-dimensional image on its three-dimensional image display area and the two-dimensional image on its two-dimensional image display area. Selection of medical image data, changes in image processing and a display parameter, and selection of image data to be displayed on the two-dimensional image display area are operated by a single man-machine interface. By setting the concerned area on the three-dimensional image, the image data to be displayed on the two-dimensional image display area can automatically be selected. Furthermore, by selecting the two-dimensional image corresponding to the concerned area set on the three-dimensional image, the concerned area can be displayed on the two-dimensional image. Thus, a medical image composite observation apparatus with which the images are understood easily is realized. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
[Technology to which the Invention belongs]
The present invention provides a medical image by displaying a three-dimensional image and a two-dimensional image created from medical image data on a plurality of display areas of a single ultra-high definition image display device and associating the three-dimensional image with the two-dimensional image. The present invention relates to a medical image combined observation apparatus that facilitates understanding of data images.
[0002]
[Prior art]
An X-ray CT apparatus can obtain accurate cross-sectional image data representing physical properties of a human body. In the initial X-ray CT, the number of cross-sectional image data collected in one examination for one subject was 10 to 20. This cross-sectional image data is displayed on an image display device such as a CRT after performing image processing such as window processing for displaying an optimum image. In a conventional method, images displayed on the image display device are sequentially printed on a film. Since about 12 images can be printed on one film, 20 images collected in one inspection can be printed on two films. In a conventional image data interpretation method, a doctor in charge of image interpretation attaches these two films to a light box and interprets 20 images collected in one examination. In addition, a film in which image data collected in a past inspection is burned is attached to a light box at the same time, and the images are compared for image reading.
[0003]
In recent years, with the technological advancement of X-ray CT systems, helical scan X-ray CT systems and multi-row detector X-ray CT systems have been put into practical use. It has become possible to acquire various image data. In addition, due to the technical progress of the X-ray CT apparatus, the X-ray dose to patients has been greatly reduced. As a result, the number of image data collected in one inspection has increased significantly, and may be, for example, 1000.
[0004]
In addition, technological advances in X-ray CT apparatuses have made it possible to collect image data in a short period of time, and to obtain high-quality images of pulsating organs such as the heart. Along with this, four-dimensional acquisition for acquiring image data in each phase obtained by dividing the heartbeat into ten is also performed. As a result, the number of image data items collected in one inspection is greatly increased, and may be, for example, 4,000.
[0005]
With the large increase in image data, the conventional method of printing images on film requires an enormous number of films on which images collected in a single inspection were burned, and all of these films were light-boxed. It is becoming difficult to attach and interpret images.
[0006]
Due to the large increase in image data, it has become difficult to attach a film in which a conventional image is imprinted to a light box and read the image. A so-called electronic light box has been attempted in which a plurality of image display devices are arranged and sequentially display images collected in one inspection. However, since the number of images that can be displayed on one high-definition image display device is about 24, the number of images that can be displayed at one time even if four of them are arranged is about 100. For this reason, there is a demand for a method of displaying 1000 to 4000 images efficiently and interpreting the images.
[0007]
Reconstruction of three-dimensional stereoscopic images using multiple cross-sectional image data taken at different cross-sectional positions since accurate cross-sectional image data representing the physical properties of the human body has been obtained by X-ray CT equipment Has been done. In particular, recently, a helical scan X-ray CT apparatus and a multi-row detector X-ray CT apparatus have been put to practical use, so that it has become possible to reconstruct a more precise three-dimensional stereoscopic image.
[0008]
Surface display method (surface rendering method), which extracts the boundary surface of the object that constitutes the subject and displays the shape of the boundary surface, and supports the subject in terms of physical properties There is a volume rendering method that treats the data as a three-dimensional array of voxels having the specified values. In the case of displaying a three-dimensional image, generally, the larger the number of cross-sectional image data used for displaying the three-dimensional image, the more precise a three-dimensional image can be created. Technical advances in X-ray CT equipment have resulted in the use of a greater number of cross-sectional image data to create more precise three-dimensional images.
[0009]
However, it is often difficult for a doctor who interprets medical image data to interpret X-ray CT image data only by displaying a three-dimensional image, even for a precise three-dimensional image. This is because the training so far has been performed on two-dimensional images, and the window level setting may affect the shape on three-dimensional images. Therefore, interpretation of X-ray CT image data requires not only three-dimensional image display but also two-dimensional image display.
[0010]
For this purpose, a light box is installed adjacent to the three-dimensional image display device to perform three-dimensional image display and image interpretation using a film. In addition, an electronic light box is installed adjacent to the three-dimensional display device to perform three-dimensional display and interpretation using a two-dimensional image displayed on the electronic light box. However, in these cases, since the cooperation between the three-dimensional image and the two-dimensional image displayed on the three-dimensional display device is poor, the effect of synergizing the three-dimensional image and the two-dimensional image cannot be expected.
[0011]
[Problems to be solved by the invention]
The three-dimensional image display device is widely used because grasping the three-dimensional structure of the subject using the three-dimensional image is easier than grasping the two-dimensional image. There is a request to use an image. Conventionally, there has been insufficient cooperation between the three-dimensional image displayed on the three-dimensional image device and the two-dimensional image displayed on the two-dimensional image display device. It has been difficult to specify a region of interest found in a three-dimensional image on a two-dimensional image displayed on a two-dimensional image display device.
[0012]
Advances in X-ray CT technology have increased the number of image data acquired in a single inspection, making it impossible to arrange all films at once on a light box. Further, even when displaying a two-dimensional image on the two-dimensional image display device, it is impossible to arrange all the images at once. For this reason, how to handle this huge two-dimensional image is an important issue.
[0013]
[Means for Solving the Problems]
The present invention has been devised in order to solve the above problems,
A plurality of adjacent high-definition image display devices function as a single ultra-high-definition image display device, and a large number of medical images can be displayed thereon. A three-dimensional image is constructed using medical image data composed of a plurality of two-dimensional image data collected by the medical image diagnostic apparatus, and the three-dimensional image is displayed in a three-dimensional image display area of the ultra-high definition image display device. Further, image processing is performed on the two-dimensional image data constituting the medical image data, and the two-dimensional image data is displayed in the two-dimensional image display area of the ultra-high definition image display device.
Selection of medical image data, image processing of the three-dimensional image displayed in the three-dimensional image display area, change of image display parameters, two-dimensional image data to be displayed in the two-dimensional image display area from the two-dimensional image data constituting the medical image data The selection of image data, the image processing of the two-dimensional image displayed in the two-dimensional image display area, and the change of image display parameters can be operated with a single man-machine interface.
Interactively operate medical image data selection, 3D image display-related processing, 2D image data display in the 2D image display area, and 2D image display-related processing with one man-machine interface. As a result, a three-dimensional image and a two-dimensional image can be displayed simultaneously, and the three-dimensional image and the two-dimensional image can be associated with each other, thereby realizing a medical image combined observation apparatus that facilitates image understanding of medical image data.
[0014]
Means for setting a region of interest on a three-dimensional image displayed in a three-dimensional image display area, thereby enabling selection of a range of two-dimensional image data to be displayed in the two-dimensional image display area from medical image data A medical image compound observation device that enables to select 2D image data to be displayed in the 2D image display area from medical image data by moving the region of interest on the 3D image did.
[0015]
By setting a region of interest on the three-dimensional image displayed in the three-dimensional image display area, a corresponding two-dimensional image is selected from the two-dimensional images displayed in the two-dimensional image display area, and the interest in the three-dimensional image is displayed. Means for enabling a region of interest corresponding to the region to be displayed on the two-dimensional image, and displaying the region of interest at a corresponding position on the two-dimensional image corresponding to the region of interest set on the three-dimensional image By realizing this, a medical image combined observation apparatus that facilitates understanding of images of medical image data has been realized.
[0016]
The medical image compound observation apparatus is configured to select medical image data, select three-dimensional image processing and image display parameters, select two-dimensional image display image data, select two-dimensional image processing and image display parameters based on man-machine interface operations. A means for issuing via a network is provided. A high-speed image processing device is installed near the network of the medical image diagnostic device or the medical image storage communication system (PACS), and medical image data is acquired based on instructions issued by the medical image compound observation device. And a means for performing three-dimensional image processing and image display processing, two-dimensional image processing and image display processing, and transmitting a result of the image processing to a medical image combined observation apparatus via a network. As a result, a medical image combined observation apparatus system that can reduce network traffic and effectively utilize image processing functions has been realized.
[0017]
A means for supporting the creation of an interpretation report on medical image data and displaying this in the interpretation report display area of the ultra-high-definition image display device facilitates image understanding of the medical image data and creation of an interpretation reporter. A medical image composite observation device was realized.
[0018]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, the medical image composite observation apparatus according to the present invention will be described. FIG. 1 is a schematic diagram showing a configuration of an embodiment of the present invention.
Reference numeral 101 denotes a medical image combined observation apparatus main body, which is an ultra-high definition image display device including a plurality of high definition image display devices. Reference numeral 102 denotes a two-dimensional image display area, 103 denotes a three-dimensional image display area, and 104 denotes a four-dimensional image display area / report creation area.
Reference numeral 201 denotes a man-machine interface for operating the medical image composite observation apparatus. Reference numeral 202 denotes a personal computer, which supplies video signals to a plurality of high-definition image displays constituting the medical image composite observation apparatus main body, and controls the man-machine interface 201.
Reference numeral 203 denotes an instruction from the man-machine interface to the high-speed image processing apparatus.
A high-speed image processing apparatus 301 performs three-dimensional image processing and two-dimensional image processing of medical image data.
Reference numeral 302 denotes a display three-dimensional image or a display two-dimensional image processed by the high-speed image processing apparatus.
Reference numeral 401 denotes a medical diagnostic device that generates medical image data such as an X-ray CT device, and 402 denotes an image database such as a PACS that stores medical image data.
403 is a network.
[0019]
The medical image composite observation apparatus main body 101 is composed of, for example, ten high-definition image display devices having 2048 × 3072 pixels. Eight of these are used for the two-dimensional image display area 102. In an X-ray CT image having 512 × 512 pixels, 24 images can be displayed on an image display device having 2048 × 3072 pixels, and 192 images can be displayed at a time with eight devices. In this example, one high-definition image display device having 2048 × 3072 pixels is assigned to each of the three-dimensional image display area 103 and the four-dimensional image display area / report creation area 104.
[0020]
When the user operates the man-machine interface 201 to select image data to be displayed in the three-dimensional image display area 103, the high-speed image processing apparatus is instructed via the personal computer 202 to select image data and perform three-dimensional image processing. -Two-dimensional image processing parameters 203 are transmitted.
[0021]
The high-speed image processing device 301 inquires and obtains image data from the image diagnostic device 401 and the PACS image database 402 based on the image data selection instruction transmitted from the personal computer 202. If the high-speed image processing apparatus 301 owns the image data, the high-speed image processing apparatus 301 uses the owned image data.
The high-speed image processing apparatus 301 performs three-dimensional image processing and two-dimensional image processing based on the image processing parameters transmitted from the personal computer 202, and transmits image data as a processing result to the personal computer 202.
[0022]
The personal computer 202 displays the result data of the three-dimensional image processing transmitted from the high-speed image processing device 301 in the three-dimensional image display area 103 of the medical image combined observation device. Further, the result data of the two-dimensional image processing transmitted from the high-speed image processing device 301 is displayed in the two-dimensional image display area 102 of the medical image combined observation device.
[0023]
When the user operates the man-machine interface 201 to change the image processing parameters of the three-dimensional image data displayed in the three-dimensional image display area 103, the changed information is transmitted to the high-speed image processing via the personal computer 202. Sent to the device. The high-speed image processing device 301 performs three-dimensional image processing in which the parameters are changed based on the image processing parameters transmitted from the personal computer 202, and transmits the processed image data to the personal computer 202. The personal computer 202 displays the result data of the three-dimensional image processing transmitted from the high-speed image processing device 301 in the three-dimensional image display area 103 of the medical image combined observation device. When the user operates the man-machine interface 201 to change the image processing parameters of the three-dimensional image data displayed in the three-dimensional image display area 103, the changed result is displayed in the three-dimensional image display area 103. The user can interactively change the three-dimensional image processing parameters.
[0024]
When the user operates the man-machine interface 201 to change the image processing parameters of the two-dimensional image data displayed in the two-dimensional image display area 102, the change information is transmitted to the high-speed image processing via the personal computer 202. Sent to the device. The high-speed image processing apparatus 301 performs two-dimensional image processing in which the parameters are changed based on the image processing parameters transmitted from the personal computer 202, and transmits the processed image data to the personal computer 202. The personal computer 202 displays the result data of the two-dimensional image processing transmitted from the high-speed image processing apparatus 301 on the three-dimensional image display area 102 of the medical image combined observation apparatus. When the user operates the man-machine interface 201 to change the image processing parameters of the two-dimensional image data displayed in the two-dimensional image display area 102, the changed result is displayed in the two-dimensional image display area 102. The user can interactively change the image processing parameters of the two-dimensional image data.
[0025]
Since the medical image combined observation apparatus 101 uses eight image display devices with 2048 × 3072 pixels for the two-dimensional image display area 102, it displays 192 X-ray CT images with 512 × 512 pixels at a time. be able to. However, as described above, in the recent X-ray CT inspection, the number of image data acquired in one inspection may be as many as 1,000. Therefore, 1000 images cannot be displayed at once in the 192 two-dimensional image display area.
[0026]
In the present invention, when the user sets a region of interest on the three-dimensional image displayed on the three-dimensional image display region 103 using the man-machine interface 201, the personal computer 202 transmits 192 images before and after including the region of interest. And requests the high-speed image processing device 301 to perform two-dimensional image processing of the image data. The high-speed image processing device performs two-dimensional image processing of the instructed image data, and transmits data resulting from the image processing to the personal computer. The personal computer displays this data in the two-dimensional image display area 102.
[0027]
By moving the region of interest set on the three-dimensional image displayed on the three-dimensional image display region 103, a two-dimensional image centered on the region of interest is always automatically displayed on the two-dimensional image display region 102. It became possible.
[0028]
Until now, even if a 3D image display device and a 2D image display device were installed adjacent to each other, the 3D image displayed on the 3D image display device and the 2D image displayed on the 2D image display device could not be displayed. It was difficult to understand the spatial response.
[0029]
In the present invention, when the user sets a region of interest on the three-dimensional image displayed on the three-dimensional image display area 103 using the man-machine interface 201, the two-dimensional image displayed on the two-dimensional image display area is displayed. A means for selecting a corresponding two-dimensional image from images and displaying a region of interest corresponding to the region of interest on the three-dimensional image on the two-dimensional image; It is possible to display the region of interest at a spatial position on the two-dimensional image corresponding to the region of interest.
As a result, a region corresponding to the region of interest set by the user on the three-dimensional image can be displayed on the two-dimensional image, and the understanding of the image is greatly improved.
[0030]
【Example】
In the above description, the personal computer 202 and the high-speed image processing device 301 in FIG. 1 have been described as being independent, but the personal computer 202 and the high-speed image processing device 301 can be integrated.
[0031]
【The invention's effect】
The present invention enables a plurality of adjacent high-definition image display devices to function as a single ultra-high-definition image display device, and enables a large number of medical images to be displayed thereon. It is possible to construct a three-dimensional image using medical image data collected by the medical image diagnostic apparatus, display the three-dimensional image in the three-dimensional image display area of the ultra-high-definition image display device, and Image processing is performed on a plurality of constituted two-dimensional medical image data, which can be displayed in a two-dimensional image display area of an ultra-high definition image display device.
Selection of medical image data, image processing of the three-dimensional image displayed in the three-dimensional image display area and change of image display parameters, selection of image data to be displayed from two-dimensional image data constituting medical image data, two-dimensional image display area It is possible to operate the image processing and change the image display parameters of the two-dimensional image displayed on a single man-machine interface.
This makes it possible to display three-dimensional images and two-dimensional images at the same time, to associate three-dimensional images with two-dimensional images, and to provide a medical image compound observation device that facilitates image understanding of medical image data. Could be realized.
[0032]
By setting a region of interest on the three-dimensional image displayed in the three-dimensional image display area, a means for selecting a range of the two-dimensional image to be displayed in the two-dimensional image display area from medical image data is provided. Equipped. To realize a medical image combined observation apparatus that can automatically select a two-dimensional image to be displayed in a two-dimensional image display area from medical image data by moving a region of interest on a three-dimensional image. Was completed. This makes it possible to display the two-dimensional image data in a range in which the user is interested in the two-dimensional image display area.
[0033]
By setting a region of interest on the three-dimensional image displayed in the three-dimensional image display area, a corresponding two-dimensional image is selected from the two-dimensional images displayed in the two-dimensional image display area, and the interest in the three-dimensional image is displayed. Means are provided for enabling a region of interest corresponding to the region to be displayed on the two-dimensional image. A medical image that enables a spatial position corresponding to a region of interest on a three-dimensional image to be displayed as a region of interest in a two-dimensional image displayed in a two-dimensional image display region, thereby facilitating image understanding of medical image data. A composite observation device was realized.
[0034]
The medical image compound observation device selects image data, selects three-dimensional image processing and image display parameters, selects two-dimensional image data to display two-dimensional images, two-dimensional image processing and image display based on man-machine interface operations. A means for issuing parameters via a network is provided. A means for installing a high-speed image processing apparatus near a network of a medical image diagnostic apparatus or a medical image storage communication system to acquire medical image data, and a means for constructing a three-dimensional image using the medical image data Means for performing image processing on the two-dimensional image data constituting the medical image data, and means for connecting to the medical image composite observation apparatus via a network. Selection of image data issued by the medical image complex observation device via the network, three-dimensional image processing / image display parameters, selection of image data to display two-dimensional images, and designation based on two-dimensional image processing / image display parameters Image data is acquired, three-dimensional image processing and image display processing, two-dimensional image processing and image display processing are performed on the image data, and the result of the image processing is transmitted to the medical image combined observation apparatus via a network. This image processing apparatus can respond to requests from a plurality of medical image composite observation apparatuses. As a result, a medical image combined observation apparatus system capable of reducing network traffic and effectively utilizing the image processing function was realized.
[0035]
The medical image composite observation apparatus is provided with means for supporting creation of an interpretation report on medical image data and displaying the report in an interpretation report display area of the ultra-high definition image display device. Since the three-dimensional image display of the medical data and the two-dimensional image display could be associated with each other, the understanding of the image of the medical image data was facilitated, and the creation of the interpretation report was facilitated.
[Brief description of the drawings]
FIG. 1 is a schematic diagram showing the configuration of an embodiment according to the present invention.
[Explanation of symbols]
101 medical image combined observation apparatus main body 102 two-dimensional image display area 103 three-dimensional image display area 104 four-dimensional image display area / report creation area 201 man-machine interface 202 personal computer 203 instruction issued by personal computer 301 high-speed image processing apparatus 302 Processing result 401 of high-speed image processing device Image diagnostic device 402 Image database 403 such as PACS Network

Claims (5)

Means for causing a plurality of adjacent high-definition image display devices to function as one ultra-high-definition image display device; means for operating the ultra-high-definition image display device with one man-machine interface; Means for constructing a three-dimensional image using the medical image data collected by the medical image diagnostic apparatus and displaying the three-dimensional image on the three-dimensional image display area of the ultra-high definition image display apparatus; Means for displaying the two-dimensional image in the two-dimensional image display area of the ultra-high-definition image display device, and enabling image processing of three-dimensional images and change of image display parameters and image processing of two-dimensional images and change of image display parameters. To operate medical image data selection, 3D image display-related processing, and 2D image display-related processing using a single man-machine interface. Allows the association of simultaneous display and 3D image and a 2D image of the 3D image and a 2D image, medical image composite observation apparatus which facilitates the image understanding of the medical image data. 2. A range of image data to be displayed in a two-dimensional image display area is automatically selected from medical image data by setting a region of interest on a three-dimensional image displayed in the three-dimensional image display area according to claim 1. A medical image composite observation apparatus, comprising: means for enabling a user to select an image data to be displayed in a two-dimensional image display area by moving a region of interest on a three-dimensional image. In claim 1 and claim 2, by setting a region of interest on the three-dimensional image displayed in the three-dimensional image display area, a corresponding two-dimensional image is displayed from the two-dimensional images displayed in the two-dimensional image display area. Means for selecting and displaying the region of interest at the spatial position corresponding to the two-dimensional image, and setting the region of interest at the spatial position on the two-dimensional image corresponding to the region of interest set on the three-dimensional image. A medical image combined observation device that enables display of images and facilitates understanding of images of medical image data. In claim 1, claim 2, claim 3,
Means for selecting medical image data, selecting three-dimensional image processing and image display parameters, selecting image data to display two-dimensional images, and issuing two-dimensional image processing and image display parameters via a network based on man-machine interface operations Acquires medical image data based on the provided medical image composite observation device and the instructions issued by the medical image composite observation device, and performs three-dimensional image processing and image display processing, two-dimensional image processing and image display processing on this. , A high-speed image processing device equipped with a means for transmitting the result of image processing to a medical image composite observation device via a network, thereby reducing network traffic and effectively utilizing image processing functions. Equipment system. In the first, second, third, and fourth aspects, there is provided means for supporting creation of an interpretation report on medical image data, and displaying the report in an interpretation report display area of an ultra-high definition image display device. And a medical image combined observation apparatus that facilitates image understanding of medical image data and creation of a radiological reporter.

Images