JP4537813B2 - 3D image display device - Google Patents

Description

  The present invention relates to a three-dimensional image display apparatus that displays a list of volume data files as medical images as thumbnails, and calls and displays a desired one of them.

  It is common to create a low-resolution image sample (thumbnail) with a reduced number of vertical and horizontal pixels and display it in a list by thinning out the pixels or bundling nearby pixels so that the image pattern can be seen at a glance. Has been done. This technique is also used in the three-dimensional image display device, and as illustrated in FIG. 10, a two-dimensional projection image is created from the original volume data file at a predetermined viewpoint and direction, and this is displayed in a list. It has been made to display. An image created at a high resolution from the volume data file selected from the thumbnail list is displayed.

In this way, when displaying a list of volume data files handled by the 3D image display device, similarly to the 2D image display, it is created from the volume data file at a predetermined viewpoint with a predetermined gaze direction (projection direction). The two-dimensional projected images are displayed in a list, but at this time, since the stereo information is lost, in the case of medical images that often have unclear outlines, it is not possible to identify images by looking at only the thumbnails. It may be difficult, and it may not be possible to select an image with a similar trend in the contents of the volume data file, or it may happen that the volume data file is called and viewed many times in place of the volume data file. In this case, there has been a problem in the operation of selecting the volume data file, for example, it takes a long time to call the volume data file.
JP 11-318905 A

  An object of the present invention is to improve the image identification ability when displaying a list of a plurality of volume data files as thumbnails.

A three-dimensional image display device according to the present invention includes a storage unit that stores a plurality of volume data files, a thumbnail creation unit that creates a plurality of thumbnail files respectively corresponding from the plurality of volume data files, and the plurality of thumbnail files Each of the plurality of thumbnail files is composed of a plurality of two-dimensional projection images that differ in at least one of the viewpoint and the line-of-sight direction.

A three-dimensional image display device according to the present invention includes a storage unit that stores a plurality of volume data files, a thumbnail creation unit that creates a plurality of thumbnail files respectively corresponding from the plurality of volume data files, and the plurality of thumbnail files A thumbnail display unit that displays a plurality of two-dimensional projection images based on at least one of a viewpoint and a line-of-sight direction according to an operation history when the volume data file was displayed in the past. the characterized by creating a plurality of thumbnail files.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
In order to facilitate understanding of the present embodiment, a thumbnail display screen according to the present embodiment will be described. In order to improve the mutual identification ability when displaying a list of a plurality of volume data files as thumbnails, the thumbnail list display area 12 of the screen is displayed in a thumbnail size of 3 × 3, for example, as shown in FIG. The screen is divided into display frames 15 and thumbnail files corresponding to the volume data files are displayed in the respective thumbnail display frames 15. The thumbnail file is composed of a plurality of (multi-frame) two-dimensional projection images 11 having low resolutions in which at least one of the viewpoint and the line-of-sight direction respectively created from the volume data file is different. By switching and displaying at a predetermined time interval in 15, the volume can be expressed like an animation while moving the viewpoint or direction. The volume data file selected by the selection highlight 13 is read from the storage device when the display button 14 is clicked, and is three-dimensionally displayed at a high resolution. In this way, each volume data file is displayed like an animation while moving the viewpoint and direction with a plurality of two-dimensional projection images, so that the volume data file can be observed from various directions, thereby a single two-dimensional projection image. The ability to identify a volume data file can be improved rather than displaying. Instead of displaying a plurality of two-dimensional projection images in the thumbnail display frame 15, as shown in FIG. 4, the thumbnail display frame 25 is enlarged and the viewpoints and directions created from the respective volume data files are different. A plurality of two-dimensional projection images may be arranged and displayed. In this case, the thumbnail list display area 22 of the screen is divided into thumbnail display frames (frames constituting a multi-frame thumbnail) 23 with a size of, for example, 1 × 3, and thumbnail images corresponding to volume data files are respectively displayed in the thumbnail display frames 23. Group 21 is arranged. The volume data file selected by the selection highlight 24 is read from the storage device when the display button 25 is clicked, and is three-dimensionally displayed at a high resolution. When a single frame (projection image) is selected by the selection highlight 24, projection processing is performed at a high resolution under the same viewpoint and line-of-sight direction as the selected projection image, and the rendered image is initially displayed. The Also in this case, since the volume data file can be observed from various directions, the identification ability of the volume data file can be improved as compared to displaying a single two-dimensional projection image.

  FIG. 1 shows the configuration of the three-dimensional image display apparatus according to the present embodiment. The volume data file storage device 4 is a large-capacity storage device for storing a single or a wide variety of volume data files. The volume data file is acquired from an external device via the communication device 9. The volume data file is generated by the volume data collection device 10. The volume data collection device 10 is an X-ray computed tomography (CT), magnetic resonance imaging (MRI), ultrasonic diagnostic apparatus, SPECT (single photon emission computed tomography), PET (positron emission tomography), X-ray stereoscopic imaging. It consists of one or a plurality of devices that can collect volume data (three-dimensional region data) such as devices. In addition, the 3D image display device is initialized by the CPU 3 for overall control, the main memory 7, and the thumbnail data file (data of a plurality of projection images), when collected, or when acquired via the communication device 9. A data storage device 8 is provided for storing operation history data and snapshot image data when displayed automatically. The three-dimensional image display apparatus also includes a two-dimensional projection rendering processing unit 6 for instantly creating a two-dimensional projection image from the volume data file, the image display device 1, and the two-dimensional projection image on the image display device 1. The graphic board 2 is in charge of the display, and a user input device 5 such as a mouse or a keyboard.

  FIG. 2 shows a series of processing procedures from volume data collection to thumbnail display by the 3D image display apparatus according to the present embodiment. First, a volume data file is generated by the volume data collection device 10 or received via the communication device 9 (S1). The volume data file is stored in the volume data storage device 4 and displayed on the image display device 1 via the two-dimensional projection rendering processing unit 6 and the graphic board 2 for confirmation (S2). Note that the process may be terminated without confirming the display of the volume data file. When the user confirms the volume data file, the user operates the input device 5 to rotate, enlarge, reduce, or move the volume while arbitrarily changing at least one of the viewpoint position and the line-of-sight direction for viewing the volume ( S3). When the viewpoint position and the line-of-sight direction are changed, the corresponding two-dimensional projection image is immediately created in the two-dimensional projection rendering processing unit 6. Operation history data during the observation period is generated by the CPU 3 and stored in the data storage device 8 (S4). The operation history describes the time when the user operates the input device 5 to change at least one of the viewpoint position and the line-of-sight direction (elapsed time from the observation start time), and the viewpoint position and line-of-sight direction at that time. The Instead of the viewpoint position and the line-of-sight direction, other parameters in image processing such as coordinates and rotation angles may be used. In addition to the operation history, the projection image data itself generated by changing at least one of the viewpoint position and the line-of-sight direction may be stored in the data storage device 8 as snapshot data (S5). Whether to store the snapshot data is determined by a user instruction. Further, when a suitable projection image is displayed so that the region of interest looks good during the observation period, the user can press the bookmark button of the input device 5. When the bookmark button is pressed, the bookmark button code is written into the operation history by the CPU 3 along with the time.

  Next, when a plurality of stored volume data files are displayed as a list in accordance with a user instruction, the CPU 3 determines whether or not multi-frame thumbnail data has already been created and stored in the data storage device 8. Check for each file (S6). The multi-frame thumbnail data has a resolution that is low enough to correspond to the matrix size of a partial area of the screen (thumbnail display frame 15), and a plurality of two-dimensional projection images that differ in at least one of the viewpoint and the line-of-sight direction. It is data. If the multi-frame thumbnail data is stored, the multi-frame thumbnail is displayed as it is in the corresponding thumbnail display frame 15 of FIG. 3 or the corresponding thumbnail display frame 25 of FIG. 4 (S7).

  If the multi-frame thumbnail data is not stored, the CPU 3 checks for each volume data file whether the operation history data is stored in the data storage device 8 (S8). When the operation history data is stored for the volume data file, the two-dimensional projection rendering processing obtaining unit 6 performs the processing according to any one of rules (a) to (e) described below under the control of the CPU 3. Multi-frame thumbnail data is created from the operation history of the volume data file (S9). The user can initially set which rule is applied. The user can change from the default rule to another rule at any time.

  FIG. 5 shows the rule (a). For the sake of convenience, the horizontal axis represents the time axis from the start of observation to the end of observation in S3, and the observation time is represented by “T”. The observation time axis is divided into equal intervals by the time interval T / (N-1) obtained by dividing the observation time T by the initial number of frames N (N-1), and set at each time point during observation. Finally, N (N frames) two-dimensional projection images are created according to the viewpoint and line-of-sight direction.

  FIG. 6 shows the rule (b). At the time of observation in S3, the intervals of the viewpoint / line-of-sight direction change operations are compared, and the longest top N interval is selected. N (N frames) two-dimensional projection images are created in accordance with the viewpoint and line-of-sight direction set within the selected interval. That is, a two-dimensional projection image is reproduced from the same viewpoint and line-of-sight direction by observing for a long time without changing the viewpoint and line-of-sight direction.

  FIG. 7 shows the rule (c). The observation time axis is divided at predetermined intervals, the number of times (operation frequency) at which at least one of the viewpoint and the line-of-sight direction is changed is counted at each interval, and the top N intervals with the highest operation frequency are selected. N (N frames) two-dimensional projection images are created according to the viewpoint and line-of-sight direction set at the first time point, intermediate time point, or last time point within the selected interval. In other words, the two-dimensional projection image is reproduced with the viewpoint and the line-of-sight direction according to the period in which the change of the viewpoint and the line-of-sight direction is frequently repeated. This is based on the time when the user repeated trial and error. It sets the line-of-sight direction.

  FIG. 8 shows the rule (d). A two-dimensional projection image is created according to the viewpoint and line-of-sight direction set at the time when the user clicked the bookmark button during the observation in S3.

  FIG. 9 shows the rule (e). Rule (e) is applied when volume data is repeatedly collected for the same object. According to rule (e), the imaging time axis is applied instead of the observation time axis, and the imaging time TT from the start of imaging to the end of imaging is divided by (N−1) of the initially set number N of frames. It is divided into equal intervals by the time interval TT / (N-1), and from the volume data collected at each time point, finally N sheets (in accordance with the initially set viewpoint and line-of-sight direction so as to change little by little in the order of the intervals ( N-frame) two-dimensional projection image is created.

  Returning to FIG. If the operation history is not stored in S8, the CPU 3 checks whether the snapshot data is stored for the volume data file by accessing the data storage device 8 (S10). When snapshot data is stored, thumbnail data having a lower resolution than that is created from the snapshot data by thinning or pixel bundling processing (S11) and displayed in a list (S7). When the snapshot data is not stored, multi-frame thumbnail data is created from the volume data file according to the default rule (S11). As the default rule, for example, an arbitrary rule is set such that the viewpoint rotates around the X, Y, Z or tilt axis by a predetermined angle.

  According to the present embodiment, by displaying a list of a plurality of projection images having different viewpoints and directions with respect to one volume data file as thumbnails, the contents of the volume data file can be easily identified and the number of calling operations can be reduced. Is possible. Further, by displaying a two-dimensional projection image that well represents the characteristics of the volume data file when determining the thumbnail image, it is possible to improve the listability in the thumbnail list display.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

The figure which shows the structure of the three-dimensional image display apparatus by embodiment of this invention. The figure which shows the flow of the image display operation | movement by this embodiment. The figure which shows the example of a display of the multi-frame thumbnail of FIG. The figure which shows the other example of a display of the multi-frame thumbnail of FIG. Explanatory drawing of the production | generation rule (a) of the multi-frame thumbnail of FIG. Explanatory drawing of the production | generation rule (b) of the multi-frame thumbnail of FIG. Explanatory drawing of the creation rule (c) of the multi-frame thumbnail of FIG. Explanatory drawing of the production | generation rule (d) of the multi-frame thumbnail of FIG. Explanatory drawing of the production | generation rule (e) of the multi-frame thumbnail of FIG. FIG. 14 is a schematic diagram illustrating a display example of a thumbnail of a conventional volume data file.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Image display device, 2 ... Graphic board, 3 ... CPU, 4 ... Volume data file storage apparatus, 5 ... User input device, 6 ... Rendering processing part for 2D projection, 7 ... Main memory, 8 ... Data storage apparatus, 9: Communication device, 10 ... Volume data file collection device.

Claims (8)

A storage unit for storing a plurality of volume data files;
A thumbnail creation unit for creating a plurality of corresponding thumbnail files from the plurality of volume data files;
A display unit for displaying a list of the plurality of thumbnail files,
The thumbnail creating unit creates a plurality of two-dimensional projection images as the plurality of thumbnail files based on at least one of a viewpoint and a line-of-sight direction according to an operation history at the time of past display of the volume data file. A three-dimensional image display device. The three-dimensional image display device according to claim 1, wherein the plurality of two-dimensional projection images are displayed as moving images while switching one frame at a time. The three-dimensional image display device according to claim 1, wherein the plurality of two-dimensional projection images are arranged and displayed simultaneously. Wherein the plurality of two-dimensional projection image, a three-dimensional image display apparatus according to claim 1, characterized in that it is created based on the viewpoint and line-of-sight direction of the plurality of time points in the past display time on the axis of the volume data file. The plurality of two-dimensional projection images are created based on a viewpoint and a line-of-sight direction that are set at a predetermined upper number of intervals with a long interval between viewpoint / line-of-sight direction changing operations on the past display time axis of the volume data file. The three-dimensional image display device according to claim 1, wherein: Wherein the plurality of two-dimensional projection image, the past display time viewpoint has been set from a plurality of intervals viewpoint / line of sight direction between the top predetermined number the frequently changing operation interval on an axis and line of sight of the volume data file The three-dimensional image display device according to claim 1 , wherein the three-dimensional image display device is created based on a direction. Wherein the plurality of two-dimensional projection images, according to claim 1, characterized in that it is created based on the viewpoint and line-of-sight direction of the plurality of time points designated by the operator in the past display time on the axis of the volume data file 3D image display device. 3-dimensional image display apparatus according to claim 1, further comprising a display operation history data storage unit that stores data for the last display operation history for each of the volume data file.

Images