JP7555560B2 - Medical image processing apparatus, control method for medical image processing apparatus, and medical image processing program - Google Patents

Description

The present invention relates to a medical image processing device that displays the anatomical structures of a subject as two-dimensional or three-dimensional medical images, a control method for the medical image processing device, and a medical image processing program, and in particular to a medical image processing device that can handle three-dimensional medical images with good operability and contribute to the implementation of highly reliable surgery, a control method for the medical image processing device, and a medical image processing program.

Conventionally, medical images are generated based on tomographic image data obtained by an imaging device such as a CT scanner, and diagnosis and treatment are performed using the medical images. Medical images are used, for example, to check the presence or absence of lesions, for pre-operative simulations, and for navigation during surgery. In addition to two-dimensional images, three-dimensional images (three-dimensional models) that show anatomical structures in three dimensions are also increasingly being used as medical images. Note that the tomographic image data obtained by an imaging device is data of multiple slices, i.e., two-dimensional images, while three-dimensional images are obtained by creating volume data from two-dimensional image data.

For example, Patent Document 1 discloses a medical image display device that can display two-dimensional and three-dimensional images on the same display device.

JP2020-863A

The device in the above document also allows for good confirmation of the presence or absence of lesions and simulations while observing both two-dimensional and three-dimensional images, but in this type of device, which is expected to be used immediately before or during surgery, it is desirable from the perspective of performing highly reliable surgery to be able to handle medical images with greater ease of use.

The object of the present invention is to provide a medical image processing device, a medical image processing method, and a medical image processing program that can handle three-dimensional medical images with ease and contribute to the implementation of highly reliable surgery.

In order to achieve the above object, one aspect of the present invention is as follows:
A medical image processing device including a display control unit that controls display of a three-dimensional image representing an anatomical structure of a subject,
The display control unit is
A process for generating an image including a graphical user interface for defining a display range of the three-dimensional image, the graphical user interface comprising:
a first slider for defining a cutting reference plane on one side of the three-dimensional image along a predetermined reference axis in three-dimensional space;
a second slider for identifying a cutting reference plane on the other side of the three-dimensional image along the predetermined reference axis;
An image generation process comprising:
A process of displaying the three-dimensional image existing between the cutting reference planes;
13. A medical image processing device configured to:

(Definition of terms)
A "two-dimensional image" (two-dimensional image in the context of medical images) refers to a cross-sectional image of a subject, such as an image expressed in shades of gray corresponding to the magnitude of the CT value.
"Three-dimensional image" refers to a three-dimensional model that represents an anatomical structure in three dimensions. As an example, a three-dimensional image is composed of multiple layers that are set for each anatomical structure, and in addition to coordinate information, the image has multiple layer information that indicates these layers, and different hue information for each layer (each anatomical structure). As an example, this information may be information inherited from each voxel of a volume data set when the three-dimensional image is created from the volume data set. In the three-dimensional image, the anatomical structures may be displayed in different colors for each layer.
"Anatomical structure" refers to a recognizable object within a subject (e.g., organs, bones, blood vessels, etc.), including fat and lesions such as tumors. Also, even if an anatomical structure is viewed as a whole, it may be treated as multiple anatomical structures if it is divided into multiple units or has separate roles. For example, the upper lobe, middle lobe, and lower lobe of the lungs can each be treated as separate anatomical structures, and the arterial and venous blood vessels can each be treated as separate anatomical structures.
With regard to the word "select", for example, when it is said that "the operator selects an icon", the means for selecting an icon is not particularly limited, and includes, for example, the operator touching (tapping) the icon via a touch panel, selecting the icon with a cursor using a mouse or the like, selecting the icon using gesture input, etc.
In one embodiment, the "controller" has a CPU, memory, and the like and performs arithmetic processing, and may also be called a "controller," a "processor," a "controller unit," a "controller circuit," a "controller module," a "processor section," a "arithmetic section," a "processor unit," a "processor module," or the like. The "controller" may be composed of a microcomputer, a microcontroller, a programmable logic controller, an application-specific integrated circuit, and other programmable circuits. In this specification, the "controller" may be a single physical configuration, or two or more control units may functionally cooperate to constitute one "controller."
"Semi-transparent" in image display is one of the display forms of anatomical structures in a three-dimensional image, and means that the transparency is set so that other anatomical structures that were hidden can be made visible. It also includes a display in which the anatomical structure that is considered to be semi-transparent is almost impossible to see.

(General Description of Medical Imaging Devices)
As an example, a medical image processing device includes an input device for receiving input from an operator, one or more control units (processor units) that perform predetermined data processing based on the input, and a display device for displaying medical images, and displays two-dimensional and three-dimensional images. Devices that do not include a display device and only perform image generation, etc., are also included in the medical image processing device of the present invention. Display functions possessed by a medical image processing device include at least one of the following:
- Movement, rotation, enlargement, reduction, etc. of medical images, change of cross-sectional position, etc.
- Coloring of specific anatomical structures, display in a transparent state, etc.
- Display of corresponding positions in two-dimensional and three-dimensional images, etc.

The present invention provides a medical image processing device, a medical image processing method, and a medical image processing program that can handle three-dimensional medical images with ease and contribute to the performance of highly reliable surgery.

1 is a block diagram of a medical image processing apparatus according to an embodiment of the present invention. FIG. 2 is a diagram showing an example of an image displayed on the medical image processing apparatus. FIG. 13 is a diagram showing an example of a display image (a state in which a cut surface is displayed together with a three-dimensional image). FIG. 13 illustrates an example of a graphical user interface for a flatcut function. FIG. 13 illustrates an example of a graphical user interface for a flat cut function (with the three-dimensional image partially cut away). FIG. 5 is a diagram for explaining functions of the user interface in FIG. 4 . 11 is a diagram for explaining a 3D pointer displayed with respect to a three-dimensional image. FIG. 11A and 11B are diagrams illustrating a method of operating a 3D pointer. FIG. 13 is a diagram for explaining a virtual probe function. FIG. 13 is a diagram for explaining a margin sphere. FIG. 13 is a diagram showing an example of a user interface for changing the size of the margin sphere. FIG. 13 is a diagram illustrating an example of a user interface for changing the transparency of an object. FIG. 13 is a diagram for explaining a coagulation range simulation function. FIG. 11 is a diagram showing an example of an input method for displaying a pointer. FIG. 15 is a diagram showing a pointer displayed by the input method of FIG. 14. FIG. 13 is a diagram showing an example of an input method for specifying a circular region.

Below, several embodiments of the present invention will be described with reference to the drawings. Note that the specific device configuration and method described below relate to only one embodiment of the present invention, and the present invention is not necessarily limited to this.

As shown in FIG. 1, in this example, the medical image processing system 1 includes an image display control unit 11, a data storage unit 12, a display device 13, and an input device 14. The medical image processing system 1 may further include a data input/output interface 15, a medical information management device 21, a liquid medicine injection device 22, and an imaging device 23. The medical image processing system 1 is configured so that a three-dimensional image and a second image, which is another type of image associated with the three-dimensional image, can be simultaneously displayed on the display device 13. In the following, an example will be described in which the second image is a two-dimensional image.

The display device 13 may be any display capable of displaying the image created by the image display control unit 11, such as a liquid crystal display or an organic EL display. There may be one or more display devices 13.

The input device 14 may be any device, such as a keyboard or a mouse, that can accept input operations by the operator and input data, etc., to the image display control unit 11. A touch panel that combines a display and a touch screen can also be used as the display device 13 and the input device 14. The input device 14 can also be combined with a non-contact input unit that can perform input without contact. Non-contact input units can be divided into those that use gesture recognition technology and those that use voice recognition technology. An example of a non-contact input unit that uses gesture recognition technology is the "Leap Sensor" (manufactured by Leap Motion). The "Leap Sensor" is an input device that can recognize the movement of the operator's fingers, etc., without contact, and has an infrared irradiation unit and an infrared camera, etc. When infrared rays irradiated from the infrared irradiation unit hit the operator's hand, the reflected light is photographed by an infrared camera, and the image is analyzed to detect the position, movement, shape, etc. of the operator's hand and fingers in three-dimensional space in real time. Another example of a non-contact input unit using gesture recognition technology is "RealSense" (manufactured by Intel). "RealSense" is a modularized 3D camera consisting of an RGB camera and an infrared camera, an infrared sensor, etc., and can obtain depth information in addition to color information, and can recognize the movement of the operator's fingers, etc. in three dimensions. In this embodiment, both the Leap sensor and RealSense can be used, and in either case, the operator's movements for input include the same movements as the operator's movements on a touch panel (e.g., tap, double tap, swipe, flick, pinch in, pinch out, etc.), as well as movements in the depth direction. When actually performing an input operation, a transparent flat plate made of acrylic resin or the like is placed at an appropriate position, and the input operation is performed using the flat plate as a reference plane, thereby preventing erroneous recognition due to positional deviation in the depth direction.

A voice recognition unit is an example of a non-contact input unit that uses voice recognition technology. The voice recognition unit may have a microphone that picks up the voice generated by the operator, and a voice recognition device that recognizes the voice picked up by the microphone and converts it into an operation signal. The voice recognition device may be installed anywhere, but it is preferable to install the microphone near the operator.

The data storage unit 12 stores at least one data set capable of creating a three-dimensional image showing the three-dimensional arrangement of a plurality of anatomical structures. The data storage unit 12 may include at least one of a hard disk drive (HDD), a solid state drive (SSD), and various types of memory. In addition to these two-dimensional image data and three-dimensional image data, the data storage unit 12 may store at least one program, table, database, etc. required for the processing performed by the image display control unit 11. The data set stored in the data storage unit 12 can be obtained from the medical information management device 21 through the data input/output interface 15. The data input/output interface 15 may be connected to the medical information management device 21 wirelessly or by wire.

The medical information management device 21 may be a PACS (picture archiving and communication system), a RIS (radiology information system), or a HIS (hospital information system). The medical information management device 21 manages data on medical images of a subject into which a medicinal liquid (e.g., contrast agent) is injected by a medicinal liquid injector 22 and which is captured by an imaging device 23. The medicinal liquid injector 22 may be any injection device that injects a medicinal liquid such as a contrast agent filled in a syringe or a medicinal liquid bag into the subject according to preset injection conditions.

The imaging device 23 may be any device capable of capturing medical images composed of image data, such as a CT (Computed Tomography) device, an MRI (Magnetic Resonance Imaging) device, an angiography device, a PET (Positron Emission Tomography) device, an ultrasound diagnostic device, etc. The data set stored in the data storage unit 12 can also be acquired from the imaging device 23.

Regarding the data set stored in the data storage unit 12, an example of the data set is a volume data set for a plurality of anatomical structures. The volume data set is a data set obtained by arranging a plurality of (e.g., 300) slice image data pieces, which are continuously photographed at regular intervals (e.g., 1 mm intervals) in a specific direction (e.g., body axis direction, left-right direction, front-back direction, a direction inclined to at least one of these directions) of the subject by the imaging device 23, in the body axis direction. The data set stored in the data storage unit 12 may be raw data obtained directly or indirectly from the imaging device 23. In this case, it is preferable that the image display processing unit 11 is configured to reconstruct the raw data stored in the data storage unit 12 and obtain an arbitrary image. The volume data set is composed of a plurality of voxels, and a plurality of anatomical structures are extracted by a predetermined process based on the voxel value of each voxel. Then, the transmittance and hue are set for each extracted anatomical structure for each voxel. Thus, each voxel includes coordinate information, transmittance information, and hue information. In this way, anatomical structures are extracted, and a three-dimensional image is created by performing rendering processing on the volume data set in which the transmittance and hue are set for each anatomical structure. Examples of rendering processing include volume rendering (VR) and maximum intensity projection (MIP). Since each process for creating a three-dimensional image from a volume data set, such as the process for extracting anatomical structures, the setting of the transmittance and hue for each voxel, and the rendering process, may be known processes, detailed explanations of them will be omitted here. In addition, the extraction of anatomical structures in the volume data set and the setting of the transmittance and hue may be performed by this image display control unit 11, or the volume data set in which the anatomical structures are extracted and the transmittance and hue are set may be stored in advance in the data storage unit 12, etc.

The volume data set in which the transmittance and hue are set for each anatomical structure may be divided into multiple layers for each anatomical structure, and each voxel may contain layer information. In this case, the volume data set may be stored in the data storage unit 12 or the like as one data file having multiple layer information for each anatomical structure, or may be stored in the data storage unit 12 or the like as multiple data files each divided according to layer information. The form in which the volume data set is stored may be freely selected by the operator when storing the volume data set.

It is possible to create a two-dimensional image by cutting out the volume data set on an arbitrary plane and reconstructing it. This process is called arbitrary plane reconstruction (MPR). Basically, two-dimensional images used in the medical field include an axial section perpendicular to the subject's body axis, a sagittal section perpendicular to the subject's left-right direction, and a coronal section perpendicular to the subject's anterior-posterior direction. These two-dimensional images can be created using two-dimensional image data at a desired cross-sectional position created from the volume data set. The creation of the two-dimensional image data may be performed by the image display control unit 11 using a volume data set stored in the data storage unit 12 or the like. Alternatively, multiple two-dimensional image data (two-dimensional image data sets) created in advance using the volume data set may be stored in the data storage unit 12 or the like together with the original volume data set. In either case, when the two-dimensional image data is created from the volume data, the coordinate information of each voxel of the volume data is inherited by the two-dimensional image data, and therefore the three-dimensional image and the two-dimensional image based on the common volume data have common coordinate data. In addition, when the two-dimensional image is displayed, an interpolation process of the two-dimensional image data may be performed. For example, when two-dimensional image data sets in multiple slices such as the above-mentioned axial slice, sagittal slice, and coronal slice are stored in the data storage unit 12, etc., the two-dimensional image data set may be stored in the data storage unit 12 as one data file having multiple two-dimensional image data for all slices, or may be stored in the data storage unit 12, etc. as multiple data files each having multiple two-dimensional image data for each slice.

Regarding the configuration in FIG. 1, the medical image processing device indicated by the reference symbol 10 may be configured as a device in which the image display control unit 11, data storage unit 12, display device 13, input device 14, and data input/output interface 15 are housed in a single housing. The medical image processing device 10 may be a portable terminal such as a tablet terminal or a notebook personal computer having a touch panel display. However, the present invention is not limited to this, and the medical image processing terminal 10 may be configured as a workstation in which the display device 13 and input device 14 are configured as separate units from the image display control unit 11.

The image display control unit 11 may be configured as a computer unit equipped with a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory), and executes various processes to control the display of images on the display device 13 according to input received by the input device 14. The processes performed by the image display control unit 11 may be realized by a computer program, or may be realized by hardware using logic circuits. When the processes performed by the image display control unit 11 are realized by a computer program, the computer program may be stored in the data storage unit 12, etc., as described above. The computer program stored in the data storage unit 12 is executed by being loaded into the RAM of the image display control unit 11, and various processes are executed by cooperating with hardware such as the CPU.

The computer program may be stored in a computer-readable recording medium. The recording medium storing the computer program may be a non-transient recording medium. There is no particular limitation on the non-transient recording medium, and it may be, for example, a memory card, a CD-ROM, or other recording medium. The computer program stored in the recording medium may be stored in the computer unit via an appropriate reader. Examples of the appropriate reader include a card reader when the recording medium is a memory card, and a CD drive when the recording medium is a CD-ROM. Alternatively, the computer program may be downloaded from an external server to the computer unit via a communication network.

The image display control unit 11 (see FIG. 1) may have a conceptual configuration including an input determination unit, a display processing unit, and a user interface unit to execute various processes for controlling the display of images.

The input determination unit determines what processing should be performed on the image displayed on the display device 13 based on the input received by the input device 14, the type of input device 14 that received the input, changes in the input signal, etc. The display processing unit mainly processes the display area of the display device 13 and processes the image display within the display area.

To briefly explain these processes, taking as an example a case where a volume data set is stored in the data storage unit 12 or the like, in regard to the processing of the display area, the display processing unit generates specific medical images as shown in FIG. 2 or the like and displays them on the display device. The user interface unit plays a role in generating and/or displaying images of various user interfaces, including image buttons (icons) for input operations by the operator.

In processing the image display within the display area, as described in detail below, a three-dimensional image created from a volume data set stored in the data storage unit 12 or the like is displayed, and at the same time, a two-dimensional image corresponding to a position identified in the three-dimensional image is created from a volume data set stored in the data storage unit 12 or the like and displayed.

[Examples of displayed images]
A display screen according to one embodiment of the present invention may be as shown in Fig. 2. In this example, the display image 100 includes two areas, a three-dimensional image display area 101A and a two-dimensional image display area 101B (hereinafter, these areas will not be distinguished from each other and will be simply expressed as "image display areas (101A, 101B)"). Note that, although an example in which various icons and the like are operated through a touch panel will be described below, the present invention is of course not limited to this. Also, for convenience of explanation, there are cases in which reference numerals are omitted in the explanation.

The image display areas 101A, 101B may be displayed side by side in the horizontal direction, or may be separated by a dividing line 102 as shown in FIG. 2. As an example, the dividing line 102 is provided so as to be movable in the left-right direction, and the size of each of the image display areas 101A, 101B can be changed by moving the dividing line 102 left-right. To allow the operator to intuitively understand that the dividing line 102 is movable, an operation target portion 102a may be provided on part of the dividing line 102. By touching a finger near the operation target portion 102a and moving it left-right, the dividing line 102 moves left-right.

In the example of Figure 2, a model including a liver object 305 and a blood vessel object 303 is displayed in the image display area 101A as a three-dimensional image 300.

In the image display area 101A, various icons 111 to 116 are displayed for operating the display of the three-dimensional image 300. The icon 111 is a menu icon for calling up various functions, and the icon 112 is for changing the display of the three-dimensional image to a predetermined posture that has been set in advance. The icon 113 is for taking a screenshot of the displayed image and saving it, and the icon 114 is for displaying the saved image. The icon 115 is a flat cut icon for changing and adjusting the display range of the three-dimensional image (described in detail later). The icon 116 is for changing the display resolution of the three-dimensional image, and in this example, it is possible to switch between 512 x 512 x 512 pixels and 1024 x 1024 x 1024 pixels. The same icons may be displayed in the image display area 101B, and in this embodiment, icons with the same functions are denoted by the same symbols (see FIG. 2). Note that the icons 115 and 116 are not displayed in the image display area 101B because their functions are intended only for three-dimensional images.

[Various functions of medical image processing device]
The medical image processing device 10 has various functions related to the display of medical images, etc. Some of these functions will be described below. Note that in the following description, image processing is realized, as an example, by the functions of the image display control unit 11 shown in FIG.

(a) Image rotation, enlargement/reduction, display change, etc. In the medical image processing device 10, the three-dimensional image 300 can be rotated in any direction, enlarged/reduction, etc., and the display can be changed by a predetermined input operation by the operator. For example, an input operation on a touch panel may be used for these display changes. Specifically, examples of display changes include rotating the three-dimensional image 300 according to the swipe direction by a swipe operation, and shrinking/enlarging the three-dimensional image 300 by a pinch-in/pinch-out operation. Similarly, the two-dimensional image 200 can be changed in display, such as changing the cross-sectional position, enlarging/reducing, etc., like the three-dimensional image 300. Note that the function for operating the two-dimensional image and the function for operating the three-dimensional image may be common.

(b) Displaying the cross-sectional position of the two-dimensional image on the three-dimensional image The two-dimensional image 200 and the three-dimensional image 300 have corresponding coordinate information in the body axis direction, the left-right direction, and the front-back direction of the subject. Therefore, by using these coordinate information, it is also possible to display on the three-dimensional image 300 the cross-sectional position corresponding to the current display of the two-dimensional image 200. The position of the two-dimensional image 200 in the body axis direction can be changed, and the input method for this is not particularly limited, but for example, by moving a scroll indicator (not shown) displayed in the display area 100B, a tomographic image at a body axis direction position corresponding to the position is displayed.

A more specific display mode in this embodiment may be as follows. That is, as shown in FIG. 3, a cut surface 310 corresponding to the position of the current tomographic image in the two-dimensional image 200 may be displayed together with the three-dimensional image 300. By displaying such a cut surface 310, it becomes possible to visually and easily grasp which position in the three-dimensional image the current tomographic image corresponds to. Specifically, a configuration may be made in which a predetermined position p (x, y, z) in the two-dimensional image 200 and a corresponding predetermined position P (x, y, z) in the three-dimensional image 300 are displayed. Note that, with regard to the display of such positions p and P, auxiliary lines (not shown) or the like for easily indicating the positions may be displayed as necessary.

(c) Other Functions Related to Image Display With regard to functions that can be called up from the menu button icon 111 (see FIG. 2), when the menu button icon 111 is selected, a group of function call icons (not shown) is displayed, and the operator may select a desired icon from among them to select the corresponding function. Examples of such functions may include the following:

The medical image processing device 10 may have a revert function. The orientation and size of the three-dimensional image 300 can be changed at will, and the cross-sectional position and size of the two-dimensional image can be changed at will. The revert function is a function for initializing the display of the three-dimensional image and/or the two-dimensional image. Initializing the display means displaying an initial image in the image display areas 101A and 101B.

The medical image processing device 10 may have a clipping function. The clipping function is, as an example here, a function for cutting out and displaying an arbitrary part of a three-dimensional image. Although detailed illustration is omitted, as a specific example, a configuration may be used in which clipping processing is executed when an icon displayed as "BBox" is selected. Specifically, in the clipping function, selection is performed in a state in which a part of the three-dimensional image is surrounded by a hexahedron. The hexahedron is displayed semi-transparently so that the operator can visually recognize the anatomical structure located inside it. In this state, clipping is performed as follows. That is, when one face of the hexahedron to be clipped is selected, the selected face becomes active, and when the active face is slid, the shape of the hexahedron is changed and the target range in the three-dimensional image is changed. When an anatomical structure exists on the clipped face, the anatomical structure may be displayed in a cross section on the clipped face. Note that when another face is tapped, the tapped other face becomes active, and the three-dimensional image can be further clipped with the other face as described above.

The medical image processing device 10 may have a perspective display function. Perspective display is one of the methods of expressing a three-dimensional image with a perspective projection to create a sense of depth. When the operator slides, for example, a button for adjusting the angle of view (not shown) in a predetermined direction, the width of the angle of view of the three-dimensional image is adjusted according to the amount of sliding or the position of the slider. For example, when the angle of view is widened, parts that are closer are displayed larger and parts that are farther away are displayed smaller. By displaying the three-dimensional image with perspective projection, an image close to the image seen by an endoscope can be displayed. Therefore, the perspective display function can be effectively used in endoscopic surgery, for example, in which the image acquired from the imaging device is compared with an image of the actual organ obtained by the endoscope while proceeding with the procedure.

Next, we will further explain some examples and functions of graphical user interfaces that make the medical image processing device 10 easier to use.

(Flat cut function)
The medical image processing apparatus 10 may have a flat cut function. The "flat cut function" is a function for cutting a three-dimensional image by one or more reference planes and displaying the image. This function will be described with reference to Figs. 4 to 6.

The operation for activating the flat cut function is not particularly limited, but for example, this function may be activated by selecting a flat cut icon 115 displayed on the screen as shown in FIG. 4. This icon 115 may be displayed within the image display area 101A.

When icon 115 is selected, a graphical user interface 140 is displayed. This graphical user interface 140 includes a first slider 145a and a second slider 145b that can be slid independently. Each slider moves along a guide line 145c. The sliders 145a and 145b may move in any direction, but in this example, they move in the vertical direction shown in the figure. When each slider 145a and 145b is located at the end of its movable range (specifically, as an example, when the sliders are furthest apart from each other), the three-dimensional image is displayed in its entirety without being cut out.

On the other hand, as shown in FIG. 5, by changing the positions of the sliders 145a and 145b, the three-dimensional image is displayed in a partially cut state. Specifically, when the first slider 145a is slid slightly downward from the end of the movable range, a cutting reference plane (not shown) on one side along a predetermined reference axis (here, the "x-axis" in one example) of the three-dimensional image is set corresponding to that position. The three-dimensional image is displayed in a state cut by that cutting reference plane. In this example, the liver object 305 is cut by the end surface 305a. Similarly, when the second slider 145b is slid slightly from the end of the movable range, a cutting reference plane (not shown) on the opposite side is set corresponding to that position. Specifically, the liver object 305 is cut by this cutting reference plane and the end surface 305b is displayed. In this embodiment, that is, only the 3D medical image within the area corresponding to the distance L1 between sliders 145a and 145b (the area corresponding to distance L2 in FIG. 5) is displayed, and the area outside of that is not displayed.

With such a graphical user interface 140, it is possible to move the sliders 145a and 145b to narrow the display area of the three-dimensional image or to display its end surface as necessary, which has the advantage that the anatomical structure of the three-dimensional image can be confirmed in more detail.

In one embodiment, it is preferable that the three-dimensional image in the state shown in FIG. 5 can be moved, rotated, and enlarged/reduced so that the three-dimensional image can be observed from multiple angles and checked by enlarging/reducing it. With such a configuration, for example, the three-dimensional image can be rotated and displayed so that the end face 305a, which faces the back side in FIG. 5, becomes the front side. It is also possible to enlarge and display the end face 305a.

As the graphical user interface 140, for example, it is preferable in one form that the two sliders 145a and 145b can be moved simultaneously while maintaining the distance L1 between the sliders 145a and 145b. In order to be able to move the two sliders 145a and 145b simultaneously, a method of selecting a special icon to set such a mode and then moving the sliders is also assumed. However, as an example, when the sliders 145a and 145b are in a predetermined position as shown in FIG. 6(a), an interface may be provided in which the two sliders 145a and 145b can be moved together while maintaining the distance L1 by touching any position (for example, near the guide line 145c) in the area between the sliders 145a and 145b as shown in FIG. 6(b) and moving it up and down. The display area of the three-dimensional image is also changed in real time in conjunction with the movement of the slides 145a and 145b. With this configuration, it is possible to change the display area of the three-dimensional image while maintaining the distance L1 that was once determined by moving the individual sliders 145a and 145b, so the display range can be fine-tuned with a very simple operation.

(3D pointer function)
The medical image processing apparatus 10 may have a 3D pointer function. The "3D pointer function" refers to a function for displaying a three-dimensional pointer on a specific object in a three-dimensional image, and in particular, refers to a function for moving the pointer so as to follow the surface of the object. This function will be described with reference to Figs. 7 and 8.

In the display screen shown in FIG. 7, a two-dimensional image 200 and a corresponding three-dimensional image 300 are displayed, as in FIG. 2. For convenience of explanation, only a blood vessel object 303' is displayed in the three-dimensional image 300. When the operator designates an arbitrary point p in the two-dimensional image 200 in a state in which a mode for displaying a 3D pointer is selected, a 3D pointer 161 is displayed at a corresponding point P in the three-dimensional image 300. There are no particular limitations on the shape or size of the 3D pointer 161, and it may be any shape as long as it can clearly indicate a predetermined position in a three-dimensional image displayed stereoscopically. Other methods for displaying the pointer 161 will be described later with reference to other drawings.

The 3D pointer 161 displayed in the three-dimensional image 300 is currently linked to one of the objects (here, the blood vessel object 303') and is displayed so as to be in contact with the object 303'. With such a 3D pointer 161, the following problem may arise when the pointer is moved. That is, when the 3D pointer 161 is moved in a three-dimensional space, the pointer can usually be moved in any direction, so it is expected that when the operator moves the pointer, the pointer may move away from the target object. Therefore, in this embodiment, the 3D pointer 161 is configured to move along the surface of the target object 303' without moving away from the object 303'.

Various methods may be adopted for moving the 3D pointer 161, and may be, for example, the following. In the following, an example will be described in which an operator operates the pointer with a finger via a touch panel, but of course, the input format may be other than that. As shown in FIG. 8, when the operator touches the first region 161a of the 3D pointer 161 and moves the finger, the 3D pointer 161 rotates around the rotation center 161p and changes its orientation. The first region 161a may be a region including a part of the base end side of the pointer 161. On the other hand, when the operator touches the second region 161b of the 3D pointer 161 and moves the finger, the entire pointer 161 can be moved in any direction (while maintaining the orientation of the pointer). The second region 161b may be a region including a part of the tip side of the pointer. By such operations, the orientation and position of the 3D pointer 161 can be freely changed.

The 3D pointer 161 is displayed in three-dimensional space (image display area 101A). Therefore, it is preferable that the pointer can be moved with ease not only in the up, down, left, and right directions, but also in the depth direction (one example). As an example, and not a particular limitation, the 3D pointer 161 may be moved by the simultaneous movement (e.g., upward or downward, or right or left) of multiple fingers (three or four fingers). As another viewpoint, the 3D pointer 161 itself may be displayed as multiple images with parallax, allowing it to be viewed stereoscopically on the display screen.

(Virtual probe function)
The medical image processing apparatus 10 may have a virtual probe function. The "virtual probe function" refers to placing a virtual probe in a three-dimensional image and displaying a virtual image captured by the virtual probe on the screen. This function will be described with reference to FIG. 9.

In FIG. 9, a specific three-dimensional image (liver object 305 in one example) is displayed in image display area 101A. A virtual probe 171 is displayed in contact with or close to this object 305. This probe 171 is one example that represents an ultrasound probe of an ultrasound diagnostic device. The shape of probe 171 may be any of linear, convex, sector, and single types, and may be either a probe for two-dimensional images or a probe for three-dimensional images.

An image that would be captured by an imaging device including a probe 171 is displayed in the display area 101B. Here, an ultrasound diagnostic image 220 is displayed in the display area 101B. This configuration in which a virtual ultrasound diagnostic image 220 targeting a specific three-dimensional image is displayed has the advantage that it is possible to confirm the shape and arrangement of anatomical structures within a target object without actually imaging the subject.

It is also desirable that the virtual probe 171 in FIG. 9 is easy to operate. For example, when the first region 171a on the handle side of the probe 171 is touched and moved, the probe 171 may be configured to change its orientation (tilt) based on a predetermined rotation center. Also, when the second region 171b on the tip side of the probe 171 is touched and moved, the entire probe 171 may be moved.

The movement of the virtual probe 171 may be performed in a manner similar to the 3D pointer 161 described above, such that the probe 171 moves along the surface of the three-dimensional image of the target.

(Margin sphere adjustment user interface)
The medical image processing device 10 may have a user interface for adjusting a margin sphere. The "margin sphere" refers to a sphere or polyhedron surrounding a specific object (for example, a tumor object) in a three-dimensional image, and this margin sphere is used, for example, to confirm how much margin of a tumor area is to be removed when the tumor is resected. The "margin sphere adjustment user interface" is a user interface for easily changing the size of the margin sphere, etc. This function will be described with reference to Figs. 10 and 11.

First, the margin sphere will be described. When a predetermined input is received from the operator, the medical image processing device 10 of this embodiment displays the smallest circumscribing sphere 377 surrounding the tumor 365 in the three-dimensional image, as shown in FIG. 10(a). The "predetermined input" is not particularly limited, but may be the selection of an icon displayed on the screen, voice input, or gesture input at a position away from the screen. Then, as shown in FIG. 10(b), a margin sphere 378 that is one size larger than the circumscribing sphere 377 and has a predetermined margin (for example, 1 mm, 2 mm, 3 mm, 4 mm, 5 mm, 10 mm, 15 mm, etc.) added thereto is displayed. As an example, this margin sphere 378 is a sphere concentric with the circumscribing sphere 377. The margin sphere 378 may be displayed in a transparent color so that its inside can be seen. It is also possible to display only the margin sphere 378 and not display the circumscribing sphere 377.

The appropriate margin value varies depending on the tumor removal procedure and the target organ, so it is preferable that the operator be able to set the desired value. For example, the value may be input and changed by inputting a numerical value and/or by operating an on-screen user interface. A specific example of the user interface will be described later with reference to FIG. 11.

As shown in FIG. 10(b), if the margin sphere 378 is in contact with, for example, a nearby major blood vessel 353b, the medical image processing device 10 may be configured to display a warning to that effect and/or highlight the blood vessel portion. The blood vessel 353b may be highlighted at the portion where the margin sphere 378 is in contact (which may include the vicinity thereof), or the entire blood vessel 353b from its origin to its tip. This configuration is advantageous because it allows confirmation in advance of which blood vessels will need to be resected when removing the tumor 365 (the portion of the blood vessel 353 indicated by the reference symbol 353a does not need to be resected).

Also, as in the example of FIG. 10(b), when the margin sphere 378 is in contact with some anatomical structure, the mask of the anatomical structure (which may be, but is not limited to, a solid organ such as the liver) contained within the margin sphere 378 may be automatically separated, and the volume contained within may be calculated and the amount of volume may be displayed as necessary. Regarding the amount of volume, instead of a single margin sphere, the sum of the volumes contained within multiple margin spheres may be calculated.

A user interface 150 as shown in FIG. 11 may be employed to change the size of the margin sphere 378. This user interface 150 includes a slider 156 for setting the margin length. In this example, the slider 156 can be slid within a range of approximately 0 mm to 20 mm (as an example), and is configured to be able to move along the horizontal axis. Note that the numbers on the horizontal axis indicate the margin length, but such a display is not essential.

When the slider 156 is at the "0" position, the margin length is 0, and in the above example, only the circumscribed sphere 377 is displayed. By moving the slider 156, a numerical value according to the slider position is set as the margin length. The size of the margin sphere 378 in the three-dimensional image may be changed in real time. Such a graphical user interface 150 allows the size of the margin sphere 378 to be changed very intuitively and instantly, and also allows the relationship between the tumor 365 and the margin sphere 378 to be confirmed in the three-dimensional image, which contributes to the implementation of highly accurate surgery.

The user interface 150 may display information indicating the length of the margin as a large number in the display area 151. Specifically, in the illustrated example, the number "10" may be displayed in the display area 151. With this configuration, it is possible to provide the operator with information on the specific set numerical value with good visibility.

The user interface 150 may also include multiple size indicators 159 in the form of concentric arcs that connect the values on the vertical axis and the horizontal axis. Also, to make it easier to visually grasp the current setting value, among the multiple size indicators 159, only the indicator 159 that indicates the current margin length and corresponds to the position of the slider 156 may be highlighted. For example, in this example, the indicators 159 that exist in the range from "0" to "10" are displayed thicker than the others.

The user interface 150 may be one in which a specific numerical value is input by selecting a preset value, rather than inputting a numerical value via a slider 156. In the example of FIG. 11, a preset value display section 157 displays "0" mm, "10" mm, and "20" mm (one example) as preset values on the vertical axis. When any of these is selected, the corresponding margin length may be set. It should be noted that the above numerical values and preset numbers are, of course, merely examples and can be changed as appropriate.

As an embodiment of the user interface 150, the slider 156 may move continuously along the horizontal axis, or may move in steps corresponding to discrete values such as "1", "2", "3", "4", and "5" mm. The user interface 150 in FIG. 11 can be displayed at any position on the display screen, but as an example, it may be displayed within the display area 101A.

(User interface for changing transparency)
The medical image processing apparatus 10 may have a user interface for changing the transparency of an object. The "transparency of an object" refers to the transparency of each object of an anatomical structure included in a three-dimensional image, and the transparency of the object can be adjusted, so that, for example, an object displayed in the foreground as viewed from the operator can be displayed semi-transparently while another object in the background can be observed. The user interface will be described with reference to FIG. 12.

As shown in FIG. 12, the user interface 170 includes a slider 177 that slides along a circular orbit 173, and the operator moves the slider 177 to change the transparency of the object. The transparency may range from 0% to 100%, but is not limited to this and may be any numerical range. The start point 173a of the circular orbit 173 may correspond to 0%, and the end point 173b may correspond to 100%. The circular orbit 173 may not be a closed circle, but may extend over a range in which the central angle of the sector is 180° or more and less than 360°, more specifically, 270° or more and less than 360° (as an example). However, a completely closed circular orbit may be used in which the slider 177 can be rotated 360° or more. In order to make it easy to identify the current transparency, a highlight 174 may be displayed from the start point 173a to the position of the slider 177.

According to the user interface 160 as shown in FIG. 12, the transparency can be changed with high precision even in a compact space on the screen for the following reasons. That is, as a user interface for changing the transparency, for example, a configuration (not shown) in which a slider is moved back and forth linearly can be adopted. However, in touch panel operation, the operator needs to move his/her hand up and down or left and right (one example) to move the slider linearly, which requires a relatively large motion. On the other hand, in the case of the configuration as shown in FIG. 12, for example, the slider 177 can be moved a sufficient distance by simply touching and rotating the slider 177 with the index finger without moving the hand much. In other words, there is no need to move the hand much, and more detailed input can be made by moving the finger compared to linear movement, so there is also a technical advantage that fine adjustment of the transparency can be easily performed.

The user interface 170 in FIG. 12 can be displayed at any position on the display screen, but as an example, it may be displayed within the display area 101A.

(Coagulation range simulation function for cauterization or cryotherapy)
The medical image processing device 10 may have a function of simulating the coagulation range in a target part of a subject. The "coagulation range simulation function" is, for example, a function of simulating the extent to which coagulation will occur when a target part of a subject is cauterized and resected by a cauterization method using an electrode needle (this function can be applied not only to cauterization but also to a freezing method). An example of cauterization will be described with reference to FIG. 13.

One percutaneous local therapy for necrotizing a tumor and its surrounding area involves applying energy to the target area of the subject from an electrode needle or probe, thereby cauterizing the cellular tissue and causing coagulation necrosis. The extent to which an area is cauterized by the application of energy from an electrode needle or the like depends on the shape of the electrode needle, the performance of the device, etc.

Figure 13 is a schematic diagram showing the difference in the coagulation range due to different electrode needles. Figure 13(a) shows probe 190a, which is a virtual representation of a certain electrode needle, and shows that when this probe is inserted into the target area of a subject and used, area 195a undergoes coagulation necrosis. Figure 13(b) shows probe 190b, which is a different electrode needle, and shows that area 195b undergoes coagulation necrosis when used. Figure 13(c) shows probe 190c, which is yet another electrode needle, and shows that area 195c undergoes coagulation necrosis.

The coagulation range can also be viewed as a function of time. Therefore, the probe cauterization time can be simulated, or the display can be such that the area sphere is gradually enlarged in response to time. This method can also be applied to freezing, not just cauterization. In this embodiment, the medical image processing device 10 thus has information on the coagulation characteristics of each probe, and can be configured to, for example, virtually puncture a specific anatomical structure in a three-dimensional medical image with a probe and simulate the coagulation range when energy is applied.

As an example of a probe puncture, the device may be provided with a simulation function for the route when the probe is inserted (i.e., which route the probe should insert, or which route it should not insert). For example, if a specific anatomical structure to be avoided, such as a blood vessel, is present on the route along which the probe is inserted, the device may determine this and issue an alert (display a message, issue a warning sound, etc.) and/or automatically avoid the route. Although not limited to this, the alert may be a highlighting of a specific object (e.g., a display on a screen) by coloring or blinking.

Since it is assumed that a given target site may be coagulated and necrotized using multiple probes (or by multiple probe punctures), it is preferable to be able to perform a simulation of a range corresponding to multiple cases. Also, for example, if a tumor is present in multiple locations or is widespread, the treatment may be performed in several separate sessions (on different days). Also, additional treatment may be required at a later date. In this way, it is assumed that the cauterization method and freezing method may require multiple treatments on different days rather than a single treatment, so it is preferable to be able to save the simulation results of the coagulation range and/or output them to an external device (time information, subject information, surgery information, device user information, etc. may be included). Such data may be called up as necessary to continue the simulation (for example, to perform a simulation of an additional probe).

In addition, medical images include those generated based on image data from a CT device and those generated based on image data from an MR device. Even for the same subject, data from different modalities may be used depending on the purpose of the treatment and the contents of the examination (for example, an image based on data from a CT device is used first, and an image based on data from an MR device is used as necessary). In such a case, it is also preferable in one embodiment that medical images based on data from a first modality (for example, a CT device) and medical images based on data from a second modality (for example, an MR device) can be replaced and/or superimposed (overlayed) so that simulation can be performed consistently. Images may be replaced not only during one simulation operation, but also after the fact (for example, images may be replaced at a later date). Images of different modalities may be aligned automatically or manually. The above-mentioned image data replacement is useful in that it enables various simulations, but it does not necessarily replace images of different modalities. For example, even if the medical images are based on image data from the same imaging device (e.g., a CT device), it may be possible to replace relatively low-resolution data (such as data captured with a thick slice thickness for confirmation before the actual imaging) with high-resolution data.

(Capture function for device usage status)
The medical image processing apparatus 10 may have a function of capturing and storing the usage status of the apparatus. This function is mainly for storing information on the fact that the medical image processing apparatus 10 was actually used during the treatment of the subject and/or the details of the treatment. In this way, with a configuration in which information on the usage status of the apparatus is stored, the information can be used to determine medical fees, etc.

Information regarding the usage status may be stored inside the medical image processing device 10 (such as the data storage unit 12), or may be transmitted externally and stored, for example, in the medical information management device 21 (see Figure 1).

The information relating to the usage status may be, for example, at least one or a combination of the subject's identification information, date and time information (time) when the surgery was performed, surgery duration information, device usage time information, a screenshot image of the displayed 3D image, a screenshot image of the displayed 2D image, doctor or other medical staff information, contrast agent injector information, contrast agent information, contrast protocol information, etc. The time and time-related information may be captured in a manner embedded in the screenshot image. Although not limited to this, the screenshot image may be able to be selected arbitrarily from 2D images only, 3D images only, or a combination thereof.

The timing of acquiring information on the usage status may be at a predetermined time interval or at a predetermined time, but may also be the following timing. That is, when the medical image processing device 10 is being used (for example, when observing a three-dimensional image during surgery, etc.), if there is no input from the operator for a certain period of time or more, the device may be configured to automatically acquire and store or transmit to the outside predetermined information on the usage status. In this case, time stamp information associated with the information acquisition timing may be added. Specifically, the hash value of the target electronic information (image data as an example) and the accurate time information issued by the time stamp authority may be added with the electronic signature of the time stamp authority. By adding such a time stamp, it is possible to confirm that the electronic information existed at that time (proof of existence), and also to make it possible to prove non-tampering after the fact.

(Timer function)
The medical image processing device 10 may have a timer function for measuring the operation time. For example, in a liver cancer operation, a method called the Pringle method is sometimes used, in which forceps or the like are used to temporarily block the blood flowing into the liver in order to suppress bleeding. In this case, it is important to accurately measure and manage the time during which the blood flow is blocked (or the time during which it is not blocked). Therefore, the medical image processing device 10 may be configured, for example, to display the time during which the blood flow is blocked using a timer, and to sound an alarm and/or display an alert when a predetermined specified time has elapsed. Similarly, the time during which the blood flow is not blocked may be displayed using a timer, and to sound an alarm and/or display an alert. In this way, a configuration in which the time during relaxation and/or blocking can be confirmed by a timer allows for safer treatment. Although not limited to this, the timer function during relaxation may be configured to display a first display color (e.g., green) and/or emit a first sound so that a safe state can be recognized, and on the other hand, during blocking, a display in a second display color (e.g., red) and/or emit a second sound (to inform of the blocking state) may be displayed. The timer function during blockage may further include an extension function, for example, a configuration in which a preset value such as 1 minute, 2 minutes, or 3 minutes can be selected, or an arbitrary extension time can be inputted numerically. The medical image processing device 10 may be configured so that operations are prohibited or rejected during the time when blood circulation is blocked. If operations are prohibited while the timer during blood circulation is functioning, unintentional changes or resetting of the timer is prevented, and accurate time measurement is performed.

(Various input methods)
In a device such as a tablet terminal where input is mainly performed via a touch panel, it is desirable to provide an easy-to-operate and intuitive input. The medical image processing device 10 of this embodiment may have a function for displaying a pointer (cursor, arrow) at a predetermined position of a three-dimensional image, for example. In this case, an input method such as that shown in FIG. 14 may be used to display the cursor.

First, as shown in FIG. 14, two points (P1, P2) on the screen are selected. For example, the selection may be made by touching the two points with the thumb and index finger. The medical image processing device 10 accepts the input of the two points (P1, P2) by the operator and specifies the coordinates of each point. Next, in one example, the operator slides the index finger from point P2 to point P2' while keeping the thumb at the position where it was initially touched. The medical image processing device 10 may be configured to display a pointer 161 (see FIG. 15) using the input as a trigger when (i) two points P1 and P2 are selected, and then (ii) there is an input to move one point while keeping one point fixed in a direction that increases the distance between the two points. In the pointer 161, the fixed point P1 is the tip side of the arrow, and the opposite point P2' is the rear end side of the arrow. For example, when such an input is made in image display area 101A and/or image display area 101B, an arrow 161 may be displayed, and this input method makes it possible to easily display the pointer by making the above input directly on the display screen, without the need to previously select a mode for displaying the arrow (such as by touching a dedicated icon, for example).

In the medical image processing device 10, it is also preferable that, for example, a part of a three-dimensional image can be selected as a circular region. In this case, an input method such as that shown in FIG. 16 may be available for specifying the circular region.

First, as shown in FIG. 16(a), two points (P11, P12) on the screen are selected. For example, the selection may be made by touching the two points with the thumb and index finger. The medical image processing device 10 accepts the input of the two points P11, P12 by the operator and identifies the coordinates of each point. Next, the operator simultaneously slides the thumb and index finger in an arc around the point o like a compass. When such an input is detected, the medical image processing device 10 may be configured to display a circle 198 with the point o as the center and the distance between P11 and P12 as the diameter, as shown in FIG. 16(b). According to this input method, a circular area can be selected in only two steps: selecting the two points and rotating them.

Although the embodiment of the present invention has been described above with reference to specific drawings, the present invention is not limited to the above specific configuration, and can be modified as appropriate without departing from the spirit of the invention. In addition, different technical features can be combined as appropriate. For example, the content disclosed as an invention of a product can be understood as an invention of a method, a program, or a program medium.

(Additional Note)
This application discloses the following: The reference symbols in parentheses are provided for reference purposes only and are not intended to limit the present invention to the specific embodiments.
A medical image processing device (10) including a display control unit (11) for controlling the display of a three-dimensional image (300) representing an anatomical structure of a subject,
The display control unit (11)
a1: a process for generating an image including a graphical user interface (140) for defining a display range of the three-dimensional image (300), the graphical user interface (140) comprising:
a first slider (145a) for defining a cutting reference plane (e.g., 305a) on one side of the three-dimensional image along a given reference axis (e.g., x-axis) in three-dimensional space;
a second slider (145b) for defining a cutting reference plane (e.g. 300b) on the other side of the three-dimensional image along the predetermined reference axis (e.g. x-axis);
An image generation process comprising:
a2: a process of displaying the three-dimensional image (300) existing between the cutting reference planes;
13. A medical image processing device configured to:

1. A method for controlling a medical image processing device that displays a three-dimensional image representing an anatomical structure of a subject, comprising:
a1: generating an image including a graphical user interface for defining a display range of the three-dimensional image, the graphical user interface comprising:
a first slider for defining a cutting reference plane on one side of the three-dimensional image along a predetermined reference axis in three-dimensional space;
a second slider for identifying a cutting reference plane on the other side of the three-dimensional image along the predetermined reference axis;
a generating step,
a2: displaying the three-dimensional image existing between the cutting reference planes;
A method for controlling a medical image processing device, comprising:

1. A medical image processing program for displaying a three-dimensional image representative of an anatomical structure of a subject, comprising:
a1: A step of generating an image including a graphical user interface for defining a display range of the three-dimensional image, the graphical user interface comprising:
a first slider for defining a cutting reference plane on one side of the three-dimensional image along a predetermined reference axis in three-dimensional space;
a second slider for identifying a cutting reference plane on the other side of the three-dimensional image along the predetermined reference axis;
a generating step,
a2: displaying the three-dimensional image existing between the cutting reference planes;
A medical image processing program that performs the following:

B1. A medical image processing device (10) including a display control unit (11) for controlling the display of a three-dimensional image (300) representing an anatomical structure of a subject,
The display control unit (11)
b1: A process of generating an image including a two-dimensional image (200) which is a tomographic image obtained by imaging a subject, and the three-dimensional image (300);
b2: A process of detecting a predetermined position (p) in the two-dimensional image designated by an operator;
b3: a process of displaying a 3D pointer at a position (P) in the three-dimensional image corresponding to the predetermined position (p), the 3D pointer being displayed in association with a predetermined object in the three-dimensional image;
b4: when an input for moving the 3D pointer is received from an operator, a process for moving the 3D pointer along the predetermined object;
13. A medical image processing device configured to:

C1. A medical image processing device (10) including a display control unit (11) for controlling the display of a three-dimensional image (300) representing an anatomical structure of a subject,
The display control unit (11)
c1: identifying a selected object (e.g., a tumor) in the three-dimensional image;
c2: displaying a three-dimensional margin sphere (378) surrounding the selected object; and
c3: displaying a graphical user interface (150) for setting the size of the margin sphere (378), the graphical user interface including a slider (156) whose position corresponds to the size of the margin sphere (378) and a size indicator (159) indicating the size of the margin body determined based on the position of the slider;
13. A medical image processing device configured to:

D1. A medical image processing device (10) including a control unit (11) for controlling display of a medical image (200, 300) representing an anatomical structure of a subject,
The control unit (11)
d1: A process of determining whether or not there has been no input from an operator for a certain period of time in a state in which the medical image is displayed, in which the apparatus is assumed to be used during surgery;
d2: if there is no input for a certain period of time, a process of capturing the screen of the medical image displayed at that time and acquiring the image data;
d3: A process of storing the image data in a predetermined data storage unit or transmitting the image data to an outside of the device;
13. A medical image processing device configured to:

1 Medical image processing system 10 Medical image processing device 11 Image display control unit 12 Data storage unit 13 Display device 14 Input device 15 Data input/output interface 21 Medical information management device 22 Liquid injection device 23 Imaging device 100 Display screen 101A, 101B Image display area 102 Division lines 111 to 116 Icon 140 Graphical user interface 145a, 145b Slider 150 Graphical user interface 156 Slider 157 Preset value display unit 159 Size indicator 161 3D pointer 170 Graphical user interface 171 Virtual probe 173 Circular orbit 174 Highlighting 177 Slider 190a to 190c Probe 195a to 195c Expected necrosis area 198 Circle (circular area)
200 Two-dimensional image 220 Ultrasound diagnostic image 300 Three-dimensional image 303, 303', 305 Object 305a, 305b End surface 310 Cutting surface 365 Tumor 377 Circumscribed sphere 378 Margin sphere p, P Position

Claims (8)

A medical image processing device including a display control unit that controls display of a three-dimensional image representing an anatomical structure of a subject,
The display control unit is
a1: A process for generating an image including a graphical user interface for defining a display range of the three-dimensional image, the graphical user interface comprising:
a first slider for defining a cutting reference plane on one side of the three-dimensional image along a predetermined reference axis in three-dimensional space;
a second slider for identifying a cutting reference plane on the other side of the three-dimensional image along the predetermined reference axis;
An image generation process comprising:
a2: a process of displaying the three-dimensional image existing between the cutting reference planes;
and further configured to:
the first and second sliders are independently movable; and
a medical image processing apparatus configured to, when a predetermined input is performed, move the first and second sliders simultaneously while maintaining the distance between the sliders. A medical image processing device including a display control unit that controls display of a three-dimensional image representing an anatomical structure of a subject on a touch panel display,
The display control unit is
a1: A process for generating an image including a graphical user interface for defining a display range of the three-dimensional image, the graphical user interface comprising:
a first slider for defining a cutting reference plane on one side of the three-dimensional image along a predetermined reference axis in three-dimensional space;
a second slider for identifying a cutting reference plane on the other side of the three-dimensional image along the predetermined reference axis;
An image generation process comprising:
a2: a process of displaying the three-dimensional image existing between the cutting reference planes;
The device is configured to:
A medical image processing device configured to be able to move the first and second sliders simultaneously while maintaining the distance between them when any position in the area between the first and second sliders is touched and moved in a predetermined direction while the first and second sliders are in a predetermined position. The medical image processing apparatus according to claim 1 , wherein the predetermined input is to select a part of an area between the first slider and the second slider and move the part in a predetermined direction. The medical image processing device according to any one of claims 1 to 3, wherein the graphical user interface is displayed in a display area for displaying a three-dimensional image. A cross-section of the three-dimensional image is displayed on the cutting reference plane on one side, and/or
Another cross section of the three-dimensional image is displayed on the other side of the cutting reference plane.
The medical image processing device according to any one of claims 1 to 4. With the display range specified,
The three-dimensional image is displayed in at least one of a rotatable, movable, and scalable manner.
The medical image processing device according to any one of claims 1 to 5. 1. A method for controlling a medical image processing device that displays a three-dimensional image representing an anatomical structure of a subject, comprising:
a1: generating an image including a graphical user interface for defining a display range of the three-dimensional image, the graphical user interface comprising:
a first slider for defining a cutting reference plane on one side of the three-dimensional image along a predetermined reference axis in three-dimensional space;
a second slider for identifying a cutting reference plane on the other side of the three-dimensional image along the predetermined reference axis;
a generating step,
a2: displaying the three-dimensional image existing between the cutting reference planes;
and
the first and second sliders are independently movable; and
A method for controlling a medical image processing device, comprising: when a predetermined input is performed, moving the first and second sliders simultaneously while maintaining the distance between the sliders. 1. A medical image processing program for displaying a three-dimensional image representative of an anatomical structure of a subject, comprising:
a1: A step of generating an image including a graphical user interface for defining a display range of the three-dimensional image, the graphical user interface comprising:
a first slider for defining a cutting reference plane on one side of the three-dimensional image along a predetermined reference axis in three-dimensional space;
a second slider for identifying a cutting reference plane on the other side of the three-dimensional image along the predetermined reference axis;
a generating step,
a2: displaying the three-dimensional image existing between the cutting reference planes;
and then
the first and second sliders are independently movable; and
a medical image processing program that, when a predetermined input is performed, makes it possible to simultaneously move the first and second sliders while maintaining the distance between the sliders ;