JP3261999B2 - Biological tissue multi-dimensional visualization device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a biological tissue multidimensional visual apparatus utilizing an ultrasonic tomographic image detecting function such as an ultrasonic diagnostic apparatus.

[0002]

2. Description of the Related Art An ultrasonic diagnostic apparatus displays a tomographic image of a living tissue in a plane in a linear scanning direction of the probe by applying an ultrasonic probe of a linear scanning type to the surface of the living tissue. . For example, when observing or visualizing a certain tissue of the human body, a probe of an ultrasonic diagnostic apparatus is applied to a body surface close to the tissue to emit pulsed ultrasonic waves, and the intensity of reflected ultrasonic waves is plotted on a time axis. To be displayed. One tomographic image is obtained by linearly scanning the above-described ultrasonic waves from the probe. In order to make a diagnosis of the whole tissue, a large number of tomographic images are obtained while moving the probe in a direction perpendicular to the linear scanning direction, and judgment is made visually from the large number of tomographic images.

In the conventional ultrasonic diagnostic technique as described above, a doctor examines a large number of tomographic images and makes a judgment, thereby diagnosing a pathology or a lesion and finding an abnormal site.
For this reason, diagnosis requires a high degree of specialized experience and skill, and a specially trained physician must read a tomographic image. That is, the conventional ultrasonic diagnostic apparatus is intended for a specialized doctor to decode an image and make a diagnosis.

Further, conventional ultrasonic diagnostic apparatuses are mainly for observing internal organs, and there are almost all apparatuses capable of observing bones, tendons, muscle tissues and the like simply and without specialized decoding techniques. Did not. According to the X-ray imaging apparatus, it is possible to observe the bones and the like of the limbs, but there is a disadvantage that a special qualification is required to handle X-rays and that there is a risk of irradiation.

[0005]

SUMMARY OF THE INVENTION The applicant of the present invention performs ultrasonic diagnosis on a plurality of parallel sections of a living tissue as a multidimensional visualization apparatus for a living tissue that can easily observe the living tissue without any special experience. By reading out the stored tomographic image data for each tomographic image, the average value of the pixel data along the ultrasonic wave traveling direction existing in a predetermined region among the data is calculated. After obtaining the two-dimensional image data of the cross section, a two-dimensional image based on the obtained two-dimensional image data and a tomographic image of a desired cross section based on the stored tomographic image pixel data are displayed on the same screen. Has already been proposed (Japanese Unexamined Patent Publication No.
241296).

According to the proposed biological tissue multidimensional visual apparatus, a two-dimensional image of a living tissue is displayed next to a tomographic image of a desired section, so that the relation of the tomographic image to the living tissue is intuitive. It is possible to easily analyze living tissues without special experience.

However, there are various tissues in a living body, and unnecessary tissues other than the tissue to be observed are also two.
Since the image is displayed on a two-dimensional image, it has been difficult to decode the image and find an abnormal part.

Accordingly, an object of the present invention is to provide a multi-dimensional living tissue visualization apparatus which further improves the one already proposed by the present applicant, and which can observe living tissues more easily.

[0009]

According to the present invention, for each of a plurality of cross sections of a living tissue parallel to each other, an ultrasonic tomography comprising a plurality of pixel data arranged in an ultrasonic traveling direction and an ultrasonic scanning direction. Ultrasonic tomographic image detecting means for forming image data, storing means for temporarily storing tomographic image pixel data for each section formed using the ultrasonic tomographic image detecting means, and a tomographic image stored in the storing means Detecting a layer surface position in each section of the biological tissue from the image pixel data and forming layer surface coordinate data, respectively, and correcting the layer surface coordinate data in each section formed by the layer surface position detecting means. Means for arbitrarily setting a region of interest for each section, and for each section, a region existing in the region of interest in the tomographic image pixel data stored in the storage unit. Average value calculation means for calculating an average value of pixel data along the traveling direction of the ultrasonic wave, and a two-dimensional image corresponding to the positions of the plurality of cross sections of the living tissue and the position in the ultrasonic scanning direction for the calculated average value. Find Data 2
A biological tissue multidimensional visualization device is provided that includes a two-dimensional image data calculation unit and a display unit that displays a two-dimensional image based on the obtained two-dimensional image data on a screen. In this case, it is preferable that the region of interest is set to be different from each other in at least the plurality of cross sections. According to the present invention, further, for each of a plurality of cross sections parallel to each other of the living tissue, an ultrasonic wave that forms ultrasonic tomographic image data composed of a plurality of pixel data arranged in an ultrasonic traveling direction and an ultrasonic scanning direction. Tomographic image detecting means, storing means for temporarily storing tomographic image pixel data for each cross section formed using the ultrasonic tomographic image detecting means, and a tomographic image of the living tissue from the tomographic image pixel data stored in the storing means. A layer surface position detecting means for detecting a layer surface position in one section and forming layer surface coordinate data, respectively, and an interest in this section by correcting the layer surface coordinate data in one section formed by the layer surface position detecting means. Means for arbitrarily setting a region, and, for each section, a supersonic wave existing in the above-mentioned region of interest in the tomographic image pixel data stored in the storage means. Mean value calculation means for calculating an average value of pixel data along the traveling direction, and for the calculated average value, two-dimensional image data corresponding to a plurality of cross-sectional positions of the biological tissue and a position in the ultrasonic scanning direction are obtained. Provided is a biological tissue multidimensional visualization device that includes a two-dimensional image data calculation unit and a display unit that displays a two-dimensional image based on the obtained two-dimensional image data on a screen.

[0010] Ultrasonic diagnosis is performed on a plurality of sections of the living tissue that are parallel to each other to store tomographic image data for each tomographic section. Alternatively, by detecting the layer surface position in one cross section, forming layer surface coordinate data, and correcting the layer surface coordinate data in each cross section or one cross section, the region of interest of each cross section or one cross section can be arbitrarily set. The average value of the pixel data along the traveling direction of the ultrasonic wave existing in the set region of interest among the stored tomographic image pixel data is calculated and calculated for each section. With respect to the average value, two-dimensional image data corresponding to the positions of a plurality of cross sections of the living tissue and the position in the ultrasonic scanning direction is obtained and displayed on the screen.
As described above, since the region of interest of each section or one section is arbitrarily set by correcting the layer surface coordinate data representing the layer surface position, unnecessary tissues other than the tissue to be observed are removed from the region of interest. , And only the desired portion can be integrated and emphasized and displayed on the two-dimensional image.
As a result, the analysis of the living tissue can be performed very easily.

[0011]

According to the present invention, the biological tissue multidimensional visualization apparatus converts tomographic image pixel data stored in the storage means into
The apparatus further comprises a three-dimensional image data calculating means for obtaining three-dimensional image data by overwriting while shifting the position of the tomographic image by a predetermined amount for each of the designated cross sections, and the display means described above comprises: 3D image based on data
Display means for displaying on the same screen as the three-dimensional image;
The two-dimensional image data calculation means overwrites only the pixel data existing in the region of interest arbitrarily designated for each section, and writes the pixel data to be overwritten of each pixel into the pixel. It is preferable that the overwriting is performed only when the luminance is higher than the data.

[0013] It is preferable that the display means displays the luminance of the tomographic image pixel data in the desired area partially emphasized. Thereby, the stereoscopic effect of the three-dimensional image is further emphasized. In that case, the display means may display the tomographic image pixel data in the desired area with the luminance being maximized at the center in the ultrasonic scanning direction and gradually decreasing as the distance from the center in the ultrasonic scanning direction increases. Absent.

Preferably, the display means is a display means for displaying a tomographic image of a desired cross section on the same screen based on the tomographic image pixel data stored in the storage means.

The display means displays a tomographic image of a desired section and the position of the desired section (by a line, a mark, or the like).
It is preferable that the three-dimensional image and the three-dimensional image are displayed on the same screen. By displaying the position of the desired cross section by the line, the mark, or the like, the relationship between the tomographic image and the living tissue can be more intuitively grasped.

[0016]

[0017] It is preferable that the apparatus further comprises a deletion unit for deleting the tomographic image pixel data other than the region of interest stored in the storage unit.

[0018]

[0019]

It is preferable that the frequency of the ultrasonic wave output from the ultrasonic tomographic image detecting means into the living tissue can be arbitrarily set by the operator. By switching the ultrasonic frequency when creating the two-dimensional image and the three-dimensional image, the living body can be easily identified for each tissue.

[0021]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 is a block diagram schematically showing a configuration of an embodiment of a multi-dimensional living tissue visualizing apparatus according to the present invention.

In FIG. 1, reference numeral 10 denotes an ultrasonic diagnostic apparatus;
1 is a probe of the ultrasonic diagnostic apparatus 10. The ultrasonic diagnostic apparatus 10 has the configuration of a commercially available general ultrasonic diagnostic apparatus, and includes an oscillator 10a for generating a high-frequency pulse voltage and an amplifying the high-frequency pulse as shown in FIG. A transmitting amplifier 10b for sending out, a receiving amplifier 10c for receiving and amplifying a reflected pulse (echo signal) sent from the probe 11, a display unit 10d such as a liquid crystal display or a CRT for displaying an output of the receiving amplifier 10c, and a receiving amplifier. An A / D converter 10e that converts the output of 10c into digital data, and a controller 10f that performs other control such as synchronization of the transmitted high-frequency pulse with the display unit 10d and the A / D converter 10e and selection control of the oscillation frequency. Have.

The oscillation frequency of the oscillator 10a corresponds to the frequency of the ultrasonic pulse (probe frequency), and its value is transmitted from the digital computer 14 described later to the control board 13
Switching control is possible via the. This is to make it easier to identify a living body by tissue by switching the ultrasonic frequency when creating a two-dimensional image and a three-dimensional image. This switching can be instructed by the operator while looking at the screen according to the type and position of the inspection target 12a. If the frequency is set high (for example, 7.5 MHz or more), the tissue near the body surface can be visualized with high resolution.
If the frequency is set low (for example, below 5.0 MHz),
It becomes possible to visualize a wide range of tissues from the body surface to deep parts. The frequency is also selected according to whether the test object 12a is a bone, a soft tissue such as a muscle or a blood vessel, or an internal organ. In the present embodiment, 3.5
MHz, 5.0 MHz, and 7.5 MHz. In this embodiment, since the probe 11 uses a broadband type probe, one probe 11 can cover almost all frequencies. The probe 11 may be replaced depending on the frequency.

The probe 11 is a linear scanning ultrasonic probe in which a large number of piezoelectric vibrators are arranged one-dimensionally. The probe 11 is held in contact with the skin surface of the human body 12 to be examined via a water bag (not shown) or a jelly-like oil applied to the body surface. The high-frequency pulse sent from the diagnostic apparatus body to the probe 11 is sequentially switched and applied to the one-dimensionally arranged piezoelectric vibrators, whereby ultrasonic pulses are emitted from each piezoelectric vibrator to the living tissue of the human body 12. You.
The ultrasonic echo reflected by the inspection object 12a or the like in the human body 12 is applied to each piezoelectric vibrator, converted into an electric pulse, becomes an echo signal, and sent to the diagnostic apparatus main body.

A / D converter 1 of ultrasonic diagnostic apparatus 10
The output of 0e is connected via a control board 13 to an input interface (not shown) of a digital computer 14 such as a personal computer. The computer 14 includes a CPU (Central Processing Unit) (not shown), a ROM (Read Only Memory) storing a program to be described later, a RAM (Random Access Memory), a bus connecting these, and other general control circuits. And an input device such as a keyboard 14a and a mouse 14b as shown, a CRT 14c, an external memory 14d, and the like.

The control board 13 functions as a circulating buffer between the ultrasonic diagnostic apparatus 10 and the digital computer 14, and as shown in FIG.
An image memory 13a is provided for temporarily storing tomographic image data sent from 0. This image memory 13a
Can be configured by a general RAM, and has a capacity to store tomographic image data for 150 images in the present embodiment. If data exceeds this capacity,
Overwriting is performed sequentially from the start address.
This means that the latest image data for 0 images is always stored.

Input / output controllers 13b and 13c are connected before and after the image memory 13a, respectively. A thermo body surface observation device 15 and a moiré fringe distribution observation device 16 for measuring body surface temperature distribution data shown in FIG. 1 are connected to the input / output control device 13c. It is configured to take in.

Next, the operation of the present embodiment will be described with reference to the flowchart of the digital computer 14. FIG.
9 is a flowchart for explaining an ultrasonic tomographic image data capturing operation control program.

First, in step S1, a probe frequency control signal is output to the ultrasonic diagnostic apparatus 10, and the ultrasonic frequency is set. In this case, the operator arbitrarily sets the optimum frequency in that case while viewing the display on the screen. With this setting, the controller 10f of the ultrasonic diagnostic apparatus 10
The oscillation frequency of the oscillator 10a is controlled. Next, when the operator instructs to take in the ultrasonic tomographic image data using the keyboard 14a or the mouse 14b, an activation signal is output to the ultrasonic diagnostic apparatus 10 in step S2.
In the next step S3, the capturing operation is delayed for a predetermined time. This is to absorb a time delay from the capturing instruction to the start of the movement of the probe 11.

Steps S4 and S5 while the operator or an automatic feeder (not shown) moves the probe 11 on the layer surface of the human body 12 at a constant speed along a predetermined axis.
Is performed. In step S4, the same ultrasonic diagnosis as in the related art is performed, and ultrasonic tomographic image data for one screen (one frame), that is, for one cross section, is captured and stored in the image memory 13a of the control board 13. Is done. In step S5, it is determined whether or not an image of a section (frame) designated in advance has been captured. This determination may be made by determining whether the number of cross-sections actually taken in has reached the specified number, or by determining whether a predetermined time has elapsed since the start-up. The latter can simplify the processing content. If the capturing of all the designated cross sections has not been completed, the process returns to step S4, and if completed, the process proceeds to step S6.

In step S6, a stop signal is output to the ultrasonic diagnostic apparatus 10. At this point, the image memory 13a
Inside, ultrasonic tomographic image data relating to a specified number of sections are stored. That is, as shown in FIG.
3a, n different cross sections D _{1 to} D of the human body 12 are provided.
The tomographic image data for _n is accumulated for each tomographic image.

FIG. 5 is a flowchart for explaining the image display operation control program.

When the operator gives an instruction to display an image using the keyboard 14a or the mouse 14b, an image display processing operation is started in step S11. Then step S
At 12, the ultrasonic tomographic image data stored in the image memory 13a of the control board 13 is loaded into the RAM of the computer 14 for one image (one frame = 1 cross section).

In the next step S13, a process of cutting a low-level echo portion from the acquired ultrasonic tomographic image data is performed. This processing is performed to remove noise generated between the probe 11 and the skin surface, and the contents will be described below with reference to FIGS.

FIG. 6 is a flowchart for explaining the processing in step S13, and FIG. 7 is a view showing the correspondence between an image of one section and its ultrasonic tomographic image data. As shown in FIG. 7, the ultrasonic tomographic image data for one cross section is composed of a large number of arrays arranged in a matrix of an ultrasonic linear scanning direction (X axis, row direction) and an ultrasonic traveling direction (Y axis, column direction). Of pixel data P _XY .

In step S131 of FIG. 6, the pointer is set to the start address of the ultrasonic tomographic image data in the RAM of the computer 14, and the pixel data _P00 is read. Each pixel data P _XY is 0 to 2 according to the echo level.
And represented by a gray level value of 55, the pixel data P ₀₀ read in the next step S132, it is determined whether or less gray scale value 50. Only when the pixel data has a gradation value of 50 or less, the pixel data P ₀₀ in the next step S133.
Is set to 0 and stored in the RAM of the computer 14 again. Next in step S134 Y-axis direction is incremented to the next address location corresponding to the pixel data P ₁₀ rows of (ultrasonic traveling direction, see FIG. 7). Next step S1
At 35, all pixel data P ₀₁ , P ₀₂ ,
It is determined whether or not the above processing has been completed for P ₀₃ ,..., P _0m , and if not, the process returns to step S131 to perform the same processing for these pixel data. X-axis direction in the next step S136 when the completion is incremented to the next address position corresponding to the pixel data P ₀₁ of the first row of the column of (ultrasonic linear scanning direction, see FIG. 7). In the next step S137, it is determined whether or not the processing has been completed up to the pixel data P _n0 , P _n1 ,..., P _{nm of the} last column in the X-axis direction. Is repeated. If the processing has been completed, the process proceeds to step S14 in FIG.

In step S14, coordinate values on the skin surface are detected. In this process, the ultrasonic tomographic image data is sequentially checked in the traveling direction of the ultrasonic wave, and a position where the gradation difference between adjacent pixel data is not 0 is detected as a skin surface. This is shown in FIG.

In step S141 of FIG. 8, the R of the computer 14 after the processing of step S13 is performed.
The pointer is set to the head address where the ultrasonic tomographic image data in the AM is stored, and the pixel data _P00 is read out. In the next step S142, it is determined whether or not the difference between the gradation value and the previous pixel data is 0. Difference of gradation value is 0
Only when no longer exists, it is determined that this position is the skin surface, and the coordinate value of the pixel data is stored in the RAM of the computer 14 in the next step S143. If the difference between the tone value is 0, the process proceeds to step S144, incrementing the address in the Y-axis direction position corresponding to the pixel data P ₀₁ of the next row of (ultrasonic traveling direction, see FIG. 7) Let it.
In the next step S145, it is determined whether or not the above processing has been completed for all the pixel data P ₀₁ , P ₀₂ , P ₀₃ ,..., P _0m in the Y-axis direction, and if not completed, the flow returns to step S141. A similar process is performed on these pixel data. If the process has ended and if the difference between the gradation values is not 0 and the process of step S143 is executed, the next step S143 is executed.
X-axis direction in 146 to increment the next address to the position corresponding to the pixel data P ₀₁ of the first row of the column of (ultrasonic linear scanning direction, see FIG. 7). Next step S14
7, the pixel data P _{n0 of} the last column in the X-axis direction,
It is determined whether the processing has been completed up to P _n1 ,..., P _nm , and if not completed, the flow returns to step S131 to repeat the same processing. When the processing has been completed, the process proceeds to step S15 in FIG.

With the above processing, the RAM stores the coordinate data of the skin surface 20 (see FIG. 7) in the ultrasonic tomographic image data. That is, probe 1
Only the water bag filled with water or the jelly-like oil is present between 1 and the layer surface of the human body, and the ultrasonic beam emitted from the probe 11 is first reflected due to the difference in acoustic impedance due to the skin surface. Therefore, the position of the skin surface can be determined by determining whether or not the difference between the gradation values is 0.

In step S15 of FIG. 5, it is determined whether or not the processing of steps S12 to S14 has been completed for all designated cross sections. If not, the process returns to step S12 to repeat the same processing. If the processing has been completed, the process proceeds to step S16.

In step S16, a skin surface correction curve is created for an arbitrary section, and a region of interest is set for each section. Details of step S16 are shown in FIGS. FIG. 9 shows the case where the skin surface position is actually corrected for all the cross sections. FIG. 12 shows the case where the skin surface position is corrected only for the specified cross section and the same correction amount as the previous cross section is used for the other cross sections. This is the case where the correction processing operation is simplified.

In the example of FIG. 9, first, in step S161, the coordinate data of the detected skin surface in one of all the cross sections is read, and the detected skin surface position 30 is displayed on the CRT 14c. Next, in step S162, by operating the mouse 14b, the skin surface position 30 in the frame is moved up and down to correct. As shown in FIG. 10, the mouse operation is to move the selected base point 31a in the vertical direction (Y-axis direction) by dragging the selected base point 31a among a plurality of base points displayed at equal intervals along the skin surface position. It is. Thus, the base point 31a and the left and right base points 31b and 31c are connected by a spline curve or the like. Each base point is arbitrarily movable in the left-right direction (X-axis direction).

In the next step S163, the correction amount in the Y-axis direction corrected by the mouse operation is calculated for all the columns in the X-axis direction, and these correction amounts are added to the Y coordinate of the skin surface position to obtain the cross-section. Create a skin surface correction curve. The created coordinate data of the skin surface correction curve is stored in the RAM of the computer 14.

FIG. 11 is an ultrasonic tomographic image showing the skin surface correction curve created in this way and the region of interest defined by the curve. In the figure, reference numeral 40 denotes a skin surface position, and 41 denotes a skin surface correction curve. The boundary on the skin surface side of the region of interest 42 is defined by the skin surface correction curve 41, and the boundary on the opposite side is a curve 43.
Defined by That is, the region between the skin surface correction curve 41 and the curve 43 is the region of interest 42.

In the prior art (the above-mentioned technique by the applicant of the present invention), the boundary of the region of interest on the skin surface side is a curve 4 (parallel) along the skin surface as shown by a broken line in FIG.
The region of interest was a strip or strip along the skin surface, being 1 'or straight. In addition, the shape was constant in all cross sections. For this reason, in the related art, there is a disadvantage that a tissue unnecessary for display is also included in the region of interest.

However, in the present embodiment, as shown in the figure, the skin surface correction curve 41 is a curve that can be arbitrarily changed, and the tissue 45 other than the bone 44 to be displayed can be removed from the region of interest 42. In a two-dimensional image and / or a three-dimensional image described later, the portion of the bone 44 is displayed sharpened. Moreover, since the skin surface correction curve 41 can be set for each section, the effect is further enhanced. In the present embodiment, the curve 43 defining the boundary on the opposite side of the region of interest 42 is along the skin surface (parallel) in the present embodiment because the ultrasonic tomographic image is unclear at this part and the influence of the shape is considered to be small. Although it is a shape, it is obvious that this shape may be arbitrarily changed similarly to the skin surface correction curve 41.

In the next step S165, it is determined whether or not all the processes in steps S161 to S163 have been completed for all the cross sections. If the processing has not been completed, the process returns to step S161 to repeat the same processing. When the processing has been completed, the process proceeds to step S17 in FIG.

In the example of FIG. 12, first, at step S161 '
In, the coordinate data of the detected skin surface in one of a plurality of designated cross-sections (for example, a cross-section at a predetermined number or a cross-section at a plurality of predetermined positions) is read out, and the detected skin surface position is detected. 30 to CRT14
Display on c. Next, in step S162 ', by operating the mouse 14b, the skin surface position 30 in that frame is moved up and down to correct. As shown in FIG. 10, this mouse operation is performed among a plurality of base points displayed at equal intervals along the skin surface position.
The selected base point 31a is dragged and moved in the vertical direction (Y-axis direction). Thereby, the base point 31a
And the left and right base points 31b and 31c are connected by a spline curve or the like. Each base point is arbitrarily movable in the left-right direction (X-axis direction).

In the next step S163 ', the correction amount in the Y-axis direction corrected by the mouse operation is calculated for all the columns in the X-axis direction.

In the next step S164 ', the correction amount calculated in step S163' is added to the Y coordinate of the skin surface position for all sections up to the section immediately before the next designated section, including the current section. Thus, a skin surface correction curve in each section is created. The created coordinate data of the skin surface correction curve is stored in the RAM of the computer 14.

In the next step S165 ', the above steps S161' to S16 are performed for all the designated cross sections.
It is determined whether or not all the processes of 4 'have been completed. If the processing has not been completed, the process returns to step S161 'and the same processing is repeated. If completed, step S17 in FIG.
Proceed to.

As described above, in the example of FIG. 12, the skin surface position is corrected only for the designated cross section, and the other cross sections are corrected using the same correction amount as the previous cross section. The operation of the operator is greatly simplified.

In step S17 of FIG. 1, two-dimensional image data of a desired tissue such as a bone is obtained from the ultrasonic tomographic image data, and a two-dimensional luminance image is displayed on the CRT 14c based on the obtained data. FIG. 13 shows the details of step S17.

In step S171 of FIG. 13, the ultrasonic tomographic image data, the skin surface coordinate data, and the skin surface correction curve coordinate data in one section designated by the pointer in the RAM of the computer 14 are read. Next, in step S172, a region of interest (42 in FIG. 11) in the cross section is specified from the coordinate data of the skin surface and the coordinate data of the skin surface correction curve, and pixel data other than the region of interest is deleted from the ultrasonic tomographic image data. .

In the next step S173, the average value of the ultrasonic tomographic image pixel data in the ultrasonic traveling direction, that is, the depth direction (Y-axis direction, column direction) in the region of interest 42 (see FIG. 11) is calculated. This average value is calculated for each pixel data string. The average value can be calculated by dividing the sum of all pixel data in each column in the region of interest by the number of pixels in that column in the region of interest. In step S173, the average value of all the columns in the designated section is calculated.

Next, in step S174, the calculated average value along the X-axis of the designated cross section is converted into luminance information (for example, 256 gradations) and displayed on the CRT 14c as a luminance image of one line. You. This corresponds to, for example, a line image along the broken line 51a in FIG.

In the next step S175, the pointer is moved to ultrasonic tomographic image data, skin surface coordinate data, and skin surface correction curve coordinate data in the next section. In step S176, it is determined whether or not the processes in steps S171 to S175 described above have been completed for all the cross sections for the designated image. If the processing has not been completed, the process returns to step S171 to specify the region of interest of the next section, and repeat the same processing. If the processing has been completed for all the sections, the process proceeds to step S18 in FIG.

By the above processing, the CRT 1 of the computer
As shown in FIG. 14, a two-dimensional luminance image 51 (in this case, a bone of a human finger) in which only a desired portion is sharpened is displayed on 4c as an X-ray image.

In step S18 of FIG. 5, as shown in FIG. 14, the tomographic image 52 of the designated section is obtained by using the ultrasonic tomographic image data stored in the RAM of the computer 14 to obtain a two-dimensional luminance. It is displayed in the same screen 50 as the image 51. In the next step S19, a line 51a representing the position of the designated cross section is displayed in a different color on the two-dimensional image 51, so that the correspondence between the two-dimensional luminance image and the tomographic image can be understood at a glance. As the indication of the position of this cross section, besides providing a line 51a of a different color, for example, (1) the line 51a is a special line such as a broken line, a chain line, or a blinking line. A mark (non-flashing, flashing or different color) may be attached to the side of the position.

For example, a keyboard 14a or a mouse 14b
By moving the line 51a on the screen 50 by using, for example, a desired section can be designated, and ultrasonic tomographic image data of the designated section can be displayed on the screen 50.

According to the above-described configuration of this embodiment, the shape of the region of interest can be arbitrarily changed, and therefore, tissues other than the tissue to be displayed can be removed from the region of interest. In the above, the part of the tissue to be displayed is sharpened and displayed. In addition, since the shape of the region of interest can be set arbitrarily for each cross section, the effect is further enhanced. Of course, the two-dimensional luminance image to be inspected is displayed next to the tomographic image relating to the desired cross section, and the position of the two-dimensional luminance image in which the tomographic image is specified is clearly indicated. Can be grasped.
Therefore, according to the present embodiment, even if there is no special experience, it is possible to very easily analyze changes in damage to human body tissues, for example, bones, tendons of soft tissues, muscle connective tissues, and the like. For this reason,
It is possible to grasp, for example, fractures, bruises, sprains, and the like that cannot be diagnosed from the outside and those that are difficult to diagnose by X-ray imaging, even if there is no special experience. Moreover, the operation is simple, and bones, tendons, and muscle tissues can be easily observed. Moreover, since there is no danger like X-rays and there is no legal restriction on the operation, anyone can use it easily. Furthermore, it can be manufactured at a much lower cost than a CT scanning device or the like.

In the above-described embodiment, two-dimensional images of desired tissues are also represented by luminance images for bone and soft tissue complementation. However, these two-dimensional images of desired tissues are converted to an appropriate number of gradation values. Obviously, the damage change in the body may be displayed more clearly by displaying the image in a different color image.

FIG. 15 is a flowchart for explaining an ultrasonic tomographic image display operation control program in another embodiment of the biological tissue multidimensional visualization apparatus of the present invention.

The structure of the multidimensional visual device in this embodiment and the content of the operation for controlling the operation of capturing the ultrasonic tomographic image data are substantially the same as those in the above-described embodiment shown in FIGS. Accordingly, in the following description, similar elements are referred to by the same reference numerals.

When the operator gives an instruction to display an image using the keyboard 14a or the mouse 14b, an image display processing operation is started in step S21. Then step S
At 22, the ultrasonic tomographic image data stored in the image memory 13a of the control board 13 is loaded into the RAM of the computer 14 for one image (one cross section).

In the next step S23, step S23 in FIG.
In step S24, a process of detecting the coordinate position on the skin surface is performed in the next step S24 in the same manner as step S14 in FIG. 5.

In the next step S25, it is determined whether or not all the processes in steps S22 to S24 have been completed for the designated image (cross section). If not completed, the process returns to step S22 and the same processing is repeated.
If the processing has been completed, the process proceeds to step S26.

In step S26, step S16 in FIG.
In the same manner as the above, a process of creating a skin surface correction curve is performed. In the next step S27, two-dimensional image data of the desired tissue is obtained in the same manner as in step S17 in FIG. 5, a two-dimensional luminance image is displayed, and the process proceeds to the next step S28. As shown in FIG. 20, a two-dimensional luminance image 51 (in this case, a bone of a human finger) in which only a desired portion is sharpened is displayed on the CRT 14c of the computer by the process of step S27.
It will be displayed like a line image.

In step S28, processing is performed to partially emphasize the luminance of the tissue to be displayed (in this case, the bone portion). FIG. 16 shows the details of step S28.

In step S281 in FIG. 16, an emphasis area of an arbitrary size is set centering on a bone portion to be emphasized in an arbitrary cross section (this cross section is the first frame). The shape of the emphasis area may be a rectangular shape, an elliptical shape, or another closed curve shape. In this example, the shape is a rectangular shape for simplicity of description. The setting of this emphasis area
As shown in FIG. 17, it is preferable that an image of the cross section be displayed on the CRT 14c and the setting be made by operating the mouse 14b. 17, reference numeral 60 denotes a skin surface, 61 denotes a skin surface correction curve, 62 denotes a region of interest, 63
Indicates the other boundary of the region of interest, 64 indicates a bone portion, and 66 indicates a set enhancement region.

In the next step S 282, the pixel data of the portion of the ultrasonic tomographic image data where both the region of interest 62 and the enhancement region 66 overlap are extracted by the RA of the computer 14.
Read from M. Next, in step S283,
As shown in FIG. 17, the luminance of all pixels arranged in the Y-axis direction (ultrasonic traveling direction) at the center position in the X-axis direction (ultrasonic scanning direction) in the rectangular emphasizing area 66 is set to 100%. The brightness of all pixels arranged in the Y-axis direction at both left and right (X-axis direction) positions is changed so as to be 50%, and the brightness of pixels between them is linearly interpolated. The pixel data thus obtained is stored in the RAM again.

In the next step S 284, the above steps S 28 up to the designated final section (final frame) are performed.
It is determined whether or not all of the processing of 2 to S283 has been completed.
If it has not been completed, step S2 is performed for the next section.
Returning to 82, the same processing is repeated. When the processing has been completed, the process proceeds to step S29 in FIG. Step S above
According to the enhancement process of 28, the luminance is partially emphasized for the tissue to be displayed (in this case, the bone portion). Therefore, when the image of this portion is displayed in three dimensions, the central portion of the bone has the maximum luminance. Since the left and right luminances are expressed so as to gradually decrease, the stereoscopic effect can be further enhanced.

In step S29, three-dimensional image data of a desired tissue such as bone is obtained from the ultrasonic tomographic image data, and a three-dimensional luminance image is displayed on the CRT 14c based on the three-dimensional image data. FIG. 18 shows the details of step S29.

In step S291 of FIG. 18, first, as shown in FIG.
Is the current frame, and the region of interest 7 in the cross section 70 is
The data of 0a is read from the RAM and displayed on the CRT 14c.

In the next step S 292, the region of interest 7 in the cross section 71, for example, one to three frames before the current frame by the frame specified in the Z-axis direction.
The pixel data of 1a is read from the RAM. The read section is newly treated as the current frame. Next, in step S293, the coordinates of the read pixel data of the current frame are shifted by a predetermined amount in the X-axis direction and the Y-axis direction. In the example of FIG. 19, the shift is 1 mm to the right (negative direction of the X axis) and 1 mm to the downward direction (positive direction of the Y axis). This shift direction and shift amount can be set arbitrarily. For example, 1 to the left (positive direction of the X axis)
mm and may be shifted 1 mm downward (positive direction of the Y axis), or may be shifted 1 mm only downward (positive direction of the Y axis).
It may be shifted by mm.

In the next step S294, the brightness of the displayed (written) pixel data is compared with the brightness of the pixel data at the corresponding coordinates in the shifted current frame, and the pixel data in the current frame is compared. Only when (brightness) is higher, in step S295, the pixel data is overwritten and displayed. That is, the condition for overwriting and displaying the pixel data is that the pixel data is written only when the luminance of the corresponding pixel position is higher than the luminance already displayed at the pixel at the writing position. In other cases, the pixel data is already displayed. The remaining pixel data is left as it is.

In step S296, it is determined whether or not the processing in steps S294 and S295 has been performed for all the pixels in the region of interest. If all pixels have not been completed, the process returns to step S294, and the same processing is repeated. If the processing has been completed, the process proceeds to step S297.

In step S297, it is determined whether or not the processing in steps S292 to S296 has been completed for all designated cross sections. If the processing has not been completed, the process returns to step S292, and the same processing is repeated. When the processing has been completed, the process proceeds to step S30 in FIG.

As described above, by performing the overwriting process while shifting the position of the tomographic image by a predetermined amount, the CRT 1
A three-dimensional luminance image 53 as shown in FIG. 20 is displayed on 4c. According to such a three-dimensional luminance image, it is possible to very easily determine a bone displacement or the like that is difficult to understand with a two-dimensional luminance image.

In the next step S30, as shown in FIG. 20, a tomographic image 52 of a designated section is obtained by using an ultrasonic tomographic image data stored in the RAM of the computer 14 as a two-dimensional luminance image. 51 and the three-dimensional luminance image 53 are displayed in the same screen 50. In the next step S31, lines 51a and 53a representing the positions of the designated cross sections are changed to two-dimensional image 51 and three-dimensional image 53, respectively.
It is displayed in a different color above, so that the correspondence between the two-dimensional luminance image and the three-dimensional luminance image and the tomographic image can be understood at a glance. As the display of the position of this cross section, besides providing the lines 51a and 53a of different colors, for example,
(1) The lines 51a and 53a are special lines such as broken lines, chain lines, or blinking lines. (2) Marks next to the designated cross-sectional position (non-blinking, blinking, or different colors) And so on.

For example, a keyboard 14a or a mouse 14b
By moving the lines 51a and 53a on the screen 50 by using, for example, the desired section can be designated, and the ultrasonic tomographic image data of the designated section can be displayed on the screen 50.

According to the above-described configuration of the present embodiment, 3
Since the two-dimensional luminance image is displayed, the part of the tissue to be displayed more sharply than the two-dimensional luminance image is sharpened.
Moreover, since the luminance is partially emphasized, the three-dimensional effect is enhanced, and the effect is very large. Of course, the three-dimensional luminance image to be inspected is displayed on the same screen as the tomographic image relating to the desired cross section, and furthermore, the position of the three-dimensional luminance image in which the tomographic image is specified is clearly indicated. Target). Therefore, according to the present embodiment, even if there is no special experience, it is possible to very easily analyze changes in damage to human body tissues, for example, bones, tendons of soft tissues, muscle connective tissues, and the like. For this reason, it is possible to grasp, for example, fractures, bruises, sprains, and the like that cannot be diagnosed from the outside and those that are difficult to diagnose by X-ray imaging, even if there is no special experience. Moreover, the operation is simple, and bones, tendons,
Observe for muscle tissue. Moreover, since there is no danger like X-rays and there is no legal restriction on the operation, anyone can use it easily. Furthermore, it can be manufactured at a much lower cost than a CT scanning device or the like.

In the above embodiment, the three-dimensional luminance image, the two-dimensional luminance image and the tomographic image are displayed on the same screen. However, only the three-dimensional luminance image and the tomographic image may be displayed. It is clear.

In addition to the basic functions described above, the apparatus according to the present embodiment (1) displays a tomographic image in a different color for an appropriate number of gradation values to clearly display a change in damage in the body. 2)
The tomographic image is displayed in different colors for each tissue, and is displayed in different brightness for each gradation value to clearly show changes in damage in the body. (3) Valves are provided at a plurality of ultrasonic frequencies depending on the type of the inspection object. A function of displaying a separately obtained tomographic image as a synthesized tomographic image may be added.

Since bones, tendons, and muscle tissues located near the body surface have little individual difference and are almost in a similar relationship, a standard image for these tissues is displayed simultaneously with the above-described tomographic image. Then, by comparing with an actual ultrasonic tomographic image, analysis can be facilitated.

If the body surface temperature distribution obtained from the thermo-body surface observation device 15 is displayed simultaneously with the tomographic image, the change in damage to tendons, muscle connective tissue, etc. is an ultrasonic tomographic image, and the inflammatory state is the body surface temperature distribution. Can be grasped simultaneously from one screen.

If an image relating to a change in muscle tissue tension obtained from the moiré fringe distribution observation device 16 is displayed simultaneously with a tomographic image, moire display of tissue tension and skin tension change caused by an obstacle can be simultaneously grasped. Damage changes in soft tissue that could not be observed conventionally can be captured from inside and outside the body.

The embodiments described above all show the present invention by way of example and not by way of limitation, and the present invention can be embodied in other various modifications and alterations. Therefore, the scope of the present invention is defined only by the appended claims and their equivalents.

[0090]

As described in detail above, in the present invention,
Ultrasonic diagnosis is performed on a plurality of cross sections of the living tissue that are parallel to each other to store tomographic image data for each tomographic image. Detecting the layer surface position in the cross section, forming the layer surface coordinate data respectively, and correcting the layer surface coordinate data in each cross section or one cross section to arbitrarily set the region of interest for each cross section or one cross section For each section, the average value of the pixel data along the ultrasonic wave traveling direction existing in the set region of interest among the stored tomographic image pixel data is calculated, and the calculated average value is calculated. Then, two-dimensional image data corresponding to the positions of the plurality of cross sections of the living tissue and the position in the ultrasonic scanning direction is obtained and displayed on the screen. in this way,
Since the region of interest of each cross section or one cross section is arbitrarily set by correcting the layer surface coordinate data representing the layer surface position, unnecessary tissues other than the tissue to be observed can be removed from the region of interest. Only the desired portion can be integrated and emphasized and displayed on the two-dimensional image. As a result, the analysis of the living tissue can be performed very easily.

The three-dimensional image data calculation means for obtaining three-dimensional image data by overwriting the tomographic image pixel data stored in the storage means while shifting the position of the tomographic image by a predetermined amount for each designated section. Further provided.
The display means is configured to display a three-dimensional image based on the obtained three-dimensional image data on the same screen as the two-dimensional image, and the three-dimensional image data calculation means is arbitrarily designated for each section. Overwrite only the pixel data existing in the region of interest, and perform the overwrite only when the pixel data to be overwritten for each pixel has a higher luminance than the pixel data written to the pixel. It is configured. Since the three-dimensional luminance image is displayed in this manner,
The part of the tissue to be displayed further than the three-dimensional luminance image is sharpened.

Further, since the two-dimensional luminance image and / or the three-dimensional luminance image of the living tissue is displayed next to the tomographic image relating to the desired cross section, the relationship of the tomographic image with respect to the living tissue can be intuitively grasped. Even if there is no special experience, analysis of a living tissue can be performed more easily.

[Brief description of the drawings]

FIG. 1 is a block diagram schematically illustrating a configuration of an embodiment of a biological tissue multidimensional visualization device according to the present invention.

FIG. 2 is a block diagram schematically showing a configuration of a control board in FIG. 1;

FIG. 3 is a flowchart illustrating an operation control program for capturing ultrasonic tomographic image data.

FIG. 4 is a diagram illustrating the relationship between a human body and its tomographic image.

FIG. 5 is a flowchart illustrating an image display operation control program.

FIG. 6 is a flowchart illustrating the details of low-level echo cut processing in FIG. 5;

FIG. 7 is a diagram showing a correspondence relationship between an image in one cross-sectional example and its ultrasonic tomographic image data.

FIG. 8 is a flowchart illustrating the details of a skin surface position detection process in FIG. 5;

FIG. 9 is a flowchart illustrating an example of a process of creating a skin surface correction curve of FIG.

FIG. 10 is a diagram illustrating a correction operation of a skin surface position.

FIG. 11 is a diagram showing a tomographic image for explaining a skin surface correction curve and a region of interest obtained thereby.

FIG. 12 is a flowchart illustrating another example of the process of creating the skin surface correction curve of FIG.

FIG. 13 is a flowchart illustrating a process of calculating an average value of the tomographic image data of FIG. 5 and forming two-dimensional image data for each section.

14 is a diagram showing an example of a screen displayed by the image display operation control program of FIG.

FIG. 15 is a flowchart illustrating an image display operation control program according to another embodiment of the biological tissue multidimensional visualization device of the present invention.

FIG. 16 is a flowchart illustrating the content of a luminance portion emphasizing process of FIG. 15;

FIG. 17 is a diagram illustrating the emphasis processing of FIG. 16;

FIG. 18 is a flowchart illustrating a process of forming three-dimensional luminance image data in FIG. 15;

FIG. 19 is a diagram illustrating the operation of creating the three-dimensional luminance image data of FIG.

20 is a diagram showing an example of a screen displayed by the image display operation control program of FIG.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 10 Ultrasonic diagnostic apparatus 10a Oscillator 10b Transmission amplifier 10c Receiving amplifier 10d Display unit 10e A / D converter 10f Controller 11 Probe 12 Human body 12a Inspection object 13 Control board 13a Image memory 13b, 13c Input / output control device 14 Digital computer 14a Keyboard 14b Mouse 14c CRT 14d External memory

──────────────────────────────────────────────────続 き Continuation of front page (56) References JP-A-7-241296 (JP, A) JP-A-5-245146 (JP, A) JP-A-60-63034 (JP, A) JP-A-56- 70757 (JP, A) JP-A-60-63033 (JP, A) JP-A-6-14923 (JP, A) (58) Fields investigated (Int. Cl. ⁷ , DB name) A61B 8/00-8 / 15

Claims (10)

(57) [Claims] 1. Ultrasonic tomographic image detection for forming ultrasonic tomographic image data including a plurality of pixel data arranged in an ultrasonic traveling direction and an ultrasonic scanning direction for each of a plurality of mutually parallel cross sections of a living tissue. Means, storage means for temporarily storing tomographic image pixel data for each section formed by using the ultrasonic tomographic image detecting means, and storing the tomographic image data of the living tissue from the tomographic image pixel data stored in the storing means. A layer surface position detecting means for detecting a layer surface position in each section and forming layer surface coordinate data, respectively, and an interest in each section by correcting the layer surface coordinate data in each section formed by the layer surface position detecting means. Means for arbitrarily setting an area, and for each section, the progress of the ultrasonic wave present in the area of interest in the tomographic image pixel data stored in the storage means Average value calculation means for calculating an average value of pixel data along the direction, and for the calculated average value, two-dimensional image data corresponding to the positions of the plurality of cross sections of the living tissue and the position in the ultrasonic scanning direction. A biological tissue multidimensional visualization apparatus comprising: a two-dimensional image data calculating means to be obtained; and a display means for displaying a two-dimensional image based on the obtained two-dimensional image data on a screen. 2. The biological tissue multidimensional visualization device according to claim 1, wherein the region of interest is set to be different from each other in at least a plurality of the cross sections. 3. Ultrasonic tomographic image detection for forming ultrasonic tomographic image data comprising a plurality of pixel data arranged in an ultrasonic traveling direction and an ultrasonic scanning direction for each of a plurality of mutually parallel cross sections of a living tissue. Means, storage means for temporarily storing tomographic image pixel data for each section formed by using the ultrasonic tomographic image detecting means, and storing the tomographic image data of the living tissue from the tomographic image pixel data stored in the storing means. 1
A layer surface position detecting means for detecting a layer surface position in one section and forming layer surface coordinate data, respectively, and an interest in the section by correcting the layer surface coordinate data in one section formed by the layer surface position detecting means. Means for arbitrarily setting an area, and for each section, of tomographic image pixel data stored in the storage means, of pixel data along the direction of travel of ultrasonic waves existing in the region of interest. Mean value calculating means for calculating an average value, and two-dimensional image data calculating means for obtaining two-dimensional image data corresponding to the positions of the plurality of cross sections of the living tissue and the position in the ultrasonic scanning direction for the calculated average value And a display unit for displaying a two-dimensional image based on the obtained two-dimensional image data on a screen. 4. Three-dimensional image data for obtaining three-dimensional image data by overwriting the tomographic image pixel data stored in the storage means while shifting the position of the tomographic image by a predetermined amount for each designated cross section. Calculating means, wherein the display means displays a three-dimensional image based on the obtained three-dimensional image data on the same screen as the two-dimensional image, and the three-dimensional image data calculating means Is
Only the pixel data existing in the region of interest arbitrarily designated for each section is overwritten, and the pixel data to be overwritten of each pixel has a higher luminance than the pixel data written in the pixel The biological tissue multidimensional visualization device according to any one of claims 1 to 3, wherein overwriting is performed only in the case. 5. The biological tissue multidimensional visualization apparatus according to claim 4, wherein the display means displays the luminance of the tomographic image pixel data in a desired area partially emphasized. 6. The display means sets the brightness of the tomographic image pixel data in the desired area to a maximum at a center in an ultrasonic scanning direction, and gradually reduces the brightness as the distance from the center in the ultrasonic scanning direction increases. The biological tissue multidimensional visualization device according to claim 5, wherein 7. The display device according to claim 1, wherein the display unit displays a tomographic image of a desired cross section based on the tomographic image pixel data stored in the storage unit on the same screen. 7. The biological tissue multidimensional visualization device according to any one of 6. 8. The display device according to claim 7, wherein the display unit displays a tomographic image of a desired section and the two-dimensional image displaying the position of the desired section on the same screen. 2. The biological tissue multidimensional visualization device according to item 1. 9. The apparatus according to claim 1, further comprising a deletion unit that deletes tomographic image pixel data other than the region of interest stored in the storage unit. Biological tissue multidimensional visualization device. 10. The apparatus according to claim 1, wherein the frequency of the ultrasonic wave output from the ultrasonic tomographic image detecting means into the living tissue can be arbitrarily set by an operator. The biological tissue multidimensional visualization device according to the above item.