JP2001212147A - Method for ultrasonically processing image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To rapidly obtain a three-dimensionally built image by data obtained by pasting data by a surface extraction to a wall in a body cavity and volume extracting. SOLUTION: An equation rc=r0 is obtained by using a vector r0 and a vector rc in a step S51, a function Φ(rc) of rc at this time is calculated and whether Φ(rc)>0 is satisfied or not is decided in a step S52. In the step S52, if Φ(rc)=1(>0) is satisfied, it contributes to three-dimensional image building. Then, whether a difference ||r0-rc|| between the length of the vector r0 and the length of the vector rc is less than a predetermined value ε or not is decided. If the difference ||r0-rc|| is less than the predetermined value ε, this flow is advanced to a step S55. If the difference ||r0-rc|| is the value ε or more, in a step S57, a function Γ(rc) is used as a display value in the built image, and the process is finished.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to an ultrasonic image processing method for processing ultrasonic data to construct a three-dimensional image.

[0002]

2. Description of the Related Art Ultrasonic diagnostic apparatuses that ultrasonically scan the inside of a body cavity with an ultrasonic probe and obtain tomographic images around the body cavity have been widely used.

[0003] With the conventional ultrasonic probe, a linear image and a radial image can only be obtained independently of each other.
For example, as disclosed in Japanese Patent Application Laid-Open No. 62-219076 or Japanese Patent Application Laid-Open No. 62-194310, three-dimensional scanning is performed so that the size of a tumor or the like formed on a subject can be grasped. Some have been proposed.

[0004] In such a three-dimensional scanning method, the size of a tumor or the like can be obtained by the area, and the volume can be measured. On the other hand, with the recent high performance of general personal computers (hereinafter, personal computers), complicated image processing can be performed even on personal computers.

[0005]

However, in Japanese Patent Application Laid-Open No. 62-219076 described above, surface rendering (Surface Rendering) is performed on a three-dimensional image.
However, since the transmittance of the volume extraction (Volume Rendering) cannot be set independently, there is a problem that information on internal organs and the like at the same time as information on fine irregularities on the surface cannot be easily seen.

In Japanese Patent Application Laid-Open No. Sho 62-194310, it is easy to distinguish organs and the like in a cross-sectional image. There is a problem that is not seen in.

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and has an ultrasonic wave capable of attaching a data obtained by surface extraction to an inner wall portion of a body cavity and rapidly obtaining a three-dimensional construction image based on data obtained by volume extraction. It is intended to provide an image processing method.

[0008]

An ultrasonic image processing method according to the present invention is constructed by combining an ultrasonic data acquiring step of acquiring ultrasonic data in a body cavity and a tissue cross-sectional image (texture) from the ultrasonic data. A perspective image generation step of generating a perspective image, and a three-dimensional image construction step of extracting a cross section of the perspective image and an inner wall in the body cavity to construct a three-dimensional image, wherein the three-dimensional image construction step is performed from a viewpoint. An inner wall in the body cavity is extracted based on a distance between an intersection of an extending vector on a cross section of the perspective image and a point on the extension of the vector where the ultrasonic data exists inside the perspective image.

[0009]

Embodiments of the present invention will be described below with reference to the drawings.

First Embodiment FIGS. 1 to 19 relate to the first embodiment, FIG. 1 is a block diagram showing the configuration of an ultrasonic image processing apparatus, and FIG. 2 is a diagram showing the ultrasonic image processing of FIG. 3 is an explanatory diagram illustrating a search dialog in the flowchart of FIG. 2, FIG. 4 is an explanatory diagram illustrating a read dialog in the flowchart of FIG. 2, and FIG. 5 is a radial diagram in the flowchart of FIG. FIG. 6 is an explanatory diagram illustrating a DPR image in the flowchart of FIG. 2, FIG. 7 is an explanatory diagram illustrating an image rotation process in the flowchart of FIG. 2, and FIG. 8 is an image in the flowchart of FIG. FIG. 9 is an explanatory diagram for explaining a modification of the rotation process of FIG. 9, FIG. 9 is an explanatory diagram for explaining a mode selection dialog in the flowchart of FIG. 2, and FIG. FIG. 11 is a view showing simultaneous display of a radial image, a longitudinal axis cross-sectional image, and a perspective image in which a tissue cross-sectional image is attached to a cross section in the flowchart of FIG. FIG. 12 is a view showing the simultaneous display of a three-dimensional construction image in which the surface extracted image is pasted on the inner wall portion of the body cavity, and FIG. 12 is a flowchart showing the flow of an animated image display process in the flowchart of FIG.
Is an explanatory view for explaining the perspective image of FIG. 10, and FIG.
FIG. 15 is an explanatory diagram illustrating the extraction of the body cavity inner wall surface in the three-dimensional constructed image of FIG. 14, and FIG. 16 is an extraction process of the body cavity inner wall surface in the three-dimensional constructed image of FIG. FIG. 17 is a second flowchart showing the flow of the extraction processing of the inner wall surface of the body cavity in the three-dimensional construction image of FIG. 14, and FIG. 18 is a diagram for explaining image deformation of the three-dimensional construction image of FIG. FIG. 19 is a second explanatory diagram illustrating image deformation of the three-dimensional construction image of FIG.

(Construction) As shown in FIG.
The ultrasound image processing apparatus 1 according to the first embodiment includes an ultrasound image input unit 2 that performs ultrasound image data input processing from an ultrasound probe (not shown) that is inserted into a body cavity and transmits and receives ultrasound. Oblique image constructing unit 3 for constructing an oblique image, surface extracting unit 4 for extracting the surface of the inner wall of the body cavity (the boundary between the tissue and the lumen) in the oblique image, volume extraction (Volume Rendering) and surface A three-dimensional image construction unit 5 that constructs a three-dimensional image by extraction (Surface Rendering), and an image synthesis unit that reads the three-dimensional image generated by the three-dimensional image construction unit 4 and combines the three-dimensional image by volume extraction and surface extraction Part 6
And a monitor 7 for displaying a three-dimensional image or the like synthesized and generated by the image synthesizing unit 6.

The three-dimensional image construction unit 5 includes a volume extraction image construction unit 5a for constructing a three-dimensional image by volume extraction.
It is constituted by a surface extraction image construction unit 5b for constructing a three-dimensional image by surface extraction, and parameters such as a display angle of each of them and a position and an angle of a cut surface are held by a parameter holding memory 8. Although not shown,
The three-dimensional image constructing unit 5 has a memory for storing the constructed three-dimensional image data, and the image synthesizing unit 6 reads the three-dimensional image data stored in the memory of the three-dimensional image constructing unit 3 to read the three-dimensional image data.
A two-dimensional image is synthesized.

(Operation) The ultrasonic image processing apparatus 1 configured as described above will be described.

In the ultrasonic image processing apparatus 1, a plurality of ultrasonic cross-sectional image data input by the ultrasonic image input unit 2 is used to construct a perspective image by the perspective image construction unit 3, and the surface is extracted by the surface extraction unit 4. The boundary between the tissue and the lumen) is extracted. Then, a volume extraction three-dimensional image is constructed by the volume extraction image construction part 5a of the three-dimensional image construction part 5,
The surface extraction image construction unit 5b constructs a three-dimensional image of the surface extraction. The parameters such as the display angle coordinate, the position and angle coordinate of the cut plane are held and updated by a common parameter holding memory 8, and the surface extraction image construction unit 5a and the volume extraction image construction unit 5b always have the same parameters. Can be. Further, the surface extraction image or the volume extraction image is read out by the image synthesizing unit 6 and displayed on the monitor 7.

The image synthesizing unit 6 also has the effect of switching by changing the ratio between surface extraction and volume extraction.

More specifically, when the power of the ultrasonic image processing apparatus 1 is turned on, after a predetermined initial process, as shown in FIG. 2, in step S1, the image synthesizing unit 6 performs a search as shown in FIG. Dialog (Retrieve Dialog) 10
Is displayed on the monitor 7. The search dialog 10 includes a file search tag 11 for performing a search based on a file name, a patient information search tag 12 for performing a search based on patient information such as a patient ID, a patient name, a birthday, an age at examination, and gender. Test information search tag 1 for searching based on test information such as freeze date and time, hospital name, display range, stroke, pitch, frequency, gain, contrast, and image quality level
3 so that an image can be searched with various information.

When a search is performed in the search dialog 10, the image synthesizing unit 6 in step S2 (see FIG. 2) reads a dialog (Load Dialog) as shown in FIG.
g) Display 14 on the monitor 7. The read dialog 14 includes an image file display area 15, a patient information display area 16, and a preview image display area 17, and a plurality of 3D images displayed in the image file display area 15.
When a desired data file is selected from the data file of the two-dimensional image, patient information relating to the selected data file is displayed in the patient information display area 16 and a preview image of the selected data file is displayed in the preview image display area 17. .

Then, when the loading of the desired data file is instructed in the reading dialogue 14, the loading of the desired data file is started in step S3 (see FIG. 2), and the image synthesizing section 6 operates as shown in FIG. Radial image 2
1 is displayed on the monitor 7. During the loading, a progress bar 22 indicating the reading status is displayed on the radial image 21.
Is displayed.

When the loading of the data file is completed, in step S4 (see FIG. 2), the image synthesizing section 6 displays a radial image 23a and a linear image 23b simultaneously as shown in FIG. 6 (Dual Plane Reconstant).
(raction) image 23 is displayed on the monitor 7.

Next, in the image synthesizing section 6, step S5
The image is rotated (see FIG. 2). Specifically, the image rotation processing in step S5 is performed as shown in FIG.
Position setting line 2 in linear image 23b of DPR image 23
4 is moved linearly, and the radial image 23a at the position specified by the position setting line 24 is sequentially and continuously changed in accordance with the movement to find the region of interest 25 on the radial image 23a. Thereafter, the angle setting line 26 is rotated about the radial image 23a in the radial image 23a, and the angle setting line 26 is superimposed on the region of interest 25, so that the region of interest 25 is displayed on the linear image 23b. By these processes, the region of interest 25 becomes the DPR image 23
Are displayed on both the radial image 23a and the linear image 23b.

Then, the radial image 23a and the angle setting line 26 are simultaneously rotated, the region of interest 25 is moved in the 6 o'clock direction, and the angle setting line 26 can be returned to the initial angle. (Figure 1
0) and a three-dimensional construction image (see FIG. 11).

As a modification of the image rotation process in step S5, as shown in FIG. 8, the position setting line 24 is linearly moved in the linear image 23b of the DPR image 23, and the position By sequentially and continuously changing the radial image 23a at the position designated by the setting line 24, after finding the region of interest 25 on the radial image 23a, the angle setting line 26 is fixed, and the radial image 23a is rotated to obtain the region of interest. By superimposing the angle setting line 26 on 25, the region of interest 25 can be displayed on the linear image 23b.

When the processing in step S5 is completed, a radial image and a longitudinal axis cross-sectional image (Longitu) are obtained in step S6.
digital image: a cross-sectional image composed of an image in which a linear image is displayed vertically and an image in which it is displayed horizontally, and a tissue cross-sectional image (Text)
ure), a simultaneous display mode of mode 1 consisting of a perspective image attached to a cross section, a radial image,
The mode 2 simultaneous display mode consisting of a three-dimensional construction image in which the longitudinal axis cross-sectional image and the tissue cross-sectional image are pasted on the cross section and the surface-extracted image is pasted on the inner wall portion of the body cavity is displayed using the mode selection dialog 30 shown in FIG. To select.

The surface extraction in the three-dimensional construction image can be replaced by volume extraction or a combination of surface extraction and volume extraction.

In the mode selection dialog 30, "Squint" (O
blique) is selected, in step S7, the image synthesizing unit 6 sets the radial image as shown in FIG.
The monitor 7 displays a perspective image in which the longitudinal axis cross-sectional image and the tissue cross-sectional image are attached to the cross section, and returns to step S6 to repeat the processing.

In the mode selection dialog 30, "Extract" (R
When “ending” is selected, in step S8, the image combining unit 6 affixes the radial image, the longitudinal axis sectional image, and the tissue sectional image as shown in FIG. Is displayed on the monitor 7.

The surface extraction in the three-dimensional construction image can be replaced by volume extraction or a combination of surface extraction and volume extraction.

Then, in step S9, an animated image display process of the three-dimensional construction image is performed, and the process returns to step S6 to repeat the process.

In the animated image display processing of the three-dimensionally constructed image in step S9, a plurality of continuously rotated three-dimensionally constructed images are read out in chronological order and sequentially displayed. The three-dimensional construction image thus calculated is calculated as described below and stored in the memory of the three-dimensional image construction unit 5.

That is, as shown in FIG. 12, the oblique image in the oblique image construction 3 is displayed in step S21, the display section and the viewing angle of the oblique image are changed in step S22, and the three-dimensional constructed image display is performed in step S23. When a request for displaying a three-dimensional construction image is received, a three-dimensional construction image is created in step S24, and parameters for the animated image are set based on the parameters of the display section and the viewing angle in step S22. Then, in step S25, based on the parameters for the animated image, an animated image composed of a plurality of three-dimensionally constructed images whose viewing angles are sequentially shifted is created and stored in the memory of the three-dimensionally image constructing unit 5;
In step 6, the animated images are read out in time series and sequentially displayed.

Next, a three-dimensional image in which a perspective image in which the tissue cross-sectional image shown in FIG. 10 is pasted on the cross section and an image in which the tissue cross-sectional image shown in FIG. The construction image will be described.

As shown in FIG. 13, a perspective image 41 in which a tissue cross-sectional image is attached to a cross-section is defined as each cross-section (a-plane, b-plane, c-plane, and d-plane) of the perspective image constructed in the perspective image construction 3. ,
Tissue cross-sectional image 4 showing the layer structure of the tissue in the body cavity based on the data obtained by the volume extraction image construction unit 5a on the (e-plane, f-plane)
2, which is constructed by oblique image construction 3.

As shown in FIG. 14, a three-dimensional construction image 43 in which a tissue cross-section image is pasted on a cross-section and a surface-extracted image is pasted on the inner wall portion of a body cavity is referred to as a perspective image constructed in perspective image construction 3. (A-plane, b-plane, c-plane, d-plane)
A tissue cross-sectional image 42 indicating the layer structure of the tissue in the body cavity based on the data obtained by the volume extraction image construction unit 5a is attached to the surface, the surface e, and the surface f), the body cavity inner wall portion is extracted, and the extracted body cavity inner wall portion is extracted. Is an image in which the image 44 whose surface has been extracted is attached to the image.

The extraction of the inner wall portion of the body cavity is performed as follows. First, as shown in FIG. 15, the perspective image is divided into a plurality of stacked surfaces I1, I2,..., In. Then, as shown in FIG. 16, in step S31, a small area is set on the surface In. Next, in step S32, the line of sight passage (View
Plane) at position (Vx, Vy) Vx = 0, Vy
= 0 is set. Then, in step S33, the light beam is advanced from the positions Vx and Vy of the line of sight passage to the small area of the surface In to obtain a vector r0 (see FIG. 15). Here, the light ray is a light ray from the viewpoint when the viewpoint is moved to infinity, and is a parallel light ray on the line of sight passage.

Next, in step S34, the light beam is further advanced from the small area of the plane In, and the inner wall of the body cavity is detected by a predetermined process described later.

In step S35, Vx = Vx + 1. In step S36, it is determined whether or not Vx is outside the line of sight.
If x is within the line of sight e, the process returns to step S33 to repeat the process. If Vx is outside the line of sight, Vx = 0, Vy = Vy + 1 in step S37, and Vy in step S38.
Is determined to be outside the line of sight passage. If Vy is within the line of sight passage, the process returns to step S33 to repeat the process. If Vy is outside the line of sight passage, the process ends. As a result, scanning of the oblique image by the light beam is performed at all positions on the line of sight passage.

The predetermined processing in step S34 will be described. First, as described above, the vector r0 is the value of the surface In where the light beam has reached from the position (Vx, Vy) when the light beam has traveled from the position (Vx, Vy) of the line-of-sight passing surface to the small area of the surface In. Indicates a vector up to a small area.

Next, the light beam is advanced from the position (Vx, Vy) of the line of sight passage to the small area of the surface In, and the light ray is made to reach the next layer surface In-1 from the small area of the surface In. In this case, a vector from the position (Vx, Vy) to the small area of the plane In-1 where the light beam has reached is defined as a vector rc (see FIG. 15). That is, the vector rc is a vector that starts from the starting point (position (Vx, Vy)) of the vector r0, sequentially increases in length, and changes from the position (Vx, Vy) to a vector from the position (Vx, Vy) to a small area of the plane I1 where the light beam arrives. is there.

In the predetermined process of step S34, using this vector r0 and vector rc, as shown in FIG. 17, rc = r0 is set in step S51, and a function Φ (rc) of rc at this time is set in step S52. Calculate and Φ (rc)>
It is determined whether it is 0. This function Φ (rc) is a function from a neighboring point in the layered data set to a single number of values 0 or 1, and is a limitation for determining that the data at rc contributes to the construction of a three-dimensional image. Function. That is, in step S52, the data at rc is Φ (r
If c) = 0, it does not contribute to the construction of the three-dimensional image, and Φ (rc) =
If 1 (> 0), it is determined that it has contributed to the construction of the three-dimensional image. For example, Φ (rc) is a function that takes 0 if the intensity of the data up to the previous ten positions along the ray at rc is below a predetermined threshold.

When it is determined that the data at rc does not contribute to the construction of the three-dimensional image when Φ (rc) = 0,
In step S53, rc is moved to the plane Ik of the next layer. In step S54, it is determined whether or not rc is within the boundary of a data set including a plurality of planes I1, I2, ..., In. If rc is outside the boundaries of the data set, the process returns to step S52, and if rc is outside the boundaries of the data set, the process ends in step S55 using the function Π (rc) as the display value in the three-dimensional construction image.

Here, the function Π (rc) gives data obtained by volume extraction.

In step S52, Φ (rc) = 1 (> 0)
If it is determined that it contributes to the construction of the three-dimensional image, it is determined in step S56 whether or not the difference || r0−rc || between the length of the vector r0 and the length of the vector rc is less than a predetermined value ε.
If || r0−rc || is smaller than the predetermined value ε, the process proceeds to step S55. If || r0−rc ||
At 57, the process ends using the function Γ (rc) as the display value in the three-dimensional construction image.

Here, the function Γ (rc) gives data obtained by surface extraction. For example, the function Γ (rc) is
It can be a six-neighbor point gradient illumination shadow function at the six neighbors at the end of rc.

By performing such processing, it is possible to obtain a three-dimensional construction image in which data obtained by surface extraction is attached to the inner wall portion of the body cavity and data obtained by volume extraction is attached. Can be improved. Also, while using Φ (rc), the vector r0
Since the inner wall of the body cavity is extracted by judging the difference || r0−rc || between the length of the vector rc and the length of the vector rc, the above three-dimensional construction image can be calculated at a high speed.

The three-dimensional construction image 43 constructed in this manner
As shown in FIG. 14, the surface of the inner wall of the body cavity is displayed as a surface-extracted image 44, the internal information obtained by volume extraction is held inside, and the cross-section is displayed as a tissue cross-sectional image 42, as shown in FIG.

As shown in FIG. 18, the three-dimensional construction image 43
(A-plane, b-plane, c-plane, d-plane, e-plane, and f-plane)
It is possible to advance and retreat in the directions of the respective arrows, and taking the a-plane as an example, as shown in FIG. 19, the surface is extracted from the three-dimensional construction image 43 in the initial state using a pointing device such as a mouse (not shown). It can be converted into a three-dimensional construction image 43a in which the convex section held by the internal information by the volume extraction inside the image 44 and the tissue section image 42 is reduced.

Further, a three-dimensional construction image 43b obtained by extending a convex cross-section held by internal information by volume extraction into an interior consisting of an image 44 extracted from the surface of the three-dimensional construction image 43 in the initial state and a tissue cross-section image 42 is converted. it can.

Further, the image 44 surface-extracted in the convex section from the three-dimensional construction image 43 in the initial state is converted into a three-dimensional construction image 43c in which the internal information obtained by volume extraction is retained inside the reduced tissue cross-sectional image 42 alone. it can.

Furthermore, the three-dimensional construction image 4 in the initial state
3, only the image 44 whose surface has been extracted can be converted into a three-dimensional construction image 43 d extended in the depth direction, while the tissue section image 42 held by the internal information by volume extraction inside as it is.

(Effects) As described above, according to the present embodiment, the retention of internal information, which is the advantage of volume extraction, the ability to see fine irregularity information on the surface, which is the advantage of surface extraction, and the cross section is a tissue section The effect that the resolution is improved by the image 42 is obtained.

A three-dimensional construction image 43 which is a conversion image
a) The cutting plane can be freely changed as in the three-dimensional construction image 43b, and the internal information can be viewed by volume extraction while maintaining the state of the surface by the image 44 extracted as in the three-dimensional construction image 43c. 3D construction image 43
As shown by d, there is an effect that fine surface unevenness information and the like can be seen from the image 44 whose surface has been extracted while maintaining the internal state by volume extraction.

Second Embodiment FIGS. 20 to 22 relate to the second embodiment, FIG. 20 is a block diagram showing a configuration of an ultrasonic image processing apparatus, and FIG. 21 is an ultrasonic image processing apparatus shown in FIG. FIG. 22 is a first explanatory view for explaining the operation of the apparatus, and FIG.
FIG. 5 is a second explanatory diagram for explaining the operation of the ultrasonic image processing apparatus of FIG.

(Configuration) Since the second embodiment is almost the same as the first embodiment, only different points will be described, and the same components will be denoted by the same reference numerals and description thereof will be omitted.

As shown in FIG. 20, in the present embodiment,
Between the three-dimensional image construction unit 5 and the image synthesizing unit 6, a transmittance setting unit 51 including a volume extraction transmittance setting unit 51a and a surface extraction transmittance setting unit 51b for setting the volume extraction transmittance is provided. The transmittance setting unit 51 can set different transmittances for volume extraction and surface extraction. Other configurations are the same as those of the first embodiment.

(Operation) In the present embodiment, in the transmittance setting unit 51, the volume extraction transmittance is set in the volume extraction transmittance setting unit 51a, and in the surface extraction transmittance setting unit 51b, the surface extraction transmittance is set. Then, the surface extraction image or the volume extraction image is read out by the image synthesizing unit 6 and displayed on the monitor 7.

As shown in FIG. 21, the surface of the inner wall of the body cavity is displayed on the monitor 7 by surface extraction, the internal information is retained by volume extraction, and a tissue cross-sectional image is pasted on the cross section. In addition, by setting the transmittance of surface extraction and volume extraction, the presence of the region of interest 52 inside the volume extraction can be confirmed from the outside.

FIG. 22 shows the above from the side, and the region of interest 52 in the volume-extracted image 54 viewed from the viewpoint 53 has the transparency set in the surface-extracted image 44 and the volume extracted. The presence of the image 54 can be confirmed from the outside by setting the transparency. Other operations are the same as those of the first embodiment.

(Effect) As described above, according to the present embodiment, in addition to the effect of the first embodiment, the surface of the inner wall of the body cavity can be observed up to fine irregularities on the surface by the image 44 extracted from the surface. Since the internal information is retained in the image 54, that is, the volume extracted, the internal information is retained by the volume extraction, and the transparency of the surface extracted image 44 and the volume extracted image 54 can be set independently. There is an effect that the region 52 can be observed simultaneously with the inner wall surface of the body cavity.

Third Embodiment FIGS. 23 and 24 relate to the third embodiment, and FIG. 23 is a block diagram showing a configuration of an ultrasonic image processing apparatus, and FIG. 24 is an ultrasonic image processing apparatus shown in FIG. It is explanatory drawing explaining the effect | action of an apparatus.

(Structure) The third embodiment is almost the same as the first embodiment. Therefore, only different points will be described, and the same structures will be denoted by the same reference numerals and description thereof will be omitted.

As shown in FIG. 23, in this embodiment,
Between the three-dimensional image construction unit 5 and the image synthesizing unit 6, the size of the surface extraction and the surface extraction size (position) for changing the display position
A size (position) change module 61 including a change module 61a is provided. Other configurations are the same as those of the first embodiment.

(Operation) In this embodiment, the operation of a pointing device such as a mouse (not shown) is performed by operating a pointing device (not shown).
As shown in (3), the three-dimensional construction image 43e in the initial state can be converted into a three-dimensional construction image 43e in which the surface-extracted image 44 is pasted in a partially reduced range.

Further, the three-dimensional construction image 43e can be converted into a three-dimensional construction image 43f in which the surface-extracted image 44 is pasted in a partially reduced range.

By operating a pointing device such as a mouse (not shown), for example, the surface-extracted image 44 in a partially reduced range of the three-dimensional construction image 43f is converted into a three-dimensional construction image 43g moved to the back. Can,
Similarly, for example, the surface-extracted image 44 of the partially reduced range of the three-dimensional construction image 43f can be converted to a three-dimensional construction image 43h moved toward the near side. Other operations are the same as those of the first embodiment.

(Effects) As described above, according to the present embodiment, in addition to the effects of the first embodiment, by changing the size and / or position of the surface-extracted image 44,
There is an effect that it is possible to observe even the fine surface unevenness information by the surface extraction and at the same time to observe the inside by the volume extraction.

Fourth Embodiment: FIGS. 25 to 27 relate to the fourth embodiment, FIG. 25 is a configuration diagram showing the configuration of an ultrasonic image processing apparatus, and FIG. 26 is an ultrasonic image processing of FIG. FIG. 27 is a first explanatory view for explaining the operation of the apparatus, and FIG.
FIG. 5 is a second explanatory diagram for explaining the operation of the ultrasonic image processing apparatus of FIG.

(Structure) Since the fourth embodiment is almost the same as the first embodiment, only different points will be described, and the same structures will be denoted by the same reference numerals and description thereof will be omitted.

As shown in FIG. 25, in the present embodiment,
A coloring module 71 including a surface extraction coloring module 71a that performs coloring processing for surface extraction is provided between the three-dimensional image construction unit 5 and the image synthesis unit 6. Other configurations are the same as those of the first embodiment.

(Operation) In the present embodiment, the operation of a pointing device such as a mouse (not shown) is performed as shown in FIG.
As shown in (3), a color processing is performed on the three-dimensional construction image 43 including the image 44 whose surface is extracted using the color palette 75.

Referring to FIG. 27, using a pointing device such as a mouse (not shown), a three-dimensional construction image including an image 44 whose surface is extracted using color data of an endoscope image 76 is shown. 43 is colored. Other operations are the same as those of the first embodiment.

(Effects) As described above, according to the present embodiment, in addition to the effects of the first embodiment, the three-dimensional construction image 4
By performing the coloring process on No. 3, it becomes easy to distinguish organs, tumors, and the like, which were difficult in gray scale, and further, as color data, data of an endoscopic image (the endoscope used when performing an ultrasonic examination) The use of (image data) can provide a more realistic image.

[Supplementary Note] (Supplementary note 1) An ultrasound data acquiring step of acquiring ultrasound data in a body cavity, and a perspective image for generating a perspective image constructed by bonding tissue cross-sectional images (textures) from the ultrasound data. A three-dimensional image construction step of extracting a cross-section of the perspective image and an inner wall in the body cavity to construct a three-dimensional image, the three-dimensional image construction step comprising: An ultrasonic image processing method, wherein an inner wall in the body cavity is extracted based on a distance between an intersection on a cross section and a point where the ultrasonic data is present inside the oblique image when the vector is extended.

(Appendix 2) The viewpoint is the Obli.
2. The ultrasonic image processing method according to claim 1, wherein the ultrasonic image processing apparatus is located at a position distant from the que image to infinity.

(Additional Item 3) In the three-dimensional image construction step, the position and the viewing angle of the cross section are arbitrarily changed, and
3. The ultrasonic image processing method according to claim 1, wherein a two-dimensional image is constructed.

(Additional Item 4) The three-dimensional image construction step includes a volume extraction step of constructing a three-dimensional image by volume extraction, a surface extraction step of constructing a three-dimensional image by surface extraction, and a three-dimensional image by the volume extraction. 2. The ultrasonic image processing method according to claim 1, further comprising a display step of performing switching display and / or simultaneous display of an image and a three-dimensional image obtained by the surface extraction.

(Additional Item 5) The ultrasonic image processing method according to additional item 4, wherein the volume extraction step and the surface extraction step can independently set the equivalence of the three-dimensional image. .

(Additional Item 6) The ultrasonic image processing method according to additional item 4, wherein in the surface extraction step, a size position of a three-dimensional image by the surface extraction can be set.

(Additional Item 7) The ultrasonic image processing method according to additional item 4, wherein in the surface extraction step, the three-dimensional image can be colored with a color palette or a medical image.

(Additional Item 8) The ultrasonic image processing according to additional item 1, further comprising a combining step of combining and displaying the three-dimensional image obtained by the volume extraction and the three-dimensional image obtained by the surface extraction. Method.

(Supplementary note 9) The ultrasonic image processing method according to supplementary note 8, wherein the volume extraction step and the surface extraction step can independently set the transmittance of the three-dimensional image. .

(Additional Item 10) The surface extraction step
9. The ultrasonic image processing method according to claim 8, wherein a size position of the three-dimensional image can be set by the surface extraction.

(Supplementary Item 11) The surface extraction step includes:
The ultrasonic image processing method according to claim 8, wherein the three-dimensional image can be colored with a color palette or a medical image.

[0083]

As described above, according to the ultrasonic image processing method of the present invention, data by surface extraction is attached to the inner wall of the body cavity, and a three-dimensional construction image based on the data obtained by volume extraction is obtained at high speed. There is an effect that can be.

[Brief description of the drawings]

FIG. 1 is a configuration diagram showing a configuration of an ultrasonic image processing apparatus according to a first embodiment of the present invention.

FIG. 2 is a flowchart showing a processing flow of the ultrasonic image processing apparatus of FIG. 1;

FIG. 3 is an explanatory diagram illustrating a search dialog in the flowchart of FIG. 2;

FIG. 4 is an explanatory diagram illustrating a read dialog in the flowchart of FIG. 2;

FIG. 5 is an explanatory diagram illustrating a radial image in the flowchart of FIG. 2;

FIG. 6 is an explanatory diagram illustrating a DPR image in the flowchart of FIG. 2;

FIG. 7 is an explanatory diagram illustrating an image rotation process in the flowchart of FIG. 2;

FIG. 8 is an explanatory diagram illustrating a modification of the image rotation process in the flowchart of FIG. 2;

FIG. 9 is an explanatory diagram illustrating a mode selection dialog in the flowchart of FIG. 2;

FIG. 10 is a view showing simultaneous display of a radial image, a longitudinal axis cross-sectional image, and a perspective image in which a tissue cross-sectional image is attached to a cross section in the flowchart of FIG. 2;

11 is a view showing the simultaneous display of a three-dimensional construction image in which a radial image, a longitudinal axis cross-sectional image, and a tissue cross-sectional image in the flowchart of FIG.

FIG. 12 is a flowchart showing the flow of an animated image display process in the flowchart of FIG. 2;

FIG. 13 is an explanatory diagram illustrating the perspective image of FIG. 10;

FIG. 14 is an explanatory diagram illustrating the three-dimensional construction image in FIG. 11;

FIG. 15 is an explanatory diagram illustrating extraction of a body cavity inner wall surface in the three-dimensional construction image of FIG. 14;

FIG. 16 is a first flowchart showing a flow of an extraction process of a body cavity inner wall surface in the three-dimensional construction image of FIG. 14;

17 is a second flowchart showing the flow of extraction processing of the inner wall surface of the body cavity in the three-dimensional construction image of FIG.

18 is a first explanatory diagram illustrating image deformation of the three-dimensional construction image in FIG.

FIG. 19 is a second explanatory diagram illustrating image deformation of the three-dimensional construction image in FIG. 14;

FIG. 20 is a configuration diagram showing a configuration of an ultrasonic image processing apparatus according to a second embodiment of the present invention.

FIG. 21 is a first explanatory view illustrating the operation of the ultrasonic image processing apparatus in FIG. 20;

FIG. 22 is a second explanatory view for explaining the operation of the ultrasonic image processing apparatus in FIG. 20;

FIG. 23 is a configuration diagram showing a configuration of an ultrasonic image processing apparatus according to a third embodiment of the present invention.

FIG. 24 is an explanatory diagram for explaining the operation of the ultrasonic image processing device of FIG. 23;

FIG. 25 is a configuration diagram showing a configuration of an ultrasonic image processing apparatus according to a fourth embodiment of the present invention.

FIG. 26 is a first explanatory view illustrating the operation of the ultrasonic image processing device in FIG. 25;

FIG. 27 is a second explanatory diagram illustrating the operation of the ultrasonic image processing apparatus in FIG. 25;

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 ... Ultrasonic image processing apparatus 2 ... Ultrasonic image input part 3 ... Perspective image construction part 4 ... Surface extraction part 5 ... Three-dimensional image construction part 5a ... Volume extraction image construction part 5b ... Surface extraction image construction part 6 ... Image synthesis Part 7 Monitor 8 Parameter holding memory

 ────────────────────────────────────────────────── ─── Continuing on the front page (72) Inventor Hong Zhaho, USA 95010 Capitola Sweet Number 212 Bay Avenue 820 Index Systems, Inc. F term (reference) 4C301 BB03 EE10 FF04 KK02 KK18 KK30 5B057 AA07 BA05 CA02 CA08 CA12 CA16 CB02 CB08 CB13 CB16 CC01 CD14 CE14 5B080 AA19 BA04 FA08 GA22

Claims (1)

[Claims] An ultrasound data acquisition step of acquiring ultrasound data in a body cavity; a perspective image generation step of creating a perspective image constructed by laminating a tissue cross-sectional image (texture) from the ultrasound data; A three-dimensional image construction step of extracting a cross-section of an image and an inner wall in the body cavity to construct a three-dimensional image, wherein the three-dimensional image construction step includes an intersection of a vector extending from a viewpoint on a cross section of the perspective image, An ultrasonic image processing method, wherein an inner wall in the body cavity is extracted based on a distance from a point where the ultrasonic data exists inside the oblique image on the extension of the vector.