JP2005312993A - Ultrasonic imaging diagnostic system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an ultrasonic diagnostic system capable of confirming whether or not extracting the surface of an object is carried out properly. <P>SOLUTION: In the ultrasonic imaging diagnostic system, a surface position extraction means is provided with a surface tracing means for automatically tracing an object surface position successively on a plurality of continuous ultrasonic tomographic images. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

 The present invention relates to an ultrasonic diagnostic imaging apparatus that obtains a three-dimensional image by transmitting and receiving ultrasonic waves to and from a living body.

  In recent years, while performing a three-dimensional scan such as a spiral scan as in the device disclosed in Japanese Patent Laid-Open No. 6-30937, etc., ultrasonic waves are transmitted and received into the living body, and echo data of the region to be examined is captured, There has been proposed an ultrasonic diagnostic apparatus that three-dimensionally displays a body part to be examined.

  Among these, in Japanese Patent Application Laid-Open Nos. 7-47066 and 4-279156, in order to express the three-dimensional shape of the living body while maintaining the gradation that is inherent to the echo data of the living body necessary for medical diagnosis. In addition, there is disclosed a device that displays echo data in three dimensions and synthesizes it with surface image data of a body cavity surface shaded by perspective or glow shading.

  Among them, the apparatus disclosed in Japanese Patent Application Laid-Open No. 7-47066 can interactively set a desired cross section by dividing the display screen of the monitor into four and setting the cross section position with a trackball or the like.

  The apparatus disclosed in Japanese Patent Laid-Open No. 4-279158 automatically extracts the organ surface by threshold processing on the line of sight. Furthermore, in order to express the surface three-dimensionally, the surface is colored to express a sense of perspective by changing the hue.

  Further, in the devices disclosed in JP-A-7-47066 and JP-A-4-279158, the display color of the surface image data in the three-dimensional image is attached only from the perspective and the three-dimensional shape, It was not related to the original color of the organ visible in the optical image.

  However, in the device disclosed in Japanese Patent Laid-Open No. 4-279156, the threshold value processing is performed, and the surface is extracted simply by determining whether or not the luminance is higher than a certain luminance. There is a problem that it may be mistakenly extracted from the organ surface.

  Therefore, a first object of the present invention is to provide an ultrasonic diagnostic apparatus that can accurately represent a desired object surface without being disturbed by noise or the like.

  Further, the apparatus disclosed in Japanese Patent Laid-Open No. 4-279156 has a problem that it cannot be confirmed whether or not the surface extraction has been properly performed.

  Therefore, a second object of the present invention is to provide an ultrasonic diagnostic apparatus capable of confirming whether or not an object surface is properly extracted.

  Further, the apparatus disclosed in Japanese Patent Laid-Open No. 4-279156 has a problem that it is impossible to correct a portion where surface extraction is not appropriate.

  Accordingly, a third object of the present invention is to provide an ultrasonic diagnostic apparatus capable of correcting a portion where extraction of an object surface is not appropriate.

  In addition, the apparatus disclosed in Japanese Patent Application Laid-Open No. 7-47066 is configured to set the cross-sectional position only by setting the crossing position of the cutting line, and the cross-section is set only in a cross-section parallel to the cutting line. Cannot be set. For this reason, there is a problem that the cross section cannot be observed at the position of the lesion existing at an oblique position such as the lower right on the tomographic image perpendicular to the luminal axis, and the depth of the lesion cannot be diagnosed.

  Accordingly, a fourth object of the present invention is to provide an ultrasonic diagnostic apparatus capable of appropriately setting a cross section regardless of the position of a lesion on a tomographic image and diagnosing the depth of the lesion. .

  Further, in the apparatus disclosed in Japanese Patent Application Laid-Open No. 7-47066, a cross-section is expressed simply by displaying a cutting line on a display screen of a monitor divided into four parts. There was a problem that it was difficult to distinguish the correspondence between the displayed part and the non-displayed part.

  Accordingly, a fifth object of the present invention is to provide an ultrasonic diagnostic apparatus capable of distinguishing between a portion displayed as a three-dimensional image and a portion not displayed on a tomographic image, and setting a cross section in an easily understandable relationship. .

  In addition, the apparatus disclosed in Japanese Patent Application Laid-Open No. 7-47066 has a problem in that the ray angle during shading cannot be changed, and depending on the shape, it cannot be represented in three dimensions.

  Accordingly, a sixth object of the present invention is to provide an ultrasonic diagnostic imaging apparatus that can represent a desired object surface in a more three-dimensional manner and that can set the light angle more intuitively and anatomically. It is in.

  Further, the apparatus disclosed in Japanese Patent Application Laid-Open No. 7-47066 does not have means for instructing the line-of-sight direction. For this reason, there are cases where the region of interest cannot be seen well even after the line-of-sight direction of the three-dimensional image is changed so that the region of interest such as a lesion can be seen well, and two-dimensional reprojection is performed, and many times until a desired three-dimensional image is obtained. There was a problem of requiring reprojection.

  Accordingly, a seventh object of the present invention is to provide an ultrasonic diagnostic apparatus capable of more easily setting a line-of-sight angle so that a region of interest such as a lesion can be seen well.

  In addition, when a doctor determines the degree of progression such as the depth of a lesion using echo data and compares the shape of the lesion with an optical image such as an endoscope using surface image data, Japanese Patent Laid-Open No. 7-47066. In the apparatus disclosed in the Japanese Patent Publication No. Gazette, both the three-dimensional image data and the surface image data are displayed in gray scale, so that each part of the three-dimensional image holds the tone of the echo of the living body. There is a problem that it is difficult for a surgeon to distinguish whether the image data is surface image data to which three-dimensional information such as shape is added as a shadow.

  Further, in the devices disclosed in Japanese Patent Application Laid-Open Nos. 7-47066 and 4-279156, the display color of the surface image data in the three-dimensional image is given only from the perspective and the three-dimensional shape, There is a problem that it is difficult for a person other than the surgeon to determine which part of the body cavity is being observed because it is not related to the original color of the organ visible in the optical image.

  Accordingly, an eighth object of the present invention is to provide an ultrasonic diagnostic imaging apparatus that can easily distinguish between echo data and surface image data.

  Furthermore, a ninth object of the present invention is to provide an ultrasonic diagnostic imaging apparatus capable of observing a more realistic three-dimensional image by associating the display color of the surface image data with the original color of an organ visible in an optical image.

In order to achieve the first object, the following configuration (1) is adopted.
(1) 3D echo data storage means for transmitting and receiving ultrasonic waves to a living body and storing the obtained echo data of the 3D region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
Synthesis means for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting means and the surface echo data to which the shadow is added by the shadow adding means;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
In the three-dimensional echo data, the surface position extracting means scans the scan line farther from the scan line start point, and a point having a luminance value larger than a certain threshold value is continuously longer than a predetermined distance. The present invention is characterized in that a run extracting means for extracting a run closest to the scan line start point is provided.

According to the above configuration, the cross-sectional position setting unit sets a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage unit.
In the surface position extracting means, the run extracting means scans the scan line farther from the scan line start point in the three-dimensional echo data, and a point having a luminance value greater than a certain threshold value continues for a predetermined distance or more. Of these, by extracting the run closest to the scan line start point, the desired object surface position in the 3D echo data stored in the 3D echo data storage means is extracted.
The shadow adding means adds a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means.
The synthesizing unit synthesizes a three-dimensional image from the cross-sectional echo data and the surface echo data. The display means displays a three-dimensional image.

In order to achieve the second object, the following configuration (2) or (3) is adopted.
(2) an ultrasonic probe that transmits and receives ultrasonic waves to a living body and obtains a plurality of continuous ultrasonic tomographic images in a three-dimensional region;
Three-dimensional echo data storage means for storing echo data of a three-dimensional region composed of a plurality of successive ultrasonic tomographic images obtained by the ultrasonic probe;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
A synthesizing unit for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting unit and the surface echo data to which the shadow is added by the shadow adding unit;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The surface position extracting means is provided with boundary superimposing means for superimposing the extracted object surface position as a boundary on all of the plurality of continuous ultrasonic tomographic images or on a specific ultrasonic tomographic image. .

According to the above configuration, the cross-sectional position setting unit sets a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage unit.
The surface position extracting means superimposes the extracted object surface position on all or a specific ultrasonic tomographic image as a boundary, and the user confirms the extracted position. However, a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means is extracted. The shadow adding means adds a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means.
The synthesizing unit synthesizes a three-dimensional image from the cross-sectional echo data and the surface echo data. The display means displays a three-dimensional image.

(3) three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to the living body and storing the obtained echo data of the three-dimensional region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
A synthesizing unit for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting unit and the surface echo data to which the shadow is added by the shadow adding unit;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The surface position extracting means constructs a plurality of tomographic images having different directions generated from echo data in the three-dimensional echo data;
Boundary superimposing means for superimposing the extracted object surface position as a boundary on the tomographic image constructed by the tomographic image constructing means is provided.

According to the above configuration, the cross-sectional position setting unit sets a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage unit.
The surface position extraction means includes a tomographic image constructing means for constructing a plurality of tomographic images having different directions generated from echo data in the three-dimensional echo data, and a boundary superimposing means for creating a tomographic image constructed by the tomographic image constructing means. The desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means is extracted while superimposing the extracted object surface position as a boundary and confirming the extraction position by the user. The shadow adding means adds a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means.
The synthesizing unit synthesizes a three-dimensional image from the cross-sectional echo data and the surface echo data. The display means displays a three-dimensional image.

In order to achieve the third object, the following configuration (4) or (5) is adopted.
(4) In the ultrasonic diagnostic imaging apparatus according to (2) or (3), the surface position extracting unit includes a boundary correcting unit that corrects the boundary superimposed by the boundary superimposing unit, and is corrected by the boundary correcting unit. The object surface position extracted by the boundary is corrected.
According to the above configuration, the cross-sectional position setting unit sets a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage unit.
The surface position extraction means is a three-dimensional echo data storage means in which the boundary correction means corrects the boundary superimposed by the boundary superimposing means and corrects the object surface position extracted by the boundary corrected by the boundary correction means. The desired object surface position in the three-dimensional echo data stored in is appropriately extracted.
The shadow adding means adds a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means.
The synthesizing unit synthesizes a three-dimensional image from the cross-sectional echo data and the surface echo data. The display means displays a three-dimensional image.

(5) In the ultrasonic diagnostic imaging apparatus of (4),
In the three-dimensional echo data, the surface position extracting means scans the scan line farther from the scan line start point, and a point having a luminance value larger than a certain threshold value is continuously longer than a predetermined distance. , Provided with a run extracting means for extracting the run closest to the scan line start point,
The boundary correction means includes a correction scan line specifying means for specifying a scan line where a boundary to be corrected exists,
A run closest to the scan line start point is extracted after the run extracted by the run extraction unit on the scan line specified by the corrected scan line specifying unit.

  According to the above configuration, the surface position extracting unit scans the scan line farther from the scan line start point in the three-dimensional echo data, and a point having a luminance value larger than a certain threshold is predetermined. By extracting the run closest to the scan line start point from the runs that are continuous over the distance, the desired object surface position in the 3D echo data stored in the 3D echo data storage means is extracted. The boundary correction unit specifies a scan line where the boundary to be corrected exists by the correction scan line specification unit, and scans next to the run extracted by the run extraction unit on the scan line specified by the correction scan line specification unit. By extracting a run close to the line start point, a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means is appropriately extracted.

In order to achieve the fourth object, the following configuration (6) is adopted. (6) Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to the living body and storing the obtained echo data of the three-dimensional region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Combining means for constructing a three-dimensional image using the cross-sectional echo data whose position is set by the cross-sectional position setting means;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The tomographic image constructing means for constructing a plurality of tomographic images having different orientations generated from the echo data in the three-dimensional echo data;
A cutting line moving means for moving a cutting line indicating a cross-sectional position in the plurality of tomographic images constructed by the tomographic image construction means;
Among the plurality of tomographic images constructed by the tomographic image constructing means, a tomographic image rotating means for rotating a specific tomographic image;
And changing a tomographic image other than the specific tomographic image among the plurality of tomographic images constructed by the tomographic image constructing means in conjunction with the rotation of the specific tomographic image by the tomographic image rotating means. It is characterized by doing.

According to the above configuration, the cross-sectional position setting means constructs a plurality of tomographic images having different directions generated by the tomographic image construction means from the echo data in the three-dimensional echo data,
The cutting line moving means moves the cutting line indicating the cross-sectional ultrasonic wave in the plurality of tomographic images constructed by the tomographic image constructing means, and the tomographic image rotating means is constructed by the tomographic image constructing means. Among them, a specific tomographic image is rotated, and among the multiple tomographic images constructed by the tomographic image constructing means, the tomographic images other than the specific tomographic image are linked to the rotation of the specific tomographic image by the tomographic image rotating means. Thus, the desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means is set.
The synthesizing means constructs a three-dimensional image using the cross-sectional echo data whose position is set by the cross-sectional position setting means. The display means displays a three-dimensional image.

In order to achieve the fifth object, the following configuration (7) or (8) is adopted.
(7) Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to the living body and storing the obtained echo data of the three-dimensional region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Combining means for constructing a three-dimensional image using the cross-sectional echo data whose position is set by the cross-sectional position setting means;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The tomographic image constructing means for constructing a plurality of tomographic images having different orientations generated from the echo data in the three-dimensional echo data;
A cutting line moving means for moving a cutting line indicating a cross-sectional position in the plurality of tomographic images constructed by the tomographic image construction means;
The tomographic image constructing means is provided with mask means for displaying echo data synthesized as the three-dimensional image by the synthesizing means and other echo data in different forms.

According to the above configuration, the cross-sectional position setting unit is configured such that the tomographic image constructing unit constructs a plurality of tomographic images having different directions generated from the echo data in the three-dimensional echo data, and the cutting line moving unit is configured to construct the tomographic image. The cutting line indicating the cross-sectional position is moved in a plurality of tomographic images constructed by the means, and the mask means displays the echo data constructed as a three-dimensional image by the synthesizing means and the other echo data in different forms. By doing so, a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means is set.
The synthesizing unit constructs a three-dimensional image using the cross-sectional echo data whose position is set by the cross-sectional position setting unit.
The display means displays a three-dimensional image.

(8) In the ultrasonic diagnostic imaging apparatus according to (7), the masking unit displays echo data for the synthesizing unit to synthesize as the three-dimensional image and other echo data in different forms. The display mode designating means for designating whether to display is provided.
According to the above configuration, the display mode designating unit designates whether echo data to be synthesized by the synthesizing unit as a three-dimensional image and other echo data are to be displayed in different modes or similar.

In order to achieve the sixth object, the following configuration (9) or (10) is adopted.
(9) Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to the living body and storing the obtained echo data of the three-dimensional region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
A synthesizing unit for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting unit and the surface echo data to which the shadow is added by the shadow adding unit;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus,
The shadow adding means is provided with a light beam angle setting means for setting a light beam angle for shadow addition as an angle in a coordinate system with a biological lumen axis or an ultrasound probe insertion axis as a coordinate axis, and the display means The ray angle in a coordinate system having the biological lumen axis or the ultrasonic probe insertion axis as a coordinate axis is displayed.

According to the above configuration, the cross-sectional position setting unit sets a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage unit.
The surface position extraction unit extracts a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage unit.
The shadow adding means sets the light ray angle for adding the shadow as the angle in the coordinate system with the biological lumen axis or the ultrasonic probe insertion axis as the coordinate axis, and the display means is three-dimensional. By displaying the image and displaying the ray angle in the coordinate system with the biological lumen axis or the ultrasonic probe insertion axis as the coordinate axis, the surface echo data indicated by the surface position extracted by the surface position extracting means is shaded. Is added.
The synthesizing unit synthesizes a three-dimensional image from the cross-sectional echo data and the surface echo data. The display means displays a three-dimensional image.

(10) In the ultrasonic diagnostic imaging apparatus according to (9), the display means displays the light beam angle three-dimensionally.
According to the said structure, a display means displays a light ray angle in three dimensions.

In order to achieve the seventh object, the following configuration (11) is adopted. (11) Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to the living body and storing the obtained echo data of the three-dimensional region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
A synthesizing unit for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting unit and the surface echo data to which the shadow is added by the shadow adding unit;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
Cross-sectional echo data whose position is set by the cross-sectional position setting means, and coordinate conversion means for converting the coordinates of the surface echo data whose position is extracted by the surface position extracting means,
A line-of-sight angle setting unit in which the coordinate conversion unit sets a line-of-sight angle formed by a line-of-sight direction when displaying the three-dimensional image as an angle in a coordinate system with a biological lumen axis or an ultrasound probe insertion axis as a coordinate axis. When,
And the display means displays the line-of-sight angle in a coordinate system having the biological lumen axis or the ultrasonic probe insertion axis as a coordinate axis.

According to the above configuration, the cross-sectional position setting unit sets a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage unit.
The surface position extraction unit extracts a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage unit.
The shadow adding means adds a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means.
The coordinate conversion unit sets the line-of-sight angle formed by the line-of-sight direction when the line-of-sight angle setting unit displays the three-dimensional image as an angle in a coordinate system with the biological lumen axis or the ultrasound probe insertion axis as the coordinate axis. The display means displays the line-of-sight angle in the coordinate system with the biological lumen axis or the ultrasound probe insertion axis as the coordinate axis, and the cross-section echo data whose position is set by the cross-section position setting means and the surface position extraction The coordinates of the surface echo data whose position is extracted by the means are converted.
The synthesizing unit synthesizes a three-dimensional image from the cross-sectional echo data and the surface echo data. The display means displays a three-dimensional image.

In order to achieve the eighth object, the following configuration (12) is adopted. (12) Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to the living body and storing the obtained echo data of the three-dimensional region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
Synthesis means for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting means and the surface echo data to which the shadow is added by the shadow adding means;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The synthesizing unit is provided with a cross-sectional surface boundary superimposing unit that superimposes a boundary line between the cross-sectional echo data and the surface echo data on the three-dimensional image as a cross-sectional surface boundary line,
The display unit displays the three-dimensional image in which the cross-sectional surface boundary superimposing unit superimposes the cross-sectional surface boundary line.

According to the above configuration, the cross-sectional position setting unit sets a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage unit.
The surface position extraction unit extracts a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage unit.
The shadow adding means adds a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means.
The synthesizing unit synthesizes a three-dimensional image from the cross-sectional echo data and the surface echo data, and the cross-sectional surface boundary superimposing unit superimposes the boundary line between the cross-sectional echo data and the surface echo data on the three-dimensional image as a cross-sectional surface boundary line.
The display unit displays a three-dimensional image in which the cross-sectional surface boundary superimposing unit superimposes the cross-sectional surface boundary line.

In order to achieve the first object, the following configuration (13) is adopted. (13) In the ultrasonic diagnostic imaging apparatus according to (1),
A scan line start point specifying means for specifying the position of the scan line start point is provided.

  According to the above configuration, the cross-sectional position setting unit sets a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage unit.

The surface position extracting unit is configured such that after the scan line start point specifying unit specifies the position of the scan line start point, the run extracting unit is farther on the scan line than the specified scan line start point in the three-dimensional echo data. And the run closest to the scan line start point is extracted from the runs in which a point having a luminance value greater than a certain threshold value continues for a predetermined distance or longer, and stored in the three-dimensional echo data storage means. A desired object surface position in the three-dimensional echo data is extracted.
The shadow adding means adds a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means.
The synthesizing unit synthesizes a three-dimensional image from the cross-sectional echo data and the surface echo data.
The display means displays a three-dimensional image.

In order to achieve the ninth object, the following configuration (14) is adopted. (14) Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to the living body and storing the obtained echo data of the three-dimensional region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
Synthesis means for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting means and the surface echo data to which the shadow is added by the shadow adding means;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The shadow adding means adds a shadow to the surface echo data with an organ surface color.

According to the above configuration, the cross-sectional position setting unit sets a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage unit.
The surface position extraction unit extracts a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage unit.
The shadow adding means adds a shadow with the organ surface color to the surface echo data indicated by the surface position extracted by the surface position extracting means.
The synthesizing unit synthesizes a three-dimensional image from the cross-sectional echo data and the surface echo data.
The display means displays a three-dimensional image.

In order to achieve the eighth object, the following configuration (15) is adopted. (15) Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to the living body and storing the obtained echo data of the three-dimensional region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
Synthesis means for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting means and the surface echo data to which the shadow is added by the shadow adding means;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The shadow adding means is
Provided with a display color specifying means for specifying the display color of the surface echo data,
A shadow is added to the surface echo data with the display color designated by the display color designation means.

According to the above configuration, the cross-sectional position setting unit sets a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage unit.
The surface position extraction unit extracts a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage unit.
The shade addition means designates the display color of the surface echo data by the display color designation means, and adds a shadow to the surface echo data with the display color designated by the display color designation means.
The synthesizing unit synthesizes a three-dimensional image from the cross-sectional echo data and the surface echo data.
The display means displays a three-dimensional image.

In order to achieve the first object, the following configuration (16) is adopted. (16) Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to and from a living body, and storing echo data of a three-dimensional region composed of a plurality of obtained continuous ultrasonic tomographic images;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
Synthesis means for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting means and the surface echo data to which the shadow is added by the shadow adding means;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The surface position extracting means is
Surface position specifying means for specifying a desired object surface position on a specific tomographic image among the plurality of ultrasonic tomographic images;
First gradient value calculating means for calculating the gradient value of the luminance value of the surface position specified by the surface position specifying means;
A second value for calculating a gradient value of a luminance value within a specific range from a point at which the first gradient value is calculated on a tomographic image other than the specific tomographic image among the plurality of ultrasonic tomographic images. A slope value calculating means of
By comparing the gradient values calculated by the first gradient value calculating unit and the second gradient value calculating unit, the tomographic image different from the tomographic image in which the surface position specifying unit specifies the object surface position Surface position specifying means for specifying the object surface position above,
It is characterized by having.

According to the above configuration, the cross-sectional position setting unit sets a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage unit.
In the surface position extracting means, the surface position specifying means constituting the surface position extracting means specifies a desired object surface position on a specific tomographic image among a plurality of ultrasonic tomographic images,
The first gradient value calculation means calculates the gradient value of the luminance value of the surface position designated by the surface position designation means,
The second gradient value calculating means calculates the luminance value within a specific range from the point where the first gradient value is calculated on a tomographic image other than the specific tomographic image among the plurality of ultrasonic tomographic images. Calculate the slope value,
The surface position specifying unit compares the gradient values calculated by the first gradient value calculating unit and the second gradient value calculating unit, so that the tomographic image is different from the tomographic image in which the surface position specifying unit specifies the object surface position. By specifying the object surface position on the image, the desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means is extracted.
The shadow adding means adds a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means.
The synthesizing unit synthesizes a three-dimensional image from the cross-sectional echo data and the surface echo data.
The display means displays a three-dimensional image.

In order to achieve the first object, the following configuration (17) is adopted. (17) Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to and from a living body, and storing echo data of a three-dimensional region composed of a plurality of obtained continuous ultrasonic tomograms;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
Synthesis means for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting means and the surface echo data to which the shadow is added by the shadow adding means;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The surface position extracting means is
Surface tracing means for automatically tracing a desired object surface position sequentially on a plurality of successive ultrasonic tomographic images is provided.

According to the above configuration, the cross-sectional position setting unit sets a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage unit.
The surface position extraction means is such that the surface tracing means automatically traces a desired object surface position sequentially in sequence on the plurality of successive ultrasonic tomographic images,
A desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means is extracted.
The shadow adding means adds a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means.
The synthesizing unit synthesizes a three-dimensional image from the cross-sectional echo data and the surface echo data.
The display means displays a three-dimensional image.

In order to achieve the first object, the following configuration (18) is adopted. (18) In the ultrasonic diagnostic imaging apparatus according to (17),
The surface tracing means is provided with luminance change point searching means for searching the surface position as a change point of the luminance value on an arc for searching for a desired object surface position, and the change point is newly determined as the center of the arc. In this case, a desired object surface position is traced sequentially.
According to the above configuration, the surface trace means searches for the surface position as the change point of the brightness value on the arc for the brightness value change point search means to search for the surface position, and the change point is re-examined in the arc. By repositioning as the center of the surface, the surface position is traced sequentially.

In order to achieve the first object, the following configuration (19) is adopted. (19) In the ultrasonic diagnostic imaging apparatus of (17), (18),
The surface position extracting means includes trace start point designating means for designating a trace start point to be traced on the ultrasonic tomographic image.
According to the above configuration, the surface position extracting means specifies the trace start point to be traced on the ultrasonic tomographic image by the trace start point specifying means, and the surface tracing means has a plurality of continuous ultrasonic tomographic images on the ultrasonic tomographic image. The desired object surface in the 3D echo data stored in the 3D echo data storage means is extracted by automatically tracing the desired object surface position sequentially.

In order to achieve the first object, the following configuration (20) is adopted. (20) In the ultrasonic diagnostic imaging apparatus of (17), (18), (19),
The surface position extraction means includes tomographic image construction means for constructing a plurality of different tomographic images generated from echo data in the three-dimensional echo data;
The trace start point designating unit designates the trace start point on the tomographic images having directions different from those of the plurality of continuous ultrasonic tomographic images constructed by the tomographic image constructing unit.

According to the above configuration, the surface position extracting means constructs a plurality of tomographic images having different directions generated from the echo data in the three-dimensional echo data by the tomographic image constructing means constituting the surface position extracting means,
The trace start point designating unit designates a trace start point on a tomographic image having a different direction from a plurality of continuous ultrasonic tomographic images constructed by the tomographic image constructing unit,
By tracing, a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means is extracted.

  ADVANTAGE OF THE INVENTION According to this invention, the ultrasonic diagnosing device which can confirm whether extraction of the object surface is performed appropriately can be provided.

Embodiments of the present invention will be described below with reference to the drawings.
(First embodiment)
1 to 16 relate to the first embodiment of the present invention, FIG. 1 is a block diagram showing the configuration of the ultrasonic diagnostic imaging apparatus of the first embodiment of the present invention, and FIG. 2 is a CPU and image processing. FIG. 3 is a flowchart showing the details of image processing performed by the processor, FIG. 3 is a flowchart showing the details of setting the cross-sectional position in FIG. 2, and FIG. 4 is a diagram showing a specific example of an ultrasound image at four cross-sectional positions. FIG. 5 is a diagram showing a simple three-dimensional image in which no surface position is extracted, FIG. 6 is a diagram showing hatched portions in FIG. 4 that are not shown as a cross section in FIG. 5, and FIG. FIG. 8 is a spatial explanatory diagram of the angle of FIG. 7, FIG. 9 is a flowchart showing details of the processing contents of the surface position extraction in FIG. 2, and FIG. 10 is a scan for extracting the surface position. Explanatory drawing showing the state of scanning from the starting point FIG. 11 is a flowchart showing details of processing for adding shadows, FIG. 12 is an explanatory diagram of processing for adding shadows, FIG. 13 is a diagram showing a setting sub-screen showing setting values for the light beam direction, and FIG. FIG. 15 is a diagram showing a non-display portion of four cross sections in a three-dimensional image by hatching, and FIG. 16 is a diagram showing a finally constructed three-dimensional image.

  As shown in FIG. 1, the ultrasonic diagnostic imaging apparatus 1 according to the present embodiment is obtained by an ultrasonic observation unit 2 that transmits and receives ultrasonic waves and displays a real-time echo image, and the ultrasonic observation unit 2. And an image processing unit 3 that performs image processing for displaying a three-dimensional image based on the echo data. Further, an ultrasonic probe 4 having means for inserting an ultrasonic transducer (transducer) for transmitting and receiving ultrasonic waves into a body cavity and performing a spiral scan of the ultrasonic transducer, and the ultrasonic probe 4 are provided. A driving unit 5 to be driven is connected to the ultrasonic observation unit 2.

  The ultrasonic observation unit 2 includes a transmission / reception unit 6 that transmits / receives ultrasonic waves to / from the drive unit 5, an A / D converter 7 that converts the echo signal captured by the transmission / reception unit 6 into digital echo data, A frame memory 8 for storing the eco data converted by the D converter 7, a digital scan converter (abbreviated as DSC) 9 for converting the echo data stored in the frame memory 8 into image data of a desired television system, and a DSC 9 D / A converter 10 for converting the output digital image signal into an analog signal, monitor 11 for inputting the output image signal of D / A converter 10 and displaying a real-time echo image, drive unit 5, transmission / reception unit 6, a system controller 12 that controls each part such as the A / D converter 7, the frame memory 8, and the like.

  The image processing unit 3 includes a CPU 13 that controls image processing, a main storage device 14 that stores data of each image processing result, a control unit 15 that transmits and receives commands to and from the system controller 12, and an ultrasonic observation A polar coordinate conversion unit 16 that converts continuous sound ray data from the unit 2 into a plurality of continuous two-dimensional image data; an image data storage device 17 that stores image data converted by the polar coordinate conversion unit 16; and a surface position An image processor 18 for performing various types of image processing such as extraction, shading addition, composition, coordinate transformation, etc. at high speed, a first external storage device 19 comprising a hard disk or the like for storing information such as processing programs and backup data, Operation of the second external storage device 20 composed of a magneto-optical disk or the like for backing up the first external storage device 19 and a keyboard A terminal 21, a frame buffer 22 that temporarily stores data after image processing, a D / A converter 23 that converts an output image signal of the frame buffer 22 into an analog signal, and an output image signal of the D / A converter 23 are input. A cover-like touch panel 25 provided on the display surface of the three-dimensional image processing monitor 24 for displaying a three-dimensional image after image processing and for inputting an image display area setting and the like. And is configured.

  The operation surface of the operation terminal 21 is provided with a mask switching key 21a and a simple three-dimensional construction key 21b. Further, since the touch panel 25 is provided, the CPU 13 can recognize that the user touches the 3D image processing monitor 23 with a finger. Each unit of the image processing unit 3 is connected via a data transfer bus 26 so that image data and the like are exchanged.

  In this embodiment, as will be described later, surface position extraction means is provided. This surface position extraction means is located on the scan line from the scan line start point in the three-dimensional echo data output from the ultrasonic observation unit 2. Is scanned farther than the threshold that eliminates noise due to a run that has a luminance value greater than a certain threshold that is set for surface extraction. By extracting the run closest to the point to prevent erroneous extraction due to noise, etc., the surface of the target object such as an organ is accurately extracted, and the extracted positions are synthesized to accurately correspond to the target surface. It is a great feature that a three-dimensional image can be displayed.

Hereinafter, the operation of the ultrasonic observation unit 2 will be described.
When performing ultrasonic observation, the ultrasonic probe 4 is inserted into the body cavity, and the ultrasonic transducer in the ultrasonic probe 4 is spirally formed by the transmission / reception unit 6 and the drive unit 5 based on the control of the system controller 12. The echo data of the three-dimensional region in the body cavity is taken in by driving and transmitting / receiving ultrasonic waves into the living body.

  For example, this male screw arranged along the axial direction of the ultrasonic probe 4 by rotating a motor built in the drive unit 5 of the ultrasonic probe 4 and attached to the rear end of the male screw screwed into the female screw. The ultrasonic transducer attached to the tip of the probe is driven to rotate, and the ultrasonic waves are transmitted radially in the direction perpendicular to the axial direction (longitudinal direction) of the ultrasonic probe 4 and reflected by the changing portion of the acoustic impedance. Receives reflected ultrasound (echo signal). In addition, an echo signal for a three-dimensional area (by spiral scanning) is obtained by scanning linearly in the axial direction of the rotation axis for each pitch of the male screw along with the rotation. This echo signal is converted into a digital signal by the A / D converter 7 and becomes echo data.

  The obtained echo data is stored in the frame memory 8 and displayed as a real-time echo image (ultrasonic observation image) on the monitor 11 via the DSC 9 and the D / A converter 10. At the same time, it is sent from the subsequent stage of the A / D converter 7 to the image processing unit 3 in the form of continuous one-dimensional echo data (sound ray data) as a digital signal. At this time, incidental data such as the image size of the two-dimensional image data and the distance between the images are also sent to the image processing unit 3 at the same time.

Next, the operation of the image processing unit 3 will be described.
The sound ray data obtained by spiral scanning within the body cavity of the ultrasonic probe 4 and sent from the ultrasonic observation unit 2 to the image processing unit 3 is converted into image data by the polar coordinate conversion unit 16. Then, the image data storage device 17 writes the image data together with the accompanying data in the order in which they are captured as a plurality of continuous two-dimensional images.

  The image data storage device 17 functions as a three-dimensional echo data storage unit. The image processing processor 18 performs image processing such as surface position extraction, shading addition, composition, coordinate conversion, and the like based on the image data and auxiliary data stored in the image data storage device 17.

  Then, the processed image data is sent to the frame buffer 22, temporarily stored, and sent to the three-dimensional image processing monitor 24 via the D / A converter 23. Thereafter, a three-dimensional image based on the echo data is displayed on the three-dimensional image processing monitor 24.

The process of each image processing by the image processor 18 is controlled by the CPU 13.
Details of the image processing performed by the CPU 13 and the image processing processor 18 will be described below with reference to the flowchart of FIG. 2 and the explanatory diagrams of the processing steps shown in FIGS.

  In step S1 shown in FIG. 2, the image data of the three-dimensional area stored in the image data storage device 17 is read together with the accompanying data. In step S2 shown in FIG. 2, a cross-sectional position is set.

Details of step S2 will be described below.
FIG. 3 is a flowchart showing the detailed contents of the specific example of step S2. FIG. 4 shows a plurality of, specifically four cross sections (cross-section echo data) constructed by the tomographic image construction means when three-dimensionally displayed on the three-dimensional image processing monitor 24, and is shown in a satin pattern. The portion is a region of interest 31 such as a lesion.

  This cross section is displayed on the three-dimensional image processing monitor 24 using the image data read from the image data storage device 17 in step S1. FIG. 16 shows a three-dimensional image finally constructed by appropriately setting the four cross sections. The cross sections A, B, C, and D in FIG. 4 are the cross sections A, B, and C in FIG. , D (FIG. 4 is a cross-section after the translation or rotation of the cross-section A etc. in FIG. 16 so that the cross-section including the lesion is actually obtained from the state of FIG. 16 as described below. Equivalent to

  That is, the cross section C is perpendicular to the cross sections A and D and includes the cutting line + shown in FIG. 4, and the cross section B similarly includes the cutting line x shown in FIG. The section A is a section perpendicular to the sections B and C and including the cutting line Δ shown in FIG. 4, and the section D is a section including the cutting line □ shown in FIG.

  In FIG. 16, the z-axis is set to the insertion axis of the ultrasonic probe 4 (longitudinal direction of the ultrasonic probe 4) as will be described later, so that the cross-sections A and D perpendicular to the z-axis and parallel to each other are radial surfaces, A description will be given assuming that the cross sections B and C parallel to the z-axis are linear surfaces. In this case, the cross section A is described as radial before the radial scanning front surface, and the cross section D is described as radial after the radial scanning rear surface. Also, as shown in FIG. 16, the cross section B is described as linear horizontal and the cross section C as linear upper, corresponding to the case where the y-axis is set upward and three-dimensional display is performed.

  The cutting line indicated by the dotted line in FIG. 4, the frame line of the cross section being operated, etc., are displayed in a yellow color so that they can be easily distinguished from the cross section displayed in black and white grayscale. To be.

In step S21 shown in FIG. 3, the user touches the Δ cursor on the cross section B (that is, linear horizontal) in FIG. 4 with a finger so that the region of interest 31 such as a lesion is displayed on the cross section A via the touch panel 25. Then, the Δ cursor is slid in the direction of the arrow (left and right in FIG. 4). Then, the cutting line Δ moves in conjunction with each other, and the region of interest 31 is displayed on the section A (before radial) along the cutting line Δ.
As described above, the tomographic image constructing means or the tomographic image constructing function includes a cutting line moving means or a cutting line moving function for moving the cutting line indicating the cross-sectional position.

  In step S22 shown in FIG. 3, the user rotates the cross section A so that the region of interest 31 is in an appropriate orientation. Specifically, a point indicated by a symbol K in the cross section A in FIG. 4 is touched with a finger, and the finger is moved in the arrow direction. As a result, the entire image of the cross section A rotates in the direction of the arrow about the center point of the cross section A indicated by reference numeral 0. In the cross section A of FIG. 4, the region of interest 31 is set to be directly below. That is, it has a tomographic image rotating means for rotating the tomographic image or a tomographic image rotating function.

In step S <b> 23 shown in FIG. 3, the cutting lines + and x are moved so that the cutting line + or x comes on the region of interest 31. The movement method is the same as that for the Δ cursor. Then, the region of interest 31 is displayed on the cross section B or the cross section C. FIG. 4 shows a case where the cutting line x is moved.
In step S24 shown in FIG. 3, the cutting lines Δ and □ are moved so that the region of interest 31 is included between the cutting lines Δ and □.

Thus, the setting of the cross-sectional position of the three-dimensional image shown in FIG. 16 is completed.
As described above, the cutting line moving means moves the cutting line indicating the cross-sectional position on the specific tomographic image among the plurality of tomographic images having different directions constructed by the tomographic image building means (function), and the tomographic image rotating means Since the tomogram is rotated and the tomograms other than the specific tomogram are changed in conjunction, the cross section can be set so that the lesion passes through the lesion no matter where the lesion exists on the tomogram. Can be diagnosed.

  By the way, when the user presses the simple three-dimensional construction key 21b after the cross-sectional position setting in step S2 is completed, the simple three-dimensional that does not perform the surface position extraction as shown in FIG. 5 for reference to the user. An image is constructed and displayed on the three-dimensional image processing monitor 24.

  In addition, the mask means or the display mode designation means so that the cross section can be set or displayed so that the distinction and correspondence between the portion displayed as a three-dimensional image and the portion not displayed on the tomographic image can be easily understood as follows. Is provided.

  In FIG. 6, portions of the cross section shown in FIG. 4 that do not appear as the cross section of the simple three-dimensional image shown in FIG. 5 are indicated by hatching. When the user presses the mask switching key 21a on the operation terminal 21, the hatched portion is displayed darker than the unhatched portion, and the three-dimensional perspective display of FIG. 6 and the corresponding cross-sections are displayed. Correspondence and mutual correspondence with each cross section are made easy to understand. When the mask switching key 21a is pressed again, the original display shown in FIG. 4 is restored. Further, the above-described processing from step S21 to step S24 can be performed while the hatched portion is darkly displayed.

  By operating the mask switching key 21a and specifying or selecting a display form in this way, echo data for synthesizing a three-dimensional image and other echo data (echoes that are not actually displayed as a three-dimensional image). Display mode designation means is provided for designating whether to display data in a different mode or similar display.

In step S3 shown in FIG. 2, the line-of-sight direction is set.
Details of step S3 will be described below.

  In step S3, the set value of the current line-of-sight direction is displayed on the three-dimensional image processing monitor 24 as a setting sub-screen as shown in FIG. FIG. 8 is a diagram for explaining a spatial relationship with the angles θ and φ shown in FIG. 7, and the coordinate axis 0-xyz is taken in the image data. At this time, the z-axis is the direction of the biological lumen axis.

  In the present embodiment, since the ultrasonic probe 4 is inserted into the body cavity along the biological lumen axis, the z-axis is assumed to be in the direction of the insertion axis of the ultrasonic probe 4. In the present embodiment, 45 ° is set as a default value for the angles θ and φ so that the inside of the body cavity can be expressed three-dimensionally from an oblique direction without changing the setting.

  The user touches one point on the sub-screen indicated by the symbol E with a finger so that the line-of-sight direction can be changed to a desired direction via the touch panel 25, and the circumference of the center of the sub-screen indicated by the symbol O Slide in the direction. Then, the line segment OE moves, and the line-of-sight angle θ is changed and set in conjunction with it. In this way, the polar coordinate conversion unit 16 as coordinate conversion means converts polar coordinates. Further, the operation method is the same for the angle φ except that the point touched with the finger is changed to x ′.

The display shown in FIG. 8 is also displayed on the three-dimensional image processing monitor 24 in conjunction with the setting sub-screen shown in FIG. 7 as a setting sub-screen. Then, the line-of-sight direction of the three-dimensional image shown in FIG. 16 is set.
As described above, in the present embodiment, the coordinate conversion unit converts the coordinates of the cross-sectional echo data and the surface echo data, and the line-of-sight angle setting unit determines the line-of-sight angle formed by the line-of-sight direction when displaying the three-dimensional image. It is set as an angle in the coordinate system with the lumen axis or the ultrasound probe insertion axis as the coordinate axis, and the display means sets the viewing angle in the coordinate system with the biological lumen axis or the ultrasound probe insertion axis as the coordinate axis. In this way, the line-of-sight angle of the three-dimensional image can be set more easily. It is also easy to understand intuitively and anatomically.

  In step S4 shown in FIG. 2, the position of the surface of an object such as an organ is extracted. Details of step S4 will be described below.

FIG. 9 is a flowchart showing the detailed contents of step S4. FIG. 10 is a diagram for explaining a state of scanning from the scan line start point O for extracting the surface position. Steps S411 to S428 are an automatic extraction routine for automatically extracting the surface position, and steps S429 to 442 are a display / correction routine for displaying and correcting the automatically detected boundary.
The details of the automatic extraction routine will be described below. This automatic extraction routine includes run extraction means for preventing a surface from being erroneously extracted due to noise or the like and extracting a run corresponding to the surface position.

  In step S411 shown in FIG. 9, the image data is smoothed. The processing unit for performing the smoothing is made variable so as to be optimal with respect to the ultrasonic resolution when the ultrasonic transducer of the ultrasonic probe 4 scans.

  In step S412 shown in FIG. 9, threshold processing for surface extraction is performed on the image data. A point having a luminance value less than or equal to the threshold value can be replaced with 0.

  In the next step S413 shown in FIG. 9, the length of the threshold value that a run having a length shorter than this among the points (runs) in which the points equal to or greater than the threshold value are connected is determined as noise. , Is assigned to the variable run0. This input is performed via the operation terminal 21.

In step S414 shown in FIG. 9, 0 is substituted into the variable i. This variable i indicates the number of a two-dimensional image to be processed among a plurality of continuous two-dimensional images written as image data in the image data storage device 17 (for this reason, it may be abbreviated as “image i” in some cases). ). In this embodiment, it is assumed that all 50 continuous two-dimensional images are processed,
0 ≦ i ≦ 49
And In addition, it is not limited to what processes with respect to all the images, The case where it processes only with respect to a specific image is also included.

In step S415 shown in FIG. 9, 0 is substituted into the variable s. This variable s indicates a scan line to be processed among the scan lines emitted farther from the scan line start point in order to extract the surface position (for this reason, it may be abbreviated as scan line s). . In the present embodiment, for example, 36 scan lines are emitted radially at 10 ° intervals,
0 ≦ s ≦ 35
And Note that, in the case of this interval, the extracted boundary is point-like, but if this interval is reduced, the extracted boundary is almost linear, and this embodiment includes such a case.

  In step S416 shown in FIG. 9, the coordinates of the scan line start point are set as the processing point address. The processing point address consists of an x address and ay address, and indicates the x coordinate and y coordinate of the point currently being processed. In this embodiment, the scan line start point is set at the center of each two-dimensional image. In FIG. 10, the starting point is indicated as point O.

In step S417 shown in FIG. 9, 0 is substituted into the variable run. The variable run is used to measure the run length.
In step S418 shown in FIG. 9, the processing point address is moved to the address of the next point on the scan line s.

  In step S419 shown in FIG. 9, it is determined whether the luminance value of the point indicated by the processing point address is larger or smaller than the threshold value of the threshold value processing performed in step S412. If it is larger, the process jumps to step S420, and if smaller, the process jumps to step S417.

In step S420 shown in FIG. 9, the x-point of the processing point address is assigned to the run-th variable p (run) of the one-dimensional array variable p, and the processing point is assigned to the run-th variable q (run) of the one-dimensional array variable q. Substitute the y address of the address.
In step S421 shown in FIG. 9, 1 is added to the variable run.

  In step S422 shown in FIG. 9, it is determined whether or not the variable run matches run0. If they match, the process jumps to step S423, and if they do not match, the process jumps to step S418.

  In step S423 shown in FIG. 9, p (run-run0) is substituted for the two-dimensional array variable X (s, i), and q (run-run0) is substituted for the two-dimensional array variable Y (s, i). In this way, the coordinates of the run closest to the scan line start point are extracted as X (s, i) and Y (s, i) among the runs in which points having a luminance value greater than the threshold value are continuous for the distance run0 or more.

In step S424 shown in FIG. 9, X (s, i) and Y (s, i) are output to the image data storage device 17. That is, in step S424, the address of the point M shown in FIG.
In step S425 shown in FIG. 9, 1 is added to the variable s. That is, the scan line to be processed is moved to the adjacent scan line.

  In step S426 shown in FIG. 9, it is determined whether or not the variable s matches 35 + 1. That is, it is determined whether or not the last scan line has been processed in the two-dimensional image i. If they match, the process jumps to step S427, and if they do not match, the process jumps to step S416.

  In step S427 shown in FIG. 9, 1 is added to the variable i. That is, the two-dimensional image to be processed is moved to the adjacent two-dimensional image.

  In step S428 shown in FIG. 9, it is determined whether i matches 49 + 1. That is, it is determined whether or not the last two-dimensional image has been processed among the two-dimensional images written to the image data storage device 17. If they match, the process jumps to step S429, and if they do not match, the process jumps to step S415.

  Thus, in the automatic extraction routine, the coordinates of the surface of the body cavity, that is, the point recognized as the boundary, are written in the image data storage device 17 for all the scan lines on all the two-dimensional images.

This automatic extraction routine can eliminate most surface mis-extraction due to noise and the like. In the present embodiment, a display / correction routine for displaying a corrected boundary having a boundary correcting means or a boundary correcting function for correcting a boundary that has been erroneously extracted and cannot be excluded even by the automatic extraction routine. Is provided.
Therefore, the object surface position is corrected by the boundary correction function, so that an incorrect three-dimensional image can be displayed by correcting a part where the object surface is not properly extracted and further reducing erroneous extraction such as noise. Yes.

Details of the display / correction routine will be described below.
In step S429 shown in FIG. 9, X (s, i) and Y (s, i) are read for all integers i and s satisfying 0 ≦ i ≦ 49 and 0 ≦ s ≦ 35. That is, the coordinates of the point recognized as the boundary are read from the image data storage device 17.

  In step S430 shown in FIG. 9, boundary points whose coordinates are indicated by X (s, i) and Y (s, i) are superimposed on each threshold-processed two-dimensional image. That is, it has boundary superimposing means or a boundary superimposing function so that it can be confirmed whether or not the object surface has been properly extracted, and coordinates corresponding to the extracted surface for each two-dimensional image by this boundary superimposing function. The positions X (s, i) and Y (s, i) are superimposed in a dot shape.

In step S431 shown in FIG. 9, a list of the two-dimensional images on which the boundary points are superimposed is displayed on the three-dimensional image processing monitor 24.
In step S432 shown in FIG. 9, a two-dimensional image i0 to be corrected and a scan line s0 to be corrected are designated.

  In FIG. 10, this point is shown as a point M (X (s0, i0), Y (s0, i0)). This point is a point that is erroneously extracted before the point to be extracted as a boundary as viewed from the scan line start point O due to a residue in the body cavity, noise, or the like. The designation method is designated by touching the vicinity of the scan line with a finger via the touch panel 25. In FIG. 10, i and i0 are mixedly displayed on the image of the general image i because of the relationship in which the description of the image i0 to be corrected is illustrated (in FIG. 10, i0 is i. S0 is s + 2).

In step S433 shown in FIG. 9, the coordinates of the far end point of the run of the point M (X (s0, i0), Y (s0, i0)) on the scan line s0 are set as the processing point address. In FIG. 10, this point is indicated by N.
Steps S434 to S439 shown in FIG. 9 are basically the same as steps S417 to S422, and a description thereof will be omitted.

  In step S440 shown in FIG. 9, p (run-run0) is substituted for the two-dimensional array variable X (s0, i0), and q (run-run0) is substituted for the two-dimensional array variable Y (s0, i0). Then, next to the mis-extracted point, the coordinates of the run close to the scan line start point are newly extracted as X (s0, i0) and Y (s0, i0).

  In this way, the coordinates of the run closest to the scan line start point after the mis-extracted point among the runs in which the luminance value greater than the threshold value is continuous for the distance run0 or more are X (s0, i0), Y Extract as (s0, i0). In FIG. 10, this point is indicated by M ′ (X (s0, i0), Y (s0, i0)).

  In step S441 shown in FIG. 9, X (s0, i0) and Y (s0, i0) are output to the image data storage device 17 and overwritten. That is, the point M (X (s0, i0), Y (s0, i0)) shown in FIG. 10 is corrected to the point M ′ (X (s0, i0), Y (s0, i0)), and an error due to noise or the like occurs. The extracted point M (X (s0, i0), Y (s0, i0)) is corrected.

  In step S442 shown in FIG. 9, a message indicating whether correction is still necessary is output on the three-dimensional image processing monitor 24, and the user responds via the operation terminal 21. If correction is necessary, the process jumps to step S432, and if correction is not necessary, the process proceeds to step S5 shown in FIG.

In this way, the display / correction routine corrects points that have been erroneously extracted due to residues in the body cavity, noise, or the like.
In step S5 shown in FIG. 2, a shadow is added to the surface extracted in step S4.
Hereinafter, the detailed processing content of this step S5 is demonstrated.

  FIG. 11 shows a flowchart of the detailed processing contents of step S5. FIG. 12 is a diagram illustrating a process for adding a shadow.

  In step S511 shown in FIG. 11, image data is modeled. In the present embodiment, a plurality of polygons called polygons are assumed from the points extracted as boundaries (surfaces of body cavities) in step S4.

  In FIG. 12, two of these polygons, two triangles having vertices at points Ms, Ms + 1, M's, M's + 1 extracted in step S4, .DELTA.Ms Ms + 1 M's. And ΔMs + 1 M ′s M ′s + 1. Here, the scan line start point 0 and the points Ms and Ms + 1 are points on the two-dimensional image i, and the scanline start point 0 'and the points M's and M's + 1 are points on the two-dimensional image i + 1. is there. The points Ms and M's and the points Ms + 1 and M's + 1 have the same scan line number. The coordinates of the four points are as follows.

Ms (X (s, i), Y (s, i))
Ms + 1 (X (s + 1, i), Y (s + 1, i))
M ′s (X (s, i + 1), Y (s, i + 1))
M ′s + 1 (X (s + 1, i + 1), Y (s + 1, i + 1))
In this step S511, a normal vector of each polygon is calculated from the coordinate value of the vertex. In FIG. 12, the normal vectors of each polygon are shown as Vs and V's.

  In step S512 shown in FIG. 11, the coordinates of the polygon vertices are coordinate-converted corresponding to the line-of-sight direction set in step S3. At this time, the normal vector of each polygon is also converted.

In step S513 shown in FIG. 11, hidden surface processing is performed on each polygon. That is, the polygon that is behind the polygon is deleted from the line of sight.
In step S514 shown in FIG. 11, the light beam direction is set. That is, a light beam angle setting means or a light beam angle setting function for setting a light beam direction (light beam angle) is provided.

  In step S514, the set value of the current light direction is displayed on the three-dimensional image processing monitor 24 as a setting sub-screen as shown in FIG.

  FIG. 14 is a diagram for explaining a spatial relationship with the angles θ and φ shown in FIG. The display shown in FIG. 14 is also displayed on the 3D image processing monitor 24 as a setting sub-screen in conjunction with the setting sub-screen shown in FIG. Since the operation such as the setting method is the same as that in step S3, the description thereof is omitted.

  In the present embodiment, the light beam angle setting means sets the light beam angle for shadow addition as the angle in the coordinate system with the biological lumen axis or the ultrasound probe insertion axis as the coordinate axis, and the display means By displaying the ray angle in the coordinate system with the cavity axis or ultrasound probe insertion axis as the coordinate axis, the desired object surface is expressed more three-dimensionally, and the ray angle is more intuitive and anatomical. To make it easy to understand.

Step S515 shown in FIG. 11 is a shading such as flat shading, glow shading, phone shading, and depth shading depending on the distance from the viewpoint of each polygon and the angle between the normal vector and the ray direction set in step S514. Is used to determine the brightness of points in each polygon.
In this way, the surface shadow is added.

  Step S6 shown in FIG. 2 cuts a non-display portion of the cross section whose position is set in step S2. The hatched portion in FIG. 15 shows a non-display portion of the four cross sections of the three-dimensional image shown in FIG. 16, and the data in this portion is erased.

  Step S7 shown in FIG. 2 performs coordinate conversion of the display portion left in step S6 among the four cross sections of the three-dimensional image corresponding to the line-of-sight direction set in step S3.

  Step S8 shown in FIG. 2 performs a composition process. That is, by synthesizing the surface in which the position is extracted in steps S4 and S5 and the shade is added and the cross section in which the non-display portion is cut and the coordinate conversion is performed in steps S6 and S7, FIG. The three-dimensional image shown in FIG. In FIG. 16, the surface data portion is indicated by E.

In step S9 shown in FIG. 2, the boundary line between the cross section and the surface is superimposed on the three-dimensional image as, for example, a green boundary line shown in FIG.
That is, in the present embodiment, there is a cross-sectional surface boundary superimposing unit that superimposes the boundary line between the cross-section and the surface on the three-dimensional image, and the cross-sectional surface boundary superimposing unit adds the cross-sectional echo data and the surface echo data boundary line to the three-dimensional image. It is superimposed as a cross-sectional surface boundary line, and the display means displays a three-dimensional image with the cross-sectional surface boundary line superimposed so that the echo data and the surface image data can be easily distinguished.

In step S10 shown in FIG. 2, the 3D image constructed in FIG. 8 is displayed on the monitor 24 for 3D image processing.
As described above, the CPU 13 and the image processor 18 serve as surface position extraction means, shadow addition means, synthesis means, run extraction means, boundary superimposition means, tomographic image construction means, coordinate conversion means, and cross-sectional surface boundary superimposition means. Function.

  The touch panel 25 functions as a cross-section position setting unit, a boundary correction unit, a correction scan line designation unit, a cutting line movement unit, a tomographic image rotation unit, a mask unit, a ray angle setting unit, and a line-of-sight angle setting unit.

The mask switching key 21a functions as a display mode designation unit.
The image data storage device 17 functions as a three-dimensional echo data storage unit.
The three-dimensional image processing monitor 24 functions as display means.

The present embodiment has the following effects.
In the present embodiment, the run extracting means scans the scan line far, and the run closest to the scan line start point among the runs in which the luminance value greater than a certain threshold value continues for a predetermined distance or more. Therefore, a run less than the predetermined distance can be almost eliminated as noise. For this reason, a desired object surface can be accurately expressed without being disturbed by noise or the like.

In the present embodiment, various types of noise removal can be performed by inputting a length that a run having a length shorter than this should be determined as noise in step S413.
In addition, even if there is a part that is erroneously extracted due to noise or the like, the extracted boundary can be corrected by the boundary correction function, so that the object surface with less influence of noise or the like can be extracted.
In the present embodiment, the image shown in FIG. 10 can be referred to, so that the boundary can be corrected while checking whether the correction is appropriate.

  In other words, the extracted object surface position is superimposed as a boundary on all of a plurality of consecutive ultrasonic tomographic images or a specific ultrasonic tomographic image by the boundary superimposing function and displayed on the display means, so that the object surface can be extracted appropriately. It can be confirmed whether or not it is done.

In this embodiment, when the simple three-dimensional construction key 21b is pressed, a simple three-dimensional image without surface position extraction as shown in FIG. 5 is displayed for reference to the user. You can grab a 3D image.
In addition, the cutting line moving unit moves the cutting line indicating the cross-sectional position on the specific tomographic image among the tomographic images having different directions constructed by the tomographic image building unit, and the tomographic image rotating unit rotates the tomographic image. Because the tomographic image other than the specific tomographic image is changed in conjunction, the cross-section can be set so that it passes through the lesion regardless of the position of the lesion on the tomographic image. Can be diagnosed.

  Further, the tomographic image constructing means constructs a plurality of tomographic images having different directions generated from the echo data in the three-dimensional echo data, and the cutting line moving means determines the cross-sectional position in the constructed tomographic images. By moving the cutting line shown, the mask means can display the echo data synthesized as a three-dimensional image and the other echo data in different modes, so that it is displayed as a three-dimensional image on the tomographic image. The distinction between the parts and the parts that are not displayed, and the correspondences are easy to understand.

  In addition, a normal tomographic image display, echo data for displaying as a three-dimensional image, and other echo data by changing the mode, a display for setting a cross section, and two types of display Since the display mode designating means for designating such a mask is provided, it is possible to remove such a mask when it is in the way and perform a normal diagnosis in an arbitrary cross section using a plurality of tomographic images.

Further, in the present embodiment, the light beam angle setting means sets the light beam angle for adding a shadow as an angle in a coordinate system having the biological lumen axis or the ultrasonic probe insertion axis as a coordinate axis, and the display means Because it displays the light ray angle in the coordinate system with the biological lumen axis or the ultrasound probe insertion axis as the coordinate axis, the desired object surface can be expressed more three-dimensionally, and the light angle can be more intuitive and anatomical. Can be set easily.
In the present embodiment, since the display means displays the light beam angle in a three-dimensional manner, it is easy to grasp the light beam angle sensuously.

  In the present embodiment, the coordinate conversion means converts the coordinates of the cross-sectional echo data and the surface echo data, and the line-of-sight angle setting means determines the line-of-sight angle formed by the line-of-sight direction when displaying the three-dimensional image. Set as the angle in the coordinate system with the cavity axis or ultrasound probe insertion axis as the coordinate axis, and the display means displays the gaze angle in the coordinate system with the biological lumen axis or ultrasound probe insertion axis as the coordinate axis Therefore, the viewing angle of the three-dimensional image can be set more easily. In addition, it can be set intuitively and anatomically.

  In the present embodiment, the cross-sectional surface boundary superimposing unit superimposes the cross-sectional echo data and the boundary line of the surface echo data as a cross-sectional surface boundary line on the three-dimensional image, and the display unit superimposes the cross-sectional surface boundary line 3 Since a three-dimensional image is displayed, it is easy to distinguish between echo data and surface image data.

(Modification of the first embodiment)
In this embodiment, the touch panel 25 is used, but instead of the touch panel 25, a cursor may be displayed on the screen and another pointing device such as a mouse, a light pen, or a trackball may be used.

Further, the threshold processing of the present embodiment includes binarization in that the luminance value of a point having a luminance value equal to or lower than the threshold is replaced with 0.
In this embodiment, the line-of-sight direction and the ray direction can be set for the display shown in FIGS. 7 and 13 using the touch panel 25, but the display shown in FIGS. You may make it possible to set for.

Further, in the present embodiment, the setting of the cross-sectional position in step S2 is provided before the surface position extraction in step S4, but the order may be reversed.
In this embodiment, when the mask switching key 21a is pressed, the display is switched to the display shown in FIG. 6, but when the order is reversed, the display may be switched to the display shown in FIG. 15 by pressing the mask switching key 21a.

  In the present embodiment, the ultrasonic probe 4 performs a spiral scan, but is not limited to a specific example of the present embodiment, such as a combination of a sector scan and a linear scan.

In this embodiment, the boundary points are superimposed in step S430, but a boundary line that connects boundary points on adjacent scan lines in order may be used. Furthermore, the inside of the boundary line may be painted with a color of a system different from the superimposing ultrasonic tomographic image such as red, and the boundary may be expressed as a side of the painted area.
In this embodiment, a list of two-dimensional images on which boundary points are superimposed is displayed in step S431. However, adjacent two-dimensional images may be displayed sequentially.

(Second Embodiment)
Next, a second embodiment of the present invention will be described. The configuration is the same as that of the first embodiment, and the processes of the CPU 13 and the image processor 18 are different. For this reason, only a different part is demonstrated. FIG. 17 shows four cross sections by ultrasonic waves in the second embodiment.

Hereinafter, operations of the CPU 13 and the image processor 18 will be described with reference to FIG.
In the present embodiment, a plurality of cross-section displays shown in FIG. 17 are displayed on the three-dimensional image processing monitor 24 instead of the list display (step S431 in FIG. 9) in the surface position extraction in the first embodiment. Display. In this screen, the extracted boundary is superimposed on each cross section as a boundary line, and in FIG. 17, a boundary erroneously extracted by noise in the cross section C can be referred to.

  In this screen, as in FIG. 4 in the first embodiment, the other cross sections are changed in conjunction with the movement and rotation of the cutting lines +, x, Δ, □ of a specific cross section. Then, when a boundary erroneously extracted due to noise or the like is found as shown in FIG. 17, the boundary is corrected as described with reference to FIG. Other operations are the same as those in the first embodiment.

  At this time, the CPU 13 and the image processor 18 function as tomographic image construction means and boundary superimposing means.

The present embodiment has the following effects.
In the present embodiment, the display of a plurality of cross sections shown in FIG. 17 is displayed on the three-dimensional image processing monitor 24, and the extracted boundary is superimposed on each cross section as a boundary line. It is possible to determine at a glance whether or not the surface position extraction is appropriate.
In this way, the extracted object surface position is superimposed as a boundary on a plurality of tomographic images having different directions, so that a significant portion of the boundary extraction error can be found at a glance.
Further, by changing the cross section, it is possible to search for an erroneously extracted portion.

(Third embodiment)
Next, a third embodiment of the present invention will be described with reference to FIGS. FIG. 18 is a flowchart showing a part of the processing contents in the third embodiment, FIG. 19 is an explanatory view of the operation and effect thereof, and FIG. 20 is an explanatory view of a modified example of scanning by the ultrasonic probe 4 in the present embodiment. It is.

  The configuration of this embodiment is the same as that of the first embodiment, and the processing of the CPU 13 and the image processor 18 is different. For this reason, only a different part is demonstrated. Hereinafter, the operations of the CPU 13 and the image processor 18 will be described with reference to FIGS.

  In the present embodiment, only the process of designating the scan line start point shown in FIG. 9 is the same as the first embodiment, and the others are the same. In the present embodiment, processing in steps S1811 and S1812 is added between step S414 and step S415 in FIG. 9 as shown in FIG. Other processes are the same as those of the first embodiment shown in FIG.

  In step S <b> 1811 shown in FIG. 18, the image specified by the variable i is displayed on the three-dimensional image processing monitor 24. This image i is shown in FIG.

  In step S1812 shown in FIG. 18, the scan line start point is designated while referring to the image i displayed on the three-dimensional image processing monitor 24. In FIG. 19, this scan line start point is indicated as O. This designation method is performed by touching the position of the scan line start point O with a finger via the touch panel 25.

  Thus, the scan line start point O is designated. Thus, the touch panel 25 functions as a scan line start point designation unit. Others are the same as in the case of the first embodiment.

The present embodiment has the following effects.
For example, when the scan line start point is set in advance at the point Od shown in FIG. 19, a blind spot is formed at the extracted boundary. This blind spot portion is indicated by hatching in FIG.

However, in the present embodiment, the scan line start point O is designated in step S1812 while referring to the image displayed on the three-dimensional image processing monitor 24. Thus, as compared with the first embodiment, this is the case. The scan line start point O can be designated at a position where a blind spot is unlikely to occur.
Other effects are the same as those of the first embodiment.

Note that the configuration of a modification of the present embodiment described below may be employed.
The ultrasonic probe 4 in this modification irradiates ultrasonic waves from outside the subject. An ultrasonic transducer (not shown) of the ultrasonic probe 4 moves on a straight line while performing sector scanning. That is, when the ultrasonic probe 4 performs sector & linear scan combining sector scan and linear scan from outside the body, a plurality of continuous two-dimensional images are written in the image data storage device 17 as three-dimensional echo data. . The plurality of two-dimensional images are shown in FIG. In FIG. 20, the image numbers are assigned as image 1, image 2,.

  The satin pattern portion in FIG. 20 indicates a low luminance region such as a tumor, and the surrounding hatched portion indicates a high luminance region such as a liver parenchyma.

  In this modified example, the scan line start point O is designated while referring to the image displayed on the three-dimensional image processing monitor 24 in step S1812 shown in FIG. In FIG. 20, this point is indicated as O. This designation method is performed by touching the point O with a finger via the touch panel 25.

Other configurations, operations, and effects are the same as those in the third embodiment described with reference to FIGS. 18 and 19.
As described above, when the surface extraction means or method according to the present embodiment is used, the surface can be accurately extracted even if the scanning method such as spiral scanning or sector & linear scanning is changed.

(Fourth embodiment)
Next, a fourth embodiment of the present invention will be described with reference to FIG. FIG. 21 is a flowchart showing details of processing for adding a shadow according to the present embodiment, and includes a process of inputting a display color when displaying a polygon from the operation terminal 21.

  The configuration is the same as that of the first embodiment, and the processes of the CPU 13 and the image processor 18 are partially different. For this reason, only a different part is demonstrated.

  Operations of the CPU 13 and the image processor 18 will be described with reference to FIG.

  Steps S211 to S2114 shown in FIG. 21 are the same as the processes in steps S511 to S514 of FIG. 11 in the first embodiment, respectively.

  In step S2115 shown in FIG. 21, a display color for displaying a polygon is input from the operation terminal 21.

  In step S2116 shown in FIG. 21, the brightness of the points in each polygon is determined by the same algorithm as in step S515 shown in FIG. 11 and with the color tone input in step S2115.

Thus, the shading process is performed by adding the shade of the surface with the color tone input in step S2115.
As described above, the operation terminal 21 functions as a display color designation unit.
The present embodiment has the following effects.

  In the present embodiment, since the display color for displaying the polygon is input in step S2115 and the color tone of the polygon is determined, the surface data E in FIG. 16 is displayed in this display color, and other parts that retain the gray scale. And can be displayed separately. Therefore, the operator distinguishes whether each part of the three-dimensional image is image data that retains the echo tone of the living body or surface image data that is added with three-dimensional information such as a shape as a shadow. Can be easily done.

Note that a more realistic three-dimensional image can be displayed by designating the color tone of the actual organ surface that can be seen in the optical image of the endoscope as the display color.
Other effects are the same as those of the first embodiment.

(Modification of the fourth embodiment)
In the present embodiment, the display color is input through the operation terminal 21 in step S2115. However, an optical image such as an endoscopic image is stored in a storage device such as the first external storage device 19, and a representative image is displayed from here. You may copy the color. The stored optical images may be stored separately such as the esophagus, upper stomach, and duodenum, and these display colors may be used.

(Fifth embodiment)
Next, a fifth embodiment of the present invention will be described with reference to FIGS. FIG. 22 is a flowchart of surface position extraction processing in the fifth embodiment, and FIGS. 23 and 24 are diagrams for explaining the operation and effect.

  The configuration of this embodiment is the same as that of the first embodiment, and the processing of the CPU 13 and the image processor 18 is different. For this reason, only a different part is demonstrated. Hereinafter, operations of the CPU 13 and the image processor 18 will be described with reference to FIGS.

In the present embodiment, only the surface position extraction process shown in FIG. 9 is different from the first embodiment, and the others are the same.
In step S2211 shown in FIG. 22, the first image is displayed on the three-dimensional image processing monitor 24 among the 50 consecutive two-dimensional images stored in the image data storage device 17. This image is shown in FIG.

  In step S2212 shown in FIG. 22, the first image is traced. The boundary of the two-dimensional image displayed on the three-dimensional image processing monitor 24, that is, the organ surface is manually traced. Tracing is performed via the touch panel 25.

  In step S2213 shown in FIG. 22, the first gradient value at the traced point is calculated. That is, as shown in FIG. 23, the gradient of the luminance value at points Z2, Z3,..., Zi,... On the trace trajectory at an equal angle .alpha. A value (hereinafter referred to as a first gradient value) is calculated.

This first gradient value represents the luminance gradient value on the straight line OZi (i = 1, 2, 3...), And the distance for calculating the gradient value is set to a fixed length. In FIG. 24A, the luminance value on the straight line OZi in the first image is represented. This “constant length” is represented by Δx, and the difference between the luminance values is represented by ΔI. Therefore,
Gradient value = ΔI / Δx
It is expressed.

In step S2214 shown in FIG. 22, a gradient value (hereinafter referred to as a second gradient value) in the direction of the straight line OZi set in the first image is calculated for the second image. The second gradient value is calculated for each point within a specific range on the straight line OZi from the point Zi 'on the second image (see FIG. 24B) corresponding to the point Zi. In FIG. 24B, this specific range is indicated by δx. That is, the second gradient value is calculated at each point within the range included in the range δx in the OZi direction and the opposite direction around the point Zi ′ corresponding to the point Zi.
This process is repeated for points in the range corresponding to all points Zi.

  In step S2215 shown in FIG. 22, the second gradient value calculated at each point is compared with the first gradient value calculated at the point Zi, and the straight line OZi ′ having a value closest to the first gradient value is calculated. Identify the points. In FIG. 24B, the point thus identified is denoted by Zi ″. In this way, the boundary of the second image is identified.

  By performing such processing, even in an image where noise exists as shown in FIGS. 23 and 24A, the position of the noise can be removed to some extent by the range δx, and the noise is temporarily within the range δx. Is included, it is very rare that the gradient value has a value close to the first gradient value, and in most cases, the point having the value closest to the first gradient value is set as the boundary point of the second image. It can be identified correctly.

In step S2216 shown in FIG. 22, the process branches depending on whether or not the process has been completed for all the two-dimensional images. If not completed, the process jumps to step S2214. If completed, the surface position extraction process is terminated. After jumping to step S2214, the same processing is repeated with the gradient value of the second image as the first gradient value and the gradient value of the third image as the second gradient value. The same processing is applied to the subsequent images.
Thus, the surface position is extracted.

As described above, the CPU 13 and the image processor 18 function as a first gradient value calculating unit, a second gradient value calculating unit, and a surface position specifying unit.
The touch panel 25 functions as a surface position designation unit.
The present embodiment has the following effects.

In the present embodiment, in step S2214, the second gradient value is calculated for each point within a specific range from the point where the first gradient value is calculated, and in step S2215, the second gradient value and the first gradient value are calculated. The surface position was extracted by comparison. Therefore, noise that does not fall within this range is not erroneously extracted as a surface. This noise is shown in FIGS.
Other effects are the same as those of the first embodiment.

(Sixth embodiment)
Next, a sixth embodiment of the present invention will be described with reference to FIGS. FIG. 25 is a flowchart showing details of the surface position extraction process in the sixth embodiment. FIG. 26, FIG. 27, FIG. 28, and FIG. 29 are diagrams for explaining the state of tracing from the start point P for extracting the surface position. 27 is an enlarged view on the right side of FIG. 26, FIG. 29 is an enlarged view on the left side of FIG. 26, and FIG. 28 shows luminance values on the arc shown in FIG.

The configuration of this embodiment is the same as that of the first embodiment, and the processing of the CPU 13 and the image processor 18 is different. Since the surface position extraction method in step S4 shown in FIG. 2 is different from that of the first embodiment, this portion will be described.
Details of image processing performed by the CPU 13 and the image processor 18 will be described below with reference to FIGS.
Steps S2511 to S2531 shown in FIG. 25 are an automatic extraction routine for automatically extracting the surface position, and steps S2532 to S2539 are a display / correction routine for displaying and correcting the automatically extracted boundary.

Further, among the automatic extraction routines, steps S2511 to S2525 are a trace start point extraction routine for extracting a trace start point, and steps S2526 to S2531 are a trace routine for performing automatic extraction by tracing the surface position.
Details of the trace start point extraction routine of the automatic extraction routine will be described below.

  In step S2511 shown in FIG. 25, the image data is smoothed. The processing unit for performing the smoothing is made variable so as to be optimal for the ultrasonic resolution when the ultrasonic probe 4 scans.

  In step S2512 shown in FIG. 25, binarization processing is performed on the image data. A point having a luminance value below a certain threshold is replaced with a luminance value of 0, and a point having a luminance value above the threshold is replaced with a luminance value of 1.

  In step S2513 shown in FIG. 25, the length that a run longer than the threshold (run) that is connected between points equal to or greater than the threshold should be determined as noise is substituted into variable run0. This input is performed via the operation terminal 21.

In step S2514 shown in FIG. 25, 0 is substituted into the variable i. The variable i indicates the number of a two-dimensional image to be currently processed among a plurality of continuous two-dimensional images written as image data in the image data storage device 17. In this embodiment, it is assumed that 50 two-dimensional images are processed,
0 ≦ i ≦ 49
And

  In step S2515 shown in FIG. 25, 0 is substituted into the variable s. The variable s is a variable for assigning the boundary point numbers extracted by the trace described later.

  In step S2516 shown in FIG. 25, one point G on the screen is designated. Hereinafter, this point G is called a scan line start point and is shown in FIG. Specifically, the user designates the point G by touching a point on the screen with a finger via the touch panel 25. In step S2517 shown in FIG. 25, another point G ′ on the screen is designated. Specifically, the user touches a point on the screen with a finger via the touch panel 25. At this time, a line segment GG ′ is displayed on the two-dimensional image displayed on the three-dimensional image processing monitor 24 as shown in FIG. Hereinafter, this GG ′ is called a scan line.

In step S2518 shown in FIG. 25, the coordinates of G are set as the processing point address. The processing point address consists of an x address and ay address, and indicates the x coordinate and y coordinate of the point currently being processed.
In step S2519 shown in FIG. 25, 0 is substituted into the variable run. The variable run is used to measure the run length.

In step S2520 shown in FIG. 25, the processing point address is moved to the address of the next point on the scan line GG '.
In step S2521 shown in FIG. 25, it is determined whether the luminance value of the point indicated by the processing point address is larger or smaller than the threshold value of the binarization processing performed in step S2512. If it is larger, the process proceeds to step S2522, and if it is smaller, the process jumps to step S2519.

In step S2522 shown in FIG. 25, the x address of the processing point address is substituted for the run-th variable p (run) of the one-dimensional array variable p, and the processing point is assigned to the run-th variable q (run) of the one-dimensional array variable q. Substitute the y address of the address.
In step S2523 shown in FIG. 25, 1 is added to the variable run.

  In step S2524 shown in FIG. 25, it is determined whether or not the variable run matches run0. If they match, the process moves to step S2525, and if they do not match, the process jumps to step S2520.

In step S2525 shown in FIG. 25, q (run-run0) is substituted for the two-dimensional array variable X (s, i), and q (run-run0) is substituted for the two-dimensional array variable Y (s, i). Thus, the coordinates of the run closest to the scan line start point among the runs in which the points whose luminance values are larger than the threshold on the scan line are continuous for the distance run0 are X (s, i) and Y (s, i). Extract.
Next, details of the trace routine in the automatic extraction routine will be described.

  In step S2526 shown in FIG. 25, X (s, i) and Y (s, i) are output to the image data storage device 17. That is, in step S 2526, the address of the point P shown in FIG. 26 is written in the image data storage device 17.

  In step S2527 shown in FIG. 25, a search is performed from the intersection Po of the line segment GP and the arc on the arc of radius r centered on the point P shown in FIG. A new boundary point P ′ is extracted. This search is performed as follows.

  First, in FIG. 26, the outer side represents the organ substance with the organ surface as a boundary, and the inner side, that is, the side including G is usually a portion representing an ultrasonic medium such as water. Therefore, the luminance value after binarization on the arc of FIG. 27 is shown as in FIG.

The horizontal axis in FIG. 28 indicates an angle ψ formed with the line segment GP. Since the point Po is on the ultrasonic medium side and is on the low luminance side, the point where the luminance changes from the low side to the high side with respect to the change in the angle ψ is the boundary point P ′ shown in FIGS. Corresponding to In this way, the point P ′ is extracted by searching for the first changing point from the luminance value side of the point Po on FIG.
In step S2528 shown in FIG. 25, 1 is added to the variable s. Hereinafter, the point P ′ is replaced with the point P anew.

  In step S2529 shown in FIG. 25, ∠PGG ′ is calculated from the newly placed point P, and it is determined whether ∠PGG ′ is larger or smaller than 360 °. If it is larger, the process proceeds to step S2530, and if it is smaller, the process jumps to step S2526. Incidentally, since the point P ′ is replaced with the point P in step S2528, this ∠PGG ′ actually corresponds to ∠P′GG ′ in FIG.

In step S2530 shown in FIG. 25, 1 is added to the variable i. That is, the two-dimensional image to be processed is moved to the adjacent two-dimensional image.
In step S2531, shown in FIG. 25, it is determined whether i matches 49 + 1. That is, it is determined whether or not the last two-dimensional image has been processed among the two-dimensional images written to the image data storage device 17. If they match, the process moves to step S2532. If not, the process jumps to step S2515.

  Thus, in the automatic extraction routine including the trace start point extraction routine and the trace routine, the point P (s, i) recognized as the surface of the body cavity, that is, the boundary, for all the two-dimensional images stored in the image data storage device 17. Coordinates X (s, i) and Y (s, i) are obtained and sequentially written in the image data storage device 17.

  In FIG. 26, since the organ substance on the screen is cut off on the left side of the screen, the search for the point P (s, i) is interrupted as it is. Therefore, in step S2527, as shown in FIG. 29, when searching for a point where the luminance value of the point Po first changes, when the arc hits the end of the image halfway, the intersection of the arc and the end of the image is determined. It will be extracted as a point P ′.

Next, details of the display / correction routine will be described.
In step S2532 shown in FIG. 25, X (s, i) and Y (s, i) are read for all images and all boundary points written in the image data storage device 17.

  That is, the coordinates of the point P recognized as the boundary are read from the image data storage device 17. In step S2533 shown in FIG. 25, boundary points whose coordinates are indicated by X (s, i) and Y (s, i) are superimposed on each two-dimensional image having ultrasonic gradation.

  In step S2534 shown in FIG. 25, a list of two-dimensional images having ultrasonic gradation on which boundary points are superimposed is displayed on the three-dimensional image processing monitor 24.

  In step S2535 shown in FIG. 25, the two-dimensional image i0 in which the boundary is erroneously extracted is designated from the two-dimensional images displayed in the list. This two-dimensional image i0 is shown in FIG.

  In step S2536 shown in FIG. 25, the user designates a correction range in the two-dimensional image i0 via the touch panel 25. Specifically, as shown in FIG. 30, the end points R1 and R2 of the erroneously extracted boundary are designated, and the correction range is designated by determining ∠R1 GR2. This range corresponds to the portion indicated by hatching in FIG.

In step S2537 shown in FIG. 25, the user manually traces the true boundary via the touch panel 25. The state of this trace is shown in FIG. That is, the true boundary point is traced as indicated by the white point (white circle) instead of the boundary point indicated by the erroneously extracted black point.
At this time, a true boundary point P (s, i) is set again for each equidistant section on the locus traced by the user within the range of ∠R1 GR2.

  In step S2538 shown in FIG. 25, the coordinates of the boundary point that has been erroneously extracted are deleted from the image data storage device 17, and the coordinates of the true boundary point P (s, i) set in step S2537 are renewed. X (s, i) and Y (s, i) are output to the image data storage device 17. At this time, the two-dimensional array variables X (s, i) and Y (s, i) in the image data storage device 17 are represented by P (s, i) (s = 0, 1,...) In FIG. In this way, rearrangement is performed again so that the number s is assigned in order.

  In step S2539 shown in FIG. 25, a message is output on the three-dimensional image processing monitor 24 as to whether correction is still necessary, and the user responds via the operation terminal 21. If correction is necessary, the process jumps to step S2534, and if not necessary, the surface position extraction process ends.

In this way, the display / correction routine corrects points that have been erroneously extracted due to residues in the body cavity, noise, or the like.
As described above, the CPU 13 and the image processor 18 function as surface tracing means and luminance change point searching means.
The touch panel 25 functions as a trace start point designation unit.

The present embodiment has the following effects.
In the present embodiment, a desired object surface position is automatically traced sequentially on a plurality of consecutive ultrasonic tomographic images, so that, for example, noise shown in FIG. 26 is erroneously extracted from the organ surface. There is nothing. That is, a desired object surface can be accurately extracted and expressed without being disturbed by noise or the like.

  In the present embodiment, since the image is smoothed in step S2511, it is possible to remove some noise before extracting the surface position on the scan line in advance.

  In this embodiment, boundary points are superimposed on the ultrasonic tomographic image in step S2533, and a list is displayed in step S2534. The image superimposed at this time is subjected to threshold processing such as binarization. It may be a rendered image. However, as shown in the present embodiment, when the original images having ultrasonic gradations are displayed in a list in this way, the boundary points are usually superimposed on the ultrasonic images used for diagnosis. The effect is clearer if it should be corrected.

In the present embodiment, the boundary can be appropriately corrected because it can be corrected with reference to the image shown in FIG.
In this embodiment, in step S2513, a length that a run of less than this length should be determined as noise is input. Therefore, when designating the trace start point, noises of various sizes are input. Can be removed.
Other effects are the same as those of the first embodiment.

(Modification of the sixth embodiment)
In this embodiment, the touch panel 25 is used, but instead of the touch panel 25, a cursor may be displayed on the screen and another pointing device such as a mouse, a light pen, or a trackball may be used.
In this embodiment, binarization is performed in step S2512. However, other threshold processing may be used.

  In this embodiment, boundary points are superimposed in step S2533. However, boundary lines connecting boundary points P (s, i) in the order of number s may be used. Furthermore, the inside of the boundary line may be painted with a color of a system different from the superimposing ultrasonic tomographic image such as red, and the boundary may be expressed as a side of the painted area.

In the present embodiment, a list of two-dimensional images on which boundary points are superimposed is displayed in step S2534, but adjacent two-dimensional images may be sequentially displayed.
In the present embodiment, the present invention is applied assuming a luminal organ such as the stomach shown in FIG. 26, but the present invention can also be applied to a non-luminal organ such as the liver and pancreas.

(Seventh embodiment)
Next, a seventh embodiment of the present invention will be described with reference to FIGS. FIG. 31 is a flowchart showing a part of the surface position extraction processing in the seventh embodiment, and FIG. 32 is a diagram for explaining the operation and effect.

  The configuration of this embodiment is the same as that of the sixth embodiment, and the processing of the CPU 13 and the image processor 18 is different. For this reason, only a different part is demonstrated. Hereinafter, operations of the CPU 13 and the image processor 18 will be described with reference to FIGS. 31 and 32. FIG.

  In the present embodiment, only the process of designating the scan line start point shown in FIG. 25 is different from the sixth embodiment, and the others are the same. In the present embodiment, as shown in FIG. 31, the processes of step S3111, step S3112, and step S3113 are added. The other processes shown in FIG. 31 are the same as the processes with the same numbers in the sixth embodiment shown in FIG.

  In step S3111 subsequent to step S2513 shown in FIG. 31, the four cross-sectional images shown in FIG. 32 are displayed on the monitor 24 for three-dimensional image processing. The positional relationship of the four cross sections is the same as that in FIG.

In step S3112 shown in FIG. 31, the trace start point is designated on the screen B or the linear surface of C while referring to the image displayed on the three-dimensional image processing monitor 24. This designation method is designated by tracing the thick line in FIG. 32 with a finger via the touch panel 25. Since the linear plane is formed from a plurality of continuous two-dimensional images of 50 sheets, tracing start points of 50 two-dimensional images can be designated at a time by tracing the boundary expressed on the linear plane with a finger.
In this way, the trace start point is designated.

Since the trace start point can be specified at once, the processing from step S2516 to step S2525 in FIG. 25 is omitted. Instead, in step S3113 shown in FIG. 31, the address of the trace start point of the two-dimensional image i is substituted into the two-dimensional array variable X (s, i) Y (s, i).
As described above, the touch panel 25 functions as a trace start point designation unit.

The present embodiment has the following effects.
In the present embodiment, the trace start point is designated at once for 50 images while referring to the image displayed on the three-dimensional image processing monitor 24 in step S3112. On the other hand, the operation is simple as compared with the sixth embodiment in which the trace start points are sequentially specified.
Other effects are the same as those of the sixth embodiment.

[Appendix]
1. Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to a living body and storing the obtained echo data of the three-dimensional region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
Synthesis means for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting means and the surface echo data to which the shadow is added by the shadow adding means;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
In the three-dimensional echo data, the surface position extracting means scans the scan line farther from the scan line start point, and a point having a luminance value larger than a certain threshold value is continuously longer than a predetermined distance. An ultrasonic image diagnostic apparatus comprising: a run extracting unit that extracts a run closest to the scan line start point.

(Object of Supplementary Note 1) To provide an ultrasonic diagnostic apparatus capable of accurately expressing a desired object surface without being disturbed by noise or the like.

(Effect of Supplementary Note 1) The run extracting unit scans the scan line far, and the run closest to the scan line start point among the runs in which the luminance value greater than a certain threshold value continues for a predetermined distance or more. Therefore, a run less than this predetermined distance can be removed as noise. For this reason, a desired object surface can be accurately expressed without being disturbed by noise or the like.

2. An ultrasonic probe that transmits and receives ultrasonic waves to a living body and obtains a plurality of continuous ultrasonic tomographic images in a three-dimensional region;
Three-dimensional echo data storage means for storing echo data of a three-dimensional region composed of a plurality of successive ultrasonic tomographic images obtained by the ultrasonic probe;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
A synthesizing unit for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting unit and the surface echo data to which the shadow is added by the shadow adding unit;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The surface position extracting means is provided with boundary superimposing means for superimposing the extracted object surface position as a boundary on all of the plurality of continuous ultrasonic tomographic images or on a specific ultrasonic tomographic image. Ultrasound image diagnostic equipment.

(Background of Supplementary Notes 2 and 3) In addition, the apparatus disclosed in Japanese Patent Application Laid-Open No. 4-279156 has a problem that it cannot be confirmed whether or not the surface extraction is properly performed.

(Purpose of Supplementary Notes 2 and 3) To provide an ultrasonic diagnostic apparatus capable of confirming whether or not an object surface has been appropriately extracted.

(Effects of Supplementary Notes 2 and 3) Since the boundary superimposing unit superimposes the extracted object surface position on all or a specific ultrasonic tomographic image as a boundary, the object surface can be extracted. It can be confirmed whether or not it is properly performed.

3. Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to a living body and storing the obtained echo data of the three-dimensional region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
A synthesizing unit that synthesizes a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting unit and the surface echo data to which the shadow is added by the shadow adding unit;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The tomographic image constructing means for constructing a plurality of tomographic images having different directions generated from the echo data in the three-dimensional echo data, the surface position extracting means;
An ultrasonic diagnostic imaging apparatus comprising: a boundary superimposing unit that superimposes the extracted object surface position on the tomographic image constructed by the tomographic image constructing unit.

(Effect of Supplementary Note 3) Since the extracted object surface position is superimposed as a boundary on a plurality of tomographic images having different directions, a significant portion of the boundary extraction error can be found at a glance.

4). The surface position extracting unit includes a boundary correcting unit that corrects the boundary superimposed by the boundary superimposing unit, and corrects the object surface position extracted by the boundary corrected by the boundary correcting unit. The ultrasonic diagnostic imaging apparatus according to appendix 2 or 3.

5). In the three-dimensional echo data, the surface position extracting means scans the scan line farther from the scan line start point, and a point having a luminance value larger than a certain threshold value is continuously longer than a predetermined distance. , Provided with a run extracting means for extracting the run closest to the scan line start point,
The boundary correction means includes a correction scan line specifying means for specifying a scan line where a boundary to be corrected exists,
The ultrasonic wave according to appendix 4, wherein a run closest to the scan line start point is extracted after the run extracted by the run extraction unit on the scan line specified by the modified scan line specifying unit. Diagnostic imaging device.

(Background of Supplementary Notes 4 and 5) In addition, the apparatus disclosed in Japanese Patent Laid-Open No. 4-279156 has a problem that it is impossible to correct a portion where surface extraction is not appropriate.

(Purpose of Supplementary Notes 4 and 5) To provide an ultrasonic diagnostic apparatus capable of correcting a portion where extraction of an object surface is not appropriate.
(Effects of Supplementary Notes 4 and 5) Since the boundary correcting unit corrects the object surface position, it is possible to correct a portion where extraction of the object surface is not appropriate.

6). Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to a living body and storing the obtained echo data of the three-dimensional region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Combining means for constructing a three-dimensional image using the cross-sectional echo data whose position is set by the cross-sectional position setting means;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The tomographic image constructing means for constructing a plurality of tomographic images having different orientations generated from the echo data in the three-dimensional echo data;
A cutting line moving means for moving a cutting line indicating a cross-sectional position in the plurality of tomographic images constructed by the tomographic image construction means;
A tomographic image rotating means for rotating a specific one of the tomographic images constructed by the tomographic image constructing means;
And changing a tomographic image other than the specific tomographic image among the plurality of tomographic images constructed by the tomographic image constructing means in conjunction with the rotation of the specific tomographic image by the tomographic image rotating means. An ultrasonic diagnostic imaging apparatus.

(Background of Supplementary Note 6) Further, the apparatus disclosed in Japanese Patent Application Laid-Open No. 7-47066 is configured to set the cross-sectional position only by setting the crossing position of the cutting line, and is parallel to the cutting line. A cross section can be set only with a simple cross section. For this reason, on the tomographic image perpendicular to the luminal axis, there is a problem that the cross section cannot be observed at the position of the lesion existing at an oblique position such as the lower right, and the depth of the lesion cannot be diagnosed.

(Purpose of Supplementary Note 6) To provide an ultrasonic diagnostic apparatus capable of appropriately setting a cross section regardless of the position of a lesion on a tomographic image and diagnosing the depth of the lesion.

(Effect of Supplementary Note 6) On the specific tomographic image among the plurality of tomographic images having different directions constructed by the tomographic image constructing means, the cutting line moving means moves the cutting line indicating the cross-sectional position, and the tomographic image rotating means is the tomographic image Since the image is rotated and the tomographic image other than the specific tomographic image is changed in conjunction, the cross section can be set regardless of the position of the lesion on the tomographic image, and the depth of the lesion can be diagnosed.

7). Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to a living body and storing the obtained echo data of the three-dimensional region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Synthesizing means for synthesizing a three-dimensional image using the cross-sectional echo data whose position is set by the cross-sectional position setting means;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The tomographic image constructing means for constructing a plurality of tomographic images having different orientations generated from the echo data in the three-dimensional echo data;
A cutting line moving means for moving a cutting line indicating a cross-sectional position in the plurality of tomographic images constructed by the tomographic image construction means;
An ultrasonic image characterized in that the tomographic image constructing means is provided with mask means for displaying the echo data synthesized as the three-dimensional image by the synthesizing means and the other echo data in a different form. Diagnostic device.

(Background of Supplementary Notes 7 and 8) Further, in the apparatus disclosed in Japanese Patent Application Laid-Open No. 7-47066, the section is expressed only by displaying the cutting line on the display screen of the monitor divided into four. There is a problem in that it is difficult to distinguish and the correspondence between a portion displayed as a three-dimensional image and a portion not displayed from the divided screen.

(Purpose of Supplementary Notes 7 and 8) To provide an ultrasonic diagnostic apparatus capable of setting a cross section so that the distinction and correspondence between a portion displayed as a three-dimensional image and a portion not displayed on the tomographic image can be easily understood.

(Effects of Supplementary Notes 7 and 8) The tomographic image constructing unit constructs a plurality of tomographic images having different directions generated from the echo data in the three-dimensional echo data, and the cutting line moving unit constructs the plurality of constructed tomographic images. In the image, the cutting line indicating the cross-sectional position is moved, and the mask means displays the echo data synthesized as the three-dimensional image and the other echo data in different modes. The section can be set in an easy-to-understand manner and the distinction between the displayed part and the non-displayed part.

8). The mask means is provided with display mode designation means for designating whether the echo data for the synthesis means to synthesize as the three-dimensional image and the other echo data are displayed in a different mode or similar display. The ultrasonic diagnostic imaging apparatus according to appendix 7, which is characterized in that.

(Effects of Supplementary Note 8) Display in normal tomographic image mode, echo data for displaying as a three-dimensional image, and other types of echo data by changing the mode, display for setting a cross section, and two types Since the display mode designation means for designating any one of the above display is provided, when such a mask is obstructive, it can be removed, and a normal diagnosis can be performed on an arbitrary cross section using a plurality of tomographic images. .

9. Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to a living body and storing the obtained echo data of the three-dimensional region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
A synthesizing unit for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting unit and the surface echo data to which the shadow is added by the shadow adding unit;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The shadow adding means is provided with a light beam angle setting means for setting a light beam angle for shadow addition as an angle in a coordinate system with a biological lumen axis or an ultrasonic probe insertion axis as a coordinate axis,
The ultrasonic diagnostic imaging apparatus, wherein the display means displays the light beam angle in a coordinate system having the biological lumen axis or the ultrasonic probe insertion axis as a coordinate axis.

(Backgrounds of Supplementary Notes 9 and 10) In addition, the apparatus disclosed in Japanese Patent Application Laid-Open No. 7-47066 cannot change the ray angle during shading, and cannot be expressed three-dimensionally depending on the shape. was there.

(Object of Supplementary Notes 9 and 10) To provide an ultrasonic diagnostic imaging apparatus capable of expressing a desired object surface in a more three-dimensional manner and setting a ray angle more intuitively and anatomically.

(Effects of Supplementary Notes 9 and 10) The light beam angle setting means sets the light beam angle for adding a shadow as an angle in a coordinate system having the biological lumen axis or the ultrasonic probe insertion axis as a coordinate axis, and the display means Since the ray angle in the coordinate system with the axis of the biological lumen or the ultrasound probe insertion axis as the coordinate axis is displayed, the desired object surface can be expressed more three-dimensionally, and the ray angle can be more intuitive and anatomical. Can be set easily.

10. The ultrasonic diagnostic imaging apparatus according to appendix 9, wherein the display unit displays the light beam angle three-dimensionally.
(Effect of Supplementary Note 10) Since the display means displays the light beam angle in three dimensions, it is easy to grasp the light beam angle sensuously.

11. Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to a living body and storing the obtained echo data of the three-dimensional region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
A synthesizing unit for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting unit and the surface echo data to which the shadow is added by the shadow adding unit;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus,
Cross-sectional echo data whose position is set by the cross-sectional position setting means, and coordinate conversion means for converting the coordinates of the surface echo data whose position is extracted by the surface position extracting means,
A line-of-sight angle setting unit in which the coordinate conversion unit sets a line-of-sight angle formed by a line-of-sight direction when displaying the three-dimensional image as an angle in a coordinate system with a biological lumen axis or an ultrasound probe insertion axis as a coordinate axis. When,
And the display means displays the line-of-sight angle in a coordinate system having the biological lumen axis or the ultrasonic probe insertion axis as a coordinate axis.

(Background of Supplementary Note 11) Further, the apparatus disclosed in Japanese Patent Application Laid-Open No. 7-47066 has no means for instructing the line-of-sight direction. For this reason, there are cases where the region of interest cannot be seen well even after the line-of-sight direction of the three-dimensional image is changed and the two-dimensional reprojection is performed so that the region of interest can be seen well. There was a problem of requiring reprojection.

(Purpose of Supplementary Note 11) To provide an ultrasonic diagnostic apparatus in which a line-of-sight angle can be set more easily so that a region of interest such as a lesion can be seen well.

(Effect of Supplementary Note 11) The coordinate conversion unit converts the coordinates of the cross-sectional echo data and the surface echo data, and the line-of-sight angle setting unit determines the line-of-sight angle formed by the line-of-sight direction when displaying the three-dimensional image. Or, it is set as an angle in the coordinate system with the ultrasound probe insertion axis as the coordinate axis, and the display means displays the gaze angle in the coordinate system with the biological lumen axis or the ultrasound probe insertion axis as the coordinate axis. The viewing angle of the three-dimensional image can be set more easily. In addition, it can be set intuitively and anatomically.

12 Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to a living body and storing the obtained echo data of the three-dimensional region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
A synthesizing unit for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting unit and the surface echo data to which the shadow is added by the shadow adding unit;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The synthesizing unit is provided with a cross-sectional surface boundary superimposing unit that superimposes a boundary line between the cross-sectional echo data and the surface echo data on the three-dimensional image as a cross-sectional surface boundary line,
The ultrasonic image diagnostic apparatus, wherein the display means displays the three-dimensional image in which the cross-sectional surface boundary superimposing means superimposes the cross-sectional surface boundary line.

(Background of Supplementary Note 12) Also, when the doctor judges the degree of progression such as the depth of the lesion from the echo data and compares the shape of the lesion with the optical image such as an endoscope using the surface image data In the apparatus disclosed in Japanese Patent Application Laid-Open No. 7-47066, the image data displayed three-dimensionally and the surface image data are both displayed in gray scale. There is a problem that it is difficult for a surgeon to distinguish whether the image data holds gradation or is surface image data to which three-dimensional information such as a shape is added as a shadow.

  Further, in the devices disclosed in Japanese Patent Application Laid-Open Nos. 7-47066 and 4-279156, the display color of the surface image data in the three-dimensional image is given only from the perspective and the three-dimensional shape, There is a problem that it is difficult for a person other than the surgeon to determine which part of the body cavity is being observed because it is not related to the original color of the organ visible in the optical image.

(Purpose of Supplementary Note 12) To provide an ultrasonic diagnostic imaging apparatus that can easily distinguish between echo data and surface image data.
(Effects of Supplementary Note 12) The cross-sectional surface boundary superimposing unit superimposes the boundary line of the cross-sectional echo data and the surface echo data on the three-dimensional image as the cross-sectional surface boundary line, and the display unit superimposes the cross-sectional surface boundary line. Is displayed, it is easy to distinguish the echo data from the surface image data.

13. In the ultrasonic diagnostic imaging apparatus according to claim 1,
An ultrasound diagnostic imaging apparatus comprising: a scan line start point designating unit that designates a position of the scan line start point.
(Purpose of Supplementary Note 13) Same as the purpose of Supplementary Note 1.

14 Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to a living body and storing the obtained echo data of the three-dimensional region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
Synthesis means for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting means and the surface echo data to which the shadow is added by the shadow adding means;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The shadow adding means is
Adding a shadow to the surface echo data in the organ surface color;
An ultrasonic diagnostic imaging apparatus.
(Purpose of Supplementary Note 14) To provide an ultrasonic diagnostic imaging apparatus capable of observing a more realistic three-dimensional image by associating the display color of surface image data with the original color of an organ visible in an optical image.

(Effect of Supplementary Note 14) Since the shadow is added by the organ surface color to the surface echo data by the shadow adding means, it is possible to observe a more realistic three-dimensional image.

15. Three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to a living body and storing the obtained echo data of the three-dimensional region;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
Synthesis means for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting means and the surface echo data to which the shadow is added by the shadow adding means;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The shadow adding means is
Display color designating means for designating the display color of the surface echo data;
Provided,
Adding a shadow to the surface echo data in the display color designated by the display color designation means;
An ultrasonic diagnostic imaging apparatus.
(Purpose of Supplementary Note 15) Same as the purpose of Supplementary Note 12.

16. A three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to a living body, and storing echo data of a three-dimensional region composed of a plurality of obtained continuous ultrasonic tomographic images;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
Synthesis means for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting means and the surface echo data to which the shadow is added by the shadow adding means;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The surface position extracting means is
Surface position specifying means for specifying a desired object surface position on a specific tomographic image among the plurality of ultrasonic tomographic images;
First gradient value calculating means for calculating the gradient value of the luminance value of the surface position specified by the surface position specifying means;
A second value for calculating a gradient value of a luminance value within a specific range from a point at which the first gradient value is calculated on a tomographic image other than the specific tomographic image among the plurality of ultrasonic tomographic images. A slope value calculating means of
By comparing the gradient values calculated by the first gradient value calculating unit and the second gradient value calculating unit, the tomographic image different from the tomographic image in which the surface position specifying unit specifies the object surface position Surface position specifying means for specifying the object surface position above,
An ultrasonic diagnostic imaging apparatus comprising:
(Purpose of Supplementary Notes 16, 17, 18, 19, and 20) Same as the purpose of Supplementary Note 1.

17. A three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to a living body, and storing echo data of a three-dimensional region composed of a plurality of obtained continuous ultrasonic tomographic images;
Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Surface position extraction means for extracting a desired object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
Synthesis means for synthesizing a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting means and the surface echo data to which the shadow is added by the shadow adding means;
Display means for displaying the three-dimensional image synthesized by the synthesis means;
In the ultrasonic diagnostic imaging apparatus provided with
The surface position extracting means is
An ultrasonic diagnostic imaging apparatus, comprising surface tracing means for automatically tracing a desired object surface position sequentially on a plurality of successive ultrasonic tomographic images.

18. In the ultrasonic diagnostic imaging apparatus according to appendix 17,
The surface tracing means is provided with luminance change point searching means for searching the surface position as a change point of the luminance value on an arc for searching for a desired object surface position, and the change point is newly determined as the center of the arc. The ultrasonic diagnostic imaging apparatus is characterized by sequentially tracing a desired object surface position by replacing as follows.

19. In the ultrasonic diagnostic imaging apparatus according to appendices 17 and 18,
An ultrasonic diagnostic imaging apparatus, wherein the surface position extraction means includes trace start point designation means for designating a trace start point to be traced on the ultrasonic tomographic image.

20. In the ultrasonic diagnostic imaging apparatus according to appendices 17, 18, and 19,
The surface position extracting means is
A tomographic image constructing means for constructing a plurality of cross-sectional images having different directions generated from echo data in the three-dimensional echo data;
Provided,
The trace start point designating means is
Designating the trace start point on the tomographic images having different directions from the plurality of continuous ultrasonic tomographic images constructed by the tomographic image constructing means;
An ultrasonic diagnostic imaging apparatus.

1 is a block diagram showing a configuration of an ultrasonic diagnostic imaging apparatus according to a first embodiment of the present invention. The flowchart figure which shows the content of the image processing which CPU and an image processor perform. The flowchart figure which shows the detailed content of the setting of the cross-sectional position in FIG. The figure which shows the specific example of four ultrasonic images corresponding to each cut surface. The figure which shows the simple three-dimensional image which does not extract a surface position. In FIG. 4, the figure which showed the part which does not appear as a cross section of FIG. 5 by hatching. The figure which shows the subscreen for the setting of a gaze direction. FIG. 8 is a diagram for explaining the angle in FIG. The flowchart figure which shows the detail of the processing content of the extraction of the surface position in FIG. Explanatory drawing which shows the mode of the scan from the scanning start point which extracts the position of the surface. The flowchart figure which shows the detail of the processing content of a shadow addition. Explanatory drawing of a shadow addition process. The figure which shows the sub-screen for a setting which shows the setting value of a light beam direction. FIG. 14 is a diagram for explaining the angle in FIG. 13. The figure which showed the non-display part of the four cross sections in a three-dimensional image by hatching. The figure which shows the three-dimensional image finally constructed | assembled. The figure which shows the specific example of four ultrasonic images in the 2nd Embodiment of this invention. The flowchart figure which shows a part of processing content of the extraction of the surface position in the 3rd Embodiment of this invention. Explanatory drawing of the effect | action in 3rd Embodiment. Explanatory drawing of the modification of the scan by an ultrasonic probe. The flowchart figure which shows the processing content of the shadow addition in the 4th Embodiment of this invention. The flowchart figure which shows the processing content of the surface position extraction in the 5th Embodiment of this invention. Explanatory drawing which shows a mode that the boundary point of a 1st image is traced manually. Explanatory drawing which calculates the 1st gradient value in the point traced on the 1st image, and the 2nd gradient value in the corresponding point on the 2nd image. The flowchart figure which shows the detail of the processing content of the surface position extraction in the 6th Embodiment of this invention. Explanatory drawing which shows a mode that a boundary point is traced sequentially from the starting point P on the two-dimensional image i. Explanatory drawing which expands and shows a part of FIG. Explanatory drawing of the effect | action by binarization in the process of step S2527 of FIG. Explanatory drawing of the process of the edge of an image. Explanatory drawing which shows a mode that the part from which the boundary was extracted incorrectly is corrected. The flowchart figure which shows a part of processing content of the surface position extraction in the 7th Embodiment of this invention. Explanatory drawing of the effect | action which designates a scanning line start point.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Ultrasound image diagnostic apparatus 2 ... Ultrasound observation part 3 ... Image processing part 4 ... Ultrasonic probe 5 ... Drive part 6 ... Transmission / reception part 7 ... A / D converter 8 ... Frame memory 9 ... DSC
11 ... Monitor 12 ... System controller 13 ... CPU
DESCRIPTION OF SYMBOLS 14 ... Main memory 15 ... Control part 16 ... Polar coordinate converter 17 ... Image data memory 18 ... Image processor 19 ... 1st external memory 20 ... 2nd external memory 21 ... Operation terminal 22 ... Frame buffer 24 ... Monitor for 3D image processing 25 ... Touch panel

Claims (5)

A three-dimensional echo data storage means for transmitting and receiving ultrasonic waves to a living body, and storing echo data of a three-dimensional region composed of a plurality of continuous ultrasonic tomograms obtained;
Surface position extraction means for extracting an object surface position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
Three-dimensional image generation means for generating a three-dimensional image from surface echo data indicated by the surface position extracted by the surface position extraction means;
Display means for displaying the three-dimensional image generated by the three-dimensional image generation means;
With
The ultrasonic image diagnostic apparatus according to claim 1, wherein the surface position extracting means includes surface tracing means for automatically tracing the object surface position sequentially on a plurality of successive ultrasonic tomographic images.   The surface tracing means includes a luminance change point search means for searching the surface position as a change point of the luminance value on an arc for searching for a desired object surface position, and the change point is set as the center of the arc again. 2. The ultrasonic diagnostic imaging apparatus according to claim 1, wherein the object surface position is newly traced by repositioning.   The ultrasonic image diagnosis apparatus according to claim 1, wherein the surface position extraction unit includes a trace start point designating unit that designates a trace start point to be traced on the ultrasonic tomographic image.   The surface position extracting unit includes a tomographic image constructing unit configured to construct a plurality of tomographic images having different directions generated from echo data in the three-dimensional echo data, and the trace start point designating unit includes the continuous plurality of tomographic images 4. The ultrasonic diagnostic imaging apparatus according to claim 1, wherein the trace start point is designated on the tomographic image having a direction different from that of the ultrasonic tomographic image. Cross-sectional position setting means for setting a desired cross-sectional position in the three-dimensional echo data stored in the three-dimensional echo data storage means;
A shadow adding means for adding a shadow to the surface echo data indicated by the surface position extracted by the surface position extracting means;
With
The three-dimensional image generating means synthesizes a three-dimensional image from the cross-sectional echo data whose position is set by the cross-sectional position setting means and the surface echo data to which the shadow is added by the shadow adding means. The ultrasonic diagnostic imaging apparatus according to claim 1.

Images