JP2015016062A - Ultrasonic image pickup device and ultrasonic image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an ultrasonic image pickup device capable of preventing deterioration of image quality of a two-dimensional image and displaying the two-dimensional image exceeding an area of interest even in a case in which the two-dimensional image and a three-dimensional image are combined and displayed, and provide an ultrasonic image display method.SOLUTION: An ultrasonic image pickup device includes: a volume rendering part which constitutes a three-dimensional image by applying interpolation processing to a plurality of two-dimensional images stored in a first two-dimensional image storage part; a cross section coordinate calculation part which calculates the cross sectional position with respect to the movement of an arbitrary cross section corresponding to the movement of a three-dimensional image; a selection cross section image generation part which generates a selection cross section image in accordance with the movement of the three-dimensional image on the basis of the cross sectional position from at least one of the first two-dimensional image storage part and a second two-dimensional image storage part; and a composite image generation part which composes the three-dimensional image and the selection cross section image.

Description

  The present invention relates to an ultrasonic image pickup apparatus and an ultrasonic image display method, and more particularly to an ultrasonic image pickup apparatus and an ultrasonic image display method for displaying a three-dimensional image.

  The ultrasonic diagnostic apparatus measures the ultrasonic reflectance of a living tissue in a subject using ultrasonic waves, and displays a tomographic image of a diagnostic region using the measured luminance as luminance. In addition, the ultrasonic diagnostic apparatus measures the blood flow velocity by utilizing the Doppler effect due to the blood flow in the subject, and assigns a hue in accordance with the blood flow velocity, so that the blood flow velocity at the diagnostic site is color Doppler. It was displayed as an image (Doppler image). Furthermore, recent ultrasonic diagnostic apparatuses measure the distortion by taking image correlation and spatially differentiating the movement amount (for example, displacement) of the living tissue, or by applying a pressure change to the living tissue. Or measuring the strain or the elastic modulus as an elastic image (for example, Patent Document 1). Further, these images are three-dimensionally configured to generate a three-dimensional image.

  In such an ultrasonic diagnostic apparatus, a combination of a two-dimensional image (tomographic image) showing an arbitrary cross section in volume data and a three-dimensional image (Doppler image) showing blood flow velocity is performed (for example, a patent). Document 2 or Patent Document 3).

JP 2000-60853 A Japanese Patent Laid-Open No. 2001-14446 Japanese Patent No. 4653324

In a conventional ultrasonic diagnostic apparatus, when a two-dimensional image (tomographic image) and a three-dimensional image (Doppler image) are combined, a two-dimensional image (tomographic image) is generated from volume data. However, volume data is generated by performing interpolation processing on a spatially continuous two-dimensional image. Therefore, when generating a two-dimensional image (tomographic image) from volume data, the two-dimensional image (tomographic image) is generated by interpolation processing. ) Image quality deteriorated. In addition, since volume data is generated by performing interpolation processing on the set region of interest (ROI), when generating a two-dimensional image (tomographic image) from the volume data, the two-dimensional image of the set region of interest There was a problem that only (tomographic images) could be displayed.
Therefore, the present invention can prevent deterioration of the image quality of a two-dimensional image and display a two-dimensional image exceeding a region of interest even when displaying a combination of a two-dimensional image and a three-dimensional image. An object is to provide an ultrasonic imaging apparatus.

  The ultrasonic imaging apparatus according to the present invention includes a first two-dimensional image constituting unit that constitutes a two-dimensional image based on first image information, and the two-dimensional image constituted by the first two-dimensional image constituting unit. A second two-dimensional image comprising a first two-dimensional image storage unit that stores the two-dimensional image in association with an acquisition position of the two-dimensional image, and second image information that exhibits different characteristics from the first image information. A second two-dimensional image storage unit that stores the two-dimensional image configured by the two-dimensional image configuration unit, the second two-dimensional image configuration unit in association with an acquisition position of the two-dimensional image, and the first A volume rendering unit that constitutes a three-dimensional image by performing interpolation processing on the plurality of two-dimensional images stored in the two-dimensional image storage unit, and a cross section of an arbitrary cross section corresponding to the movement of the three-dimensional image Sectional coordinate calculation to calculate the position And a selected section corresponding to the movement of the three-dimensional image based on the section position from at least one two-dimensional image storage section of the first two-dimensional image storage section and the second two-dimensional image storage section. A selected cross-sectional image generating unit that generates an image; and a composite image generating unit that combines the three-dimensional image and the selected cross-sectional image.

  According to the present invention, even when a two-dimensional image and a three-dimensional image are displayed in combination, the image quality of the two-dimensional image can be prevented from being deteriorated, and a two-dimensional image exceeding the region of interest can be displayed. .

It is the block diagram which showed an example of the ultrasonic imaging device of this Embodiment. It is the block diagram which showed an example of the cross-section coordinate calculation part. It is the figure which showed an example of the data regarding the gaze direction distance of arbitrary cross sections. It is the figure which showed an example of the data regarding the coordinate of arbitrary cross sections. It is the figure which represented typically about the arbitrary cross-section coordinate calculation part calculating gaze direction distance data. It is the figure which represented typically about the arbitrary cross-section coordinate calculation part calculating cross-section coordinate data. It is the block diagram which showed an example of the volume rendering part. It is the figure which showed that a back side 3D elasticity image and a near side 3D elasticity image were synthesize | combined. It is the figure which showed an example of the image which the image display part of an ultrasonic diagnosing device displays. It is the figure which showed an example of the image which an image display part displays, when a some orthogonal 3 cross-sectional image (two-dimensional tomographic image) is used as a selection cross-sectional image. It is the 1st figure which showed that the transparency of a selection section image and a three-dimensional elasticity image was adjusted, respectively. It is the 2nd figure which showed that the transparency of a selection section image and a three-dimensional elasticity image was adjusted, respectively. It is the 3rd figure which showed that the transparency of a selection cross-sectional image and a three-dimensional elastic image was adjusted, respectively. It is the figure which showed an example of the three-dimensional Doppler image which an image display part displays. It is the block diagram which showed an example of the ultrasonic imaging device which uses elasticity information as 1st image information, uses luminance information as 2nd image information, and uses Doppler information as 3rd image information. It is the figure which showed an example of the image which the image display part of an ultrasonic diagnosing device displays. It is the figure which showed an example of the image which an image display part of an ultrasound diagnosing device displays, when elasticity information is used as 1st image information and Doppler information is used as 3rd image information. It is the figure which showed an example of the image which the image display part of an ultrasound diagnosing device displays, when elasticity information is used as 1st image information and elasticity information is used as 3rd image information.

  Hereinafter, an ultrasonic imaging apparatus according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram illustrating an example of an ultrasonic imaging apparatus according to the present embodiment. The ultrasonic imaging apparatus may be used as an ultrasonic diagnostic apparatus.

  As shown in FIG. 1, the ultrasonic diagnostic apparatus 50 repeats ultrasonic waves to a subject 1 through a probe 2 that is used in contact with the subject 1 and at a fixed time interval via the probe 2. The transmitting unit 3 for transmitting, the receiving unit 4 for receiving the reflected echo signal reflected from the subject 1, the ultrasonic transmission / reception control unit 5 for controlling the transmitting unit 3 and the receiving unit 4, and the reflection received by the receiving unit 4 And a phasing addition unit 6 for phasing and adding echoes.

  The probe 2 is formed by arranging a plurality of transducers, and has a function of transmitting and receiving ultrasonic waves to and from the subject 1 via the transducers. The probe 2 includes a plurality of transducers having a rectangular shape or a sector shape, and can mechanically swing the transducers in a direction orthogonal to the arrangement direction of the plurality of transducers, and can transmit and receive ultrasonic waves three-dimensionally. Note that the probe 2 may be one in which a plurality of transducers are two-dimensionally arranged so that transmission / reception of ultrasonic waves can be electronically controlled.

  The transmitter 3 generates a transmission pulse for driving the transducer of the probe 2 to generate an ultrasonic wave. The transmission unit 3 has a function of setting a convergence point of transmitted ultrasonic waves to a predetermined depth. The receiver 4 amplifies the reflected echo signal received by the probe 2 with a predetermined gain to generate an RF signal (that is, a received signal). The ultrasonic transmission / reception control unit 5 controls the transmission unit 3 and the reception unit 4.

  The phasing / adding unit 6 controls the phase of the RF signal amplified by the receiving unit 4 and forms an ultrasonic beam at one or more convergence points to generate RF signal frame data (corresponding to RAW data). To do.

  The ultrasonic diagnostic apparatus 50 includes a first two-dimensional image configuration unit 7 that forms a two-dimensional image by using first image information based on the RF signal frame data generated by the phasing addition unit 6, and first image information. And a second two-dimensional image constructing unit 9 that constructs a two-dimensional image with second image information that exhibits different characteristics.

  The image information is image information selected from elasticity information, luminance information, and Doppler information. In the present embodiment, elasticity information is used as the first image information, and luminance information is used as the second image information. The first two-dimensional image construction unit 7 measures displacement from the plurality of RF signal frame data generated by the phasing addition unit 6, calculates an elastic value based on the measured displacement, and uses the first image information. A two-dimensional image (two-dimensional elasticity image) is constructed from certain elasticity information. The elastic information includes at least one elastic value among strain, elastic modulus, displacement, viscosity, and strain ratio. Also, the second two-dimensional image construction unit 9 generates a two-dimensional image (two-dimensional tomographic image) from the luminance information as the second image information based on the luminance value of the RF signal frame data generated by the phasing addition unit 6. Image). The second two-dimensional image construction unit 9 receives the RF signal frame data output from the phasing addition unit 6, performs signal processing such as gain correction, log compression, detection, contour enhancement, and filter processing, A two-dimensional image (two-dimensional tomographic image) is constructed.

  The ultrasonic diagnostic apparatus 50 includes a first two-dimensional image storage unit that stores the two-dimensional elasticity image configured by the first two-dimensional image configuration unit 7 in association with the acquisition position (acquisition coordinates) of the two-dimensional elasticity image. 8 and a second two-dimensional image storage unit 10 that stores the two-dimensional tomographic image formed by the second two-dimensional image configuration unit 9 in association with the acquisition position (acquisition coordinates) of the two-dimensional tomographic image; Volume data generation for generating volume data (elastic volume data) by performing three-dimensional coordinate conversion and interpolation processing based on the acquisition position of a two-dimensional image (two-dimensional elastic image) stored in one two-dimensional image storage unit 8 Volumes that make up a three-dimensional image (three-dimensional elastic image) by performing volume rendering using opacity based on the elastic volume data generated by the unit 11 and the volume data generating unit 11 3D based on the sectioning section 12, movement information (information regarding movement, rotation, enlargement, reduction, etc.) of the 3D image (3D elasticity image) and each cross-sectional position (cross-section coordinate) of the orthogonal 3 cross-section image A cross-section coordinate calculation unit 13 that calculates a cross-section position (cross-section coordinates) for movement of an arbitrary cross-section (including three orthogonal cross-sections) corresponding to the movement of the image (three-dimensional elasticity image), and a cross-section calculated by the cross-section coordinate calculation unit 13 Based on the position (cross-sectional coordinates), data is extracted from the first two-dimensional image storage unit 8, and the cross-sectional image (two-dimensional elastic image) orthogonal 3 corresponding to the movement of the three-dimensional image (three-dimensional elastic image). Data is extracted from the second two-dimensional image storage unit 10 based on the first cross-sectional image construction unit 14 that generates a cross-sectional image and the cross-sectional position (cross-sectional coordinate) calculated by the cross-sectional coordinate calculation unit 13, 3D image (3D bullet Based on the cross-sectional position calculated by the second cross-sectional image construction unit 15 that generates an orthogonal three cross-sectional image of the cross-sectional image (two-dimensional tomographic image) according to the movement of the image) and the cross-sectional coordinate calculation unit 13. Data is extracted from the two-dimensional image storage unit 10 and at least one cross-section is selected from the orthogonal three-section images (two-dimensional tomographic images), and a three-dimensional image (three-dimensional) is selected for the selected section (selected section). A three-dimensional image composed of a selected cross-sectional image generation unit 16 that generates a selected cross-sectional image (two-dimensional tomographic image) according to the movement (movement, rotation, enlargement, reduction, etc.) of the elastic image) and the volume rendering unit 12 (3D elasticity image) and the selected cross-sectional image generated by the selected cross-sectional image generation unit 16, and a composite image generation unit 17 that generates a composite image and the orthogonal 3 generated by the first cross-sectional image configuration unit 14. Cross-sectional image (cross-sectional image ) At least one cross-sectional image and at least one cross-sectional image (cross-sectional image) generated by the second cross-sectional image constructing unit 15 are superimposed on the composite image (switching addition unit) 18; And an image display unit 19 for displaying an image superimposed by the superimposing unit 18.

  The ultrasound diagnostic apparatus 50 also controls the control unit 20 that controls each component of the ultrasound diagnostic apparatus 50 and the movement (movement, rotation, enlargement, reduction, etc.) of the 3D image (3D elasticity image). To perform various inputs to the control unit 20, the three-dimensional image control unit 21, and the cross-sectional image position control unit 22. Part 23. The operation unit 23 includes a keyboard, a trackball, and the like.

  Next, operations of the cross-sectional coordinate calculation unit 13, the volume rendering unit 12, and the composite image generation unit 17 of the present embodiment will be described. FIG. 2 is a block diagram illustrating an example of the cross-section coordinate calculation unit 13. As shown in FIG. 2, the cross-sectional coordinate calculation unit 13 includes an arbitrary cross-sectional coordinate calculation unit 100 and an orthogonal three cross-sectional coordinate calculation unit 101. The arbitrary cross-section coordinate calculation unit 100 outputs cross-section coordinate data (data regarding the line-of-sight direction distance and the ultrasonic transmission / reception direction) of the arbitrary cross-section. FIG. 3 is a diagram illustrating an example of data relating to a gaze direction distance of an arbitrary cross section. FIG. 4 is a diagram illustrating an example of data relating to coordinates of an arbitrary cross section. As shown in FIG. 3, the gaze direction distance data 102 stores the gaze direction distance of an arbitrary cross section for each pixel in the same coordinate system as the screen on which the image is finally projected. Also, as shown in FIG. 4, the cross-sectional coordinate data 103 stores the coordinates of an arbitrary cross-section for each pixel in the same coordinate system as the screen on which the image is finally projected. The coordinates of the arbitrary cross section for each pixel are the same as the coordinates stored in the two-dimensional image storage unit (the first two-dimensional image storage unit 8 and the second two-dimensional image storage unit 10). The coordinates stored in the first two-dimensional image storage unit 8 and the second two-dimensional image storage unit 10 are the distance R from the ultrasonic emission surface of the probe 2 and the ultrasonic emission surface of the probe 2. And the transmission / reception direction (θ, φ). The probe 2 can measure the transmission / reception direction (θ, φ) simultaneously with the transmission / reception of ultrasonic waves. The first two-dimensional image storage unit 8 and the second two-dimensional image storage unit 10 The distance R from the ultrasonic emission surface 2 and the transmission / reception direction (θ, φ) corresponding to the acquisition position of the two-dimensional image (two-dimensional elasticity image and two-dimensional tomographic image) are stored. The cross-sectional coordinate data 103 stores the coordinates (R, θ, φ) of an arbitrary cross-section in each pixel on the projection plane, so that the coordinates (R) can be obtained from the first two-dimensional image storage unit 8 and the second two-dimensional image storage unit 10. It is possible to project a two-dimensional image corresponding to (R, θ, φ) onto the projection plane.

  FIG. 5 is a diagram schematically illustrating that the arbitrary cross-section coordinate calculation unit 100 calculates the line-of-sight direction distance data 102. As shown in FIG. 5, the gaze direction distance data 102 stores the gaze direction distance of an arbitrary cross section for each pixel in the same coordinate system (sx, sy) as the screen on which the image is finally projected. The line-of-sight direction distance data 102 is represented by a plane represented by the sx axis and the sy axis. Since the gaze direction distance data 102 is the same coordinate system as the screen on which the image is finally projected, it is a coordinate in a two-dimensional space consisting of the sx axis and the sy axis. Set a three-dimensional space. This three-dimensional coordinate space is taken as an S coordinate system. Note that the sz axis is the line-of-sight direction.

  In FIG. 5, a virtual three-dimensional space represented by the wx axis, the wy axis, and the wz axis is set, and an arbitrary cross section and an orthogonal three cross section image are set in this coordinate space. This three-dimensional coordinate space is a W coordinate system 104. The orthogonal three-section images are set so as to be orthogonal to the wx axis, the wy axis, and the wz axis, respectively. In FIG. 5, an arbitrary cross section 105 orthogonal to the wz axis in the three orthogonal cross-sectional images is illustrated by oblique lines. The transformation from the S coordinate system to the W coordinate system 104 defines a mutual origin position and represents a coordinate transformation matrix that represents a movement (parallel movement, rotational movement, enlargement, reduction, etc.) of a three-dimensional image (three-dimensional elastic image). It can be performed by using. For example, if a 3 × 3 coordinate conversion matrix is Msw, a conversion formula from the S coordinate system to the W coordinate system 104 is expressed by Expression (1).

  (Wx, wy, wz) = Msw · (sx, sy, sz) (1)

  Here, the position of the arbitrary cross section 105 is represented on the wz axis, and is set by the cross section image position control unit 22. When the position of the arbitrary cross section 105 is set at wz = q, assuming that (sx, sy) = (i, j), the three variables sx, sy, and wz in Equation (1) are known, and sz , Wx, wy are unknown. Therefore, sz can be obtained by solving the equation (1) as a simultaneous equation. As shown in FIG. 5, when the line-of-sight direction distance from the screen to the arbitrary cross section 105 at (sx, sy) = (i, j) is k, sz when (sx, sy) = (i, j). Becomes k. At this time, as shown in FIG. 3, the gaze direction distance data 102 stores k in (sx, sy) = (i, j). The arbitrary cross-section coordinate calculation unit 100 performs this calculation with all coordinates (sx, sy), and stores the obtained sz value in each coordinate of the line-of-sight direction distance data 102.

  FIG. 6 is a diagram schematically illustrating that the arbitrary cross-section coordinate calculation unit 100 calculates the cross-section coordinate data 103. As shown in FIG. 6A, an arbitrary cross-sectional image (selected cross-sectional image) is set for volume data (elastic volume data). In this case, the volume data coordinate system 106 is set in the W coordinate system 104. As shown in FIG. 6B, the transformation from the W coordinate system 104 to the volume data coordinate system 106 uses a coordinate transformation matrix that defines each other's origin position and movement amount (parallel movement amount, rotational movement amount, etc.). Can be done. For example, if a 3 × 3 coordinate conversion matrix is Mwv, a conversion formula from the W coordinate system 104 to the volume data coordinate system 106 is expressed by Expression (2).

  (Vx, vy, vz) = Mwv · (wx, wy, wz) (2)

  When wz = q is set by the cross-sectional image position control unit 22, wx and wy are obtained by solving equation (1). Therefore, from equation (2), (sx, sy) = (i, j) vx, vy, vz) is calculated. Further, as shown in FIG. 6C, (R, θ, φ) corresponding to (vx, vy, vz) is obtained by performing inverse transformation of the three-dimensional coordinate transformation performed in the volume data generation unit 11. I want. From the above, (R, θ, φ) for (sx, sy) = (i, j) is obtained. At this time, as shown in FIG. 4, the cross-sectional coordinate data 103 stores (R, θ, φ) in (sx, sy) = (i, j). The arbitrary section coordinate calculation unit 100 performs this calculation with all coordinates (sx, sy), and stores the obtained (R, θ, φ) in each coordinate of the section coordinate data 103.

  Similar to the arbitrary cross-section coordinate calculation unit 100, the orthogonal three-section coordinate calculation unit 101 outputs cross-section coordinate data (data on the line-of-sight direction distance and the ultrasonic transmission / reception direction) of the three cross-sections. Similarly to the cross-section coordinate data 103, the cross-section coordinate data of the three orthogonal cross sections is the same coordinate system as the screen on which the image is finally projected, and the coordinates (R, θ, φ) of each cross section of the orthogonal three cross-section image for each pixel. ). The coordinates (R, θ, φ) of the arbitrary cross section for each pixel are the same as the coordinates stored in the two-dimensional image storage unit (the first two-dimensional image storage unit 8 and the second two-dimensional image storage unit 10). Coordinates. Specifically, in the coordinate transformation matrix Msw representing the movement of the equation (1), cross-sectional coordinate data of three orthogonal cross sections by setting the rotation component to 0 degree, 90 degrees around the wy axis, and 90 degrees around the wx axis. Is obtained. For example, if the rotation component is 90 degrees around the wy axis, the sz axis and the wx axis are parallel, and a cross-sectional image of the wy-wz plane viewed from the front is obtained.

  The first cross-sectional image construction unit 14 and the second cross-sectional image construction unit 15 are based on the cross-sectional coordinate data of the three orthogonal cross-sections output from the orthogonal three-section cross-section coordinate calculation unit 101, and the two-dimensional image storage unit (first From the two-dimensional image storage unit 8 and the second two-dimensional image storage unit 10), three cross-sectional images (two-dimensional tomographic images or two-dimensional elastic images) corresponding to the coordinates (R, θ, φ) of three orthogonal cross sections are obtained. Each is generated and projected onto the screen projection plane. In addition, when the two-dimensional image corresponding to the coordinates (R, θ, φ) of the orthogonal three cross-sectional images is not in the two-dimensional image storage unit, the first cross-sectional image configuration unit 14 and the second cross-sectional image configuration unit 15 are An orthogonal three-section image (a two-dimensional tomographic image or a two-dimensional elastic image) is generated by performing interpolation processing on the values of adjacent coordinates.

  The selected cross-sectional image generation unit 16 corresponds to the coordinates (R, θ, φ) of the arbitrary cross section from the second two-dimensional image storage unit 10 based on the cross-section coordinate data 103 output from the arbitrary cross-section coordinate calculation unit 100. A selected cross-sectional image (two-dimensional tomographic image) is generated and projected onto a screen projection plane. If the second two-dimensional image storage unit 10 does not have a two-dimensional image corresponding to the coordinates (R, θ, φ) of the selected cross-sectional image, the selected cross-sectional image generation unit 16 performs an interpolation process on the values of adjacent coordinates. To generate a selected cross-sectional image (two-dimensional tomographic image).

  FIG. 7 is a block diagram illustrating an example of the volume rendering unit 12. FIG. 8 is a diagram illustrating that the volume rendering unit 12 configures the back side 3D image and the near side 3D image, respectively. The volume rendering unit 12 includes a back side volume rendering unit (first volume rendering unit) 200 and a near side volume rendering unit (second volume rendering unit) 201. In the present embodiment, since elasticity information is used as the first image information, the volume rendering unit 12 renders elastic volume data to form a three-dimensional elasticity image.

  In this embodiment, in order to simplify the description, a case will be described in which the inspector is set to render a range representing the hardest part. However, the inspector may set to render a plurality of ranges. The back side volume rendering unit 200 and the near side volume rendering unit 201 perform volume rendering on the elastic volume data within the set hardness range using Equations (3) to (5), and generate a three-dimensional elastic image. Configure.

Eout (i) = Eout (i-1) + (1-Aout (i-1)). A (i) .E (i) .S (i) (3)
Aout (i) = Aout (i-1) + (1-Aout (i-1)). A (i) (4)
A (i) = EOpacity [E (i)] (5)

  E (i) is an i-th elasticity value on the line of sight when the three-dimensional elasticity image is viewed from a certain point on the two-dimensional projection surface on which the three-dimensional elasticity image is projected. For data outside the set hardness range, calculation is performed with E (i) = 0. Eout (i) is an output pixel value. For example, when the elasticity values of N voxels are arranged on the line of sight, the integrated value Eout (N−1) obtained by integrating the elasticity values from i = 0 to i = N−1 is the pixel value that is finally output. Become. Eout (i-1) indicates the integrated value up to the (i-1) th line of sight. A (i) is the opacity of the i-th elastic value existing on the line of sight, and is an elastic opacity table shown in Expression (5).

  S (i) is a weight component for shading calculated from the gradient obtained from the elastic value E (i) and the elastic values around it, for example, centering on voxel i (i-th voxel on the line of sight). When the normal line of the selected surface coincides with the light source direction, the surface centered on the voxel i (i-th voxel on the line of sight) reflects the light of the light source most strongly, so S (i) = 1.0 is given. When the normal is orthogonal to the light source direction, S (i) = 0.0 is given. Thus, S (i) represents an enhancement effect such as a shadow based on the light of the light source.

  Both Eout (i) and Aout (i) are set to 0 as an initial value, and as shown in Expression (5), Aout (i) is integrated and converges to 1.0 each time it passes through the voxel. Therefore, as shown in Expression (4), when the integrated value Aout (i−1) ≈1.0 of the opacity of the voxels up to the (i−1) th line of sight is 1.0, the i-th and subsequent voxel values on the line of sight. E (i) is not reflected in the output image.

  The back volume rendering unit (first volume rendering unit) 200 receives the line-of-sight direction distance data 102 from the arbitrary cross-section coordinate calculation unit 100, and uses the line-of-sight direction distance of the selected cross-sectional image 301 stored in the line-of-sight direction distance data 102. Rendering is performed on the volume data on the far side in the line-of-sight direction to form a three-dimensional elasticity image (three-dimensional image). For example, when the value stored in the coordinates (x, y) on the line-of-sight direction distance data 102 is k, and the elasticity values of N voxels are arranged on the line of sight of the coordinates (x, y), the back volume rendering unit 200. Integrates the elastic value from i = k + 1 to i = N−1 using the equations (3) to (5). Thereby, the back side three-dimensional elasticity image 300 located in the back from the selection cross-sectional image 301 is obtained.

  The near-side volume rendering unit (second volume rendering unit) 201 receives the line-of-sight direction distance data 102 from the arbitrary cross-section coordinate calculation unit 100 and uses the line-of-sight direction distance of the selected cross-sectional image 301 stored in the line-of-sight direction distance data 102. Rendering is performed on the volume data on the near side in the line of sight direction to form a three-dimensional elasticity image (three-dimensional image). For example, when the value stored in the coordinates (x, y) on the line-of-sight direction distance data 102 is k and the elasticity values of N voxels are arranged on the line of sight of the coordinates (x, y), the front volume rendering unit 201 Uses the equations (3) to (5) to integrate the elasticity values from i = 0 to i = k. As a result, a near-side three-dimensional elasticity image 302 positioned in front of the selected slice image 301 is obtained.

  In FIG. 8, the back side three-dimensional elasticity image 300 obtained from the back side volume rendering unit 200, the selected slice image 301 obtained from the selected slice image generation unit 16, and the near side three dimensional elasticity image obtained from the near side volume rendering unit 201. 302 is synthesized. The composite image generation unit 17 combines the images in the order of the back side three-dimensional elastic image 300, the selected cross-sectional image 301, and the near side three-dimensional elastic image 302 to generate a composite image.

  FIG. 9 is a diagram illustrating an example of an image displayed by the image display unit 19 of the ultrasonic diagnostic apparatus 50. As shown in FIG. 9, based on the elastic color map 400, a dark color is assigned to a hard part and a light color is assigned to a soft part. Although the elastic color map 400 of FIG. 9 expresses the hardness of the tissue discretely, a color that continuously changes from a hard part to a soft part may be assigned. Further, as shown in FIG. 9, the superimposing unit (switching addition unit) 18 generates orthogonal three-section images (two-dimensional tomographic images) 401, 408, and 409 and orthogonal three-section images (two-dimensional elasticity images) 402, 410, and 411. Superimposed. The image display unit 19 includes orthogonal three-section images 412, 413, and superimposed three-section images (two-dimensional tomographic images) 401, 408, and 409 and orthogonal three-section images (two-dimensional elasticity images) 402, 410, and 411. 414, and a composite image 404 obtained by combining and displaying the selected cross-sectional image 405 and the three-dimensional elasticity image (the back side three-dimensional elasticity image and the near side three-dimensional elasticity image) 406 are displayed. The selected cross-sectional image 405 in the composite image 404 is the same cross-sectional image as the orthogonal three-sectional image (two-dimensional tomographic image) 401 according to the movement (movement, rotation, enlargement, reduction, etc.) of the three-dimensional elastic image 406. It has been moved. That is, the selected slice image generation unit 16 selects the selected slice according to the movement (movement, rotation, enlargement, reduction, etc.) of the three-dimensional image (three-dimensional elasticity image) 406 with respect to the selected slice (selected slice) 401. An image (two-dimensional tomographic image) 405 is generated.

  A composite image 404 shows a spatial relationship between the selected cross-sectional image (two-dimensional tomographic image) 405 and the three-dimensional elasticity image 406. Further, in the conventional ultrasonic diagnostic apparatus, since the region of interest is set to determine the region for creating volume data, only a two-dimensional image (tomographic image) of the region of interest can be displayed. On the other hand, in the ultrasonic diagnostic apparatus 50 according to the present embodiment, orthogonal three-section images (two-dimensional tomographic images) 401, 408, and 409, orthogonal three-section images (two-dimensional elasticity images) 402, 410, and 411, and selected sectional images. Since 405 is generated regardless of the volume data, each cross-sectional image can be drawn even in a wide range outside the range in which the region of interest 407 is set. Further, in the ultrasonic diagnostic apparatus 50 according to the present embodiment, a two-dimensional image storage unit (first two-dimensional image storage unit) is generated without generating a two-dimensional image (tomographic image) from the volume data subjected to the interpolation processing. By directly referring to the values of the two-dimensional images stored in the 8 and the second two-dimensional image storage unit 10), it is possible to render an image with high accuracy before performing the interpolation process.

  In the present embodiment, one two-dimensional tomographic image 401 is used as the selected cross-sectional image 405, but another orthogonal three-sectional image (for example, two-dimensional tomographic image 408) may be used as the selected cross-sectional image. A plurality of orthogonal three-section images (for example, two-dimensional tomographic images 408 and 409) may be used as the selected section images. FIG. 10 is a diagram illustrating an example of an image displayed by the image display unit 19 when a plurality of orthogonal three cross-sectional images (two-dimensional tomographic images) are used as the selected cross-sectional images. As shown in FIG. 10, the synthesized image 424 is an image obtained by synthesizing a plurality of selected slice images 405, 415, 416 corresponding to orthogonal three slice images (two-dimensional tomographic images) 401, 408, 409 and a three-dimensional elasticity image 406. It becomes. In this case, the back side 3D image (back side 3D elastic image) and the front side 3D image (front side 3D elastic image) are portions of the 3D image divided by the respective orthogonal 3 cross-sectional images (total 8). Therefore, the volume rendering unit 12 includes a back volume rendering unit 200 and a front volume rendering unit 201 corresponding to each part, and renders volume data for each of the three parts. An image may be constructed.

  As mentioned above, although embodiment concerning this invention was described, this invention is not limited to these, It can change and deform | transform within the range described in the claim.

  For example, the transparency of the selected cross-sectional image and the three-dimensional image may be adjusted. 11 to 13 are diagrams showing that the transparency of the selected cross-sectional image and the three-dimensional elasticity image is adjusted. As illustrated in FIG. 11, when the composite image generation unit 17 generates a composite image, the selected cross-sectional image 500 and the three-dimensional image (three-dimensional elastic image) 501 are multiplied by the respective transparency, thereby selecting the selected cross-sectional image 500. And the transparency of the three-dimensional image (three-dimensional elastic image) 501 are adjusted. In this case, as shown in FIGS. 11 to 13, the cross-sectional image transparency setting unit 503 that controls the transparency of the selected cross-sectional image 500 by the operation unit 23 and the transparency 3 of the three-dimensional image (three-dimensional elastic image) 501 are controlled. A dimensional image transparency setting unit 504 is provided on the screen of the image display unit 19. FIG. 11 shows a combined image 502 that is combined with each transparency being zero. FIG. 12 shows a synthesized image 502 synthesized by setting the transparency of the three-dimensional elastic image 501 high. FIG. 13 shows a synthesized image 502 synthesized by setting the transparency of the selected cross-sectional image 500 high. As described above, by changing the transparency, it is easier to grasp the spatial relationship between the selected cross-sectional image 500 and the three-dimensional image (three-dimensional elastic image) 501.

  In the above embodiment, elasticity information is used as the first image information. However, Doppler information (for example, blood flow velocity information) may be used as the first image information. When blood flow velocity information is used as the first image information, the first two-dimensional image construction unit 7 performs operations such as Doppler demodulation on the plurality of RF signal frame data generated by the phasing addition unit 6. The blood flow velocity information is converted into a two-dimensional image (two-dimensional Doppler image). The first two-dimensional image storage unit 8 stores a two-dimensional image (two-dimensional Doppler image), and the volume data generation unit 11 performs volume data (two-dimensional Doppler image) based on the acquisition position of the two-dimensional image (two-dimensional Doppler image). Blood flow volume data), and the first cross-sectional image constructing unit 14 generates an orthogonal three-section image of the cross-sectional image (two-dimensional Doppler image) in accordance with the movement of the three-dimensional image (three-dimensional Doppler image).

  FIG. 14 is a diagram illustrating an example of a three-dimensional Doppler image displayed by the image display unit 19. As shown in FIG. 14, colors are assigned to positive and negative blood flow velocities based on the blood flow color map 600. For example, red is assigned to the positive blood flow velocity and blue is assigned to the negative blood flow velocity. The blood flow color map 600 in FIG. 14 expresses positive and negative blood flow velocity discretely, but a color map for assigning a hue that continuously changes from a positive blood flow velocity to a negative blood flow velocity is provided. May be used. In FIG. 14, the image display unit 19 displays orthogonal three-section images obtained by superimposing orthogonal three-section images (two-dimensional tomographic images) 601, 608, and 609 and orthogonal three-section images (two-dimensional Doppler images) 602, 610, and 611, respectively. A composite image 604 in which the selected cross-sectional image (two-dimensional tomographic image) 605 and the three-dimensional Doppler image (the back-side three-dimensional Doppler image and the near-side three-dimensional Doppler image) 606 are combined and displayed is displayed. Further, the selected cross-sectional image 605 in the composite image 604 is the same cross-sectional image as the orthogonal three-sectional image (two-dimensional tomographic image) 601 according to the movement (movement, rotation, enlargement, reduction, etc.) of the three-dimensional Doppler image 606. It has been moved. That is, the selected slice image generation unit 16 selects the selected slice according to the movement (movement, rotation, enlargement, reduction, etc.) of the three-dimensional image (three-dimensional Doppler image) 606 with respect to the selected slice (selected slice) 601. An image (two-dimensional tomographic image) 605 is generated. A composite image 604 shows a spatial relationship between the selected cross-sectional image (two-dimensional tomographic image) 605 and the three-dimensional Doppler image 606. Further, in the conventional ultrasonic diagnostic apparatus, since the region of interest is set to determine the region for creating volume data, only a two-dimensional image (tomographic image) of the region of interest can be displayed. On the other hand, in the ultrasonic diagnostic apparatus 50 according to the present embodiment, orthogonal three-section images (two-dimensional tomographic images) 601, 608, 609, orthogonal three-section images (two-dimensional Doppler images) 602, 610, 611, and selected sectional images. Since 605 is generated regardless of the volume data, each cross-sectional image can be rendered even in a wide range outside the range in which the region of interest 407 is set. Further, in the ultrasonic diagnostic apparatus 50 according to the present embodiment, a two-dimensional image storage unit (first two-dimensional image storage unit) is generated without generating a two-dimensional image (tomographic image) from the volume data subjected to the interpolation processing. By directly referring to the values of the two-dimensional images stored in the 8 and the second two-dimensional image storage unit 10), it is possible to render an image with high accuracy before performing the interpolation process.

  In addition, although one two-dimensional tomographic image 601 is used as the selected cross-sectional image 605, another orthogonal three-sectional image (for example, two-dimensional Doppler image 610) may be used as the selected cross-sectional image. (For example, the two-dimensional tomographic image 608 and the two-dimensional Doppler image 610) may be used as the selected cross-sectional image.

  In the above embodiment, elasticity information or Doppler information (blood flow information) is used as the first image information. However, elasticity information is used as the first image information, and Doppler information is used as the third image information. It may be used. Note that the second image information remains luminance information. FIG. 15 is a block diagram illustrating an example of an ultrasonic imaging apparatus that uses elasticity information as the first image information, uses luminance information as the second image information, and uses Doppler information as the third image information. . As shown in FIG. 15, the ultrasonic diagnostic apparatus 500 forms a two-dimensional image (two-dimensional elastic image) with the first image information (elastic information) based on the RF signal frame data generated by the phasing addition unit 6. The second two-dimensional image forming the two-dimensional image (two-dimensional tomographic image) by the first two-dimensional image constructing unit 7 and the second image information (luminance information) showing characteristics different from the first image information A third two-dimensional image that constitutes a two-dimensional image (two-dimensional blood flow image) by the configuration unit 9 and the third image information (Doppler information) showing characteristics different from the first image information and the second image information. And a configuration unit 700.

  The first two-dimensional image construction unit 7 measures displacement from the plurality of RF signal frame data generated by the phasing addition unit 6, calculates an elastic value based on the measured displacement, and uses the first image information. A two-dimensional image (two-dimensional elasticity image) is constructed from certain elasticity information. The elastic information includes at least one elastic value among strain, elastic modulus, displacement, viscosity, and strain ratio. Also, the second two-dimensional image construction unit 9 generates a two-dimensional image (two-dimensional tomographic image) from the luminance information as the second image information based on the luminance value of the RF signal frame data generated by the phasing addition unit 6. Image). The second two-dimensional image construction unit 9 receives the RF signal frame data output from the phasing addition unit 6, performs signal processing such as gain correction, log compression, detection, contour enhancement, and filter processing, A two-dimensional image (two-dimensional tomographic image) is constructed. In addition, the third two-dimensional image construction unit 700 performs operations such as Doppler demodulation on the RF signal frame data generated by the phasing addition unit 6, and generates a two-dimensional image from the Doppler information that is the third image information. (Two-dimensional blood flow image) is constructed.

  The ultrasonic diagnostic apparatus 500 includes a first two-dimensional image storage unit 8 that stores the two-dimensional elasticity image configured by the first two-dimensional image configuration unit 7 in association with the acquisition position (acquisition coordinates), and the second The second two-dimensional image storage unit 10 that stores the two-dimensional tomographic image configured by the two-dimensional image configuration unit 9 in association with the acquisition position (acquisition coordinates) and the third two-dimensional image configuration unit 700 A second two-dimensional blood flow image stored in the first two-dimensional image storage unit 8 and a third two-dimensional image storage unit 701 that stores the two-dimensional blood flow image in association with the acquisition position (acquisition coordinates). A volume data generation unit 11 that generates volume data (elastic volume data) by performing three-dimensional coordinate conversion and interpolation processing based on the acquisition position of the elasticity image), and based on the elastic volume data generated by the volume data generation unit 11 Z Volume rendering is performed using opacity and volume rendering unit 12 constituting a three-dimensional image (three-dimensional elastic image) and movement information (moving, rotating, enlarging and reducing) of three-dimensional image (three-dimensional elastic image) Information) and the cross-sectional position for the movement of an arbitrary cross-section (including the orthogonal three cross-sections) corresponding to the movement of the three-dimensional image (three-dimensional elastic image) based on the cross-sectional positions (cross-sectional coordinates) of the orthogonal three cross-sectional images. Based on the cross-sectional coordinate calculation unit 13 that calculates (cross-sectional coordinates) and the cross-sectional position (cross-sectional coordinates) calculated by the cross-sectional coordinate calculation unit 13, data is extracted from the second two-dimensional image storage unit 10 and 3 Calculated by the second cross-sectional image constructing unit 15 that generates an orthogonal three cross-sectional image of the cross-sectional image (two-dimensional tomographic image) according to the movement of the three-dimensional image (three-dimensional elastic image) and the cross-sectional coordinate calculating unit 13 Based on the surface position (cross-sectional coordinates), data is extracted from the third two-dimensional image storage unit 701, and a cross-sectional image (two-dimensional blood flow image) corresponding to the movement of the three-dimensional image (three-dimensional elastic image) is extracted. Data is extracted from the second two-dimensional image storage unit 10 based on the cross-sectional position (cross-sectional coordinates) calculated by the third cross-sectional image constructing unit 704 that generates the orthogonal three cross-sectional images and the cross-sectional coordinate calculating unit 13. Then, at least one cross section is selected from the orthogonal three cross section images (two-dimensional tomographic image), and the movement (movement, rotation, enlargement) of the three-dimensional image (three-dimensional elastic image) with respect to the selected cross section (selected cross section), Based on the first selected cross-sectional image generation unit 702 that generates a selected cross-sectional image (two-dimensional tomographic image) according to the cross-sectional position (cross-sectional coordinate) calculated by the cross-sectional coordinate calculation unit 13, and the like. 3 data from the two-dimensional image storage unit 701 Extract and select at least one section from orthogonal three-section images (two-dimensional blood flow image), and move (move, rotate) the three-dimensional image (three-dimensional elastic image) with respect to the selected section (selected section). , Enlargement, reduction, etc.) a second selected cross-sectional image generation unit 703 that generates a selected cross-sectional image (two-dimensional blood flow image) and three orthogonal cross sections generated by the first selected cross-sectional image generation unit 702 Superimposing at least one selected cross-sectional image (two-dimensional tomographic image) of the image and at least one selected cross-sectional image (two-dimensional blood flow image) of the three orthogonal cross-sectional images generated by the second selected cross-sectional image generating unit 703; Thus, the selected section image superimposing unit 705 for generating the superimposed selected section image, the three-dimensional image (three-dimensional elastic image) configured by the volume rendering unit 12, and the selected section image superimposing unit 705 generated by the selected section image superimposing unit 705. A composite image generation unit 17 that combines images and generates a composite image, and at least one cross-sectional image of the three orthogonal cross-sectional images generated by the second cross-sectional image configuration unit 15 and a third cross-sectional image configuration unit 704 And a superimposing unit (switching addition unit) 18 that superimposes at least one cross-sectional image of the three orthogonal cross-sectional images on the composite image, and an image display unit 19 that displays an image superimposed by the superimposing unit 18.

  Note that the ultrasonic diagnostic apparatus 500 extracts data from the first two-dimensional image storage unit 8 and is orthogonal 3 of the cross-sectional image (two-dimensional elastic image) according to the movement of the three-dimensional image (three-dimensional elastic image). The first cross-sectional image forming unit 14 that generates the cross-sectional image is provided, and the superimposing unit (switching addition unit) 18 synthesizes at least one cross-sectional image of the three orthogonal cross-sectional images generated by the first cross-sectional image forming unit 14. Although the image may be superimposed on the image, the first cross-sectional image construction unit 14 is omitted in FIG.

  The first selected cross-sectional image generation unit 702 and the second selected cross-sectional image generation unit 703 have the same functions as the above-described selected cross-sectional image generation unit 16, and each of the selected cross-sectional image (two-dimensional tomographic image and two-dimensional blood image). Stream image). The selected slice image superimposing unit 705 superimposes the two-dimensional tomographic image and the two-dimensional blood flow image to generate a superimposed selected slice image. The weight for superimposing the selected cross-sectional image may be set from the operation unit 23. Similar to the above, the composite image generation unit 17 combines the three-dimensional image (three-dimensional elastic image) and the superimposed selected cross-sectional image to generate a composite image.

  FIG. 16 is a diagram illustrating an example of an image displayed by the image display unit 19 of the ultrasonic diagnostic apparatus 500. As shown in FIG. 16, based on the blood flow color map 800, colors are assigned to positive and negative blood flow velocities. Further, based on the elastic color map 850, a dark color is assigned to a hard part and a light color is assigned to a soft part. The blood flow color map 800 discretely expresses positive and negative blood flow velocities, but a color map for assigning a hue that continuously changes from a positive blood flow velocity to a negative blood flow velocity is used. Also good. The elastic color map 850 discretely represents the hardness of the tissue, but a color that continuously changes from a hard part to a soft part may be assigned.

  In addition, the image display unit 19 includes orthogonal three-section images 812, 812, 810, and 811 superimposed and displayed with orthogonal three-section images (two-dimensional tomographic images) 801, 808, 809 and orthogonal three-section images (two-dimensional Doppler images) 802, 810, 811, respectively. 813, 814, a selected slice image (two-dimensional tomographic image) 804 and a selected slice image (two-dimensional Doppler image) 815 superimposed, a superimposed selected slice image 816, and a three-dimensional elasticity image (back 3) A composite image 806 obtained by combining and displaying a three-dimensional elastic image and a front three-dimensional elastic image 805 is displayed. In addition, the superposition selection cross-sectional image 816 in the composite image 806 is the same cross-sectional image as the orthogonal three cross-sectional image (two-dimensional tomographic image) 812 according to the movement (movement, rotation, enlargement, reduction, etc.) of the three-dimensional elastic image 805. Moved. That is, the selected cross-sectional image generation unit (the first selected cross-sectional image generation unit 702 and the second selected cross-sectional image generation unit 703) performs a three-dimensional image (three-dimensional elasticity image) on the selected cross-section (selected cross-section). Selected cross-sectional images (two-dimensional tomographic image 804 and two-dimensional Doppler image 815) corresponding to the movement (movement, rotation, enlargement, reduction, etc.) 805 are generated. The selected slice image superimposing unit 705 superimposes the selected slice images (two-dimensional tomographic image 804 and two-dimensional Doppler image 815), and generates a superimposed selected slice image 816. A composite image 806 shows a spatial relationship between the superimposed selected cross-sectional image 816 and the three-dimensional elasticity image 805. For example, tumors are generally harder than other tissues and tend to be rich in blood flow. Therefore, according to the present embodiment, the two-dimensional tomographic image 804 and the two-dimensional Doppler image 815 are superimposed, and the superimposed selection cross-sectional image 816 is generated, thereby observing the tissue image and blood flow around the tumor. In addition, the three-dimensional elastic image 805 can be combined to grasp the spread of hardness around the tumor in a three-dimensional manner.

  Further, in the conventional ultrasonic diagnostic apparatus, since the region of interest is set to determine the region for creating volume data, only a two-dimensional image (tomographic image) of the region of interest can be displayed. On the other hand, in the ultrasonic diagnostic apparatus 500 of the present embodiment, orthogonal three-section images (two-dimensional tomographic images) 801, 808, 809, orthogonal three-section images (two-dimensional Doppler images) 802, 810, 811 and selected sectional images. Since 816 is generated regardless of the volume data, each cross-sectional image can be drawn even in a wide range outside the range in which the region of interest 407 is set. Further, in the ultrasonic diagnostic apparatus 500 of the present embodiment, a two-dimensional image storage unit (first 2D) is generated without generating a two-dimensional image (tomographic image and blood flow image) from the volume data subjected to the interpolation processing. By directly referring to the values of the two-dimensional images stored in the two-dimensional image storage unit 8, the second two-dimensional image storage unit 10, and the third two-dimensional image storage unit 701). A highly accurate image can be drawn.

  In addition, one set of two-dimensional images (two-dimensional tomographic image 801 and two-dimensional Doppler image 802) is used as the superposed selection sectional image 816, but another set of orthogonal three-sectional images (for example, two-dimensional tomographic images 808 and 2). Dimensional Doppler image 810) may be used as the superposed selection cross-sectional image, and a plurality of sets of orthogonal three-section images (for example, a set of two-dimensional tomographic image 808 and two-dimensional Doppler image 810, two-dimensional tomographic image 809 and two-dimensional Doppler image). Two sets including the set of images 811) may be used as the selected cross-sectional image. In addition, the transparency of the superimposed selection cross-sectional image 816 and the three-dimensional image (three-dimensional elastic image 805) may be adjusted.

  The ultrasonic diagnostic apparatus 500 in FIG. 15 uses elasticity information as the first image information and uses Doppler information as the third image information, but uses the Doppler information as the first image information. Elastic information may be used as Note that the second image information remains luminance information. When blood flow velocity information is used as the first image information, the first two-dimensional image construction unit 7 performs operations such as Doppler demodulation on the plurality of RF signal frame data generated by the phasing addition unit 6. The blood flow velocity information is converted into a two-dimensional image (two-dimensional Doppler image). When elastic information is used as the third image information, the third two-dimensional image construction unit 700 measures displacement from a plurality of RF signal frame data generated by the phasing addition unit 6, and based on the measured displacement. The elasticity value is calculated, and a two-dimensional image (two-dimensional elasticity image) is constructed from the elasticity information that is the third image information. The elastic information includes at least one elastic value among strain, elastic modulus, displacement, viscosity, and strain ratio.

  FIG. 17 is a diagram illustrating an example of an image displayed by the image display unit 19 of the ultrasonic diagnostic apparatus 500 when elasticity information is used as the first image information and Doppler information is used as the third image information. is there. As shown in FIG. 17, based on the elastic color map 900, a dark color is assigned to a hard part and a light color is assigned to a soft part. Further, based on the blood flow color map 901, colors are assigned to positive and negative blood flow velocities. The elastic color map 900 discretely represents the hardness of the tissue, but a color that continuously changes from a hard part to a soft part may be assigned. The blood flow color map 901 expresses positive and negative blood flow velocity discretely, but a color map for assigning a hue that continuously changes from a positive blood flow velocity to a negative blood flow velocity is used. Also good.

  As shown in FIG. 17, orthogonal three-section images (two-dimensional tomographic images) 902, 908, and 909 and orthogonal three-section images (two-dimensional elasticity images) 903, 910, and 911 are superimposed by a superimposing unit (switching addition unit) 18. The The image display unit 19 includes orthogonal three-section images 912, 913 in which orthogonal three-section images (two-dimensional tomographic images) 902, 908, and 909 and orthogonal three-section images (two-dimensional elasticity images) 903, 910, and 911 are superimposed and displayed, respectively. 914, a superimposed selected sectional image 916 obtained by superimposing a selected sectional image (two-dimensional tomographic image) 904 and a selected sectional image (two-dimensional elastic image) 915, a superimposed selected sectional image 916, and a three-dimensional Doppler image (back three-dimensional Doppler image). A composite image 906 obtained by combining and displaying the image and the front three-dimensional Doppler image) 905 is displayed. In addition, the superposition selection cross-sectional image 916 in the composite image 906 is the same cross-sectional image as the orthogonal three cross-sectional image (two-dimensional tomographic image) 912 according to the movement (movement, rotation, enlargement, reduction, etc.) of the three-dimensional Doppler image 905. Moved. In other words, the selected cross-sectional image generation unit (the first selected cross-sectional image generation unit 702 and the second selected cross-sectional image generation unit 703) performs a three-dimensional image (three-dimensional Doppler image) on the selected cross-section (selected cross-section). Selected cross-sectional images (two-dimensional tomographic image 902 and two-dimensional elastic image 903) corresponding to the movement (movement, rotation, enlargement, reduction, etc.) 905 are generated. The selected slice image superimposing unit 705 superimposes the selected slice images (two-dimensional tomographic image 902 and two-dimensional elastic image 903), and generates a superimposed selected slice image 916. A composite image 906 shows a spatial relationship between the superimposed selected cross-sectional image 916 and the three-dimensional elasticity image 905. According to the present embodiment, the two-dimensional tomographic image 902 and the two-dimensional elastic image 903 are superimposed, and the superimposed selection cross-sectional image 916 is generated, whereby the tissue image and elasticity information around the tumor can be observed. By synthesizing the three-dimensional Doppler image 905, the blood flow state around the tumor can be grasped in three dimensions.

  Further, in the conventional ultrasonic diagnostic apparatus, since the region of interest is set to determine the region for creating volume data, only a two-dimensional image (tomographic image) of the region of interest can be displayed. On the other hand, in the ultrasonic diagnostic apparatus 500 of the present embodiment, orthogonal three-section images (two-dimensional tomographic images) 902, 908, 909, orthogonal three-section images (two-dimensional elasticity images) 903, 910, 911, and selected sectional images. Since 916 is generated regardless of the volume data, each cross-sectional image can be drawn even in a wide range outside the range in which the region of interest 407 is set. Further, in the ultrasonic diagnostic apparatus 500 of the present embodiment, a two-dimensional image storage unit (first 2D) is generated without generating a two-dimensional image (tomographic image and blood flow image) from the volume data subjected to the interpolation processing. By directly referring to the values of the two-dimensional images stored in the two-dimensional image storage unit 8, the second two-dimensional image storage unit 10, and the third two-dimensional image storage unit 701). A highly accurate image can be drawn.

  In addition, one set of two-dimensional images (two-dimensional tomographic image 902 and two-dimensional elastic image 903) is used as the superposed selection sectional image 916, but another set of orthogonal three-sectional images (for example, two-dimensional tomographic images 908 and 2). Dimensional elasticity image 910) may be used as the superimposed selected slice image, and a plurality of sets of orthogonal three slice images (for example, a set of two-dimensional tomographic image 908 and two-dimensional elastic image 910, two-dimensional tomographic image 909 and two-dimensional elastic image). Two sets including the set of images 911) may be used as the selected cross-sectional images. In addition, the transparency of the superimposed selection cross-sectional image 916 and the three-dimensional image (three-dimensional Doppler image 905) may be adjusted.

  The first image information, the second image information, and the third image information can be selected from luminance information, elasticity information, and Doppler information by the operation unit 23. Further, the first image information and the third image information may be the same image information selected from luminance information, elasticity information, and Doppler information. For example, elasticity information may be used as the first image information, luminance information may be used as the second image information, and elasticity information may be used as the third image information. That is, the third image information may be image information that exhibits different characteristics from the second image information. FIG. 18 is a diagram illustrating an example of an image displayed by the image display unit 19 of the ultrasonic diagnostic apparatus 500 when elasticity information is used as the first image information and elasticity information is used as the third image information. is there. As shown in FIG. 18, the image display unit 19 is an orthogonal display in which orthogonal three cross-sectional images (two-dimensional tomographic images) 902, 908, and 909 and orthogonal three cross-sectional images (two-dimensional elastic images) 903, 910, and 911 are superimposed and displayed. A three-section image 912, 913, 914, a selected section image (two-dimensional tomographic image) 904 and a selected section image (two-dimensional elasticity image) 915 are superimposed, a superimposed selection section image 916, and a three-dimensional elasticity A composite image 926 in which the images (back side three-dimensional elasticity image and front side three-dimensional elasticity image) 925 are synthesized and displayed is displayed. In addition, the superposition selection cross-sectional image 916 in the composite image 926 is the same cross-sectional image as the orthogonal three cross-sectional image (two-dimensional tomographic image) 912 according to the movement (movement, rotation, enlargement, reduction, etc.) of the three-dimensional elastic image 925. Moved. That is, the selected cross-sectional image generation unit (the first selected cross-sectional image generation unit 702 and the second selected cross-sectional image generation unit 703) performs a three-dimensional image (three-dimensional elasticity image) on the selected cross-section (selected cross-section). Selected cross-sectional images (two-dimensional tomographic image 902 and two-dimensional elastic image 903) corresponding to the movement (movement, rotation, enlargement, reduction, etc.) of 925 are generated. The selected slice image superimposing unit 705 superimposes the selected slice images (two-dimensional tomographic image 902 and two-dimensional elastic image 903), and generates a superimposed selected slice image 916. A composite image 926 shows the spatial relationship between the superimposed selected cross-sectional image 916 and the three-dimensional elastic image 925.

  Based on the elastic color map 950, a dark color is assigned to the hard part and a light color is assigned to the soft part. The elastic color map 950 discretely represents the hardness of the tissue, but a color that continuously changes from a hard part to a soft part may be assigned. The two-dimensional elastic image 903 and the three-dimensional elastic image 925 may be elastic images based on different elastic value ranges according to the hardness of the tissue. For example, the two-dimensional elasticity image 903 is an elasticity image based on a range of elasticity values from a hard part to a soft part, and the three-dimensional elasticity image 925 is an elasticity image based on a range of elasticity values of a hard part. Good. In this case, the second selected slice image generation unit 703 generates an elasticity image corresponding to a predetermined elasticity value range as a selected slice image, and the volume rendering unit 12 generates an elasticity image corresponding to the predetermined elasticity value range. Are configured as a three-dimensional image. Since the tumor is generally harder than other tissues, the three-dimensional elastic image 925 is displayed as an elastic image representing the tumor (hard portion). On the other hand, the two-dimensional elastic image 903 is displayed as an elastic image including both a tumor (hard portion) and its periphery (soft portion). In this case, the range of the elasticity value of the elasticity image displayed in the two-dimensional elasticity image 903 and the three-dimensional elasticity image 925 may be adjusted by setting the indicator 951 in the elasticity color map 950, or by the operation unit 23. It may be adjusted by inputting a predetermined elasticity value. A plurality of elasticity color maps corresponding to each of the two-dimensional elasticity image 903 and the three-dimensional elasticity image 925 may be provided. By setting an indicator for each of the plurality of elasticity color maps, the elasticity value of the elasticity image The range may be adjusted.

  According to the present embodiment, the two-dimensional tomographic image 902 and the two-dimensional elastic image 903 are superimposed, and the superimposed selection cross-sectional image 916 is generated, whereby the tissue image and elasticity information around the tumor can be observed. By synthesizing the three-dimensional elastic image 925, the spread of hardness around the tumor can be grasped in three dimensions. Further, by adjusting the range of the elasticity value of the elasticity image, it is possible to display elasticity images having different elasticity values in the two-dimensional elasticity image 903 and the three-dimensional elasticity image 925, and display the tumor as the three-dimensional elasticity image 925. Then, the periphery of the tumor can be displayed as a two-dimensional elastic image 903.

  The present invention prevents an image quality of a two-dimensional image from being deteriorated even when displaying a combination of a two-dimensional image and a three-dimensional image, and can display a two-dimensional image exceeding the region of interest. It is useful as an image pickup apparatus and an ultrasonic image display method.

2 Probe 3 Transmitter 4 Receiving Unit 5 Ultrasonic Transmission / Reception Control Unit 6 Phased Adder 7 First 2D Image Constructing Unit 8 First 2D Image Storage Unit 9 Second 2D Image Constructing Unit 10 Two-dimensional image storage unit 11 Volume data generation unit 12 Volume rendering unit 13 Cross-sectional coordinate calculation unit 14 First cross-sectional image configuration unit 15 Second cross-sectional image configuration unit 16 Selected cross-sectional image generation unit 17 Composite image generation unit 18 Superposition Unit 19 Image display unit 20 Control unit 21 Three-dimensional image control unit 22 Cross-sectional image position control unit 23 Operation unit 50,500 Ultrasound diagnostic apparatus 100 Arbitrary cross-section coordinate calculation unit 101 Orthogonal three-section coordinate calculation unit 200 Back side volume rendering unit ( First volume rendering unit)
201 Front volume rendering unit (second volume rendering unit)
700 Third dimensional image construction unit 701 Third dimensional image storage unit 702 First selected cross-sectional image generation unit 703 Second selected cross-sectional image generation unit 704 Third cross-sectional image construction unit 705 Selected cross-sectional image superimposing unit

Claims (12)

A first two-dimensional image constructing unit that constructs a two-dimensional image from the first image information;
A first two-dimensional image storage unit that stores the two-dimensional image configured by the first two-dimensional image configuration unit in association with an acquisition position of the two-dimensional image;
A second two-dimensional image constructing unit that constructs a two-dimensional image with second image information that exhibits different characteristics from the first image information;
A second 2D image storage unit that stores the 2D image configured by the second 2D image configuration unit in association with an acquisition position of the 2D image;
A volume rendering unit that constitutes a three-dimensional image by performing interpolation processing on the plurality of two-dimensional images stored in the first two-dimensional image storage unit;
A cross-sectional coordinate calculation unit that calculates a cross-sectional position for movement of an arbitrary cross-section corresponding to the movement of the three-dimensional image;
Based on the cross-sectional position, a selected cross-sectional image corresponding to the movement of the three-dimensional image is obtained from at least one of the first two-dimensional image storage unit and the second two-dimensional image storage unit. A selected cross-sectional image generation unit to generate,
An ultrasonic image capturing apparatus comprising: a composite image generation unit configured to combine the three-dimensional image and the selected slice image. A volume data generation unit that performs volumetric data conversion and interpolation processing based on an acquisition position of the 2D image stored in the first 2D image storage unit, and generates volume data;
First, data is extracted from the first two-dimensional image storage unit based on the cross-sectional position calculated by the cross-sectional coordinate calculation unit, and an orthogonal three-sectional image corresponding to the movement of the three-dimensional image is generated. A cross-sectional image construction unit;
Secondly, data is extracted from the second two-dimensional image storage unit based on the cross-sectional position calculated by the cross-sectional coordinate calculation unit, and an orthogonal three-sectional image corresponding to the movement of the three-dimensional image is generated. A cross-sectional image construction unit,
The volume rendering unit performs volume rendering based on the volume data generated by the volume data generation unit, configures the three-dimensional image,
The selected cross-sectional image generation unit extracts data from the second two-dimensional image storage unit based on the cross-sectional position calculated by the cross-sectional coordinate calculation unit, and extracts at least one cross-section from the orthogonal three cross-sectional image. Selecting, generating the selected cross-sectional image according to the movement of the three-dimensional image with respect to the selected cross-section,
The composite image generation unit generates the composite image by combining the three-dimensional image formed by the volume rendering unit and the selected cross-sectional image generated by the selected cross-sectional image generation unit. The ultrasonic imaging apparatus according to 1. A third two-dimensional image constructing unit that constructs a two-dimensional image with third image information that exhibits different characteristics from the second image information;
A second two-dimensional image storage unit that stores the two-dimensional image configured by the third two-dimensional image configuration unit in association with an acquisition position of the two-dimensional image;
A first selected cross-sectional image generating unit that generates a selected cross-sectional image according to the movement of the three-dimensional image based on the cross-sectional position from the second two-dimensional image storage unit;
A second selected cross-sectional image generating unit that generates a selected cross-sectional image according to the movement of the three-dimensional image based on the cross-sectional position from the third two-dimensional image storage unit;
A selected slice that generates a superimposed selected slice image by superimposing the selected slice image generated by the first selected slice image generation unit and the selected slice image generated by the second selected slice image generation unit. An image superimposing unit,
The ultrasonic image imaging apparatus according to claim 1, wherein the synthesized image generation unit synthesizes the three-dimensional image and the superimposed selected slice image. A third two-dimensional image constructing unit that constructs a two-dimensional image with third image information that exhibits different characteristics from the second image information;
A second two-dimensional image storage unit that stores the two-dimensional image configured by the third two-dimensional image configuration unit in association with an acquisition position of the two-dimensional image;
Based on the cross-sectional position calculated by the cross-sectional coordinate calculation unit, data is extracted from the third two-dimensional image storage unit, and a third orthogonal cross-sectional image corresponding to the movement of the three-dimensional image is generated. A cross-sectional image construction unit;
Based on the cross-sectional position calculated by the cross-section coordinate calculation unit, data is extracted from the second two-dimensional image storage unit, and at least one cross-section is selected from the orthogonal three-section image, and the selected cross-section is selected. A first selected cross-sectional image generating unit that generates a selected cross-sectional image corresponding to the movement of the three-dimensional image;
Based on the cross-sectional position calculated by the cross-section coordinate calculation unit, data is extracted from the third two-dimensional image storage unit, and at least one cross-section is selected from the orthogonal three-section image, and the selected cross-section is selected. A second selected cross-sectional image generation unit that generates a selected cross-sectional image corresponding to the movement of the three-dimensional image;
At least one selected slice image of the orthogonal three slice images generated by the first selected slice image generator and at least one selected slice image of the orthogonal three slice images generated by the second selected slice image generator A selection slice image superimposing unit that generates a superposition selection slice image by superimposing,
The composite image generation unit generates the composite image by combining the three-dimensional image formed by the volume rendering unit and the superimposed selected cross-sectional image generated by the selected cross-sectional image superimposing unit. The ultrasonic imaging apparatus according to claim 2.   The ultrasonic image capturing apparatus according to claim 1, wherein the image information is image information selected from elasticity information, luminance information, and Doppler information.   The ultrasonic image imaging apparatus according to claim 3 or 4, wherein the first image information and the third image information are the same image information selected from luminance information, elasticity information, and Doppler information. . The cross-sectional coordinate calculation unit includes an arbitrary cross-sectional coordinate calculation unit that outputs cross-sectional coordinate data of an arbitrary cross-section,
The selected cross-sectional image generation unit generates the selected cross-sectional image corresponding to the coordinates of the arbitrary cross-section based on the cross-sectional coordinate data,
The volume rendering unit
The line-of-sight direction distance data is input from the arbitrary cross-section coordinate calculation unit, and the three-dimensional image is configured with respect to volume data located on the back side of the line-of-sight direction from the line-of-sight direction distance of the selected cross-sectional image stored in the line-of-sight direction distance data. 1 volume rendering unit,
The line-of-sight direction distance data is input from the arbitrary cross-section coordinate calculation unit, and the three-dimensional image is configured with respect to volume data that is closer to the line-of-sight direction than the line-of-sight direction distance of the selected cross-sectional image stored in the line-of-sight direction distance data. The ultrasonic imaging apparatus according to claim 1, further comprising two volume rendering units. The cross-sectional coordinate calculation unit includes an orthogonal three-section coordinate calculation unit that outputs cross-section coordinate data of the three orthogonal cross-sections,
The first cross-sectional image configuration unit and the second cross-sectional image configuration unit respectively generate three cross-sectional images corresponding to the coordinates of the three orthogonal cross sections based on the cross-sectional coordinate data,
At least one cross-sectional image of the cross-sectional image generated by the first cross-sectional image constituent unit and at least one cross-sectional image of the cross-sectional image generated by the second cross-sectional image constituent unit are superimposed on the composite image. The ultrasonic imaging apparatus according to claim 2, further comprising a superimposing unit.   The composite image generation unit adjusts the transparency of the selected cross-sectional image and the three-dimensional image by multiplying the selected cross-sectional image and the three-dimensional image by respective transparency when generating the composite image. The ultrasonic imaging apparatus according to claim 1. The first image information and the third image information are elasticity information,
The second selected cross-sectional image generation unit generates an elastic image corresponding to a predetermined elastic value range as the selected cross-sectional image,
The ultrasonic image capturing apparatus according to claim 3, wherein the volume rendering unit configures an elastic image corresponding to a predetermined elastic value range as the three-dimensional image.   The ultrasonic image capturing apparatus according to claim 10, wherein an elastic color map having an indicator for adjusting the range of the elastic value is displayed. A first two-dimensional image is formed from the first image information;
Storing the first two-dimensional image in association with the acquisition position of the two-dimensional image;
A second two-dimensional image is composed of second image information showing characteristics different from the first image information;
Storing the second two-dimensional image in association with the acquisition position of the two-dimensional image;
By interpolating the first two-dimensional image, a three-dimensional image is formed,
Calculating a cross-sectional position for movement of an arbitrary cross-section corresponding to the movement of the three-dimensional image;
Generating a selected cross-sectional image corresponding to the movement of the three-dimensional image based on the cross-sectional position from at least one two-dimensional image of the first two-dimensional image and the second two-dimensional image;
An ultrasonic image display method comprising combining the three-dimensional image and the selected cross-sectional image.

Images