JP2006217939A - Image display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a body movement and deformation image display device which evaluates a three-dimensional body movement and deformation of an object of examination, and fuses images from different imaging means and displays in real time. <P>SOLUTION: The image display device has first and second ultrasonic probes 2 which send an ultrasonic wave to the object of examination 1 and acquires reflection signal from the object of examination, and in which piezoelectric elements are arranged in the form of an array, a body movement detection section 12 forming a two-dimensional ultrasonic image by using the reflection signal acquired by the first and second ultrasonic probes, sets a plurality of evaluation areas used for the evaluation of the body movements of the object of examination in the image and detects the amount of three-dimensional body movement and deformation in the evaluation area, a means to acquire an MRI including the same area as the two-dimensional ultrasonic image and sets an area corresponding to the evaluation area in the image for coordination and an image deformation section to move or deform the MRI by using the body movement evaluated in the body movement detection section and displays a deformed MRI image in real time. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image display apparatus that displays an image of body movement and deformation of an inspection object using ultrasonic waves.

  Imaging means represented by ultrasonic waves, MRI (Magnetic Resonance Imaging), and X-rays are indispensable as means for visually observing an inspection object. Functional images that visualize biological functions such as positron emission tomography (PET images) that visualize the accumulation of sugar in tumors and ultrasonic Doppler images that visualize blood flow are also important for diagnosis and treatment. It is used as a support image.

  These medical images have different merits and demerits depending on the region and composition of the imaging target. For example, an ultrasonic image can be displayed in real time and is excellent in portability, but contrast resolution is not sufficient. In addition, the MRI image has high contrast resolution and excellent angiography. However, many limitations caused by working in a shelter that cuts off an external magnetic field can be problematic because of a long imaging time. Therefore, it is necessary for the doctor to appropriately select the optimum imaging means depending on the patient's condition and diagnosis location. In addition, regarding a functional image, it is difficult to specify a part only with the single image, and the usefulness can be exhibited only after the part can be specified using a morphological image.

  In order to combine images, it is necessary to evaluate the movement of the inspection object and to match the images.

  A body motion detection method using a conventional ultrasonic imaging apparatus will be described below.

  A technique has been reported in which a biplane image is acquired by two ultrasonic probes arranged orthogonally and the three-dimensional motion of an inspection object located on the intersection line is evaluated (for example, see Non-Patent Document 1). ). The principle of the method is that the motion of the inspection object is projected onto the image as a component vector in each direction (x, y, z direction), and the component vector is calculated by cross-correlation between two temporally continuous images. And reconstructing a three-dimensional motion vector to be inspected.

  It is also possible to extract the outline of the tissue by evaluating the body movement. Many conventional techniques related to tissue contour extraction have been reported so far, and enhancement of high-intensity signals subjected to filtering or the like, or removal of low-intensity signals is common. However, in contour extraction using only luminance information, the difference in acoustic impedance at the boundary where the same tissue is folded is small, so it is difficult to depict the boundary. On the contrary, if there is a difference in acoustic impedance even at the non-boundary part It is drawn as a boundary. Therefore, it is difficult to accurately depict the boundary of the tissue, and in particular, it is difficult to depict the overlapping boundary of the same tissue such as the lobe boundary of the liver tissue.

Japan Super Medical Basic Research Materials Vol. 103, No. 4, p. 29 (2003)

  Since ultrasound images can be displayed in real time, image guidance in less invasive treatments such as HIFU (High Intensity Focused Ultrasound) treatment, in which laparoscopic surgery or intense ultrasound is focused on the affected area and heated and solidified. However, it is an effective means. On the other hand, there are many situations in which an image with sufficient contrast cannot be obtained for use in the follow-up of treatment and effect determination, and still images by MRI must be collated with guides by ultrasonic images.

  Therefore, there is a demand for a technique for combining a morphological image and a functional image obtained by different imaging means and displaying an optimal image for a patient in real time. In particular, there is a need for a technique for displaying including the deformation of tissues caused by body movements and respiratory movements.

  Accordingly, an object of the present invention is to provide an image display device capable of displaying a high-resolution, high-function image that combines the real-time property of an ultrasonic imaging device and the superiority of other imaging means.

  In order to achieve the above object, the image display apparatus of the present invention three-dimensionally evaluates the body movement and deformation of an inspection object using an ultrasonic image, and based on the evaluation result, other MRI images, X-rays, and the like. The image by the imaging means is deformed and displayed as a two-dimensional image or a three-dimensional image.

  Hereinafter, typical configuration examples of the image display apparatus of the present invention will be listed.

  (1) First and second ultrasonic probes for transmitting ultrasonic waves to an inspection object and acquiring a reflection signal from the inspection object, and the first and second ultrasonic probes A body motion detector configured to construct an ultrasound image using a reflection signal acquired by the child and detect a three-dimensional body motion and a deformation amount from the ultrasound image information, and a body motion or deformation evaluated by the body motion detector An image display unit for displaying the quantity and the ultrasonic image, wherein the body motion detection unit performs the body motion detection using a plurality of ultrasonic images having intersecting lines.

  (2) In the image display device according to (1), the three-dimensional body motion is decomposed into velocity component vectors of an orthogonal coordinate system, and the velocity component vectors projected on a plurality of ultrasonic images are obtained to obtain 3 It is characterized by inferring body movement and deformation in a dimension.

  (3) In the image display device according to (1), the body motion detection unit sets a plurality of evaluation regions used for body motion evaluation of the inspection target in the image plane of the configured ultrasonic image, A three-dimensional body movement and a deformation amount are detected from information of the ultrasonic image in the evaluation region.

  (4) In the image display device according to any one of (1) to (3), each of the first and second ultrasonic probes includes a plurality of piezoelectric elements in a one-dimensional or two-dimensional array. It is an arrayed ultrasonic probe.

  (5) In the image display device according to (1), an area corresponding to the evaluation area is set in an image plane of an image including the same area as the ultrasonic image acquired by another imaging unit. Means for matching, and means for reflecting the body motion or deformation amount evaluated by the body motion detection unit in an image by the other imaging unit and moving or deforming the image, the image display unit, A modified image of the image obtained by the other imaging means is further displayed.

  (6) In the image display device according to (5), the image obtained by the other imaging unit is a morphological image of an MRI image or an X-ray image, or a functional image of a PET image or an ultrasonic Doppler image. To do.

  (7) Two ultrasonic probes that transmit and receive ultrasonic waves to and from the inspection target and obtain a two-dimensional tomographic image of the inspection target, and biplane images acquired by the two ultrasonic probes, Means for detecting a velocity component vector of body motion to be examined; means for obtaining an image including at least one of the biplane images by the other imaging means; and the other imaging The image processing apparatus includes: means for deforming an image by the means based on the velocity component vector; and an image display unit for displaying the deformed image.

  According to the present invention, it is possible to display a high-resolution, high-function image combining the real-time property of an ultrasonic imaging apparatus and the superiority of other imaging means, and an image optimal for diagnosis and treatment can be displayed.

    Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

Example 1
FIG. 1 is a block diagram showing a configuration of an image display apparatus according to an embodiment of the present invention. FIG. 2 is a flowchart of processing until an image obtained by an imaging unit other than ultrasonic waves is deformed in accordance with an actual movement using the evaluation results of body movement and deformation amount by ultrasonic waves and displayed.

  In the image display apparatus according to the present embodiment, ultrasonic waves are transmitted / received to / from the inspection target, biplane images are acquired by two ultrasonic probes that obtain a two-dimensional tomographic image (B mode) of the inspection target, and the biplane A three-dimensional velocity component vector of body motion is detected from the image, and an image including the same part as at least one of the biplane images is obtained by other imaging means (for example, MRI or X-ray imaging device). The acquired MRI image or X-ray image is deformed based on the velocity component vector, and the deformed image is displayed as needed.

  First, an apparatus configuration from acquisition of an ultrasonic image to be inspected to display of a deformed image using an image by imaging means other than ultrasonic waves will be described with reference to the block diagram of FIG.

  The ultrasonic probe (hereinafter referred to as a probe) 2 has a structure in which a plurality of piezoelectric elements are arranged in parallel. An analog transmission signal is sent to each piezoelectric element from the transmission beam former 3 via the D / A converter 4 and irradiates ultrasonic waves toward the inspection object 1. The ultrasonic wave transmitted from each piezoelectric element is electronically delayed by the transmission beam former 3 and is focused at a predetermined depth. The transmission signal is reflected in the inspection object 1 and received again by each piezoelectric element of the probe. The reflected echo received by each piezoelectric element is corrected by the TGC (Time Gain Control) unit 5 for the attenuation that varies depending on the arrival depth of the transmission wave, and then converted into a digital signal by the A / D converter 6, and the received beam Sent to former 7.

  The reception beam former 7 outputs the addition result by multiplying a delay time corresponding to the distance from the focal position to each piezoelectric element. A two-dimensional reflected echo distribution of the inspection object 1 is obtained by two-dimensionally scanning the focused ultrasonic wave. An RF signal divided into a real part and an imaginary part is output from the reception beam former 7 and sent to the envelope detection unit 8 and the initial position setting unit 11. The signal sent to the envelope detection unit 8 is converted into a video signal, interpolated between the scan lines by the scan converter 9 and reconstructed into two-dimensional image data, and then displayed on the image display unit 10. Is done. The initial position setting unit 11 sets the imaging cross-sectional position of the initial frame that tracks the body movement and deformation of the inspection target. The RF data after the initial position is set is sent to the body motion detection unit 12. The body motion detection unit 12 can evaluate a three-dimensional body motion and deformation amount by setting a region (evaluation region) for evaluating body motion and deformation and performing cross-correlation between frames.

  The deformed image storage unit 15 stores a three-dimensional image to be inspected by an imaging means (MRI, X-ray apparatus, etc.) other than ultrasound acquired before or during surgery. The extracted slice initial position setting unit 16 extracts a slice image corresponding to the initial frame of the ultrasonic image set by the initial position setting unit 11 from the three-dimensional image stored in the deformed image storage unit. Using the slice image corresponding to the initial frame and the stored three-dimensional image, the extracted cross-section relative movement unit 13 performs image processing according to the body movement and the deformation amount evaluated by the body movement detection unit 12. When there are a plurality of evaluation regions set by the body motion detection unit 12, the evaluation regions on the image after processing by the extracted image relative movement unit may be located discontinuously. The extracted section reconstruction unit 14 continuously corrects such discontinuity in the evaluation region, reconstructs it into one two-dimensional image, and displays it on the display unit 10.

  Next, according to the flowchart of FIG. 2, details of steps from acquisition of an image by each imaging unit to display will be described. For the sake of simplicity, an MRI image will be described as an example of an image obtained by imaging means other than ultrasound.

  First, at least two pieces of ultrasonic RF data that intersect with each other in step 11 are acquired. Ultrasonic probes for acquiring images include a one-dimensional array type and a two-dimensional array type. To obtain a biplane image using a one-dimensional array type requires a plurality of probes, or a mechanical drive or device to rotate or scan. Further, when a probe having a structure in which a piezoelectric element is arranged in an N-shape, H-shape or # -shape as shown in FIG. 3 is used, there is no need for rotation or scanning, so that no mechanical drive is required. . Further, if a two-dimensional array type probe is used, two-dimensional oblique can be electronically performed, so that an arbitrary cross section can be imaged according to the shape of the inspection object.

  Next, the basic principle of the method of the present invention will be described with reference to FIGS. 4, 5, and 6 prior to describing the method for evaluating the body movement and deformation amount of the inspection object from step 12 to step 13. To do.

  FIG. 4 is a diagram illustrating a configuration example of a probe for acquiring a biplane image, an imaging surface thereof, and a trajectory of an inspection target moving from the intersection line of the biplane image.

  FIG. 5 is a diagram illustrating a trajectory of an inspection object that passes through one imaging surface. 5A is a diagram viewed from the x-axis direction, and FIG. 5B is a diagram viewed from the z-direction.

  FIG. 6 shows an ultrasound image at each position of the inspection object shown in FIG.

  As shown in FIG. 4, the probes 20 and 21 are arranged in a T shape, and ultrasonic waves are alternately scanned to form a biplane composed of two-dimensional tomographic images 22 (xz plane) and 23 (yz plane). Get an image. Here, an example of a T-shaped arrangement has been described, but a cross-shaped arrangement, for example, is also possible as long as a plurality of images having intersecting lines can be obtained.

  When the inspection object 24 located on the intersection line of the biplane image moves with the velocity vector V, the velocity component vectors Va and Vb are projected onto the imaging surface 22 and the imaging surface 23. The velocity component vector that changes in each imaging plane can be evaluated by a cross-correlation calculation between temporally consecutive frames. However, when the movement of the inspection target deviates from the imaging plane, the luminance information is lost and the correlation between frames cannot be obtained. Therefore, it is necessary to acquire RF data under the condition of a high-speed frame rate so that minute movements to be inspected are captured in each frame so that luminance information is not lost as much as possible. This will be described below with reference to the drawings.

  Paying attention to the yz plane in FIGS. 5A and 5B, consider an inspection object that passes through the imaging surface 31. Reference numerals 30a, 30b, 30c, and 30d represent the positions of inspection targets in the temporally continuous frames, and move in the order of 30a → 30b → 30c → 30d. Images at each position are as shown in FIG. Reference numerals 33a, 33b, 33c, and 33d correspond to the frames 30a, 30b, 30c, and 30d, respectively, and reference numerals 34a, 34b, 34c, and 34d denote tomographic images to be inspected in the respective frames. The image 35 obtained by superimposing the continuous frames 33a and 33b shows a state in which the tomographic image to be inspected moves from 34a to 34b. When the inspection object moves out of the imaging plane of the probe, the tomographic image is not a similar translational movement but a movement with a contour deformation, like 34a and 34b shown in the image 35. However, if cross-correlation calculation is performed between the two, a velocity component vector related to the movement of the center of gravity of the inspection object can be obtained. If this method is applied to a biplane image and each velocity component vector is obtained, a three-dimensional body motion vector to be examined can be reconstructed.

  Subsequently, the setting of the evaluation area in step 12 will be described.

  In the present invention, as shown in FIG. 7, a plurality of evaluation areas 71 are set on the biplane images 70a and 70b, and the amount of movement is calculated by cross-correlation between evaluation areas at the same place between temporally consecutive frames. Ask for. Although the movement in each evaluation region is regarded as a rigid body motion without deformation, the deformation of the inspection object can be evaluated by combining individual movement amounts obtained in each evaluation region. Further, if the amount of movement of the specific signal of interest between consecutive frames exceeds the size of the evaluation area, the specific signal cannot be followed. Therefore, it is necessary to set the size and number of evaluation areas based on the movement or deformation size of the inspection target and the calculation time required for the evaluation.

  Specs formed by interference between contour components such as the contour of the object to be inspected and the boundary between tissues, and ultrasonic waves scattered by minute scatterers scattered inside and outside the tissue to be inspected as signal components used for correlation calculation Component is considered. In the present invention, the amount of movement is calculated by setting an evaluation area for the entire image without distinguishing between the two. As a result, it is possible to evaluate body movements in areas where characteristic luminance information such as contour components cannot be obtained. When the above-mentioned specific signal is considered as a speckle component, its magnitude is 1 mm in the azimuth direction and 0.5 mm in the time direction, although it depends on the aperture of the probe and the center frequency used. Therefore, the size of the evaluation area needs to be at least equal to the size of the speckle component. By obtaining the movement of the speckle component, it becomes possible to visualize the deformation inside the tissue without contour information. It is also possible to visualize the denaturation of the test object due to heat and external efficacy. Furthermore, it is possible to evaluate slippage associated with body movement between tissues based on the movement of each set evaluation area, and it is possible to discriminate tissue contours and boundaries independent of the internal structure of the tissues.

  Next, the evaluation of the body movement and deformation amount in step 13 will be described. FIG. 8 shows a flowchart for obtaining the velocity component vector in each evaluation region.

  First, an arbitrary number of evaluation areas are set on the biplane image (step 1). Next, a frame for starting body motion evaluation is set as a reference frame (n) (step 2). Next, the next frame (n + 1) continuous in time is acquired, and cross-correlation calculation is performed between the same evaluation areas on both frames (step 3). Next, it is determined whether or not the movement amount obtained by the correlation calculation is 0 (step 4). If the amount of movement is not 0, the process returns to step 2 and the frame at that time is reset as the reference frame. When the movement amount is 0, the next frame (n + 2) is further acquired, and the cross-correlation calculation with the reference frame is calculated (step 5). Then, Step 4 and Step 5 are repeated until the movement amount becomes zero, and a velocity component vector between temporally continuous frames is obtained as needed.

  Since each evaluation region is set discretely, it is necessary to estimate the motion other than the evaluation region using the obtained velocity component vector and perform an interpolation process for making the motion of the inspection object continuous.

As an interpolation method, there is a method of obtaining an average value obtained by adding a weight according to a distance based on a velocity component vector in the vicinity of an interpolation area. This method will be described with reference to FIG. Assume adjacent evaluation areas a (40a) and b (40b) on the image, and n evaluation areas are interpolated between the evaluation areas. The velocity component vector of the evaluation region to be interpolated, aj (j = 1, 2,... N) is weighted according to the distance between the evaluation region a and the evaluation region b, and is expressed by (Equation 1) shown below. Calculate as follows.
aj = [(n + 1−j) / (n + 1)] a + [j / (n + 1)] b (Expression 1)
(J = 1, 2,... N)
If the above calculation is performed in the vertical and horizontal directions as well as in the diagonal direction, the evaluation area having a linear luminance change can be interpolated.

  Next, acquisition of an image (MRI image) by imaging means other than ultrasonic waves in step 14 will be described.

  The first method for acquiring an MRI image of the same tomographic plane as the ultrasonic image is a method using a marker that can be contrasted by MRI. If three or more MRI markers are fixed on the ultrasonic imaging surface, the imaging surface including the inclination can be determined in the space, and an MRI image having the same cross section as the ultrasonic wave can be captured.

  The second method is a method in which a plurality of characteristic parts to be landmarks in the body are determined in advance, and an imaging surface in the inspection body is relatively determined based on the characteristic parts. As a characteristic part, the outline of a skeleton or an organ that is less affected by breathing or peristaltic movement can be used.

  Next, the matching between the ultrasonic image and the MRI image in step 15 will be described.

  MRI images generally have a wider field of view than ultrasound images. Therefore, it is necessary to check which part of the MRI image acquired in step 14 corresponds to the region where the body motion can be detected, and to match both images. In the case where an MRI marker is used in step 14, alignment can be easily achieved by placing markers at positions where the position of the probe can be determined in advance, for example, at both ends of the probe. It is also possible to take a matching between images by substituting a tissue having a characteristic shape or brightness inside the living body as a marker. At that time, it is also an effective means to perform filter processing for enhancing the tissue shape.

  Next, the deformation and display of the image by the imaging means other than the ultrasonic image in step 16 will be described.

  In general, since the pixel size is different between an ultrasonic image and an MRI image, pixel interpolation or thinning is first performed in any image. The interpolation method is the same as the velocity component vector interpolation method already described with reference to FIG. Assume that the evaluation areas 40a and 40b are pixels on adjacent MRI images, and n pixels are interpolated between the pixels. The luminance of the pixel aj (j = 1, 2,... N) to be complemented is calculated by (Equation 1). Another possible method is to calculate the luminance of the pixel to be interpolated by weighting according to the luminance of the surrounding area.

  Subsequently, the corresponding evaluation region on the MRI image is moved according to the velocity component vector in each evaluation region obtained in step 13. Three-dimensional and two-dimensional images can be displayed. In the case of a three-dimensional image, there is a time loss required to display the deformed image, but the body movement, deformation, and position information of the examination region can be visually grasped.

  However, from the biplane image obtained with the configuration of FIG. 4, a three-dimensional body motion velocity vector can be obtained only in the evaluation area on the intersection line of the biplane image, and from other evaluation areas on the image. Can only obtain velocity component vectors on each image. Therefore, it is necessary to estimate the continuity of the inspection object from the bulk modulus and density and to extend the partially evaluated body motion to three dimensions. When an arbitrary cross section of an inspection object can be imaged using a two-dimensional array probe or the like, velocity component vectors at a plurality of dispersed points in the inspection object space can be obtained, so that three-dimensional body movement can be accurately performed. Can be evaluated.

  When the body motion to be examined is a periodic motion such as respiratory motion, a three-dimensional MRI image at a plurality of time phases of the motion cycle is stored in advance, and the subject to be examined is determined from the evaluated body motion and deformation state. It is also possible to determine in which time phase and display a three-dimensional MRI image in the corresponding time phase. In addition, when the body motion to be examined is mainly caused by respiratory motion and can be approximated as a two-dimensional motion, the display image is not necessarily three-dimensional. In the case of two-dimensional image display, an MRI deformed image can be displayed at a high frame rate, and it is effective as a biopsy that requires real-time display or an intraoperative image guide.

  Next, an image to be displayed will be described. An image in which a two-dimensional or three-dimensional MRI image is deformed in real time is displayed using a velocity vector of body motion obtained using an ultrasonic image. Further, the present technology can be any morphological image including an X-ray image.

  Furthermore, by superimposing a PET image or an ultrasonic Doppler image on an MRI image or an X-ray image, an image including blood flow or cancer tissue position information is displayed on a two-dimensional or three-dimensional deformed image having a high contrast. be able to. FIG. 10 shows an example in which an MRI image 100 is superimposed with a blood flow ultrasonic Doppler image 101.

The present invention can be applied to treatment, particularly low-invasive HIFU treatment or heavy particle beam treatment, and used as an intraoperative support image. The displayed image can grasp changes in the treatment site over time, including not only body movements but also deformations, so there is little invasion of normal sites, and there is an excess of intense ultrasound or heavy particle beams Accurate treatment with less irradiation becomes possible.
Also, during intracranial surgery such as brain tumors, changes in the internal pressure of the brain occur before and after the skull opening, and the position of the treatment site changes. For this reason, after confirming the treatment site by MRI and opening the skull before surgery, the position of the treatment site must be estimated from the image before opening, and MRI imaging must be performed again as necessary. Therefore, by applying the method according to the present invention and monitoring the change in position and deformation of the treatment site before and after opening, it is possible to accurately and shorten the operation time without re-imaging.

(Example 2)
Hereinafter, a tissue contour extraction technique using the image display device described in the first embodiment will be described with reference to FIGS. 11, 12, 13, and 14.

  FIG. 11 is a flowchart relating to the second embodiment. The steps (step 11 to step 13) from the imaging of the ultrasonic orthogonal two-section image of the region of interest to the evaluation of body movement and deformation amount are performed as described in the first embodiment.

  The evaluated body movement evaluation result is displayed on the B-mode image (step 114). The display form may be a moving image in which the set marker moves or an image in which a motion vector of body movement is displayed, and the form is not limited as long as the body movement in the set evaluation area can be recognized. However, the vector display is effective for grasping the shear boundary generated in the tissue lobe and the slowness of the periodic movement of the tissue.

  Next, a region that can be regarded as a continuum is extracted from the displayed tissue movement. For explanation, attention is paid to the liver tissue 60 shown in FIG. The liver tissue 60 has a boundary 64 in which lobes are folded and deviated in opposite directions by body movement. However, when the liver tissue 60 is imaged in the ultrasonic B mode, the boundary between the lobes is not clearly depicted like the liver tissue 63a of the image 63 because there is no great difference in acoustic impedance. However, when the calculated body motion vector is displayed on the B-mode image 61 in which the boundary has disappeared, the boundary 64 where the shear is generated can be depicted as an image 61a. If the contour extraction of the tissue boundary information obtained from the drawn shear boundary 64 and the ultrasound B-mode image 62 is combined, an contour extraction image can be displayed as shown in an image 62a (step). 115).

  As shown in FIG. 13, a plurality of contour extraction image display forms are conceivable. The image 81 is a vector type display form in which body motion is displayed as a vector and the size and direction of deformation can be observed. The image 82 is a color-coded display form that is color-coded according to body movement and the speed of body movement. The images 83a and 83b are mesh-type display forms in which the region of interest is cut by a mesh and the deformation is discriminated based on how the mesh is deformed. Further, by using the technique for combining images from different imaging means described in the first embodiment, the display form of FIG. 13 using MRI or X-ray images can be realized.

  In addition, the continuum area | region can be extracted in three dimensions by performing the above outline extraction by several cross sections.

  Further, the present technology can be applied to a less invasive treatment such as a HIFU treatment or a heavy particle beam treatment to identify the position of a treatment site and can be used for an accurate treatment technology that does not invade a normal site. An example of HIFU treatment for a tumor near a lobe of liver tissue will be described.

  FIG. 14 shows a liver tissue 90, an ablation area 91 by high-intensity ultrasound, and a lobe boundary 92 extracted by body motion evaluation. During treatment, the periphery of the boundary is set as a non-cauterized region 93. If the lobe boundary 92 is deformed as 92a after the treatment is started and the ablation area 91a comes into contact with the non-cauterization area 93a, the irradiation of the high intensity ultrasonic wave for treatment is stopped. Irradiate. By repeating this, it is possible to perform treatment that avoids erroneous irradiation of normal tissue and does not damage normal sites. Furthermore, the treatment site can be cauterized automatically and accurately by always grasping the positional information of the treatment area in the three-dimensional space using the body motion evaluation technique described in the first embodiment.

  As described above in detail, according to the present invention, it is possible to display a high-resolution, high-function image that combines the real-time property of an ultrasonic imaging apparatus and the superiority of other imaging means, and is optimal for diagnosis and treatment. Simple images can be displayed.

1 is a block diagram illustrating a configuration of an image display device according to a first embodiment of the present invention. FIG. 3 is a flowchart for explaining operations from acquisition of RF data to image display in the image display apparatus according to the first embodiment. 3 is a diagram illustrating a configuration example of an ultrasonic probe for obtaining RF data in the image display apparatus according to Embodiment 1. FIG. In the image display apparatus of Example 1, the figure which shows the structural example and biplane image of an ultrasound probe, and the body motion vector of test object. FIG. 3 is a diagram illustrating a movement of an inspection target that passes through an imaging surface in the image display apparatus according to the first embodiment. FIG. 6 is a diagram illustrating an ultrasonic image obtained in response to the movement of the inspection target in FIG. 5 in the image display apparatus according to the first embodiment. FIG. 3 is a diagram illustrating a plurality of evaluation areas set on a biplane image in the image display apparatus according to the first embodiment. FIG. 3 is a flowchart for explaining from evaluation area setting to body motion vector evaluation in the image display apparatus according to the first embodiment. FIG. 4 is a diagram for explaining interpolation processing in the image display apparatus according to the first embodiment. FIG. 3 is a diagram illustrating a combination example of a form image and a function image in the image display apparatus according to the first embodiment. The flowchart figure explaining the operation | movement from acquisition of RF data to an outline extraction image display in the structure | tissue outline extraction technique of Example 2 of this invention. FIG. 10 is a diagram illustrating extraction of a liver boundary in the tissue contour extraction technique according to the second embodiment. FIG. 10 is a diagram illustrating an example of an image display form in the tissue contour extraction technique according to the second embodiment. The figure which shows the monitoring of a treatment site | part in the tissue outline extraction technique of Example 2. FIG.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Inspection object, 2 ... Ultrasonic probe, 3 ... Transmission beam former, 4 ... D / A converter, 5 ... TGC, 6 ... A / D converter, 7 ... Reception beam former, 8 ... Envelope Line detection unit, 9 ... scan converter, 10 ... display unit, 11 ... initial position setting unit, 12 ... body motion detection unit, 13 ... extraction section relative movement unit, 14 ... extraction section configuration unit, 15 ... deformed image storage unit, 16 ... Extracted section initial position setting unit 20, 21 ... Probe, 22 ... Two-dimensional sectional image (xz plane), 23 ... Two-dimensional sectional image (yz plane), 24 ... Inspection object, 31 ... Imaging plane, 35 ... Image, 71 ... Evaluation region, 100 ... MRI image, 101 ... Ultrasonic Doppler image.

Claims (7)

  Acquired by the first and second ultrasonic probes for transmitting ultrasonic waves to the inspection object and acquiring reflected signals from the inspection object, and the first and second ultrasonic probes. An ultrasonic image is constructed using the reflected signal, a body motion detection unit that detects a three-dimensional body motion and a deformation amount from the ultrasound image information, a body motion or deformation amount evaluated by the body motion detection unit, and the And an image display unit for displaying an ultrasonic image, wherein the body motion detection unit performs the body motion detection using a plurality of ultrasonic images having intersecting lines.   The image display device according to claim 1, wherein the three-dimensional body motion is decomposed into velocity component vectors of an orthogonal coordinate system, and the velocity component vectors projected on a plurality of ultrasonic images are obtained to obtain a three-dimensional body. An image display device that estimates movement and deformation.   2. The image display device according to claim 1, wherein the body motion detection unit sets a plurality of evaluation regions used for body motion evaluation of the inspection target in an image plane of the configured ultrasonic image, and the evaluation region A three-dimensional body movement and a deformation amount are detected from information of the ultrasonic image in the image display device.   4. The image display device according to claim 1, wherein each of the first and second ultrasonic probes has a plurality of piezoelectric elements arranged in a one-dimensional or two-dimensional array. 5. An image display device characterized by being an ultrasonic probe.   The image display device according to claim 1, further comprising: setting an area corresponding to the evaluation area in an image plane of an image including the same area as the ultrasonic image acquired by another imaging unit to perform matching. And means for reflecting the body motion or deformation amount evaluated by the body motion detection unit in an image by the other imaging unit and moving or deforming the image, and the image display unit An image display device characterized by further displaying a deformed image of the image by the imaging means.   6. The image display device according to claim 5, wherein the image obtained by the other imaging unit is a morphological image of an MRI image or an X-ray image, or a functional image of a PET image or an ultrasonic Doppler image. Display device. Two ultrasonic probes that transmit and receive ultrasonic waves to and from the inspection target to obtain a two-dimensional tomographic image of the inspection target, and biplane images acquired by the two ultrasonic probes, Means for detecting a velocity component vector of body movement; means for obtaining an image including at least one of the biplane images by the other imaging means; and an image by the other imaging means. An image display device comprising: means for deforming the image based on the velocity component vector; and image display means for displaying the deformed image.

Images