Classifications

• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
  • G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
  • G01S15/88—Sonar systems specially adapted for specific applications
  • G01S15/89—Sonar systems specially adapted for specific applications for mapping or imaging
  • G01S15/8906—Short-range imaging systems; Acoustic microscope systems using pulse-echo techniques
  • G01S15/8979—Combined Doppler and pulse-echo imaging systems
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
  • A61B8/48—Diagnostic techniques
  • A61B8/483—Diagnostic techniques involving the acquisition of a 3D volume of data
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
  • G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
  • G01S15/88—Sonar systems specially adapted for specific applications
  • G01S15/89—Sonar systems specially adapted for specific applications for mapping or imaging
  • G01S15/8906—Short-range imaging systems; Acoustic microscope systems using pulse-echo techniques
  • G01S15/8993—Three dimensional imaging systems
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
  • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
  • G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
  • G01S7/52017—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 particularly adapted to short-range imaging
  • G01S7/52053—Display arrangements
  • G01S7/52057—Cathode ray tube displays
  • G01S7/52071—Multicolour displays; using colour coding; Optimising colour or information content in displays, e.g. parametric imaging

Definitions

• This invention relates to medical diagnostic ultrasound systems and, in particular, to ultrasound systems which perform three dimensional (3D) color flow imaging.
• invert imaging Another known technique for fetal imaging is known as "invert imaging.”
• invert imaging the conventional grayscale range which generally shows structures in the body which return strong echoes as brightly displayed and anechoic structures such as blood which return little echo energy as dark, in an inverted grayscale range. This reversal of the grayscale range results in the blood inside of vessels as shown brightly lighted with the tissue of the surrounding vessels dimly displayed or invisible, thereby highlighting blood pools and vessel blood flow. See, for instance, US Pat. 6,117,080 - 1 ? ⁇
• the use of the fetal STIC technique in combination with invert imaging has provided clinicians with new insight into the structure of the fetal heart. This is important because the clinician is often presented with the problem of assessing the fetal heart for normal or abnormal formation and function.
• the conventional 3D invert image does not provide any information about the hemodynamics of the heart. For that, the clinician must turn instead to another image, typically a cross-sectional color flow slice through the volume to assess blood flow velocity, and mentally correlate the flow of the cross-sectional color flow image with the 3D grayscale image formed with the invert technique. Accordingly it would be desirable to provide the clinician with a single imaging technique which simultaneously provides the vascular flow path information of an inverted image and the flow velocity information of the color flow slice.
• 3D grayscale data is combined with 3D color flow data to allow them to be visualized together.
• the 3D projection of the surface rendering of the color volume data is combined with the 3D projection of the surface rendering of the "inverted" grayscale volume data to produce an image of the two together.
• the process of combining the two 3D projections compares the value of the grayscale projection data at a given pixel location with the value of the color projection data at the same pixel location. If the grayscale value is below a certain threshold, only the grayscale value is used for the image pixel in the combined image. If the grayscale value is above that threshold, the grayscale value is added to the color value and that new value is used for the image pixel in the combined image.
• image data algorithms can also be used to enhance features of the image.
• FIGURE 1 illustrates in block diagram form an ultrasonic diagnostic imaging system constructed in accordance with the principles of the present invention.
• FIGURE 2 illustrates a flowchart of an example of a method of the present invention.
• FIGURES 3 and 4 illustrate two ultrasound images produced in accordance with the principles of the present invention and captured during diastole and systole, respectively.
• a transducer array 10a is provided for transmitting ultrasonic waves and receiving echo signals.
• the array shown is a two dimensional array of transducer elements capable of providing 3D image information, although an implementation of the present invention may also use a swept one dimensional array of transducer elements which produces 2D (planar) images from a volumetric region.
• the transducer array is coupled to a microbeamformer 12a which controls transmission and reception of signals by the array elements.
• the microbeamformer is also capable of at least partial beamforming of the signals received by groups or "patches" of transducer elements as described in US Pats. 5,997,479 (Savord et al . ) , 6,013,032 (Savord) , -A -
• the microbeamformer 12a is coupled to a transmit/receive (T/R) switch 16 which switches between transmission and reception and protects the main beamformer 20 from high energy transmit signals.
• T/R transmit/receive
• the transmission of ultrasonic beams from the transducer array 10a is under control of a transmit controller 18 coupled to the T/R switch, which receives input from the user's operation of the user interface or control panel 38.
• the partially beamformed signals produced by the microbeamformer 12a are coupled to a main beamformer 20 where partially beamformed signals from the individual patches of elements are combined into a fully beamformed signal.
• the main beamformer 20 may have 128 channels, each of which receives a partially beamformed signal from a patch of 12 transducer elements. In this way the signals received by over 1500 transducer elements of a two dimensional array can contribute efficiently to a single beamformed signal.
• the beamformed signals are coupled to a signal processor 22 where they may undergo additional enhancement such as speckle removal, signal compounding, harmonic separation, filtering, multiline interpolation and processing, and noise elimination.
• the processed signals are coupled to a B mode processor 26 and a Doppler processor 28.
• the B mode processor 26 employs amplitude detection for the imaging of structures in the body such as muscle, tissue, and blood cells. B mode images of structure of the body may be formed in either the harmonic mode or the fundamental mode. Tissues in the body and microbubbles both return both types of signals and the harmonic returns of microbubbles enable microbubbles to be clearly segmented in an image in most applications.
• the Doppler processor processes temporally distinct signals from tissue and blood flow for the detection of motion of substances in the image field including blood cells, tissue, and microbubbles .
• the Doppler processor operates on ensembles of temporally distinct samples from each location in the volume being imaged to produce an estimate of Doppler power, velocity, acceleration, or variance at each location in the volumetric region, the same volumetric region which is the source of the B mode signals. Different transmit signals may be used for B mode and Doppler returns or the same signals may be used by both processors as described in US Pat. 6,139,501 (Roundhill et al . )
• the Doppler processor 28 can operate on the I, Q quadrature data typically produced by the signal processor 22 and the B mode processor 26 can operate on the same data in the form of (I 2 + Q 2 ) 1/2 .
• the structural B mode signals are coupled to a grayscale mapping processor 32 which converts the B mode signals to a range of grayscale values.
• the flow signals from the Doppler processor 28 are coupled to a color mapping processor 34 which similarly converts the flow signals to a range of color values.
• the range of color values corresponds to a range of flow velocities, for instance.
• Other Doppler modes such as power Doppler, acceleration, and variance may be used if desired.
• the mapping processors may implement grayscale and color ranges selected by the user and may be constructed as lookup tables.
• the grayscale map is inverted from its conventional scale, with stronger B mode signals being converted to darker grayscale values and weaker B mode signals converted to brighter grayscale values. This will cause the stronger echoes from the tissue of blood vessel walls to be displayed less brightly than the weaker anechoic echo returns from blood flow within the vessel, for instance.
• the grayscale 3D data set and the 3D flow data set are each volume rendered to form a 2D display of each 3D volume of data by volume renderers 42 and 44, respectively.
• one volume renderer may be used which is multiplexed to render one data set and then the other.
• Volume rendering is well known and is described in US Pat. 5,720,291 (Schwartz), for instance. See also US Pat. 6,530,885 (Entrekin et al.) Volume rendering can produce projections of a 3D volume from a series of different look directions and the user can then sequence through the look directions to view the 3D volume from different perspectives, a display format known as kinetic parallax.
• the volume renderers 42 and 44 can operate on image data in either rectilinear or polar coordinates as described in US Pat. 6,723,050 (Dow et al.)
• the volume rendered, "inverted" grayscale data produced by the volume renderer 42 and the volume rendered flow data produced by the volume renderer 44 are blended together by a pixel comparator and 3D image merge processor 50, which allows the flow path of blood vessels and heart chambers to be visualized together with the fluid motion characteristics of the flow path or chamber.
• a pixel comparator and 3D image merge processor 50 which allows the flow path of blood vessels and heart chambers to be visualized together with the fluid motion characteristics of the flow path or chamber.
• One way to do this is to compare the B mode and flow data at each point in the image with each other or a threshold.
• one technique is to compare the grayscale value at an image location with a threshold and if the grayscale value is below the threshold, the grayscale value alone is used for display. But if the grayscale value exceeds the threshold, the grayscale and flow values are summed, resulting in a display pixel at that location which has been tinted with the flow value such as flow velocity.
• the flow value is first compared with a threshold and used for display if it exceeds the threshold. If the flow value does not exceed the threshold the grayscale value is used for display at that location.
• the thresholds may be controlled and set by the user from the control panel 38, if desired.
• the result of this processing is that a single volume rendered (3D) image is used which contains characteristics of both of the initial volume renderings.
• the resultant merged image is coupled to a Cineloop buffer 36 where it may be displayed with a sequence of similarly processed imaged to visualize the hemodymanics of the heart, for instance.
• the images to be displayed are coupled to an image processor 30 for display on an image display 40.
• the formation of the combined grayscale and color 3D image projections is realized in a series of processing steps. These steps involve first the formation of the individual grayscale and color data projections, and then the final step of combining or compositing them into a single image for display.
• the formation of the grayscale image projection is realized through the rendering of grayscale data using an inverted grayscale map from the conventional map, where the first step in the process is to reverse, or invert the intensity of the individual voxels of the volume of data to be visualized. This inversion is such that it causes bright voxels to become dark, and dark voxels to become bright.
• a conventional 3D rendering technique such as the ray-cast method previously described is used to create a 2D image which is a projection of the 3D data as observed from a given viewpoint.
• this rendering method is configured to find and show "surfaces" in the data, surfaces meaning generally the transition from low intensity (dark) voxels to higher intensity (bright) voxels as seen by a "ray” traveling from the observer into the volume of data. Because of the first step of inverting the intensities of the voxel data, the surfaces found and displayed during the rendering process are the equivalent to the interior surfaces of tissue which oppose anechoic, or normally dark regions present in the volume data.
• the surfaces found and displayed would correspond to the interior surfaces of the ventricles of the heart and associated blood vessels connecting to it.
• the resulting 2D image is composed of MXN pixels, with each pixel consisting of a red (R) , green (G) , and blue (B) value. Typically these RGB values will all be equal to one another so that the displayed pixel will have a neutral (grey) color, although other tints can be used.
• the formation of a color flow image projection is realized through conventional 3D rendering methods, such as the ray-cast method, to find and display the surface of targets that were previously detected by the ultrasound system to have a Doppler shift associated with them (moving blood cells) within the volume data, as viewed from a particular viewpoint.
• the resulting 2D image is composed of MXN pixels, each pixel consisting of a red (R) , blue (B) , and green (G) value.
• the RGB values of the pixels will be such that the resulting color displayed at each pixel location will correspond to the direction and velocity of the blood cells at that location as determined by a color map that relates velocity and direction as determined by the Doppler shift of the received echoes to displayed color.
• the combined color and grayscale 2D projections of the 3D data created above are combined, or composited, in a non-linear fashion where each pixel of the combined image is formed as a combination of the pixel (voxel) data from the corresponding location in the grayscale and color images.
• pixel data from the two images There are several ways to combine the pixel data from the two images. One way is to first compare the grayscale pixel value to a selected threshold. If the pixel value falls below an adjustable threshold, only that RGB pixel value from the grayscale image is used for the combined image pixel, that is, only the grayscale data is displayed.
• Another way to composite the grayscale and color images is to use an additional adjustable threshold for the values of the color pixel data such that the velocity of the color data is also taken into consideration. In this case, it may be desired to show the color pixel data regardless of the grayscale data if the velocity of the color data exceeds the adjustable threshold.
• Yet another factor that can influence the compositing process is to consider the location in the volume from which the grayscale surface and the color surface portrayed by the grayscale and color image pixels originated.
• the final result is a two dimensional projection in which the depth dimension is normally lost.
• the depth location in the original volume data set from which the pixel originated can be determined by keeping track of the distance along the ray where the surface was found for each of the grayscale and color surfaces. Then, in addition to comparing the grayscale and color pixel values as part of the compositing process, the depths along the ray where each pixel was encountered can also be considered.
• FIGURE 2 A simplified flowchart of a process of the present invention is shown in FIGURE 2.
• a 3D grayscale data set is acquired.
• AT 104 a 3D color flow data set is acquired.
• the grayscale data set is converted or mapped to an inverted grayscale map or range of values.
• the inverted 3D grayscale data set and the 3D color flow data set are volume rendered.
• the color flow values and grayscale values are combined or composited into a single 3D volume rendered image containing the characteristics of both data sets.
• a sequence of such images are then displayed in real time at 112.
• FIGURES 3 at 4 show two ultrasound images of a fetal heart, the first one acquired at diastole and the second one acquired at systole. These images were acquired by an operating implementation of the present invention and were displayed on the acquiring ultrasound system as color images shown against a black background.
• this conventional display format has been reversed in the drawings so that the background is white and the flow paths and velocities are in a gray shading.
• the first characteristic that can be noted is that these images are not of the heart itself (myocardium) , but of the blood within the heart.
• the myocardial tissue structure around these regions of blood flow have been caused to be translucent or disappear by the inversion of the grayscale map, producing an image of flow similar to that described in US Pat. 5,474,073 (Schwartz et al.) See also the aforementioned US Pat. 5,720,291 (Schwartz) which illustrates a technique for visualizing flow by rendering the Doppler data opaque while tissue is rendered translucent.
• the flow paths are opaquely displayed so that the outer surfaces of the flow paths and blood pools are highlighted in the rendering, thus showing the flow of a continuous vessel as a continuous opaque "tube" of blood.
• the clinician can note the locations and positions of the flow paths such as the aorta 200, examining their continuity and diagnosing the proper formation of the heart and vessels.
• the left ventricle indicated at 202 is highly colored as blood fills this chamber of the heart. There is little or no color in the aorta 200 as the heart is filling during this phase.

Landscapes

• Physics & Mathematics (AREA)
• Engineering & Computer Science (AREA)
• Radar, Positioning & Navigation (AREA)
• Remote Sensing (AREA)
• Acoustics & Sound (AREA)
• Health & Medical Sciences (AREA)
• Life Sciences & Earth Sciences (AREA)
• Computer Networks & Wireless Communication (AREA)
• General Physics & Mathematics (AREA)
• Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
• Molecular Biology (AREA)
• Pathology (AREA)
• Radiology & Medical Imaging (AREA)
• Biomedical Technology (AREA)
• Heart & Thoracic Surgery (AREA)
• Medical Informatics (AREA)
• Biophysics (AREA)
• Surgery (AREA)
• Animal Behavior & Ethology (AREA)
• General Health & Medical Sciences (AREA)
• Public Health (AREA)
• Veterinary Medicine (AREA)
• Ultra Sonic Daignosis Equipment (AREA)

Priority Applications (4)

Applications Claiming Priority (2)

Publications (1)

Family

ID=39030845

Family Applications (1)

Country Status (5)

Cited By (4)

Families Citing this family (35)

Citations (10)

Family Cites Families (6)

• 2007
  • 2007-10-04 US US12/444,594 patent/US20100099991A1/en not_active Abandoned
  • 2007-10-04 WO PCT/IB2007/054044 patent/WO2008044173A1/en not_active Ceased
  • 2007-10-04 EP EP07805443A patent/EP2082262B1/en not_active Ceased
  • 2007-10-04 CN CN200780037891.6A patent/CN101523237B/zh not_active Expired - Fee Related
  • 2007-10-04 JP JP2009531947A patent/JP5236655B2/ja not_active Expired - Fee Related

Patent Citations (11)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events