Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T5/00—Image enhancement or restoration
  • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/70—Determining position or orientation of objects or cameras
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/10—Image acquisition modality
  • G06T2207/10132—Ultrasound image
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/20—Special algorithmic details
  • G06T2207/20212—Image combination
  • G06T2207/20216—Image averaging
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/20—Special algorithmic details
  • G06T2207/20212—Image combination
  • G06T2207/20224—Image subtraction

Definitions

• This application is directed to removal of artifacts from volume images. Specifically, this application is directed to removal of artifacts in ultrasound volume images.
• Ultrasound imaging is used to visualize internal anatomy and help guide invasive devices
• a single ultrasound probe is used to acquire a volume (three dimensional) image of a region of interest in the body.
• the ultrasound probe may be held by the clinician performing the procedure, an assisting technician, and/or a mechanical apparatus. Even when the ultrasound probe is held in close contact with the patient and is not moved, artifacts may be present in the ultrasound images.
• Certain invasive devices are strong reflectors of ultrasound waves. The strong reflection may cause reverberation artifacts in the image. These artifacts may impair a clinician's ability to interpret the images or perform the procedure. For example, the reverberation artifact may obscure the view of the mitral valve during a valve replacement procedure. In another example, the reverberation may appear as an extension of the invasive device, making placement of the device difficult.
• the systems, methods, and/or apparatuses described herein may reduce reverberation artifacts when volume images acquired from different coordinate positions are combined. This may provide improved field of view in the combined images.
• Some embodiments described herein may reduce registration issues when co-registering images from multiple ultrasound probes (e.g., a probe imaging from an apical direction and another probe imaging from a parasternal direction of a patient).
• the method may involve registering the positions (e.g., 3-D coordinates) of the probe or probes.
• the probe registration may include determining two or more probe coordinates relative to a center of the probe's transducer (e.g. the center of a two dimensional matrix array).
• the system may obtain a volume image from each probe (e.g. interleaved image acquisition from the probes) or from each probe position.
• the volume image data from each probe position is translated/rotated to align the volume images using the probe registration information.
• an average of the signals from each probe position may be calculated and subtracted.
• Image values of an object may result in a zero value after subtraction and any non-zero values remaining after the subtraction may be labeled as reverberation artifacts and removed from the combined image.
• an ultrasound imaging system may include at least one ultrasound probe configured to obtain at least two volume images, wherein the volume images may comprise coordinate positions and each volume image may be obtained from at least one different coordinate position, and at least one processor that may be configured to: receive the volume images, align the volume images based on the coordinate positions of the volume images, average the aligned volume images to create a combined image, estimate a difference between the aligned volume images, the difference being representative of a reverberation artifact, and remove the estimated difference from the combined image, thereby reducing the reverberation artifact.
• a method to reduce reverberation artifacts may include receiving at least two volume images of an object within a subject, wherein the volume images comprise coordinate positions and each volume image is obtained from at least one different coordinate position, aligning a first volume image and a second volume image based on the coordinate positions of the volume images, averaging the aligned volume images to create a combined image, estimating a difference between the aligned volume images, the difference representative of a reverberation artifact; and removing the estimated difference from the combined image, thereby reducing the reverberation artifact.
• FIG. 1 is a block diagram of an ultrasound imaging system according to an embodiment of the disclosure.
• FIG. 2 is a block diagram of an ultrasound imaging system according to an embodiment of the disclosure.
• FIG. 3 is a system level diagram of an ultrasound imaging system according to principles of the present disclosure.
• FIG. 4 is a block diagram of an example ultrasound probe set-up according to principles of the disclosure.
• FIG. 5 is a diagram of acquiring images in an interleaved manner according to principles of the disclosure.
• FIG. 6 is a block diagram of a method that may be performed by an image processor according to embodiments of the disclosure.
• FIGS. 7 A, 7B, 7C, 7D and 7E illustrate an example reverberation cancellation procedure according to embodiments of the present disclosure.
• two ultrasound probes may be placed in acoustical contact with a patient.
• the ultrasound probes may be two-dimensional matrix probes capable of three dimensional volume imaging.
• the ultrasound probes may each be positioned to image a region of interest of the body from different angles.
• the region of interest may include relevant anatomy (e.g. mitral valve, blood vessel, tissue) and/or an invasive device.
• Reverberation artifacts from invasive devices are angle dependent, so the reverberation artifact in each probe's volume image will be different.
• the anatomy in each probe's volume image will be the same.
• the volume images from the two ultrasound probes may be combined to eliminate the reverberation artifact from an invasive device and/or other strong reflector.
• the clean image generated by the combined volume images may be provided to a clinician on a display. This may improve navigation and interpretation of images during invasive procedures.
• an ultrasound imaging system 10a constructed in accordance with the principles of the present disclosure is shown in block diagram form.
• an ultrasound probe 12 includes a transducer array 14 for transmitting ultrasonic waves and receiving echo information.
• transducer arrays are well known in the art, e.g., linear arrays, convex arrays or phased arrays.
• the transducer array 14, for example, can include a two dimensional array (as shown) of transducer elements capable of scanning in both elevation and azimuth dimensions for 2D and/or 3D imaging.
• the transducer array 14 is coupled to a microbeamformer 16 in the probe 12 which controls transmission and reception of signals by the transducer elements in the array.
• the microbeamformer is coupled by the probe cable to a transmit/receive (T/R) switch 18, which switches between transmission and reception and protects the main beamformer 22 from high energy transmit signals.
• T/R switch 18 and other elements in the system can be included in the transducer probe rather than in a separate ultrasound system base.
• the transmission of ultrasonic beams from the transducer array 14 under control of the microbeamformer 16 is directed by the transmit controller 20 coupled to the T/R switch 18 and the beamformer 22, which receives input from the user's operation of the user interface or control panel 24.
• One of the functions controlled by the transmit controller 20 is the direction in which beams are steered.
• Beams may be steered straight ahead from (orthogonal to) the transducer array, or at different angles for a wider field of view.
• the partially beamformed signals produced by the microbeamformer 16 are coupled to a main beamformer 22 where partially beamformed signals from individual patches of transducer elements are combined into a fully beamformed signal.
• the beamformed signals are coupled to a signal processor 26.
• the signal processor 26 can process the received echo signals in various ways, such as bandpass filtering, decimation, I and Q component separation, and harmonic signal separation.
• the signal processor 26 may also perform additional signal enhancement such as speckle reduction, signal compounding, and noise elimination.
• the processed signals are coupled to a B mode processor 28, which can employ amplitude detection for the imaging of structures in the body.
• the signals produced by the B mode processor are coupled to a scan converter 30 and a multiplanar reformatter 32.
• the scan converter 30 arranges the echo signals in the spatial relationship from which they were received in a desired image format.
• the scan converter 30 may arrange the echo signal into a two dimensional (2D) sector-shaped format, or a pyramidal three dimensional (3D) image.
• the multiplanar reformatter 32 can convert echoes which are received from points in a common plane in a volumetric region of the body into an ultrasonic image of that plane, as described in U.S. Pat. No. 6,443,896 (Detmer).
• a volume renderer 34 converts the echo signals of a 3D data set into a projected 3D image as viewed from a given reference point, e.g., as described in U.S. Pat. No.
• the 2D or 3D images are coupled from the scan converter 30, multiplanar reformatter 32, and volume renderer 34 to an image processor 36 for further enhancement, buffering and temporary storage for display on an image display 38.
• the graphics processor 36 can generate graphic overlays for display with the ultrasound images. These graphic overlays can contain, e.g., standard identifying information such as patient name, date and time of the image, imaging parameters, and the like. For these purposes the graphics processor receives input from the user interface 24, such as a typed patient name.
• the user interface can also be coupled to the multiplanar reformatter 32 for selection and control of a display of multiple multiplanar reformatted (MPR) images.
• MPR multiplanar reformatted
• an ultrasound imaging system may include at least one ultrasound probe configured to obtain at least two volume images acquired at different coordinate positions.
• the ultrasound imaging system may include at least one processor configured to receive the volume images, align the volume images based on the coordinate positions, average the aligned volume images to create a combined image, estimate a difference between the aligned volume images, and remove the estimated difference from the combined image, thereby reducing reverberation artifacts.
• ultrasound imaging system 10b constructed in accordance with the principles of the present disclosure is shown in block diagram form.
• the ultrasound imaging system 10b includes all of the components of ultrasound imaging system 10a described in reference to FIG. 1.
• ultrasound imaging system 10b includes two ultrasound probes 12a and 12b.
• Each ultrasound probe 12a and 12b include transducer arrays 14a and 14b and microbeam formers 16a and 16b, respectively.
• Both ultrasound probes 12a and 12b are shown coupled to the transmit/receive (T/R) switch 18 in FIG. 2.
• T/R transmit/receive
• each ultrasound probe 12a 12b may include or may be coupled to separate T/R switches, which may both be coupled to the transmit controller 20.
• a separate beamformer may be coupled to each ultrasound probe 12a and 12b.
• Ultrasound imaging system 10b may include a probe register 42 coupled to the ultrasound probes 12a and 12b.
• the probe register 42 may register the relative positions (e.g., coordinate positions) of the ultrasound probes 12a and 12b to one another and/or other reference points in three dimensional space.
• the probe registration information (e.g., angle, orientation, points in space) may be provided by the probe register 42 to the image processor 36 and/or other components of the ultrasound imaging system 10b.
• the probe register 42 may be physically coupled to the ultrasound probes 12a and 12b.
• the probe register 42 may have no physical contact with the ultrasound probes 12a and 12b.
• the probe register 42 may optically and/or electromagnetically detect the positions of the ultrasound probes 12a and 12b.
• FIG. 3 is a system level diagram of an ultrasound imaging system 300 according to principles of the present disclosure.
• the ultrasound imaging system 10b of FIG. 2 had integrated components to operate two ultrasound probes.
• the ultrasound imaging system in FIG. 3 shows an ultrasound system 305 coupled to an external control unit 310 to control two separate ultrasound probes 315a and 315b.
• the external control unit 310 may include one or more probe register, T/R switches, beamformers, and/or transmit controller 20.
• the ultrasound system 305 may communicate with the external control unit 310 to acquire images from the two separate ultrasound probes 315a and 315b.
• the use of an external control unit may be desirable when adapting a pre-existing ultrasound imaging system to operate according to principles of the present disclosure.
• the use of an external control unit may also be desirable if additional components are controlled by the ultrasound system 305 (e.g., robotic arms, microscribes).
• FIG. 4 is a block diagram 400 of an example ultrasound probe set-up according to principles of the disclosure.
• Ultrasound imaging system 405 includes ultrasound probes 410a and 410b.
• the ultrasound probes 410a and 410b are placed in acoustical contact with a subject (e.g., patient) 420 at different positions. Dotted regions 415a and 415b represent approximate volumes imaged by ultrasound probes 410a and 410b, respectively. Within a common volume (e.g., region of interest) imaged by both ultrasound probes 410a and 410b, an object 425 may be imaged along with the surrounding anatomy of the subject 420. The object 425 may be an interventional device in some embodiments.
• the ultrasound probes 410a and 410b may be held in position by mechanical arms 430.
• the mechanical arms 430 may be implemented by metal poles and clamps. Although the mechanical arms 430 are shown in an L-shape, the mechanical arms 430 could be in other configurations. For example, mechanical arms 430 could form a U-shape, a T-shape, or I-shape. In some embodiments, mechanical arms 430 could be implemented as a single mechanical arm holding both ultrasound probes 410a and 410b. In some embodiments, mechanical arms 430 may have one or more articulated joints that may provide for adjustable positioning of the ultrasound probes 410a and 410b.
• the mechanical arms 430 may include a probe register (e.g., probe register 42 in FIG. 2).
• the mechanical arm 430 may be communicatively coupled to the ultrasound imaging system 405 to provide the probe registration information and/or receive instructions from the ultrasound imaging system 405.
• the mechanical arms 430 may be robotic arms that include actuators and/or sensors that provide probe registration information to the ultrasound system 405.
• movement of the robotic arms and/or other functions of the robotic arms may be controlled by the ultrasound imaging system 405 and/or an external robotic control system.
• the probe register may be independent of the mechanical arms 430.
• the mechanical arms 430 may be omitted.
• an ultrasound technician may hold the ultrasound probes 410a and 410b in position.
• the ultrasound probes 410a and 410b may be attached to the subject 420 by a strap or an adhesive.
• the ultrasound imaging system may receive signals from both ultrasound probes for analysis.
• the ultrasound imaging system may receive a complete volume scan from a first probe and then a complete volume scan from the second probe. Scans may be repeated in an interleaved manner 500 as illustrated in FIG. 5.
• Line 505 illustrates which ultrasound probe is currently acquiring a volume. In the example shown in FIG. 5, when Line 505 is high, a volume is acquired from Probe A, and when Line 505 is low, a volume is acquired from Probe B.
• Images 510 represent volumes acquired by Probe B and images 515 represent volumes acquired by Probe A.
• scans of the volumes from the two probes may be interleaved on a per slice basis or per beam basis. Other divisions of signal acquisition from the two probes may also be possible (e.g., per patch, per sub-volume unit).
• the two ultrasound images of the volume may be combined to eliminate the reverberation artifact.
• the common signals in the two images of the volume correspond to the "true” image whereas the different signals in the two images correspond to the reverberation artifact.
• the volume images are aligned. That is, the volume images are be adjusted such that the locations of anatomy and/or other objects in the volume images correspond.
• the relative positions of the two probes may be determined. This may be achieved by a probe register, such as probe register 42 shown in FIG. 2.
• a probe register may include a mechanical probe holder coupled to a microscribe.
• the probe holder may be configured to maintain a constant orientation with the probe.
• the relationship between the probe holder and the transducer array of the probe e.g., center point of array, angle of array
• Measurements of the mechanical probe holders by one or more microscribes may be used to generate a transformation matrix to correlate the volume images acquired by the two probes.
• the probe register is not limited to mechanical systems such as microscribes and robotic arms as discussed above.
• the ultrasound transducer probes may include electromagnetic tracking tags that allow an electromagnetic tracking system to determine the registration information of the ultrasound probes (e.g., direction, angle, location in space).
• An example of an electromagnetic tracking system is the PercuNav System. However, other electromagnetic tracking systems may be used.
• visible or infrared cameras positioned around the subject may register the locations of the ultrasound probes.
• optical scanning of the subject and probes may register the locations of the ultrasound probes.
• a technician may manually input the locations and positions of the ultrasound probes into the ultrasound imaging system, which may then calculate a transformation matrix.
• FIG. 6 is a block diagram of a method 600 that may be performed by the image processor according to embodiments of the disclosure.
• the image processor may generate a transformation matrix, based at least in part, on the registration information (e.g., coordinate positions or simply positions) of the two ultrasound probes.
• the registration information may have been provided by a probe register, such as probe register 42 shown in FIG. 2.
• a transformation matrix is a two-dimensional matrix used to "transform" a three dimensional volume (e.g., volume image).
• Example transformations of a volume include, but are not limited to, translating the volume in space (e.g., move the volume to another location), rotating the volume in space (e.g., change the angle of the volume), and/or scaling the volume in space (e.g., make the volume larger or smaller).
• the image processor may rotate and translate the volume images based at least in part on the transformation matrix.
• the 2-D transformation matrix is multiplied by a one- dimensional matrix comprising the X, Y, and Z coordinates of a voxel of a volume image.
• Each voxel of the volume image is multiplied by the transformation matrix to rotate, translate, and/or scale the volume image as desired.
• the volume images are rotated, translated, and/or scaled to align the volume images acquired by the two ultrasound probes.
• one of the volume images acquired by one of the ultrasound probes is selected as a reference volume.
• the transformation matrix is calculated based at least in part, on the reference volume and the probe registration information and the second volume image acquired by the second ultrasound probe is multiplied by the transformation matrix to align the second volume image with the first volume image.
• a reference volume independent of the two volume images is used along with the probe registration information to calculate the transformation matrix and both the first and second volume images are multiplied by the transformation matrix to align the two volume images.
• separate transformation matrices may be calculated based on the reference volume and probe registration information and each volume image is multiplied by the respective transformation matrix to align the two volume images.
• the transformation matrix of Step 610 would provide an exact alignment of the two volume images acquired by the ultrasound probes.
• ultrasound signals may be refracted or otherwise distorted traveling through non-homogenous media (e.g., tissue). These distortions may reduce the accuracy of the resulting alignment calculated by the transformation matrix. In some instances, this reduced accuracy may be unacceptable.
• a second alignment may be performed to "fine tune" the alignment at Step 615. Fine tuning may be accomplished by selecting three or more common points within the two volume images and calculating an additional "fine tuning" transformation matrix to align the common points. The fine tuning transformation matrix is then applied to improve the alignment of the two volume images.
• the image processor may apply feature recognition algorithms to automatically select the common points within the volumes.
• a user may manually select the common points within the volume images.
• fiducials or other markers may be used to provide the common points. Fiducials are often spheres or disks that are configured to be detected by an ultrasound imaging system and/or electromagnetic tracking systems. Some fiducials may be configured to be detected by optical systems. The fiducials may be placed in various locations including, but not limited to, the skin of the subject, a surface in contact with the subject, an implantable device, and/or an interventional device.
• the image processor may detect positions of the fiducials in the volume images.
• an electromagnetic tracking system and/or other fiducial tracking system may provide fiducial location information to the image processor for use as the three or more common points within the two volume images.
• the aligned volume images are then combined at Step 620.
• the common values in the volume images represent the anatomical features and/or objects scanned within the volume.
• the values that are different between the two volume images represent the reverberation artifact generated by a strong reflector (e.g., interventional device).
• a strong reflector e.g., interventional device.
• voxels with zero values may be voxels containing the anatomical features and/or objects scanned.
• the voxels with non-zero values may contain the reverberation artifact.
• the reverberation artifact is removed at Step 625.
• the combined volume images may be divided in half and then the absolute value of the difference between the volume images is subtracted to remove the reverberation. That is, a mean value of the volume images and a value of a difference between the volume images may be computed. This process is summarized in Equation 1 :
• V A and V B represent the aligned volume images acquired by the two ultrasound probes.
• a clean image of the volume is provided at Step 630.
• the image may be provided to a display, such as display 38 shown in FIG. 2.
• FIGS. 7A-E illustrate an example reverberation cancellation procedure according to embodiments of the present disclosure.
• FIG. 7A shows an Allen wrench (e.g., hex key), which was imaged by two ultrasound probes.
• FIG. 7B shows two Philips x5-l ultrasound probes held in probe holders coupled to a microscribe to register the positions of the probes.
• FIG. 7C is an image of the Allen wrench in a 3D volume acquired by the first ultrasound probe.
• FIG. 7D is an image of the Allen wrench in a 3D volume acquired by the second ultrasound probe.
• the reverberation artifact is indicated by an arrow in each image.
• FIG. 7E is an image of the Allen wrench in the aligned combined volumes with the reverberation artifact removed. The tip of the Allen wrench can now be more clearly observed.
• ultrasound probe 12b may be eliminated.
• the single ultrasound probe 12a may be moved to different positions between acquisition of the volume images and the probe register 42 may acquire the position of the ultrasound probe 12a for each acquisition for alignment of the volume images.
• the ultrasound probe 12a may be moved by a user, a robotic arm, and/or other translation means (e.g., mechanical lever).
• the ultrasound imaging system in FIG. 2 including either one more probes may be capable of performing a method of receiving at least two volume images and each volume image is obtained from different coordinate positions, aligning the volume images based on the coordinate positions of the volume images, averaging the aligned volume images to create a combined image, estimating a difference between the aligned volume images, and removing the estimated difference from the combined image.
• the present system has been described with reference to an ultrasound imaging system, the present system may be extended to other ultrasound transducers. Additionally, the present system may be used to obtain and/or record image information related to, but not limited to renal, testicular, prostate, breast, ovarian, uterine, thyroid, hepatic, lung, musculoskeletal, splenic, nervous, cardiac, arterial and vascular systems, as well as other imaging applications related to ultrasound-guided interventions and other interventions which may be guided by realtime medical imaging. Further, the present system may also include one or more elements which may be used with non-ultrasound imaging systems with or without real-time imaging components so that they may provide features and advantages of the present system.
• Suitable ultrasonic imaging systems may include a Philips ® ultrasound system which may, for example, support a conventional broadband linear array transducer that may be suitable for small-parts imaging.

Landscapes

• Engineering & Computer Science (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Theoretical Computer Science (AREA)
• Computer Vision & Pattern Recognition (AREA)
• Ultra Sonic Daignosis Equipment (AREA)

Priority Applications (5)

Applications Claiming Priority (2)

Publications (1)

Family

ID=63168427

Family Applications (1)

Country Status (5)

Families Citing this family (1)

Citations (5)

Family Cites Families (13)

• 2018
  • 2018-08-10 US US16/638,797 patent/US11334974B2/en active Active
  • 2018-08-10 CN CN201880052882.2A patent/CN111226259B/zh active Active
  • 2018-08-10 JP JP2020508030A patent/JP7319246B2/ja active Active
  • 2018-08-10 EP EP18753167.8A patent/EP3669324B1/en active Active
  • 2018-08-10 WO PCT/EP2018/071720 patent/WO2019034545A1/en not_active Ceased
• 2023
  • 2023-05-18 JP JP2023082044A patent/JP7442718B2/ja active Active

Patent Citations (5)

Non-Patent Citations (3)

Also Published As

Similar Documents

Legal Events