US20170307741A1 - Ultrasound signal processing circuitry and related apparatus and methods - Google Patents

Ultrasound signal processing circuitry and related apparatus and methods Download PDF

Info

Publication number
US20170307741A1
US20170307741A1 US15/517,284 US201515517284A US2017307741A1 US 20170307741 A1 US20170307741 A1 US 20170307741A1 US 201515517284 A US201515517284 A US 201515517284A US 2017307741 A1 US2017307741 A1 US 2017307741A1
Authority
US
United States
Prior art keywords
signal samples
frequency domain
processing
weighting
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US15/517,284
Other languages
English (en)
Inventor
Tyler S. Ralston
Nevada J. Sanchez
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bfly Operations Inc
Original Assignee
Butterfly Network Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Butterfly Network Inc filed Critical Butterfly Network Inc
Priority to US15/517,284 priority Critical patent/US20170307741A1/en
Assigned to BUTTERFLY NETWORK, INC. reassignment BUTTERFLY NETWORK, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: RALSTON, TYLER S., SANCHEZ, NEVADA J.
Publication of US20170307741A1 publication Critical patent/US20170307741A1/en
Assigned to BFLY OPERATIONS, INC. reassignment BFLY OPERATIONS, INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: BUTTERFLY NETWORK, INC.
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/52017—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 particularly adapted to short-range imaging
    • G01S7/52079—Constructional features
    • G01S7/5208—Constructional features with integration of processing functions inside probe or scanhead
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235—Details of waveform analysis
    • A61B5/7253—Details of waveform analysis characterised by using transforms
    • A61B5/7257—Details of waveform analysis characterised by using transforms using Fourier transforms
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/44—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device
    • A61B8/4483—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device characterised by features of the ultrasound transducer
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5207—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of raw data to produce diagnostic data, e.g. for generating an image
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/88—Sonar systems specially adapted for specific applications
    • G01S15/89—Sonar systems specially adapted for specific applications for mapping or imaging
    • G01S15/8906—Short-range imaging systems; Acoustic microscope systems using pulse-echo techniques
    • G01S15/8909—Short-range imaging systems; Acoustic microscope systems using pulse-echo techniques using a static transducer configuration
    • G01S15/8915—Short-range imaging systems; Acoustic microscope systems using pulse-echo techniques using a static transducer configuration using a transducer array
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/52017—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 particularly adapted to short-range imaging
    • G01S7/52019—Details of transmitters
    • G01S7/5202—Details of transmitters for pulse systems
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/52017—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 particularly adapted to short-range imaging
    • G01S7/52023—Details of receivers
    • G01S7/52025—Details of receivers for pulse systems
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/52017—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 particularly adapted to short-range imaging
    • G01S7/52023—Details of receivers
    • G01S7/52025—Details of receivers for pulse systems
    • G01S7/52026—Extracting wanted echo signals
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/52017—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 particularly adapted to short-range imaging
    • G01S7/52023—Details of receivers
    • G01S7/52034—Data rate converters
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/52017—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 particularly adapted to short-range imaging
    • G01S7/52046—Techniques for image enhancement involving transmitter or receiver
    • G01S7/52047—Techniques for image enhancement involving transmitter or receiver for elimination of side lobes or of grating lobes; for increasing resolving power
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/52017—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 particularly adapted to short-range imaging
    • G01S7/52023—Details of receivers
    • G01S7/52033—Gain control of receivers

Definitions

  • aspects of the present disclosure relate to circuitry, devices, systems and methods for imaging and/or treatment, such as ultrasonic imaging and/or treatment technology. More particularly, aspects of the present disclosure relate to circuitry and methods for processing signals received from an ultrasound transducer array.
  • Ultrasound transducer arrays used for medical applications typically produce a large amount of data, as needed to produce ultrasound images for medical applications. The higher the quality and complexity of the desired images, the more data is typically needed.
  • the present disclosure describes aspects of processing signals received from an ultrasound transducer array in an ultrasound transducer based imaging system, including the digital and analog circuitry used to process the signals.
  • signal samples are processed, or conditioned, by application of one or more weighting functions.
  • one or more weighting functions may be applied to the signal samples in the time domain.
  • the signal samples may be converted to the frequency domain and one or more weighting functions may be applied in the frequency domain.
  • one or more weighting functions may be applied in the time domain and one or more weighting functions may be applied in the frequency domain.
  • the weighting functions may be channel dependent and/or channel independent.
  • the processed data can be provided to an image formation processor.
  • the processing of signals prior to image formation processing may be termed “preprocessing” of the signals received from the ultrasound transducer array.
  • Some embodiments are directed to a method for processing signals received from an ultrasound transducer array.
  • the method comprises signal conditioning of the received signals after conversion of the received signals from an analog domain to a digital domain.
  • Some embodiments are directed to a method for processing signals received from an ultrasound transducer array.
  • the method comprises converting the received signals to a digital domain to provide signal samples and performing quadrature demodulation of the signal samples followed by Fast Fourier Transform of the demodulated signal samples and signal conditioning in a frequency domain.
  • Some embodiments are directed to a method for processing signals received from an ultrasound transducer array.
  • the method comprises summing elevation channels of the ultrasound transducer array in a frequency domain following Fast Fourier Transform of the received signals.
  • Some embodiments are directed to a method for processing signals received from an ultrasound transducer array.
  • the method comprises processing the received signals to provide signals for Fourier Resample image formation processing and/or Back Projection image formation processing.
  • Some embodiments are directed to a method for processing signals received from an ultrasound transducer array.
  • the method comprises processing the received signals with a first number of channels to provide partially processed signal samples, storing the partially processed signal samples in a memory, and completing processing of the partially processed signal samples with a second number of channels less than the first number of channels.
  • Some embodiments are directed to a method for processing signals received from an ultrasound transducer array.
  • the method comprises converting the received signals to a digital domain to provide signal samples, conditioning the signal samples, and outputting the conditioned signal samples for image formation processing.
  • Some embodiments are directed to an ultrasound device comprising: an ultrasound transducer array configured to provide received signals in response to receiving ultrasound energy, and a processing circuit configured to process the received signals.
  • the processing circuit comprises a conversion circuit configured to convert the received signals to a digital domain to provide signal samples, a conditioning circuit configured to condition the signal samples, and an output circuit configured to output the conditioned signal samples for image formation processing.
  • Some embodiments are directed to a method for processing signals received from an ultrasound transducer array.
  • the method comprises converting the received signals to a digital domain to provide signal samples, extracting from the signal samples a subset of the signal samples that correspond to an image to be formed, application of a time domain weighting function to the signal samples, conversion of the weighted signal samples to frequency domain values, application of a frequency domain weighting function to the frequency domain values, and outputting the weighted frequency domain values for image formation processing.
  • FIG. 1 is a block diagram of an illustrative example of a monolithic ultrasound device embodying various aspects of the disclosed technology.
  • FIG. 2 is a block diagram illustrating how, in some embodiments, the TX circuitry and the RX circuitry for a given transducer element may be used either to energize the element to emit an ultrasonic pulse, or to receive and process a signal from the element representing an ultrasonic pulse sensed by the transducer element.
  • FIGS. 3-8 are block diagrams of illustrative examples of components that may be included within the analog processing block and the digital processing block of the RX circuitry shown in FIG. 2 .
  • FIG. 9 is a block diagram of the digital processing block of the RX circuitry, in accordance with embodiments.
  • FIG. 10 is a block diagram of an embodiment of the QDM, filter and downsample blocks shown in FIG. 9 .
  • FIG. 11 is a block diagram of the time domain conditioning block of FIG. 9 , in accordance with embodiments.
  • FIG. 12 is a block diagram of the FFT block shown in FIG. 9 , in accordance with embodiments.
  • FIG. 13 is a block diagram of the frequency domain conditioning block shown in FIG. 9 , in accordance with embodiments.
  • FIG. 14 is a block diagram of the sum channels block shown in FIG. 13 , in accordance with embodiments.
  • FIG. 15 is a schematic block diagram of an example of a channel configuration of the signal processing architecture, in accordance with embodiments.
  • FIG. 16 is a flowchart of an example of a signal processing method, in accordance with embodiments.
  • aspects of the present disclosure relate to digital and analog circuitry and methods for processing signals received from an ultrasound transducer array.
  • the ultrasound transducer array and the circuitry may be integrated on a single complementary metal oxide semiconductor (CMOS) chip, or substrate, or may be on multiple chips within an ultrasound probe.
  • CMOS complementary metal oxide semiconductor
  • the present disclosure provides unique, cost-effective, and scalable integrated signal processing architectures to process signals from ultrasound transducer elements or groups of ultrasound transducer elements and to provide data that is sufficiently robust for advanced high quality imaging applications.
  • aspects of the present disclosure provide an architecture which may be used with a single substrate ultrasound device having integrated ultrasound transducers (e.g. CMOS ultrasonic transducers) and digital circuitry.
  • the present disclosure describes aspects of processing signals received from an ultrasound transducer array in an ultrasound transducer-based imaging system.
  • signal samples are processed, or conditioned, by application of one or more weighting functions, or masks.
  • one or more weighting functions may be applied to the signal samples in the time domain.
  • the signal samples may be converted to the frequency domain and one or more weighting functions may be applied in the frequency domain.
  • one or more weighting functions may be applied in the time domain and one or more weighting functions may be applied in the frequency domain.
  • the weighting functions may be channel dependent and/or channel independent.
  • the processed data can be provided to an image formation processor.
  • the processing of signals prior to image formation processing may be termed “preprocessing” of the signals received from the ultrasound transducer array.
  • the signal samples may be converted to a form that is advantageous for image formation processing.
  • data corresponding to several elevation channels can be combined prior to image formation processing.
  • various signal processing functions may be performed prior to image formation processing or during image formation processing based on a particular architecture.
  • the signal processing architecture may further include data reduction, compression and/or downsampling to reduce the volume of data being processed. Such operations may include, for example, quadrature demodulation, filtering and downsampling.
  • signal samples that do not contribute to the image being formed or which degrade the image may be discarded.
  • FIG. 1 shows an illustrative example of a monolithic ultrasound device 100 embodying various aspects of the present disclosure.
  • the device 100 may include one or more transducer arrangements (e.g., arrays) 102 , transmit (TX) circuitry 104 , receive (RX) circuitry 106 , a timing & control circuit 108 , a signal conditioning/processing circuit 110 , a power management circuit 118 , and/or a high-intensity focused ultrasound (HIFU) controller 120 .
  • TX transmit
  • RX receive
  • a timing & control circuit 108 e.g., a timing & control circuit 108
  • a signal conditioning/processing circuit 110 e.g., a power management circuit 118
  • HIFU high-intensity focused ultrasound
  • TX circuitry 104 shows both TX circuitry 104 and RX circuitry 106
  • only TX circuitry or only RX circuitry may be employed.
  • such embodiments may be employed in a circumstance where one or more transmission-only devices 100 are used to transmit acoustic signals and one or more reception-only devices 100 are used to receive acoustic signals that have been transmitted through or reflected by a subject being ultrasonically imaged.
  • one or more high-speed busses may be used to allow high-speed intra-chip communication or communication with one or more off-chip components.
  • the one or more transducer arrays 102 may take on any of numerous forms, and aspects of the present technology do not necessarily require the use of any particular type or arrangement of transducer cells or transducer elements. Indeed, although the term “array” is used in this description, it should be appreciated that in some embodiments the transducer elements may not be organized in an array and may instead be arranged in some non-array fashion. In various embodiments, each of the transducer elements in the array 102 may, for example, include one or more CMUTs, one or more CMOS ultrasonic transducers (CUTs), and/or one or more other suitable ultrasonic transducer cells.
  • CUTs CMOS ultrasonic transducers
  • the transducer elements of the transducer array 102 may be formed on the same chip as the electronics of the TX circuitry 104 and/or RX circuitry 106 .
  • CMOS COMPLEMENTARY METAL OXIDE SEMICONDUCTOR
  • METHODS FOR FORMING THE SAME bearing attorney docket No. B1348.70007US01 and filed on Mar. 13, 2014, the entire disclosure of which is incorporated herein by reference.
  • a CUT may, for example, include a cavity formed in a CMOS wafer, with a membrane overlying the cavity, and in some embodiments sealing the cavity. Electrodes may be provided to create a transducer cell from the covered cavity structure.
  • the CMOS wafer may include integrated circuitry to which the transducer cell may be connected.
  • the transducer cell and CMOS wafer may be monolithically integrated, thus forming an integrated ultrasonic transducer cell and integrated circuit on a single substrate (the CMOS wafer).
  • the TX circuitry 104 may, for example, generate pulses that drive the individual elements of, or one or more groups of elements within, the transducer array(s) 102 so as to generate acoustic signals to be used for imaging.
  • the RX circuitry 106 may receive and process electronic signals generated by the individual elements of the transducer array(s) 102 when acoustic signals impinge upon such elements.
  • the timing & control circuit 108 may, for example, be responsible for generating all timing and control signals that are used to synchronize and coordinate the operation of the other elements in the device 100 .
  • the timing & control circuit 108 is driven by a single clock signal CLK supplied to an input port 116 .
  • the clock signal CLK may, for example, be a high-frequency clock used to drive one or more of the on-chip circuit components.
  • the clock signal CLK may, for example, be a 1.5625 GHz or 2.5 GHz clock used to drive a high-speed serial output device (not shown in FIG.
  • timing & control circuit 108 may divide or multiply the clock CLK, as necessary, to drive other components on the die 112 .
  • two or more clocks of different frequencies may be separately supplied to the timing & control circuit 108 from an off-chip source.
  • the power management circuit 118 may, for example, be responsible for converting one or more input voltages V IN from an off-chip source into voltages needed to carry out operation of the chip, and for otherwise managing power consumption within the device 100 .
  • a single voltage e.g., 12V, 80V, 100V, 120V, etc.
  • the power management circuit 118 may step that voltage up or down, as necessary, using a charge pump circuit or via some other DC-to-DC voltage conversion mechanism.
  • multiple different voltages may be supplied separately to the power management circuit 118 for processing and/or distribution to the other on-chip components.
  • a HIFU controller 120 may be integrated on the die 112 so as to enable the generation of HIFU signals via one or more elements of the transducer array(s) 102 .
  • a HIFU controller for driving the transducer array(s) 102 may be located off-chip, or even within a device separate from the device 100 . That is, aspects of the present disclosure relate to provision of ultrasound-on-a-chip HIFU systems, with and without ultrasound imaging capability. It should be appreciated, however, that some embodiments may not have any HIFU capabilities and thus may not include a HIFU controller 120 .
  • the HIFU controller 120 may not represent distinct circuitry in those embodiments providing HIFU functionality.
  • the remaining circuitry of FIG. 1 may be suitable to provide ultrasound imaging functionality and/or HIFU, i.e., in some embodiments the same shared circuitry may be operated as an imaging system and/or for HIFU. Whether or not imaging or HIFU functionality is exhibited may depend on the power provided to the system.
  • HIFU typically operates at higher powers than ultrasound imaging.
  • providing the system a first power level (or voltage level) appropriate for imaging applications may cause the system to operate as an imaging system, whereas providing a higher power level (or voltage level) may cause the system to operate for HIFU.
  • Such power management may be provided by off-chip control circuitry in some embodiments.
  • imaging and HIFU applications may utilize different waveforms.
  • waveform generation circuitry may be used to provide suitable waveforms for operating the system as either an imaging system or a HIFU system.
  • the system may operate as both an imaging system and a HIFU system (e.g., capable of providing image-guided HIFU).
  • a HIFU system e.g., capable of providing image-guided HIFU.
  • the same on-chip circuitry may be utilized to provide both functions, with suitable timing sequences used to control the operation between the two modalities. Additional details with respect to HIFU implementations and operational features that may be employed in the various embodiments set forth in the present disclosure are described in U.S. patent application Ser. No. 13/654,337, entitled TRANSMISSIVE IMAGING AND RELATED APPARATUS AND METHODS, filed Oct. 17, 2012, the entire contents of which is incorporated herein by reference.
  • one or more output ports 114 may output a high-speed serial data stream generated by one or more components of the signal conditioning/processing circuit 110 .
  • Such data streams may, for example, be generated by one or more USB 3.0 modules, and/or one or more 10 GB, 40 GB, or 100 GB Ethernet modules, integrated on the die 112 .
  • the signal stream produced on output port 114 can be fed to a computer, tablet, or smartphone for the generation and/or display of 2-dimensional, 3-dimensional, and/or tomographic images.
  • image formation capabilities are incorporated in the signal conditioning/processing circuit 110
  • even relatively low-power devices such as smartphones or tablets which have only a limited amount of processing power and memory available for application execution, can display images using only a serial data stream from the output port 114 .
  • the use of on-chip analog-to-digital conversion and a high-speed serial data link to offload a digital data stream is one of the features that helps facilitate an “ultrasound on a chip” solution according to some embodiments of the present disclosure.
  • an imaging device including an N ⁇ M planar or substantially planar array of CMUT elements may itself be used to acquire an ultrasonic image of a subject, e.g., a person's abdomen, by energizing some or all of the elements in the array(s) 102 (either together or individually) during one or more transmit phases, and receiving and processing signals generated by some or all of the elements in the array(s) 102 during one or more receive phases, such that during each receive phase the CMUT elements sense acoustic signals reflected by the subject.
  • a subject e.g., a person's abdomen
  • a single imaging device may include a P ⁇ Q array of individual devices, or a P ⁇ Q array of individual N ⁇ M planar arrays of CMUT elements, which components can be operated in parallel, sequentially, or according to some other timing scheme so as to allow data to be accumulated from a larger number of CMUT elements than can be embodied in a single device 100 or on a single die 112 .
  • a pair of imaging devices can be positioned so as to straddle a subject, such that one or more CMUT elements in the device(s) 100 of the imaging device on one side of the subject can sense acoustic signals generated by one or more CMUT elements in the device(s) 100 of the imaging device on the other side of the subject, to the extent that such pulses were not substantially attenuated by the subject.
  • the same device 100 can be used to measure both the scattering of acoustic signals from one or more of its own CMUT elements as well as the transmission of acoustic signals from one or more of the CMUT elements disposed in an imaging device on the opposite side of the subject.
  • FIG. 2 is a block diagram illustrating how, in some embodiments, the TX circuitry 104 and the RX circuitry 106 for a given transducer element 204 may be used either to energize the transducer element 204 to emit an ultrasonic pulse, or to receive and process a signal from the transducer element 204 representing an ultrasonic pulse sensed by it.
  • the TX circuitry 104 may be used during a “transmission” phase
  • the RX circuitry may be used during a “reception” phase that is non-overlapping with the transmission phase.
  • one of the TX circuitry 104 and the RX circuitry 106 may simply not be used in a given device 100 , such as when a pair of ultrasound units is used for only transmissive imaging.
  • a device 100 may alternatively employ only TX circuitry 104 or only RX circuitry 106 , and aspects of the present technology do not necessarily require the presence of both such types of circuitry.
  • TX circuitry 104 and/or RX circuitry 106 may include a TX circuit and/or an RX circuit associated with a single transducer cell (e.g., a CUT or CMUT), a group of two or more transducer cells within a single transducer element 204 , a single transducer element 204 comprising a group of transducer cells, a group of two or more transducer elements 204 within an array 102 , or an entire array 102 of transducer elements 204 .
  • a single transducer cell e.g., a CUT or CMUT
  • the TX circuitry 104 /RX circuitry 106 includes a separate TX circuit and a separate RX circuit for each transducer element 204 in the array(s) 102 , but there is only one instance of each of the timing & control circuit 108 and the signal conditioning/processing circuit 110 .
  • the timing & control circuit 108 may be responsible for synchronizing and coordinating the operation of all of the TX circuitry 104 /RX circuitry 106 combinations on the die 112
  • the signal conditioning/processing circuit 110 may be responsible for handling inputs from all of the RX circuitry 106 on the die 112 .
  • timing and control circuit 108 may be replicated for each transducer element 204 or for a group of transducer elements 204 .
  • the timing & control circuit 108 may output either an “TX enable” signal to enable the operation of each TX circuit of the TX circuitry 104 , or an “RX enable” signal to enable operation of each RX circuit of the RX circuitry 106 .
  • a switch 202 in the RX circuitry 106 may always be opened before the TX circuitry 104 is enabled, so as to prevent an output of the TX circuitry 104 from driving the RX circuitry 106 .
  • the switch 202 may be closed when operation of the RX circuitry 106 is enabled, so as to allow the RX circuitry 106 to receive and process a signal generated by the transducer element 204 .
  • the TX circuitry 104 for a respective transducer element 204 may include both a waveform generator 206 and a pulser 208 .
  • the waveform generator 206 may, for example, be responsible for generating a waveform that is to be applied to the pulser 208 , so as to cause the pulser 208 to output a driving signal to the transducer element 204 corresponding to the generated waveform.
  • the RX circuitry 106 for a respective transducer element 204 includes an analog processing block 210 , an analog-to-digital converter (ADC) 212 , and a digital processing block 214 .
  • the ADC 212 may, for example, comprise a 10-bit or 12-bit, 20 Msps, 25 Msps, 40 Msps, 50 Msps, or 80 Msps ADC.
  • the outputs of all of the RX circuits on the die 112 are fed to a multiplexer (MUX) 216 in the signal conditioning/processing circuit 110 .
  • MUX multiplexer
  • the number of transducer elements is larger than the number of RX circuits, and several transducer elements provide signals to a single RX circuit.
  • the MUX 216 multiplexes the digital data from the RX circuits, and the output of the MUX 216 is fed to a multiplexed digital processing block 218 in the signal conditioning/processing circuit 110 , for final processing before the data is output from the die 112 , e.g., via one or more high-speed serial output ports 114 .
  • the MUX 216 is optional, and in some embodiments parallel signal processing is performed.
  • a high-speed serial data port may be provided at any interface between or within blocks, any interface between chips and/or any interface to a host.
  • Various components in the analog processing block 210 and/or the digital processing block 214 may reduce the amount of data that needs to be output from the die 112 via a high-speed serial data link or otherwise.
  • one or more components in the analog processing block 210 and/or the digital processing block 214 may thus serve to allow the RX circuitry 106 to receive transmitted and/or scattered ultrasound pressure waves with an improved signal-to-noise ratio (SNR) and in a manner compatible with a diversity of waveforms.
  • SNR signal-to-noise ratio
  • the inclusion of such elements may thus further facilitate and/or enhance the disclosed “ultrasound-on-a-chip” solution in some embodiments.
  • analog processing block 210 Although particular components that may optionally be included in the analog processing block 210 are described below, it should be appreciated that digital counterparts to such analog components may additionally or alternatively be employed in the digital processing block 214 . The converse is also true. That is, although particular components that may optionally be included in the digital processing block 214 are described below, it should be appreciated that analog counterparts to such digital components may additionally or alternatively be employed in the analog processing block 210 .
  • FIG. 3 shows an illustrative example of components that may be included within the analog processing block 210 and the digital processing block of RX circuitry 106 (see FIG. 2 ).
  • the components of the RX circuitry 106 may, for example, collectively have a bandwidth from DC to 50 MHz and provide a gain of 50 dB, 60 dB, 70 dB, 80 dB or higher, with a noise figure of less than 4 dB, aliased harmonic rejection of 45 dB, and channel isolation of 40 dB.
  • Such parameters are listed for illustrative purposes only and are not intended to be limiting. Other performance parameters are possible and contemplated.
  • the digital control block 214 of the RX circuitry 106 includes a digital quadrature demodulation (DQDM) circuit 308 , an averaging circuit 314 (including an accumulator 310 and an averaging memory 312 ), and an output buffer 316 .
  • the DQDM circuit 308 may, for example, be configured to mix down the digitized version of the received signal from center frequency to baseband, and then low-pass filter and decimate the baseband signal.
  • the DQDM circuit 308 may allow for a lossless reduction of bandwidth by removing unused frequencies from the received signal, thus significantly reducing the amount of digital data that needs to be processed by the signal conditioning/processing circuit 110 and offloaded from the die 112 .
  • the bandwidth reduction achieved by these components may help to facilitate and/or improve the performance of the “ultrasound-on-a-chip” embodiments described herein.
  • f c center frequency of the DQDM 308
  • RX circuitry 106 examples of additional components that may, in some embodiments, be included in RX circuitry 106 , in addition to or in lieu of the DQDM 308 and/or the other components illustrated in FIG. 3 are described below in connection with FIGS. 4-8 .
  • the averaging circuit 314 in the embodiment shown (including accumulator 310 and averaging memory 312 ) functions to average received windows of data.
  • FIG. 4 shows an example implementation of RX circuitry 106 that includes a matched filter 402 that may, for example, perform waveform removal and improve the signal-to-noise ratio of the reception circuitry.
  • a matched filter 402 may, for example, perform waveform removal and improve the signal-to-noise ratio of the reception circuitry.
  • the filter circuit 402 may actually operate as either a matched filter or a mismatched filter so as to decouple waveforms from the received signal.
  • the matched filter 402 may work for either linear frequency modulated (LFM) or non-LFM pulses.
  • LFM linear frequency modulated
  • the matched filter 402 may, for example, include a padding circuit 502 , a fast Fourier transformation (FFT) circuit 504 , a multiplier 506 , a low-pass filter 508 , a decimator circuit 510 , and an inverse FFT circuit 512 .
  • the padding circuit 502 may, for example, apply padding to the incoming signal sufficient to avoid artifacts from an FFT implementation of circular convolution.
  • the value of “H( ⁇ )” applied to the multiplier 506 should be a conjugate of the transmission waveform T x ( ⁇ ).
  • the filter 402 may thus indeed operate as a “matched” filter, by applying a conjugate of the transmission waveform T x ( ⁇ ) to the multiplier 506 .
  • the “matched” filter 402 may instead operate as a mismatched filter, in which case some value other than a conjugate of the transmission waveform T x ( ⁇ ) may be applied to the multiplier 506 .
  • FIG. 6 shows another example implementation of RX circuitry 106 .
  • RX circuitry 106 includes a dechirp circuit 602 that can perform yet another technique to reduce bandwidth by isolating signals of interest. Dechirp circuits as also sometimes referred to as “digital ramp” or “stretch” circuits.
  • a dechirp circuit 602 may be included within the analog processing block 210 , or may be included within the digital processing block 214 of the RX, or may be included in both the analog processing block 210 and the digital processing block 214 of the RX circuitry 106 .
  • Using a dechirp circuit with an LFM waveform effectively converts time to frequency.
  • FIG. 7 An example of a digital dechirp circuit 602 is shown in FIG. 7 .
  • the dechirp circuit 602 may include a digital multiplier 702 , a digital low pass filter 704 , and a decimator circuit 706 .
  • Ana analog dechirp circuit discussed below in connection with FIG. 8 —would employ an analog multiplier and filter, rather than a digital multiplier and filter, and would not include the decimator circuit 706 ).
  • the “reference chirp” shown in FIG. 7 may, for example, be the same “chirp” as that generated by the waveform generator 206 in the corresponding TX circuitry 104 .
  • FIG. 8 shows yet another example implementation of RX circuitry 106 .
  • an analog quadrature demodulation (AQDM) circuit 802 and an analog dechirp circuit 804 are included in the analog processing block 210 .
  • the AQDM 802 may, for example, employ an analog mixer (not shown) and a local oscillator (not shown) to mix the incoming signal to baseband and then employ a low-pass analog filter (not shown) to remove unwanted frequencies from the analog signal.
  • an analog quadrature demodulation (AQDM) circuit 802 and an analog dechirp circuit 804 are included in the analog processing block 210 .
  • the AQDM 802 may, for example, employ an analog mixer (not shown) and a local oscillator (not shown) to mix the incoming signal to baseband and then employ a low-pass analog filter (not shown) to remove unwanted frequencies from the analog signal.
  • FIG. 8 shows yet another example implementation of RX circuitry 106 .
  • two ADCs 806 a - b may be employed in this embodiment to convert the output of the analog dechirp circuit 804 into a digital signal format, but each of the ADCs 806 a - b may run at half the rate as the ADC 212 employed in the other examples, thus potentially reducing power consumption.
  • FIG. 9 is a block diagram of the digital processing block 214 of RX circuitry 106 , in accordance with embodiments.
  • the digital processing block 214 of FIG. 9 is configured as a signal processing circuit that receives signal samples from ADC 212 , processes the signal samples and provides data for image formation processing.
  • the signal processing may include, but is not limited to, processing for data reduction, data compression and/or downsampling, processing for compensation of various physical and circuit effects, processing to convert the data to a selected form and/or for transmission on a selected data port and/or processing to account for different excitations and/or to convert from one excitation type to another.
  • the signal processing circuit includes an extract range swath block 910 , a quadrature demodulation block 912 , a filter block 914 shown as a low pass filter (LPF), a downsample block 916 , a memory 920 , a time domain signal conditioning block 922 , a fast Fourier transform (FFT) block 924 , a frequency domain signal conditioning block 926 , a sum elevation channels block 930 and an Inverse Fast Fourier transform (IFFT) block 932 .
  • the output of the signal processing chain may be supplied to one or more image formation processors (IFP), such as a Fourier resampled image formation processor 940 and/or a backprojection image formation processor 942 .
  • the extract range swatch block 910 can be implemented by appropriate streaming of data from the ADC 212 .
  • the memory 920 can be located at any point in the signal processing circuit.
  • the signal processing circuit of FIG. 9 processes signals received via ADC 212 from a single ultrasound transducer element or a group of ultrasound transducer elements. Thus, at least a portion of the signal processing chain is repeated for each ultrasound transducer element or group of ultrasound transducer elements. As discussed below, in some embodiments, a portion of the signal processing chain utilizes a reduced number of channels and processes the signals for several channels on a time multiplexed basis. By utilizing a reduced number of channels for signal processing, the chip area and power consumption can be reduced in comparison with a configuration that utilizes one signal processing channel for each ultrasound transducer element or group of ultrasound transducer elements. By way of example only, an ultrasound transducer array may include 1000 ultrasound transducer elements, thereby requiring 1000 signal processing channels.
  • the number of processing channels following memory 920 is reduced, as compared with the number of processing channels before memory 920 .
  • the number of processing channels following memory 920 is reduced, as compared with the number of processing channels before memory 920 .
  • 4, 8 or 16 channels may be used following memory 920 , but the architecture is not limited with respect to the number of channels.
  • the memory 920 can be located at any point in the signal processing circuit to make an effective rate change via time multiplexing.
  • the signal processing circuit of FIG. 9 can have a variety of configurations in which some blocks are bypassed or omitted, depending on the requirements of a particular ultrasound system.
  • the quadrature demodulation block 912 , the filter block 914 and the downsample block 916 perform data reduction and can be bypassed or omitted in systems where data reduction is not required.
  • the sum elevation channels block 930 can be bypassed or omitted in systems where channel summation is performed by the image formation processor.
  • the IFFT block 932 can be bypassed or omitted in systems where in the image formation processor operates on frequency domain data.
  • the FFT block 924 and the frequency domain signal conditioning block 926 can be bypassed or omitted.
  • the time domain signal conditioning block 922 can be bypassed or omitted.
  • the extract range swath block 910 selects input samples that contribute to the image and discards input samples that do not contribute to the image. In order to process an image whose pixels have a given extent and location relative to the aperture, and a waveform with a given pulse length is used, there is a set of time samples that will contribute to the image pixels for a given receiver/excitation combination; time samples outside this set can be discarded.
  • the extract range swath block 910 may be implemented by streaming of data from the ADC 212 , wherein the selected range of data is defined by the beginning and ending times when the data is digitized and/or is injected into the signal processing circuit.
  • Extracting the contributing portion of the receive swath can reduce the data transfer requirements (when done on-board), the data storage requirements (whether in memory or writing to disk), and the processing burden. This can be done to various degrees of compactness depending on the importance of the data reduction.
  • a basic implementation includes a constant time extent across all receivers and all excitations, with a constant start time across all receivers and all excitations. Other implementations can use a separate start time and time extent for each receiver and each excitation. After data transfer, the data are aligned and arranged in whatever form is necessary for processing.
  • These samples may be discarded during preprocessing.
  • the approximate index where this nonlinear portion ends can be determined using the relative delay information and the pulse length of the waveform.
  • An additional buffer can be used to be sure that the nonlinear samples are all identified. This process may be performed independently across channel and excitation to minimize the amount of the image that is discarded at near range.
  • the data at the input to the preprocessor may be real or complex, and may already have an implied carrier frequency.
  • the combined steps of carrier adjustment, low pass filtering, and downsampling ensure that the data are complex, not excessively oversampled, and have the desired carrier frequency for the image formation processor.
  • the existing carrier frequency may be a “default” one and may not be the actual center of the desired processing band.
  • FIG. 10 is a block diagram of an example of the quadrature demodulation (QDM) block 912 , the filter block 914 and the downsample block 916 of FIG. 9 .
  • FIG. 10 shows that quadrature demodulation block 912 may be implemented as two separate data streams for the imaginary (I[n]) and quadrature (Q[n]) portions of the complex input signal x[n].
  • QDM block 912 includes a numerically-controlled oscillator, or any other suitable component, that may be used to generate cos(2 ⁇ f c t) and sin(2 ⁇ f c t), where the center frequency f c is selected to provide a particular amount of demodulation.
  • Demodulation may phase modulate a signal to be centered at 0 Hz or bounded by some desired frequency range for filtering. In some embodiments, it may be desirable to match f c with a frequency of interest of the transducers that are used in the array(s) 102 .
  • the imaginary and quadrature data streams from QDM block 912 are further processed by filter block 914 and downsample block 916 prior to output.
  • Filter block 914 is illustrated as performing low-pass filtering (LPF). However, it should be appreciated that other types of filtering, such as band-pass filtering (BPF) and high-pass filtering (HPF) may alternatively be used in filter block 914 .
  • LPF low-pass filtering
  • BPF band-pass filtering
  • HPF high-pass filtering
  • a cascade integrating comb (CIC) filter architecture may be used to perform filtering (e.g., for filter block 914 ) and decimation (e.g., for downsample block 916 ).
  • CIC filter architecture may be used to accurately calculate a range value using a precise delay time index.
  • the CIC filter includes a plurality (N) stages and acts as a low-pass filter, while decimating the input data stream x[n] to produce an output data stream y[n]. Increasing the number of stages results in more droop in the passband, while increasing the number of stages results in better image rejection.
  • passband droop may be at least partially addressed using a compensation filter that is applied after the CIC filter has been applied to the data.
  • the circuit of FIG. 10 includes six stages of processing implemented in digital processing circuitry. It should be appreciated that any number of digital processing stages may be included, and the six-stage implementation shown in FIG. 10 is provided merely for illustration. Additionally, some modes of operation of the ultrasound imaging device may employ some, but not all of the digital signal processing functionality described in FIG. 10 to provide different amounts and/or types of compression (including no compression) for particular applications. Mode selection and subsequent activation/deactivation of digital signal processing components may be achieved using any suitable technique.
  • received digital signal x[n] is first processed by QDM block 912 , which includes a pair of multiplier circuits 1020 , 1022 , a sine wave generator 1024 , and a phase shifter element 1026 .
  • the outputs of QDM block 912 are passed to filter block 914 implemented as a low pass filter (LPF).
  • LPF 914 is shown as a portion of a cascade integrating comb (CIC) filter that includes an integrator stage 1012 a and a comb stage 1012 b .
  • CIC cascade integrating comb
  • LPF 914 should be sufficient to reject high-frequency images from the multiply operation of QDM block 912 and anti-alias the signal before the downsampling provided by downsample block 916 .
  • the outputs of QDM block 912 are provided to the integrator stage 1012 a of the CIC filter.
  • integrator stage 612 a includes delay elements 1030 and adder elements 1032 .
  • the outputs of the integrator stage 1012 a are passed to downsample block 916 , which downsamples the received digital signal by a factor M using downsampling circuits 1040 .
  • the outputs of downsample block 916 are passed to the comb stage 1012 b of the CIC filter.
  • comb stage 1012 b includes delay elements 1050 and subtraction elements 1052 .
  • the outputs of the comb stage 1012 b are passed to re-quantization circuit 1016 , where re-quantization of the digital signals is performed using re-quantization circuits 1060 .
  • the outputs of re-quantization circuit 1016 are passed to arithmetic logic unit (ALU) 1018 , which provides additional arithmetic processing.
  • ALU arithmetic logic unit
  • the memory 920 stores signal samples after the received signal samples are processed by the extract range swath block 910 , the quadrature demodulation block 912 , the low pass filter 914 and the downsample block 916 .
  • the signal samples stored in memory 920 are indexed according to time.
  • the signal samples are read from memory 920 when required by time domain signal conditioning block 922 .
  • the processing following memory 920 may operate on several input channels. Accordingly, the signal samples are written to memory 920 upon receipt from the ultrasound transducer array and after initial processing. The signal samples are read from memory 920 when required by the processing blocks following memory 920 .
  • Memory can be provided between any pair of blocks or even sub-blocks (blocks within blocks).
  • a memory block may facilitate a reduction in the rate of streamed processing, thus reducing the number of parallel resources needed for processing, e.g., 1152 channels being processed concurrently may be saved to memory, then after memory the streaming processing may only consist of 4 channels at a time.
  • One reason for reducing the streaming rate is to optimize between speed and resources by matching a data rate interface, e.g., universal serial bus (USB), Firewire, low voltage differential signaling (LVDS), Thunderbolt, or other.
  • USB universal serial bus
  • Firewire Firewire
  • LVDS low voltage differential signaling
  • Thunderbolt Thunderbolt
  • the time domain signal conditioning block 922 shown in FIG. 9 performs signal conditioning of the signal samples in the time domain.
  • the signal conditioning may involve weighting of the time domain signals to compensate for various effects.
  • the weighting may be performed using a weighting function, or mask.
  • the weighting function may include a coefficient, or weighting value, corresponding to a range of times following a reference time, such as a transmit event.
  • the signal samples may include samples at times t 0 , t 1 , t 2 , . . . to after a reference time
  • the weighting function may include a coefficient, or a weighting value, corresponding to each signal sample after the reference time. Each signal sample is multiplied by the corresponding coefficient to provide a weighted signal sample.
  • a memory in time domain signal conditioning block 922 may store the coefficients of one or more weighting functions.
  • the weighting functions may be fixed or may be downloaded from a host computer to provide flexibility.
  • the weighting functions can be channel dependent or channel independent.
  • the multiplication of the signal samples by the weighting values can be a complex multiply.
  • FIG. 11 is a schematic block diagram of an example of the time domain signal conditioning block 922 of FIG. 9 .
  • the time domain signal conditioning block 922 of FIG. 11 includes complex multipliers 1110 and a Random Access Memory (RAM) 1120 .
  • Each of the complex multipliers 1110 receives a signal sample from memory 920 and a weighting value from RAM 1120 .
  • the complex multipliers 1110 perform time domain weighting of signal samples.
  • a weighting function including weighting coefficients is stored in RAM 1120 .
  • a weighting coefficient corresponding to an index of the signal sample is read from RAM 1120 , and the multiplications are performed as the signal samples are received.
  • the RAM 1120 contains a single weighting function corresponding to a single effect to be compensated.
  • the weighting function may be a combination of two or more effects to be compensated.
  • the signal conditioning circuit of FIG. 11 is repeated two or more times and a different weighting function is applied by each set of complex multipliers 1110 .
  • the time domain signal conditioning block 922 includes four complex multipliers 1110 .
  • the time domain signal conditioning block 922 may include any desired number of multipliers operating in parallel, such as for example eight multipliers or sixteen multipliers.
  • complex multipliers 1110 may be replaced with conventional multipliers if the signal samples are represented by real values.
  • the signal samples may include twenty-four bits, including a twelve-bit real value and a twelve-bit imaginary value.
  • any signal sample by size and format may be utilized.
  • the received signal may need to be altered across time and/or range in order to produce imagery with desired characteristics. This may be done using weightings in the time or range compressed domain. Weightings performed in almost any domain may be done to account for physically relevant phenomena. Examples are time invariant transfer functions applied as weights in the frequency domain, time-dependent weights to account for TGC (time-gain compensation), and range-dependent weights to account for attenuation/“range loss”.
  • the time domain is to be distinguished from the range compressed domain. Weights applied across time and weights applied across range mean different things when there are sufficiently long waveforms imposed on the time domain data. There are effects that are more accurately described as time domain effects, such as TGC or other time-dependent receiver gains, and effects that are more accurately described as range domain effects, such as tissue attenuation.
  • An accurate preprocessor (or forward operator, depending on which mode the processing is being used/defined) separates the application/removal of time and range domain weights, with waveform and system transfer function application/removal occurring between the two. Sharp transitions in range and/or time need to be applied with care, since these mean physically different things when extended waveforms are present, and since steep slopes and transitions affect the shape of the spectrum (relevant when deconvolving using the data itself; a ramp in the range/time domain is a derivative in the temporal spectrum). When the situation, parameters, or desired image quality dictate that the time and range weights are to be applied separately, true range processing can be used.
  • time domain weighting is channel-dependent or channel-independent, it may be desirable to perform dispersive (frequency dependent) time domain weighting (or “true range weighting”). This can be done several ways, including by polynomial or other basis expansion, and multirate filter banks.
  • time domain weighting The most basic case of time domain weighting is a channel-independent (receiver and excitation independent) weighting.
  • channel-independent weighting When the only weighting to be applied across time is channel-independent, then there can be a savings of memory and a simplification in the indexing.
  • this channel-independent weight can be absorbed into the other time domain weighting.
  • Examples of channel-independent time domain weights include: (1) carrier frequency adjustment, as discussed above; (2) linear phase that when applied in time, FFT shifts the temporal frequency domain after the FFT; and (3) time-gain compensation (TGC) profile, which in some cases is the same for every receiver and for every excitation.
  • TGC time-gain compensation
  • receiver-dependent fast-time domain weights that are a function of time but not a function of excitation.
  • An example is TGC profiles that are different enough from receiver-to-receiver that they need to be compensated for individually (this may still be the case even if the TGC settings/parameters are the same for every receiver; this is possible if the variation in the amplifier gains are so great that they need to be dealt with separately).
  • excitation-dependent fast-time domain weights There may be a need to apply excitation-dependent fast-time domain weights. This could be the case when the excitations are different enough that different TGC settings are intentionally used to best quantize the signal across all excitations.
  • Channel-dependent time domain weights may be applied within a preprocessing chain. It is also possible to have a set of receiver-dependent time domain weights and a set of excitation-dependent time domain weights, and this creates a trade off between the memory storage of combining these into a single set of channel-dependent weights vs. two separate sets of multiplies with more complicated indexing.
  • TGC Time-Gain Compensation
  • FIG. 12 A schematic block diagram of an example of the FFT block 924 of FIG. 9 is shown in FIG. 12 .
  • the FFT block 924 of FIG. 12 includes FFT units 1210 , a data selector 1220 and zero-stuff logic 1230 .
  • the FFT block 924 receives signal samples, after weighting by time domain signal conditioning block 922 , and performs Fast Fourier Transform processing of the signal samples.
  • the data selector 1220 selects either the signal samples or a zero value to be provided to the FFT units 1210 in accordance with control signals from zero-stuff logic 1230 .
  • the data selector 1220 in effect provides zeropadding of input signal samples.
  • the data selector 1220 may be configured as a separate data selector for each of the FFT units 1210 so as to provide individual control of zeropadding in each channel.
  • the FFT units 1210 may be 1024 point variable streaming FFT units. However, other FFT units may be utilized.
  • the signal samples are twenty-four bits including a twelve-bit real value and a twelve-bit imaginary value.
  • the FFT units 1210 convert the time domain signals to frequency domain values which, in the example of FIG. 12 , have sixteen bits. However, any number of bits and real or complex signal samples may be utilized.
  • the FFT block 924 of FIG. 9 includes zeropadding, a Fast Fourier Transform (FFT), and truncation to the desired processing band.
  • the data are zeropadded by placing the trimmed time domain data in the FFT-center of a zero-filled array of a larger, predetermined size.
  • the amount of zeropadding/size of the larger array relative to the trimmed array is dependent on several factors as discussed below.
  • mismatched filter here means a reference signal that is not the matched filter.
  • the mismatched filter generation technique that is of particular use is simply the signal generated by regularized deconvolution of the signal's spectrum. Poor choices of mismatched filters will not adequately remove the waveform, while useful mismatched filters likely have effective lengths equal to or longer than matched filters. In some cases, an extended length may be used to move unwanted signals far out such that they can easily be removed. There may be a large enough difference between the lengths of the signals being convolved for forward/adjoint processing than for “inverse”/adjoint of “inverse” processing that separate chains may be more efficient and more appropriate.
  • the length of the mismatched filter is intentionally made to be very long, it may be appropriate to add an additional pair of FFTs and pads/truncations/weights in range to remove the unwanted signal pushed by the mismatched filter as well as to equate the temporal frequency grids (number of frequencies, spacing, and start frequency) between all modes for the final preprocessed complex scattering function.
  • FFT Fast Fourier Transform
  • linear phase ramps Another way to perform FFTshifts indirectly is by multiplying by linear phase ramps (a linear phase ramp multiplied on the input to the FFT can result in an FFTshift of the output, a linear phase ramp multiplied on the output of the FFT can result in the same effect as applying an FFTshift to the input).
  • the linear phase ramps that perform this are simple ( ⁇ 1 on both sides when length is divisible by four, ⁇ 1 or ⁇ 1 on the different sides when length is only divisible by two. When one considers that there are not many genuine “good FFT sizes” of appreciable length that are not evenly divisible by four, then these linear phase ramps are just ⁇ 1 across the fast-time or temporal frequency samples on both sides of the FFT.
  • the spectrum is trimmed to the portion of the processing band that is chosen to contribute to the image. This may be chosen from image quality requirements.
  • FIG. 13 A schematic block diagram of an example of the frequency domain signal conditioning block 926 of FIG. 9 is shown in FIG. 13 .
  • the frequency domain signal conditioning block 926 receives frequency domain values corresponding to the signal samples and performs signal conditioning in the frequency domain. In particular, the frequency domain signal conditioning block 926 performs weighting of the frequency domain values to compensate for one or more effects and provides weighted frequency domain values.
  • the frequency domain signal conditioning block 926 includes numerically controlled oscillators (NCO 1 -NCO 4 ) 1310 , a RAM 1320 , complex multipliers 1330 , 1332 and 1334 , and a RAM 1340 .
  • the RAM 1320 provides initial phase information to NCOs 1310 .
  • the outputs of NCOs 1310 are provided to one input of each of complex multipliers 1330 , respectively, and apodization values are provided to second inputs of complex multipliers 1330 from RAM 1320 .
  • the outputs of complex multipliers 1330 are provided to one input of each of complex multipliers 1332 , respectively.
  • the RAM 1340 provides weighting values, or coefficients, to the second inputs of complex multipliers 1332 .
  • the outputs of complex multipliers 1332 are provided to one input of each of complex multipliers 1334 , respectively, and inputs from FFT block 924 are provided to second inputs of each of complex multipliers 1334 .
  • the outputs of complex multipliers 1334 are weighted frequency domain values which have been conditioned in accordance with one or more weighting functions contained in RAM 1340 .
  • the RAM 1320 may be sized to accommodate channel independent or channel dependent multiplication. Furthermore, an implementation may be dependent on the receiver transducer location, e.g., array row channel dependent and column channel independent or vice versa.
  • the NCO is generating a single frequency for multiplication, which has the effect of imparting a delay in the associated time domain signal (the signal after inverse FFT).
  • the first multiply is a method for imparting a delay and an apodization.
  • the frequency domain preprocessing and weighting performs the bulk of the processing on the data and has the biggest impact on image quality. This is where the transfer functions of all the individual pieces are combined and accounted for, and where motion compensation/phase adjustment can be performed.
  • FFT shifting the input is desired before the fast-time FFT (preprocessing block preceding the temporal frequency domain weightings), that can be accomplished by a multiplication along temporal frequency after the FFT.
  • the linear phase ramp to accomplish this can be absorbed into any of the precomputed temporal frequency weightings for no additional computational cost during preprocessing.
  • a channel-independent frequency domain weighting may be desirable to account for several effects: (1) temporal frequency linear aperture weighting, chosen to impose a specific sidelobe structure in the imagery, rather than just using whatever the system generated with its non-flat waveform generator/transfer function combination; (2) constant “master waveform” applied across all channels; and (3) common transducer transfer function.
  • the channel-independent frequency domain weighting there is at least one receiver/excitation/channel-dependent frequency domain weighting that needs to be applied within preprocessing, and the channel-independent frequency domain weighting can be absorbed there.
  • the receiver/excitation/channel-dependent frequency domain weighting is phase-only, where the phase is described by a low-order polynomial (such as motion compensations with linear phase or other phase adjustments with quadratic phase functions).
  • the phase-only function can be efficiently computed on-the-fly, and the channel-independent weight is applied as a separate multiply step. This would incur more overall multiplies but save a large amount of memory that would be used for storing the pre-computed weights (particularly for fully channel-dependent weights).
  • Receiver-dependent frequency domain weighting may be useful. This would be the case if the transfer functions of each combined transmitter/transducer/receiver are different enough to warrant accounting for them separately.
  • Excitation-dependent frequency domain weighting may be applied to the data that is receiver-independent.
  • a relevant example is for plane wave excitations, where there is often an offset delay relative to the phase reference at the middle receiver that is a function of the plane wave angle. While this can be absorbed into a time domain interpolation or a fully channel-dependent frequency domain weighting, the amount of memory storage for a full set of weights may make an excitation-dependent weighting attractive.
  • Channel-dependent frequency domain weighting may also be utilized.
  • the most general weighting is one that is potentially different on every channel of data, where a channel is a unique receiver/excitation combination. Any channel-independent weightings can be absorbed into channel-dependent, receiver-dependent, or excitation-dependent weightings.
  • True range processing may be performed separately from other weighting. There may be scenarios, particularly with long waveforms, where it may be desirable to apply weights before and after waveform application/removal to better emulate fast-time and range domain physical processes. The choice to separate these vs. lump them into the fast-time weights is dependent on the specific scenario and constraints.
  • Reduction of localized acoustic energy as it propagates through tissue can be significant. It may be desirable to unweight the raw data with an estimated range-dependent profile in order to level out the image. It may be useful to compensate for approximate range decay.
  • many 2-D imaging formulations assume infinite line sources and infinite line transducer elements, which result in cylindrical wave decay. Many of these formulations actually impose the correct cylindrical wave behavior on the raw data (when used in the forward sense, and accurately removed when used in the “inverse” sense). But since the actual transducers behave more like point sources and the volume is composed of point scatterers, spherical waves are more appropriate to describe basic propagation loss.
  • the signal attenuation characteristics through tissue are not generally known in advance. Approximating the attenuation as a homogeneous process with estimated parameters, however, can aid in leveling out the image brightness as a function of downrange. Even with assumed homogeneous attenuation parameters, the attenuation should be imposed/removed as a function of frequency, either through polynomial or other basis expansion, multirate, or by other means. If this is too computationally burdensome, then it can be approximated using the parameters at a single frequency.
  • FIG. 14 A schematic block diagram of an example of the sum elevation channels block 930 of FIG. 9 is shown in FIG. 14 .
  • the sum elevation channels block 930 performs summing of elevation channel data in the frequency domain. In other embodiments, summing of elevation channel data may be performed by the image formation processor.
  • the sum elevation channels block 930 includes registers 1410 , data selectors 1412 , summing units 1420 , 1422 , 1424 and 1426 , data selectors 1430 and 1432 , RAMs 1440 and 1442 , data selectors 1450 and 1452 , and an OR circuit 1460 .
  • Weighted frequency domain values are provided via registers 1410 and data selectors 1412 to summing units 1420 and 1422 , where the weighted frequency domain values represent different elevation channels.
  • the outputs of summing units 1420 and 1422 are provided to one input of each of summing units 1424 and 1426 , respectively.
  • the RAMs 1440 and 1442 provide frequency domain values for additional channels to second inputs of summing units 1424 and 1426 , respectively, via data selectors 1430 and 1432 .
  • the outputs of summing units 1424 and 1426 are routed by data selectors 1450 and 1452 either to the RAMs 1440 and 1442 , respectively, or to the OR circuit 1460 for output of the sum elevation channels block.
  • the sum elevation channels block 930 provides configurable summation of the channels.
  • Data in the range compressed domain may be the required output of the preprocessor/input to image formation, e.g. Backprojection.
  • standardized data ports may be established along the processing chain, whether or not that port is explicitly a waypoint along a given preprocessor/IFP processing chain.
  • Another FFT IFFT, if an FFT was done along fast-time
  • the IFFT 932 of FIG. 9 may be used to convert the frequency domain data output by sum elevation channels block 930 , or by frequency domain signal conditioning block 926 if sum elevation channels block 930 is not utilized, to the time domain for image formation processing. This may have some amount of zeropadding, in order to operate on an upsampled range compressed data for reconstruction.
  • the output of the preprocessor is data that is to be ingested by an image formation processor (IFP).
  • IFP image formation processor
  • this input to the image formation processor should be in the form of complex scattering function in the temporal frequency vs. receiver channel domain, but this is not the only option. Branches that have the input of the image formation processor in the range compressed domain are useful for reconstructions such as backprojection.
  • FIG. 15 A schematic block diagram of an example of a channel configuration of the signal processing architecture is shown in FIG. 15 .
  • several input channels 1510 including Channel 0, Channel 1, . . . Channel M, are combined into a single output channel 1520 .
  • the signal samples output by input channels 1510 are written to channel memories 1530 .
  • signal samples output by Channel 0 are written to Channel 0 memory
  • signal samples output by Channel 1 are written to Channel 1 memory
  • . . . and signal samples output by Channel M are written to Channel M memory.
  • Signal sample values are read from channel memories 1530 as required for processing by output channel 1520 .
  • each input channel 1510 may include extract range swath block 910 , quadrature demodulation block 912 , LPF 914 and downsample block 916 .
  • the output channel 1520 may include time domain signal conditioning block 922 , FFT block 924 , frequency domain signal conditioning block 926 , sum elevation channels block 930 and IFFT block 932 , and each channel memory 1530 corresponds to memory 920 .
  • time domain signal conditioning block 922 FFT block 924 , frequency domain signal conditioning block 926 , sum elevation channels block 930 and IFFT block 932
  • each channel memory 1530 corresponds to memory 920 .
  • more or fewer signal processing functions may be included in each input channel 1510 and, similarly, more or fewer signal processing functions may be included in output channel 1520 .
  • FIG. 16 A flowchart that illustrates an example of a method performed by the signal processing circuit of FIG. 9 is shown in FIG. 16 .
  • the signal processing circuit receives signal samples from ADC 212 .
  • signal samples that do not contribute to the image may be discarded. Non-linear signal samples may also be discarded.
  • quadrature demodulation is performed by quadrature demodulation block 912
  • filtering is performed by LPF 914 in stage 1616 .
  • Downsampling of the filtered signal is performed by downsample block 916 in stage 1618 .
  • the partially processed signal samples may then be stored in memory 920 in stage 1620 .
  • time domain signal conditioning is performed by time domain signal conditioning block 922 .
  • time domain signal conditioning may include application of one or more weighting functions to the time domain signal.
  • a Fast Fourier Transform is applied to the signal samples, and frequency domain signal conditioning is performed in stage 1634 .
  • frequency domain signal conditioning involves application of one or more frequency domain weighting functions to the frequency domain data.
  • the elevation channels are summed by sum elevation channels block 930 to thereby reduce the quantity of data supplied for image formation processing.
  • an inverse Fast Fourier Transform may be applied to the conditioned signal samples if time domain signals are required for image formation processing.
  • the conditioned signal samples are utilized for image formation processing.
  • optional functions can be omitted. For example, summing of elevation channels in stage 1636 can be omitted if summing is performed during image formation processing. In another example, the Inverse Fast Fourier Transform of stage 1638 may be omitted when the image formation processing of stage 1640 operates on frequency domain data. In addition, data reduction operations, such as the quadrature demodulation of stage 1614 , the filtering of stage 1616 and the downsampling of stage 1618 may be omitted in some applications. Furthermore, additional steps may be included within the signal processing method of FIG. 16 .
  • One or more aspects and embodiments of the present disclosure involving the performance of processes or methods may utilize program instructions executable by a device (e.g., a computer, a processor, or other device) to perform, or control performance of, the processes or methods.
  • a device e.g., a computer, a processor, or other device
  • inventive concepts may be embodied as a computer readable storage medium (or multiple computer readable storage media) (e.g., a computer memory, one or more floppy discs, compact discs, optical discs, magnetic tapes, flash memories, circuit configurations in Field Programmable Gate Arrays or other semiconductor devices, or other tangible computer storage medium) encoded with one or more programs that, when executed on one or more computers or other processors, perform methods that implement one or more of the various embodiments described above.
  • the computer readable medium or media can be transportable, such that the program or programs stored thereon can be loaded onto one or more different computers or other processors to implement various ones of the aspects described above.
  • computer readable media may be non-transitory media.
  • program or “software” are used herein in a generic sense to refer to any type of computer code or set of computer-executable instructions that can be employed to program a computer or other processor to implement various aspects as described above. Additionally, it should be appreciated that according to one aspect, one or more computer programs that when executed perform methods of the present disclosure need not reside on a single computer or processor, but may be distributed in a modular fashion among a number of different computers or processors to implement various aspects of the present disclosure.
  • Computer-executable instructions may be in many forms, such as program modules, executed by one or more computers or other devices.
  • program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types.
  • functionality of the program modules may be combined or distributed as desired in various embodiments.
  • data structures may be stored in computer-readable media in any suitable form.
  • data structures may be shown to have fields that are related through location in the data structure. Such relationships may likewise be achieved by assigning storage for the fields with locations in a computer-readable medium that convey relationship between the fields.
  • any suitable mechanism may be used to establish a relationship between information in fields of a data structure, including through the use of pointers, tags or other mechanisms that establish relationship between data elements.
  • the software code can be executed on any suitable processor or collection of processors, whether provided in a single computer or distributed among multiple computers.
  • a computer may be embodied in any of a number of forms, such as a rack-mounted computer, a desktop computer, a laptop computer, or a tablet computer, as non-limiting examples. Additionally, a computer may be embedded in a device not generally regarded as a computer but with suitable processing capabilities, including a Personal Digital Assistant (PDA), a smartphone or any other suitable portable or fixed electronic device.
  • PDA Personal Digital Assistant
  • a computer may have one or more input and output devices. These devices can be used, among other things, to present a user interface. Examples of output devices that can be used to provide a user interface include printers or display screens for visual presentation of output and speakers or other sound generating devices for audible presentation of output. Examples of input devices that can be used for a user interface include keyboards, and pointing devices, such as mice, touch pads, and digitizing tablets. As another example, a computer may receive input information through speech recognition or in other audible formats.
  • Such computers may be interconnected by one or more networks in any suitable form, including a local area network or a wide area network, such as an enterprise network, and intelligent network (IN) or the Internet.
  • networks may be based on any suitable technology and may operate according to any suitable protocol and may include wireless networks, wired networks or fiber optic networks.
  • some aspects may be embodied as one or more methods.
  • the acts performed as part of the method may be ordered in any suitable way. Accordingly, embodiments may be constructed in which acts are performed in an order different than illustrated, which may include performing some acts simultaneously, even though shown as sequential acts in illustrative embodiments.
  • a reference to “A and/or B”, when used in conjunction with open-ended language such as “comprising” can refer, in one embodiment, to A only (optionally including elements other than B); in another embodiment, to B only (optionally including elements other than A); in yet another embodiment, to both A and B (optionally including other elements); etc.
  • the phrase “at least one,” in reference to a list of one or more elements, should be understood to mean at least one element selected from any one or more of the elements in the list of elements, but not necessarily including at least one of each and every element specifically listed within the list of elements and not excluding any combinations of elements in the list of elements.
  • This definition also allows that elements may optionally be present other than the elements specifically identified within the list of elements to which the phrase “at least one” refers, whether related or unrelated to those elements specifically identified.
  • “at least one of A and B” can refer, in one embodiment, to at least one, optionally including more than one, A, with no B present (and optionally including elements other than B); in another embodiment, to at least one, optionally including more than one, B, with no A present (and optionally including elements other than A); in yet another embodiment, to at least one, optionally including more than one, A, and at least one, optionally including more than one, B (and optionally including other elements); etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Veterinary Medicine (AREA)
  • Pathology (AREA)
  • Public Health (AREA)
  • Biophysics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Gynecology & Obstetrics (AREA)
  • Mathematical Physics (AREA)
  • Artificial Intelligence (AREA)
  • Physiology (AREA)
  • Psychiatry (AREA)
  • Signal Processing (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
US15/517,284 2014-10-07 2015-10-07 Ultrasound signal processing circuitry and related apparatus and methods Abandoned US20170307741A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/517,284 US20170307741A1 (en) 2014-10-07 2015-10-07 Ultrasound signal processing circuitry and related apparatus and methods

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201462060822P 2014-10-07 2014-10-07
US15/517,284 US20170307741A1 (en) 2014-10-07 2015-10-07 Ultrasound signal processing circuitry and related apparatus and methods
PCT/US2015/054405 WO2016057622A1 (fr) 2014-10-07 2015-10-07 Circuiterie de traitement de signal à ultrasons, et appareil et procédés associés

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2015/054405 A-371-Of-International WO2016057622A1 (fr) 2014-10-07 2015-10-07 Circuiterie de traitement de signal à ultrasons, et appareil et procédés associés

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/252,382 Continuation US10371804B2 (en) 2014-10-07 2019-01-18 Ultrasound signal processing circuitry and related apparatus and methods

Publications (1)

Publication Number Publication Date
US20170307741A1 true US20170307741A1 (en) 2017-10-26

Family

ID=55653700

Family Applications (2)

Application Number Title Priority Date Filing Date
US15/517,284 Abandoned US20170307741A1 (en) 2014-10-07 2015-10-07 Ultrasound signal processing circuitry and related apparatus and methods
US16/252,382 Active US10371804B2 (en) 2014-10-07 2019-01-18 Ultrasound signal processing circuitry and related apparatus and methods

Family Applications After (1)

Application Number Title Priority Date Filing Date
US16/252,382 Active US10371804B2 (en) 2014-10-07 2019-01-18 Ultrasound signal processing circuitry and related apparatus and methods

Country Status (9)

Country Link
US (2) US20170307741A1 (fr)
EP (1) EP3203917A4 (fr)
JP (1) JP6692804B2 (fr)
KR (1) KR102108616B1 (fr)
CN (1) CN106794009A (fr)
AU (2) AU2015328134B2 (fr)
CA (1) CA2962785A1 (fr)
TW (1) TWI683121B (fr)
WO (1) WO2016057622A1 (fr)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170202541A1 (en) * 2016-01-15 2017-07-20 Butterfly Network, Inc. Ultrasound signal processing circuitry and related apparatus and methods
US20180293758A1 (en) * 2017-04-08 2018-10-11 Intel Corporation Low rank matrix compression
TWI663397B (zh) * 2018-02-09 2019-06-21 大陸商業成科技（成都）有限公司 超聲波成像系統及方法
US10371804B2 (en) 2014-10-07 2019-08-06 Butterfly Network, Inc. Ultrasound signal processing circuitry and related apparatus and methods
US10755692B2 (en) 2017-06-19 2020-08-25 Butterfly Network, Inc. Mesh-based digital microbeamforming for ultrasound applications
US20200405266A1 (en) * 2019-06-25 2020-12-31 Butterfly Network, Inc. Methods and apparatuses for processing ultrasound signals
US10972842B2 (en) 2017-06-23 2021-04-06 Butterfly Network, Inc. Differential ultrasonic transducer element for ultrasound devices
US20210389439A1 (en) * 2015-06-04 2021-12-16 Chikayoshi Sumi Measurement and imaging instruments and beamforming method
US11501562B2 (en) 2019-04-30 2022-11-15 Bfly Operations, Inc. Ultrasound face scanning and identification apparatuses and methods
US11534135B2 (en) 2019-09-27 2022-12-27 Bfly Operations, Inc. Methods and apparatuses for monitoring fetal heartbeat and uterine contraction signals
WO2023060235A1 (fr) * 2021-10-08 2023-04-13 Deepsight Technology, Inc. Visualisation de balise ultrasonore avec des capteurs optiques
US11808897B2 (en) 2020-10-05 2023-11-07 Bfly Operations, Inc. Methods and apparatuses for azimuthal summing of ultrasound data

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10082565B2 (en) 2016-03-31 2018-09-25 Butterfly Network, Inc. Multilevel bipolar pulser
US11154279B2 (en) 2016-03-31 2021-10-26 Bfly Operations, Inc. Transmit generator for controlling a multilevel pulser of an ultrasound device, and related methods and apparatus
US9778348B1 (en) 2016-03-31 2017-10-03 Butterfly Network, Inc. Symmetric receiver switch for bipolar pulser
US10859687B2 (en) 2016-03-31 2020-12-08 Butterfly Network, Inc. Serial interface for parameter transfer in an ultrasound device
JP2017225808A (ja) * 2016-06-22 2017-12-28 韓國電子通信研究院Ｅｌｅｃｔｒｏｎｉｃｓ ａｎｄ Ｔｅｌｅｃｏｍｍｕｎｉｃａｔｉｏｎｓ Ｒｅｓｅａｒｃｈ Ｉｎｓｔｉｔｕｔｅ 心拍変異度分析装置及びそれを利用した心拍変異度検出方法
CN110062945B (zh) * 2016-12-02 2023-05-23 迪拉克研究公司 音频输入信号的处理
US10469846B2 (en) 2017-03-27 2019-11-05 Vave Health, Inc. Dynamic range compression of ultrasound images
US11531096B2 (en) 2017-03-23 2022-12-20 Vave Health, Inc. High performance handheld ultrasound
US10856843B2 (en) 2017-03-23 2020-12-08 Vave Health, Inc. Flag table based beamforming in a handheld ultrasound device
US11446003B2 (en) 2017-03-27 2022-09-20 Vave Health, Inc. High performance handheld ultrasound
CN108344987B (zh) * 2018-01-04 2022-06-14 中国人民解放军91388部队 多子阵合成孔径声纳频域函数基于数值计算的方法
TWI646344B (zh) * 2018-03-19 2019-01-01 廣達電腦股份有限公司 電子裝置、超音波測距裝置和方法
CN110161508A (zh) * 2019-06-03 2019-08-23 Oppo广东移动通信有限公司 测距方法、装置、终端及存储介质
WO2021041211A1 (fr) * 2019-08-23 2021-03-04 Butterfly Network, Inc. Procédés et appareils de stockage de données ultrasonores
WO2021055721A1 (fr) 2019-09-19 2021-03-25 Butterfly Network, Inc. Commutateur récepteur symétrique pour dispositifs à ultrasons
JP7235645B2 (ja) * 2019-11-29 2023-03-08 日立Ｇｅニュークリア・エナジー株式会社 超音波検査方法及び超音波検査装置
WO2021211822A1 (fr) 2020-04-16 2021-10-21 Bfly Operations, Inc. Procédés et circuiterie pour auto-essai intégré de circuiterie et/ou de transducteurs dans des dispositifs à ultrasons

Citations (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4463608A (en) * 1979-05-07 1984-08-07 Yokogawa Hokushin Electric Corp. Ultrasound imaging system
US4646754A (en) * 1985-02-19 1987-03-03 Seale Joseph B Non-invasive determination of mechanical characteristics in the body
US5718229A (en) * 1996-05-30 1998-02-17 Advanced Technology Laboratories, Inc. Medical ultrasonic power motion imaging
US5793701A (en) * 1995-04-07 1998-08-11 Acuson Corporation Method and apparatus for coherent image formation
US5830147A (en) * 1997-05-30 1998-11-03 Schepens Eye Research Institute, Inc. Method and apparatus for examining optic nerve head circulation
US5839442A (en) * 1995-06-29 1998-11-24 Teratech Corporation Portable ultrasound imaging system
US5912826A (en) * 1994-12-24 1999-06-15 Cambridge Consultants Limited Data processing method and apparatus
US5924991A (en) * 1997-08-22 1999-07-20 Acuson Corporation Ultrasonic system and method for harmonic imaging in three dimensions
US5957846A (en) * 1995-06-29 1999-09-28 Teratech Corporation Portable ultrasound imaging system
US5964709A (en) * 1995-06-29 1999-10-12 Teratech Corporation Portable ultrasound imaging system
US6005916A (en) * 1992-10-14 1999-12-21 Techniscan, Inc. Apparatus and method for imaging with wavefields using inverse scattering techniques
US6104670A (en) * 1995-03-02 2000-08-15 Acuson Corporation Ultrasonic harmonic imaging system and method
US6122223A (en) * 1995-03-02 2000-09-19 Acuson Corporation Ultrasonic transmit waveform generator
US6132375A (en) * 1999-03-31 2000-10-17 Acuson Corporation Medical ultrasonic system and method for synthetic aperture processing in elevation
US6248073B1 (en) * 1995-06-29 2001-06-19 Teratech Corporation Ultrasound scan conversion with spatial dithering
US6409667B1 (en) * 2000-02-23 2002-06-25 Acuson Corporation Medical diagnostic ultrasound transducer system and method for harmonic imaging
US6443894B1 (en) * 1999-09-29 2002-09-03 Acuson Corporation Medical diagnostic ultrasound system and method for mapping surface data for three dimensional imaging
US20030009102A1 (en) * 2001-04-19 2003-01-09 Sonosite, Inc. Medical diagnostic ultrasound instrument with ECG module, authorization mechanism and methods of use
US20030013965A1 (en) * 2001-04-19 2003-01-16 Quistgaard Jens U. Medical diagnostic ultrasound instrument wih ecg module, authorization mechanism and methods of use
US6511426B1 (en) * 1998-06-02 2003-01-28 Acuson Corporation Medical diagnostic ultrasound system and method for versatile processing
US20030216627A1 (en) * 1997-08-14 2003-11-20 Lorenz Alexander D. Measurement site dependent data preprocessing method for robust calibration and prediction
US6682483B1 (en) * 1999-05-28 2004-01-27 Vuesonix Sensors, Inc. Device and method for mapping and tracking blood flow and determining parameters of blood flow
US20040220474A1 (en) * 2002-03-20 2004-11-04 Kenneth Abend Determining the power of an ultrasound reflection using an autocorrelation technique
US20040267127A1 (en) * 1999-05-28 2004-12-30 Vuesonix Sensors, Inc. Transmitter patterns for multi beam reception
US20060187462A1 (en) * 2005-01-21 2006-08-24 Vivek Srinivasan Methods and apparatus for optical coherence tomography scanning
US20070123110A1 (en) * 2003-10-08 2007-05-31 Koninklijke Philips Electronics N.V. Ultrasonic volumetric imaging by coordination of acoustic sampling resolution, volumetric line density, and volume imaging rate
US20070133878A1 (en) * 2005-12-14 2007-06-14 Porikli Fatih M Method for constructing covariance matrices from data features
US20070161904A1 (en) * 2006-11-10 2007-07-12 Penrith Corporation Transducer array imaging system
US20080114253A1 (en) * 2006-11-10 2008-05-15 Penrith Corporation Transducer array imaging system
US20080114255A1 (en) * 2006-11-10 2008-05-15 Penrith Corporation Transducer array imaging system
US20090306513A1 (en) * 2008-06-06 2009-12-10 Seshadri Srinivasan Multi-Plane/Multi-Slice Processing For 2-D Flow Imaging in Medical Diagnostic Ultrasound
US20100022884A1 (en) * 2008-07-28 2010-01-28 Siemens Medical Solutions Usa, Inc. Spectral doppler with multiple spatially distinct gates
US20110125017A1 (en) * 2004-09-20 2011-05-26 Innervision Medical Technologies Inc. Systems and Methods for Ultrasound Imaging
US20150187052A1 (en) * 2012-06-18 2015-07-02 University Health Network Method and system for compressed sensing image reconstruction
US20150224346A1 (en) * 2012-09-14 2015-08-13 Isis Innovation Limited Passive ultrasound imaging with sparse transducer arrays
US20160157828A1 (en) * 2014-06-05 2016-06-09 Chikayoshi Sumi Beamforming method, measurement and imaging instruments, and communication instruments

Family Cites Families (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA1192654A (fr) * 1982-01-11 1985-08-27 Technicare Corporation Dispositif et methode de stockage d'images a ultrasons
JPH04276243A (ja) * 1991-02-28 1992-10-01 Shimadzu Corp 超音波診断装置
US5904652A (en) * 1995-06-29 1999-05-18 Teratech Corporation Ultrasound scan conversion with spatial dithering
JP4382884B2 (ja) * 1996-11-08 2009-12-16 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 高調波による超音波画像処理方法および装置
CN1242079A (zh) * 1996-12-24 2000-01-19 垓技术公司 带空间抖颤的超声扫描变换
US6200266B1 (en) * 1998-03-31 2001-03-13 Case Western Reserve University Method and apparatus for ultrasound imaging using acoustic impedance reconstruction
US5980459A (en) * 1998-03-31 1999-11-09 General Electric Company Ultrasound imaging using coded excitation on transmit and selective filtering of fundamental and (sub)harmonic signals on receive
US6352507B1 (en) * 1999-08-23 2002-03-05 G.E. Vingmed Ultrasound As Method and apparatus for providing real-time calculation and display of tissue deformation in ultrasound imaging
US7115093B2 (en) 2001-11-21 2006-10-03 Ge Medical Systems Global Technology Company, Llc Method and system for PDA-based ultrasound system
CN1296012C (zh) * 2002-10-01 2007-01-24 深圳迈瑞生物医疗电子股份有限公司 全数字超声频谱多普勒成像方法及装置
US7549961B1 (en) 2003-07-31 2009-06-23 Sonosite, Inc. System and method supporting imaging and monitoring applications
ES2277473B1 (es) * 2004-01-30 2008-07-16 Consejo Sup. Investig. Cientificas Composicion coherente de señales por correccion focal progresiva.
US7461554B2 (en) * 2005-10-14 2008-12-09 Olympus Ndt Digital time variable gain circuit for non-destructive test instrument
US8465431B2 (en) 2005-12-07 2013-06-18 Siemens Medical Solutions Usa, Inc. Multi-dimensional CMUT array with integrated beamformation
US8277380B2 (en) 2007-09-11 2012-10-02 Siemens Medical Solutions Usa, Inc. Piezoelectric and CMUT layered ultrasound transducer array
AU2009243918A1 (en) 2008-05-07 2009-11-12 Signostics Limited Docking system for medical diagnostic scanning using a handheld device
JP5653057B2 (ja) * 2009-05-27 2015-01-14 キヤノン株式会社 測定装置
US8647279B2 (en) 2010-06-10 2014-02-11 Siemens Medical Solutions Usa, Inc. Volume mechanical transducer for medical diagnostic ultrasound
JP5053430B2 (ja) * 2010-10-05 2012-10-17 シャープ株式会社 空気調和機
KR101221309B1 (ko) * 2010-12-13 2013-01-10 삼성메디슨 주식회사 Ｅｘｔｒａｐｏｌａｔｉｏｎ에 기초하여 도플러 모드 영상을 제공하는 초음파 시스템 및 방법
WO2012146946A1 (fr) * 2011-04-29 2012-11-01 B-K Medical Aps Imagerie ultrasonore harmonique à l'aide d'une formation de faisceau séquentielle à ouverture synthétique
KR101282764B1 (ko) * 2011-05-06 2013-07-05 서강대학교산학협력단 직교 비선형 코드를 이용한 초음파 영상 생성 방법 및 장치
DE112012002629T5 (de) * 2011-06-08 2014-04-17 University Of Virginia Trennbare Strahlenformung für Ultraschallanordnung
CN103747743B (zh) * 2011-07-01 2016-10-12 皇家飞利浦有限公司 对超声波束形成器进行基于对象姿态的初始化
CA2851839C (fr) * 2011-10-17 2020-09-15 Butterfly Network, Inc. Imagerie transmissive et appareils et procedes associes
JP5865050B2 (ja) * 2011-12-15 2016-02-17 キヤノン株式会社 被検体情報取得装置
TW201325556A (zh) * 2011-12-28 2013-07-01 Ind Tech Res Inst 超音波能量轉換裝置以及超音波成像系統與方法
JP2015163087A (ja) * 2012-05-31 2015-09-10 日立アロカメディカル株式会社 超音波撮像装置
JP6253296B2 (ja) * 2012-08-28 2017-12-27 キヤノン株式会社 被検体情報取得装置、表示方法、及びプログラム
US9513372B2 (en) * 2013-01-22 2016-12-06 Schlumberger Technology Corporation Automatic processing of ultrasonic data
US8929177B2 (en) * 2013-03-14 2015-01-06 Fujifilm Sonosite, Inc. System and method for performing progressive beamforming
CA2903479C (fr) 2013-03-15 2023-10-10 Butterfly Network, Inc. Dispositifs, systemes et procedes d'imagerie ultrasonique monolithique
US9592030B2 (en) 2013-07-23 2017-03-14 Butterfly Network, Inc. Interconnectable ultrasound transducer probes and related methods and apparatus
CN105492129B (zh) 2013-08-27 2019-07-02 皇家飞利浦有限公司 双模式cmut换能器
TWI643601B (zh) 2014-04-18 2018-12-11 美商蝴蝶網路公司 超音波成像壓縮方法和設備
US9229097B2 (en) 2014-04-18 2016-01-05 Butterfly Network, Inc. Architecture of single substrate ultrasonic imaging devices, related apparatuses, and methods
KR102108616B1 (ko) 2014-10-07 2020-05-07 버터플라이 네트워크, 인크. 초음파 신호 처리 회로와 관련 장치 및 방법
US10695034B2 (en) 2015-05-15 2020-06-30 Butterfly Network, Inc. Autonomous ultrasound probe and related apparatus and methods
JP6848793B2 (ja) * 2017-09-28 2021-03-24 コニカミノルタ株式会社 超音波信号処理方法、及び超音波信号処理装置。

Patent Citations (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4463608A (en) * 1979-05-07 1984-08-07 Yokogawa Hokushin Electric Corp. Ultrasound imaging system
US4646754A (en) * 1985-02-19 1987-03-03 Seale Joseph B Non-invasive determination of mechanical characteristics in the body
US6005916A (en) * 1992-10-14 1999-12-21 Techniscan, Inc. Apparatus and method for imaging with wavefields using inverse scattering techniques
US5912826A (en) * 1994-12-24 1999-06-15 Cambridge Consultants Limited Data processing method and apparatus
US6122223A (en) * 1995-03-02 2000-09-19 Acuson Corporation Ultrasonic transmit waveform generator
US6104670A (en) * 1995-03-02 2000-08-15 Acuson Corporation Ultrasonic harmonic imaging system and method
US5793701A (en) * 1995-04-07 1998-08-11 Acuson Corporation Method and apparatus for coherent image formation
US5839442A (en) * 1995-06-29 1998-11-24 Teratech Corporation Portable ultrasound imaging system
US5964709A (en) * 1995-06-29 1999-10-12 Teratech Corporation Portable ultrasound imaging system
US5957846A (en) * 1995-06-29 1999-09-28 Teratech Corporation Portable ultrasound imaging system
US6248073B1 (en) * 1995-06-29 2001-06-19 Teratech Corporation Ultrasound scan conversion with spatial dithering
US20030028113A1 (en) * 1995-06-29 2003-02-06 Teratech Corporation Ultrasound scan conversion with spatial dithering
US5718229A (en) * 1996-05-30 1998-02-17 Advanced Technology Laboratories, Inc. Medical ultrasonic power motion imaging
US5830147A (en) * 1997-05-30 1998-11-03 Schepens Eye Research Institute, Inc. Method and apparatus for examining optic nerve head circulation
US20030216627A1 (en) * 1997-08-14 2003-11-20 Lorenz Alexander D. Measurement site dependent data preprocessing method for robust calibration and prediction
US5924991A (en) * 1997-08-22 1999-07-20 Acuson Corporation Ultrasonic system and method for harmonic imaging in three dimensions
US6511426B1 (en) * 1998-06-02 2003-01-28 Acuson Corporation Medical diagnostic ultrasound system and method for versatile processing
US6132375A (en) * 1999-03-31 2000-10-17 Acuson Corporation Medical ultrasonic system and method for synthetic aperture processing in elevation
US6682483B1 (en) * 1999-05-28 2004-01-27 Vuesonix Sensors, Inc. Device and method for mapping and tracking blood flow and determining parameters of blood flow
US20040267127A1 (en) * 1999-05-28 2004-12-30 Vuesonix Sensors, Inc. Transmitter patterns for multi beam reception
US6443894B1 (en) * 1999-09-29 2002-09-03 Acuson Corporation Medical diagnostic ultrasound system and method for mapping surface data for three dimensional imaging
US6409667B1 (en) * 2000-02-23 2002-06-25 Acuson Corporation Medical diagnostic ultrasound transducer system and method for harmonic imaging
US20030013965A1 (en) * 2001-04-19 2003-01-16 Quistgaard Jens U. Medical diagnostic ultrasound instrument wih ecg module, authorization mechanism and methods of use
US20030009102A1 (en) * 2001-04-19 2003-01-09 Sonosite, Inc. Medical diagnostic ultrasound instrument with ECG module, authorization mechanism and methods of use
US20040220474A1 (en) * 2002-03-20 2004-11-04 Kenneth Abend Determining the power of an ultrasound reflection using an autocorrelation technique
US20070123110A1 (en) * 2003-10-08 2007-05-31 Koninklijke Philips Electronics N.V. Ultrasonic volumetric imaging by coordination of acoustic sampling resolution, volumetric line density, and volume imaging rate
US20110125017A1 (en) * 2004-09-20 2011-05-26 Innervision Medical Technologies Inc. Systems and Methods for Ultrasound Imaging
US20060187462A1 (en) * 2005-01-21 2006-08-24 Vivek Srinivasan Methods and apparatus for optical coherence tomography scanning
US20070133878A1 (en) * 2005-12-14 2007-06-14 Porikli Fatih M Method for constructing covariance matrices from data features
US20080114253A1 (en) * 2006-11-10 2008-05-15 Penrith Corporation Transducer array imaging system
US20080114255A1 (en) * 2006-11-10 2008-05-15 Penrith Corporation Transducer array imaging system
US20070161904A1 (en) * 2006-11-10 2007-07-12 Penrith Corporation Transducer array imaging system
US20090306513A1 (en) * 2008-06-06 2009-12-10 Seshadri Srinivasan Multi-Plane/Multi-Slice Processing For 2-D Flow Imaging in Medical Diagnostic Ultrasound
US20100022884A1 (en) * 2008-07-28 2010-01-28 Siemens Medical Solutions Usa, Inc. Spectral doppler with multiple spatially distinct gates
US20150187052A1 (en) * 2012-06-18 2015-07-02 University Health Network Method and system for compressed sensing image reconstruction
US20150224346A1 (en) * 2012-09-14 2015-08-13 Isis Innovation Limited Passive ultrasound imaging with sparse transducer arrays
US20160157828A1 (en) * 2014-06-05 2016-06-09 Chikayoshi Sumi Beamforming method, measurement and imaging instruments, and communication instruments

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10371804B2 (en) 2014-10-07 2019-08-06 Butterfly Network, Inc. Ultrasound signal processing circuitry and related apparatus and methods
US11965993B2 (en) * 2015-06-04 2024-04-23 Chikayoshi Sumi Measurement and imaging instruments and beamforming method
US20210389439A1 (en) * 2015-06-04 2021-12-16 Chikayoshi Sumi Measurement and imaging instruments and beamforming method
US20170202541A1 (en) * 2016-01-15 2017-07-20 Butterfly Network, Inc. Ultrasound signal processing circuitry and related apparatus and methods
US10624613B2 (en) * 2016-01-15 2020-04-21 Butterfly Network, Inc. Ultrasound signal processing circuitry and related apparatus and methods
US11037330B2 (en) * 2017-04-08 2021-06-15 Intel Corporation Low rank matrix compression
US11620766B2 (en) 2017-04-08 2023-04-04 Intel Corporation Low rank matrix compression
US20180293758A1 (en) * 2017-04-08 2018-10-11 Intel Corporation Low rank matrix compression
US10755692B2 (en) 2017-06-19 2020-08-25 Butterfly Network, Inc. Mesh-based digital microbeamforming for ultrasound applications
US10972842B2 (en) 2017-06-23 2021-04-06 Butterfly Network, Inc. Differential ultrasonic transducer element for ultrasound devices
US11388524B2 (en) 2017-06-23 2022-07-12 Bfly Operations, Inc. Differential ultrasonic transducer element for ultrasound devices
TWI663397B (zh) * 2018-02-09 2019-06-21 大陸商業成科技（成都）有限公司 超聲波成像系統及方法
US11501562B2 (en) 2019-04-30 2022-11-15 Bfly Operations, Inc. Ultrasound face scanning and identification apparatuses and methods
US20200405266A1 (en) * 2019-06-25 2020-12-31 Butterfly Network, Inc. Methods and apparatuses for processing ultrasound signals
US11534135B2 (en) 2019-09-27 2022-12-27 Bfly Operations, Inc. Methods and apparatuses for monitoring fetal heartbeat and uterine contraction signals
US11808897B2 (en) 2020-10-05 2023-11-07 Bfly Operations, Inc. Methods and apparatuses for azimuthal summing of ultrasound data
WO2023060235A1 (fr) * 2021-10-08 2023-04-13 Deepsight Technology, Inc. Visualisation de balise ultrasonore avec des capteurs optiques

Also Published As

Publication number Publication date
EP3203917A4 (fr) 2018-09-26
CN106794009A (zh) 2017-05-31
AU2018222929A1 (en) 2018-09-20
JP6692804B2 (ja) 2020-05-13
KR20170067815A (ko) 2017-06-16
US20190154820A1 (en) 2019-05-23
TWI683121B (zh) 2020-01-21
WO2016057622A1 (fr) 2016-04-14
CA2962785A1 (fr) 2016-04-14
JP2017534358A (ja) 2017-11-24
AU2018222929B2 (en) 2020-09-10
US10371804B2 (en) 2019-08-06
TW201621348A (zh) 2016-06-16
EP3203917A1 (fr) 2017-08-16
AU2015328134A1 (en) 2017-03-09
KR102108616B1 (ko) 2020-05-07
AU2015328134B2 (en) 2018-08-02

Similar Documents

Publication Publication Date Title
US10371804B2 (en) Ultrasound signal processing circuitry and related apparatus and methods
US10624613B2 (en) Ultrasound signal processing circuitry and related apparatus and methods
AU2019201147B2 (en) Ultrasonic imaging compression methods and apparatus
Gao Efficient digital beamforming for medical ultrasound imaging

Legal Events

Date Code Title Description
AS Assignment

Owner name: BUTTERFLY NETWORK, INC., CONNECTICUT

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:RALSTON, TYLER S.;SANCHEZ, NEVADA J.;REEL/FRAME:042006/0813

Effective date: 20141007

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

AS Assignment

Owner name: BFLY OPERATIONS, INC., CONNECTICUT

Free format text: CHANGE OF NAME;ASSIGNOR:BUTTERFLY NETWORK, INC.;REEL/FRAME:058823/0737

Effective date: 20210212

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION