WO2020056500A1 - Ultrasonic analysis of a subject - Google Patents

Ultrasonic analysis of a subject Download PDF

Info

Publication number
WO2020056500A1
WO2020056500A1 PCT/CA2019/051314 CA2019051314W WO2020056500A1 WO 2020056500 A1 WO2020056500 A1 WO 2020056500A1 CA 2019051314 W CA2019051314 W CA 2019051314W WO 2020056500 A1 WO2020056500 A1 WO 2020056500A1
Authority
WO
WIPO (PCT)
Prior art keywords
subject
imaging parameter
function
representation
signals
Prior art date
Application number
PCT/CA2019/051314
Other languages
French (fr)
Inventor
Purang Abolmaesumi
Parvin Mousavi
Original Assignee
The University Of British Columbia
Queen's University At Kingston
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by The University Of British Columbia, Queen's University At Kingston filed Critical The University Of British Columbia
Priority to EP19863419.8A priority Critical patent/EP3853598B1/en
Priority to CA3112852A priority patent/CA3112852A1/en
Publication of WO2020056500A1 publication Critical patent/WO2020056500A1/en
Priority to US17/206,002 priority patent/US11131650B2/en

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N29/00—Investigating or analysing materials by the use of ultrasonic, sonic or infrasonic waves; Visualisation of the interior of objects by transmitting ultrasonic or sonic waves through the object
    • G01N29/04—Analysing solids
    • G01N29/043—Analysing solids in the interior, e.g. by shear waves
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N29/00—Investigating or analysing materials by the use of ultrasonic, sonic or infrasonic waves; Visualisation of the interior of objects by transmitting ultrasonic or sonic waves through the object
    • G01N29/04—Analysing solids
    • G01N29/12—Analysing solids by measuring frequency or resonance of acoustic waves
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08—Detecting organic movements or changes, e.g. tumours, cysts, swellings
    • A61B8/0833—Detecting organic movements or changes, e.g. tumours, cysts, swellings involving detecting or locating foreign bodies or organic structures
    • A61B8/085—Detecting organic movements or changes, e.g. tumours, cysts, swellings involving detecting or locating foreign bodies or organic structures for locating body or organic structures, e.g. tumours, calculi, blood vessels, nodules
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5207—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of raw data to produce diagnostic data, e.g. for generating an image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/54—Control of the diagnostic device
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N29/00—Investigating or analysing materials by the use of ultrasonic, sonic or infrasonic waves; Visualisation of the interior of objects by transmitting ultrasonic or sonic waves through the object
    • G01N29/04—Analysing solids
    • G01N29/06—Visualisation of the interior, e.g. acoustic microscopy
    • G01N29/0654—Imaging
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N29/00—Investigating or analysing materials by the use of ultrasonic, sonic or infrasonic waves; Visualisation of the interior of objects by transmitting ultrasonic or sonic waves through the object
    • G01N29/22—Details, e.g. general constructional or apparatus details
    • G01N29/221—Arrangements for directing or focusing the acoustical waves
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N29/00—Investigating or analysing materials by the use of ultrasonic, sonic or infrasonic waves; Visualisation of the interior of objects by transmitting ultrasonic or sonic waves through the object
    • G01N29/22—Details, e.g. general constructional or apparatus details
    • G01N29/24—Probes
    • G01N29/2456—Focusing probes
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N29/00—Investigating or analysing materials by the use of ultrasonic, sonic or infrasonic waves; Visualisation of the interior of objects by transmitting ultrasonic or sonic waves through the object
    • G01N29/36—Detecting the response signal, e.g. electronic circuits specially adapted therefor
    • G01N29/42—Detecting the response signal, e.g. electronic circuits specially adapted therefor by frequency filtering or by tuning to resonant frequency
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N29/00—Investigating or analysing materials by the use of ultrasonic, sonic or infrasonic waves; Visualisation of the interior of objects by transmitting ultrasonic or sonic waves through the object
    • G01N29/44—Processing the detected response signal, e.g. electronic circuits specially adapted therefor
    • G01N29/46—Processing the detected response signal, e.g. electronic circuits specially adapted therefor by spectral analysis, e.g. Fourier analysis or wavelet analysis
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/88—Sonar systems specially adapted for specific applications
    • G01S15/89—Sonar systems specially adapted for specific applications for mapping or imaging
    • G01S15/8906—Short-range imaging systems; Acoustic microscope systems using pulse-echo techniques
    • G01S15/8909—Short-range imaging systems; Acoustic microscope systems using pulse-echo techniques using a static transducer configuration
    • G01S15/8915—Short-range imaging systems; Acoustic microscope systems using pulse-echo techniques using a static transducer configuration using a transducer array
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/52017—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 particularly adapted to short-range imaging
    • G01S7/52019—Details of transmitters
    • G01S7/5202—Details of transmitters for pulse systems
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/52017—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 particularly adapted to short-range imaging
    • G01S7/52023—Details of receivers
    • G01S7/52036—Details of receivers using analysis of echo signal for target characterisation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461—Displaying means of special interest
    • A61B8/462—Displaying means of special interest characterised by constructional features of the display
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N2291/00—Indexing codes associated with group G01N29/00
    • G01N2291/01—Indexing codes associated with the measuring variable
    • G01N2291/015—Attenuation, scattering
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N2291/00—Indexing codes associated with group G01N29/00
    • G01N2291/02—Indexing codes associated with the analysed material
    • G01N2291/023—Solids
    • G01N2291/0231—Composite or layered materials
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N2291/00—Indexing codes associated with group G01N29/00
    • G01N2291/02—Indexing codes associated with the analysed material
    • G01N2291/028—Material parameters
    • G01N2291/02818—Density, viscosity
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N2291/00—Indexing codes associated with group G01N29/00
    • G01N2291/10—Number of transducers
    • G01N2291/101—Number of transducers one transducer

Definitions

  • Embodiments of this invention relate to nondestructive testing and more particularly to nondestructive testing using ultrasonic analysis of a subject.
  • NDT Nondestructive Testing
  • Some NDT techniques may involve using microscopy or analysis of a single ultrasound image.
  • such known NDT techniques may be difficult to set up and perform and/or may not perform well in detecting or characterizing subtle properties of the subjects, such as, for example where a change in or loss of signal caused by the property may be negligible.
  • a method of facilitating ultrasonic analysis of a subject involving producing signals for causing a set of outgoing ultrasonic signals to be transmitted to the subject, wherein the set of outgoing ultrasonic signals is defined at least in part by a variable imaging parameter that varies over time in accordance with a variable imaging parameter function, the variable imaging parameter function represented or representable at least in part by a function characteristic, receiving signals representing a time dependent representation of the subject generated from a set of received ultrasonic signals scattered by the subject, determining at least one property representation of the subject based on the function characteristic and the time dependent representation of the subject, and producing signals representing the at least one property representation of the subject to facilitate analysis of the subject.
  • the set of outgoing ultrasonic signals may be a temporally ordered set of outgoing ultrasonic signals and the variable imaging parameter may vary over the temporally ordered set of outgoing ultrasonic signals.
  • the set of outgoing ultrasonic signals may include at least one ultrasonic beam and producing the signals for causing the set of outgoing ultrasonic signals to be transmitted to the subject may involve producing signals for causing the at least one ultrasonic beam to be transmitted to the subject, the at least one ultrasonic beam defined at least in part by the variable imaging parameter.
  • the variable imaging parameter may be a focal depth of the at least one ultrasonic beam and producing the signals for causing the at least one ultrasonic beam to be transmitted to the subject may involve producing signals for causing the focal depth of the at least one ultrasonic beam to vary over time according to the variable imaging parameter function.
  • variable imaging parameter function may include a periodic function that varies over time at an imaging parameter frequency and the function characteristic may include the imaging parameter frequency.
  • the method may involve, for each of the one or more imaging parameter frequency components, applying at least one anomaly criterion to the imaging parameter frequency component to determine whether the imaging parameter frequency component indicates presence of an anomaly in the subject.
  • Applying the at least one anomaly criterion may involve determining whether the imaging parameter frequency component is outside of a predetermined normal range.
  • Producing the signals representing the at least one property representation of the subject may involve producing signals for causing at least one display to display a representation of the subject including indicators identifying the one or more imaging parameter frequency components determined to be outside of the predetermined normal range.
  • Producing the signals representing the at least one property representation of the subject may involve producing signals for causing at least one display to display a representation of the one or more imaging parameter frequency components.
  • the periodic function may be a first periodic function and the imaging parameter frequency may be a first imaging parameter frequency.
  • the set of outgoing ultrasonic signals may be a first set of outgoing ultrasonic signals
  • the variable imaging parameter may be a first variable imaging parameter
  • the variable imaging parameter function may be a first variable imaging parameter function
  • the function characteristic may be a first function characteristic.
  • the method may involve producing signals for causing a second set of outgoing ultrasonic signals to be transmitted to the subject, wherein the second set of outgoing ultrasonic signals is defined at least in part by a second variable imaging parameter that varies over time in accordance with a second variable imaging parameter function, the second variable imaging parameter function represented at least in part by a second function characteristic, and receiving signals representing a second time dependent representation of the subject generated from a second set of received ultrasonic signals scattered by the subject.
  • Determining the at least one property representation of the subject may involve determining the at least one property representation of the subject based on the first function characteristic, the second function characteristic, and the time dependent representation of the subject.
  • the subject may be a composite material.
  • a system for facilitating ultrasonic analysis of a subject comprising at least one processor configured to perform any of the above methods.
  • a non-transitory computer readable medium having stored thereon codes which when executed by at least one processor cause the at least one processor to perform any of the above methods.
  • Figure 1 is a schematic view of a system for facilitating ultrasonic analysis of a subject, according to various embodiments of the invention
  • FIG 2 is a schematic view of an analyzer of the system shown in Figure 1 including a processor circuit in accordance with various embodiments of the invention
  • Figure 3 is a flowchart depicting blocks of code for directing the analyzer of the system shown in Figure 1 to perform subject analysis functions in accordance with various embodiments of the invention
  • Figure 4 is a representation of an exemplary ultrasound instruction message that may be used in the system shown in Figure 1 in accordance with various embodiments of the invention
  • Figure 5 is a representation of an exemplary image record that may be used in the system shown in Figure 1 in accordance with various embodiments of the invention
  • Figure 6 is a flowchart depicting blocks of code that may be included in the flowchart shown in Figure 3 in accordance with various embodiments of the invention
  • Figure 7 is a representation of images that may be used in the system shown in Figure 1 in accordance with various embodiments of the invention.
  • FIG 8 is a flowchart depicting blocks of code that may be included in the flowchart shown in Figure 3 in accordance with various embodiments of the invention.
  • Figure 9 is a representation of an exemplary anomaly range record that may be used in the system shown in Figure 1 in accordance with various embodiments of the invention.
  • Figure 10 is a representation of an exemplary anomaly indicating image and an image that may be used in the system shown in Figure 1 in accordance with various embodiments of the invention
  • Figure 11 is a representation of how an image of the system may fit as a plane of voxels in a larger 3D representation in Figure 1 in accordance with various embodiments of the invention
  • Figure 12 is a representation of an exemplary ultrasound instruction message that may be used in the system shown in Figure 1 in accordance with various embodiments of the invention
  • Figure 13 is a representation of an exemplary ultrasound instruction message that may be used in the system shown in Figure 1 in accordance with various embodiments of the invention
  • Figure 14 is a representation of an exemplary ultrasound instruction message that may be used in the system shown in Figure 1 in accordance with various embodiments of the invention.
  • Figure 15 is a schematic view of a system for facilitating ultrasonic analysis of a subject, according to various embodiments of the invention.
  • FIG. 1 there is provided a schematic representation of a system 10 for facilitating ultrasonic analysis of a subject 12, in accordance with various embodiments described herein.
  • the system includes a computer-implemented analyzer 14 and an ultrasound machine 16 in communication with the analyzer 14.
  • the system 10 may also include a display 18 in communication with the analyzer 14.
  • the system 10 may facilitate ultrasonic analysis of materials or parts to allow detection of subtle defects in the materials, which may be difficult to detect using conventional NDT analysis.
  • the system 10 may facilitate ultrasonic analysis of advanced composite parts, such as parts made from fibre-reinforced composite materials, for example.
  • defects may include, for example, porosity, foreign object debris, impact-induced delamination, heat-induced resin degradation, and/or waviness of fibres or wrinkles in the fibres.
  • the system 10 may facilitate easier implementation of NDT without affecting workflow of a production factory and/or may provide improved detection of defects or properties of a subject, when compared to conventional NDT techniques.
  • a user of the system 10 may initiate ultrasonic analysis of the subject 12 through interaction with the analyzer 14.
  • the user may initiate ultrasonic analysis of the subject 12 during quality assurance testing of the subject 12.
  • the analyzer 14 may be configured to produce signals for causing a set of outgoing ultrasonic signals to be transmitted to the subject 12, wherein the transmitted ultrasonic signals are defined at least in part by a variable imaging parameter that varies over time in accordance with a variable imaging parameter function and the variable imaging parameter function is represented or representable at least in part by a function characteristic.
  • the set of outgoing ultrasonic signals may be a temporally ordered set of outgoing ultrasonic signals and the variable imaging parameter may vary over the temporally ordered set of outgoing ultrasonic signals.
  • varying at least one imaging parameter of the transmitted ultrasonic signals may result in a variation of the ultrasound point spread function used in the imaging system of the system 10.
  • Backscattered RF data sensed for a point x 0 in the imaging system may be defined by the following equation: where PSF(x 0 ) is an ultrasound point spread function at a point x 0 that is convolved with s(x 0 ) , the scattering function for the subject 12 at the same point, to generate /(x 0 , t) , and n represents random noise, A is the amplitude of a micro vibration at point x 0 or the amplitude of variation in the ultrasound point spread function at point x 0 , and w is the frequency of variation in the ultrasound point spread function at point x 0 .
  • the variable imaging parameter that defines the transmitted ultrasonic signals may be a focal depth of the transmitted signals and the analyzer 14 may cause the ultrasound machine 16 to transmit ultrasonic signals to the subject 12, via a transducer 20 of the ultrasound machine, that have a focal depth that varies over time according to a variable imaging parameter function or focal depth function.
  • the focal depth function may be periodic at a focal depth variation frequency and this frequency may act as a function characteristic of the focal depth function.
  • the analyzer 14 may store the focal depth variation frequency for use later during analysis or characterization of the subject 12.
  • the ultrasound machine 16 may cause the transducer 20 to transmit, based on the signals received from the analyzer 14, a set of ultrasonic signals to the subject 12 and receive a set of reflected ultrasonic signals scattered by the subject.
  • the ultrasound machine 16 may generate a time dependent representation of the subject 12 based on the received reflected ultrasonic signals and may send the time dependent representation to the analyzer 14.
  • the time dependent representation may include a temporally ordered set or sequence of image representations of the subject 12 representing the subject 12 over a time period. In some embodiments, this time dependent representation may be taken for a fixed location or volume in the subject 12, during that time period.
  • the analyzer 14 may receive signals representing the time dependent representation of the subject. For example, in some embodiments, the analyzer 14 may receive the sequence of image representations, from the ultrasound machine 16.
  • the analyzer 14 may then determine at least one property representation of the subject based on the function characteristic and the time dependent representation of the subject 12.
  • a representation of the subject 12 that would otherwise be difficult or impossible to discern may be determined.
  • the time dependent imaging parameter function may be a periodic focal depth function and the analyzer 14 may use the frequency of the focal depth function as the function characteristic to generate one or more images, acting as property representations of the subject 12, based on the frequency of the focal depth function and the time dependent representation of the subject 12.
  • determining the at least one property representation may involve applying a discrete Fourier transform (DFT) such as, for example, a fast Fourier transform, to the time dependent representation of the subject and choosing a component or filtering to determine the component of the result that corresponds to the frequency of the focal depth function.
  • DFT discrete Fourier transform
  • the time dependent representation of the subject may include a sequence of image representations of the subject as shown in Figure 2, and the analyzer 14 may apply an FFT to each sequence of values for each pixel location. The analyzer 14 may then, for each pixel location, choose the FFT component that corresponds to the frequency of the focal depth function and set that component as an imaging parameter frequency component.
  • determining the at least one property representation may involve the analyzer 14 generating an image representation of the determined imaging parameter frequency components. In some embodiments, determining the at least one property representation may involve the analyzer 14 applying at least one anomaly criterion to each of the determined imaging parameter frequency components to determine whether each respective one of the imaging parameter frequency components indicates presence of an anomaly in the subject 12
  • the analyzer 14 may then produce signals representing the at least one property representation of the subject to facilitate analysis of the subject.
  • the analyzer may produce signals for causing the display 18 to display a representation of the image representation of the one or more imaging parameter frequency components and/or an image representation of the results of the application of the at least one anomaly criterion.
  • varying an imaging parameter in the ultrasonic signal and knowing of a function characteristic of the variable imaging parameter may allow the analyzer 14 to derive properties of the subject 12 and provide analysis that otherwise would not be possible.
  • the properties may be derived by applying a function to the time dependent representation of the subject 12 wherein the function is defined by the function characteristic or is specific based on the function characteristic.
  • use of such a particularized property determining function may facilitate generating a representation of the subject 12 that makes properties of the subject 12 discernible, which would otherwise be difficult or impossible to discern using non- destructive testing.
  • the analyzer 14 includes a processor circuit including an analyzer processor 100 and a program memory 102, a storage memory 104, and an input/output (I/O) interface 112, all of which are in communication with the analyzer processor 100.
  • the analyzer processor 100 may include one or more processing units, such as for example, a central processing unit (CPU), a graphical processing unit (GPU), and/or a field programmable gate array (FPGA).
  • CPU central processing unit
  • GPU graphical processing unit
  • FPGA field programmable gate array
  • any or all of the functionality of the analyzer 14 described herein may be implemented using one or more FPGAs.
  • the I/O interface 112 includes an interface 120 for communicating with the ultrasound machine 16 and an interface 130 for communicating with the display 18. In some embodiments, any of the interfaces 120 or 130 may facilitate wireless or wired communication. In some embodiments, the I/O interface 120 may include an ethernet interface for connecting to the ultrasound machine 16. In some embodiments, the I/O interface 130 may include an HDMI or another multimedia interface.
  • each of the interfaces may include one or more interfaces and/or some or all of the interfaces included in the I/O interface 112 may be implemented as combined interfaces or a single interface.
  • a device receives signals representing the information via an interface of the device or produces signals representing the information and transmits the signals to the other device via an interface of the device.
  • Processor-executable program codes for directing the analyzer processor 100 to carry out various functions are stored in the program memory 102.
  • the program memory 102 includes a block of codes 160 for directing the analyzer 14 to perform subject analysis functions.
  • certain encoded entities such as applications or modules perform certain functions.
  • at least one processor e.g., the analyzer processor 100
  • the analyzer processor 100 is directed to take the action by way of programmable codes or processor-executable codes or instructions defining or forming part of the application.
  • the storage memory 104 includes a plurality of storage locations including location 140 for storing ultrasonic signal definition information, location 142 for storing time dependent representation of the subject 12 information, location 144 for storing pixel specific time dependent information, location 146 for storing discrete Fourier transform (DFT) result information, location 148 for storing frequency specific DFT component information, location 150 for storing anomaly criteria information, location 152 for storing anomaly representation data, and location 154 for storing frequency component differentiator data.
  • the plurality of storage locations may be stored in a database in the storage memory 104.
  • the blocks of codes included in the program memory 102 may be integrated into a single block of codes and/or may include one or more blocks of code stored in one or more separate locations in program memory 102. In various embodiments, any or all of the locations in the storage memory 104 may be integrated and/or each may include one or more separate locations in the storage memory 104.
  • each of the program memory 102 and/or the storage memory 104 may be implemented as one or more storage devices including, for example, random access memory (RAM), a hard disk drive (HDD), a solid-state drive (SSD), a network drive, flash memory, a memory stick or card, any other form of non-transitory computer-readable memory or storage medium, and/or a combination thereof.
  • RAM random access memory
  • HDD hard disk drive
  • SSD solid-state drive
  • network drive flash memory
  • flash memory stick or card any other form of non-transitory computer-readable memory or storage medium, and/or a combination thereof.
  • the program memory 102, the storage memory 104, and/or any portion thereof may be included in a device separate from the analyzer 14 and in communication with the analyzer 14 via a network interface included in the I/O interface 112, for example.
  • FIG. 3 a flowchart depicting blocks of code for directing the analyzer processor 100 shown in Figure 2 to perform subject analysis functions in accordance with various embodiments is shown generally at 200.
  • the blocks of code included in the flowchart 200 may be included in the block of codes 160 of the program memory 102 shown in Figure 2, for example.
  • execution of the flowchart 200 by the analyzer processor 100 may be initiated when a user or users of the analyzer 14 wishes to analyze or characterize the subject 12 or a similar subject, for example, to perform non- destructive testing.
  • the display 18 shown in Figure 1 may include a touch interface and the user may interact with the display 18 to initiate execution of the flowchart 200.
  • the results of the analysis may be used to determine whether the subject 12 is viable for use in an intended application and/or to determine the composition of the subject 12.
  • the subject 12 may be an advanced composite part, which may, for example, include a composite material having fibres and in some embodiments, the results of the analysis may be used to identify anomalies or defects, such as, for example, waviness of the fibres or wrinkles in the fibres, and thereby determine whether the subject 12 may be used in an aerospace application, for example. Accordingly, in various embodiments, the flowchart 200 may be initiated during quality assurance testing of the subject 12. In various embodiments, the subject 12 may be submerged in a water bath container on a table during analysis.
  • the flowchart 200 begins with block 202 which directs the analyzer processor 100 to produce signals for causing a set of outgoing ultrasonic signals to be transmitted to the subject, wherein the set of outgoing ultrasonic signals are defined at least in part by a variable imaging parameter that varies over time in accordance with a variable imaging parameter function, the variable imaging parameter function represented or representable at least in part by a function characteristic.
  • the set of outgoing ultrasonic signals may be a temporally ordered set of outgoing ultrasonic signals and the variable imaging parameter may vary over the temporally ordered set of outgoing ultrasonic signals.
  • the set of outgoing ultrasonic signals may include at least one ultrasonic beam and block 202 may direct the analyzer processor 100 to produce signals for causing the at least one ultrasonic beam to be transmitted to the subject, the at least one ultrasonic beam defined at least in part by the variable imaging parameter.
  • variable imaging parameter may be a focal depth and block 202 may direct the analyzer processor 100 to transmit to the ultrasound machine 16 shown in Figure 1 , an ultrasound instruction message, a portion of which is shown at 240 in Figure 4, which may in some embodiments represent computer code, such as, for example C code, for directing the ultrasound machine to cause the transducer 20 to transmit ultrasonic signals to the subject such that the ultrasonic signals have a focal depth that varies over time according to a focal depth function.
  • the ultrasound machine 16 may include an ultrasound machine with a 1-D linear array transducer with 128 elements.
  • the ultrasound instruction message 240 includes a focal depth or focal distance function definition 242 that defines a focal depth or focal distance in microns as a function of an index number“i”.
  • the ultrasound machine 16 may be configured to transmit a temporally ordered set or sequence of ultrasonic signals indexed by the index number“i” to the subject 12 such that a sequence of images or frames having corresponding indices and representing the reflected or scattered signals can be generated.
  • the frame rate may be set at a frequency, such as for example, 730 frames per second, and the total number of ultrasonic signals or indices may be set to 128, for example.
  • a frame rate of about 730 frames per second may facilitate imaging the subject quickly in a short time period.
  • capturing 128 frames may allow later analysis, such as analysis using an FFT to be performed accurately.
  • the focal depth function definition 242 being a function of i will result in the focal depth function being a function of time.
  • the focal depth function definition 242 of the ultrasound instruction message 240 may be defined in part by respective values stored in a mean focal depth field 244, an amplitude field 246, and a focal depth frequency field 248 included in the ultrasound instruction message.
  • the mean focal depth field 244 and the amplitude field 246 may have been previously set, for example, by a user of the analyzer 14.
  • the mean focal depth field 244 may be set to a depth that is in the center of the subject 12 being analyzed, which may facilitate more accurate characterization of the subject.
  • the subject 12 may have a total depth of about 4 cm or 40000 microns and so the mean focal depth field 244 may have been previously set to 20000 microns.
  • the imaging depth for imaging the subject 12 may be set such that a reasonably high resolution for imaging is achieved. For example, for a 5 MFIz transducer, 4 cm depth may be reasonable. In some embodiments, lower than that like 1 cm, for example, may degrade beamforming quality and much higher than that like 10 cm, for example, may reduce the imaging resolution. In various embodiments, the subject 12 may be placed generally at the mean focal depth and in various embodiments, a typical focal depth may be about 1 cm to 3 cm for a 4 cm imaging depth.
  • the value of the focal depth frequency field 248 of the ultrasound instruction message 240 may have also been previously set, for example, by a user of the analyzer 14.
  • the focal depth frequency field 248 may be chosen such that the focal depth function definition 242 completes 1 period within a sample time period.
  • this may result in a frequency of the focal depth function of about 5.7 Hz, hence with 128 frames, one cycle of the sinusoid may be sampled fairly densely and this may facilitate reliably reconstructing the amplitude of the sinusoid.
  • the focal depth frequency field 248 may be set to a value such that each period is sampled at about 4 times the Nyquist rate given the imaging frame rate to facilitate reliable reconstruction of the signal in a noisy environment.
  • the value stored in the focal depth frequency field 248 may act as an imaging parameter frequency and a function characteristic for the focal depth function defined by the focal depth function definition 242.
  • the ultrasound instruction message 240 may have been previously stored in the location 140 of the storage memory 104 and block 202 may direct the analyzer processor 100 to retrieve the ultrasound instruction message 240 from the location 140 of the storage memory 104 and to send a representation of the ultrasound instruction message 240 to the ultrasound machine 16 via the interface 120 of the I/O interface 112 shown in Figure 2.
  • the ultrasound machine 16 may cause the transducer 20 to transmit a plurality of outgoing ultrasonic signals to the subject based on the ultrasound instruction message 240.
  • the transducer 20 then receives reflections of each of the transmitted ultrasonic signals from the subject 12 and the ultrasound machine 16 generates respective images, each representing a reflection of one of the transmitted signals and so corresponding to an index or frame number.
  • the ultrasound machine 16 may transmit the sequence of 128 images, each associated with a respective index number representing time, to the analyzer 14, for analysis.
  • the ultrasound machine 16 may generate and transmit to the analyzer 14 respective image records, an exemplary one of which is shown at 280 in Figure 5.
  • the image record 280 includes an index field 282 for storing an index value representing a time at which the image was taken and an image field 284 for storing an image representation of the reflected ultrasonic signals received at the transducer 20.
  • the image information stored in the image field 284 may include a plurality of pixel positions, each associated with a pixel value, wherein the pixel value represents an echo intensity which may represent a change in density, speed of sound and/or acoustic impedance of the subject at the pixel location.
  • the image information may represent an 8-12 bit image and the pixel values may each be within a range of 0-255 or 0-4095, for example.
  • block 204 directs the analyzer processor 100 to receive signals representing a time dependent representation of the subject generated from a set of received ultrasonic signal scattered by the subject.
  • block 204 may direct the analyzer processor 100 to receive a set of 128 image records, each having the same format as the image record 280 shown in Figure 5, from the ultrasound machine 16 via the interface 120 of the I/O interface 112 shown in Figure 2.
  • Block 204 may direct the analyzer processor 100 to store the received image records in the location 142 of the storage memory 104 shown in Figure 2.
  • the received image records may act as a temporally ordered set of image representations of the subject 12.
  • Block 206 then directs the analyzer processor 100 to determine at least one property representation of the subject 12 based on the function characteristic and the time dependent representation of the subject.
  • block 206 may direct the analyzer processor 100 to retrieve the set of image records including the image record 280, together acting as a time dependent representation of the received ultrasonic signals, received at block 204 from the location 142 of storage memory 104 and to retrieve the focal depth frequency value stored in the focal depth frequency field 248, acting as a function characteristic, from the location 140 of the storage memory 104.
  • Block 206 may then direct the analyzer processor 100 to determine at least one property representation of the subject based on the set of image records and the focal depth frequency value.
  • FIG. 6 there is shown a flowchart 290 depicting blocks of code for directing the analyzer processor 100 shown in Figure 2 to perform subject property determining functions in accordance with various embodiments.
  • the blocks of code included in the flowchart 290 may be included in the block 206 of the flowchart 200 shown in Figure 5.
  • the flowchart 290 begins with block 292 which directs the analyzer processor 100 to identify a sequence of pixel values for a pixel position in the set of images included in the set of image records stored at the location 142 of the storage memory 104.
  • block 292 may direct the analyzer processor 100 to read the pixel values for position (0,0) in each image of the set of images and generate a pixel value sequence vector, representing the pixel values for position (0,0).
  • Block 292 may direct the analyzer processor 100 to store the pixel value sequence vector in the location 144 of the storage memory 104.
  • Figure 7 shows a representation of images 300 that may be included in the image records stored in the location 142 of the storage memory 104, in accordance with various embodiments.
  • Figure 7 shows a representative pixel 302 at a particular position in the images 300, which may correspond to a particular position or location in the subject 12.
  • Figure 7 shows how the pixel value representing echo intensity or material density 304 associated with the pixel 302 changes over time.
  • Block 292 may direct the analyzer processor 100 to generate and store in the location 144 of the storage memory 104, a pixel value sequence vector representing an echo intensity over time for the first pixel position (0,0).
  • Block 294 then directs the analyzer processor 100 to apply a discrete Fourier transform (DFT) to the pixel value sequence vector generated at block 292.
  • block 294 may direct the analyzer processor 100 to apply a DFT normalized to the frame rate of image acquisition and generate a DFT vector from the application of the DFT, the DFT vector including absolute value components of the computed DFT, each of the absolute value components associated with a frequency.
  • Block 294 may direct the analyzer processor 100 to store the DFT vector in the location 146 of the storage memory 104 shown in Figure 1.
  • block 294 may direct the analyzer processor 100 to apply a fast Fourier Transform (FFT) to the pixel value sequence vector generated at block 292 to generate the DFT vector.
  • FFT fast Fourier Transform
  • block 296 then directs the analyzer processor 100 to identify from the result of the DFT, a component that is associated with the focal depth frequency value stored in the focal depth frequency field 248 of the ultrasound instruction message 240 shown in Figure 4.
  • the identified component may act as an imaging parameter frequency component since it may be associated with the frequency at which the imaging parameter (i.e. , the focal depth in some embodiments) varies.
  • block 296 may direct the analyzer processor 100 to identify a component or value from the DFT vector stored in the location 146 of the storage memory 104 as associated with the focal depth frequency.
  • Block 298 then directs the analyzer processor 100 to associate the identified component with the pixel position being considered.
  • block 298 may direct the analyzer processor 100 to generate a frequency component image and to set a pixel position of the frequency component image corresponding to the pixel position that was considered at block 292 to the component or value identified at block 296 of the flowchart 290.
  • Block 298 may direct the analyzer processor 100 to store the frequency component image in the location 148 of the storage memory 104.
  • block 298 may direct the analyzer processor 100 to modify the frequency component image previously generated and stored in the location 148 of the storage memory 104 to include further pixel values at respective considered pixel positions.
  • the analyzer processor 100 may be directed to return to block 292 and to consider another pixel position.
  • blocks 292 to 298 may be repeated for each pixel position included in the images stored in the location 144 of the storage memory 104.
  • the frequency component image stored in the location 148 of the storage memory 104 and each of the pixel values included therein may act as a representation of features or properties of the subject 12.
  • deviation of pixel values from a mean pixel value may represent an anomaly or probability of an anomaly in the subject 12 at a particular location in the subject.
  • the frequency component image may be visualized as a color map, which shows the imaging parameter frequency component for each pixel position.
  • block 206 may direct the analyzer processor 100 to, for each of the imaging parameter frequency components determined, apply anomaly criteria to the determined component to determine whether the imaging parameter frequency component indicates presence of an anomaly in the subject 12.
  • FIG 8 there is shown a flowchart 340 depicting blocks of code for directing the analyzer processor 100 shown in Figure 2 to perform anomaly detection functions in accordance with various embodiments.
  • the blocks of code included in the flowchart 340 may be included in the block 206 of the flowchart 200 shown in Figure 3 and may be executed after the blocks of code included in the flowchart 290 shown in Figure 6 have been executed.
  • the flowchart 340 begins with block 342 which directs the analyzer processor 100 to identify an imaging parameter frequency component associated with a particular pixel position.
  • block 342 may direct the analyzer processor 100 to read the frequency component image from the location 148 of the storage memory 104 and to identify a first imaging parameter frequency component of the frequency component image associated with a first pixel position in the frequency component image.
  • Block 344 then directs the analyzer processor 100 to apply at least one anomaly criterion to the identified imaging parameter frequency component to determine whether the imaging parameter frequency component indicates presence of an anomaly in the subject.
  • expected values for the imaging parameter frequency components may be within a predetermined normal range and so block 344 may direct the analyzer processor 100 to determine whether the imaging parameter frequency component is outside of a predetermined normal range.
  • an anomaly range record 360 shown in Figure 9 may have been previously determined or provided and may be stored in the location 150 of the storage memory 104.
  • the anomaly range record 360 includes a minimum field 362 and a maximum field 364 for storing values defining the predetermined normal range.
  • Block 344 may direct the analyzer processor 100 to compare the first imaging parameter frequency component to the values from the minimum and maximum fields 362 and 364 of the anomaly range record 360 and to determine whether the first imaging parameter frequency component is less than the value stored in the minimum field 362 or greater than the value stored in the maximum field 364. In some embodiments, there may be no minimum value and so the minimum field 362 may be omitted.
  • block 344 may direct the analyzer processor 100 to determine whether the first imaging parameter frequency component is greater than the value stored in the maximum field 364.
  • the minimum and maximum values may have been previously determined by scanning one or more samples similar to the subject 12 but without anomalies and determining a range of pixel values for frequency component images generated from the samples.
  • the analyzer processor is directed to block 346. For example, if at block 344 it is determined that the first imaging parameter frequency component is greater than the value stored in the maximum field 364, block 344 may direct the analyzer processor 100 to proceed to block 346.
  • Block 346 directs the analyzer processor 100 to associate the pixel position with an anomaly indicator.
  • block 346 may direct the analyzer processor 100 to set the pixel position identified at block 342 of an anomaly indicating image to an anomaly indicator value.
  • the anomaly indicating image may be stored in the location 152 of the storage memory 104.
  • block 346 may direct the analyzer processor 100 to set the pixel position to an anomaly indicator value that represents an indicator color, such as, for example, red.
  • an indicator color such as, for example, red.
  • the analyzer processor is directed to block 348. For example, if at block 344 it is determined that the first imaging parameter frequency component is less than the value stored in the maximum field 364 and greater than the value stored in the minimum field 362, block 344 may direct the analyzer processor 100 to proceed to block 348.
  • Block 348 may direct the analyzer processor 100 to associate the pixel position with a value that indicates that there is not an anomaly at the pixel position. In some embodiments, block 348 may direct the analyzer processor 100 to associate the pixel position with a value that represents the color blue, for example.
  • blocks 342, 344, and 346 or 348 may be executed for each pixel position in the frequency component image until a complete anomaly indicating image is stored in the location 152 of the storage memory 104.
  • the anomaly indicating image 380 includes a region of anomaly which is indicated by the color red (represented in Figure 10 by vertical line hatching), and a normal region which is indicated by the color blue (represented in Figure 10 by horizontal line hatching).
  • the anomaly indicating image 380 stored in the location 152 of the storage memory 104 and each of the pixel values included in the anomaly indicating image may act as representations of features or properties of the subject 12.
  • block 206 may direct the analyzer processor 100 to determine a representative value from the frequency component image stored in the location 148 of the storage memory 104. For example, in some embodiments block 206 may direct the analyzer processor 100 to determine a median pixel value from the frequency component image and to store the median pixel value in the location 148 of the storage memory 104. In various embodiments, the median pixel value may be representative of a level of porosity in the subject 12. For example, in some embodiments, as the median pixel value increases, this may indicate a higher porosity of the subject 12.
  • blocks 202, 204, and 206 of the flowchart 200 may be executed for a plurality of positions on the subject 12, such that the 3-dimensional subject 12 may be characterized at a plurality of planes.
  • the system 10 may include a Y-Z stage and the analyzer 14 may be configured to execute blocks 202, 204, and 206 of the flowchart 200 shown in Figure 3 in a first Z position. The system 10 may then move the subject 12 using the Y-Z stage relative to the transducer 20 and then the analyzer 14 may execute blocks 202, 204, and 206 in the next Z-position.
  • the subject 12 may move about 1 mm at a time.
  • the entire movement procedure may be automated such that the subject 12 moves with increments of 1 mm representing a 1 mm scanning resolution across the entire subject.
  • the pixels discussed herein may act as a plane of voxels in a larger 3D representation of the subject.
  • Figure 11 shows how an image 390 included in the image records stored in the location 142 of the storage memory 104 may fit as a plane of voxels within a 3D representation 392 of properties of the subject 12.
  • the frequency component images stored in the location 148 of the storage memory 104 and/or the anomaly indicating images stored in the location 152 of the storage memory 104 may similarly together form respective 3D representations of properties of the subject 12
  • the ultrasound image data stored in the location 142 may be collected in various ways.
  • the ultrasound image data stored in the location 142 of the storage memory 104 may be collected over equally-sized Regions of Interests (ROI), where the width of each ROI is the half of the probe width (e.g., 1.9 cm) and its depth is equal to the sample’s thickness.
  • ROI Regions of Interests
  • analysis may be performed for 2 ROIs that cover the entire cross section of the subject 12.
  • block 208 directs the analyzer processor 100 to produce signals representing the at least one property representation determined at block 206 to facilitate analysis of the subject 12.
  • block 208 may direct the analyzer processor 100 to produce signals representing one or more of the frequency component images stored in the location 148 for causing the display 18 shown in Figure 1 to display a representation of the frequency component images.
  • a 3D representation of the frequency component images may be displayed.
  • a user or quality assurance specialist viewing the display 18 may be able to use the display 18 showing the frequency component images to determine whether the subject 12 can be used for a desired application.
  • the user may determine that the frequency component images include too many high and/or low pixel values that are different from an average or normal pixel value and that therefore the subject 12 has too many imperfections or too high of a porosity to be used in the intended application.
  • block 208 may direct the analyzer processor 100 to produce signals representing the median pixel value stored in the location 148 of the storage memory 104 for one or more of the frequency component images, for causing the display 18 shown in Figure 1 to display a representation of the median pixel value.
  • a user or quality assurance specialist viewing the display 18 may be able to use the display 18 showing the median pixel values to determine whether the subject 12 can be used for a desired application. For example, in various embodiments, the user may determine that the median pixel values are too high or too low and therefore has too many imperfections or too high of a level of porosity for the intended application.
  • block 208 may direct the analyzer processor 100 to produce signals representing one or more of the anomaly indicating images stored in the location 152 for causing the display 18 to display a representation of the one or more anomaly indicating images.
  • block 208 may direct the analyzer processor 100 to produce signals representing a plurality of anomaly indicating images such that a 3D view or a top down view of one or more cross sections taken at a pixel position on the x axis may be displayed by the display 18.
  • a user or quality assurance specialist viewing the display 18 may be able to use the display 18 showing the anomaly indicating images to determine whether the subject 12 can be used for a desired application.
  • the user may determine that the anomaly indicating image includes too many pixel positions that are associated with anomaly indicator values and that therefore the subject 12 has too many imperfections to be used in an aerospace application.
  • variable imaging parameter function may be representable by more than one function characteristic, which may be used to determine the at least one property representation of the subject 12.
  • a focal depth function may be used that includes more than one periodic function, each having a different frequency.
  • an ultrasound instruction message 400 as shown in Figure 12 may be stored in the location 140 of the storage memory 104 and used generally as described above having regard to the ultrasound instruction message 240 shown in Figure 4.
  • the ultrasound instruction message 400 includes a focal depth function definition 402 that includes more than one periodic function, such that the focal depth of the ultrasonic signals transmitted to the subject 12 by the ultrasound machine 16 may vary according to more than one periodic function.
  • the focal depth function definition 402 may define a focal depth as follows:
  • Focal depth (in microns ) D + A sin(2 nf i) + B sin(2 p/ 2 i) where i is the frame index number for each transmitted ultrasonic signal.
  • the focal depth function may include a first periodic function A * sin(2pi * fi * i) where fi is a first focal depth frequency and a second periodic function B * sin(2pi * f2 * i) where f2 is a second focal depth frequency, wherein f2 is different from fi.
  • the values for fi and f2 may each act as respective function characteristics for the focal depth function.
  • block 296 of the flowchart 290 shown in Figure 6 may direct the analyzer processor 100 to identify first and second frequency components of the DFT result, the first and second frequency components associated with the first and second focal depth frequencies.
  • block 298 of the flowchart 290 shown in Figure 6 may direct the analyzer processor 100 to determine a difference between the first and second frequency components and to associate the pixel position with the difference between the identified first and second frequency components.
  • Block 298 may, for example, direct the analyzer processor 100 to generate a frequency component differentiator image which includes a representation of the difference between frequency component values associated with each pixel position.
  • the generated frequency component differentiator image may act as a property representation of the subject.
  • imaging parameters and imaging parameter functions may be utilized generally as described herein regarding the focal depth acting as an imaging parameter and the focal depth function acting as an imaging parameter function defining how the focal depth varies over time.
  • imaging parameters that may be treated generally as described herein regarding the focal depth may include focal depth, f-number, apodization window, time gain compensation (TGC), dynamic range, number of active elements, centre frequency of the transducer, shape of the transmitted signal, direction of the transmitted signal (which may be changed using beam steering, for example), length of the transmitted signal, and/or another imaging parameter that affects the point spread function of the imaging system.
  • TGC time gain compensation
  • an ultrasound instruction message 420 as shown in Figure 13 may be stored in the location 140 of the storage memory 104 and used generally as described above having regard to the ultrasound instruction message 240 shown in Figure 4, except the ultrasound instruction message 420 may cause the ultrasound machine 16 to vary a centre frequency of the transmitted signals based on the ultrasound instruction message 420.
  • the ultrasound instruction message 420 includes a centre frequency function definition 422 for defining the centre frequency in Hz of the ultrasonic signals to be transmitted to the subject 12 by the ultrasound machine 16, such that the centre frequency may vary according to the centre frequency function definition 422.
  • the centre frequency function may be used on its own generally as described above for the focal depth function. However, in other embodiments, the centre frequency function may be used in conjunction with varying of another imaging parameter, such as, for example, the focal depth. Accordingly, in various embodiments, the flowcharts 200 and 290 shown in Figures 3 and 6 may be executed first as described above using the ultrasound instruction message 240 shown in Figure 5 and then the flowcharts 200 and 290 may be executed generally as described above but using the ultrasound instruction message 420 shown in Figure 13.
  • a focal depth frequency component image and a centre frequency component image for the same planar position in the subject 12 may thus be stored in the location 148 of the storage memory 104.
  • block 206 may direct the analyzer processor 100 to determine, for each pixel position in the images stored in the location 148 of the storage memory 104, a difference between the pixel values of the focal depth frequency component image and the centre frequency component image.
  • Block 206 may direct the analyzer processor 100 to generate and store a differentiator image representing the differences in pixel values at each pixel position.
  • the differentiator image may be stored in the location 154 of the storage memory 104, for example.
  • block 208 may direct the analyzer processor 100 to produce signals representing the differentiator image stored in the location 154 for causing the display 18 to display a representation of the differentiator image.
  • a user viewing the differentiator image may be able to determine properties of the subject 12 in view of the differentiator image.
  • the user may be able to determine a material type from the displayed differentiator image.
  • a differentiator image may be generated as described above, but using two different functions for the same imaging parameter.
  • an ultrasound instruction message 440 as shown in Figure 14 may be used as described above instead of the ultrasound instruction message 420 shown in Figure 13.
  • block 208 of the flowchart 200 shown in Figure 3 may direct the analyzer processor 100 to produce signals representing the at least one property representation of the subject to facilitate analysis of the subject 12 using a neural network.
  • block 208 may direct the analyzer processor 100 to use the frequency component images and/or the anomaly indicating images stored in the location 148 of the storage memory 104 as inputs into a neural network for analyzing the images.
  • block 208 of the flowchart 200 shown in Figure 3 may direct the analyzer processor 100 to transmit signals representing the at least one property representation of the subject to facilitate analysis at another computer of the subject 12.
  • the I/O interface 112 may include a network interface and block 208 may direct the analyzer processor 100 to transmit representations of frequency component images and/or the anomaly indicating images stored in the location 148 of the storage memory 104 to another computer via the network interface to facilitate analysis at the other computer.
  • the ultrasound machine 16 may include 3D transducers or circular, array transducers which may not require any motion to scan in 3D. In some embodiments, the ultrasound machine 16 may include more than one transducer, such as, for example, one sending a signal from one side and one receiving a signal from the other side.
  • imaging parameter functions or focal depth functions may be used.
  • a focal depth function that is not periodic may be used.
  • block 206 of the flowchart 200 shown in Figure 3 may direct the analyzer processor 100 to, instead of applying the DFT, convolve the focal depth function with the time dependent subject representation (e.g., by convolving the focal depth function with the pixel value sequence vectors) to determine convolution values that may be included in a convolution image which may be treated generally similarly to the frequency component image described herein.
  • the shape of the focal depth function may include any varying function, such as, for example, a step or a triangle, or a sequence of pulses of varying length or amplitude, or another varying function, such as, for example a function that includes randomly varying elements.
  • the focal depth function may result in a sequence of ultrasonic or transmit signals being produced that vary the focal point sinusoidally according to an index or time value.
  • the order of firing or transmitting of that sequence of signals to the subject 12 may be scrambled randomly in time, as each backscattered data frame may be considered independent of the subsequent data frame.
  • block 206 may direct the analyzer processor 100 to first re-sort the received image frames and then to perform an analysis generally as described herein. While various embodiments described herein have been described in connection with the subject 12 being made of a composite material, in various embodiments, the system 10 may facilitate ultrasonic characterization of other subjects for which accurate characterization is required.
  • the system 10 may be configured to facilitate ultrasonic characterization in biomedical applications, such as for in vivo and ex vivo characterization of biological material, such as, for example, for tissue or organ analysis.
  • the system 10 may be used to detect cancer, such as, for example prostate cancer and/or breast cancer.
  • block 206 may direct the analyzer processor 100 to more generally apply a band-pass filter to the time dependent representation of the subject 12 received at block 204, wherein the band-pass filter is configured to pass the focal depth frequency.
  • block 206 may process the time dependent representation of the subject 12 using additional or alternative analyses compared to the DFT described above, which may be based on time, frequency, amplitude, statistical, stochastic or a combination thereof.
  • block 206 may direct the analyzer processor 100 to use a band- pass filter such as a finite impulse response (FIR) filter to filter the time dependent representation, and to use a property of the filtered result, such as the power of the filtered result or its amplitude, for example, to facilitate ultrasonic analysis of a subject.
  • FIR finite impulse response
  • the power of the filtered result or its amplitude may act as a representation of at least one property of the subject 12.
  • the design of the FIR filter may be informed from the variable imaging parameter function.
  • the FIR filter may have a passband centered around a frequency of the variable imaging parameter function. For example, if the focal depth variation frequency is 10 Hz, then the FIR filter may be implemented as a 10 Hz bandpass filter.
  • block 206 of the flowchart 200 shown in Figure 3 may direct the analyzer processor 100 to input the time dependent representation of the subject 12 and the function characteristic into a neural network, the neural network having been trained/configured to determine whether the subject 12 has a defect based on the input time dependent representation of the subject 12 and the function characteristic.
  • the neural network may act as a classifier and may output a determined probability or likelihood that there is a defect in the subject 12. In such embodiments, the determined probability that there is a defect in the subject 12 may act as the at least one property representation of the subject.
  • block 208 may then direct the analyzer processor 100 to, if it is determined by the neural network that the subject has a high probability of a defect (e.g., by determining whether the probability of a defect is higher than a threshold probability), produce signals for causing an alert to be provided for a user of the analyzer 14.
  • block 208 may direct the analyzer processor 100 to, produce signals for causing the display 18 to provide an alert noting that the subject 12 likely has a defect.
  • block 206 may direct the analyzer processor 100 to use a deep neural network that is trained to perform DFT and perform an analysis on the result. In some embodiments, block 206 may direct the analyzer processor 100 to use a neural network that is trained to extract a specific frequency component (corresponding to the focal depth frequency, for example) from each of the pixel value sequences without needing to use a full DFT calculation for all frequency components. While the system 10 shown in Figure 1 includes the ultrasound machine 16 which is shown pictorially as a standard cart-based ultrasound machine, in various embodiments, the system 10 may be implemented in alternative environments, such as, for example, in an assembly line or in a hand held device for use in the field.
  • a system 460 shown in Figure 15 that functions generally similarly to the system 10 described herein and shown in Figure 1 may include an ultrasound machine 462 that incorporates an analyzer within the ultrasound machine 462, the analyzer having generally similar functionality to the analyzer 14 described herein.
  • a single processor circuit included in the ultrasound 462 may implement functionality of both the ultrasound machine 16 and the analyzer 14 described herein.
  • a display 464 of the system 460 may be used generally as described above regarding the display 18 of the system 10 shown in Figure 1.
  • any or all of the ultrasound machine 16, transducer 20, analyzer 14 and/or display 18 may be implemented as a combined single device that incorporates any or all of the functionality described herein.
  • time dependent representations and/or functions described herein may be merely variable over time and may, in some embodiments, include random elements.

Landscapes

  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Pathology (AREA)
  • General Physics & Mathematics (AREA)
  • Biochemistry (AREA)
  • Immunology (AREA)
  • Analytical Chemistry (AREA)
  • Chemical & Material Sciences (AREA)
  • Acoustics & Sound (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Signal Processing (AREA)
  • Molecular Biology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Biophysics (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Mathematical Physics (AREA)
  • Vascular Medicine (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Investigating Or Analyzing Materials By The Use Of Ultrasonic Waves (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)

Abstract

A method of facilitating ultrasonic analysis of a subject is provided. The method involves producing signals for causing a set of outgoing ultrasonic signals to be transmitted to the subject, wherein the set of outgoing ultrasonic signals is defined at least in part by a variable imaging parameter that varies over time in accordance with a variable imaging parameter function, the variable imaging parameter function represented or representable at least in part by a function characteristic, receiving signals representing a time dependent representation of the subject generated from a set of received ultrasonic signals scattered by the subject, determining at least one property representation of the subject based on the function characteristic and the time dependent representation of the subject, and producing signals representing the at least one property representation of the subject to facilitate analysis of the subject. Systems, non-transitory computer readable media, and other methods are also provided.

Description

ULTRASONIC ANALYSIS OF A SUBJECT
RELATED APPLICATION
This application claims the benefit of U.S. Provisional Application No. 62/732,904 entitled“ULTRASONIC ANALYSIS OF A SUBJECT”, filed on September 18, 2018, which is hereby incorporated by reference herein in its entirety.
BACKGROUND
1. Field
Embodiments of this invention relate to nondestructive testing and more particularly to nondestructive testing using ultrasonic analysis of a subject.
2. Description of Related Art
Nondestructive Testing (“NDT”) may be used to analyze or characterize various subjects, such as, for example, materials, tissue, tools, devices, tissue/organs, or other subjects where damage to the subject is undesirable, but analysis of the subject is required. Some NDT techniques may involve using microscopy or analysis of a single ultrasound image. However, such known NDT techniques may be difficult to set up and perform and/or may not perform well in detecting or characterizing subtle properties of the subjects, such as, for example where a change in or loss of signal caused by the property may be negligible.
SUMMARY
In accordance with various embodiments, there is provided a method of facilitating ultrasonic analysis of a subject, the method involving producing signals for causing a set of outgoing ultrasonic signals to be transmitted to the subject, wherein the set of outgoing ultrasonic signals is defined at least in part by a variable imaging parameter that varies over time in accordance with a variable imaging parameter function, the variable imaging parameter function represented or representable at least in part by a function characteristic, receiving signals representing a time dependent representation of the subject generated from a set of received ultrasonic signals scattered by the subject, determining at least one property representation of the subject based on the function characteristic and the time dependent representation of the subject, and producing signals representing the at least one property representation of the subject to facilitate analysis of the subject.
The set of outgoing ultrasonic signals may be a temporally ordered set of outgoing ultrasonic signals and the variable imaging parameter may vary over the temporally ordered set of outgoing ultrasonic signals.
The set of outgoing ultrasonic signals may include at least one ultrasonic beam and producing the signals for causing the set of outgoing ultrasonic signals to be transmitted to the subject may involve producing signals for causing the at least one ultrasonic beam to be transmitted to the subject, the at least one ultrasonic beam defined at least in part by the variable imaging parameter.
The variable imaging parameter may be a focal depth of the at least one ultrasonic beam and producing the signals for causing the at least one ultrasonic beam to be transmitted to the subject may involve producing signals for causing the focal depth of the at least one ultrasonic beam to vary over time according to the variable imaging parameter function.
The variable imaging parameter function may include a periodic function that varies over time at an imaging parameter frequency and the function characteristic may include the imaging parameter frequency.
Determining the at least one property representation of the subject may involve applying a band-pass filter to the time dependent representation of the subject, the band-pass filter configured to pass the imaging parameter frequency. Determining the at least one property representation of the subject may involve applying a discrete Fourier transform to the time dependent representation of the subject to determine one or more imaging parameter frequency components, each of the one or more imaging parameter frequency components associated with the imaging parameter frequency.
The method may involve, for each of the one or more imaging parameter frequency components, applying at least one anomaly criterion to the imaging parameter frequency component to determine whether the imaging parameter frequency component indicates presence of an anomaly in the subject.
Applying the at least one anomaly criterion may involve determining whether the imaging parameter frequency component is outside of a predetermined normal range.
Producing the signals representing the at least one property representation of the subject may involve producing signals for causing at least one display to display a representation of the subject including indicators identifying the one or more imaging parameter frequency components determined to be outside of the predetermined normal range.
Producing the signals representing the at least one property representation of the subject may involve producing signals for causing at least one display to display a representation of the one or more imaging parameter frequency components.
The periodic function may be a first periodic function and the imaging parameter frequency may be a first imaging parameter frequency. The variable imaging parameter function may include a second periodic function that varies over time at a second imaging parameter frequency, different from the first imaging parameter frequency such that the variable imaging parameter function is represented at least in part by the second imaging parameter frequency. Determining the at least one property representation of the subject based on the function characteristic and the time dependent representation of the subject may involve determining the at least one property representation of the subject based on the first imaging parameter frequency, the second imaging parameter frequency, and the time dependent representation of the subject.
The set of outgoing ultrasonic signals may be a first set of outgoing ultrasonic signals, the variable imaging parameter may be a first variable imaging parameter, the variable imaging parameter function may be a first variable imaging parameter function, and the function characteristic may be a first function characteristic. The method may involve producing signals for causing a second set of outgoing ultrasonic signals to be transmitted to the subject, wherein the second set of outgoing ultrasonic signals is defined at least in part by a second variable imaging parameter that varies over time in accordance with a second variable imaging parameter function, the second variable imaging parameter function represented at least in part by a second function characteristic, and receiving signals representing a second time dependent representation of the subject generated from a second set of received ultrasonic signals scattered by the subject. Determining the at least one property representation of the subject may involve determining the at least one property representation of the subject based on the first function characteristic, the second function characteristic, and the time dependent representation of the subject.
The subject may be a composite material.
In accordance with various embodiments, there is provided a system for facilitating ultrasonic analysis of a subject comprising at least one processor configured to perform any of the above methods.
In accordance with various embodiments, there is provided a non-transitory computer readable medium having stored thereon codes which when executed by at least one processor cause the at least one processor to perform any of the above methods.
Other aspects and features of embodiments of the invention will become apparent to those ordinarily skilled in the art upon review of the following description of specific embodiments of the invention in conjunction with the accompanying figures.
BRIEF DESCRIPTION OF THE DRAWINGS
In drawings which illustrate embodiments of the invention,
Figure 1 is a schematic view of a system for facilitating ultrasonic analysis of a subject, according to various embodiments of the invention;
Figure 2 is a schematic view of an analyzer of the system shown in Figure 1 including a processor circuit in accordance with various embodiments of the invention;
Figure 3 is a flowchart depicting blocks of code for directing the analyzer of the system shown in Figure 1 to perform subject analysis functions in accordance with various embodiments of the invention;
Figure 4 is a representation of an exemplary ultrasound instruction message that may be used in the system shown in Figure 1 in accordance with various embodiments of the invention;
Figure 5 is a representation of an exemplary image record that may be used in the system shown in Figure 1 in accordance with various embodiments of the invention; Figure 6 is a flowchart depicting blocks of code that may be included in the flowchart shown in Figure 3 in accordance with various embodiments of the invention;
Figure 7 is a representation of images that may be used in the system shown in Figure 1 in accordance with various embodiments of the invention;
Figure 8 is a flowchart depicting blocks of code that may be included in the flowchart shown in Figure 3 in accordance with various embodiments of the invention;
Figure 9 is a representation of an exemplary anomaly range record that may be used in the system shown in Figure 1 in accordance with various embodiments of the invention;
Figure 10 is a representation of an exemplary anomaly indicating image and an image that may be used in the system shown in Figure 1 in accordance with various embodiments of the invention;
Figure 11 is a representation of how an image of the system may fit as a plane of voxels in a larger 3D representation in Figure 1 in accordance with various embodiments of the invention
Figure 12 is a representation of an exemplary ultrasound instruction message that may be used in the system shown in Figure 1 in accordance with various embodiments of the invention;
Figure 13 is a representation of an exemplary ultrasound instruction message that may be used in the system shown in Figure 1 in accordance with various embodiments of the invention; Figure 14 is a representation of an exemplary ultrasound instruction message that may be used in the system shown in Figure 1 in accordance with various embodiments of the invention; and
Figure 15 is a schematic view of a system for facilitating ultrasonic analysis of a subject, according to various embodiments of the invention.
DETAILED DESCRIPTION
Referring to Figure 1, there is provided a schematic representation of a system 10 for facilitating ultrasonic analysis of a subject 12, in accordance with various embodiments described herein. The system includes a computer-implemented analyzer 14 and an ultrasound machine 16 in communication with the analyzer 14. In various embodiments, the system 10 may also include a display 18 in communication with the analyzer 14.
In some embodiments, the system 10 may facilitate ultrasonic analysis of materials or parts to allow detection of subtle defects in the materials, which may be difficult to detect using conventional NDT analysis. In some embodiments, the system 10 may facilitate ultrasonic analysis of advanced composite parts, such as parts made from fibre-reinforced composite materials, for example. In various embodiments, defects may include, for example, porosity, foreign object debris, impact-induced delamination, heat-induced resin degradation, and/or waviness of fibres or wrinkles in the fibres. In various embodiments, the system 10 may facilitate easier implementation of NDT without affecting workflow of a production factory and/or may provide improved detection of defects or properties of a subject, when compared to conventional NDT techniques.
In various embodiments, a user of the system 10 may initiate ultrasonic analysis of the subject 12 through interaction with the analyzer 14. For example, in some embodiments, the user may initiate ultrasonic analysis of the subject 12 during quality assurance testing of the subject 12. Upon initiation of the analysis, the analyzer 14 may be configured to produce signals for causing a set of outgoing ultrasonic signals to be transmitted to the subject 12, wherein the transmitted ultrasonic signals are defined at least in part by a variable imaging parameter that varies over time in accordance with a variable imaging parameter function and the variable imaging parameter function is represented or representable at least in part by a function characteristic. In various embodiments, the set of outgoing ultrasonic signals may be a temporally ordered set of outgoing ultrasonic signals and the variable imaging parameter may vary over the temporally ordered set of outgoing ultrasonic signals.
In various embodiments, varying at least one imaging parameter of the transmitted ultrasonic signals may result in a variation of the ultrasound point spread function used in the imaging system of the system 10. Backscattered RF data sensed for a point x0 in the imaging system may be defined by the following equation:
Figure imgf000010_0001
where PSF(x0) is an ultrasound point spread function at a point x0 that is convolved with s(x0) , the scattering function for the subject 12 at the same point, to generate /(x0, t) , and n represents random noise, A is the amplitude of a micro vibration at point x0 or the amplitude of variation in the ultrasound point spread function at point x0, and w is the frequency of variation in the ultrasound point spread function at point x0.
Accordingly, knowledge of a function characteristic which may represent how the point spread function varies may be used to characterize or identify properties of the subject scattering function and therefore, may be used to characterize or identify properties of the subject 12. ln some embodiments, the variable imaging parameter that defines the transmitted ultrasonic signals may be a focal depth of the transmitted signals and the analyzer 14 may cause the ultrasound machine 16 to transmit ultrasonic signals to the subject 12, via a transducer 20 of the ultrasound machine, that have a focal depth that varies over time according to a variable imaging parameter function or focal depth function. In some embodiments, the focal depth function may be periodic at a focal depth variation frequency and this frequency may act as a function characteristic of the focal depth function. In various embodiments, the analyzer 14 may store the focal depth variation frequency for use later during analysis or characterization of the subject 12.
The ultrasound machine 16 may cause the transducer 20 to transmit, based on the signals received from the analyzer 14, a set of ultrasonic signals to the subject 12 and receive a set of reflected ultrasonic signals scattered by the subject. The ultrasound machine 16 may generate a time dependent representation of the subject 12 based on the received reflected ultrasonic signals and may send the time dependent representation to the analyzer 14. In some embodiments, the time dependent representation may include a temporally ordered set or sequence of image representations of the subject 12 representing the subject 12 over a time period. In some embodiments, this time dependent representation may be taken for a fixed location or volume in the subject 12, during that time period.
The analyzer 14 may receive signals representing the time dependent representation of the subject. For example, in some embodiments, the analyzer 14 may receive the sequence of image representations, from the ultrasound machine 16.
The analyzer 14 may then determine at least one property representation of the subject based on the function characteristic and the time dependent representation of the subject 12. In various embodiments, by basing the determination in part on the function characteristic, a representation of the subject 12 that would otherwise be difficult or impossible to discern may be determined. For example, in some embodiments, the time dependent imaging parameter function may be a periodic focal depth function and the analyzer 14 may use the frequency of the focal depth function as the function characteristic to generate one or more images, acting as property representations of the subject 12, based on the frequency of the focal depth function and the time dependent representation of the subject 12.
In some embodiments, determining the at least one property representation may involve applying a discrete Fourier transform (DFT) such as, for example, a fast Fourier transform, to the time dependent representation of the subject and choosing a component or filtering to determine the component of the result that corresponds to the frequency of the focal depth function. For example, in some embodiments, the time dependent representation of the subject may include a sequence of image representations of the subject as shown in Figure 2, and the analyzer 14 may apply an FFT to each sequence of values for each pixel location. The analyzer 14 may then, for each pixel location, choose the FFT component that corresponds to the frequency of the focal depth function and set that component as an imaging parameter frequency component.
In various embodiments, determining the at least one property representation may involve the analyzer 14 generating an image representation of the determined imaging parameter frequency components. In some embodiments, determining the at least one property representation may involve the analyzer 14 applying at least one anomaly criterion to each of the determined imaging parameter frequency components to determine whether each respective one of the imaging parameter frequency components indicates presence of an anomaly in the subject 12
The analyzer 14 may then produce signals representing the at least one property representation of the subject to facilitate analysis of the subject. In some embodiments, the analyzer may produce signals for causing the display 18 to display a representation of the image representation of the one or more imaging parameter frequency components and/or an image representation of the results of the application of the at least one anomaly criterion.
In various embodiments, varying an imaging parameter in the ultrasonic signal and knowing of a function characteristic of the variable imaging parameter may allow the analyzer 14 to derive properties of the subject 12 and provide analysis that otherwise would not be possible. In some embodiments, the properties may be derived by applying a function to the time dependent representation of the subject 12 wherein the function is defined by the function characteristic or is specific based on the function characteristic. In various embodiments, use of such a particularized property determining function may facilitate generating a representation of the subject 12 that makes properties of the subject 12 discernible, which would otherwise be difficult or impossible to discern using non- destructive testing.
Analyzer - Processor Circuit
Referring now to Figure 2, a schematic view of the analyzer 14 of the system 10 shown in Figure 1 according to various embodiments is shown. The analyzer 14 includes a processor circuit including an analyzer processor 100 and a program memory 102, a storage memory 104, and an input/output (I/O) interface 112, all of which are in communication with the analyzer processor 100. In various embodiments, the analyzer processor 100 may include one or more processing units, such as for example, a central processing unit (CPU), a graphical processing unit (GPU), and/or a field programmable gate array (FPGA). In some embodiments, any or all of the functionality of the analyzer 14 described herein may be implemented using one or more FPGAs.
The I/O interface 112 includes an interface 120 for communicating with the ultrasound machine 16 and an interface 130 for communicating with the display 18. In some embodiments, any of the interfaces 120 or 130 may facilitate wireless or wired communication. In some embodiments, the I/O interface 120 may include an ethernet interface for connecting to the ultrasound machine 16. In some embodiments, the I/O interface 130 may include an HDMI or another multimedia interface.
Referring to Figure 2, in some embodiments, each of the interfaces may include one or more interfaces and/or some or all of the interfaces included in the I/O interface 112 may be implemented as combined interfaces or a single interface.
In some embodiments, where a device is described herein as receiving or sending information, it may be understood that the device receives signals representing the information via an interface of the device or produces signals representing the information and transmits the signals to the other device via an interface of the device.
Processor-executable program codes for directing the analyzer processor 100 to carry out various functions are stored in the program memory 102. Referring to Figure 2, the program memory 102 includes a block of codes 160 for directing the analyzer 14 to perform subject analysis functions. In this specification, it may be stated that certain encoded entities such as applications or modules perform certain functions. Flerein, when an application, module or encoded entity is described as taking an action, as part of, for example, a function or a method, it will be understood that at least one processor (e.g., the analyzer processor 100) is directed to take the action by way of programmable codes or processor-executable codes or instructions defining or forming part of the application.
The storage memory 104 includes a plurality of storage locations including location 140 for storing ultrasonic signal definition information, location 142 for storing time dependent representation of the subject 12 information, location 144 for storing pixel specific time dependent information, location 146 for storing discrete Fourier transform (DFT) result information, location 148 for storing frequency specific DFT component information, location 150 for storing anomaly criteria information, location 152 for storing anomaly representation data, and location 154 for storing frequency component differentiator data. In various embodiments, the plurality of storage locations may be stored in a database in the storage memory 104.
In various embodiments, the blocks of codes included in the program memory 102 may be integrated into a single block of codes and/or may include one or more blocks of code stored in one or more separate locations in program memory 102. In various embodiments, any or all of the locations in the storage memory 104 may be integrated and/or each may include one or more separate locations in the storage memory 104.
In various embodiments, each of the program memory 102 and/or the storage memory 104 may be implemented as one or more storage devices including, for example, random access memory (RAM), a hard disk drive (HDD), a solid-state drive (SSD), a network drive, flash memory, a memory stick or card, any other form of non-transitory computer-readable memory or storage medium, and/or a combination thereof. In some embodiments, the program memory 102, the storage memory 104, and/or any portion thereof may be included in a device separate from the analyzer 14 and in communication with the analyzer 14 via a network interface included in the I/O interface 112, for example.
Subject analysis
Referring now to Figure 3, a flowchart depicting blocks of code for directing the analyzer processor 100 shown in Figure 2 to perform subject analysis functions in accordance with various embodiments is shown generally at 200. The blocks of code included in the flowchart 200 may be included in the block of codes 160 of the program memory 102 shown in Figure 2, for example.
In some embodiments, execution of the flowchart 200 by the analyzer processor 100 may be initiated when a user or users of the analyzer 14 wishes to analyze or characterize the subject 12 or a similar subject, for example, to perform non- destructive testing. For example, in some embodiments, the display 18 shown in Figure 1 may include a touch interface and the user may interact with the display 18 to initiate execution of the flowchart 200. In some embodiments, the results of the analysis may be used to determine whether the subject 12 is viable for use in an intended application and/or to determine the composition of the subject 12.
Referring to Figure 1 , in some embodiments, the subject 12 may be an advanced composite part, which may, for example, include a composite material having fibres and in some embodiments, the results of the analysis may be used to identify anomalies or defects, such as, for example, waviness of the fibres or wrinkles in the fibres, and thereby determine whether the subject 12 may be used in an aerospace application, for example. Accordingly, in various embodiments, the flowchart 200 may be initiated during quality assurance testing of the subject 12. In various embodiments, the subject 12 may be submerged in a water bath container on a table during analysis.
Referring to Figure 3, the flowchart 200 begins with block 202 which directs the analyzer processor 100 to produce signals for causing a set of outgoing ultrasonic signals to be transmitted to the subject, wherein the set of outgoing ultrasonic signals are defined at least in part by a variable imaging parameter that varies over time in accordance with a variable imaging parameter function, the variable imaging parameter function represented or representable at least in part by a function characteristic. In some embodiments, the set of outgoing ultrasonic signals may be a temporally ordered set of outgoing ultrasonic signals and the variable imaging parameter may vary over the temporally ordered set of outgoing ultrasonic signals.
In some embodiments, the set of outgoing ultrasonic signals may include at least one ultrasonic beam and block 202 may direct the analyzer processor 100 to produce signals for causing the at least one ultrasonic beam to be transmitted to the subject, the at least one ultrasonic beam defined at least in part by the variable imaging parameter.
In some embodiments, the variable imaging parameter may be a focal depth and block 202 may direct the analyzer processor 100 to transmit to the ultrasound machine 16 shown in Figure 1 , an ultrasound instruction message, a portion of which is shown at 240 in Figure 4, which may in some embodiments represent computer code, such as, for example C code, for directing the ultrasound machine to cause the transducer 20 to transmit ultrasonic signals to the subject such that the ultrasonic signals have a focal depth that varies over time according to a focal depth function. In various embodiments, the ultrasound machine 16 may include an ultrasound machine with a 1-D linear array transducer with 128 elements.
Referring to Figure 4, in various embodiments, the ultrasound instruction message 240 includes a focal depth or focal distance function definition 242 that defines a focal depth or focal distance in microns as a function of an index number“i”. The ultrasound machine 16 may be configured to transmit a temporally ordered set or sequence of ultrasonic signals indexed by the index number“i” to the subject 12 such that a sequence of images or frames having corresponding indices and representing the reflected or scattered signals can be generated. In some embodiments, the frame rate may be set at a frequency, such as for example, 730 frames per second, and the total number of ultrasonic signals or indices may be set to 128, for example. In various embodiments, a frame rate of about 730 frames per second may facilitate imaging the subject quickly in a short time period. In various embodiments, capturing 128 frames may allow later analysis, such as analysis using an FFT to be performed accurately.
Accordingly, in some embodiments, the focal depth function definition 242 being a function of i will result in the focal depth function being a function of time. Referring to Figure 4, in various embodiments, the focal depth function definition 242 of the ultrasound instruction message 240 may represent the following function: Focal depth ( in microns ) = D + A sin(2 nf i ) where i is the frame index number for each transmitted ultrasonic signal.
Referring still to Figure 4, in various embodiments, the focal depth function definition 242 of the ultrasound instruction message 240 may be defined in part by respective values stored in a mean focal depth field 244, an amplitude field 246, and a focal depth frequency field 248 included in the ultrasound instruction message.
In various embodiments, the mean focal depth field 244 and the amplitude field 246 may have been previously set, for example, by a user of the analyzer 14. In some embodiments, the mean focal depth field 244 may be set to a depth that is in the center of the subject 12 being analyzed, which may facilitate more accurate characterization of the subject. In some embodiments, for example, the subject 12 may have a total depth of about 4 cm or 40000 microns and so the mean focal depth field 244 may have been previously set to 20000 microns.
In some embodiments, the imaging depth for imaging the subject 12 may be set such that a reasonably high resolution for imaging is achieved. For example, for a 5 MFIz transducer, 4 cm depth may be reasonable. In some embodiments, lower than that like 1 cm, for example, may degrade beamforming quality and much higher than that like 10 cm, for example, may reduce the imaging resolution. In various embodiments, the subject 12 may be placed generally at the mean focal depth and in various embodiments, a typical focal depth may be about 1 cm to 3 cm for a 4 cm imaging depth.
The value of the focal depth frequency field 248 of the ultrasound instruction message 240 may have also been previously set, for example, by a user of the analyzer 14. In some embodiments, the focal depth frequency field 248 may be chosen such that the focal depth function definition 242 completes 1 period within a sample time period. For example, in some embodiments, a sample time period may include 128 frames, and so the focal depth frequency field 248 may be set to 1/128 = 0.03125. In various embodiments, based on the frame rate of 730 frames per second, this may result in a frequency of the focal depth function of about 5.7 Hz, hence with 128 frames, one cycle of the sinusoid may be sampled fairly densely and this may facilitate reliably reconstructing the amplitude of the sinusoid.
In various embodiments, the focal depth frequency field 248 may be set to a value such that each period is sampled at about 4 times the Nyquist rate given the imaging frame rate to facilitate reliable reconstruction of the signal in a noisy environment.
In some embodiments, the value stored in the focal depth frequency field 248 may act as an imaging parameter frequency and a function characteristic for the focal depth function defined by the focal depth function definition 242.
In some embodiments, the ultrasound instruction message 240 may have been previously stored in the location 140 of the storage memory 104 and block 202 may direct the analyzer processor 100 to retrieve the ultrasound instruction message 240 from the location 140 of the storage memory 104 and to send a representation of the ultrasound instruction message 240 to the ultrasound machine 16 via the interface 120 of the I/O interface 112 shown in Figure 2.
After receiving the ultrasound instruction message 240 from the analyzer 14, the ultrasound machine 16 may cause the transducer 20 to transmit a plurality of outgoing ultrasonic signals to the subject based on the ultrasound instruction message 240. For example, in various embodiments, the ultrasound machine 16 may receive the ultrasound instruction message 240 shown in Figure 4 and the ultrasound machine 16 may cause the transducer 20 to transmit 128 ultrasonic signals indexed from i=0 to i=127 at 730 signals/second and each defined at least in part by a focal depth determined according to the focal depth function definition 242 of the ultrasound instruction message 240. The transducer 20 then receives reflections of each of the transmitted ultrasonic signals from the subject 12 and the ultrasound machine 16 generates respective images, each representing a reflection of one of the transmitted signals and so corresponding to an index or frame number. For example, in some embodiments, the ultrasound machine 16 may generate 128 images indexed from i=0 to i=127 representing the subject 12 taken at 730 images/second representing reflections of the ultrasonic signals transmitted to the subject 12. In various embodiments, the ultrasound machine 16 may transmit the sequence of 128 images, each associated with a respective index number representing time, to the analyzer 14, for analysis.
For example, in various embodiments, the ultrasound machine 16 may generate and transmit to the analyzer 14 respective image records, an exemplary one of which is shown at 280 in Figure 5. The image record 280 includes an index field 282 for storing an index value representing a time at which the image was taken and an image field 284 for storing an image representation of the reflected ultrasonic signals received at the transducer 20. In some embodiments, the image information stored in the image field 284 may include a plurality of pixel positions, each associated with a pixel value, wherein the pixel value represents an echo intensity which may represent a change in density, speed of sound and/or acoustic impedance of the subject at the pixel location. In some embodiments, the image information may represent an 8-12 bit image and the pixel values may each be within a range of 0-255 or 0-4095, for example.
Referring back to Figure 3, block 204 directs the analyzer processor 100 to receive signals representing a time dependent representation of the subject generated from a set of received ultrasonic signal scattered by the subject. In some embodiments, block 204 may direct the analyzer processor 100 to receive a set of 128 image records, each having the same format as the image record 280 shown in Figure 5, from the ultrasound machine 16 via the interface 120 of the I/O interface 112 shown in Figure 2. Block 204 may direct the analyzer processor 100 to store the received image records in the location 142 of the storage memory 104 shown in Figure 2. In various embodiments, the received image records may act as a temporally ordered set of image representations of the subject 12.
Block 206 then directs the analyzer processor 100 to determine at least one property representation of the subject 12 based on the function characteristic and the time dependent representation of the subject. In some embodiments, block 206 may direct the analyzer processor 100 to retrieve the set of image records including the image record 280, together acting as a time dependent representation of the received ultrasonic signals, received at block 204 from the location 142 of storage memory 104 and to retrieve the focal depth frequency value stored in the focal depth frequency field 248, acting as a function characteristic, from the location 140 of the storage memory 104. Block 206 may then direct the analyzer processor 100 to determine at least one property representation of the subject based on the set of image records and the focal depth frequency value.
Referring now to Figure 6, there is shown a flowchart 290 depicting blocks of code for directing the analyzer processor 100 shown in Figure 2 to perform subject property determining functions in accordance with various embodiments. In various embodiments, the blocks of code included in the flowchart 290 may be included in the block 206 of the flowchart 200 shown in Figure 5.
The flowchart 290 begins with block 292 which directs the analyzer processor 100 to identify a sequence of pixel values for a pixel position in the set of images included in the set of image records stored at the location 142 of the storage memory 104. For example, in some embodiments, block 292 may direct the analyzer processor 100 to read the pixel values for position (0,0) in each image of the set of images and generate a pixel value sequence vector, representing the pixel values for position (0,0). Block 292 may direct the analyzer processor 100 to store the pixel value sequence vector in the location 144 of the storage memory 104. For example, referring to Figure 7, there is shown a representation of images 300 that may be included in the image records stored in the location 142 of the storage memory 104, in accordance with various embodiments. Figure 7 shows a representative pixel 302 at a particular position in the images 300, which may correspond to a particular position or location in the subject 12. Figure 7 shows how the pixel value representing echo intensity or material density 304 associated with the pixel 302 changes over time. Block 292 may direct the analyzer processor 100 to generate and store in the location 144 of the storage memory 104, a pixel value sequence vector representing an echo intensity over time for the first pixel position (0,0).
Block 294 then directs the analyzer processor 100 to apply a discrete Fourier transform (DFT) to the pixel value sequence vector generated at block 292. In some embodiments, block 294 may direct the analyzer processor 100 to apply a DFT normalized to the frame rate of image acquisition and generate a DFT vector from the application of the DFT, the DFT vector including absolute value components of the computed DFT, each of the absolute value components associated with a frequency. Block 294 may direct the analyzer processor 100 to store the DFT vector in the location 146 of the storage memory 104 shown in Figure 1. In some embodiments, block 294 may direct the analyzer processor 100 to apply a fast Fourier Transform (FFT) to the pixel value sequence vector generated at block 292 to generate the DFT vector.
Referring to Figure 6, block 296 then directs the analyzer processor 100 to identify from the result of the DFT, a component that is associated with the focal depth frequency value stored in the focal depth frequency field 248 of the ultrasound instruction message 240 shown in Figure 4. In some embodiments, the identified component may act as an imaging parameter frequency component since it may be associated with the frequency at which the imaging parameter (i.e. , the focal depth in some embodiments) varies. In some embodiments, block 296 may direct the analyzer processor 100 to identify a component or value from the DFT vector stored in the location 146 of the storage memory 104 as associated with the focal depth frequency. In various embodiments, block 296 may direct the analyzer processor 100 to apply knowledge of the sampling frequency of the signal or frame rate to determine which component of the DFT vector corresponds to the focal depth frequency. For example, in some embodiments, if the focal depth frequency is f=5.7 Hz, the period for the focal depth function is T=1/f=0.1754s. In some embodiments, the sampling time may be ts=T/128=0.00137 and the sampling frequency may be Fs=1/ts=729.6 Flz. In various embodiments where 128 frames are used, the second frequency component in FFT corresponds to 1/128*Fs=5.7 Hz. Hence, in such embodiments, the amplitude of the second frequency component corresponds to the focal depth frequency of 5.7 Hz.
Block 298 then directs the analyzer processor 100 to associate the identified component with the pixel position being considered. In some embodiments, on a first execution of block 298, block 298 may direct the analyzer processor 100 to generate a frequency component image and to set a pixel position of the frequency component image corresponding to the pixel position that was considered at block 292 to the component or value identified at block 296 of the flowchart 290. Block 298 may direct the analyzer processor 100 to store the frequency component image in the location 148 of the storage memory 104. In various embodiments in subsequent executions of block 298, block 298 may direct the analyzer processor 100 to modify the frequency component image previously generated and stored in the location 148 of the storage memory 104 to include further pixel values at respective considered pixel positions.
After block 298 has been completed for a particular pixel position, the analyzer processor 100 may be directed to return to block 292 and to consider another pixel position. In various embodiments, blocks 292 to 298 may be repeated for each pixel position included in the images stored in the location 144 of the storage memory 104. Once every pixel position of the images stored in the location 142 of the storage memory 104 has been considered during execution of blocks 292 to 298, the frequency component image stored in the location 148 of the storage memory 104 and each of the pixel values included therein may act as a representation of features or properties of the subject 12. In some embodiments, deviation of pixel values from a mean pixel value may represent an anomaly or probability of an anomaly in the subject 12 at a particular location in the subject. In various embodiments, once every pixel position has been considered, the frequency component image may be visualized as a color map, which shows the imaging parameter frequency component for each pixel position.
In some embodiments, block 206 may direct the analyzer processor 100 to, for each of the imaging parameter frequency components determined, apply anomaly criteria to the determined component to determine whether the imaging parameter frequency component indicates presence of an anomaly in the subject 12. Referring now to Figure 8, there is shown a flowchart 340 depicting blocks of code for directing the analyzer processor 100 shown in Figure 2 to perform anomaly detection functions in accordance with various embodiments. In various embodiments, the blocks of code included in the flowchart 340 may be included in the block 206 of the flowchart 200 shown in Figure 3 and may be executed after the blocks of code included in the flowchart 290 shown in Figure 6 have been executed.
The flowchart 340 begins with block 342 which directs the analyzer processor 100 to identify an imaging parameter frequency component associated with a particular pixel position. In some embodiments, block 342 may direct the analyzer processor 100 to read the frequency component image from the location 148 of the storage memory 104 and to identify a first imaging parameter frequency component of the frequency component image associated with a first pixel position in the frequency component image.
Block 344 then directs the analyzer processor 100 to apply at least one anomaly criterion to the identified imaging parameter frequency component to determine whether the imaging parameter frequency component indicates presence of an anomaly in the subject. In some embodiments, expected values for the imaging parameter frequency components may be within a predetermined normal range and so block 344 may direct the analyzer processor 100 to determine whether the imaging parameter frequency component is outside of a predetermined normal range.
For example, in some embodiments, an anomaly range record 360 shown in Figure 9 may have been previously determined or provided and may be stored in the location 150 of the storage memory 104. Referring to Figure 9, in various embodiments, the anomaly range record 360 includes a minimum field 362 and a maximum field 364 for storing values defining the predetermined normal range. Block 344 may direct the analyzer processor 100 to compare the first imaging parameter frequency component to the values from the minimum and maximum fields 362 and 364 of the anomaly range record 360 and to determine whether the first imaging parameter frequency component is less than the value stored in the minimum field 362 or greater than the value stored in the maximum field 364. In some embodiments, there may be no minimum value and so the minimum field 362 may be omitted. In such embodiments, block 344 may direct the analyzer processor 100 to determine whether the first imaging parameter frequency component is greater than the value stored in the maximum field 364. In some embodiments, the minimum and maximum values may have been previously determined by scanning one or more samples similar to the subject 12 but without anomalies and determining a range of pixel values for frequency component images generated from the samples.
If at block 344 it is determined that the at least one anomaly criterion is met and the imaging parameter frequency component indicates presence of an anomaly in the subject 12, the analyzer processor is directed to block 346. For example, if at block 344 it is determined that the first imaging parameter frequency component is greater than the value stored in the maximum field 364, block 344 may direct the analyzer processor 100 to proceed to block 346.
Block 346 directs the analyzer processor 100 to associate the pixel position with an anomaly indicator. In some embodiments, block 346 may direct the analyzer processor 100 to set the pixel position identified at block 342 of an anomaly indicating image to an anomaly indicator value. In various embodiments, the anomaly indicating image may be stored in the location 152 of the storage memory 104. In some embodiments, block 346 may direct the analyzer processor 100 to set the pixel position to an anomaly indicator value that represents an indicator color, such as, for example, red. In various embodiments, by associating the pixel position with an anomaly indicator, anomalies in the imaging parameter frequency components may be easily identified.
If at block 344 it is determined that the at least one anomaly criterion is not met and the imaging parameter frequency component does not indicate presence of an anomaly in the subject 12, the analyzer processor is directed to block 348. For example, if at block 344 it is determined that the first imaging parameter frequency component is less than the value stored in the maximum field 364 and greater than the value stored in the minimum field 362, block 344 may direct the analyzer processor 100 to proceed to block 348.
Block 348 may direct the analyzer processor 100 to associate the pixel position with a value that indicates that there is not an anomaly at the pixel position. In some embodiments, block 348 may direct the analyzer processor 100 to associate the pixel position with a value that represents the color blue, for example.
After either block 346 or 348 has been executed, the analyzer processor 100 is directed to return to block 342 and to consider another pixel position of the frequency component image retrieved from the location 148 of the storage memory 104. In various embodiments, blocks 342, 344, and 346 or 348 may be executed for each pixel position in the frequency component image until a complete anomaly indicating image is stored in the location 152 of the storage memory 104.
Referring to Figure 10, a representation of an exemplary anomaly indicating image 380 that may be stored in the location 152 of the storage memory 104 after flowchart 340 has been executed is shown beside an image 384 included in one of the image records, for reference. Referring to Figure 10, the anomaly indicating image 380 includes a region of anomaly which is indicated by the color red (represented in Figure 10 by vertical line hatching), and a normal region which is indicated by the color blue (represented in Figure 10 by horizontal line hatching).
In various embodiments, the anomaly indicating image 380 stored in the location 152 of the storage memory 104 and each of the pixel values included in the anomaly indicating image may act as representations of features or properties of the subject 12.
Referring to Figure 3, in some embodiments, block 206 may direct the analyzer processor 100 to determine a representative value from the frequency component image stored in the location 148 of the storage memory 104. For example, in some embodiments block 206 may direct the analyzer processor 100 to determine a median pixel value from the frequency component image and to store the median pixel value in the location 148 of the storage memory 104. In various embodiments, the median pixel value may be representative of a level of porosity in the subject 12. For example, in some embodiments, as the median pixel value increases, this may indicate a higher porosity of the subject 12.
In some embodiments, blocks 202, 204, and 206 of the flowchart 200 may be executed for a plurality of positions on the subject 12, such that the 3-dimensional subject 12 may be characterized at a plurality of planes. For example, in some embodiments, the system 10 may include a Y-Z stage and the analyzer 14 may be configured to execute blocks 202, 204, and 206 of the flowchart 200 shown in Figure 3 in a first Z position. The system 10 may then move the subject 12 using the Y-Z stage relative to the transducer 20 and then the analyzer 14 may execute blocks 202, 204, and 206 in the next Z-position. For example, in some embodiments, the subject 12 may move about 1 mm at a time. The entire movement procedure may be automated such that the subject 12 moves with increments of 1 mm representing a 1 mm scanning resolution across the entire subject. Accordingly, in various embodiments, the pixels discussed herein may act as a plane of voxels in a larger 3D representation of the subject. Figure 11 shows how an image 390 included in the image records stored in the location 142 of the storage memory 104 may fit as a plane of voxels within a 3D representation 392 of properties of the subject 12. In various embodiments, the frequency component images stored in the location 148 of the storage memory 104 and/or the anomaly indicating images stored in the location 152 of the storage memory 104 may similarly together form respective 3D representations of properties of the subject 12
In some embodiments, the ultrasound image data stored in the location 142 may be collected in various ways. For example, in some embodiments, the ultrasound image data stored in the location 142 of the storage memory 104 may be collected over equally-sized Regions of Interests (ROI), where the width of each ROI is the half of the probe width (e.g., 1.9 cm) and its depth is equal to the sample’s thickness. For each imaging plane, analysis may be performed for 2 ROIs that cover the entire cross section of the subject 12.
Referring back to Figure 3, block 208 directs the analyzer processor 100 to produce signals representing the at least one property representation determined at block 206 to facilitate analysis of the subject 12. In some embodiments, block 208 may direct the analyzer processor 100 to produce signals representing one or more of the frequency component images stored in the location 148 for causing the display 18 shown in Figure 1 to display a representation of the frequency component images. For example, in some embodiments, a 3D representation of the frequency component images may be displayed. In various embodiments, a user or quality assurance specialist viewing the display 18 may be able to use the display 18 showing the frequency component images to determine whether the subject 12 can be used for a desired application. For example, in various embodiments, the user may determine that the frequency component images include too many high and/or low pixel values that are different from an average or normal pixel value and that therefore the subject 12 has too many imperfections or too high of a porosity to be used in the intended application.
In some embodiments, block 208 may direct the analyzer processor 100 to produce signals representing the median pixel value stored in the location 148 of the storage memory 104 for one or more of the frequency component images, for causing the display 18 shown in Figure 1 to display a representation of the median pixel value. In various embodiments, a user or quality assurance specialist viewing the display 18 may be able to use the display 18 showing the median pixel values to determine whether the subject 12 can be used for a desired application. For example, in various embodiments, the user may determine that the median pixel values are too high or too low and therefore has too many imperfections or too high of a level of porosity for the intended application.
In some embodiments, block 208 may direct the analyzer processor 100 to produce signals representing one or more of the anomaly indicating images stored in the location 152 for causing the display 18 to display a representation of the one or more anomaly indicating images. For example, in some embodiments, block 208 may direct the analyzer processor 100 to produce signals representing a plurality of anomaly indicating images such that a 3D view or a top down view of one or more cross sections taken at a pixel position on the x axis may be displayed by the display 18. In various embodiments, a user or quality assurance specialist viewing the display 18 may be able to use the display 18 showing the anomaly indicating images to determine whether the subject 12 can be used for a desired application. For example, in various embodiments, the user may determine that the anomaly indicating image includes too many pixel positions that are associated with anomaly indicator values and that therefore the subject 12 has too many imperfections to be used in an aerospace application.
Various embodiments
In some embodiments, the variable imaging parameter function may be representable by more than one function characteristic, which may be used to determine the at least one property representation of the subject 12. For example, in some embodiments, a focal depth function may be used that includes more than one periodic function, each having a different frequency. Accordingly, in various embodiments, an ultrasound instruction message 400 as shown in Figure 12 may be stored in the location 140 of the storage memory 104 and used generally as described above having regard to the ultrasound instruction message 240 shown in Figure 4.
Referring to Figure 12, the ultrasound instruction message 400 includes a focal depth function definition 402 that includes more than one periodic function, such that the focal depth of the ultrasonic signals transmitted to the subject 12 by the ultrasound machine 16 may vary according to more than one periodic function. Accordingly, referring to Figure 12, in some embodiments, the focal depth function definition 402 may define a focal depth as follows:
Focal depth (in microns ) = D + A sin(2 nf i) + B sin(2 p/2 i) where i is the frame index number for each transmitted ultrasonic signal.
Accordingly, in various embodiments, the focal depth function may include a first periodic function A*sin(2pi*fi*i) where fi is a first focal depth frequency and a second periodic function B* sin(2pi*f2*i) where f2 is a second focal depth frequency, wherein f2 is different from fi. In such embodiments, the values for fi and f2 may each act as respective function characteristics for the focal depth function. In various embodiments, where the ultrasound instruction message 400 is transmitted to the ultrasound machine 16, block 296 of the flowchart 290 shown in Figure 6 may direct the analyzer processor 100 to identify first and second frequency components of the DFT result, the first and second frequency components associated with the first and second focal depth frequencies. In various embodiments, block 298 of the flowchart 290 shown in Figure 6 may direct the analyzer processor 100 to determine a difference between the first and second frequency components and to associate the pixel position with the difference between the identified first and second frequency components. Block 298 may, for example, direct the analyzer processor 100 to generate a frequency component differentiator image which includes a representation of the difference between frequency component values associated with each pixel position. In various embodiments, the generated frequency component differentiator image may act as a property representation of the subject.
In various embodiments, alternative or additional imaging parameters and imaging parameter functions may be utilized generally as described herein regarding the focal depth acting as an imaging parameter and the focal depth function acting as an imaging parameter function defining how the focal depth varies over time. For example, in some embodiments imaging parameters that may be treated generally as described herein regarding the focal depth, may include focal depth, f-number, apodization window, time gain compensation (TGC), dynamic range, number of active elements, centre frequency of the transducer, shape of the transmitted signal, direction of the transmitted signal (which may be changed using beam steering, for example), length of the transmitted signal, and/or another imaging parameter that affects the point spread function of the imaging system.
For example, in some embodiments, an ultrasound instruction message 420 as shown in Figure 13 may be stored in the location 140 of the storage memory 104 and used generally as described above having regard to the ultrasound instruction message 240 shown in Figure 4, except the ultrasound instruction message 420 may cause the ultrasound machine 16 to vary a centre frequency of the transmitted signals based on the ultrasound instruction message 420. Referring to Figure 13, the ultrasound instruction message 420 includes a centre frequency function definition 422 for defining the centre frequency in Hz of the ultrasonic signals to be transmitted to the subject 12 by the ultrasound machine 16, such that the centre frequency may vary according to the centre frequency function definition 422.
In some embodiments, the centre frequency function may be used on its own generally as described above for the focal depth function. However, in other embodiments, the centre frequency function may be used in conjunction with varying of another imaging parameter, such as, for example, the focal depth. Accordingly, in various embodiments, the flowcharts 200 and 290 shown in Figures 3 and 6 may be executed first as described above using the ultrasound instruction message 240 shown in Figure 5 and then the flowcharts 200 and 290 may be executed generally as described above but using the ultrasound instruction message 420 shown in Figure 13.
Accordingly, in various embodiments, a focal depth frequency component image and a centre frequency component image for the same planar position in the subject 12 may thus be stored in the location 148 of the storage memory 104. In some embodiments, when both the focal depth frequency component image and the centre frequency component image are stored in the location 148 of the storage memory 104, block 206 may direct the analyzer processor 100 to determine, for each pixel position in the images stored in the location 148 of the storage memory 104, a difference between the pixel values of the focal depth frequency component image and the centre frequency component image. Block 206 may direct the analyzer processor 100 to generate and store a differentiator image representing the differences in pixel values at each pixel position. The differentiator image may be stored in the location 154 of the storage memory 104, for example. ln some embodiments, block 208 may direct the analyzer processor 100 to produce signals representing the differentiator image stored in the location 154 for causing the display 18 to display a representation of the differentiator image. In various embodiments, a user viewing the differentiator image may be able to determine properties of the subject 12 in view of the differentiator image. For example, in some embodiments, the user may be able to determine a material type from the displayed differentiator image.
In some embodiments, a differentiator image may be generated as described above, but using two different functions for the same imaging parameter. For example, in some embodiments, an ultrasound instruction message 440 as shown in Figure 14 may be used as described above instead of the ultrasound instruction message 420 shown in Figure 13.
In some embodiments block 208 of the flowchart 200 shown in Figure 3 may direct the analyzer processor 100 to produce signals representing the at least one property representation of the subject to facilitate analysis of the subject 12 using a neural network. For example, in some embodiments, block 208 may direct the analyzer processor 100 to use the frequency component images and/or the anomaly indicating images stored in the location 148 of the storage memory 104 as inputs into a neural network for analyzing the images.
In some embodiments, block 208 of the flowchart 200 shown in Figure 3 may direct the analyzer processor 100 to transmit signals representing the at least one property representation of the subject to facilitate analysis at another computer of the subject 12. For example, in some embodiments, the I/O interface 112 may include a network interface and block 208 may direct the analyzer processor 100 to transmit representations of frequency component images and/or the anomaly indicating images stored in the location 148 of the storage memory 104 to another computer via the network interface to facilitate analysis at the other computer. In some embodiments, the ultrasound machine 16 may include 3D transducers or circular, array transducers which may not require any motion to scan in 3D. In some embodiments, the ultrasound machine 16 may include more than one transducer, such as, for example, one sending a signal from one side and one receiving a signal from the other side.
In various embodiments alternative or additional imaging parameter functions or focal depth functions may be used. For example, in some embodiments, a focal depth function that is not periodic may be used.
In various embodiments, block 206 of the flowchart 200 shown in Figure 3 may direct the analyzer processor 100 to, instead of applying the DFT, convolve the focal depth function with the time dependent subject representation (e.g., by convolving the focal depth function with the pixel value sequence vectors) to determine convolution values that may be included in a convolution image which may be treated generally similarly to the frequency component image described herein.
In various embodiments, the shape of the focal depth function may include any varying function, such as, for example, a step or a triangle, or a sequence of pulses of varying length or amplitude, or another varying function, such as, for example a function that includes randomly varying elements.
In some embodiments, the focal depth function may result in a sequence of ultrasonic or transmit signals being produced that vary the focal point sinusoidally according to an index or time value. Flowever, in some embodiments, the order of firing or transmitting of that sequence of signals to the subject 12 may be scrambled randomly in time, as each backscattered data frame may be considered independent of the subsequent data frame. In such embodiments, block 206 may direct the analyzer processor 100 to first re-sort the received image frames and then to perform an analysis generally as described herein. While various embodiments described herein have been described in connection with the subject 12 being made of a composite material, in various embodiments, the system 10 may facilitate ultrasonic characterization of other subjects for which accurate characterization is required. For example, in some embodiments, the system 10 may be configured to facilitate ultrasonic characterization in biomedical applications, such as for in vivo and ex vivo characterization of biological material, such as, for example, for tissue or organ analysis. For example, in some embodiments, the system 10 may be used to detect cancer, such as, for example prostate cancer and/or breast cancer.
While various embodiments described herein involved the use of a DFT or FFT and selection of components of a result of the DFT or FFT, in various embodiments alternative or additional processing of the time dependent representation of the subject may be used. For example, in some embodiments, block 206 may direct the analyzer processor 100 to more generally apply a band-pass filter to the time dependent representation of the subject 12 received at block 204, wherein the band-pass filter is configured to pass the focal depth frequency.
In various embodiments, block 206 may process the time dependent representation of the subject 12 using additional or alternative analyses compared to the DFT described above, which may be based on time, frequency, amplitude, statistical, stochastic or a combination thereof. For example, in some embodiments, block 206 may direct the analyzer processor 100 to use a band- pass filter such as a finite impulse response (FIR) filter to filter the time dependent representation, and to use a property of the filtered result, such as the power of the filtered result or its amplitude, for example, to facilitate ultrasonic analysis of a subject. For example, in some embodiments, the power of the filtered result or its amplitude may act as a representation of at least one property of the subject 12. In some embodiments, the design of the FIR filter may be informed from the variable imaging parameter function. In some embodiments, the FIR filter may have a passband centered around a frequency of the variable imaging parameter function. For example, if the focal depth variation frequency is 10 Hz, then the FIR filter may be implemented as a 10 Hz bandpass filter.
In some embodiments, block 206 of the flowchart 200 shown in Figure 3 may direct the analyzer processor 100 to input the time dependent representation of the subject 12 and the function characteristic into a neural network, the neural network having been trained/configured to determine whether the subject 12 has a defect based on the input time dependent representation of the subject 12 and the function characteristic. In some embodiments, the neural network may act as a classifier and may output a determined probability or likelihood that there is a defect in the subject 12. In such embodiments, the determined probability that there is a defect in the subject 12 may act as the at least one property representation of the subject.
In various embodiments, block 208 may then direct the analyzer processor 100 to, if it is determined by the neural network that the subject has a high probability of a defect (e.g., by determining whether the probability of a defect is higher than a threshold probability), produce signals for causing an alert to be provided for a user of the analyzer 14. For example, in some embodiments, block 208 may direct the analyzer processor 100 to, produce signals for causing the display 18 to provide an alert noting that the subject 12 likely has a defect.
In some embodiments, block 206 may direct the analyzer processor 100 to use a deep neural network that is trained to perform DFT and perform an analysis on the result. In some embodiments, block 206 may direct the analyzer processor 100 to use a neural network that is trained to extract a specific frequency component (corresponding to the focal depth frequency, for example) from each of the pixel value sequences without needing to use a full DFT calculation for all frequency components. While the system 10 shown in Figure 1 includes the ultrasound machine 16 which is shown pictorially as a standard cart-based ultrasound machine, in various embodiments, the system 10 may be implemented in alternative environments, such as, for example, in an assembly line or in a hand held device for use in the field.
In various embodiments, a system 460 shown in Figure 15 that functions generally similarly to the system 10 described herein and shown in Figure 1 may include an ultrasound machine 462 that incorporates an analyzer within the ultrasound machine 462, the analyzer having generally similar functionality to the analyzer 14 described herein. For example, in various embodiments, a single processor circuit included in the ultrasound 462 may implement functionality of both the ultrasound machine 16 and the analyzer 14 described herein. In various embodiments a display 464 of the system 460 may be used generally as described above regarding the display 18 of the system 10 shown in Figure 1.
In various embodiments, any or all of the ultrasound machine 16, transducer 20, analyzer 14 and/or display 18 may be implemented as a combined single device that incorporates any or all of the functionality described herein.
In various embodiments, time dependent representations and/or functions described herein may be merely variable over time and may, in some embodiments, include random elements.
While specific embodiments of the invention have been described and illustrated, such embodiments should be considered illustrative of the invention only and not as limiting the invention as construed in accordance with the accompanying claims.

Claims

CLAIMS:
1. A method of facilitating ultrasonic analysis of a subject, the method comprising: producing signals for causing a set of outgoing ultrasonic signals to be transmitted to the subject, wherein the set of outgoing ultrasonic signals is defined at least in part by a variable imaging parameter that varies over time in accordance with a variable imaging parameter function, the variable imaging parameter function represented or representable at least in part by a function characteristic; receiving signals representing a time dependent representation of the subject generated from a set of received ultrasonic signals scattered by the subject; determining at least one property representation of the subject based on the function characteristic and the time dependent representation of the subject; and producing signals representing the at least one property representation of the subject to facilitate analysis of the subject.
2. The method of claim 1 wherein the set of outgoing ultrasonic signals is a temporally ordered set of outgoing ultrasonic signals and wherein the variable imaging parameter varies over the temporally ordered set of outgoing ultrasonic signals.
3. The method of claim 1 or 2 wherein the set of outgoing ultrasonic signals includes at least one ultrasonic beam and wherein producing the signals for causing the set of outgoing ultrasonic signals to be transmitted to the subject comprises producing signals for causing the at least one ultrasonic beam to be transmitted to the subject, said at least one ultrasonic beam defined at least in part by the variable imaging parameter.
4. The method of claim 3 wherein the variable imaging parameter is a focal depth of the at least one ultrasonic beam and wherein producing the signals for causing the at least one ultrasonic beam to be transmitted to the subject comprises producing signals for causing the focal depth of the at least one ultrasonic beam to vary over time according to the variable imaging parameter function.
5. The method of any one of claims 1 to 4 wherein the variable imaging parameter function includes a periodic function that varies over time at an imaging parameter frequency and wherein the function characteristic includes the imaging parameter frequency.
6. The method of claim 5 wherein determining the at least one property representation of the subject comprises applying a band-pass filter to the time dependent representation of the subject, the band-pass filter configured to pass the imaging parameter frequency.
7. The method of claim 5 or 6 wherein determining the at least one property representation of the subject comprises applying a discrete Fourier transform to the time dependent representation of the subject to determine one or more imaging parameter frequency components, each of the one or more imaging parameter frequency components associated with the imaging parameter frequency.
8. The method of claim 7 further comprising, for each of the one or more imaging parameter frequency components, applying at least one anomaly criterion to the imaging parameter frequency component to determine whether the imaging parameter frequency component indicates presence of an anomaly in the subject.
9. The method of claim 8 wherein applying the at least one anomaly criterion comprises determining whether the imaging parameter frequency component is outside of a predetermined normal range.
10. The method of claim 9 wherein producing the signals representing the at least one property representation of the subject comprises producing signals for causing at least one display to display a representation of the subject including indicators identifying the one or more imaging parameter frequency components determined to be outside of the predetermined normal range.
11. The method of claim 7 wherein producing the signals representing the at least one property representation of the subject comprises producing signals for causing at least one display to display a representation of the one or more imaging parameter frequency components.
12. The method of claim any one of claims 5 to 11 wherein: the periodic function is a first periodic function and the imaging parameter frequency is a first imaging parameter frequency; the variable imaging parameter function includes a second periodic function that varies over time at a second imaging parameter frequency, different from the first imaging parameter frequency, such that the variable imaging parameter function is represented or representable at least in part by the second imaging parameter frequency; and determining the at least one property representation of the subject based on the function characteristic and the time dependent representation of the subject comprises determining the at least one property representation of the subject based on the first imaging parameter frequency, the second imaging parameter frequency, and the time dependent representation of the subject.
13. The method of any one of claims 1 to 12 wherein: the set of outgoing ultrasonic signals is a first set of outgoing ultrasonic signals; the variable imaging parameter is a first variable imaging parameter; the variable imaging parameter function is a first variable imaging parameter function; the function characteristic is a first function characteristic; the method further comprises: producing signals for causing a second set of outgoing ultrasonic signals to be transmitted to the subject, wherein the second set of outgoing ultrasonic signals is defined at least in part by a second variable imaging parameter that varies over time in accordance with a second variable imaging parameter function, the second variable imaging parameter function represented or representable at least in part by a second function characteristic; and receiving signals representing a second time dependent representation of the subject generated from a second set of received ultrasonic signals scattered by the subject; and determining the at least one property representation of the subject comprises determining the at least one property representation of the subject based on the first function characteristic, the second function characteristic, and the time dependent representation of the subject.
14. The method of any one of claims 1 to 13 wherein the subject is a composite material.
15. A system for facilitating ultrasonic analysis of a subject comprising at least one processor configured to perform the method of any one of claims 1 to 14.
16. A non-transitory computer readable medium having stored thereon codes which when executed by at least one processor cause the at least one processor to perform the method of any one of claims 1 to 14.
PCT/CA2019/051314 2018-09-18 2019-09-16 Ultrasonic analysis of a subject WO2020056500A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP19863419.8A EP3853598B1 (en) 2019-09-16 Ultrasonic analysis of a subject
CA3112852A CA3112852A1 (en) 2018-09-18 2019-09-16 Ultrasonic analysis of a subject
US17/206,002 US11131650B2 (en) 2018-09-18 2021-03-18 Ultrasonic analysis of a subject

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862732904P 2018-09-18 2018-09-18
US62/732,904 2018-09-18

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/206,002 Continuation US11131650B2 (en) 2018-09-18 2021-03-18 Ultrasonic analysis of a subject

Publications (1)

Publication Number Publication Date
WO2020056500A1 true WO2020056500A1 (en) 2020-03-26

Family

ID=69886869

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CA2019/051314 WO2020056500A1 (en) 2018-09-18 2019-09-16 Ultrasonic analysis of a subject

Country Status (3)

Country Link
US (1) US11131650B2 (en)
CA (1) CA3112852A1 (en)
WO (1) WO2020056500A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022009596A1 (en) * 2020-07-08 2022-01-13 国立大学法人愛媛大学 Device for inspecting composite material, method for inspecting composite material, and program for inspecting composite material

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11548161B2 (en) 2020-05-14 2023-01-10 The Boeing Company Methods of performing a plurality of operations within a region of a part utilizing an end effector of a robot and robots that perform the methods
US11639914B2 (en) 2020-12-16 2023-05-02 The Boeing Company Non-destructive test systems with infrared thermography assemblies and ultrasonic test assemblies, and associated methods

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060287596A1 (en) * 1996-08-29 2006-12-21 Techniscan, Inc. Apparatus and method for imaging objects with wavefields
EP3239706A1 (en) * 2016-04-29 2017-11-01 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for inspecting an object using ultrasonic waves in the field of material testing

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6385474B1 (en) 1999-03-19 2002-05-07 Barbara Ann Karmanos Cancer Institute Method and apparatus for high-resolution detection and characterization of medical pathologies
US10018712B2 (en) 2006-05-26 2018-07-10 Queen's University At Kingston Method for improved ultrasonic detection
WO2016198990A1 (en) 2015-06-12 2016-12-15 Koninklijke Philips N.V. System and method for identifying cancerous tissue
CN107847217A (en) 2015-07-27 2018-03-27 苏黎世联合高等工业学校 The method and apparatus shown for generating ultrasonic scattering body surface
WO2017192603A1 (en) 2016-05-02 2017-11-09 The Johns Hopkins University System for generating synthetic aperture ultrasound images during needle placement
DE102017201214A1 (en) * 2017-01-26 2018-07-26 Robert Bosch Gmbh Ultrasonic sensor device
WO2019141526A1 (en) 2018-01-19 2019-07-25 Koninklijke Philips N.V. Automated path correction during multi-modal fusion targeted biopsy

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060287596A1 (en) * 1996-08-29 2006-12-21 Techniscan, Inc. Apparatus and method for imaging objects with wavefields
EP3239706A1 (en) * 2016-04-29 2017-11-01 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for inspecting an object using ultrasonic waves in the field of material testing

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3853598A4 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022009596A1 (en) * 2020-07-08 2022-01-13 国立大学法人愛媛大学 Device for inspecting composite material, method for inspecting composite material, and program for inspecting composite material

Also Published As

Publication number Publication date
CA3112852A1 (en) 2020-03-26
US11131650B2 (en) 2021-09-28
US20210208107A1 (en) 2021-07-08
EP3853598A1 (en) 2021-07-28
EP3853598A4 (en) 2022-04-13

Similar Documents

Publication Publication Date Title
US11131650B2 (en) Ultrasonic analysis of a subject
US11344278B2 (en) Ovarian follicle count and size determination using transvaginal ultrasound scans
EP3382386B1 (en) Defect detection using ultrasound scan data
Mento et al. On the influence of imaging parameters on lung ultrasound B-line artifacts, in vitro study
EP1691194B1 (en) Methods and system for ultrasound inspection
CN107037131B (en) A kind of tiny flaw supersonic detection method based on the extreme value distribution theory
EP3982839B1 (en) Super-resolution microvessel imaging using separated subsets of ultrasound data
JP7266523B2 (en) Prenatal ultrasound imaging
CN105407809A (en) Diagnostic ultrasound apparatus and elasticity evaluation method
CN110446466B (en) Volume rendered ultrasound imaging
CN108490077A (en) A kind of real-time 3D total focus phased array supersonic imaging method, device and storage medium
CN114972567B (en) Medical ultrasonic CT multi-parameter image reconstruction method based on wave equation
CN106983524A (en) A kind of parameter and its measuring method for reflecting that biological tissue is abnormal
EP3771927A1 (en) Ultrasound system for detecting a flow of a fluid in a medium
CN112997075B (en) Method for ultrasonic detection and characterization of defects in heterogeneous materials
Gupta et al. Image denoising in acoustic microscopy using block-matching and 4D filter
MacGillivray et al. The resolution integral: visual and computational approaches to characterizing ultrasound images
CN110313940B (en) Signal attenuation calculation method, device, equipment and computer readable storage medium
JP2020103883A (en) Ultrasound imaging system and method for displaying target object quality level
Osman Automated evaluation of three dimensional ultrasonic datasets
EP3853598B1 (en) Ultrasonic analysis of a subject
Wilcox et al. Exploiting the Full Data Set from Ultrasonic Arrays by Post‐Processing
de Moura et al. Image-based ultrasound speed estimation in isotropic materials
CN110604595B (en) Fatty liver quantitative analysis method and fatty liver quantitative analysis system
Jadhav et al. Deep learning-based denoising of acoustic images generated with point contact method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19863419

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 3112852

Country of ref document: CA

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2019863419

Country of ref document: EP

Effective date: 20210419