US7715018B2 - 3-dimensional imaging by acoustic warping and defocusing - Google Patents
3-dimensional imaging by acoustic warping and defocusing Download PDFInfo
- Publication number
- US7715018B2 US7715018B2 US11/784,304 US78430407A US7715018B2 US 7715018 B2 US7715018 B2 US 7715018B2 US 78430407 A US78430407 A US 78430407A US 7715018 B2 US7715018 B2 US 7715018B2
- Authority
- US
- United States
- Prior art keywords
- scattering structure
- coordinate
- sensor array
- pairs
- response function
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related, expires
Links
- 238000003384 imaging method Methods 0.000 title abstract description 22
- 230000001419 dependent effect Effects 0.000 claims abstract description 46
- 238000005316 response function Methods 0.000 claims abstract description 39
- 239000000463 material Substances 0.000 claims description 43
- 238000000034 method Methods 0.000 claims description 35
- 238000004590 computer program Methods 0.000 claims description 23
- 230000008569 process Effects 0.000 claims description 20
- 230000004044 response Effects 0.000 description 16
- 230000006870 function Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 238000003491 array Methods 0.000 description 4
- 230000015654 memory Effects 0.000 description 4
- 239000002245 particle Substances 0.000 description 3
- 239000000523 sample Substances 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000012512 characterization method Methods 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000010355 oscillation Effects 0.000 description 2
- 238000000917 particle-image velocimetry Methods 0.000 description 2
- 238000000037 particle-tracking velocimetry Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000002604 ultrasonography Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000003292 diminished effect Effects 0.000 description 1
- 238000010348 incorporation Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000007620 mathematical function Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 238000011179 visual inspection Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
- G01S15/88—Sonar systems specially adapted for specific applications
- G01S15/89—Sonar systems specially adapted for specific applications for mapping or imaging
- G01S15/8906—Short-range imaging systems; Acoustic microscope systems using pulse-echo techniques
- G01S15/8993—Three dimensional imaging systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
- G01S15/88—Sonar systems specially adapted for specific applications
- G01S15/89—Sonar systems specially adapted for specific applications for mapping or imaging
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N29/00—Investigating or analysing materials by the use of ultrasonic, sonic or infrasonic waves; Visualisation of the interior of objects by transmitting ultrasonic or sonic waves through the object
- G01N29/04—Analysing solids
- G01N29/06—Visualisation of the interior, e.g. acoustic microscopy
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
- G01S15/88—Sonar systems specially adapted for specific applications
- G01S15/89—Sonar systems specially adapted for specific applications for mapping or imaging
- G01S15/8906—Short-range imaging systems; Acoustic microscope systems using pulse-echo techniques
- G01S15/8977—Short-range imaging systems; Acoustic microscope systems using pulse-echo techniques using special techniques for image reconstruction, e.g. FFT, geometrical transformations, spatial deconvolution, time deconvolution
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
- G01S7/52017—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 particularly adapted to short-range imaging
- G01S7/52023—Details of receivers
- G01S7/52025—Details of receivers for pulse systems
- G01S7/52026—Extracting wanted echo signals
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2291/00—Indexing codes associated with group G01N29/00
- G01N2291/10—Number of transducers
- G01N2291/106—Number of transducers one or more transducer arrays
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
- G01S7/52017—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 particularly adapted to short-range imaging
- G01S7/5205—Means for monitoring or calibrating
Definitions
- the present invention relates to a system for determining three-dimension (3-D) positional information of a scattering structure embedded within a material that is outside the traditional focal region of a characterized acoustic impulse signal and, more particularly, to a process for producing the 3-D positional information, size, and material composition of a scattering structure by inspecting artifacts in the form of sidelobes and other sources of distortion via the use of a look-up table or comparison function.
- Two-dimensional (2-D) imaging techniques may be used to determine the location of a material or scattering structure within another material with varying degrees of resolution and certainty.
- 2-D imaging only objects within the region of focus of a sensor array system become well-defined areas in an image slice. Objects outside the region of focus introduce blurred and warped artifacts. Thus, existing 2-D imaging systems do not provide sufficient imaging information with respect to objects in the extended region.
- the present invention is a system for determining the position of a scattering structure in three-dimensional (3-D) space using information from a two-dimensional (2-D) image.
- a process is performed through using a characterized sensor array to emit a signal from the sensor array into an object of interest to generate at least one 2-D representation of the object of interest.
- the 2-D representation comprises a plurality of x and y coordinate pairs and at least one candidate scattering structure.
- the candidate scattering structure is a shape defined by at least one pair of x and y coordinates.
- the candidate scattering structure shape is substantially restricted to the at least one pair of x and y coordinates.
- the at least one pair of x and y coordinates of the candidate scattering structure shape are then compared with a first coordinate-dependent response function to assign an x, y, and z position of a scattering structure in 3-D space.
- system is further configured with a second coordinate-dependent response function, where the first coordinate response function includes characteristics representing a first scattering structure comprised of a first material and a second coordinate-dependent response function representing a second scattering structure representing a second material.
- the system compares the at least one pair of x and y coordinates of the candidate scattering structure shape with a coordinate-dependent response function, at least one of the coordinate-dependent response functions further relates the candidate scattering structure view with the scattering structure size.
- the system further compares the at least one pair of x and y coordinates of the candidate scattering structure shape with a first coordinate-dependent response function.
- the coordinate-dependent response function is a look-up table comprising a plurality of relationships relating the x and y coordinate pairs of a candidate scattering structure view with an x, y, and z position in 3-D space.
- the signal of the characterized sensor array is an asymmetric signal.
- the system is further configured to perform a scattering structure registration operation.
- the scattering structure registration is performed by using the characterized sensor array to emit a signal from the sensor array into a known material to capture at least one 2-D image of a scattering structure of known size in at least one location in 3-D space.
- the scattering structure resides substantially within the known material such that at least one image of the scattering structure of known size is outside the region of focus of the characterized sensor array.
- An image shape and the x, y, and z positional information of the scattering structure in 3-D space are recorded in a coordinate-dependent look-up table. The position of the characterized sensor array with respect to the known material is then adjusted.
- a characterized sensor array is used again to emit a signal from the sensor array into a known material to capture at least one 2-D image of a scattering structure of known size in at least one location in 3-D space.
- the scattering structure resides substantially within the known material such that at least one image of the scattering structure of known size is within the region of focus of the characterized sensor array.
- an image shape and the x, y, and z positional information of the scattering structure in 3-D space are recorded in a coordinate-dependent look-up table.
- the present invention also includes a method and computer program product.
- the method comprises a plurality of acts that embody the operations described herein.
- the computer program product comprises computer-readable instruction means stored on a computer-readable medium that are executable by a computer for causing the computer to perform said operations.
- FIG. 1 is an illustration contrasting an in-focus area from which conventional two-dimensional (2-D) imaging techniques may extract information from a scattering structure and that area from which useful information may be extracted from out-of-focus scattering structures;
- FIG. 2A is a 2-D image of an in-focus scattering structure response to a sensor array signal
- FIG. 2B is a three-dimensional (3-D) graph illustrating a well-defined, coordinate-dependent response to a characterized sensor array signal source
- FIG. 2C is an image of an out-of-focus candidate scattering structure response to a somewhat distant-characterized sensor array signal source
- FIG. 2D is a 3-D graph illustrating a coordinate-dependent response to a somewhat distant-characterized sensor array signal source
- FIG. 2E is a 2-D image of an out-of-focus scattering structure response to a distant sensor array
- FIG. 2F is a 3-D graph illustrating a poorly defined coordinate-dependent response function in which the characterized sensor array signal source is a great distance away from the candidate scattering structure;
- FIG. 3 is an illustration of a sensor array and characterized sensor array signal used to detect both in-focus and out-of-focus scattering structures
- FIG. 4 is an illustration of both a top-view and side-view of a sensor array and characterized sensor array signal that is used to detect both in-focus and out-of-focus scattering structures;
- FIG. 5 is an illustration of a signal forming to create asymmetry in the x-y, y-z, or x-z planes to bias warping and defocusing in the scattering structures or object acoustic;
- FIG. 6 is a block diagram of a 3-D imaging system according to the present invention.
- FIG. 7 is illustrative diagram of a computer program product embodying the present invention.
- the present invention is an improved process for determining positional information in three dimensions of a scattering structure embedded within a material using acoustic imaging techniques.
- the following description is presented to enable one of ordinary skill in the art to make and use the invention and to incorporate it in the context of particular applications. Various modifications, as well as a variety of uses in different applications will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to a wide range of embodiments. Thus, the present invention is not intended to be limited to the embodiments presented, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
- any element in a claim that does not explicitly state “means for” performing a specified function, or “step for” performing a specific function, is not to be interpreted as a “means” or “step” clause as specified in 35 U.S.C. Section 108, Paragraph 6.
- the use of “step of” or “act of” in the claims herein is not intended to invoke the provisions of 35 U.S.C. 108, Paragraph 6.
- Asymmetric signal refers to a signal which lacks symmetry in either the in x-y, y-z, or x-z planes. Generally, the asymmetric signal may be any signal which may be used to bias warping and defocusing in a candidate scattering structure.
- Candidate Scattering Structure refers to a shape in a two-dimensional (2-D) acoustic image defined by at least one pair of x and y coordinates which may or may not be associated with a scattering structure.
- Characterized Sensor Array refers to a sensor array in which the strength and shape of the emitted signal from the sensor array has been measured in the x, y, and z dimensions.
- the parameters of the characterized sensor array may be established immediately following production of the sensor array, prior to searching for candidate scattering structures embedded within a material, or subsequent to searching for the candidate scattering structures. In general, it is desirable to characterize the sensor array prior to searching for candidate scattering structures in order to expedite the searching process.
- Coordinate-Dependent Response Function refers to a table or mathematical function relating information gathered from a scattering structure in response to a characterized sensor array signal where the distance between the scattering structure and characterized sensor array has been varied.
- Instruction means generally indicates a set of operations to be performed on a computer, and may represent pieces of a whole program or individual, separable, software modules.
- Non-limiting examples of “instruction means” include computer program code (source or object code) and “hard-coded” electronics (i.e., computer operations coded into a computer chip).
- the “instruction means” may be stored in the memory of a computer or on a computer-readable medium such as a floppy disk, a CD-ROM, and a flash drive.
- Sensor Array is used to describe any system of cooperative signal emitters and signal receivers used to gather response information from both in focus and out of focus scattering structures.
- suitable sensor arrays include standard sonic imaging systems such as a one dimension (1-D) linear array of sensing elements, one and one-half dimension (1.5-D) phased arrays, two dimension (2-D) arrays, and, in general, arbitrary 3-D distributions of transmitting and sensing elements.
- an array of sensors 100 can be configured to emit a signal 102 into an object of interest 104 and in return receive a response signal as the signal 102 propagates through the material 104 back towards the sensor array 100 .
- the array of sensors 100 is any suitable sensor array that is capable of emitting and receiving a signal, a non-limiting example of which includes an array of piezoelectric transducers.
- scattering structures 106 within the material 104 oscillate back and forth in response to the signal 102 .
- a scattering structure 106 will respond to an emitted signal 102 with a characteristic response related to the size and material composition of the scattering structure 106 , the distance between the scattering structure 106 and the sensor array 100 , and the emission pattern of the sensor array 100 .
- the vibrations of the scattering structures 106 are picked up by the sensor array 100 as the vibrations are transferred through the material 104 .
- the signal 102 from the sensor array 100 is essentially limited to two planes, for example the x and z plane, a scattering structure 108 outside the focal region 110 of the sensor array 100 will begin to oscillate in response to a scattering structure 106 within the focal region 110 .
- the oscillations of these out-of-focus scattering structures 108 make a small contribution to the signal received by the sensor array 100 , which often appear as obscured candidate scattering structure images 214 in the 2-D representations 204 , shown in FIG. 2A .
- the oscillations within the focal region 110 produce the clearest 2-D representations 204 of potential candidate scattering structures 200 .
- These 2-D images 204 of the candidate scattering structures 200 when combined with an asymmetric signal, can be used to detect additional information in a third dimension to produce a well-defined image slice 202 , such as the one shown in FIG. 2B .
- a registration process for a scattering structure 106 in a known material 104 may be conducted by capturing images 204 , 206 , and 210 with a characterized and asymmetric signal 102 .
- the registration process characterizes a sensor array signal 102 and its point spread function into a warping map, which, like a fingerprint, is unique to the geometry and materials 104 comprising that array.
- This process involves recording the image of a scattering structure 106 with a known size at a number of positions within the entire field of view 114 of the sensing array 100 , which includes both the focused region 110 and defocused region 112 .
- This information is then loaded into a look-up table and a mathematical de-convolution is performed with a standard image to extract scattering structure locations above 400 and 400′ and below 406 and 406′ the focal region 412 (see FIG. 4 ).
- the scattering structures appear as blurred or warped regions, and not sharp particles in captured 2-D images. With increasing z-distance, the point spread function tends to become more diffuse. The registration process takes this spread into account to calculate a more precise location of the scattering structure, despite the spread in pixels.
- the present invention determines 3-D position information of acoustic scattering structures 106 inside the focal region 110 and scattering structures 108 in the area 112 outside the boundaries of the focal region 110 of the sensor array 100 acoustic signal 102 (such as in standard 2-D-slice ultrasound).
- images (see FIGS. 2A , 2 C, and 2 E) produced through standard acoustic reflection techniques may be analyzed for out-of-focus data 200 ′ and 200 ′′ present in the form of warped or blurred artifacts.
- FIGS. 2A , 2 C and 2 E illustrate a sequence of 2-D ultrasound images of a reflector whose position changes in each frame. The probe is centered at the top of each image.
- FIGS. 2B , 2 D, and 2 F illustrate the corresponding 3-D representations.
- the scattering structure is near the probe, which produces a well-defined (sharp) image slice.
- the image slice loses definition (sharpness).
- This changing profile, or point spread function changes with position in x, y, and z. While these images show the changes within the x-z plane, the registration process also performs characterization in the y-direction (which is into and out of the page) to characterize the sonic array for de-warping in 3-D for particle locating.
- Scattering structures appear different in the image depending on where in the field of view they are located (see FIGS. 2A , 2 C, and 2 E). With increasing z-distance, the point spread function (see FIGS. 2B , 2 D, and 2 F) tends to become more diffuse. The registration process takes this spread into account to calculate a more precise location of the scattering structure, despite the spread in pixels.
- the present invention utilizes acoustic and other qualitative positional analysis to identify the x-y-z position in a “right-handed coordinate system” of out-of-focus 108 and out-of-plane reflectors.
- the asymmetric properties of the signal 310 enable reflected signals from out-of-beam scattering structures 302 and out-of-focus scattering structures 306 to contribute discernable positional information with regard to their x-y-z position.
- the collected scattering structure information can be used to develop a coordinate-dependent response look-up table or response function.
- a perspective view of scattering structures 302 , 304 , and 306 demonstrates possible scattering positions during the registration process. FIG.
- FIG. 3 illustrates the spatial relationship between the sensor array 300 , an emitted characterized signal 310 , a close-proximity scattering structure 302 , an in-focus scattering structure 304 , and an out-of-focus in-signal scattering structure 306 .
- the asymmetric signal 310 has an in-focus area 308 , which is by definition the narrowest portion of the signal.
- a scattering structure 306 within the in-focus area 308 will typically produce a clean 2-D images 200 , as shown in FIG. 2A .
- a series of 2-D images can be iteratively produced.
- the 2-D images are used to develop the coordinate-dependent response look-up table.
- the scattering structure 302 , 304 , and 306 will respond with a distribution based on the shape of the originating signal pattern 310 .
- out-of-focus in signal scattering structures 306 can be inferred to have a height in the y-direction, which is generally not available data in 2-D imaging.
- above scattering structures 302 versus below scattering structures 308 are distinguished by actively imparting asymmetry into the beam pattern so that the beam profile is identifiable top or bottom.
- FIG. 4 illustrates three acoustic reflectors, 402 , 404 , and 406 , each having the same x-coordinate, but at varying distance, z, from the sensor array.
- the three reflectors 402 , 404 , and 406 are also at positions that vary in y, above and below the image plane (x-z).
- Reflector 402 is within the focal plane at the optimum location for 2-D imaging which would show up as a sharply defined reflector in a standard image.
- Reflector 406 is beyond the optimum focal distance.
- reflector 406 appears as a much larger structure (in number of pixels) that is not sharply defined and generally weaker in overall response brightness.
- the present invention determines a more precise distance in z, as well as distance from an x-y image plane in y based on a comparison with the look up table.
- reflector 404 is in the nearfield and substantially above the imaging plane. Some energy is transmitted and received from a reflector in such a position. In standard imaging, such a response is typically not seen by visual inspection due to the energy being spread over many or all of the pixels in the obtained 2-D image.
- the present invention finds such reflectors by matching large diffuse regions of the 2-D image with the look-up table.
- the look-up tables can also be referred to as warping maps, each of which may be created for a different material through the registration process.
- Signal forming and warping may be used to form an asymmetric signal 510 such as the one shown in FIG. 5 .
- the asymmetric signal 510 may be created to code an upper half plane, the area above the nominal signal plane 508 , as well as a bottom half plane, the area below the nominal signal plane 508 .
- the asymmetry of the signal 510 is able to reflect back to the sensor 500 a coordinate-dependent response function that will reveal the plane in which the structure 512 resides.
- FIG. 5 illustrates a possible signal forming shape 510 that includes an upper lobe 502 , a center lobe 506 , and a bottom lobe 504 to create asymmetry in x-y, y-z or x-z planes to bias warping and defocusing in the scattering structure 512 .
- Possible methods for signal forming include, but are not limited to, phase array distortion, acoustic lenses, and spatial-complete or partial-path blockage.
- the present invention has three “principal” aspects.
- the first is a system for 3-D imaging using acoustic warping and defocusing.
- the system is typically in the form of a computer system operating software or in the form of a “hard-coded” instruction set. This system may be incorporated into a wide variety of devices that provide different functionalities.
- the second principal aspect is a method, typically in the form of software, operated using a data processing system (computer).
- the third principal aspect is a computer program product.
- the computer program product generally represents computer-readable instructions stored on a computer-readable medium such as an optical storage device, e.g., a compact disc (CD) or digital versatile disc (DVD), or a magnetic storage device such as a floppy disk or magnetic tape.
- a computer-readable medium such as an optical storage device, e.g., a compact disc (CD) or digital versatile disc (DVD), or a magnetic storage device such as a floppy disk or magnetic tape.
- the image processing system 600 comprises an input 602 for receiving information from at least one sensor (e.g., transducer array) for use in detecting an image.
- the input 602 may include multiple “ports.”
- input is received from at least one sensor, non-limiting examples of which include video image sensors.
- An output 604 is connected with the processor for providing information regarding the presence and/or identity of object(s) in the scene to other systems in order that a network of computer systems may serve as an imaging system. Output may also be provided to other devices or other programs; e.g., to other software modules, for use therein.
- the input 602 and the output 604 are both coupled with a processor 606 , which may be a general-purpose computer processor or a specialized processor designed specifically for use with the present invention.
- the processor 606 is coupled with a memory 608 to permit storage of data and software that are to be manipulated by commands to the processor 606 .
- FIG. 7 An illustrative diagram of a computer program product embodying the present invention is depicted in FIG. 7 .
- the computer program product 700 is depicted as an optical disk such as a CD or DVD.
- the computer program product generally represents computer-readable instructions stored on any compatible computer-readable medium.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Acoustics & Sound (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Analytical Chemistry (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Health & Medical Sciences (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Investigating Or Analyzing Materials By The Use Of Ultrasonic Waves (AREA)
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
- Image Processing (AREA)
- Length Measuring Devices Characterised By Use Of Acoustic Means (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
Description
Claims (19)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US11/784,304 US7715018B2 (en) | 2006-04-05 | 2007-04-05 | 3-dimensional imaging by acoustic warping and defocusing |
| US12/729,100 US8169621B2 (en) | 2006-04-05 | 2010-03-22 | 3-dimensional imaging by acoustic warping and defocusing |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US78933506P | 2006-04-05 | 2006-04-05 | |
| US11/784,304 US7715018B2 (en) | 2006-04-05 | 2007-04-05 | 3-dimensional imaging by acoustic warping and defocusing |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US11/724,067 Continuation US7685869B2 (en) | 2006-03-13 | 2007-03-13 | Nanoindenter |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US12/729,100 Continuation US8169621B2 (en) | 2006-04-05 | 2010-03-22 | 3-dimensional imaging by acoustic warping and defocusing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US20070236694A1 US20070236694A1 (en) | 2007-10-11 |
| US7715018B2 true US7715018B2 (en) | 2010-05-11 |
Family
ID=39204976
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US11/784,304 Expired - Fee Related US7715018B2 (en) | 2006-04-05 | 2007-04-05 | 3-dimensional imaging by acoustic warping and defocusing |
| US12/729,100 Expired - Fee Related US8169621B2 (en) | 2006-04-05 | 2010-03-22 | 3-dimensional imaging by acoustic warping and defocusing |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US12/729,100 Expired - Fee Related US8169621B2 (en) | 2006-04-05 | 2010-03-22 | 3-dimensional imaging by acoustic warping and defocusing |
Country Status (6)
| Country | Link |
|---|---|
| US (2) | US7715018B2 (en) |
| EP (1) | EP2013641A2 (en) |
| JP (1) | JP2009532702A (en) |
| KR (1) | KR20080110779A (en) |
| CN (1) | CN101460863B (en) |
| WO (1) | WO2008054496A2 (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100245844A1 (en) * | 2006-04-05 | 2010-09-30 | California Institute Of Technology | 3-Dimensional Imaging by Acoustic Warping and Defocusing |
| US9219907B2 (en) | 2007-01-22 | 2015-12-22 | California Institute Of Technology | Method and apparatus for quantitative 3-D imaging |
| US9247235B2 (en) | 2008-08-27 | 2016-01-26 | California Institute Of Technology | Method and device for high-resolution imaging which obtains camera pose using defocusing |
| WO2017034784A1 (en) * | 2015-08-21 | 2017-03-02 | Sony Corporation | Defocus estimation from single image based on laplacian of gaussian approximation |
| US9596452B2 (en) | 2009-08-11 | 2017-03-14 | California Institute Of Technology | Defocusing feature matching system to measure camera pose with interchangeable lens cameras |
| US9736463B2 (en) | 2007-04-23 | 2017-08-15 | California Institute Of Technology | Single-lens, single-sensor 3-D imaging device with a central aperture for obtaining camera position |
| US10182223B2 (en) | 2010-09-03 | 2019-01-15 | California Institute Of Technology | Three-dimensional imaging system |
| US11406264B2 (en) | 2016-01-25 | 2022-08-09 | California Institute Of Technology | Non-invasive measurement of intraocular pressure |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8089635B2 (en) | 2007-01-22 | 2012-01-03 | California Institute Of Technology | Method and system for fast three-dimensional imaging using defocusing and feature recognition |
| EP2459069B1 (en) * | 2009-07-29 | 2013-06-19 | Koninklijke Philips Electronics N.V. | X-ray examination device and method |
| US8773514B2 (en) * | 2009-08-27 | 2014-07-08 | California Institute Of Technology | Accurate 3D object reconstruction using a handheld device with a projected light pattern |
| US10210858B2 (en) | 2015-06-30 | 2019-02-19 | Pixie Dust Technologies, Inc. | System and method for manipulating objects in a computational acoustic-potential field |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5235857A (en) | 1986-05-02 | 1993-08-17 | Forrest Anderson | Real time 3D imaging device using filtered ellipsoidal backprojection with extended transmitters |
| US5714762A (en) * | 1993-11-09 | 1998-02-03 | British Nuclear Fuels Plc | Determination of the surface properties of an object |
| WO2001086281A1 (en) | 2000-05-05 | 2001-11-15 | Acoustical Technologies Singapore Pte Ltd. | Acoustic microscope |
Family Cites Families (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB8617567D0 (en) * | 1986-07-18 | 1986-08-28 | Szilard J | Ultrasonic imaging apparatus |
| JP2878409B2 (en) * | 1989-09-04 | 1999-04-05 | 株式会社リコー | 3D object imaging method |
| JP2882861B2 (en) * | 1989-09-07 | 1999-04-12 | 株式会社リコー | Ultrasound 3D object imaging method |
| JPH04276785A (en) * | 1991-03-04 | 1992-10-01 | Ricoh Co Ltd | Ultrasonic three-dimensional object recognizing system |
| CA2150676A1 (en) * | 1992-12-02 | 1994-06-09 | Francine J. Prokoski | Method and apparatus for flash correlation |
| JP2738244B2 (en) * | 1992-12-09 | 1998-04-08 | 三菱電機株式会社 | Radar equipment |
| JP3281946B2 (en) * | 1994-05-25 | 2002-05-13 | 日本電信電話株式会社 | 3D object recognition method |
| JP3245606B2 (en) * | 1994-10-04 | 2002-01-15 | 独立行政法人産業技術総合研究所 | Measurement method of particle dispersion amount and particle size of solid material |
| AU4720197A (en) * | 1996-11-07 | 1998-05-29 | Tomtec Imaging Systems Gmbh | Method and apparatus for ultrasound image reconstruction |
| US5810008A (en) * | 1996-12-03 | 1998-09-22 | Isg Technologies Inc. | Apparatus and method for visualizing ultrasonic images |
| JP3416730B2 (en) * | 2000-05-12 | 2003-06-16 | 防衛庁技術研究本部長 | Target identification system by radar |
| JP3699903B2 (en) * | 2001-03-16 | 2005-09-28 | アロカ株式会社 | Ultrasonic diagnostic equipment |
| US6554771B1 (en) * | 2001-12-18 | 2003-04-29 | Koninklijke Philips Electronics N.V. | Position sensor in ultrasound transducer probe |
| JP2004046772A (en) * | 2002-05-13 | 2004-02-12 | 3D Media Co Ltd | Method, system and apparatus for processing image |
| EP2013641A2 (en) * | 2006-04-05 | 2009-01-14 | California Institute of Technology | 3- dimensional imaging by acoustic warping and defocusing |
-
2007
- 2007-04-05 EP EP07867059A patent/EP2013641A2/en not_active Withdrawn
- 2007-04-05 US US11/784,304 patent/US7715018B2/en not_active Expired - Fee Related
- 2007-04-05 JP JP2009504318A patent/JP2009532702A/en active Pending
- 2007-04-05 KR KR1020087024339A patent/KR20080110779A/en not_active Ceased
- 2007-04-05 CN CN2007800207700A patent/CN101460863B/en not_active Expired - Fee Related
- 2007-04-05 WO PCT/US2007/008598 patent/WO2008054496A2/en not_active Ceased
-
2010
- 2010-03-22 US US12/729,100 patent/US8169621B2/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5235857A (en) | 1986-05-02 | 1993-08-17 | Forrest Anderson | Real time 3D imaging device using filtered ellipsoidal backprojection with extended transmitters |
| US5714762A (en) * | 1993-11-09 | 1998-02-03 | British Nuclear Fuels Plc | Determination of the surface properties of an object |
| WO2001086281A1 (en) | 2000-05-05 | 2001-11-15 | Acoustical Technologies Singapore Pte Ltd. | Acoustic microscope |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100245844A1 (en) * | 2006-04-05 | 2010-09-30 | California Institute Of Technology | 3-Dimensional Imaging by Acoustic Warping and Defocusing |
| US8169621B2 (en) * | 2006-04-05 | 2012-05-01 | California Institute Of Technology | 3-dimensional imaging by acoustic warping and defocusing |
| US9219907B2 (en) | 2007-01-22 | 2015-12-22 | California Institute Of Technology | Method and apparatus for quantitative 3-D imaging |
| US9736463B2 (en) | 2007-04-23 | 2017-08-15 | California Institute Of Technology | Single-lens, single-sensor 3-D imaging device with a central aperture for obtaining camera position |
| US9247235B2 (en) | 2008-08-27 | 2016-01-26 | California Institute Of Technology | Method and device for high-resolution imaging which obtains camera pose using defocusing |
| US9596452B2 (en) | 2009-08-11 | 2017-03-14 | California Institute Of Technology | Defocusing feature matching system to measure camera pose with interchangeable lens cameras |
| US10182223B2 (en) | 2010-09-03 | 2019-01-15 | California Institute Of Technology | Three-dimensional imaging system |
| US10742957B2 (en) | 2010-09-03 | 2020-08-11 | California Institute Of Technology | Three-dimensional imaging system |
| WO2017034784A1 (en) * | 2015-08-21 | 2017-03-02 | Sony Corporation | Defocus estimation from single image based on laplacian of gaussian approximation |
| US9646225B2 (en) | 2015-08-21 | 2017-05-09 | Sony Corporation | Defocus estimation from single image based on Laplacian of Gaussian approximation |
| US11406264B2 (en) | 2016-01-25 | 2022-08-09 | California Institute Of Technology | Non-invasive measurement of intraocular pressure |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101460863B (en) | 2012-06-06 |
| US8169621B2 (en) | 2012-05-01 |
| CN101460863A (en) | 2009-06-17 |
| WO2008054496A3 (en) | 2008-07-31 |
| KR20080110779A (en) | 2008-12-19 |
| JP2009532702A (en) | 2009-09-10 |
| US20070236694A1 (en) | 2007-10-11 |
| EP2013641A2 (en) | 2009-01-14 |
| WO2008054496A2 (en) | 2008-05-08 |
| US20100245844A1 (en) | 2010-09-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8169621B2 (en) | 3-dimensional imaging by acoustic warping and defocusing | |
| Santos et al. | Image-based 3D digitizing for plant architecture analysis and phenotyping | |
| CN109425657A (en) | Linear scan ultrasonic flaw detecting device and linear scan defect detection on ultrasonic basis | |
| US9730675B2 (en) | Ultrasound imaging system and an ultrasound imaging method | |
| CN100457046C (en) | Real-time ultrasound quantification using acoustic data in more than two dimensions | |
| CN102818851B (en) | Detection method for ultrasonic detection of arc-shaped corner of L-shaped workpeice | |
| CN103747729A (en) | Three-dimensional needle localization with two-dimensional imaging probe | |
| US20130070257A1 (en) | Three-Dimensional Scanning System | |
| WO2018195946A1 (en) | Method and device for displaying ultrasonic image, and storage medium | |
| JPWO2012086152A1 (en) | Ultrasonic image generation apparatus and image generation method | |
| CN101828109A (en) | Method and device for the non-destructive material testing of a test object using ultrasonic waves | |
| TW201205043A (en) | Distance measuring system and distance measuring method | |
| CN109490419A (en) | A kind of acoustic beam calibration method of total focus imaging | |
| JP2012502682A (en) | 3D ultrasound imaging using volumetric data processing | |
| JP7167045B2 (en) | Location devices and systems for positioning acoustic sensors | |
| CN107690312A (en) | Supersonic imaging device | |
| JP7091191B2 (en) | Ultrasonic flaw detector and ultrasonic flaw detector method | |
| CN109709206B (en) | Method for measuring defects of R-angle structure based on ultrasonic phased array technology | |
| CN103211618B (en) | The method being shaped for ultrasonic focal spot | |
| JP7261870B2 (en) | Systems and methods for tracking tools in ultrasound images | |
| Plotnick et al. | Circular synthetic aperture sonar imaging of simple objects illuminated by an evanescent wavefield | |
| Krieg et al. | SAFT processing for manually acquired ultrasonic measurement data with 3D smartInspect | |
| KR20180053718A (en) | Apparatus and method for generating data representing a pixel beam | |
| JP4972678B2 (en) | Ultrasonic measuring device, ultrasonic sensor and ultrasonic measuring method used therefor | |
| KR102512104B1 (en) | Apparatus and method for generating 3d ultrasound image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: CALIFORNIA INSTITUTE OF TECHNOLOGY, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:GHARIB, MORTEZA;ADAMS, JOSHUA;REEL/FRAME:019659/0317;SIGNING DATES FROM 20070607 TO 20070709 Owner name: CALIFORNIA INSTITUTE OF TECHNOLOGY,CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:GHARIB, MORTEZA;ADAMS, JOSHUA;SIGNING DATES FROM 20070607 TO 20070709;REEL/FRAME:019659/0317 |
|
| AS | Assignment |
Owner name: NATIONAL SCIENCE FOUNDATION, VIRGINIA Free format text: CONFIRMATORY LICENSE;ASSIGNOR:CALIFORNIA INSTITUTE OF TECHNOLOGY;REEL/FRAME:019897/0411 Effective date: 20070907 Owner name: NATIONAL SCIENCE FOUNDATION,VIRGINIA Free format text: CONFIRMATORY LICENSE;ASSIGNOR:CALIFORNIA INSTITUTE OF TECHNOLOGY;REEL/FRAME:019897/0411 Effective date: 20070907 |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
| FPAY | Fee payment |
Year of fee payment: 4 |
|
| MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2552) Year of fee payment: 8 |
|
| FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
| LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
| STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
| FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20220511 |