Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
  • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
  • G06V40/12—Fingerprints or palmprints
  • G06V40/13—Sensors therefor
  • G06V40/1306—Sensors therefor non-optical, e.g. ultrasonic or capacitive sensing
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
  • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
  • G06V40/12—Fingerprints or palmprints
  • G06V40/1382—Detecting the live character of the finger, i.e. distinguishing from a fake or cadaver finger
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V20/00—Scenes; Scene-specific elements
  • G06V20/60—Type of objects
  • G06V20/64—Three-dimensional objects
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
  • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
  • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
  • G06V40/12—Fingerprints or palmprints
  • G06V40/1347—Preprocessing; Feature extraction
  • G06V40/1359—Extracting features related to ridge properties; Determining the fingerprint type, e.g. whorl or loop
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
  • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
  • G06V40/12—Fingerprints or palmprints
  • G06V40/1365—Matching; Classification
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
  • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
  • G06V40/14—Vascular patterns
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
  • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
  • G06V40/15—Biometric patterns based on physiological signals, e.g. heartbeat, blood flow

Definitions

• Fingerprinting is one of the most widely used biometric for human identification. Identification is obtained by analyzing a given fingerprint image obtained by a fingerprint sensor for the: relati ve locations and orientations of structural elements such as branch ing or ending of ridges and valleys kno wn as minuiia. These characteristics are obtained in the enrol lment mode of a person's finger or multiple fingers. In the verification mode a second fingerprint is obtained and analyzed for similarity based on minuiia or other previously defined fingerprint characteristics. This minutia is also referred to herein as a type of biometric marker.
• the probability for false identi ication either a false acceptance or false rejection depends on the number of minutia identified in the fingerprint.
• the numbe of minutia increase with the fingertip area being scanned.
• a small area fingerprint sensor is very desirable for integration of fingerprint sensors into mobile devices for access control, such as cell phone.
• Sonavation, Inc. of Palm Beach Gardens, Florida, USA manufactures biometric sensing devices having a ceramic Micro-Electro Mechanical System (MEMS) piezoelectric array that is. made from a ceramic composite material.
• MEMS Micro-Electro Mechanical System
• This piezoelectric material is formed into a pillar 1 10th the diameter of a human hair, it. has a unique set of properties that enable it to -mechanically oscillate when an electric field is applied or create an electrical voltage when mechanically vibrated.
• the piezoelectric pillar is electrically vibrated at its natural ultrasonic resonant frequency.
• a fingerprint ridge is directly above the pillar, much of the ultrasonic energy is absorbed by the skin and the signal impedance of the pillar is ver - high, if a valley is directly above the pillar, very little energy is absorbed and the impedance is very low.
• An imaging ASIC electrically controls the pillar oscillation, imaging of the fingerprint and data management of the fingerprint information.
• U.S. Patent No. 7.141.918 describes an biometiie sensing device having the above piezoelectric array operable for fingerprint imaging. It has been found as also described in this patent that the piezoelectric array can be operated in non-fingerprint imaging modes to obtai other biometric information, such as in an echo mode to provide imaging, such as: bone, or a Dopp!er-shift mode to detect blood flow velocity and blood flow patterns. Although the sensor described in this patent is useful, it would be desirable to also operate the sensing device in a three-dimension ultrasound imaging mode to provide improved imaging of subcutaneous structures for use in biometric identification (or medical applications) that does not rely on echo mode imaging as described in U.S. Patent No. 7,141,918.
• a biometric sensing device having a piezoelectric array providing improved three -dimensi n imaging of subcutaneous tissue structures of a finger, -such as bone or vasculature, utilizing pitch/catch ultrasonieally formed images.
• subcutaneous iissue structures of a finger where such images are useful for further providing proof of life parameters.
• the present invention embodies a biometric sensing device having an array of piezoelectric ceramic elements operable in a first mode for producing first dat representative of a fingerprint image, and a second mode for producing second data representative of least one three-dimensional image of subcutaneous iissue structure(s), such as or bone or vascular, formed by pitc -n-cateh ultrasound imaging.
• the images provided from operating the sensing device in the first and second modes provide anatomical and
• biometric identification morphological biometrics (biomeirie data) for use in biometric identification
• subcutaneous tissue structure may also be used for determining elastic properties of tissue, and vita! or proof of life parameters, i,e, physiological information, such as heart beat, blood flow velocities, and pulse wave" pattern- or other parameters which can be used to determine if the finger disposed upon the sensor array is fake or dead.
• physiological information such as heart beat, blood flow velocities, and pulse wave" pattern- or other parameters which can be used to determine if the finger disposed upon the sensor array is fake or dead.
• biometrics ⁇ biometric data
• multiple types: of biometric data can obtained with a single application of a finger to the sensor array, which can be done in real-time and simultaneously,
• FIG. 1A is a schematic diagram of a top down view of a piezoelectric identification device according to the present invention
• FIG. I B is a side perspecti ve view of the piezoelectric identification device in which pillars (elements) are evenly spaced and are separated by filler material
• FIG. 2 a schematic illustration of the sensor array addressing scheme is shown, where there are M by N number of elements 1.1, ' disposed in M rows along an x axis and in columns along a y axis.
• FIG. 3 illustrates an identification device thai is coupled to a computer system.
• FIG. 4 illustrates cross-section of sensor array 10 and of a finger 30 placed proximate to an upper surface of the sensor array so that the finger's surface 31 is in direct contact with its protective shield 23.
• FIG, 5 illustrates a scan aperture 40 thai is scanned by processor 13 with respect to an x axis (M rows) and y axis (N columns) dimensions of the scan aperture, like shown in FIG. 2,
• FIG. 6A illustrates a transmit aperture 41 that is selected by processor 13 to form a transmit beam or pulse 46 (shown as a translucent volume) having an hour-glass shape, having 6 transmit .channels.
• FIG. 6B illustrates transmit signals traveling via channels A-F.
• FIG. 7A illustrates a receive aperture 42 selected by processor 13 to receive acoustic energy (beam or pulse 49), FIG. 7B ill strates transmit signals received via channels A-F.
• FIG, 8 illustrates a combined output signal 54.
• FIG. 9 illustrates ultrasound scanning of a blood vessel 50 within a finger via a sensor array.
• FIG. 10 illustrates ultrasound scanning of a bone structure within a finger via a sensor array.
• FIG. 1 1 illustrates operation of the identification device 9 oF FIG. 3 while scanning a finger via a sensor array, like shown in FIGS. 4, 9 and 10.
• FIG. 12 is a simplified illustration of sensor control hardware and software.
• FIG, 13 illustrates an alternative hardware for transmitting and receivin signals to and from the sensor array.
• Identification device 9 has a sensor array 10 of piezo-efectrie elements i 1 providing mechanical resonator sensing, a sensor input signal generator 12, and a processor 13. Under control of processor 13, the input signal generated by input signal generator 12 is coupled to sensor array 10 by a signal multiplexer 15a, and output signal of sensor 10 is coupled to processor 13 by a multiplexer 15b.
• Processor 1 3 processes the output signals from select element(s) via multiplexor 15b to obtain biometric data which may then be stored in a memory 14.
• Biometrie data can include one or more fingerprint images, and/or one or more ultrasound, images of subcutaneous structures of the finger, subcutaneous tissue parameters) such as of tissue elasticity, and/or detected proof of life parameters, as described later below.
• Addressing of elements 11, via multiplexers 1 5a and 1 5b, is enabled via a mu controller 1 6 in accordance with user specified imaging modes and/or in detection of proof of lif ' parameters.
• each multiplexor 1.5 and 15b is shown singularly, each multiplexor's function may alternatively be designed to be provided by two or more multiplexors as desired.
• Sensor array elements 1 1 may be of lead zireonate titanate (PZT) or other material having similar properties, preferably, PZT 1 -3 composite.
• the piezo-eeramie elements 1 1 can have shapes other than rectangular, such as circular as shown in FIG. 2.
• Sensor area 10 is preferably provided on a support layer, such as described in the above incorporated patent.
• Other ASIC chips may provide the electronics shown in FIG. 1 A to which the sensor is connected
• FIG. 1 B A more detailed view of sensor array 10 is shown in FIG. 1 B in which elements 1 i represent evenl spaced pillars 1 1 with filler material 17 there between.
• Filler material 17 may be an epoxy or polymer having micro-spheres.
• Transmit electrodes (or lines) 19 and receive electrodes (or lines) 20 are provided above and below, respecti vely, along sensor array 10.
• a shield or protective coating layer 22 such as ureihane providing a surface 23 upon which a fingertip may be placed.
• a support substrate 24, such as of foam material is provided below the receive electrodes 20 .
• Transmit electrodes 19 are parallel conductors that connect to the top of elements 1 1 in rows. 1 ' to M, while receive electrodes 20 are parallel conductors mat connect to bottom of elements 1 1 in columns 1 to N.
• each element i I is 40 microns square by 100 microns deep, thereby yielding a dense sensor array 10 having a 20 MHz fundamental frequency sonic wave elements 1 1.
• a spacing of 10 microns is used between elements 1 1 and is preferred in order to provide a 50-micron total pitch between elements.
• Other geometries may be used, such as for example, a pitch of greater or lower than 50 microns.
• a sensor with 368 rows and 256 columns may be 18,7 by 13 mm, or other size according to the maximum imaging size desired for the particular application.
• sensor array 10 may be manufactured as described in U.S. Patent No, 7,489,066, which is herein incorporated by reference.
• elements 1 1 are individually addressable for application of an input signal by row, and then addressable for reading out an output signal by column, by selection of electrodes 19 and 20, via multiplexors 1 5a and 1 b, respectively.
• a ground switch 26 is provided coupled to all transmit electrodes 1 between edge connector 19a and multiplexor 1 5a enabling processor 1 3 to connect electrodes 1 to ground when needed.
• a ground switch 27 is provided coupled to all receive electrodes 20 between edge connector 20a and multiplexor 15b enabling processor 1 3 enabling processor 13 to connect electrodes 20 to ground when needed.
• the benefi t of ground switches 26 and 27 is that it avoids additional switching of ground and signal electrodes as described in U.S. Patent No. 7, 141 ,918, thereby avoiding unwanted additional eapacitive loads parallel to the transmitting and receiving elements 1 1.
• processor 13 is programmed within its embedded merhory (or memory 14) to enable all sensing operations by sensor array 10 as described herein, including at least fingerprint imaging, and three-dimensional ultrasound imaging, Further, processor 13 may provide other activities commonly implemented in an ultrasonic imaging system as part of electronic beam formation including synthetic aperture imaging.
• identification device is coupled to a computer system 28 for data communication to send commands and receive biometric data from identification device 9.
• Computer system 28 may be any microprocessor-based device operating in accordance with a program or instructions which utilizes identification device 9 to obtai biometric data via sensor array 10 as needed for identification ⁇ e.g., verification and/or enrollment) of biometric data.
• Such computer system 28 uses biometric data collected from ihe sensor to enable biometric feature or identifier matching in accordance with a database or memory within system 28, or accessible to system 28, For example, computer system 28 may foe part of portable identification, device, point of transaction system, or any other device requiring secure biometric sensing to enable access to physical and/or electronic resources.
• FIG. 4 illustrates a cross-section of sensor array 10 of the device 9, and a finger .30 placed proximate to the sensor array so that the finger's surface 3 1 is in drreet contact with its protective shield 23.
• the finger's Such surface 31 has ridges 32 whic make such direct contact, and valleys 33 which do not make such direct contact with the protective shield 23, When an element 11 is.
• i ts oscillation is directed or transmitted towards ihe finger's surface 31 and produces a sonic wave either towards ridges 32 or valleys 33 as graphically illustrated by sonic waves 35 and 36, respectively.
• the input signal excites elements 11 within the sensor array 10 and causes these elements to oscillate, preferably at a resonant frequency.
• Phenomena outside of the sensor array 10 such as a presence of acoustic impedance or a reflection of acoustic energy off of outside entities (external to the sensor), further influences the motion of these elements 11 (apart from the influence of input, signal excitation) within the sensor array 10.
• Such outside influenced motion is monitored, pleasured and analyzed by electronic hardware in combination with software that controls operation of the electronic hardware. (See FIG. 12)
• the surface 31 response to sonic wave differs due to contact to tissue of a ridge versus non-contact of valley difference in impedance (or attenuation voltage) which is detectable by the same element 1 1 which transmitted the sonic waves or beam, via one of receive electrodes 20 selected by mux controller 16 via multiplexor 15b, thereby providing a measure as to whether the element is facing a ridge or a valley.
• the processor 1 2 builds a map in memory 14 where each element response (output signal) detected by processor 12 represents one pixel of the two-dimensional -fingerprint image in memory 14, where each pixel may he represented as a- black or white value to represent ridge or valley, respectively, or vice versa.
• identification device 9 Such operation of identification device 9 to obtain a fingerprint image is described in more detail in connection with FIGS. 17-22 of in incorporated U.S. Patent: No. 7,141 ,918 which is included in Appendi A of the prior filed provisional patent application, or other U.S. Patent No. 7,489,066, 7,514,842, 8,331 ,633, and 8,335,356 ⁇ which are also all herein incorporated by reference.
• sensor array 1 0 operates to obtain a fingerprint by detecting the impedance at a resonant frequency of an applied input signal generated 12, via multiplexor 15a, where upon soon after a driving input signal of each element 1 1 ceases in time, and an output signal is read from that same pixel. That output signal is representative of impedance.
• the element 1 1 ring (vibration) characteristic causes an electrical output signal to be produced by the element that when sampled, via multiplexor 15b, provides a measure of impedance.
• two impedance measurements can take place at two different frequencies (e.g., 19.8 MHz and 20.2 H ' z) for each element 1 1 , where the difference of measured
• impedance at each frequency is used to determine whether the element 1 1 is lacing and adjacent to a ridge or a valley as described in incorporated U.S. Patent No. 7, 141 ,918.
• Identification device 9 can also operate sensor 10 in a pitch catch imaging mode to obtain three-dimensional ultrasound images within a finger presented to sensor array 10.
• a sensor principally designed for fingerprint image capture can enable viewing of structures within the same tissue that provided a " fingerprint image, such as vascular structures (venous and arterial vessels), or bone structure.
• processor 13 operates the elements 11 of the sensor array 10 m this pitch/catch mode by connecting the transmitter and receiver in series, rather than in parallel as in echo imaging of the prior incorporated 1 J.S. Patent No. 7,141 ,918.
• an scan aperture 40 is scanned by processor 1 3 along in x and y axes or dimensions, where the x dimension corresponds to the 1 to M rows, and y dimension corresponds to the 1 to columns of FIG. 2.
• the scan aperture 40 is formed along the intersection of a group 43 of'm" number of adjacent rows of elements 1 1 activated by processor 13 to provide a transmit aperture 41 that produces a transmit beam, and a group 44 of "n" number of adjacent columns of elements 1 1 activated by processor 1 3 to provide a receive aperture 42 that receives a receive beam, where the time delay of signals received is representative of stracture(s) in the volume of tissue into which the transmit beam is focused and the receive beam is received above scan aperture 40.
• processor 1 3 moves the scan aperture 40 along the x and y dimensions by selecting different groups 43 and 44 of "in” rows and "n” columns in which different scan apertures 40 may overlap each other.
• the transmit electrodes 1 lo the "m” rows of elements 1 1 are di vided equal ly into “p" number channels, where the number of transmit channels equals "m” divided by "p”.
• the receive electrodes 20 the “n” columns of elements 1 1 are divided equally into “r” number of receive channels, where the number of receive channels equals "n” di vided by "r”.
• FIG. 6A represents a transmit cycle
• FIG, 6B represents a receive cycle
• a transmit aperture 41 is ' Selected by processor 1 3 to form a transmit beam or pulse 46 (shown as a translucent volume) having an hour-glass shape.
• “m” equals 12 and "p” equals 6, resulti ng in 6 transmit channels A-F each with two rows.
• the transmit (input) signal is applied by transmit channels A-F offset in time in accordance with distance of rows from volume 48. The transmit signal is first applied to rows of the most outer transmit channels A and F first, then the second most outer transmit channels B and , and then the central most transmit channels C and D last, as illustrated in FIG, 6B,
• transmit beam 46 forms a transmit aperture 41 which will arrive at approximately the same time thereby focusing transmit beam 46 along the intended volume 48 of that may contain the object or structure of interest, such as a blood vessel 50 , In forming transmit beam 46 all other rows of elements 1 1 which are not used in the transmi t aperture 41 are inactive. A blood vessel may or may not be fully included in the transmit beam 46.
• switch 27 is switched to ground by processor 13 to ground the receive electrodes 20, while switch 26 is not set to ground.
• transmit beam 46 is launched into the tissue of the finger 30 and an addit ional period for ring down of the transmit electrodes 19 transmitting elements 1 1 along the "m" rows (i.e., their electrodes 19) are switched to ground by processor 13 via switch 26, and switch 27 is not set to ground.
• the receive cycle can then begin,
• FIG. 7 A shows an example of the recei ve aperture 42 selected by processor 13 to receive beam or pulse 49 having an hour-glass shape.
• “n” equals 12 and “r” equals 6, resulting in 6 receive channels A-F each with two columns.
• the receive (output) signal is read (or detected) from receive channels A-F offset in time in accordance with distance of columns from volume 52.
• the receive signal is first read from col umns of the most outer receive channels A and F first, then the second most outer receive channels B and E, and then the central most receive channels C and D last, as illustrated in FIG, 78, [0051 ]
• the beam recei ved by elements 1 1 of the receive aperture 42 will arrive at approximately the Same time from the intended volume 52, which in this example includes part of blood vessel 50.
• the signals from all the receive channels A-F are aligned in accordance with the tim offset of reception shown n FIG. 7B and combined by a beam former 53 in processor 13 to form a combined output signal for scan aperture 40 as shown in FIG. 8,
• Receive beam 49 is orthogonal to the transmit beam 46, and it is their intersection along transmit aperture 41 and receiver aperture 42 which defines the effective pitch/catch scan aperture 40.
• the processor 13 receives signal from the "n" column of elements 1 1 during the sampling interval associated with the round trip time after the ceased transmit beam is haekscatter reflected towards the sensor i 0 having the objects or structures desired to be imaged.
• the delay in time of the combined output signal from beam former 53 over the sampling interval represents distance from the sensor array 10, and the amplitude or value 54 of the signal at different depths along the z dimension sampled during the sampling interval is recorded by processor 13 in memory 14 at x,y,z coordinates associated with that scan aperture 40.
• the processor 13 may receive combined output signal over the entire depth of the scan aperture 40. but records information in memory 14 over a desired range of volume's depth of intersecting volumes 48 and 5 I of scan aperture 40 to provide a three-dimensional ultrasound image havin structures of interest which. can lie within that desired depth range from sensor array 10.
• FIG. 8 shows an effect upon a beam formed signal by a blood vessel 50 along the z axis at a distance from senso 10 centered along the scan aperture 40, where +/- amplitude value 54 of coordinate along the x axis at a common y position centered about the receive aperture 42.
• the amplitude of the signal between the outer boundaries of the vessels diameter may also be processed by processor 13 to provide velocity information of the flow there through at that x,y coordinate for use as a vital parameter).
• this transmit beam 46 is steered in two orthogonal axes x and y within a two-dimensional (2D) scan of the sensor array 1 1.
• the 3rd axis defined as the axial or z-axis is obtained by time of arrival analysis of subcutaneous tissue causing backseaitered sound waves by processor 13. 10055]
• the processor adds the information at sampled points of amplitude 54 obtained alon the z axis from sensor 10 at the x,y coordinate to a map in memory 14 along the x and y dimensions thereby building a three-dimensional ultrasound image of subcutaneous structures.
• a full 2D x,y image along an x,z plane is obtained from time history in z and receive aperture 42 position in y,
• this 2D image provides a slice along the x,z plane of the lull 3D volume presentation of backscattered ultrasound for a given scan aperture 40, Scanning along the x axis while scanning the receive aperture for each new position creates the full volume representation of the fingertip object.
• switch 26 is switched to ground by processor 13 t ground the transmit electrodes 19, while switch 27 is not set to ground.
• the processor 13 then repeats the process for different scan apertures 40 along the x any y dimensions over the volume of tissue above sensor array 10. providing mul tiple slices along x,z planes of scan apertures to complete three-dimensional ultrasound image of subcutaneous structures.
• the sampling interval for the subcutaneous may be set to provide three-dimensional ultrasound image of the vasculature of finger 30 as illustrated in FIG. 9, or bone structure of finger 30 as illustrated in FIG. 10, thereby enabling three-dimensional imaging of different types of subcutaneous st ructures.
• Other structures in the tissue of the finger may simi larly be imaged as desired.
• transmitting elements 1 1 is active providing an electronically focused beam 46 in one lateral direction commonly referred to as azimuth axis, in the orthogonal direction, commonly referred to as the elevation direction, the receive aperture 49 is Selected as a sub-group of "in” electrodes 20 via the multiplexer 1 5b, thus the effective aperture for transmit and receive becomes the spatial intersection between transmit and receive apertures 41 and 42, respectively.
• Only a sub-group " ⁇ " of the M receive electrodes 20 are connected via a multiplexer 1 b to a group of "m" receive amplifiers and signal processing chains for beam formation and further backsca tier analysis by processor 13.
• the receive electrodes 1 are grounded during the transmission cycle or phase while switched off from ground during the receive phase during which ail transmitting elements 1 1 are grounded.
• proof of life parameters By analyzing changes in two or more ultrasound images a a x,y,z eoordinate(s) in a blood vessel, proof of life parameters) are detectable, such as velocity or flow of cells through the vessel, heartbeat, or flow patterns, as desired, in a manner as commonly detected in typical u I trasound imaging system .
• an identification device 9 for identification (or verification) or a subject's finger 30 presented to sensor array as shown in FIGS, 4, 9, and 10.
• processor 1 3 to capture an image (two dimensional representation) of a fingerprint along the surface of finger 30 (step 60), as described above, which is stored in memory 14 as rmnutia (biometric fingerprint identifiers) in relative and local sensor x,y coordinates (step 64).
• the fingerprint image may be stored in memory 14, and/or sent to computer system 28.
• identification device 9 is switched to three-dimensional ultrasound volumetric imaging mode.
• An image of subcutaneous fingertip vascular structure of finger 30 is then captured in memory 14 (step 61), and processed by processor 13 to obtain biometric data of identifiers uniquely characterizing curvature and/or shape of all or major subcutaneous vascular structure of the finger in relative and local sensor x,y,z coordinates (ste 65).
• Other tissue characteristics from image may also provide biometric identifiers, such as tissue speckle.
• the three-dimensional ultrasound image may be stored in memory 14, and/or sent to computer system 28.
• subcutaneous tissue parameters are measured from the ultrasound image stored in memory 14.
• the ultrasound image may be processed by processor 13 to determine elastic properties of tissue by applying pressure to the fingertip and estimating the strain in the tissue using typical ultrasound cystography. Reversely, with known tissue elasticity applied pressure is estimated from tissue strain..
• the elastic measure represents another biometric identifier stored in memory 14.
• the processor 13 using the three-dimensional ultrasound image from step 1 stored in memory 14 determines one or more vital parameters which -may be used to reduce the risk that the subject's finger in fake or dead, such as blood flow, vessel wall pulse waves and heart rate parameters.
• Each of the one or more vital parameters are compared with one or more • thresholds stored in memory 14 (or by computer system 28 if sent thereto) which if not met indicates that the subject's finger 30 may be falie or dead.
• Blood flow may be identified using common procedure of ultrasonic flow detection, such as described in J .A. Jensen, Estimation of Blood Flow using Ultrasound, Cambridge University Press, 1996. or R.S.C. Cobbold, Foundations of Biomedical Ultrasound, Oxford University Press, 2007.
• J .A. Jensen Estimation of Blood Flow using Ultrasound, Cambridge University Press, 1996. or R.S.C. Cobbold, Foundations of Biomedical Ultrasound, Oxford University Press, 2007.
• blood mean velocity or maximum velocities as well as flow spectra are obtained.
• Heart rate and vessel wall motion is detected from lower frequency variations of pulsed and continuous wave ultrasound.
• Finger bone structure is useful as biometric, particularly if bone curvature or other bone shape identifiers.
• Computer system 28 stores a database of security identification information of previously captured identifiers of biometric data of fingers of enrolled subjects, and attempts to map the identifiers of biometric data obtained from the finger at steps 60-63 to such security identi fication information (step 66), A score is calculated for each attempted mapping (step 67) and when one of the mapping store exceeds a threshold level identification may be considered as being confirmed.
• Use of additional biometric data identifier than a finger print for a small area subcutaneous biometric image increases the probability for true acceptance and true rejection.
• processor 1 3 or computer system 28 ⁇ detects that one or more of the proof of .life parameters is outside their respective acceptable threshold va jesis) stored in memory 14, the identification process ends and the operator of computer system 28 notified.
• the fingerprint, and/or one or more of the three- dimensional ultrasound images of vasculature and bone structure may be stored in memory 14, and/or sent to computer system 28 for storage in its .memory.
• all or part of the processing of image(s) by processor 13 ⁇ to. provide biometric identifiers may be performed by computer system 28 upon such image(s) if so provided to system 28, which like processor 13 operates in accordance . with a program or software in its memory enabling such operations.
• steps 60-65 are also performed, and the biometric data from such steps is sent to computer system 29 for storage in a .database of security information of computer system 28 along with other inputted identification information related to the subject, e.g., name, fecial picture, department, etc., for future use in biometric iden tification in a manner typical of fingerprint identification systems.
• the processor 1 3 or computer system 28 detects that one or more of the proof of ii fe parameters is outside their respective acceptable threshold vaiues(s) stored in memory 14, the enrollment process ends and the operator of computer system 28 noti fied,
• the identification device 9 may provide other imaging or vital parameter detection.
• a very large aperture 40 unfocused beam transmit and received channels are not time shifted
• a wavelet time frequency pattern
• This wavelet is then utilized to identify areas Of pulsation associated with arterial blood flow supporting hiometric identification by providing temporal filtering.
• parallel overlapping transmit and receiving beams, and non-overlapping parallel transmit and receive beams, rather than orthogonal as described above, may be used, such as useful for detecting and monitoring flow of correlation in three- dimensions,
• the scan aperture 40 is described as being fixed in size along x and y dimensions, a search for subcutaneous features using a variable aperture may be used, where areas of subcutaneous biometric is first coarsely scanned using wider beams; only identified areas by processor 13 are scanned using high resolution scanning of smaller scan apertures, such as described above in connection with F!GS. 5 to 8. identified areas may be identified by have pixel values (or spatial distributions) above threshold value(s) indicative of possible object detection.
• One or multiple ultrasound three-dimensional images described herein may be analyzed using any common ultrasound analysis to pro vide -additional biometric or medical Information.
• application of biomedical ultrasound to the fingertip may be used for extracting anatomical, morphological and physiological properties of tissue; each one can increases the number of biometrics used for personal identification and proof of life.
• Ultrasound images provided from sensor 10 aitliough described for identification may be used for medical applications in a manner as typical of ultrasound images.
• FIG. 12 is a simplified illustration of sensor control hardware and software.
• a central processing unit ⁇ CPU ⁇ 1 3, also referred to herein as the processor 1 3, is electronically attached to a system bus 70, also referred to herein as the bus 70.
• Memory 14 a signal generator 12, a controller 16 and a signal processor 76 are also electronically attached to the bus and addressable b the processor 13, via the bus 70.
• the memory 14, represents memory implemented as one or more memory components that are addressable from the processor 13, via the bus 70.
• the processor 13 can address other memory components that are not necessarily electrically attached to the bus 70, and are addressable via means other than the bus 70, [0075]
• Virtual memory 72 represents processor addressable and accessible memory, whether implemented as memory 14 or as other non-bus attached memory.
• the virtual address space 74 stores digital logic expressed as CPU instructions and processor addressable data.
• Sensor control software 74 is Stored within the virtual memory 72, and is configured to control transmission of signals, and configured to control reception of signal from, the sensor array 10 via the processor 13, the controller 16, the signal generator 12 and the signal processor 76.
• the controller 1 6 interfaces with multiplexors ("muxes"), like the multiplexors 1 5a- 15b shown in FIG, 1 A. Because the processor als interfaces with the controller 1 via the bus 70, the sensor control software 74 via the processor 1 3, also exercises control of the multiplexors I 5a- 1 5b, via the controller 16,
• the controller 16 interfaces with non- inu!t!plexor based hardware, to transmit and receive signals to and from the sensor array 10, Because the processor also interfaces with the controller 16 via the bus 70, the sensor control software 74 ia the processor 1 3, exercises control of the non-multiplexor based hardware, via the controller 16.
• the sensor control software 74 is configured to operable in first mode for obtaining -a first set of data encoding at least one two dimensional image of a fi gerprint of a finger.
• the software 74 is also con igured t be operable in a second mode for obtaining a second set of data encoding at least one three-dimensional representation of one or more subcutaneous tissue structures that are located within tissue that is embedded within a finger.
• a second, third and possibly a fourth mapping of one or more biometric markers over time to identify dynamic properties of portions of subcu taneous tissue.
• locations of biomarkers that change over time can be recorded and analyzed to determine a patteni of motion indicati ve of a presence and/or frequency of a heart beat and to optionally determine an amount of blood flow or a pulse wave pattern through the vascular structure.
• Such analysis can also determine elastic properties, such as an expansion and contraction measurement of the vascular structure.
• a static representati on of less dynamic, and relatively static biometric markers within the finger print and subcutaneous tissue are measured and combined to represent an overall sialic biometric characteristic, of a person, for which is employed for later comparison with biometric information later obtained from n ' unidentified person, to perform biometric matching,
• biometric matching involves computation of a matching score, i such matching score equals or exceeds a minimum score value, then an identity match has occurred and as result, it is highly likely that a person currently having an improve n identity, is a person from which biometric data has been previously obtained from and registered and later matched in association with the system of the invention.
• multiplexors 15a- 15b are replaced with non-multiplexor based electronic hardware components 85a-85b, respectively.
• the component 85a includes CMOS drivers and is configured for facilitating transmission of signals from the signal generator 12 to the elements 1 I of the sensor array 10, Use of multiplexors adds significant and unwanted capacitance, which degrades use of the sensor array 10 when generating ultrasound acoustic energy from the sensor army 1 0.
• the non-multiplexor based electronic hardware 85a instead employs CMOS drivers for periodically switching the transmission of signals to the sensor array 10, instead to a ground potential, when the component 85b, Is receiving signals from the sensor array 10, Likewise, the non-multiplexor based electronic hardware 85b, instead employs pre-ampli iers for receiving signals and periodically switching the reception of signals from the sensor array 10, to a ground potential, when the component 85a is transmitting signals to the sensor array 10.
• the receiving (Rx) lines 20 are clamped to ground during signal transmission over the (Tx) lines 19, and the transmitting (Tx) lines 1 are clamped to ground while receiving signals over the (Rx) lines 20,
• This allows for a ground potential clamping multiplexor (mux) on low impedance receiving (Rx) lines durin the signal transmission (Tx) sequence and for controlling the transmission (Tx) driver to clamp the transmission (Tx) lines during the signal receiving sequence.
• H-bridge transmission drivers can be employed, by changing the receive (Rx) clamping multiplexor (mux) to an inverse polarity driven transmission (Tx) driver.
• the second transmission (Tx) driver on the (Rx) lines would be placed into a tri-state during signal (Rx) reception, while the opposite transmission (Tx) driver would clamp to ground potential,

Landscapes

• Engineering & Computer Science (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Multimedia (AREA)
• Theoretical Computer Science (AREA)
• Human Computer Interaction (AREA)
• Computer Vision & Pattern Recognition (AREA)
• Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
• Ultra Sonic Daignosis Equipment (AREA)
• Image Input (AREA)

Priority Applications (5)

Applications Claiming Priority (2)

Publications (1)

Family

ID=51259249

Family Applications (1)

Country Status (7)

Cited By (5)

Families Citing this family (101)

Citations (7)

Family Cites Families (29)

• 2014
  • 2014-02-06 CA CA2900479A patent/CA2900479A1/en not_active Abandoned
  • 2014-02-06 KR KR1020157021371A patent/KR20150115789A/ko not_active Ceased
  • 2014-02-06 EP EP14748559.3A patent/EP2954458A4/en not_active Withdrawn
  • 2014-02-06 CN CN201480011088.5A patent/CN105264542A/zh active Pending
  • 2014-02-06 JP JP2015557074A patent/JP2016513983A/ja not_active Withdrawn
  • 2014-02-06 WO PCT/US2014/015145 patent/WO2014124167A1/en not_active Ceased
  • 2014-02-06 US US14/174,761 patent/US9607206B2/en active Active
• 2018
  • 2018-05-29 JP JP2018102366A patent/JP2018192266A/ja active Pending
  • 2018-11-29 JP JP2018223622A patent/JP2019069160A/ja active Pending
• 2019
  • 2019-01-11 US US16/245,299 patent/US10621404B2/en active Active - Reinstated
  • 2019-04-16 US US16/385,437 patent/US20190311174A1/en not_active Abandoned
  • 2019-04-16 US US16/385,413 patent/US10528785B2/en active Active
  • 2019-04-16 US US16/385,339 patent/US20190311173A1/en not_active Abandoned

Patent Citations (9)

Non-Patent Citations (4)

Also Published As

Similar Documents

Legal Events