US11170198B2 - Fingerprint identification method and device, storage medium and terminal - Google Patents

Fingerprint identification method and device, storage medium and terminal Download PDF

Info

Publication number
US11170198B2
US11170198B2 US16/705,693 US201916705693A US11170198B2 US 11170198 B2 US11170198 B2 US 11170198B2 US 201916705693 A US201916705693 A US 201916705693A US 11170198 B2 US11170198 B2 US 11170198B2
Authority
US
United States
Prior art keywords
fingerprint
light
identified
pixels
sensing unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US16/705,693
Other versions
US20200184182A1 (en
Inventor
Jiandong Huang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Harvest Intelligence Tech Co Ltd
Original Assignee
Shanghai Harvest Intelligence Tech Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Harvest Intelligence Tech Co Ltd filed Critical Shanghai Harvest Intelligence Tech Co Ltd
Assigned to SHANGHAI HARVEST INTELLIGENCE TECHNOLOGY CO., LTD. reassignment SHANGHAI HARVEST INTELLIGENCE TECHNOLOGY CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HUANG, JIANDONG
Publication of US20200184182A1 publication Critical patent/US20200184182A1/en
Application granted granted Critical
Publication of US11170198B2 publication Critical patent/US11170198B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G06K9/0012
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/13Sensors therefor
    • G06V40/1318Sensors therefor using electro-optical elements or layers, e.g. electroluminescent sensing
    • G06K9/0004
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/1365Matching; Classification
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/1382Detecting the live character of the finger, i.e. distinguishing from a fake or cadaver finger
    • G06V40/1394Detecting the live character of the finger, i.e. distinguishing from a fake or cadaver finger using acquisition arrangements

Definitions

  • the present disclosure generally relates to a fingerprint identification method and device, a storage medium and a terminal.
  • fingerprint identification technology has gradually developed and been widely used in mobile terminals (such as mobile phones, tablet computers or the like), banking systems and attendance systems.
  • An embodiment of the present disclosure provides a fingerprint identification method and device, a storage medium and a terminal.
  • true or false fingers may be easily identified and determined, which enhances security and reliability of a fingerprint identification system, and also ensures and improves quality of fingerprint imaging.
  • a fingerprint identification method including: when a touch sensing unit senses a touch signal after a screen is touched by a fingerprint to be identified, a control unit sending a display drive signal to a display unit to light pixels of one or more discrete point light source regions in the display unit; and a photoelectric sensing unit receiving a scattered light signal formed by light from the pixels reaching a physiological tissue of a finger having the fingerprint to be identified, and a total reflection light signal formed by light from the pixels reaching the screen.
  • an incident angle of the light from the pixels is smaller than a critical angle ⁇ of total reflection, the light enters the physiological tissue of the finger through the screen and is scattered, and a part of the light returns, to form the scattered light signal, and the scattered light signal is received by the photoelectric sensing unit and analyzed to obtain a heart rate blood oxygen value.
  • the method further includes: determining whether the fingerprint to be identified is a living fingerprint based on the heart rate blood oxygen value.
  • wavelength of scattered light is greater than 600 nm, preferably 600 to 1000 nm, more preferably 600 to 800 nm.
  • an incident angle of the light from the pixels is greater than or equal to a critical angle ⁇ of total reflection, total reflection occurs to form the total reflection light signal, and the total reflection light signal is received by the photoelectric sensing unit and analyzed to reconstruct an entire image of the fingerprint to be identified.
  • the method further includes: determining whether the image of the fingerprint to be identified is consistent with a standard fingerprint image.
  • the fingerprint to be identified is determined as a living fingerprint based on a heart rate blood oxygen value, and an image of the fingerprint to be identified is determined to be consistent with a standard fingerprint image, fingerprint identification is successful; otherwise, the fingerprint identification is failed.
  • a fingerprint identification device including a screen, a touch sensing unit, a display unit, a photoelectric sensing unit and a control unit, wherein the screen is configured to be touched by a fingerprint to be identified, the touch sensing unit is configured to sense a touch signal of the fingerprint to be identified, the display unit is provided with pixels of one or more discrete point light source regions, the photoelectric sensing unit is configured to receive a scattered light signal formed by light from the pixels reaching a physiological tissue of a finger having the fingerprint to be identified, and a total reflection light signal formed by light from the pixels reaching the screen, and the control unit is configured to send a display drive signal to the display unit to light the pixels of the one or more discrete point light source regions in the display unit, when the touch sensing unit senses the touch signal.
  • an incident angle of the light from the pixels is smaller than a critical angle ⁇ of total reflection, the light enters the physiological tissue of the finger through the screen and is scattered, and a part of the light returns, to form the scattered light signal, and the scattered light signal is received by the photoelectric sensing unit and analyzed to obtain a heart rate blood oxygen value.
  • an incident angle of the light from the pixels is greater than or equal to a critical angle ⁇ of total reflection, total reflection occurs to form the total reflection light signal, and the total reflection light signal is received by the photoelectric sensing unit and analyzed to reconstruct an entire image of the fingerprint to be identified.
  • a terminal including the above fingerprint identification device is provided.
  • a computer readable storage medium having computer instructions stored therein is provided, where once the computer instructions are executed, the above method is performed.
  • a terminal including a memory and a processor
  • the memory has computer instructions stored therein, and when the processor executes the computer instructions, the above method is performed.
  • a terminal including a memory and a processor
  • the memory has computer instructions stored therein, and when the processor executes the computer instructions, the above fingerprint encryption or fingerprint decryption method is performed.
  • whether the fingerprint to be identified is a living fingerprint is determined rapidly, and whether the image of the fingerprint to be identified is consistent with a standard fingerprint image is determined to obtain a matching result rapidly, which may easily identify true or false fingers, thereby enhancing security and reliability of a fingerprint identification system and greatly improving user experience.
  • FIG. 1 schematically illustrates a flow chart of a fingerprint identification method according to an embodiment
  • FIG. 2 schematically illustrates a diagram of optical fingerprint imaging according to an embodiment
  • FIG. 3 schematically illustrates a block diagram of a fingerprint identification device according to an embodiment
  • FIG. 4 schematically illustrates a diagram of an array in a plurality of discrete point light source regions in a display unit according to an embodiment
  • FIG. 5 schematically illustrates a diagram of a pixel according to an embodiment.
  • fingerprint identification has been widely used in terminals for wake-up (unlocking), payment and user identification (attendance).
  • some fake fingerprints made of materials such as conductive silica gel have appeared, which seriously affects daily life and work. Therefore, a fingerprint identification method and device, a storage medium and a terminal are provided in embodiments of the present disclosure.
  • true or false fingers may be easily identified and determined, which enhances security and reliability of a fingerprint identification system, and also ensures and improves quality of fingerprint imaging.
  • FIG. 1 schematically illustrates a flow chart of a fingerprint identification method according to an embodiment
  • FIG. 2 schematically illustrates a diagram of optical fingerprint imaging by employing the method shown in FIG. 1 .
  • the method includes S 101 , S 102 , S 103 , S 1041 , S 1042 and S 105 .
  • a screen 10 is touched by a fingerprint F to be identified.
  • a control unit 50 sends a display drive signal to a display unit 30 to light pixels of one or more discrete point light source regions in the display unit 30 .
  • a photoelectric sensing unit 40 receives a scattered light signal formed by light from the pixels reaching a physiological tissue of a finger having the fingerprint to be identified, and a total reflection light signal formed by light from the pixels reaching the screen.
  • the scattered light signal is received by the photoelectric sensing unit 40 and analyzed to obtain a heart rate blood oxygen value.
  • S 103 when light emitted from a pixel O in the display unit 30 reaches the fingerprint F to be identified and a touch point A on the screen 10 , as the incident angle is greater than or equal to the critical angle ⁇ of total reflection, total reflection occurs to form the total reflection light signal.
  • the total reflection light signal is received by the photoelectric sensing unit 40 and analyzed to reconstruct an entire image of the fingerprint to be identified.
  • the method may further include S 1041 .
  • S 1041 whether the fingerprint to be identified is a living fingerprint is determined based on the heart rate blood oxygen value.
  • the heart rate blood oxygen value includes a heart rate value and a blood oxygen saturation. If it is detected that the heart rate value of the fingerprint to be identified falls within a first preset threshold range (for example, 60 to 100 times/min, for normal persons), it is determined that the fingerprint to be identified is a living fingerprint; otherwise, the method ends or it is determined that the fingerprint identification is failed.
  • the fingerprint to be identified is determined to be a living fingerprint; otherwise, the method ends or it is determined that the fingerprint identification is failed.
  • a second preset threshold range for example, 94% to 100% for normal persons
  • the fingerprint to be identified is determined to be a living fingerprint; otherwise, the method ends or it is determined that the fingerprint identification is failed.
  • their heart rate and blood oxygen saturation may be slightly lower or slightly higher than the above threshold range.
  • the fingerprint to be identified may be determined to be a living fingerprint.
  • the method may further include S 1042 .
  • S 1042 whether the image of the fingerprint to be identified is consistent with a standard fingerprint image is determined.
  • the method may further include S 105 .
  • S 105 if the fingerprint to be identified is determined as a living fingerprint based on the heart rate blood oxygen value, and the image of the fingerprint to be identified is determined to be consistent with the standard fingerprint image, fingerprint identification is successful; otherwise, the fingerprint identification is failed.
  • FIG. 3 schematically illustrates a block diagram of a fingerprint identification device according to an embodiment.
  • the fingerprint identification device includes, from top to bottom, a screen 10 , a touch sensing unit 20 , a display unit 30 , a photoelectric sensing unit 40 and a control unit 50 .
  • the screen 10 is configured to be touched by a fingerprint to be identified.
  • the touch sensing unit 20 is configured to sense a touch signal of the fingerprint to be identified.
  • the display unit 30 is provided with pixels of one or more discrete point light source regions.
  • the photoelectric sensing unit 40 is configured to receive a scattered light signal formed by light from the pixels reaching a physiological tissue of a finger having the fingerprint to be identified, and a total reflection light signal formed by light from the pixels reaching the screen 10 .
  • the control unit 50 is configured to send a display drive signal to the display unit 30 to light the pixels of the one or more discrete point light source regions in the display unit 30 , when the touch sensing unit 20 senses the touch signal.
  • the pixels of the plurality of discrete point light source regions in the display unit 30 are arranged in array and are separated by non-lighted pixels (referring to FIG. 4 ).
  • Light emitted from the plurality of discrete point light source regions can light a plurality of regions of the screen 10 , and then reaches a surface of the screen 10 to form a total reflection light signal received by the photoelectric sensing unit 40 , so that images of the plurality of regions can be acquired, which improves efficiency of image acquisition.
  • the point light source regions include a plurality of pixels, which satisfies illumination brightness requirements of imaging, and thus realizes acquisition of the image of the fingerprint to be identified on the screen 10 . In this way, availability of the acquired image is guaranteed.
  • the point light sources have a plurality of arrangements, such as a topological arrangement, preferably a uniform arrangement, that is, the distance between any two point light sources is the same, such that images formed by reflections of light from the point light sources are all the same, which facilitates subsequent image processing.
  • Specific form of the arrangement may include a lateral arrangement, a longitudinal arrangement, a lateral longitudinal cross arrangement, a circular arrangement, a single point arrangement, a multi-point arrangement, a linear arrangement, a parallel line arrangement, a ring arrangement, a dotted line arrangement or a parallel dotted line arrangement.
  • the plurality of point light sources constitute a plurality of parallel horizontal rows and a plurality of parallel longitudinal rows (as shown in FIG. 4 ).
  • An interval between the point light sources determines imaging quality.
  • the interval between two point light sources satisfies a condition that images corresponding to photoelectric signals generated by the photoelectric sensing unit 40 based on light emitted from the two point light sources subjected to total reflection do not contact or repeat.
  • the interval may be a minimum value under the above condition.
  • the minimum value may be obtained by multiple manual trials. For example, images generated based on light emitted from the two point light sources subjected to total reflection under different intervals are acquired, and then a minimum value of the intervals which satisfy the above condition is selected to be pre-set on a memory which stores computer instructions for the method provided in embodiments of the present disclosure.
  • the interval between two point light sources is affected by an interval between the display unit 30 and the screen 10 , where the former interval is proportional to the latter interval.
  • the former interval is proportional to the latter interval.
  • hardware parameters of a screen of a product generally do not change. For the screen, multiple manual trials are more direct and convenient for the determination of the interval.
  • multiple pixels are combined to form a composite point light source whose brightness meets imaging requirements.
  • a shape of the point light source also affects image quality.
  • the point light source region is circular.
  • a combination of multiple pixels can't form a standard circle, only being a quasi-circular shape that is close to a circle. Pixels in the quasi-circular shape may be determined in a way below. A circle is drawn around a particular pixel, and pixels in the circle can all be used as pixels in the quasi-circular shape. Further, a preset area ratio is set for pixels on the circumference.
  • a size of the circle determines light intensity of the point light source and whether the photoelectric sensing unit can obtain images with higher quality. If the circle is too small, the point light source region is too small, the light will be insufficient. If the circle is too large, the point light source region is too large, which affects imaging quality. Different display panels will also have different light source intensities, and sizes of the point light source regions of different display panels will also be different. For a certain imaging acquisition structure, the size of the point light source region may also be obtained by multiple manual trials. The point light source regions may be lighted according to the sizes of the point light source regions from small to large, and after the photoelectric sensing unit obtains image data, a minimum point light source region that satisfies the imaging quality is selected manually.
  • a size and a shape of the point light source region are as shown in FIG. 5 (each grid represents one pixel, and a position where the light source is located is shown in white).
  • a rectangle occupying 7 pixels*7 pixels is disposed in the middle, and there is a protrusion of three pixels at the middle of each side of the rectangle, to enable better imaging quality.
  • a color of the light source may be green, red or a combination of either of the two colors with any other colors, which color may avoid interference from external light.
  • the total reflection light signal is received by the photoelectric sensing unit 40 and analyzed to reconstruct an entire image of the fingerprint to be identified.
  • the photoelectric sensing unit 40 further receives the scattered light signal. If an incident angle of the light from the pixels is smaller than a critical angle ⁇ of total reflection, the light enters the physiological tissue of the finger through the screen 10 and is scattered, and a part of the light returns, to form the scattered light signal (more details can be referred to the above descriptions and are not described here).
  • the scattered light signal is received by the photoelectric sensing unit 40 and analyzed to obtain a heart rate blood oxygen value.
  • a terminal including the above fingerprint identification device is provided.
  • a computer readable storage medium having computer instructions stored therein is provided, where once the computer instructions are executed, the above method is performed.
  • the storage medium may be a non-volatile memory or a non-transitory memory.
  • the storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
  • a terminal including a memory and a processor
  • the memory has computer instructions stored therein, and when the processor executes the computer instructions, the above method is performed.
  • the terminal may include but is not limited to a personal computer, a server, a general-purpose computer, a special-purpose computer, a network device, an embedded device, a programmable device, a smart mobile terminal (such as a mobile phone, an IPAD or a POS machine), a smart home device (such as a smart fingerprint lock), a wearable smart equipment, a vehicular smart equipment, or a fingerprint identification device such as a fingerprint time recorder or a fingerprint attendance machine.

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Image Input (AREA)

Abstract

A fingerprint identification method and device, a storage medium and a terminal are provided. The method includes: when a touch sensing unit senses a touch signal after a screen is touched by a fingerprint to be identified, a control unit sending a display drive signal to a display unit to light pixels of one or more discrete point light source regions in the display unit; and a photoelectric sensing unit receiving a scattered light signal formed by light from the pixels reaching a physiological tissue of a finger having the fingerprint to be identified, and a total reflection light signal formed by light from the pixels reaching the screen. True or false fingers may be easily identified and determined, which enhances security and reliability of a fingerprint identification system, and also ensures and improves quality of fingerprint imaging.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
The present application claims priority to Chinese patent application No. 201811491875.0, filed on Dec. 7, 2018, and the entire disclosure of which is incorporated herein by reference.
TECHNICAL FIELD
The present disclosure generally relates to a fingerprint identification method and device, a storage medium and a terminal.
BACKGROUND
With the rapid development of information technology, fingerprint identification technology has gradually developed and been widely used in mobile terminals (such as mobile phones, tablet computers or the like), banking systems and attendance systems.
However, with the advancement of technology, some fake fingerprints made of materials such as conductive silica gel have appeared. Existing fingerprint identification systems hardly distinguish a simulated fingerprint film from a human living fingerprint, thereby reliability of fingerprint identification is greatly reduced.
SUMMARY
An embodiment of the present disclosure provides a fingerprint identification method and device, a storage medium and a terminal. By embodiments of the present disclosure, true or false fingers may be easily identified and determined, which enhances security and reliability of a fingerprint identification system, and also ensures and improves quality of fingerprint imaging.
In an embodiment of the present disclosure, a fingerprint identification method is provided, including: when a touch sensing unit senses a touch signal after a screen is touched by a fingerprint to be identified, a control unit sending a display drive signal to a display unit to light pixels of one or more discrete point light source regions in the display unit; and a photoelectric sensing unit receiving a scattered light signal formed by light from the pixels reaching a physiological tissue of a finger having the fingerprint to be identified, and a total reflection light signal formed by light from the pixels reaching the screen.
Optionally, if an incident angle of the light from the pixels is smaller than a critical angle θ of total reflection, the light enters the physiological tissue of the finger through the screen and is scattered, and a part of the light returns, to form the scattered light signal, and the scattered light signal is received by the photoelectric sensing unit and analyzed to obtain a heart rate blood oxygen value.
Optionally, the method further includes: determining whether the fingerprint to be identified is a living fingerprint based on the heart rate blood oxygen value.
Optionally, wavelength of scattered light is greater than 600 nm, preferably 600 to 1000 nm, more preferably 600 to 800 nm.
Optionally, if an incident angle of the light from the pixels is greater than or equal to a critical angle θ of total reflection, total reflection occurs to form the total reflection light signal, and the total reflection light signal is received by the photoelectric sensing unit and analyzed to reconstruct an entire image of the fingerprint to be identified.
Optionally, the method further includes: determining whether the image of the fingerprint to be identified is consistent with a standard fingerprint image.
Optionally, if the fingerprint to be identified is determined as a living fingerprint based on a heart rate blood oxygen value, and an image of the fingerprint to be identified is determined to be consistent with a standard fingerprint image, fingerprint identification is successful; otherwise, the fingerprint identification is failed.
In an embodiment of the present disclosure, a fingerprint identification device is provided, including a screen, a touch sensing unit, a display unit, a photoelectric sensing unit and a control unit, wherein the screen is configured to be touched by a fingerprint to be identified, the touch sensing unit is configured to sense a touch signal of the fingerprint to be identified, the display unit is provided with pixels of one or more discrete point light source regions, the photoelectric sensing unit is configured to receive a scattered light signal formed by light from the pixels reaching a physiological tissue of a finger having the fingerprint to be identified, and a total reflection light signal formed by light from the pixels reaching the screen, and the control unit is configured to send a display drive signal to the display unit to light the pixels of the one or more discrete point light source regions in the display unit, when the touch sensing unit senses the touch signal.
Optionally, if an incident angle of the light from the pixels is smaller than a critical angle θ of total reflection, the light enters the physiological tissue of the finger through the screen and is scattered, and a part of the light returns, to form the scattered light signal, and the scattered light signal is received by the photoelectric sensing unit and analyzed to obtain a heart rate blood oxygen value.
Optionally, if an incident angle of the light from the pixels is greater than or equal to a critical angle θ of total reflection, total reflection occurs to form the total reflection light signal, and the total reflection light signal is received by the photoelectric sensing unit and analyzed to reconstruct an entire image of the fingerprint to be identified.
In an embodiment of the present disclosure, a terminal including the above fingerprint identification device is provided.
In an embodiment of the present disclosure, a computer readable storage medium having computer instructions stored therein is provided, where once the computer instructions are executed, the above method is performed.
In an embodiment of the present disclosure, a terminal including a memory and a processor is provided, wherein the memory has computer instructions stored therein, and when the processor executes the computer instructions, the above method is performed.
In an embodiment of the present disclosure, a terminal including a memory and a processor is provided, wherein the memory has computer instructions stored therein, and when the processor executes the computer instructions, the above fingerprint encryption or fingerprint decryption method is performed.
By embodiments of the present disclosure, whether the fingerprint to be identified is a living fingerprint is determined rapidly, and whether the image of the fingerprint to be identified is consistent with a standard fingerprint image is determined to obtain a matching result rapidly, which may easily identify true or false fingers, thereby enhancing security and reliability of a fingerprint identification system and greatly improving user experience.
BRIEF DESCRIPTION OF THE DRAWINGS
In order to clarify solutions of the present disclosure, embodiments of present disclosure will be described in detail in conjunction with accompanying drawings, while the accompanying drawings do not limit the solutions of the present disclosure.
FIG. 1 schematically illustrates a flow chart of a fingerprint identification method according to an embodiment;
FIG. 2 schematically illustrates a diagram of optical fingerprint imaging according to an embodiment;
FIG. 3 schematically illustrates a block diagram of a fingerprint identification device according to an embodiment;
FIG. 4 schematically illustrates a diagram of an array in a plurality of discrete point light source regions in a display unit according to an embodiment; and
FIG. 5 schematically illustrates a diagram of a pixel according to an embodiment.
DETAILED DESCRIPTION
As described in the background, fingerprint identification has been widely used in terminals for wake-up (unlocking), payment and user identification (attendance). However, some fake fingerprints made of materials such as conductive silica gel have appeared, which seriously affects daily life and work. Therefore, a fingerprint identification method and device, a storage medium and a terminal are provided in embodiments of the present disclosure. By embodiments of the present disclosure, true or false fingers may be easily identified and determined, which enhances security and reliability of a fingerprint identification system, and also ensures and improves quality of fingerprint imaging.
In order to clarify the object, solutions and advantages of embodiments of the present disclosure, embodiments of present disclosure will be described clearly in detail in conjunction with accompanying drawings.
Referring to FIGS. 1 and 2, FIG. 1 schematically illustrates a flow chart of a fingerprint identification method according to an embodiment, and FIG. 2 schematically illustrates a diagram of optical fingerprint imaging by employing the method shown in FIG. 1. The method includes S101, S102, S103, S1041, S1042 and S105.
In S101, a screen 10 is touched by a fingerprint F to be identified. In S102, when a touch sensing unit 20 senses a touch signal, a control unit 50 sends a display drive signal to a display unit 30 to light pixels of one or more discrete point light source regions in the display unit 30. In S103, a photoelectric sensing unit 40 receives a scattered light signal formed by light from the pixels reaching a physiological tissue of a finger having the fingerprint to be identified, and a total reflection light signal formed by light from the pixels reaching the screen.
In some embodiments, in S103, when light emitted from a pixel O′ in the display unit 30 reaches the fingerprint F to be identified and a touch point A′ on the screen 10, as the incident angle is smaller than the critical angle θ of total reflection, the light enters skin of the finger and is scattered, while a part of the light returns back, forming the scattered light signal (i.e., when the light passes through the physiological tissue of the fingerprint, one portion of the light is absorbed, the other portion is scattered to the photoelectric sensing unit 40, and thus the illumination is attenuated). Studies have found that absorption of light by muscles, bones, veins and other connected tissues is essentially constant (provided that there is no large movement in a measured site), but the blood is different. As blood flows in an artery, absorption of light by the artery also changes naturally. Green light (with wavelength of about 530 nm) and yellow light (with wavelength of about 570 nm) entering the physiological tissue of the finger are mostly absorbed by erythrocytes, while red light and light close to IR (for example, with wavelength greater than 600 nm, preferably within a range from 600 nm to 1000 nm, more preferably within a range from 600 nm to 800 nm) are more prone to pass through the physiological tissue of the finger with a part of light being scattered to return back. Therefore, in embodiments of the present disclosure, the scattered light signal is received by the photoelectric sensing unit 40 and analyzed to obtain a heart rate blood oxygen value.
In some embodiments, in S103, when light emitted from a pixel O in the display unit 30 reaches the fingerprint F to be identified and a touch point A on the screen 10, as the incident angle is greater than or equal to the critical angle θ of total reflection, total reflection occurs to form the total reflection light signal. The total reflection light signal is received by the photoelectric sensing unit 40 and analyzed to reconstruct an entire image of the fingerprint to be identified.
In some embodiments, the method may further include S1041. In S1041, whether the fingerprint to be identified is a living fingerprint is determined based on the heart rate blood oxygen value. The heart rate blood oxygen value includes a heart rate value and a blood oxygen saturation. If it is detected that the heart rate value of the fingerprint to be identified falls within a first preset threshold range (for example, 60 to 100 times/min, for normal persons), it is determined that the fingerprint to be identified is a living fingerprint; otherwise, the method ends or it is determined that the fingerprint identification is failed. If it is detected that the blood oxygen saturation of the fingerprint to be identified falls within a second preset threshold range (for example, 94% to 100% for normal persons), the fingerprint to be identified is determined to be a living fingerprint; otherwise, the method ends or it is determined that the fingerprint identification is failed. In some special cases, due to physiological characteristics of individual persons, their heart rate and blood oxygen saturation may be slightly lower or slightly higher than the above threshold range. However, as long as an error range is within ±20%, in principle, the fingerprint to be identified may be determined to be a living fingerprint.
In some embodiments, the method may further include S1042. In S1042, whether the image of the fingerprint to be identified is consistent with a standard fingerprint image is determined.
In some embodiments, the method may further include S105. In S105, if the fingerprint to be identified is determined as a living fingerprint based on the heart rate blood oxygen value, and the image of the fingerprint to be identified is determined to be consistent with the standard fingerprint image, fingerprint identification is successful; otherwise, the fingerprint identification is failed.
FIG. 3 schematically illustrates a block diagram of a fingerprint identification device according to an embodiment. The fingerprint identification device includes, from top to bottom, a screen 10, a touch sensing unit 20, a display unit 30, a photoelectric sensing unit 40 and a control unit 50. The screen 10 is configured to be touched by a fingerprint to be identified. The touch sensing unit 20 is configured to sense a touch signal of the fingerprint to be identified. The display unit 30 is provided with pixels of one or more discrete point light source regions. The photoelectric sensing unit 40 is configured to receive a scattered light signal formed by light from the pixels reaching a physiological tissue of a finger having the fingerprint to be identified, and a total reflection light signal formed by light from the pixels reaching the screen 10. The control unit 50 is configured to send a display drive signal to the display unit 30 to light the pixels of the one or more discrete point light source regions in the display unit 30, when the touch sensing unit 20 senses the touch signal.
In some embodiments, the pixels of the plurality of discrete point light source regions in the display unit 30 are arranged in array and are separated by non-lighted pixels (referring to FIG. 4). Light emitted from the plurality of discrete point light source regions can light a plurality of regions of the screen 10, and then reaches a surface of the screen 10 to form a total reflection light signal received by the photoelectric sensing unit 40, so that images of the plurality of regions can be acquired, which improves efficiency of image acquisition. Furthermore, the point light source regions include a plurality of pixels, which satisfies illumination brightness requirements of imaging, and thus realizes acquisition of the image of the fingerprint to be identified on the screen 10. In this way, availability of the acquired image is guaranteed.
In some embodiments, the point light sources have a plurality of arrangements, such as a topological arrangement, preferably a uniform arrangement, that is, the distance between any two point light sources is the same, such that images formed by reflections of light from the point light sources are all the same, which facilitates subsequent image processing. Specific form of the arrangement may include a lateral arrangement, a longitudinal arrangement, a lateral longitudinal cross arrangement, a circular arrangement, a single point arrangement, a multi-point arrangement, a linear arrangement, a parallel line arrangement, a ring arrangement, a dotted line arrangement or a parallel dotted line arrangement. By the lateral longitudinal cross arrangement, the plurality of point light sources constitute a plurality of parallel horizontal rows and a plurality of parallel longitudinal rows (as shown in FIG. 4).
An interval between the point light sources determines imaging quality. To avoid overlaps between images, the interval between two point light sources satisfies a condition that images corresponding to photoelectric signals generated by the photoelectric sensing unit 40 based on light emitted from the two point light sources subjected to total reflection do not contact or repeat. Preferably, the interval may be a minimum value under the above condition. The minimum value may be obtained by multiple manual trials. For example, images generated based on light emitted from the two point light sources subjected to total reflection under different intervals are acquired, and then a minimum value of the intervals which satisfy the above condition is selected to be pre-set on a memory which stores computer instructions for the method provided in embodiments of the present disclosure. In practice, the interval between two point light sources is affected by an interval between the display unit 30 and the screen 10, where the former interval is proportional to the latter interval. In practical applications, hardware parameters of a screen of a product generally do not change. For the screen, multiple manual trials are more direct and convenient for the determination of the interval.
As described above, in embodiments of the present disclosure, multiple pixels are combined to form a composite point light source whose brightness meets imaging requirements. Besides, a shape of the point light source also affects image quality. Preferably, the point light source region is circular. In practice, as each pixel is square, a combination of multiple pixels can't form a standard circle, only being a quasi-circular shape that is close to a circle. Pixels in the quasi-circular shape may be determined in a way below. A circle is drawn around a particular pixel, and pixels in the circle can all be used as pixels in the quasi-circular shape. Further, a preset area ratio is set for pixels on the circumference. If a ratio of an area of a pixel on the circumference inside the circle to a total area of the pixel on the circumference is greater than the preset area ratio, the pixel on the circumference is taken as a pixel in the quasi-circular shape. A size of the circle determines light intensity of the point light source and whether the photoelectric sensing unit can obtain images with higher quality. If the circle is too small, the point light source region is too small, the light will be insufficient. If the circle is too large, the point light source region is too large, which affects imaging quality. Different display panels will also have different light source intensities, and sizes of the point light source regions of different display panels will also be different. For a certain imaging acquisition structure, the size of the point light source region may also be obtained by multiple manual trials. The point light source regions may be lighted according to the sizes of the point light source regions from small to large, and after the photoelectric sensing unit obtains image data, a minimum point light source region that satisfies the imaging quality is selected manually.
In some embodiments, a size and a shape of the point light source region are as shown in FIG. 5 (each grid represents one pixel, and a position where the light source is located is shown in white). A rectangle occupying 7 pixels*7 pixels is disposed in the middle, and there is a protrusion of three pixels at the middle of each side of the rectangle, to enable better imaging quality. A color of the light source may be green, red or a combination of either of the two colors with any other colors, which color may avoid interference from external light.
In some embodiments, the total reflection light signal is received by the photoelectric sensing unit 40 and analyzed to reconstruct an entire image of the fingerprint to be identified.
Besides the total reflection light signal, the photoelectric sensing unit 40 further receives the scattered light signal. If an incident angle of the light from the pixels is smaller than a critical angle θ of total reflection, the light enters the physiological tissue of the finger through the screen 10 and is scattered, and a part of the light returns, to form the scattered light signal (more details can be referred to the above descriptions and are not described here). The scattered light signal is received by the photoelectric sensing unit 40 and analyzed to obtain a heart rate blood oxygen value.
More details about working principles and modes of the fingerprint identification device may be referred to the descriptions of the foregoing embodiments, and are not described in detail here.
In an embodiment of the present disclosure, a terminal including the above fingerprint identification device is provided.
In an embodiment of the present disclosure, a computer readable storage medium having computer instructions stored therein is provided, where once the computer instructions are executed, the above method is performed. The storage medium may be a non-volatile memory or a non-transitory memory. The storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
In an embodiment of the present disclosure, a terminal including a memory and a processor is provided, wherein the memory has computer instructions stored therein, and when the processor executes the computer instructions, the above method is performed. The terminal may include but is not limited to a personal computer, a server, a general-purpose computer, a special-purpose computer, a network device, an embedded device, a programmable device, a smart mobile terminal (such as a mobile phone, an IPAD or a POS machine), a smart home device (such as a smart fingerprint lock), a wearable smart equipment, a vehicular smart equipment, or a fingerprint identification device such as a fingerprint time recorder or a fingerprint attendance machine.
Although the present disclosure has been disclosed above with reference to preferred embodiments thereof, it should be understood that the disclosure is presented by way of example only, and not limitation. Those skilled in the art can modify and vary the embodiments without departing from the spirit and scope of the present disclosure.

Claims (9)

What is claimed is:
1. A fingerprint identification method, comprising:
when a touch sensing unit senses a touch signal after a screen is touched by a fingerprint to be identified, a control unit sending a display drive signal to a display unit to light pixels of one or more discrete point light source regions in the display unit; and
a photoelectric sensing unit receiving a scattered light signal formed by light from the pixels reaching a physiological tissue of a finger having the fingerprint to be identified, and a total reflection light signal formed by light from the pixels reaching the screen,
wherein the light from the pixels with an incident angle smaller than a critical angle θ of total reflection enters the physiological tissue of the finger through the screen and is scattered, and a part of the light returns, to form scattered light, and the scattered light is received by the photoelectric sensing unit and analyzed to obtain a heart rate blood oxygen value,
wherein the light from the pixels with an incident angle greater than or equal to a critical angle θ of total reflection is totally reflected to form total reflection light, and the total reflection light is received by the photoelectric sensing unit and analyzed to obtain an image of the fingerprint to be identified.
2. The method according to claim 1, wherein wavelength of scattered light is greater than 600 nm.
3. The method according to claim 1, further comprising: determining whether the fingerprint to be identified is a living fingerprint based on the heart rate blood oxygen value.
4. The method according to claim 1, further comprising: determining whether the image of the fingerprint to be identified is consistent with a standard fingerprint image.
5. The method according to claim 1, wherein if the fingerprint to be identified is determined as a living fingerprint based on the heart rate blood oxygen value, and the image of the fingerprint to be identified is determined to be consistent with a standard fingerprint image, fingerprint identification is successful; otherwise, the fingerprint identification is failed.
6. A fingerprint identification device, comprising a screen, a touch sensing unit, a display unit, a photoelectric sensing unit and a control unit,
wherein the screen is configured to be touched by a fingerprint to be identified, the touch sensing unit is configured to sense a touch signal of the fingerprint to be identified,
the display unit is provided with pixels of one or more discrete point light source regions,
the photoelectric sensing unit is configured to receive a scattered light signal formed by light from the pixels reaching a physiological tissue of a finger having the fingerprint to be identified, and a total reflection light signal formed by light from the pixels reaching the screen, and
the control unit is configured to send a display drive signal to the display unit to light the pixels of the one or more discrete point light source regions in the display unit, when the touch sensing unit senses the touch signal,
wherein the light from the pixels with an incident angle smaller than a critical angle θ of total reflection enters the physiological tissue of the finger through the screen and is scattered, and a part of the light returns, to form scattered light, and the scattered light is received by the photoelectric sensing unit and analyzed to obtain a heart rate blood oxygen value,
wherein the light from the pixels with an incident angle greater than or equal to a critical angle θ of total reflection is totally reflected to form total reflection light, and the total reflection light is received by the photoelectric sensing unit and analyzed to obtain an image of the fingerprint to be identified.
7. The device according to claim 6, wherein if the fingerprint to be identified is determined as a living fingerprint based on the heart rate blood oxygen value, and the image of the fingerprint to be identified is determined to be consistent with a standard fingerprint image, fingerprint identification is successful; otherwise, the fingerprint identification is failed.
8. A non-transitory computer readable storage medium having computer instructions stored therein, wherein once the computer instructions are executed, the method according to claim 1 is performed.
9. A terminal comprising a memory and a processor, wherein the memory has computer instructions stored therein, and when the processor executes the computer instructions, the method according to claim 1 is performed.
US16/705,693 2018-12-07 2019-12-06 Fingerprint identification method and device, storage medium and terminal Expired - Fee Related US11170198B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811491875.0A CN111291592A (en) 2018-12-07 2018-12-07 Fingerprint identification method and device, storage medium and terminal
CN201811491875.0 2018-12-07

Publications (2)

Publication Number Publication Date
US20200184182A1 US20200184182A1 (en) 2020-06-11
US11170198B2 true US11170198B2 (en) 2021-11-09

Family

ID=70971453

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/705,693 Expired - Fee Related US11170198B2 (en) 2018-12-07 2019-12-06 Fingerprint identification method and device, storage medium and terminal

Country Status (3)

Country Link
US (1) US11170198B2 (en)
CN (1) CN111291592A (en)
TW (1) TWI747096B (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111325055B (en) * 2018-12-14 2024-03-19 上海耕岩智能科技有限公司 Fingerprint identification method and device, storage medium and terminal
CN112183320B (en) * 2020-09-27 2024-10-18 北京奕斯伟计算技术股份有限公司 Fingerprint recognition method, fingerprint recognition device and fingerprint recognition display device
CN112190247A (en) * 2020-10-30 2021-01-08 苏州多感科技有限公司 Heart rate detection method, heart rate detection device and mobile terminal
WO2022125058A1 (en) 2020-12-07 2022-06-16 Google Llc Fingerprint-based authentication using touch inputs
TWI831059B (en) * 2021-10-12 2024-02-01 大陸商北京集創北方科技股份有限公司 Fingerprint identification method, fingerprint identification device and information processing device
CN115100693A (en) * 2022-05-31 2022-09-23 北京极豪科技有限公司 A fingerprint identification method, device, storage medium and program product
TWI835245B (en) * 2022-08-16 2024-03-11 大陸商北京集創北方科技股份有限公司 Under-screen fingerprint collection device and information processing device
CN115294613A (en) * 2022-08-16 2022-11-04 北京集创北方科技股份有限公司 Under-screen biometric feature acquisition system and method
CN116310779A (en) * 2022-09-29 2023-06-23 中国气象局沈阳大气环境研究所 Forest fire low-light level remote sensing identification method
CN117093843B (en) * 2023-10-19 2024-02-20 华侨大学 Signal reconstruction and working modal parameter identification methods, devices, equipment and media

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130194236A1 (en) * 2011-11-21 2013-08-01 Pixart Imaging Inc. Optical input device and input detection thereof
US8605961B2 (en) * 2009-03-30 2013-12-10 Motorola Mobility Llc Method and apparatus for determining a physiological parameter using a fingerprint sensor on a portable electronic device
US20140168167A1 (en) * 2012-12-19 2014-06-19 Bruce C.S. Chou Stray-light-coupled biometrics sensing module and electronic apparatus using the same
US20160180139A1 (en) * 2014-12-22 2016-06-23 Gingy Technology Inc. Fingerprint identification apparatus and method capable of simultaneously identifying fingerprint and oxygen saturation
US20160314334A1 (en) * 2015-04-23 2016-10-27 Shenzhen Huiding Technology Co., Ltd. Multifunction fingerprint sensor
US20160328090A1 (en) * 2014-01-16 2016-11-10 FlatFrong Laboratories AB Oled display panel
US20170300738A1 (en) * 2015-12-31 2017-10-19 Shenzhen GOODIX Technology Co., Ltd. Fingerprint recognition method and fingerprint recognition apparatus
US20180322328A1 (en) * 2017-05-03 2018-11-08 Shenzhen GOODIX Technology Co., Ltd. Method for determining vital sign information, identity authentication method and apparatus
US10303921B1 (en) * 2018-02-26 2019-05-28 Shenzhen GOODIX Technology Co., Ltd. On-LCD screen optical fingerprint sensing based on optical imaging with lens-pinhole module and other optical designs
US20200279090A1 (en) * 2018-10-08 2020-09-03 Shenzhen GOODIX Technology Co., Ltd. Lens-pinhole array designs in ultra thin under-screen optical sensors for on-screen fingerprint sensing

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107004130B (en) * 2015-06-18 2020-08-28 深圳市汇顶科技股份有限公司 Optical sensor module under screen for sensing fingerprint on screen
WO2016205832A1 (en) * 2015-06-18 2016-12-22 Shenzhen Huiding Technology Co., Ltd. Multifunction fingerprint sensor having optical sensing capability
CN107004126A (en) * 2015-11-02 2017-08-01 深圳市汇顶科技股份有限公司 Multifunctional fingerprint sensor with anti-fingerprint spoofing optical sensing
EP3504588A4 (en) * 2017-03-07 2019-10-23 Shenzhen Goodix Technology Co., Ltd. PERIPHERAL TASK BAR DISPLAY DEVICES AND LCD SUB-SCREEN OPTICAL SENSOR MODULE FOR DIGITAL SCREEN DETECTION ON SCREEN
CN107247922B (en) * 2017-05-12 2020-04-03 Oppo广东移动通信有限公司 Display device and mobile terminal

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8605961B2 (en) * 2009-03-30 2013-12-10 Motorola Mobility Llc Method and apparatus for determining a physiological parameter using a fingerprint sensor on a portable electronic device
US20130194236A1 (en) * 2011-11-21 2013-08-01 Pixart Imaging Inc. Optical input device and input detection thereof
US20140168167A1 (en) * 2012-12-19 2014-06-19 Bruce C.S. Chou Stray-light-coupled biometrics sensing module and electronic apparatus using the same
US20160328090A1 (en) * 2014-01-16 2016-11-10 FlatFrong Laboratories AB Oled display panel
US20160180139A1 (en) * 2014-12-22 2016-06-23 Gingy Technology Inc. Fingerprint identification apparatus and method capable of simultaneously identifying fingerprint and oxygen saturation
US20160314334A1 (en) * 2015-04-23 2016-10-27 Shenzhen Huiding Technology Co., Ltd. Multifunction fingerprint sensor
US20170300738A1 (en) * 2015-12-31 2017-10-19 Shenzhen GOODIX Technology Co., Ltd. Fingerprint recognition method and fingerprint recognition apparatus
US20180322328A1 (en) * 2017-05-03 2018-11-08 Shenzhen GOODIX Technology Co., Ltd. Method for determining vital sign information, identity authentication method and apparatus
US10303921B1 (en) * 2018-02-26 2019-05-28 Shenzhen GOODIX Technology Co., Ltd. On-LCD screen optical fingerprint sensing based on optical imaging with lens-pinhole module and other optical designs
US20200279090A1 (en) * 2018-10-08 2020-09-03 Shenzhen GOODIX Technology Co., Ltd. Lens-pinhole array designs in ultra thin under-screen optical sensors for on-screen fingerprint sensing

Also Published As

Publication number Publication date
TW202032424A (en) 2020-09-01
CN111291592A (en) 2020-06-16
TWI747096B (en) 2021-11-21
US20200184182A1 (en) 2020-06-11

Similar Documents

Publication Publication Date Title
US11170198B2 (en) Fingerprint identification method and device, storage medium and terminal
EP3799785B1 (en) Method for biometric recognition, fingerprint recognition apparatus, and electronic device
CN109643379B (en) Fingerprint identification method and device and electronic equipment
KR102430083B1 (en) Fingerprint identification devices and electronic devices
US9697414B2 (en) User authentication through image analysis
US10943083B2 (en) Fingerprint identification apparatus and method and terminal device
CN102622588B (en) Double verification face anti-counterfeiting method and device
CN107004114B (en) Blood vessel image capturing device and personal authentication system
US20250094553A1 (en) Face authentication including material data extracted from image
US9750420B1 (en) Facial feature selection for heart rate detection
KR102322029B1 (en) Method and Apparatus for acquiring a biometric information
US7539330B2 (en) Multispectral liveness determination
US11380138B2 (en) Device and method for touchless palm print acquisition
EP3795071B1 (en) Heart rate detection method and electronic device
US20220121869A1 (en) Biometric authentication device and biometric authentication method
US20080298649A1 (en) Hygienic biometric sensors
US20150205992A1 (en) Multispectral imaging biometrics
KR20090035611A (en) Spatial Spectrum Fingerprint Spoof Detection
Wang et al. An automatic physical access control system based on hand vein biometric identification
US20250078567A1 (en) Face authentication including occlusion detection based on material data extracted from an image
US20190374156A1 (en) Skin detection device and product information determination method, device and system
US20250095335A1 (en) Image manipulation for material information determination
DE112008001530T5 (en) Contactless multispectral biometric acquisition
CN110214328B (en) Fingerprint identification method and device and electronic equipment
CN114092974A (en) Identity recognition method, device, terminal and storage medium

Legal Events

Date Code Title Description
AS Assignment

Owner name: SHANGHAI HARVEST INTELLIGENCE TECHNOLOGY CO., LTD., CHINA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HUANG, JIANDONG;REEL/FRAME:051202/0170

Effective date: 20191122

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO SMALL (ORIGINAL EVENT CODE: SMAL); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20251109