WO2021017014A1 - Procédé et appareil de reconnaissance d'empreintes digitales et anticontrefaçon, et dispositif électronique - Google Patents

Procédé et appareil de reconnaissance d'empreintes digitales et anticontrefaçon, et dispositif électronique Download PDF

Info

Publication number
WO2021017014A1
WO2021017014A1 PCT/CN2019/098945 CN2019098945W WO2021017014A1 WO 2021017014 A1 WO2021017014 A1 WO 2021017014A1 CN 2019098945 W CN2019098945 W CN 2019098945W WO 2021017014 A1 WO2021017014 A1 WO 2021017014A1
Authority
WO
WIPO (PCT)
Prior art keywords
light
fingerprint
area
finger
sub
Prior art date
Application number
PCT/CN2019/098945
Other languages
English (en)
Chinese (zh)
Inventor
蒋鹏
Original Assignee
深圳市汇顶科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市汇顶科技股份有限公司 filed Critical 深圳市汇顶科技股份有限公司
Priority to PCT/CN2019/098945 priority Critical patent/WO2021017014A1/fr
Priority to CN201980001573.7A priority patent/CN110582780A/zh
Publication of WO2021017014A1 publication Critical patent/WO2021017014A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/13—Sensors therefor
    • G06V40/1318—Sensors therefor using electro-optical elements or layers, e.g. electroluminescent sensing

Definitions

  • This application relates to the field of biometric identification, and in particular to methods, devices and electronic equipment for fingerprint identification and anti-counterfeiting.
  • under-screen optical fingerprint sensor technologies there are currently two main under-screen optical fingerprint sensor technologies.
  • the first is an under-screen optical fingerprint recognition technology based on a periodic microhole array, which is susceptible to the influence of moiré fringes.
  • the second is based on the integrated micro-lens under-screen optical fingerprint recognition technology.
  • the under-screen optical fingerprint recognition technology of these two technologies extracts fingerprint information by illuminating all pixels of the fingerprint pressing area, and then performs fingerprint recognition, but this does not have a good degree of recognition for various real and fake fingers.
  • This application provides a method, device and electronic equipment for fingerprint identification and anti-counterfeiting, which can perform fingerprint identification and anti-counterfeiting authentication.
  • a fingerprint identification device which is arranged under a display screen of an electronic device, the display screen includes a plurality of light-emitting display pixels, the display screen includes a fingerprint detection area, and the fingerprint detection area includes non-overlapping
  • the fingerprint identification device includes a light path guiding structure for guiding the return light signal to the optical sensor, and the return light signal is the fingerprint detection
  • the light emitted by the light-emitting display pixels in the area illuminates the finger and the returned light signal, wherein the light-emitting display pixels in the central area emit monochromatic light to illuminate the finger, and the light-emitting display pixels in the surrounding area emit spatially spaced signals.
  • the distributed light of multiple colors illuminates the finger; an optical sensor is located below the light path guiding structure, and is used to receive light signals passing through the light path guiding structure, and the light signals are used to obtain fingerprint images of the finger
  • the central part of the fingerprint image corresponding to the central area is used for fingerprint identification, and the surrounding part of the fingerprint image corresponding to the surrounding area is used for fingerprint anti-counterfeiting authentication.
  • the light emitted by the light-emitting display pixels in the surrounding area has a different color from the monochromatic light emitted by the light-emitting display pixels in the central area.
  • the fingerprint detection area further includes a supplementary light area located at the periphery of the surrounding area, and the light-emitting display in the supplementary light area
  • the pixels emit monochromatic light to illuminate the finger.
  • the monochromatic light emitted by the light-emitting display pixels in the supplementary light area is compared with the single-color light emitted by the light-emitting display pixels in the central area.
  • the colors of the shades are the same.
  • the area of the central region is larger than the area of the surrounding region.
  • the central area is rectangular or circular.
  • the surrounding area includes multiple sets of sub-regions, and the light-emitting display pixels in the same set of sub-regions in the multiple sets of sub-regions emit the same Color light illuminates the finger, and light-emitting display pixels in different groups of sub-areas in the plurality of groups of sub-areas emit light of different colors to illuminate the finger.
  • the subregions of different groups in the plurality of groups of subregions are arranged at intervals.
  • the areas and/or shapes of multiple subregions in the same group of subregions in the multiple sets of subregions are the same.
  • each subregion in the plurality of groups of subregions includes 5-10 light-emitting display pixels.
  • the multiple groups of sub-areas are two groups of sub-areas or three groups of sub-areas.
  • the two sets of sub-regions include a first set of sub-regions and a second set of sub-regions.
  • the area and shape of the sub-regions are the same as those of the sub-regions in the second group of sub-regions.
  • the shape of the subregions in the first group of subregions is the same as the shape of the subregions in the second set of subregions .
  • the shapes of the sub-regions in the first group of sub-regions and the second group of sub-regions are both square, circular, or Semicircle.
  • the shape of the subregion in the first group of subregions is different from the shape of the subregion in the second set of subregions. the same.
  • the shape of the subregions in the first group of subregions is square, and the shape of the subregions in the second set of subregions is square.
  • the shape is round.
  • the fingerprint identification device further includes: a filter, which is arranged above the optical sensor and is used to filter out the return light The infrared light signal in the signal.
  • the multiple sets of sub-regions include a third set of sub-regions, and the light-emitting display pixels in the third set of sub-regions are used to emit Red light; the filter is used to filter the light signal returned after the red light irradiates the finger.
  • the light path guiding structure includes an optical lens; or, the light path guiding structure includes a plurality of collimating units or microhole arrays.
  • An optical collimator the optical collimator is used to transmit the return light signal to the corresponding optical sensing unit in the sensing array of the optical sensor through the plurality of collimating units or microhole arrays; or
  • the optical path guiding structure includes a microlens array with a plurality of microlenses and a light blocking layer with a plurality of microholes, and the microlens array is used to focus the return light signals to the microlenses respectively.
  • the micro-holes corresponding to the light blocking layer are transmitted to the corresponding optical sensing units in the sensing array of the optical sensor through the micro-holes.
  • the monochromatic light emitted by the light-emitting display pixels in the central area is green light or cyan light
  • the luminescence in the surrounding area is
  • the display pixels emit light of multiple colors including at least two of red light, blue light, yellow light, and black light.
  • the surrounding part in the fingerprint image is used to determine whether the fingerprint image to be detected is a real finger based on a deep learning algorithm Fingerprint image.
  • the deep learning algorithm includes at least one of the following: support vector machine, convolutional neural network, recurrent neural network, and k-means clustering algorithm.
  • the fingerprint identification device of the embodiment of the present application is arranged under the display screen of the electronic device, and the display screen includes a fingerprint detection area.
  • the central area of the fingerprint detection area is set to illuminate the finger in a single color, and the surrounding area is set to illuminate the finger with a color pattern.
  • This edge pattern can be a periodic grid, or a pattern with a certain curvature on the edge, or multiple color lines, so that the acquired fingerprint image can be used for fingerprint recognition and fingerprint anti-counterfeiting authentication, which solves the existing problem.
  • the under-screen optical fingerprint recognition device cannot prevent the problem of false fingerprints in various forms, and improves the security level of the system, thereby enhancing the user experience.
  • the cost of the optical fingerprint module using the color patterning method of the present application is much lower than that of the color filter fingerprint module; moreover, the optical sensor chip in the embodiment of the present application has a shorter processing cycle, lower cost, and higher yield. high.
  • an electronic device in a second aspect, includes a fingerprint identification device, a display screen, and a processor as in the first aspect or any possible implementation of the first aspect.
  • the display screen includes a plurality of light emitting devices. Display pixels, the light-emitting display pixels are used to display images, the display screen includes a fingerprint detection area, the fingerprint detection area includes a central area and a surrounding area that do not overlap each other, the central area is located in the middle of the surrounding area, the The light-emitting display pixels in the central area emit monochromatic light to illuminate the finger, and the light-emitting display pixels in the surrounding area emit light of multiple colors distributed at intervals to illuminate the finger; the processor is used to illuminate the finger according to the fingerprint
  • the light signal received by the optical sensor in the recognition device generates a fingerprint image, and performs fingerprint recognition on the finger according to the central part of the fingerprint image corresponding to the central area, and according to the fingerprint image and the The surrounding part corresponding to the surrounding area performs fingerprint anti-counterfeiting authentication on the
  • the processor is further configured to: based on a deep learning algorithm, determine the fingerprint image to be detected according to the surrounding part in the fingerprint image to be detected Whether it is a fingerprint image of a real finger.
  • the processor is further configured to: based on a deep learning algorithm, according to the distribution image of the reflected light signal in the surrounding part and/or The distribution image of the scattered light signal to determine whether the fingerprint image to be detected is a fingerprint image of a real finger, wherein the reflected light signal is the light emitted by the light-emitting display pixels in the surrounding area generated on the surface of the target finger.
  • the returned light signal after reflection, and the scattered light signal is the light signal returned after the light emitted by the light-emitting display pixels in the surrounding area is scattered inside the target finger.
  • the processor is further configured to: based on a deep learning algorithm, according to the distribution image and/or the first optical signal in the surrounding part Or the distribution image of the second light signal to determine whether the fingerprint image to be detected is a fingerprint image of a real finger, wherein the first light signal and the second light signal are respectively the light-emitting display pixels in the surrounding area Light signals of any two colors of the emitted light of multiple colors after irradiating the target finger.
  • the processor is further configured to: determine the distribution image of the first optical signal in the surrounding part and the second The distribution image of the light signal, the first light signal is the light signal returned by the blue light emitted by the light-emitting display pixels in the surrounding area after irradiating the target finger, and the second light signal is the light signal in the surrounding area
  • the red light emitted by the luminescent display pixel returns the optical signal after irradiating the target finger; based on the deep learning algorithm, according to the difference between the distribution image of the first optical signal and the distribution image of the second optical signal, determine Whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the processor is further configured to: obtain several sample data, the several sample data including several real finger data and several fake finger data
  • the plurality of real finger data includes the surrounding parts corresponding to the surrounding area in the fingerprint image obtained when a plurality of real fingers touch the fingerprint detection area, and the plurality of fake finger data includes a plurality of fake fingers touching the surrounding area.
  • the surrounding part of the fingerprint image obtained during the fingerprint detection area corresponding to the surrounding area training based on the several sample data to obtain a deep learning model of fingerprint images of real and fake fingers; according to the deep learning model, according to The surrounding part of the fingerprint image to be detected is determined whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the deep learning algorithm includes at least one of the following: support vector machine, convolutional neural network, recurrent neural network, and k-means clustering algorithm.
  • the electronic device of the embodiment of the present application has an under-screen fingerprint identification device.
  • the display screen of the electronic device includes a fingerprint detection area.
  • a monochrome illuminating finger is set in the center area of the fingerprint detection area, and a color pattern is set to illuminate the finger in the surrounding area.
  • the edge pattern can be a periodic grid, or a pattern with a certain curvature on the edge, or multiple colored lines, so that the acquired fingerprint image can be used for fingerprint recognition and fingerprint anti-counterfeiting authentication, which solves the problem of existing screens.
  • the lower optical fingerprint recognition device cannot prevent the problem of false fingerprints in various forms, and improves the security level of the system, thereby enhancing the user experience.
  • the cost of the optical fingerprint module using the color patterning method of the present application is much lower than that of the color filter fingerprint module.
  • a fingerprint identification and anti-counterfeiting method comprising: acquiring a fingerprint image of a target finger to be detected, where the fingerprint image to be detected is the fingerprint of the target finger touching the fingerprint detection area of the display screen Image, the fingerprint detection area includes a non-overlapping central area and a surrounding area, the central area is located in the middle of the surrounding area, the light-emitting display pixels in the central area emit monochromatic light to illuminate the target finger, so The light-emitting display pixels in the surrounding area emit light of multiple colors to illuminate the target finger; perform fingerprint recognition on the target finger according to the central part of the fingerprint image to be detected corresponding to the central area; Perform fingerprint anti-counterfeiting authentication on the target finger in the surrounding part corresponding to the surrounding area in the fingerprint image to be detected.
  • the performing fingerprint anti-counterfeiting authentication on the target finger according to the surrounding part corresponding to the surrounding area in the fingerprint image to be detected includes: depth-based
  • the learning algorithm determines whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected.
  • the deep learning algorithm is used to determine the fingerprint image to be detected according to the surrounding part in the fingerprint image to be detected Whether it is a fingerprint image of a real finger, including: based on a deep learning algorithm, determining whether the fingerprint image to be detected is a fingerprint of a real finger according to the distribution image of the reflected light signal and/or the distribution image of the scattered light signal in the surrounding part An image, wherein the reflected light signal is the light signal returned by the light emitted by the light-emitting display pixels in the surrounding area after being reflected on the surface of the target finger, and the scattered light signal is the light emission in the surrounding area The light emitted by the display pixel is scattered inside the target finger and then returned to the light signal.
  • the deep learning algorithm is used to determine the fingerprint image to be detected according to the surrounding part in the fingerprint image to be detected Whether it is a fingerprint image of a real finger, including: based on a deep learning algorithm, determining whether the fingerprint image to be detected is a real finger according to the distribution image of the first light signal and/or the distribution image of the second light signal in the surrounding part The fingerprint image of the fingerprint image, wherein the first light signal and the second light signal are respectively the light of any two colors of the multiple colors emitted by the light-emitting display pixels in the surrounding area illuminating the target finger After returning the light signal.
  • the deep learning algorithm is used according to the distribution image of the first optical signal and/or the second optical signal in the surrounding part
  • a distribution image determining whether the fingerprint image to be detected is a fingerprint image of a real finger, including: determining a distribution image of the first light signal and a distribution image of the second light signal in the surrounding part, the first The light signal is the light signal returned by the blue light emitted by the light-emitting display pixels in the surrounding area after irradiating the target finger, and the second light signal is the red light emitted by the light-emitting display pixels in the surrounding area.
  • the optical signal returned after the target finger based on a deep learning algorithm, determine whether the fingerprint image to be detected is a real finger based on the difference between the distribution image of the first optical signal and the distribution image of the second optical signal Fingerprint image.
  • the deep learning algorithm is used to determine the fingerprint image to be detected according to the surrounding part in the fingerprint image to be detected Whether it is a fingerprint image of a real finger, including: acquiring a number of sample data including a number of real finger data and a number of fake finger data, the number of real finger data including a number of real fingers touching the fingerprint detection area Surrounding parts in the acquired fingerprint image corresponding to the surrounding area, and the plurality of fake finger data includes the surrounding parts corresponding to the surrounding area in the fingerprint image obtained when the fake fingers touch the fingerprint detection area;
  • the several sample data are trained to obtain a deep learning model of fingerprint images of real and fake fingers; according to the deep learning model, according to the surrounding part of the fingerprint image to be detected, it is determined whether the fingerprint image to be detected is The fingerprint image of a real finger.
  • the deep learning algorithm includes at least one of the following: support vector machine, convolutional neural network, recurrent neural network, and k-means clustering algorithm.
  • the under-screen fingerprint identification and anti-counterfeiting method of the embodiment of the present application is suitable for electronic equipment with under-screen fingerprint identification devices.
  • the display screen of the electronic equipment includes a fingerprint detection area, and a single color is set in the center area of the fingerprint detection area. Illuminate the finger and set a color pattern in the surrounding area to illuminate the finger.
  • This edge pattern can be a periodic grid, or a pattern with a certain curvature on the edge, or multiple colored lines, so that the acquired fingerprint image can be fingerprinted.
  • Fingerprint anti-counterfeiting authentication can also be performed, which solves the problem that the existing under-screen optical fingerprint recognition device cannot prevent various forms of fake fingerprints, improves the security level of the system, and thereby enhances the user experience.
  • the cost of the optical fingerprint module using the color patterning method of the present application is much lower than that of the color filter fingerprint module; moreover, the optical sensor chip of the embodiment of the present application has a shorter processing cycle, lower cost, and higher yield. .
  • an electronic device including: a storage unit and a processor, the storage unit is used to store instructions, the processor is used to execute the instructions stored in the memory, and when the processor executes the instructions stored in the memory The execution causes the processor to execute the third aspect or the method in any possible implementation manner of the third aspect.
  • a computer-readable medium for storing a computer program, and the computer program includes instructions for executing the third aspect or any possible implementation of the third aspect.
  • a computer program product including instructions is provided.
  • the computer runs the finger of the computer program product, the computer executes the fingerprint in the third aspect or any possible implementation of the third aspect.
  • Methods of identification and anti-counterfeiting can run on the electronic device of the fourth aspect.
  • Fig. 1 is a schematic diagram of an electronic device according to an embodiment of the present application.
  • Fig. 2 is another schematic diagram of an electronic device according to an embodiment of the present application.
  • Fig. 3 is a partial schematic diagram of another electronic device according to an embodiment of the present application.
  • Fig. 4 is a schematic diagram of a fingerprint detection area according to an embodiment of the present application.
  • Fig. 5 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
  • Fig. 6 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
  • Fig. 7 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
  • Fig. 8 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
  • Fig. 9 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
  • Fig. 10 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
  • Fig. 11 is a schematic flowchart of an off-screen fingerprint identification and anti-counterfeiting method according to an embodiment of the present application.
  • embodiments of this application can be applied to optical fingerprint systems, including but not limited to optical fingerprint identification systems and medical diagnostic products based on optical fingerprint imaging.
  • the embodiments of this application only take optical fingerprint systems as an example for description, but should not The embodiments of the application constitute any limitation, and the embodiments of the present application are also applicable to other systems using optical imaging technology.
  • the optical fingerprint system provided in the embodiments of this application can be applied to smart phones, tablet computers, and other mobile terminals with display screens or other electronic devices; more specifically, in the above electronic devices, fingerprint identification
  • the device may specifically be an optical fingerprint device, which may be arranged in a partial area or an entire area under the display screen, thereby forming an under-display optical fingerprint system.
  • the fingerprint identification device may be partially or fully integrated into the display screen of the electronic device, thereby forming an in-display optical fingerprint system.
  • FIG. 1 and FIG. 2 are schematic diagrams of the structure of an electronic device to which the embodiment of the application can be applied.
  • FIG. 1 is a front view of the electronic device
  • FIG. 2 is a side view of the electronic device.
  • the electronic device 10 includes a display screen 120 and an optical fingerprint device 130, wherein the optical fingerprint device 130 is arranged in a partial area below the display screen 120.
  • the optical fingerprint device 130 includes an optical fingerprint sensor, and the optical fingerprint sensor includes a sensing array 133 with a plurality of optical sensing units 131, and the area where the sensing array is located or its sensing area is the fingerprint detection area 103 of the optical fingerprint device 130.
  • FIG. 1 is a front view of the electronic device
  • FIG. 2 is a side view of the electronic device.
  • the electronic device 10 includes a display screen 120 and an optical fingerprint device 130, wherein the optical fingerprint device 130 is arranged in a partial area below the display screen 120.
  • the optical fingerprint device 130 includes an optical fingerprint sensor, and the optical fingerprint sensor includes
  • the fingerprint detection area 103 is located in the display area of the display screen 120.
  • the optical fingerprint device 130 can also be arranged in other positions, such as the side of the display screen 120 or the non-transmissive area on the edge of the electronic device 10, and the optical fingerprint device 130 can be designed through the optical path. At least part of the optical signal of the display area is guided to the optical fingerprint device 130, so that the fingerprint detection area 103 is actually located in the display area of the display screen 120.
  • the area of the fingerprint detection area 103 may be different from the area of the sensing array of the optical fingerprint device 130.
  • the reflective folding optical path design, or other optical path design such as light convergence or reflection, it can make The area of the fingerprint detection area 103 of the optical fingerprint device 130 is larger than the area of the sensing array of the optical fingerprint device 130.
  • the fingerprint detection area 103 of the optical fingerprint device 130 can also be designed to be substantially the same as the area of the sensing array of the optical fingerprint device 130.
  • the electronic device 10 adopting the above structure does not need to reserve space on the front side to set fingerprint buttons (such as the Home button), so that a full screen solution can be adopted, that is, the display area of the display screen 120 can be It basically extends to the front of the entire electronic device 10.
  • the optical fingerprint device 130 includes a light detecting part 134 and an optical component 132, and the light detecting part 134 includes the sensing array and a reader electrically connected to the sensing array.
  • the circuit and other auxiliary circuits can be fabricated on a chip (Die) through a semiconductor process, such as an optical imaging chip or an optical fingerprint sensor.
  • the sensing array is specifically a photodetector array, which includes a plurality of arrays.
  • the photodetector can be used as the above-mentioned optical sensing unit; the optical component 132 can be arranged above the sensing array of the light detection part 134, which can specifically include a filter layer (Filter), light guide The light guide layer or light path guiding structure and other optical elements, the filter layer can be used to filter the ambient light penetrating the finger, and the light guide layer or light path guiding structure is mainly used to guide the reflected light reflected from the finger surface to the The sensing array performs optical inspection.
  • the filter layer Filter
  • the light guide layer or light path guiding structure and other optical elements the filter layer can be used to filter the ambient light penetrating the finger
  • the light guide layer or light path guiding structure is mainly used to guide the reflected light reflected from the finger surface to the The sensing array performs optical inspection.
  • the optical assembly 132 and the light detecting part 134 may be packaged in the same optical fingerprint component.
  • the optical component 132 and the optical detection part 134 can be packaged in the same optical fingerprint chip, or the optical component 132 can be arranged outside the chip where the optical detection part 134 is located, for example, the optical component 132 can be attached to the Above the chip, or part of the components of the optical assembly 132 are integrated in the above chip.
  • the light guide layer or light path guiding structure of the optical component 132 has multiple implementation schemes.
  • the light guide layer may specifically be a collimator layer made on a semiconductor silicon wafer, which has multiple collimators.
  • a collimating unit or a micro-hole array the collimating unit can be specifically a through hole or a small hole.
  • the reflected light reflected from the finger the light that is perpendicularly incident on the collimating unit can pass through and be received by the optical sensor unit below it , And the light with too large incident angle is attenuated by multiple reflections inside the collimating unit. Therefore, each optical sensing unit can basically only receive the reflected light reflected by the fingerprint pattern directly above it, so the sensing array is The fingerprint image of the finger can be detected.
  • the light guide layer or the light path guide structure can also be an optical lens (Lens) layer, which has one or more lens units, such as a lens group composed of one or more aspheric lenses, The reflected light reflected from the finger is condensed to the sensing array of the light detection part 134 below it, so that the sensing array can perform imaging based on the reflected light, thereby obtaining a fingerprint image of the finger.
  • the optical lens layer may further have a pinhole formed in the optical path of the lens unit, and the pinhole may cooperate with the optical lens layer to expand the field of view of the optical fingerprint device, so as to improve the fingerprint imaging of the optical fingerprint device 130 effect.
  • the light guide layer or the light path guide structure may also specifically adopt a micro-lens (Micro-Lens) layer.
  • the micro-lens layer has a micro-lens array formed by a plurality of micro-lens, which may be formed by a semiconductor growth process or Other processes are formed above the sensing array of the light detection part 134, and each microlens can correspond to one of the sensing units of the sensing array.
  • other optical film layers may be formed between the microlens layer and the sensing unit, such as a dielectric layer or a passivation layer. More specifically, a barrier with microholes may also be formed between the microlens layer and the sensing unit.
  • the light blocking layer can block the optical interference between the adjacent micro lens and the sensing unit, and allow the light corresponding to the sensing unit to pass through the
  • the micro lens is converged into the micro hole and is transmitted to the sensing unit through the micro hole to perform optical fingerprint imaging.
  • a microlens layer can be further provided under the collimator layer or the optical lens layer.
  • the collimator layer or the optical lens layer is used in combination with the microlens layer, the specific laminated structure or optical path may need to be adjusted according to actual needs.
  • the display screen 120 may be a display screen with a self-luminous display unit, such as an organic light-emitting diode (Organic Light-Emitting Diode, OLED) display screen or a micro-LED (Micro-LED) display screen .
  • OLED Organic Light-Emitting Diode
  • Micro-LED micro-LED
  • the optical fingerprint device 130 can use the display unit (ie, an OLED light source) of the OLED display screen 120 located in the fingerprint detection area 103 as an excitation light source for optical fingerprint detection.
  • the display screen 120 emits a beam of light 111 to the target finger 140 above the fingerprint detection area 103.
  • the light 111 is reflected on the surface of the finger 140 to form reflected light or passes through the finger 140.
  • Internal scattering forms scattered light.
  • the above-mentioned reflected light and scattered light are collectively referred to as return light passing through the finger. Since the ridge and valley of the fingerprint have different ability to reflect, scatter or absorb light, the return light 151 from the fingerprint ridge and the return light 152 from the fingerprint ridge have different light intensities, and the return light passes through
  • the optical component 132 After the optical component 132, it is received by the sensor array 134 in the optical fingerprint device 130 and converted into a corresponding electrical signal, that is, a fingerprint detection signal; based on the fingerprint detection signal, fingerprint image data can be obtained, and fingerprint matching verification can be further performed.
  • the electronic device 10 realizes the optical fingerprint recognition function.
  • the electronic device 10 further includes a transparent protective cover, which may be a glass cover or a sapphire cover, which is located above the display screen 120 and covers the front of the electronic device 10. . Therefore, in the embodiments of the present application, the so-called finger pressing on the display screen 120 actually refers to pressing on the cover plate above the display screen 120 or covering the surface of the protective layer of the cover plate.
  • a transparent protective cover which may be a glass cover or a sapphire cover
  • the optical fingerprint device 130 may only include one optical fingerprint sensor.
  • the fingerprint detection area 103 of the optical fingerprint device 130 has a small area and a fixed position. Therefore, when the user performs fingerprint input It is necessary to press the finger to a specific position of the fingerprint detection area 103, otherwise the optical fingerprint device 130 may not be able to collect fingerprint images, resulting in poor user experience.
  • the optical fingerprint device 130 may specifically include a plurality of optical fingerprint sensors; the plurality of optical fingerprint sensors may be arranged side by side under the display screen 120 in a splicing manner, and the sensing of the plurality of optical fingerprint sensors The areas collectively constitute the fingerprint detection area 103 of the optical fingerprint device 130.
  • the fingerprint detection area 103 of the optical fingerprint device 130 may include multiple sub-areas, and each sub-area corresponds to the sensing area of one of the optical fingerprint sensors, so that the fingerprint collection area 103 of the optical fingerprint module 130 can be It extends to the main area of the lower half of the display screen, that is, extends to the area where the finger is habitually pressed, so as to realize the blind fingerprint input operation.
  • the fingerprint detection area 130 can also be extended to half of the display area or even the entire display area, thereby realizing half-screen or full-screen fingerprint detection.
  • the current under-screen optical fingerprint device usually includes a periodic small hole optical path solution and a macro lens solution according to the different light path guiding structure it includes. Both of these solutions place the optical fingerprint device on Below the display, for example, the way is below the OLED screen.
  • the fingerprint is a diffuse reflector, and the light returned by the finger may exist in all directions.
  • the first periodic small hole solution (or collimator solution) is to collect the light leaked from the fingerprint screen through periodic small holes under the OLED screen. This part of the light contains the fingerprint signal and the internal structure signal of the screen.
  • the second macro lens solution (including the optical lens solution) uses a macro lens to collect the light leaked from the OLED screen, and then detect fingerprints.
  • the lighting method of the under-screen optical fingerprint device that has been released generally uses a partial area monochrome pattern, which will light up all the pixels in the fingerprint detection area or fingerprint pressing area.
  • This method can better reflect the fingerprint information of the finger, but because the full-area lighting basically reflects the boundary conditions between the glass cover on the surface of the screen and the fingerprint contact surface, this method has a poor anti-counterfeiting effect on true and false fingerprints. , So it cannot distinguish between true and false fingerprints.
  • the existing anti-counterfeiting solution generally involves fabricating color filters in a specific area of a Complementary Metal-Oxide-Semiconductor (CMOS) image sensor, and identifying true and false fingerprints through a deep learning method.
  • CMOS Complementary Metal-Oxide-Semiconductor
  • the cost of such a color filter anti-counterfeiting solution is much higher than that of a non-filter solution.
  • the embodiments of the present application propose a fingerprint identification and anti-counterfeiting method, device, and electronic equipment, which can perform fingerprint recognition and fingerprint anti-counterfeiting authentication, with lower cost and higher efficiency.
  • FIG. 3 shows a partial schematic diagram of an electronic device 20 according to an embodiment of the present application, and FIG. 3 is a side view of the electronic device 20.
  • the electronic device 20 includes a display screen 200 and a fingerprint identification device 300, and the display screen 200 is located above the fingerprint identification device 300.
  • the display screen 200 may correspond to the display screen 120 in the electronic device 10 described in FIG. 1 and FIG. 2, and is suitable for the related description of the display screen 120 described above. For the sake of brevity, details are not repeated here.
  • the display screen 200 includes a number of light-emitting display pixels, which can be used to display images.
  • the display screen 200 in FIG. 3 may represent a part of the display screen 200 instead of the actual size and size of the display 200.
  • the display screen 200 includes a fingerprint detection area 210 for finger pressing, that is, when the user needs to unlock the electronic device 20 or other fingerprint recognition, he only needs to press his finger on the fingerprint detection area 210, the fingerprint input can be realized.
  • the fingerprint detection area 210 may correspond to the fingerprint detection area 103 in the electronic device 10 described in FIG. 1 and FIG. 2, and is applicable to the relevant description of the fingerprint detection area 103 described above. For the sake of brevity, it will not be repeated here.
  • the fingerprint detection area 210 includes a central area 211 and a surrounding area 212 that do not overlap each other, and the central area 211 is located in the middle of the surrounding area 212.
  • the light-emitting display pixels in the central area 211 emit monochromatic light to illuminate the finger above it, and the light-emitting display pixels in the surrounding area 212 emit light of multiple colors distributed at intervals to illuminate the finger. That is, when a finger touches the fingerprint detection area 210, the central area 211 of the fingerprint detection area 210 illuminates the finger with monochromatic light, and the surrounding area 212 of the fingerprint detection area 210 illuminates the finger with a color pattern.
  • the return light signal includes the light that returns after being reflected on the surface of the finger, as shown in the three groups of hollow arrow symbols in Figure 3; in addition, the return light signal also includes the light that returns after being scattered inside the finger, as shown in Figure 3.
  • the three groups of black solid thick arrow symbols are shown.
  • the fingerprint identification device 300 is provided under the display screen 200 of the terminal device 20 in the embodiment of the present application, and the fingerprint identification device 300 may be used to receive the return light signal of the finger.
  • the fingerprint identification device 300 includes: an optical path guiding structure 310 and an optical sensor 320, and the optical sensor 320 is disposed under the optical path guiding structure 310.
  • the light path guiding structure 310 is used to: guide the return light signal to the optical sensor, the return light signal is the light signal returned after the light emitted by the light-emitting display pixel in the fingerprint detection area irradiates the finger; the optical sensor 320 is used for : Receive the light signal passing through the optical path guiding structure, the light signal is used to obtain the fingerprint image of the finger, the central part of the fingerprint image corresponding to the central area is used for fingerprint identification, and the fingerprint image corresponds to the surrounding area The surrounding part is used for fingerprint anti-counterfeiting authentication.
  • the optical path guiding structure 310 may correspond to the optical component 132 in the electronic device 10 described in FIGS. 1 and 2, and is suitable for the above-mentioned related description of the optical component 132; similarly, the optical sensor 320 may correspond to the above The optical fingerprint sensor in the electronic device 10 described in FIGS. 1 and 2, specifically, the optical sensor 320 may be the light detecting portion 134 in the above-mentioned electronic device 10, which is applicable to the above-mentioned related description about the light detecting portion 134, in order to It's concise, so I won't repeat it here.
  • the optical path guiding structure 320 of the embodiment of the present application may include an optical lens.
  • the optical path guiding structure 320 of the embodiment of the present application may further include an optical collimator having a plurality of collimating units or a microhole array, and the optical collimator is used to pass the return optical signal through the plurality of collimating units Or the microhole array is respectively transmitted to the corresponding optical sensing unit in the sensing array of the optical sensor.
  • the optical path guiding structure 320 of the embodiment of the present application includes a microlens array with a plurality of microlenses and a light blocking layer with a plurality of microholes, and the microlens array is used to pass the return light signal through the plurality of microlenses.
  • the lenses are respectively focused on the micro holes corresponding to the light blocking layer, and are transmitted to the corresponding optical sensing units in the sensing array of the optical sensor through the micro holes.
  • an embodiment of the present application proposes The method of using the edge area to emit colored light separately to realize the anti-counterfeiting authentication of optical fingerprints can be used for fingerprint identification and anti-counterfeiting of true and false fingerprints at the same time, which improves the user experience.
  • FIG. 4 shows a schematic diagram of a fingerprint detection area 210 according to an embodiment of the present application.
  • the fingerprint detection area 210 includes a central area 211 and a surrounding area 212.
  • the central area 211 is the central part of the fingerprint detection area 210, that is, the white area in the middle of FIG. 4.
  • the light-emitting display pixels in the central area 211 emit monochromatic light to illuminate the finger, and the return light after the monochromatic light illuminates the finger passes through After the optical path guide structure is received by the optical sensor, the fingerprint image is obtained by this, and this part of the fingerprint image can be used for fingerprint identification.
  • the light-emitting display pixels in the central area 211 can be used to emit monochromatic light for fingerprint recognition, where the monochromatic light can be light of any color.
  • the monochromatic light may be green light, cyan light or white light, and the embodiment of the present application is not limited thereto.
  • any light-emitting display pixel in the embodiments of the present application may refer to a combination of three colors of red, green, and blue. Therefore, each pixel may be used to emit light of various colors.
  • the periphery of the central area 211 is the surrounding area 212, that is, the surrounding area 212 is located at the periphery of the middle white area in FIG. 4, which refers to the area with pattern filling in FIG.
  • the peripheral area 212 surrounds the central area 212.
  • the light-emitting display pixels in the peripheral area 212 emit light of multiple colors to illuminate the finger, and the lights of multiple colors are distributed at intervals in space.
  • the return light after the light irradiates the finger is guided by the optical path.
  • the optical sensor obtains the corresponding image. This part of the image can be used for finger anti-counterfeiting authentication, that is, to confirm whether the finger is a real finger or a fake finger.
  • the light-emitting display pixels in the surrounding area 212 may be used to emit light of multiple colors, and the light of multiple colors may be lights of any two or more colors.
  • the light of the multiple colors may include at least two of red light, blue light, green light, yellow light, and black light, where the black light means no light is emitted.
  • the fingerprint image of the finger can be correspondingly obtained. Since the fingerprint detection area 210 is divided into a central area 211 and a surrounding area 212, and the light of the central area 211 and the surrounding area 211 are different, the corresponding The acquired fingerprint image of the finger can also be seen as two parts. For ease of description, the two parts are referred to as the central part and the surrounding part of the fingerprint image below.
  • the fingerprint image corresponding to the central area 211 is the central part, the central part is obtained according to the return light signal generated by the monochromatic light emitted in the central area 211 irradiating the finger, and the central part is used for fingerprint identification to determine the Whether the fingerprint image is a pre-stored fingerprint image; in addition, the surrounding area 212 corresponds to the surrounding area in the fingerprint image, and the surrounding area is obtained based on the return light signal generated by irradiating the finger with multiple colors of light emitted by the surrounding area 212.
  • the surrounding part is used for fingerprint anti-counterfeiting verification, that is, to determine whether the fingerprint image is a fingerprint image of a real finger, that is, to determine whether the finger touching the fingerprint detection area 210 is a real finger.
  • the central part of the fingerprint image is used for fingerprint identification, in order to ensure the accuracy of the central part of the fingerprint image of the obtained finger during fingerprint identification, that is, to ensure the clarity and accuracy of the fingerprint in the central part, it is necessary to use
  • the central part is not less than a certain threshold, and correspondingly, it is necessary to set the central area 211 in the fingerprint detection area 210 to be no less than a certain threshold. Therefore, the area and shape of the central area 211 can be set according to actual application requirements.
  • the area of the central area 211 may be set to be greater than the area of the surrounding area 212.
  • the central area 211 can usually be set as a single connected area with an area greater than or equal to 16 mm 2 , for example, considering the effect and cost, the central area 211 can be set as a rectangle of 5.5 mm * 8.5 mm; correspondingly, The peripheral area 212 may be set as an outer ring area with a width of 0.05 mm-3 mm at the edge of the central area 211.
  • the central area 211 may be set to be a rectangle or a circle.
  • the central area 211 is a rectangle as an example, but the embodiment of the present application is not limited to this.
  • FIG. 5 shows a schematic diagram of another fingerprint detection area 210 according to an embodiment of the present application.
  • the fingerprint detection area 210 includes a central area 211 and a surrounding area 212.
  • the fingerprint detection area 210 may also include a supplementary light area 213 located at the periphery of the surrounding area 212, as shown in FIG. 4 In the outermost white area, the light-emitting display pixels in the supplemental light area 213 emit monochromatic light to illuminate the finger.
  • the color of the monochromatic light emitted by the light-emitting display pixels in the supplemental light area 213 may be the same as or different from the color of the monochromatic light emitted by the light-emitting display pixels in the central area 211.
  • the monochromatic light emitted by the light-emitting display pixels in the supplemental light area 213 is usually set to be the same color as the monochromatic light emitted by the light-emitting display pixels in the central area 211.
  • the light of multiple colors emitted by the light-emitting display pixels in the surrounding area 212 may have the same color as the monochromatic light emitted by the light-emitting display pixels in the central area 211, or there may be no light of the same color. Considering the effect, the light of multiple colors emitted by the light-emitting display pixels in the surrounding area 212 is usually set to be different from the color of the monochromatic light emitted by the light-emitting display pixels in the central area 211.
  • the surrounding area 212 is considered to include multiple sets of sub-regions.
  • the light-emitting display pixels in the same group of sub-regions emit light of the same color to illuminate the finger, and the light-emitting display pixels in different groups of sub-regions emit light of different colors to illuminate the finger.
  • each group of sub-regions in the multiple groups of sub-regions includes multiple sub-regions, and the number of sub-regions included in different groups of sub-regions may be the same or different.
  • the light-emitting display pixels in the surrounding area 212 emit light of multiple colors to illuminate the finger, and the light of the multiple colors is distributed at intervals in space.
  • the sub-regions of different groups in the multiple sub-regions Arranged at intervals. For example, assuming that the multiple sets of subregions are three sets of subregions, the subregions included in the three sets of subregions are arranged at intervals.
  • the areas and/or shapes of multiple subregions in the same group of subregions in the multiple sets of subregions may be the same or different; and the areas and/or shapes of subregions included in different sets of subregions may also be Same or different.
  • multiple sub-regions in the same group of sub-regions are usually set to have the same area and shape.
  • the following description takes the same area and shape of multiple sub-regions in the same group of sub-regions as an example; in addition, the areas and shapes of different groups of sub-regions in the embodiments of the present application may be the same or different.
  • the size of any subregion in the embodiments of the present application can be set according to actual applications.
  • the width of each sub-region in the surrounding area 212 can be set in the range of 0.2mm-3mm.
  • the side length of the square is in the range of 0.2mm-3mm; and the sub-region is assumed to be a circle.
  • the diameter of the sub-area can be set to be 0.2mm-3mm.
  • the size of each sub-region in the surrounding region 212 may be correspondingly set to include 5-10 light-emitting display pixels, but the embodiment of the present application is not limited to this.
  • the multiple sets of sub-regions included in the surrounding area 212 in the embodiment of the present application may be two sets of sub-regions or more than two sets of sub-regions.
  • the multiple sets of sub-regions are used as two sets of sub-regions or Three groups of sub-regions are described in ranks.
  • the surrounding area 212 in this embodiment of the present application includes two groups of sub-areas, which are a first group of sub-areas and a second group of sub-areas, respectively.
  • the sub-regions in the first group of sub-regions and the sub-regions in the second group of sub-regions are arranged at intervals; the areas and shapes of the multiple sub-regions in the first group of sub-regions are the same.
  • the area and shape of the sub-regions are the same.
  • the shape of the sub-areas in the first group of sub-areas may be the same as the shape of the sub-areas in the second group of sub-areas.
  • the shape of the sub-areas in the first group of sub-areas and the second group of sub-areas can be set to any shape, for example, can be set to a square, a circle or a semicircle.
  • the shapes of the sub-areas in the first group of sub-areas and the second group of sub-areas may both be square.
  • the colors of the two groups of regions can be set reasonably so that there are regions with different light intensities in the surrounding region 212.
  • any group of sub-areas in the first group of sub-areas or the second group of sub-areas can also set any group of sub-areas in the first group of sub-areas or the second group of sub-areas to red, and the other group to other colors, such as yellow or blue, so that both groups of sub-areas emit light, but Through the filter set above the optical sensor to intercept the red return light, the light intensity of the two groups of sub-areas can also be clearly contrasted.
  • the shapes of the sub-areas in the first group of sub-areas and the second group of sub-areas may both be semicircular.
  • the surrounding area 212 may also include a part of the black area, that is, the non-luminous area, that is, the black area as shown in FIG. 6.
  • the part of the black area may make the surrounding area 212 have areas with different light intensities. The embodiment is not limited to this.
  • the shape of the sub-regions in the first group of sub-regions may also be different from the shape of the sub-regions in the second group of sub-regions.
  • the first group of sub-regions and the second group of sub-regions can be set in any two different shapes, for example, can be set in any two shapes of a square, a circle, a semicircle, and an ellipse.
  • the shape of the sub-areas in the first group of sub-areas is a square
  • the shape of the sub-areas in the second group of sub-areas is a circle
  • the surrounding area 212 may also include a part of the black area, that is, the non-luminous area, that is, the black area as shown in FIG. 7, and the embodiment of the present application is not limited to this.
  • the surrounding area 212 of the embodiment of the present application includes three groups of sub-areas, which are respectively a first group of sub-areas, a second group of sub-areas, and a third group of sub-areas.
  • the sub-regions in the first group of sub-regions, the sub-regions in the second group of sub-regions, and the sub-regions in the third group of sub-regions are arranged at intervals; multiple sub-regions in the same group of sub-regions have the same area and shape .
  • the shapes of all the sub-areas in the first group of sub-areas, the second group of sub-areas and the third group of sub-areas may be set to be the same.
  • the shape of the sub-regions in the three groups of sub-regions may be set to any shape, for example, all may be set to be square, circular or semicircular.
  • the shapes of all the sub-areas in the first group of sub-areas, the second group of sub-areas, and the third group of sub-areas may all be square.
  • the colors of the three groups of areas can be set reasonably so that there are areas with different light intensities in the surrounding area 212.
  • any group of sub-areas from the first group of sub-areas to the third group of sub-areas can be black, that is, non-light-emitting areas; while the other two groups are set to light-emitting areas of other colors, such as blue and yellow, so that This makes the light intensities of these three groups of sub-regions have obvious contrast.
  • the shapes of all the sub-regions in the first group of sub-regions, the second group of sub-regions, and the third group of sub-regions may all be semicircular.
  • the surrounding area 212 may also include a part of the black area, that is, the non-luminous area, that is, the black area as shown in FIG. 9, and the embodiment of the present application is not limited to this.
  • the shapes of the sub-areas in different groups of sub-areas may also be set to be different.
  • the first group of sub-regions, the second group of sub-regions, and the third group of sub-regions can be set to any two or three different shapes, that is, there may be two groups of sub-regions with the same shape in the three groups of sub-regions.
  • the other group has a different shape
  • the three groups of sub-regions can also be set to three completely different shapes.
  • the three groups of sub-regions can be set to any two or three shapes among square, circle, semicircle and ellipse.
  • the shape of the sub-areas in the first group of sub-areas is square, and the shapes of the sub-areas in the second group of sub-areas and the third group of sub-areas are both circular.
  • the surrounding area 212 may also include a part of a black area, that is, a non-light emitting area, that is, a black area as shown in FIG. 10, and the embodiment of the present application is not limited to this.
  • the light-emitting display pixels in the fingerprint detection area 210 are set to illuminate the finger to obtain a fingerprint image corresponding to the finger.
  • the central part of the fingerprint image is used for fingerprint identification, and the fingerprint image
  • the surrounding part can be used for fingerprint anti-counterfeiting authentication.
  • the central area 211 of the fingerprint detection area 210 illuminates the finger with monochromatic light, and the corresponding optical sensor 320 obtains the part of the returned light and generates the central part of the fingerprint image.
  • the central part is the image with the fingerprint of the finger.
  • the central part of the fingerprint image performs fingerprint recognition.
  • the surrounding area 212 of the fingerprint detection area 210 illuminates the finger with spatially spaced light of multiple colors, and the optical sensor 320 obtains the part of the returned light and generates the surrounding part of the fingerprint image.
  • the surrounding part can be used for fingerprint anti-counterfeiting authentication.
  • a deep learning algorithm may be used to determine whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected.
  • a real fingerprint is composed of different layers.
  • a human finger can generally include structures such as the epidermis, dermis, body tissue, and phalanges.
  • the isotropic material and structure are far from the structure of the real fingerprint.
  • the return light signal received by the optical fingerprint device can be divided into two parts, one is the return light directly reflected by the fingerprint surface, and the other is inside the fingerprint Light that returns after scattering.
  • different colors of light hit the real and fake fingerprints, and the amount of signal shown is also different.
  • True and false fingerprints have different characteristics between the reflected light and internally scattered light due to the material and structure of the fingerprint surface, and the reflected spectrum of the fingerprint is different. By distinguishing these characteristics, the true and false fingerprints can be distinguished.
  • a deep learning algorithm may be used to analyze the surrounding part of the fingerprint image to be detected to determine whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the deep learning algorithm may include at least one of the following: Support Vector Machine (SVM), Convolutional Neural Networks (CNN), Recurrent Neural Network (RNN), and k-means aggregation Class algorithm (k-means clustering algorithm).
  • the fingerprint image to be detected of the target finger is acquired, and based on the deep learning algorithm, according to the surrounding part of the fingerprint image to be detected, it is determined whether the fingerprint image to be detected is
  • the fingerprint image of a real finger is to determine whether the target finger is a real finger.
  • a deep learning algorithm may be used to determine whether the fingerprint image to be detected is a fingerprint image of a real finger according to the distribution image of the reflected light signal and/or the distribution image of the scattered light signal in the surrounding part of the fingerprint image to be detected.
  • the reflected light signal is the light signal returned after the light emitted by the light-emitting display pixels in the surrounding area is reflected on the surface of the target finger.
  • the distribution image of the reflected light signal may refer to the spectrum of the returned reflected light Image, or can also refer to the intensity distribution image of the returned reflected light.
  • the scattered light signal is the light signal returned after the light emitted by the light-emitting display pixels in the surrounding area is scattered inside the target finger.
  • the distribution image of the scattered light signal may refer to the spectral image of the returned scattered light. Or it can also refer to the intensity distribution image of the returned scattered light.
  • This method uses one or more kinds of information such as internal scattering, external reflection, and different spectrum of fingerprints for anti-counterfeiting authentication, and the anti-counterfeiting effect is better than that of pure optical filters. Moreover, the lighting method of the fingerprint detection area 210 in the embodiment of the present application has a much lower cost than the method of using randomly distributed color filters, and other resources are consumed the same.
  • the method of determining whether the fingerprint image to be detected is a fingerprint image of a real finger based on a deep learning algorithm and according to surrounding parts in the fingerprint image to be detected may also include: based on the deep learning algorithm, according to the fingerprint image to be detected The distribution image of the first light signal and/or the distribution image of the second light signal in the surrounding part of the, determining whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the first light signal and the second light signal are respectively the light signals of any two colors of light emitted by the light-emitting display pixels in the surrounding area 212 after irradiating the target finger.
  • the distribution images of more kinds of light signals may be used for comparison to determine whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the distribution image of the first light signal and the distribution image of the second light signal in the surrounding part are determined, and the first light signal is that the blue light emitted by the light-emitting display pixel in the surrounding area 212 illuminates the target finger.
  • the light signal returned later, the second light signal is the light signal returned by the red light emitted by the light-emitting display pixel in the surrounding area 212 after irradiating the target finger.
  • the fingerprint image to be detected is a fingerprint image of a real finger according to the distribution image of the first light signal and/or the distribution image of the second light signal.
  • the corresponding blue light intensity distribution image can be determined based on the blue light signal returned by the blue light emitted by the light-emitting display pixels in the surrounding area 212 after irradiating the target finger; and then based on the deep learning algorithm, the acquired fingerprint image to be detected
  • the blue light intensity distribution image in the image is analyzed to determine whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the corresponding red light intensity distribution image can also be determined based on the red light signal returned by the red light emitted by the light-emitting display pixels in the surrounding area 212 after irradiating the target finger; and then based on the deep learning algorithm, the acquired The red light intensity distribution image in the fingerprint image to be detected is analyzed to determine whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • a deep learning algorithm may also be used to determine whether the fingerprint image to be detected is a fingerprint image of a real finger based on the difference between the distribution image of the first optical signal and the distribution image of the second optical signal. Specifically, based on the blue light signal returned by the blue light emitted by the light-emitting display pixels in the surrounding area 212 after irradiating the target finger, the corresponding blue light intensity distribution image is determined; based on the red light emitted by the light-emitting display pixels in the surrounding area 212 The red light signal returned after the light irradiates the target finger determines the corresponding red light intensity distribution image; obtains the difference image between the blue light intensity distribution image and the red light intensity distribution image; then analyzes the difference based on the deep learning algorithm, Then it is determined whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the fingerprint identification device 300 may further include: a filter 330, which is disposed above the optical sensor 320, and is used to filter out the infrared light signal in the return light signal, so as to filter out such as Influence of infrared light signals such as ambient light.
  • a filter 330 which is disposed above the optical sensor 320, and is used to filter out the infrared light signal in the return light signal, so as to filter out such as Influence of infrared light signals such as ambient light.
  • the filter can also be used to filter out part of the red light.
  • the third group of sub-areas may be any group of sub-areas, and the light emission in the third group of sub-areas
  • the display pixels are used to emit red light; the filter 330 can be used to filter the light signal returned after the red light irradiates the finger, and the filter 330 can filter the light returned after the red light irradiates the finger All or part of the signal.
  • the red light signal in the fingerprint image to be detected is the red light signal after passing through the filter 330.
  • one or more pieces of information about the surrounding part of the fingerprint image to be detected can be analyzed to determine whether the fingerprint image to be detected is a fingerprint image of a real finger; correspondingly, in the deep learning algorithm In the modeling phase, different information may need to be collected.
  • the modeling process of the deep learning algorithm may include: acquiring several sample data, the several sample data including several real finger data and several fake finger data.
  • the plurality of real finger data includes the surrounding parts corresponding to the surrounding area 212 in the fingerprint image obtained when a plurality of real fingers touch the fingerprint detection area 210;
  • the plurality of fake finger data includes a plurality of fake fingers touched in the fingerprint detection area.
  • the area 210 corresponds to the surrounding area 212 in the acquired fingerprint image.
  • the plurality of fake fingers may include various types of fake fingers, for example, may include: milky white rubber fingers, transparent rubber fake fingers, yellow 2D fake fingers, black rubber fingers, flesh-colored 3D rubber fingers, and so on.
  • the deep learning algorithm when used, it can be based on information such as the scattered light distribution, the reflected light distribution, and the distribution of different colors of light around the acquired fingerprint image. Therefore, when acquiring the several sample data, Corresponding to the different information that needs to be collected for each sample data. For example, the distribution of scattered light, the distribution of reflected light, and the distribution of light of different colors in the fingerprint image corresponding to each sample data can be collected, and the embodiment of the present application is not limited to this.
  • Training is performed based on the several sample data to obtain a deep learning model of fingerprint images of real and fake fingers. If there are many kinds of fake fingers collected, the deep learning model will be more accurate. According to the deep learning model, if the surrounding part of the fingerprint image to be detected of the target finger is input, after the analysis of the deep learning model, the result of whether the fingerprint image to be detected is a fingerprint image of a real finger can be output accordingly.
  • a monochrome illuminating finger is set in the center area of the fingerprint detection area, and a color pattern is set to illuminate the finger in the surrounding area.
  • This edge pattern can be a periodic grid or The edge has a certain curvature pattern, or it can be multiple color lines, so that the acquired fingerprint image can be used for fingerprint recognition and fingerprint anti-counterfeiting authentication, which solves the problem that the existing under-screen optical fingerprint recognition device cannot prevent various forms of false
  • the problem of fingerprints improves the security level of the system, thereby enhancing the user experience.
  • the cost of the optical fingerprint module using the color patterning method of the present application is much lower than that of the color filter fingerprint module; moreover, the optical sensor chip of the embodiment of the present application has a shorter processing cycle, lower cost, and higher yield. .
  • a deep learning algorithm can be used to distinguish the spectrum of true and false fingerprints.
  • the deep learning algorithm will be trained in advance using the historical big data of true and false fingerprints. This historical data contains various true and false fingerprints, including true and false fingerprints in various scenarios.
  • the original fingerprint image is output to the anti-counterfeiting algorithm to distinguish true and false fingerprints. Among them, the data of a single image can be recorded.
  • FIG. 11 shows a schematic flowchart of a method 400 for off-screen fingerprint identification and anti-counterfeiting according to an embodiment of the present application.
  • the method 400 may be executed by an electronic device with a display screen.
  • the electronic device may be the aforementioned electronic device 20.
  • the electronic device 20 may include a processor or a processing unit for executing the method 400.
  • the method 400 includes: S410, acquiring a fingerprint image of a target finger to be detected, where the fingerprint image to be detected is the fingerprint image of the target finger touching the fingerprint detection area of the display screen, and the fingerprint detection area includes mutual Non-overlapping central area and surrounding area, the central area is located in the middle of the surrounding area, the light-emitting display pixels in the central area emit monochromatic light to illuminate the target finger, and the light-emitting display pixels in the surrounding area emit light of multiple colors Illuminate the target finger; S420, perform fingerprint recognition on the target finger according to the central part of the fingerprint image to be detected corresponding to the central area; S430, perform fingerprint recognition on the surrounding part corresponding to the surrounding area in the fingerprint image to be detected The target finger performs fingerprint anti-counterfeiting authentication.
  • performing fingerprint anti-counterfeiting authentication on the target finger according to the surrounding part of the fingerprint image to be detected corresponding to the surrounding area includes: based on a deep learning algorithm, according to the fingerprint image in the fingerprint image to be detected The surrounding part determines whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the step of determining whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected based on a deep learning algorithm includes: The distribution image of the reflected light signal and/or the distribution image of the scattered light signal in the surrounding part to determine whether the fingerprint image to be detected is a fingerprint image of a real finger, where the reflected light signal is emitted by the light-emitting display pixels in the surrounding area The light signal returned after the light is reflected on the surface of the target finger, and the scattered light signal is the light signal returned after the light emitted by the light-emitting display pixels in the surrounding area is scattered inside the target finger.
  • the step of determining whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected based on a deep learning algorithm includes: The distribution image of the first light signal and/or the distribution image of the second light signal in the surrounding part is used to determine whether the fingerprint image to be detected is a fingerprint image of a real finger, where the first light signal and the second light signal are respectively The light-emitting display pixels in the surrounding area display light signals of any two colors of the multiple colors of light emitted by the target finger after irradiating the target finger.
  • the deep learning algorithm is used to determine whether the fingerprint image to be detected is the fingerprint of a real finger according to the distribution image of the first light signal and/or the distribution image of the second light signal in the surrounding part
  • the image includes: determining the distribution image of the first light signal and the distribution image of the second light signal in the surrounding part, where the first light signal is that the blue light emitted by the light-emitting display pixel in the surrounding area illuminates the target finger
  • the second light signal is the light signal returned by the red light emitted by the light-emitting display pixels in the surrounding area after irradiating the target finger
  • the difference of the distribution image of the second light signal determines whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the determination of whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected based on a deep learning algorithm includes: acquiring a plurality of sample data, the plurality of The sample data includes several real finger data and several fake finger data.
  • the several real finger data includes the surrounding parts of the fingerprint image obtained when the real finger touches the fingerprint detection area corresponding to the surrounding area
  • the several fake finger data includes A number of fake fingers touch the surrounding part of the fingerprint image obtained when the fingerprint detection area is corresponding to the surrounding area; training based on the several sample data to obtain a deep learning model of fingerprint images of real and fake fingers; according to the deep learning The model determines whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected.
  • the deep learning algorithm includes at least one of the following: a support vector machine, a convolutional neural network, a recurrent neural network, and a k-means clustering algorithm.
  • the method 400 can be applied to various electronic devices with an under-screen optical fingerprint identification device.
  • the fingerprint identification device can be an under-screen optical fingerprint identification device including a periodic small hole array, a macro wide-angle lens solution, and a folding type.
  • the under-screen optical fingerprint identification device and the under-screen optical fingerprint identification device of the microlens array solution are not limited to this embodiment of the present application.
  • the under-screen fingerprint identification and anti-counterfeiting method of the embodiment of the present application is suitable for electronic equipment with under-screen fingerprint identification devices.
  • the display screen of the electronic equipment includes a fingerprint detection area, and a single color is set in the center area of the fingerprint detection area. Illuminate the finger and set a color pattern in the surrounding area to illuminate the finger.
  • This edge pattern can be a periodic grid, or a pattern with a certain curvature on the edge, or multiple colored lines, so that the acquired fingerprint image can be fingerprinted.
  • Fingerprint anti-counterfeiting authentication can also be performed, which solves the problem that the existing under-screen optical fingerprint recognition device cannot prevent various forms of fake fingerprints, improves the security level of the system, and thereby enhances the user experience.
  • the cost of the optical fingerprint module using the color patterning method of the present application is much lower than that of the color filter fingerprint module; moreover, the optical sensor chip of the embodiment of the present application has a shorter processing cycle, lower cost, and higher yield. .
  • the disclosed system, device, and method may be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • each unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of this application essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (read-only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program code .

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Image Input (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

Les modes de réalisation selon la présente invention portent sur un procédé et un appareil de reconnaissance d'empreintes digitales et anticontrefaçon, et sur un dispositif électronique. L'appareil de reconnaissance d'empreintes digitales est agencé sous un écran d'affichage d'un dispositif électronique, et une zone de détection d'empreintes digitales de l'écran d'affichage comprend une zone centrale et une zone périphérique qui ne se chevauchent pas. L'appareil de reconnaissance d'empreintes digitales comprend : une structure de guidage de chemin de lumière destinée à guider un signal lumineux renvoyé vers un capteur optique, le signal lumineux renvoyé étant un signal lumineux renvoyé après qu'une lumière émise par un pixel d'affichage électroluminescent dans une zone de détection d'empreintes digitales éclaire un doigt, un pixel d'affichage électroluminescent dans une zone centrale émettant de la lumière monochrome pour éclairer le doigt, et un pixel d'affichage électroluminescent dans une zone périphérique émettant de la lumière d'une pluralité de couleurs réparties par intervalles en termes d'espace pour éclairer le doigt ; et le capteur optique destiné à recevoir un signal lumineux traversant la structure de guidage de chemin optique, afin d'acquérir une image d'empreinte digitale du doigt, une partie centrale, correspondant à la zone centrale, de l'image d'empreinte digitale servant à la reconnaissance d'empreintes digitales, et une partie périphérique, correspondant à la zone périphérique, de l'image d'empreinte digitale servant à l'authentification anti-contrefaçon de l'empreinte digitale.
PCT/CN2019/098945 2019-08-01 2019-08-01 Procédé et appareil de reconnaissance d'empreintes digitales et anticontrefaçon, et dispositif électronique WO2021017014A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2019/098945 WO2021017014A1 (fr) 2019-08-01 2019-08-01 Procédé et appareil de reconnaissance d'empreintes digitales et anticontrefaçon, et dispositif électronique
CN201980001573.7A CN110582780A (zh) 2019-08-01 2019-08-01 指纹识别和防伪的方法、装置和电子设备

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/098945 WO2021017014A1 (fr) 2019-08-01 2019-08-01 Procédé et appareil de reconnaissance d'empreintes digitales et anticontrefaçon, et dispositif électronique

Publications (1)

Publication Number Publication Date
WO2021017014A1 true WO2021017014A1 (fr) 2021-02-04

Family

ID=68815623

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/098945 WO2021017014A1 (fr) 2019-08-01 2019-08-01 Procédé et appareil de reconnaissance d'empreintes digitales et anticontrefaçon, et dispositif électronique

Country Status (2)

Country Link
CN (1) CN110582780A (fr)
WO (1) WO2021017014A1 (fr)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111837128A (zh) * 2020-01-06 2020-10-27 深圳市汇顶科技股份有限公司 指纹防伪的方法、指纹识别装置和电子设备
CN111209875B (zh) * 2020-01-10 2023-05-12 上海箩箕技术有限公司 一种显示和输入装置
CN111259752B (zh) * 2020-01-10 2023-05-12 上海箩箕技术有限公司 一种显示和输入装置
CN111242011B (zh) * 2020-01-10 2023-06-02 上海箩箕技术有限公司 一种显示和输入装置
CN112101194A (zh) 2020-01-21 2020-12-18 神盾股份有限公司 电子装置及其操作方法
CN111801684A (zh) * 2020-01-22 2020-10-20 深圳市汇顶科技股份有限公司 指纹检测的装置和电子设备
WO2021168666A1 (fr) * 2020-02-25 2021-09-02 深圳市汇顶科技股份有限公司 Appareil d'identification d'empreintes digitales et dispositif électronique
WO2021168672A1 (fr) * 2020-02-25 2021-09-02 深圳市汇顶科技股份有限公司 Appareil de reconnaissance d'empreintes digitales et dispositif électronique
CN111788577B (zh) * 2020-03-03 2024-04-30 深圳市汇顶科技股份有限公司 指纹识别装置、显示屏和电子设备
CN111291719A (zh) * 2020-03-03 2020-06-16 北京迈格威科技有限公司 指纹识别装置、显示面板、设备及指纹识别方法
WO2021184233A1 (fr) * 2020-03-18 2021-09-23 上海思立微电子科技有限公司 Appareil d'identification d'empreintes digitales optique sous-écran et procédé d'identification d'empreintes digitales
CN111626100B (zh) * 2020-03-26 2024-02-02 天津极豪科技有限公司 屏下指纹装置及显示模组
CN111444888A (zh) * 2020-04-30 2020-07-24 多感科技(上海)有限公司 生物特征检测装置、电子设备及生物特征检测方法
WO2022183511A1 (fr) * 2021-03-05 2022-09-09 深圳市汇顶科技股份有限公司 Appareil de reconnaissance d'empreinte digitale et dispositif électronique
WO2022188041A1 (fr) * 2021-03-09 2022-09-15 深圳市汇顶科技股份有限公司 Appareil d'identification d'empreintes digitales, dispositif électronique et procédé de détection de lumière ambiante
WO2022241792A1 (fr) * 2021-05-21 2022-11-24 深圳市汇顶科技股份有限公司 Procédé et appareil de reconnaissance d'empreinte digitale, dispositif électronique et support de stockage
WO2023279700A1 (fr) * 2021-07-07 2023-01-12 北京极豪科技有限公司 Module de reconnaissance d'informations biométriques et dispositif électronique
US11620852B2 (en) * 2021-09-08 2023-04-04 Omnivision Technologies, Inc. Method for detecting spoof fingerprints with an under-display fingerprint sensor
US11798314B1 (en) 2022-06-21 2023-10-24 Novatek Microelectronics Corp. Fingerprint identification method and apparatus

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7920130B2 (en) * 2007-07-18 2011-04-05 Quanta Computer Inc. Electronic apparatus equipped with touch panel capable of identifying fingerprint
CN107820617A (zh) * 2017-09-30 2018-03-20 深圳市汇顶科技股份有限公司 指纹识别的方法、装置和终端设备
CN109716353A (zh) * 2018-12-20 2019-05-03 深圳市汇顶科技股份有限公司 指纹识别方法、指纹识别装置和电子设备
CN109934137A (zh) * 2019-02-28 2019-06-25 维沃移动通信有限公司 一种光电指纹识别装置、终端及指纹识别方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7920130B2 (en) * 2007-07-18 2011-04-05 Quanta Computer Inc. Electronic apparatus equipped with touch panel capable of identifying fingerprint
CN107820617A (zh) * 2017-09-30 2018-03-20 深圳市汇顶科技股份有限公司 指纹识别的方法、装置和终端设备
CN109716353A (zh) * 2018-12-20 2019-05-03 深圳市汇顶科技股份有限公司 指纹识别方法、指纹识别装置和电子设备
CN109934137A (zh) * 2019-02-28 2019-06-25 维沃移动通信有限公司 一种光电指纹识别装置、终端及指纹识别方法

Also Published As

Publication number Publication date
CN110582780A (zh) 2019-12-17

Similar Documents

Publication Publication Date Title
WO2021017014A1 (fr) Procédé et appareil de reconnaissance d'empreintes digitales et anticontrefaçon, et dispositif électronique
KR102430083B1 (ko) 지문 식별 장치 및 전자 기기
CN107820617B (zh) 指纹识别的方法、装置和终端设备
CN110062931B (zh) 指纹识别装置、指纹识别方法和电子设备
KR20190069126A (ko) 3d 지문센서 소자 및 이를 포함하는 전자 장치
CN111133446B (zh) 指纹识别装置和电子设备
CN109922722B (zh) 心率检测的方法、装置和电子设备
EP3910536B1 (fr) Appareil de reconnaissance d'empreintes digitales et dispositif électronique
CN111801684A (zh) 指纹检测的装置和电子设备
CN211062054U (zh) 生物特征成像布置和电子装置
WO2021138776A1 (fr) Procédé anti-contrefaçon d'empreintes digitales, dispositif d'identification d'empreintes digitales et dispositif électronique
CN110100250B (zh) 指纹识别的装置、方法和电子设备
CN211319244U (zh) 指纹检测的装置和电子设备
CN210295114U (zh) 光学指纹识别装置和电子设备
CN110214328B (zh) 指纹识别的方法、装置和电子设备
CN111066027B (zh) 图像采集的装置、方法和电子设备
US11741745B2 (en) Multicolor illumination in an optical fingerprint sensor for anti-spoofing
CN211529170U (zh) 指纹识别装置和电子设备
CN211554961U (zh) 指纹识别装置和电子设备
US11893100B2 (en) Spoof detection based on specular and diffuse reflections
US11900715B2 (en) Spoof detection based on specular and diffuse reflections
WO2022183511A1 (fr) Appareil de reconnaissance d'empreinte digitale et dispositif électronique
CN115273157A (zh) 指纹识别装置以及指纹检测方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19939254

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19939254

Country of ref document: EP

Kind code of ref document: A1