WO2021017014A1 - Fingerprint recognition and anti-counterfeiting method and apparatus, and electronic device - Google Patents

Fingerprint recognition and anti-counterfeiting method and apparatus, and electronic device Download PDF

Info

Publication number
WO2021017014A1
WO2021017014A1 PCT/CN2019/098945 CN2019098945W WO2021017014A1 WO 2021017014 A1 WO2021017014 A1 WO 2021017014A1 CN 2019098945 W CN2019098945 W CN 2019098945W WO 2021017014 A1 WO2021017014 A1 WO 2021017014A1
Authority
WO
WIPO (PCT)
Prior art keywords
light
fingerprint
area
finger
sub
Prior art date
Application number
PCT/CN2019/098945
Other languages
French (fr)
Chinese (zh)
Inventor
蒋鹏
Original Assignee
深圳市汇顶科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市汇顶科技股份有限公司 filed Critical 深圳市汇顶科技股份有限公司
Priority to CN201980001573.7A priority Critical patent/CN110582780A/en
Priority to PCT/CN2019/098945 priority patent/WO2021017014A1/en
Publication of WO2021017014A1 publication Critical patent/WO2021017014A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/13Sensors therefor
    • G06V40/1318Sensors therefor using electro-optical elements or layers, e.g. electroluminescent sensing

Definitions

  • This application relates to the field of biometric identification, and in particular to methods, devices and electronic equipment for fingerprint identification and anti-counterfeiting.
  • under-screen optical fingerprint sensor technologies there are currently two main under-screen optical fingerprint sensor technologies.
  • the first is an under-screen optical fingerprint recognition technology based on a periodic microhole array, which is susceptible to the influence of moiré fringes.
  • the second is based on the integrated micro-lens under-screen optical fingerprint recognition technology.
  • the under-screen optical fingerprint recognition technology of these two technologies extracts fingerprint information by illuminating all pixels of the fingerprint pressing area, and then performs fingerprint recognition, but this does not have a good degree of recognition for various real and fake fingers.
  • This application provides a method, device and electronic equipment for fingerprint identification and anti-counterfeiting, which can perform fingerprint identification and anti-counterfeiting authentication.
  • a fingerprint identification device which is arranged under a display screen of an electronic device, the display screen includes a plurality of light-emitting display pixels, the display screen includes a fingerprint detection area, and the fingerprint detection area includes non-overlapping
  • the fingerprint identification device includes a light path guiding structure for guiding the return light signal to the optical sensor, and the return light signal is the fingerprint detection
  • the light emitted by the light-emitting display pixels in the area illuminates the finger and the returned light signal, wherein the light-emitting display pixels in the central area emit monochromatic light to illuminate the finger, and the light-emitting display pixels in the surrounding area emit spatially spaced signals.
  • the distributed light of multiple colors illuminates the finger; an optical sensor is located below the light path guiding structure, and is used to receive light signals passing through the light path guiding structure, and the light signals are used to obtain fingerprint images of the finger
  • the central part of the fingerprint image corresponding to the central area is used for fingerprint identification, and the surrounding part of the fingerprint image corresponding to the surrounding area is used for fingerprint anti-counterfeiting authentication.
  • the light emitted by the light-emitting display pixels in the surrounding area has a different color from the monochromatic light emitted by the light-emitting display pixels in the central area.
  • the fingerprint detection area further includes a supplementary light area located at the periphery of the surrounding area, and the light-emitting display in the supplementary light area
  • the pixels emit monochromatic light to illuminate the finger.
  • the monochromatic light emitted by the light-emitting display pixels in the supplementary light area is compared with the single-color light emitted by the light-emitting display pixels in the central area.
  • the colors of the shades are the same.
  • the area of the central region is larger than the area of the surrounding region.
  • the central area is rectangular or circular.
  • the surrounding area includes multiple sets of sub-regions, and the light-emitting display pixels in the same set of sub-regions in the multiple sets of sub-regions emit the same Color light illuminates the finger, and light-emitting display pixels in different groups of sub-areas in the plurality of groups of sub-areas emit light of different colors to illuminate the finger.
  • the subregions of different groups in the plurality of groups of subregions are arranged at intervals.
  • the areas and/or shapes of multiple subregions in the same group of subregions in the multiple sets of subregions are the same.
  • each subregion in the plurality of groups of subregions includes 5-10 light-emitting display pixels.
  • the multiple groups of sub-areas are two groups of sub-areas or three groups of sub-areas.
  • the two sets of sub-regions include a first set of sub-regions and a second set of sub-regions.
  • the area and shape of the sub-regions are the same as those of the sub-regions in the second group of sub-regions.
  • the shape of the subregions in the first group of subregions is the same as the shape of the subregions in the second set of subregions .
  • the shapes of the sub-regions in the first group of sub-regions and the second group of sub-regions are both square, circular, or Semicircle.
  • the shape of the subregion in the first group of subregions is different from the shape of the subregion in the second set of subregions. the same.
  • the shape of the subregions in the first group of subregions is square, and the shape of the subregions in the second set of subregions is square.
  • the shape is round.
  • the fingerprint identification device further includes: a filter, which is arranged above the optical sensor and is used to filter out the return light The infrared light signal in the signal.
  • the multiple sets of sub-regions include a third set of sub-regions, and the light-emitting display pixels in the third set of sub-regions are used to emit Red light; the filter is used to filter the light signal returned after the red light irradiates the finger.
  • the light path guiding structure includes an optical lens; or, the light path guiding structure includes a plurality of collimating units or microhole arrays.
  • An optical collimator the optical collimator is used to transmit the return light signal to the corresponding optical sensing unit in the sensing array of the optical sensor through the plurality of collimating units or microhole arrays; or
  • the optical path guiding structure includes a microlens array with a plurality of microlenses and a light blocking layer with a plurality of microholes, and the microlens array is used to focus the return light signals to the microlenses respectively.
  • the micro-holes corresponding to the light blocking layer are transmitted to the corresponding optical sensing units in the sensing array of the optical sensor through the micro-holes.
  • the monochromatic light emitted by the light-emitting display pixels in the central area is green light or cyan light
  • the luminescence in the surrounding area is
  • the display pixels emit light of multiple colors including at least two of red light, blue light, yellow light, and black light.
  • the surrounding part in the fingerprint image is used to determine whether the fingerprint image to be detected is a real finger based on a deep learning algorithm Fingerprint image.
  • the deep learning algorithm includes at least one of the following: support vector machine, convolutional neural network, recurrent neural network, and k-means clustering algorithm.
  • the fingerprint identification device of the embodiment of the present application is arranged under the display screen of the electronic device, and the display screen includes a fingerprint detection area.
  • the central area of the fingerprint detection area is set to illuminate the finger in a single color, and the surrounding area is set to illuminate the finger with a color pattern.
  • This edge pattern can be a periodic grid, or a pattern with a certain curvature on the edge, or multiple color lines, so that the acquired fingerprint image can be used for fingerprint recognition and fingerprint anti-counterfeiting authentication, which solves the existing problem.
  • the under-screen optical fingerprint recognition device cannot prevent the problem of false fingerprints in various forms, and improves the security level of the system, thereby enhancing the user experience.
  • the cost of the optical fingerprint module using the color patterning method of the present application is much lower than that of the color filter fingerprint module; moreover, the optical sensor chip in the embodiment of the present application has a shorter processing cycle, lower cost, and higher yield. high.
  • an electronic device in a second aspect, includes a fingerprint identification device, a display screen, and a processor as in the first aspect or any possible implementation of the first aspect.
  • the display screen includes a plurality of light emitting devices. Display pixels, the light-emitting display pixels are used to display images, the display screen includes a fingerprint detection area, the fingerprint detection area includes a central area and a surrounding area that do not overlap each other, the central area is located in the middle of the surrounding area, the The light-emitting display pixels in the central area emit monochromatic light to illuminate the finger, and the light-emitting display pixels in the surrounding area emit light of multiple colors distributed at intervals to illuminate the finger; the processor is used to illuminate the finger according to the fingerprint
  • the light signal received by the optical sensor in the recognition device generates a fingerprint image, and performs fingerprint recognition on the finger according to the central part of the fingerprint image corresponding to the central area, and according to the fingerprint image and the The surrounding part corresponding to the surrounding area performs fingerprint anti-counterfeiting authentication on the
  • the processor is further configured to: based on a deep learning algorithm, determine the fingerprint image to be detected according to the surrounding part in the fingerprint image to be detected Whether it is a fingerprint image of a real finger.
  • the processor is further configured to: based on a deep learning algorithm, according to the distribution image of the reflected light signal in the surrounding part and/or The distribution image of the scattered light signal to determine whether the fingerprint image to be detected is a fingerprint image of a real finger, wherein the reflected light signal is the light emitted by the light-emitting display pixels in the surrounding area generated on the surface of the target finger.
  • the returned light signal after reflection, and the scattered light signal is the light signal returned after the light emitted by the light-emitting display pixels in the surrounding area is scattered inside the target finger.
  • the processor is further configured to: based on a deep learning algorithm, according to the distribution image and/or the first optical signal in the surrounding part Or the distribution image of the second light signal to determine whether the fingerprint image to be detected is a fingerprint image of a real finger, wherein the first light signal and the second light signal are respectively the light-emitting display pixels in the surrounding area Light signals of any two colors of the emitted light of multiple colors after irradiating the target finger.
  • the processor is further configured to: determine the distribution image of the first optical signal in the surrounding part and the second The distribution image of the light signal, the first light signal is the light signal returned by the blue light emitted by the light-emitting display pixels in the surrounding area after irradiating the target finger, and the second light signal is the light signal in the surrounding area
  • the red light emitted by the luminescent display pixel returns the optical signal after irradiating the target finger; based on the deep learning algorithm, according to the difference between the distribution image of the first optical signal and the distribution image of the second optical signal, determine Whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the processor is further configured to: obtain several sample data, the several sample data including several real finger data and several fake finger data
  • the plurality of real finger data includes the surrounding parts corresponding to the surrounding area in the fingerprint image obtained when a plurality of real fingers touch the fingerprint detection area, and the plurality of fake finger data includes a plurality of fake fingers touching the surrounding area.
  • the surrounding part of the fingerprint image obtained during the fingerprint detection area corresponding to the surrounding area training based on the several sample data to obtain a deep learning model of fingerprint images of real and fake fingers; according to the deep learning model, according to The surrounding part of the fingerprint image to be detected is determined whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the deep learning algorithm includes at least one of the following: support vector machine, convolutional neural network, recurrent neural network, and k-means clustering algorithm.
  • the electronic device of the embodiment of the present application has an under-screen fingerprint identification device.
  • the display screen of the electronic device includes a fingerprint detection area.
  • a monochrome illuminating finger is set in the center area of the fingerprint detection area, and a color pattern is set to illuminate the finger in the surrounding area.
  • the edge pattern can be a periodic grid, or a pattern with a certain curvature on the edge, or multiple colored lines, so that the acquired fingerprint image can be used for fingerprint recognition and fingerprint anti-counterfeiting authentication, which solves the problem of existing screens.
  • the lower optical fingerprint recognition device cannot prevent the problem of false fingerprints in various forms, and improves the security level of the system, thereby enhancing the user experience.
  • the cost of the optical fingerprint module using the color patterning method of the present application is much lower than that of the color filter fingerprint module.
  • a fingerprint identification and anti-counterfeiting method comprising: acquiring a fingerprint image of a target finger to be detected, where the fingerprint image to be detected is the fingerprint of the target finger touching the fingerprint detection area of the display screen Image, the fingerprint detection area includes a non-overlapping central area and a surrounding area, the central area is located in the middle of the surrounding area, the light-emitting display pixels in the central area emit monochromatic light to illuminate the target finger, so The light-emitting display pixels in the surrounding area emit light of multiple colors to illuminate the target finger; perform fingerprint recognition on the target finger according to the central part of the fingerprint image to be detected corresponding to the central area; Perform fingerprint anti-counterfeiting authentication on the target finger in the surrounding part corresponding to the surrounding area in the fingerprint image to be detected.
  • the performing fingerprint anti-counterfeiting authentication on the target finger according to the surrounding part corresponding to the surrounding area in the fingerprint image to be detected includes: depth-based
  • the learning algorithm determines whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected.
  • the deep learning algorithm is used to determine the fingerprint image to be detected according to the surrounding part in the fingerprint image to be detected Whether it is a fingerprint image of a real finger, including: based on a deep learning algorithm, determining whether the fingerprint image to be detected is a fingerprint of a real finger according to the distribution image of the reflected light signal and/or the distribution image of the scattered light signal in the surrounding part An image, wherein the reflected light signal is the light signal returned by the light emitted by the light-emitting display pixels in the surrounding area after being reflected on the surface of the target finger, and the scattered light signal is the light emission in the surrounding area The light emitted by the display pixel is scattered inside the target finger and then returned to the light signal.
  • the deep learning algorithm is used to determine the fingerprint image to be detected according to the surrounding part in the fingerprint image to be detected Whether it is a fingerprint image of a real finger, including: based on a deep learning algorithm, determining whether the fingerprint image to be detected is a real finger according to the distribution image of the first light signal and/or the distribution image of the second light signal in the surrounding part The fingerprint image of the fingerprint image, wherein the first light signal and the second light signal are respectively the light of any two colors of the multiple colors emitted by the light-emitting display pixels in the surrounding area illuminating the target finger After returning the light signal.
  • the deep learning algorithm is used according to the distribution image of the first optical signal and/or the second optical signal in the surrounding part
  • a distribution image determining whether the fingerprint image to be detected is a fingerprint image of a real finger, including: determining a distribution image of the first light signal and a distribution image of the second light signal in the surrounding part, the first The light signal is the light signal returned by the blue light emitted by the light-emitting display pixels in the surrounding area after irradiating the target finger, and the second light signal is the red light emitted by the light-emitting display pixels in the surrounding area.
  • the optical signal returned after the target finger based on a deep learning algorithm, determine whether the fingerprint image to be detected is a real finger based on the difference between the distribution image of the first optical signal and the distribution image of the second optical signal Fingerprint image.
  • the deep learning algorithm is used to determine the fingerprint image to be detected according to the surrounding part in the fingerprint image to be detected Whether it is a fingerprint image of a real finger, including: acquiring a number of sample data including a number of real finger data and a number of fake finger data, the number of real finger data including a number of real fingers touching the fingerprint detection area Surrounding parts in the acquired fingerprint image corresponding to the surrounding area, and the plurality of fake finger data includes the surrounding parts corresponding to the surrounding area in the fingerprint image obtained when the fake fingers touch the fingerprint detection area;
  • the several sample data are trained to obtain a deep learning model of fingerprint images of real and fake fingers; according to the deep learning model, according to the surrounding part of the fingerprint image to be detected, it is determined whether the fingerprint image to be detected is The fingerprint image of a real finger.
  • the deep learning algorithm includes at least one of the following: support vector machine, convolutional neural network, recurrent neural network, and k-means clustering algorithm.
  • the under-screen fingerprint identification and anti-counterfeiting method of the embodiment of the present application is suitable for electronic equipment with under-screen fingerprint identification devices.
  • the display screen of the electronic equipment includes a fingerprint detection area, and a single color is set in the center area of the fingerprint detection area. Illuminate the finger and set a color pattern in the surrounding area to illuminate the finger.
  • This edge pattern can be a periodic grid, or a pattern with a certain curvature on the edge, or multiple colored lines, so that the acquired fingerprint image can be fingerprinted.
  • Fingerprint anti-counterfeiting authentication can also be performed, which solves the problem that the existing under-screen optical fingerprint recognition device cannot prevent various forms of fake fingerprints, improves the security level of the system, and thereby enhances the user experience.
  • the cost of the optical fingerprint module using the color patterning method of the present application is much lower than that of the color filter fingerprint module; moreover, the optical sensor chip of the embodiment of the present application has a shorter processing cycle, lower cost, and higher yield. .
  • an electronic device including: a storage unit and a processor, the storage unit is used to store instructions, the processor is used to execute the instructions stored in the memory, and when the processor executes the instructions stored in the memory The execution causes the processor to execute the third aspect or the method in any possible implementation manner of the third aspect.
  • a computer-readable medium for storing a computer program, and the computer program includes instructions for executing the third aspect or any possible implementation of the third aspect.
  • a computer program product including instructions is provided.
  • the computer runs the finger of the computer program product, the computer executes the fingerprint in the third aspect or any possible implementation of the third aspect.
  • Methods of identification and anti-counterfeiting can run on the electronic device of the fourth aspect.
  • Fig. 1 is a schematic diagram of an electronic device according to an embodiment of the present application.
  • Fig. 2 is another schematic diagram of an electronic device according to an embodiment of the present application.
  • Fig. 3 is a partial schematic diagram of another electronic device according to an embodiment of the present application.
  • Fig. 4 is a schematic diagram of a fingerprint detection area according to an embodiment of the present application.
  • Fig. 5 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
  • Fig. 6 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
  • Fig. 7 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
  • Fig. 8 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
  • Fig. 9 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
  • Fig. 10 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
  • Fig. 11 is a schematic flowchart of an off-screen fingerprint identification and anti-counterfeiting method according to an embodiment of the present application.
  • embodiments of this application can be applied to optical fingerprint systems, including but not limited to optical fingerprint identification systems and medical diagnostic products based on optical fingerprint imaging.
  • the embodiments of this application only take optical fingerprint systems as an example for description, but should not The embodiments of the application constitute any limitation, and the embodiments of the present application are also applicable to other systems using optical imaging technology.
  • the optical fingerprint system provided in the embodiments of this application can be applied to smart phones, tablet computers, and other mobile terminals with display screens or other electronic devices; more specifically, in the above electronic devices, fingerprint identification
  • the device may specifically be an optical fingerprint device, which may be arranged in a partial area or an entire area under the display screen, thereby forming an under-display optical fingerprint system.
  • the fingerprint identification device may be partially or fully integrated into the display screen of the electronic device, thereby forming an in-display optical fingerprint system.
  • FIG. 1 and FIG. 2 are schematic diagrams of the structure of an electronic device to which the embodiment of the application can be applied.
  • FIG. 1 is a front view of the electronic device
  • FIG. 2 is a side view of the electronic device.
  • the electronic device 10 includes a display screen 120 and an optical fingerprint device 130, wherein the optical fingerprint device 130 is arranged in a partial area below the display screen 120.
  • the optical fingerprint device 130 includes an optical fingerprint sensor, and the optical fingerprint sensor includes a sensing array 133 with a plurality of optical sensing units 131, and the area where the sensing array is located or its sensing area is the fingerprint detection area 103 of the optical fingerprint device 130.
  • FIG. 1 is a front view of the electronic device
  • FIG. 2 is a side view of the electronic device.
  • the electronic device 10 includes a display screen 120 and an optical fingerprint device 130, wherein the optical fingerprint device 130 is arranged in a partial area below the display screen 120.
  • the optical fingerprint device 130 includes an optical fingerprint sensor, and the optical fingerprint sensor includes
  • the fingerprint detection area 103 is located in the display area of the display screen 120.
  • the optical fingerprint device 130 can also be arranged in other positions, such as the side of the display screen 120 or the non-transmissive area on the edge of the electronic device 10, and the optical fingerprint device 130 can be designed through the optical path. At least part of the optical signal of the display area is guided to the optical fingerprint device 130, so that the fingerprint detection area 103 is actually located in the display area of the display screen 120.
  • the area of the fingerprint detection area 103 may be different from the area of the sensing array of the optical fingerprint device 130.
  • the reflective folding optical path design, or other optical path design such as light convergence or reflection, it can make The area of the fingerprint detection area 103 of the optical fingerprint device 130 is larger than the area of the sensing array of the optical fingerprint device 130.
  • the fingerprint detection area 103 of the optical fingerprint device 130 can also be designed to be substantially the same as the area of the sensing array of the optical fingerprint device 130.
  • the electronic device 10 adopting the above structure does not need to reserve space on the front side to set fingerprint buttons (such as the Home button), so that a full screen solution can be adopted, that is, the display area of the display screen 120 can be It basically extends to the front of the entire electronic device 10.
  • the optical fingerprint device 130 includes a light detecting part 134 and an optical component 132, and the light detecting part 134 includes the sensing array and a reader electrically connected to the sensing array.
  • the circuit and other auxiliary circuits can be fabricated on a chip (Die) through a semiconductor process, such as an optical imaging chip or an optical fingerprint sensor.
  • the sensing array is specifically a photodetector array, which includes a plurality of arrays.
  • the photodetector can be used as the above-mentioned optical sensing unit; the optical component 132 can be arranged above the sensing array of the light detection part 134, which can specifically include a filter layer (Filter), light guide The light guide layer or light path guiding structure and other optical elements, the filter layer can be used to filter the ambient light penetrating the finger, and the light guide layer or light path guiding structure is mainly used to guide the reflected light reflected from the finger surface to the The sensing array performs optical inspection.
  • the filter layer Filter
  • the light guide layer or light path guiding structure and other optical elements the filter layer can be used to filter the ambient light penetrating the finger
  • the light guide layer or light path guiding structure is mainly used to guide the reflected light reflected from the finger surface to the The sensing array performs optical inspection.
  • the optical assembly 132 and the light detecting part 134 may be packaged in the same optical fingerprint component.
  • the optical component 132 and the optical detection part 134 can be packaged in the same optical fingerprint chip, or the optical component 132 can be arranged outside the chip where the optical detection part 134 is located, for example, the optical component 132 can be attached to the Above the chip, or part of the components of the optical assembly 132 are integrated in the above chip.
  • the light guide layer or light path guiding structure of the optical component 132 has multiple implementation schemes.
  • the light guide layer may specifically be a collimator layer made on a semiconductor silicon wafer, which has multiple collimators.
  • a collimating unit or a micro-hole array the collimating unit can be specifically a through hole or a small hole.
  • the reflected light reflected from the finger the light that is perpendicularly incident on the collimating unit can pass through and be received by the optical sensor unit below it , And the light with too large incident angle is attenuated by multiple reflections inside the collimating unit. Therefore, each optical sensing unit can basically only receive the reflected light reflected by the fingerprint pattern directly above it, so the sensing array is The fingerprint image of the finger can be detected.
  • the light guide layer or the light path guide structure can also be an optical lens (Lens) layer, which has one or more lens units, such as a lens group composed of one or more aspheric lenses, The reflected light reflected from the finger is condensed to the sensing array of the light detection part 134 below it, so that the sensing array can perform imaging based on the reflected light, thereby obtaining a fingerprint image of the finger.
  • the optical lens layer may further have a pinhole formed in the optical path of the lens unit, and the pinhole may cooperate with the optical lens layer to expand the field of view of the optical fingerprint device, so as to improve the fingerprint imaging of the optical fingerprint device 130 effect.
  • the light guide layer or the light path guide structure may also specifically adopt a micro-lens (Micro-Lens) layer.
  • the micro-lens layer has a micro-lens array formed by a plurality of micro-lens, which may be formed by a semiconductor growth process or Other processes are formed above the sensing array of the light detection part 134, and each microlens can correspond to one of the sensing units of the sensing array.
  • other optical film layers may be formed between the microlens layer and the sensing unit, such as a dielectric layer or a passivation layer. More specifically, a barrier with microholes may also be formed between the microlens layer and the sensing unit.
  • the light blocking layer can block the optical interference between the adjacent micro lens and the sensing unit, and allow the light corresponding to the sensing unit to pass through the
  • the micro lens is converged into the micro hole and is transmitted to the sensing unit through the micro hole to perform optical fingerprint imaging.
  • a microlens layer can be further provided under the collimator layer or the optical lens layer.
  • the collimator layer or the optical lens layer is used in combination with the microlens layer, the specific laminated structure or optical path may need to be adjusted according to actual needs.
  • the display screen 120 may be a display screen with a self-luminous display unit, such as an organic light-emitting diode (Organic Light-Emitting Diode, OLED) display screen or a micro-LED (Micro-LED) display screen .
  • OLED Organic Light-Emitting Diode
  • Micro-LED micro-LED
  • the optical fingerprint device 130 can use the display unit (ie, an OLED light source) of the OLED display screen 120 located in the fingerprint detection area 103 as an excitation light source for optical fingerprint detection.
  • the display screen 120 emits a beam of light 111 to the target finger 140 above the fingerprint detection area 103.
  • the light 111 is reflected on the surface of the finger 140 to form reflected light or passes through the finger 140.
  • Internal scattering forms scattered light.
  • the above-mentioned reflected light and scattered light are collectively referred to as return light passing through the finger. Since the ridge and valley of the fingerprint have different ability to reflect, scatter or absorb light, the return light 151 from the fingerprint ridge and the return light 152 from the fingerprint ridge have different light intensities, and the return light passes through
  • the optical component 132 After the optical component 132, it is received by the sensor array 134 in the optical fingerprint device 130 and converted into a corresponding electrical signal, that is, a fingerprint detection signal; based on the fingerprint detection signal, fingerprint image data can be obtained, and fingerprint matching verification can be further performed.
  • the electronic device 10 realizes the optical fingerprint recognition function.
  • the electronic device 10 further includes a transparent protective cover, which may be a glass cover or a sapphire cover, which is located above the display screen 120 and covers the front of the electronic device 10. . Therefore, in the embodiments of the present application, the so-called finger pressing on the display screen 120 actually refers to pressing on the cover plate above the display screen 120 or covering the surface of the protective layer of the cover plate.
  • a transparent protective cover which may be a glass cover or a sapphire cover
  • the optical fingerprint device 130 may only include one optical fingerprint sensor.
  • the fingerprint detection area 103 of the optical fingerprint device 130 has a small area and a fixed position. Therefore, when the user performs fingerprint input It is necessary to press the finger to a specific position of the fingerprint detection area 103, otherwise the optical fingerprint device 130 may not be able to collect fingerprint images, resulting in poor user experience.
  • the optical fingerprint device 130 may specifically include a plurality of optical fingerprint sensors; the plurality of optical fingerprint sensors may be arranged side by side under the display screen 120 in a splicing manner, and the sensing of the plurality of optical fingerprint sensors The areas collectively constitute the fingerprint detection area 103 of the optical fingerprint device 130.
  • the fingerprint detection area 103 of the optical fingerprint device 130 may include multiple sub-areas, and each sub-area corresponds to the sensing area of one of the optical fingerprint sensors, so that the fingerprint collection area 103 of the optical fingerprint module 130 can be It extends to the main area of the lower half of the display screen, that is, extends to the area where the finger is habitually pressed, so as to realize the blind fingerprint input operation.
  • the fingerprint detection area 130 can also be extended to half of the display area or even the entire display area, thereby realizing half-screen or full-screen fingerprint detection.
  • the current under-screen optical fingerprint device usually includes a periodic small hole optical path solution and a macro lens solution according to the different light path guiding structure it includes. Both of these solutions place the optical fingerprint device on Below the display, for example, the way is below the OLED screen.
  • the fingerprint is a diffuse reflector, and the light returned by the finger may exist in all directions.
  • the first periodic small hole solution (or collimator solution) is to collect the light leaked from the fingerprint screen through periodic small holes under the OLED screen. This part of the light contains the fingerprint signal and the internal structure signal of the screen.
  • the second macro lens solution (including the optical lens solution) uses a macro lens to collect the light leaked from the OLED screen, and then detect fingerprints.
  • the lighting method of the under-screen optical fingerprint device that has been released generally uses a partial area monochrome pattern, which will light up all the pixels in the fingerprint detection area or fingerprint pressing area.
  • This method can better reflect the fingerprint information of the finger, but because the full-area lighting basically reflects the boundary conditions between the glass cover on the surface of the screen and the fingerprint contact surface, this method has a poor anti-counterfeiting effect on true and false fingerprints. , So it cannot distinguish between true and false fingerprints.
  • the existing anti-counterfeiting solution generally involves fabricating color filters in a specific area of a Complementary Metal-Oxide-Semiconductor (CMOS) image sensor, and identifying true and false fingerprints through a deep learning method.
  • CMOS Complementary Metal-Oxide-Semiconductor
  • the cost of such a color filter anti-counterfeiting solution is much higher than that of a non-filter solution.
  • the embodiments of the present application propose a fingerprint identification and anti-counterfeiting method, device, and electronic equipment, which can perform fingerprint recognition and fingerprint anti-counterfeiting authentication, with lower cost and higher efficiency.
  • FIG. 3 shows a partial schematic diagram of an electronic device 20 according to an embodiment of the present application, and FIG. 3 is a side view of the electronic device 20.
  • the electronic device 20 includes a display screen 200 and a fingerprint identification device 300, and the display screen 200 is located above the fingerprint identification device 300.
  • the display screen 200 may correspond to the display screen 120 in the electronic device 10 described in FIG. 1 and FIG. 2, and is suitable for the related description of the display screen 120 described above. For the sake of brevity, details are not repeated here.
  • the display screen 200 includes a number of light-emitting display pixels, which can be used to display images.
  • the display screen 200 in FIG. 3 may represent a part of the display screen 200 instead of the actual size and size of the display 200.
  • the display screen 200 includes a fingerprint detection area 210 for finger pressing, that is, when the user needs to unlock the electronic device 20 or other fingerprint recognition, he only needs to press his finger on the fingerprint detection area 210, the fingerprint input can be realized.
  • the fingerprint detection area 210 may correspond to the fingerprint detection area 103 in the electronic device 10 described in FIG. 1 and FIG. 2, and is applicable to the relevant description of the fingerprint detection area 103 described above. For the sake of brevity, it will not be repeated here.
  • the fingerprint detection area 210 includes a central area 211 and a surrounding area 212 that do not overlap each other, and the central area 211 is located in the middle of the surrounding area 212.
  • the light-emitting display pixels in the central area 211 emit monochromatic light to illuminate the finger above it, and the light-emitting display pixels in the surrounding area 212 emit light of multiple colors distributed at intervals to illuminate the finger. That is, when a finger touches the fingerprint detection area 210, the central area 211 of the fingerprint detection area 210 illuminates the finger with monochromatic light, and the surrounding area 212 of the fingerprint detection area 210 illuminates the finger with a color pattern.
  • the return light signal includes the light that returns after being reflected on the surface of the finger, as shown in the three groups of hollow arrow symbols in Figure 3; in addition, the return light signal also includes the light that returns after being scattered inside the finger, as shown in Figure 3.
  • the three groups of black solid thick arrow symbols are shown.
  • the fingerprint identification device 300 is provided under the display screen 200 of the terminal device 20 in the embodiment of the present application, and the fingerprint identification device 300 may be used to receive the return light signal of the finger.
  • the fingerprint identification device 300 includes: an optical path guiding structure 310 and an optical sensor 320, and the optical sensor 320 is disposed under the optical path guiding structure 310.
  • the light path guiding structure 310 is used to: guide the return light signal to the optical sensor, the return light signal is the light signal returned after the light emitted by the light-emitting display pixel in the fingerprint detection area irradiates the finger; the optical sensor 320 is used for : Receive the light signal passing through the optical path guiding structure, the light signal is used to obtain the fingerprint image of the finger, the central part of the fingerprint image corresponding to the central area is used for fingerprint identification, and the fingerprint image corresponds to the surrounding area The surrounding part is used for fingerprint anti-counterfeiting authentication.
  • the optical path guiding structure 310 may correspond to the optical component 132 in the electronic device 10 described in FIGS. 1 and 2, and is suitable for the above-mentioned related description of the optical component 132; similarly, the optical sensor 320 may correspond to the above The optical fingerprint sensor in the electronic device 10 described in FIGS. 1 and 2, specifically, the optical sensor 320 may be the light detecting portion 134 in the above-mentioned electronic device 10, which is applicable to the above-mentioned related description about the light detecting portion 134, in order to It's concise, so I won't repeat it here.
  • the optical path guiding structure 320 of the embodiment of the present application may include an optical lens.
  • the optical path guiding structure 320 of the embodiment of the present application may further include an optical collimator having a plurality of collimating units or a microhole array, and the optical collimator is used to pass the return optical signal through the plurality of collimating units Or the microhole array is respectively transmitted to the corresponding optical sensing unit in the sensing array of the optical sensor.
  • the optical path guiding structure 320 of the embodiment of the present application includes a microlens array with a plurality of microlenses and a light blocking layer with a plurality of microholes, and the microlens array is used to pass the return light signal through the plurality of microlenses.
  • the lenses are respectively focused on the micro holes corresponding to the light blocking layer, and are transmitted to the corresponding optical sensing units in the sensing array of the optical sensor through the micro holes.
  • an embodiment of the present application proposes The method of using the edge area to emit colored light separately to realize the anti-counterfeiting authentication of optical fingerprints can be used for fingerprint identification and anti-counterfeiting of true and false fingerprints at the same time, which improves the user experience.
  • FIG. 4 shows a schematic diagram of a fingerprint detection area 210 according to an embodiment of the present application.
  • the fingerprint detection area 210 includes a central area 211 and a surrounding area 212.
  • the central area 211 is the central part of the fingerprint detection area 210, that is, the white area in the middle of FIG. 4.
  • the light-emitting display pixels in the central area 211 emit monochromatic light to illuminate the finger, and the return light after the monochromatic light illuminates the finger passes through After the optical path guide structure is received by the optical sensor, the fingerprint image is obtained by this, and this part of the fingerprint image can be used for fingerprint identification.
  • the light-emitting display pixels in the central area 211 can be used to emit monochromatic light for fingerprint recognition, where the monochromatic light can be light of any color.
  • the monochromatic light may be green light, cyan light or white light, and the embodiment of the present application is not limited thereto.
  • any light-emitting display pixel in the embodiments of the present application may refer to a combination of three colors of red, green, and blue. Therefore, each pixel may be used to emit light of various colors.
  • the periphery of the central area 211 is the surrounding area 212, that is, the surrounding area 212 is located at the periphery of the middle white area in FIG. 4, which refers to the area with pattern filling in FIG.
  • the peripheral area 212 surrounds the central area 212.
  • the light-emitting display pixels in the peripheral area 212 emit light of multiple colors to illuminate the finger, and the lights of multiple colors are distributed at intervals in space.
  • the return light after the light irradiates the finger is guided by the optical path.
  • the optical sensor obtains the corresponding image. This part of the image can be used for finger anti-counterfeiting authentication, that is, to confirm whether the finger is a real finger or a fake finger.
  • the light-emitting display pixels in the surrounding area 212 may be used to emit light of multiple colors, and the light of multiple colors may be lights of any two or more colors.
  • the light of the multiple colors may include at least two of red light, blue light, green light, yellow light, and black light, where the black light means no light is emitted.
  • the fingerprint image of the finger can be correspondingly obtained. Since the fingerprint detection area 210 is divided into a central area 211 and a surrounding area 212, and the light of the central area 211 and the surrounding area 211 are different, the corresponding The acquired fingerprint image of the finger can also be seen as two parts. For ease of description, the two parts are referred to as the central part and the surrounding part of the fingerprint image below.
  • the fingerprint image corresponding to the central area 211 is the central part, the central part is obtained according to the return light signal generated by the monochromatic light emitted in the central area 211 irradiating the finger, and the central part is used for fingerprint identification to determine the Whether the fingerprint image is a pre-stored fingerprint image; in addition, the surrounding area 212 corresponds to the surrounding area in the fingerprint image, and the surrounding area is obtained based on the return light signal generated by irradiating the finger with multiple colors of light emitted by the surrounding area 212.
  • the surrounding part is used for fingerprint anti-counterfeiting verification, that is, to determine whether the fingerprint image is a fingerprint image of a real finger, that is, to determine whether the finger touching the fingerprint detection area 210 is a real finger.
  • the central part of the fingerprint image is used for fingerprint identification, in order to ensure the accuracy of the central part of the fingerprint image of the obtained finger during fingerprint identification, that is, to ensure the clarity and accuracy of the fingerprint in the central part, it is necessary to use
  • the central part is not less than a certain threshold, and correspondingly, it is necessary to set the central area 211 in the fingerprint detection area 210 to be no less than a certain threshold. Therefore, the area and shape of the central area 211 can be set according to actual application requirements.
  • the area of the central area 211 may be set to be greater than the area of the surrounding area 212.
  • the central area 211 can usually be set as a single connected area with an area greater than or equal to 16 mm 2 , for example, considering the effect and cost, the central area 211 can be set as a rectangle of 5.5 mm * 8.5 mm; correspondingly, The peripheral area 212 may be set as an outer ring area with a width of 0.05 mm-3 mm at the edge of the central area 211.
  • the central area 211 may be set to be a rectangle or a circle.
  • the central area 211 is a rectangle as an example, but the embodiment of the present application is not limited to this.
  • FIG. 5 shows a schematic diagram of another fingerprint detection area 210 according to an embodiment of the present application.
  • the fingerprint detection area 210 includes a central area 211 and a surrounding area 212.
  • the fingerprint detection area 210 may also include a supplementary light area 213 located at the periphery of the surrounding area 212, as shown in FIG. 4 In the outermost white area, the light-emitting display pixels in the supplemental light area 213 emit monochromatic light to illuminate the finger.
  • the color of the monochromatic light emitted by the light-emitting display pixels in the supplemental light area 213 may be the same as or different from the color of the monochromatic light emitted by the light-emitting display pixels in the central area 211.
  • the monochromatic light emitted by the light-emitting display pixels in the supplemental light area 213 is usually set to be the same color as the monochromatic light emitted by the light-emitting display pixels in the central area 211.
  • the light of multiple colors emitted by the light-emitting display pixels in the surrounding area 212 may have the same color as the monochromatic light emitted by the light-emitting display pixels in the central area 211, or there may be no light of the same color. Considering the effect, the light of multiple colors emitted by the light-emitting display pixels in the surrounding area 212 is usually set to be different from the color of the monochromatic light emitted by the light-emitting display pixels in the central area 211.
  • the surrounding area 212 is considered to include multiple sets of sub-regions.
  • the light-emitting display pixels in the same group of sub-regions emit light of the same color to illuminate the finger, and the light-emitting display pixels in different groups of sub-regions emit light of different colors to illuminate the finger.
  • each group of sub-regions in the multiple groups of sub-regions includes multiple sub-regions, and the number of sub-regions included in different groups of sub-regions may be the same or different.
  • the light-emitting display pixels in the surrounding area 212 emit light of multiple colors to illuminate the finger, and the light of the multiple colors is distributed at intervals in space.
  • the sub-regions of different groups in the multiple sub-regions Arranged at intervals. For example, assuming that the multiple sets of subregions are three sets of subregions, the subregions included in the three sets of subregions are arranged at intervals.
  • the areas and/or shapes of multiple subregions in the same group of subregions in the multiple sets of subregions may be the same or different; and the areas and/or shapes of subregions included in different sets of subregions may also be Same or different.
  • multiple sub-regions in the same group of sub-regions are usually set to have the same area and shape.
  • the following description takes the same area and shape of multiple sub-regions in the same group of sub-regions as an example; in addition, the areas and shapes of different groups of sub-regions in the embodiments of the present application may be the same or different.
  • the size of any subregion in the embodiments of the present application can be set according to actual applications.
  • the width of each sub-region in the surrounding area 212 can be set in the range of 0.2mm-3mm.
  • the side length of the square is in the range of 0.2mm-3mm; and the sub-region is assumed to be a circle.
  • the diameter of the sub-area can be set to be 0.2mm-3mm.
  • the size of each sub-region in the surrounding region 212 may be correspondingly set to include 5-10 light-emitting display pixels, but the embodiment of the present application is not limited to this.
  • the multiple sets of sub-regions included in the surrounding area 212 in the embodiment of the present application may be two sets of sub-regions or more than two sets of sub-regions.
  • the multiple sets of sub-regions are used as two sets of sub-regions or Three groups of sub-regions are described in ranks.
  • the surrounding area 212 in this embodiment of the present application includes two groups of sub-areas, which are a first group of sub-areas and a second group of sub-areas, respectively.
  • the sub-regions in the first group of sub-regions and the sub-regions in the second group of sub-regions are arranged at intervals; the areas and shapes of the multiple sub-regions in the first group of sub-regions are the same.
  • the area and shape of the sub-regions are the same.
  • the shape of the sub-areas in the first group of sub-areas may be the same as the shape of the sub-areas in the second group of sub-areas.
  • the shape of the sub-areas in the first group of sub-areas and the second group of sub-areas can be set to any shape, for example, can be set to a square, a circle or a semicircle.
  • the shapes of the sub-areas in the first group of sub-areas and the second group of sub-areas may both be square.
  • the colors of the two groups of regions can be set reasonably so that there are regions with different light intensities in the surrounding region 212.
  • any group of sub-areas in the first group of sub-areas or the second group of sub-areas can also set any group of sub-areas in the first group of sub-areas or the second group of sub-areas to red, and the other group to other colors, such as yellow or blue, so that both groups of sub-areas emit light, but Through the filter set above the optical sensor to intercept the red return light, the light intensity of the two groups of sub-areas can also be clearly contrasted.
  • the shapes of the sub-areas in the first group of sub-areas and the second group of sub-areas may both be semicircular.
  • the surrounding area 212 may also include a part of the black area, that is, the non-luminous area, that is, the black area as shown in FIG. 6.
  • the part of the black area may make the surrounding area 212 have areas with different light intensities. The embodiment is not limited to this.
  • the shape of the sub-regions in the first group of sub-regions may also be different from the shape of the sub-regions in the second group of sub-regions.
  • the first group of sub-regions and the second group of sub-regions can be set in any two different shapes, for example, can be set in any two shapes of a square, a circle, a semicircle, and an ellipse.
  • the shape of the sub-areas in the first group of sub-areas is a square
  • the shape of the sub-areas in the second group of sub-areas is a circle
  • the surrounding area 212 may also include a part of the black area, that is, the non-luminous area, that is, the black area as shown in FIG. 7, and the embodiment of the present application is not limited to this.
  • the surrounding area 212 of the embodiment of the present application includes three groups of sub-areas, which are respectively a first group of sub-areas, a second group of sub-areas, and a third group of sub-areas.
  • the sub-regions in the first group of sub-regions, the sub-regions in the second group of sub-regions, and the sub-regions in the third group of sub-regions are arranged at intervals; multiple sub-regions in the same group of sub-regions have the same area and shape .
  • the shapes of all the sub-areas in the first group of sub-areas, the second group of sub-areas and the third group of sub-areas may be set to be the same.
  • the shape of the sub-regions in the three groups of sub-regions may be set to any shape, for example, all may be set to be square, circular or semicircular.
  • the shapes of all the sub-areas in the first group of sub-areas, the second group of sub-areas, and the third group of sub-areas may all be square.
  • the colors of the three groups of areas can be set reasonably so that there are areas with different light intensities in the surrounding area 212.
  • any group of sub-areas from the first group of sub-areas to the third group of sub-areas can be black, that is, non-light-emitting areas; while the other two groups are set to light-emitting areas of other colors, such as blue and yellow, so that This makes the light intensities of these three groups of sub-regions have obvious contrast.
  • the shapes of all the sub-regions in the first group of sub-regions, the second group of sub-regions, and the third group of sub-regions may all be semicircular.
  • the surrounding area 212 may also include a part of the black area, that is, the non-luminous area, that is, the black area as shown in FIG. 9, and the embodiment of the present application is not limited to this.
  • the shapes of the sub-areas in different groups of sub-areas may also be set to be different.
  • the first group of sub-regions, the second group of sub-regions, and the third group of sub-regions can be set to any two or three different shapes, that is, there may be two groups of sub-regions with the same shape in the three groups of sub-regions.
  • the other group has a different shape
  • the three groups of sub-regions can also be set to three completely different shapes.
  • the three groups of sub-regions can be set to any two or three shapes among square, circle, semicircle and ellipse.
  • the shape of the sub-areas in the first group of sub-areas is square, and the shapes of the sub-areas in the second group of sub-areas and the third group of sub-areas are both circular.
  • the surrounding area 212 may also include a part of a black area, that is, a non-light emitting area, that is, a black area as shown in FIG. 10, and the embodiment of the present application is not limited to this.
  • the light-emitting display pixels in the fingerprint detection area 210 are set to illuminate the finger to obtain a fingerprint image corresponding to the finger.
  • the central part of the fingerprint image is used for fingerprint identification, and the fingerprint image
  • the surrounding part can be used for fingerprint anti-counterfeiting authentication.
  • the central area 211 of the fingerprint detection area 210 illuminates the finger with monochromatic light, and the corresponding optical sensor 320 obtains the part of the returned light and generates the central part of the fingerprint image.
  • the central part is the image with the fingerprint of the finger.
  • the central part of the fingerprint image performs fingerprint recognition.
  • the surrounding area 212 of the fingerprint detection area 210 illuminates the finger with spatially spaced light of multiple colors, and the optical sensor 320 obtains the part of the returned light and generates the surrounding part of the fingerprint image.
  • the surrounding part can be used for fingerprint anti-counterfeiting authentication.
  • a deep learning algorithm may be used to determine whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected.
  • a real fingerprint is composed of different layers.
  • a human finger can generally include structures such as the epidermis, dermis, body tissue, and phalanges.
  • the isotropic material and structure are far from the structure of the real fingerprint.
  • the return light signal received by the optical fingerprint device can be divided into two parts, one is the return light directly reflected by the fingerprint surface, and the other is inside the fingerprint Light that returns after scattering.
  • different colors of light hit the real and fake fingerprints, and the amount of signal shown is also different.
  • True and false fingerprints have different characteristics between the reflected light and internally scattered light due to the material and structure of the fingerprint surface, and the reflected spectrum of the fingerprint is different. By distinguishing these characteristics, the true and false fingerprints can be distinguished.
  • a deep learning algorithm may be used to analyze the surrounding part of the fingerprint image to be detected to determine whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the deep learning algorithm may include at least one of the following: Support Vector Machine (SVM), Convolutional Neural Networks (CNN), Recurrent Neural Network (RNN), and k-means aggregation Class algorithm (k-means clustering algorithm).
  • the fingerprint image to be detected of the target finger is acquired, and based on the deep learning algorithm, according to the surrounding part of the fingerprint image to be detected, it is determined whether the fingerprint image to be detected is
  • the fingerprint image of a real finger is to determine whether the target finger is a real finger.
  • a deep learning algorithm may be used to determine whether the fingerprint image to be detected is a fingerprint image of a real finger according to the distribution image of the reflected light signal and/or the distribution image of the scattered light signal in the surrounding part of the fingerprint image to be detected.
  • the reflected light signal is the light signal returned after the light emitted by the light-emitting display pixels in the surrounding area is reflected on the surface of the target finger.
  • the distribution image of the reflected light signal may refer to the spectrum of the returned reflected light Image, or can also refer to the intensity distribution image of the returned reflected light.
  • the scattered light signal is the light signal returned after the light emitted by the light-emitting display pixels in the surrounding area is scattered inside the target finger.
  • the distribution image of the scattered light signal may refer to the spectral image of the returned scattered light. Or it can also refer to the intensity distribution image of the returned scattered light.
  • This method uses one or more kinds of information such as internal scattering, external reflection, and different spectrum of fingerprints for anti-counterfeiting authentication, and the anti-counterfeiting effect is better than that of pure optical filters. Moreover, the lighting method of the fingerprint detection area 210 in the embodiment of the present application has a much lower cost than the method of using randomly distributed color filters, and other resources are consumed the same.
  • the method of determining whether the fingerprint image to be detected is a fingerprint image of a real finger based on a deep learning algorithm and according to surrounding parts in the fingerprint image to be detected may also include: based on the deep learning algorithm, according to the fingerprint image to be detected The distribution image of the first light signal and/or the distribution image of the second light signal in the surrounding part of the, determining whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the first light signal and the second light signal are respectively the light signals of any two colors of light emitted by the light-emitting display pixels in the surrounding area 212 after irradiating the target finger.
  • the distribution images of more kinds of light signals may be used for comparison to determine whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the distribution image of the first light signal and the distribution image of the second light signal in the surrounding part are determined, and the first light signal is that the blue light emitted by the light-emitting display pixel in the surrounding area 212 illuminates the target finger.
  • the light signal returned later, the second light signal is the light signal returned by the red light emitted by the light-emitting display pixel in the surrounding area 212 after irradiating the target finger.
  • the fingerprint image to be detected is a fingerprint image of a real finger according to the distribution image of the first light signal and/or the distribution image of the second light signal.
  • the corresponding blue light intensity distribution image can be determined based on the blue light signal returned by the blue light emitted by the light-emitting display pixels in the surrounding area 212 after irradiating the target finger; and then based on the deep learning algorithm, the acquired fingerprint image to be detected
  • the blue light intensity distribution image in the image is analyzed to determine whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the corresponding red light intensity distribution image can also be determined based on the red light signal returned by the red light emitted by the light-emitting display pixels in the surrounding area 212 after irradiating the target finger; and then based on the deep learning algorithm, the acquired The red light intensity distribution image in the fingerprint image to be detected is analyzed to determine whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • a deep learning algorithm may also be used to determine whether the fingerprint image to be detected is a fingerprint image of a real finger based on the difference between the distribution image of the first optical signal and the distribution image of the second optical signal. Specifically, based on the blue light signal returned by the blue light emitted by the light-emitting display pixels in the surrounding area 212 after irradiating the target finger, the corresponding blue light intensity distribution image is determined; based on the red light emitted by the light-emitting display pixels in the surrounding area 212 The red light signal returned after the light irradiates the target finger determines the corresponding red light intensity distribution image; obtains the difference image between the blue light intensity distribution image and the red light intensity distribution image; then analyzes the difference based on the deep learning algorithm, Then it is determined whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the fingerprint identification device 300 may further include: a filter 330, which is disposed above the optical sensor 320, and is used to filter out the infrared light signal in the return light signal, so as to filter out such as Influence of infrared light signals such as ambient light.
  • a filter 330 which is disposed above the optical sensor 320, and is used to filter out the infrared light signal in the return light signal, so as to filter out such as Influence of infrared light signals such as ambient light.
  • the filter can also be used to filter out part of the red light.
  • the third group of sub-areas may be any group of sub-areas, and the light emission in the third group of sub-areas
  • the display pixels are used to emit red light; the filter 330 can be used to filter the light signal returned after the red light irradiates the finger, and the filter 330 can filter the light returned after the red light irradiates the finger All or part of the signal.
  • the red light signal in the fingerprint image to be detected is the red light signal after passing through the filter 330.
  • one or more pieces of information about the surrounding part of the fingerprint image to be detected can be analyzed to determine whether the fingerprint image to be detected is a fingerprint image of a real finger; correspondingly, in the deep learning algorithm In the modeling phase, different information may need to be collected.
  • the modeling process of the deep learning algorithm may include: acquiring several sample data, the several sample data including several real finger data and several fake finger data.
  • the plurality of real finger data includes the surrounding parts corresponding to the surrounding area 212 in the fingerprint image obtained when a plurality of real fingers touch the fingerprint detection area 210;
  • the plurality of fake finger data includes a plurality of fake fingers touched in the fingerprint detection area.
  • the area 210 corresponds to the surrounding area 212 in the acquired fingerprint image.
  • the plurality of fake fingers may include various types of fake fingers, for example, may include: milky white rubber fingers, transparent rubber fake fingers, yellow 2D fake fingers, black rubber fingers, flesh-colored 3D rubber fingers, and so on.
  • the deep learning algorithm when used, it can be based on information such as the scattered light distribution, the reflected light distribution, and the distribution of different colors of light around the acquired fingerprint image. Therefore, when acquiring the several sample data, Corresponding to the different information that needs to be collected for each sample data. For example, the distribution of scattered light, the distribution of reflected light, and the distribution of light of different colors in the fingerprint image corresponding to each sample data can be collected, and the embodiment of the present application is not limited to this.
  • Training is performed based on the several sample data to obtain a deep learning model of fingerprint images of real and fake fingers. If there are many kinds of fake fingers collected, the deep learning model will be more accurate. According to the deep learning model, if the surrounding part of the fingerprint image to be detected of the target finger is input, after the analysis of the deep learning model, the result of whether the fingerprint image to be detected is a fingerprint image of a real finger can be output accordingly.
  • a monochrome illuminating finger is set in the center area of the fingerprint detection area, and a color pattern is set to illuminate the finger in the surrounding area.
  • This edge pattern can be a periodic grid or The edge has a certain curvature pattern, or it can be multiple color lines, so that the acquired fingerprint image can be used for fingerprint recognition and fingerprint anti-counterfeiting authentication, which solves the problem that the existing under-screen optical fingerprint recognition device cannot prevent various forms of false
  • the problem of fingerprints improves the security level of the system, thereby enhancing the user experience.
  • the cost of the optical fingerprint module using the color patterning method of the present application is much lower than that of the color filter fingerprint module; moreover, the optical sensor chip of the embodiment of the present application has a shorter processing cycle, lower cost, and higher yield. .
  • a deep learning algorithm can be used to distinguish the spectrum of true and false fingerprints.
  • the deep learning algorithm will be trained in advance using the historical big data of true and false fingerprints. This historical data contains various true and false fingerprints, including true and false fingerprints in various scenarios.
  • the original fingerprint image is output to the anti-counterfeiting algorithm to distinguish true and false fingerprints. Among them, the data of a single image can be recorded.
  • FIG. 11 shows a schematic flowchart of a method 400 for off-screen fingerprint identification and anti-counterfeiting according to an embodiment of the present application.
  • the method 400 may be executed by an electronic device with a display screen.
  • the electronic device may be the aforementioned electronic device 20.
  • the electronic device 20 may include a processor or a processing unit for executing the method 400.
  • the method 400 includes: S410, acquiring a fingerprint image of a target finger to be detected, where the fingerprint image to be detected is the fingerprint image of the target finger touching the fingerprint detection area of the display screen, and the fingerprint detection area includes mutual Non-overlapping central area and surrounding area, the central area is located in the middle of the surrounding area, the light-emitting display pixels in the central area emit monochromatic light to illuminate the target finger, and the light-emitting display pixels in the surrounding area emit light of multiple colors Illuminate the target finger; S420, perform fingerprint recognition on the target finger according to the central part of the fingerprint image to be detected corresponding to the central area; S430, perform fingerprint recognition on the surrounding part corresponding to the surrounding area in the fingerprint image to be detected The target finger performs fingerprint anti-counterfeiting authentication.
  • performing fingerprint anti-counterfeiting authentication on the target finger according to the surrounding part of the fingerprint image to be detected corresponding to the surrounding area includes: based on a deep learning algorithm, according to the fingerprint image in the fingerprint image to be detected The surrounding part determines whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the step of determining whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected based on a deep learning algorithm includes: The distribution image of the reflected light signal and/or the distribution image of the scattered light signal in the surrounding part to determine whether the fingerprint image to be detected is a fingerprint image of a real finger, where the reflected light signal is emitted by the light-emitting display pixels in the surrounding area The light signal returned after the light is reflected on the surface of the target finger, and the scattered light signal is the light signal returned after the light emitted by the light-emitting display pixels in the surrounding area is scattered inside the target finger.
  • the step of determining whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected based on a deep learning algorithm includes: The distribution image of the first light signal and/or the distribution image of the second light signal in the surrounding part is used to determine whether the fingerprint image to be detected is a fingerprint image of a real finger, where the first light signal and the second light signal are respectively The light-emitting display pixels in the surrounding area display light signals of any two colors of the multiple colors of light emitted by the target finger after irradiating the target finger.
  • the deep learning algorithm is used to determine whether the fingerprint image to be detected is the fingerprint of a real finger according to the distribution image of the first light signal and/or the distribution image of the second light signal in the surrounding part
  • the image includes: determining the distribution image of the first light signal and the distribution image of the second light signal in the surrounding part, where the first light signal is that the blue light emitted by the light-emitting display pixel in the surrounding area illuminates the target finger
  • the second light signal is the light signal returned by the red light emitted by the light-emitting display pixels in the surrounding area after irradiating the target finger
  • the difference of the distribution image of the second light signal determines whether the fingerprint image to be detected is a fingerprint image of a real finger.
  • the determination of whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected based on a deep learning algorithm includes: acquiring a plurality of sample data, the plurality of The sample data includes several real finger data and several fake finger data.
  • the several real finger data includes the surrounding parts of the fingerprint image obtained when the real finger touches the fingerprint detection area corresponding to the surrounding area
  • the several fake finger data includes A number of fake fingers touch the surrounding part of the fingerprint image obtained when the fingerprint detection area is corresponding to the surrounding area; training based on the several sample data to obtain a deep learning model of fingerprint images of real and fake fingers; according to the deep learning The model determines whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected.
  • the deep learning algorithm includes at least one of the following: a support vector machine, a convolutional neural network, a recurrent neural network, and a k-means clustering algorithm.
  • the method 400 can be applied to various electronic devices with an under-screen optical fingerprint identification device.
  • the fingerprint identification device can be an under-screen optical fingerprint identification device including a periodic small hole array, a macro wide-angle lens solution, and a folding type.
  • the under-screen optical fingerprint identification device and the under-screen optical fingerprint identification device of the microlens array solution are not limited to this embodiment of the present application.
  • the under-screen fingerprint identification and anti-counterfeiting method of the embodiment of the present application is suitable for electronic equipment with under-screen fingerprint identification devices.
  • the display screen of the electronic equipment includes a fingerprint detection area, and a single color is set in the center area of the fingerprint detection area. Illuminate the finger and set a color pattern in the surrounding area to illuminate the finger.
  • This edge pattern can be a periodic grid, or a pattern with a certain curvature on the edge, or multiple colored lines, so that the acquired fingerprint image can be fingerprinted.
  • Fingerprint anti-counterfeiting authentication can also be performed, which solves the problem that the existing under-screen optical fingerprint recognition device cannot prevent various forms of fake fingerprints, improves the security level of the system, and thereby enhances the user experience.
  • the cost of the optical fingerprint module using the color patterning method of the present application is much lower than that of the color filter fingerprint module; moreover, the optical sensor chip of the embodiment of the present application has a shorter processing cycle, lower cost, and higher yield. .
  • the disclosed system, device, and method may be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • each unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of this application essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (read-only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program code .

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Image Input (AREA)

Abstract

The embodiments of the present application relate to a fingerprint recognition and anti-counterfeiting method and apparatus, and an electronic device. The fingerprint recognition apparatus is arranged below a display screen of an electronic device, and a fingerprint detection area of the display screen comprises a central area and a surrounding area that do not overlap with each other. The fingerprint recognition apparatus comprises: a light path guiding structure for guiding a returned light signal to an optical sensor, wherein the returned light signal is a light signal returned after light emitted by a light-emitting display pixel in a fingerprint detection area irradiates a finger, a light-emitting display pixel in a central area emits monochromatic light to irradiate the finger, and a light-emitting display pixel in a surrounding area emits light of a plurality of colors distributed at intervals in terms of space to irradiate the finger; and the optical sensor for receiving a light signal passing through the optical path guiding structure, so as to acquire a fingerprint image of the finger, wherein a central part, corresponding to the central area, of the fingerprint image is used for fingerprint recognition, and a surrounding part, corresponding to the surrounding area, of the fingerprint image is used for fingerprint anti-counterfeiting authentication.

Description

指纹识别和防伪的方法、装置和电子设备Fingerprint identification and anti-counterfeiting method, device and electronic equipment 技术领域Technical field
本申请涉及生物识别领域,尤其涉及指纹识别和防伪的方法、装置和电子设备。This application relates to the field of biometric identification, and in particular to methods, devices and electronic equipment for fingerprint identification and anti-counterfeiting.
背景技术Background technique
随着屏下光学指纹方案的手机逐渐普及,对于屏下光学指纹的防伪提出了更高的要求。但目前已经面世的屏下光学指纹技术,防伪功能有限,大部分几乎没有防伪功能。With the gradual popularity of mobile phones with under-screen optical fingerprint solutions, higher requirements are put forward for the anti-counterfeiting of under-screen optical fingerprints. However, the currently available under-screen optical fingerprint technology has limited anti-counterfeiting functions, and most of them have almost no anti-counterfeiting functions.
例如,目前屏下光学指纹传感器技术主要有两种。第一种是基于周期性微孔阵列的屏下光学指纹识别技术,此技术容易受到莫尔条纹的影响。第二种是基于一体式的微透镜屏下光学指纹识别技术。这两种技术的屏下光学指纹识别技术,都是通过指纹按压区域全像素点亮的方式提取指纹信息,进而进行指纹识别,但是这对各种真假手指的没有好的辨识度。For example, there are currently two main under-screen optical fingerprint sensor technologies. The first is an under-screen optical fingerprint recognition technology based on a periodic microhole array, which is susceptible to the influence of moiré fringes. The second is based on the integrated micro-lens under-screen optical fingerprint recognition technology. The under-screen optical fingerprint recognition technology of these two technologies extracts fingerprint information by illuminating all pixels of the fingerprint pressing area, and then performs fingerprint recognition, but this does not have a good degree of recognition for various real and fake fingers.
发明内容Summary of the invention
本申请提供了一种指纹识别和防伪的方法、装置和电子设备,既能够进行指纹识别也能够进行指纹防伪认证。This application provides a method, device and electronic equipment for fingerprint identification and anti-counterfeiting, which can perform fingerprint identification and anti-counterfeiting authentication.
第一方面,提供了一种指纹识别装置,设置于电子设备的显示屏下方,所述显示屏包括多个发光显示像素,所述显示屏包括指纹检测区域,所述指纹检测区域包括互不重叠的中心区域和周围区域,所述中心区域位于所述周围区域的中间,该指纹识别装置包括:光路引导结构,用于将返回光信号引导至光学传感器,所述返回光信号为所述指纹检测区域内的发光显示像素发出的光照射手指后返回的光信号,其中,所述中心区域内的发光显示像素发出单色光照射所述手指,所述周围区域内的发光显示像素发出空间上间隔分布的多种颜色的光照射所述手指;光学传感器,位于所述光路引导结构的下方,用于接收经过所述光路引导结构的光信号,所述光信号用于获取所述手指的指纹图像,所述指纹图像中与所述中心区域对应的中心部分用于进行指纹识别,所述指纹图像中与所述周围区域对应的周围部分用于进行指纹防伪认证。In a first aspect, a fingerprint identification device is provided, which is arranged under a display screen of an electronic device, the display screen includes a plurality of light-emitting display pixels, the display screen includes a fingerprint detection area, and the fingerprint detection area includes non-overlapping The fingerprint identification device includes a light path guiding structure for guiding the return light signal to the optical sensor, and the return light signal is the fingerprint detection The light emitted by the light-emitting display pixels in the area illuminates the finger and the returned light signal, wherein the light-emitting display pixels in the central area emit monochromatic light to illuminate the finger, and the light-emitting display pixels in the surrounding area emit spatially spaced signals. The distributed light of multiple colors illuminates the finger; an optical sensor is located below the light path guiding structure, and is used to receive light signals passing through the light path guiding structure, and the light signals are used to obtain fingerprint images of the finger The central part of the fingerprint image corresponding to the central area is used for fingerprint identification, and the surrounding part of the fingerprint image corresponding to the surrounding area is used for fingerprint anti-counterfeiting authentication.
结合第一方面,在第一方面的一种实现方式中,所述周围区域内的发光显示像素发出的光与所述中心区域内的发光显示像素发出的单色光的颜色不同。With reference to the first aspect, in an implementation of the first aspect, the light emitted by the light-emitting display pixels in the surrounding area has a different color from the monochromatic light emitted by the light-emitting display pixels in the central area.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述指纹检测区域还包括位于所述周围区域的外围的补光区域,所述补光区域内的发光显示像素发出单色光照射所述手指。With reference to the first aspect and the foregoing implementation manners, in another implementation manner of the first aspect, the fingerprint detection area further includes a supplementary light area located at the periphery of the surrounding area, and the light-emitting display in the supplementary light area The pixels emit monochromatic light to illuminate the finger.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述补光区域内的发光显示像素发出的单色光与所述中心区域内的发光显示像素发出的单色光的颜色相同。In combination with the first aspect and the foregoing implementation manners of the first aspect, in another implementation manner of the first aspect, the monochromatic light emitted by the light-emitting display pixels in the supplementary light area is compared with the single-color light emitted by the light-emitting display pixels in the central area. The colors of the shades are the same.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述中心区域的面积大于所述周围区域的面积。With reference to the first aspect and the foregoing implementation manners, in another implementation manner of the first aspect, the area of the central region is larger than the area of the surrounding region.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述中心区域为矩形或者圆形。With reference to the first aspect and the foregoing implementation manners, in another implementation manner of the first aspect, the central area is rectangular or circular.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述周围区域包括多组子区域,所述多组子区域中同一组子区域内的发光显示像素发出相同颜色的光照射所述手指,所述多组子区域中不同组子区域内的发光显示像素发出不同颜色的光照射所述手指。With reference to the first aspect and the foregoing implementation manners, in another implementation manner of the first aspect, the surrounding area includes multiple sets of sub-regions, and the light-emitting display pixels in the same set of sub-regions in the multiple sets of sub-regions emit the same Color light illuminates the finger, and light-emitting display pixels in different groups of sub-areas in the plurality of groups of sub-areas emit light of different colors to illuminate the finger.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述多组子区域中不同组的子区域之间间隔排列。With reference to the first aspect and the foregoing implementation manners of the first aspect, in another implementation manner of the first aspect, the subregions of different groups in the plurality of groups of subregions are arranged at intervals.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述多组子区域中同一组子区域内的多个子区域的面积和/或形状相同。With reference to the first aspect and the foregoing implementation manners of the first aspect, in another implementation manner of the first aspect, the areas and/or shapes of multiple subregions in the same group of subregions in the multiple sets of subregions are the same.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述多组子区域中每个子区域包括5-10个发光显示像素。With reference to the first aspect and the foregoing implementation manners of the first aspect, in another implementation manner of the first aspect, each subregion in the plurality of groups of subregions includes 5-10 light-emitting display pixels.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述多组子区域为两组子区域或者三组子区域。With reference to the first aspect and the foregoing implementation manners thereof, in another implementation manner of the first aspect, the multiple groups of sub-areas are two groups of sub-areas or three groups of sub-areas.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述两组子区域包括第一组子区域和第二组子区域,所述第一组子区域内的子区域的面积和形状相同,与所述第二组子区域内的子区域的面积和形状相同。With reference to the first aspect and the foregoing implementation manners, in another implementation manner of the first aspect, the two sets of sub-regions include a first set of sub-regions and a second set of sub-regions. The area and shape of the sub-regions are the same as those of the sub-regions in the second group of sub-regions.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述第一组子区域中的子区域的形状与所述第二组子区域中的子区域的形状 相同。With reference to the first aspect and the foregoing implementation manners thereof, in another implementation manner of the first aspect, the shape of the subregions in the first group of subregions is the same as the shape of the subregions in the second set of subregions .
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述第一组子区域与所述第二组子区域中的子区域的形状均为方形、圆形或者半圆形。With reference to the first aspect and the foregoing implementation manners thereof, in another implementation manner of the first aspect, the shapes of the sub-regions in the first group of sub-regions and the second group of sub-regions are both square, circular, or Semicircle.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述第一组子区域中的子区域的形状与所述第二组子区域中的子区域的形状不相同。In combination with the first aspect and the foregoing implementation manners of the first aspect, in another implementation manner of the first aspect, the shape of the subregion in the first group of subregions is different from the shape of the subregion in the second set of subregions. the same.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述第一组子区域中的子区域的形状为方形,所述第二组子区域中的子区域的形状为圆形。With reference to the first aspect and the foregoing implementation manners of the first aspect, in another implementation manner of the first aspect, the shape of the subregions in the first group of subregions is square, and the shape of the subregions in the second set of subregions is square. The shape is round.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述指纹识别装置还包括:滤光片,设置于所述光学传感器上方,用于滤除所述返回光信号中的红外光信号。In combination with the first aspect and the foregoing implementation manners, in another implementation manner of the first aspect, the fingerprint identification device further includes: a filter, which is arranged above the optical sensor and is used to filter out the return light The infrared light signal in the signal.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述多组子区域包括第三组子区域,所述第三组子区域内的发光显示像素用于发出红光;所述滤光片用于滤除所述红光照射所述手指后返回的光信号。With reference to the first aspect and the foregoing implementation manners thereof, in another implementation manner of the first aspect, the multiple sets of sub-regions include a third set of sub-regions, and the light-emitting display pixels in the third set of sub-regions are used to emit Red light; the filter is used to filter the light signal returned after the red light irradiates the finger.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述光路引导结构包括光学透镜;或者,所述光路引导结构包括具有多个准直单元或者微孔阵列的光学准直器,所述光学准直器用于将所述返回光信号通过所述多个准直单元或者微孔阵列分别传输到所述光学传感器的所述感应阵列中对应的光学感应单元;或者,所述光路引导结构包括具有多个微透镜的微透镜阵列和具有多个微孔的挡光层,所述微透镜阵列用于将所述返回光信号通过所述多个微透镜分别聚焦到所述挡光层对应的微孔,并通过所述微孔传输到所述光学传感器的所述感应阵列中对应的光学感应单元。With reference to the first aspect and the foregoing implementation manners, in another implementation manner of the first aspect, the light path guiding structure includes an optical lens; or, the light path guiding structure includes a plurality of collimating units or microhole arrays. An optical collimator, the optical collimator is used to transmit the return light signal to the corresponding optical sensing unit in the sensing array of the optical sensor through the plurality of collimating units or microhole arrays; or The optical path guiding structure includes a microlens array with a plurality of microlenses and a light blocking layer with a plurality of microholes, and the microlens array is used to focus the return light signals to the microlenses respectively. The micro-holes corresponding to the light blocking layer are transmitted to the corresponding optical sensing units in the sensing array of the optical sensor through the micro-holes.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述中心区域内的发光显示像素发出的单色光为绿光或青光,所述周围区域内的发光显示像素发出多种颜色的光包括红光、蓝光、黄光和黑光中的至少两个。Combining the first aspect and the foregoing implementation manners thereof, in another implementation manner of the first aspect, the monochromatic light emitted by the light-emitting display pixels in the central area is green light or cyan light, and the luminescence in the surrounding area is The display pixels emit light of multiple colors including at least two of red light, blue light, yellow light, and black light.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述指纹图像中的所述周围部分用于基于深度学习算法,确定所述待检测指纹图像是否为真手指的指纹图像。In combination with the first aspect and the foregoing implementation manners, in another implementation manner of the first aspect, the surrounding part in the fingerprint image is used to determine whether the fingerprint image to be detected is a real finger based on a deep learning algorithm Fingerprint image.
结合第一方面及其上述实现方式,在第一方面的另一种实现方式中,所述深度学习算法包括以下至少一种:支持向量机、卷积神经网络、循环神经网络以及k均值聚类算法。Combining the first aspect and the foregoing implementation manners thereof, in another implementation manner of the first aspect, the deep learning algorithm includes at least one of the following: support vector machine, convolutional neural network, recurrent neural network, and k-means clustering algorithm.
因此,本申请实施例的指纹识别装置,设置在电子设备的显示屏下方,该显示屏包括指纹检测区域,在指纹检测区域的中心区域设置单色照射手指,在周围区域设置彩色图案照射手指,这种边沿图案可以是周期性方格,也可以是边沿有一定曲率图案,还可以是多条彩色线,使得获取的指纹图像既可以进行指纹识别,也可以进行指纹防伪认证,解决了现有屏下光学指纹识别装置不能防止各种形态的假指纹的问题,提高系统的安全级别,进而提升用户体验感。另外,利用本申请的打彩色图案的方法光学指纹模组比彩色滤波片的指纹模组成本低很多;而且,本申请实施例中的光学传感器芯片加工周期更短,成本更低,良率更高。Therefore, the fingerprint identification device of the embodiment of the present application is arranged under the display screen of the electronic device, and the display screen includes a fingerprint detection area. The central area of the fingerprint detection area is set to illuminate the finger in a single color, and the surrounding area is set to illuminate the finger with a color pattern. This edge pattern can be a periodic grid, or a pattern with a certain curvature on the edge, or multiple color lines, so that the acquired fingerprint image can be used for fingerprint recognition and fingerprint anti-counterfeiting authentication, which solves the existing problem. The under-screen optical fingerprint recognition device cannot prevent the problem of false fingerprints in various forms, and improves the security level of the system, thereby enhancing the user experience. In addition, the cost of the optical fingerprint module using the color patterning method of the present application is much lower than that of the color filter fingerprint module; moreover, the optical sensor chip in the embodiment of the present application has a shorter processing cycle, lower cost, and higher yield. high.
第二方面,提供了一种电子设备,该电子设备包括:如第一方面或者第一方面的任意可能的实现方式中的指纹识别装置、显示屏以及处理器,所述显示屏包括多个发光显示像素,所述发光显示像素用于显示图像,显示屏包括指纹检测区域,所述指纹检测区域包括互不重叠的中心区域和周围区域,所述中心区域位于所述周围区域的中间,所述中心区域内的发光显示像素发出单色光照射所述手指,所述周围区域内的发光显示像素发出空间上间隔分布的多种颜色的光照射所述手指;所述处理器用于根据所述指纹识别装置中的光学传感器接收的光信号,生成指纹图像,并根据所述指纹图像中与所述中心区域对应的中心部分,对所述手指进行指纹识别,以及根据所述指纹图像中与所述周围区域对应的周围部分,对所述手指进行指纹防伪认证。In a second aspect, an electronic device is provided. The electronic device includes a fingerprint identification device, a display screen, and a processor as in the first aspect or any possible implementation of the first aspect. The display screen includes a plurality of light emitting devices. Display pixels, the light-emitting display pixels are used to display images, the display screen includes a fingerprint detection area, the fingerprint detection area includes a central area and a surrounding area that do not overlap each other, the central area is located in the middle of the surrounding area, the The light-emitting display pixels in the central area emit monochromatic light to illuminate the finger, and the light-emitting display pixels in the surrounding area emit light of multiple colors distributed at intervals to illuminate the finger; the processor is used to illuminate the finger according to the fingerprint The light signal received by the optical sensor in the recognition device generates a fingerprint image, and performs fingerprint recognition on the finger according to the central part of the fingerprint image corresponding to the central area, and according to the fingerprint image and the The surrounding part corresponding to the surrounding area performs fingerprint anti-counterfeiting authentication on the finger.
结合第二方面,在第二方面的一种实现方式中,所述处理器还用于:基于深度学习算法,根据所述待检测指纹图像中的所述周围部分,确定所述待检测指纹图像是否为真手指的指纹图像。With reference to the second aspect, in an implementation manner of the second aspect, the processor is further configured to: based on a deep learning algorithm, determine the fingerprint image to be detected according to the surrounding part in the fingerprint image to be detected Whether it is a fingerprint image of a real finger.
结合第二方面及其上述实现方式,在第二方面的另一种实现方式中,所述处理器还用于:基于深度学习算法,根据所述周围部分中反射光信号的分布图像和/或散射光信号的分布图像,确定所述待检测指纹图像是否为真手指的指纹图像,其中,所述反射光信号为所述周围区域内的发光显示像素发出的光在所述目标手指的表面发生反射后返回的光信号,所述散射光信号为所述周围区域内的发光显示像素发出的光在所述目标手指的内部发生散射后 返回的光信号。Combining the second aspect and the foregoing implementation manners thereof, in another implementation manner of the second aspect, the processor is further configured to: based on a deep learning algorithm, according to the distribution image of the reflected light signal in the surrounding part and/or The distribution image of the scattered light signal to determine whether the fingerprint image to be detected is a fingerprint image of a real finger, wherein the reflected light signal is the light emitted by the light-emitting display pixels in the surrounding area generated on the surface of the target finger The returned light signal after reflection, and the scattered light signal is the light signal returned after the light emitted by the light-emitting display pixels in the surrounding area is scattered inside the target finger.
结合第二方面及其上述实现方式,在第二方面的另一种实现方式中,所述处理器还用于:基于深度学习算法,根据所述周围部分中第一光信号的分布图像和/或第二光信号的分布图像,确定所述待检测指纹图像是否为真手指的指纹图像,其中,所述第一光信号和所述第二光信号分别为所述周围区域内的发光显示像素发出的多种颜色的光中任意两种颜色的光在照射所述目标手指后返回的光信号。In combination with the second aspect and the foregoing implementation manners, in another implementation manner of the second aspect, the processor is further configured to: based on a deep learning algorithm, according to the distribution image and/or the first optical signal in the surrounding part Or the distribution image of the second light signal to determine whether the fingerprint image to be detected is a fingerprint image of a real finger, wherein the first light signal and the second light signal are respectively the light-emitting display pixels in the surrounding area Light signals of any two colors of the emitted light of multiple colors after irradiating the target finger.
结合第二方面及其上述实现方式,在第二方面的另一种实现方式中,所述处理器还用于:确定所述周围部分中所述第一光信号的分布图像和所述第二光信号的分布图像,所述第一光信号为所述周围区域内的发光显示像素发出的蓝色光在照射所述目标手指后返回的光信号,所述第二光信号为所述周围区域内的发光显示像素发出的红色光在照射所述目标手指后返回的光信号;基于深度学习算法,根据所述第一光信号的分布图像和所述第二光信号的分布图像的差值,确定所述待检测指纹图像是否为真手指的指纹图像。With reference to the second aspect and the foregoing implementation manners of the second aspect, in another implementation manner of the second aspect, the processor is further configured to: determine the distribution image of the first optical signal in the surrounding part and the second The distribution image of the light signal, the first light signal is the light signal returned by the blue light emitted by the light-emitting display pixels in the surrounding area after irradiating the target finger, and the second light signal is the light signal in the surrounding area The red light emitted by the luminescent display pixel returns the optical signal after irradiating the target finger; based on the deep learning algorithm, according to the difference between the distribution image of the first optical signal and the distribution image of the second optical signal, determine Whether the fingerprint image to be detected is a fingerprint image of a real finger.
结合第二方面及其上述实现方式,在第二方面的另一种实现方式中,所述处理器还用于:获取若干样本数据,所述若干样本数据包括若干真手指数据以及若干假手指数据,所述若干真手指数据包括若干个真手指触摸在所述指纹检测区域时获取的指纹图像中与所述周围区域对应的周围部分,所述若干假手指数据包括若干个假手指触摸在所述指纹检测区域时获取的指纹图像中与所述周围区域对应的周围部分;基于所述若干样本数据进行训练,以获取真假手指的指纹图像的深度学习模型;按照所述深度学习模型,根据所述待检测指纹图像中的所述周围部分,确定所述待检测指纹图像是否为真手指的指纹图像。In combination with the second aspect and the foregoing implementation manners of the second aspect, in another implementation manner of the second aspect, the processor is further configured to: obtain several sample data, the several sample data including several real finger data and several fake finger data The plurality of real finger data includes the surrounding parts corresponding to the surrounding area in the fingerprint image obtained when a plurality of real fingers touch the fingerprint detection area, and the plurality of fake finger data includes a plurality of fake fingers touching the surrounding area. The surrounding part of the fingerprint image obtained during the fingerprint detection area corresponding to the surrounding area; training based on the several sample data to obtain a deep learning model of fingerprint images of real and fake fingers; according to the deep learning model, according to The surrounding part of the fingerprint image to be detected is determined whether the fingerprint image to be detected is a fingerprint image of a real finger.
结合第二方面及其上述实现方式,在第二方面的另一种实现方式中,所述深度学习算法包括以下至少一种:支持向量机、卷积神经网络、循环神经网络以及k均值聚类算法。In combination with the second aspect and the foregoing implementation manners, in another implementation manner of the second aspect, the deep learning algorithm includes at least one of the following: support vector machine, convolutional neural network, recurrent neural network, and k-means clustering algorithm.
因此,本申请实施例的电子设备,具有屏下指纹识别装置该电子设备的显示屏包括指纹检测区域,在指纹检测区域的中心区域设置单色照射手指,在周围区域设置彩色图案照射手指,这种边沿图案可以是周期性方格,也可以是边沿有一定曲率图案,还可以是多条彩色线,使得获取的指纹图像既可以进行指纹识别,也可以进行指纹防伪认证,解决了现有屏下光学指纹识别 装置不能防止各种形态的假指纹的问题,提高系统的安全级别,进而提升用户体验感。另外,利用本申请的打彩色图案的方法光学指纹模组比彩色滤波片的指纹模组成本低很多。Therefore, the electronic device of the embodiment of the present application has an under-screen fingerprint identification device. The display screen of the electronic device includes a fingerprint detection area. A monochrome illuminating finger is set in the center area of the fingerprint detection area, and a color pattern is set to illuminate the finger in the surrounding area. The edge pattern can be a periodic grid, or a pattern with a certain curvature on the edge, or multiple colored lines, so that the acquired fingerprint image can be used for fingerprint recognition and fingerprint anti-counterfeiting authentication, which solves the problem of existing screens. The lower optical fingerprint recognition device cannot prevent the problem of false fingerprints in various forms, and improves the security level of the system, thereby enhancing the user experience. In addition, the cost of the optical fingerprint module using the color patterning method of the present application is much lower than that of the color filter fingerprint module.
第三方面,提供了一种指纹识别和防伪的方法,该方法包括:获取目标手指的待检测指纹图像,所述待检测指纹图像为触摸在显示屏的指纹检测区域的所述目标手指的指纹图像,所述指纹检测区域包括互不重叠的中心区域和周围区域,所述中心区域位于所述周围区域的中间,所述中心区域内的发光显示像素发出单色光照射所述目标手指,所述周围区域内的发光显示像素发出多种颜色的光照射所述目标手指;根据所述待检测指纹图像中与所述中心区域对应的中心部分,对所述目标手指进行指纹识别;根据所述待检测指纹图像中与所述周围区域对应的周围部分,对所述目标手指进行指纹防伪认证。In a third aspect, a fingerprint identification and anti-counterfeiting method is provided, the method comprising: acquiring a fingerprint image of a target finger to be detected, where the fingerprint image to be detected is the fingerprint of the target finger touching the fingerprint detection area of the display screen Image, the fingerprint detection area includes a non-overlapping central area and a surrounding area, the central area is located in the middle of the surrounding area, the light-emitting display pixels in the central area emit monochromatic light to illuminate the target finger, so The light-emitting display pixels in the surrounding area emit light of multiple colors to illuminate the target finger; perform fingerprint recognition on the target finger according to the central part of the fingerprint image to be detected corresponding to the central area; Perform fingerprint anti-counterfeiting authentication on the target finger in the surrounding part corresponding to the surrounding area in the fingerprint image to be detected.
结合第三方面,在第三方面的一种实现方式中,所述根据所述待检测指纹图像中与所述周围区域对应的周围部分,对所述目标手指进行指纹防伪认证,包括:基于深度学习算法,根据所述待检测指纹图像中的所述周围部分,确定所述待检测指纹图像是否为真手指的指纹图像。With reference to the third aspect, in an implementation manner of the third aspect, the performing fingerprint anti-counterfeiting authentication on the target finger according to the surrounding part corresponding to the surrounding area in the fingerprint image to be detected includes: depth-based The learning algorithm determines whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected.
结合第三方面及其上述实现方式,在第三方面的另一种实现方式中,所述基于深度学习算法,根据所述待检测指纹图像中的所述周围部分,确定所述待检测指纹图像是否为真手指的指纹图像,包括:基于深度学习算法,根据所述周围部分中反射光信号的分布图像和/或散射光信号的分布图像,确定所述待检测指纹图像是否为真手指的指纹图像,其中,所述反射光信号为所述周围区域内的发光显示像素发出的光在所述目标手指的表面发生反射后返回的光信号,所述散射光信号为所述周围区域内的发光显示像素发出的光在所述目标手指的内部发生散射后返回的光信号。Combining the third aspect and the foregoing implementation manners thereof, in another implementation manner of the third aspect, the deep learning algorithm is used to determine the fingerprint image to be detected according to the surrounding part in the fingerprint image to be detected Whether it is a fingerprint image of a real finger, including: based on a deep learning algorithm, determining whether the fingerprint image to be detected is a fingerprint of a real finger according to the distribution image of the reflected light signal and/or the distribution image of the scattered light signal in the surrounding part An image, wherein the reflected light signal is the light signal returned by the light emitted by the light-emitting display pixels in the surrounding area after being reflected on the surface of the target finger, and the scattered light signal is the light emission in the surrounding area The light emitted by the display pixel is scattered inside the target finger and then returned to the light signal.
结合第三方面及其上述实现方式,在第三方面的另一种实现方式中,所述基于深度学习算法,根据所述待检测指纹图像中的所述周围部分,确定所述待检测指纹图像是否为真手指的指纹图像,包括:基于深度学习算法,根据所述周围部分中第一光信号的分布图像和/或第二光信号的分布图像,确定所述待检测指纹图像是否为真手指的指纹图像,其中,所述第一光信号和所述第二光信号分别为所述周围区域内的发光显示像素发出的多种颜色的光中任意两种颜色的光在照射所述目标手指后返回的光信号。Combining the third aspect and the foregoing implementation manners thereof, in another implementation manner of the third aspect, the deep learning algorithm is used to determine the fingerprint image to be detected according to the surrounding part in the fingerprint image to be detected Whether it is a fingerprint image of a real finger, including: based on a deep learning algorithm, determining whether the fingerprint image to be detected is a real finger according to the distribution image of the first light signal and/or the distribution image of the second light signal in the surrounding part The fingerprint image of the fingerprint image, wherein the first light signal and the second light signal are respectively the light of any two colors of the multiple colors emitted by the light-emitting display pixels in the surrounding area illuminating the target finger After returning the light signal.
结合第三方面及其上述实现方式,在第三方面的另一种实现方式中,所述基于深度学习算法,根据所述周围部分中第一光信号的分布图像和/或第二光信号的分布图像,确定所述待检测指纹图像是否为真手指的指纹图像,包括:确定所述周围部分中所述第一光信号的分布图像和所述第二光信号的分布图像,所述第一光信号为所述周围区域内的发光显示像素发出的蓝色光在照射所述目标手指后返回的光信号,所述第二光信号为所述周围区域内的发光显示像素发出的红色光在照射所述目标手指后返回的光信号;基于深度学习算法,根据所述第一光信号的分布图像和所述第二光信号的分布图像的差值,确定所述待检测指纹图像是否为真手指的指纹图像。Combining the third aspect and the foregoing implementation manners thereof, in another implementation manner of the third aspect, the deep learning algorithm is used according to the distribution image of the first optical signal and/or the second optical signal in the surrounding part A distribution image, determining whether the fingerprint image to be detected is a fingerprint image of a real finger, including: determining a distribution image of the first light signal and a distribution image of the second light signal in the surrounding part, the first The light signal is the light signal returned by the blue light emitted by the light-emitting display pixels in the surrounding area after irradiating the target finger, and the second light signal is the red light emitted by the light-emitting display pixels in the surrounding area. The optical signal returned after the target finger; based on a deep learning algorithm, determine whether the fingerprint image to be detected is a real finger based on the difference between the distribution image of the first optical signal and the distribution image of the second optical signal Fingerprint image.
结合第三方面及其上述实现方式,在第三方面的另一种实现方式中,所述基于深度学习算法,根据所述待检测指纹图像中的所述周围部分,确定所述待检测指纹图像是否为真手指的指纹图像,包括:获取若干样本数据,所述若干样本数据包括若干真手指数据以及若干假手指数据,所述若干真手指数据包括若干个真手指触摸在所述指纹检测区域时获取的指纹图像中与所述周围区域对应的周围部分,所述若干假手指数据包括若干个假手指触摸在所述指纹检测区域时获取的指纹图像中与所述周围区域对应的周围部分;基于所述若干样本数据进行训练,以获取真假手指的指纹图像的深度学习模型;按照所述深度学习模型,根据所述待检测指纹图像中的所述周围部分,确定所述待检测指纹图像是否为真手指的指纹图像。Combining the third aspect and the foregoing implementation manners thereof, in another implementation manner of the third aspect, the deep learning algorithm is used to determine the fingerprint image to be detected according to the surrounding part in the fingerprint image to be detected Whether it is a fingerprint image of a real finger, including: acquiring a number of sample data including a number of real finger data and a number of fake finger data, the number of real finger data including a number of real fingers touching the fingerprint detection area Surrounding parts in the acquired fingerprint image corresponding to the surrounding area, and the plurality of fake finger data includes the surrounding parts corresponding to the surrounding area in the fingerprint image obtained when the fake fingers touch the fingerprint detection area; The several sample data are trained to obtain a deep learning model of fingerprint images of real and fake fingers; according to the deep learning model, according to the surrounding part of the fingerprint image to be detected, it is determined whether the fingerprint image to be detected is The fingerprint image of a real finger.
结合第三方面及其上述实现方式,在第三方面的另一种实现方式中,所述深度学习算法包括以下至少一种:支持向量机、卷积神经网络、循环神经网络以及k均值聚类算法。With reference to the third aspect and the foregoing implementation manners, in another implementation manner of the third aspect, the deep learning algorithm includes at least one of the following: support vector machine, convolutional neural network, recurrent neural network, and k-means clustering algorithm.
因此,本申请实施例的屏下指纹识别和防伪的方法,适用于具有屏下指纹识别装置的电子设备中,该电子设备的显示屏包括指纹检测区域,在指纹检测区域的中心区域设置单色照射手指,在周围区域设置彩色图案照射手指,这种边沿图案可以是周期性方格,也可以是边沿有一定曲率图案,还可以是多条彩色线,使得获取的指纹图像既可以进行指纹识别,也可以进行指纹防伪认证,解决了现有屏下光学指纹识别装置不能防止各种形态的假指纹的问题,提高系统的安全级别,进而提升用户体验感。另外,利用本申请的打彩色图案的方法光学指纹模组比彩色滤波片的指纹模组成本低很多;而且,本申请实施例的光学传感器芯片加工周期更短,成本更低,良率更高。Therefore, the under-screen fingerprint identification and anti-counterfeiting method of the embodiment of the present application is suitable for electronic equipment with under-screen fingerprint identification devices. The display screen of the electronic equipment includes a fingerprint detection area, and a single color is set in the center area of the fingerprint detection area. Illuminate the finger and set a color pattern in the surrounding area to illuminate the finger. This edge pattern can be a periodic grid, or a pattern with a certain curvature on the edge, or multiple colored lines, so that the acquired fingerprint image can be fingerprinted. , Fingerprint anti-counterfeiting authentication can also be performed, which solves the problem that the existing under-screen optical fingerprint recognition device cannot prevent various forms of fake fingerprints, improves the security level of the system, and thereby enhances the user experience. In addition, the cost of the optical fingerprint module using the color patterning method of the present application is much lower than that of the color filter fingerprint module; moreover, the optical sensor chip of the embodiment of the present application has a shorter processing cycle, lower cost, and higher yield. .
第四方面,提供了一种电子设备,包括:存储单元和处理器,该存储单元用于存储指令,该处理器用于执行该存储器存储的指令,并且当该处理器执行该存储器存储的指令时,该执行使得该处理器执行第三方面或第三方面的任意可能的实现方式中的方法。In a fourth aspect, an electronic device is provided, including: a storage unit and a processor, the storage unit is used to store instructions, the processor is used to execute the instructions stored in the memory, and when the processor executes the instructions stored in the memory The execution causes the processor to execute the third aspect or the method in any possible implementation manner of the third aspect.
第五方面,提供了一种计算机可读介质,用于存储计算机程序,该计算机程序包括用于执行第三方面或第三方面的任意可能的实现方式中的方法的指令。In a fifth aspect, a computer-readable medium is provided for storing a computer program, and the computer program includes instructions for executing the third aspect or any possible implementation of the third aspect.
第六方面,提供了一种包括指令的计算机程序产品,当计算机运行所述计算机程序产品的所述指时,所述计算机执行上述第三方面或第三方面的任意可能的实现方式中的指纹识别和防伪的方法。具体地,该计算机程序产品可以运行于上述第四方面的电子设备上。In a sixth aspect, a computer program product including instructions is provided. When the computer runs the finger of the computer program product, the computer executes the fingerprint in the third aspect or any possible implementation of the third aspect. Methods of identification and anti-counterfeiting. Specifically, the computer program product can run on the electronic device of the fourth aspect.
附图说明Description of the drawings
图1是根据本申请实施例的电子设备的示意图。Fig. 1 is a schematic diagram of an electronic device according to an embodiment of the present application.
图2是根据本申请实施例的电子设备的另一示意图。Fig. 2 is another schematic diagram of an electronic device according to an embodiment of the present application.
图3是根据本申请实施例的另一电子设备的局部示意图。Fig. 3 is a partial schematic diagram of another electronic device according to an embodiment of the present application.
图4是根据本申请实施例的指纹检测区域的示意图。Fig. 4 is a schematic diagram of a fingerprint detection area according to an embodiment of the present application.
图5是根据本申请实施例的指纹检测区域的另一示意图。Fig. 5 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
图6是根据本申请实施例的指纹检测区域的再一示意图。Fig. 6 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
图7是根据本申请实施例的指纹检测区域的再一示意图。Fig. 7 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
图8是根据本申请实施例的指纹检测区域的再一示意图。Fig. 8 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
图9是根据本申请实施例的指纹检测区域的再一示意图。Fig. 9 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
图10是根据本申请实施例的指纹检测区域的再一示意图。Fig. 10 is another schematic diagram of a fingerprint detection area according to an embodiment of the present application.
图11是根据本申请实施例的屏下指纹识别和防伪的方法的示意性流程图。Fig. 11 is a schematic flowchart of an off-screen fingerprint identification and anti-counterfeiting method according to an embodiment of the present application.
具体实施方式Detailed ways
下面将结合附图,对本申请实施例中的技术方案进行描述。The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings.
应理解,本申请实施例可以应用于光学指纹系统,包括但不限于光学指纹识别系统和基于光学指纹成像的医疗诊断产品,本申请实施例仅以光学指纹系统为例进行说明,但不应对本申请实施例构成任何限定,本申请实施例 同样适用于其他采用光学成像技术的系统等。It should be understood that the embodiments of this application can be applied to optical fingerprint systems, including but not limited to optical fingerprint identification systems and medical diagnostic products based on optical fingerprint imaging. The embodiments of this application only take optical fingerprint systems as an example for description, but should not The embodiments of the application constitute any limitation, and the embodiments of the present application are also applicable to other systems using optical imaging technology.
作为一种常见的应用场景,本申请实施例提供的光学指纹系统可以应用在智能手机、平板电脑以及其他具有显示屏的移动终端或者其他电子设备;更具体地,在上述电子设备中,指纹识别装置可以具体为光学指纹装置,其可以设置在显示屏下方的局部区域或者全部区域,从而形成屏下(Under-display)光学指纹系统。或者,所述指纹识别装置也可以部分或者全部集成至所述电子设备的显示屏内部,从而形成屏内(In-display)光学指纹系统。As a common application scenario, the optical fingerprint system provided in the embodiments of this application can be applied to smart phones, tablet computers, and other mobile terminals with display screens or other electronic devices; more specifically, in the above electronic devices, fingerprint identification The device may specifically be an optical fingerprint device, which may be arranged in a partial area or an entire area under the display screen, thereby forming an under-display optical fingerprint system. Alternatively, the fingerprint identification device may be partially or fully integrated into the display screen of the electronic device, thereby forming an in-display optical fingerprint system.
如图1和图2所示为本申请实施例可以适用的电子设备的结构示意图,其中,图1为该电子设备的主视图,图2为该电子设备的侧视图。如图1和图2所示,该电子设备10包括显示屏120和光学指纹装置130,其中,该光学指纹装置130设置在该显示屏120下方的局部区域。该光学指纹装置130包括光学指纹传感器,该光学指纹传感器包括具有多个光学感应单元131的感应阵列133,该感应阵列所在区域或者其感应区域为该光学指纹装置130的指纹检测区域103。如图1所示,该指纹检测区域103位于该显示屏120的显示区域之中。在一种替代实施例中,该光学指纹装置130还可以设置在其他位置,比如该显示屏120的侧面或者该电子设备10的边缘非透光区域,并通过光路设计来将该显示屏120的至少部分显示区域的光信号导引到该光学指纹装置130,从而使得该指纹检测区域103实际上位于该显示屏120的显示区域。FIG. 1 and FIG. 2 are schematic diagrams of the structure of an electronic device to which the embodiment of the application can be applied. FIG. 1 is a front view of the electronic device, and FIG. 2 is a side view of the electronic device. As shown in FIGS. 1 and 2, the electronic device 10 includes a display screen 120 and an optical fingerprint device 130, wherein the optical fingerprint device 130 is arranged in a partial area below the display screen 120. The optical fingerprint device 130 includes an optical fingerprint sensor, and the optical fingerprint sensor includes a sensing array 133 with a plurality of optical sensing units 131, and the area where the sensing array is located or its sensing area is the fingerprint detection area 103 of the optical fingerprint device 130. As shown in FIG. 1, the fingerprint detection area 103 is located in the display area of the display screen 120. In an alternative embodiment, the optical fingerprint device 130 can also be arranged in other positions, such as the side of the display screen 120 or the non-transmissive area on the edge of the electronic device 10, and the optical fingerprint device 130 can be designed through the optical path. At least part of the optical signal of the display area is guided to the optical fingerprint device 130, so that the fingerprint detection area 103 is actually located in the display area of the display screen 120.
应当理解,该指纹检测区域103的面积可以与该光学指纹装置130的感应阵列的面积不同,例如通过例如透镜成像的光路设计、反射式折叠光路设计或者其他光线汇聚或者反射等光路设计,可以使得该光学指纹装置130的指纹检测区域103的面积大于该光学指纹装置130感应阵列的面积。在其他替代实现方式中,如果采用例如光线准直方式进行光路引导,该光学指纹装置130的指纹检测区域103也可以设计成与该光学指纹装置130的感应阵列的面积基本一致。It should be understood that the area of the fingerprint detection area 103 may be different from the area of the sensing array of the optical fingerprint device 130. For example, through the optical path design of lens imaging, the reflective folding optical path design, or other optical path design such as light convergence or reflection, it can make The area of the fingerprint detection area 103 of the optical fingerprint device 130 is larger than the area of the sensing array of the optical fingerprint device 130. In other alternative implementations, if for example, light collimation is used for light path guidance, the fingerprint detection area 103 of the optical fingerprint device 130 can also be designed to be substantially the same as the area of the sensing array of the optical fingerprint device 130.
因此,使用者在需要对该电子设备10进行解锁或者其他指纹验证的时候,只需要将手指按压在位于该显示屏120的指纹检测区域103,便可以实现指纹输入。由于指纹检测可以在屏内实现,因此采用上述结构的电子设备10无需其正面专门预留空间来设置指纹按键(比如Home键),从而可以采 用全面屏方案,即该显示屏120的显示区域可以基本扩展到整个电子设备10的正面。Therefore, when the user needs to unlock the electronic device 10 or perform other fingerprint verification, he only needs to press his finger on the fingerprint detection area 103 located on the display screen 120 to realize fingerprint input. Since fingerprint detection can be implemented in the screen, the electronic device 10 adopting the above structure does not need to reserve space on the front side to set fingerprint buttons (such as the Home button), so that a full screen solution can be adopted, that is, the display area of the display screen 120 can be It basically extends to the front of the entire electronic device 10.
作为一种可选的实现方式,如图2所示,该光学指纹装置130包括光检测部分134和光学组件132,该光检测部分134包括该感应阵列以及与该感应阵列电性连接的读取电路及其他辅助电路,其可以在通过半导体工艺制作在一个芯片(Die),比如光学成像芯片或者光学指纹传感器,该感应阵列具体为光探测器(Photo detector)阵列,其包括多个呈阵列式分布的光探测器,该光探测器可以作为如上该的光学感应单元;该光学组件132可以设置在该光检测部分134的感应阵列的上方,其可以具体包括滤光层(Filter)、导光层或光路引导结构以及其他光学元件,该滤光层可以用于滤除穿透手指的环境光,而该导光层或光路引导结构主要用于从手指表面反射回来的反射光导引至该感应阵列进行光学检测。As an optional implementation, as shown in FIG. 2, the optical fingerprint device 130 includes a light detecting part 134 and an optical component 132, and the light detecting part 134 includes the sensing array and a reader electrically connected to the sensing array. The circuit and other auxiliary circuits can be fabricated on a chip (Die) through a semiconductor process, such as an optical imaging chip or an optical fingerprint sensor. The sensing array is specifically a photodetector array, which includes a plurality of arrays. Distributed photodetector, the photodetector can be used as the above-mentioned optical sensing unit; the optical component 132 can be arranged above the sensing array of the light detection part 134, which can specifically include a filter layer (Filter), light guide The light guide layer or light path guiding structure and other optical elements, the filter layer can be used to filter the ambient light penetrating the finger, and the light guide layer or light path guiding structure is mainly used to guide the reflected light reflected from the finger surface to the The sensing array performs optical inspection.
在具体实现上,该光学组件132可以与该光检测部分134封装在同一个光学指纹部件。比如,该光学组件132可以与该光学检测部分134封装在同一个光学指纹芯片,也可以将该光学组件132设置在该光检测部分134所在的芯片外部,比如将该光学组件132贴合在该芯片上方,或者将该光学组件132的部分元件集成在上述芯片之中。In terms of specific implementation, the optical assembly 132 and the light detecting part 134 may be packaged in the same optical fingerprint component. For example, the optical component 132 and the optical detection part 134 can be packaged in the same optical fingerprint chip, or the optical component 132 can be arranged outside the chip where the optical detection part 134 is located, for example, the optical component 132 can be attached to the Above the chip, or part of the components of the optical assembly 132 are integrated in the above chip.
其中,该光学组件132的导光层或者光路引导结构有多种实现方案,比如,该导光层可以具体为在半导体硅片制作而成的准直器(Collimator)层,其具有多个准直单元或者微孔阵列,该准直单元可以具体为通孔或者小孔,从手指反射回来的反射光中,垂直入射到该准直单元的光线可以穿过并被其下方的光学感应单元接收,而入射角度过大的光线在该准直单元内部经过多次反射被衰减掉,因此每一个光学感应单元基本只能接收到其正上方的指纹纹路反射回来的反射光,从而该感应阵列便可以检测出手指的指纹图像。Among them, the light guide layer or light path guiding structure of the optical component 132 has multiple implementation schemes. For example, the light guide layer may specifically be a collimator layer made on a semiconductor silicon wafer, which has multiple collimators. A collimating unit or a micro-hole array, the collimating unit can be specifically a through hole or a small hole. Among the reflected light reflected from the finger, the light that is perpendicularly incident on the collimating unit can pass through and be received by the optical sensor unit below it , And the light with too large incident angle is attenuated by multiple reflections inside the collimating unit. Therefore, each optical sensing unit can basically only receive the reflected light reflected by the fingerprint pattern directly above it, so the sensing array is The fingerprint image of the finger can be detected.
在另一种实施例中,该导光层或者光路引导结构也可以为光学透镜(Lens)层,其具有一个或多个透镜单元,比如一个或多个非球面透镜组成的透镜组,其用于将从手指反射回来的反射光汇聚到其下方的光检测部分134的感应阵列,以使得该感应阵列可以基于该反射光进行成像,从而得到该手指的指纹图像。可选地,该光学透镜层在该透镜单元的光路中还可以形成有针孔,该针孔可以配合该光学透镜层扩大该光学指纹装置的视场,以提高该光学指纹装置130的指纹成像效果。In another embodiment, the light guide layer or the light path guide structure can also be an optical lens (Lens) layer, which has one or more lens units, such as a lens group composed of one or more aspheric lenses, The reflected light reflected from the finger is condensed to the sensing array of the light detection part 134 below it, so that the sensing array can perform imaging based on the reflected light, thereby obtaining a fingerprint image of the finger. Optionally, the optical lens layer may further have a pinhole formed in the optical path of the lens unit, and the pinhole may cooperate with the optical lens layer to expand the field of view of the optical fingerprint device, so as to improve the fingerprint imaging of the optical fingerprint device 130 effect.
在其他实施例中,该导光层或者光路引导结构也可以具体采用微透镜(Micro-Lens)层,该微透镜层具有由多个微透镜形成的微透镜阵列,其可以通过半导体生长工艺或者其他工艺形成在该光检测部分134的感应阵列上方,并且每一个微透镜可以分别对应于该感应阵列的其中一个感应单元。并且,该微透镜层和该感应单元之间还可以形成其他光学膜层,比如介质层或者钝化层,更具体地,该微透镜层和该感应单元之间还可以包括具有微孔的挡光层,其中该微孔形成在其对应的微透镜和感应单元之间,该挡光层可以阻挡相邻微透镜和感应单元之间的光学干扰,并使得该感应单元所对应的光线通过该微透镜汇聚到该微孔内部并经由该微孔传输到该感应单元以进行光学指纹成像。应当理解,上述光路引导结构的几种实现方案可以单独使用也可以结合使用,比如,可以在该准直器层或者该光学透镜层下方进一步设置微透镜层。当然,在该准直器层或者该光学透镜层与该微透镜层结合使用时,其具体叠层结构或者光路可能需要按照实际需要进行调整。In other embodiments, the light guide layer or the light path guide structure may also specifically adopt a micro-lens (Micro-Lens) layer. The micro-lens layer has a micro-lens array formed by a plurality of micro-lens, which may be formed by a semiconductor growth process or Other processes are formed above the sensing array of the light detection part 134, and each microlens can correspond to one of the sensing units of the sensing array. In addition, other optical film layers may be formed between the microlens layer and the sensing unit, such as a dielectric layer or a passivation layer. More specifically, a barrier with microholes may also be formed between the microlens layer and the sensing unit. Optical layer, wherein the micro-hole is formed between the corresponding micro lens and the sensing unit, the light blocking layer can block the optical interference between the adjacent micro lens and the sensing unit, and allow the light corresponding to the sensing unit to pass through the The micro lens is converged into the micro hole and is transmitted to the sensing unit through the micro hole to perform optical fingerprint imaging. It should be understood that several implementation solutions of the above-mentioned light path guiding structure can be used alone or in combination. For example, a microlens layer can be further provided under the collimator layer or the optical lens layer. Of course, when the collimator layer or the optical lens layer is used in combination with the microlens layer, the specific laminated structure or optical path may need to be adjusted according to actual needs.
作为一种可选的实施例,该显示屏120可以采用具有自发光显示单元的显示屏,比如有机发光二极管(Organic Light-Emitting Diode,OLED)显示屏或者微型发光二极管(Micro-LED)显示屏。以采用OLED显示屏为例,该光学指纹装置130可以利用该OLED显示屏120位于该指纹检测区域103的显示单元(即OLED光源)来作为光学指纹检测的激励光源。当手指140按压在该指纹检测区域103时,显示屏120向该指纹检测区域103上方的目标手指140发出一束光111,该光111在手指140的表面发生反射形成反射光或者经过该手指140内部散射而形成散射光。为便于描述,本申请实施例中将上述反射光和散射光统称为经过手指的返回光。由于指纹的嵴(ridge)与峪(vally)对于光的反射、散射或者吸收的能力不同,因此,来自指纹嵴的返回光151和来自指纹峪的返回光152具有不同的光强,返回光经过光学组件132后,被光学指纹装置130中的感应阵列134所接收并转换为相应的电信号,即指纹检测信号;基于该指纹检测信号便可以获得指纹图像数据,并且可以进一步进行指纹匹配验证,从而在该电子设备10实现光学指纹识别功能。As an optional embodiment, the display screen 120 may be a display screen with a self-luminous display unit, such as an organic light-emitting diode (Organic Light-Emitting Diode, OLED) display screen or a micro-LED (Micro-LED) display screen . Taking an OLED display screen as an example, the optical fingerprint device 130 can use the display unit (ie, an OLED light source) of the OLED display screen 120 located in the fingerprint detection area 103 as an excitation light source for optical fingerprint detection. When the finger 140 is pressed on the fingerprint detection area 103, the display screen 120 emits a beam of light 111 to the target finger 140 above the fingerprint detection area 103. The light 111 is reflected on the surface of the finger 140 to form reflected light or passes through the finger 140. Internal scattering forms scattered light. For ease of description, in the embodiments of the present application, the above-mentioned reflected light and scattered light are collectively referred to as return light passing through the finger. Since the ridge and valley of the fingerprint have different ability to reflect, scatter or absorb light, the return light 151 from the fingerprint ridge and the return light 152 from the fingerprint ridge have different light intensities, and the return light passes through After the optical component 132, it is received by the sensor array 134 in the optical fingerprint device 130 and converted into a corresponding electrical signal, that is, a fingerprint detection signal; based on the fingerprint detection signal, fingerprint image data can be obtained, and fingerprint matching verification can be further performed. Thus, the electronic device 10 realizes the optical fingerprint recognition function.
应当理解的是,在具体实现上,该电子设备10还包括透明保护盖板,该盖板可以为玻璃盖板或者蓝宝石盖板,其位于该显示屏120的上方并覆盖该电子设备10的正面。因此,本申请实施例中,所谓的手指按压在该显示 屏120实际上是指按压在该显示屏120上方的盖板或者覆盖该盖板的保护层表面。It should be understood that, in specific implementation, the electronic device 10 further includes a transparent protective cover, which may be a glass cover or a sapphire cover, which is located above the display screen 120 and covers the front of the electronic device 10. . Therefore, in the embodiments of the present application, the so-called finger pressing on the display screen 120 actually refers to pressing on the cover plate above the display screen 120 or covering the surface of the protective layer of the cover plate.
另一方面,在某些实施例中,该光学指纹装置130可以仅包括一个光学指纹传感器,此时光学指纹装置130的指纹检测区域103的面积较小且位置固定,因此用户在进行指纹输入时需要将手指按压到该指纹检测区域103的特定位置,否则光学指纹装置130可能无法采集到指纹图像而造成用户体验不佳。在其他替代实施例中,该光学指纹装置130可以具体包括多个光学指纹传感器;该多个光学指纹传感器可以通过拼接方式并排设置在该显示屏120的下方,且该多个光学指纹传感器的感应区域共同构成该光学指纹装置130的指纹检测区域103。也即是说,该光学指纹装置130的指纹检测区域103可以包括多个子区域,每个子区域分别对应于其中一个光学指纹传感器的感应区域,从而将该光学指纹模组130的指纹采集区域103可以扩展到该显示屏的下半部分的主要区域,即扩展到手指惯常按压区域,从而实现盲按式指纹输入操作。可替代地,当该光学指纹传感器数量足够时,该指纹检测区域130还可以扩展到半个显示区域甚至整个显示区域,从而实现半屏或者全屏指纹检测。On the other hand, in some embodiments, the optical fingerprint device 130 may only include one optical fingerprint sensor. At this time, the fingerprint detection area 103 of the optical fingerprint device 130 has a small area and a fixed position. Therefore, when the user performs fingerprint input It is necessary to press the finger to a specific position of the fingerprint detection area 103, otherwise the optical fingerprint device 130 may not be able to collect fingerprint images, resulting in poor user experience. In other alternative embodiments, the optical fingerprint device 130 may specifically include a plurality of optical fingerprint sensors; the plurality of optical fingerprint sensors may be arranged side by side under the display screen 120 in a splicing manner, and the sensing of the plurality of optical fingerprint sensors The areas collectively constitute the fingerprint detection area 103 of the optical fingerprint device 130. In other words, the fingerprint detection area 103 of the optical fingerprint device 130 may include multiple sub-areas, and each sub-area corresponds to the sensing area of one of the optical fingerprint sensors, so that the fingerprint collection area 103 of the optical fingerprint module 130 can be It extends to the main area of the lower half of the display screen, that is, extends to the area where the finger is habitually pressed, so as to realize the blind fingerprint input operation. Alternatively, when the number of optical fingerprint sensors is sufficient, the fingerprint detection area 130 can also be extended to half of the display area or even the entire display area, thereby realizing half-screen or full-screen fingerprint detection.
综上所述,目前的屏下光学指纹装置按照其包括的光路引导结构的不同,通常包括设置有周期性小孔光路方案和微距透镜方案,这两种方案均是将光学指纹装置放置于显示屏下方,例如方式在OLED屏下方。当手指放于亮屏的OLED上方,手指就会散射或者反射OLED屏发出的光,经过手指的返回光会穿透OLED屏直到OLED下方的光学指纹装置。指纹是一个漫反射体,经过手指返回的光在各方向都可能存在。第一种周期性小孔方案(或者说准直器方案)是在OLED屏下方通过周期性小孔收集指纹屏漏下来的光,这部分光包含指纹信号和屏内部结构信号。第二种微距镜头方案(包括光学透镜的方案)使用微距镜头收集OLED屏漏下来的光,进而检测指纹。To sum up, the current under-screen optical fingerprint device usually includes a periodic small hole optical path solution and a macro lens solution according to the different light path guiding structure it includes. Both of these solutions place the optical fingerprint device on Below the display, for example, the way is below the OLED screen. When the finger is placed above the OLED of the bright screen, the finger will scatter or reflect the light emitted by the OLED screen, and the returning light from the finger will penetrate the OLED screen to the optical fingerprint device below the OLED. The fingerprint is a diffuse reflector, and the light returned by the finger may exist in all directions. The first periodic small hole solution (or collimator solution) is to collect the light leaked from the fingerprint screen through periodic small holes under the OLED screen. This part of the light contains the fingerprint signal and the internal structure signal of the screen. The second macro lens solution (including the optical lens solution) uses a macro lens to collect the light leaked from the OLED screen, and then detect fingerprints.
已经面世的屏下光学指纹装置的点亮方式一般都是采用局部区域单色图案,这种方式会将指纹检测区域或者说指纹按压区域内的所有像素全部点亮。这种方式可较好的反映出手指的指纹信息,但由于全区域点亮基本反映的是屏上表面玻璃盖板与指纹接触面的边界条件,此种方法对真假指纹的防伪效果很差,因此其不能区分真假指纹。The lighting method of the under-screen optical fingerprint device that has been released generally uses a partial area monochrome pattern, which will light up all the pixels in the fingerprint detection area or fingerprint pressing area. This method can better reflect the fingerprint information of the finger, but because the full-area lighting basically reflects the boundary conditions between the glass cover on the surface of the screen and the fingerprint contact surface, this method has a poor anti-counterfeiting effect on true and false fingerprints. , So it cannot distinguish between true and false fingerprints.
而现有防伪方案在一般为在互补金属氧化物半导体(Complementary  Metal-Oxide-Semiconductor,CMOS)图像传感器特定区域制作彩色滤光片,并且通过深度学习的方法做真假指纹的识别。但是这种彩色滤光片防伪的方案成本相对无滤光片的方案要高很多。The existing anti-counterfeiting solution generally involves fabricating color filters in a specific area of a Complementary Metal-Oxide-Semiconductor (CMOS) image sensor, and identifying true and false fingerprints through a deep learning method. However, the cost of such a color filter anti-counterfeiting solution is much higher than that of a non-filter solution.
因此,本申请实施例提出了一种指纹识别和防伪的方法、装置和电子设备,能够进行指纹识别以及指纹的防伪认证,成本更低,效率更高。Therefore, the embodiments of the present application propose a fingerprint identification and anti-counterfeiting method, device, and electronic equipment, which can perform fingerprint recognition and fingerprint anti-counterfeiting authentication, with lower cost and higher efficiency.
图3示出了根据本申请实施例的电子设备20的局部示意图,该图3为电子设备20的侧视图。如图3所示,该电子设备20包括显示屏200和指纹识别装置300,显示屏200位于指纹识别装置300的上方。FIG. 3 shows a partial schematic diagram of an electronic device 20 according to an embodiment of the present application, and FIG. 3 is a side view of the electronic device 20. As shown in FIG. 3, the electronic device 20 includes a display screen 200 and a fingerprint identification device 300, and the display screen 200 is located above the fingerprint identification device 300.
具体地,该显示屏200可以对应于上述图1和图2中描述的电子设备10中的显示屏120,适用于上述关于显示屏120的相关描述,为了简洁,在此不再赘述。Specifically, the display screen 200 may correspond to the display screen 120 in the electronic device 10 described in FIG. 1 and FIG. 2, and is suitable for the related description of the display screen 120 described above. For the sake of brevity, details are not repeated here.
具体地,如3所示,该显示屏200包括若干发光显示像素,可以用于显示图像。图3中的该显示屏200可以表示显示屏200的一部分,而并不是显示200的实际尺寸和大小。如图3所示,该显示屏200包括指纹检测区域210,用于手指按压,即使用者在需要对该电子设备20进行解锁或者其他指纹识别的时候,只需要将手指按压在该指纹检测区域210,便可以实现指纹输入。其中,该指纹检测区域210可以对应于上述图1和图2中描述的电子设备10中的指纹检测区域103,适用于上述关于指纹检测区域103的相关描述,为了简洁,在此不再赘述。Specifically, as shown in 3, the display screen 200 includes a number of light-emitting display pixels, which can be used to display images. The display screen 200 in FIG. 3 may represent a part of the display screen 200 instead of the actual size and size of the display 200. As shown in FIG. 3, the display screen 200 includes a fingerprint detection area 210 for finger pressing, that is, when the user needs to unlock the electronic device 20 or other fingerprint recognition, he only needs to press his finger on the fingerprint detection area 210, the fingerprint input can be realized. Wherein, the fingerprint detection area 210 may correspond to the fingerprint detection area 103 in the electronic device 10 described in FIG. 1 and FIG. 2, and is applicable to the relevant description of the fingerprint detection area 103 described above. For the sake of brevity, it will not be repeated here.
另外,如图3所示,该指纹检测区域210包括互不重叠的中心区域211和周围区域212,该中心区域211位于该周围区域212的中间。该中心区域211内的发光显示像素发出单色光照射其上方的手指,该周围区域212内的发光显示像素发出空间上间隔分布的多种颜色的光照射该手指。也就是说,手指触摸指纹检测区域210时,指纹检测区域210的中心区域211采用单色光照射手指,而指纹检测区域210的周围区域212采用彩色图案照射手指。In addition, as shown in FIG. 3, the fingerprint detection area 210 includes a central area 211 and a surrounding area 212 that do not overlap each other, and the central area 211 is located in the middle of the surrounding area 212. The light-emitting display pixels in the central area 211 emit monochromatic light to illuminate the finger above it, and the light-emitting display pixels in the surrounding area 212 emit light of multiple colors distributed at intervals to illuminate the finger. That is, when a finger touches the fingerprint detection area 210, the central area 211 of the fingerprint detection area 210 illuminates the finger with monochromatic light, and the surrounding area 212 of the fingerprint detection area 210 illuminates the finger with a color pattern.
具体地,指纹检测区域210内的发光显示像素发出的光照射到手指后,会产生返回光信号。其中,该返回光信号包括在手指表面发生反射后返回的光,例如图3中三组空心箭头符号所示;另外,该返回光信号也包括在手指内部发生散射后返回的光,例如图3中三组黑色实心粗箭头符号所示。Specifically, after the light emitted by the light-emitting display pixels in the fingerprint detection area 210 irradiates the finger, a return light signal will be generated. Among them, the return light signal includes the light that returns after being reflected on the surface of the finger, as shown in the three groups of hollow arrow symbols in Figure 3; in addition, the return light signal also includes the light that returns after being scattered inside the finger, as shown in Figure 3. The three groups of black solid thick arrow symbols are shown.
应理解,本申请实施例中的终端设备20的显示屏200下方设置有指纹识别装置300,该指纹识别装置300可以用于接收手指的返回光信号。具体 地,该指纹识别装置300包括:光路引导结构310以及光学传感器320,该光学传感器320设置在光路引导结构310的下方。其中,该光路引导结构310用于:将返回光信号引导至光学传感器,该返回光信号为该指纹检测区域内的发光显示像素发出的光照射手指后返回的光信号;该光学传感器320用于:接收经过该光路引导结构的光信号,该光信号用于获取该手指的指纹图像,该指纹图像中与该中心区域对应的中心部分用于进行指纹识别,该指纹图像中与该周围区域对应的周围部分用于进行指纹防伪认证。It should be understood that the fingerprint identification device 300 is provided under the display screen 200 of the terminal device 20 in the embodiment of the present application, and the fingerprint identification device 300 may be used to receive the return light signal of the finger. Specifically, the fingerprint identification device 300 includes: an optical path guiding structure 310 and an optical sensor 320, and the optical sensor 320 is disposed under the optical path guiding structure 310. Wherein, the light path guiding structure 310 is used to: guide the return light signal to the optical sensor, the return light signal is the light signal returned after the light emitted by the light-emitting display pixel in the fingerprint detection area irradiates the finger; the optical sensor 320 is used for : Receive the light signal passing through the optical path guiding structure, the light signal is used to obtain the fingerprint image of the finger, the central part of the fingerprint image corresponding to the central area is used for fingerprint identification, and the fingerprint image corresponds to the surrounding area The surrounding part is used for fingerprint anti-counterfeiting authentication.
应理解,该光路引导结构310可以对应于上述图1和图2中描述的电子设备10中的光学组件132,适用于上述关于光学组件132的相关描述;类似的,光学传感器320可以对应于上述图1和图2中描述的电子设备10中的光学指纹传感器,具体地,该光学传感器320可以为上述电子设备10中的光检测部分134,适用于上述关于光检测部分134的相关描述,为了简洁,在此均不再赘述。It should be understood that the optical path guiding structure 310 may correspond to the optical component 132 in the electronic device 10 described in FIGS. 1 and 2, and is suitable for the above-mentioned related description of the optical component 132; similarly, the optical sensor 320 may correspond to the above The optical fingerprint sensor in the electronic device 10 described in FIGS. 1 and 2, specifically, the optical sensor 320 may be the light detecting portion 134 in the above-mentioned electronic device 10, which is applicable to the above-mentioned related description about the light detecting portion 134, in order to It's concise, so I won't repeat it here.
例如,本申请实施例的该光路引导结构320可以包括光学透镜。For example, the optical path guiding structure 320 of the embodiment of the present application may include an optical lens.
再例如,本申请实施例的该光路引导结构320还可以包括具有多个准直单元或者微孔阵列的光学准直器,该光学准直器用于将该返回光信号通过该多个准直单元或者微孔阵列分别传输到该光学传感器的该感应阵列中对应的光学感应单元。For another example, the optical path guiding structure 320 of the embodiment of the present application may further include an optical collimator having a plurality of collimating units or a microhole array, and the optical collimator is used to pass the return optical signal through the plurality of collimating units Or the microhole array is respectively transmitted to the corresponding optical sensing unit in the sensing array of the optical sensor.
再例如,本申请实施例的该光路引导结构320包括具有多个微透镜的微透镜阵列和具有多个微孔的挡光层,该微透镜阵列用于将该返回光信号通过该多个微透镜分别聚焦到该挡光层对应的微孔,并通过该微孔传输到该光学传感器的该感应阵列中对应的光学感应单元。For another example, the optical path guiding structure 320 of the embodiment of the present application includes a microlens array with a plurality of microlenses and a light blocking layer with a plurality of microholes, and the microlens array is used to pass the return light signal through the plurality of microlenses. The lenses are respectively focused on the micro holes corresponding to the light blocking layer, and are transmitted to the corresponding optical sensing units in the sensing array of the optical sensor through the micro holes.
因此,考虑到假指纹的材质、光谱、内部光学散射特性与真手指的材质以及结构相差较远,为了区分出真假手指的指纹图像,提高屏下光学指纹的防伪能力,本申请实施例提出了使用边沿区域单独打彩色光的方式实现光学指纹的防伪认证,能够在做指纹识别的同时做真假指纹防伪,提升用户体验感。Therefore, considering that the material, spectrum, and internal optical scattering characteristics of fake fingerprints are far different from those of real fingers, in order to distinguish fingerprint images of real and fake fingers and improve the anti-counterfeiting ability of optical fingerprints under the screen, an embodiment of the present application proposes The method of using the edge area to emit colored light separately to realize the anti-counterfeiting authentication of optical fingerprints can be used for fingerprint identification and anti-counterfeiting of true and false fingerprints at the same time, which improves the user experience.
下面将结合图4至图10,详细描述本申请实施例的指纹检测区域的发光或者说打光方式以及指纹识别和防伪的方法。The following will describe in detail the light-emitting or lighting method of the fingerprint detection area and the method of fingerprint identification and anti-counterfeiting in the embodiment of the present application with reference to FIGS. 4 to 10.
图4示出了本申请实施例的一种指纹检测区域210的示意图。如图4所示,该指纹检测区域210包括中心区域211和周围区域212。其中,该中心 区域211为该指纹检测区域210的中心部分,即图4中间白色区域,该中心区域211内的发光显示像素发出单色光照射手指,该单色光照射手指后的返回光经过光路引导结构后由光学传感器接收,并以此获取指纹图像,该部分指纹图像可以用于进行指纹识别。FIG. 4 shows a schematic diagram of a fingerprint detection area 210 according to an embodiment of the present application. As shown in FIG. 4, the fingerprint detection area 210 includes a central area 211 and a surrounding area 212. The central area 211 is the central part of the fingerprint detection area 210, that is, the white area in the middle of FIG. 4. The light-emitting display pixels in the central area 211 emit monochromatic light to illuminate the finger, and the return light after the monochromatic light illuminates the finger passes through After the optical path guide structure is received by the optical sensor, the fingerprint image is obtained by this, and this part of the fingerprint image can be used for fingerprint identification.
可选地,该中心区域211内的发光显示像素可以用于发出单色光以进行指纹识别过程,其中,该单色光可以为任意一种颜色的光。例如,该单色光可以为绿光、青光或者白光,本申请实施例并不限于此。Optionally, the light-emitting display pixels in the central area 211 can be used to emit monochromatic light for fingerprint recognition, where the monochromatic light can be light of any color. For example, the monochromatic light may be green light, cyan light or white light, and the embodiment of the present application is not limited thereto.
应理解,本申请实施例中的任意一个发光显示像素可以指红色、绿色和蓝色三种颜色的组合像素,因此,每个像素都可以用于发出各种颜色的光。It should be understood that any light-emitting display pixel in the embodiments of the present application may refer to a combination of three colors of red, green, and blue. Therefore, each pixel may be used to emit light of various colors.
如图4所示,在中心区域211的外围为周围区域212,即该周围区域212位于图4的中间白色区域的外围,指该图4中带有图案填充的区域。该周围区域212包围中心区域212,该周围区域212内的发光显示像素发出多种颜色的光照射手指,该多种颜色的光在空间上间隔分布,这些光照射手指后的返回光经过光路引导结构后由光学传感器接收,并以此获取对应的图像,该部分图像可以用于进行手指防伪认证,也就是确认该手指为真手指还是假手指。As shown in FIG. 4, the periphery of the central area 211 is the surrounding area 212, that is, the surrounding area 212 is located at the periphery of the middle white area in FIG. 4, which refers to the area with pattern filling in FIG. The peripheral area 212 surrounds the central area 212. The light-emitting display pixels in the peripheral area 212 emit light of multiple colors to illuminate the finger, and the lights of multiple colors are distributed at intervals in space. The return light after the light irradiates the finger is guided by the optical path. After the structure is received, the optical sensor obtains the corresponding image. This part of the image can be used for finger anti-counterfeiting authentication, that is, to confirm whether the finger is a real finger or a fake finger.
可选地,该周围区域212内的发光显示像素可以用于发出多种颜色的光,该多种颜色的光可以为任意两种或者更多种颜色的光。例如,该多种颜色的光可以包括红光、蓝光、绿光、黄光和黑光中的至少两个,其中,黑光表示该不发光。为了使得后续进行指纹防伪认证效果更佳,通常选择颜色差异较大的光,这样可以最大限度的增加真假指纹的光谱差异。Optionally, the light-emitting display pixels in the surrounding area 212 may be used to emit light of multiple colors, and the light of multiple colors may be lights of any two or more colors. For example, the light of the multiple colors may include at least two of red light, blue light, green light, yellow light, and black light, where the black light means no light is emitted. In order to make the subsequent fingerprint anti-counterfeiting authentication effect better, usually choose light with a large color difference, which can maximize the spectral difference between true and false fingerprints.
应理解,若手指触摸指纹检测区域210,可以对应获取该手指的指纹图像,由于指纹检测区域210分为中心区域211和周围区域212,并且中心区域211与周围区域211的光不同,因此,对应获取的手指的指纹图像也可以看作两部分。为了便于描述,下面将该两部分分别称为该指纹图像的中心部分和周围部分。其中,指纹图像中与中心区域211对应的为中心部分,该中心部分是根据中心区域211内发出的单色光照射手指产生的返回光信号获取的,该中心部分用于进行指纹识别,确定该指纹图像是否为预存的指纹图像;另外,该指纹图像中与周围区域212对应的为周围部分,该周围部分是根据周围区域212发出的多种颜色光照射手指产生的返回光信号获取的,该周围部分用于进行指纹防伪验证,即确定该指纹图像是否为真手指的指纹图像, 也就是确定触摸在指纹检测区域210上的手指是否是真手指。It should be understood that if a finger touches the fingerprint detection area 210, the fingerprint image of the finger can be correspondingly obtained. Since the fingerprint detection area 210 is divided into a central area 211 and a surrounding area 212, and the light of the central area 211 and the surrounding area 211 are different, the corresponding The acquired fingerprint image of the finger can also be seen as two parts. For ease of description, the two parts are referred to as the central part and the surrounding part of the fingerprint image below. Among them, the fingerprint image corresponding to the central area 211 is the central part, the central part is obtained according to the return light signal generated by the monochromatic light emitted in the central area 211 irradiating the finger, and the central part is used for fingerprint identification to determine the Whether the fingerprint image is a pre-stored fingerprint image; in addition, the surrounding area 212 corresponds to the surrounding area in the fingerprint image, and the surrounding area is obtained based on the return light signal generated by irradiating the finger with multiple colors of light emitted by the surrounding area 212. The surrounding part is used for fingerprint anti-counterfeiting verification, that is, to determine whether the fingerprint image is a fingerprint image of a real finger, that is, to determine whether the finger touching the fingerprint detection area 210 is a real finger.
由于指纹图像的中心部分用于进行指纹识别,为了保证获取的手指的指纹图像的中心部分在进行指纹识别时的准确性,也就是为了保证该中心部分的指纹的清晰度和准确度,需要使该中心部分不小于一定阈值,对应的,也就是需要将指纹检测区域210中的中心区域211设置为不小于一定阈值。因此,可以根据实际应用的需要设置该中心区域211的面积和形状。Since the central part of the fingerprint image is used for fingerprint identification, in order to ensure the accuracy of the central part of the fingerprint image of the obtained finger during fingerprint identification, that is, to ensure the clarity and accuracy of the fingerprint in the central part, it is necessary to use The central part is not less than a certain threshold, and correspondingly, it is necessary to set the central area 211 in the fingerprint detection area 210 to be no less than a certain threshold. Therefore, the area and shape of the central area 211 can be set according to actual application requirements.
例如,可以将该中心区域211的面积设置为大于该周围区域212的面积。在实际应用中,通常可以将该中心区域211设置为面积大于或者等于16mm 2的单连通区域,例如,考虑效果和成本,该中心区域211可以设置为5.5mm*8.5mm的长方形;对应的,该周围区域212可以设置为在中心区域211的边沿宽度为0.05mm-3mm的外圈区域。再例如,对于中心区域211的形状,可以将该中心区域211设置为矩形或者圆形,例如,图4以该中心区域211为长方形为例,但本申请实施例并不限于此。 For example, the area of the central area 211 may be set to be greater than the area of the surrounding area 212. In practical applications, the central area 211 can usually be set as a single connected area with an area greater than or equal to 16 mm 2 , for example, considering the effect and cost, the central area 211 can be set as a rectangle of 5.5 mm * 8.5 mm; correspondingly, The peripheral area 212 may be set as an outer ring area with a width of 0.05 mm-3 mm at the edge of the central area 211. For another example, for the shape of the central area 211, the central area 211 may be set to be a rectangle or a circle. For example, in FIG. 4, the central area 211 is a rectangle as an example, but the embodiment of the present application is not limited to this.
可选地,考虑到周围区域212通常较小,为了达到更好的打光效果,还可以设置补光区域。图5示出了本申请实施例的另一种指纹检测区域210的示意图。如图5所示,对比图4可知,该指纹检测区域210包括中心区域211和周围区域212以外,该指纹检测区域210还可以包括位于该周围区域212的外围的补光区域213,即图4中最外围的白色区域,该补光区域213内的发光显示像素发出单色光照射该手指。Optionally, considering that the surrounding area 212 is usually small, in order to achieve a better lighting effect, a supplemental light area may also be set. FIG. 5 shows a schematic diagram of another fingerprint detection area 210 according to an embodiment of the present application. As shown in FIG. 5, compared with FIG. 4, it can be seen that the fingerprint detection area 210 includes a central area 211 and a surrounding area 212. The fingerprint detection area 210 may also include a supplementary light area 213 located at the periphery of the surrounding area 212, as shown in FIG. 4 In the outermost white area, the light-emitting display pixels in the supplemental light area 213 emit monochromatic light to illuminate the finger.
可选地,该补光区域213内的发光显示像素发出的单色光可以与该中心区域211内的发光显示像素发出的单色光的颜色相同或者不同。考虑打光的效果,通常将该补光区域213内的发光显示像素发出的单色光设置为与该中心区域211内的发光显示像素发出的单色光的颜色相同。Optionally, the color of the monochromatic light emitted by the light-emitting display pixels in the supplemental light area 213 may be the same as or different from the color of the monochromatic light emitted by the light-emitting display pixels in the central area 211. Considering the effect of lighting, the monochromatic light emitted by the light-emitting display pixels in the supplemental light area 213 is usually set to be the same color as the monochromatic light emitted by the light-emitting display pixels in the central area 211.
另外,该周围区域212内的发光显示像素发出的多种颜色的光中可以存在与中心区域211内的发光显示像素发出的单色光的颜色相同的光,也可以不存在颜色相同的光。考虑到效果,通常将该周围区域212内的发光显示像素发出的多种颜色的光设置为与中心区域211内的发光显示像素发出的单色光的颜色不相同。In addition, the light of multiple colors emitted by the light-emitting display pixels in the surrounding area 212 may have the same color as the monochromatic light emitted by the light-emitting display pixels in the central area 211, or there may be no light of the same color. Considering the effect, the light of multiple colors emitted by the light-emitting display pixels in the surrounding area 212 is usually set to be different from the color of the monochromatic light emitted by the light-emitting display pixels in the central area 211.
为了便于描述本申请实施例中指纹检测区域210中周围区域212内的发光显示像素发出的多种颜色的光的分布,这里将该周围区域212看作包括多组子区域,该多组子区域中同一组子区域内的发光显示像素发出相同颜色的 光照射该手指,而不同组子区域内的发光显示像素发出不同颜色的光照射该手指。In order to facilitate the description of the distribution of light of multiple colors emitted by the light-emitting display pixels in the surrounding area 212 in the fingerprint detection area 210 in the embodiment of the present application, the surrounding area 212 is considered to include multiple sets of sub-regions. The light-emitting display pixels in the same group of sub-regions emit light of the same color to illuminate the finger, and the light-emitting display pixels in different groups of sub-regions emit light of different colors to illuminate the finger.
应理解,该多组子区域中每组子区域包括多个子区域,不同组子区域包括的子区域的个数可以相同,也可以不同。本申请实施例中该周围区域212内的发光显示像素发出多种颜色的光照射手指,该多种颜色的光在空间上间隔分布,对应的,该多组子区域中不同组的子区域之间间隔排列。例如,假设该多组子区域为三组子区域,则该三组子区域中包括的子区域间隔排列。It should be understood that each group of sub-regions in the multiple groups of sub-regions includes multiple sub-regions, and the number of sub-regions included in different groups of sub-regions may be the same or different. In the embodiment of the present application, the light-emitting display pixels in the surrounding area 212 emit light of multiple colors to illuminate the finger, and the light of the multiple colors is distributed at intervals in space. Correspondingly, among the sub-regions of different groups in the multiple sub-regions Arranged at intervals. For example, assuming that the multiple sets of subregions are three sets of subregions, the subregions included in the three sets of subregions are arranged at intervals.
可选地,该多组子区域中同一组子区域内的多个子区域的面积和/或形状可以相同,也可以不同;而不同组子区域中包括的子区域的面积和/或形状也可以相同或者不同。考虑到实际设置的难易程度,通常将同一组子区域内的多个子区域设置为面积和形状相同。为了便于描述,下面以同一组子区域内的多个子区域的面积和形状相同为例进行描述;另外,本申请实施例中不同组子区域的面积和形状可以相同,也可以不同。Optionally, the areas and/or shapes of multiple subregions in the same group of subregions in the multiple sets of subregions may be the same or different; and the areas and/or shapes of subregions included in different sets of subregions may also be Same or different. Taking into account the difficulty of actual setting, multiple sub-regions in the same group of sub-regions are usually set to have the same area and shape. For ease of description, the following description takes the same area and shape of multiple sub-regions in the same group of sub-regions as an example; in addition, the areas and shapes of different groups of sub-regions in the embodiments of the present application may be the same or different.
应理解,本申请实施例中的任意一个子区域的大小可以根据实际应用进行设置。例如,可以将周围区域212中每个子区域的宽度设置在0.2mm-3mm的范围内,例如,假设子区域为正方形,则该正方形的边长的范围为0.2mm-3mm;假设子区域为圆形或者半圆形,该子区域的直径可以设置为为0.2mm-3mm。再例如,根据子区域的宽度的范围,对应可以将周围区域212中的每个子区域的大小设置为包括5-10个发光显示像素,但本申请实施例并不限于此。It should be understood that the size of any subregion in the embodiments of the present application can be set according to actual applications. For example, the width of each sub-region in the surrounding area 212 can be set in the range of 0.2mm-3mm. For example, if the sub-region is a square, the side length of the square is in the range of 0.2mm-3mm; and the sub-region is assumed to be a circle. The diameter of the sub-area can be set to be 0.2mm-3mm. For another example, according to the width of the sub-region, the size of each sub-region in the surrounding region 212 may be correspondingly set to include 5-10 light-emitting display pixels, but the embodiment of the present application is not limited to this.
可选地,本申请实施例的周围区域212包括的多组子区域可以为两组子区域或者多于两组子区域,为了便于说明,下面分别以该多组子区域为两组子区域或者三组子区域位列进行描述。Optionally, the multiple sets of sub-regions included in the surrounding area 212 in the embodiment of the present application may be two sets of sub-regions or more than two sets of sub-regions. For ease of description, the multiple sets of sub-regions are used as two sets of sub-regions or Three groups of sub-regions are described in ranks.
可选地,作为第一个实施例,假设本申请实施例的周围区域212包括两组子区域,分别为第一组子区域和第二组子区域。其中,第一组子区域中的子区域与第二组子区域中的子区域之间间隔排列;第一组子区域中的多个子区域的面积和形状相同,第二组子区域中的多个子区域的面积和形状相同。Optionally, as a first embodiment, it is assumed that the surrounding area 212 in this embodiment of the present application includes two groups of sub-areas, which are a first group of sub-areas and a second group of sub-areas, respectively. Among them, the sub-regions in the first group of sub-regions and the sub-regions in the second group of sub-regions are arranged at intervals; the areas and shapes of the multiple sub-regions in the first group of sub-regions are the same. The area and shape of the sub-regions are the same.
可选地,该第一组子区域中的子区域的形状可以与该第二组子区域中的子区域的形状相同。具体地,该第一组子区域与该第二组子区域中的子区域的形状可以设置为任意一种形状,例如可以均设置为方形、圆形或者半圆形。Optionally, the shape of the sub-areas in the first group of sub-areas may be the same as the shape of the sub-areas in the second group of sub-areas. Specifically, the shape of the sub-areas in the first group of sub-areas and the second group of sub-areas can be set to any shape, for example, can be set to a square, a circle or a semicircle.
例如,如图4和图5所示,该第一组子区域与该第二组子区域中的子区 域的形状可以均为方形。在这种情况下,可以通过合理设置两组区域的颜色,使得周围区域212中存在光强不同的区域。例如,可以将第一组子区域或者第二组子区域中任意一组子区域设置为黑色,即不发光区域;而另一组设置为其他颜色的发光区域,比如蓝色或者黄色,这样可以使得第一组子区域和第二组子区域的光强有明显对比。或者,也可以将第一组子区域或者第二组子区域中任意一组子区域设置为红色,另一组为其他颜色,比如黄色或者蓝色,这样,两组子区域均发光,但是可以通过光学传感器上方设置的滤光片,拦截红色的返回光,同样可以使得两组子区域的光强形成明显对比。For example, as shown in Figs. 4 and 5, the shapes of the sub-areas in the first group of sub-areas and the second group of sub-areas may both be square. In this case, the colors of the two groups of regions can be set reasonably so that there are regions with different light intensities in the surrounding region 212. For example, you can set any group of sub-areas in the first group of sub-areas or the second group of sub-areas to be black, that is, non-light-emitting areas; while the other group is set to light-emitting areas of other colors, such as blue or yellow, so that This makes the light intensity of the first group of sub-areas and the second group of sub-areas have obvious contrast. Or, you can also set any group of sub-areas in the first group of sub-areas or the second group of sub-areas to red, and the other group to other colors, such as yellow or blue, so that both groups of sub-areas emit light, but Through the filter set above the optical sensor to intercept the red return light, the light intensity of the two groups of sub-areas can also be clearly contrasted.
再例如,如图6所示,该第一组子区域与第二组子区域中的子区域的形状可以均为半圆形。此时,该周围区域212还可以包括部分黑色区域,也就是不发光区域,即如图6所示的黑色区域部分,该部分黑色区域可以使得周围区域212中存在光强不同的区域,本申请实施例并不限于此。For another example, as shown in FIG. 6, the shapes of the sub-areas in the first group of sub-areas and the second group of sub-areas may both be semicircular. At this time, the surrounding area 212 may also include a part of the black area, that is, the non-luminous area, that is, the black area as shown in FIG. 6. The part of the black area may make the surrounding area 212 have areas with different light intensities. The embodiment is not limited to this.
可选地,该第一组子区域中的子区域的形状还可以与该第二组子区域中的子区域的形状不相同。具体地,该第一组子区域和第二组子区域可以设置为任意不同的两种形状,例如可以设置为方形、圆形、半圆形和椭圆中的任意两种形状。Optionally, the shape of the sub-regions in the first group of sub-regions may also be different from the shape of the sub-regions in the second group of sub-regions. Specifically, the first group of sub-regions and the second group of sub-regions can be set in any two different shapes, for example, can be set in any two shapes of a square, a circle, a semicircle, and an ellipse.
例如,如图7所示,该第一组子区域中的子区域的形状为方形,该第二组子区域中的子区域的形状为圆形。此时,该周围区域212还可以包括部分黑色区域,也就是不发光区域,即如图7所示的黑色区域部分,本申请实施例并不限于此。For example, as shown in FIG. 7, the shape of the sub-areas in the first group of sub-areas is a square, and the shape of the sub-areas in the second group of sub-areas is a circle. At this time, the surrounding area 212 may also include a part of the black area, that is, the non-luminous area, that is, the black area as shown in FIG. 7, and the embodiment of the present application is not limited to this.
可选地,作为第二个实施例,假设本申请实施例的周围区域212包括三组子区域,分别为第一组子区域、第二组子区域和第三组子区域。其中,第一组子区域中的子区域、第二组子区域中的子区域与第三组子区域中的子区域之间间隔排列;同一组子区域中的多个子区域的面积和形状相同。Optionally, as a second embodiment, it is assumed that the surrounding area 212 of the embodiment of the present application includes three groups of sub-areas, which are respectively a first group of sub-areas, a second group of sub-areas, and a third group of sub-areas. Among them, the sub-regions in the first group of sub-regions, the sub-regions in the second group of sub-regions, and the sub-regions in the third group of sub-regions are arranged at intervals; multiple sub-regions in the same group of sub-regions have the same area and shape .
可选地,该第一组子区域、该第二组子区域和第三组子区域中的全部子区域的形状可以设置为相同。具体地,该三组子区域中的子区域的形状可以设置为任意一种形状,例如可以均设置为方形、圆形或者半圆形。Optionally, the shapes of all the sub-areas in the first group of sub-areas, the second group of sub-areas and the third group of sub-areas may be set to be the same. Specifically, the shape of the sub-regions in the three groups of sub-regions may be set to any shape, for example, all may be set to be square, circular or semicircular.
例如,如图8所示,该第一组子区域、该第二组子区域和第三组子区域中的全部子区域的形状可以均为方形。此时,与周围区域212包括如图4和图5所示的两组子区域的情况类似,可以通过合理设置这三组区域的颜色,使得周围区域212中存在光强不同的区域。例如,可以将第一组子区域至第 三组子区域中任意一组子区域设置为黑色,即不发光区域;而另两组设置为其他颜色的发光区域,比如蓝色和黄色,这样可以使得这三组子区域的光强有明显对比。或者,也可以将第一组子区域至第三组子区域中任意一组子区域设置为红色,另两组为其他颜色,比如黄色和蓝色,这样,三组子区域均发光,但是可以通过光学传感器上方设置的滤光片,拦截红色的返回光,同样可以使得三组子区域的光强形成明显对比。For example, as shown in FIG. 8, the shapes of all the sub-areas in the first group of sub-areas, the second group of sub-areas, and the third group of sub-areas may all be square. At this time, similar to the situation where the surrounding area 212 includes the two groups of sub-areas as shown in FIGS. 4 and 5, the colors of the three groups of areas can be set reasonably so that there are areas with different light intensities in the surrounding area 212. For example, you can set any group of sub-areas from the first group of sub-areas to the third group of sub-areas to be black, that is, non-light-emitting areas; while the other two groups are set to light-emitting areas of other colors, such as blue and yellow, so that This makes the light intensities of these three groups of sub-regions have obvious contrast. Or, you can also set any group of sub-areas from the first group of sub-areas to the third group of sub-areas to be red, and the other two groups to be other colors, such as yellow and blue, so that all three groups of sub-areas emit light, but Through the filter set above the optical sensor to intercept the red return light, the light intensity of the three groups of sub-regions can also be clearly contrasted.
再例如,如图9所示,该第一组子区域、该第二组子区域和第三组子区域中的全部子区域的形状可以均为半圆形。此时,该周围区域212还可以包括部分黑色区域,也就是不发光区域,即如图9所示的黑色区域部分,本申请实施例并不限于此。For another example, as shown in FIG. 9, the shapes of all the sub-regions in the first group of sub-regions, the second group of sub-regions, and the third group of sub-regions may all be semicircular. At this time, the surrounding area 212 may also include a part of the black area, that is, the non-luminous area, that is, the black area as shown in FIG. 9, and the embodiment of the present application is not limited to this.
可选地,不同组子区域中的子区域的形状还可以设置为不相同。具体地,该第一组子区域、第二组子区域和第三组子区域可以设置为任意不同的两种或者三种形状,即该三组子区域中可以存在两组子区域的形状相同,而另一组与之形状不同,或者,该三组子区域也可以设置为完全不同的三种形状。例如该三组子区域可以设置为方形、圆形、半圆形和椭圆中的任意两种或者三种形状。Optionally, the shapes of the sub-areas in different groups of sub-areas may also be set to be different. Specifically, the first group of sub-regions, the second group of sub-regions, and the third group of sub-regions can be set to any two or three different shapes, that is, there may be two groups of sub-regions with the same shape in the three groups of sub-regions. , And the other group has a different shape, or the three groups of sub-regions can also be set to three completely different shapes. For example, the three groups of sub-regions can be set to any two or three shapes among square, circle, semicircle and ellipse.
例如,如图10所示,该第一组子区域中的子区域的形状为方形,该第二组子区域和第三组子区域中的子区域的形状均为圆形。此时,该周围区域212还可以包括部分黑色区域,也就是不发光区域,即如图10所示的黑色区域部分,本申请实施例并不限于此。For example, as shown in FIG. 10, the shape of the sub-areas in the first group of sub-areas is square, and the shapes of the sub-areas in the second group of sub-areas and the third group of sub-areas are both circular. At this time, the surrounding area 212 may also include a part of a black area, that is, a non-light emitting area, that is, a black area as shown in FIG. 10, and the embodiment of the present application is not limited to this.
在本申请实施例中,按照上述内容,设置指纹检测区域210内的发光显示像素照射手指,获得该手指对应的指纹图像,其中,该指纹图像的中心部分用于进行指纹识别,而该指纹图像的周围部分可以用于进行指纹防伪认证。In the embodiment of the present application, according to the above content, the light-emitting display pixels in the fingerprint detection area 210 are set to illuminate the finger to obtain a fingerprint image corresponding to the finger. The central part of the fingerprint image is used for fingerprint identification, and the fingerprint image The surrounding part can be used for fingerprint anti-counterfeiting authentication.
具体地,指纹检测区域210的中心区域211采用单色光照射手指,对应光学传感器320获取该部分返回光并生成指纹图像的中心部分,该中心部分为带有手指指纹的图像,因此可以根据该指纹图像的中心部分进行指纹识别。Specifically, the central area 211 of the fingerprint detection area 210 illuminates the finger with monochromatic light, and the corresponding optical sensor 320 obtains the part of the returned light and generates the central part of the fingerprint image. The central part is the image with the fingerprint of the finger. The central part of the fingerprint image performs fingerprint recognition.
另外,指纹检测区域210的周围区域212采用空间上间隔的多种颜色光照射手指,光学传感器320获取该部分返回光并生成指纹图像的周围部分,该周围部分可以用于进行指纹防伪认证。具体地,可以基于深度学习算法, 根据该待检测指纹图像中的该周围部分,确定该待检测指纹图像是否为真手指的指纹图像。In addition, the surrounding area 212 of the fingerprint detection area 210 illuminates the finger with spatially spaced light of multiple colors, and the optical sensor 320 obtains the part of the returned light and generates the surrounding part of the fingerprint image. The surrounding part can be used for fingerprint anti-counterfeiting authentication. Specifically, a deep learning algorithm may be used to determine whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected.
常见的假指纹包括乳白色橡胶指纹、透明橡胶假指纹、黄色2D假指纹、黑色橡胶指纹以及肉色3D橡胶指纹等。考虑到假指纹通常通过倒模的工艺制作,这种工艺限制了所制作的假指纹从指纹的材质到指纹背后的材质通常都是各项同性且材质均匀的。但是真实的指纹由不同层构成,例如人的手指一般可以包括表皮层、真皮层、肉体组织、指骨等结构。Common fake fingerprints include milky white rubber fingerprints, transparent rubber fake fingerprints, yellow 2D fake fingerprints, black rubber fingerprints, and flesh-colored 3D rubber fingerprints. Taking into account that fake fingerprints are usually produced by an inverted mold process, this technique limits the production of fake fingerprints from the fingerprint material to the material behind the fingerprint, which is usually homogeneous and uniform. However, a real fingerprint is composed of different layers. For example, a human finger can generally include structures such as the epidermis, dermis, body tissue, and phalanges.
因此,各向同性的材质以及结构与真实指纹的结构就相差较远。当有一定间隔的光打在手指上之后再被光学指纹装置成像,光学指纹装置接收到的返回光信号可以分为两个部分,一是经过指纹表面直接反射的返回光,二是在指纹内部散射后返回的光。并且,不同颜色的光打在真假指纹上,表现出的信号量也有差异。真假指纹由于材质和结构的原因,造成指纹表面之间反射的光和内部散射的光均有不同的特性,指纹反射的光谱有差异,区分出这些特性就可区分出真假指纹。Therefore, the isotropic material and structure are far from the structure of the real fingerprint. When a certain interval of light hits the finger and then is imaged by the optical fingerprint device, the return light signal received by the optical fingerprint device can be divided into two parts, one is the return light directly reflected by the fingerprint surface, and the other is inside the fingerprint Light that returns after scattering. Moreover, different colors of light hit the real and fake fingerprints, and the amount of signal shown is also different. True and false fingerprints have different characteristics between the reflected light and internally scattered light due to the material and structure of the fingerprint surface, and the reflected spectrum of the fingerprint is different. By distinguishing these characteristics, the true and false fingerprints can be distinguished.
应理解,本申请实施例中可以基于深度学习算法,分析该待检测指纹图像中的该周围部分,进而确定该待检测指纹图像是否为真手指的指纹图像。其中,该深度学习算法可以包括以下至少一种:支持向量机(Support Vector Machine,SVM)、卷积神经网络(Convolutional Neural Networks,CNN)、循环神经网络(Recurrent Neural Network,RNN)以及k均值聚类算法(k-means clustering algorithm)。It should be understood that, in the embodiment of the present application, a deep learning algorithm may be used to analyze the surrounding part of the fingerprint image to be detected to determine whether the fingerprint image to be detected is a fingerprint image of a real finger. Among them, the deep learning algorithm may include at least one of the following: Support Vector Machine (SVM), Convolutional Neural Networks (CNN), Recurrent Neural Network (RNN), and k-means aggregation Class algorithm (k-means clustering algorithm).
具体地,以对任意一个目标手指进行指纹防伪认证为例,获取该目标手指的待检测指纹图像,基于深度学习算法,根据该待检测指纹图像中的周围部分,确定该待检测指纹图像是否为真手指的指纹图像,也就是确定目标手指是否是真手指。Specifically, taking fingerprint anti-counterfeiting authentication on any target finger as an example, the fingerprint image to be detected of the target finger is acquired, and based on the deep learning algorithm, according to the surrounding part of the fingerprint image to be detected, it is determined whether the fingerprint image to be detected is The fingerprint image of a real finger is to determine whether the target finger is a real finger.
可选地,可以基于深度学习算法,根据该待检测指纹图像的周围部分中反射光信号的分布图像和/或散射光信号的分布图像,确定该待检测指纹图像是否为真手指的指纹图像。其中,该反射光信号为该周围区域内的发光显示像素发出的光在该目标手指的表面发生反射后返回的光信号,对应的,该反射光信号的分布图像可以指返回的反射光的光谱图像,或者也可以指返回的反射光的光强分布图像等。该散射光信号为该周围区域内的发光显示像素发出的光在该目标手指的内部发生散射后返回的光信号,对应的,该散射光信 号的分布图像可以指返回的散射光的光谱图像,或者也可以指返回的散射光的光强分布图像等。Optionally, a deep learning algorithm may be used to determine whether the fingerprint image to be detected is a fingerprint image of a real finger according to the distribution image of the reflected light signal and/or the distribution image of the scattered light signal in the surrounding part of the fingerprint image to be detected. Wherein, the reflected light signal is the light signal returned after the light emitted by the light-emitting display pixels in the surrounding area is reflected on the surface of the target finger. Correspondingly, the distribution image of the reflected light signal may refer to the spectrum of the returned reflected light Image, or can also refer to the intensity distribution image of the returned reflected light. The scattered light signal is the light signal returned after the light emitted by the light-emitting display pixels in the surrounding area is scattered inside the target finger. Correspondingly, the distribution image of the scattered light signal may refer to the spectral image of the returned scattered light. Or it can also refer to the intensity distribution image of the returned scattered light.
这种方式利用了指纹的内部散射、外部反射、光谱不同等一种或者多种信息进行防伪认证,防伪效果较采用纯光学滤光片的效果更好。并且,本申请实施例的指纹检测区域210的打光方式相较于采用随机分布的彩色滤光片的方式成本低很多,而其他资源消耗相同。This method uses one or more kinds of information such as internal scattering, external reflection, and different spectrum of fingerprints for anti-counterfeiting authentication, and the anti-counterfeiting effect is better than that of pure optical filters. Moreover, the lighting method of the fingerprint detection area 210 in the embodiment of the present application has a much lower cost than the method of using randomly distributed color filters, and other resources are consumed the same.
可选地,该基于深度学习算法,根据该待检测指纹图像中的周围部分,确定该待检测指纹图像是否为真手指的指纹图像,还可以包括:基于深度学习算法,根据该待检测指纹图像的周围部分中第一光信号的分布图像和/或第二光信号的分布图像,确定该待检测指纹图像是否为真手指的指纹图像。其中,该第一光信号和该第二光信号分别为该周围区域212内的发光显示像素发出的多种颜色的光中任意两种颜色的光在照射该目标手指后返回的光信号。另外,若该周围区域212内的发光显示像素发出的光多于两种,也可以采用更多种光信号的分布图像进行比较,进而确定该待检测指纹图像是否为真手指的指纹图像。Optionally, the method of determining whether the fingerprint image to be detected is a fingerprint image of a real finger based on a deep learning algorithm and according to surrounding parts in the fingerprint image to be detected may also include: based on the deep learning algorithm, according to the fingerprint image to be detected The distribution image of the first light signal and/or the distribution image of the second light signal in the surrounding part of the, determining whether the fingerprint image to be detected is a fingerprint image of a real finger. Wherein, the first light signal and the second light signal are respectively the light signals of any two colors of light emitted by the light-emitting display pixels in the surrounding area 212 after irradiating the target finger. In addition, if the light-emitting display pixels in the surrounding area 212 emit more than two kinds of light, the distribution images of more kinds of light signals may be used for comparison to determine whether the fingerprint image to be detected is a fingerprint image of a real finger.
例如,以蓝光和红光为例。具体地,确定该周围部分中该第一光信号的分布图像和该第二光信号的分布图像,该第一光信号为该周围区域212内的发光显示像素发出的蓝色光在照射该目标手指后返回的光信号,该第二光信号为该周围区域212内的发光显示像素发出的红色光在照射该目标手指后返回的光信号。基于深度学习算法,可以根据该第一光信号的分布图像和/或第二光信号的分布图像确定该待检测指纹图像是否为真手指的指纹图像。For example, take blue and red light as examples. Specifically, the distribution image of the first light signal and the distribution image of the second light signal in the surrounding part are determined, and the first light signal is that the blue light emitted by the light-emitting display pixel in the surrounding area 212 illuminates the target finger. The light signal returned later, the second light signal is the light signal returned by the red light emitted by the light-emitting display pixel in the surrounding area 212 after irradiating the target finger. Based on the deep learning algorithm, it can be determined whether the fingerprint image to be detected is a fingerprint image of a real finger according to the distribution image of the first light signal and/or the distribution image of the second light signal.
例如,可以基于该周围区域212内的发光显示像素发出的蓝色光在照射该目标手指后返回的蓝光信号,确定出对应的蓝光强度分布图像;再基于深度学习算法,将获取的待检测指纹图像中的蓝光强度分布图像进行分析,进而确定该待检测指纹图像是否为真手指的指纹图像。For example, the corresponding blue light intensity distribution image can be determined based on the blue light signal returned by the blue light emitted by the light-emitting display pixels in the surrounding area 212 after irradiating the target finger; and then based on the deep learning algorithm, the acquired fingerprint image to be detected The blue light intensity distribution image in the image is analyzed to determine whether the fingerprint image to be detected is a fingerprint image of a real finger.
再例如,还可以基于该周围区域212内的发光显示像素发出的红光在照射该目标手指后返回的红光信号,确定出对应的红光强度分布图像;再基于深度学习算法,将获取的待检测指纹图像中的红光强度分布图像进行分析,进而确定该待检测指纹图像是否为真手指的指纹图像。For another example, the corresponding red light intensity distribution image can also be determined based on the red light signal returned by the red light emitted by the light-emitting display pixels in the surrounding area 212 after irradiating the target finger; and then based on the deep learning algorithm, the acquired The red light intensity distribution image in the fingerprint image to be detected is analyzed to determine whether the fingerprint image to be detected is a fingerprint image of a real finger.
再例如,还可以基于深度学习算法,根据该第一光信号的分布图像和该第二光信号的分布图像的差值,确定该待检测指纹图像是否为真手指的指纹 图像。具体地,基于该周围区域212内的发光显示像素发出的蓝色光在照射该目标手指后返回的蓝光信号,确定出对应的蓝光强度分布图像;基于该周围区域212内的发光显示像素发出的红光在照射该目标手指后返回的红光信号,确定出对应的红光强度分布图像;获取蓝光强度分布图像与红光强度分布图像的差值图像;再基于深度学习算法,分析该差值,进而确定该待检测指纹图像是否为真手指的指纹图像。For another example, a deep learning algorithm may also be used to determine whether the fingerprint image to be detected is a fingerprint image of a real finger based on the difference between the distribution image of the first optical signal and the distribution image of the second optical signal. Specifically, based on the blue light signal returned by the blue light emitted by the light-emitting display pixels in the surrounding area 212 after irradiating the target finger, the corresponding blue light intensity distribution image is determined; based on the red light emitted by the light-emitting display pixels in the surrounding area 212 The red light signal returned after the light irradiates the target finger determines the corresponding red light intensity distribution image; obtains the difference image between the blue light intensity distribution image and the red light intensity distribution image; then analyzes the difference based on the deep learning algorithm, Then it is determined whether the fingerprint image to be detected is a fingerprint image of a real finger.
可选地,如图3所示,该指纹识别装置300还可以包括:滤光片330,设置于该光学传感器320上方,用于滤除返回光信号中的红外光信号,以便于滤除诸如环境光等红外光信号的影响。Optionally, as shown in FIG. 3, the fingerprint identification device 300 may further include: a filter 330, which is disposed above the optical sensor 320, and is used to filter out the infrared light signal in the return light signal, so as to filter out such as Influence of infrared light signals such as ambient light.
另外,该滤光片还可以用于滤除部分红光。具体地,以指纹检测区域210的周围区域212包括的多组子区域中第三组子区域为例,该第三组子区域可以为任意一组子区域,该第三组子区域内的发光显示像素用于发出红光;该滤光片330可以用于滤除该红光照射该手指后返回的光信号,其中,该滤光片330可以滤除该红光照射该手指后返回的光信号中的全部或者部分。对应的,在上述待检测指纹图像中的红色光信号即为经过滤光片330之后的红色光信号。In addition, the filter can also be used to filter out part of the red light. Specifically, taking the third group of sub-areas in the plurality of groups of sub-areas included in the surrounding area 212 of the fingerprint detection area 210 as an example, the third group of sub-areas may be any group of sub-areas, and the light emission in the third group of sub-areas The display pixels are used to emit red light; the filter 330 can be used to filter the light signal returned after the red light irradiates the finger, and the filter 330 can filter the light returned after the red light irradiates the finger All or part of the signal. Correspondingly, the red light signal in the fingerprint image to be detected is the red light signal after passing through the filter 330.
应理解,根据上述描述,基于深度学习算法,可以分析待检测指纹图像的周围部分的一个或者多个信息,进而确定待检测指纹图像是否为真手指的指纹图像;对应的,在该深度学习算法建模阶段,可需要采集不同的信息。It should be understood that according to the above description, based on the deep learning algorithm, one or more pieces of information about the surrounding part of the fingerprint image to be detected can be analyzed to determine whether the fingerprint image to be detected is a fingerprint image of a real finger; correspondingly, in the deep learning algorithm In the modeling phase, different information may need to be collected.
具体地,该深度学习算法的建模过程可以包括:获取若干样本数据,该若干样本数据包括若干真手指数据以及若干假手指数据。其中,该若干真手指数据包括若干个真手指触摸在该指纹检测区域210时获取的指纹图像中与该周围区域212对应的周围部分;该若干假手指数据包括若干个假手指触摸在该指纹检测区域210时获取的指纹图像中与该周围区域212对应的周围部分。该若干个假手指可以包括各种类型的假手指,例如,可以包括:乳白色橡胶手指、透明橡胶假手指、黄色2D假手指、黑色橡胶手指以及肉色3D橡胶手指等等。Specifically, the modeling process of the deep learning algorithm may include: acquiring several sample data, the several sample data including several real finger data and several fake finger data. Wherein, the plurality of real finger data includes the surrounding parts corresponding to the surrounding area 212 in the fingerprint image obtained when a plurality of real fingers touch the fingerprint detection area 210; the plurality of fake finger data includes a plurality of fake fingers touched in the fingerprint detection area. The area 210 corresponds to the surrounding area 212 in the acquired fingerprint image. The plurality of fake fingers may include various types of fake fingers, for example, may include: milky white rubber fingers, transparent rubber fake fingers, yellow 2D fake fingers, black rubber fingers, flesh-colored 3D rubber fingers, and so on.
考虑到在使用该深度学习算法时,可以依据获取的指纹图像的周围部分的散射光分布情况、反射光分布情况以及不同颜色的光的分布情况等信息,因此,在获取该若干样本数据时,对应需要采集各个样本数据的不同信息。例如,可以采集各个样本数据对应的指纹图像中散射光分布情况、反射光分 布情况以及不同颜色的光的分布情况等,本申请实施例并不限于此。Considering that when the deep learning algorithm is used, it can be based on information such as the scattered light distribution, the reflected light distribution, and the distribution of different colors of light around the acquired fingerprint image. Therefore, when acquiring the several sample data, Corresponding to the different information that needs to be collected for each sample data. For example, the distribution of scattered light, the distribution of reflected light, and the distribution of light of different colors in the fingerprint image corresponding to each sample data can be collected, and the embodiment of the present application is not limited to this.
基于该若干样本数据进行训练,以获取真假手指的指纹图像的深度学习模型。若采集的假手指种类较多,该深度学习模型会更准确。按照该深度学习模型,若输入目标手指的待检测指纹图像中的该周围部分,则经过该深度学习模型的分析,对应可以输出该待检测指纹图像是否为真手指的指纹图像的结果。Training is performed based on the several sample data to obtain a deep learning model of fingerprint images of real and fake fingers. If there are many kinds of fake fingers collected, the deep learning model will be more accurate. According to the deep learning model, if the surrounding part of the fingerprint image to be detected of the target finger is input, after the analysis of the deep learning model, the result of whether the fingerprint image to be detected is a fingerprint image of a real finger can be output accordingly.
因此,本申请实施例的包括指纹识别装置的电子设备,在指纹检测区域的中心区域设置单色照射手指,在周围区域设置彩色图案照射手指,这种边沿图案可以是周期性方格,也可以是边沿有一定曲率图案,还可以是多条彩色线,使得获取的指纹图像既可以进行指纹识别,也可以进行指纹防伪认证,解决了现有屏下光学指纹识别装置不能防止各种形态的假指纹的问题,提高系统的安全级别,进而提升用户体验感。另外,利用本申请的打彩色图案的方法光学指纹模组比彩色滤波片的指纹模组成本低很多;而且,本申请实施例的光学传感器芯片加工周期更短,成本更低,良率更高。Therefore, in the electronic device including the fingerprint identification device of the embodiment of the present application, a monochrome illuminating finger is set in the center area of the fingerprint detection area, and a color pattern is set to illuminate the finger in the surrounding area. This edge pattern can be a periodic grid or The edge has a certain curvature pattern, or it can be multiple color lines, so that the acquired fingerprint image can be used for fingerprint recognition and fingerprint anti-counterfeiting authentication, which solves the problem that the existing under-screen optical fingerprint recognition device cannot prevent various forms of false The problem of fingerprints improves the security level of the system, thereby enhancing the user experience. In addition, the cost of the optical fingerprint module using the color patterning method of the present application is much lower than that of the color filter fingerprint module; moreover, the optical sensor chip of the embodiment of the present application has a shorter processing cycle, lower cost, and higher yield. .
例如,可以基于指纹表面直接反射的返回光和经过指纹内部散射的返回光,使用深度学习算法来区分出真假指纹的光谱。深度学习算法会利用真假指纹历史大数据提前训练,这个历史数据包含各种真假指纹,包含各种场景下的真假指纹。将原始指纹图像输出给防伪算法就可分辨出真假指纹。其中,可以将单幅图数据记录,经过去除屏结构的校准过程,对单幅图的边沿区域可以做特定的处理,例如将采集图像中蓝色区域的值减去红色区域的值获得新的图像,这样防伪模型获得的原始信息更多。这样比传统分布式彩色滤波片的获取的特征信息更多,识别效果更优。For example, based on the return light directly reflected on the fingerprint surface and the return light scattered inside the fingerprint, a deep learning algorithm can be used to distinguish the spectrum of true and false fingerprints. The deep learning algorithm will be trained in advance using the historical big data of true and false fingerprints. This historical data contains various true and false fingerprints, including true and false fingerprints in various scenarios. The original fingerprint image is output to the anti-counterfeiting algorithm to distinguish true and false fingerprints. Among them, the data of a single image can be recorded. After the calibration process of removing the screen structure, specific processing can be done on the edge area of the single image, such as subtracting the value of the red area from the value of the blue area in the collected image to obtain a new Image, so that the anti-counterfeiting model obtains more original information. In this way, more characteristic information can be obtained than traditional distributed color filters, and the recognition effect is better.
图11示出了根据本申请实施例的屏下指纹识别和防伪的方法400的示意性流程图。应理解,该方法400可以由具有显示屏的电子设备执行,例如,该电子设备可以为上述电子设备20,例如,该电子设备20可以包括处理器或者处理单元,以用于执行该方法400。FIG. 11 shows a schematic flowchart of a method 400 for off-screen fingerprint identification and anti-counterfeiting according to an embodiment of the present application. It should be understood that the method 400 may be executed by an electronic device with a display screen. For example, the electronic device may be the aforementioned electronic device 20. For example, the electronic device 20 may include a processor or a processing unit for executing the method 400.
如图11所示,该方法400包括:S410,获取目标手指的待检测指纹图像,该待检测指纹图像为触摸在显示屏的指纹检测区域的该目标手指的指纹图像,该指纹检测区域包括互不重叠的中心区域和周围区域,该中心区域位于该周围区域的中间,该中心区域内的发光显示像素发出单色光照射该目标手指,该周围区域内的发光显示像素发出多种颜色的光照射该目标手指; S420,根据该待检测指纹图像中与该中心区域对应的中心部分,对该目标手指进行指纹识别;S430,根据该待检测指纹图像中与该周围区域对应的周围部分,对该目标手指进行指纹防伪认证。As shown in FIG. 11, the method 400 includes: S410, acquiring a fingerprint image of a target finger to be detected, where the fingerprint image to be detected is the fingerprint image of the target finger touching the fingerprint detection area of the display screen, and the fingerprint detection area includes mutual Non-overlapping central area and surrounding area, the central area is located in the middle of the surrounding area, the light-emitting display pixels in the central area emit monochromatic light to illuminate the target finger, and the light-emitting display pixels in the surrounding area emit light of multiple colors Illuminate the target finger; S420, perform fingerprint recognition on the target finger according to the central part of the fingerprint image to be detected corresponding to the central area; S430, perform fingerprint recognition on the surrounding part corresponding to the surrounding area in the fingerprint image to be detected The target finger performs fingerprint anti-counterfeiting authentication.
可选地,作为一个实施例,该根据该待检测指纹图像中与该周围区域对应的周围部分,对该目标手指进行指纹防伪认证,包括:基于深度学习算法,根据该待检测指纹图像中的该周围部分,确定该待检测指纹图像是否为真手指的指纹图像。Optionally, as an embodiment, performing fingerprint anti-counterfeiting authentication on the target finger according to the surrounding part of the fingerprint image to be detected corresponding to the surrounding area includes: based on a deep learning algorithm, according to the fingerprint image in the fingerprint image to be detected The surrounding part determines whether the fingerprint image to be detected is a fingerprint image of a real finger.
可选地,作为一个实施例,该基于深度学习算法,根据该待检测指纹图像中的该周围部分,确定该待检测指纹图像是否为真手指的指纹图像,包括:基于深度学习算法,根据该周围部分中反射光信号的分布图像和/或散射光信号的分布图像,确定该待检测指纹图像是否为真手指的指纹图像,其中,该反射光信号为该周围区域内的发光显示像素发出的光在该目标手指的表面发生反射后返回的光信号,该散射光信号为该周围区域内的发光显示像素发出的光在该目标手指的内部发生散射后返回的光信号。Optionally, as an embodiment, the step of determining whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected based on a deep learning algorithm includes: The distribution image of the reflected light signal and/or the distribution image of the scattered light signal in the surrounding part to determine whether the fingerprint image to be detected is a fingerprint image of a real finger, where the reflected light signal is emitted by the light-emitting display pixels in the surrounding area The light signal returned after the light is reflected on the surface of the target finger, and the scattered light signal is the light signal returned after the light emitted by the light-emitting display pixels in the surrounding area is scattered inside the target finger.
可选地,作为一个实施例,该基于深度学习算法,根据该待检测指纹图像中的该周围部分,确定该待检测指纹图像是否为真手指的指纹图像,包括:基于深度学习算法,根据该周围部分中第一光信号的分布图像和/或第二光信号的分布图像,确定该待检测指纹图像是否为真手指的指纹图像,其中,该第一光信号和该第二光信号分别为该周围区域内的发光显示像素发出的多种颜色的光中任意两种颜色的光在照射该目标手指后返回的光信号。Optionally, as an embodiment, the step of determining whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected based on a deep learning algorithm includes: The distribution image of the first light signal and/or the distribution image of the second light signal in the surrounding part is used to determine whether the fingerprint image to be detected is a fingerprint image of a real finger, where the first light signal and the second light signal are respectively The light-emitting display pixels in the surrounding area display light signals of any two colors of the multiple colors of light emitted by the target finger after irradiating the target finger.
可选地,作为一个实施例,该基于深度学习算法,根据该周围部分中第一光信号的分布图像和/或第二光信号的分布图像,确定该待检测指纹图像是否为真手指的指纹图像,包括:确定该周围部分中该第一光信号的分布图像和该第二光信号的分布图像,该第一光信号为该周围区域内的发光显示像素发出的蓝色光在照射该目标手指后返回的光信号,该第二光信号为该周围区域内的发光显示像素发出的红色光在照射该目标手指后返回的光信号;基于深度学习算法,根据该第一光信号的分布图像和该第二光信号的分布图像的差值,确定该待检测指纹图像是否为真手指的指纹图像。Optionally, as an embodiment, the deep learning algorithm is used to determine whether the fingerprint image to be detected is the fingerprint of a real finger according to the distribution image of the first light signal and/or the distribution image of the second light signal in the surrounding part The image includes: determining the distribution image of the first light signal and the distribution image of the second light signal in the surrounding part, where the first light signal is that the blue light emitted by the light-emitting display pixel in the surrounding area illuminates the target finger The light signal returned later, the second light signal is the light signal returned by the red light emitted by the light-emitting display pixels in the surrounding area after irradiating the target finger; based on the deep learning algorithm, according to the distribution image and the first light signal The difference of the distribution image of the second light signal determines whether the fingerprint image to be detected is a fingerprint image of a real finger.
可选地,作为一个实施例,该基于深度学习算法,根据该待检测指纹图像中的该周围部分,确定该待检测指纹图像是否为真手指的指纹图像,包括:获取若干样本数据,该若干样本数据包括若干真手指数据以及若干假手指数 据,该若干真手指数据包括若干个真手指触摸在该指纹检测区域时获取的指纹图像中与该周围区域对应的周围部分,该若干假手指数据包括若干个假手指触摸在该指纹检测区域时获取的指纹图像中与该周围区域对应的周围部分;基于该若干样本数据进行训练,以获取真假手指的指纹图像的深度学习模型;按照该深度学习模型,根据该待检测指纹图像中的该周围部分,确定该待检测指纹图像是否为真手指的指纹图像。Optionally, as an embodiment, the determination of whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected based on a deep learning algorithm includes: acquiring a plurality of sample data, the plurality of The sample data includes several real finger data and several fake finger data. The several real finger data includes the surrounding parts of the fingerprint image obtained when the real finger touches the fingerprint detection area corresponding to the surrounding area, and the several fake finger data includes A number of fake fingers touch the surrounding part of the fingerprint image obtained when the fingerprint detection area is corresponding to the surrounding area; training based on the several sample data to obtain a deep learning model of fingerprint images of real and fake fingers; according to the deep learning The model determines whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected.
可选地,作为一个实施例,该深度学习算法包括以下至少一种:支持向量机、卷积神经网络、循环神经网络以及k均值聚类算法。Optionally, as an embodiment, the deep learning algorithm includes at least one of the following: a support vector machine, a convolutional neural network, a recurrent neural network, and a k-means clustering algorithm.
应理解,该方法400可以适用于各种具有屏下光学指纹识别装置的电子设备中,该指纹识别装置可以为包括周期性小孔阵列、微距广角镜头方案的屏下光学指纹识别装置、折叠式屏下光学指纹识别装置、微透镜阵列方案的屏下光学指纹识别装置,本申请实施例并不限于此。It should be understood that the method 400 can be applied to various electronic devices with an under-screen optical fingerprint identification device. The fingerprint identification device can be an under-screen optical fingerprint identification device including a periodic small hole array, a macro wide-angle lens solution, and a folding type. The under-screen optical fingerprint identification device and the under-screen optical fingerprint identification device of the microlens array solution are not limited to this embodiment of the present application.
因此,本申请实施例的屏下指纹识别和防伪的方法,适用于具有屏下指纹识别装置的电子设备中,该电子设备的显示屏包括指纹检测区域,在指纹检测区域的中心区域设置单色照射手指,在周围区域设置彩色图案照射手指,这种边沿图案可以是周期性方格,也可以是边沿有一定曲率图案,还可以是多条彩色线,使得获取的指纹图像既可以进行指纹识别,也可以进行指纹防伪认证,解决了现有屏下光学指纹识别装置不能防止各种形态的假指纹的问题,提高系统的安全级别,进而提升用户体验感。另外,利用本申请的打彩色图案的方法光学指纹模组比彩色滤波片的指纹模组成本低很多;而且,本申请实施例的光学传感器芯片加工周期更短,成本更低,良率更高。Therefore, the under-screen fingerprint identification and anti-counterfeiting method of the embodiment of the present application is suitable for electronic equipment with under-screen fingerprint identification devices. The display screen of the electronic equipment includes a fingerprint detection area, and a single color is set in the center area of the fingerprint detection area. Illuminate the finger and set a color pattern in the surrounding area to illuminate the finger. This edge pattern can be a periodic grid, or a pattern with a certain curvature on the edge, or multiple colored lines, so that the acquired fingerprint image can be fingerprinted. , Fingerprint anti-counterfeiting authentication can also be performed, which solves the problem that the existing under-screen optical fingerprint recognition device cannot prevent various forms of fake fingerprints, improves the security level of the system, and thereby enhances the user experience. In addition, the cost of the optical fingerprint module using the color patterning method of the present application is much lower than that of the color filter fingerprint module; moreover, the optical sensor chip of the embodiment of the present application has a shorter processing cycle, lower cost, and higher yield. .
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。A person of ordinary skill in the art may be aware that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that, for the convenience and conciseness of description, the specific working process of the above-described system, device, and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示 意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed system, device, and method may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。In addition, the functional units in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(read-only memory,ROM)、随机存取存储器(random access memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solution of this application essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (read-only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program code .
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。The above are only specific implementations of this application, but the protection scope of this application is not limited to this. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in this application. Should be covered within the scope of protection of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims (37)

  1. 一种指纹识别装置,其特征在于,设置于电子设备的显示屏下方,所述显示屏包括多个发光显示像素,所述显示屏包括指纹检测区域,所述指纹检测区域包括互不重叠的中心区域和周围区域,所述中心区域位于所述周围区域的中间,所述指纹识别装置包括:A fingerprint identification device, characterized in that it is arranged under a display screen of an electronic device, the display screen includes a plurality of light-emitting display pixels, the display screen includes a fingerprint detection area, and the fingerprint detection area includes a center that does not overlap each other Area and surrounding area, the central area is located in the middle of the surrounding area, and the fingerprint identification device includes:
    光路引导结构,用于将返回光信号引导至光学传感器,所述返回光信号为所述指纹检测区域内的发光显示像素发出的光照射手指后返回的光信号,其中,所述中心区域内的发光显示像素发出单色光照射所述手指,所述周围区域内的发光显示像素发出空间上间隔分布的多种颜色的光照射所述手指;The optical path guiding structure is used to guide the return light signal to the optical sensor, and the return light signal is the light signal returned after the light emitted by the light-emitting display pixel in the fingerprint detection area irradiates the finger, wherein the light signal in the center area The light-emitting display pixels emit monochromatic light to illuminate the finger, and the light-emitting display pixels in the surrounding area emit light of multiple colors distributed at intervals to illuminate the finger;
    光学传感器,位于所述光路引导结构的下方,用于接收经过所述光路引导结构的光信号,所述光信号用于获取所述手指的指纹图像,所述指纹图像中与所述中心区域对应的中心部分用于指纹识别,所述指纹图像中与所述周围区域对应的周围部分用于指纹防伪认证。The optical sensor is located below the light path guiding structure, and is used to receive light signals passing through the light path guiding structure. The light signals are used to obtain a fingerprint image of the finger, and the fingerprint image corresponds to the central area The central part of is used for fingerprint identification, and the surrounding part of the fingerprint image corresponding to the surrounding area is used for fingerprint anti-counterfeiting authentication.
  2. 根据权利要求1所述的指纹识别装置,其特征在于,所述周围区域内的发光显示像素发出的光与所述中心区域内的发光显示像素发出的单色光的颜色不同。The fingerprint identification device according to claim 1, wherein the light emitted by the light-emitting display pixels in the surrounding area and the monochromatic light emitted by the light-emitting display pixels in the central area have a different color.
  3. 根据权利要求1或2所述的指纹识别装置,其特征在于,所述指纹检测区域还包括位于所述周围区域的外围的补光区域,所述补光区域内的发光显示像素发出单色光照射所述手指。The fingerprint identification device according to claim 1 or 2, wherein the fingerprint detection area further comprises a supplemental light area located at the periphery of the surrounding area, and the light-emitting display pixels in the supplementary light area emit monochromatic light Irradiate the finger.
  4. 根据权利要求3所述的指纹识别装置,其特征在于,所述补光区域内的发光显示像素发出的单色光与所述中心区域内的发光显示像素发出的单色光的颜色相同。The fingerprint identification device according to claim 3, wherein the color of the monochromatic light emitted by the light-emitting display pixels in the supplemental light area is the same as the color of the monochromatic light emitted by the light-emitting display pixels in the central area.
  5. 根据权利要求1至4中任一项所述的指纹识别装置,其特征在于,所述中心区域的面积大于所述周围区域的面积。The fingerprint identification device according to any one of claims 1 to 4, wherein the area of the central area is larger than the area of the surrounding area.
  6. 根据权利要求5所述的指纹识别装置,其特征在于,所述中心区域为面积大于或者等于16mm 2的单连通区域。 The fingerprint identification device of claim 5, wherein the central area is a single connected area with an area greater than or equal to 16 mm 2 .
  7. 根据权利要求5或6所述的指纹识别装置,其特征在于,所述中心区域为矩形或者圆形。The fingerprint identification device according to claim 5 or 6, wherein the central area is rectangular or circular.
  8. 根据权利要求1至7中任一项所述的指纹识别装置,其特征在于,所述周围区域包括多组子区域,所述多组子区域中同一组子区域内的发光显示像素发出相同颜色的光照射所述手指,所述多组子区域中不同组子区域内 的发光显示像素发出不同颜色的光照射所述手指。The fingerprint identification device according to any one of claims 1 to 7, wherein the surrounding area includes multiple groups of sub-areas, and light-emitting display pixels in the same group of sub-areas in the multiple groups of sub-areas emit the same color The light illuminates the finger, and the light-emitting display pixels in different groups of sub-areas in the multiple groups of sub-areas emit light of different colors to illuminate the finger.
  9. 根据权利要求8所述的指纹识别装置,其特征在于,所述多组子区域中不同组的子区域之间间隔排列。8. The fingerprint identification device according to claim 8, wherein the sub-areas of different groups in the plurality of sub-areas are arranged at intervals.
  10. 根据权利要求8或9所述的指纹识别装置,其特征在于,所述多组子区域中同一组子区域内的多个子区域的面积和/或形状相同。The fingerprint identification device according to claim 8 or 9, wherein the areas and/or shapes of the multiple sub-regions in the same group of the multiple sub-regions are the same.
  11. 根据权利要求8至10中任一项所述的指纹识别装置,其特征在于,所述多组子区域中每个子区域的宽度为0.2mm-3mm。The fingerprint identification device according to any one of claims 8 to 10, wherein the width of each sub-area in the plurality of groups of sub-areas is 0.2mm-3mm.
  12. 根据权利要求8至11中任一项所述的指纹识别装置,其特征在于,所述多组子区域为两组子区域或者三组子区域。The fingerprint identification device according to any one of claims 8 to 11, wherein the multiple groups of sub-areas are two groups of sub-areas or three groups of sub-areas.
  13. 根据权利要求12所述的指纹识别装置,其特征在于,所述两组子区域包括第一组子区域和第二组子区域,所述第一组子区域内的子区域的面积和形状相同,与所述第二组子区域内的子区域的面积和形状相同。The fingerprint identification device according to claim 12, wherein the two groups of sub-areas include a first group of sub-areas and a second group of sub-areas, and the sub-areas in the first group of sub-areas have the same area and shape , The area and shape of the sub-regions in the second group of sub-regions are the same.
  14. 根据权利要求13所述的指纹识别装置,其特征在于,所述第一组子区域中的子区域的形状与所述第二组子区域中的子区域的形状相同。The fingerprint identification device according to claim 13, wherein the shape of the sub-areas in the first group of sub-areas is the same as the shape of the sub-areas in the second group of sub-areas.
  15. 根据权利要求14所述的指纹识别装置,其特征在于,所述第一组子区域与所述第二组子区域中的子区域的形状均为方形、圆形或者半圆形。The fingerprint identification device according to claim 14, wherein the shapes of the sub-areas in the first group of sub-areas and the second group of sub-areas are square, circular or semicircular.
  16. 根据权利要求13所述的指纹识别装置,其特征在于,所述第一组子区域中的子区域的形状与所述第二组子区域中的子区域的形状不相同。The fingerprint identification device according to claim 13, wherein the shape of the sub-areas in the first group of sub-areas is different from the shape of the sub-areas in the second group of sub-areas.
  17. 根据权利要求16所述的指纹识别装置,其特征在于,所述第一组子区域中的子区域的形状为方形,所述第二组子区域中的子区域的形状为圆形。The fingerprint identification device according to claim 16, wherein the shape of the sub-areas in the first group of sub-areas is a square, and the shape of the sub-areas in the second group of sub-areas is a circle.
  18. 根据权利要求8至17中任一项所述的指纹识别装置,其特征在于,所述指纹识别装置还包括:The fingerprint identification device according to any one of claims 8 to 17, wherein the fingerprint identification device further comprises:
    滤光片,设置于所述光学传感器上方,用于滤除所述返回光信号中的红外光信号。The filter is arranged above the optical sensor and used to filter the infrared light signal in the return light signal.
  19. 根据权利要求18所述的指纹识别装置,其特征在于,所述多组子区域包括第三组子区域,所述第三组子区域内的发光显示像素用于发出红光;The fingerprint identification device according to claim 18, wherein the multiple groups of sub-areas comprise a third group of sub-areas, and light-emitting display pixels in the third group of sub-areas are used to emit red light;
    所述滤光片用于滤除所述红光照射所述手指后返回的光信号。The filter is used to filter the light signal returned after the red light irradiates the finger.
  20. 根据权利要求1至19中任一项所述的指纹识别装置,其特征在于,所述光路引导结构包括光学透镜;或者,The fingerprint identification device according to any one of claims 1 to 19, wherein the optical path guiding structure comprises an optical lens; or,
    所述光路引导结构包括具有多个准直单元或者微孔阵列的光学准直器,所述光学准直器用于将所述返回光信号通过所述多个准直单元或者微孔阵列分别传输到所述光学传感器的所述感应阵列中对应的光学感应单元;或者,The optical path guiding structure includes an optical collimator having a plurality of collimating units or microhole arrays, and the optical collimator is used to transmit the return light signals to the plurality of collimating units or microhole arrays respectively. The corresponding optical sensing unit in the sensing array of the optical sensor; or,
    所述光路引导结构包括具有多个微透镜的微透镜阵列和具有多个微孔的挡光层,所述微透镜阵列用于将所述返回光信号通过所述多个微透镜分别聚焦到所述挡光层对应的微孔,并通过所述微孔传输到所述光学传感器的所述感应阵列中对应的光学感应单元。The optical path guiding structure includes a microlens array with a plurality of microlenses and a light blocking layer with a plurality of microholes, and the microlens array is used to focus the return light signal to the respective microlenses through the plurality of microlenses. The micro-holes corresponding to the light blocking layer are transmitted to the corresponding optical sensing units in the sensing array of the optical sensor through the micro-holes.
  21. 根据权利要求1至20中任一项所述的指纹识别装置,其特征在于,所述中心区域内的发光显示像素发出的单色光为绿光或青光,所述周围区域内的发光显示像素发出多种颜色的光包括红光、蓝光、黄光和黑光中的至少两个。The fingerprint identification device according to any one of claims 1 to 20, wherein the monochromatic light emitted by the light-emitting display pixels in the central area is green light or cyan light, and the light-emitting display in the surrounding area The pixels emit light of multiple colors including at least two of red light, blue light, yellow light and black light.
  22. 根据权利要求1至21中任一项所述的指纹识别装置,其特征在于,所述指纹图像中的所述周围部分用于基于深度学习算法,确定所述待检测指纹图像是否为真手指的指纹图像。The fingerprint identification device according to any one of claims 1 to 21, wherein the surrounding part of the fingerprint image is used to determine whether the fingerprint image to be detected is of a real finger based on a deep learning algorithm Fingerprint image.
  23. 根据权利要求22所述的指纹识别装置,其特征在于,所述深度学习算法包括以下至少一种:支持向量机、卷积神经网络、循环神经网络以及k均值聚类算法。The fingerprint identification device of claim 22, wherein the deep learning algorithm comprises at least one of the following: a support vector machine, a convolutional neural network, a recurrent neural network, and a k-means clustering algorithm.
  24. 一种电子设备,其特征在于,包括:如权利要求1至23中任一项所述的指纹识别装置、显示屏以及处理器,An electronic device, characterized by comprising: the fingerprint identification device according to any one of claims 1 to 23, a display screen and a processor,
    所述显示屏包括多个发光显示像素,所述发光显示像素用于显示图像,显示屏包括指纹检测区域,所述指纹检测区域包括互不重叠的中心区域和周围区域,所述中心区域位于所述周围区域的中间,所述中心区域内的发光显示像素发出单色光照射所述手指,所述周围区域内的发光显示像素发出空间上间隔分布的多种颜色的光照射所述手指;The display screen includes a plurality of light-emitting display pixels, the light-emitting display pixels are used to display images, the display screen includes a fingerprint detection area, the fingerprint detection area includes a central area and a surrounding area that do not overlap each other, and the central area is located In the middle of the surrounding area, the light-emitting display pixels in the central area emit monochromatic light to illuminate the finger, and the light-emitting display pixels in the surrounding area emit light of multiple colors distributed at intervals to illuminate the finger;
    所述处理器用于根据所述指纹识别装置中的光学传感器接收的光信号,生成指纹图像,并根据所述指纹图像中与所述中心区域对应的中心部分,对所述手指进行指纹识别,以及根据所述指纹图像中与所述周围区域对应的周围部分,对所述手指进行指纹防伪认证。The processor is configured to generate a fingerprint image according to the light signal received by the optical sensor in the fingerprint recognition device, and perform fingerprint recognition on the finger according to the central part of the fingerprint image corresponding to the central area, and Perform fingerprint anti-counterfeiting authentication on the finger according to the surrounding part corresponding to the surrounding area in the fingerprint image.
  25. 根据权利要求24所述的电子设备,其特征在于,所述处理器还用于:The electronic device according to claim 24, wherein the processor is further configured to:
    基于深度学习算法,根据所述待检测指纹图像中的所述周围部分,确定所述待检测指纹图像是否为真手指的指纹图像。Based on a deep learning algorithm, it is determined whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected.
  26. 根据权利要求25所述的电子设备,其特征在于,所述处理器还用于:The electronic device according to claim 25, wherein the processor is further configured to:
    基于深度学习算法,根据所述周围部分中反射光信号的分布图像和/或散射光信号的分布图像,确定所述待检测指纹图像是否为真手指的指纹图像,其中,所述反射光信号为所述周围区域内的发光显示像素发出的光在所述目标手指的表面发生反射后返回的光信号,所述散射光信号为所述周围区域内的发光显示像素发出的光在所述目标手指的内部发生散射后返回的光信号。Based on the deep learning algorithm, determine whether the fingerprint image to be detected is a fingerprint image of a real finger according to the distribution image of the reflected light signal and/or the distribution image of the scattered light signal in the surrounding part, wherein the reflected light signal is The light emitted by the light-emitting display pixels in the surrounding area is reflected on the surface of the target finger, and the scattered light signal is the light emitted by the light-emitting display pixels in the surrounding area on the target finger. The light signal returned after being scattered inside.
  27. 根据权利要求25所述的电子设备,其特征在于,所述处理器还用于:The electronic device according to claim 25, wherein the processor is further configured to:
    基于深度学习算法,根据所述周围部分中第一光信号的分布图像和/或第二光信号的分布图像,确定所述待检测指纹图像是否为真手指的指纹图像,其中,所述第一光信号和所述第二光信号分别为所述周围区域内的发光显示像素发出的多种颜色的光中任意两种颜色的光在照射所述目标手指后返回的光信号。Based on the deep learning algorithm, according to the distribution image of the first light signal and/or the distribution image of the second light signal in the surrounding part, it is determined whether the fingerprint image to be detected is a fingerprint image of a real finger, wherein the first The optical signal and the second optical signal are respectively the optical signals returned by any two colors of light of the multiple colors emitted by the light-emitting display pixels in the surrounding area after irradiating the target finger.
  28. 根据权利要求27所述的电子设备,其特征在于,所述处理器还用于:The electronic device according to claim 27, wherein the processor is further configured to:
    确定所述周围部分中所述第一光信号的分布图像和所述第二光信号的分布图像,所述第一光信号为所述周围区域内的发光显示像素发出的蓝色光在照射所述目标手指后返回的光信号,所述第二光信号为所述周围区域内的发光显示像素发出的红色光在照射所述目标手指后返回的光信号;Determine the distribution image of the first light signal and the distribution image of the second light signal in the surrounding part, where the first light signal is that the blue light emitted by the light-emitting display pixels in the surrounding area illuminates the A light signal returned after the target finger, where the second light signal is a light signal returned by the red light emitted by the light-emitting display pixels in the surrounding area after irradiating the target finger;
    基于深度学习算法,根据所述第一光信号的分布图像和所述第二光信号的分布图像的差值,确定所述待检测指纹图像是否为真手指的指纹图像。Based on a deep learning algorithm, it is determined whether the fingerprint image to be detected is a fingerprint image of a real finger according to the difference between the distribution image of the first optical signal and the distribution image of the second optical signal.
  29. 根据权利要求25至28中任一项所述的电子设备,其特征在于,所述处理器还用于:The electronic device according to any one of claims 25 to 28, wherein the processor is further configured to:
    获取若干样本数据,所述若干样本数据包括若干真手指数据以及若干假手指数据,所述若干真手指数据包括若干个真手指触摸在所述指纹检测区域时获取的指纹图像中与所述周围区域对应的周围部分,所述若干假手指数据包括若干个假手指触摸在所述指纹检测区域时获取的指纹图像中与所述周围区域对应的周围部分;Acquire several sample data, the several sample data including several real finger data and several fake finger data, the several real finger data including several real finger touching the fingerprint image obtained when the fingerprint detection area and the surrounding area Corresponding surrounding parts, the plurality of fake finger data includes surrounding parts corresponding to the surrounding area in the fingerprint image obtained when the plurality of fake fingers touch the fingerprint detection area;
    基于所述若干样本数据进行训练,以获取真假手指的指纹图像的深度学习模型;Training based on the several sample data to obtain a deep learning model of fingerprint images of real and fake fingers;
    按照所述深度学习模型,根据所述待检测指纹图像中的所述周围部分,确定所述待检测指纹图像是否为真手指的指纹图像。According to the deep learning model, it is determined whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected.
  30. 根据权利要求25至29中任一项所述的电子设备,其特征在于,所述深度学习算法包括以下至少一种:支持向量机、卷积神经网络、循环神经网络以及k均值聚类算法。The electronic device according to any one of claims 25 to 29, wherein the deep learning algorithm comprises at least one of the following: a support vector machine, a convolutional neural network, a recurrent neural network, and a k-means clustering algorithm.
  31. 一种屏下指纹识别和防伪的方法,其特征在于,包括:An under-screen fingerprint recognition and anti-counterfeiting method, characterized in that it comprises:
    获取目标手指的待检测指纹图像,所述待检测指纹图像为触摸在显示屏的指纹检测区域的所述目标手指的指纹图像,所述指纹检测区域包括互不重叠的中心区域和周围区域,所述中心区域位于所述周围区域的中间,所述中心区域内的发光显示像素发出单色光照射所述目标手指,所述周围区域内的发光显示像素发出多种颜色的光照射所述目标手指;Obtain the fingerprint image to be detected of the target finger, the fingerprint image to be detected is the fingerprint image of the target finger touching the fingerprint detection area of the display screen, and the fingerprint detection area includes a central area and a surrounding area that do not overlap each other, so The central area is located in the middle of the surrounding area, the light emitting display pixels in the central area emit monochromatic light to illuminate the target finger, and the light emitting display pixels in the surrounding area emit light of multiple colors to illuminate the target finger ;
    根据所述待检测指纹图像中与所述中心区域对应的中心部分,对所述目标手指进行指纹识别;Performing fingerprint recognition on the target finger according to the central part corresponding to the central area in the fingerprint image to be detected;
    根据所述待检测指纹图像中与所述周围区域对应的周围部分,对所述目标手指进行指纹防伪认证。Perform fingerprint anti-counterfeiting authentication on the target finger according to the surrounding part corresponding to the surrounding area in the fingerprint image to be detected.
  32. 根据权利要求31所述的方法,其特征在于,所述根据所述待检测指纹图像中与所述周围区域对应的周围部分,对所述目标手指进行指纹防伪认证,包括:The method according to claim 31, wherein said performing fingerprint anti-counterfeiting authentication on said target finger according to the surrounding part corresponding to said surrounding area in said fingerprint image to be detected comprises:
    基于深度学习算法,根据所述待检测指纹图像中的所述周围部分,确定所述待检测指纹图像是否为真手指的指纹图像。Based on a deep learning algorithm, it is determined whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected.
  33. 根据权利要求32所述的方法,其特征在于,所述基于深度学习算法,根据所述待检测指纹图像中的所述周围部分,确定所述待检测指纹图像是否为真手指的指纹图像,包括:The method according to claim 32, wherein the determining whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected based on a deep learning algorithm comprises :
    基于深度学习算法,根据所述周围部分中反射光信号的分布图像和/或散射光信号的分布图像,确定所述待检测指纹图像是否为真手指的指纹图像,其中,所述反射光信号为所述周围区域内的发光显示像素发出的光在所述目标手指的表面发生反射后返回的光信号,所述散射光信号为所述周围区域内的发光显示像素发出的光在所述目标手指的内部发生散射后返回的光信号。Based on the deep learning algorithm, determine whether the fingerprint image to be detected is a fingerprint image of a real finger according to the distribution image of the reflected light signal and/or the distribution image of the scattered light signal in the surrounding part, wherein the reflected light signal is The light emitted by the light-emitting display pixels in the surrounding area is reflected on the surface of the target finger, and the scattered light signal is the light emitted by the light-emitting display pixels in the surrounding area on the target finger. The light signal returned after being scattered inside.
  34. 根据权利要求32所述的方法,其特征在于,所述基于深度学习算 法,根据所述待检测指纹图像中的所述周围部分,确定所述待检测指纹图像是否为真手指的指纹图像,包括:The method according to claim 32, wherein the determining whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected based on a deep learning algorithm comprises :
    基于深度学习算法,根据所述周围部分中第一光信号的分布图像和/或第二光信号的分布图像,确定所述待检测指纹图像是否为真手指的指纹图像,其中,所述第一光信号和所述第二光信号分别为所述周围区域内的发光显示像素发出的多种颜色的光中任意两种颜色的光在照射所述目标手指后返回的光信号。Based on the deep learning algorithm, according to the distribution image of the first light signal and/or the distribution image of the second light signal in the surrounding part, it is determined whether the fingerprint image to be detected is a fingerprint image of a real finger, wherein the first The optical signal and the second optical signal are respectively the optical signals returned by any two colors of light of the multiple colors emitted by the light-emitting display pixels in the surrounding area after irradiating the target finger.
  35. 根据权利要求34所述的方法,其特征在于,所述基于深度学习算法,根据所述周围部分中第一光信号的分布图像和/或第二光信号的分布图像,确定所述待检测指纹图像是否为真手指的指纹图像,包括:The method according to claim 34, characterized in that, based on the deep learning algorithm, the fingerprint to be detected is determined according to the distribution image of the first light signal and/or the distribution image of the second light signal in the surrounding part Whether the image is a fingerprint image of a real finger, including:
    确定所述周围部分中所述第一光信号的分布图像和所述第二光信号的分布图像,所述第一光信号为所述周围区域内的发光显示像素发出的蓝色光在照射所述目标手指后返回的光信号,所述第二光信号为所述周围区域内的发光显示像素发出的红色光在照射所述目标手指后返回的光信号;Determine the distribution image of the first light signal and the distribution image of the second light signal in the surrounding part, where the first light signal is that the blue light emitted by the light-emitting display pixels in the surrounding area illuminates the A light signal returned after the target finger, where the second light signal is a light signal returned by the red light emitted by the light-emitting display pixels in the surrounding area after irradiating the target finger;
    基于深度学习算法,根据所述第一光信号的分布图像和所述第二光信号的分布图像的差值,确定所述待检测指纹图像是否为真手指的指纹图像。Based on a deep learning algorithm, it is determined whether the fingerprint image to be detected is a fingerprint image of a real finger according to the difference between the distribution image of the first optical signal and the distribution image of the second optical signal.
  36. 根据权利要求32至35中任一项所述的方法,其特征在于,所述基于深度学习算法,根据所述待检测指纹图像中的所述周围部分,确定所述待检测指纹图像是否为真手指的指纹图像,包括:The method according to any one of claims 32 to 35, wherein the deep learning algorithm is used to determine whether the fingerprint image to be detected is true according to the surrounding part in the fingerprint image to be detected Finger fingerprint image, including:
    获取若干样本数据,所述若干样本数据包括若干真手指数据以及若干假手指数据,所述若干真手指数据包括若干个真手指触摸在所述指纹检测区域时获取的指纹图像中与所述周围区域对应的周围部分,所述若干假手指数据包括若干个假手指触摸在所述指纹检测区域时获取的指纹图像中与所述周围区域对应的周围部分;Acquire several sample data, the several sample data including several real finger data and several fake finger data, the several real finger data including several real finger touching the fingerprint image obtained when the fingerprint detection area and the surrounding area Corresponding surrounding parts, the plurality of fake finger data includes surrounding parts corresponding to the surrounding area in the fingerprint image obtained when the plurality of fake fingers touch the fingerprint detection area;
    基于所述若干样本数据进行训练,以获取真假手指的指纹图像的深度学习模型;Training based on the several sample data to obtain a deep learning model of fingerprint images of real and fake fingers;
    按照所述深度学习模型,根据所述待检测指纹图像中的所述周围部分,确定所述待检测指纹图像是否为真手指的指纹图像。According to the deep learning model, it is determined whether the fingerprint image to be detected is a fingerprint image of a real finger according to the surrounding part in the fingerprint image to be detected.
  37. 根据权利要求32至36中任一项所述的方法,其特征在于,所述深度学习算法包括以下至少一种:支持向量机、卷积神经网络、循环神经网络以及k均值聚类算法。The method according to any one of claims 32 to 36, wherein the deep learning algorithm comprises at least one of the following: a support vector machine, a convolutional neural network, a recurrent neural network, and a k-means clustering algorithm.
PCT/CN2019/098945 2019-08-01 2019-08-01 Fingerprint recognition and anti-counterfeiting method and apparatus, and electronic device WO2021017014A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201980001573.7A CN110582780A (en) 2019-08-01 2019-08-01 Fingerprint identification and anti-counterfeiting method and device and electronic equipment
PCT/CN2019/098945 WO2021017014A1 (en) 2019-08-01 2019-08-01 Fingerprint recognition and anti-counterfeiting method and apparatus, and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/098945 WO2021017014A1 (en) 2019-08-01 2019-08-01 Fingerprint recognition and anti-counterfeiting method and apparatus, and electronic device

Publications (1)

Publication Number Publication Date
WO2021017014A1 true WO2021017014A1 (en) 2021-02-04

Family

ID=68815623

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/098945 WO2021017014A1 (en) 2019-08-01 2019-08-01 Fingerprint recognition and anti-counterfeiting method and apparatus, and electronic device

Country Status (2)

Country Link
CN (1) CN110582780A (en)
WO (1) WO2021017014A1 (en)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021138776A1 (en) * 2020-01-06 2021-07-15 深圳市汇顶科技股份有限公司 Fingerprint anti-counterfeiting method, fingerprint identification device and electronic device
CN111242011B (en) * 2020-01-10 2023-06-02 上海箩箕技术有限公司 Display and input device
CN111209875B (en) * 2020-01-10 2023-05-12 上海箩箕技术有限公司 Display and input device
CN111259752B (en) * 2020-01-10 2023-05-12 上海箩箕技术有限公司 Display and input device
TWI793448B (en) * 2020-01-21 2023-02-21 神盾股份有限公司 Electronic device and operating method thereof
WO2021146976A1 (en) * 2020-01-22 2021-07-29 深圳市汇顶科技股份有限公司 Fingerprint detection apparatus and electronic device
WO2021168666A1 (en) * 2020-02-25 2021-09-02 深圳市汇顶科技股份有限公司 Fingerprint identification apparatus and electronic device
WO2021168672A1 (en) * 2020-02-25 2021-09-02 深圳市汇顶科技股份有限公司 Fingerprint recognition apparatus and electronic device
CN111788577B (en) * 2020-03-03 2024-04-30 深圳市汇顶科技股份有限公司 Fingerprint identification device, display screen and electronic equipment
CN111291719A (en) * 2020-03-03 2020-06-16 北京迈格威科技有限公司 Fingerprint identification device, display panel, equipment and fingerprint identification method
CN115298701A (en) * 2020-03-18 2022-11-04 上海思立微电子科技有限公司 Optical fingerprint identification device and fingerprint identification method under screen
CN111626100B (en) * 2020-03-26 2024-02-02 天津极豪科技有限公司 Under-screen fingerprint device and display module
WO2022183511A1 (en) * 2021-03-05 2022-09-09 深圳市汇顶科技股份有限公司 Fingerprint recognition apparatus and electronic device
CN112860120A (en) * 2021-03-09 2021-05-28 深圳市汇顶科技股份有限公司 Fingerprint identification device, electronic equipment and method for detecting ambient light
WO2022188041A1 (en) * 2021-03-09 2022-09-15 深圳市汇顶科技股份有限公司 Fingerprint identification apparatus, electronic device, and ambient light detection method
WO2022241792A1 (en) * 2021-05-21 2022-11-24 深圳市汇顶科技股份有限公司 Fingerprint recognition method and apparatus, and electronic device and storage medium
WO2023279700A1 (en) * 2021-07-07 2023-01-12 北京极豪科技有限公司 Biometric information recognition module and electronic device
US11620852B2 (en) * 2021-09-08 2023-04-04 Omnivision Technologies, Inc. Method for detecting spoof fingerprints with an under-display fingerprint sensor
US11798314B1 (en) 2022-06-21 2023-10-24 Novatek Microelectronics Corp. Fingerprint identification method and apparatus

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7920130B2 (en) * 2007-07-18 2011-04-05 Quanta Computer Inc. Electronic apparatus equipped with touch panel capable of identifying fingerprint
CN107820617A (en) * 2017-09-30 2018-03-20 深圳市汇顶科技股份有限公司 The method, apparatus and terminal device of fingerprint recognition
CN109716353A (en) * 2018-12-20 2019-05-03 深圳市汇顶科技股份有限公司 Fingerprint identification method, fingerprint identification device and electronic equipment
CN109934137A (en) * 2019-02-28 2019-06-25 维沃移动通信有限公司 A kind of photoelectricity fingerprint identification device, terminal and fingerprint identification method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7920130B2 (en) * 2007-07-18 2011-04-05 Quanta Computer Inc. Electronic apparatus equipped with touch panel capable of identifying fingerprint
CN107820617A (en) * 2017-09-30 2018-03-20 深圳市汇顶科技股份有限公司 The method, apparatus and terminal device of fingerprint recognition
CN109716353A (en) * 2018-12-20 2019-05-03 深圳市汇顶科技股份有限公司 Fingerprint identification method, fingerprint identification device and electronic equipment
CN109934137A (en) * 2019-02-28 2019-06-25 维沃移动通信有限公司 A kind of photoelectricity fingerprint identification device, terminal and fingerprint identification method

Also Published As

Publication number Publication date
CN110582780A (en) 2019-12-17

Similar Documents

Publication Publication Date Title
WO2021017014A1 (en) Fingerprint recognition and anti-counterfeiting method and apparatus, and electronic device
KR102430083B1 (en) Fingerprint identification devices and electronic devices
CN107820617B (en) Fingerprint identification method and device and terminal equipment
CN110062931B (en) Fingerprint identification device, fingerprint identification method and electronic equipment
KR20190069126A (en) 3-dimensional finger print device and electronic device comprising the same
CN111133446B (en) Fingerprint identification device and electronic equipment
CN109922722B (en) Heart rate detection method and device and electronic equipment
CN111801684A (en) Fingerprint detection device and electronic equipment
WO2021138776A1 (en) Fingerprint anti-counterfeiting method, fingerprint identification device and electronic device
EP3910536B1 (en) Fingerprint recognition apparatus and electronic device
CN211062054U (en) Biometric imaging arrangement and electronic device
CN110100250B (en) Fingerprint identification device and method and electronic equipment
CN211319244U (en) Fingerprint detection device and electronic equipment
CN210295114U (en) Optical fingerprint identification device and electronic equipment
CN110214328B (en) Fingerprint identification method and device and electronic equipment
CN111066027B (en) Image acquisition device and method and electronic equipment
US11741745B2 (en) Multicolor illumination in an optical fingerprint sensor for anti-spoofing
CN211529170U (en) Fingerprint identification device and electronic equipment
CN211554961U (en) Fingerprint identification device and electronic equipment
US11893100B2 (en) Spoof detection based on specular and diffuse reflections
US11900715B2 (en) Spoof detection based on specular and diffuse reflections
WO2022183511A1 (en) Fingerprint recognition apparatus and electronic device
CN115273157A (en) Fingerprint identification device and fingerprint detection method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19939254

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19939254

Country of ref document: EP

Kind code of ref document: A1