WO2020232696A1 - Calibration method and device for optical fingerprint identification and electronic equipment - Google Patents

Calibration method and device for optical fingerprint identification and electronic equipment Download PDF

Info

Publication number
WO2020232696A1
WO2020232696A1 PCT/CN2019/088128 CN2019088128W WO2020232696A1 WO 2020232696 A1 WO2020232696 A1 WO 2020232696A1 CN 2019088128 W CN2019088128 W CN 2019088128W WO 2020232696 A1 WO2020232696 A1 WO 2020232696A1
Authority
WO
WIPO (PCT)
Prior art keywords
specific pattern
screen
pattern
light
displayed
Prior art date
Application number
PCT/CN2019/088128
Other languages
French (fr)
Chinese (zh)
Inventor
程雷刚
邝文静
Original Assignee
深圳市汇顶科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市汇顶科技股份有限公司 filed Critical 深圳市汇顶科技股份有限公司
Priority to CN201980000780.0A priority Critical patent/CN112513871B/en
Priority to PCT/CN2019/088128 priority patent/WO2020232696A1/en
Publication of WO2020232696A1 publication Critical patent/WO2020232696A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition

Definitions

  • This application relates to the technical field of optical fingerprint recognition, and in particular to a calibration method, device and electronic equipment for optical fingerprint recognition.
  • the display screens in electronic devices are gradually developing towards full screens.
  • the pursuit of higher and higher screen-to-body ratios makes the front capacitive fingerprint nowhere to be placed and will gradually withdraw from the stage of history.
  • the under-screen optical fingerprint solution came into being, which places the optical fingerprint sensor (Sensor) on the back of the display area of the display, which does not occupy the area of the display area, which helps to increase the screen-to-body ratio.
  • the light with fingerprint information can penetrate the screen to reach Optical fingerprint Sensor surface imaging, combined with software algorithms, can realize fingerprint recognition function.
  • the light penetrating the screen with fingerprint information will inevitably be interfered by the uneven distribution of the internal layers of the screen.
  • interferences such as uneven light intensity of the light source and inconsistency of the sensor response. These interferences will affect the quality of the fingerprint image.
  • the above-mentioned interference is removed by the calibration algorithm.
  • most of the calibration algorithms provided in the related art can only be applied in specific scenarios, and cannot be applied to scenes with severe or rapid changes in light intensity.
  • some calibration algorithms are compatible with scenes with severe or rapid changes in light intensity , But also sacrificed the performance of other scenes.
  • the embodiments of the application provide a calibration method, device and electronic equipment for optical fingerprint recognition to accurately detect the intensity of the light displayed on the screen during the application process, which can be applied to scenes where the intensity of the screen is severe or rapidly changing, and has more Wide application scenarios, and can detect the relative displacement of the optical fingerprint sensor and the screen, which improves the fingerprint recognition performance in the scene where the relative position of the screen and the optical fingerprint sensor changes rapidly.
  • an embodiment of the present application provides a calibration method for optical fingerprint recognition, including:
  • the fingerprint image and the reference image are respectively collected by the optical fingerprint sensor, wherein the fingerprint image is an image containing the fingerprint of the medium, and the reference image Is an image containing the specific pattern; the intensity of the light displayed on the screen is detected according to the intensity information of the specific pattern in the reference image, and the position information of the specific pattern in the reference image is detected.
  • the relative displacement of the optical fingerprint sensor and the screen; the fingerprint image is calibrated according to the detected intensity of the light displayed on the screen and the relative displacement.
  • the calibration method further includes: controlling the screen to display the screen display light spot and the specific pattern according to the pressing area of the medium on the screen.
  • the screen display light spot and the specific pattern are displayed on the screen at the same time; wherein, the screen display light spot is displayed at the position of the pressing area, and the specific pattern is superimposed and displayed In the screen display spot; or, the specific pattern and the screen display spot are respectively displayed at different positions in the pressing area.
  • the specific pattern is superimposed and displayed in the screen display spot, and the specific pattern is a pattern composed of lines with a predetermined width, and the color of the specific pattern is the same as that displayed on the screen. Any color with different light spots.
  • the specific pattern and the screen display spot are respectively displayed at different positions in the pressing area, and the specific pattern is a pattern composed of lines with a predetermined width, and the specific pattern
  • the color of is any color different from the background color of the screen.
  • the screen display light spot and the specific pattern are displayed on the screen sequentially in a time-sharing manner.
  • the specific pattern is a pattern composed of lines with a predetermined width, and the color of the specific pattern is any color different from the background color of the screen.
  • the specific pattern is a pattern composed of lines with a predetermined width and a predetermined pattern, and the color of the specific pattern is any color different from the background color of the screen.
  • the intensity of the light displayed on the screen is detected according to the intensity information of the specific pattern in the reference image, and the position of the specific pattern in the reference image is detected.
  • the information detecting the relative displacement of the optical fingerprint sensor and the screen includes: detecting the intensity of the light displayed on the screen according to the intensity information of the line pattern of the predetermined width in the reference image, and according to the reference.
  • the position information of the predetermined graphic pattern in the image detects the relative displacement of the optical fingerprint sensor and the screen.
  • the colors of the predetermined graphics in different positions in the specific pattern are different; the method further includes: after the reference image is collected by an optical fingerprint sensor, the The reflectance of the light of different colors of the predetermined pattern is determined, and the color of the medium is determined to perform anti-counterfeiting detection on the medium.
  • the specific pattern is a pattern composed of lines of a predetermined width, or the specific pattern is a blank pattern, and the color of the specific pattern is any color different from the background color of the screen; Wherein, the specific pattern is first displayed on the screen, and then the specific pattern and the screen display spot are superimposed and displayed.
  • it further includes: after the specific pattern is displayed on the screen, collecting a frame of an image containing the specific pattern and ambient light by the optical fingerprint sensor; After the specific pattern and the screen display the light spot, a frame of image containing the fingerprint of the medium and the ambient light is collected by the optical fingerprint sensor; and the image containing the fingerprint and ambient light of the medium is combined with the image containing the specific pattern and The image of ambient light is subtracted to eliminate the influence of ambient light on fingerprint recognition.
  • an embodiment of the present application provides a calibration device for optical fingerprint recognition, including: a collection module, configured to display the screen display light spot and a specific pattern on the display module when the screen is respectively displayed according to the pressing area of the medium. After the light spot is displayed on the screen, a fingerprint image and a reference image are respectively collected by an optical fingerprint sensor, where the fingerprint image is an image of a fingerprint containing the medium; and after the display module displays the specific pattern, the optical fingerprint sensor
  • the collection of the reference image is an image containing the specific pattern;
  • a detection module is configured to perform a measurement on the screen according to the intensity information of the specific pattern in the image containing the specific pattern in the reference image collected by the collection module Detecting the intensity of the displayed light, and detecting the relative displacement of the optical fingerprint sensor and the screen according to the position information of the specific pattern in the reference image containing the specific pattern collected by the acquisition module; a calibration module, It is used to calibrate the fingerprint image including the fingerprint of the medium according to the intensity of the light displayed on the screen and the
  • the device further includes a display control module, specifically configured to control the screen to display the screen display spot and the specific pattern according to the pressing area of the medium on the screen.
  • the screen display light spot and the specific pattern are displayed on the screen at the same time; wherein, the screen display light spot is displayed at the position of the pressing area, and the specific pattern is superimposed and displayed In the screen display spot; or, the specific pattern and the screen display spot are respectively displayed at different positions in the pressing area.
  • the specific pattern is superimposed and displayed in the screen display spot, and the specific pattern is a pattern composed of lines with a predetermined width, and the color of the specific pattern is the same as that displayed on the screen. Any color with different light spots.
  • the specific pattern and the screen display spot are respectively displayed at different positions in the pressing area, and the specific pattern is a pattern composed of lines with a predetermined width, and the specific pattern
  • the color of is any color different from the background color of the screen.
  • the screen display light spot and the specific pattern are displayed on the screen sequentially in a time-sharing manner.
  • the specific pattern is a pattern composed of lines with a predetermined width, and the color of the specific pattern is any color different from the background color of the screen.
  • the specific pattern is a pattern composed of lines with a predetermined width and a predetermined figure, and the color of the specific pattern is any color different from the background color of the screen.
  • the detection module is specifically configured to detect the intensity of the light displayed on the screen according to the intensity information of the line pattern of the predetermined width in the reference image, and according to the With reference to the position information of the predetermined graphic pattern in the image, the relative displacement of the optical fingerprint sensor and the screen is detected.
  • the colors of predetermined graphics in different positions in the specific pattern are different; the detection module is also used to collect the specific pattern containing the specific pattern through the optical fingerprint sensor in the collection module. After referring to the image, the color of the medium is determined according to the reflectance of the medium to the light of different colors of the predetermined pattern, so as to perform anti-counterfeiting detection on the medium.
  • the specific pattern is a pattern composed of lines of a predetermined width, or the specific pattern is a blank pattern, and the color of the specific pattern is any color different from the background color of the screen;
  • the display control module is specifically configured to control the specific pattern to be displayed on the screen first, and then superimpose and display the specific pattern and the screen display spot.
  • the collection module is further configured to collect a frame of an image containing the specific pattern and ambient light through the optical fingerprint sensor after the display control module controls to display the specific pattern After the display control module superimposes the display of the specific pattern and the screen display spot, the optical fingerprint sensor collects a frame of images containing the fingerprint of the medium and the ambient light; the calibration module is also used to The image containing the fingerprint of the medium and the ambient light is subtracted from the image containing the specific pattern and the ambient light, so as to eliminate the influence of the ambient light on fingerprint recognition.
  • an embodiment of the present application provides an electronic device including a memory, a processor, and a computer program stored on the memory and capable of running on the processor.
  • the processor executes the computer program, Implement the method described above.
  • an embodiment of the present application provides a non-transitory computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the method described above is implemented.
  • the fingerprint image and the reference image are respectively collected by the optical fingerprint sensor, wherein the fingerprint image is an image containing the fingerprint of the medium
  • the reference image is an image containing the specific pattern.
  • the intensity of the light displayed on the screen is detected according to the intensity information of the specific pattern in the reference image, and the optical fingerprint sensor and the screen are detected according to the position information of the specific pattern in the reference image.
  • the relative displacement is calibrated according to the detected intensity of the light displayed on the screen and the relative displacement, so that the intensity of the light displayed on the screen can be accurately detected during the application process, which can be applied to screen light. Strong, violent or fast-changing scenes have broader application scenarios, and can detect the relative displacement between the optical fingerprint sensor and the screen, which improves the fingerprint recognition performance in the scene where the relative position of the screen and the optical fingerprint sensor changes rapidly.
  • FIG. 1 is a schematic diagram of the implementation scheme of optical fingerprint based on AMOLED hard screen of this application;
  • FIG. 2 is a schematic diagram of an embodiment of a light spot displayed on the screen in the calibration method of optical fingerprint recognition according to the present application;
  • 3 is a schematic diagram of light leakage and medium light under the light spot displayed on the screen in the calibration method for optical fingerprint recognition according to the application;
  • FIG. 4 is a flowchart of an embodiment of a calibration method for optical fingerprint recognition according to this application.
  • FIG. 5 is a flowchart of another embodiment of a calibration method for optical fingerprint recognition according to this application.
  • FIG. 6 is a schematic diagram of a screen with a specific pattern in the calibration method for optical fingerprint recognition according to this application;
  • FIG. 7 is a schematic diagram of light leakage and medium light when a specific pattern is superimposed and displayed in a screen display spot in the calibration method of optical fingerprint recognition according to the application;
  • FIG. 8(a) is a schematic diagram of an embodiment of light leakage received by the optical fingerprint sensor in the calibration method for optical fingerprint recognition of this application;
  • FIG. 8(b) is a schematic diagram of an embodiment of the medium light received by the optical fingerprint Sensor in the calibration method for optical fingerprint recognition of this application;
  • FIG. 9 is a schematic diagram of an embodiment of a specific pattern in the calibration method for optical fingerprint recognition of this application.
  • FIG. 10 is a schematic diagram of light leakage and medium light when the screen displays a specific pattern in the calibration method of optical fingerprint recognition according to the present application;
  • FIG. 11(a) is a schematic diagram of another embodiment of the light leakage received by the optical fingerprint Sensor in the calibration method of optical fingerprint recognition in this application;
  • FIG. 11(b) is a schematic diagram of another embodiment of the medium light received by the optical fingerprint Sensor in the calibration method of optical fingerprint recognition in this application;
  • FIG. 12 is a schematic diagram of another embodiment of a specific pattern in the calibration method of optical fingerprint recognition according to this application.
  • FIG. 13 is a schematic diagram of ambient light in the calibration method of optical fingerprint recognition according to this application.
  • FIG. 14 is a schematic diagram of an embodiment of using a specific pattern to eliminate ambient light interference in the calibration method for optical fingerprint recognition of this application;
  • 15 is a schematic diagram of another embodiment of using a specific pattern to eliminate ambient light interference in the calibration method of optical fingerprint recognition according to this application;
  • 16 is a schematic structural diagram of an embodiment of a calibration device for optical fingerprint recognition in this application.
  • FIG. 17 is a schematic structural diagram of an embodiment of an electronic device of this application.
  • the embodiment of this application proposes a calibration method for optical fingerprint recognition, which can rely on a small amount of prior information to accurately detect changes in the intensity of the light displayed on the screen during the application process, which can be applied to situations where the light intensity of the screen changes drastically or rapidly. Scenarios, with broader application scenarios.
  • the above-mentioned optical fingerprint recognition calibration method can also detect the relative displacement of the optical fingerprint sensor and the screen on the XY axis, which improves the fingerprint recognition performance in a scene where the relative position of the screen and the optical fingerprint sensor changes rapidly.
  • some of the embodiments in this application have the functions of anti-counterfeiting and anti-interference from ambient light.
  • FIG 1 is a schematic diagram of an application based on an Active Matrix Organic Light Emitting Diode (Active Matrix Organic Light Emitting Diode; hereinafter abbreviated as: AMOLED) optical fingerprint implementation solution.
  • AMOLED Active Matrix Organic Light Emitting Diode
  • the embodiments of this application take the AMOLED hard screen as an example to illustrate the realization of the optical fingerprint under the screen.
  • Other types of organic light-emitting diodes Organic Light-Emitting Diode; hereinafter referred to as OLED
  • LCD Liquid Crystal Display
  • OLED Organic Light-Emitting Diode
  • LCD Liquid Crystal Display
  • a brief stack of AMOLED hard screens is shown in Figure 1.
  • Various organic materials are distilled on the substrate glass to form display pixels, and then sealed with sealing glass.
  • the substrate glass, sealing glass and the laminate between them are implemented with the display drive circuit. Display function.
  • the Touch Panel (TP) layer above the sealing glass cooperates with the touch drive circuit to realize the touch function.
  • the TP layer can be etched into various patterns.
  • the OLED screen generally adds a layer Circular polarizer to suppress the reflection of the display screen to the ambient light and achieve higher display contrast, and finally fit the cover glass to form a complete display screen.
  • the optical fingerprint sensor is placed or attached to the bottom of the substrate glass, and the under-screen optical fingerprint can be implemented locally in the display area of the display screen, or in full screen.
  • the user presses the finger on the screen surface of the electronic device.
  • the electronic device detects the user's pressing operation and recognizes the user's pressing area. Then the electronic device lights up a fixed size (or adaptively) on the screen according to the user's pressing area. Size), that is, the screen display spot.
  • the screen display spot can be in the user's pressing area or cover the user's pressing area, and the screen display spot can be any color such as green, cyan, or white.
  • the screen display spot can be a circle. A shape, an ellipse, or an irregular polygon automatically generated according to the user's pressing area, etc., as shown in FIG.
  • FIG. 2 which is a schematic diagram of an embodiment of a screen display light spot in the calibration method for optical fingerprint recognition of this application.
  • the light received by the optical fingerprint sensor is mainly composed of two parts: light leakage (represented by PL) and medium light (represented by PM), as shown in Figure 3, which is the light spot on the screen in the calibration method of optical fingerprint recognition in this application Schematic diagram of light leakage and medium light below.
  • the illuminated screen display spot emits screen light upward, but there is also a part of downward light leakage, and the screen light has reflected light at each interface of the laminated layers inside the screen, and these two parts are combined into the leakage light PL.
  • the reflected light of the screen light passing through a medium (such as a finger) after exiting the screen is called medium light for short.
  • the optical fingerprint recognition calibration method realizes detection of the intensity of the light displayed on the screen and the relative displacement between the optical fingerprint Sensor and the above-mentioned screen by displaying the screen display light spot and a specific pattern on the screen.
  • FIG. 4 is a flowchart of an embodiment of a calibration method for optical fingerprint recognition according to this application.
  • the above-mentioned calibration method for optical fingerprint recognition may include:
  • Step 401 When the screen displays the screen display light spot and the specific pattern according to the pressing area of the medium, the fingerprint image and the reference image are respectively collected by the optical fingerprint sensor, wherein the fingerprint image is an image containing the fingerprint of the medium, so The reference image is an image containing the specific pattern.
  • Step 402 Detect the intensity of the light displayed on the screen according to the intensity information of the specific pattern in the reference image, and detect the optical fingerprint sensor and the optical fingerprint sensor according to the position information of the specific pattern in the reference image. The relative displacement of the screen.
  • Step 403 Calibrate the fingerprint image according to the detected intensity of the light displayed on the screen and the relative displacement.
  • the above-mentioned medium may be a user's finger, and of course, it may also be other objects that can complete the pressing operation on the screen. This embodiment does not limit the above-mentioned medium.
  • the image of the fingerprint containing the medium can be calibrated according to the intensity of the light displayed on the screen and the relative displacement.
  • feature point extraction and/or feature point matching a conclusion is given whether the fingerprint matches or not, and a complete fingerprint identification is completed.
  • the fingerprint image and the reference image are respectively collected by the optical fingerprint sensor, wherein the fingerprint image contains the medium
  • the fingerprint image of the reference image is an image containing the specific pattern.
  • the intensity of the light displayed on the screen is detected according to the intensity information of the specific pattern in the reference image, and the optical fingerprint sensor and the screen are detected according to the position information of the specific pattern in the reference image.
  • the relative displacement is calibrated according to the detected intensity of the light displayed on the screen and the relative displacement, so that the intensity of the light displayed on the screen can be accurately detected during the application process, which can be applied to screen light. Strong, violent or fast-changing scenes have broader application scenarios, and can detect the relative displacement between the optical fingerprint sensor and the screen, which improves the fingerprint recognition performance in the scene where the relative position of the screen and the optical fingerprint sensor changes rapidly.
  • FIG. 5 is a flowchart of another embodiment of a calibration method for optical fingerprint recognition according to this application. As shown in FIG. 5, based on the embodiment shown in FIG. 4 of this application, the method further includes the following steps:
  • Step 500 Control the screen to display the screen display spot and the specific pattern according to the pressing area of the medium on the screen.
  • the screen display light spot and the specific pattern are simultaneously displayed on the screen.
  • the screen display light spot is displayed at the position of the pressing area, and the specific pattern is superimposed and displayed in the screen display light spot; or the specific pattern and the screen display light spot are respectively displayed at different positions in the pressing area.
  • the specific pattern is superimposed and displayed in the screen display light spot
  • the above-mentioned specific pattern is a pattern composed of lines with a predetermined width
  • the color of the above-mentioned specific pattern is any color different from the color of the screen display light spot.
  • the specific pattern and the screen display spot are respectively displayed at different positions in the pressing area, and the specific pattern is a pattern composed of lines with a predetermined width, and the color of the specific pattern is any color different from the background color of the screen.
  • the above-mentioned predetermined width can be set according to system performance and/or implementation requirements during specific implementation. This embodiment does not limit the size of the above-mentioned predetermined width.
  • the above-mentioned predetermined width may be 1 to 1 of screen display pixels. 3 pixels (Pixel).
  • FIG. 6 is a schematic diagram of a screen display light spot with a specific pattern in the calibration method of optical fingerprint recognition in this application.
  • the above-mentioned specific patterns can be regular horizontal lines, vertical lines, diagonal lines, square grids, diamond grids, triangular grids, circular rings or concentric rings, etc.
  • the line colors of the specific patterns can be set as The screen displays any color with different colors of the light spot, and the line width of the specific pattern is a predetermined width.
  • the predetermined width is required to be as narrow as possible while ensuring the detection accuracy (detection of the intensity of the light displayed on the screen and relative displacement detection). 1 ⁇ 3Pixel of display pixels is better.
  • the light leakage PL received by the optical fingerprint sensor contains the information of the above-mentioned specific pattern, and because the reflection of light by a medium such as a finger or a test head is similar to diffuse reflection, and the pattern width is narrow, The pattern information is basically obscured, so there is basically no information of the above-mentioned specific pattern in the medium light PM received by the optical fingerprint sensor.
  • Fig. 7 shows the specific pattern superimposed and displayed on the screen in the calibration method of optical fingerprint recognition in this application. Shows the schematic diagram of light leakage and medium light in the light spot.
  • Fig. 8(a) is a schematic diagram of an embodiment of the light leakage received by the optical fingerprint sensor in the calibration method of optical fingerprint recognition of this application
  • Fig. 8(b) is the optical fingerprint of the calibration method of optical fingerprint recognition of this application
  • a schematic diagram of an embodiment of the medium light received by the Sensor, as shown in Fig. 8(b), the medium light PM basically does not contain the above-mentioned specific pattern information.
  • the above-mentioned specific pattern information does not exist in the external ambient light. That is to say, the intensity information and position information of the above-mentioned specific pattern are basically not affected by the medium light and external ambient light, so the intensity of the light displayed on the screen can be detected by the intensity information of the above-mentioned specific pattern, and the position of the above-mentioned specific pattern Information to detect the relative displacement of the optical fingerprint Sensor and the screen.
  • the concave zigzag pattern in FIG. 8(a) is the information of the specific pattern in the light leakage
  • the depth a of the concave zigzag pattern is the intensity information of the above-mentioned specific pattern.
  • the specific pattern part is not included. The difference between the intensity b of the light and the intensity information a of the aforementioned specific pattern can be detected to obtain the intensity of the light displayed on the screen.
  • the screen display spot and the specific pattern are displayed on the screen sequentially in a time-sharing manner.
  • the medium is pressed on the screen, and after the display screen displays the light spot, the optical fingerprint sensor collects an image of the fingerprint containing the medium, and the optical fingerprint sensor also displays a specific pattern before or after the image of the fingerprint containing the medium is collected.
  • the above-mentioned specific pattern is a pattern composed of lines with a predetermined width
  • the color of the above-mentioned specific pattern is any color different from the background color of the above-mentioned screen.
  • the specific pattern is a pattern composed of lines with a predetermined width and a predetermined pattern, and the color of the specific pattern is any color different from the background color of the screen.
  • the above-mentioned predetermined width can be set according to system performance and/or implementation requirements during specific implementation. This embodiment does not limit the size of the above-mentioned predetermined width.
  • the above-mentioned predetermined width may be 1 to 1 of screen display pixels. 3Pixel.
  • FIG. 9 is a schematic diagram of an embodiment of the specific pattern in the calibration method of optical fingerprint recognition in this application, and the color of the specific pattern may be Any color different from the background color of the above-mentioned screen, the above-mentioned specific pattern can be regular horizontal lines, vertical lines, diagonal lines, square grids, diamond grids, triangular grids, rings or concentric rings with a predetermined width, etc.
  • the pattern composed of lines, the line width of the above-mentioned specific pattern is a predetermined width, and the above-mentioned predetermined width is required to be as narrow as possible while ensuring the detection accuracy (detection of the light intensity displayed on the screen, relative displacement detection), and 1 of the pixels displayed on the screen ⁇ 3Pixel is better.
  • the pattern composed of lines with a predetermined width is not accurate enough to detect the relative displacement between the optical fingerprint Sensor and the screen, it can be estimated by adding other predetermined patterns with a wider size, as shown in Figure 9, for example, when the line is composed of predetermined widths Add three circles, four circles, or three squares to the pattern of.
  • This embodiment does not limit the number and size of the predetermined patterns.
  • the sizes between the predetermined patterns are not required to be equal, and you can only use the predetermined patterns.
  • the pattern composed of graphics (circular or square, etc.) independently detects the relative displacement of the optical fingerprint Sensor and the screen.
  • the specific pattern is a pattern composed of lines with a predetermined width
  • the information of the specific pattern is present in the light leakage PL received by the optical fingerprint sensor, and the reflection of light by a medium such as a finger or a test head is similar to diffuse reflection, and the specific pattern is The line width is narrow, so the information of the above-mentioned specific pattern is basically obscured, so there is basically no information of the above-mentioned specific pattern in the medium light PM received by the optical fingerprint Sensor, as shown in FIG. 10, which is the optical fingerprint recognition of this application.
  • FIG. 11(a) is a schematic diagram of another embodiment of the light leakage received by the optical fingerprint sensor in the calibration method of optical fingerprint recognition of this application
  • FIG. 11(b) is the calibration method of optical fingerprint recognition of this application
  • the intensity information and position information of the above-mentioned specific pattern will not be affected by the medium light and external ambient light. Therefore, the intensity information of the above-mentioned specific pattern can be used to detect the intensity of the light displayed on the screen.
  • the position information of the pattern is used to detect the relative displacement of the optical fingerprint Sensor and the screen.
  • the convex zigzag pattern in FIG. 11(a) is the information of the specific pattern in the light leakage
  • the height indicated by c in FIG. 11(a) is the intensity information of the above-mentioned specific pattern. Intensity information can detect the intensity of the light displayed on the screen.
  • the light leakage PL received by the optical fingerprint Sensor contains the information of the above-mentioned specific pattern, and since the reflection of light by a medium such as a finger or a test head is similar to diffuse reflection, the predetermined Because the width of the line is narrow, the pattern information of the line of the predetermined width is basically blurred, and the pattern of the predetermined pattern is still retained due to the larger size, so there are basically only patterns of the predetermined pattern in the medium light PM received by the optical fingerprint sensor Information, there is no pattern information of a line of a predetermined width. At this time, the intensity information of the pattern of the predetermined width of the line can be used to detect the intensity of the light displayed on the screen, and the position information of the pattern of the predetermined figure can be used to detect the relative displacement of the optical fingerprint Sensor and the screen.
  • step 402 may be: detecting the intensity of the light displayed on the screen according to the intensity information of the line pattern of the predetermined width in the reference image, according to the With reference to the position information of the predetermined graphic pattern in the image, the relative displacement of the optical fingerprint sensor and the screen is detected.
  • the calibration method for optical fingerprint recognition provided in the embodiment of the present application is also It may include: after the image containing the specific pattern is collected by the optical fingerprint sensor, the color of the medium is determined according to the reflectivity of the medium to the light of different colors of the predetermined pattern, so as to perform anti-counterfeiting detection on the medium.
  • the predetermined patterns of the above-mentioned specific patterns at different positions can be set to different colors, preferably red, green and blue can be used, as shown in FIG. 12, which is an example of the specific pattern in the calibration method for optical fingerprint recognition in this application.
  • FIG. 12 is an example of the specific pattern in the calibration method for optical fingerprint recognition in this application.
  • FIG. 12 A schematic diagram of another embodiment. In FIG. 12, the shades of squares, diagonal lines and small dots are used to represent the three colors of red, green and blue, respectively.
  • the color of the medium can be approximately calculated based on the reflectance of the medium, such as a finger or a fake fingerprint, to the three colors of red, green and blue, and the anti-counterfeiting detection can be performed according to the color of the medium.
  • the specific pattern may be a pattern composed of lines with a predetermined width, or the specific pattern may be a blank pattern.
  • the color of the pattern is any color different from the background color of the above-mentioned screen; wherein, the specific pattern is first displayed on the screen, and then the specific pattern and the screen display light spot are superimposed and displayed.
  • the pressing area of the medium on the screen first displaying a specific pattern, and then superimposing the display of the specific pattern and the screen display spot, it may also include: after the specific pattern is displayed, collecting a frame through the optical fingerprint Sensor includes The above-mentioned specific pattern and the image of the ambient light; after the above-mentioned specific pattern and the screen display light spot are superimposed and displayed, a frame containing the fingerprint of the above-mentioned medium and the ambient light image is collected by the optical fingerprint sensor; the fingerprint and the ambient light containing the above-mentioned medium are collected Perform a subtraction operation between the image and the image containing the specific pattern and ambient light to eliminate the influence of ambient light on fingerprint recognition.
  • FIG. 13 is a schematic diagram of the ambient light in the calibration method of optical fingerprint recognition in this application.
  • the optical fingerprint sensor After displaying the above-mentioned specific pattern, the optical fingerprint sensor collects a frame of image containing the above-mentioned specific pattern and ambient light; after superimposing the above-mentioned specific pattern and the screen display light spot, the optical fingerprint Sensor collects a frame of fingerprints and a frame containing the above-mentioned medium
  • Figure 14 is the application of the optical fingerprint recognition calibration method using a specific pattern to eliminate ambient light interference
  • FIG. 15 is a schematic diagram of another embodiment of using a specific pattern to eliminate ambient light interference in the calibration method for optical fingerprint recognition of this application.
  • the left is the image containing the specific pattern and ambient light collected after the specific pattern is displayed, and the right is the image of the fingerprint and ambient light collected after the above-mentioned specific pattern and the screen display spot are superimposed and displayed. image.
  • the color of the specific pattern can be any color, but it is preferable to use a completely black background, and the specific pattern can only use a pattern composed of lines with a predetermined width (see Figure 15) or a blank pattern (see Figure 14) .
  • the aforementioned calibration device 16 for optical fingerprint recognition may include: an acquisition module 1601, a detection module 1602, a calibration module 1603, and a display control module 1604.
  • the collection module 1601 is used to collect a fingerprint image and a reference image through an optical fingerprint sensor when the screen displays the screen display light spot and a specific pattern according to the pressing area of the medium, wherein the fingerprint image is a fingerprint containing the medium
  • the reference image is an image containing the specific pattern.
  • the detection module 1602 is configured to detect the intensity of the light displayed on the screen according to the intensity information of the specific pattern in the reference image, and detect the intensity of the light displayed on the screen according to the position information of the specific pattern in the reference image.
  • the relative displacement of the optical fingerprint sensor and the screen is configured to calibrate the fingerprint image according to the intensity of the light displayed on the screen and the relative displacement obtained by the detection module 1602.
  • the display control module 1604 is configured to control the screen to display the screen display light spot and the specific pattern according to the pressing area of the medium on the screen.
  • the calibration module 1603 can perform a measurement of the fingerprint containing the medium according to the intensity of the light displayed on the screen and the relative displacement. After calibrating, perform preprocessing, feature point extraction and/or feature point matching, and then give a conclusion on whether the fingerprint matches or not, and complete a complete fingerprint identification.
  • the screen display spot and the specific pattern are displayed on the screen at the same time.
  • the screen display light spot is displayed at the position where the pressing area is located, and the specific pattern is superimposed and displayed in the screen display light spot; or the specific pattern and the screen display light spot are respectively displayed at different positions in the pressing area.
  • the specific pattern is superimposed and displayed in the screen display spot, and the specific pattern is a pattern composed of lines with a predetermined width, and the color of the specific pattern is different from the color of the screen display spot Of any color.
  • the specific pattern and the screen display spot are respectively displayed at different positions in the pressing area, and the specific pattern is a pattern composed of lines with a predetermined width, and the color of the specific pattern is the same as that of the background of the screen. Any color with different colors.
  • the above-mentioned predetermined width can be set according to system performance and/or implementation requirements during specific implementation. This embodiment does not limit the size of the above-mentioned predetermined width.
  • the above-mentioned predetermined width may be 1 to 1 of screen display pixels. 3Pixel.
  • the above-mentioned specific patterns can be regular horizontal lines, vertical lines, diagonal lines, square grids, diamond grids, triangular grids, circular rings or concentric rings, etc.
  • the line colors of the specific patterns can be set as The screen displays any color with different colors of the light spot, and the line width of the specific pattern is a predetermined width.
  • the predetermined width is required to be as narrow as possible while ensuring the detection accuracy (detection of the intensity of the light displayed on the screen and relative displacement detection). 1 ⁇ 3Pixel of display pixels is better.
  • the light leakage PL received by the optical fingerprint sensor contains the information of the above-mentioned specific pattern, and because the reflection of light by a medium such as a finger or a test head is similar to diffuse reflection, and the pattern width is narrow,
  • the pattern information is basically obscured, so there is basically no information of the above-mentioned specific pattern in the medium light PM received by the optical fingerprint Sensor, as shown in FIG. 7.
  • the above specific pattern information only exists in the light leakage PL, as shown in Figure 8(a), and the intensity information of the above specific pattern is greater than the intensity of the light displayed on the screen.
  • there is no information about the above-mentioned specific pattern in the external ambient light that is, the information about the above-mentioned specific pattern
  • the intensity information and position information are basically not affected by medium light and external ambient light.
  • the detection module 1704 can detect the intensity of the light displayed on the screen through the intensity information of the above-mentioned specific pattern, and detect the optical intensity through the position information of the above-mentioned specific pattern.
  • the relative displacement of the fingerprint Sensor and the screen can detect the intensity of the light displayed on the screen through the intensity information of the above-mentioned specific pattern, and detect the optical intensity through the position information of the above-mentioned specific pattern.
  • the concave zigzag pattern in FIG. 8(a) is the information of the specific pattern in the light leakage
  • the depth a of the concave zigzag pattern is the intensity information of the above-mentioned specific pattern.
  • the specific pattern part is not included. The difference between the intensity b of the light and the intensity information a of the aforementioned specific pattern can be detected to obtain the intensity of the light displayed on the screen.
  • the screen display spot and the specific pattern are sequentially displayed on the screen in a time-sharing manner.
  • the medium is pressed on the screen, and after the light spot is displayed on the display screen, the optical fingerprint Sensor collects the image of the fingerprint containing the medium. Before or after the optical fingerprint Sensor collects the image of the fingerprint containing the medium, the display control module 1604 displays a specific pattern.
  • the above-mentioned specific pattern is a pattern composed of lines of a predetermined width, and the color of the above-mentioned specific pattern is any color different from the background color of the above-mentioned screen.
  • the above-mentioned specific pattern is a pattern composed of lines with a predetermined width and a predetermined figure, and the color of the above-mentioned specific pattern is any color different from the background color of the above-mentioned screen.
  • the above-mentioned predetermined width can be set according to system performance and/or implementation requirements during specific implementation. This embodiment does not limit the size of the above-mentioned predetermined width.
  • the above-mentioned predetermined width may be 1 to 1 of screen display pixels. 3Pixel.
  • the specific pattern may be as shown in FIG. 9.
  • the color of the specific pattern may be any color different from the background color of the screen, and the specific pattern may be regular horizontal lines, Vertical lines, diagonal lines, square grids, diamond grids, triangular grids, circular rings, or concentric rings, etc., are patterns composed of lines with a predetermined width.
  • the line width of the above specific pattern is a predetermined width.
  • the predetermined width is required to be guaranteed In the case of detection accuracy (detection of the intensity of the light displayed on the screen, relative displacement detection), it is as narrow as possible, and preferably 1 to 3 pixels of the screen display pixels.
  • the pattern composed of lines with a predetermined width is not accurate enough to detect the relative displacement between the optical fingerprint Sensor and the screen, it can be estimated by adding other predetermined patterns with a wider size, as shown in Figure 9, for example, when the line is composed of predetermined widths Add three circles, four circles, or three squares to the pattern of.
  • This embodiment does not limit the number and size of the predetermined patterns.
  • the sizes between the predetermined patterns are not required to be equal, and you can only use the predetermined patterns.
  • the pattern composed of graphics (circular or square, etc.) independently detects the relative displacement of the optical fingerprint Sensor and the screen.
  • the specific pattern is a pattern composed of lines with a predetermined width
  • the information of the specific pattern is present in the light leakage PL received by the optical fingerprint sensor, and the reflection of light by a medium such as a finger or a test head is similar to diffuse reflection, and the specific pattern is The line width is relatively narrow, so the information of the above-mentioned specific pattern is basically blurred, so there is basically no information of the above-mentioned specific pattern in the medium light PM received by the optical fingerprint sensor, as shown in FIG. 10.
  • the information of the specific pattern only exists in the light leakage PL, and the intensity information of the specific pattern and the intensity of the light displayed on the screen are The linear relationship of the zero crossing point; as shown in Figure 11(b), there is basically no information about the above-mentioned specific pattern in the medium light PM.
  • the intensity information and position information of the above will not be affected by the medium light and external ambient light. Therefore, the intensity information of the specific pattern can be used to detect the intensity of the light displayed on the screen, and the position information of the specific pattern can be used to detect the optical fingerprint Sensor The relative displacement from the screen.
  • the convex zigzag pattern in FIG. 11(a) is the information of the specific pattern in the light leakage
  • the height indicated by c in FIG. 11(a) is the intensity information of the above-mentioned specific pattern. Intensity information can detect the intensity of the light displayed on the screen.
  • the light leakage PL received by the optical fingerprint Sensor contains the information of the above-mentioned specific pattern, and since the reflection of light by a medium such as a finger or a test head is similar to diffuse reflection, the predetermined Because the width of the line is narrow, the pattern information of the line of the predetermined width is basically blurred, and the pattern of the predetermined pattern is still retained due to the larger size, so there are basically only patterns of the predetermined pattern in the medium light PM received by the optical fingerprint sensor Information, there is no pattern information of a line of a predetermined width. At this time, the intensity information of the pattern of the predetermined width of the line can be used to detect the intensity of the light displayed on the screen, and the position information of the pattern of the predetermined pattern can be used to detect the relative displacement of the optical fingerprint Sensor and the screen.
  • the detection module 1602 is specifically configured to detect the intensity of the light displayed on the screen according to the intensity information of the line pattern of the predetermined width in the reference image, and according to the predetermined pattern in the reference image The position information of the pattern detects the relative displacement of the optical fingerprint sensor and the screen.
  • the detection module 1602 is also used to pass the optical signal in the collection module 1601 After the fingerprint sensor collects the reference image, the color of the medium is determined according to the reflectance of the light of different colors of the predetermined pattern by the medium, so as to perform anti-counterfeiting detection on the medium.
  • the predetermined patterns of the above-mentioned specific patterns at different positions can be set to different colors, and preferably three colors of red, green and blue can be used, as shown in FIG. 12.
  • the shades of squares, diagonal dashes and small dots are used to represent the three colors of red, green and blue.
  • the detection module 1602 can approximate the color of the medium, and then can perform anti-counterfeiting detection according to the color of the medium.
  • the above-mentioned specific pattern may be a pattern composed of lines with a predetermined width, or the above-mentioned specific pattern is a blank pattern, and the color of the above-mentioned specific pattern is any color different from the background color of the above-mentioned screen;
  • the display control module 1604 is specifically configured to control the specific pattern to be displayed on the screen first, and then superimpose and display the specific pattern and the screen display spot.
  • the collection module 1601 is also configured to collect an image containing the above-mentioned specific pattern and ambient light through the optical fingerprint sensor after the display control module 1604 displays the above-mentioned specific pattern. After the display control module 1604 superimposes and displays the above-mentioned specific pattern and the screen display light spot, collect a frame of image containing the fingerprint of the above-mentioned medium and the ambient light through the optical fingerprint sensor;
  • the calibration module 1603 is also used to subtract the image containing the fingerprint and ambient light of the aforementioned medium with the image containing the aforementioned specific pattern and ambient light, so as to eliminate the influence of ambient light on fingerprint recognition.
  • the collection module 1601 uses the optical fingerprint Sensor to collect an image containing the above-mentioned specific pattern and ambient light; after the display control module 1604 superimposes and displays the above-mentioned specific pattern and the screen display light spot, the collection module 1601 collects
  • the module 1601 uses the optical fingerprint sensor to collect a frame of images containing the fingerprint of the aforementioned medium and ambient light.
  • the calibration module 1705 subtracts the two frames of images to effectively avoid the influence of ambient light on fingerprint recognition, as shown in FIGS. 14 and 15.
  • the left side is the image containing the specific pattern and ambient light collected by the collection module 1601 after the specific pattern is displayed
  • the right side is the image after the above-mentioned specific pattern and the screen display spot are superimposed and displayed, and the collection module 1601 collects the image containing the above The fingerprint of the medium and the image of the ambient light.
  • the color of the specific pattern can be any color, but it is preferable to use a completely black background, and the specific pattern can only use a pattern composed of lines with a predetermined width (see Figure 15) or a blank pattern (see Figure 14) .
  • FIG. 17 is a schematic structural diagram of an embodiment of an electronic device of this application.
  • the electronic device may include a memory, a processor, and a computer program stored on the memory and capable of running on the processor.
  • the processor executes the computer program,
  • the optical fingerprint identification calibration method provided in the embodiments of the present application can be implemented.
  • Fig. 17 shows a block diagram of an exemplary electronic device suitable for implementing the embodiments of the present application.
  • the electronic device shown in FIG. 17 is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present application.
  • the electronic device is represented in the form of a general-purpose computing device.
  • the components of the electronic device may include, but are not limited to: one or more processors 410, a memory 430, and a communication bus 440 connecting different system components (including the memory 430 and the processing unit 410).
  • the communication bus 440 represents one or more of several types of bus structures, including a memory bus or a memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any bus structure among multiple bus structures.
  • these architectures include but are not limited to industry standard architecture (Industry Standard Architecture; hereinafter referred to as: ISA) bus, Micro Channel Architecture (hereinafter referred to as: MAC) bus, enhanced ISA bus, video electronics Standards Association (Video Electronics Standards Association; hereinafter referred to as VESA) local bus and Peripheral Component Interconnection (hereinafter referred to as PCI) bus.
  • Industry Standard Architecture hereinafter referred to as: ISA
  • MAC Micro Channel Architecture
  • VESA Video Electronics Standards Association
  • PCI Peripheral Component Interconnection
  • Electronic devices typically include a variety of computer system readable media. These media can be any available media that can be accessed by electronic devices, including volatile and non-volatile media, removable and non-removable media.
  • the memory 430 may include a computer system readable medium in the form of a volatile memory, such as random access memory (Random Access Memory; hereinafter referred to as RAM) and/or cache memory.
  • the electronic device may further include other removable/non-removable, volatile/non-volatile computer system storage media.
  • a disk drive for reading and writing to a removable non-volatile disk such as a "floppy disk”
  • a removable non-volatile optical disk such as a compact disk read-only memory
  • CD-ROM Disc Read Only Memory
  • DVD-ROM Digital Video Disc Read Only Memory
  • each drive may be connected to the communication bus 440 through one or more data medium interfaces.
  • the memory 430 may include at least one program product, and the program product has a set of (for example, at least one) program modules, which are configured to perform the functions of the embodiments of the present application.
  • a program/utility tool having a set of (at least one) program modules may be stored in the memory 430.
  • Such program modules include, but are not limited to, an operating system, one or more application programs, other program modules, and program data Each of these examples or some combination may include the implementation of a network environment.
  • the program module usually executes the functions and/or methods in the embodiments described in this application.
  • the electronic device can also communicate with one or more external devices (such as keyboards, pointing devices, displays, etc.), and can also communicate with one or more devices that enable the user to interact with the electronic device, and/or communicate with the electronic device Any device (such as a network card, modem, etc.) that can communicate with one or more other computing devices. Such communication can be performed through the communication interface 420.
  • the electronic device can also connect to one or more networks (such as local area network (Local Area Network; hereinafter referred to as: LAN), Wide Area Network (hereinafter referred to as WAN) and/or other networks through a network adapter (not shown in FIG. 18).
  • networks such as local area network (Local Area Network; hereinafter referred to as: LAN), Wide Area Network (hereinafter referred to as WAN) and/or other networks through a network adapter (not shown in FIG. 18).
  • the above-mentioned network adapter may communicate with other modules of the electronic device through the communication bus 440.
  • other hardware and/or software modules can be used in conjunction with electronic devices, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, and disk arrays (Redundant Arrays). of Independent Drives; hereinafter referred to as: RAID) systems, tape drives, and data backup storage systems.
  • the processor 410 executes various functional applications and data processing by running programs stored in the memory 430, for example, to implement the optical fingerprint recognition calibration method provided in the embodiments of the present application.
  • the embodiment of the present application also provides a non-transitory computer-readable storage medium on which a computer program is stored.
  • the computer program is executed by a processor, the optical fingerprint recognition calibration method provided in the embodiment of the present application can be implemented.
  • the aforementioned non-transitory computer-readable storage medium may adopt any combination of one or more computer-readable media.
  • the computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium.
  • the computer-readable storage medium may be, for example, but not limited to, an electric, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above.
  • computer-readable storage media include: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (Read Only Memory) ; Hereinafter referred to as: ROM), Erasable Programmable Read Only Memory; hereinafter referred to as EPROM) or flash memory, optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic memory Pieces, or any suitable combination of the above.
  • the computer-readable storage medium can be any tangible medium that contains or stores a program, and the program can be used by or in combination with an instruction execution system, apparatus, or device.
  • the computer-readable signal medium may include a data signal propagated in baseband or as a part of a carrier wave, and computer-readable program code is carried therein. This propagated data signal can take many forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • the computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium.
  • the computer-readable medium may send, propagate, or transmit the program for use by or in combination with the instruction execution system, apparatus, or device .
  • the program code contained on the computer-readable medium can be transmitted by any suitable medium, including, but not limited to, wireless, wire, optical cable, RF, etc., or any suitable combination of the above.
  • the computer program code used to perform the operations of the present application can be written in one or more programming languages or a combination thereof.
  • the programming languages include object-oriented programming languages-such as Java, Smalltalk, C++, and also conventional Procedural programming language-such as "C" language or similar programming language.
  • the program code can be executed entirely on the user's computer, partly on the user's computer, executed as an independent software package, partly on the user's computer and partly executed on a remote computer, or entirely executed on the remote computer or server.
  • the remote computer can be connected to the user's computer through any kind of network-including local area network (Local Area Network; hereinafter referred to as LAN) or Wide Area Network (hereinafter referred to as WAN), or Connect to an external computer (for example, use an Internet service provider to connect via the Internet).
  • LAN Local Area Network
  • WAN Wide Area Network
  • an external computer for example, use an Internet service provider to connect via the Internet.
  • first and second are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with “first” and “second” may explicitly or implicitly include at least one of the features. In the description of the present application, "a plurality of” means at least two, such as two, three, etc., unless specifically defined otherwise.
  • the word “if” as used herein can be interpreted as “when” or “when” or “in response to determination” or “in response to detection”.
  • the phrase “if determined” or “if detected (statement or event)” can be interpreted as “when determined” or “in response to determination” or “when detected (statement or event) )” or “in response to detection (statement or event)”.
  • terminals involved in the embodiments of this application may include, but are not limited to, personal computers (Personal Computer; hereinafter referred to as PC), Personal Digital Assistants (Personal Digital Assistant; hereinafter referred to as PDA), wireless handheld devices, and tablets Computer (Tablet Computer), mobile phone, MP3 player, MP4 player, etc.
  • PC Personal Computer
  • PDA Personal Digital Assistants
  • Tablett Computer Tablet Computer
  • mobile phone MP3 player, MP4 player, etc.
  • the disclosed system, device, and method may be implemented in other ways.
  • the device embodiments described above are merely illustrative, for example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined Or it can be integrated into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • each unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit may be implemented in the form of hardware, or may be implemented in the form of hardware plus software functional units.
  • the above-mentioned integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium.
  • the above-mentioned software functional unit is stored in a storage medium and includes several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (Processor) execute the method described in each embodiment of the present application Part of the steps.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory; hereinafter referred to as ROM), random access memory (Random Access Memory; hereinafter referred to as RAM), magnetic disks or optical disks, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Image Input (AREA)
  • Collating Specific Patterns (AREA)

Abstract

The embodiments of the present application provide a calibration method and device for optical fingerprint identification, and an electronic equipment. The calibration method for optical fingerprint identification comprises: when a screen displays a screen display light spot and a specific pattern respectively according to the pressing area of a medium, collecting fingerprint images and reference images by means of an optical fingerprint sensor, wherein the fingerprint image is an image containing a fingerprint of the medium, and the reference image is an image containing the specific pattern; detecting the intensity of light displayed on the screen according to the intensity information of the specific pattern in the reference images and detecting the relative displacement of the optical fingerprint sensor and the screen according to the position information of the specific pattern in the reference image; and calibrating the fingerprint image according to the detected intensity of the light displayed on the screen and the relative displacement. According to the present application, the intensity of the light displayed on the screen can be accurately detected in an application process, and a scene where the light intensity of the screen is severe or is changed rapidly is applicable.

Description

光学指纹识别的校准方法、装置和电子设备Calibration method, device and electronic equipment for optical fingerprint recognition 【技术领域】【Technical Field】
本申请涉及光学指纹识别技术领域,尤其涉及一种光学指纹识别的校准方法、装置和电子设备。This application relates to the technical field of optical fingerprint recognition, and in particular to a calibration method, device and electronic equipment for optical fingerprint recognition.
【背景技术】【Background technique】
为响应市场需求,电子设备(例如:手机或平板电脑等)中的显示屏逐渐向全面屏发展,追求越来越高的屏占比,使得正面电容指纹无处放置,将逐渐退出历史舞台。屏下光学指纹方案应运而生,其将光学指纹传感器(Sensor)放置在显示屏显示区域的背部,不占用显示区域面积,有助于提高屏占比,带指纹信息的光能够穿透屏幕到达光学指纹Sensor表面成像,再结合软件算法即能够实现指纹识别功能。In response to market demand, the display screens in electronic devices (such as mobile phones or tablet computers) are gradually developing towards full screens. The pursuit of higher and higher screen-to-body ratios makes the front capacitive fingerprint nowhere to be placed and will gradually withdraw from the stage of history. The under-screen optical fingerprint solution came into being, which places the optical fingerprint sensor (Sensor) on the back of the display area of the display, which does not occupy the area of the display area, which helps to increase the screen-to-body ratio. The light with fingerprint information can penetrate the screen to reach Optical fingerprint Sensor surface imaging, combined with software algorithms, can realize fingerprint recognition function.
带指纹信息的光穿透屏幕必然会受到屏幕内部叠层分布不均匀性的干扰,另外还存在光源光强的不均匀性、Sensor响应不一致性等干扰,这些干扰会影响指纹图像的质量,需要通过校准算法去除上述干扰。但是,现有相关技术中提供的大部分校准算法都只能在特定场景下应用,不能适用于光源光强剧烈或者快速变化的场景,部分校准算法虽然能够兼容光源光强剧烈或者快速变化的场景,但也牺牲了其他场景的性能。The light penetrating the screen with fingerprint information will inevitably be interfered by the uneven distribution of the internal layers of the screen. In addition, there are also interferences such as uneven light intensity of the light source and inconsistency of the sensor response. These interferences will affect the quality of the fingerprint image. The above-mentioned interference is removed by the calibration algorithm. However, most of the calibration algorithms provided in the related art can only be applied in specific scenarios, and cannot be applied to scenes with severe or rapid changes in light intensity. Although some calibration algorithms are compatible with scenes with severe or rapid changes in light intensity , But also sacrificed the performance of other scenes.
【发明内容】[Content of the invention]
本申请实施例提供了一种光学指纹识别的校准方法、装置和电子设备,以在应用过程中准确检测屏幕所显示的光的强度,能够适用于屏幕光强剧烈或者快速变化的场景,具有更宽泛的应用场景,并且可以对光学指纹传感器与屏幕的相对位移进行检测,提高了屏幕与光学指纹传感器的相对位 置快速变化场景下的指纹识别性能。The embodiments of the application provide a calibration method, device and electronic equipment for optical fingerprint recognition to accurately detect the intensity of the light displayed on the screen during the application process, which can be applied to scenes where the intensity of the screen is severe or rapidly changing, and has more Wide application scenarios, and can detect the relative displacement of the optical fingerprint sensor and the screen, which improves the fingerprint recognition performance in the scene where the relative position of the screen and the optical fingerprint sensor changes rapidly.
第一方面,本申请实施例提供一种光学指纹识别的校准方法,包括:In the first aspect, an embodiment of the present application provides a calibration method for optical fingerprint recognition, including:
在屏幕根据媒介物的按压区域分别显示屏幕显示光斑和特定图案时,通过光学指纹传感器分别采集指纹图像和参考图像,其中所述指纹图像为包含所述媒介物的指纹的图像,所述参考图像为包含所述特定图案的图像;根据所述参考图像中所述特定图案的强度信息对所述屏幕所显示的光的强度进行检测,并根据参考图像中所述特定图案的位置信息检测所述光学指纹传感器与所述屏幕的相对位移;根据检测获得的所述屏幕所显示的光的强度和所述相对位移,对所述指纹图像进行校准。When the screen displays the screen display light spot and the specific pattern according to the pressing area of the medium, the fingerprint image and the reference image are respectively collected by the optical fingerprint sensor, wherein the fingerprint image is an image containing the fingerprint of the medium, and the reference image Is an image containing the specific pattern; the intensity of the light displayed on the screen is detected according to the intensity information of the specific pattern in the reference image, and the position information of the specific pattern in the reference image is detected. The relative displacement of the optical fingerprint sensor and the screen; the fingerprint image is calibrated according to the detected intensity of the light displayed on the screen and the relative displacement.
其中一种可能的实现方式中,校准方法还包括:根据所述媒介物在所述屏幕上的按压区域,控制所述屏幕显示所述屏幕显示光斑和所述特定图案。In one of the possible implementation manners, the calibration method further includes: controlling the screen to display the screen display light spot and the specific pattern according to the pressing area of the medium on the screen.
其中一种可能的实现方式中,所述屏幕显示光斑和所述特定图案同时在所述屏幕进行显示;其中,所述屏幕显示光斑显示在所述按压区域所在的位置,所述特定图案叠加显示在所述屏幕显示光斑中;或者,所述特定图案与所述屏幕显示光斑分别显示在所述按压区域中的不同位置。In one possible implementation manner, the screen display light spot and the specific pattern are displayed on the screen at the same time; wherein, the screen display light spot is displayed at the position of the pressing area, and the specific pattern is superimposed and displayed In the screen display spot; or, the specific pattern and the screen display spot are respectively displayed at different positions in the pressing area.
其中一种可能的实现方式中,所述特定图案叠加显示在所述屏幕显示光斑中,并且,所述特定图案为预定宽度的线条组成的图案,所述特定图案的颜色为与所述屏幕显示光斑的颜色不同的任意颜色。In one of the possible implementation manners, the specific pattern is superimposed and displayed in the screen display spot, and the specific pattern is a pattern composed of lines with a predetermined width, and the color of the specific pattern is the same as that displayed on the screen. Any color with different light spots.
其中一种可能的实现方式中,所述特定图案与所述屏幕显示光斑分别显示在所述按压区域中的不同位置,并且,所述特定图案为预定宽度的线条组成的图案,所述特定图案的颜色为与所述屏幕的背景颜色不同的任意颜色。In one possible implementation manner, the specific pattern and the screen display spot are respectively displayed at different positions in the pressing area, and the specific pattern is a pattern composed of lines with a predetermined width, and the specific pattern The color of is any color different from the background color of the screen.
其中一种可能的实现方式中,所述屏幕显示光斑和所述特定图案分时先后在所述屏幕上进行显示。In one possible implementation manner, the screen display light spot and the specific pattern are displayed on the screen sequentially in a time-sharing manner.
其中一种可能的实现方式中,所述特定图案为预定宽度的线条组成的图案,所述特定图案的颜色为与所述屏幕的背景颜色不同的任意颜色。In one possible implementation manner, the specific pattern is a pattern composed of lines with a predetermined width, and the color of the specific pattern is any color different from the background color of the screen.
其中一种可能的实现方式中,所述特定图案为预定宽度的线条和预定图形组成的图案,所述特定图案的颜色为与所述屏幕的背景颜色不同的任 意颜色。In one possible implementation manner, the specific pattern is a pattern composed of lines with a predetermined width and a predetermined pattern, and the color of the specific pattern is any color different from the background color of the screen.
其中一种可能的实现方式中,所述根据所述参考图像中所述特定图案的强度信息对所述屏幕所显示的光的强度进行检测,并根据所述参考图像中所述特定图案的位置信息检测所述光学指纹传感器与所述屏幕的相对位移包括:根据所述参考图像中所述预定宽度的线条图案的强度信息,对所述屏幕所显示的光的强度进行检测,根据所述参考图像中所述预定图形图案的位置信息,检测所述光学指纹传感器与所述屏幕的相对位移。In one possible implementation manner, the intensity of the light displayed on the screen is detected according to the intensity information of the specific pattern in the reference image, and the position of the specific pattern in the reference image is detected. The information detecting the relative displacement of the optical fingerprint sensor and the screen includes: detecting the intensity of the light displayed on the screen according to the intensity information of the line pattern of the predetermined width in the reference image, and according to the reference The position information of the predetermined graphic pattern in the image detects the relative displacement of the optical fingerprint sensor and the screen.
其中一种可能的实现方式中,所述特定图案中处于不同位置的预定图形的颜色不同;所述方法还包括:在通过光学指纹传感器采集所述参考图像之后,根据所述媒介物对所述预定图形的不同颜色光的反射率,确定所述媒介物的颜色,以对所述媒介物进行防伪检测。In one of the possible implementations, the colors of the predetermined graphics in different positions in the specific pattern are different; the method further includes: after the reference image is collected by an optical fingerprint sensor, the The reflectance of the light of different colors of the predetermined pattern is determined, and the color of the medium is determined to perform anti-counterfeiting detection on the medium.
其中一种可能的实现方式中,所述特定图案为预定宽度的线条组成的图案,或者所述特定图案为空白图案,所述特定图案的颜色为与所述屏幕的背景颜色不同的任意颜色;其中,所述特定图案先在所述屏幕进行显示,再叠加显示所述特定图案和屏幕显示光斑。In one possible implementation manner, the specific pattern is a pattern composed of lines of a predetermined width, or the specific pattern is a blank pattern, and the color of the specific pattern is any color different from the background color of the screen; Wherein, the specific pattern is first displayed on the screen, and then the specific pattern and the screen display spot are superimposed and displayed.
其中一种可能的实现方式中,还包括:在所述特定图案在所述屏幕进行显示之后,通过所述光学指纹传感器采集一帧包含所述特定图案和环境光的图像;在叠加显示所述特定图案和屏幕显示光斑之后,通过所述光学指纹传感器采集一帧包含所述媒介物的指纹和环境光的图像;将包含所述媒介物的指纹和环境光的图像与包含所述特定图案和环境光的图像进行相减操作,以消除环境光对指纹识别的影响。In one possible implementation manner, it further includes: after the specific pattern is displayed on the screen, collecting a frame of an image containing the specific pattern and ambient light by the optical fingerprint sensor; After the specific pattern and the screen display the light spot, a frame of image containing the fingerprint of the medium and the ambient light is collected by the optical fingerprint sensor; and the image containing the fingerprint and ambient light of the medium is combined with the image containing the specific pattern and The image of ambient light is subtracted to eliminate the influence of ambient light on fingerprint recognition.
第二方面,本申请实施例提供一种光学指纹识别的校准装置,包括:采集模块,用于在屏幕根据媒介物的按压区域分别显示屏幕显示光斑和特定图案时在所述显示模块显示所述屏幕显示光斑之后,通过光学指纹传感器分别采集指纹图像和参考图像,其中所述指纹图像为包含所述媒介物的指纹的图像;以及在所述显示模块显示所述特定图案之后,通过光学指纹传感器采集所述参考图像为包含所述特定图案的图像;检测模块,用于根据所述采集模块采集的包含所述参考图像中所述特定图案的图像中所述特定图案的强度信息对所述屏幕所显示的光的强度进行检测,并根据所述 采集模块采集的包含所述特定图案的参考图像中所述特定图案的位置信息检测所述光学指纹传感器与所述屏幕的相对位移;校准模块,用于根据所述检测模块检测获得的所述屏幕所显示的光的强度和所述相对位移,对包含所述媒介物的指纹的所述指纹图像进行校准。In a second aspect, an embodiment of the present application provides a calibration device for optical fingerprint recognition, including: a collection module, configured to display the screen display light spot and a specific pattern on the display module when the screen is respectively displayed according to the pressing area of the medium. After the light spot is displayed on the screen, a fingerprint image and a reference image are respectively collected by an optical fingerprint sensor, where the fingerprint image is an image of a fingerprint containing the medium; and after the display module displays the specific pattern, the optical fingerprint sensor The collection of the reference image is an image containing the specific pattern; a detection module is configured to perform a measurement on the screen according to the intensity information of the specific pattern in the image containing the specific pattern in the reference image collected by the collection module Detecting the intensity of the displayed light, and detecting the relative displacement of the optical fingerprint sensor and the screen according to the position information of the specific pattern in the reference image containing the specific pattern collected by the acquisition module; a calibration module, It is used to calibrate the fingerprint image including the fingerprint of the medium according to the intensity of the light displayed on the screen and the relative displacement obtained by the detection module.
其中一种可能的实现方式中,装置还包括:显示控制模块,具体用于根据所述媒介物在所述屏幕上的按压区域,控制所述屏幕显示所述屏幕显示光斑和所述特定图案。In one of the possible implementation manners, the device further includes a display control module, specifically configured to control the screen to display the screen display spot and the specific pattern according to the pressing area of the medium on the screen.
其中一种可能的实现方式中,所述屏幕显示光斑和所述特定图案同时在所述屏幕进行显示;其中,所述屏幕显示光斑显示在所述按压区域所在的位置,所述特定图案叠加显示在所述屏幕显示光斑中;或者,所述特定图案与所述屏幕显示光斑分别显示在所述按压区域中的不同位置。In one possible implementation manner, the screen display light spot and the specific pattern are displayed on the screen at the same time; wherein, the screen display light spot is displayed at the position of the pressing area, and the specific pattern is superimposed and displayed In the screen display spot; or, the specific pattern and the screen display spot are respectively displayed at different positions in the pressing area.
其中一种可能的实现方式中,所述特定图案叠加显示在所述屏幕显示光斑中,并且,所述特定图案为预定宽度的线条组成的图案,所述特定图案的颜色为与所述屏幕显示光斑的颜色不同的任意颜色。In one of the possible implementation manners, the specific pattern is superimposed and displayed in the screen display spot, and the specific pattern is a pattern composed of lines with a predetermined width, and the color of the specific pattern is the same as that displayed on the screen. Any color with different light spots.
其中一种可能的实现方式中,所述特定图案与所述屏幕显示光斑分别显示在所述按压区域中的不同位置,并且,所述特定图案为预定宽度的线条组成的图案,所述特定图案的颜色为与所述屏幕的背景颜色不同的任意颜色。In one possible implementation manner, the specific pattern and the screen display spot are respectively displayed at different positions in the pressing area, and the specific pattern is a pattern composed of lines with a predetermined width, and the specific pattern The color of is any color different from the background color of the screen.
其中一种可能的实现方式中,所述屏幕显示光斑和所述特定图案分时先后在所述屏幕上进行显示。In one possible implementation manner, the screen display light spot and the specific pattern are displayed on the screen sequentially in a time-sharing manner.
其中一种可能的实现方式中,所述特定图案为预定宽度的线条组成的图案,所述特定图案的颜色为与所述屏幕的背景颜色不同的任意颜色。In one possible implementation manner, the specific pattern is a pattern composed of lines with a predetermined width, and the color of the specific pattern is any color different from the background color of the screen.
其中一种可能的实现方式中,所述特定图案为预定宽度的线条和预定图形组成的图案,所述特定图案的颜色为与所述屏幕的背景颜色不同的任意颜色。In one possible implementation manner, the specific pattern is a pattern composed of lines with a predetermined width and a predetermined figure, and the color of the specific pattern is any color different from the background color of the screen.
其中一种可能的实现方式中,所述检测模块,具体用于根据所述参考图像中所述预定宽度的线条图案的强度信息,对所述屏幕所显示的光的强度进行检测,根据所述参考图像中所述预定图形图案的位置信息,检测所述光学指纹传感器与所述屏幕的相对位移。In one possible implementation manner, the detection module is specifically configured to detect the intensity of the light displayed on the screen according to the intensity information of the line pattern of the predetermined width in the reference image, and according to the With reference to the position information of the predetermined graphic pattern in the image, the relative displacement of the optical fingerprint sensor and the screen is detected.
其中一种可能的实现方式中,所述特定图案中处于不同位置的预定图形的颜色不同;所述检测模块,还用于在所述采集模块通过光学指纹传感器采集包含所述特定图案的所述参考图像之后,根据所述媒介物对所述预定图形的不同颜色光的反射率,确定所述媒介物的颜色,以对所述媒介物进行防伪检测。In one of the possible implementation manners, the colors of predetermined graphics in different positions in the specific pattern are different; the detection module is also used to collect the specific pattern containing the specific pattern through the optical fingerprint sensor in the collection module. After referring to the image, the color of the medium is determined according to the reflectance of the medium to the light of different colors of the predetermined pattern, so as to perform anti-counterfeiting detection on the medium.
其中一种可能的实现方式中,所述特定图案为预定宽度的线条组成的图案,或者所述特定图案为空白图案,所述特定图案的颜色为与所述屏幕的背景颜色不同的任意颜色;所述显示控制模块,具体用于控制所述特定图案先在所述屏幕进行显示,再叠加显示所述特定图案和屏幕显示光斑。In one possible implementation manner, the specific pattern is a pattern composed of lines of a predetermined width, or the specific pattern is a blank pattern, and the color of the specific pattern is any color different from the background color of the screen; The display control module is specifically configured to control the specific pattern to be displayed on the screen first, and then superimpose and display the specific pattern and the screen display spot.
其中一种可能的实现方式中,所述采集模块,还用于在所述显示控制模块控制显示所述特定图案之后,通过所述光学指纹传感器采集一帧包含所述特定图案和环境光的图像;在所述显示控制模块叠加显示所述特定图案和屏幕显示光斑之后,通过所述光学指纹传感器采集一帧包含所述媒介物的指纹和环境光的图像;所述校准模块,还用于将包含所述媒介物的指纹和环境光的图像与包含所述特定图案和环境光的图像进行相减操作,以消除环境光对指纹识别的影响。In one of the possible implementation manners, the collection module is further configured to collect a frame of an image containing the specific pattern and ambient light through the optical fingerprint sensor after the display control module controls to display the specific pattern After the display control module superimposes the display of the specific pattern and the screen display spot, the optical fingerprint sensor collects a frame of images containing the fingerprint of the medium and the ambient light; the calibration module is also used to The image containing the fingerprint of the medium and the ambient light is subtracted from the image containing the specific pattern and the ambient light, so as to eliminate the influence of the ambient light on fingerprint recognition.
第三方面,本申请实施例提供一种电子设备,包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时,实现如上所述的方法。In a third aspect, an embodiment of the present application provides an electronic device including a memory, a processor, and a computer program stored on the memory and capable of running on the processor. When the processor executes the computer program, Implement the method described above.
第四方面,本申请实施例提供一种非临时性计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现如上所述的方法。In a fourth aspect, an embodiment of the present application provides a non-transitory computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the method described above is implemented.
以上技术方案中,在屏幕根据媒介物的按压区域分别显示屏幕显示光斑和特定图案时,通过光学指纹传感器分别采集指纹图像和参考图像,其中所述指纹图像为包含所述媒介物的指纹的图像所述参考图像为包含所述特定图案的图像。然后,根据所述参考图像中所述特定图案的强度信息对所述屏幕所显示的光的强度进行检测,并根据参考图像中所述特定图案的位置信息检测所述光学指纹传感器与所述屏幕的相对位移。最后,根据检测获得的所述屏幕所显示的光的强度和所述相对位移,对所述指纹图像 进行校准,从而可以在应用过程中准确检测屏幕所显示的光的强度,能够适用于屏幕光强剧烈或者快速变化的场景,具有更宽泛的应用场景,并且可以对光学指纹传感器与屏幕的相对位移进行检测,提高了屏幕与光学指纹传感器的相对位置快速变化场景下的指纹识别性能。In the above technical solution, when the screen displays the screen display spot and the specific pattern according to the pressing area of the medium, the fingerprint image and the reference image are respectively collected by the optical fingerprint sensor, wherein the fingerprint image is an image containing the fingerprint of the medium The reference image is an image containing the specific pattern. Then, the intensity of the light displayed on the screen is detected according to the intensity information of the specific pattern in the reference image, and the optical fingerprint sensor and the screen are detected according to the position information of the specific pattern in the reference image. The relative displacement. Finally, the fingerprint image is calibrated according to the detected intensity of the light displayed on the screen and the relative displacement, so that the intensity of the light displayed on the screen can be accurately detected during the application process, which can be applied to screen light. Strong, violent or fast-changing scenes have broader application scenarios, and can detect the relative displacement between the optical fingerprint sensor and the screen, which improves the fingerprint recognition performance in the scene where the relative position of the screen and the optical fingerprint sensor changes rapidly.
【附图说明】【Explanation of drawings】
为了更清楚地说明本申请实施例的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其它的附图。In order to explain the technical solutions of the embodiments of the present application more clearly, the following will briefly introduce the drawings needed in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained from these drawings without creative work.
图1为本申请基于AMOLED硬屏的光学指纹实现方案的示意图;FIG. 1 is a schematic diagram of the implementation scheme of optical fingerprint based on AMOLED hard screen of this application;
图2为本申请光学指纹识别的校准方法中屏幕显示光斑一个实施例的示意图;2 is a schematic diagram of an embodiment of a light spot displayed on the screen in the calibration method of optical fingerprint recognition according to the present application;
图3为本申请光学指纹识别的校准方法中点亮屏幕显示光斑下的漏光和媒介光的示意图;3 is a schematic diagram of light leakage and medium light under the light spot displayed on the screen in the calibration method for optical fingerprint recognition according to the application;
图4为本申请光学指纹识别的校准方法一个实施例的流程图;4 is a flowchart of an embodiment of a calibration method for optical fingerprint recognition according to this application;
图5为本申请光学指纹识别的校准方法另一个实施例的流程图;5 is a flowchart of another embodiment of a calibration method for optical fingerprint recognition according to this application;
图6为本申请光学指纹识别的校准方法中带特定图案的屏幕显示光斑的示意图;6 is a schematic diagram of a screen with a specific pattern in the calibration method for optical fingerprint recognition according to this application;
图7为本申请光学指纹识别的校准方法中特定图案叠加显示在屏幕显示光斑中时漏光与媒介光的示意图;7 is a schematic diagram of light leakage and medium light when a specific pattern is superimposed and displayed in a screen display spot in the calibration method of optical fingerprint recognition according to the application;
图8(a)为本申请光学指纹识别的校准方法中光学指纹Sensor接收的漏光的一个实施例的示意图;FIG. 8(a) is a schematic diagram of an embodiment of light leakage received by the optical fingerprint sensor in the calibration method for optical fingerprint recognition of this application;
图8(b)为本申请光学指纹识别的校准方法中光学指纹Sensor接收的媒介光的一个实施例的示意图;FIG. 8(b) is a schematic diagram of an embodiment of the medium light received by the optical fingerprint Sensor in the calibration method for optical fingerprint recognition of this application;
图9为本申请光学指纹识别的校准方法中特定图案的一个实施例的示意图;FIG. 9 is a schematic diagram of an embodiment of a specific pattern in the calibration method for optical fingerprint recognition of this application;
图10为本申请光学指纹识别的校准方法中屏幕显示特定图案时的漏 光与媒介光的示意图;10 is a schematic diagram of light leakage and medium light when the screen displays a specific pattern in the calibration method of optical fingerprint recognition according to the present application;
图11(a)为本申请光学指纹识别的校准方法中光学指纹Sensor接收的漏光的另一个实施例的示意图;FIG. 11(a) is a schematic diagram of another embodiment of the light leakage received by the optical fingerprint Sensor in the calibration method of optical fingerprint recognition in this application;
图11(b)为本申请光学指纹识别的校准方法中光学指纹Sensor接收的媒介光的另一个实施例的示意图;FIG. 11(b) is a schematic diagram of another embodiment of the medium light received by the optical fingerprint Sensor in the calibration method of optical fingerprint recognition in this application;
图12为本申请光学指纹识别的校准方法中特定图案的另一个实施例的示意图;FIG. 12 is a schematic diagram of another embodiment of a specific pattern in the calibration method of optical fingerprint recognition according to this application;
图13为本申请光学指纹识别的校准方法中环境光的示意图;FIG. 13 is a schematic diagram of ambient light in the calibration method of optical fingerprint recognition according to this application;
图14为本申请光学指纹识别的校准方法中使用特定图案消除环境光干扰一个实施例的示意图;FIG. 14 is a schematic diagram of an embodiment of using a specific pattern to eliminate ambient light interference in the calibration method for optical fingerprint recognition of this application;
图15为本申请光学指纹识别的校准方法中使用特定图案消除环境光干扰另一个实施例的示意图;15 is a schematic diagram of another embodiment of using a specific pattern to eliminate ambient light interference in the calibration method of optical fingerprint recognition according to this application;
图16为本申请光学指纹识别的校准装置一个实施例的结构示意图;16 is a schematic structural diagram of an embodiment of a calibration device for optical fingerprint recognition in this application;
图17为本申请电子设备一个实施例的结构示意图。FIG. 17 is a schematic structural diagram of an embodiment of an electronic device of this application.
【具体实施方式】【Detailed ways】
为了更好的理解本申请的技术方案,下面结合附图对本申请实施例进行详细描述。In order to better understand the technical solutions of the present application, the following describes the embodiments of the present application in detail with reference to the accompanying drawings.
应当明确,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其它实施例,都属于本申请保护的范围。It should be clear that the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.
在本申请实施例中使用的术语是仅仅出于描述特定实施例的目的,而非旨在限制本申请。在本申请实施例和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式,除非上下文清楚地表示其他含义。The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present application. The singular forms of "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.
本申请实施例提出了一种光学指纹识别的校准方法,可以依托少量的先验信息,在应用过程中准确检测屏幕所显示的光的强度的变化,能够适 用于屏幕光强剧烈或者快速变化的场景,具有更宽泛的应用场景。同时,上述光学指纹识别的校准方法也可以检测光学指纹Sensor与屏幕在XY轴上的相对位移,提高了屏幕与光学指纹Sensor的相对位置快速变化场景下的指纹识别性能。此外,本申请中的部分实施例兼具防伪和防环境光干扰的功能。The embodiment of this application proposes a calibration method for optical fingerprint recognition, which can rely on a small amount of prior information to accurately detect changes in the intensity of the light displayed on the screen during the application process, which can be applied to situations where the light intensity of the screen changes drastically or rapidly. Scenarios, with broader application scenarios. At the same time, the above-mentioned optical fingerprint recognition calibration method can also detect the relative displacement of the optical fingerprint sensor and the screen on the XY axis, which improves the fingerprint recognition performance in a scene where the relative position of the screen and the optical fingerprint sensor changes rapidly. In addition, some of the embodiments in this application have the functions of anti-counterfeiting and anti-interference from ambient light.
图1为本申请基于主动矩阵有机发光二极管(Active Matrix Organic Light Emitting Diode;以下简称:AMOLED)硬屏的光学指纹实现方案的示意图。Figure 1 is a schematic diagram of an application based on an Active Matrix Organic Light Emitting Diode (Active Matrix Organic Light Emitting Diode; hereinafter abbreviated as: AMOLED) optical fingerprint implementation solution.
本申请实施例以AMOLED硬屏为例,说明屏下光学指纹的实现方式,其他种类有机发光二极管(Organic Light-Emitting Diode;以下简称:OLED)/液晶显示器(Liquid Crystal Display;以下简称:LCD)屏幕的实现方式与之一致或相似,在此不再赘述。AMOLED硬屏的简要叠层如图1所示,在基板玻璃上蒸馏各种有机材料形成显示像素,再使用密封玻璃进行密封,基板玻璃、密封玻璃及其之间的叠层配合显示驱动电路实现显示功能,在密封玻璃上方的触控面板(Touch Panel;以下简称:TP)层配合触控驱动电路实现触控功能,其中TP层可以被蚀刻成各种图案,此外OLED屏幕一般会增加一层圆偏光片,以抑制显示屏对环境光的反射,实现更高的显示对比度,最后贴合盖板玻璃形成一个完整的显示屏。光学指纹Sensor放置或者贴合在基板玻璃底部,屏下光学指纹可以在显示屏的显示区域中局部实现,也可以全屏实现。The embodiments of this application take the AMOLED hard screen as an example to illustrate the realization of the optical fingerprint under the screen. Other types of organic light-emitting diodes (Organic Light-Emitting Diode; hereinafter referred to as OLED)/Liquid Crystal Display (hereinafter referred to as: LCD) The implementation of the screen is consistent or similar to it, and will not be repeated here. A brief stack of AMOLED hard screens is shown in Figure 1. Various organic materials are distilled on the substrate glass to form display pixels, and then sealed with sealing glass. The substrate glass, sealing glass and the laminate between them are implemented with the display drive circuit. Display function. The Touch Panel (TP) layer above the sealing glass cooperates with the touch drive circuit to realize the touch function. The TP layer can be etched into various patterns. In addition, the OLED screen generally adds a layer Circular polarizer to suppress the reflection of the display screen to the ambient light and achieve higher display contrast, and finally fit the cover glass to form a complete display screen. The optical fingerprint sensor is placed or attached to the bottom of the substrate glass, and the under-screen optical fingerprint can be implemented locally in the display area of the display screen, or in full screen.
在用户实际应用中,用户将手指按压在电子设备的屏幕表面,上述电子设备检测到用户按压操作,并识别用户按压区域,然后电子设备根据用户按压区域在屏幕上点亮固定尺寸(或者自适应尺寸)的光斑,即屏幕显示光斑,屏幕显示光斑可以在用户按压区域内,也可以覆盖用户按压区域,并且屏幕显示光斑可以为绿色、青色或白色等任意颜色,屏幕显示光斑的形状可以为圆形、椭圆形或根据用户按压区域自动生成的不规则多边形等,如图2所示,图2为本申请光学指纹识别的校准方法中屏幕显示光斑一个实施例的示意图。待屏幕显示光斑的光强稳定后,通过光学指纹Sensor采集上述用户的指纹图像,然后电子设备对上述指纹图像进行校准、预处理、 特征点提取和/或特征点匹配等操作后给出指纹匹配与否的结论,完成一次完整的指纹识别。In the actual application of the user, the user presses the finger on the screen surface of the electronic device. The electronic device detects the user's pressing operation and recognizes the user's pressing area. Then the electronic device lights up a fixed size (or adaptively) on the screen according to the user's pressing area. Size), that is, the screen display spot. The screen display spot can be in the user's pressing area or cover the user's pressing area, and the screen display spot can be any color such as green, cyan, or white. The screen display spot can be a circle. A shape, an ellipse, or an irregular polygon automatically generated according to the user's pressing area, etc., as shown in FIG. 2, which is a schematic diagram of an embodiment of a screen display light spot in the calibration method for optical fingerprint recognition of this application. After the light intensity of the light spot displayed on the screen is stabilized, the fingerprint image of the user is collected through the optical fingerprint sensor, and then the electronic device performs the operation of calibrating, preprocessing, feature point extraction and/or feature point matching on the fingerprint image, and then the fingerprint matching is given To conclude or not, complete a complete fingerprint identification.
光学指纹Sensor接收的光主要由两部分组成:漏光(用PL表示)和媒介光(用PM表示),如图3所示,图3为本申请光学指纹识别的校准方法中点亮屏幕显示光斑下的漏光和媒介光的示意图。具体地,被点亮的屏幕显示光斑向上发出屏幕光,但也存在部分向下漏光,而且屏幕光在屏幕内部叠层各交界面处存在反射光,这两部分合成为漏光PL。屏幕光射出屏幕后经过媒介物(例如手指)的反射光,简称为媒介光。The light received by the optical fingerprint sensor is mainly composed of two parts: light leakage (represented by PL) and medium light (represented by PM), as shown in Figure 3, which is the light spot on the screen in the calibration method of optical fingerprint recognition in this application Schematic diagram of light leakage and medium light below. Specifically, the illuminated screen display spot emits screen light upward, but there is also a part of downward light leakage, and the screen light has reflected light at each interface of the laminated layers inside the screen, and these two parts are combined into the leakage light PL. The reflected light of the screen light passing through a medium (such as a finger) after exiting the screen is called medium light for short.
本申请实施例提供的光学指纹识别的校准方法,通过在屏幕上显示屏幕显示光斑和特定图案,实现对屏幕所显示的光的强度和光学指纹Sensor与上述屏幕的相对位移的检测。The optical fingerprint recognition calibration method provided by the embodiments of the present application realizes detection of the intensity of the light displayed on the screen and the relative displacement between the optical fingerprint Sensor and the above-mentioned screen by displaying the screen display light spot and a specific pattern on the screen.
图4为本申请光学指纹识别的校准方法一个实施例的流程图,如图4所示,上述光学指纹识别的校准方法可以包括:FIG. 4 is a flowchart of an embodiment of a calibration method for optical fingerprint recognition according to this application. As shown in FIG. 4, the above-mentioned calibration method for optical fingerprint recognition may include:
步骤401,在屏幕根据媒介物的按压区域分别显示屏幕显示光斑和特定图案时,通过光学指纹传感器分别采集指纹图像和参考图像,其中所述指纹图像为包含所述媒介物的指纹的图像,所述参考图像为包含所述特定图案的图像。Step 401: When the screen displays the screen display light spot and the specific pattern according to the pressing area of the medium, the fingerprint image and the reference image are respectively collected by the optical fingerprint sensor, wherein the fingerprint image is an image containing the fingerprint of the medium, so The reference image is an image containing the specific pattern.
步骤402,根据所述参考图像中所述特定图案的强度信息对所述屏幕所显示的光的强度进行检测,并根据参考图像中所述特定图案的位置信息检测所述光学指纹传感器与所述屏幕的相对位移。Step 402: Detect the intensity of the light displayed on the screen according to the intensity information of the specific pattern in the reference image, and detect the optical fingerprint sensor and the optical fingerprint sensor according to the position information of the specific pattern in the reference image. The relative displacement of the screen.
步骤403,根据检测获得的所述屏幕所显示的光的强度和所述相对位移,对所述指纹图像进行校准。Step 403: Calibrate the fingerprint image according to the detected intensity of the light displayed on the screen and the relative displacement.
本实施例中,上述媒介物可以为用户的手指,当然也可以为其他能够完成对屏幕的按压操作的物品,本实施例对上述媒介物不作限定。In this embodiment, the above-mentioned medium may be a user's finger, and of course, it may also be other objects that can complete the pressing operation on the screen. This embodiment does not limit the above-mentioned medium.
在检测获得上述屏幕所显示的光的强度和上述相对位移之后,就可以根据上述屏幕所显示的光的强度和上述相对位移对包含上述媒介物的指纹的图像进行校准,校准之后,再进行预处理、特征点提取和/或特征点匹配等操作后给出指纹匹配与否的结论,完成一次完整的指纹识别。After detecting the intensity of the light displayed on the screen and the relative displacement, the image of the fingerprint containing the medium can be calibrated according to the intensity of the light displayed on the screen and the relative displacement. After processing, feature point extraction and/or feature point matching, a conclusion is given whether the fingerprint matches or not, and a complete fingerprint identification is completed.
上述光学指纹识别的校准方法中,在屏幕根据媒介物的按压区域分别 显示屏幕显示光斑和特定图案时,通过光学指纹传感器分别采集指纹图像和参考图像,其中所述指纹图像为包含所述媒介物的指纹的图像所述参考图像为包含所述特定图案的图像。然后,根据所述参考图像中所述特定图案的强度信息对所述屏幕所显示的光的强度进行检测,并根据参考图像中所述特定图案的位置信息检测所述光学指纹传感器与所述屏幕的相对位移。最后,根据检测获得的所述屏幕所显示的光的强度和所述相对位移,对所述指纹图像进行校准,从而可以在应用过程中准确检测屏幕所显示的光的强度,能够适用于屏幕光强剧烈或者快速变化的场景,具有更宽泛的应用场景,并且可以对光学指纹传感器与屏幕的相对位移进行检测,提高了屏幕与光学指纹传感器的相对位置快速变化场景下的指纹识别性能。In the above-mentioned calibration method for optical fingerprint recognition, when the screen displays the screen display light spot and the specific pattern according to the pressing area of the medium, the fingerprint image and the reference image are respectively collected by the optical fingerprint sensor, wherein the fingerprint image contains the medium The fingerprint image of the reference image is an image containing the specific pattern. Then, the intensity of the light displayed on the screen is detected according to the intensity information of the specific pattern in the reference image, and the optical fingerprint sensor and the screen are detected according to the position information of the specific pattern in the reference image. The relative displacement. Finally, the fingerprint image is calibrated according to the detected intensity of the light displayed on the screen and the relative displacement, so that the intensity of the light displayed on the screen can be accurately detected during the application process, which can be applied to screen light. Strong, violent or fast-changing scenes have broader application scenarios, and can detect the relative displacement between the optical fingerprint sensor and the screen, which improves the fingerprint recognition performance in the scene where the relative position of the screen and the optical fingerprint sensor changes rapidly.
图5为本申请光学指纹识别的校准方法另一个实施例的流程图,如图5所示,基于本申请图4所示实施例,还包括如下步骤:FIG. 5 is a flowchart of another embodiment of a calibration method for optical fingerprint recognition according to this application. As shown in FIG. 5, based on the embodiment shown in FIG. 4 of this application, the method further includes the following steps:
步骤500、根据所述媒介物在所述屏幕上的按压区域,控制所述屏幕显示所述屏幕显示光斑和所述特定图案。Step 500: Control the screen to display the screen display spot and the specific pattern according to the pressing area of the medium on the screen.
在本实施例的一种实施方式中,所述屏幕显示光斑和所述特定图案同时在所述屏幕进行显示。其中,屏幕显示光斑显示在上述按压区域所在的位置,上述特定图案叠加显示在屏幕显示光斑中;或者,特定图案与屏幕显示光斑分别显示在上述按压区域中的不同位置。In an implementation of this embodiment, the screen display light spot and the specific pattern are simultaneously displayed on the screen. Wherein, the screen display light spot is displayed at the position of the pressing area, and the specific pattern is superimposed and displayed in the screen display light spot; or the specific pattern and the screen display light spot are respectively displayed at different positions in the pressing area.
本实施例中,特定图案叠加显示在屏幕显示光斑中,并且上述特定图案为预定宽度的线条组成的图案,上述特定图案的颜色为与屏幕显示光斑的颜色不同的任意颜色。In this embodiment, the specific pattern is superimposed and displayed in the screen display light spot, and the above-mentioned specific pattern is a pattern composed of lines with a predetermined width, and the color of the above-mentioned specific pattern is any color different from the color of the screen display light spot.
特定图案与屏幕显示光斑分别显示在上述按压区域中的不同位置,并且特定图案为预定宽度的线条组成的图案,上述特定图案的颜色为与屏幕的背景颜色不同的任意颜色。The specific pattern and the screen display spot are respectively displayed at different positions in the pressing area, and the specific pattern is a pattern composed of lines with a predetermined width, and the color of the specific pattern is any color different from the background color of the screen.
其中,上述预定宽度可以在具体实现时根据系统性能和/或实现需求等自行设定,本实施例对上述预定宽度的大小不作限定,举例来说,上述预定宽度可以为屏幕显示像素的1~3像素(Pixel)。The above-mentioned predetermined width can be set according to system performance and/or implementation requirements during specific implementation. This embodiment does not limit the size of the above-mentioned predetermined width. For example, the above-mentioned predetermined width may be 1 to 1 of screen display pixels. 3 pixels (Pixel).
具体地,以圆形屏幕显示光斑为例,特定图案的部分实施例可以如图 6所示,图6为本申请光学指纹识别的校准方法中带特定图案的屏幕显示光斑的示意图。本实施例中,上述特定图案可以为规律的横线、竖线、斜线、方形网格、菱形网格、三角形网格、圆环或同心圆环等,特定图案的线条颜色可以设置为与屏幕显示光斑的颜色不同的任意颜色,特定图案的线条宽度为预定宽度,上述预定宽度要求在保证检测精度(屏幕所显示的光的强度的检测和相对位移检测)的情况下尽量窄,以屏幕显示像素的1~3Pixel为佳。Specifically, taking a circular screen display light spot as an example, some embodiments of a specific pattern may be shown in FIG. 6, which is a schematic diagram of a screen display light spot with a specific pattern in the calibration method of optical fingerprint recognition in this application. In this embodiment, the above-mentioned specific patterns can be regular horizontal lines, vertical lines, diagonal lines, square grids, diamond grids, triangular grids, circular rings or concentric rings, etc. The line colors of the specific patterns can be set as The screen displays any color with different colors of the light spot, and the line width of the specific pattern is a predetermined width. The predetermined width is required to be as narrow as possible while ensuring the detection accuracy (detection of the intensity of the light displayed on the screen and relative displacement detection). 1~3Pixel of display pixels is better.
当特定图案叠加显示在屏幕显示光斑中时,光学指纹Sensor接收的漏光PL中存在上述特定图案的信息,而由于手指或测试头等媒介物对光的反射近似于漫反射,且图案宽度较窄,图案信息基本被模糊掉,所以光学指纹Sensor接收的媒介光PM中基本不存在上述特定图案的信息,如图7所示,图7为本申请光学指纹识别的校准方法中特定图案叠加显示在屏幕显示光斑中时漏光与媒介光的示意图。When a specific pattern is superimposed and displayed in the screen display spot, the light leakage PL received by the optical fingerprint sensor contains the information of the above-mentioned specific pattern, and because the reflection of light by a medium such as a finger or a test head is similar to diffuse reflection, and the pattern width is narrow, The pattern information is basically obscured, so there is basically no information of the above-mentioned specific pattern in the medium light PM received by the optical fingerprint sensor. As shown in Fig. 7, Fig. 7 shows the specific pattern superimposed and displayed on the screen in the calibration method of optical fingerprint recognition in this application. Shows the schematic diagram of light leakage and medium light in the light spot.
以特定图案为周期竖线组成的图案为例,上述特定图案信息只存在于漏光PL中,如图8(a)所示,且上述特定图案的强度信息与屏幕所显示的光的强度为过零点的线性关系,图8(a)为本申请光学指纹识别的校准方法中光学指纹Sensor接收的漏光的一个实施例的示意图;图8(b)为本申请光学指纹识别的校准方法中光学指纹Sensor接收的媒介光的一个实施例的示意图,如图8(b)所示,媒介光PM中基本不存在上述特定图案的信息,显然可知外界环境光中也不存在上述特定图案的信息,也就是说,上述特定图案的强度信息和位置信息基本不会受到媒介光和外界环境光的影响,因此可以通过上述特定图案的强度信息来检测屏幕所显示的光的强度,通过上述特定图案的位置信息来检测光学指纹Sensor与屏幕的相对位移。Taking a specific pattern as a pattern composed of periodic vertical lines as an example, the above specific pattern information only exists in the light leakage PL, as shown in Figure 8(a), and the intensity information of the above specific pattern is greater than the intensity of the light displayed on the screen. The linear relationship of the zero point, Fig. 8(a) is a schematic diagram of an embodiment of the light leakage received by the optical fingerprint sensor in the calibration method of optical fingerprint recognition of this application; Fig. 8(b) is the optical fingerprint of the calibration method of optical fingerprint recognition of this application A schematic diagram of an embodiment of the medium light received by the Sensor, as shown in Fig. 8(b), the medium light PM basically does not contain the above-mentioned specific pattern information. Obviously, it can be known that the above-mentioned specific pattern information does not exist in the external ambient light. That is to say, the intensity information and position information of the above-mentioned specific pattern are basically not affected by the medium light and external ambient light, so the intensity of the light displayed on the screen can be detected by the intensity information of the above-mentioned specific pattern, and the position of the above-mentioned specific pattern Information to detect the relative displacement of the optical fingerprint Sensor and the screen.
具体来说,图8(a)中下凹的锯齿状图形即为漏光中特定图案的信息,锯齿状图形下凹的深度a为上述特定图案的强度信息,根据漏光中不包括特定图案部分的光的强度b与上述特定图案的强度信息a的差值,可以检测获得屏幕所显示的光的强度。Specifically, the concave zigzag pattern in FIG. 8(a) is the information of the specific pattern in the light leakage, and the depth a of the concave zigzag pattern is the intensity information of the above-mentioned specific pattern. According to the light leakage, the specific pattern part is not included. The difference between the intensity b of the light and the intensity information a of the aforementioned specific pattern can be detected to obtain the intensity of the light displayed on the screen.
在本实施例的另一种实施方式中,所述屏幕显示光斑和所述特定图案分时先后在所述屏幕上进行显示。In another implementation manner of this embodiment, the screen display spot and the specific pattern are displayed on the screen sequentially in a time-sharing manner.
本实施例中,媒介物按压屏幕,在显示屏幕显示光斑之后,光学指纹Sensor采集包含媒介物的指纹的图像,在光学指纹Sensor采集包含媒介物的指纹的图像之前或者之后还显示特定图案。In this embodiment, the medium is pressed on the screen, and after the display screen displays the light spot, the optical fingerprint sensor collects an image of the fingerprint containing the medium, and the optical fingerprint sensor also displays a specific pattern before or after the image of the fingerprint containing the medium is collected.
例如,上述特定图案为预定宽度的线条组成的图案,上述特定图案的颜色为与上述屏幕的背景颜色不同的任意颜色。For example, the above-mentioned specific pattern is a pattern composed of lines with a predetermined width, and the color of the above-mentioned specific pattern is any color different from the background color of the above-mentioned screen.
又例如,上述特定图案为预定宽度的线条和预定图形组成的图案,上述特定图案的颜色为与上述屏幕的背景颜色不同的任意颜色。For another example, the specific pattern is a pattern composed of lines with a predetermined width and a predetermined pattern, and the color of the specific pattern is any color different from the background color of the screen.
其中,上述预定宽度可以在具体实现时根据系统性能和/或实现需求等自行设定,本实施例对上述预定宽度的大小不作限定,举例来说,上述预定宽度可以为屏幕显示像素的1~3Pixel。The above-mentioned predetermined width can be set according to system performance and/or implementation requirements during specific implementation. This embodiment does not limit the size of the above-mentioned predetermined width. For example, the above-mentioned predetermined width may be 1 to 1 of screen display pixels. 3Pixel.
以圆形屏幕显示光斑为例,特定图案的部分实施例可以如图9所示,图9为本申请光学指纹识别的校准方法中特定图案的一个实施例的示意图,上述特定图案的颜色可以为与上述屏幕的背景颜色不同的任意颜色,上述特定图案可以为规律的横线、竖线、斜线、方形网格、菱形网格、三角形网格、圆环或同心圆环等由预定宽度的线条组成的图案,上述特定图案的线条宽度为预定宽度,上述预定宽度要求在保证检测精度(屏幕所显示的光的强度的检测、相对位移检测)的情况下尽量窄,以屏幕显示像素的1~3Pixel为佳。Taking a circular screen display light spot as an example, some embodiments of the specific pattern may be shown in FIG. 9. FIG. 9 is a schematic diagram of an embodiment of the specific pattern in the calibration method of optical fingerprint recognition in this application, and the color of the specific pattern may be Any color different from the background color of the above-mentioned screen, the above-mentioned specific pattern can be regular horizontal lines, vertical lines, diagonal lines, square grids, diamond grids, triangular grids, rings or concentric rings with a predetermined width, etc. The pattern composed of lines, the line width of the above-mentioned specific pattern is a predetermined width, and the above-mentioned predetermined width is required to be as narrow as possible while ensuring the detection accuracy (detection of the light intensity displayed on the screen, relative displacement detection), and 1 of the pixels displayed on the screen ~3Pixel is better.
但如果预定宽度的线条组成的图案在检测光学指纹Sensor与屏幕的相对位移时精度不够,可以通过添加其他更宽尺寸的预定图形进行估计,如图9中所示,例如在预定宽度的线条组成的图案上增添三个圆形、四个圆形或三个方形等,本实施例对预定图形的个数及尺寸不作限制,上述预定图形之间的尺寸并不要求相等,也可以只用预定图形(圆形或方形等)组成的图案单独进行光学指纹Sensor与屏幕的相对位移的检测。However, if the pattern composed of lines with a predetermined width is not accurate enough to detect the relative displacement between the optical fingerprint Sensor and the screen, it can be estimated by adding other predetermined patterns with a wider size, as shown in Figure 9, for example, when the line is composed of predetermined widths Add three circles, four circles, or three squares to the pattern of. This embodiment does not limit the number and size of the predetermined patterns. The sizes between the predetermined patterns are not required to be equal, and you can only use the predetermined patterns. The pattern composed of graphics (circular or square, etc.) independently detects the relative displacement of the optical fingerprint Sensor and the screen.
当特定图案为预定宽度的线条组成的图案时,光学指纹Sensor接收的漏光PL中存在该特定图案的信息,而由于手指或测试头等媒介物对光的反射近似于漫反射,且上述特定图案中线条宽度较窄,因此上述特定图 案的信息基本被模糊掉,所以光学指纹Sensor接收的媒介光PM中基本不存在上述特定图案的信息,如图10所示,图10为本申请光学指纹识别的校准方法中屏幕显示特定图案时的漏光与媒介光的示意图。When the specific pattern is a pattern composed of lines with a predetermined width, the information of the specific pattern is present in the light leakage PL received by the optical fingerprint sensor, and the reflection of light by a medium such as a finger or a test head is similar to diffuse reflection, and the specific pattern is The line width is narrow, so the information of the above-mentioned specific pattern is basically obscured, so there is basically no information of the above-mentioned specific pattern in the medium light PM received by the optical fingerprint Sensor, as shown in FIG. 10, which is the optical fingerprint recognition of this application. Schematic diagram of light leakage and medium light when the screen displays a specific pattern in the calibration method.
以特定图案为周期竖线组成的图案为例,如图11(a)所示,上述特定图案的信息只存在于漏光PL中,且上述特定图案的强度信息与屏幕所显示的光的强度为过零点的线性关系,图11(a)为本申请光学指纹识别的校准方法中光学指纹Sensor接收的漏光的另一个实施例的示意图;图11(b)为本申请光学指纹识别的校准方法中光学指纹Sensor接收的媒介光的另一个实施例的示意图,如图11(b)所示,媒介光PM中基本不存在上述特定图案的信息,显然可知外界环境光中也不存在上述特定图案的信息,也就是说,上述特定图案的强度信息和位置信息基本不会受到媒介光和外界环境光的影响,因此可以通过上述特定图案的强度信息来检测屏幕所显示的光的强度,通过上述特定图案的位置信息来检测光学指纹Sensor与屏幕的相对位移。Taking a specific pattern as a pattern composed of periodic vertical lines as an example, as shown in Figure 11(a), the information of the specific pattern only exists in the light leakage PL, and the intensity information of the specific pattern and the intensity of the light displayed on the screen are The linear relationship of the zero-crossing point, FIG. 11(a) is a schematic diagram of another embodiment of the light leakage received by the optical fingerprint sensor in the calibration method of optical fingerprint recognition of this application; FIG. 11(b) is the calibration method of optical fingerprint recognition of this application A schematic diagram of another embodiment of the medium light received by the optical fingerprint Sensor, as shown in FIG. 11(b), the medium light PM basically does not have the information of the above-mentioned specific pattern, and it is obvious that there is no such specific pattern in the external ambient light. Information, that is, the intensity information and position information of the above-mentioned specific pattern will not be affected by the medium light and external ambient light. Therefore, the intensity information of the above-mentioned specific pattern can be used to detect the intensity of the light displayed on the screen. The position information of the pattern is used to detect the relative displacement of the optical fingerprint Sensor and the screen.
具体来说,图11(a)中上凸的锯齿状图形即为漏光中特定图案的信息,图11(a)中的c所指示的高度为上述特定图案的强度信息,根据上述特定图案的强度信息,可以检测获得屏幕所显示的光的强度。Specifically, the convex zigzag pattern in FIG. 11(a) is the information of the specific pattern in the light leakage, and the height indicated by c in FIG. 11(a) is the intensity information of the above-mentioned specific pattern. Intensity information can detect the intensity of the light displayed on the screen.
当上述特定图案为预定宽度的线条和预定图形组成的图案时,光学指纹Sensor接收的漏光PL中存在上述特定图案的信息,而由于手指或测试头等媒介物对光的反射近似于漫反射,预定宽度的线条由于宽度较窄,因此预定宽度的线条的图案信息基本被模糊掉,预定图形的图案由于尺寸较宽仍被保留,所以光学指纹Sensor接收的媒介光PM中基本只存在预定图形的图案信息,不存在预定宽度的线条的图案信息。这时可以利用预定宽度的线条的图案的强度信息来检测屏幕所显示的光的强度,利用预定图形的图案的位置信息来检测光学指纹Sensor与屏幕的相对位移。When the above-mentioned specific pattern is a pattern composed of lines with a predetermined width and a predetermined pattern, the light leakage PL received by the optical fingerprint Sensor contains the information of the above-mentioned specific pattern, and since the reflection of light by a medium such as a finger or a test head is similar to diffuse reflection, the predetermined Because the width of the line is narrow, the pattern information of the line of the predetermined width is basically blurred, and the pattern of the predetermined pattern is still retained due to the larger size, so there are basically only patterns of the predetermined pattern in the medium light PM received by the optical fingerprint sensor Information, there is no pattern information of a line of a predetermined width. At this time, the intensity information of the pattern of the predetermined width of the line can be used to detect the intensity of the light displayed on the screen, and the position information of the pattern of the predetermined figure can be used to detect the relative displacement of the optical fingerprint Sensor and the screen.
因此,本申请图4所示实施例中,步骤402可以为:根据所述参考图像中所述预定宽度的线条图案的强度信息,对所述屏幕所显示的光的强度进行检测,根据所述参考图像中所述预定图形图案的位置信息,检测所述光学指纹传感器与所述屏幕的相对位移。Therefore, in the embodiment shown in FIG. 4 of the present application, step 402 may be: detecting the intensity of the light displayed on the screen according to the intensity information of the line pattern of the predetermined width in the reference image, according to the With reference to the position information of the predetermined graphic pattern in the image, the relative displacement of the optical fingerprint sensor and the screen is detected.
进一步地,当上述特定图案为预定宽度的线条和预定图形组成的图案时,上述特定图案中处于不同位置的预定图形的颜色不同;这时,本申请实施例提供的光学指纹识别的校准方法还可以包括:在通过光学指纹Sensor采集包含上述特定图案的图像之后,根据上述媒介物对上述预定图形的不同颜色光的反射率,确定上述媒介物的颜色,以对上述媒介物进行防伪检测。Further, when the above-mentioned specific pattern is a pattern composed of lines with a predetermined width and a predetermined pattern, the colors of the predetermined patterns at different positions in the above-mentioned specific pattern are different; at this time, the calibration method for optical fingerprint recognition provided in the embodiment of the present application is also It may include: after the image containing the specific pattern is collected by the optical fingerprint sensor, the color of the medium is determined according to the reflectivity of the medium to the light of different colors of the predetermined pattern, so as to perform anti-counterfeiting detection on the medium.
具体地,可以将上述特定图案在不同位置的预定图形设置为不同颜色,优选地可以采用红绿蓝三色,如图12所示,图12为本申请光学指纹识别的校准方法中特定图案的另一个实施例的示意图,图12中,采用方格、斜划线和小圆点的阴影分别表示红绿蓝三种颜色光。根据媒介物例如手指或假指纹等对红绿蓝三种颜色光的反射率可以近似计算出媒介物的颜色,进而可以根据媒介物的颜色来进行防伪检测。Specifically, the predetermined patterns of the above-mentioned specific patterns at different positions can be set to different colors, preferably red, green and blue can be used, as shown in FIG. 12, which is an example of the specific pattern in the calibration method for optical fingerprint recognition in this application. A schematic diagram of another embodiment. In FIG. 12, the shades of squares, diagonal lines and small dots are used to represent the three colors of red, green and blue, respectively. The color of the medium can be approximately calculated based on the reflectance of the medium, such as a finger or a fake fingerprint, to the three colors of red, green and blue, and the anti-counterfeiting detection can be performed according to the color of the medium.
在上述所述屏幕显示光斑和所述特定图案分时先后在所述屏幕上进行显示的实施方式中,上述特定图案可以为预定宽度的线条组成的图案,或者上述特定图案为空白图案,上述特定图案的颜色为与上述屏幕的背景颜色不同的任意颜色;其中,所述特定图案先在所述屏幕进行显示,再叠加显示所述特定图案和屏幕显示光斑。In the foregoing embodiment where the screen display spot and the specific pattern are displayed on the screen in time-division, the specific pattern may be a pattern composed of lines with a predetermined width, or the specific pattern may be a blank pattern. The color of the pattern is any color different from the background color of the above-mentioned screen; wherein, the specific pattern is first displayed on the screen, and then the specific pattern and the screen display light spot are superimposed and displayed.
进一步地,根据上述媒介物在上述屏幕上的按压区域,先显示特定图案,再叠加显示上述特定图案和屏幕显示光斑之后,还可以包括:在显示特定图案之后,通过光学指纹Sensor采集一帧包含上述特定图案和环境光的图像;在叠加显示上述特定图案和屏幕显示光斑之后,通过光学指纹传感器采集一帧包含上述媒介物的指纹和环境光的图像;将包含上述媒介物的指纹和环境光的图像与包含特定图案和环境光的图像进行相减操作,以消除环境光对指纹识别的影响。Further, according to the pressing area of the medium on the screen, first displaying a specific pattern, and then superimposing the display of the specific pattern and the screen display spot, it may also include: after the specific pattern is displayed, collecting a frame through the optical fingerprint Sensor includes The above-mentioned specific pattern and the image of the ambient light; after the above-mentioned specific pattern and the screen display light spot are superimposed and displayed, a frame containing the fingerprint of the above-mentioned medium and the ambient light image is collected by the optical fingerprint sensor; the fingerprint and the ambient light containing the above-mentioned medium are collected Perform a subtraction operation between the image and the image containing the specific pattern and ambient light to eliminate the influence of ambient light on fingerprint recognition.
具体地,在光学指纹的识别过程中容易受到环境光的干扰,如图13所示,图13为本申请光学指纹识别的校准方法中环境光的示意图。在显示上述特定图案之后,通过光学指纹Sensor采集一帧包含上述特定图案和环境光的图像;在叠加显示上述特定图案和屏幕显示光斑之后,通过光学指纹Sensor采集一帧包含上述媒介物的指纹和环境光的图像,将两帧 图像相减可以有效避免环境光对指纹识别的影响,如图14和图15所示,图14为本申请光学指纹识别的校准方法中使用特定图案消除环境光干扰一个实施例的示意图,图15为本申请光学指纹识别的校准方法中使用特定图案消除环境光干扰另一个实施例的示意图。图14和图15中,左边为显示特定图案之后,采集的包含特定图案和环境光的图像,右边为叠加显示上述特定图案和屏幕显示光斑之后,采集的包含上述媒介物的指纹和环境光的图像。图14和图15中,特定图案的颜色可以为任意颜色,但优选地采用全黑背景,而特定图案只能采用预定宽度的线条组成的图案(参见图15)或者空白图案(参见图14)。Specifically, the optical fingerprint recognition process is easily interfered by ambient light, as shown in FIG. 13, which is a schematic diagram of the ambient light in the calibration method of optical fingerprint recognition in this application. After displaying the above-mentioned specific pattern, the optical fingerprint sensor collects a frame of image containing the above-mentioned specific pattern and ambient light; after superimposing the above-mentioned specific pattern and the screen display light spot, the optical fingerprint Sensor collects a frame of fingerprints and a frame containing the above-mentioned medium For the image of ambient light, subtracting the two frames of images can effectively avoid the impact of ambient light on fingerprint recognition, as shown in Figure 14 and Figure 15. Figure 14 is the application of the optical fingerprint recognition calibration method using a specific pattern to eliminate ambient light interference A schematic diagram of an embodiment. FIG. 15 is a schematic diagram of another embodiment of using a specific pattern to eliminate ambient light interference in the calibration method for optical fingerprint recognition of this application. In Figures 14 and 15, the left is the image containing the specific pattern and ambient light collected after the specific pattern is displayed, and the right is the image of the fingerprint and ambient light collected after the above-mentioned specific pattern and the screen display spot are superimposed and displayed. image. In Figures 14 and 15, the color of the specific pattern can be any color, but it is preferable to use a completely black background, and the specific pattern can only use a pattern composed of lines with a predetermined width (see Figure 15) or a blank pattern (see Figure 14) .
图16为本申请光学指纹识别的校准装置一个实施例的结构示意图,本实施例中的光学指纹识别的校准装置可以实现本申请实施例提供的光学指纹识别的校准方法。如图16所示,上述光学指纹识别的校准装置16可以包括:采集模块1601、检测模块1602、校准模块1603以及显示控制模块1604。16 is a schematic structural diagram of an embodiment of a calibration device for optical fingerprint recognition in this application. The calibration device for optical fingerprint recognition in this embodiment can implement the calibration method for optical fingerprint recognition provided in the embodiment of this application. As shown in FIG. 16, the aforementioned calibration device 16 for optical fingerprint recognition may include: an acquisition module 1601, a detection module 1602, a calibration module 1603, and a display control module 1604.
所述采集模块1601用于在屏幕根据媒介物的按压区域分别显示屏幕显示光斑和特定图案时,通过光学指纹传感器分别采集指纹图像和参考图像,其中所述指纹图像为包含所述媒介物的指纹的图像,所述参考图像为包含所述特定图案的图像。所述检测模块1602用于根据所述参考图像中所述特定图案的强度信息对所述屏幕所显示的光的强度进行检测,并根据所述参考图像中所述特定图案的位置信息检测所述光学指纹传感器与所述屏幕的相对位移。所述校准模块1603用于根据所述检测模块1602检测获得的所述屏幕所显示的光的强度和所述相对位移,对所述指纹图像进行校准。所述显示控制模块1604用于根据所述媒介物在所述屏幕上的按压区域,控制所述屏幕显示所述屏幕显示光斑和所述特定图案。The collection module 1601 is used to collect a fingerprint image and a reference image through an optical fingerprint sensor when the screen displays the screen display light spot and a specific pattern according to the pressing area of the medium, wherein the fingerprint image is a fingerprint containing the medium The reference image is an image containing the specific pattern. The detection module 1602 is configured to detect the intensity of the light displayed on the screen according to the intensity information of the specific pattern in the reference image, and detect the intensity of the light displayed on the screen according to the position information of the specific pattern in the reference image. The relative displacement of the optical fingerprint sensor and the screen. The calibration module 1603 is configured to calibrate the fingerprint image according to the intensity of the light displayed on the screen and the relative displacement obtained by the detection module 1602. The display control module 1604 is configured to control the screen to display the screen display light spot and the specific pattern according to the pressing area of the medium on the screen.
本实施例中,在检测模块1602检测获得上述屏幕所显示的光的强度和上述相对位移之后,校准模块1603就可以根据上述屏幕所显示的光的强度和上述相对位移对包含上述媒介物的指纹的图像进行校准,校准之后,再进行预处理、特征点提取和/或特征点匹配等操作后给出指纹匹配与否 的结论,完成一次完整的指纹识别。In this embodiment, after the detection module 1602 detects and obtains the intensity of the light displayed on the screen and the above relative displacement, the calibration module 1603 can perform a measurement of the fingerprint containing the medium according to the intensity of the light displayed on the screen and the relative displacement. After calibrating, perform preprocessing, feature point extraction and/or feature point matching, and then give a conclusion on whether the fingerprint matches or not, and complete a complete fingerprint identification.
一个实施例中,所述屏幕显示光斑和所述特定图案同时在所述屏幕进行显示。其中,屏幕显示光斑显示在上述按压区域所在的位置,上述特定图案叠加显示在屏幕显示光斑中;或者,所述特定图案与上述屏幕显示光斑分别显示在上述按压区域中的不同位置。In one embodiment, the screen display spot and the specific pattern are displayed on the screen at the same time. Wherein, the screen display light spot is displayed at the position where the pressing area is located, and the specific pattern is superimposed and displayed in the screen display light spot; or the specific pattern and the screen display light spot are respectively displayed at different positions in the pressing area.
本实施例中,所述特定图案叠加显示在所述屏幕显示光斑中,并且,所述特定图案为预定宽度的线条组成的图案,所述特定图案的颜色为与所述屏幕显示光斑的颜色不同的任意颜色。In this embodiment, the specific pattern is superimposed and displayed in the screen display spot, and the specific pattern is a pattern composed of lines with a predetermined width, and the color of the specific pattern is different from the color of the screen display spot Of any color.
所述特定图案与所述屏幕显示光斑分别显示在所述按压区域中的不同位置,并且,所述特定图案为预定宽度的线条组成的图案,所述特定图案的颜色为与所述屏幕的背景颜色不同的任意颜色。The specific pattern and the screen display spot are respectively displayed at different positions in the pressing area, and the specific pattern is a pattern composed of lines with a predetermined width, and the color of the specific pattern is the same as that of the background of the screen. Any color with different colors.
其中,上述预定宽度可以在具体实现时根据系统性能和/或实现需求等自行设定,本实施例对上述预定宽度的大小不作限定,举例来说,上述预定宽度可以为屏幕显示像素的1~3Pixel。The above-mentioned predetermined width can be set according to system performance and/or implementation requirements during specific implementation. This embodiment does not limit the size of the above-mentioned predetermined width. For example, the above-mentioned predetermined width may be 1 to 1 of screen display pixels. 3Pixel.
具体地,以圆形屏幕显示光斑为例,特定图案的部分实施例可以如图6所示。本实施例中,上述特定图案可以为规律的横线、竖线、斜线、方形网格、菱形网格、三角形网格、圆环或同心圆环等,特定图案的线条颜色可以设置为与屏幕显示光斑的颜色不同的任意颜色,特定图案的线条宽度为预定宽度,上述预定宽度要求在保证检测精度(屏幕所显示的光的强度的检测和相对位移检测)的情况下尽量窄,以屏幕显示像素的1~3Pixel为佳。Specifically, taking the circular screen display light spot as an example, some embodiments of the specific pattern may be as shown in FIG. 6. In this embodiment, the above-mentioned specific patterns can be regular horizontal lines, vertical lines, diagonal lines, square grids, diamond grids, triangular grids, circular rings or concentric rings, etc. The line colors of the specific patterns can be set as The screen displays any color with different colors of the light spot, and the line width of the specific pattern is a predetermined width. The predetermined width is required to be as narrow as possible while ensuring the detection accuracy (detection of the intensity of the light displayed on the screen and relative displacement detection). 1~3Pixel of display pixels is better.
当特定图案叠加显示在屏幕显示光斑中时,光学指纹Sensor接收的漏光PL中存在上述特定图案的信息,而由于手指或测试头等媒介物对光的反射近似于漫反射,且图案宽度较窄,图案信息基本被模糊掉,所以光学指纹Sensor接收的媒介光PM中基本不存在上述特定图案的信息,如图7所示。When a specific pattern is superimposed and displayed in the screen display spot, the light leakage PL received by the optical fingerprint sensor contains the information of the above-mentioned specific pattern, and because the reflection of light by a medium such as a finger or a test head is similar to diffuse reflection, and the pattern width is narrow, The pattern information is basically obscured, so there is basically no information of the above-mentioned specific pattern in the medium light PM received by the optical fingerprint Sensor, as shown in FIG. 7.
以特定图案为周期竖线组成的图案为例,上述特定图案信息只存在于漏光PL中,如图8(a)所示,且上述特定图案的强度信息与屏幕所显示的光的强度为过零点的线性关系;如图8(b)所示,媒介光PM中基本不 存在上述特定图案的信息,显然可知外界环境光中也不存在上述特定图案的信息,也就是说,上述特定图案的强度信息和位置信息基本不会受到媒介光和外界环境光的影响,因此检测模块1704可以通过上述特定图案的强度信息来检测屏幕所显示的光的强度,通过上述特定图案的位置信息来检测光学指纹Sensor与屏幕的相对位移。Taking a specific pattern as a pattern composed of periodic vertical lines as an example, the above specific pattern information only exists in the light leakage PL, as shown in Figure 8(a), and the intensity information of the above specific pattern is greater than the intensity of the light displayed on the screen. The linear relationship of the zero point; as shown in Figure 8(b), there is basically no information about the above-mentioned specific pattern in the medium light PM. Obviously, there is no information about the above-mentioned specific pattern in the external ambient light, that is, the information about the above-mentioned specific pattern The intensity information and position information are basically not affected by medium light and external ambient light. Therefore, the detection module 1704 can detect the intensity of the light displayed on the screen through the intensity information of the above-mentioned specific pattern, and detect the optical intensity through the position information of the above-mentioned specific pattern. The relative displacement of the fingerprint Sensor and the screen.
具体来说,图8(a)中下凹的锯齿状图形即为漏光中特定图案的信息,锯齿状图形下凹的深度a为上述特定图案的强度信息,根据漏光中不包括特定图案部分的光的强度b与上述特定图案的强度信息a的差值,可以检测获得屏幕所显示的光的强度。Specifically, the concave zigzag pattern in FIG. 8(a) is the information of the specific pattern in the light leakage, and the depth a of the concave zigzag pattern is the intensity information of the above-mentioned specific pattern. According to the light leakage, the specific pattern part is not included. The difference between the intensity b of the light and the intensity information a of the aforementioned specific pattern can be detected to obtain the intensity of the light displayed on the screen.
另一个实施例中,所述屏幕显示光斑和所述特定图案分时先后在所述屏幕上进行显示。In another embodiment, the screen display spot and the specific pattern are sequentially displayed on the screen in a time-sharing manner.
本实施例中,媒介物按压屏幕,在显示屏幕显示光斑之后,光学指纹Sensor采集包含媒介物的指纹的图像,在光学指纹Sensor采集包含媒介物的指纹的图像之前或者之后,所述显示控制模块1604显示特定图案。In this embodiment, the medium is pressed on the screen, and after the light spot is displayed on the display screen, the optical fingerprint Sensor collects the image of the fingerprint containing the medium. Before or after the optical fingerprint Sensor collects the image of the fingerprint containing the medium, the display control module 1604 displays a specific pattern.
本实施例的一种实现方式中,上述特定图案为预定宽度的线条组成的图案,上述特定图案的颜色为与上述屏幕的背景颜色不同的任意颜色。In an implementation of this embodiment, the above-mentioned specific pattern is a pattern composed of lines of a predetermined width, and the color of the above-mentioned specific pattern is any color different from the background color of the above-mentioned screen.
本实施例的另一种实现方式中,上述特定图案为预定宽度的线条和预定图形组成的图案,上述特定图案的颜色为与上述屏幕的背景颜色不同的任意颜色。In another implementation of this embodiment, the above-mentioned specific pattern is a pattern composed of lines with a predetermined width and a predetermined figure, and the color of the above-mentioned specific pattern is any color different from the background color of the above-mentioned screen.
其中,上述预定宽度可以在具体实现时根据系统性能和/或实现需求等自行设定,本实施例对上述预定宽度的大小不作限定,举例来说,上述预定宽度可以为屏幕显示像素的1~3Pixel。The above-mentioned predetermined width can be set according to system performance and/or implementation requirements during specific implementation. This embodiment does not limit the size of the above-mentioned predetermined width. For example, the above-mentioned predetermined width may be 1 to 1 of screen display pixels. 3Pixel.
以圆形屏幕显示光斑为例,特定图案的部分实施例可以如图9所示,上述特定图案的颜色可以为与上述屏幕的背景颜色不同的任意颜色,上述特定图案可以为规律的横线、竖线、斜线、方形网格、菱形网格、三角形网格、圆环或同心圆环等由预定宽度的线条组成的图案,上述特定图案的线条宽度为预定宽度,上述预定宽度要求在保证检测精度(屏幕所显示的光的强度的检测、相对位移检测)的情况下尽量窄,以屏幕显示像素的1~3Pixel为佳。Taking a circular screen display light spot as an example, some embodiments of the specific pattern may be as shown in FIG. 9. The color of the specific pattern may be any color different from the background color of the screen, and the specific pattern may be regular horizontal lines, Vertical lines, diagonal lines, square grids, diamond grids, triangular grids, circular rings, or concentric rings, etc., are patterns composed of lines with a predetermined width. The line width of the above specific pattern is a predetermined width. The predetermined width is required to be guaranteed In the case of detection accuracy (detection of the intensity of the light displayed on the screen, relative displacement detection), it is as narrow as possible, and preferably 1 to 3 pixels of the screen display pixels.
但如果预定宽度的线条组成的图案在检测光学指纹Sensor与屏幕的相对位移时精度不够,可以通过添加其他更宽尺寸的预定图形进行估计,如图9中所示,例如在预定宽度的线条组成的图案上增添三个圆形、四个圆形或三个方形等,本实施例对预定图形的个数及尺寸不作限制,上述预定图形之间的尺寸并不要求相等,也可以只用预定图形(圆形或方形等)组成的图案单独进行光学指纹Sensor与屏幕的相对位移的检测。However, if the pattern composed of lines with a predetermined width is not accurate enough to detect the relative displacement between the optical fingerprint Sensor and the screen, it can be estimated by adding other predetermined patterns with a wider size, as shown in Figure 9, for example, when the line is composed of predetermined widths Add three circles, four circles, or three squares to the pattern of. This embodiment does not limit the number and size of the predetermined patterns. The sizes between the predetermined patterns are not required to be equal, and you can only use the predetermined patterns. The pattern composed of graphics (circular or square, etc.) independently detects the relative displacement of the optical fingerprint Sensor and the screen.
当特定图案为预定宽度的线条组成的图案时,光学指纹Sensor接收的漏光PL中存在该特定图案的信息,而由于手指或测试头等媒介物对光的反射近似于漫反射,且上述特定图案中线条宽度较窄,因此上述特定图案的信息基本被模糊掉,所以光学指纹Sensor接收的媒介光PM中基本不存在上述特定图案的信息,如图10所示。When the specific pattern is a pattern composed of lines with a predetermined width, the information of the specific pattern is present in the light leakage PL received by the optical fingerprint sensor, and the reflection of light by a medium such as a finger or a test head is similar to diffuse reflection, and the specific pattern is The line width is relatively narrow, so the information of the above-mentioned specific pattern is basically blurred, so there is basically no information of the above-mentioned specific pattern in the medium light PM received by the optical fingerprint sensor, as shown in FIG. 10.
以特定图案为周期竖线组成的图案为例,如图11(a)所示,上述特定图案的信息只存在于漏光PL中,且上述特定图案的强度信息与屏幕所显示的光的强度为过零点的线性关系;如图11(b)所示,媒介光PM中基本不存在上述特定图案的信息,显然可知外界环境光中也不存在上述特定图案的信息,也就是说,上述特定图案的强度信息和位置信息基本不会受到媒介光和外界环境光的影响,因此可以通过上述特定图案的强度信息来检测屏幕所显示的光的强度,通过上述特定图案的位置信息来检测光学指纹Sensor与屏幕的相对位移。Taking a specific pattern as a pattern composed of periodic vertical lines as an example, as shown in Figure 11(a), the information of the specific pattern only exists in the light leakage PL, and the intensity information of the specific pattern and the intensity of the light displayed on the screen are The linear relationship of the zero crossing point; as shown in Figure 11(b), there is basically no information about the above-mentioned specific pattern in the medium light PM. Obviously, there is no information about the above-mentioned specific pattern in the external ambient light, that is, the above-mentioned specific pattern The intensity information and position information of the above will not be affected by the medium light and external ambient light. Therefore, the intensity information of the specific pattern can be used to detect the intensity of the light displayed on the screen, and the position information of the specific pattern can be used to detect the optical fingerprint Sensor The relative displacement from the screen.
具体来说,图11(a)中上凸的锯齿状图形即为漏光中特定图案的信息,图11(a)中的c所指示的高度为上述特定图案的强度信息,根据上述特定图案的强度信息,可以检测获得屏幕所显示的光的强度。Specifically, the convex zigzag pattern in FIG. 11(a) is the information of the specific pattern in the light leakage, and the height indicated by c in FIG. 11(a) is the intensity information of the above-mentioned specific pattern. Intensity information can detect the intensity of the light displayed on the screen.
当上述特定图案为预定宽度的线条和预定图形组成的图案时,光学指纹Sensor接收的漏光PL中存在上述特定图案的信息,而由于手指或测试头等媒介物对光的反射近似于漫反射,预定宽度的线条由于宽度较窄,因此预定宽度的线条的图案信息基本被模糊掉,预定图形的图案由于尺寸较宽仍被保留,所以光学指纹Sensor接收的媒介光PM中基本只存在预定图形的图案信息,不存在预定宽度的线条的图案信息。这时可以利用预定宽度的线条的图案的强度信息来检测屏幕所显示的光的强度,利用预定图 形的图案的位置信息来检测光学指纹Sensor与屏幕的相对位移。When the above-mentioned specific pattern is a pattern composed of lines with a predetermined width and a predetermined pattern, the light leakage PL received by the optical fingerprint Sensor contains the information of the above-mentioned specific pattern, and since the reflection of light by a medium such as a finger or a test head is similar to diffuse reflection, the predetermined Because the width of the line is narrow, the pattern information of the line of the predetermined width is basically blurred, and the pattern of the predetermined pattern is still retained due to the larger size, so there are basically only patterns of the predetermined pattern in the medium light PM received by the optical fingerprint sensor Information, there is no pattern information of a line of a predetermined width. At this time, the intensity information of the pattern of the predetermined width of the line can be used to detect the intensity of the light displayed on the screen, and the position information of the pattern of the predetermined pattern can be used to detect the relative displacement of the optical fingerprint Sensor and the screen.
因此,所述检测模块1602具体用于根据所述参考图像中所述预定宽度的线条图案的强度信息,对所述屏幕所显示的光的强度进行检测,根据所述参考图像中所述预定图形图案的位置信息,检测所述光学指纹传感器与所述屏幕的相对位移。Therefore, the detection module 1602 is specifically configured to detect the intensity of the light displayed on the screen according to the intensity information of the line pattern of the predetermined width in the reference image, and according to the predetermined pattern in the reference image The position information of the pattern detects the relative displacement of the optical fingerprint sensor and the screen.
进一步地,当上述特定图案为预定宽度的线条和预定图形组成的图案时,上述特定图案中处于不同位置的预定图形的颜色不同;所述检测模块1602还用于在所述采集模块1601通过光学指纹传感器采集所述参考图像之后,根据所述媒介物对所述预定图形的不同颜色光的反射率,确定所述媒介物的颜色,以对所述媒介物进行防伪检测。Further, when the above-mentioned specific pattern is a pattern composed of lines with a predetermined width and a predetermined pattern, the colors of the predetermined patterns at different positions in the above-mentioned specific pattern are different; the detection module 1602 is also used to pass the optical signal in the collection module 1601 After the fingerprint sensor collects the reference image, the color of the medium is determined according to the reflectance of the light of different colors of the predetermined pattern by the medium, so as to perform anti-counterfeiting detection on the medium.
具体地,可以将上述特定图案在不同位置的预定图形设置为不同颜色,优选地可以采用红绿蓝三色,如图12所示。图12中,采用方格、斜划线和小圆点的阴影分别表示红绿蓝三种颜色光。根据媒介物例如手指或假指纹等对红绿蓝三种颜色光的反射率,检测模块1602可以近似计算出媒介物的颜色,进而可以根据媒介物的颜色来进行防伪检测。Specifically, the predetermined patterns of the above-mentioned specific patterns at different positions can be set to different colors, and preferably three colors of red, green and blue can be used, as shown in FIG. 12. In Fig. 12, the shades of squares, diagonal dashes and small dots are used to represent the three colors of red, green and blue. According to the reflectivity of the medium, such as a finger or a fake fingerprint, to the red, green and blue light, the detection module 1602 can approximate the color of the medium, and then can perform anti-counterfeiting detection according to the color of the medium.
本实施例的再一种实现方式中,上述特定图案可以为预定宽度的线条组成的图案,或者上述特定图案为空白图案,上述特定图案的颜色为与上述屏幕的背景颜色不同的任意颜色;所述显示控制模块1604具体用于控制所述特定图案先在所述屏幕进行显示,再叠加显示所述特定图案和屏幕显示光斑。In still another implementation of this embodiment, the above-mentioned specific pattern may be a pattern composed of lines with a predetermined width, or the above-mentioned specific pattern is a blank pattern, and the color of the above-mentioned specific pattern is any color different from the background color of the above-mentioned screen; The display control module 1604 is specifically configured to control the specific pattern to be displayed on the screen first, and then superimpose and display the specific pattern and the screen display spot.
进一步地,所述采集模块1601还用于在显示控制模块1604显示上述特定图案之后,通过光学指纹传感器采集一帧包含上述特定图案和环境光的图像。在所述显示控制模块1604叠加显示上述特定图案和屏幕显示光斑之后,通过光学指纹传感器采集一帧包含上述媒介物的指纹和环境光的图像;Further, the collection module 1601 is also configured to collect an image containing the above-mentioned specific pattern and ambient light through the optical fingerprint sensor after the display control module 1604 displays the above-mentioned specific pattern. After the display control module 1604 superimposes and displays the above-mentioned specific pattern and the screen display light spot, collect a frame of image containing the fingerprint of the above-mentioned medium and the ambient light through the optical fingerprint sensor;
所述校准模块1603还用于将包含上述媒介物的指纹和环境光的图像与包含上述特定图案和环境光的图像进行相减操作,以消除环境光对指纹识别的影响。The calibration module 1603 is also used to subtract the image containing the fingerprint and ambient light of the aforementioned medium with the image containing the aforementioned specific pattern and ambient light, so as to eliminate the influence of ambient light on fingerprint recognition.
具体地,在光学指纹的识别过程中容易受到环境光的干扰,如图13 所示。在显示控制模块1604显示上述特定图案之后,所述采集模块1601通过光学指纹Sensor采集一帧包含上述特定图案和环境光的图像;在显示控制模块1604叠加显示上述特定图案和屏幕显示光斑之后,采集模块1601通过光学指纹传感器采集一帧包含上述媒介物的指纹和环境光的图像,校准模块1705将两帧图像相减可以有效避免环境光对指纹识别的影响,如图14和图15所示。图14和图15中,左边为显示特定图案之后,采集模块1601采集的包含特定图案和环境光的图像,右边为叠加显示上述特定图案和屏幕显示光斑之后,所述采集模块1601采集的包含上述媒介物的指纹和环境光的图像。图14和图15中,特定图案的颜色可以为任意颜色,但优选地采用全黑背景,而特定图案只能采用预定宽度的线条组成的图案(参见图15)或者空白图案(参见图14)。Specifically, it is easy to be interfered by ambient light in the process of optical fingerprint recognition, as shown in Figure 13. After the display control module 1604 displays the above-mentioned specific pattern, the collection module 1601 uses the optical fingerprint Sensor to collect an image containing the above-mentioned specific pattern and ambient light; after the display control module 1604 superimposes and displays the above-mentioned specific pattern and the screen display light spot, the collection module 1601 collects The module 1601 uses the optical fingerprint sensor to collect a frame of images containing the fingerprint of the aforementioned medium and ambient light. The calibration module 1705 subtracts the two frames of images to effectively avoid the influence of ambient light on fingerprint recognition, as shown in FIGS. 14 and 15. In Figures 14 and 15, the left side is the image containing the specific pattern and ambient light collected by the collection module 1601 after the specific pattern is displayed, and the right side is the image after the above-mentioned specific pattern and the screen display spot are superimposed and displayed, and the collection module 1601 collects the image containing the above The fingerprint of the medium and the image of the ambient light. In Figures 14 and 15, the color of the specific pattern can be any color, but it is preferable to use a completely black background, and the specific pattern can only use a pattern composed of lines with a predetermined width (see Figure 15) or a blank pattern (see Figure 14) .
图17为本申请电子设备一个实施例的结构示意图,上述电子设备可以包括存储器、处理器及存储在上述存储器上并可在上述处理器上运行的计算机程序,上述处理器执行上述计算机程序时,可以实现本申请实施例提供的光学指纹识别的校准方法。FIG. 17 is a schematic structural diagram of an embodiment of an electronic device of this application. The electronic device may include a memory, a processor, and a computer program stored on the memory and capable of running on the processor. When the processor executes the computer program, The optical fingerprint identification calibration method provided in the embodiments of the present application can be implemented.
图17示出了适于用来实现本申请实施方式的示例性电子设备的框图。图17显示的电子设备仅仅是一个示例,不应对本申请实施例的功能和使用范围带来任何限制。Fig. 17 shows a block diagram of an exemplary electronic device suitable for implementing the embodiments of the present application. The electronic device shown in FIG. 17 is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present application.
如图17所示,电子设备以通用计算设备的形式表现。电子设备的组件可以包括但不限于:一个或者多个处理器410,存储器430,连接不同系统组件(包括存储器430和处理单元410)的通信总线440。As shown in Figure 17, the electronic device is represented in the form of a general-purpose computing device. The components of the electronic device may include, but are not limited to: one or more processors 410, a memory 430, and a communication bus 440 connecting different system components (including the memory 430 and the processing unit 410).
通信总线440表示几类总线结构中的一种或多种,包括存储器总线或者存储器控制器,外围总线,图形加速端口,处理器或者使用多种总线结构中的任意总线结构的局域总线。举例来说,这些体系结构包括但不限于工业标准体系结构(Industry Standard Architecture;以下简称:ISA)总线,微通道体系结构(Micro Channel Architecture;以下简称:MAC)总线,增强型ISA总线、视频电子标准协会(Video Electronics Standards Association;以下简称:VESA)局域总线以及外围组件互连(Peripheral  Component Interconnection;以下简称:PCI)总线。The communication bus 440 represents one or more of several types of bus structures, including a memory bus or a memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any bus structure among multiple bus structures. For example, these architectures include but are not limited to industry standard architecture (Industry Standard Architecture; hereinafter referred to as: ISA) bus, Micro Channel Architecture (hereinafter referred to as: MAC) bus, enhanced ISA bus, video electronics Standards Association (Video Electronics Standards Association; hereinafter referred to as VESA) local bus and Peripheral Component Interconnection (hereinafter referred to as PCI) bus.
电子设备典型地包括多种计算机系统可读介质。这些介质可以是任何能够被电子设备访问的可用介质,包括易失性和非易失性介质,可移动的和不可移动的介质。Electronic devices typically include a variety of computer system readable media. These media can be any available media that can be accessed by electronic devices, including volatile and non-volatile media, removable and non-removable media.
存储器430可以包括易失性存储器形式的计算机系统可读介质,例如随机存取存储器(Random Access Memory;以下简称:RAM)和/或高速缓存存储器。电子设备可以进一步包括其它可移动/不可移动的、易失性/非易失性计算机系统存储介质。尽管图18中未示出,可以提供用于对可移动非易失性磁盘(例如“软盘”)读写的磁盘驱动器,以及对可移动非易失性光盘(例如:光盘只读存储器(Compact Disc Read Only Memory;以下简称:CD-ROM)、数字多功能只读光盘(Digital Video Disc Read Only Memory;以下简称:DVD-ROM)或者其它光介质)读写的光盘驱动器。在这些情况下,每个驱动器可以通过一个或者多个数据介质接口与通信总线440相连。存储器430可以包括至少一个程序产品,该程序产品具有一组(例如至少一个)程序模块,这些程序模块被配置以执行本申请各实施例的功能。The memory 430 may include a computer system readable medium in the form of a volatile memory, such as random access memory (Random Access Memory; hereinafter referred to as RAM) and/or cache memory. The electronic device may further include other removable/non-removable, volatile/non-volatile computer system storage media. Although not shown in FIG. 18, a disk drive for reading and writing to a removable non-volatile disk (such as a "floppy disk") and a removable non-volatile optical disk (such as a compact disk read-only memory) can be provided. Disc Read Only Memory; hereinafter referred to as CD-ROM), Digital Video Disc Read Only Memory (hereinafter referred to as DVD-ROM) or other optical media) read and write optical disc drives. In these cases, each drive may be connected to the communication bus 440 through one or more data medium interfaces. The memory 430 may include at least one program product, and the program product has a set of (for example, at least one) program modules, which are configured to perform the functions of the embodiments of the present application.
具有一组(至少一个)程序模块的程序/实用工具,可以存储在存储器430中,这样的程序模块包括——但不限于——操作系统、一个或者多个应用程序、其它程序模块以及程序数据,这些示例中的每一个或某种组合中可能包括网络环境的实现。程序模块通常执行本申请所描述的实施例中的功能和/或方法。A program/utility tool having a set of (at least one) program modules may be stored in the memory 430. Such program modules include, but are not limited to, an operating system, one or more application programs, other program modules, and program data Each of these examples or some combination may include the implementation of a network environment. The program module usually executes the functions and/or methods in the embodiments described in this application.
电子设备也可以与一个或多个外部设备(例如键盘、指向设备、显示器等)通信,还可与一个或者多个使得用户能与该电子设备交互的设备通信,和/或与使得该电子设备能与一个或多个其它计算设备进行通信的任何设备(例如网卡,调制解调器等等)通信。这种通信可以通过通信接口420进行。并且,电子设备还可以通过网络适配器(图18中未示出)与一个或者多个网络(例如局域网(Local Area Network;以下简称:LAN),广域网(Wide Area Network;以下简称:WAN)和/或公共网络,例如因特网)通信,上述网络适配器可以通过通信总线440与电子设备的其它模 块通信。应当明白,尽管图18中未示出,可以结合电子设备使用其它硬件和/或软件模块,包括但不限于:微代码、设备驱动器、冗余处理单元、外部磁盘驱动阵列、磁盘阵列(Redundant Arrays of Independent Drives;以下简称:RAID)系统、磁带驱动器以及数据备份存储系统等。The electronic device can also communicate with one or more external devices (such as keyboards, pointing devices, displays, etc.), and can also communicate with one or more devices that enable the user to interact with the electronic device, and/or communicate with the electronic device Any device (such as a network card, modem, etc.) that can communicate with one or more other computing devices. Such communication can be performed through the communication interface 420. In addition, the electronic device can also connect to one or more networks (such as local area network (Local Area Network; hereinafter referred to as: LAN), Wide Area Network (hereinafter referred to as WAN) and/or other networks through a network adapter (not shown in FIG. 18). Or a public network, such as the Internet, for communication, the above-mentioned network adapter may communicate with other modules of the electronic device through the communication bus 440. It should be understood that although not shown in FIG. 18, other hardware and/or software modules can be used in conjunction with electronic devices, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, and disk arrays (Redundant Arrays). of Independent Drives; hereinafter referred to as: RAID) systems, tape drives, and data backup storage systems.
处理器410通过运行存储在存储器430中的程序,从而执行各种功能应用以及数据处理,例如实现本申请实施例提供的光学指纹识别的校准方法。The processor 410 executes various functional applications and data processing by running programs stored in the memory 430, for example, to implement the optical fingerprint recognition calibration method provided in the embodiments of the present application.
本申请实施例还提供一种非临时性计算机可读存储介质,其上存储有计算机程序,上述计算机程序被处理器执行时可以实现本申请实施例提供的光学指纹识别的校准方法。The embodiment of the present application also provides a non-transitory computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the optical fingerprint recognition calibration method provided in the embodiment of the present application can be implemented.
上述非临时性计算机可读存储介质可以采用一个或多个计算机可读的介质的任意组合。计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件,或者任意以上的组合。计算机可读存储介质的更具体的例子(非穷举的列表)包括:具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机存取存储器(RAM)、只读存储器(Read Only Memory;以下简称:ROM)、可擦式可编程只读存储器(Erasable Programmable Read Only Memory;以下简称:EPROM)或闪存、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本文件中,计算机可读存储介质可以是任何包含或存储程序的有形介质,该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。The aforementioned non-transitory computer-readable storage medium may adopt any combination of one or more computer-readable media. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium may be, for example, but not limited to, an electric, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of computer-readable storage media (non-exhaustive list) include: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (Read Only Memory) ; Hereinafter referred to as: ROM), Erasable Programmable Read Only Memory; hereinafter referred to as EPROM) or flash memory, optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic memory Pieces, or any suitable combination of the above. In this document, the computer-readable storage medium can be any tangible medium that contains or stores a program, and the program can be used by or in combination with an instruction execution system, apparatus, or device.
计算机可读的信号介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式,包括——但不限于——电磁信号、光信号或上述的任意合适的组合。计算机可读的信号介质还可以是计算机可读存储介质以外的任何计算机可读介质,该计算机可读介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。The computer-readable signal medium may include a data signal propagated in baseband or as a part of a carrier wave, and computer-readable program code is carried therein. This propagated data signal can take many forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium. The computer-readable medium may send, propagate, or transmit the program for use by or in combination with the instruction execution system, apparatus, or device .
计算机可读介质上包含的程序代码可以用任何适当的介质传输,包括——但不限于——无线、电线、光缆、RF等等,或者上述的任意合适的组合。The program code contained on the computer-readable medium can be transmitted by any suitable medium, including, but not limited to, wireless, wire, optical cable, RF, etc., or any suitable combination of the above.
可以以一种或多种程序设计语言或其组合来编写用于执行本申请操作的计算机程序代码,所述程序设计语言包括面向对象的程序设计语言—诸如Java、Smalltalk、C++,还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中,远程计算机可以通过任意种类的网络——包括局域网(Local Area Network;以下简称:LAN)或广域网(Wide Area Network;以下简称:WAN)连接到用户计算机,或者,可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。The computer program code used to perform the operations of the present application can be written in one or more programming languages or a combination thereof. The programming languages include object-oriented programming languages-such as Java, Smalltalk, C++, and also conventional Procedural programming language-such as "C" language or similar programming language. The program code can be executed entirely on the user's computer, partly on the user's computer, executed as an independent software package, partly on the user's computer and partly executed on a remote computer, or entirely executed on the remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network-including local area network (Local Area Network; hereinafter referred to as LAN) or Wide Area Network (hereinafter referred to as WAN), or Connect to an external computer (for example, use an Internet service provider to connect via the Internet).
在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本申请的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。In the description of this specification, descriptions with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" etc. mean specific features described in conjunction with the embodiment or example , The structure, materials, or characteristics are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the described specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine the different embodiments or examples and the features of the different embodiments or examples described in this specification without contradicting each other.
此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本申请的描述中,“多个”的含义是至少两个,例如两个,三个等,除非另有明确具体的限定。In addition, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present application, "a plurality of" means at least two, such as two, three, etc., unless specifically defined otherwise.
流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为,表示包括一个或更多个用于实现定制逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分,并且本申请的优选实施方式的范围包括 另外的实现,其中可以不按所示出或讨论的顺序,包括根据所涉及的功能按基本同时的方式或按相反的顺序,来执行功能,这应被本申请的实施例所属技术领域的技术人员所理解。Any process or method description in the flowchart or described in other ways herein can be understood as a module, segment or part of code that includes one or more executable instructions for implementing custom logic functions or steps of the process , And the scope of the preferred embodiments of the present application includes additional implementations, which may not be in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order according to the functions involved. This should It is understood by those skilled in the art to which the embodiments of this application belong.
取决于语境,如在此所使用的词语“如果”可以被解释成为“在……时”或“当……时”或“响应于确定”或“响应于检测”。类似地,取决于语境,短语“如果确定”或“如果检测(陈述的条件或事件)”可以被解释成为“当确定时”或“响应于确定”或“当检测(陈述的条件或事件)时”或“响应于检测(陈述的条件或事件)”。Depending on the context, the word "if" as used herein can be interpreted as "when" or "when" or "in response to determination" or "in response to detection". Similarly, depending on the context, the phrase "if determined" or "if detected (statement or event)" can be interpreted as "when determined" or "in response to determination" or "when detected (statement or event) )" or "in response to detection (statement or event)".
需要说明的是,本申请实施例中所涉及的终端可以包括但不限于个人计算机(Personal Computer;以下简称:PC)、个人数字助理(Personal Digital Assistant;以下简称:PDA)、无线手持设备、平板电脑(Tablet Computer)、手机、MP3播放器、MP4播放器等。It should be noted that the terminals involved in the embodiments of this application may include, but are not limited to, personal computers (Personal Computer; hereinafter referred to as PC), Personal Digital Assistants (Personal Digital Assistant; hereinafter referred to as PDA), wireless handheld devices, and tablets Computer (Tablet Computer), mobile phone, MP3 player, MP4 player, etc.
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如,多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed system, device, and method may be implemented in other ways. For example, the device embodiments described above are merely illustrative, for example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined Or it can be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能单元的形式实现。In addition, the functional units in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware, or may be implemented in the form of hardware plus software functional units.
上述以软件功能单元的形式实现的集成的单元,可以存储在一个计算机可读取存储介质中。上述软件功能单元存储在一个存储介质中,包括若干指令用以使得一台计算机装置(可以是个人计算机,服务器,或者网络装置等)或处理器(Processor)执行本申请各个实施例所述方法的部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-Only Memory;以下简称:ROM)、随机存取存储器(Random Access Memory; 以下简称:RAM)、磁碟或者光盘等各种可以存储程序代码的介质。The above-mentioned integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium. The above-mentioned software functional unit is stored in a storage medium and includes several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (Processor) execute the method described in each embodiment of the present application Part of the steps. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory; hereinafter referred to as ROM), random access memory (Random Access Memory; hereinafter referred to as RAM), magnetic disks or optical disks, etc. A medium that can store program codes.
以上所述仅为本申请的较佳实施例而已,并不用以限制本申请,凡在本申请的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本申请保护的范围之内。The above are only the preferred embodiments of this application and are not intended to limit this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included in this application Within the scope of protection.

Claims (26)

  1. 一种光学指纹识别的校准方法,其特征在于,包括:A calibration method for optical fingerprint recognition, characterized in that it comprises:
    在屏幕根据媒介物的按压区域分别显示屏幕显示光斑和特定图案时,通过光学指纹传感器分别采集指纹图像和参考图像,其中所述指纹图像为包含所述媒介物的指纹的图像,所述参考图像为包含所述特定图案的图像;When the screen displays the screen display light spot and the specific pattern according to the pressing area of the medium, the fingerprint image and the reference image are respectively collected by the optical fingerprint sensor, wherein the fingerprint image is an image containing the fingerprint of the medium, and the reference image Is an image containing the specific pattern;
    根据所述参考图像中所述特定图案的强度信息对所述屏幕所显示的光的强度进行检测,并根据参考图像中所述特定图案的位置信息检测所述光学指纹传感器与所述屏幕的相对位移;Detect the intensity of the light displayed on the screen according to the intensity information of the specific pattern in the reference image, and detect the relative position of the optical fingerprint sensor and the screen according to the position information of the specific pattern in the reference image Displacement
    根据检测获得的所述屏幕所显示的光的强度和所述相对位移,对所述指纹图像进行校准。The fingerprint image is calibrated according to the detected intensity of the light displayed on the screen and the relative displacement.
  2. 根据权利要求1所述的方法,其特征在于,还包括:The method according to claim 1, further comprising:
    根据所述媒介物在所述屏幕上的按压区域,控制所述屏幕显示所述屏幕显示光斑和所述特定图案。According to the pressing area of the medium on the screen, the screen is controlled to display the screen display spot and the specific pattern.
  3. 根据权利要求2所述的方法,其特征在于,所述屏幕显示光斑和所述特定图案同时在所述屏幕进行显示;The method according to claim 2, wherein the screen display spot and the specific pattern are simultaneously displayed on the screen;
    其中,所述屏幕显示光斑显示在所述按压区域所在的位置,所述特定图案叠加显示在所述屏幕显示光斑中;或者,所述特定图案与所述屏幕显示光斑分别显示在所述按压区域中的不同位置。Wherein, the screen display light spot is displayed at the position of the pressing area, and the specific pattern is superimposed and displayed in the screen display light spot; or, the specific pattern and the screen display light spot are respectively displayed in the pressing area In different locations.
  4. 根据权利要求3所述的方法,其特征在于,所述特定图案叠加显示在所述屏幕显示光斑中,并且,所述特定图案为预定宽度的线条组成的图案,所述特定图案的颜色为与所述屏幕显示光斑的颜色不同的任意颜色。The method according to claim 3, wherein the specific pattern is superimposed and displayed in the screen display spot, and the specific pattern is a pattern composed of lines with a predetermined width, and the color of the specific pattern is and The screen displays any colors with different colors of light spots.
  5. 根据权利要求3所述的方法,其特征在于,所述特定图案与所述屏幕显示光斑分别显示在所述按压区域中的不同位置,并且,所述特定图案为预定宽度的线条组成的图案,所述特定图案的颜色为与所述屏幕的背景颜色不同的任意颜色。The method according to claim 3, wherein the specific pattern and the screen display spot are respectively displayed at different positions in the pressing area, and the specific pattern is a pattern composed of lines with a predetermined width, The color of the specific pattern is any color different from the background color of the screen.
  6. 根据权利要求2所述的方法,其特征在于,所述屏幕显示光斑和所述特定图案分时先后在所述屏幕上进行显示。The method according to claim 2, wherein the screen display light spot and the specific pattern are displayed on the screen successively in a time-sharing manner.
  7. 根据权利要求6所述的方法,其特征在于,所述特定图案为预定宽度的线条组成的图案,所述特定图案的颜色为与所述屏幕的背景颜色不同的任意颜色。7. The method according to claim 6, wherein the specific pattern is a pattern composed of lines of a predetermined width, and the color of the specific pattern is any color different from the background color of the screen.
  8. 根据权利要求6所述的方法,其特征在于,所述特定图案为预定宽度的线条和预定图形组成的图案,所述特定图案的颜色为与所述屏幕的背景颜色不同的任意颜色。The method according to claim 6, wherein the specific pattern is a pattern composed of lines with a predetermined width and a predetermined figure, and the color of the specific pattern is any color different from the background color of the screen.
  9. 根据权利要求8所述的方法,其特征在于,所述根据所述参考图像中所述特定图案的强度信息对所述屏幕所显示的光的强度进行检测,并根据所述参考图像中所述特定图案的位置信息检测所述光学指纹传感器与所述屏幕的相对位移包括:The method according to claim 8, wherein the detecting the intensity of the light displayed on the screen according to the intensity information of the specific pattern in the reference image, and detecting the intensity of the light displayed in the reference image according to the The position information of a specific pattern detecting the relative displacement of the optical fingerprint sensor and the screen includes:
    根据所述参考图像中所述预定宽度的线条图案的强度信息,对所述屏幕所显示的光的强度进行检测,根据所述参考图像中所述预定图形图案的位置信息,检测所述光学指纹传感器与所述屏幕的相对位移。Detect the intensity of the light displayed on the screen according to the intensity information of the line pattern of the predetermined width in the reference image, and detect the optical fingerprint according to the position information of the predetermined graphic pattern in the reference image The relative displacement of the sensor and the screen.
  10. 根据权利要求8所述的方法,其特征在于,所述特定图案中处于不同位置的预定图形的颜色不同;8. The method according to claim 8, characterized in that the colors of predetermined graphics in different positions in the specific pattern are different;
    所述方法还包括:The method also includes:
    在通过光学指纹传感器采集所述参考图像之后,根据所述媒介物对所述预定图形的不同颜色光的反射率,确定所述媒介物的颜色,以对所述媒介物进行防伪检测。After the reference image is collected by the optical fingerprint sensor, the color of the medium is determined according to the reflectance of the medium to the light of different colors of the predetermined pattern, so as to perform anti-counterfeiting detection on the medium.
  11. 根据权利要求6所述的方法,其特征在于,所述特定图案为预定宽度的线条组成的图案,或者所述特定图案为空白图案,所述特定图案的颜色为与所述屏幕的背景颜色不同的任意颜色;The method according to claim 6, wherein the specific pattern is a pattern composed of lines with a predetermined width, or the specific pattern is a blank pattern, and the color of the specific pattern is different from the background color of the screen Any color of
    其中,所述特定图案先在所述屏幕进行显示,再叠加显示所述特定图案和屏幕显示光斑。Wherein, the specific pattern is first displayed on the screen, and then the specific pattern and the screen display spot are superimposed and displayed.
  12. 根据权利要求11所述的方法,其特征在于,还包括:The method according to claim 11, further comprising:
    在所述特定图案在所述屏幕进行显示之后,通过所述光学指纹传感器采集一帧包含所述特定图案和环境光的图像;After the specific pattern is displayed on the screen, collecting an image including the specific pattern and ambient light by the optical fingerprint sensor;
    在叠加显示所述特定图案和屏幕显示光斑之后,通过所述光学指纹传感器采集一帧包含所述媒介物的指纹和环境光的图像;After superimposing and displaying the specific pattern and the screen display light spot, collecting a frame of image containing the fingerprint of the medium and the ambient light by the optical fingerprint sensor;
    将包含所述媒介物的指纹和环境光的图像与包含所述特定图案和环境光的图像进行相减操作,以消除环境光对指纹识别的影响。A subtraction operation is performed on the image containing the fingerprint of the medium and the ambient light and the image containing the specific pattern and the ambient light to eliminate the influence of the ambient light on fingerprint recognition.
  13. 一种光学指纹识别的校准装置,其特征在于,包括:A calibration device for optical fingerprint recognition, characterized in that it comprises:
    采集模块,用于在屏幕根据媒介物的按压区域分别显示屏幕显示光斑和特定图案时,通过光学指纹传感器分别采集指纹图像和参考图像,其中所述指纹图像为包含所述媒介物的指纹的图像,所述参考图像为包含所述特定图案的图像;The collection module is used to collect a fingerprint image and a reference image through the optical fingerprint sensor when the screen displays the screen display light spot and the specific pattern according to the pressing area of the medium, wherein the fingerprint image is an image containing the fingerprint of the medium , The reference image is an image containing the specific pattern;
    检测模块,用于根据所述参考图像中所述特定图案的强度信息对所述屏幕所显示的光的强度进行检测,并根据所述参考图像中所述特定图案的位置信息检测所述光学指纹传感器与所述屏幕的相对位移;The detection module is configured to detect the intensity of the light displayed on the screen according to the intensity information of the specific pattern in the reference image, and detect the optical fingerprint according to the position information of the specific pattern in the reference image The relative displacement of the sensor and the screen;
    校准模块,用于根据所述检测模块检测获得的所述屏幕所显示的光的强度和所述相对位移,对所述指纹图像进行校准。The calibration module is configured to calibrate the fingerprint image according to the intensity of the light displayed on the screen and the relative displacement obtained by the detection module.
  14. 根据权利要求13所述的装置,其特征在于,还包括:The device according to claim 13, further comprising:
    显示控制模块,用于根据所述媒介物在所述屏幕上的按压区域,控制所述屏幕显示所述屏幕显示光斑和所述特定图案。The display control module is configured to control the screen to display the screen display light spot and the specific pattern according to the pressing area of the medium on the screen.
  15. 根据权利要求14所述的装置,其特征在于,所述屏幕显示光斑和所述特定图案同时在所述屏幕进行显示;The device according to claim 14, wherein the screen display spot and the specific pattern are simultaneously displayed on the screen;
    其中,所述屏幕显示光斑显示在所述按压区域所在的位置,所述特定图案叠加显示在所述屏幕显示光斑中;或者,所述特定图案与所述屏幕显示光斑分别显示在所述按压区域中的不同位置。Wherein, the screen display light spot is displayed at the position of the pressing area, and the specific pattern is superimposed and displayed in the screen display light spot; or, the specific pattern and the screen display light spot are respectively displayed in the pressing area In different locations.
  16. 根据权利要求15所述的装置,其特征在于,所述特定图案叠加显示在所述屏幕显示光斑中,并且,所述特定图案为预定宽度的线条组成的图案,所述特定图案的颜色为与所述屏幕显示光斑的颜色不同的任意颜色。The device according to claim 15, wherein the specific pattern is superimposed and displayed in the screen display spot, and the specific pattern is a pattern composed of lines with a predetermined width, and the color of the specific pattern is and The screen displays any colors with different colors of light spots.
  17. 根据权利要求15所述的装置,其特征在于,所述特定图案与所述屏幕显示光斑分别显示在所述按压区域中的不同位置,并且,所述特定图案为预定宽度的线条组成的图案,所述特定图案的颜色为与所述屏幕的背景颜色不同的任意颜色。15. The device according to claim 15, wherein the specific pattern and the screen display spot are respectively displayed at different positions in the pressing area, and the specific pattern is a pattern composed of lines with a predetermined width, The color of the specific pattern is any color different from the background color of the screen.
  18. 根据权利要求14所述的装置,其特征在于,The device according to claim 14, wherein:
    所述屏幕显示光斑和所述特定图案分时先后在所述屏幕上进行显示。The screen display spot and the specific pattern are sequentially displayed on the screen in a time-sharing manner.
  19. 根据权利要求18所述的装置,其特征在于,所述特定图案为预定宽度的线条组成的图案,所述特定图案的颜色为与所述屏幕的背景颜色不同的任意颜色。18. The device according to claim 18, wherein the specific pattern is a pattern composed of lines of a predetermined width, and the color of the specific pattern is any color different from the background color of the screen.
  20. 根据权利要求18所述的装置,其特征在于,所述特定图案为预定宽度的线条和预定图形组成的图案,所述特定图案的颜色为与所述屏幕的背景颜色不同的任意颜色。The device according to claim 18, wherein the specific pattern is a pattern composed of lines with a predetermined width and a predetermined figure, and the color of the specific pattern is any color different from the background color of the screen.
  21. 根据权利要求20所述的装置,其特征在于,The device according to claim 20, wherein:
    所述检测模块,具体用于根据所述参考图像中所述预定宽度的线条图案的强度信息,对所述屏幕所显示的光的强度进行检测,根据所述参考图像中所述预定图形图案的位置信息,检测所述光学指纹传感器与所述屏幕的相对位移。The detection module is specifically configured to detect the intensity of the light displayed on the screen according to the intensity information of the line pattern of the predetermined width in the reference image, and to detect the intensity of the predetermined graphic pattern in the reference image. The position information detects the relative displacement of the optical fingerprint sensor and the screen.
  22. 根据权利要求20所述的装置,其特征在于,所述特定图案中处于不同位置的预定图形的颜色不同;The device according to claim 20, wherein the colors of the predetermined graphics at different positions in the specific pattern are different;
    所述检测模块,还用于在所述采集模块通过光学指纹传感器采集所述参考图像之后,根据所述媒介物对所述预定图形的不同颜色光的反射率,确定所述媒介物的颜色,以对所述媒介物进行防伪检测。The detection module is further configured to determine the color of the medium according to the reflectivity of the medium to the light of different colors of the predetermined pattern after the collection module collects the reference image through the optical fingerprint sensor, In order to perform anti-counterfeiting detection on the medium.
  23. 根据权利要求18所述的装置,其特征在于,所述特定图案为预定宽度的线条组成的图案,或者所述特定图案为空白图案,所述特定图案的颜色为与所述屏幕的背景颜色不同的任意颜色;The device according to claim 18, wherein the specific pattern is a pattern composed of lines with a predetermined width, or the specific pattern is a blank pattern, and the color of the specific pattern is different from the background color of the screen Any color of
    所述显示控制模块,具体用于控制所述特定图案先在所述屏幕进行显示,再叠加显示所述特定图案和屏幕显示光斑。The display control module is specifically configured to control the specific pattern to be displayed on the screen first, and then superimpose and display the specific pattern and the screen display spot.
  24. 根据权利要求23所述的装置,其特征在于,The device according to claim 23, wherein:
    所述采集模块,还用于在所述显示控制模块控制显示所述特定图案之后,通过所述光学指纹传感器采集一帧包含所述特定图案和环境光的图像;在所述显示控制模块叠加显示所述特定图案和屏幕显示光斑之后,通过所述光学指纹传感器采集一帧包含所述媒介物的指纹和环境光的图像;The collection module is further configured to collect a frame of images containing the specific pattern and ambient light through the optical fingerprint sensor after the display control module controls to display the specific pattern; superimpose and display on the display control module After the specific pattern and the screen display the light spot, collecting a frame of image containing the fingerprint of the medium and the ambient light by the optical fingerprint sensor;
    所述校准模块,还用于将包含所述媒介物的指纹和环境光的图像与包含所述特定图案和环境光的图像进行相减操作,以消除环境光对指纹识别的影响。The calibration module is also used to subtract the image containing the fingerprint and ambient light of the medium with the image containing the specific pattern and ambient light, so as to eliminate the influence of ambient light on fingerprint recognition.
  25. 一种电子设备,其特征在于,包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时,实现如权利要求1-12中任一所述的方法。An electronic device, comprising a memory, a processor, and a computer program stored on the memory and capable of running on the processor, and when the processor executes the computer program, the implementation is as claimed in claim 1. -12 The method described in any one.
  26. 一种非临时性计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现如权利要求1-12中任一所述的方法。A non-transitory computer-readable storage medium with a computer program stored thereon, wherein the computer program implements the method according to any one of claims 1-12 when the computer program is executed by a processor.
PCT/CN2019/088128 2019-05-23 2019-05-23 Calibration method and device for optical fingerprint identification and electronic equipment WO2020232696A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201980000780.0A CN112513871B (en) 2019-05-23 2019-05-23 Calibration method and device for optical fingerprint identification and electronic equipment
PCT/CN2019/088128 WO2020232696A1 (en) 2019-05-23 2019-05-23 Calibration method and device for optical fingerprint identification and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/088128 WO2020232696A1 (en) 2019-05-23 2019-05-23 Calibration method and device for optical fingerprint identification and electronic equipment

Publications (1)

Publication Number Publication Date
WO2020232696A1 true WO2020232696A1 (en) 2020-11-26

Family

ID=73459320

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/088128 WO2020232696A1 (en) 2019-05-23 2019-05-23 Calibration method and device for optical fingerprint identification and electronic equipment

Country Status (2)

Country Link
CN (1) CN112513871B (en)
WO (1) WO2020232696A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113766218A (en) * 2021-09-14 2021-12-07 北京集创北方科技股份有限公司 Position detection method for optical lens, electronic device, and storage medium
CN115706751A (en) * 2021-08-09 2023-02-17 北京小米移动软件有限公司 Image acquisition method and device, electronic equipment and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001033494A1 (en) * 1999-10-29 2001-05-10 Cross Match Technologies, Inc. Hand-held fingerprint scanner with on-board image normalization data storage
CN106650614A (en) * 2016-11-07 2017-05-10 上海与德信息技术有限公司 Dynamic calibration method and apparatus
CN108844961A (en) * 2018-08-01 2018-11-20 佛山科学技术学院 A kind of temperature controller case vision detection system and method

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2562682B1 (en) * 2011-08-24 2014-10-08 DERMALOG Identification Systems GmbH Method and device for capture of a fingerprint with authenticity recognition
KR101756344B1 (en) * 2016-03-07 2017-07-27 주식회사 에스원 Improvement System of Fingerprint Recognition Rate through Revision of Illumination Sensor and Method thereof
CN106164933B (en) * 2016-03-22 2019-06-07 深圳市汇顶科技股份有限公司 Bearing calibration, device and the terminal of fingerprint image
CN107657240B (en) * 2017-10-09 2020-11-24 上海天马微电子有限公司 Display device, fingerprint identification calibration method thereof and electronic equipment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001033494A1 (en) * 1999-10-29 2001-05-10 Cross Match Technologies, Inc. Hand-held fingerprint scanner with on-board image normalization data storage
CN106650614A (en) * 2016-11-07 2017-05-10 上海与德信息技术有限公司 Dynamic calibration method and apparatus
CN108844961A (en) * 2018-08-01 2018-11-20 佛山科学技术学院 A kind of temperature controller case vision detection system and method

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115706751A (en) * 2021-08-09 2023-02-17 北京小米移动软件有限公司 Image acquisition method and device, electronic equipment and storage medium
CN113766218A (en) * 2021-09-14 2021-12-07 北京集创北方科技股份有限公司 Position detection method for optical lens, electronic device, and storage medium
CN113766218B (en) * 2021-09-14 2024-05-14 北京集创北方科技股份有限公司 Position detection method of optical lens, electronic device and storage medium

Also Published As

Publication number Publication date
CN112513871A (en) 2021-03-16
CN112513871B (en) 2024-03-22

Similar Documents

Publication Publication Date Title
US11138927B2 (en) Electronic device having display
US11074855B2 (en) Devices and methods for providing access to internal component
US11545085B2 (en) Electronic device having display
US9372540B2 (en) Method and electronic device for gesture recognition
TWI742471B (en) A driving method of a portable data-processing device
CN105723300B (en) Determining segmentation boundaries based on an image representing an object
US10788908B2 (en) Electronic device including optical structure
CN110870072A (en) Image sensor including light-shielding member for blocking interference between plurality of light-receiving sensors, and electronic device including the same
US20210175297A1 (en) Electronic device with display portion
CN110209273A (en) Gesture identification method, interaction control method, device, medium and electronic equipment
US20180246617A1 (en) Transparent interactive touch system and method
CN113763856B (en) Method and device for determining ambient illumination intensity and storage medium
CN107967467B (en) OLED display panel, driving method thereof and display device
US11854310B2 (en) Face liveness detection method and related apparatus
WO2019200529A1 (en) Image processing method and apparatus, and electronic device
WO2020232696A1 (en) Calibration method and device for optical fingerprint identification and electronic equipment
US9658702B2 (en) System and method of object recognition for an interactive input system
US10823589B2 (en) Electronic device and method for controlling sensitivity of sensor on basis of window attributes
CN109313866A (en) With the near-infrared transparence display frame in following coding pattern
EP3418971B1 (en) Display method and handheld electronic device
US20150015613A1 (en) Data processing device and data processing system
US11776297B2 (en) Coordinate transformation method used for imaging under screen, storage medium and electronic device
CN114067757A (en) Data processing method and device and display device
CN213028136U (en) Mobile terminal
US9779691B2 (en) Display front of screen performance architecture

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19929491

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19929491

Country of ref document: EP

Kind code of ref document: A1