CN109543558B

CN109543558B - Fingerprint image processing method and related product

Info

Publication number: CN109543558B
Application number: CN201811283339.1A
Authority: CN
Inventors: 吴安平
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2018-10-30
Filing date: 2018-10-30
Publication date: 2023-12-26
Anticipated expiration: 2038-10-30
Also published as: CN109543558A

Abstract

The embodiment of the application discloses a fingerprint image processing method and related products, comprising the following steps: when a fingerprint acquisition instruction is detected, determining a second area to be lightened of the screen and an effective acquisition area of the under-screen fingerprint module; the second area of the screen is lightened, the emitted light rays of the second area are related to first optical noise, second optical noise and first light rays, the first optical noise comprises reflected light rays, the reflected light rays are light rays reflected by the screen, the second light rays are light rays with the irradiation direction extending along the Z axis of the screen in the emitted light rays, the second optical noise comprises direct light rays, the direct light rays are light rays with the irradiation direction extending along the Z axis of the screen in the emitted light rays in the reverse direction, and the first light rays are light rays reflected by fingerprints of a user; and only collecting the first light through the effective collecting area, and obtaining the fingerprint image after processing. The embodiment of the application is beneficial to reducing the influence of optical noise on fingerprint image acquisition and improving the accuracy and speed of fingerprint image processing.

Description

Fingerprint image processing method and related product

Technical Field

The application relates to the technical field of electronic equipment, in particular to a fingerprint image processing method and related products.

Background

The under-screen fingerprint collection principle is that the light emitted by the screen is utilized to irradiate the finger placed on the screen, the light emitted by the screen is reflected when reaching the finger, and the optical fingerprint module arranged below the screen receives the reflected light signal to form a fingerprint image.

At present, due to uneven fingerprint lines, light absorption amplitude is different, so that fingerprint images with different brightness are obtained, and the quality of the collected fingerprint images can be influenced by the optical fingerprint module due to some optical noise, so that the processing and matching of the fingerprint images are influenced.

Disclosure of Invention

The embodiment of the application provides a fingerprint image processing method and related products, which can reduce the influence of optical noise on fingerprint image acquisition and improve the accuracy and speed of fingerprint image processing.

In a first aspect, an embodiment of the present application provides a fingerprint image processing method, which is applied to an electronic device, where the electronic device includes a screen and an under-screen fingerprint module set disposed opposite to a first area of the screen, and the method includes:

when a fingerprint acquisition instruction is detected, determining a second area to be lightened of the screen and an effective acquisition area of the under-screen fingerprint module, wherein the second area comprises an annular area or a non-annular independent area or a plurality of separation areas, an acquisition area corresponding to an unlighted display area surrounded by an inner ring of the annular area is the effective acquisition area, an acquisition area corresponding to an area except the non-annular independent area of the screen comprises the effective acquisition area, and an acquisition area corresponding to an unlighted display area between at least two separation areas in the plurality of separation areas is the effective acquisition area;

The method comprises the steps that a second area of a screen is lightened, wherein emitted light rays of the second area are related to first optical noise, second optical noise and first light rays, the first optical noise comprises reflected light rays, the reflected light rays are light rays of the second light rays reflected by the screen, the second light rays are light rays of the emitted light rays, the irradiation direction of the light rays is forward along the Z axis of the screen, the second optical noise comprises direct light rays, the direct light rays are light rays of the emitted light rays, the irradiation direction of the light rays is backward along the Z axis of the screen, and the first light rays are light rays of the emitted light rays reflected by fingerprints of a user;

and collecting only the first light through the effective collecting area, and obtaining a fingerprint image after processing.

In a second aspect, an embodiment of the present application provides a fingerprint image processing apparatus, which is applied to an electronic device, where the electronic device includes a screen and an off-screen fingerprint module set opposite to a first area of the screen, and the fingerprint image processing apparatus includes a determining unit, a lighting unit, and a processing unit, where:

the determining unit is configured to determine, when a fingerprint acquisition instruction is detected, a second area to be lit up of the screen and an effective acquisition area of the under-screen fingerprint module, where the second area includes an annular area or a non-annular independent area or a plurality of separate areas, an acquisition area corresponding to an unlit display area surrounded by an inner ring of the annular area is the effective acquisition area, an acquisition area corresponding to an area of the screen other than the non-annular independent area includes the effective acquisition area, and an acquisition area corresponding to an unlit display area between at least two separate areas in the plurality of separate areas is the effective acquisition area;

The lighting unit is configured to light a second area of the screen, where the emitted light of the second area is associated with first optical noise, second optical noise and first light, the first optical noise includes reflected light, the reflected light is light reflected by the screen through the second light, the second light is light with an irradiation direction along a positive direction of a Z-axis of the screen in the emitted light, the second optical noise includes direct light, the direct light is light with an irradiation direction along a reverse direction of the Z-axis of the screen in the emitted light, and the first light is light reflected by a fingerprint of a user;

and the processing unit is used for only collecting the first light through the effective collecting area and obtaining a fingerprint image after processing.

In a third aspect, an embodiment of the present application provides an electronic device, including: a processor, a memory, and one or more programs; the one or more programs are stored in the memory described above and configured to be executed by the processor, the programs including instructions for performing the steps described in any of the methods of the first aspect of the embodiments of the present application.

In a fourth aspect, embodiments of the present application provide a computer-readable storage medium storing a computer program for electronic data exchange, the computer program specifically including instructions for performing part or all of the steps described in any of the methods of the first aspect of embodiments of the present application, the computer including an electronic device.

In a fifth aspect, embodiments of the present application provide a computer program product, wherein the computer program product comprises a non-transitory computer-readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps described in any of the methods of the first aspect of embodiments of the present application. The computer program product may be a software installation package, the computer comprising an electronic device.

It can be seen that, in this embodiment of the present application, when a fingerprint acquisition instruction is detected, an electronic device determines a second area to be lit up by the screen and an effective acquisition area of the fingerprint module under the screen, then, the second area of the screen is lit up, an emission light of the second area is associated with first optical noise, second optical noise and first light, the first optical noise includes a reflection light, the reflection light is a light reflected by the screen by the second light, the second light is a light in which an irradiation direction in the emission light is forward along a Z axis of the screen, the second optical noise includes a direct light, the direct light is a light in which an irradiation direction in the emission light is reverse along the Z axis of the screen, and finally, only the first light is acquired by the effective acquisition area, and a fingerprint image is obtained after processing. Therefore, the electronic equipment only lightens the second area, but not the effective acquisition area of the fingerprint module, can effectively avoid the influence of the first optical noise and the second optical noise on the fingerprint module when acquiring the fingerprint image, only acquires the first light reflected to the effective acquisition area through the fingerprint, is favorable for improving the accuracy of fingerprint image formation, and can reduce the process of filtering the optical noise after acquiring the first light, directly forms the fingerprint image and is favorable for improving the speed of fingerprint image formation.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1A is a schematic flow chart of a fingerprint image processing method disclosed in an embodiment of the present application;

FIG. 1B is a schematic diagram of an under-screen fingerprint module disclosed in an embodiment of the present application;

fig. 1C is a schematic diagram of an effective acquisition area and a second area of an under-screen fingerprint module according to an embodiment of the present disclosure;

FIG. 1D is a schematic diagram of an effective acquisition area and a second area of an on-screen fingerprint module according to another embodiment of the present disclosure;

FIG. 1E is a schematic diagram of an effective acquisition area and a second area of an on-screen fingerprint module according to an embodiment of the present disclosure;

FIG. 1F is a schematic diagram of a second area emitting light as disclosed in an embodiment of the present application;

fig. 1G is a schematic diagram of a positional relationship among a first contact area, a first screen reference area, and a second area according to an embodiment of the present disclosure;

FIG. 2 is a flow chart of another fingerprint image processing method disclosed in an embodiment of the present application;

FIG. 3 is a flow chart of another fingerprint image processing method disclosed in an embodiment of the present application;

fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;

fig. 5 is a functional unit block diagram of a fingerprint image processing device according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of a smart phone according to an embodiment of the present application.

Detailed Description

In order to make the present application solution better understood by those skilled in the art, the following description will clearly and completely describe the technical solution in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.

The terms first, second and the like in the description and in the claims of the present application and in the above-described figures, are used for distinguishing between different objects and not for describing a particular sequential order. Furthermore, the terms "comprise" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those listed steps or elements but may include other steps or elements not listed or inherent to such process, method, article, or apparatus.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the present application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments.

The electronic device according to the embodiments of the present application may include various handheld devices, vehicle-mounted devices, wearable devices, computing devices, or other processing devices connected to a wireless modem, and various forms of User Equipment (UE), mobile Station (MS), terminal devices (terminal devices), and so on. For convenience of description, the above-mentioned devices are collectively referred to as electronic devices. The embodiments of the present application are described in detail below.

Referring to fig. 1A, fig. 1A is a schematic flow chart of a fingerprint image processing method applied to an electronic device, where the electronic device includes a screen and an off-screen fingerprint module set in a first area opposite to the screen, and as shown in the drawing, the fingerprint image processing method includes:

S101, when the electronic equipment detects a fingerprint acquisition instruction, determining a second area to be lightened of the screen and an effective acquisition area of the under-screen fingerprint module;

the under-screen fingerprint module is disposed in a space between the screen and the rear shell corresponding to the first area of the screen, as shown in fig. 1B, the shape of the first area may be various, for example, may be elliptical, rectangular, etc., and the size of the first area is smaller than or equal to the size of the screen, which is not limited herein.

The instruction for collecting the fingerprint may be that the finger presses the screen in a state that the screen is off, or may be that the screen is on, and the instruction for collecting the fingerprint to pay is not limited herein.

The second area and the effective collecting area of the under-screen fingerprint module do not have an overlapping area, the light emitted after the second area is lightened comprises light which can irradiate a finger of a user, the part of light can be reflected to the effective collecting area of the under-screen fingerprint module through the finger of the user, the under-screen fingerprint module can collect fingerprint images, the second area comprises an annular area or a non-annular independent area or a plurality of separation areas, the collecting area corresponding to the non-lightened display area surrounded by the inner ring of the annular area is the effective collecting area, as shown in fig. 1C, the collecting area corresponding to the area except the non-annular independent area of the screen comprises the effective collecting area, as shown in fig. 1D, and the collecting area corresponding to the non-lightened display area between at least two separation areas in the plurality of separation areas is the effective collecting area, as shown in fig. 1E.

S102, the electronic equipment lightens a second area of the screen, the emitted light rays of the second area are related to first optical noise, second optical noise and first light rays, the first optical noise comprises reflected light rays, the reflected light rays are light rays reflected by the screen through second light rays, the second light rays are light rays with the irradiation direction along the Z-axis forward direction of the screen in the emitted light rays, the second optical noise comprises direct light rays, the direct light rays are light rays with the irradiation direction along the Z-axis reverse direction of the screen in the emitted light rays, and the first light rays are light rays reflected by fingerprints of users;

wherein, the screen area of covering the effective collection area of fingerprint module under the screen is the extinction state.

The first optical noise is reflected light rays of light rays with the irradiation direction extending along the Z axis of the screen in the second area, and then the first optical noise is light rays with the irradiation direction extending along the Z axis of the screen in the negative direction, namely light rays with the vertical screen downward in the second area.

The second optical noise is direct light rays with the irradiation direction opposite to the Z axis of the screen in the light rays emitted by the second area, and is also light rays with the vertical screen downward in the second area, so that the second optical noise can be eliminated based on the same reason as the first optical noise, as shown in fig. 1F, and the second optical noise includes the first optical noise, the second optical noise and the first light rays.

S103, the electronic equipment only collects the first light through the effective collection area, and a fingerprint image is obtained after processing.

In one possible example, the determining the second area to be lit up of the screen and the effective collection area of the under-screen fingerprint module includes:

acquiring a first contact area between a user finger and the screen;

determining an acquisition area corresponding to a first screen reference area comprising the first contact area as an effective acquisition area of the under-screen fingerprint module;

and determining an annular area, including the first screen reference area, of the surrounding area in the screen as the second area, wherein the surrounding area is an area surrounded by an inner ring of the annular area.

The area of the first screen reference area including the first contact area is greater than or equal to the first contact area, and the area of the first screen reference area is smaller than a first preset area threshold, which is because if the area of the first screen reference area is greater than the first preset area threshold, the second area is far away from the finger, and then the emitted light of the second area cannot irradiate the finger of the user to form a fingerprint image, for the same reason, the area of the surrounding area should be greater than or equal to the first screen reference area and less than a second preset area threshold, and the positional relationship among the first contact area, the first screen reference area and the second area is shown in fig. 1G.

The first preset area threshold and the second area threshold are experience values, which may be values set by a technical developer of the electronic device according to multiple verification data before the electronic device leaves the factory, and are not limited herein.

In this example, the electronic device determines the effective collection area and the second area of the under-screen fingerprint module according to the first contact area between the finger of the user and the screen, which is favorable for improving the accuracy of the area setting, and the second area is set to be an annular area, which is favorable for improving the integrity of fingerprint image acquisition.

acquiring a second contact area between the finger of the user and the screen;

determining an acquisition area corresponding to a second screen reference area comprising the second contact area as an effective acquisition area of the under-screen fingerprint module;

and determining a non-annular independent area except the second screen reference area in the screen as the second area, wherein the irradiation light of the non-annular independent area comprises the light irradiated to the contact area.

The shape of the non-annular independent area may be a half annular shape, or three quarters annular shape, or a half rectangular shape, etc., which is not limited herein, and the second screen reference area is the same as the above-mentioned method for setting the first screen reference area.

The specific implementation manner of determining that the non-annular independent area except the second screen reference area in the screen is the second area may be various, for example, the area of the screen capable of determining the electric quantity according to the current electric quantity may be determined, the non-annular independent area may be determined according to the area, and in order to ensure the integrity of fingerprint image acquisition after the non-annular independent area is lightened as much as possible, the shape of the non-annular independent area should include the second contact area as much as possible under the same area, that is, the shape of the non-annular independent area may include as much light as possible, which irradiates different positions of the contact area, in the irradiation light, instead of being set at only one side position of the contact area, or may be determined according to the broken screen state of the display screen, which is not limited herein.

It can be seen that, in this example, the electronic device determines the effective collection area and the second area of the fingerprint module under the screen according to the second contact area between the finger of the user and the screen, which is favorable for improving the diversity of the second area, and the second area is set to be a non-annular independent area, so that the electric quantity consumption can be reduced compared with the annular area.

acquiring a third contact area between the finger of the user and the screen;

determining an acquisition area corresponding to a third screen reference area comprising the third contact area as an effective acquisition area of the under-screen fingerprint module;

determining a maximum reference area to be lightened of the screen according to the third contact area;

determining a plurality of separated regions in the maximum reference region as the second region, wherein the irradiation light of each of the separated regions includes the light irradiated to the contact region.

The shape of each of the plurality of separation areas may be the same or different, for example, may be rectangular, triangular, circular, etc., which is not limited herein, and the third screen reference area is the same as the above-mentioned method for setting the first screen reference area.

The specific implementation manner of determining the maximum reference area to be lighted according to the third contact area may be various, for example, may be the maximum reference area determined according to the position of the third contact area and the preset positional relationship between the position of the third contact area and the maximum reference area, or may be determining the maximum reference area according to the mapping relationship between the area of the third contact area and the area of the maximum reference area, which is not limited herein.

When the electronic device determines that the plurality of separation areas in the maximum reference area are the second area, the positions and the shapes of the plurality of separation areas set each time can be random, so that the diversity of the setting is enhanced.

It can be seen that, in this example, the electronic equipment confirms the effective collection region and the second region of fingerprint module under the screen according to the third contact area of user's finger and screen, is favorable to promoting the accuracy that effective collection region and second region set up, moreover, sets up the second region into a plurality of separation regions, is favorable to promoting the diversity and the interest that the second region set up.

In one possible example, the method further includes, after the capturing only the first light ray through the effective capturing area and obtaining the fingerprint image after processing the first light ray, the method further includes:

performing a fingerprint comparison process according to the fingerprint image to obtain a comparison result;

if the comparison result is matched, unlocking operation is executed;

and if the comparison result is not matched, not executing the unlocking operation.

And when the matching degree of the fingerprint image and the preset fingerprint image in the fingerprint comparison process is smaller than a preset matching degree threshold, the fingerprint image is not matched, and if the matching degree is larger than or equal to the matching degree threshold, the fingerprint image is matched.

In this example, the electronic device performs the fingerprint comparison process according to the fingerprint image, and performs the unlocking operation only when the comparison result is that the fingerprint image is matched, which is beneficial to improving the security of the electronic device.

In this possible example, if the comparison result is a match, performing an unlocking operation includes:

determining the area size of the area of the second area to be lightened of the screen, which is irradiated by the irradiation light of the second area to be lightened;

determining target matching degree according to the area size;

and when the matching degree of the comparison result is larger than the target matching degree, executing the unlocking operation.

For example, when the second region is a ring-shaped region, the irradiation light may irradiate the entire region of the user's finger, and when the second region is a non-ring-shaped independent region, the irradiation light may irradiate a partial region of the user's finger, so that the integrity of the fingerprint images acquired by different regions is different, and different target matching degrees are adopted.

In this example, the electronic device determines the target matching degree according to the size of the area where the second area irradiated by the light can irradiate the finger of the user, which is beneficial to improving the rationality of matching the fingerprint images and improving the success rate of matching.

In one possible example, the method further includes, when the fingerprint collection instruction is detected, before determining the second area to be lit up of the screen and the effective collection area of the under-screen fingerprint module:

detecting a display state of the screen;

and extinguishing the first area when the display state of the screen is detected to be a bright screen state.

In this example, before determining the second area and the effective collecting area, the electronic device detects the display state of the screen, and when the screen is in the full-screen bright-screen state, the first area, that is, the first area including the effective collecting area is extinguished, which is beneficial to improving and accurately eliminating the influence of the first optical noise and the second optical noise.

Referring to fig. 2, fig. 2 is a schematic flow chart of another fingerprint image processing method provided in the embodiment of the present application, which is consistent with the embodiment shown in fig. 1A, and is applied to an electronic device, where the electronic device includes a screen and an under-screen fingerprint module set opposite to a first area of the screen, and as shown in the figure, the fingerprint image processing method includes:

s201, when the electronic equipment detects a fingerprint acquisition instruction, a first contact area between a user finger and the screen is acquired.

S202, the electronic equipment determines an acquisition area corresponding to a first screen reference area comprising the first contact area as an effective acquisition area of the under-screen fingerprint module.

S203, the electronic device determines that an annular area, including the first screen reference area, of the surrounding area in the screen is a second area, and the surrounding area is an area surrounded by an inner ring of the annular area.

S204, the electronic equipment lights a second area of the screen, the emitted light rays of the second area are related to first optical noise, second optical noise and first light rays, the first optical noise comprises reflected light rays, the reflected light rays are light rays of which the second light rays are reflected by the screen, the second light rays are light rays of which the irradiation directions extend along the Z axis of the screen in the emitted light rays, the second optical noise comprises direct light rays, the direct light rays are light rays of which the irradiation directions extend along the Z axis of the screen in the emitted light rays in a reverse direction, and the first light rays are light rays of which the emitted light rays are reflected by fingerprints of a user.

S205, the electronic equipment only collects the first light through the effective collection area, and a fingerprint image is obtained after processing.

S206, the electronic equipment executes a fingerprint comparison process according to the fingerprint image to obtain a comparison result.

S207, the electronic device determines the area size of the area where the irradiation light of the second area to be lit of the screen is irradiated to the finger of the user.

And S208, the electronic equipment determines the target matching degree according to the area size.

S209, when the matching degree of the comparison result is larger than the target matching degree, the electronic equipment executes the unlocking operation.

In addition, the electronic equipment determines an effective acquisition area and a second area of the under-screen fingerprint module according to the first contact area of the user finger and the screen, so that the accuracy of area setting is improved, and the second area is set to be an annular area, so that the integrity of fingerprint image acquisition is improved.

In addition, the electronic equipment determines the target matching degree according to the size of the area, irradiated by the second area irradiation light, of the user finger, so that the rationality of fingerprint image matching is improved, and the matching success rate is improved.

Referring to fig. 3, fig. 3 is a schematic flow chart of another fingerprint image processing method provided in the embodiment of the present application, which is consistent with the embodiment shown in fig. 1A, and is applied to an electronic device, where the electronic device includes a screen and an under-screen fingerprint module set corresponding to a first area of the screen, and as shown in the figure, the fingerprint image processing method includes:

s301, the electronic device detects the display state of the screen.

S302, when the electronic equipment detects that the display state of the screen is a bright screen state, the first area is extinguished.

S303, when the electronic equipment detects a fingerprint acquisition instruction, acquiring a third contact area between the finger of the user and the screen.

S304, the electronic equipment determines that an acquisition area corresponding to a third screen reference area comprising the third contact area is an effective acquisition area of the under-screen fingerprint module.

S305, the electronic equipment determines the maximum reference area to be lightened of the screen according to the third contact area.

S306, the electronic device determines a plurality of separation areas in the maximum reference area as second areas, and the irradiation light of each separation area comprises the light irradiated to the contact area.

S307, the electronic device lights a second area of the screen, the emitted light rays of the second area are related to first optical noise, second optical noise and first light rays, the first optical noise comprises reflected light rays, the reflected light rays are light rays of the second light rays reflected by the screen, the second light rays are light rays of the emitted light rays, the irradiation direction of the light rays is along the positive direction of the Z axis of the screen, the second optical noise comprises direct light rays, the direct light rays are light rays of the emitted light rays, the irradiation direction of the light rays is along the reverse direction of the Z axis of the screen, and the first light rays are light rays of the emitted light rays reflected by fingerprints of users.

And S308, the electronic equipment only collects the first light through the effective collection area, and obtains a fingerprint image after processing.

In addition, the electronic equipment confirms the effective collection area and the second area of fingerprint module under the screen according to the third contact area of user's finger and screen, is favorable to promoting the accuracy that effective collection area and second area set up, moreover, sets up the second area into a plurality of separation areas, is favorable to promoting the diversity and the interest that the second area set up.

In addition, before determining the second area and the effective acquisition area, the electronic equipment detects the display state of the screen, and when the screen is in the whole-screen bright-screen state, the first area is extinguished, namely the first area comprising the effective acquisition area, so that the influence of the first optical noise and the second optical noise is improved and accurately eliminated.

Referring to fig. 4, fig. 4 is a schematic structural diagram of an electronic device provided in the embodiment of the present application, which includes a screen and an off-screen fingerprint module disposed opposite to a first area of the screen, as shown in the drawings, the electronic device includes a processor 401, a memory 402, a communication interface 403, and one or more programs 404, wherein the one or more programs 404 are stored in the memory 402 and configured to be executed by the processor 401, and the programs 404 include instructions for performing the following steps;

In one possible example, in terms of the determining the second area of the screen to be lit and the effective acquisition area of the off-screen fingerprint module, the instructions in the program 404 are specifically configured to: acquiring a first contact area between a user finger and the screen; the acquisition area corresponding to the first screen reference area comprising the first contact area is determined to be an effective acquisition area of the under-screen fingerprint module; and determining that an annular area of the screen, the annular area including the first screen reference area, is the second area, and the annular area is an area surrounded by an inner ring of the annular area.

In one possible example, in terms of the determining the second area of the screen to be lit and the effective acquisition area of the off-screen fingerprint module, the instructions in the program 404 are specifically configured to: acquiring a second contact area between the finger of the user and the screen; the acquisition area corresponding to the second screen reference area comprising the second contact area is determined to be an effective acquisition area of the under-screen fingerprint module; and determining a non-annular independent area except the second screen reference area in the screen as the second area, wherein the irradiation light of the non-annular independent area comprises the light irradiated to the contact area.

In one possible example, in terms of the determining the second area of the screen to be lit and the effective acquisition area of the off-screen fingerprint module, the instructions in the program 404 are specifically configured to: acquiring a third contact area between the finger of the user and the screen; the acquisition area corresponding to the third screen reference area comprising the third contact area is determined to be an effective acquisition area of the under-screen fingerprint module; and determining a maximum reference area to be lightened of the screen according to the third contact area; and determining a plurality of separate areas in the maximum reference area as the second area, the illumination light of each of the separate areas including light that impinges on the contact area.

In one possible example, the program 404 described above further includes instructions for performing the steps of: the effective collecting area is used for collecting the first light only, fingerprint images are obtained after processing, and then fingerprint comparison process is carried out according to the fingerprint images, so that comparison results are obtained; and the unlocking operation is executed if the comparison result is matched; and if the comparison result is not matched, not executing the unlocking operation.

In this possible example, in terms of performing an unlocking operation if the comparison result is a match, the instructions in the program 404 are specifically configured to perform the following operations: determining the area size of the area of the second area to be lightened of the screen, which is irradiated by the irradiation light of the second area to be lightened; and determining a target matching degree according to the area size; and executing the unlocking operation when the matching degree of the comparison result is greater than the target matching degree.

In one possible example, the program 404 described above further includes instructions for performing the steps of: when a fingerprint acquisition instruction is detected, before a second area to be lightened of the screen and an effective acquisition area of the under-screen fingerprint module are determined, detecting the display state of the screen; and extinguishing the first area when the display state of the screen is detected to be a bright screen state.

The foregoing description of the embodiments of the present application has been presented primarily in terms of a method-side implementation. It will be appreciated that the electronic device, in order to achieve the above-described functions, includes corresponding hardware structures and/or software modules that perform the respective functions. Those of skill in the art will readily appreciate that the elements and algorithm steps described in connection with the embodiments disclosed herein may be embodied as hardware or a combination of hardware and computer software. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The embodiment of the application may divide the functional units of the electronic device according to the above method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated in one processing unit. The integrated units may be implemented in hardware or in software functional units. It should be noted that, in the embodiment of the present application, the division of the units is schematic, which is merely a logic function division, and other division manners may be implemented in actual practice.

Fig. 5 is a functional block diagram of a fingerprint image processing device 500 according to an embodiment of the present application. The fingerprint image processing apparatus 500 is applied to an electronic device comprising a screen and an off-screen fingerprint module arranged relative to a first area of the screen, the fingerprint image processing apparatus 500 comprising a determination unit 501, a lighting unit 502 and a processing unit 503, wherein,

the determining unit 501 is configured to determine, when a fingerprint acquisition instruction is detected, a second area to be lit up of the screen and an effective acquisition area of the under-screen fingerprint module, where the second area includes an annular area or a non-annular independent area or a plurality of separate areas, an acquisition area corresponding to an unlit display area surrounded by an inner ring of the annular area is the effective acquisition area, an acquisition area corresponding to an area except the non-annular independent area of the screen includes the effective acquisition area, and an acquisition area corresponding to an unlit display area between at least two separate areas in the plurality of separate areas is the effective acquisition area;

The lighting unit 502 is configured to light a second area of the screen, where an emitted light ray of the second area is associated with a first optical noise, a second optical noise and a first light ray, the first optical noise includes a reflected light ray, the reflected light ray is a light ray reflected by the screen by a second light ray, the second light ray is a light ray with an irradiation direction along a Z-axis forward direction of the screen in the emitted light ray, the second optical noise includes a direct light ray, the direct light ray is a light ray with an irradiation direction along a Z-axis reverse direction of the screen in the emitted light ray, and the first light ray is a light ray reflected by a fingerprint of a user in the emitted light ray;

the processing unit 503 is configured to collect only the first light through the effective collecting area, and obtain a fingerprint image after processing.

In one possible example, in the aspect of determining the second area to be lit up of the screen and the effective collection area of the under-screen fingerprint module, the determining unit 501 is specifically configured to: acquiring a first contact area between a user finger and the screen; the acquisition area corresponding to the first screen reference area comprising the first contact area is determined to be an effective acquisition area of the under-screen fingerprint module; and determining that an annular area of the screen, the annular area including the first screen reference area, is the second area, and the annular area is an area surrounded by an inner ring of the annular area.

In one possible example, in the aspect of determining the second area to be lit up of the screen and the effective collection area of the under-screen fingerprint module, the determining unit 501 is specifically configured to: acquiring a second contact area between the finger of the user and the screen; the acquisition area corresponding to the second screen reference area comprising the second contact area is determined to be an effective acquisition area of the under-screen fingerprint module; and determining a non-annular independent area except the second screen reference area in the screen as the second area, wherein the irradiation light of the non-annular independent area comprises the light irradiated to the contact area.

In one possible example, in the aspect of determining the second area to be lit up of the screen and the effective collection area of the under-screen fingerprint module, the determining unit 501 is specifically configured to: acquiring a third contact area between the finger of the user and the screen; the acquisition area corresponding to the third screen reference area comprising the third contact area is determined to be an effective acquisition area of the under-screen fingerprint module; and determining a maximum reference area to be lightened of the screen according to the third contact area; and determining a plurality of separate areas in the maximum reference area as the second area, the illumination light of each of the separate areas including light that impinges on the contact area.

In a possible example, the processing unit 503 is further configured to, after the capturing only the first light ray through the effective capturing area and obtaining the fingerprint image after processing: performing a fingerprint comparison process according to the fingerprint image to obtain a comparison result; and the unlocking operation is executed if the comparison result is matched; and if the comparison result is not matched, not executing the unlocking operation.

In this possible example, in terms of performing an unlocking operation if the comparison result is a match, the processing unit 503 is specifically configured to: determining the area size of the area of the second area to be lightened of the screen, which is irradiated by the irradiation light of the second area to be lightened; and determining a target matching degree according to the area size; and executing the unlocking operation when the matching degree of the comparison result is greater than the target matching degree.

In one possible example, the lighting unit is further configured to, before the determining, when the fingerprint acquisition instruction is detected, the second area to be lit up of the screen and the effective acquisition area of the under-screen fingerprint module: detecting a display state of the screen; and extinguishing the first area when the display state of the screen is detected to be a bright screen state.

The determining unit 501 and the processing unit 503 may be processors, and the lighting unit 502 may be a display.

Referring to fig. 6, fig. 6 is a schematic structural diagram of a smart phone 600 according to an embodiment of the present application, where the smart phone 600 includes: the electronic device comprises a shell 610, a screen 620 and a main board 630, wherein a camera 631, a processor 632, a memory 633, a power management chip 634, an off-screen fingerprint module 635 and the like are arranged on the main board 630.

When a fingerprint acquisition instruction is detected, the smart phone 600 determines a second area to be lightened of the screen and an effective acquisition area of the under-screen fingerprint module, wherein the second area comprises an annular area or a non-annular independent area or a plurality of separation areas, an acquisition area corresponding to an unlit display area surrounded by an inner ring of the annular area is the effective acquisition area, an acquisition area corresponding to an area except the non-annular independent area of the screen comprises the effective acquisition area, and an acquisition area corresponding to an unlit display area between at least two separation areas in the plurality of separation areas is the effective acquisition area; the method comprises the steps that a second area of a screen is lightened, wherein emitted light rays of the second area are related to first optical noise, second optical noise and first light rays, the first optical noise comprises reflected light rays, the reflected light rays are light rays of the second light rays reflected by the screen, the second light rays are light rays of the emitted light rays, the irradiation direction of the light rays is forward along the Z axis of the screen, the second optical noise comprises direct light rays, the direct light rays are light rays of the emitted light rays, the irradiation direction of the light rays is backward along the Z axis of the screen, and the first light rays are light rays of the emitted light rays reflected by fingerprints of a user; and collecting only the first light through the effective collecting area, and obtaining a fingerprint image after processing.

The processor 632 is a control center of the smart phone, and connects various parts of the entire smart phone using various interfaces and lines, and performs various functions and processes of the smart phone by running or executing software programs and/or modules stored in the memory 633 and calling data stored in the memory 633, thereby performing overall monitoring of the smart phone. Optionally, processor 632 may include one or more processing units; preferably, the processor 632 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 632. The processor 632 may be, for example, a central processing unit (Central Processing Unit, CPU), a general purpose processor, a digital signal processor (Digital Signal Processor, DSP), an Application-specific integrated circuit (ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or perform the various exemplary logic blocks, modules, and circuits described in connection with this disclosure. The processor described above may also be a combination that performs the function of a computation, e.g., a combination comprising one or more microprocessors, a combination of a DSP and a microprocessor, and so on.

The above memory 633 may be used to store software programs and modules, and the processor 632 performs various functional applications and data processing of the smart phone by running the software programs and modules stored in the memory 633. The memory 633 may mainly include a storage program area that may store an operating system, application programs required for at least one function, and the like, and a storage data area; the storage data area may store data created according to the use of the smart phone, etc. In addition, memory 633 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. The Memory 633 may be, for example, random access Memory (Random Access Memory, RAM), flash Memory, read Only Memory (ROM), erasable programmable Read Only Memory (Erasable Programmable ROM), electrically Erasable Programmable Read Only Memory (EEPROM), registers, hard disk, a removable disk, a compact disc Read Only Memory (CD-ROM), or any other form of storage medium known in the art.

The embodiment of the application also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program makes a computer execute part or all of the steps of any one of the fingerprint image processing methods described in the embodiment of the method, and the computer includes a mobile terminal.

Embodiments of the present application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer, including a mobile terminal, to perform part or all of the steps of any one of the fingerprint image processing methods described in the method embodiments above.

It should be noted that, for simplicity of description, the foregoing method embodiments are all expressed as a series of action combinations, but it should be understood by those skilled in the art that the present application is not limited by the order of actions described, as some steps may be performed in other order or simultaneously in accordance with the present application. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily required in the present application.

In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to related descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, such as the division of the units, merely a logical function division, and there may be additional manners of dividing the actual implementation, such as multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, or may be in electrical or other forms.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present application may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a memory, including several instructions for causing a computer device (which may be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in the embodiments of the present application. And the aforementioned memory includes: a U-disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.

Those of ordinary skill in the art will appreciate that all or a portion of the steps in the various methods of the above embodiments may be implemented by a program that instructs associated hardware, and that the program may be stored in a computer readable memory, which may include: flash disk, read-Only Memory (ROM), random-access Memory (Random Access Memory, RAM), magnetic or optical disk, and the like.

The foregoing has outlined rather broadly the more detailed description of embodiments of the present application, wherein specific examples are provided herein to illustrate the principles and embodiments of the present application, the above examples being provided solely to assist in the understanding of the methods of the present application and the core ideas thereof; meanwhile, as those skilled in the art will have modifications in the specific embodiments and application scope in accordance with the ideas of the present application, the present description should not be construed as limiting the present application in view of the above.

Claims

1. A fingerprint image processing method, applied to an electronic device, the electronic device including a screen and an off-screen fingerprint module set opposite to a first area of the screen, the method comprising:

when a fingerprint acquisition instruction is detected, determining a second area to be lightened of the screen and an effective acquisition area of the under-screen fingerprint module, wherein the second area is positioned in the first area and is not overlapped with the effective acquisition area of the under-screen fingerprint module, the second area comprises an annular area or a non-annular independent area or a plurality of separation areas, and if the second area comprises an annular area, an acquisition area corresponding to an unlit display area surrounded by an inner ring of the annular area is the effective acquisition area; if the second area comprises a non-annular independent area, an acquisition area corresponding to an area of the screen except the non-annular independent area comprises the effective acquisition area; if the second area comprises a plurality of separation areas, an acquisition area corresponding to an unlit display area between at least two separation areas in the plurality of separation areas is the effective acquisition area;

2. The method of claim 1, wherein determining the second area of the screen to be lit and the effective acquisition area of the off-screen fingerprint module comprises:

acquiring a first contact area corresponding to the contact of the user finger with the screen;

and determining an annular area surrounding the first screen reference area in the screen as the second area.

3. The method of claim 1, wherein determining the second area of the screen to be lit and the effective acquisition area of the off-screen fingerprint module comprises:

acquiring a second contact area between the finger of the user and the screen;

4. The method of claim 1, wherein determining the second area of the screen to be lit and the effective acquisition area of the off-screen fingerprint module comprises:

acquiring a third contact area between the finger of the user and the screen;

5. The method of any of claims 1-4, wherein the capturing only the first light rays through the active capture area, after processing to obtain a fingerprint image, further comprises:

if the comparison result is matched, unlocking operation is executed;

6. The method of claim 5, wherein if the comparison result is a match, performing an unlocking operation comprises:

determining target matching degree according to the area size;

7. The method of claim 6, wherein upon detecting a fingerprint acquisition instruction, the method further comprises, prior to determining the second area of the screen to be lit and the active acquisition area of the off-screen fingerprint module:

detecting a display state of the screen;

8. The fingerprint image processing device is characterized by being applied to electronic equipment, wherein the electronic equipment comprises a screen and an off-screen fingerprint module arranged relative to a first area of the screen, and the fingerprint image processing device comprises a determining unit, a lighting unit and a processing unit, wherein:

the determining unit is configured to determine, when a fingerprint acquisition instruction is detected, a second area to be lit up of the screen and an effective acquisition area of the under-screen fingerprint module, where the second area is located in the first area and has no overlapping area with the effective acquisition area of the under-screen fingerprint module, the second area includes an annular area or a non-annular independent area or a plurality of separation areas, and if the second area includes an annular area, an acquisition area corresponding to an unlit display area surrounded by an inner ring of the annular area is the effective acquisition area; if the second area comprises a non-annular independent area, an acquisition area corresponding to an area of the screen except the non-annular independent area comprises the effective acquisition area; if the second area comprises a plurality of separation areas, an acquisition area corresponding to an unlit display area between at least two separation areas in the plurality of separation areas is the effective acquisition area;

9. An electronic device, comprising: a processor, a memory, and one or more programs; the one or more programs are stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps of the method as described in any of claims 1-7.

10. A computer readable storage medium storing a computer program for electronic data exchange, wherein the computer program causes a computer to perform the method of any one of claims 1-7, the computer comprising an electronic device.