CN109543558B - Fingerprint image processing method and related product - Google Patents

Abstract

Embodiments of the present application disclose a fingerprint image processing method and related products, which include: when a fingerprint collection instruction is detected, determining the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module; lighting all The second area of the screen, the emitted light in the second area is associated with the first optical noise, the second optical noise and the first light, the first optical noise includes the reflected light, the reflected light is the light of the second light reflected by the screen, the second The light is the light whose illumination direction extends along the positive Z-axis of the screen. The second optical noise includes direct light. The direct light is the light whose illumination direction is reverse along the Z-axis of the screen. The first light is the emitted light passing through the user's fingerprint. Reflected light; only the first light is collected through the effective collection area, and the fingerprint image is obtained after processing. The embodiments of the present application are beneficial to reducing the impact of optical noise on fingerprint image acquisition and improving the accuracy and speed of fingerprint image processing.

Description

Fingerprint image processing methods and related products

Technical field

This application relates to the technical field of electronic equipment, and specifically to a fingerprint image processing method and related products.

Background technique

The principle of under-screen fingerprint collection is to use the light emitted by the screen to illuminate the finger placed on the screen. When the light emitted by the screen reaches the finger, it is reflected. The optical fingerprint module set under the screen receives the reflected light signal and forms a fingerprint image.

At present, due to the uneven texture of fingerprints, the light absorption amplitude is different, resulting in fingerprint images with different light and dark. The optical fingerprint module will affect the quality of the collected fingerprint images due to some optical noise, which in turn affects the processing and matching of fingerprint images.

Contents of the invention

Embodiments of the present application provide a fingerprint image processing method and related products, which can reduce the impact of optical noise on fingerprint image acquisition and improve the accuracy and speed of fingerprint image processing.

In a first aspect, embodiments of the present application provide a fingerprint image processing method applied to an electronic device. The electronic device includes a screen and an under-screen fingerprint module arranged relative to a first area of the screen. The method includes:

When a fingerprint collection instruction is detected, determine the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module. The second area includes an annular area or a non-annular independent area or multiple separate areas. , the collection area corresponding to the unlit display area surrounded by the inner ring of the annular area is the effective collection area, and the collection area corresponding to the area of the screen other than the non-annular independent area includes the effective collection area. Collection area, the collection area corresponding to the unlit display area between at least two separation areas among the plurality of separation areas is the effective collection area;

Lighting a second area of the screen, wherein the emitted light of the second area is associated with first optical noise, second optical noise and first light, the first optical noise includes reflected light, and the reflected light is The second light is the light reflected by the screen. The second light is the light whose illumination direction extends along the positive Z-axis of the screen in the emitted light. The second optical noise includes direct light, and the direct light is the Among the emitted light rays, the illumination direction is in the opposite direction along the Z-axis of the screen, and the first light ray is the light ray reflected by the user's fingerprint by the emitted light ray;

Only the first light is collected through the effective collection area, and a fingerprint image is obtained after processing.

In a second aspect, embodiments of the present application provide a fingerprint image processing device for use in electronic equipment. The electronic equipment includes a screen and an under-screen fingerprint module arranged relative to a first area of the screen. The fingerprint image processing device The device includes a determination unit, a lighting unit and a processing unit, wherein:

The determination unit is configured to determine the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module when a fingerprint collection instruction is detected. The second area includes an annular area or a non-annular area. Independent area or multiple separated areas, the collection area corresponding to the unlit display area surrounded by the inner ring of the annular area is the effective collection area, and the area of the screen other than the non-annular independent area corresponds to The collection area includes the effective collection area, and the collection area corresponding to the unlit display area between at least two separation areas among the plurality of separation areas is the effective collection area;

The lighting unit is used to light a second area of the screen, wherein the emitted light of the second area is associated with first optical noise, second optical noise and first light, and the first optical noise includes Reflected light, the reflected light is the second light reflected by the screen, the second light is the light of the emitted light whose illumination direction extends along the positive Z-axis of the screen, the second optical noise includes direct light , the direct light is the light whose illumination direction is reversed along the Z-axis of the screen in the emitted light, and the first light is the light reflected by the user's fingerprint of the emitted light;

The processing unit is configured to collect only the first light through the effective collection area, and obtain a fingerprint image after processing.

In a third aspect, embodiments of the present application provide an electronic device, including: a processor, a memory, and one or more programs; the one or more programs are stored in the above-mentioned memory and are configured to be configured by the The processor executes the program, and the program includes instructions for executing the steps described in any method of the first aspect of the embodiment of the present application.

In a fourth aspect, embodiments of the present application provide a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange. The computer program specifically includes instructions, and the instructions are used to execute As part or all of the steps described in any method of the first aspect of the embodiment of this application, the computer includes an electronic device.

In a fifth aspect, embodiments of the present application provide a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause the computer to execute the following steps: Some or all of the steps described in any method of the first aspect of the application embodiment. The computer program product may be a software installation package, and the computer includes electronic equipment.

It can be seen that in the embodiment of the present application, when the electronic device detects a fingerprint collection instruction, it first determines the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module, and then lights all the areas. The second area of the screen, the emitted light in the second area is associated with first optical noise, second optical noise and first light, the first optical noise includes reflected light, the reflected light is the second light passing through The light reflected by the screen, the second light is the light whose illumination direction extends along the positive Z-axis of the screen in the emitted light, and the second optical noise includes direct light, and the direct light is the illumination direction of the emitted light. The light extending in the opposite direction along the Z-axis of the screen, and finally, only the first light is collected through the effective collection area, and the fingerprint image is obtained after processing. It can be seen that the electronic device only lights up the second area and does not light up the effective collection area of the fingerprint module, which can effectively avoid the impact of the first optical noise and the second optical noise on the fingerprint module when collecting fingerprint images, and only collects passed fingerprints. The first light reflected to the effective collection area is beneficial to improving the accuracy of fingerprint image formation, and after acquiring the first light, the process of filtering out optical noise can be reduced and the fingerprint image is directly formed, which is beneficial to improving the speed of fingerprint image formation. .

Description of drawings

In order to explain the embodiments of the present application or the technical solutions in the prior art more clearly, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without exerting creative efforts.

Figure 1A is a schematic flowchart of a fingerprint image processing method disclosed in an embodiment of the present application;

Figure 1B is a schematic diagram of an under-screen fingerprint module disclosed in an embodiment of the present application;

Figure 1C is a schematic diagram of the effective collection area and the second area of an under-screen fingerprint module disclosed in the embodiment of the present application;

Figure 1D is a schematic diagram of the effective collection area and the second area of another under-screen fingerprint module disclosed in the embodiment of the present application;

1E is a schematic diagram of the effective collection area and the second area of another under-screen fingerprint module disclosed in the embodiment of the present application;

Figure 1F is a schematic diagram of the second area emitting light disclosed in the embodiment of the present application;

1G is a schematic diagram of the positional relationship between the first contact area, the first screen reference area and the second area disclosed in the embodiment of the present application;

Figure 2 is a schematic flow chart of another fingerprint image processing method disclosed in the embodiment of the present application;

Figure 3 is a schematic flow chart of another fingerprint image processing method disclosed in the embodiment of the present application;

Figure 4 is a schematic structural diagram of an electronic device disclosed in an embodiment of the present application;

Figure 5 is a functional unit block diagram of a fingerprint image processing device disclosed in the embodiment of the present application;

Figure 6 is a schematic structural diagram of a smart phone disclosed in an embodiment of the present application.

Detailed ways

In order to enable those in the technical field to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only These are part of the embodiments of this application, but not all of them. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of this application.

The terms "first", "second", etc. in the description and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than describing a specific sequence. Furthermore, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally also includes unlisted steps or units, or optionally also includes Other steps or units inherent to such processes, methods, products or devices.

Reference herein to "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The appearances of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those skilled in the art understand, both explicitly and implicitly, that the embodiments described herein may be combined with other embodiments.

The electronic devices involved in the embodiments of the present application may include various handheld devices with wireless communication functions, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to wireless modems, as well as various forms of user equipment (User Equipment, UE), mobile station (Mobile Station, MS), terminal equipment (terminal device), etc. For convenience of description, the devices mentioned above are collectively referred to as electronic devices. The embodiments of this application are introduced in detail below.

Please refer to FIG. 1A. FIG. 1A is a schematic flow chart of a fingerprint image processing method provided by an embodiment of the present application. It is applied to an electronic device. The electronic device includes a screen and an under-screen fingerprint model arranged relative to a first area of the screen. Group, as shown in the figure, this fingerprint image processing method includes:

S101. When the electronic device detects a fingerprint collection instruction, it determines the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module;

Wherein, the under-screen fingerprint module is arranged in the space between the screen and the back shell corresponding to the first area of the screen. As shown in Figure 1B, the shape of the first area can be various, for example, it can be an ellipse. shape, rectangle, etc., the size of the first area is smaller than or equal to the size of the screen, which is not limited here.

The fingerprint collection instruction may be a finger pressing the screen when the screen is off, or it may be an instruction to collect fingerprints for payment when the screen is on, etc., which are not limited here.

There is no overlapping area between the second area and the effective collection area of the under-screen fingerprint module, and the emitted light after the second area is lit includes light that can illuminate the user's finger, and this part of the light can It is reflected by the user's finger to the effective collection area of the under-screen fingerprint module for the under-screen fingerprint module to collect fingerprint images. The second area includes an annular area or a non-annular independent area or multiple separate areas. The inner area of the annular area is The collection area corresponding to the unlit display area surrounded by the ring is the effective collection area. As shown in Figure 1C, the collection area corresponding to the area of the screen other than the non-annular independent area includes the effective collection area. area, as shown in FIG. 1D , the collection area corresponding to the unlit display area between at least two separation areas among the plurality of separation areas is the effective collection area, as shown in FIG. 1E .

S102. The electronic device lights up a second area of the screen. The emitted light in the second area is associated with first optical noise, second optical noise and first light. The first optical noise includes reflected light, so The reflected light is a second light reflected by the screen, and the second light is a light whose illumination direction extends along the positive Z-axis of the screen in the emitted light. The second optical noise includes direct light, and the direct light The light is the light whose illumination direction is reversed along the Z-axis of the screen in the emitted light, and the first light is the light reflected by the user's fingerprint of the emitted light;

Among them, the screen area covering the effective collection area of the under-screen fingerprint module is in an extinguished state.

Among them, the first optical noise is the reflected light of the light ray whose illumination direction extends along the positive Z-axis of the screen in the second area. Then the first optical noise is the light whose illumination direction extends along the negative Z-axis of the screen, that is, in the second area For light directed downwards from the vertical screen, since the effective collection area of the under-screen fingerprint module is set to have no overlap with the second area, the first optical noise will not be collected and will not affect the collection of fingerprint images. , the first optical noise can be eliminated.

Among them, the second optical noise is the direct light ray whose illumination direction is opposite to the Z-axis of the screen among the light emitted in the second area. It is also the light downward vertical to the screen in the second area. Therefore, it is based on the same reason as the above-mentioned first optical noise. , the second optical noise can be eliminated, as shown in Figure 1F, including the first optical noise, the second optical noise and the first light.

S103: The electronic device collects only the first light through the effective collection area, and obtains a fingerprint image after processing.

It can be seen that in the embodiment of the present application, when the electronic device detects a fingerprint collection instruction, it first determines the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module, and then lights all the areas. The second area of the screen, the emitted light in the second area is associated with first optical noise, second optical noise and first light, the first optical noise includes reflected light, the reflected light is the second light passing through The light reflected by the screen, the second light is the light whose illumination direction extends along the positive Z-axis of the screen in the emitted light, and the second optical noise includes direct light, and the direct light is the illumination direction of the emitted light. The light extending in the opposite direction along the Z-axis of the screen, and finally, only the first light is collected through the effective collection area, and the fingerprint image is obtained after processing. It can be seen that the electronic device only lights up the second area and does not light up the effective collection area of the fingerprint module, which can effectively avoid the impact of the first optical noise and the second optical noise on the fingerprint module when collecting fingerprint images, and only collects passed fingerprints. The first light reflected to the effective collection area is beneficial to improving the accuracy of fingerprint image formation, and after acquiring the first light, the process of filtering out optical noise can be reduced and the fingerprint image is directly formed, which is beneficial to improving the speed of fingerprint image formation. .

In a possible example, determining the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module includes:

Obtain the first contact area between the user's finger and the screen;

Determine that the collection area corresponding to the first screen reference area including the first contact area is the effective collection area of the under-screen fingerprint module;

It is determined that an annular area in the screen whose surrounding area includes the first screen reference area is the second area, and the surrounding area is an area surrounded by an inner ring of the annular area.

Wherein, the area of the first screen reference area including the first contact area is greater than or equal to the first contact area, and the area of the first screen reference area is less than the first preset area threshold. This is because , if the area of the first screen reference area is greater than the first preset area threshold, it will cause the second area to be far away from the finger, and then the emitted light from the second area will not be able to illuminate the user's finger to form a fingerprint image. Based on the same The reason is that the area of the surrounding area should be greater than or equal to the first screen reference area and less than the second preset area threshold. The area of the first contact area, the first screen reference area and the second area The positional relationship is shown in Figure 1G.

The first preset area threshold and the second area threshold are empirical values, which can be values set by technical developers of the electronic device based on multiple verification data before the electronic device leaves the factory, and are not limited here.

It can be seen that in this example, the electronic device determines the effective collection area and the second area of the under-screen fingerprint module based on the first contact area between the user's finger and the screen, which is beneficial to improving the accuracy of area setting, and the second area is Setting it as a ring area is beneficial to improving the integrity of fingerprint image acquisition.

In a possible example, determining the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module includes:

Obtain the second contact area between the user's finger and the screen;

Determine that the collection area corresponding to the second screen reference area including the second contact area is the effective collection area of the under-screen fingerprint module;

A non-annular independent area in the screen other than the second screen reference area is determined to be the second area, and the irradiation light of the non-annular independent area includes the light irradiating to the contact area.

The shape of the non-annular independent area may be half annular, or three-quarter annular, or half rectangular, etc., which is not limited here. The second screen reference area is the same as the above-mentioned first screen reference area. setting method.

The specific implementation methods for determining that the non-annular independent area in the screen other than the second screen reference area is the second area can be various. For example, it can be determined based on the current power level. The area of the screen based on the battery capacity determines the non-annular independent area based on the area. Moreover, in order to ensure the integrity of the fingerprint image acquisition after lighting up the non-annular independent area, the shape of the non-annular independent area should be as large as possible under the same area. Including the second contact area, that is to say, the shape of the non-annular independent area can make the illumination light include as much light as possible that illuminates different positions of the contact area, rather than just being provided in the contact area. The position on one side, or the non-annular independent area may be determined based on the broken screen state of the display screen, which is not limited here.

It can be seen that in this example, the electronic device determines the effective collection area and the second area of the under-screen fingerprint module based on the second contact area between the user's finger and the screen, which is beneficial to improving the diversity of the second area, and furthermore, converting the second area Setting it as a non-annular independent area can reduce power consumption compared to an annular area.

In a possible example, determining the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module includes:

Obtain the third contact area between the user's finger and the screen;

Determine that the collection area corresponding to the third screen reference area including the third contact area is the effective collection area of the under-screen fingerprint module;

Determine the maximum reference area of the screen to be lit based on the third contact area;

A plurality of separation areas in the maximum reference area are determined to be the second areas, and the irradiation light of each separation area includes the light irradiation to the contact area.

Wherein, the shape of each separation area in the plurality of separation areas may be the same or different, for example, it may be a rectangle, a triangle, a circle, etc., which is not limited here. The third screen reference area is the same as the above-mentioned first How to set the screen reference area.

Wherein, the maximum reference area is the maximum area that can be set as the second area, that is to say, the emitted light rays in areas other than the maximum reference area and the third screen reference area do not include light irradiating the contact area. , the specific implementation method of determining the maximum reference area of the screen to be lit according to the third contact area may be various, for example, it may be based on the position of the third contact area and the preset third contact The maximum reference area is determined by the positional relationship between the area and the maximum reference area, or the maximum reference area can be determined based on the mapping relationship between the area of the third contact area and the area of the maximum reference area, which is not limited here.

Wherein, when the electronic device determines that the plurality of separation areas in the maximum reference area are the second areas, the positions and shapes of the plurality of separation areas set each time may be random, thereby enhancing the diversity of the setting.

It can be seen that in this example, the electronic device determines the effective collection area and the second area of the under-screen fingerprint module based on the third contact area between the user's finger and the screen, which is beneficial to improving the accuracy of the effective collection area and the second area setting, and, Setting the second area into multiple separate areas will help improve the diversity and interest of the second area setting.

In a possible example, after collecting only the first light through the effective collection area and obtaining the fingerprint image after processing, the method further includes:

Perform a fingerprint comparison process according to the fingerprint image to obtain a comparison result;

If the comparison result is a match, perform an unlocking operation;

If the comparison result is no match, the unlocking operation is not performed.

Among them, when the matching degree between the fingerprint image and the preset fingerprint image during the fingerprint comparison process is less than the preset matching degree threshold, it is a mismatch, and if it is greater than or equal to the matching degree threshold, it is a match.

It can be seen that in this example, the electronic device performs a fingerprint comparison process based on the fingerprint image. When the comparison result is a match, the unlocking operation is performed, which is beneficial to improving the security of the electronic device.

In this possible example, if the comparison result is a match, performing an unlocking operation includes:

Determine the area size of the area where the irradiation light of the second area to be lit on the screen irradiates the user's finger;

Determine the target matching degree according to the size of the area;

When the matching degree of the comparison result is greater than the target matching degree, the unlocking operation is performed.

For example, when the second area is a ring-shaped area, the illuminating light can illuminate the entire area of the user's finger, and when the second area is a non-annular independent area, the illuminating light can illuminate part of the user's finger. Therefore, different The completeness of the fingerprint images acquired in the region is different, so different target matching degrees are used.

It can be seen that in this example, the electronic device determines the target matching degree based on the size of the area where the second area irradiation light can illuminate the user's finger, which is beneficial to improving the rationality of fingerprint image matching and improving the success rate of matching.

In a possible example, before determining the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module when a fingerprint collection instruction is detected, the method further includes:

Detect the display status of the screen;

When it is detected that the display state of the screen is a bright screen state, the first area is turned off.

It can be seen that in this example, before determining the second area and the effective collection area, the electronic device first detects the display state of the screen. When the screen is in the full screen bright state, the first area, that is, the first area including the effective collection area is turned off. , which is conducive to improving the accuracy of eliminating the influence of the first optical noise and the second optical noise.

Consistent with the embodiment shown in Figure 1A, please refer to Figure 2. Figure 2 is a schematic flow chart of another fingerprint image processing method provided by an embodiment of the present application, applied to an electronic device, and the electronic device includes a screen and As shown in the figure, the fingerprint image processing method includes:

S201. When the electronic device detects a fingerprint collection instruction, obtain the first contact area between the user's finger and the screen.

S202: The electronic device determines that the collection area corresponding to the first screen reference area including the first contact area is the effective collection area of the under-screen fingerprint module.

S203: The electronic device determines that the annular area in the screen that is surrounded by the first screen reference area is the second area, and the enclosing area is the area surrounded by the inner ring of the annular area.

S204, the electronic device lights a second area of the screen, the emitted light of the second area is associated with the first optical noise, the second optical noise and the first light, the first optical noise includes reflected light, so The reflected light is a second light reflected by the screen, and the second light is a light whose illumination direction extends along the positive Z-axis of the screen in the emitted light. The second optical noise includes direct light, and the direct light The light is the light whose illumination direction is reversed along the Z-axis of the screen in the emitted light, and the first light is the light reflected by the user's fingerprint of the emitted light.

S205: The electronic device collects only the first light through the effective collection area, and obtains a fingerprint image after processing.

S206: The electronic device performs a fingerprint comparison process based on the fingerprint image to obtain a comparison result.

S207: The electronic device determines the area size of the area where the irradiation light of the second area to be lit on the screen irradiates the user's finger.

S208: The electronic device determines the target matching degree according to the area size.

S209: When the matching degree of the comparison result is greater than the target matching degree, the electronic device performs the unlocking operation.

It can be seen that in the embodiment of the present application, when the electronic device detects a fingerprint collection instruction, it first determines the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module, and then lights all the areas. The second area of the screen, the emitted light in the second area is associated with first optical noise, second optical noise and first light, the first optical noise includes reflected light, the reflected light is the second light passing through The light reflected by the screen, the second light is the light whose illumination direction extends along the positive Z-axis of the screen in the emitted light, and the second optical noise includes direct light, and the direct light is the illumination direction of the emitted light. The light extending in the opposite direction along the Z-axis of the screen, and finally, only the first light is collected through the effective collection area, and the fingerprint image is obtained after processing. It can be seen that the electronic device only lights up the second area and does not light up the effective collection area of the fingerprint module, which can effectively avoid the impact of the first optical noise and the second optical noise on the fingerprint module when collecting fingerprint images, and only collects passed fingerprints. The first light reflected to the effective collection area is beneficial to improving the accuracy of fingerprint image formation, and after acquiring the first light, the process of filtering out optical noise can be reduced and the fingerprint image is directly formed, which is beneficial to improving the speed of fingerprint image formation. .

In addition, the electronic device determines the effective collection area and the second area of the under-screen fingerprint module based on the first contact area between the user's finger and the screen, which is beneficial to improving the accuracy of area setting, and the second area is set as a ring area. , which is conducive to improving the integrity of fingerprint image acquisition.

In addition, the electronic device determines the target matching degree based on the size of the area where the second area irradiation light can illuminate the user's finger, which is beneficial to improving the rationality of fingerprint image matching and improving the success rate of matching.

Consistent with the embodiment shown in FIG. 1A , please refer to FIG. 3 . FIG. 3 is a schematic flowchart of another fingerprint image processing method provided by an embodiment of the present application. It is applied to an electronic device. The electronic device includes a screen and a screen. As shown in the figure, the fingerprint image processing method includes:

S301. The electronic device detects the display state of the screen.

S302: When the electronic device detects that the display state of the screen is a bright screen state, the electronic device turns off the first area.

S303: When the electronic device detects a fingerprint collection instruction, obtain the third contact area between the user's finger and the screen.

S304: The electronic device determines that the collection area corresponding to the third screen reference area including the third contact area is the effective collection area of the under-screen fingerprint module.

S305: The electronic device determines the maximum reference area of the screen to be lit based on the third contact area.

S306: The electronic device determines a plurality of separation areas in the maximum reference area as second areas, and the irradiation light of each separation area includes the light irradiation to the contact area.

S307. The electronic device lights up a second area of the screen. The emitted light in the second area is associated with first optical noise, second optical noise and first light. The first optical noise includes reflected light, so The reflected light is a second light reflected by the screen, and the second light is a light whose illumination direction extends along the positive Z-axis of the screen in the emitted light. The second optical noise includes direct light, and the direct light The light is the light whose illumination direction is reversed along the Z-axis of the screen in the emitted light, and the first light is the light reflected by the user's fingerprint of the emitted light.

S308: The electronic device collects only the first light through the effective collection area, and obtains a fingerprint image after processing.

It can be seen that in the embodiment of the present application, when the electronic device detects a fingerprint collection instruction, it first determines the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module, and then lights all the areas. The second area of the screen, the emitted light in the second area is associated with first optical noise, second optical noise and first light, the first optical noise includes reflected light, the reflected light is the second light passing through The light reflected by the screen, the second light is the light whose illumination direction extends along the positive Z-axis of the screen in the emitted light, and the second optical noise includes direct light, and the direct light is the illumination direction of the emitted light. The light extending in the opposite direction along the Z-axis of the screen, and finally, only the first light is collected through the effective collection area, and the fingerprint image is obtained after processing. It can be seen that the electronic device only lights up the second area and does not light up the effective collection area of the fingerprint module, which can effectively avoid the impact of the first optical noise and the second optical noise on the fingerprint module when collecting fingerprint images, and only collects passed fingerprints. The first light reflected to the effective collection area is beneficial to improving the accuracy of fingerprint image formation, and after acquiring the first light, the process of filtering out optical noise can be reduced and the fingerprint image is directly formed, which is beneficial to improving the speed of fingerprint image formation. .

In addition, the electronic device determines the effective collection area and the second area of the under-screen fingerprint module based on the third contact area between the user's finger and the screen, which is conducive to improving the accuracy of setting the effective collection area and the second area, and the second area is Setting it up as multiple separate areas will help improve the diversity and interest of the second area setting.

In addition, before determining the second area and the effective collection area, the electronic device first detects the display state of the screen. When the screen is in the full-screen bright state, the first area, that is, the first area including the effective collection area, is beneficial to improvement. Accurately eliminate the influence of the first optical noise and the second optical noise.

Consistent with the embodiments shown in FIG. 1A, FIG. 2, and FIG. 3, please refer to FIG. 4. FIG. 4 is a schematic structural diagram of an electronic device provided by an embodiment of the present application. The electronic device includes a screen and a screen relative to the screen. An under-screen fingerprint module is provided in the first area. As shown in the figure, the electronic device includes a processor 401, a memory 402, a communication interface 403, and one or more programs 404, wherein the one or more programs 404 are stored In the above-mentioned memory 402, and configured to be executed by the above-mentioned processor 401, the above-mentioned program 404 includes instructions for performing the following steps;

When a fingerprint collection instruction is detected, determine the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module. The second area includes an annular area or a non-annular independent area or multiple separate areas. , the collection area corresponding to the unlit display area surrounded by the inner ring of the annular area is the effective collection area, and the collection area corresponding to the area of the screen other than the non-annular independent area includes the effective collection area. Collection area, the collection area corresponding to the unlit display area between at least two separation areas among the plurality of separation areas is the effective collection area;

Lighting a second area of the screen, wherein the emitted light of the second area is associated with first optical noise, second optical noise and first light, the first optical noise includes reflected light, and the reflected light is The second light is the light reflected by the screen. The second light is the light whose illumination direction extends along the positive Z-axis of the screen in the emitted light. The second optical noise includes direct light, and the direct light is the Among the emitted light rays, the illumination direction is in the opposite direction along the Z-axis of the screen, and the first light ray is the light ray reflected by the user's fingerprint by the emitted light ray;

Only the first light is collected through the effective collection area, and a fingerprint image is obtained after processing.

It can be seen that in the embodiment of the present application, when the electronic device detects a fingerprint collection instruction, it first determines the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module, and then lights all the areas. The second area of the screen, the emitted light in the second area is associated with first optical noise, second optical noise and first light, the first optical noise includes reflected light, the reflected light is the second light passing through The light reflected by the screen, the second light is the light whose illumination direction extends along the positive Z-axis of the screen in the emitted light, and the second optical noise includes direct light, and the direct light is the illumination direction of the emitted light. The light extending in the opposite direction along the Z-axis of the screen, and finally, only the first light is collected through the effective collection area, and the fingerprint image is obtained after processing. It can be seen that the electronic device only lights up the second area and does not light up the effective collection area of the fingerprint module, which can effectively avoid the impact of the first optical noise and the second optical noise on the fingerprint module when collecting fingerprint images, and only collects passed fingerprints. The first light reflected to the effective collection area is beneficial to improving the accuracy of fingerprint image formation, and after acquiring the first light, the process of filtering out optical noise can be reduced and the fingerprint image is directly formed, which is beneficial to improving the speed of fingerprint image formation. .

In one possible example, in terms of determining the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module, the instructions in the program 404 are specifically used to perform the following operations: obtain The first contact area between the user's finger and the screen; and for determining that the collection area corresponding to the first screen reference area including the first contact area is the effective collection area of the under-screen fingerprint module; and for determining The annular area in the screen that includes the first screen reference area is the second area, and the enclosing area is the area surrounded by the inner ring of the annular area.

In one possible example, in terms of determining the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module, the instructions in the program 404 are specifically used to perform the following operations: obtain The second contact area between the user's finger and the screen; and for determining that the collection area corresponding to the second screen reference area including the second contact area is the effective collection area of the under-screen fingerprint module; and for determining The non-annular independent area in the screen except the second screen reference area is the second area, and the irradiation light of the non-annular independent area includes the light irradiating to the contact area.

In one possible example, in terms of determining the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module, the instructions in the program 404 are specifically used to perform the following operations: obtain The third contact area between the user's finger and the screen; and for determining that the collection area corresponding to the third screen reference area including the third contact area is the effective collection area of the under-screen fingerprint module; and for determining according to The third contact area determines the maximum reference area of the screen to be lit; and is used to determine a plurality of separated areas in the maximum reference area as the second area, and the irradiation light of each separated area includes Light hitting the contact area.

In a possible example, the above program 404 also includes instructions for performing the following steps: collecting only the first light ray through the effective collection area, obtaining a fingerprint image after processing, and performing fingerprint processing based on the fingerprint image. A comparison process to obtain a comparison result; and for performing an unlocking operation if the comparison result is a match; and for not performing the unlocking operation if the comparison result is a mismatch.

In this possible example, in terms of performing an unlocking operation if the comparison result is a match, the instructions in the program 404 are specifically used to perform the following operations: determine the second area of the screen to be lit. The area size of the area where the illumination light irradiates the user's finger; and for determining the target matching degree according to the area size; and for executing the step when the matching degree of the comparison result is greater than the target matching degree. Unlock operation.

In a possible example, the above program 404 also includes instructions for performing the following steps: when detecting a fingerprint collection instruction, determining the second area of the screen to be lit and the location of the under-screen fingerprint module. Before effectively collecting the area, the display state of the screen is detected; and when it is detected that the display state of the screen is a bright screen state, the first area is turned off.

The above mainly introduces the solution of the embodiment of the present application from the perspective of the execution process on the method side. It can be understood that, in order to implement the above functions, the electronic device includes corresponding hardware structures and/or software modules that perform each function. Persons skilled in the art should easily realize that, with the units and algorithm steps of each example described in conjunction with the embodiments provided herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving the hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each specific application, but such implementations should not be considered beyond the scope of this application.

Embodiments of the present application can divide the electronic device into functional units according to the above method examples. For example, each functional unit can be divided corresponding to each function, or two or more functions can be integrated into one processing unit. The above integrated units can be implemented in the form of hardware or software functional units. It should be noted that the division of units in the embodiment of the present application is schematic and is only a logical function division. In actual implementation, there may be other division methods.

FIG. 5 is a functional unit block diagram of the fingerprint image processing device 500 involved in the embodiment of the present application. The fingerprint image processing device 500 is applied to electronic equipment. The electronic device includes a screen and an under-screen fingerprint module arranged relative to a first area of the screen. The fingerprint image processing device 500 includes a determining unit 501, a lighting unit 502 and a Processing unit 503, wherein,

The determination unit 501 is configured to determine the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module when a fingerprint collection instruction is detected. The second area includes an annular area or a non-circular area. An annular independent area or multiple separate areas, the collection area corresponding to the unlit display area surrounded by the inner ring of the annular area is the effective collection area, and the area of the screen other than the non-annular independent area The corresponding collection area includes the effective collection area, and the collection area corresponding to the unlit display area between at least two separation areas among the plurality of separation areas is the effective collection area;

The lighting unit 502 is used to light a second area of the screen, wherein the emitted light of the second area is associated with first optical noise, second optical noise and first light, and the first optical noise Including reflected light, the reflected light is the light reflected by the screen of the second light, the second light is the light of the emitted light whose illumination direction extends along the positive Z-axis of the screen, the second optical noise includes direct radiation Light, the direct light is the light whose illumination direction is reversed along the Z-axis of the screen in the emitted light, and the first light is the light reflected by the user's fingerprint of the emitted light;

The processing unit 503 is configured to collect only the first light through the effective collection area, and obtain a fingerprint image after processing.

It can be seen that in the embodiment of the present application, when the electronic device detects a fingerprint collection instruction, it first determines the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module, and then lights all the areas. The second area of the screen, the emitted light in the second area is associated with first optical noise, second optical noise and first light, the first optical noise includes reflected light, the reflected light is the second light passing through The light reflected by the screen, the second light is the light whose illumination direction extends along the positive Z-axis of the screen in the emitted light, and the second optical noise includes direct light, and the direct light is the illumination direction of the emitted light. The light extending in the opposite direction along the Z-axis of the screen, and finally, only the first light is collected through the effective collection area, and the fingerprint image is obtained after processing. It can be seen that the electronic device only lights up the second area and does not light up the effective collection area of the fingerprint module, which can effectively avoid the impact of the first optical noise and the second optical noise on the fingerprint module when collecting fingerprint images, and only collects passed fingerprints. The first light reflected to the effective collection area is beneficial to improving the accuracy of fingerprint image formation, and after acquiring the first light, the process of filtering out optical noise can be reduced and the fingerprint image is directly formed, which is beneficial to improving the speed of fingerprint image formation. .

In one possible example, in determining the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module, the determination unit 501 is specifically configured to: obtain the relationship between the user's finger and the The first contact area of the screen; and for determining that the collection area corresponding to the first screen reference area including the first contact area is the effective collection area of the under-screen fingerprint module; and for determining the area surrounding the screen An annular area including the first screen reference area is the second area, and the surrounding area is an area surrounded by an inner ring of the annular area.

In one possible example, in determining the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module, the determination unit 501 is specifically configured to: obtain the relationship between the user's finger and the The second contact area of the screen; and for determining that the collection area corresponding to the second screen reference area including the second contact area is the effective collection area of the under-screen fingerprint module; and for determining the area except for the second contact area on the screen. The non-annular independent area outside the second screen reference area is the second area, and the irradiation light of the non-annular independent area includes the light irradiating to the contact area.

In one possible example, in determining the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module, the determination unit 501 is specifically configured to: obtain the relationship between the user's finger and the The third contact area of the screen; and for determining that the collection area corresponding to the third screen reference area including the third contact area is the effective collection area of the under-screen fingerprint module; and for determining according to the third contact area The area determines the maximum reference area of the screen to be lit; and is used to determine a plurality of separated areas in the maximum reference area as the second area, and the irradiation light of each of the separated areas includes irradiation to the contact area of light.

In a possible example, the processing unit 503 collects only the first light through the effective collection area and obtains a fingerprint image after processing, and is further configured to: perform a fingerprint comparison process based on the fingerprint image. , to obtain the comparison result; and for performing the unlocking operation if the comparison result is a match; and for not performing the unlocking operation if the comparison result is a mismatch.

In this possible example, in terms of performing an unlocking operation if the comparison result is a match, the processing unit 503 is specifically configured to: determine whether the irradiation light of the second area to be lit on the screen is illuminated. The area size of the area of the user's finger; and for determining a target matching degree according to the area size; and for performing the unlocking operation when the matching degree of the comparison result is greater than the target matching degree.

In a possible example, the lighting unit further uses To: detect the display state of the screen; and when it is detected that the display state of the screen is a bright screen state, extinguish the first area.

The determining unit 501 and the processing unit 503 may be processors, and the lighting unit 502 may be a display.

Please refer to Figure 6. Figure 6 is a schematic structural diagram of a smart phone 600 provided by an embodiment of the present application. The smart phone 600 includes: a casing 610, a screen 620, and a mainboard 630. The mainboard 630 is provided with a camera 631 and a processor 632. , memory 633, power management chip 634, under-screen fingerprint module 635, etc.

Wherein, when the smartphone 600 detects the fingerprint collection instruction, it determines the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module. The second area includes an annular area or a non-annular independent area. area or multiple separate areas, the collection area corresponding to the unlit display area surrounded by the inner ring of the annular area is the effective collection area, and the area corresponding to the area of the screen other than the non-annular independent area The collection area includes the effective collection area, and the collection area corresponding to the unlit display area between at least two separation areas among the plurality of separation areas is the effective collection area; the second area of the screen is lit , wherein the emitted light in the second area is associated with first optical noise, second optical noise and first light. The first optical noise includes reflected light, and the reflected light is the second light reflected by the screen. Light, the second light is the light whose illumination direction extends along the positive Z-axis of the screen in the emitted light, and the second optical noise includes direct light, and the direct light is the illumination direction of the emitted light which extends along the Z-axis of the screen Reverse light, the first light is the light reflected by the user's fingerprint from the emitted light; only the first light is collected through the effective collection area, and a fingerprint image is obtained after processing.

The above-mentioned processor 632 is the control center of the smartphone, using various interfaces and lines to connect various parts of the entire smartphone, by running or executing software programs and/or modules stored in the memory 633, and calling software programs stored in the memory 633. data, perform various functions of the smartphone and process the data, thereby performing overall monitoring of the smartphone. Optionally, the processor 632 may include one or more processing units; preferably, the processor 632 may integrate an application processor and a modem processor, where the application processor mainly processes operating systems, user interfaces, application programs, etc. , the modem processor mainly handles wireless communications. It can be understood that the above-mentioned modem processor may not be integrated into the processor 632. The processor 632 may be, for example, a central processing unit (Central Processing Unit, CPU), a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application-specific integrated circuit (Application-Specific Integrated Circuit, ASIC), or field programmable. Gate array (Field Programmable GateArray, FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It may implement or execute the various illustrative logical blocks, modules, and circuits described in connection with this disclosure. The above-mentioned processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and so on.

The above-mentioned memory 633 can be used to store software programs and modules. The processor 632 executes various functional applications and data processing of the smart phone by running the software programs and modules stored in the memory 633 . The memory 633 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, at least one application program required for a function, etc.; the stored data area may store data created according to the use of the smart phone, etc. In addition, the memory 633 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. The memory 633 can be, for example, random access memory (Random Access Memory, RAM), flash memory, read only memory (Read Only Memory, ROM), erasable programmable read only memory (Erasable Programmable ROM, EPROM), electrically erasable memory. Programming read-only memory (Electrically EPROM, EEPROM), register, hard disk, mobile hard disk, CD-ROM or any other form of storage media well known in the art.

Embodiments of the present application also provide a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program causes the computer to execute any of the fingerprint image processing methods described in the above method embodiments. For some or all of the steps, the above-mentioned computer includes a mobile terminal.

Embodiments of the present application also provide a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program. The computer program is operable to cause the computer to execute the steps described in the above method embodiments. Some or all steps of any fingerprint image processing method, the above-mentioned computer includes a mobile terminal.

It should be noted that for the sake of simple description, the foregoing method embodiments are expressed as a series of action combinations. However, those skilled in the art should know that the present application is not limited by the described action sequence. Because in accordance with this application, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily necessary for this application.

In the above embodiments, each embodiment is described with its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or may be Integrated into another system, or some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated units can be implemented in the form of hardware or software functional units.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application is essentially or contributes to the existing technology, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory, It includes several instructions to cause a computer device (which can be a personal computer, a server or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of this application. The aforementioned memory includes: U disk, read-only memory (ROM), random access memory (RAM), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program. The program can be stored in a computer-readable memory, and the memory can include: a flash disk, Read-Only Memory (ROM), Random Access Memory (RAM), magnetic disk or optical disk, etc.

The embodiments of the present application have been introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and the core idea of the present application; at the same time, for Those of ordinary skill in the art will have changes in the specific implementation and application scope based on the ideas of the present application. In summary, the content of this description should not be understood as a limitation of the present application.

Claims (10)

1. A fingerprint image processing method, characterized in that it is applied to an electronic device. The electronic device includes a screen and an under-screen fingerprint module arranged relative to a first area of the screen. The method includes: When a fingerprint collection instruction is detected, the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module are determined. The second area is located in the first area and is connected to the under-screen fingerprint module. There is no overlapping area in the effective collection area of the fingerprint module. The second area includes an annular area or a non-annular independent area or multiple separate areas. If the second area includes an annular area, the inner ring of the annular area is surrounded by The collection area corresponding to the unlit display area is the effective collection area; if the second area includes a non-annular independent area, the collection area corresponding to the area of the screen other than the non-annular independent area includes all The effective collection area; if the second area includes multiple separation areas, the collection area corresponding to the unlit display area between at least two separation areas among the multiple separation areas is the effective collection area; Lighting a second area of the screen, wherein the emitted light of the second area is associated with first optical noise, second optical noise and first light, the first optical noise includes reflected light, and the reflected light is The second light is the light reflected by the screen. The second light is the light whose illumination direction extends along the positive Z-axis of the screen in the emitted light. The second optical noise includes direct light, and the direct light is the Among the emitted light rays, the illumination direction is in the opposite direction along the Z-axis of the screen, and the first light ray is the light ray reflected by the user's fingerprint by the emitted light ray; Only the first light is collected through the effective collection area, and a fingerprint image is obtained after processing. 2. The method of claim 1, wherein determining the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module includes: Obtain the first contact area corresponding to when the user's finger contacts the screen; Determine that the collection area corresponding to the first screen reference area including the first contact area is the effective collection area of the under-screen fingerprint module; The annular area surrounding the first screen reference area in the screen is determined to be the second area. 3. The method of claim 1, wherein determining the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module includes: Obtain the second contact area between the user's finger and the screen; Determine that the collection area corresponding to the second screen reference area including the second contact area is the effective collection area of the under-screen fingerprint module; A non-annular independent area in the screen other than the second screen reference area is determined to be the second area, and the irradiation light of the non-annular independent area includes the light irradiating to the contact area. 4. The method of claim 1, wherein determining the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module includes: Obtain the third contact area between the user's finger and the screen; Determine that the collection area corresponding to the third screen reference area including the third contact area is the effective collection area of the under-screen fingerprint module; Determine the maximum reference area of the screen to be lit based on the third contact area; A plurality of separation areas in the maximum reference area are determined to be the second areas, and the irradiation light of each separation area includes the light irradiation to the contact area. 5. The method according to any one of claims 1 to 4, characterized in that after collecting only the first light through the effective collection area and obtaining the fingerprint image after processing, the method further includes: Perform a fingerprint comparison process according to the fingerprint image to obtain a comparison result; If the comparison result is a match, perform an unlocking operation; If the comparison result is no match, the unlocking operation is not performed. 6. The method of claim 5, wherein if the comparison result is a match, performing an unlocking operation includes: Determine the area size of the area where the irradiation light of the second area to be lit on the screen irradiates the user's finger; Determine the target matching degree according to the size of the area; When the matching degree of the comparison result is greater than the target matching degree, the unlocking operation is performed. 7. The method of claim 6, wherein when a fingerprint collection instruction is detected, before determining the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module, The method also includes: Detect the display status of the screen; When it is detected that the display state of the screen is a bright screen state, the first area is turned off. 8. A fingerprint image processing device, characterized in that it is applied to an electronic device. The electronic device includes a screen and an under-screen fingerprint module arranged relative to a first area of the screen. The fingerprint image processing device includes a determination unit. , lighting unit and processing unit, where: The determination unit is configured to determine the second area of the screen to be lit and the effective collection area of the under-screen fingerprint module when a fingerprint collection instruction is detected, and the second area is located in the first area. There is no overlapping area with the effective collection area of the under-screen fingerprint module. The second area includes an annular area or a non-annular independent area or multiple separate areas. If the second area includes an annular area, the second area includes an annular area. The collection area corresponding to the unlit display area surrounded by the inner ring of the annular area is the effective collection area; if the second area includes a non-annular independent area, the other areas of the screen other than the non-annular independent area The collection area corresponding to the area includes the effective collection area; if the second area includes multiple separation areas, the collection area corresponding to the unlit display area between at least two separation areas in the multiple separation areas is The effective collection area; The lighting unit is used to light a second area of the screen, wherein the emitted light of the second area is associated with first optical noise, second optical noise and first light, and the first optical noise includes Reflected light, the reflected light is the second light reflected by the screen, the second light is the light of the emitted light whose illumination direction extends along the positive Z-axis of the screen, the second optical noise includes direct light , the direct light is the light whose illumination direction is reversed along the Z-axis of the screen in the emitted light, and the first light is the light reflected by the user's fingerprint of the emitted light; The processing unit is configured to collect only the first light through the effective collection area, and obtain a fingerprint image after processing. 9. An electronic device, characterized by comprising: a processor, a memory, and one or more programs; the one or more programs are stored in the memory and configured to be executed by the processor , the program includes instructions for performing steps in the method described in any one of claims 1-7. 10. A computer-readable storage medium, characterized by storing a computer program for electronic data exchange, wherein the computer program causes the computer to execute the method according to any one of claims 1-7, the computer Includes electronic equipment.