WO2022247761A1

WO2022247761A1 - Electronic device, fingerprint unlocking method therefor and fingerprint unlocking device thereof

Info

Publication number: WO2022247761A1
Application number: PCT/CN2022/094328
Authority: WO
Inventors: 林华鑫
Original assignee: 维沃移动通信有限公司
Priority date: 2021-05-27
Filing date: 2022-05-23
Publication date: 2022-12-01
Also published as: CN113312598A; CN113312598B

Abstract

Disclosed in the present application is an electronic device, comprising a display screen, a housing, a fingerprint identification module, and a near-infrared emitter. The display screen is provided on the housing, the display screen and the housing form a device cavity, and the near-infrared emitter and the fingerprint identification module are provided in the device cavity. The fingerprint identification module comprises an identification chip. The identification chip comprises a plurality of first image acquisition pixels and a plurality of second image acquisition pixels. The display screen comprises a finger placement area, and the plurality of first image acquisition pixels are used for acquiring a texture image of a finger placed in the finger placement area. The plurality of second image acquisition pixels are used for acquiring a depth image of the finger, and the depth image comprises depth information representing the distance between a dermal layer and an epidermal layer of the finger.

Description

Electronic device, fingerprint unlocking method thereof, and fingerprint unlocking device

cross reference

The present invention claims the priority of the Chinese patent application submitted to the China Patent Office on May 27, 2021, with the application number 202110584690.X, and the title of the invention is "electronic equipment and its fingerprint unlocking method, and fingerprint unlocking device". The contents are incorporated herein by reference.

technical field

The present application relates to the technical field of electronic equipment, and in particular to an electronic equipment, a fingerprint unlocking method thereof, and a fingerprint unlocking device.

Background technique

With the improvement of user needs, the performance of electronic equipment continues to be optimized. Among them, the more prominent performance is that the security performance of electronic equipment is getting better and better. More and more electronic devices are equipped with optical fingerprint recognition modules installed under the display screen. This setting method of the optical fingerprint recognition module not only can realize fingerprint recognition, but also helps to realize a larger screen ratio.

However, the optical fingerprint identification module involved in the related art realizes the unlocking of the electronic device by acquiring the 2D fingerprint pattern. It is easier for criminals to obtain 2D fingerprint texture information and form fake fingerprints for fingerprint identification. For example, criminals can print fingerprints on 2D conductive paper to form fake fingerprints, or copy 2D fingerprint texture information through ink pads to form fake fingerprints, etc. Obviously, these fake fingerprints will pass the fingerprint verification of electronic devices, which will eventually cause a relatively large security risk. It can be seen that electronic devices equipped with such optical fingerprint recognition modules still have relatively large security problems.

Contents of the invention

The present application discloses an electronic device, which can solve the problem in the related art that the electronic device can be unlocked only through 2D fingerprint lines, which leads to a relatively large security risk in the electronic device.

In order to solve the problems of the technologies described above, the application is implemented in the following way:

In the first aspect, the present application discloses an electronic device, including a display screen, a casing, a fingerprint identification module and a near-infrared emitter, wherein:

The display screen is arranged on the housing, the display screen and the housing form an inner cavity of the device, and the near-infrared emitter and the fingerprint recognition module are arranged in the inner cavity of the device;

The fingerprint identification module includes an identification chip, and the identification chip includes a plurality of first image acquisition pixels and a plurality of second image acquisition pixels,

The display screen includes a finger placement area, and the plurality of first image acquisition pixels are used to acquire texture images of fingers placed in the finger placement area; the near-infrared light emitted by the near-infrared emitter can pass through the After being reflected by the display screen and the finger, it is received by the plurality of second image acquisition pixels, and the plurality of second image acquisition pixels are used to acquire a depth image of the finger, and the depth image includes Depth information of the distance between the dermis and epidermis.

In the second aspect, the embodiment of the present application discloses a fingerprint unlocking method for an electronic device, the electronic device is the electronic device described in the first aspect, and the fingerprint unlocking method includes:

acquiring the texture image through the plurality of first image acquisition pixels and acquiring the depth image through the plurality of second image acquisition pixels;

When the texture image is the same as the preset texture image and the depth image is the same as the preset depth image, the electronic device is controlled to be unlocked.

In a third aspect, the embodiment of the present application discloses a fingerprint unlocking device for an electronic device, the electronic device is the electronic device described in the first aspect, and the fingerprint unlocking device includes:

An acquisition module, configured to acquire the texture image through a plurality of first image acquisition pixels and acquire the depth image through a plurality of second image acquisition pixels;

A first control module, configured to control the electronic device to unlock when the texture image is the same as the preset texture image and the depth image is the same as the preset depth image.

In the fourth aspect, the embodiment of the present application discloses a terminal device, including a processor, a memory, and a program or instruction stored in the memory and operable on the processor, and the program or the instruction is executed by the The processor realizes the steps of the fingerprint unlocking method described in the second aspect when executed.

In the fifth aspect, the embodiment of the present application discloses a readable storage medium, on which a program or an instruction is stored, and when the program or the instruction is executed by a processor, the fingerprint unlocking method described in the second aspect is implemented A step of.

The technical solution adopted in this application can achieve the following beneficial effects:

The electronic device disclosed in the embodiment of the present application transforms the electronic device in the related art, so that the electronic device realizes unlocking of the electronic device by collecting two different image information. Specifically, when the user unlocks the electronic device, the user's finger is placed on the finger placement area, and the fingerprint recognition module can obtain the texture image and depth image of the user's finger. The electronic device can only be unlocked when the texture image is the same as the preset texture image and the depth image is the same as the preset depth image. . Since the depth image of the user's finger is limited to the human body, even if criminals obtain the user's texture image, it is difficult to unlock the electronic device by forgery, thereby reducing the potential safety hazard of the electronic device and improving the security of the electronic device.

Description of drawings

FIG. 1 is a partial cross-sectional view of an electronic device disclosed in an embodiment of the present application;

FIG. 2 is a structural diagram of an electronic device disclosed in an embodiment of the present application;

FIG. 3 is a structural diagram of an identification chip disclosed in an embodiment of the present application;

FIG. 4 is a structural diagram of an optical filter disclosed in an embodiment of the present application;

5 is a partial cross-sectional view of the near-infrared filter and the microlens disclosed in the embodiment of the present application;

FIG. 6 is a schematic diagram of a hardware structure implementing a terminal device disclosed in an embodiment of the present application.

Explanation of reference signs:

100-display screen,

200-shell,

300-fingerprint recognition module, 310-recognition chip, 311-first image acquisition pixel, 312-second image acquisition pixel, 320-filter, 321-first filter area, 322-second filter area, 330-circuit board, 340-lens, 350-near infrared filter, 360-micro lens,

400-Near Infrared Emitter,

A-equipment cavity,

E-finger placement area,

1200-terminal equipment, 1201-radio frequency unit, 1202-network module, 1203-audio output unit, 1204-input unit, 12041-graphics processor, 12042-microphone, 1205-sensor, 1206-display unit, 12061-display panel, 1207-user input unit, 12071-touch panel, 12072-other input devices, 1208-interface unit, 1209-memory, 1210-processor, 1211-power supply.

Detailed ways

In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in conjunction with specific embodiments of the present application and corresponding drawings. Apparently, the described embodiments are only some of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

The terms "first", "second" and the like in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the application can be practiced in sequences other than those illustrated or described herein. Moreover, the objects distinguished by "first", "second" and so on are generally one type, and the number of objects is not limited, for example, there may be one first object, or there may be multiple ones. In addition, "and/or" in the specification and claims means at least one of the connected objects, and the character "/" generally means that the related objects are an "or" relationship.

The technical solutions disclosed in the various embodiments of the present application will be described in detail below through specific embodiments and application scenarios with reference to the accompanying drawings.

Please refer to FIG. 1 to FIG. 5 , the embodiment of the present application discloses an electronic device, and the disclosed electronic device includes a display screen 100 , a casing 200 , a fingerprint recognition module 300 and a near-infrared emitter 400 .

The casing 200 is a basic component of the electronic device, and the casing 200 can provide an installation base for the display screen 100 . Wherein, the display screen 100 is a display function device of an electronic device, and the display screen 100 may be a flexible display screen, a curved display screen, or the like. Specifically, the display screen 100 is arranged on the casing 200, and at the same time, the display screen 100 and the casing 200 form a device inner cavity A, which can accommodate some other components of the electronic device, the near infrared emitter 400 and the fingerprint identification module 300 is located in the inner chamber A of the device. In addition, the device inner cavity A can also provide protection for some other components in the electronic device (such as a battery, a circuit board 330 described later).

The fingerprint identification module 300 is an identification function device of the electronic device, and the user can unlock the electronic device after being identified and confirmed by the fingerprint identification module 300 . Specifically, the fingerprint identification module 300 includes an identification chip 310, wherein the identification chip 310 includes a plurality of first image acquisition pixels 311 and a plurality of second image acquisition pixels 312, and the display screen 100 includes a finger placement area E. Optionally, The finger placement area E can be a circular area or an oblate circular area. The user can place the finger on the finger placement area E, and a plurality of first image acquisition pixels 311 are used to acquire the texture image of the finger placed on the finger placement area E (that is, the 2D fingerprint pattern described in the background art), and at the same time, the near-infrared The near-infrared light emitted by the transmitter 400 can be received by a plurality of second image acquisition pixels 312 after being reflected by the display screen 100 and the finger in sequence, and the plurality of second image acquisition pixels 312 are used to detect the depth image of the finger, wherein the depth image It includes depth information that can characterize the distance between the dermis and epidermis of the finger.

In the embodiment of the present application, the user needs to input the preset texture image and preset depth image of his finger in advance, specifically, the user places the finger in the finger placement area E, and the plurality of first image acquisition pixels 311 can acquire the finger placement area E. The preset texture image of the finger placement area E, wherein the near-infrared light can pass through the display screen 100 to reach the epidermis of the finger, and even pass through the epidermis to reach the dermis. Then, the dermis and epidermis of the finger reflect the near-infrared light to a plurality of second image acquisition pixels 312. Since there is a distance between the dermis and the epidermis, the near-infrared light that respectively reaches the two can not be simultaneously reflected after being reflected. Reaching a plurality of second image acquisition pixels 312, the plurality of second image acquisition pixels 312 can respectively receive the near-infrared light reflected from the epidermis and the near-infrared light reflected from the dermis, and finally present it on the depth image. The depth information can be obtained by analyzing the image through the time-of-flight method (TOF method), so that the plurality of second image acquisition pixels 312 can acquire the preset depth image of the finger.

During the process of the user unlocking the electronic device, the user places the finger on the finger placement area E, and the multiple first image acquisition pixels 311 acquire the texture image of the finger placed on the finger placement area E. At the same time, the near-infrared emitter 400 emits The infrared light is reflected by the display screen 100 and the finger in turn, and the near-infrared light is transmitted to a plurality of second image acquisition pixels 312, and the plurality of second image acquisition pixels 312 acquire the depth image of the finger placed in the finger placement area E, and the electronic device will The texture image is compared with the preset texture image and the depth image is compared with the preset depth image. Only when the texture image is the same as the preset texture image and the depth image is the same as the preset depth image, the electronic device can Complete the unlock.

The electronic device disclosed in the embodiment of the present application transforms the electronic device in the related art, so that the electronic device realizes unlocking of the electronic device by collecting two different image information. Specifically, when the user unlocks the electronic device, the user's finger is placed on the finger placement area E, and the fingerprint identification module 300 can obtain the texture image and depth image of the user's finger. Set the texture image for comparison, and compare the depth image with the preset depth image entered by the user in advance. Only when the texture image is the same as the preset texture image, and the depth image is the same as the preset depth image, the electronic device can Complete the unlock. Since the depth image of the user's finger is limited to the human body, even if criminals obtain the user's texture image, it is difficult to unlock the electronic device by forgery, thereby reducing the potential safety hazard of the electronic device and improving the security of the electronic device.

At the same time, in the electronic device disclosed in the embodiment of this application, the fingerprint recognition module 300 creatively integrates a plurality of first image acquisition pixels 311 and a plurality of second image acquisition pixels 312 into the same identification chip 310, without affecting On the premise of the fingerprint identification function, it can help the fingerprint identification module 300 to be more miniaturized, thereby reducing its occupied space in the electronic device, and it is beneficial for the electronic device to integrate more other functional devices.

It should be noted that, herein, the distance between the dermis and the epidermis refers to the depth of the dermis, that is, the distance between the outer surface of the epidermis and the dermis.

In the embodiment of the present application, the fingerprint identification module 300 may further include a filter 320 , specifically, the filter 320 may cover the identification chip 310 . The optical filter 320 can partially filter out the light entering the fingerprint recognition module 300 , so as to allow visible light and near-infrared light that meet the requirements to pass through, and finally avoid the interference of other types of light on fingerprint recognition.

In the present application, the structure of the filter can be various. In an optional solution, the filter 320 can include a plurality of first filter regions 321 and a plurality of second filter regions 322, wherein the plurality of A first filter area 321 can cover a plurality of first image acquisition pixels 311 in one-to-one correspondence. The first filter area 321 is used to filter out near-infrared light. When the user's finger is placed in the finger placement area E, , and also form a slight extrusion deformation on the finger placement area E. After the visible light emitted by the display screen 100 passes through the deformed finger placement area E, there will be total reflection and then be transmitted to a plurality of first image acquisition pixels 311, finally forming a texture image . While the near-infrared light emitted by the near-infrared emitter 400 is doped into visible light, since the plurality of first filter regions 321 can filter the near-infrared light, thereby preventing the near-infrared light from being transmitted to the plurality of first image acquisition pixels 311, thereby avoiding The texture images acquired by the plurality of first image acquisition pixels 311 are affected, which is beneficial to ensure the accuracy of the texture images acquired by the plurality of first image acquisition pixels 311 .

At the same time, a plurality of second filter regions 322 cover the plurality of second image acquisition pixels 312 in one-to-one correspondence, and the second filter regions 322 are used to filter out visible light. The light is sequentially reflected by the display screen 100 and the fingers to the plurality of second image acquisition pixels 312, and the visible light emitted by the display screen 100 is relatively easy to be doped into the near-infrared light. Since the plurality of second filter regions 322 can filter visible light, In this way, visible light is prevented from being transmitted to the plurality of second image acquisition pixels 312, thereby preventing the depth images detected by the plurality of second image acquisition pixels 312 from being affected, thereby helping to ensure the accuracy of the depth images acquired by the plurality of second image acquisition pixels 312 .

In the embodiment of the present application, the fingerprint identification module 300 may also include a circuit board 330 and a lens 340. Specifically, the lens 340 may be provided on the circuit board 330, and the lens 340 may be opposite to the finger placement area E. In this case, The lens 340 is covered on the optical filter 320 and the identification chip 310 , so that the lens 340 can provide protection for the optical filter 320 and the identification chip 310 . At the same time, the lens 340 can also adjust the direction and angle of the visible light and the near-infrared light by means of refraction, so that both the visible light and the near-infrared light can be transmitted to the filter 320, and the identification chip 310 can be arranged on the circuit board 330, and Located in the space enclosed by the circuit board 330 and the lens 340 , wherein the identification chip 310 can be electrically connected to the circuit board 330 , and the optical filter 320 can be installed in the lens 340 .

In an optional solution, the optical filter 320 can be arranged at the end of the lens facing the identification chip 310, so that while multiple first filter areas 321 can filter near-infrared light, multiple second filter areas 322 is able to filter visible light. Although this method can realize the filtering of visible light and near-infrared light, it is still difficult to avoid that a very small part of visible light is transmitted to multiple first image acquisition pixels 311, and a very small part of near-infrared light is transmitted to multiple second image capture pixels. at pixel 312.

Based on this, in another optional solution, the optical filter 320 can be arranged on the light-receiving surface of the identification chip 310. This way of attaching the identification chip 310 enables the identification chip 310 to be an optical filter 320. Provide an installation base, this structure can eliminate the light entrance gap between the optical filter 320 and the identification chip 310, and then can better realize the filtering effect of the optical filter 320, so as to better prevent visible light from being transmitted to multiple first images The pixel 311 is captured, and the near-infrared light is transmitted to a plurality of second image capturing pixels 312 . In addition, the optical filter 320 and the identification chip 310 are attached to each other, and the optical filter 320 can also protect the identification chip 310 without occupying too much space for the fingerprint identification module 300. The overlapping thickness of the optical filter 320 and the identification chip 310 can be reduced, thereby making the structure of the fingerprint identification module 300 more compact. Moreover, this assembly method is beneficial to realize the integration of the optical filter 320 and the identification chip 310 , thereby facilitating assembly.

In yet another optional solution, in the fingerprint recognition module 300 disclosed in the embodiment of the present application, the filter 320 can be a double-pass filter, which can allow visible light and near-infrared light to pass through at the same time , avoiding the passage of other types of light other than visible light and near-infrared light.

On the basis that the filter 320 is a double-pass filter, in a further technical solution, the fingerprint recognition module 300 disclosed in the embodiment of the present application may also include a plurality of near-infrared filter parts 350, and the near-infrared filter part 350 350 are arranged on the photosensitive surface of the second image acquisition pixel 312 in one-to-one correspondence, so that the near-infrared light passing through the double-pass filter can pass through the near-infrared filter part 350 and be projected onto the second image acquisition pixel 312, During this process, the visible light will be filtered out by the near-infrared filter part 350 , so as to avoid interference to the second image acquisition pixel 312 .

In a further technical solution, the fingerprint identification module 300 disclosed in the embodiment of the present application may also include a plurality of microlenses 360, and the plurality of microlenses 360 are arranged on the far side of the near-infrared filter part 350 facing away from the second image acquisition pixel 312. The light side, so that more light passing through the double-pass filter can be projected onto the near-infrared filter part 350 . Specifically, the microlens 360 can be a plano-convex lens, and the plane of the plano-convex lens can be arranged on the near-infrared filter part 350. The convex surface of the plano-convex lens faces away from the near-infrared filter part 350. More light is projected onto the near-infrared filter 350 .

In the embodiment of the present application, a plurality of first image acquisition pixels 311 can be arranged in an array to form an entire area (which can be referred to as a first area), and a plurality of second image acquisition pixels 312 can be arranged in an array to form another entire area (It can be referred to as the second area), the first area and the second area can be spliced to form the identification chip 310, so that the identification chip 310 can obtain the texture image and the depth image of the user's finger.

In an optional solution, any two adjacent second image acquisition pixels 312 may be arranged at intervals, specifically, each second image acquisition pixel 312 may be surrounded by at least two first image acquisition pixels 311 . In this case, the structure composed of multiple first image capturing pixels 311 can be embedded in the structure composed of multiple second image capturing pixels 312, or the structure composed of multiple second image capturing pixels 312 can be embedded in multiple In the structure composed of a plurality of first image acquisition pixels 311, in the direction perpendicular to the carrying direction of the circuit board 330, a plurality of first image acquisition pixels 311 are coplanar with a plurality of second image acquisition pixels 312, so that the recognition chip 310 The structure is more compact, and the arrangement space of other components in the electronic equipment will not be interfered. The layout described above can make the distribution of the first image acquisition pixels 311 and the second image acquisition pixels 312 more extensive, which is beneficial to light-sensing in a wide range, and then it is easier to successfully acquire corresponding images.

As mentioned above, the user needs to input the preset texture image and preset depth image of his finger in advance. Based on this, the electronic device disclosed in the embodiment of the present application may also include a preset texture image recording device. The preset image recording device includes A first acquisition unit, a second acquisition unit and a first image synthesis unit.

The first acquisition unit may be used to acquire a plurality of first sub-images formed by a plurality of first image acquisition pixels 311 . In the specific entry process, the near-infrared emitter 400 is turned off, and the display screen 100 is turned on, so that visible light is projected onto a plurality of first image acquisition pixels 311 arranged at intervals. At the same time, since the near-infrared emitter 400 is turned off, the second There is no near-infrared light at the image acquisition pixel 312, and the first acquisition unit acquires a plurality of first dark spots at the plurality of second image acquisition pixels 312, so that the first acquisition unit acquires the first dark spots with the plurality of first dark spots. sub image.

The second acquisition unit can be used to calculate the brightness mean value of the first sub-images of a plurality of first image acquisition pixels 311 adjacent to each second image acquisition pixel 312, as the second sub-image acquired by the second image acquisition pixel 312 The image, wherein the positions of the plurality of brightness mean values in the second sub-image acquired by the second acquisition unit correspond one-to-one to the positions of the plurality of first dark spots in the first sub-image.

The first image synthesis unit is used for synthesizing a plurality of first sub-images and second sub-images to form a preset texture image.

In the process of the user entering the preset texture image, the user controls the near-infrared emitter 350 to turn off, and turns on the display screen 100, and places the finger on the finger placement area E, and the visible light emitted by the display screen 100 is reflected and transmitted to the fingerprint recognition module. At group 300, visible light can be projected to a plurality of first image acquisition pixels 311, so that the first acquisition unit acquires a plurality of first sub-images, and at the same time, the second image acquisition pixel 312 cannot sense the near-infrared light, and the second acquisition unit calculates the average brightness value of the first sub-images of multiple first image acquisition pixels 311 adjacent to each second image acquisition pixel 312 to form a second sub-image, and the first image is synthesized The unit synthesizes a plurality of first sub-images and second sub-images into a preset texture image. In this case, the brightness of the second sub-image finally corresponding to the second image acquisition pixel 312 can be prevented from being too dark, thereby increasing the brightness of the position where the first dark spot is located, and then the brightness between the first sub-image and the second sub-image After the synthesis, the definition of the preset texture image obtained after the synthesis can be improved.

In a further technical solution, the electronic device may further include a preset depth image recording device, and the preset depth image recording device includes a third acquisition unit, a fourth acquisition unit, and a second image synthesis unit.

The third acquisition unit is configured to acquire a third sub-image formed by a plurality of second image acquisition pixels 312 . In the specific entry process, the near-infrared emitter 400 is turned on, and the display screen 100 is turned off, so that the near-infrared light is transmitted to the second image acquisition pixels 312 arranged at intervals. At the same time, since the display screen 100 is turned off, the first image acquisition No visible light reaches the pixel 311, and the third acquiring unit acquires multiple second dark spots at the multiple first image acquiring pixels 311, so that the third acquiring unit acquires a third sub-image with multiple second dark spots.

The fourth acquisition unit is used to calculate the brightness mean value of the third sub-images of multiple second image acquisition pixels 312 adjacent to each first image acquisition pixel 311 as the fourth sub-image acquired by the first image acquisition pixels 311 , wherein the positions of the plurality of brightness mean values in the fourth sub-image acquired by the fourth acquisition unit correspond one-to-one to the positions of the plurality of second dark spots in the third sub-image.

The second image synthesis unit is used for synthesizing the third sub-image and the fourth sub-image to form a preset depth image.

In the process of the user entering the preset depth image, the user controls the near-infrared emitter 400 to turn on, and closes the display screen 100, and places the finger on the finger placement area E, and the near-infrared light emitted by the near-infrared emitter 400 passes through the display screen in turn. 100 and the fingers are reflected and projected to the fingerprint recognition module 300, and the near-infrared light can be projected to a plurality of second image acquisition pixels 312, so that the third acquisition unit acquires a plurality of third sub-images, and at the same time, due to the display screen 100 closed, so the plurality of first image acquisition pixels 311 will not sense visible light, and the fourth acquisition unit calculates the brightness mean value of the third sub-image of the plurality of second image acquisition pixels 312 adjacent to each first image acquisition pixel 311 , so as to form a fourth sub-image, and the second image synthesis unit synthesizes a plurality of third sub-images and fourth sub-images into a preset depth image. In this case, the brightness of the area corresponding to the second dark spot in the third sub-image acquired by the third acquisition unit can not be too dark, thereby increasing the brightness of the position where the second dark spot is located, and then in the third sub-image After the image is combined with the fourth sub-image, the definition of the preset depth image obtained after the combination can be improved.

In a further technical solution, the preset depth image recording device may also include a brightness information acquisition unit, and during the process of recording the preset depth image, the brightness information acquisition unit is used to obtain the third sub-image and the fourth sub-image during the recording process The combined luminance (which can be regarded as the first luminance information) is stored, and the first luminance information is stored.

As described later, during the fingerprint unlocking process, the near-infrared emitter 400 and the display screen 100 are turned on simultaneously, and the fingerprint recognition module 300 acquires the texture image and the depth image at the same time. Obviously, this is different from the scene when recording alone, so the fingerprint recognition module 300 can subtract the first brightness information collected by the brightness information acquisition unit at the time of recording from the texture image obtained, and finally get the signal Textured images with better noise ratio.

Based on the electronic device disclosed in the embodiment of the present application, the embodiment of the present application discloses a fingerprint unlocking method, the electronic device involved is the electronic device described in the above embodiment, and the fingerprint unlocking method includes:

Step 101 , acquire a texture image through a plurality of first image acquisition pixels 311 and acquire a depth image through a plurality of second image acquisition pixels 312 .

In this step, the visible light emitted by the display screen 100 is reflected by the fingers to a plurality of first image acquisition pixels 311 to form a texture image, and the near-infrared light emitted by the near-infrared emitter 400 is reflected by the display screen 100 and the fingers in turn. Passed to a plurality of second image acquisition pixels 312, wherein the dermis and epidermis of the finger can reflect the near-infrared light to the plurality of second image acquisition pixels 312, so that the plurality of second image acquisition pixels 312 can pass through the near-infrared light And get the depth image of the finger.

Step 102, when the texture image is the same as the preset texture image and the depth image is the same as the preset depth image, control the electronic device to unlock.

In the fingerprint unlocking method disclosed in the embodiment of the present application, it is possible to simultaneously compare whether the texture image is consistent with the preset texture image and whether the depth image is consistent with the preset depth image, and then perform corresponding processing according to the comparison result.

In a further technical solution, after the texture image is acquired by a plurality of first image acquisition pixels 311, the fingerprint unlocking method disclosed in the embodiment of the present application may further include:

Step 201, judging whether the texture image is the same as the preset texture image.

Step 202, if the texture image is the same as the preset texture image, determine whether the depth image is the same as the preset depth image.

In this step, only when the texture images acquired by multiple first image acquisition pixels 311 are the same as the pre-stored texture images entered by the user in advance, can the depth images acquired by multiple second image acquisition pixels 312 be matched with the pre-stored texture images entered by the user in advance. Comparison confirmation of depth images.

Step 203 , in the case that the texture image is different from the preset texture image, send out an unlock failure prompt message or a re-press prompt message.

In this case, once the fingerprint image is not the same as the pre-stored texture image, the unlock failure prompt message or re-press prompt message will be issued directly. This process does not need to compare the depth image with the preset depth image, which will undoubtedly improve the recognition efficiency. , to reduce useless identification process.

Of course, it is also possible to compare the depth image with the preset depth image first, and then compare the texture image with the preset texture image when the depth image is the same as the preset depth image. Once the depth image is not the same as the preset depth image, a prompt message of unlocking failure or a re-press prompt message is directly issued. Since the depth image has less information, the comparison is quicker. Therefore, comparing the depth image with the preset depth image first can further improve the recognition efficiency.

In a further technical solution, the fingerprint unlocking method disclosed in the embodiment of the present application may also include:

Step 301 , detecting the contact area between the finger placement area E and the finger.

Step 302 , when the contact area is less than half of the area of the finger placement area E, send out a prompt message of unlocking failure or send out a press prompt message.

In this step, if the area where the user's finger is placed is less than half of the finger placement area E, it will be difficult for the identification chip 310 to obtain a relatively complete texture image, and it will be difficult for the plurality of first image acquisition pixels 311 to obtain the texture image. At the same time, it is difficult for multiple second image acquisition pixels 312 to acquire a depth image, which will cause confusion for recognition. In this case, send out an unlock failure prompt message or re-press the prompt message to remind the user to change the pressing position so as to carry out the next identification as early as possible, which undoubtedly facilitates the user's use.

Based on the electronic device disclosed in the embodiment of the present application, the embodiment of the present application discloses a fingerprint unlocking device, the electronic device involved is the electronic device described in the above embodiment, and the fingerprint unlocking device includes:

An acquisition module, including a plurality of first image acquisition pixels and a plurality of second image acquisition pixels, the acquisition module is used to acquire a texture image through a plurality of first image acquisition pixels 311 and acquire a depth image through a plurality of second image acquisition pixels 312;

The first control module is configured to control the unlocking of the electronic device when the texture image is the same as the preset texture image and the depth image is the same as the preset depth image.

In an optional solution, the fingerprint unlocking device may also include:

The first judging module is used to judge whether the texture image is the same as the preset texture image;

The second judging module is used to judge whether the depth image is the same as the preset depth image when the texture image is the same as the preset texture image;

The second control module is used to control the sending of the prompt message of unlocking failure or the prompt message of re-pressing when the texture image is different from the preset texture image.

In a further technical solution, the fingerprint unlocking device may also include:

The detection module is used to detect the contact area between the finger placement area E and the finger;

Calculation module, for calculating the first ratio of the contact area and the area of the finger placement area E:

The second control module is configured to issue an unlock failure prompt message or a re-press prompt message when the first ratio is less than 0.5.

Since the fingerprint unlocking device for electronic equipment disclosed in the embodiment of the present application corresponds to the fingerprint unlocking method for electronic equipment described in the above embodiment, the corresponding part can refer to the corresponding description of the fingerprint unlocking method above. No longer.

The electronic devices disclosed in the embodiments of the present application can be mobile phones, computers, e-book readers, game consoles, wearable devices, etc. Of course, the electronic devices can also be other types of devices, and the embodiments of the present application do not limit the specific types of electronic devices .

FIG. 6 is a schematic diagram of a hardware structure of a terminal device implementing various embodiments of the present application.

The terminal device 1200 includes, but is not limited to: a radio frequency unit 1201, a network module 1202, an audio output unit 1203, an input unit 1204, a sensor 1205, a display unit 1206, a user input unit 1207, an interface unit 1208, a memory 1209, a processor 1210, and Power supply 1211 and other components. Those skilled in the art can understand that the structure of the terminal device 1200 shown in FIG. layout of the components. In the embodiment of the present application, the terminal devices include, but are not limited to, mobile phones, tablet computers, notebook computers, palmtop computers, vehicle-mounted terminals, wearable devices, and pedometers.

Wherein, the sensor 1205 can transmit the visible light signals received by the plurality of first image acquisition pixels 311 and the near-infrared light signals received by the plurality of second image acquisition pixels 312 to the processor 1210, and the processor 1210 based on the visible light signals and The transformation relationship of the texture image signal, and the photosensitive relationship between the near-infrared light signal and the depth image signal, so as to obtain the texture image and the depth image of the user's finger.

It should be understood that, in this embodiment of the present application, the radio frequency unit 1201 can be used for receiving and sending signals during information sending and receiving or during a call. Specifically, the downlink data from the base station is received and processed by the processor 1210; Uplink data is sent to the base station. Generally, the radio frequency unit 1201 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 1201 can also communicate with the network and other devices through a wireless communication system.

The terminal device provides users with wireless broadband Internet access through the network module 1202, such as helping users send and receive emails, browse web pages, and access streaming media.

The audio output unit 1203 may convert audio data received by the radio frequency unit 1201 or the network module 1202 or stored in the memory 1209 into an audio signal and output as sound. Also, the audio output unit 1203 may also provide audio output related to a specific function performed by the terminal device 1200 (for example, call signal reception sound, message reception sound, etc.). The audio output unit 1203 includes a speaker, a buzzer, a receiver, and the like.

The input unit 1204 is used to receive audio or video signals. The input unit 1204 may include a graphics processing unit (Graphics Processing Unit, GPU) 12041 and a microphone 12042, and the graphics processing unit 12041 controls still pictures or video images obtained by an image capturing device (such as a camera) in video capture mode or image capture mode The data is processed. The processed image frames may be displayed on the display unit 1206 . The image frames processed by the graphics processor 12041 may be stored in the memory 1209 (or other storage media) or sent via the radio frequency unit 1201 or the network module 1202 . The microphone 12042 can receive sound, and can process such sound into audio data. The processed audio data may be converted into an output format transmittable to a mobile communication base station via the radio frequency unit 1201 in case of a phone call mode.

The terminal device 1200 also includes at least one sensor 1205, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 12061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 12061 and the / or backlighting. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used to identify the posture of terminal equipment (such as horizontal and vertical screen switching, related games) , magnetometer attitude calibration), vibration recognition-related functions (such as pedometer, knocking), etc.; the sensor 1205 can also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, Infrared sensors, etc., will not be repeated here.

The display unit 1206 is used to display information input by the user or information provided to the user. The display unit 1206 may include a display panel 12061, and the display panel 12061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like.

The user input unit 1207 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the terminal device. Specifically, the user input unit 1207 includes a touch panel 12071 and other input devices 12072. The touch panel 12071, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 12071 or near the touch panel 12071 operate). The touch panel 12071 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the For the processor 1210, receive the command sent by the processor 1210 and execute it. In addition, the touch panel 12071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 12071 , the user input unit 1207 may also include other input devices 12072 . Specifically, other input devices 12072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.

Furthermore, the touch panel 12071 can be covered on the display panel 12061, and when the touch panel 12071 detects a touch operation on or near it, it will be sent to the processor 1210 to determine the type of the touch event, and then the processor 1210 will The type of event provides a corresponding visual output on the display panel 12061. Although in FIG. 6, the touch panel 12071 and the display panel 12061 are used as two independent components to realize the input and output functions of the terminal device, in some embodiments, the touch panel 12071 and the display panel 12061 can be integrated. The implementation of the input and output functions of the terminal device is not specifically limited here.

The interface unit 1208 is an interface for connecting an external device to the terminal device 1200 . For example, an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 1208 can be used to receive input from an external device (for example, data information, power, etc.) transfer data between devices.

The memory 1209 can be used to store software programs as well as various data. The memory 1209 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.); Data created by the use of terminal equipment (such as audio data, phonebook, etc.), etc. In addition, the memory 1209 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.

The processor 1210 is the control center of the terminal equipment, which uses various interfaces and lines to connect various parts of the entire terminal equipment, runs or executes software programs and/or modules stored in the memory 1209, and calls data stored in the memory 1209 , execute various functions of the terminal equipment and process data, so as to monitor the terminal equipment as a whole. The processor 1210 may include one or more processing units; optionally, the processor 1210 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc., and the modem processor The tuner processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 1210 .

The terminal device 1200 may also include a power supply 1211 (such as a battery) for supplying power to various components. Optionally, the power supply 1211 may be logically connected to the processor 1210 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. Management and other functions.

In addition, the terminal device 1200 includes some functional modules not shown, which will not be repeated here.

Optionally, this embodiment of the present application discloses a terminal device, including a processor 1210, a memory 1209, and a program or instruction stored in the memory 1209 and operable on the processor 1210. When the program or instruction is executed by the processor 1210 Each process of any of the above method embodiments can achieve the same technical effect, so in order to avoid repetition, details are not repeated here.

The embodiment of the present application discloses a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by the processor 1210, each process of any of the above-mentioned method embodiments can be realized, and the same technical effect can be achieved , to avoid repetition, it will not be repeated here. Wherein, the readable storage medium is, for example, a read-only memory (Read-Only Memory, referred to as ROM), a random access memory (Random Access Memory, referred to as RAM), a magnetic disk or an optical disk, etc.

The embodiment of the present application discloses a computer program product, the computer program product is stored in a non-volatile storage medium, and the program product is configured to be executed by at least one processor to implement the control method as described above step.

The embodiment of the present application discloses a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the control method described in the above embodiments .

The above-mentioned embodiments of this application focus on the differences between the various embodiments. As long as the different optimization features of the various embodiments are not contradictory, they can be combined to form a better embodiment. Considering the simplicity of the text, here No longer.

The above descriptions are only examples of the present application, and are not intended to limit the present application. For those skilled in the art, various modifications and changes may occur in this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included within the scope of the claims of the present application.

Claims

An electronic device, which includes a display screen (100), a housing (200), a fingerprint identification module (300) and a near-infrared emitter (400), wherein:

The display screen (100) is arranged on the housing (200), and the display screen (100) and the housing (200) form a device inner cavity (A), and the near-infrared emitter (400) and The fingerprint identification module (300) is arranged in the inner cavity (A) of the device;

The fingerprint identification module (300) includes an identification chip (310), and the identification chip (310) includes a plurality of first image acquisition pixels (311) and a plurality of second image acquisition pixels (312),

The display screen (100) includes a finger placement area (E), and the plurality of first image acquisition pixels (311) are used to acquire texture images of fingers placed in the finger placement area (E); the near-infrared The near-infrared light emitted by the emitter (400) can be received by the plurality of second image acquisition pixels (312) after being reflected by the display screen (100) and the finger in sequence, and the plurality of second image acquisition pixels (312) The pixels (312) are used to acquire a depth image of the finger, and the depth image includes depth information that can characterize the distance between the corium layer and the epidermis layer of the finger.
The electronic device according to claim 1, wherein the fingerprint identification module (300) further comprises a filter (320), and the filter (320) covers the identification chip (310).
The electronic device according to claim 2, wherein the fingerprint recognition module (300) further comprises a circuit board (330) and a lens (340), and the lens (340) is arranged on the circuit board (330) , the lens (340) is opposite to the finger placement area (E), the identification chip (310) is arranged on the circuit board (330), and is located between the circuit board (330) and the lens ( 340), the filter (320) is installed in the lens (340).
The electronic device according to claim 2, wherein the optical filter (320) is arranged on the light-receiving surface of the identification chip (310).
The electronic device according to claim 1, wherein any two adjacent second image acquisition pixels (312) are arranged at intervals, and each second image acquisition pixel (312) is composed of at least two of the first Image acquisition pixels (311) surround.
The electronic device according to claim 5, wherein the electronic device further comprises a preset texture image recording device, and the preset image recording device comprises:

a first acquisition unit, configured to acquire a plurality of first sub-images formed by the plurality of first image acquisition pixels (311);

a second acquisition unit, the second acquisition unit is configured to calculate the first sub-image of a plurality of the first image acquisition pixels (311) adjacent to each of the second image acquisition pixels (312) a brightness mean to form a second sub-image captured by said second image capture pixel (312);

A first image synthesis unit, configured to synthesize the plurality of first sub-images and the second sub-images to form the preset texture image.
The electronic device according to claim 5, wherein the electronic device further comprises a preset depth image recording device, and the preset depth image recording device comprises:

a third acquisition unit, configured to acquire a third sub-image formed by the plurality of second image acquisition pixels (312);

a fourth acquisition unit, the fourth acquisition unit is configured to calculate the third sub-image of a plurality of second image acquisition pixels (312) adjacent to each of the first image acquisition pixels (311) a brightness mean to form a fourth sub-image captured by said first image capture pixel (311);

A second image synthesis unit, configured to synthesize the third sub-image and the fourth sub-image to form a preset depth image.
A fingerprint unlocking method for an electronic device, which is applicable to the electronic device according to any one of claims 1 to 7, the fingerprint unlocking method comprising:

acquiring the texture image through the plurality of first image acquisition pixels (311) and acquiring the depth image through the plurality of second image acquisition pixels (312);

When the texture image is the same as the preset texture image and the depth image is the same as the preset depth image, the electronic device is controlled to be unlocked.
The fingerprint unlocking method according to claim 8, wherein, after acquiring the texture image through a plurality of the first image acquisition pixels (311), further comprising:

judging whether the texture image is the same as the preset texture image;

If the texture image is the same as the preset texture image, determine whether the depth image is the same as the preset depth image;

In the case that the texture image is different from the preset texture image, an unlock failure prompt message or a re-press prompt message is issued.
The fingerprint unlocking method according to claim 8, further comprising:

Detecting the contact area between the finger placement area (E) and the finger;

In the case that the contact area is less than half of the area of the finger placement area (E), an unlock failure prompt message or a re-press prompt message is issued.
A fingerprint unlocking device for an electronic device, wherein the electronic device is the electronic device according to claims 1 to 7, and the fingerprint unlocking device comprises:

An acquisition module, comprising a plurality of first image acquisition pixels (311) and a plurality of second image acquisition pixels (312), the acquisition module is used to acquire a plurality of first image acquisition pixels (311) The texture image and the depth image are acquired through a plurality of the second image acquisition pixels (312);

A first control module, configured to control the electronic device to unlock when the texture image is the same as the preset texture image and the depth image is the same as the preset depth image.
The fingerprint unlocking device according to claim 11, wherein the fingerprint unlocking device further comprises:

A first judging module, configured to judge whether the texture image is the same as the preset texture image;

A second judging module, configured to judge whether the depth image is the same as the preset depth image when the texture image is the same as the preset texture image;

The second control module is configured to control sending out an unlock failure prompt message or a re-press prompt message when the texture image is different from the preset texture image.
The fingerprint unlocking device according to claim 11, wherein the fingerprint unlocking device further comprises:

A detection module, configured to detect the contact area between the finger placement area (E) and the finger;

Calculation module, for calculating the first ratio of the contact area and the area of the finger placement area (E):

The second control module is configured to issue an unlock failure prompt message or a re-press prompt message when the first ratio is less than 0.5.
A terminal device, including a processor (1210), a memory (1209), and a program or instruction stored in the memory (1209) and operable on the processor (1210), the program or the When the instructions are executed by the processor (1210), the steps of the fingerprint unlocking method described in any one of claims 8 to 10 are realized.
A readable storage medium, wherein a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by the processor (1210), the fingerprint according to any one of claims 8 to 10 is realized Steps of the unlock method.