WO2021258294A1

WO2021258294A1 - Electronic device, unlocking method and apparatus, and storage medium

Info

Publication number: WO2021258294A1
Application number: PCT/CN2020/097756
Authority: WO
Inventors: 王路
Original assignee: Oppo广东移动通信有限公司
Priority date: 2020-06-23
Filing date: 2020-06-23
Publication date: 2021-12-30
Also published as: CN115668306A

Abstract

Disclosed is an electronic device. The electronic device comprises: a transmitter, a receiver and a processor. The transmitter is used for successively transmitting optical information having a first density and optical information having a second density, wherein the first density is different from the second density. The receiver is used for correspondingly receiving the optical information having the first density and the optical information having the second density. The processor is used for executing the following steps: performing image collection on a target object by using the optical information having the first density, so as to obtain a first target image; if the first target image successfully matches a first preset image, performing image collection on the target object by using the optical information having the second density, so as to obtain a second target image; and if the second target image successfully matches a second preset image, unlocking the electronic device. In addition, further disclosed are an unlocking method and apparatus, and a storage medium.

Description

Electronic equipment and unlocking method, device and storage medium

Technical field

The embodiments of the present application relate to electronic technology, and relate to, but are not limited to, an electronic device, an unlocking method, device, and storage medium.

Background technique

At present, smart electronic devices, such as smart phones and smart computers, are used more and more frequently by people in work and life, and most smart phones or smart watches basically have unlocking functions. Common unlocking methods include fingerprint recognition and unlocking. Face recognition to unlock.

Among them, there are many types of face recognition unlocking. The more common face recognition unlocking schemes include: proactive RGB (Red Green Blue) scheme, infrared face recognition scheme and Face ID (a kind of Face authentication method) scheme.

The RGB solution is the simplest, and it can be unlocked by using the front camera of the mobile phone. However, its shortcomings are also obvious. Because the obtained 2D (2Dimension, two-dimensional) information is too little different from face photos, videos, etc., it is easily attacked by living bodies and cannot be used in low light.

The infrared face recognition scheme uses infrared light-filling elements to project to the face, and then the infrared lens captures the light reflected by the face to generate an image. Infrared face recognition is still a 2D authentication method, and there is no 3D (3 Dimension) of the face. ) Information, identification security and accuracy are low.

Face ID is a 3D face recognition solution. Currently, there are two hardware methods: 3D structured light and TOF (Time of Flight). Taking structured light as an example, the hardware includes flood light source components, receivers and infrared dot-matrix projectors: when Face ID is activated, the flood light source components first project infrared light on the face, and the receiver obtains the 2D image of the face, and the face information Contrast and match. Then the infrared dot matrix projector is used to project the infrared dot matrix with encoded information to the human face, and the 3D image of the human face is obtained by modeling. Complete the unlocking by matching the face information.

Summary of the invention

The embodiments of the present application provide an electronic device, an unlocking method, device, and storage medium.

The technical solutions of the embodiments of the present application are implemented as follows:

In the first aspect, an embodiment of the present application provides an electronic device, the electronic device including: a transmitter, a receiver, and a processor;

The transmitter is used to sequentially emit light information with a first density and light information with a second density; wherein the first density is different from the second density;

The receiver is configured to correspondingly receive the optical information with the first density and the optical information with the second density;

The processor is configured to perform the following steps:

Use the light information with the first density to perform image acquisition on the target object to obtain a first target image; if the first target image is successfully matched with the first preset image, use the light information with the second density to pair The target object performs image collection to obtain a second target image; if the second target image is successfully matched with a second preset image, unlock the electronic device.

In a second aspect, an embodiment of the present application provides an unlocking method, and the method includes:

Image acquisition of the target object by using the light information with the first density emitted by the transmitter of the electronic device to obtain the first target image;

If the first target image is successfully matched with the first preset image, use the light information with the second density emitted by the transmitter of the electronic device to perform image collection on the target object to obtain a second target image;

If the second target image is successfully matched with the second preset image, unlock the electronic device;

Wherein, the first density is different from the second density.

In a third aspect, an embodiment of the present application provides an unlocking device, and the device includes:

The first collection unit is configured to collect the image of the target object by using the light information with the first density emitted by the transmitter of the electronic device to obtain the first target image;

The second acquisition unit is configured to, if the first target image is successfully matched with the first preset image, use the light information with the second density emitted by the transmitter of the electronic device to perform image acquisition on the target object to obtain Second target image;

A matching unit, configured to unlock the electronic device if the second target image is successfully matched with the second preset image;

Wherein, the first density is different from the second density.

In a fourth aspect, an embodiment of the present application provides an electronic device, including a memory and a processor, the memory stores a computer program that can run on the processor, and the processor implements the unlocking method described above when the program is executed Steps in.

In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps in the unlocking method described above are implemented.

The embodiments of the present application provide an electronic device, an unlocking method, a device, and a storage medium. The electronic device includes: a transmitter, a receiver, and a processor; the transmitter is used to sequentially emit light information with a first density, and Optical information of a second density; wherein the first density is different from the second density; the receiver is used to correspondingly receive the optical information with the first density and the optical information with the second density; The processor is configured to perform the following steps: use the light information with the first density to perform image collection on a target object to obtain a first target image; if the first target image is successfully matched with a first preset image, Use the light information with the second density to perform image capture on the target object to obtain a second target image; if the second target image is successfully matched with a second preset image, unlock the electronic device, so that While ensuring screen resolution and screen life, it realizes low-transmittance under-screen 3D recognition and unlocking.

Description of the drawings

FIG. 1 is a schematic diagram 1 of the composition structure of an electronic device according to an embodiment of the application;

FIG. 2 is a second schematic diagram of the composition structure of an electronic device according to an embodiment of the application;

FIG. 3 is the third schematic diagram of the composition structure of the electronic device according to the embodiment of the application;

FIG. 4 is a schematic diagram 1 of the implementation process of the unlocking method according to the embodiment of this application;

FIG. 5A is a schematic diagram 1 of the hardware composition structure of an electronic device in the prior art;

FIG. 5B is a second schematic diagram of the hardware composition structure of an electronic device in the prior art;

FIG. 6A is a schematic diagram 1 of the hardware composition structure of the transmitting unit in the embodiment of the application; FIG.

FIG. 6B is a second schematic diagram of the implementation process of the unlocking method according to the embodiment of this application;

6C is a schematic diagram of the hardware composition structure of an electronic device in an embodiment of the application;

FIG. 7A is the third schematic diagram of the implementation process of the unlocking method according to the embodiment of this application;

FIG. 7B is a second schematic diagram of the hardware composition structure of the transmitting unit in the embodiment of the application; FIG.

FIG. 7C is a schematic diagram of the structure of a light-emitting pulse according to an embodiment of the application; FIG.

FIG. 8 is a schematic diagram of the composition structure of an unlocking device according to an embodiment of the application;

FIG. 9 is a schematic diagram of a hardware entity of an electronic device according to an embodiment of the application.

detailed description

At present, users are increasingly pursuing full-screen electronic devices (for example, full-screen mobile phones). A problem faced by full-screen electronic devices is the placement of the front camera.

When the front camera is placed under the screen, due to the influence of the internal circuit and pixel structure of the display, the screen transmittance is low, which will block the light energy and imaging when taking pictures, resulting in poor picture effects. Therefore, in order to avoid this problem, the front cameras of almost all full-screen electronic devices currently adopt mechanical methods such as pop-up and side sliding. However, the result of this is that on the one hand, it is easy to enter ash, on the other hand, the cost and production process requirements are higher.

In order to completely solve the problem of realizing a full screen, various electronic equipment manufacturers are also trying to place the camera under the screen to optimize the photo effect while displaying normally. Based on this situation, realizing real under-screen unlocking has also become a strong demand for full screens.

At present, 3D structured light is widely used for face recognition. 3D structured light usually includes an infrared laser emitting unit and an infrared receiving unit. Among them, after the infrared laser emitting unit projects the dot matrix light spot with specific light information to the surface of the object, it is collected by the infrared receiving unit. Then calculate the position and depth of the object according to the change of the light signal caused by the object, and then restore the entire three-dimensional space. However, the use of 3D structured light for face recognition and unlocking requires a certain amount of laser energy. When used under the screen, it is also affected by the low transmittance of the display screen and the internal structure, resulting in reduced laser energy, resulting in poor 3D depth effect and recognition accuracy. Low, short use distance and other issues.

For this reason, in the prior art, the luminous power of the infrared dot matrix projector is usually increased to compensate for the laser energy after passing through the display screen. Or by reducing the pixel density of the display to increase the transmittance. However, increasing the power of the infrared dot matrix transmitter will increase the power consumption of the electronic equipment and make it difficult to dissipate heat. In addition, high-power infrared light sources cause flickering points on the display screen, which affects the display life. At the same time, reduce the pixel density of the display screen, the display resolution will be reduced, and the display effect will be worse.

In order to solve the above problems, the embodiment of the application proposes an unlocking scheme based on a certain resolution display screen based on the working principle of structured light. The first channel uses high-density and low-power uniform light-emitting devices, and the second channel of the dual-channel uses low-density, normal-power-consumption specific light-emitting devices. Correspondingly, the receiving unit adopts a dual-mode working mode. When unlocking under the screen, the light-emitting elements of the first channel and the second channel emit light in sequence according to the recognition and unlocking logic. The light information returned by the second channel can complete the face recognition and unlocking process under the condition of lower light transmittance.

The technical solution of the present application will be further elaborated below with reference to the drawings and embodiments. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments of the present application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present application.

In the following description, the use of suffixes such as “module”, “part” or “unit” used to indicate elements is only for the description of the present application, and has no specific meaning in itself. Therefore, "module", "part" or "unit" can be used in a mixed manner.

An embodiment of the present application provides an electronic device. FIG. 1 is a first schematic diagram of the structure of the electronic device according to an embodiment of the present application. As shown in FIG. 1, the electronic device 100 includes a transmitter 101, a receiver 102, and a processor 103;

The transmitter 101 is used to sequentially emit light information with a first density and light information with a second density; wherein, the first density is different from the second density;

The receiver 102 is configured to correspondingly receive the optical information with the first density and the optical information with the second density;

The processor 103 is configured to execute the following steps:

In some embodiments, the electronic device further includes a camera; the camera is used to collect a color RGB image of the target object; correspondingly, the processor is further used to perform the following steps: use the color RGB image Determine the type of the target object; if the type of the target object conforms to a preset type, use the light information with the first density to perform image collection on the target object.

In the embodiment of the present application, the electronic device includes: a transmitter, a receiver, and a processor; the transmitter is used to sequentially emit optical information with a first density and optical information with a second density; wherein, the first density A density is different from the second density; the receiver is used to correspondingly receive the optical information with the first density and the optical information with the second density; the processor is used to perform the following steps: The light information with the first density performs image collection on the target object to obtain the first target image; if the first target image is successfully matched with the first preset image, the light information with the second density is used to The target object performs image collection to obtain a second target image; if the second target image is successfully matched with the second preset image, the electronic device is unlocked. In this way, the screen resolution and screen life can be guaranteed while achieving Under-screen 3D recognition and unlocking with low transmittance.

Based on the foregoing embodiment, an embodiment of the present application further provides an electronic device. FIG. 2 is a schematic diagram of the composition structure of the electronic device according to the embodiment of this application. As shown in FIG. 2, the electronic device 200 includes: a transmitter 201, a receiver The transmitter 202 and the processor 203; wherein, the transmitter 201 includes a first transmission channel 2011 and a second transmission channel 2012;

The transmitter 201 is used to sequentially emit light information with a first density and light information with a second density; wherein, the first density is greater than the second density;

The first emission channel 2011 includes a plurality of light-emitting elements arranged at the first density, and the second emission channel 2012 includes a plurality of light-emitting elements arranged at the second density;

Here, a plurality of light-emitting elements arranged at the first density in the first emission channel 2011 are used to emit light information having a first density, and a plurality of the second emission channels 2012 are arranged at the first density. The two-density arrangement of light-emitting elements is used to emit light information with the second density.

The receiver 202 is configured to correspondingly receive the optical information with the first density and the optical information with the second density;

The processor 203 is configured to execute the following steps:

Based on the foregoing embodiment, an embodiment of the present application further provides an electronic device, and the electronic device includes:

A transmitter, a receiver, and a processor; wherein the transmitter includes a first transmission channel and a second transmission channel;

The transmitter is used to sequentially emit light information with a first density and light information with a second density; wherein the first density is greater than the second density;

The first emission channel includes a plurality of light-emitting elements arranged at the first density, and the second emission channel includes a plurality of light-emitting elements arranged at the second density; the first emission channel The light-emitting element in has a first power, and the light-emitting element in the second emission channel has a second power, and the first power is less than the second power;

Correspondingly, the first emission channel is used to emit a uniform light spot, and the second emission channel is used to emit a lattice light spot with specific information;

Here, the plurality of light-emitting elements arranged in the first density in the first emission channel are used to emit a uniform light spot, and the plurality of light-emitting elements in the second emission channel are arranged in the second density Used to emit a dot matrix spot with specific information.

Here, when the first emission channel emits a uniform light spot, the receiver correspondingly receives the reflected light information projected by the uniform light spot to the target object. When the second transmitting channel emits a dot matrix light spot with specific information, the receiver correspondingly receives the reflected light information of the dot matrix light spot with specific information projected to the target object.

The processor is configured to execute the following steps:

Here, the light information with the first density may be a uniform light spot, and the light information with the second density may be a dot matrix light spot with specific information. The first target image may be a 2D image of the target object, and the second target image may be a 3D image of the target object.

Based on the foregoing embodiment, the embodiment of the present application further provides an electronic device. FIG. 3 is a schematic diagram of the composition structure of the electronic device according to the embodiment of the present application. As shown in FIG. 3, the electronic device 300 includes:

Transmitter 301, receiver 302, and processor 303;

The emitter 301 includes a plurality of light-emitting elements;

The plurality of light-emitting elements includes N first light-emitting elements 3011 and M second light-emitting elements 3012; wherein, N and M are both natural numbers greater than or equal to 2, and N is less than M;

The transmitter 301 is used to sequentially emit light information with a first density and light information with a second density; wherein, the first density is different from the second density;

Here, the N first light emitting elements 3011 are used to emit light information having a first density, and the M second light emitting elements 3012 are used to emit light information having a second density.

The receiver 302 is configured to correspondingly receive the optical information with the first density and the optical information with the second density;

The processor 303 is configured to execute the following steps:

In some embodiments, the electronic device 300 further includes a camera; the camera is used to collect color RGB images of the target object; correspondingly, the processor 303 is further used to perform the following steps: use the color The RGB image determines the type of the target object; if the type of the target object conforms to a preset type, image collection is performed on the target object by using the light information with the first density.

Transmitter, receiver and processor;

The emitter includes a plurality of light-emitting elements;

The plurality of light-emitting elements include N first light-emitting elements and M second light-emitting elements; wherein, N and M are both natural numbers greater than or equal to 2, and N is less than M;

Here, the N first light-emitting elements are used to emit light information having a first density, and the M second light-emitting elements are used to emit light information having a second density.

In the embodiment of the present application, the light spots emitted by the N first light-emitting elements are used to obtain the feature point information of the target object; the light spots emitted by the M second light-emitting elements are used to obtain the depth information of the target object ；

The processor is configured to perform the following steps:

In the embodiment of the present application, when the light spots emitted by the N first light-emitting elements are used to obtain feature point information of the target object, the use of the light information with the first density to perform image collection on the target object, The method includes: using the light spots emitted by the N first light-emitting elements to perform image collection on the target object, so as to obtain feature point information of the target object.

In the embodiment of the present application, when the light spots emitted by the M second light-emitting elements are used to obtain the depth information of the target object, the use of the light information with the second density to perform image collection on the target object , Including: using the light spots emitted by the M second light-emitting elements to perform image collection on the target object, so as to obtain depth information of the target object.

Of course, the collected first target image containing the feature point information of the target object may be a 2D image, and the collected second target image containing the depth information of the target object may be a 3D image.

Based on the foregoing embodiment, the embodiment of the present application provides an unlocking method, which is applied to the above-mentioned electronic device. The function implemented by the method can be realized by calling the program code by the processor in the electronic device. Of course, the program code can be stored in Computer storage media. Fig. 4 is a schematic diagram 1 of the implementation process of the unlocking method according to the embodiment of this application. As shown in Fig. 4, the method includes:

Step S401: Use the light information with the first density emitted by the transmitter of the electronic device to image the target object to obtain the first target image;

Here, the electronic device may be various types of devices with information processing capabilities, such as smart phones, PDAs (Personal Digital Assistants, personal digital assistants), navigators, digital phones, video phones, smart watches, smart bracelets, Wearable devices, tablets, all-in-ones, etc. The target object may be a person or an object whose face is waiting to be recognized.

Here, when the transmitter of the electronic device projects the generated light information with the first density onto the surface of the target object, the corresponding receiving unit generates the first target image according to the received reflected light information. The first target image may be a 2D image, such as an image including contour information of the target object, or an image including feature point information of the target object, or the like.

Step S402: If the first target image is successfully matched with the first preset image, use the light information with the second density emitted by the emitter of the electronic device to perform image collection on the target object to obtain a second target image ；

Here, if the first target image is successfully matched with the first preset image, the light information with the second density generated by the emitter is used to perform image collection on the target object. Conversely, if the first target image fails to match the first preset image, the unlocking may be stopped and an error message may be reported.

Here, the light information with the second density may be light information with specific information. Correspondingly, the receiving unit generates the second target image according to the received reflected light information with specific information. The second target image may be a 3D image, for example, an image including depth information of the target object.

Step S403: If the second target image is successfully matched with the second preset image, unlock the electronic device; wherein, the first density is different from the second density.

Here, if the second target image fails to match the second preset image, the unlocking may be stopped and an error message may be reported.

In some embodiments, the method further includes: using a camera of the electronic device to collect a color RGB image of the target object; using the color RGB image to determine the type of the target object; if the type of the target object is According to the preset type, image acquisition is performed on the target object by using the light information with the first density.

Based on the foregoing embodiment, the embodiment of the present application further provides an unlocking method, which is applied to the above-mentioned electronic device, and the method includes:

Step S411: Use the light information with the first density emitted by the first emission channel of the transmitter to perform image collection on the target object to obtain a first target image; the first emission channel includes a plurality of Light-emitting elements arranged in the first density;

Step S412: If the first target image is successfully matched with the first preset image, use the light information with the second density emitted by the second emission channel of the transmitter to perform image collection on the target object to obtain a second Target image; the second emission channel includes a plurality of light-emitting elements arranged at the second density; wherein the first density is greater than the second density;

Step S413: If the second target image is successfully matched with the second preset image, unlock the electronic device.

Based on the foregoing embodiment, an embodiment of the present application further provides an unlocking method, the method is applied to the above-mentioned electronic device, and the method includes:

Step S421: Use the uniform light spot emitted by the first emission channel to perform image collection on the target object to obtain a first target image; the first emission channel includes a plurality of light-emitting elements arranged at the first density ；

Step S422: If the first target image is successfully matched with the first preset image, use the dot matrix light spot with specific information emitted by the second emission channel to perform image collection on the target object to obtain a second target image The second emission channel includes a plurality of light-emitting elements arranged at the second density; wherein the first density is greater than the second density;

Here, the light-emitting element in the first emission channel has a first power, and the light-emitting element in the second emission channel has a second power, and the first power is less than the second power.

Step S423: If the second target image is successfully matched with the second preset image, unlock the electronic device.

Step S431: Use the light information emitted by the N first light-emitting elements in the transmitter to perform image collection on the target object to obtain a first target image;

Step S432: If the first target image is successfully matched with the first preset image, use the light information emitted by the M second light-emitting elements in the transmitter to perform image collection on the target object to obtain a second target image ; Among them, N and M are both natural numbers greater than or equal to 2, and N is less than M;

Step S433: If the second target image is successfully matched with the second preset image, unlock the electronic device.

Step S441: Use the light spots emitted by the N first light-emitting elements in the transmitter to perform image collection on the target object to obtain feature point information of the target object to obtain a first target image;

Step S442: If the first target image is successfully matched with the first preset image, use the light spots emitted by the M second light-emitting elements in the transmitter to perform image collection on the target object to obtain the target object To obtain the second target image; where N and M are both natural numbers greater than or equal to 2, and N is less than M;

Step S443: If the second target image is successfully matched with the second preset image, unlock the electronic device.

Based on the foregoing embodiment, the embodiment of the present application provides an unlocking method. The method is based on a display screen with a certain resolution, and considering the working principle of structured light, the emitting unit is configured to adopt a dual-channel luminous infrared dot matrix projection Device. Among them, the first channel uses a high-density, low-power, uniform light-emitting device, and the second channel uses a low-density, normal-power-consumption specific light-emitting device. The receiving unit is configured to adopt a dual-mode working mode. When unlocking under the screen, the light-emitting elements of the first channel and the second channel emit light in sequence according to the recognition and unlocking logic, and the receiving unit uses the first mode and the second mode synchronously, corresponding to receiving the signals returned by the first channel and the second channel, respectively. Light information, so that the face recognition and unlocking process can be completed under the condition of lower light transmittance.

5A is a schematic diagram of the hardware composition structure of an electronic device in the prior art. As shown in FIG. 5A, the electronic device includes a glass cover 51 on a display screen, and a structured light emitting unit 52 and a structured light receiving unit 53 . In order to avoid the loss of structured light passing through the screen, it is set so that the light information emitted by the structured light emitting unit 52 and the light information received by the receiving unit 53 only pass through a transparent glass cover, but this cannot achieve a full screen of the electronic device. . If a full screen is to be realized, the transmitting unit and the receiving unit can only be set to adopt mechanical methods such as pop-up type and side sliding type, but in this case, on the one hand, it is easy to get dust, and on the other hand, the cost and production process requirements are higher. .

FIG. 5B is a second schematic diagram of the hardware composition structure of an electronic device in the prior art. As shown in FIG. 5B, the electronic device includes a display screen 51 (the display screen 51 includes a pixel array 511), and a glass cover on the display screen 52. The transmitting unit 53 and the receiving unit 54. When both the transmitting unit 53 and the receiving unit 54 of the electronic device are arranged under the display screen 51, a full screen, that is, an under-screen structured light solution, is realized. However, due to the presence of the pixel array 511 in the display screen 51, the light emitting and receiving transmittance of the structured light are reduced, resulting in low recognition accuracy.

6A is a schematic diagram 1 of the hardware composition structure of the transmitting unit in the embodiment of the application. As shown in FIG. 6A, the transmitting unit of the electronic device in the embodiment of the application includes two channels, a first channel 61 and a second channel 62. Wherein, the first channel 61 includes a plurality of light-emitting elements 611, and the second channel 62 includes a plurality of light-emitting elements 621. The first channel also includes a first channel pin 612, and most of the second channels also include a second channel pin 622.

The multiple light-emitting elements 611 in the first channel 61 are uniform light-emitting elements with high density and low power consumption, and the multiple light-emitting elements 621 in the second channel 62 are specific light-emitting elements with low density and normal power consumption. At the same time, the receiving unit adopts a dual-mode working mode. When unlocking under the screen, the light-emitting elements of the first channel 61 and the second channel 62 emit light in sequence according to the recognition and unlocking logic. Correspondingly, the receiving unit synchronously uses the first mode and the second mode to receive the light information returned by the first channel 61 and the second channel 62, respectively, so that the face recognition and unlocking process under a lower light transmittance can be realized.

Fig. 6B is a second schematic diagram of the implementation process of the unlocking method according to the embodiment of this application. As shown in Fig. 6B, the method includes:

Step S601: Obtain a first face information image and a second face information image;

Step S602: Receive an unlock start signal;

Step S603, driving the light-emitting element in the first channel of the emitting unit with a low current, so that the light-emitting element projects a uniform light spot on the human face;

Step S604: Turn on the infrared receiver to the first working mode to obtain the optical information returned by the first channel;

Step S605: Generate an infrared face image according to the light information returned by the first channel, and perform a matching comparison between the infrared face image and the first face information image;

Step S606: If the matching is passed, the second channel of the emitting unit is turned on, so that the light-emitting element in the second channel projects a dot matrix light spot with specific information on the human face;

Step S607: Turn on the infrared receiver to the second working mode to obtain the optical information returned by the second channel;

Step S608: Generate a face 3D depth image according to the light information returned by the second channel, and compare the face 3D depth image with the second face information image;

Step S609: If the matching and comparison pass, respond to the unlocking start signal.

Correspondingly, FIG. 6C is a schematic diagram of the hardware composition structure of the electronic device in an embodiment of the application. As shown in FIG. 6C, the electronic device includes a transmitting unit 61, a receiving unit 62, and a depth processing unit 63. Wherein, the transmitting unit 61 includes a first channel 611 and a second channel 612. The first channel 611 in the emitting unit 61 is used to project a uniform light spot on the human face, and the second channel 612 in the transmitting unit 61 is used to project a dot matrix light spot with specific information on the human face. The receiving unit 62 is used to receive the light information reflected by the face. When the receiving unit 62 is working in the first mode, it can generate the first image 64 by receiving the return information of the light information emitted by the first channel 611. When When the receiving unit 62 works in the second mode, it can generate the second image 65 by receiving the return information of the optical information emitted by the second channel 612. The depth processing unit 63 is used for identifying and matching the first image 64 and the second image 65.

The embodiment of the application provides a display screen based on a certain resolution, using a structured light solution composed of a low-power dual-channel transmitter and a dual-working mode receiver, which realizes low-transmittance under-screen 3D recognition and unlocking In this way, it not only guarantees the display resolution, but also uses the structured light working mode with lower power consumption to realize the under-screen 3D unlocking with low light transmittance, and at the same time guarantees the service life of the screen.

Based on the foregoing embodiment, the embodiment of the present application further provides an unlocking method, which is unlocked by RGB-D (Red Green Blue-Dimension) recognition and stepped power projection spot. FIG. 7A is the third schematic diagram of the implementation process of the unlocking method according to the embodiment of this application. As shown in FIG. 7A, the method includes:

Step S701, setting a face feature point detection area and a light spot projection area on the light emitting element of the emitting unit;

Here, the transmitting unit may be an infrared dot matrix projector.

FIG. 7B is a second schematic diagram of the hardware composition structure of the transmitting unit in the embodiment of the application. As shown in FIG. 7B, the transmitting unit includes a face feature point detection area 71 and a light spot projection area 72. The face feature point detection area 71 is used to project light information for face feature point detection, and the light spot projection area 72 is used to project light information for face 3D depth information reconstruction.

Step S702: Obtain a captured RGB image, and determine whether the RGB image is a human face;

Here, the camera of the electronic device can be used to take RGB images.

Step S703: When the RGB image is a human face, activate the face feature point detection area to project a light spot to the face to be verified, and obtain corresponding feature point information;

Step S704: If the acquired facial feature point information to be verified matches the user's facial feature information, start the light spot projection area, and project the dot matrix light spot to the face to be verified to obtain face depth information;

Step S705: If the acquired face depth information to be verified matches the entered face depth information successfully, unlocking is completed.

In the embodiment of this application, fewer light spots are emitted in advance to recognize the facial features of the user, and then dense light spots are emitted after the pre-judgment is successful, which further improves the recognition and unlocking accuracy, so as to realize the 3D recognition and unlocking under the screen, but also Reduce the power consumption of the transmitting unit.

In some embodiments, the current of the emitting unit can also be increased, and the luminous frequency and the duty cycle of each luminous pulse can be simultaneously reduced. In this way, the instantaneous power of the lattice laser can be increased in this way, so as to meet the working requirements. , It can reduce noise and improve the effect of signal-to-noise ratio and depth accuracy. In addition, because the launch time becomes shorter, damage to the screen can also be reduced.

FIG. 7C is a schematic diagram of the structure of a light-emitting pulse according to an embodiment of the application. As shown in FIG. 7C, the duty cycle of each light-emitting pulse is 10% under normal circumstances. In this embodiment, the duty cycle of each light-emitting pulse can be changed. The ratio is reduced to 5%. In this way, the instantaneous power of the lattice laser is increased, and the penetrating power of the lattice laser is improved.

Based on the foregoing embodiment, an embodiment of the present application provides an unlocking device, which includes each unit included, and each module included in each unit, and each component included in each module, which can be processed in an electronic device Of course, it can also be implemented by specific logic circuits; in the implementation process, the processor can be CPU (Central Processing Unit, central processing unit), MPU (Microprocessor Unit, microprocessor), DSP (Digital Signal Processing Unit), , Digital Signal Processor) or FPGA (Field Programmable Gate Array, Field Programmable Gate Array), etc.

FIG. 8 is a schematic diagram of the composition structure of an unlocking device according to an embodiment of the application. As shown in FIG. 8, the unlocking device 800 includes:

The first acquisition unit 801 is configured to use the light information with the first density emitted by the transmitter of the electronic device to perform image acquisition on the target object to obtain the first target image;

The second acquisition unit 802 is configured to, if the first target image is successfully matched with the first preset image, use the light information with the second density emitted by the transmitter of the electronic device to perform image acquisition on the target object, Obtain the second target image;

The matching unit 803 is configured to unlock the electronic device if the second target image is successfully matched with the second preset image;

Wherein, the first density is different from the second density.

In some embodiments, the first collection unit 801 includes:

The first acquisition module is configured to use the light information with the first density emitted by the first emission channel of the transmitter to perform image collection on the target object; the first emission channel includes a plurality of Light-emitting elements arranged in density;

Correspondingly, the second collection unit 802 includes:

The second acquisition module is configured to use the light information with the second density emitted by the second emission channel of the transmitter to perform image collection on the target object; the second emission channel includes a plurality of Light-emitting elements arranged in density;

Wherein, the first density is greater than the second density.

In some embodiments, the first acquisition module includes:

A first collection component, configured to collect images of the target object by using the uniform light spot emitted by the first emission channel;

Correspondingly, the second acquisition module includes:

A second acquisition component, configured to use the dot matrix light spot with specific information emitted by the second emission channel to perform image acquisition on the target object;

Wherein, the light-emitting element in the first emission channel has a first power, and the light-emitting element in the second emission channel has a second power, and the first power is less than the second power.

In some embodiments, the first collection unit 801 includes:

The third acquisition module is configured to use the light information emitted by the N first light-emitting elements in the transmitter to perform image acquisition on the target object;

Correspondingly, the second collection unit 802 includes:

A fourth acquisition module, configured to use the light information emitted by the M second light-emitting elements in the transmitter to perform image acquisition on the target object;

Among them, N and M are both natural numbers greater than or equal to 2, and N is less than M.

In some embodiments, the third collection module includes:

A third collection component, configured to use the light spots emitted by the N first light-emitting elements in the transmitter to perform image collection on the target object, so as to obtain feature point information of the target object;

Correspondingly, the fourth collection module includes:

The fourth collecting component is used to collect the image of the target object by using the light spots emitted by the M second light-emitting elements in the emitter to obtain the depth information of the target object.

In some embodiments, the device further includes:

A color image acquisition unit, configured to use a camera of the electronic device to acquire a color RGB image of the target object;

A determining unit, configured to determine the type of the target object by using the color RGB image;

The first collection subunit is configured to, if the type of the target object meets the preset type, use the light information with the first density to perform image collection on the target object.

The description of the above device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the device embodiments of the present application, please refer to the description of the method embodiments of the present application for understanding.

It should be noted that, in the embodiments of the present application, if the above unlocking method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present application can be embodied in the form of a software product in essence or a part that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for A computer device (which may be a personal computer, a server, or a network device, etc.) executes all or part of the methods described in the various embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, ROM (Read Only Memory), magnetic disk or optical disk and other media that can store program codes. In this way, the embodiments of the present application are not limited to any specific combination of hardware and software.

Correspondingly, an embodiment of the present application provides an electronic device, including a memory and a processor, the memory stores a computer program that can run on the processor, and when the processor executes the program, it implements the Steps in unlock method.

Correspondingly, an embodiment of the present application provides a readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps in the unlocking method described above are realized.

What needs to be pointed out here is that the description of the foregoing storage medium and device embodiments is similar to the description of the foregoing method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

It should be noted that FIG. 9 is a schematic diagram of a hardware entity of the electronic device according to an embodiment of the application. As shown in FIG. 9, the hardware entity of the electronic device 900 includes a processor 901, a communication interface 902, and a memory 903, in which:

The processor 901 generally controls the overall operation of the electronic device 900.

The communication interface 902 can enable the electronic device 900 to communicate with other terminals or servers via a network.

The memory 903 is configured to store instructions and applications executable by the processor 901, and can also cache data to be processed or processed by the processor 901 and each module in the electronic device 900 (for example, image data, audio data, voice communication data, and Video communication data) can be realized through FLASH (flash memory) or RAM (Random Access Memory).

In the several embodiments provided in this application, it should be understood that the disclosed device and method can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, such as: multiple units or components can be combined, or It can be integrated into another system, or some features can be ignored or not implemented. In addition, the coupling, or direct coupling, or communication connection between the components shown or discussed can be indirect coupling or communication connection through some interfaces, devices or units, and can be electrical, mechanical or other forms. of.

The units described above as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units; Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, the functional units in the embodiments of the present application may all be integrated into one processing module, or each unit may be individually used as a unit, or two or more units may be integrated into one unit; the above-mentioned integration The unit of can be implemented in the form of hardware, or in the form of hardware plus software functional units. A person of ordinary skill in the art can understand that all or part of the steps in the above method embodiments can be implemented by a program instructing relevant hardware. The foregoing program can be stored in a computer readable storage medium. When the program is executed, the program is executed. It includes the steps of the above method embodiment.

The methods disclosed in the several method embodiments provided in this application can be combined arbitrarily without conflict to obtain new method embodiments.

The features disclosed in the several product embodiments provided in this application can be combined arbitrarily without conflict to obtain new product embodiments.

The features disclosed in the several method or device embodiments provided in this application can be combined arbitrarily without conflict to obtain a new method embodiment or device embodiment.

The above are only specific implementations of this application, but the protection scope of this application is not limited to this. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in this application. Should be covered within the scope of protection of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims

An electronic device, wherein the electronic device includes: a transmitter, a receiver, and a processor;

The transmitter is used to sequentially emit light information with a first density and light information with a second density; wherein the first density is different from the second density;

The receiver is configured to correspondingly receive the optical information with the first density and the optical information with the second density;

The processor is configured to execute the following steps:

Use the light information with the first density to perform image acquisition on the target object to obtain a first target image; if the first target image is successfully matched with the first preset image, use the light information with the second density to pair The target object performs image collection to obtain a second target image; if the second target image is successfully matched with a second preset image, unlock the electronic device.
The electronic device according to claim 1, wherein:

The transmitter includes a first transmission channel and a second transmission channel;

The first emission channel includes a plurality of light-emitting elements arranged at the first density, and the second emission channel includes a plurality of light-emitting elements arranged at the second density;

The first density is greater than the second density.
The electronic device according to claim 2, wherein:

The light-emitting element in the first emission channel has a first power, and the light-emitting element in the second emission channel has a second power, and the first power is less than the second power;

Correspondingly, the first emission channel is used to emit a uniform light spot, and the second emission channel is used to emit a lattice light spot with specific information.
The electronic device according to claim 1, wherein:

The emitter includes a plurality of light-emitting elements;

The plurality of light-emitting elements include N first light-emitting elements and M second light-emitting elements; wherein, N and M are both natural numbers greater than or equal to 2, and N is less than M.
The electronic device according to claim 4, wherein:

The light spots emitted by the N first light-emitting elements are used to obtain feature point information of the target object;

The light spots emitted by the M second light-emitting elements are used to obtain the depth information of the target object.
The electronic device according to any one of claims 1 to 5, wherein the electronic device further comprises a camera;

The camera is used to collect a color RGB image of the target object;

Correspondingly, the processor is further configured to execute the following steps:

Using the color RGB image to determine the type of the target object;

If the type of the target object conforms to the preset type, use the light information with the first density to perform image collection on the target object.
An unlocking method, wherein the method includes:

Image acquisition of the target object by using the light information with the first density emitted by the transmitter of the electronic device to obtain the first target image;

If the first target image is successfully matched with the first preset image, use the light information with the second density emitted by the transmitter of the electronic device to perform image collection on the target object to obtain a second target image;

If the second target image is successfully matched with the second preset image, unlock the electronic device;

Wherein, the first density is different from the second density.
8. The method according to claim 7, wherein said using the light information having the first density emitted by the transmitter of the electronic device to image the target object comprises:

Image acquisition of the target object by using light information with a first density emitted by the first emission channel of the transmitter; the first emission channel includes a plurality of light-emitting elements arranged at the first density;

Correspondingly, said using the light information with the second density emitted by the transmitter of the electronic device to image the target object includes:

Use the light information with the second density emitted by the second emission channel of the transmitter to image the target object; the second emission channel includes a plurality of light-emitting elements arranged at the second density;

Wherein, the first density is greater than the second density.
8. The method according to claim 8, wherein said using the light information having the first density emitted by the first emission channel of the transmitter to image the target object comprises:

Image acquisition of the target object by using the uniform light spot emitted by the first emission channel;

Correspondingly, the use of the light information having the second density emitted by the second emission channel of the transmitter to image the target object includes:

Image acquisition of the target object by using the dot matrix light spot with specific information emitted by the second emission channel;

Wherein, the light-emitting element in the first emission channel has a first power, and the light-emitting element in the second emission channel has a second power, and the first power is less than the second power.
8. The method according to claim 7, wherein said using the light information having the first density emitted by the transmitter of the electronic device to image the target object comprises:

Using the light information emitted by the N first light-emitting elements in the emitter to perform image collection on the target object;

Correspondingly, said using the light information with the second density emitted by the transmitter of the electronic device to image the target object includes:

Using the light information emitted by the M second light-emitting elements in the transmitter to perform image collection on the target object;

Among them, N and M are both natural numbers greater than or equal to 2, and N is less than M.
The method according to claim 10, wherein said using the light information emitted by the N first light-emitting elements in the emitter to perform image collection on the target object comprises:

Image acquisition of the target object by using light spots emitted by the N first light-emitting elements in the transmitter to obtain feature point information of the target object;

Correspondingly, the using the light information emitted by the M second light-emitting elements in the transmitter to perform image collection on the target object includes:

The light spots emitted by the M second light-emitting elements in the emitter are used to perform image collection on the target object to obtain depth information of the target object.
The method according to any one of claims 7 to 11, wherein the method further comprises:

Collecting the color RGB image of the target object by using the camera of the electronic device;

Using the color RGB image to determine the type of the target object;

If the type of the target object conforms to the preset type, use the light information with the first density to perform image collection on the target object.
An unlocking device, wherein the device includes:

The first collection unit is configured to collect the image of the target object by using the light information with the first density emitted by the transmitter of the electronic device to obtain the first target image;

The second acquisition unit is configured to, if the first target image is successfully matched with the first preset image, use the light information with the second density emitted by the transmitter of the electronic device to perform image acquisition on the target object to obtain Second target image;

A matching unit, configured to unlock the electronic device if the second target image is successfully matched with the second preset image;

Wherein, the first density is different from the second density.
The device according to claim 13, wherein the first collection unit comprises:

The first acquisition module is configured to use the light information with the first density emitted by the first emission channel of the transmitter to perform image collection on the target object; the first emission channel includes a plurality of Light-emitting elements arranged in density;

Correspondingly, the second collection unit includes:

The second acquisition module is configured to use the light information with the second density emitted by the second emission channel of the transmitter to perform image collection on the target object; the second emission channel includes a plurality of Light-emitting elements arranged in density;

Wherein, the first density is greater than the second density.
The device according to claim 14, wherein the first collection module comprises:

A first collection component, configured to collect images of the target object by using the uniform light spot emitted by the first emission channel;

Correspondingly, the second acquisition module includes:

A second acquisition component, configured to use the dot matrix light spot with specific information emitted by the second emission channel to perform image acquisition on the target object;

Wherein, the light-emitting element in the first emission channel has a first power, and the light-emitting element in the second emission channel has a second power, and the first power is less than the second power.
The device according to claim 13, wherein the first collection unit comprises:

The third acquisition module is configured to use the light information emitted by the N first light-emitting elements in the transmitter to perform image acquisition on the target object;

Correspondingly, the second collection unit includes:

A fourth acquisition module, configured to use the light information emitted by the M second light-emitting elements in the transmitter to perform image acquisition on the target object;

Among them, N and M are both natural numbers greater than or equal to 2, and N is less than M.
The device according to claim 16, wherein the third acquisition module comprises:

A third collection component, configured to use the light spots emitted by the N first light-emitting elements in the transmitter to perform image collection on the target object, so as to obtain feature point information of the target object;

Correspondingly, the fourth collection module includes:

The fourth collecting component is used to collect the image of the target object by using the light spots emitted by the M second light-emitting elements in the emitter to obtain the depth information of the target object.
The device according to any one of claims 13 to 17, wherein the device further comprises:

A color image acquisition unit, configured to use a camera of the electronic device to acquire a color RGB image of the target object;

A determining unit, configured to determine the type of the target object by using the color RGB image;

The first collection subunit is configured to, if the type of the target object meets the preset type, use the light information with the first density to perform image collection on the target object.
An electronic device, comprising a memory and a processor, the memory storing a computer program that can run on the processor, and when the processor executes the program, the unlocking method of any one of claims 7 to 12 is implemented step.
A computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps in the unlocking method of any one of claims 7 to 12 are realized.