WO2020052283A1

WO2020052283A1 - Electronic apparatus, and control method and control apparatus therefor, and computer-readable storage medium

Info

Publication number: WO2020052283A1
Application number: PCT/CN2019/090018
Authority: WO
Inventors: 张学勇
Original assignee: Oppo广东移动通信有限公司
Priority date: 2018-09-10
Filing date: 2019-06-04
Publication date: 2020-03-19
Also published as: CN109376515A

Abstract

A control method for an electronic apparatus (100), a control apparatus (10) for the electronic apparatus (100), the electronic apparatus (100), and a computer-readable storage medium (200). The electronic apparatus (100) comprises a flight time module (30) and an infrared camera (40). The control method comprises: (011) controlling the infrared camera (40) to collect the current infrared image of a human face; (012) carrying out human face authentication according to the current infrared image; (013) controlling the flight time module (30) to collect the current depth image of the human face; (014) carrying out depth authentication according to the current depth image; and (015) when both the human face authentication and the depth authentication are passed, controlling the electronic apparatus (100) to execute a pre-determined operation.

Description

Electronic device, control method thereof, control device and computer-readable storage medium

Priority information

This application claims the priority and rights of the patent application with the patent application number 201811048780.1, which was filed with the State Intellectual Property Office of China on September 10, 2018, and is incorporated herein by reference in its entirety.

Technical field

The present application relates to the field of consumer electronic products, and more particularly, to a method for controlling an electronic device, a control device for an electronic device, an electronic device, and a computer-readable storage medium.

Background technique

With the rapid development of electronic technology, electronic devices such as smart phones and tablet computers have become increasingly popular. The electronic device usually verifies whether the user has relevant usage rights according to the two-dimensional image of the face input by the user.

Summary of the Invention

Embodiments of the present application provide a method for controlling an electronic device, a control device for an electronic device, an electronic device, and a computer-readable storage medium.

An embodiment of the present application provides a method for controlling an electronic device. The electronic device includes a time-of-flight module and an infrared light camera. The control method includes: controlling the infrared light camera to collect a current infrared light image of a human face; The current infrared light image is used for face authentication; the time-of-flight module is controlled to collect the current depth image of the face; the depth authentication is performed according to the current depth image; and when both the face authentication and the depth authentication pass , Controlling the electronic device to perform a predetermined operation.

An embodiment of the present application provides a control device for an electronic device. The electronic device includes a time-of-flight module and an infrared light camera. The control device includes a first control module, a first authentication module, a second control module, and a second authentication. A module and a third control module; a first control module configured to control the infrared light camera to collect a current infrared light image of a human face; a first authentication module configured to perform a face authentication based on the current infrared light image; a second control module Configured to control the time-of-flight module to collect a current depth image of a face; a second authentication module is configured to perform depth authentication based on the current depth image; and a third control module is configured to perform the face authentication and the depth authentication When all passes, the electronic device is controlled to perform a predetermined operation.

An embodiment of the present application provides an electronic device. The electronic device includes a time-of-flight module, an infrared light camera, one or more processors, a memory, and one or more programs, wherein the one or more programs are stored in The memory is configured to be executed by the one or more processors, and the program includes instructions for executing the control method of the electronic device according to the foregoing embodiment.

An embodiment of the present application provides a computer-readable storage medium. The computer-readable storage medium includes a computer program used in combination with an electronic device, and the computer program can be executed by a processor to complete the electronic device described in the foregoing embodiment. Control Method.

Additional aspects and advantages of the embodiments of the present application will be partially given in the following description, and part of them will become apparent from the following description, or be learned through the practice of the embodiments of the present application.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

1 is a schematic flowchart of a method for controlling an electronic device according to some embodiments of the present application;

2 is a schematic block diagram of a control device of an electronic device according to some embodiments of the present application;

3 is a schematic structural diagram of an electronic device according to some embodiments of the present application;

4 is a schematic flowchart of a method for controlling an electronic device according to some embodiments of the present application;

5 is a schematic block diagram of a control device of an electronic device according to some embodiments of the present application;

6 is a schematic diagram of a method for controlling an electronic device according to some embodiments of the present application;

7 is a schematic flowchart of a method for controlling an electronic device according to some embodiments of the present application;

8 is a schematic block diagram of a control device of an electronic device according to some embodiments of the present application;

9 is a schematic diagram of a method for controlling an electronic device according to some embodiments of the present application;

10 is a schematic flowchart of a method for controlling an electronic device according to some embodiments of the present application;

11 is a schematic block diagram of a control device of an electronic device according to some embodiments of the present application;

12 is a schematic diagram of a method for controlling an electronic device according to some embodiments of the present application;

13 is a schematic block diagram of an electronic device according to some embodiments of the present application;

14 is a schematic diagram of a connection state between an electronic device and a computer-readable storage medium according to some embodiments of the present application;

FIG. 15 is a perspective structural diagram of a time-of-flight module according to some embodiments of the present application; FIG.

16 is a schematic top view of a time-of-flight module according to some embodiments of the present application;

17 is a schematic bottom view of a time of flight module according to some embodiments of the present application;

18 is a schematic side view of a time-of-flight module according to some embodiments of the present application;

19 is a schematic cross-sectional view of the time-of-flight module shown in FIG. 16 along the line XIX;

FIG. 20 is an enlarged schematic view of the XX part in the time-of-flight module shown in FIG. 19; FIG.

21 is a schematic front view of a time-of-flight module of some embodiments of the present application when the flexible circuit board is not bent.

detailed description

The embodiments of the present application are further described below with reference to the accompanying drawings. The same or similar reference numerals in the drawings represent the same or similar elements or elements having the same or similar functions throughout. The embodiments of the present application described below with reference to the drawings are exemplary, and are only used to explain the embodiments of the present application, and should not be construed as limiting the present application.

Please refer to FIGS. 1 and 3. An electronic device 100 according to an embodiment of the present application includes a time-of-flight module 30 and an infrared light camera 40. Control methods include:

011: control the infrared light camera 40 to collect the current infrared light image of the human face;

012: Face authentication according to the current infrared light image;

013: controlling the time-of-flight module 30 to collect a current depth image of a human face;

014: depth authentication based on the current depth image; and

015: When both face authentication and depth authentication pass, control the electronic device 100 to perform a predetermined operation.

In some embodiments, the step of controlling the time-of-flight module 30 to collect the current depth image of the face (ie, 013) is performed when the face authentication is passed; or the infrared light camera 40 is controlled to collect the current infrared light image of the face The step (011) is performed when the deep authentication passes.

In some embodiments, the predetermined operation includes at least one of unlocking, lighting the display screen 103 of the electronic device 100 (as shown in FIG. 3), electronic payment, and opening a predetermined application of the electronic device 100.

Please refer to FIG. 4. In some embodiments, the step of controlling the infrared camera 40 to collect the current infrared image of the human face (ie, 011) and the step of controlling the time of flight module 30 to collect the current depth image of the human face (ie, 013) ) Is performed during the unlocking process of the electronic device 100, and the control method further includes:

016: controlling the infrared light camera 40 to collect a reference infrared light image of a human face during the encryption process;

The step of performing face authentication according to the current infrared light image (that is, 012) includes:

0122: determine a first similarity between the current infrared light image and the reference infrared light image;

Control methods also include:

017: controlling the time-of-flight module 30 to acquire a reference depth image of a human face during the encryption process;

The steps (i.e. 014) for performing deep authentication based on the current depth image include:

0142: determine the second similarity between the current depth image and the reference depth image;

When both the face authentication and the deep authentication pass, the step of controlling the electronic device 100 to perform a predetermined operation (that is, 015) includes:

0152: Control the electronic device 100 to unlock when the first similarity is greater than the first threshold and the second similarity is greater than the second threshold.

Please refer to FIG. 4 again. In some embodiments, the control method further includes:

018: The electronic device 100 is locked when the first similarity is larger than the third threshold and the second similarity is smaller than the fourth threshold; wherein the third threshold is larger than the first threshold and the fourth threshold is smaller than the second threshold.

Referring to FIG. 7, in some embodiments, the control method further includes:

019: identify target feature points in the current depth image;

020: Divide the current depth image into a first region and a second region according to the target feature points, where the first region includes the target feature points;

The reference depth image includes a first reference depth image and a second reference depth image. The step of determining a second similarity between the current depth image and the reference depth image (that is, 0142) includes:

01422: Determine a first sub-similarity between the first region and the first reference depth image;

01424: Determine a second sub-similarity between the second region and the second reference depth image;

The second threshold includes a first sub-threshold and a second sub-threshold. The first sub-threshold is greater than the second sub-threshold. When the first similarity is greater than the first threshold and the second similarity is greater than the second threshold, controlling the electronic device 100 to unlock the The steps (ie, 0152) include:

01522: When the first sub similarity is greater than the first sub threshold, the second sub similarity is greater than the second sub threshold, and the second similarity is greater than the second threshold, the electronic device 100 is controlled to unlock.

Referring to FIG. 10, in some embodiments, the step (ie 011) of controlling the infrared light camera 40 to collect a current infrared light image of a human face includes:

0112: Control infrared light camera 40 to collect multiple current infrared light images;

Control methods also include:

021: identify multiple target feature points in each frame of the current infrared light image;

022: judging whether the plurality of target feature points are in a moving state according to the relative position changes between the plurality of target feature points in the multi-frame current infrared light image; and

When multiple target feature points are in a moving state, a step of performing face authentication based on the current infrared light image (ie, 012), or a step of controlling the time of flight module 30 to collect a current depth image of the face (ie, 013) is entered.

Please refer to FIGS. 2 and 3. The electronic device 100 according to the embodiment of the present application includes a time-of-flight module 30 and an infrared light camera 40. The control device 10 includes a first control module 11, a first authentication module 12, a second control module 13, a second authentication module 14, and a third control module 15. The first control module 11 is configured to control the infrared light camera 40 to collect a current infrared light image of a human face. The first authentication module 12 is configured to perform face authentication according to the current infrared light image. The second control module 13 is configured to control the time-of-flight module 30 to collect a current depth image of a human face. The second authentication module 14 is configured to perform depth authentication according to the current depth image. The third control module 15 may be used to control the electronic device 100 to perform a predetermined operation when both the face authentication and the deep authentication pass.

In some embodiments, the second control module 13 is configured to control the time-of-flight module 30 to collect the current depth image of the face when the face authentication is passed; or the first control module 11 is configured to control the depth of face authentication when the face authentication is passed. The infrared light camera 40 collects a current infrared light image of a human face.

Referring to FIG. 5, in some embodiments, the first control module 11 is configured to control the infrared light camera 40 to collect a current infrared light image of a human face while the electronic device 100 is in an unlocking process. The second control module 13 is configured to control the time-of-flight module 30 to collect a current depth image of a human face when the electronic device 100 is in an unlocking process. The control device 10 further includes a fourth control module 16 and a fifth control module 17. The first authentication module 12 includes a first authentication unit 122, the second authentication module 14 includes a second authentication unit 142, and the third control module 15 includes a first control unit 152. The fourth control module 16 is configured to control the infrared light camera 40 to collect a reference infrared light image of a human face during the encryption process. The first authentication unit 122 is configured to determine a first similarity between the current infrared light image and the reference infrared light image. The fifth control module 17 is configured to control the time-of-flight module 30 to collect a reference depth image of a human face during the encryption process. The second authentication unit 142 is configured to determine a second similarity between the current depth image and the reference depth image. The first control unit 152 is configured to control the electronic device 100 to be unlocked when the first similarity is greater than the first threshold and the second similarity is greater than the second threshold.

Please refer to FIG. 5 again. In some embodiments, the control device 10 further includes a locking module 18. The locking module 18 is configured to lock the electronic device 100 when the first similarity is greater than a third threshold and the second similarity is less than a fourth threshold. The third threshold is larger than the first threshold, and the fourth threshold is smaller than the second threshold.

Referring to FIG. 8, in some embodiments, the control device 10 further includes a first identification module 19 and a division module 20. The second authentication unit 142 includes a first judgment sub-unit 1422 and a second judgment sub-unit 1424. The first control unit 152 includes a control sub-unit 1522. The first recognition module 19 is used to identify target feature points in the current depth image. The dividing module 20 is configured to divide the current depth image into a first region and a second region according to the target feature points, and the first region includes the target feature points. The first determining sub-unit 1422 is configured to determine a first sub-similarity between the first region and the first reference depth image. The second determination sub-unit 1424 is configured to determine a second sub-similarity between the second region and the second reference depth image. The control sub-unit 1522 is configured to control the electronic device 100 to unlock when the first sub-similarity is greater than the first sub-threshold, the second sub-similarity is greater than the second sub-threshold, and the second similarity is greater than the second threshold.

Referring to FIG. 11, in some embodiments, the first control module 11 further includes a second control unit 112. The control device 10 further includes a second identification module 21 and a determination module 22. The second control unit 112 is configured to control the infrared light camera 40 to collect multiple frames of current infrared light images. The second recognition module 21 is configured to identify multiple target feature points in each frame of the current infrared light image. The judging module 22 is configured to judge whether the plurality of target feature points are in a moving state according to a change in relative positions between the plurality of target feature points in the current infrared light image in multiple frames. The first authentication module 12 is configured to perform face authentication based on the current infrared light image when a plurality of target feature points are in a moving state; or the second control module 13 is configured to control flight when a plurality of target feature points are in a moving state The time module 30 collects a current depth image of a human face.

Referring to FIG. 13, an electronic device 100 according to an embodiment of the present application includes a time-of-flight module 30, an infrared light camera 40, one or more processors 50, a memory 60, and one or more programs. Among them, one or more programs are stored in the memory 60 and configured to be executed by one or more processors 50, and the programs include instructions for executing the control method of the electronic device 100 according to any one of the embodiments described above.

Referring to FIG. 14, a computer-readable storage medium 200 according to an embodiment of the present application includes a computer program used in conjunction with the electronic device 100. The computer program may be executed by the processor 50 to complete the control method of the electronic device 100 according to any one of the above embodiments.

Referring to FIG. 1 and FIG. 3, an embodiment of the present application provides a method for controlling an electronic device 100. The electronic device 100 includes a time-of-flight module 30 and an infrared light camera 40. Control methods include:

012: Face authentication according to the current infrared light image;

014: depth authentication based on the current depth image; and

Please refer to FIG. 2 and FIG. 3, an embodiment of the present application provides a control device 10 of an electronic device 100. The electronic device 100 includes a time-of-flight module 30 and an infrared light camera 40. The control device 10 includes a first control module 11, a first authentication module 12, a second control module 13, a second authentication module 14, and a third control module 15. The control method according to the embodiment of the present application may be implemented by the control device 10 according to the embodiment of the present application. For example, the first control module 11 can be used to execute the method in 011, the first authentication module 12 can be used to execute the method in 012, the second control module 13 can be used to execute the method in 013, and the second authentication module 14 can be used to execute 014 The third control module 15 can be used to execute the method in 015.

That is to say, the first control module 11 may be configured to control the infrared light camera 40 to collect a current infrared light image of a human face. The first authentication module 12 may be configured to perform face authentication according to the current infrared light image. The second control module 13 may be used to control the time-of-flight module 30 to collect a current depth image of a human face. The second authentication module 14 may be configured to perform depth authentication according to the current depth image. The third control module 15 may be used to control the electronic device 100 to perform a predetermined operation when both the face authentication and the deep authentication pass.

It can be understood that with the rapid development of electronic technology, electronic devices such as smart phones and tablet computers have become increasingly popular. The electronic device usually verifies whether the user has the relevant use right according to the two-dimensional image of the face input by the user, and this method of identity authentication has low reliability.

The control method and control device 10 of the electronic device 100 according to the embodiment of the present application only control the electronic device 100 to perform a predetermined operation when both the face authentication and the deep authentication pass, and the reliability of the identity authentication is high.

Please refer to FIG. 3, the electronic device 100 may be a mobile phone, a tablet computer, a smart watch, a smart bracelet, a smart wearable device, etc. The embodiment of the present application is described by taking the electronic device 100 as a mobile phone as an example. It can be understood that the specifics of the electronic device 100 The form is not limited to mobile phones.

The electronic device 100 may include a case 101 and a bracket 102. The time-of-flight module 30 and the infrared light camera 40 are disposed on the bracket 102. The time-of-flight module 30, the infrared light camera 40, and the bracket 102 are all housed in the casing 101 and can extend from the casing 101. Specifically, when the infrared light camera 40 is used to capture an infrared light image of a human face or the time-of-flight module 30 is used to capture a depth image of a human face, the bracket 102 drives the time-of-flight module 30 and the infrared light camera 40 toward the casing 101 Move outside to extend the casing 101 to acquire an infrared light image or a depth image. The infrared light camera 40 is configured to receive infrared light reflected by an object to be measured in an environment to form an infrared light image.

In the embodiment of the present application, the infrared light camera 40 collects the current infrared light image of the human face and the time-of-flight module 30 collects the current depth image of the human face. The order of the two may be arbitrary. For example, the infrared light camera 40 first collects the current infrared light image of the human face, and the time of flight module 30 then collects the current depth image of the human face; or the time of flight module 30 first collects the current depth image of the human face, and the infrared light camera 40 Then collect the current infrared light image of the human face. Further, the time-of-flight module 30 may collect the current depth image of the human face while the electronic device 100 performs face authentication, or the infrared light camera 40 may collect the current infrared light image of the human face while the electronic device 100 performs depth authentication. To reduce the time to complete face authentication and deep authentication.

In some embodiments, the step of controlling the time-of-flight module 30 to collect the current depth image of the face (ie, 013) is performed when the face authentication is passed. That is to say, the second control module 13 can be used to control the time-of-flight module 30 to collect the current depth image of the face when the face authentication is passed.

Specifically, the electronic device 100 first acquires a current infrared light image of a human face through the infrared light camera 40, and then performs face authentication according to the current infrared light image. When the face authentication fails, the electronic device 100 does not need to collect the current depth image of the face through the time-of-flight module 30, and directly determines that the identity authentication has failed; when the face authentication passes, the electronic device 100 collects the time-of-flight module 30 The current depth image of the face, and depth authentication is performed based on the current depth image. Since the time-of-flight module 30 does not need to collect the current depth image of the face when the face authentication fails, it is beneficial to save energy consumption of the electronic device 100.

In some embodiments, the step of controlling the infrared light camera 40 to collect the current infrared light image of the human face (ie, 011) is performed when the depth authentication passes. That is to say, the first control module 11 may be configured to control the infrared light camera 40 to collect a current infrared light image of a human face when the depth authentication passes.

Specifically, the electronic device 100 first collects the current depth image of the human face through the time-of-flight module 30, and then performs depth authentication according to the current depth image. When the deep authentication fails, the electronic device 100 does not need to collect the current infrared light image of the human face through the infrared light camera 40, and directly determines that the identity authentication has failed. When the deep authentication passes, the electronic device 100 collects the human face through the infrared light camera 40. The current infrared light image, and perform face authentication based on the current infrared light image. When the in-depth authentication fails, the infrared light camera 40 does not need to collect a current infrared light image of a human face, which is beneficial to saving power consumption of the electronic device 100.

In some embodiments, the predetermined operation includes at least one of unlocking, lighting the display screen 103 of the electronic device 100 (as shown in FIG. 3), electronic payment, and opening a predetermined application of the electronic device 100. That is to say, the user can directly obtain the corresponding operation authority on the electronic device 100 by performing face authentication and deep authentication, and does not need to manually control the electronic device 100 to perform a predetermined operation, which is beneficial to improving the user experience and has high security.

Control methods also include:

Referring to FIG. 5, in some embodiments, the first control module 11 is configured to control the infrared light camera 40 to collect a current infrared light image of a human face while the electronic device 100 is in an unlocking process. The second control module 13 is configured to control the time-of-flight module 30 to collect a current depth image of a human face when the electronic device 100 is in an unlocking process. The control device 10 further includes a fourth control module 16 and a fifth control module 17. The first authentication module 12 includes a first authentication unit 122, the second authentication module 14 includes a second authentication unit 142, and the third control module 15 includes a first control unit 152. The fourth control module 16 can be used to execute the method in 016, the fifth control module 17 can be used to execute the method in 017, the first authentication unit 122 can be used to execute the method in 0122, and the second authentication unit 142 can be used to execute the method in 0142 Method, the first control unit 152 may be configured to execute the method in 0152.

That is to say, the fourth control module 16 can be used to control the infrared light camera 40 to collect a reference infrared light image of a human face during the encryption process. The first authentication unit 122 may be configured to determine a first similarity between the current infrared light image and the reference infrared light image. The fifth control module 17 may be used to control the time-of-flight module 30 to collect a reference depth image of a human face during the encryption process. The second authentication unit 142 may be configured to determine a second similarity between the current depth image and the reference depth image. The first control unit 152 may be configured to control the electronic device 100 to be unlocked when the first similarity is greater than the first threshold and the second similarity is greater than the second threshold.

In the embodiment of the present application, the electronic device 100 inputs the reference infrared light image and the reference depth image of the human face in advance during the encryption process, so as to serve as a comparison reference for performing face authentication and depth authentication during the unlocking process of the electronic device 100.

The reference depth image used as a comparison reference may include initial depth images of a human face at multiple different angles, and multiple initial depth images may be obtained after the user's head is deflected to different angles. For example, under the guidance of the content displayed on the display screen 103, the user performs deflection actions such as leftward and rightward deviations on the head, respectively. During the deflection process, the time-of-flight module 30 acquires multiple initial depth images of the human face. Finally, the reference depth image includes a reference depth image corresponding to the right side of the face, a reference depth image corresponding to the front side of the face, and a reference depth image corresponding to the left side of the face.

Taking FIG. 6 as an example, the reference depth image includes a reference depth image 1 corresponding to the right side of the face, a reference depth image 2 corresponding to the front side of the face, and a reference depth image 3 corresponding to the left side of the face.

In one embodiment, when determining the second similarity between the current depth image and the reference depth image, the electronic device 100 determines the similarity between the current depth image and the reference depth image 1 sequentially or in parallel. Similarity between reference depth image 2 and similarity 3 between current depth image and reference depth image 3, and the maximum value among similarity 1, similarity 2, and similarity 3 is selected as the current depth image and reference Second similarity between depth images.

In another embodiment, when determining the second similarity between the current depth image and the reference depth image, the electronic device 100 first detects the deflection direction and deflection angle of the human face relative to the electronic device 100 according to the current depth image. When the face is 90 degrees to the right of the electronic device 100, the electronic device 100 selects the reference depth image 1 as a reference depth image for comparison with the current depth image, that is, the electronic device 100 compares the current depth image with the reference depth image 1. The similarity 1 between them is the second similarity between the current depth image and the reference depth image. When the human face is not deflected relative to the electronic device 100 (that is, the current depth image is a frontal image of the face), the electronic device 100 selects the reference depth image 2 as a reference depth image for comparison with the current depth image, that is, the electronic The device 100 uses the similarity 2 between the current depth image and the reference depth image 2 as the second similarity between the current depth image and the reference depth image. When the human face is 90 degrees left from the electronic device 100, the electronic device 100 selects the reference depth image 3 as a reference depth image for comparison with the current depth image, that is, the electronic device 100 compares the current depth image with the reference depth The similarity 3 between the images 3 serves as a second similarity between the current depth image and the reference depth image.

Similarly, the reference infrared light image used as a reference for comparison may also include initial infrared light images of the human face at multiple different angles. The acquisition method of the multiple initial infrared light images is similar to the acquisition method of the multiple initial depth images. The manner of similarity is also similar to the manner of determining the second similarity, and will not be described in detail here. In the embodiment of the present application, when the user needs to perform face authentication and depth verification, the user can use any deflection angle for face authentication and depth authentication, without requiring the infrared light camera 40 and time-of-flight mode to be aligned strictly at an angle. Group 30 is conducive to improving user experience.

After determining the first similarity, the electronic device 100 performs face authentication according to the first similarity. After determining the second similarity, the electronic device 100 performs identity authentication according to the second similarity. Taking the first threshold value as 80% and the second threshold value as 70%, for example, when the first similarity is greater than 70% and the second similarity is greater than 70%, both face authentication and deep authentication pass, and the electronic device 100 performs a predetermined operation. . It should be noted that the first threshold and the second threshold are percentages of similarity, and the first threshold and the second threshold may be the same value or different values.

Please refer to FIG. 5 again. In some embodiments, the control device 10 further includes a locking module 18. The locking module 18 may be used to perform the method in 018.

That is, the locking module 18 may be used to lock the electronic device 100 when the first similarity is greater than a third threshold and the second similarity is less than a fourth threshold. The third threshold is larger than the first threshold, and the fourth threshold is smaller than the second threshold.

Specifically, the first threshold is 80% and the second threshold is 70%. In this case, the third threshold may be 95%, and the fourth threshold may be 30%. When the first similarity is 99% and the second similarity is 20%, because the first similarity is greater than the third threshold, it indicates that the current infrared light image of the human face is highly similar to the reference infrared light image, and the second The similarity is much smaller than the fourth threshold, which indicates that the similarity between the current depth image of the face and the reference depth image is very low, it is likely that the non-owner uses a photo or other imitation to perform identity authentication. At this time, the electronic device 100 will A locked state is entered to protect the information in the electronic device 100.

It should be noted that the settings of the first threshold, the second threshold, the third threshold, and the fourth threshold are not limited to the above examples. The user can set the first threshold, the second threshold, the third threshold, and the fourth threshold according to his own needs. Or, before the electronic device 100 leaves the factory, the first threshold, the second threshold, the third threshold, and the fourth threshold have been set.

Referring to FIG. 7, in some embodiments, the control method further includes:

019: identify target feature points in the current depth image;

Referring to FIG. 8, in some embodiments, the control device 10 further includes a first identification module 19 and a division module 20. The second authentication unit 142 includes a first judgment sub-unit 1422 and a second judgment sub-unit 1424. The first control unit 152 includes a control sub-unit 1522. The first identification module 19 may be used to execute the method in 019, the division module 20 may be used to execute the method in 020, the first judgment subunit 1422 may be used to execute the method in 01422, and the second judgment subunit 1424 may be used to execute the method in 01224 Method, the control sub-unit 1522 may be used to execute the method in 01522.

That is to say, the first recognition module 19 can be used for identifying target feature points in the current depth image. The dividing module 20 may be configured to divide the current depth image into a first region and a second region according to the target feature point, and the first region includes the target feature point. The first determining sub-unit 1422 may be configured to determine a first sub-similarity between the first region and the first reference depth image. The second determination sub-unit 1424 may be used to determine a second sub-similarity between the second region and the second reference depth image. The control sub-unit 1522 may be configured to control the electronic device 100 to unlock when the first sub-similarity is greater than the first sub-threshold, the second sub-similarity is greater than the second sub-threshold, and the second similarity is greater than the second threshold.

Specifically, the target feature point may be a feature point corresponding to a target organ (for example, eyes, nose, mouth, etc.) of a human face. Because the attributes of the target feature points are not easy to change, and other feature points (such as hair, eyebrows, etc.) may change according to personal preferences (such as haircuts, eyebrow trimming, etc.), in the embodiment of the present application, the electronic device 100 may The current depth image is divided into a first region and a second region (as shown in FIG. 9 (a)), so that the target feature points are included in the first region. Correspondingly, the reference depth image may also be divided into a first reference depth image and a second reference depth image (as shown in FIG. 9 (b)). The first sub-similarity between the first region and the first reference depth image, and the second sub-similarity between the second region and the second reference depth image respectively correspond to different similarity thresholds, that is, the first sub-threshold, the first Second child threshold. Further, since the attributes of the target feature points are not easily changed, the first sub-threshold may be larger than the second sub-threshold to improve the reliability of identity authentication.

Of course, in other embodiments, the electronic device 100 may further divide the current depth image into more regions, such as the first region, the second region, the third region, etc., according to the target feature points, for accurate identity authentication.

Control methods also include:

022: Determine whether the plurality of target feature points are in a moving state according to the relative position changes between the plurality of target feature points in the multi-frame current infrared light image; and

Referring to FIG. 11, in some embodiments, the first control module 11 further includes a second control unit 112. The control device 10 further includes a second identification module 21 and a determination module 22. The second control unit 112 is configured to execute the method in 0112, the second identification module 21 is used to execute the method in 021, and the determination module 22 is used to execute the method in 022.

That is to say, the second control unit 112 may be configured to control the infrared light camera 40 to collect multiple frames of current infrared light images. The second recognition module 21 may be used to identify multiple target feature points in each frame of the current infrared light image. The judging module 22 may be configured to judge whether the plurality of target feature points are in a moving state according to a relative position change between the plurality of target feature points in the multiple frames of the current infrared light image. The first authentication module 12 is configured to perform face authentication according to the current infrared light image when a plurality of target feature points are in a moving state; or the second control module 13 may be used to control the plurality of target feature points when in a moving state. The time-of-flight module 30 captures a current depth image of a human face.

Referring to FIG. 12, the target feature point may be a feature point in a target organ (for example, eyes, nose, mouth, etc.) of a human face. In the embodiment of the present application, the target feature point is the upper lip feature point A and the lower lip feature point B of the mouth as examples. The multi-frame current infrared light image is at least two frames of the current infrared light image. In the example shown in FIG. 12, the mouth of the current infrared light image in the first frame is closed, and there is a certain distance between the target feature point A and the target feature point B. The mouth of the current infrared light image in the second frame is open, and the target feature point A and the target feature point B coincide. The electronic device 100 determines that the target feature point A and the target feature point B are in a moving state according to a change in the relative position of the target feature point A and the target feature point B in the first frame of the current infrared light image and the second frame of the current infrared light image. It can be explained that the test object is a living body. At this time, the electronic device 100 performs face authentication based on the current infrared light image or controls the time-of-flight module 30 to collect the current depth image of the face for deep authentication, which can not only save the energy consumption of the electronic device 100, but also avoid non-computer The host uses photos or other imitations for identity authentication, and the reliability of identity authentication is high.

For example, the program includes instructions for executing the following control methods of the electronic device 100:

012: Face authentication according to the current infrared light image;

014: depth authentication based on the current depth image; and

For example, the computer program may be executed by the processor 50 to perform the following control method of the electronic device 100:

012: Face authentication according to the current infrared light image;

014: depth authentication based on the current depth image; and

Exemplarily, the time of flight module 30 according to the embodiment of the present application may have the following structure.

Referring to FIGS. 15 to 18, the time-of-flight module 30 includes a first substrate assembly 31, a pad 32, a light transmitter 33 and a light receiver 34. The first substrate assembly 31 includes a first substrate 311 and a flexible circuit board 312 connected to each other. The pad 32 is disposed on the first substrate 311. The light transmitter 33 is used to emit light signals outward, and the light transmitter 33 is disposed on the pad 32. The flexible circuit board 312 is bent and one end of the flexible circuit board 312 is connected to the first substrate 311 and the other end is connected to the light emitter 33. The light receiver 34 is disposed on the first substrate 311. The light receiver 34 is configured to receive the light signal emitted by the reflected light transmitter 33. The light receiver 34 includes a casing 341 and an optical element disposed on the casing 341. 342, the casing 341 and the pad 32 are connected into a whole.

In the electronic device 100 according to the embodiment of the present application, since the light emitter 33 is disposed on the pad 32, the pad 32 can heighten the height of the light emitter 33, thereby increasing the height of the light emitting surface of the light emitter 33, and the light emitter 33 The emitted light signal is not easily blocked by the light receiver 34, so that the light signal can be completely irradiated on the measured object.

Specifically, the first substrate assembly 31 includes a first substrate 311 and a flexible circuit board 312. The first substrate 311 may be a printed circuit board or a flexible circuit board, and the control circuit of the time of flight module 30 may be laid on the first substrate 311. One end of the flexible circuit board 312 can be connected to the first substrate 311, and the flexible circuit board 312 can be bent at an angle, so that the relative positions of the devices connected at both ends of the flexible circuit board 312 can be selected.

Referring to FIGS. 15 and 19, the pad 32 is disposed on the first substrate 311. In one example, the pad 32 is in contact with the first substrate 311 and is carried on the first substrate 311. Specifically, the pad 32 may be combined with the first substrate 311 by means of adhesion or the like. The material of the spacer 32 may be metal, plastic, or the like. In the embodiment of the present application, a surface where the pad 32 is combined with the first substrate 311 may be a flat surface, and a surface opposite to the combined surface of the pad 32 may be a flat surface, so that when the light emitter 33 is disposed on the pad 32 Has better stability.

The light transmitter 33 is configured to emit an optical signal outwards. Specifically, the light signal may be infrared light, and the light signal may be a lattice spot emitted to the measured object. The light signal is emitted from the light transmitter 33 at a certain divergence angle. . The light emitter 33 is disposed on the pad 32. In the embodiment of the present application, the light emitter 33 is disposed on the side of the pad 32 opposite to the first substrate 311, or in other words, the pad 32 attaches the first substrate 311 And the light emitter 33 are spaced apart from each other so that a height difference is formed between the light emitter 33 and the first substrate 311. The light transmitter 33 is also connected to the flexible circuit board 312. The flexible circuit board 312 is bent and arranged. One end of the flexible circuit board 312 is connected to the first substrate 311, and the other end is connected to the light transmitter 33. The first substrate 311 is transmitted to the light transmitter 33, or a feedback signal of the light transmitter 33 (for example, time information, frequency information of the light signal transmitted by the light transmitter 33, temperature information of the light transmitter 33, etc.) is transmitted to the first Substrate 311.

Please refer to FIG. 15, FIG. 16 and FIG. 18. The light receiver 34 is configured to receive an optical signal emitted by the reflected light transmitter 33. The light receiver 34 is disposed on the first substrate 311, and the contact surface between the light receiver 34 and the first substrate 311 is substantially flush with the contact surface between the pad 32 and the first substrate 311 (that is, the installation starting point of the two is On the same plane). Specifically, the light receiver 34 includes a housing 341 and an optical element 342. The casing 341 is disposed on the first substrate 311, and the optical element 342 is disposed on the casing 341. The casing 341 may be a lens holder and a lens barrel of the light receiver 34, and the optical element 342 may be a lens disposed in the casing 341. And other components. Further, the light receiver 34 may further include a photosensitive chip (not shown), and the optical signal reflected by the measured object is irradiated into the photosensitive chip through the action of the optical element 342, and the photosensitive chip generates a response to the optical signal. The time-of-flight module 30 calculates the time difference between the light signal sent by the light transmitter 33 and the light sensor receiving the light signal reflected by the measured object, and further obtains the depth information of the measured object. The depth information can be used for ranging, For generating depth images or for 3D modeling. In the embodiment of the present application, the housing 341 and the cushion block 32 are integrally connected. Specifically, the housing 341 and the spacer 32 may be integrally formed. For example, the materials of the housing 341 and the spacer 32 are the same and are integrally formed by injection molding, cutting, or the like; or the materials of the housing 341 and the spacer 32 are different, both Integrated molding by two-color injection molding. The housing 341 and the pad 32 may also be separately formed, and the two form a matching structure. When assembling the time-of-flight module 30, the housing 341 and the pad 32 may be connected into one body, and then the two boards may be provided on the first substrate 311 together. Alternatively, one of the housing 341 and the pad 32 may be disposed on the first substrate 311, and then the other may be disposed on the first substrate 311 and connected together.

In the electronic device 100 according to the embodiment of the present application, the exit surface of the light transmitter 33 may be flush with the entrance surface of the light receiver 34, or the exit surface of the light transmitter 33 may be slightly lower than the entrance surface of the light receiver 34. It may also be that the exit surface of the light emitter 33 is slightly higher than the entrance surface of the light receiver 34.

Referring to FIG. 17 and FIG. 19, in some embodiments, the first substrate assembly 31 further includes a reinforcing plate 313. The reinforcing plate 313 is coupled to a side of the first substrate 311 opposite to the pad 32. The reinforcing plate 313 may cover one side of the first substrate 311, and the reinforcing plate 313 may be used to increase the strength of the first substrate 311 and prevent deformation of the first substrate 311. In addition, the reinforcing plate 313 may be made of a conductive material, such as a metal or an alloy. When the time-of-flight module 30 is installed on the electronic device 100, the reinforcing plate 313 and the casing 101 may be electrically connected to make the reinforcing plate 313. Grounding and effectively reducing the interference of static electricity from external components on the time of flight module 30.

Please refer to FIGS. 19 to 21. In some embodiments, the pad 32 includes a protruding portion 325 protruding from the side edge 3111 of the first substrate 311, and the flexible circuit board 312 is bent around the protruding portion 325. Specifically, a part of the pad 32 is directly carried on the first substrate 311, and another part is not in direct contact with the first substrate 311, and protrudes to form a protruding portion 325 with respect to the side edge 3111 of the first substrate 311. The flexible circuit board 312 may be connected to the side edge 3111. The flexible circuit board 312 is bent around the protrusion 325, or the flexible circuit board 312 is bent so that the protrusion 325 is located in the space surrounded by the flexible circuit board 312. Inside, when the flexible circuit board 312 is subjected to an external force, the flexible circuit board 312 will not collapse inward and cause excessive bending, which will cause damage to the flexible circuit board 312.

Further, as shown in FIG. 20, in some embodiments, the outer surface 3251 of the protruding portion 325 is a smooth curved surface (such as the outer surface of a cylinder, etc.), that is, the outer surface 3251 of the protruding portion 325 does not form a curvature. Suddenly, even if the flexible circuit board 312 is bent on the outer side 3251 of the protruding portion 325, the degree of bending of the flexible circuit board 312 will not be too large, which further ensures the integrity of the flexible circuit board 312.

Please refer to FIGS. 15 to 17. In some embodiments, the time-of-flight module 30 further includes a connector 36 connected to the first substrate 311. The connector 36 is used to connect the first substrate assembly 31 and an external device. The connector 36 and the flexible circuit board 312 are respectively connected to opposite ends of the first substrate 311. The connector 36 may be a connection base or a connector. When the time-of-flight module 30 is installed in the casing 101, the connector 36 may be connected to the main board of the electronic device 100 so that the time-of-flight module 30 is electrically connected to the main board. The connector 36 and the flexible circuit board 312 are respectively connected to opposite ends of the first substrate 311. For example, the connectors 36 and the flexible circuit board 312 may be respectively connected to the left and right ends of the first substrate 311, or may be respectively connected to the front and rear ends of the first substrate 311.

Referring to FIGS. 16 and 17, in some embodiments, the light transmitter 33 and the light receiver 34 are arranged along a straight line L, and the connector 36 and the flexible circuit board 312 are located on opposite sides of the straight line L, respectively. It can be understood that, since the light transmitter 33 and the light receiver 34 are arranged in an array, the size of the time-of-flight module 30 may be larger in the direction of the straight line L. The connector 36 and the flexible circuit board 312 are respectively disposed on opposite sides of the straight line L, which will not increase the size of the time-of-flight module 30 in the direction of the straight line L, thereby facilitating the installation of the time-of-flight module 30 on the electronic device 100 On the chassis 101.

Referring to FIGS. 19 and 20, in some embodiments, a receiving cavity 323 is defined on a side where the pad 32 is combined with the first substrate 311. The time-of-flight module 30 further includes an electronic component 35 disposed on the first substrate 311, and the electronic component 35 is contained in the receiving cavity 323. The electronic component 35 may be an element such as a capacitor, an inductor, a transistor, or a resistor. The electronic component 35 may be electrically connected to a control line laid on the first substrate 311 and used to drive or control the operation of the light transmitter 33 or the light receiver 34. The electronic component 35 is contained in the receiving cavity 323, and the space in the pad 32 is used reasonably. It is not necessary to increase the width of the first substrate 311 to set the electronic component 35, which is beneficial to reducing the overall size of the time-of-flight module 30. The number of the receiving chambers 323 may be one or more, and the multiple receiving chambers 323 may be spaced apart from each other. When the pad 32 is installed, the positions of the receiving chamber 323 and the electronic component 35 may be aligned and the pad 32 may be disposed at On the first substrate 311.

Please refer to FIG. 19 and FIG. 21. In some embodiments, the cushion block 32 is provided with an escape hole 324 communicating with at least one receiving cavity 323, and at least one electronic component 35 extends into the escape hole 324. It can be understood that when the electronic component 35 is contained in the containing cavity 323, the height of the electronic component 35 is required to be not higher than the height of the containing cavity 323. For the electronic component 35 having a height higher than the receiving cavity 323, an avoiding through hole 324 corresponding to the receiving cavity 323 may be provided, and the electronic component 35 partially extends into the avoiding through hole 324, so as to be arranged without increasing the height of the pad 32 Electronic component 35.

Referring to FIG. 19, in some embodiments, the light emitter 33 includes a second substrate assembly 331, a light source assembly 332, and a housing 333. The second substrate assembly 331 is disposed on the pad 32, and the second substrate assembly 331 is connected to the flexible circuit board 312. The light source assembly 332 is disposed on the second substrate assembly 331, and the light source assembly 332 is configured to emit a light signal. The casing 333 is disposed on the second substrate assembly 331. The casing 333 is formed with a receiving space 3331, and the receiving space 3331 can be used for receiving the light source assembly 332. The flexible circuit board 312 may be detachably connected to the second substrate assembly 331. The light source assembly 332 is electrically connected to the second substrate assembly 331. The housing 333 may be bowl-shaped as a whole, and the opening of the housing 333 is downwardly covered on the second substrate assembly 331 to receive the light source assembly 332 in the receiving space 3331. In the embodiment of the present application, a light outlet 3332 corresponding to the light source component 332 is provided on the housing 333. The light signal emitted from the light source component 332 passes through the light outlet 3332 and is emitted. The light signal can be directly emitted from the light outlet 3332. It can also pass through the optical outlet 3332 after changing the optical path through other optical devices.

Please continue to refer to FIG. 19. In some embodiments, the second substrate assembly 331 includes a second substrate 3311 and a reinforcing member 3312. The second substrate 3311 is connected to the flexible circuit board 312. The light source assembly 332 and the reinforcing member 3312 are disposed on opposite sides of the second substrate 3311. A specific type of the second substrate 3311 may be a printed circuit board or a flexible circuit board, and a control circuit may be laid on the second substrate 3311. The reinforcing member 3312 may be fixedly connected to the second substrate 3311 by means of gluing, riveting, or the like. The reinforcing member 3312 may increase the overall strength of the second substrate assembly 331. When the light emitter 33 is disposed on the pad 32, the reinforcing member 3312 can directly contact the pad 32, the second substrate 3311 is not exposed to the outside, and does not need to be in direct contact with the pad 32, and the second substrate 3311 is not easily affected. Contamination by dust, etc.

In the embodiment shown in FIG. 19, the reinforcing member 3312 and the pad 32 are formed separately. When assembling the time-of-flight module 30, the pad 32 may be first mounted on the first substrate 311. At this time, the two ends of the flexible circuit board 312 are respectively connected to the first substrate 311 and the second substrate 3311, and the flexible circuit board 312 may Do not bend first (state shown in Figure 21). Then, the flexible circuit board 312 is bent, so that the reinforcing member 3312 is disposed on the pad 32. Of course, in other embodiments, the reinforcing member 3312 and the spacer 32 may be integrally formed, for example, integrally formed by a process such as injection molding. When assembling the time of flight module 30, the spacer 32 and the light emitter 33 may be installed together. On the first substrate 311.

Referring to FIG. 21, in some embodiments, a first positioning member 3313 is formed on the reinforcing member 3312. The cushion block 32 includes a body 321 and a second positioning member 322. The second positioning member 322 is formed on the body 321. When the second substrate assembly 331 is disposed on the cushion block 32, the first positioning member 3313 cooperates with the second positioning member 322. Specifically, after the first positioning member 3313 and the second positioning member 322 cooperate, the relative movement between the second substrate assembly 331 and the pad 32 can be effectively restricted. The specific types of the first positioning member 3313 and the second positioning member 322 can be selected according to needs. For example, the first positioning member 3313 is a positioning hole formed in the reinforcing member 3312, and the second positioning member 322 is a positioning column. Protrude into the positioning hole so that the first positioning member 3313 and the second positioning member 322 cooperate with each other; or the first positioning member 3313 is a positioning column formed on the reinforcing member 3312, and the second positioning member 322 is a positioning hole and a positioning column Protrude into the positioning hole so that the first positioning member 3313 and the second positioning member 322 cooperate with each other; or the number of the first positioning member 3313 and the second positioning member 322 are multiple, and part of the first positioning member 3313 is a positioning hole, Part of the second positioning member 322 is a positioning column, part of the first positioning member 3313 is a positioning column, and part of the second positioning member 322 is a positioning hole. The positioning column projects into the positioning hole so that the first positioning member 3313 and the second positioning member 322 are located. work cooperatively.

Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limitations on the present application. Those skilled in the art may, within the scope of the present application, understand the above. Embodiments are subject to change, modification, substitution, and modification.

Claims

An electronic device control method is characterized in that the electronic device includes a time-of-flight module and an infrared light camera, and the control method includes:

Controlling the infrared light camera to collect a current infrared light image of a human face;

Performing face authentication according to the current infrared light image;

Controlling the time-of-flight module to collect a current depth image of a human face;

Performing depth authentication according to the current depth image; and

When both the face authentication and the deep authentication pass, the electronic device is controlled to perform a predetermined operation.
The control method according to claim 1, wherein the step of controlling the time-of-flight module to collect a current depth image of a face is performed when the face authentication is passed; or

The step of controlling the infrared light camera to collect a current infrared light image of a human face is performed when the depth authentication passes.
The control method according to claim 1, wherein the predetermined operation includes at least one of unlocking, lighting a display screen of the electronic device, electronic payment, and opening a predetermined application program of the electronic device.
The control method according to claim 1, wherein the step of controlling the infrared camera to collect a current infrared light image of a human face and the step of controlling the time of flight module to collect a current depth image of a human face The steps are performed while the electronic device is in an unlocking process, and the control method further includes:

Controlling the infrared light camera to collect a reference infrared light image of a human face during the encryption process;

The step of performing face authentication based on the current infrared light image includes:

Determine a first similarity between the current infrared light image and the reference infrared light image;

The control method further includes:

Controlling the time-of-flight module to collect a reference depth image of a human face during the encryption process;

The step of performing depth authentication according to the current depth image includes:

Determine a second similarity between the current depth image and the reference depth image;

When both the face authentication and the deep authentication pass, the step of controlling the electronic device to perform a predetermined operation includes:

And controlling the electronic device to unlock when the first similarity is greater than a first threshold and the second similarity is greater than a second threshold.
The control method according to claim 4, further comprising:

Locking the electronic device when the first similarity is greater than a third threshold and the second similarity is less than a fourth threshold;

The third threshold is larger than the first threshold, and the fourth threshold is smaller than the second threshold.
The control method according to claim 4, further comprising:

Identifying target feature points in the current depth image;

Dividing the current depth image into a first region and a second region according to the target feature point, wherein the first region includes the target feature point;

The reference depth image includes a first reference depth image and a second reference depth image, and the step of determining a second similarity between the current depth image and the reference depth image includes:

Determine a first sub-similarity between the first region and the first reference depth image;

Determine a second sub-similarity between the second region and the second reference depth image;

The second threshold value includes a first sub-threshold value and a second sub-threshold value, the first sub-threshold value is greater than the second sub-threshold value, and the first similarity degree is greater than the first threshold value and the second similarity degree When it is greater than the second threshold, controlling the electronic device to unlock includes:

Controlling the electronic device to unlock when the first sub-similarity is greater than the first sub-threshold, the second sub-similarity is greater than the second sub-threshold, and the second similarity is greater than a second threshold .
The control method according to claim 1, wherein the step of controlling the infrared light camera to collect a current infrared light image of a human face comprises:

Controlling the infrared light camera to collect multiple frames of the current infrared light image;

The control method further includes:

Identifying multiple target feature points in each current infrared light image;

Determining whether the plurality of target feature points are in a moving state according to a change in relative positions between the plurality of target feature points in the current infrared light image in multiple frames; and

When the plurality of target feature points are in a moving state, enter the step of performing face authentication based on the current infrared light image, or enter the step of controlling the time-of-flight module to collect a current depth image of a face .
A control device for an electronic device, characterized in that the electronic device includes a time-of-flight module and an infrared light camera, and the control device includes:

A first control module, configured to control the infrared light camera to collect a current infrared light image of a human face;

A first authentication module, configured to perform face authentication according to the current infrared light image;

A second control module, configured to control the time-of-flight module to collect a current depth image of a human face;

A second authentication module, configured to perform depth authentication according to the current depth image; and

A third control module is configured to control the electronic device to perform a predetermined operation when both the face authentication and the deep authentication pass.
The control device according to claim 8, wherein the second control module is configured to control the time-of-flight module to collect a current depth image of a face when the face authentication is passed; or

The first control module is configured to control the infrared light camera to collect a current infrared light image of a human face when the depth authentication passes.
The control device according to claim 8, wherein the predetermined operation includes at least one of unlocking, lighting a display screen of the electronic device, electronic payment, and opening a predetermined application program of the electronic device.
The control device according to claim 8, wherein the first control module is configured to control the infrared light camera to collect a current infrared light image of a human face while the electronic device is in an unlocking process, and the second The control module is configured to control the time-of-flight module to collect a current depth image of a human face while the electronic device is in an unlocking process; the control device further includes a fourth control module and a fifth control module, and the first authentication module Including a first authentication unit, the second authentication module includes a second authentication unit, and the third control module includes a first control unit;

The fourth control module is configured to control the infrared light camera to collect a reference infrared light image of a human face during the encryption process;

The first authentication unit is configured to determine a first similarity between the current infrared light image and the reference infrared light image;

The fifth control module is configured to control the time-of-flight module to collect a reference depth image of a human face during an encryption process;

The second authentication unit is configured to determine a second similarity between the current depth image and the reference depth image;

The first control unit is configured to control the electronic device to be unlocked when the first similarity is greater than a first threshold and the second similarity is greater than a second threshold.
The control device according to claim 11, wherein the control device further comprises:

A locking module, configured to lock the electronic device when the first similarity is greater than a third threshold and the second similarity is less than a fourth threshold;

The third threshold is larger than the first threshold, and the fourth threshold is smaller than the second threshold.
The control device according to claim 11, wherein the control device further comprises a first identification module and a division module, the second authentication unit includes a first judgment subunit and a second judgment subunit, and the first A control unit includes a control subunit;

The first identification module is configured to identify a target feature point in the current depth image;

The dividing module is configured to divide the current depth image into a first region and a second region according to the target feature point, wherein the first region includes the target feature point;

The reference depth image includes a first reference depth image and a second reference depth image, and the first determining subunit is configured to determine a first sub-similarity between the first region and the first reference depth image;

The second judging subunit is configured to judge a second sub-similarity between the second region and the second reference depth image;

The second threshold includes a first sub-threshold and a second sub-threshold. The first sub-threshold is greater than the second sub-threshold. The control sub-unit is configured to adjust the first sub-similarity to be greater than the first sub-threshold. A sub-threshold, the second sub-similarity is greater than the second sub-threshold, and when the second similarity is greater than the second threshold, controlling the electronic device to unlock.
The control device according to claim 8, wherein the first control module includes a second control unit, and the control device further includes a second identification module and a determination module;

The second control unit is configured to control the infrared light camera to collect multiple frames of the current infrared light image;

The second recognition module is configured to identify multiple target feature points in each frame of the current infrared light image;

The judging module is configured to judge whether the plurality of target feature points are in a moving state according to a change in relative positions between the plurality of target feature points in the current infrared light image in multiple frames;

The first authentication module is configured to perform face authentication according to the current infrared light image when the multiple target feature points are in a moving state, or the second control module is configured to perform When in a moving state, controlling the time-of-flight module to collect a current depth image of a human face.
An electronic device, comprising:

Time of flight module

Infrared light camera

One or more processors;

Memory; and

One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the programs include instructions for performing the following control methods:

Controlling the infrared light camera to collect a current infrared light image of a human face;

Performing face authentication according to the current infrared light image;

Controlling the time-of-flight module to collect a current depth image of a human face;

Performing depth authentication according to the current depth image; and

When both the face authentication and the deep authentication pass, the electronic device is controlled to perform a predetermined operation.
The electronic device according to claim 15, wherein the step of controlling the time-of-flight module to collect a current depth image of a face is performed when the face authentication is passed; or

The step of controlling the infrared light camera to collect a current infrared light image of a human face is performed when the depth authentication passes.
The electronic device according to claim 15, wherein the predetermined operation includes at least one of unlocking, lighting a display screen of the electronic device, electronic payment, and opening a predetermined application of the electronic device.
The electronic device according to claim 15, wherein the step of controlling the infrared light camera to collect a current infrared light image of a human face and the step of controlling the time of flight module to collect a current depth image of a human face The steps are performed while the electronic device is in an unlocking process, and the program further includes instructions for executing the following control methods:

Controlling the infrared light camera to collect a reference infrared light image of a human face during the encryption process;

Determine a first similarity between the current infrared light image and the reference infrared light image;

Controlling the time-of-flight module to collect a reference depth image of a human face during the encryption process;

Determine a second similarity between the current depth image and the reference depth image;

And controlling the electronic device to unlock when the first similarity is greater than a first threshold and the second similarity is greater than a second threshold.
The electronic device according to claim 18, wherein the program further comprises instructions for executing the following control methods:

Locking the electronic device when the first similarity is greater than a third threshold and the second similarity is less than a fourth threshold;

The third threshold is larger than the first threshold, and the fourth threshold is smaller than the second threshold.
The electronic device according to claim 18, wherein the program further comprises instructions for executing the following control methods:

Identifying target feature points in the current depth image;

Dividing the current depth image into a first region and a second region according to the target feature point, wherein the first region includes the target feature point;

The reference depth image includes a first reference depth image and a second reference depth image, and determines a first sub-similarity between the first region and the first reference depth image;

Determine a second sub-similarity between the second region and the second reference depth image;

The second threshold includes a first sub-threshold and a second sub-threshold. The first sub-threshold is greater than the second sub-threshold. At the first sub-similarity greater than the first sub-threshold, the second When the sub-similarity is greater than the second sub-threshold, and the second similarity is greater than the second threshold, the electronic device is controlled to be unlocked.
The electronic device according to claim 15, wherein the program further comprises instructions for executing the following control methods:

Controlling the infrared light camera to collect multiple frames of the current infrared light image;

Identifying multiple target feature points in each current infrared light image;

Determining whether the plurality of target feature points are in a moving state according to a change in relative positions between the plurality of target feature points in the current infrared light image in multiple frames; and

When the plurality of target feature points are in a moving state, enter the step of performing face authentication based on the current infrared light image, or enter the step of controlling the time-of-flight module to collect a current depth image of a face .
A computer-readable storage medium, comprising a computer program used in conjunction with an electronic device, the computer program being executable by a processor to complete the method for controlling an electronic device according to any one of claims 1 to 7.