WO2011137627A1

WO2011137627A1 - Method and apparatus for intelligently controlling mobile terminal

Info

Publication number: WO2011137627A1
Application number: PCT/CN2010/077519
Authority: WO
Inventors: 黄竹邻
Original assignee: 中兴通讯股份有限公司
Priority date: 2010-05-04
Filing date: 2010-09-30
Publication date: 2011-11-10
Also published as: CN101825947A

Abstract

A method and apparatus for intelligently controlling a mobile terminal are disclosed. The method includes: gathering human face information of an operator in real-time (S10); according to the human face information of the operator, acquiring position information of each character point in the human face of the operator, which is then recorded as the current position information (S11); comparing the current position information with the last position information, and generating a comparison result (S12); invoking a corresponding operation command to control the operation of the mobile terminal based on the comparison result (S13). The method and apparatus for intelligently controlling a mobile terminal and the mobile terminal have changed the conventional key-controlled or touch-controlled ways of controlling the mobile terminal, controlling the operation of the mobile terminal through human face identifying enables the operation convenient, simply and more strongly interactive.

Description

Method and device for intelligently controlling mobile terminal

The present invention relates to the field of human-computer interaction, and in particular, to a method and apparatus for intelligently controlling a mobile terminal. Background technique

Face recognition is a popular field of computer technology research. It belongs to biometric identification technology, which is to distinguish the biological individual from the biological characteristics of the organism itself. Due to its natural and direct characteristics, face recognition technology has been widely studied and applied in relation to other biometrics such as fingerprint recognition and iris recognition, such as criminal investigation, document authentication, video surveillance, entrance control, and expression. Analysis and so on.

Existing human-computer interaction technologies are gradually matured, such as voice, handwriting, gestures, 3D interaction, mouse, data clothing, data gloves, helmets, and sensing devices between humans and humans. Although mature human-computer interaction technology is applied to mobile terminals, the scope of use of mobile terminal interaction is expanded, and the basic obstacles of interaction between human and mobile terminals are broken. However, the mobile terminal user interface system is still limited to the key system user interface system and touch. Controlled user interface system two modes. Summary of the invention

SUMMARY OF THE INVENTION A primary object of the present invention is to provide a method and apparatus for intelligently controlling a mobile terminal, which is directed to implementing a sensory control of the operation of the mobile terminal.

The invention provides a method for intelligently controlling a mobile terminal, comprising the steps of:

Collect operator face information in real time;

Obtaining location information of each feature point of the operator's face according to the operator's face information, and recording it as current location information; The current location information is compared with the previous location information, and a comparison result is generated; according to the comparison result, the corresponding operation instruction is invoked to control the operation of the mobile terminal.

Preferably, the step of controlling the operation of the mobile terminal by using the corresponding operation instruction according to the comparison result specifically includes:

Obtaining the moving direction of the face according to the comparison result;

According to the moving direction of the face, the corresponding direction navigation command is called to control the direction navigation to move.

According to the comparison result, the expression of the operator's face is obtained; the expression of the operator's face includes two expressions: smiley face and grin;

According to the expression of the operator's face, the confirmation or cancel operation command is called to control the mobile terminal to confirm or cancel the operation.

Preferably, the step of collecting the operator face information in real time includes:

Obtain preset authentication information;

Collect operator face information;

The operator face information is compared with the preset identity authentication information to perform identity authentication. After the identity authentication is successful, the function of intelligently controlling the mobile terminal is turned on. When the identity authentication fails, the operator face information is re-collected. Authentication.

Preferably, the step of obtaining the preset identity authentication information includes:

Collect operator face information that requires authentication;

According to the face feature point extraction algorithm, the operator face information is decomposed into position information of each feature point of the adult face;

Storing the location information of each feature point of the decomposed face and using it as a preset identity authentication letter The invention also provides an apparatus for intelligently controlling a mobile terminal, comprising:

a sensor module, configured to collect operator face information in real time;

The operation module is configured to obtain position information of each feature point of the operator's face according to the operator's face information, and record the current position information;

The location information comparison module is configured to compare the current location information with the previous location information, and generate a comparison result;

The instruction mapping module is configured to control the operation of the mobile terminal according to the comparison result and call the corresponding operation instruction.

Preferably, the device further includes:

The face position acquisition module is configured to acquire the moving direction of the face according to the comparison result, and use the instruction mapping module to call the corresponding direction navigation instruction according to the moving direction of the face, and control the direction navigation to move.

Preferably, the device further includes:

The facial expression acquisition module is configured to obtain an expression of the operator's face according to the comparison result, and use the instruction mapping module to call the confirmation or cancel operation instruction according to the expression of the operator's face, and control the mobile terminal to confirm or cancel the operation.

Preferably, the device further includes:

The storage module is configured to store an operator identity information that needs to be authenticated by using the sensor module, and a preset identity authentication letter, packet, obtained by the operation module according to the face feature extraction algorithm.

Preferably, the device further includes:

The identity authentication module is configured to compare the operator face information with the preset identity authentication information stored by the storage module by using the sensor module to perform identity authentication, and when the identity authentication is successful, enable the function of intelligently controlling the mobile terminal; After the identity authentication fails, the sensor module is used to re-collect the operator's face information for identity authentication. The device for intelligently controlling the mobile terminal is located on the mobile terminal.

The method, the device and the mobile terminal for intelligently controlling the mobile terminal of the invention change the traditional key-controlled or touch-control operation mode of the mobile terminal, and not only realize the operation of the navigation control through the face movement, but also realize the operation The recognition of the facial expression controls the operation of the mobile terminal to perform confirmation or cancellation, further improving the intelligence of human-computer interaction, and making the user more engaged and interesting. DRAWINGS

1 is a schematic flowchart of a method for intelligently controlling a mobile terminal according to an embodiment of the present invention; FIG. 2 is a schematic flowchart of a step of controlling an operation of a mobile terminal by calling a corresponding operation instruction according to a comparison result according to an embodiment;

3A to 3D are schematic diagrams showing a process of acquiring a moving direction of a face according to a comparison result in the embodiment;

4 is a schematic diagram of an operation procedure of the navigation control by the recognition of the face movement in the embodiment; FIG. 5 is a flow chart showing the steps of controlling the operation of the mobile terminal by calling corresponding operation instructions according to the comparison result in the embodiment;

6 is a schematic diagram of a process of controlling a mobile terminal to confirm or cancel an operation by recognizing a facial expression in an embodiment;

7 is a schematic flowchart of another embodiment of a method for intelligently controlling a mobile terminal according to the present invention; FIG. 8 is a schematic structural diagram of an apparatus for intelligently controlling a mobile terminal according to the present invention; FIG. 9 is another schematic diagram of an apparatus for intelligently controlling a mobile terminal according to the present invention; FIG. 10 is a schematic structural diagram of still another embodiment of an apparatus for intelligently controlling a mobile terminal according to the present invention. detailed description

It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. FIG. 1 is a flowchart of a method for intelligently controlling a mobile terminal according to an embodiment of the present invention. As shown in FIG. 1, the method for intelligently controlling a mobile terminal according to the present invention includes the following steps:

Step S10: Collect operator face information in real time.

Here, the operator face information is generally collected in real time by the image sensing device. The image sensing device is preferably a high quality camera assembly with high processing power of image information, which makes the operator's face information gathered more clear and complete.

Step S11: Acquire location information of each feature point of the operator's face according to the operator's face information, and record it as current location information.

In step S11, based on the operator's face information, the face recognition algorithm is used to obtain the position information of each feature point of the operator's face. The various feature points of the face include the mouth, the head, the eyes, the nose, and the like. Existing face feature extraction methods include feature extraction of face images based on integral projection, feature extraction based on singular value decomposition, wavelet feature extraction, and the like.

Step S12: Comparing the current location information with the previous location information, and generating a comparison result.

The previous position information in step S12 is the position information generated by the last face recognition operation, and is used for comparison with the current position information. If the function of intelligently controlling the mobile terminal is turned on for the first time, the previous location information is the default location information stored in the mobile terminal.

The position information of each feature point in the current position information is compared with the position information of each feature point in the previous position information, and position difference information of each feature point is generated, which is recorded as a comparison result.

Step S13: According to the comparison result, the corresponding operation instruction is invoked to control the operation of the mobile terminal. The operation instructions may include a direction navigation instruction, a confirmation and cancellation operation instruction, and the like.

This embodiment changes the manner in which the traditional key-controlled or touch-control mobile terminal operates, and controls the operation of the mobile terminal through face recognition to implement a sensor-controlled user interface system.

2 is the same operation command according to the comparison result in the embodiment, and the control is moved. For a flowchart of the steps of the operation of the terminal, referring to FIG. 2, the step S13 may specifically include: Step S131: Acquire a moving direction of the face according to the comparison result.

In order to facilitate the comparison between the current position information and the previous position information in the step S12, the position information of each feature point is processed again to obtain the center position of the face, which is recorded as the current position information. The previous position information also indicates the center position of the face, and the acquisition method is also consistent with the method for obtaining the current position information in step S21, and details are not described herein again. If the current position information coincides with the previous position information, the face does not move; if the current position information does not coincide with the previous position information, the face moves to obtain the moving direction of the face.

Step S132: According to the moving direction of the face, the corresponding direction navigation instruction is called, and the control direction moves.

Directional navigation commands include four commands: up, down, left, and right.

3A to 3D are schematic diagrams showing a process of acquiring a moving direction of a face according to the comparison result in the embodiment. Referring to FIG. 3A to FIG. 3D, the mobile terminal interface is divided into four regions of 1, 2, 3, and 4. The current position information is recorded as XI, and the previous position information is recorded as X2. For each comparison, X2 is the center position. When the current position information XI is in the area 1, it is judged that the moving direction of the face is moving to the left as shown in Fig. 3A. Therefore, the direction navigation command is moved to the left, and the control direction navigation is moved to the left once. When the current position information XI is in the area 2, it is judged that the moving direction of the face moves downward, as shown in Fig. 3B. Therefore, the direction navigation command that moves down is called, and the control direction navigation moves down once. When the current position information XI is in the area 3, it is judged that the moving direction of the face is moving to the right, as shown in Fig. 3C. Therefore, the direction navigation command is moved to the right, and the control direction navigation is moved to the right once. When the current position information XI is located in the area 4, it is judged that the moving direction of the face is moving upward, as shown in Fig. 3D. Therefore, the direction navigation command that moves upward is called, and the control direction navigation moves up.

FIG. 4 shows the operation of the navigation control by the face movement in the above embodiment. Cheng. The front camera on the mobile terminal performs the operator face information collection, and the process specifically includes:

(1) When the current camera does not collect the operating face information for a certain period of time, the lock command is called to control the mobile terminal to be in the standby state. As shown in 4A.

(2) After identity authentication, first call the unlock command to control the unlocking of the mobile terminal, and enable the function of intelligently controlling the mobile terminal to enter the menu interface of the mobile terminal, as shown in 4B. The menu interface includes nine sub-menus A to I, wherein the default center position of the menu interface is the "E" sub-menu, and the "E" sub-menu is selected.

(3) As shown in 4C, according to the comparison result between the current position information and the previous position information (ie, the position information indicated by 4B), if the moving direction of the face is moved to the left, the call to the left is moved. Directional navigation command, control direction navigation moves to the left once, and the "D" submenu is selected.

(4) As shown in 4D, according to the comparison result between the current position information and the previous position information (ie, the position information indicated by 4C), if the moving direction of the face is moved downward, the downward movement is called. Directional navigation command, control direction navigation moves down once, and the "G" submenu is selected.

(5) As shown in 4E, according to the comparison result between the current position information and the previous position information (that is, the position information indicated by 4D), if the moving direction of the face is moved to the right, the direction of moving to the right is called. Command, control direction navigation moves to the right once, and the "H" submenu is selected.

(6) As shown in 4F, according to the comparison result between the current position information and the previous position information (ie, the position information indicated by 4E), if the moving direction of the face is moved upward, the direction of the upward movement is called. The command, control direction navigation moves up once, and the "E" submenu is selected.

In this embodiment, the traditional key-controlled or touch-control operation mode of the mobile terminal is changed, and the direction navigation operation is controlled by the movement of the face, which makes the operation convenient, simple, and interactive.

FIG. 5 is a schematic flowchart of the steps of controlling the operation of the mobile terminal according to the comparison result according to the comparison result. Referring to FIG. 5, the step S13 may further include:

Step S133: Acquire an expression of the operator's face according to the comparison result. Preferably, the expression of the operator's face includes two expressions of smile and grin. Of course, other facial expressions, such as crying, anger, etc., can also be included. It should be noted that for accurate judgment of facial expressions, it is recommended not to use actions that people often use, such as blinking. The judgment of the expression of the operator's face uses the facial expression recognition algorithm. The facial expression recognition algorithm in the prior art may include facial expression recognition based on Hidden Markov Model (HMM) algorithm, facial expression recognition based on sigular value decomposition (SVD), and of course It can be used for other facial expression recognition algorithms, which are not limited herein.

Step S134: Control the mobile terminal to confirm or cancel the operation according to the expression of the operator's face, by calling an acknowledgement or canceling the operation instruction.

The expression of the operator's face is two expressions of smile and grin. In this embodiment, when the expression of the operator's face is a smiley expression, indicating the confirmation operation, the confirmed operation command is called to control the mobile terminal to perform the confirmation operation. When the expression of the operator's face is a grin expression, indicating that the operation is canceled, the canceled operation command is called to control the mobile terminal to perform the cancel operation.

FIG. 6 shows a process of controlling the confirmation or cancellation operation of the mobile terminal by the recognition of the facial expression in the above embodiment, and the process specifically includes:

(1) After identity authentication, the unlock command is first called to control the unlocking of the mobile terminal, and the function of intelligently controlling the mobile terminal is turned on, and the menu interface of the mobile terminal is entered. As shown in FIG. 6A, the "E" sub-menu is selected.

(2) As shown in 6B, according to the comparison result between the current location information and the previous location information (as shown in FIG. 6A), the expression of the operator's face is obtained as a smiley expression, and a confirmation command is invoked to control the execution of the mobile terminal. Confirm the operation and open the "E" submenu.

(3) As shown in 6C, according to the comparison result between the current position information and the previous position information (as shown in 6B), the expression of the operator's face is obtained as a grin expression, then the cancel instruction is invoked to control the mobile terminal. Execute the cancel operation and exit the "E" submenu.

The method for intelligently controlling a mobile terminal in this embodiment controls the mobile terminal by the recognition of facial expressions The implementation of the confirmation or cancellation operation further enhances the intelligence of human-computer interaction, and makes the user more engaged and interesting. FIG. 7 is a schematic flowchart of another embodiment of a method for intelligently controlling a mobile terminal according to the present invention. Referring to FIG. 7, the embodiment is different from the foregoing embodiment in that the embodiment further includes step S14 before step S10: obtaining preset Identity authentication information.

Further, step S14 is specifically:

Step A: Collect the operator face information that needs to be authenticated.

Step B: Decompose the operator face information into position information of each feature point of the adult face according to the face feature point extraction algorithm.

Step C: storing the location information of each feature point of the decomposed face and using the preset identity authentication information.

Step S15: Collect operator face information in real time.

Step S16: Comparing the operator face information with the preset identity authentication information for identity authentication; after the identity authentication is successful, step S17 is performed; and after the identity authentication fails, the process returns to step S15.

Step S17: Turn on the function of intelligently controlling the mobile terminal.

After the identity authentication succeeds, the function of intelligently controlling the mobile terminal is turned on, and the interface of the intelligent control mobile terminal is entered.

After the identity authentication succeeds, if the mobile terminal is in the standby state, the unlocked instruction is first invoked to control the mobile terminal to unlock, and then the intelligent control function of the mobile terminal is turned on. When the operator's face information is not collected for a certain period of time, the locked command is called to control the mobile terminal to lock and is in the standby state.

The method for intelligently controlling the operation of the mobile terminal in this embodiment turns on the function of intelligently controlling the mobile terminal through identity authentication, thereby ensuring the safe operation of the mobile terminal. FIG. 8 is a diagram showing the structure of an apparatus for intelligently controlling a mobile terminal according to the present invention, such as As shown in FIG. 8, the apparatus for intelligently controlling a mobile terminal in this embodiment includes:

The sensor module 10 is configured to collect operator face information in real time;

The operation module 20 is configured to obtain location information of each feature point of the operator's face according to the operator's face information, and record the current location information;

The location information comparison module 30 is configured to compare the current location information with the previous location information, and generate a comparison result;

The instruction mapping module 40 is configured to control the operation of the mobile terminal by calling a corresponding operation instruction according to the comparison result.

The sensor module 10 is preferably a high-quality camera assembly, and has high processing capability of image information, so that the operator's face information collected by the operator can be made clearer and more complete. The interval between the operator's face information can be set according to the hardware performance of the mobile terminal and the needs of the user. The sensor module 10 includes a front camera that collects operator face information in real time.

The computing module 20 can be a CPU processor and has strong computing processing capability, so that the location information of each feature point of the operator's face can be obtained relatively quickly.

The previous position information is the position information generated by the last face recognition operation for comparison with the current position information. If the function of the intelligent control mobile terminal is turned on for the first time, the previous position information is the default location information stored in the mobile terminal.

The operation instructions invoked by the instruction mapping module 40 may include direction navigation instructions, confirmation and cancellation operation instructions, and the like.

The device also includes:

The storage module 50 is configured to store preset identity authentication information and previous location information.

The preset identity authentication information is obtained by the user collecting the operator face information through the sensor module 10 and the operation module 20 decomposing the operator face information according to the face feature extraction algorithm. The previous position information serves as a comparison reference for the current position information. When the preset identity authentication information or the previous location information is required, it is extracted from the storage module 50. The device also includes:

The identity authentication module 60 is configured to compare the operator face information collected by the sensor module 10 with the preset identity authentication information stored by the storage module 50, and perform identity authentication. After the identity authentication succeeds, the smart control mobile terminal is started. The function enters the intelligent control mobile terminal interface; after the identity authentication fails, the sensor module 10 is used to re-collect the operator face information to perform identity authentication.

This embodiment changes the manner in which the traditional key-controlled or touch-control mobile terminal operates, and controls the operation of the mobile terminal through face recognition, thereby realizing the operation of the sensor-controlled mobile terminal. FIG. 9 is a schematic structural diagram of another embodiment of an apparatus for intelligently controlling a mobile terminal according to the present invention. FIG. 9 further includes:

The face position obtaining module 70 is configured to obtain a moving direction of the face according to the comparison result. The instruction mapping module 40 invokes a corresponding direction navigation command according to the moving direction of the face, and controls the direction navigation to move.

Directional navigation commands include four movement commands: up, down, left, and right.

In this embodiment, the traditional key-controlled or touch-control operation mode of the mobile terminal is changed, and the direction navigation operation of the mobile terminal is controlled by the movement recognition of the face, so that the operation is convenient, simple, and interactive.

FIG. 10 is a schematic structural diagram of still another embodiment of an apparatus for intelligently controlling a mobile terminal according to the present invention. Referring to FIG. 10, the apparatus further includes:

The facial expression obtaining module 80 is configured to obtain an expression of the operator's face according to the comparison result. The expression of the face includes two expressions: smiley face and grin. The facial expression acquisition module 80 acquires an expression of an operator's face through a facial expression recognition algorithm. The facial expression recognition algorithm in the prior art may include facial expression recognition based on Hidden Markov Model (HMM) algorithm and facial expression based on sigular value decomposition (SVD). Identification, of course, can also be another facial expression recognition algorithm, which is not limited herein.

The instruction mapping module 40 is further configured to control the mobile terminal to confirm or cancel the operation according to the expression of the operator's face, by calling an acknowledgement or canceling the operation instruction.

The method for intelligently controlling the mobile terminal in the embodiment can control the mobile terminal to perform the confirmation or cancel operation through the recognition of the facial expression, thereby further improving the intelligence of the human-computer interaction, and making the user more engaged and interesting. The present invention also provides a mobile terminal, including an apparatus for intelligently controlling a mobile terminal. Referring to FIG. 8, the apparatus for intelligently controlling a mobile terminal includes:

The instruction mapping module 40 is configured to, according to the comparison result, invoke a corresponding operation instruction to control the operation of the mobile terminal;

The storage module 50 is configured to store the operator face information that needs to be authenticated by the sensor module 10 and the preset identity authentication information obtained by the computing module 20 after the operator face information is decomposed according to the face feature extraction algorithm;

The identity authentication module 60 is configured to compare the operator face information collected by the sensor module 10 with the preset identity authentication information stored by the storage module 50, and perform identity authentication. After the identity authentication succeeds, the smart control mobile terminal is started. Function; After the identity authentication fails, the sensor module 10 is used to re-collect the operator face information for identity authentication.

Referring to FIG. 9, the device for intelligently controlling a mobile terminal further includes:

The face position obtaining module 70 is configured to obtain a moving direction of the face according to the comparison result, and use the instruction mapping module 40 to invoke a corresponding direction navigation instruction according to the moving direction of the face, and control Direction navigation to move.

Referring to FIG. 10, the foregoing apparatus for intelligently controlling a mobile terminal further includes:

The facial expression obtaining module 80 is configured to obtain an expression of the operator's face according to the comparison result, and use the instruction mapping module 40 to call the confirmation or cancel the operation instruction according to the expression of the operator's face, and control the mobile terminal to confirm or cancel the operation. The expression of the face includes two expressions: smiley face and grin.

The mobile terminal of the present invention changes the operation mode of the traditional key-controlled or touch-controlled mobile terminal, and controls the operation of the mobile terminal through face recognition, thereby realizing the operation of the sensor-controlled mobile terminal.

The above description is only the preferred embodiment of the present invention, and is not intended to limit the scope of the invention, and the equivalent structure or equivalent flow transformation made by the specification and the drawings of the present invention may be directly or indirectly applied to other related The technical field is equally included in the scope of patent protection of the present invention.

Claims

Claim

A method for intelligently controlling a mobile terminal, the method comprising:

Collect operator face information in real time;

Obtaining, according to the operator face information, location information of each feature point of the operator's face, and recording the current location information;

Comparing the current location information with the previous location information, and generating a comparison result; and according to the comparison result, invoking a corresponding operation instruction to control the operation of the mobile terminal.

2. The method of intelligently controlling a mobile terminal according to claim 1, wherein the invoking a corresponding operation instruction according to the comparison result, and controlling the operation of the mobile terminal comprises:

Obtaining a moving direction of the face according to the comparison result;

According to the moving direction of the face, the corresponding direction navigation command is called, and the direction navigation is controlled to move.

The method of intelligently controlling a mobile terminal according to claim 1, wherein the invoking a corresponding operation instruction according to the comparison result, and controlling the operation of the mobile terminal comprises:

Obtaining an expression of an operator's face according to the comparison result;

The method of intelligently controlling a mobile terminal according to any one of claims 1 to 3, wherein before the real-time gathering of operator face information, the method further comprises:

Obtain preset authentication information;

Collect operator face information;

Comparing the operator face information with the preset identity authentication information for identity authentication;

After the identity authentication is successful, the function of intelligently controlling the mobile terminal is turned on;

After the identity authentication fails, the operator's face information is re-collected to perform identity authentication.

The method for intelligently controlling a mobile terminal according to claim 4, wherein the obtaining the preset identity authentication information comprises:

Collect operator face information that requires authentication;

The location information of each feature point of the decomposed face is stored and used as preset identity authentication information.

6. A device for intelligently controlling a mobile terminal, the device comprising: a sensor module, an operation module, a position information comparison module, and an instruction mapping module; wherein

The sensor module is configured to collect operator face information in real time;

The operation module is configured to obtain location information of each feature point of the operator's face according to the operator's face information, and record the current location information;

The location information comparison module is configured to compare the current location information with a previous location information, and generate a comparison result;

The instruction mapping module is configured to, according to the comparison result, invoke a corresponding operation instruction to control an operation of the mobile terminal.

The device for intelligently controlling a mobile terminal according to claim 6, wherein the device further comprises: a face location acquisition module, configured to acquire a moving direction of the face according to the comparison result; the instruction mapping module, It is further arranged to call the corresponding direction navigation instruction according to the moving direction of the face, and control the direction navigation to move.

8. The device for intelligently controlling a mobile terminal according to claim 6, wherein the device further comprises:

a facial expression obtaining module, configured to obtain an expression of an operator's face according to the comparison result; the instruction mapping module is further configured to call the confirmation or cancel operation instruction according to the expression of the operator's face, and control the mobile terminal Confirm or cancel the operation.

The device for intelligently controlling a mobile terminal according to claim 6, wherein the device further comprises: a storage module, configured to store an operator face information that needs to be authenticated by using the sensor module, and a preset obtained by using the operation module. Identity authentication information.

The device for intelligently controlling a mobile terminal according to claim 9, wherein the device further comprises:

The identity authentication module is configured to compare the operator face information collected by the sensor module with the preset identity authentication information stored by the storage module to perform identity authentication;

After the identity authentication fails, the sensor module is used to re-collect the operator's face information for identity authentication.

The device for intelligently controlling a mobile terminal according to any one of claims 6 to 10, wherein the device for intelligently controlling the mobile terminal is located on the mobile terminal.