CN108920922B

CN108920922B - Unlocking method, device, mobile terminal and computer readable medium

Info

Publication number: CN108920922B
Application number: CN201810621798.XA
Authority: CN
Inventors: 吕文娟
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2018-06-15
Filing date: 2018-06-15
Publication date: 2022-06-21
Anticipated expiration: 2038-06-15
Also published as: CN108920922A

Abstract

The embodiment of the application provides an unlocking method, an unlocking device, a mobile terminal and a computer readable medium, and relates to the technical field of mobile terminals. The method comprises the following steps: when the mobile terminal is in a screen locking state and a screen is in a lighting mode, acquiring an operation gesture currently acting on the screen; judging whether the operation gesture meets a preset standard or not; if the preset standard is met, moving the camera out to a preset position, and controlling the camera to collect images; unlocking a screen according to the image acquired by the camera; and if the unlocking is successful, switching the screen locking state of the mobile terminal into an unlocking state. When the screen is locked and the screen is lightened, the camera is controlled to move through the operation gesture, frequent lifting of the camera can be effectively reduced, normal use of a user is affected, and therefore user experience is improved.

Description

Unlocking method, device, mobile terminal and computer readable medium

Technical Field

The present application relates to the field of mobile terminal technologies, and in particular, to an unlocking method and apparatus, a mobile terminal, and a computer-readable medium.

Background

At present, some mobile terminals are provided with scalable or rotatable camera, and when the cell-phone was shielded by the lock, after the user lighted the screen, the camera can rise in order to carry out the unblock after face identification, but, behind the bright screen, the frequent lift of camera can cause user experience not high.

Disclosure of Invention

The application provides an unlocking method, an unlocking device, a mobile terminal and a computer readable medium, so as to overcome the defects.

In a first aspect, an embodiment of the present application provides an unlocking method, which is applied to a mobile terminal, where the mobile terminal includes a terminal body and a camera, the camera is accommodated in the terminal body and can move relative to the terminal body and move out of the terminal body, and the method includes: when the mobile terminal is in a screen locking state and a screen is in a lighting mode, acquiring an operation gesture currently acting on the screen; judging whether the operation gesture meets a preset standard or not; if the preset standard is met, moving the camera out to a preset position, and controlling the camera to collect images; unlocking a screen according to the image acquired by the camera; and if the unlocking is successful, switching the screen locking state of the mobile terminal into an unlocking state.

In a second aspect, an embodiment of the present application further provides an unlocking device, which is applied to a mobile terminal, where the mobile terminal includes a terminal body and a camera, and the camera is accommodated in the terminal body and can move relative to the terminal body and move out of the terminal body. The device comprises: the device comprises a gesture obtaining unit, a judging unit, a control unit, an unlocking unit and a switching unit. And the gesture obtaining unit is used for obtaining the current operation gesture acting on the screen when the mobile terminal is in a screen locking state and the screen is in a lighting mode. And the judging unit is used for judging whether the operation gesture meets a preset standard or not. And the control unit is used for moving the camera out to a preset position and controlling the camera to collect images if the preset standard is met. And the unlocking unit is used for unlocking the screen according to the image acquired by the camera. And the switching unit is used for switching the screen locking state of the mobile terminal into the unlocking state if the unlocking is successful.

In a third aspect, an embodiment of the present application further provides a mobile terminal, including a terminal body and a camera, where the camera is accommodated in the terminal body, and can move relative to the terminal body and move out of the terminal body; further comprising a memory and a processor, the memory coupled with the processor; the memory stores instructions that, when executed by the processor, cause the processor to: when the mobile terminal is in a screen locking state and a screen is in a lighting mode, acquiring an operation gesture currently acting on the screen; judging whether the operation gesture meets a preset standard or not; if the preset standard is met, moving the camera out to a preset position, and controlling the camera to collect images; carrying out screen unlocking according to the image acquired by the camera; and if the unlocking is successful, switching the screen locking state of the mobile terminal into an unlocking state.

In a fourth aspect, an embodiment of the present application further provides a mobile terminal, including a terminal body and a camera, where the camera is accommodated in the terminal body, and can move relative to the terminal body and move out of the terminal body; the detection circuit and the drive circuit are connected with the processor. The detection circuit is used for acquiring the operation gesture currently acting on the screen when the mobile terminal is in a screen locking state and the screen is in a lighting mode. The processor is used for judging whether the operation gesture meets a preset standard or not; and if the preset standard is met, sending a driving signal to the driving circuit. The driving circuit moves the camera out to a preset position according to the driving signal and controls the camera to collect images. The processor is also used for unlocking the screen according to the image acquired by the camera; and if the unlocking is successful, switching the screen locking state of the mobile terminal into an unlocking state.

In a fifth aspect, the present application also provides a computer-readable medium having program code executable by a processor, where the program code causes the processor to execute the above method.

According to the unlocking method, the unlocking device, the mobile terminal and the computer readable medium, under the condition that the mobile terminal is in the screen locking state and the screen is lightened, the screen can collect an operation gesture input by a user, then the mobile terminal judges whether the operation gesture meets a preset standard or not, if yes, the camera is controlled to move out of a preset position, and the camera is not automatically moved to the preset position as long as the screen is lightened by the mobile terminal in the screen locking state. And then, after the camera reaches a preset position, controlling the camera to collect images, then unlocking the screen by using the collected images, and if the unlocking is successful, switching the screen locking state of the mobile terminal into an unlocking state. Therefore, when the screen is in a screen locking state and the screen is lightened, the camera is controlled to move through the operation gesture, frequent ascending and descending of the camera can be effectively reduced, normal use of a user is affected, and therefore user experience is improved.

Additional features and advantages of embodiments of the present application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of embodiments of the present application. The objectives and other advantages of the embodiments of the application may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic structural diagram illustrating a first view of a mobile terminal according to an embodiment of the present application;

fig. 2 is a schematic structural diagram illustrating a first state of a second view angle of a mobile terminal according to an embodiment of the present application;

fig. 3 is a schematic structural diagram illustrating a second state of a second view angle of the mobile terminal according to an embodiment of the present application;

fig. 4 is a schematic structural diagram illustrating a third perspective of a mobile terminal according to an embodiment of the present application;

fig. 5 is a schematic structural diagram illustrating a first state of a mobile terminal according to another embodiment of the present application;

fig. 6 is a schematic structural diagram illustrating a second state of the mobile terminal according to another embodiment of the present application;

fig. 7 is a schematic structural diagram illustrating a first state of a mobile terminal according to yet another embodiment of the present application;

fig. 8 is a schematic structural diagram illustrating a second state of a mobile terminal according to another embodiment of the present application;

fig. 9 is a schematic diagram illustrating a first view of a mobile terminal according to still another embodiment of the present application;

fig. 10 is a schematic diagram illustrating a second view of a mobile terminal according to still another embodiment of the present application;

FIG. 11 is a flowchart illustrating a method of unlocking a device according to an embodiment of the present application;

FIG. 12 is a schematic diagram illustrating a gesture input interface provided by an embodiment of the present application;

FIG. 13 is a schematic diagram illustrating an operational gesture provided by an embodiment of the present application;

fig. 14 illustrates an interface diagram of a mobile terminal in an unlocked state according to an embodiment of the present application;

FIG. 15 illustrates a method flow diagram of an unlocking method provided by another embodiment of the present application;

FIG. 16 is a schematic diagram illustrating an operational gesture provided in accordance with another embodiment of the present application;

FIG. 17 illustrates a schematic view of an operational gesture provided in accordance with yet another embodiment of the present application;

FIG. 18 illustrates a schematic view of an unlock interface provided by an embodiment of the present application;

FIG. 19 illustrates a method flow diagram of an unlocking method provided by another embodiment of the present application;

fig. 20 is a schematic diagram illustrating a change in a position state of a camera according to an embodiment of the present application;

fig. 21 is a schematic diagram illustrating an interface change and a change in a position state of a camera according to an embodiment of the present disclosure;

FIG. 22 illustrates a method flow diagram of an unlocking method provided by yet another embodiment of the present application;

fig. 23 is a schematic diagram illustrating an angle change of a mobile terminal according to an embodiment of the present application;

FIG. 24 is a block diagram of an unlocking device provided in an embodiment of the present application;

FIG. 25 illustrates a block diagram of a mobile terminal provided by an embodiment of the present application;

fig. 26 shows a block diagram of an electronic device for performing the method provided by the embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.

Referring to fig. 1, fig. 1 is a schematic structural diagram of a mobile terminal that can be used in the embodiments of the present application. The mobile terminal 100 includes a terminal body 130, a camera 150 and a movable assembly 140, wherein the camera 150 is mounted on the movable assembly 140, and the movable assembly 140 is movably connected with the terminal body 130, specifically, the movable connection indicates that the movable assembly 140 and the terminal body 130 can be directly connected in a rotating manner or in a sliding manner. In some implementations, the movable member 140 is disposed on a surface of the terminal body 130, and in some states, when an included angle between the movable member 140 and the terminal body 130 is minimized, the movable member 140 is attached to the surface of the terminal body 130, and the movable member 140 can rotate in a direction approaching or departing from the surface of the terminal body 130.

In other embodiments, the movable element 140 can be accommodated in the terminal body 130, for example, the terminal body 130 is provided with an opening, and the movable element 140 is connected to the opening and can move into the opening to achieve the effect of being accommodated in the terminal body 130. As an embodiment, the opening may be a groove formed on the surface of the terminal body 130, and the groove may be disposed at a position near the first edge of the top of the back surface of the terminal body, a position near the middle of the top of the back surface, a position near the second edge of the top of the back surface, or the like. The shape of the groove can be rectangular, square, circular, semicircular, regular polygon or irregular polygon, etc. Referring to fig. 1, the recess may be a rectangular recess disposed at the top of the back of the terminal body near the middle, and an accommodation space formed by the rectangular recess is used for accommodating a camera, a proximity optical sensor, an earpiece, a distance sensor, an ambient light sensor, a temperature sensor, a pressure sensor, and other functional devices, wherein when the functional devices are accommodated in the recess, the functional devices are hidden behind the terminal body, and when the functional devices are rotated out of the recess by 180 °, the functional devices are exposed from the top of the terminal body and have the same orientation as the front or the back of the terminal body.

Specifically, please refer to fig. 1, fig. 2, and fig. 3, where fig. 1 illustrates a schematic structural diagram of a mobile terminal that can be used in the embodiments of the present application, fig. 2 illustrates a schematic first state diagram of the mobile terminal that can be used in the embodiments of the present application, and fig. 3 illustrates a schematic second state diagram of the mobile terminal that can be used in the embodiments of the present application. In an embodiment of the present application, the terminal body 130 includes a front side 120 and a back side 132, wherein the front side 120 of the terminal body is a touch screen of the mobile terminal, and the back side 132 of the terminal body is a housing of the mobile terminal. Further, the movable element 140 is rotatably disposed on the back surface 132 of the terminal body 130, the camera 150 is disposed on the movable element 140, and the camera 150 rotates relative to the terminal body 130 by using the movable element 140 as a rotation axis, as a manner, the back surface 132 of the terminal body 130 is provided with a groove for accommodating the movable element 140, when the movable element 140 is accommodated in the groove, the height of the movable element 140 may be flush with the back surface 132 of the terminal body 130, may protrude out of the back surface 132 of the terminal body 130, may be recessed in the back surface 132 of the terminal body 130, and the like, and in addition, the movable element 140 may drive the camera 150 to rotate relative to the terminal body 130 within a range of 0 ° to 180 °. The camera 150 is rotatably connected with the terminal body 130 of the mobile terminal through the movable assembly 140, specifically, the movable assembly 140 includes a rotating shaft and a mounting member, functional devices such as the camera 150 are mounted on the mounting member, and the mounting member is connected with the inner wall of the groove through the rotating shaft, so that the mounting member can be accommodated in the groove and also can be rotated out of the groove. When the mounting member is received in the recess, i.e. the mounting member fills the recess, the position at this time is the initial position of the mounting member, i.e. the initial position of the camera 150. At this time, the camera 150 is oriented perpendicular to the light emitting surface of the screen, that is, at this time, the camera 150 may be used as the rear camera 150 of the mobile terminal, as shown in fig. 1, and when the camera 150 is rotated out of the groove and is rotated to the maximum position, as shown in fig. 3 and 4, at this time, the camera 150 may be used as the front camera 150.

Referring to fig. 5 and 6, a block diagram of another mobile terminal 200 according to an embodiment of the present application is shown. The mobile terminal 200 shown in fig. 5 includes a terminal main body 210, a camera 221 and a movable assembly 222, wherein the camera 221 is disposed on the movable assembly 222, the movable assembly 222 is slidably connected with the terminal main body 210 and can be hidden at the back or inside of the terminal main body 210, and when hidden at the back or inside, the camera 221 cannot be seen from the front of the terminal main body by a user, as shown in fig. 6.

Specifically, the movable component 222 is slidably disposed in the housing, and can extend out of or slide into the housing, and some functional devices of the mobile terminal may also be disposed in the movable component, where the functional devices include, but are not limited to, a receiver, a structured light component, a camera, and a light supplement device, as another implementation, a receiving cavity may also be formed in the back of the mobile terminal, for example, a groove may be formed, and then the movable component 222 may slide out of the receiving cavity.

As another example, as shown in fig. 7 and 8, the present application provides a structure diagram of a mobile terminal 200. In the mobile terminal 200 shown in fig. 7, the mobile terminal includes a terminal main body 210 and a functional device module 220, the functional device module 220 is hidden in the terminal main body and is slidably exposed from the top of the terminal main body 210, specifically, the functional device module 220 includes a sliding part 222 and a functional device, the functional device is disposed on the sliding part, the sliding part 222 is slidably disposed in the housing and can extend out of or slide into the housing, wherein the functional device includes but is not limited to a receiver, a structured light assembly, a camera and a light supplement device, and as one mode, as shown in fig. 8, a camera 221 is disposed toward the front of the mobile terminal and is disposed in an upper region of the sliding part 222. The camera 221 can be carried by the slider 222 so as to be hidden in the housing or to protrude from the housing.

Referring to fig. 9 and 10, a block diagram of another mobile terminal is provided. The main difference with the mobile terminal provided in fig. 7 and 8 is that the functional device module 220 does not protrude from the inside of the housing.

Specifically, as an embodiment, a recess is provided at the top of the rear surface of the terminal body 210 of the mobile terminal, and the functional device module 220 is disposed in the recess and can be extended or retracted in the recess. The functional device module 220 includes a slider 222 and functional devices, wherein the functional devices include, but are not limited to, a receiver, a structured light module, a camera 221, and a light supplement device. The slider includes first face and second face, and first face and second face are the opposite face, and camera 221 sets up on the first face of slider 222, and when the slider was located the recess, the second face was as the partly of the back of terminal body, and the first face is sheltered from by the front of terminal body, and camera 221 is sheltered from by the front of terminal body promptly, and does not show out by the front of terminal body. As shown in fig. 10, the sliding member 222 can extend from the back surface of the terminal body, and the camera 221 is exposed from the front surface of the terminal body, i.e. not shielded by the front surface of the terminal body, and can be used as a front camera.

At present, the mobile terminal that activity such as above-mentioned camera is rotatable or flexible set up, when mobile terminal is in the lock screen state, the camera is in initial position, for example, be located the inside of mobile terminal or the intracavity that holds at the back, after the user lights the screen, the camera rises automatically or rotates, thereby the camera appears by mobile terminal's front, the direction of shooting of camera is perpendicular with the surface of screen promptly, convenience of customers just gathers facial image to the camera, thereby carry out face identification's screen unblock.

However, if the user only lights up the screen to see the time or some information such as message notification, and does not unlock the mobile terminal to enter the system, frequent lifting of the camera not only wastes the power of the mobile terminal, but also affects the operation of the user, resulting in poor user experience. Therefore, in order to solve the above defect, please refer to fig. 11, an embodiment of the present application provides an unlocking method, which is used to improve user experience of a user using the mobile terminal, so as to avoid a problem that the user experience is too low due to face acquisition caused by no movement of a camera due to the fact that the mobile terminal is turned on a screen under a lock screen, and specifically, the method includes: s1101 to S1105.

S1101: and when the mobile terminal is in a screen locking state and the screen is in a lighting mode, acquiring an operation gesture currently acting on the screen.

The mobile terminal comprises a screen locking state and a screen unlocking state, and the screen of the mobile terminal comprises a screen extinguishing state and a screen lightening state. Specifically, the SCREEN-OFF state and the SCREEN-ON state of the SCREEN may be detected by a program module in the system of the mobile terminal, for example, by an isScreenOn function of PowerManager, and broadcast of the content.

And after the screen is lighted, although the mobile terminal is in a screen locking state, the mobile terminal can still detect an operation gesture input when the user operates the screen, that is, obtain the operation gesture currently acting on the screen, specifically, the operation gesture currently acting on the screen can be detected by a program module in a system of the mobile terminal, for example, in the framework of Android, the operation gesture acted on the screen by the user is obtained by a geturedetector function.

Specifically, when the mobile terminal is in the screen lock state and the screen is lighted up, a gesture input interface, such as the interface shown in fig. 12, may be displayed on the screen, and in the gesture input interface, the mobile terminal may be capable of collecting an operation gesture input by the user at the gesture input interface and displaying a prompt content in the interface, where the prompt content is used to instruct the user what way to input the operation gesture, for example, the content may be "move up to unlock". In fig. 12, "information content" may be a reminder or notification message currently received by the mobile terminal, or a message received by the mobile terminal that is not read by the user.

S1102: and judging whether the operation gesture meets a preset standard.

The preset standard may be a preset operation gesture, which is stored in the mobile terminal in advance, and may be a gesture set by a user according to actual use, as one embodiment, the preset operation gesture may be a sliding gesture with a certain curve, such as a circle, a triangle, or a straight line, as another embodiment, the preset operation gesture may be a sliding direction, such as sliding from the bottom of the screen to the top, or sliding from the top to the bottom, and specifically, different preset operation gestures may be set in combination with different hardware forms of the mobile terminal.

As shown in fig. 1 to 4, when the camera is turned from the back side to the front side of the mobile terminal, the camera is rotatably connected to the main body of the mobile terminal, and the camera can be turned to the front side of the mobile terminal to be used as the former camera or turned to the back side of the mobile terminal to be used as the rear camera.

Specifically, the rotation direction of the camera includes a first direction and a second direction, wherein the first direction is a direction in which the camera is far away from the back of the mobile terminal, and the second direction is a direction in which the camera is close to the back of the mobile terminal. And the rotation angle may be an angle when the camera is rotated from the initial position away from the back surface of the mobile terminal, that is, an angle when the camera is rotated in the first direction, that is, the rotation angle of the camera is an included angle between a movable component of the mobile terminal and the back surface, such as an included angle a shown in fig. 2. The initial position is a limit position when the camera rotates along the second direction, namely, the camera cannot rotate along the second direction due to the limit action of the back of the mobile terminal. For the mobile terminal shown in fig. 1 to 4, the preset operation gesture may be sliding along the top of the screen to the bottom. As shown in fig. 13, a slide gesture in a direction from the bottom to the top of the screen is input in the gesture operation interface displayed on the screen of the mobile terminal, and the direction of the arrow in fig. 13 is the slide direction of the user gesture.

As another embodiment, the camera may be hidden in the mobile terminal body, may be manually pulled to be exposed from the top of the terminal body, and is located on the front side of the mobile terminal. For the mobile terminal shown in fig. 5 to 10, the preset operation gesture may be sliding along the bottom of the screen to the top.

S1103: and moving the camera to a preset position, and controlling the camera to collect images.

And if the operation gesture meets the preset standard, controlling the camera to move to a preset position, specifically, after the processor in the mobile terminal judges that the operation gesture meets the preset standard, sending a driving instruction to the driving circuit, wherein the driving instruction is used for indicating the driving circuit to move the camera to the preset position. After the driving circuit acquires the driving instruction, the driving circuit can control the camera to move to the predetermined position according to the driving signal, specifically, adjust a driving parameter, such as a driving level or a magnitude or a phase of a driving current, according to the driving instruction, send the driving signal to the driving assembly, and the driving assembly outputs a corresponding pulling force or a pushing force according to the driving signal, so as to drive the camera to move to the predetermined position.

The preset position of the camera is a position which is set by a user according to the requirement and is convenient for shooting the face of the user, and specifically, the preset position is correspondingly different according to different connection modes of the camera and the terminal body. For example, as shown in fig. 1 to 4, when the camera is turned from the back side to the front side of the mobile terminal, the predetermined position is that the shooting direction of the camera is perpendicular to the light-emitting surface of the screen, or an included angle between the shooting direction of the camera and the light-emitting surface of the screen is an acute angle, for example, an angle between 89 ° and 60 °, and specifically, may be 60 °. For another example, in the mobile terminal shown in fig. 5 to 9, the camera may extend from the inside of the terminal body of the mobile terminal or from the back of the terminal body, and the predetermined position may be a position where the camera is just exposed from the front of the screen, or may be a maximum moving position along the extending direction of the camera.

In addition, the mobile terminal can detect whether the camera is moved to a predetermined position, and specifically, by providing a device such as an angle sensor or a displacement sensor capable of detecting a movement distance of the camera on the camera, a positional relationship between the camera and the mobile terminal body, that is, a position where the camera is located can be acquired, and thus, whether the camera is moved to the predetermined position can be detected.

Specifically, the detection modes are different for the mobile terminals with different hardware forms.

In some embodiments, the detecting whether the camera is moved to the predetermined position may be: and acquiring rotation information of the camera, wherein the rotation information comprises a rotation direction and a rotation angle.

Specifically, for the mobile terminal shown in fig. 1 to 4, the embodiment of detecting the rotation direction and the rotation angle of the camera may be that a sensor for detecting the rotation direction and the rotation angle is disposed on the rotating assembly, for example, an angle sensor or a hall sensor is disposed on the rotating shaft of the rotating assembly for detecting the rotation direction and the rotation angle of the rotating shaft.

And after the rotation information is acquired, comparing the rotation information of the camera with preset rotation information, and determining whether the camera is moved to a preset position or not according to a comparison result.

In other embodiments, regarding the mobile terminal shown in fig. 5 to 9, the manner of detecting whether the camera is moved to the predetermined position is to obtain a pulling distance of the camera, and determine whether the camera is moved to the predetermined position according to the pulling distance. Specifically, a distance sensor is arranged at the camera, when the camera is in the mobile terminal body, the distance sensor at the camera is shielded by the mobile terminal body, the distance value is kept at a lower value, and when the camera is stretched to the body, the distance value acquired by the distance sensor at the camera is increased, so that whether the distance value acquired by the distance sensor is greater than a preset value or not can be judged, if so, the camera is determined to be moved to a preset position, and if not, the camera is determined not to be moved to the preset position. The preset value is a numerical value set by a user and used for indicating that the camera is not shielded by the camera body when the camera is stretched.

As an embodiment, the camera can be moved along a third direction and a fourth direction, taking the mobile terminal as a vertical screen state and being placed vertically as an example, that is, with a view angle shown in fig. 5, the third direction refers to the camera moving in an upward direction, and in the third direction, the camera can protrude from the inside of the mobile terminal body, and the fourth direction is an opposite direction of the third direction, and with a view angle shown in fig. 5, the fourth direction refers to the camera moving in a downward direction. It should be noted that the position of the camera includes an initial position and a maximum position, where the initial position is a critical position of the camera in the mobile terminal body, that is, the camera cannot move any more in the fourth direction and can move in the third direction at the initial position, and the maximum position is that the camera cannot move any more in the third direction and can move in the fourth direction.

The distance of the camera pulled can be obtained and measured through a distance sensor, specifically, a plurality of distance sensors can be arranged in a sliding channel in a mobile terminal body, wherein the sliding channel is a sliding area of the camera in the mobile terminal body, the camera is arranged on a sliding part, when the sliding part does not shield the distance sensor, the value acquired by the distance sensor is a larger value, for example, the width of the sliding channel, when the sliding part moves to the position of the distance sensor and shields the distance sensor, the distance value acquired by the distance sensor is the distance value between the sliding part and the distance sensor, therefore, which distance sensor the camera reaches can be determined, and the moving distance of the camera can be determined according to the distance between the installation positions of each distance sensor which is obtained in advance.

After the camera is determined to be moved to the preset position, the camera is started, and the camera is controlled to acquire images of objects in the field of view of the camera, so that the images acquired by the camera are obtained.

S1104: and unlocking the screen according to the image acquired by the camera.

And judging whether the face image is matched with a preset face image, if so, judging successful unlocking, and if not, judging unsuccessful unlocking.

The preset face image may be a face image preset by a user, may be stored in a mobile terminal, or may be stored in a certain server or a certain memory, and the mobile terminal may obtain the face image to be preset from the server or the certain memory. Specifically, the preset feature information of the face image may be preset, if the face image is a two-dimensional image, the preset feature information is facial feature point information of the face image previously input by the user, and if the face image is a three-dimensional image, the preset feature information is facial three-dimensional information of the face image previously input by the user. And judging whether the face image meets the preset condition or not by acquiring feature point information of the face image, comparing the acquired feature information of the face image with preset feature information input by a user in advance, if so, judging that the face image meets the preset condition, determining that the face image has the authority to unlock the screen of the mobile terminal, and if not, judging that the face image does not meet the preset condition, and if not, unlocking the screen.

S1105: and if the unlocking is successful, switching the screen locking state of the mobile terminal into an unlocking state.

When the face image is determined to meet the preset condition, the screen is unlocked, that is, the mobile terminal is switched from the screen locking state to the unlocking state, and then an interface of a system desktop, that is, an interface shown in fig. 14, can be entered. Of course, after the unlocking is successful, the screen of the mobile terminal displays an interface of an application program operated by the user before the screen is locked.

In addition, considering that the camera may not be used any more after the mobile terminal is successfully unlocked, the camera may be reset, that is, the camera is moved from the predetermined position to the initial position, and specifically, the definition of the initial position may refer to the foregoing. For example, the camera may be hidden in the terminal body and may be exposed from the top of the terminal body, that is, the mobile terminal is in the form shown in fig. 5 to 10, and after the unlocking is successful and the mobile terminal is switched from the lock screen state to the unlock state, the camera is controlled to be hidden in the terminal body.

Therefore, when the mobile terminal is in a screen locking state, after a user lights the screen, the camera cannot move to a preset position immediately, but the camera is moved after an operation gesture meeting a preset standard of the user is detected, so that the situation that the user frequently moves the camera to cause unnecessary consumption of electric quantity and influence on normal use of the camera by the user to cause poor user experience of the user under the condition that the user only checks information displayed on the mobile terminal or accidentally lights the screen is avoided.

Furthermore, considering that a user does not affect normal use of the user when the face recognition unlocking screen is unsuccessful, and in order to avoid that the user experience is too poor when the face recognition unlocking screen is unsuccessful and the face recognition is still repeatedly used, the method can also consider the requirement that the user unlocks the screen by using an unlocking password when the face recognition is performed, and can display an unlocking interface when appropriate, specifically, referring to fig. 15, the embodiment of the present application provides an unlocking method for improving the user experience of the user when using the mobile terminal, so as to avoid the problem that the camera is not moved to collect a face when the screen is lit up under the screen locking state, and further cause the user experience to be too low, and specifically, the method includes: s1501 to S1509.

S1501: and when the mobile terminal is in a screen locking state and the screen is in a lighting mode, acquiring an operation gesture currently acting on the screen.

S1502: and judging whether the operation gesture meets a preset standard.

And if the preset standard is met, executing the operation of S1503, and if the preset standard is not met, ending the method.

In addition, considering that a user may shoot an image by using a camera instead of performing face recognition to unlock the screen when the screen is lighted in the screen locking state, an operation gesture different from a preset standard may be set to start the camera without performing an operation of unlocking the screen according to the image acquired by the camera.

Specifically, when it is determined that the operation gesture does not satisfy the preset criterion, it is determined whether the operation gesture matches a preset shooting gesture, specifically, the preset shooting gesture may be a gesture preset by a user, and is different from the operation gesture that satisfies the preset criterion, for example, the operation gesture that satisfies the preset criterion slides from the bottom to the top of the screen, and the preset shooting gesture slides from the left to the right of the screen, as shown in fig. 16, when it is detected that the operation gesture input by the user based on the screen matches the preset shooting gesture, the camera is moved to a predetermined position, and the current interface is switched to an image preview interface of the camera application, and a preview interface of an image shot by the camera is displayed on the image preview interface. Then the user can use the camera to take a self-portrait or take another scene.

If the camera can be switched between the front camera mode and the rear camera mode in a rotating mode, two different preset shooting gestures can be defined, the preset shooting gestures are defined as a first shooting gesture and a second shooting gesture, the first shooting gesture corresponds to the front camera mode, and when the operation gesture input by the user is judged to be matched with the first shooting gesture, the camera is controlled to move to a first position so that the camera is in the front camera mode, and when the operation gesture input by the user is judged to be matched with the second shooting gesture, the camera is controlled to move to a second position so that the camera is in the rear camera mode. For example, the first shooting gesture slides to the right along the left side of the screen, the second shooting gesture slides to the left along the right side of the screen, and the setting of the specific gesture can be set by a user according to the requirements and the use habits of the user.

Furthermore, considering that when the user moves the camera to the predetermined position by using the operating gesture and performs the operation of unlocking the screen by face recognition, after the camera reaches the predetermined position, the photographing parameters of the camera are not suitable for photographing, for example, the focal length or the aperture size is not suitable, the photographing parameters can be automatically adjusted while the camera is moved to the predetermined position by using the operating gesture. Specifically, whether an operation gesture input by a user meets a preset adjusting gesture or not is judged, if yes, the camera is moved to a preset position, meanwhile, photographing parameters are automatically adjusted according to the gesture, and namely, the operation gesture matched with the preset adjusting gesture can meet preset standards. Specifically, when the operation gesture meeting the preset standard slides from the bottom to the top of the screen, the operation gesture meeting the preset adjustment gesture slides from the bottom to the top along a curve in a certain shape, and the mobile terminal determines that the operation gesture meets the preset standard when determining that the sliding direction of the operation gesture input by the user slides from the bottom to the top, and then determines whether the sliding track of the operation gesture matches the sliding track corresponding to the preset adjustment gesture, and if the sliding track matches the sliding track, determines that the operation gesture matches the preset adjustment gesture.

For example, the preset adjustment gesture is sliding from the bottom to the top of the screen, and the sliding track is firstly an arc and then a straight line, as shown in fig. 17, the mobile terminal adjusts the photographing parameters of the camera according to the sliding track, for example, the aperture is increased, of course, the photographing parameters corresponding to different sliding tracks are adjusted differently and are opened, the arc direction of the arc shown in fig. 17 faces left, the aperture value can be increased, and if the arc direction faces right, the aperture value can be decreased.

S1503: moving the camera to a predetermined position and displaying an unlocking interface on the screen.

Specifically, the manner of controlling the movement of the camera may refer to the foregoing embodiment, and after determining that the operation gesture satisfies the preset criterion, an unlocking interface, such as the interface shown in fig. 18, may be further displayed on the screen, where a password input interface is displayed in the interface, specifically, the password data interface includes a password input keyboard through which a user may input an unlocking password, where the unlocking password may include a numeric password, a text password, or a graphic password, and may also include a biometric information password, such as a fingerprint feature or an iris feature.

The display of the unlocking interface can be displayed in the process that the camera is moved to the preset position, or displayed after the camera is moved to the preset position, or displayed on the screen before the camera is moved to the preset position and after the operation gesture is judged to meet the preset standard.

S1504: and controlling the camera to collect images.

S1505: and unlocking the screen according to the image acquired by the camera.

The specific unlocking process can refer to the above embodiment, and in addition, the camera is started after the camera is moved to the preset position, but a user cannot align a face to the camera immediately, at this moment, the camera cannot acquire a face image, if the image acquired by the camera is still analyzed at this moment, the screen unlocking operation is performed, only system resources of the mobile terminal are not wasted, and the system resources are in shortage, whether the face image exists in the acquired image can be judged firstly, and if the face image exists, the screen unlocking operation is performed according to the face image.

Specifically, a specific embodiment of the operation of S1505 may be: judging whether the image collected by the camera comprises a face image or not; and if the screen comprises the face image, unlocking the screen according to the face image.

As an implementation mode, an image acquired by a camera is a two-dimensional image, whether a human face image is acquired can be determined by searching whether the image has facial feature points or not, and if the image is acquired, the acquired human face image is sent to a processor of the mobile terminal, so that the processor can analyze the human face image and execute screen unlocking operation. As another embodiment, the camera includes structured light, and determines whether human face three-dimensional information exists according to three-dimensional information collected by the structured light, and if so, sends the collected image to the processor of the mobile terminal.

In addition, if the image acquired by the camera does not include the face image, the operation of continuously judging whether the image acquired by the camera includes the face image is returned, and face acquisition reminding information can be sent to remind a user of using the camera to acquire the face image. Specifically, the face capturing reminding information may be displayed in the gesture input interface shown in fig. 12, for example, a reminding information of "please re-capture a face image" is displayed under the interface, and of course, the face capturing reminding information may also be displayed in the unlocking interface shown in fig. 18.

After the face acquisition reminding information is displayed, the operation of judging whether the image acquired by the camera comprises the face image is executed again, of course, the operation of judging whether the image acquired by the camera comprises the face image can be executed again after the face acquisition reminding information is displayed and a certain preset time length is delayed, so that enough time is reserved for the user to re-generate the face image, wherein the preset time length can be set according to the user requirement, for example, the preset time length can be 1-3 seconds, such as 1.5 seconds.

S1506: and judging whether unlocking is successful or not.

If the unlocking operation is not successful after the image acquired by the camera is carried out, S1507 is executed, namely the user can unlock the mobile terminal by inputting the unlocking password, and if the unlocking operation is successful, S1509 is executed, namely the mobile terminal is switched to the unlocking state and enters the system.

S1507: and acquiring an unlocking password input by the user based on the unlocking interface.

When the unlocking is not successful in the face recognition mode, the mobile terminal can send out reminding information to remind a user of unsuccessful unlocking, for example, a reminding message can be displayed in the unlocking interface, such as 'face mismatch and unlocking failure', and certainly, the user can be reminded in a voice prompt mode or a mode of changing colors or characters of a top status bar and the like.

Then, the user inputs an unlocking password in the unlocking interface, specifically, the unlocking password may include a numeric password, a text password or a graphic password, and may also include a biometric information password, such as a fingerprint feature or an iris feature. And a password input interface is displayed in the unlocking interface, such as the number keys shown in fig. 18, a user can input a number for unlocking through the number keys as an unlocking password, of course, the mobile terminal is provided with a fingerprint module, the fingerprint module may be arranged at the home key or below the screen, and the user can input a fingerprint as the unlocking password through the fingerprint module under the unlocking interface.

S1508: and judging whether the unlocking password is matched with a preset password or not.

The preset password is a password which is acquired by the mobile terminal in advance and used for unlocking a screen of the mobile terminal, and specifically can be set by a user according to requirements, for example, a certain number of digits or a fingerprint which is input in advance.

It should be noted that the display of the unlocking interface is not limited to displaying after the mobile terminal acquires the gesture meeting the preset standard, or the unlocking interface is not displayed before the screen is unlocked according to the face image, but the unlocking interface is displayed after the unlocking failure according to the face image is determined, and the user is prompted to input the unlocking password through the unlocking interface, so that the screen is unlocked through the unlocking password. In this embodiment, after it is determined that the unlocking fails, an unlocking interface is displayed and an unlocking password input by the user based on the unlocking interface is acquired.

S1509: and switching the screen locking state of the mobile terminal into an unlocking state.

In addition, similar to the manner of resetting the camera to the initial position, when the screen is successfully unlocked according to the face recognition, that is, when the operation of S1506 is executed and the screen is successfully unlocked, the camera is reset, that is, the camera is moved from the predetermined position to the initial position, taking the mobile terminal shown in fig. 5 to 10 as an example, after the screen is successfully unlocked and the mobile terminal is switched from the locked state to the unlocked state, the camera is controlled to be hidden in the terminal body. As another embodiment, the operation of S1506 may be executed, and the camera may be hidden in the terminal body after the determination of unsuccessful unlocking is made, or the operation of S1506 may be executed, and the operation of controlling the camera to be hidden in the terminal body after the determination of unsuccessful unlocking is made and the screen is successfully unlocked according to the unlocking password input by the user is executed.

It should be noted that, the above steps are parts of detailed description, and reference may be made to the foregoing embodiments, which are not repeated herein.

In addition, for the mobile terminal shown in fig. 5 to 10, in order to enable a user to have better user experience when pushing the camera out of the top of the terminal body by using an operating gesture and the top of the terminal body is exposed, please refer to fig. 19, an embodiment of the present application provides an unlocking method, which is used for improving user experience of the user using the mobile terminal, so as to avoid a problem that the user experiences too low due to the fact that the mobile terminal is turned on the screen under the lock screen to cause the camera to move for acquiring the face, and specifically, the method includes: s1901 to S1909.

S1901: and when the mobile terminal is in a screen locking state and the screen is in a lighting mode, acquiring an operation gesture currently acting on the screen.

S1902: and judging whether the operation gesture is a sliding gesture on the screen of the mobile terminal along a preset direction.

Wherein the preset direction is a direction from the bottom of the screen to the top.

Specifically, refer to fig. 13, this operation gesture is the sliding from the bottom of the screen to the top, and then because the camera can be exposed from the top of the terminal body, therefore, the adoption is released the camera from the top of the terminal body by the bottom-to-top sliding gesture, and the experience that the user manually released the camera can be provided for the user, so as to improve the experience of the user.

S1903: and controlling the camera to move out of the top part along with the operation gesture.

The movement of the camera is moved following the movement of the operation gesture, specifically, the movement may be moved according to the sliding distance of the operation gesture, as shown in fig. 20(a), the user just starts to operate the screen, that is, just inputs the operation gesture, but the mobile terminal can detect that the operation gesture is the sliding gesture and the sliding direction is sliding from the bottom to the top of the screen, and then starts to move the camera, as shown in fig. 20(b), as the user gesture slides, the camera of the mobile terminal is gradually exposed from the top of the terminal body, but is not completely exposed, that is, the camera is still partially shielded by the body of the mobile terminal, and when the sliding distance of the operation gesture of the user is long enough, the camera is gradually and completely exposed from the top of the terminal body, that is, as shown in fig. 20 (c).

In addition, considering that a user may fail when unlocking the screen by using the face recognition method, in order to improve user experience, when the unlocking fails, the user wants to unlock the screen by using another method immediately, for example, unlocking the screen by inputting an unlocking password, and then the unlocking password may be displayed on the screen while extending the camera, specifically, the embodiment of controlling the camera to move out from the top along with the operation gesture may be that the camera is controlled to move out from the top along with the operation gesture, and simultaneously, the current interface of the screen is controlled to gradually change into the unlocking interface along with the operation gesture.

As shown in fig. 21, in detail, as shown in fig. 21(a), when the user just inputs the operation gesture, but the mobile terminal can detect that the operation gesture is a sliding gesture and the sliding direction is sliding from the bottom to the top of the screen, start to move the camera and switch the current interface to the unlocking interface, as shown in fig. 21(b), as the user gesture slides, the camera of the mobile terminal gradually appears from the top of the terminal body, but is not completely exposed, i.e. the camera is still partially shielded by the body of the mobile terminal, and a part of the unlocking interface is displayed on the screen, and as the sliding distance of the operation gesture increases, the part of the unlocking interface displayed on the screen gradually increases, specifically, the top of the unlocking interface is displayed first, and as the sliding distance of the operation gesture increases, the content under the top is also displayed gradually, and the unlocking interface gradually moves upwards, and the interface before the unlocking interface, i.e., the gesture input interface gradually disappears, as shown in fig. 21(b), a part of the gesture input interface is displayed on the upper portion of the screen, and a part of the unlocking interface is displayed on the lower portion of the screen, and as the gesture continues to slide, as shown in fig. 21(c), the gesture input interface completely disappears, and the current interface of the screen becomes the unlocking interface.

Therefore, a user can aim at the camera to input a face image under the unlocking interface for unlocking the screen, and can operate the emergency call function under the interface to realize some emergency call operations.

S1904: and controlling the camera to collect images.

S1905: and unlocking the screen according to the image acquired by the camera.

S1906: and judging whether unlocking is successful or not.

S1907: and acquiring an unlocking password input by the user based on the unlocking interface.

S1908: and judging whether the unlocking password is matched with a preset password.

S1909: and switching the screen locking state of the mobile terminal into an unlocking state.

In addition, when a user unlocks the screen by using face recognition, if the unlocking is not successful, the unlocking password can be directly input in the unlocking interface, at the moment, the camera can not reset, the user continues to wait for whether the user selects face recognition unlocking or unlocking through the unlocking password, if the user continues to use face recognition unlocking, the face is continuously aligned to the camera, the camera collects face images, the mobile terminal unlocks according to the face images, if the face recognition unlocking is successful, the camera is reset, if the face recognition unlocking password is detected to be input by the user, and the camera is reset after the face recognition unlocking is successful, so that the use habit of the user is better met, and frequent ascending and descending of the camera can be avoided.

It should be noted that, the above steps are detailed portions, and reference may be made to the foregoing embodiments, which are not repeated herein.

In addition, considering that a user can set a screen lock state, and move the camera to a predetermined position in a gesture mode of the mobile terminal, the gesture of the mobile terminal needs to be determined in the screen lock state, so as to move the camera in different modes, specifically, please refer to fig. 22, which shows an unlocking method provided in an embodiment of the present application, where the method is used to improve user experience of the user using the mobile terminal, so as to avoid a problem that the mobile terminal is lighted on the screen under the screen lock state, so that the camera does not move for collecting a human face, and further the user experience is too low, and specifically, the method includes: s2201 to S2208.

S2201: and acquiring the motion trail of the mobile terminal when the mobile terminal is in a screen locking state.

Specifically, the mobile terminal may be provided with an attitude detection unit capable of detecting an attitude of the mobile terminal, such as a sensor capable of performing attitude determination, such as a gyroscope. The gesture of the mobile terminal can be determined according to the data collected by the gesture detection unit, so that the motion trail of the mobile terminal can be determined. For example, the posture detection unit includes a gyroscope. According to the fixed axis property of the gyroscope and the known preset attitude of the mobile terminal relative to the direction of a rotating shaft of the gyroscope, when the attitude of the mobile terminal is different from the preset attitude and the movement in a certain direction of pitching, yawing or rolling is generated, because the direction of the rotating shaft of the gyroscope is kept unchanged, the change of the angular relationship of the mobile terminal relative to the rotating shaft and the change of the angular relationship of the preset attitude relative to the rotating shaft are detected, the attitude change of the mobile terminal can be determined, and the current attitude and the movement track of the mobile terminal can be determined.

In addition, it should be noted that the detection of the motion trajectory of the mobile terminal in the lock screen state may be set to be started or not started, and if not, the detection of the motion trajectory of the mobile terminal in the lock screen state is not performed. Specifically, when the mobile terminal is in a screen locking state, acquiring a screen lightening parameter of the mobile terminal; determining whether the bright screen parameter is a preset parameter; and if the parameters are preset parameters, acquiring the motion trail of the mobile terminal.

The bright screen parameter is a preset state value, and the detection of the motion track is started or not started if the bright screen parameter corresponds to different values. For example, the value of the bright screen parameter is one of true or false, the preset parameter is true, when the bright screen parameter is read as true, the motion trajectory of the mobile terminal is obtained, if the bright screen parameter is read as false, it is determined that the bright screen parameter is not the preset parameter, and the motion trajectory is not detected but the user is waited to light the screen in another manner, for example, operation S2203 may also be to end the operation.

Specifically, the value of the bright screen parameter may be set in the mobile terminal, and specifically, the value may be a button that is set in a setting interface of the mobile terminal and corresponds to the bright screen parameter, and two different logic states are provided for the button, so that the bright screen parameter can be changed, for example, switching between true and false.

S2202: and judging whether the motion track meets a preset track.

As an implementation manner, the preset track may be a rotation angle of the top of the screen of the mobile terminal relative to a reference plane, for example, the reference plane is a horizontal plane, specifically, a reference point of a gyroscope may be set to set a reference plane, then, an included angle between a light-emitting surface of the screen of the mobile terminal and the reference plane is collected, if the included angle is greater than a preset value, it is determined that the motion track meets the preset track, where the preset value is a preset angle corresponding to the preset track, such as the included angle shown in fig. 23, and 2101 in the drawing is the top of the screen of the mobile terminal.

S2203: whether a screen lighting instruction input by a user is received is detected.

If the preset track is not met, waiting for receiving a screen lighting instruction input by the user, where the screen lighting instruction may be input by the user clicking a screen locking key, or may be input by another method, which is not limited herein. The screen lighting instruction is used for instructing the mobile terminal to light the screen.

S2204: and lightening the screen, and acquiring an operation gesture currently acting on the screen.

And if the screen lightening instruction is received, lightening the screen and executing the operation of acquiring the operation gesture currently acting on the screen.

S2205: and judging whether the operation gesture meets a preset standard.

S2206: and moving the camera to a preset position, and controlling the camera to collect images.

If it is determined that the motion trajectory satisfies the preset trajectory, S2206 may be directly performed, that is, the camera is directly moved to the predetermined position, and image acquisition is started. If predetermine the standard and be higher than mobile terminal's bottom for mobile terminal's top to the action that the top of simulation mobile terminal lifted up, then the user is too high with mobile terminal's top to a take the altitude under, the camera just stretches out automatically or rotates to preset position, not only can simulate out the user experience of throwing away the camera and can start the camera fast, in addition, can also light the screen when removing the camera, thereby realize that the screen lifts up the effect of bright screen.

If the motion track does not meet the preset track or the motion track detection function in the screen locking state is closed, the camera can be moved to the preset position in a mode of lightening the screen and inputting an operation gesture.

S2207: unlocking the screen according to the image collected by the camera

S2208: and if the unlocking is successful, switching the screen locking state of the mobile terminal into an unlocking state.

It should be noted that, the above steps are parts of detailed description, and reference may be made to the foregoing embodiments, which are not repeated herein, and the steps of the foregoing embodiments may also be applied to this embodiment.

Referring to fig. 24, a device 2400 for unlocking provided in an embodiment of the present application is shown, and is configured to improve user experience of a user when using the mobile terminal, so as to avoid a problem that a user experience is too low due to a situation that a screen of the mobile terminal is lit up to cause a camera to move for capturing a face, and specifically, the device includes: a gesture acquisition unit 2401, a judgment unit 2402, a control unit 2403, an unlocking unit 2404, and a switching unit 2405.

A gesture obtaining unit 2401, configured to obtain an operation gesture currently acting on the screen when the mobile terminal is in a screen lock state and the screen is in a lighting mode. A determining unit 2402, configured to determine whether the operation gesture meets a preset criterion. The control unit 2403 is configured to move the camera to a predetermined position if a preset standard is met, and control the camera to acquire an image. And the unlocking unit 2404 is used for unlocking the screen according to the image acquired by the camera. A switching unit 2405, configured to switch the screen locking state of the mobile terminal to an unlocking state if the unlocking is successful.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

Referring to fig. 25, the present application provides a mobile terminal, specifically, the mobile terminal includes the above-mentioned terminal body and camera, and further includes a detection circuit 161, a driving circuit 162 and a processor 163, where the detection circuit 161 and the driving circuit 162 are both connected to the processor 163.

The detection circuit 161 is configured to obtain an operation gesture currently acting on the screen when the mobile terminal is in a screen lock state and the screen is in a lighting mode. Specifically, for detecting a touch operation of the screen, for example, the detection circuit may include a plurality of pressure sensors disposed under the touch screen of the screen, and capable of detecting a gesture of the user when the user clicks or presses.

The processor 163 is used for judging whether the operation gesture meets a preset standard; if the preset standard is met, sending a driving signal to the driving circuit, and unlocking the screen according to the image acquired by the camera; and if the unlocking is successful, switching the screen locking state of the mobile terminal into an unlocking state.

And the driving circuit 162 moves the camera out to a preset position according to the driving signal, and controls the camera to collect images. In particular, the driving circuit may be a processor of the mobile terminal, or may be an integrated circuit capable of generating a driving voltage or current within the mobile terminal. The driving circuit outputs a driving signal with high and low levels to the driving assembly, the driving assembly drives the movable assembly to move according to the driving signal, and then the camera is driven to move, wherein the driving assembly can be a motor, and the driving signal output by the driving circuit has different electrical parameters, so that the driving force direction or the size and other parameters of the output of the driving assembly are different, and then the position and the direction of the camera to move can be controlled.

It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the above-described specific working processes of the detection circuit 161, the driving circuit 162 and the processor 163 of the mobile terminal may refer to corresponding processes in the foregoing method embodiments, and are not described herein again.

Referring again to fig. 1-10, based on the above method and apparatus, the present application further provides an electronic device, which may be any one of various types of computer system devices (various aspects are shown in fig. 1-10 for illustrative purposes only) that is mobile or portable and performs wireless communication. In particular, the electronic apparatus may be a mobile phone or a smart phone (e.g., iPhone (TM) -based phone), a Portable game device (e.g., Nintendo DS (TM), PlayStation Portable (TM), Gameboy Advance (TM), iPhone (TM)), a laptop, a PDA, a Portable internet appliance, a music player and a data storage device, other handheld devices and a head-mounted device (HMD) such as a watch, a headset, a pendant, a headset, etc., and other wearable devices (e.g., electronic glasses, electronic clothes, an electronic bracelet, an electronic necklace, an electronic tattoo, an electronic device, or a smart watch).

The electronic apparatus may also be any of a number of electronic devices including, but not limited to, cellular phones, smart phones, other wireless communication devices, personal digital assistants, audio players, other media players, music recorders, video recorders, cameras, other media recorders, radios, medical devices, vehicle transportation equipment, calculators, programmable remote controllers, pagers, laptop computers, desktop computers, printers, netbook computers, Personal Digital Assistants (PDAs), Portable Multimedia Players (PMPs), moving picture experts group (MPEG-1 or MPEG-2) audio layer 3(MP3) players, portable medical devices, and digital cameras and combinations thereof.

In some cases, the electronic device may perform a variety of functions (e.g., playing music, displaying video, storing pictures, and receiving and sending telephone calls). If desired, the electronic apparatus may be a portable device such as a cellular telephone, media player, other handheld device, wristwatch device, pendant device, earpiece device, or other compact portable device.

The electronic device may be the

mobile terminal

100 or 200, and specifically, the electronic device includes an electronic body 10, which corresponds to a terminal body, where the electronic body 10 includes a housing 12 and a main display 120 disposed on the housing 12. The housing 12 may be made of metal, such as steel or aluminum alloy. In this embodiment, the main display 120 generally includes a display panel 111, and may also include a circuit or the like for responding to a touch operation performed on the display panel 111. The Display panel 111 may be a Liquid Crystal Display (LCD) panel, and in some embodiments, the Display panel 111 is a touch screen 109.

Referring to fig. 25, in an actual application scenario, the mobile terminal may be used as a smart phone terminal, in which case the electronic body 10 generally further includes one or more processors 102 (only one is shown in the figure), a memory 104, an RF (Radio Frequency) module 106, an audio circuit 110, a sensor 114, an input module 118, and a power module 122. It will be understood by those skilled in the art that the structure shown in fig. 25 is merely illustrative and is not intended to limit the structure of the electronic body 10. For example, the electronics body section 10 may also include more or fewer components than shown in fig. 24, or have a different configuration than shown in fig. 1-10.

Those skilled in the art will appreciate that all other components are peripheral devices with respect to the processor 102, and the processor 102 is coupled to the peripheral devices through a plurality of peripheral interfaces 124. The peripheral interface 124 may be implemented based on the following criteria: universal Asynchronous Receiver/Transmitter (UART), General Purpose Input/Output (GPIO), Serial Peripheral Interface (SPI), and Inter-Integrated Circuit (I2C), but the present invention is not limited to these standards. In some examples, the peripheral interface 124 may comprise only a bus; in other examples, the peripheral interface 124 may also include other elements, such as one or more controllers, for example, a display controller for interfacing with the display panel 111 or a memory controller for interfacing with a memory. These controllers may also be separate from the peripheral interface 124 and integrated within the processor 102 or a corresponding peripheral.

The memory 104 may be used to store software programs and modules, and the processor 102 executes various functional applications and data processing by executing the software programs and modules stored in the memory 104. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the electronic body portion 10 or the primary display 120 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The RF module 106 is configured to receive and transmit electromagnetic waves, and achieve interconversion between the electromagnetic waves and electrical signals, so as to communicate with a communication network or other devices. The RF module 106 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a Subscriber Identity Module (SIM) card, memory, and so forth. The RF module 106 may communicate with various networks such as the internet, an intranet, a wireless network, or with other devices via a wireless network. The wireless network may comprise a cellular telephone network, a wireless local area network, or a metropolitan area network. The Wireless network may use various Communication standards, protocols, and technologies, including, but not limited to, Global System for Mobile Communication (GSM), Enhanced Mobile Communication (Enhanced Data GSM Environment, EDGE), wideband Code division multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Wireless Fidelity (WiFi) (e.g., Institute of Electrical and Electronics Engineers (IEEE) standard IEEE 802.10A, IEEE802.11 b, IEEE802.1 g, and/or IEEE802.11 n), Voice over internet protocol (VoIP), world wide mail Access (Microwave for Wireless Communication), Wi-11 Wireless Access (wimax), and any other suitable protocol for instant messaging, and may even include those protocols that have not yet been developed.

The audio circuitry 110, earpiece 101, sound jack 103, microphone 105 collectively provide an audio interface between a user and the electronic body portion 10 or the main display 120. Specifically, the audio circuit 110 receives sound data from the processor 102, converts the sound data into an electrical signal, and transmits the electrical signal to the earpiece 101. The earpiece 101 converts the electrical signal into sound waves that can be heard by the human ear. The audio circuitry 110 also receives electrical signals from the microphone 105, converts the electrical signals to sound data, and transmits the sound data to the processor 102 for further processing. Audio data may be retrieved from the memory 104 or through the RF module 106. In addition, audio data may also be stored in the memory 104 or transmitted through the RF module 106.

The sensor 114 is disposed in the electronic body portion 10 or the main display 120, examples of the sensor 114 include, but are not limited to: light sensors, pressure sensors, acceleration sensors 114F, proximity sensors 114J, and other sensors.

In particular, the light sensor may comprise a light line sensor. The light sensor can adjust the brightness of the screen according to the light of the environment where the mobile terminal is located. For example, in a well-lit area, the screen may be bright, whereas in a dark area, the screen may be dark (depending on the brightness setting of the screen), which both protects the eyes and saves power.

Among them, the pressure sensor may detect a pressure generated by pressing on the mobile terminal 100. That is, the pressure sensor detects pressure generated by contact or pressing between the user and the mobile terminal, for example, contact or pressing between the user's ear and the mobile terminal. Accordingly, the pressure sensor may be used to determine whether contact or pressing has occurred between the user and the mobile terminal 100, and the magnitude of the pressure.

Referring to fig. 1 to 10 again, in particular, in the embodiment shown in fig. 1 to 10, the light sensor and the pressure sensor are disposed adjacent to the display panel 111. The light sensor may turn off the display output by the processor 102 when an object is near the main display 120, for example, when the electronic body portion 10 is moved to the ear.

As one of the motion sensors, the acceleration sensor 114F can detect the magnitude of acceleration in various directions (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping) and the like for recognizing the attitude of the mobile terminal 100. In addition, the electronic body 10 may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer and a thermometer, which are not described herein,

in this embodiment, the input module 118 may include the touch screen 109 disposed on the main display 120, and the touch screen 109 may collect touch operations of the user (for example, operations of the user on or near the touch screen 109 using any suitable object or accessory such as a finger, a stylus, etc.) and drive the corresponding connection device according to a preset program. Optionally, the touch screen 109 may include a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 102, and can receive and execute commands sent by the processor 102. In addition, the touch detection function of the touch screen 109 may be implemented by various types, such as resistive, capacitive, infrared, and surface acoustic wave.

The main display 120 is used to display information input by a user, information provided to the user, and various graphic user interfaces of the electronic main body part 10, which may be formed of graphics, text, icons, numerals, video, and any combination thereof, and in one example, the touch screen 109 may be provided on the display panel 111 so as to be integrated with the display panel 111.

The power module 122 is used to provide power supply to the processor 102 and other components. Specifically, the power module 122 may include a power management system, one or more power sources (e.g., batteries or ac power), a charging circuit, a power failure detection circuit, an inverter, a power status indicator light, and any other components associated with the generation, management, and distribution of power within the electronic body portion 10 or the primary display 120.

The mobile terminal 100 further comprises a locator 119, the locator 119 being configured to determine an actual location of the mobile terminal 100. In this embodiment, the locator 119 implements the positioning of the mobile terminal 100 by using a positioning service, which is understood to be a technology or a service for obtaining the position information (e.g., longitude and latitude coordinates) of the mobile terminal 100 by using a specific positioning technology and marking the position of the positioned object on an electronic map.

As shown in fig. 25, the mobile terminal further includes a detection circuit 161 and a driving circuit 162, and the functions of the detection circuit 161, the driving circuit 162 and the processor may refer to the foregoing embodiments, which are not described herein again.

To sum up, according to the unlocking method, the unlocking device, the mobile terminal and the computer readable medium provided by the embodiments of the present application, when the mobile terminal is in the screen locking state and the screen is lighted, the screen can collect an operation gesture input by the user, then the mobile terminal determines whether the operation gesture meets a preset standard, and if so, the camera is controlled to move to a predetermined position, instead of automatically moving the camera to the predetermined position as long as the mobile terminal is lighted on the screen in the screen locking state. And then, after the camera reaches a preset position, controlling the camera to collect images, then unlocking the screen by using the collected images, and if the unlocking is successful, switching the screen locking state of the mobile terminal into an unlocking state. Therefore, when the screen is locked and the screen is lightened, the camera is controlled to move through the operation gesture, frequent ascending and descending of the camera can be effectively reduced, normal use of a user is affected, and user experience is improved.

It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following technologies, which are well known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments. In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. An unlocking method is characterized in that the unlocking method is applied to a mobile terminal, the mobile terminal comprises a terminal body and a camera, the camera is contained in the terminal body and can move relative to the terminal body and move out of the terminal body, and the method comprises the following steps:

when the mobile terminal is in a screen locking state and a screen is in a lighting mode, acquiring an operation gesture currently acting on the screen;

judging whether the operation gesture is a sliding gesture on a screen of the mobile terminal along a preset direction, wherein the preset direction is a direction from the bottom of the screen to the top;

if so, controlling the camera to move out from the top along with the operation gesture, and simultaneously controlling the current interface of the screen to gradually change into an unlocking interface along with the operation gesture, wherein the movement of the camera follows the sliding distance of the operation gesture to move;

controlling the camera to acquire an image;

unlocking a screen according to the image acquired by the camera;

and if the unlocking is successful, switching the screen locking state of the mobile terminal into an unlocking state.

2. The method of claim 1, further comprising:

if the unlocking is unsuccessful, acquiring an unlocking password input by a user based on the unlocking interface;

and if the unlocking password is matched with a preset password, switching the screen locking state of the mobile terminal into an unlocking state.

3. The method according to claim 2, wherein after switching the mobile terminal from the screen-locking state to the unlocking state if the unlocking password matches a preset password, the method further comprises:

and controlling the camera to move into the terminal body.

4. The method according to claim 1, wherein if the unlocking is successful, after switching the mobile terminal from the screen-locking state to the unlocking state, the method further comprises:

and controlling the camera to move into the terminal body.

5. The method of claim 1, wherein the screen unlocking according to the image captured by the camera comprises:

judging whether the image collected by the camera comprises a face image or not;

if the image comprises a face image, unlocking a screen according to the face image;

and if the face image is not included, sending face acquisition reminding information, and executing the operation of judging whether the image acquired by the camera comprises the face image again, wherein the face acquisition reminding information is used for reminding a user to use the camera to acquire the face image.

6. The method according to claim 1, wherein the obtaining of the operation gesture currently acting on the screen when the mobile terminal is in the lock screen state and the screen is in the lighting mode comprises:

acquiring a motion track of the mobile terminal when the mobile terminal is in a screen locking state;

if the motion track does not meet the preset track, detecting whether a screen lightening instruction input by a user is received;

and if so, lightening the screen and acquiring the operation gesture currently acting on the screen.

7. The method of claim 6, further comprising:

and if the motion track meets the preset track, moving the camera to a preset position, and controlling the camera to acquire images.

8. An unlocking device, which is applied to a mobile terminal, wherein the mobile terminal comprises a terminal body and a camera, the camera is accommodated in the terminal body and can move relative to the terminal body and move out of the terminal body, and the device comprises:

the gesture obtaining unit is used for obtaining an operation gesture currently acting on the screen when the mobile terminal is in a screen locking state and the screen is in a lighting mode;

the judging unit is used for judging whether the operation gesture is a sliding gesture on a screen of the mobile terminal along a preset direction, wherein the preset direction is a direction from the bottom of the screen to the top;

the control unit is used for controlling the camera to move out from the top along with the operation gesture if the operation gesture exists, simultaneously controlling the current interface of the screen to gradually change into an unlocking interface along with the operation gesture, and controlling the camera to acquire an image, wherein the camera moves along with the sliding distance of the operation gesture;

the unlocking unit is used for unlocking the screen according to the image acquired by the camera;

and the switching unit is used for switching the screen locking state of the mobile terminal into the unlocking state if the unlocking is successful.

9. A mobile terminal is characterized by comprising a terminal body and a camera, wherein the camera is accommodated in the terminal body and can move relative to the terminal body and move out of the terminal body; further comprising a memory and a processor, the memory coupled with the processor; the memory stores instructions that, when executed by the processor, cause the processor to:

controlling the camera to acquire an image;

carrying out screen unlocking according to the image acquired by the camera;

10. A mobile terminal is characterized by comprising a terminal body and a camera, wherein the camera is accommodated in the terminal body and can move relative to the terminal body and move out of the terminal body; the detection circuit and the drive circuit are connected with the processor;

the detection circuit is used for acquiring an operation gesture currently acting on the screen when the mobile terminal is in a screen locking state and the screen is in a lighting mode;

the processor is used for judging whether the operation gesture is a sliding gesture on a screen of the mobile terminal along a preset direction, wherein the preset direction is a direction from the bottom of the screen to the top; if the preset standard is met, sending a driving signal to the driving circuit;

the driving circuit controls the camera to move out of the top part along with the operation gesture according to the driving signal, controls the current interface of the screen to gradually change into an unlocking interface along with the operation gesture, and controls the camera to acquire images, wherein the camera moves along with the sliding distance of the operation gesture;

the processor is also used for unlocking the screen according to the image acquired by the camera; and if the unlocking is successful, switching the screen locking state of the mobile terminal into an unlocking state.

11. A computer-readable medium having program code executable by a processor, wherein the program code causes the processor to perform the method of any one of claims 1-7.