CN108804894B

CN108804894B - Screen unlocking method and device, mobile terminal and computer readable medium

Info

Publication number: CN108804894B
Application number: CN201810387779.5A
Authority: CN
Inventors: 张正山; 范晓宇
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2018-04-26
Filing date: 2018-04-26
Publication date: 2021-01-26
Anticipated expiration: 2038-04-26
Also published as: CN108804894A

Abstract

The embodiment of the application discloses a screen unlocking method and device, a mobile terminal and a computer readable medium, and belongs to the technical field of mobile terminals. The method comprises the following steps: when the screen is in a screen extinguishing state and the camera is moved to a preset position, starting the camera and acquiring a face image acquired by the camera; carrying out screen unlocking according to the face image; and if the unlocking is successful, lightening the screen. Therefore, the operation that the screen is lightened through the screen locking key firstly and then the camera is started to collect the face can be avoided, but the camera is moved to the preset position to directly collect the image and unlock the screen.

Description

Screen unlocking method and device, mobile terminal and computer readable medium

Technical Field

The present application relates to the field of mobile terminal technologies, and in particular, to a screen unlocking method and apparatus, a mobile terminal, and a computer readable medium.

Background

At present, mobile terminals are more and more widely used by people, and in order to improve the security of the mobile terminals, the safety factor of the mobile terminals can be increased by setting an unlocking mode of the mobile terminals, however, some problems also exist, for example, when a user unlocks a mobile phone, the user needs to click an unlocking button to light a screen, then an unlocking password is input at an unlocking interface, for example, a fingerprint password, a digital password or a face image and the like, then the screen is unlocked according to the unlocking password, the operation is too complicated, and the user experience is not high.

Disclosure of Invention

The application provides a screen unlocking method and device, a mobile terminal and a computer readable medium, so as to overcome the defects.

In a first aspect, an embodiment of the present application provides a screen unlocking method, which is applied to a mobile terminal, where the mobile terminal includes a mobile terminal body and a camera, and the camera can be pulled or rotated manually. The method comprises the following steps: when the screen is in a screen extinguishing state and the camera is moved to a preset position, starting the camera and acquiring a face image acquired by the camera; carrying out screen unlocking according to the face image; and if the unlocking is successful, lightening the screen.

In a second aspect, an embodiment of the present application further provides a screen unlocking device, which is applied to a mobile terminal, where the mobile terminal includes a mobile terminal body and a camera, and the camera can be pulled or rotated. The device comprises: an acquisition unit, an unlocking unit, and a lighting unit. The acquisition unit is used for starting the camera and acquiring the face image acquired by the camera when the screen is in a screen extinguishing state and the camera is moved to a preset position. And the unlocking unit is used for unlocking the screen according to the face image. And the lighting unit is used for lighting the screen if the unlocking is successful.

In a third aspect, an embodiment of the present application further provides a mobile terminal, including a mobile terminal body and a camera, where the camera can be pulled or rotated, and further including a memory and a processor, where the memory is coupled with the processor; the memory stores instructions that, when executed by the processor, cause the processor to: when the screen is in a screen extinguishing state and the camera is moved to a preset position, starting the camera and acquiring a face image acquired by the camera; carrying out screen unlocking according to the face image; and if the unlocking is successful, lightening the screen.

In a fourth aspect, the present application also provides a computer-readable medium having program code executable by a processor, where the program code causes the processor to execute the above method.

The embodiment of the application provides a screen unlocking method, a screen unlocking device, a mobile terminal and a computer readable medium. Therefore, the operation that the screen is lightened through the screen locking key firstly and then the camera is started to collect the face can be avoided, but the image is directly collected after the camera is moved to the preset position, and the screen is lightened after the screen is successfully unlocked.

Additional features and advantages of embodiments of the present application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of embodiments of the present application. The objectives and other advantages of the embodiments of the application may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic structural diagram illustrating a first view of a mobile terminal according to a first embodiment of the present application;

fig. 2 is a schematic structural diagram illustrating a first state of a second view angle of a mobile terminal according to a first embodiment of the present application;

fig. 3 is a schematic structural diagram illustrating a second state of a second viewing angle of the mobile terminal according to the first embodiment of the present application;

fig. 4 is a schematic structural diagram illustrating a third viewing angle of the mobile terminal according to the first embodiment of the present application;

fig. 5 is a schematic structural diagram illustrating a first state of a mobile terminal according to a second embodiment of the present application;

fig. 6 is a schematic structural diagram illustrating a second state of the mobile terminal according to a second embodiment of the present application;

fig. 7 is a schematic structural diagram of a mobile terminal according to a third embodiment of the present application;

FIG. 8 is a flowchart illustrating a method for unlocking a screen according to a first embodiment of the present application;

FIG. 9 is a flowchart illustrating a method for unlocking a screen according to a second embodiment of the present application;

FIG. 10 is a flowchart illustrating a method for unlocking a screen according to a third embodiment of the present application;

FIG. 11 shows a block diagram of a screen unlocking device provided in an embodiment of the present application;

fig. 12 shows a block diagram of a mobile terminal according to an embodiment of the present application for executing the method according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.

The display screen generally plays a role in a mobile terminal such as a mobile phone or a tablet computer to display contents such as text, pictures, icons or videos. With the development of touch technologies, more and more display screens arranged on mobile terminals are touch display screens, and when a user is detected to perform touch operations such as dragging, clicking, double clicking, sliding and the like on the touch display screen under the condition of arranging the touch display screens, the touch operation of the user can be responded.

With the increasing requirements of users on the definition and the fineness of displayed contents, more mobile terminals adopt touch display screens with larger sizes to achieve the display effect of a full screen. However, in the process of setting a touch display screen with a large size, it is found that functional devices such as a front camera, a proximity optical sensor, and a receiver, which are arranged at the front end of the mobile terminal, affect an area that the touch display screen can extend to.

Generally, a mobile terminal includes a front panel, a rear cover, and a bezel. The front panel includes a forehead area, a middle screen area and a lower key area. Generally, the forehead area is provided with a sound outlet of a receiver and functional devices such as a front camera, the middle screen area is provided with a touch display screen, and the lower key area is provided with one to three physical keys. With the development of the technology, the lower key area is gradually cancelled, and the physical keys originally arranged in the lower key area are replaced by the virtual keys in the touch display screen.

And functional devices such as a receiver sound outlet hole and a front camera arranged in the forehead area are important for the functional support of the mobile phone and are not easy to cancel, so that the display area of the touch display screen is expanded to cover the forehead area with great difficulty. After some series of researches, the inventor finds that a functional device module comprising a receiver, an image acquisition device, a light supplement device and a structured light assembly can be hidden inside a terminal main body of the mobile terminal, and the reconfigured functional device module can be exposed from the top of the terminal body in a sliding manner, or the functional assembly is arranged on the back of the mobile phone in a turnover manner, so that a display screen can be arranged in the previous upper jaw area in an expanded manner.

Referring to fig. 1, fig. 1 is a schematic structural diagram of a mobile terminal that may be used in an embodiment of the present application. The mobile terminal comprises a terminal body 130, a camera 150 and a rotating assembly 140, wherein the camera 150 is mounted on the rotating assembly 140, the rotating assembly 140 is rotatably connected with the mobile terminal body 130, in some implementations, the rotating assembly 140 is arranged on the surface of the mobile terminal body 130, and in some states, when an included angle between the rotating assembly 140 and the mobile terminal body 130 is minimum, the rotating assembly 140 is attached to the surface of the mobile terminal body 130.

In other embodiments, the rotating component 140 can be accommodated in the mobile terminal body 130, for example, the mobile terminal body 130 is provided with an opening, and the rotating component 140 is connected to the opening and can rotate into the opening, so as to achieve the effect of being accommodated in the mobile terminal body 130. As an embodiment, the opening may be a groove formed on the surface of the mobile terminal body 130, and the groove may be disposed at a position near the first edge of the top of the back surface of the terminal body, a position near the middle of the top of the back surface, a position near the second edge of the top of the back surface, or the like. The shape of the groove can be rectangular, square, circular, semicircular, regular polygon or irregular polygon, etc. Referring to fig. 1, the recess may be a rectangular recess disposed at the top of the back of the terminal body near the middle, and an accommodation space formed by the rectangular recess is used for accommodating a camera, a proximity optical sensor, an earpiece, a distance sensor, an ambient light sensor, a temperature sensor, a pressure sensor, and other functional devices, wherein when the functional devices are accommodated in the recess, the functional devices are hidden behind the terminal body, and when the functional devices are rotated out of the recess by 180 °, the functional devices are exposed from the top of the terminal body and have the same orientation as the front or the back of the terminal body.

Specifically, please refer to fig. 1, fig. 2, and fig. 3, where fig. 1 illustrates a schematic structural diagram of a mobile terminal that can be used in the embodiments of the present application, fig. 2 illustrates a schematic first state diagram of the mobile terminal that can be used in the embodiments of the present application, and fig. 3 illustrates a schematic second state diagram of the mobile terminal that can be used in the embodiments of the present application. In an embodiment of the present application, the terminal body 130 includes a front surface 120 and a back surface 132, wherein the front surface 120 of the terminal body is a touch screen of the mobile terminal, and the back surface 132 of the terminal body is a housing of the mobile terminal. Further, the rotating component 140 is rotatably disposed on the back surface 132 of the terminal body 130, the camera 150 is disposed on the rotating component 140, and the camera 150 rotates relative to the terminal body 130 by using the rotating component 140 as a rotating shaft, as a manner, the back surface 132 of the terminal body 130 is provided with a groove for accommodating the rotating component 140, when the rotating component 140 is accommodated in the groove, the height of the rotating component 140 can be flush with the back surface 132 of the terminal body 130, can protrude out of the back surface 132 of the terminal body 130, can be recessed into the back surface 132 of the terminal body 130, and the like, and in addition, the rotating component 140 can drive the camera 150 to rotate relative to the terminal body 130 within a range of 0 ° to 180 °.

Camera 150 passes through rotating assembly and is connected with mobile terminal's body rotation, and specifically, rotating assembly includes pivot and installed part, and functional device such as camera 150 installs on the installed part, and the installed part passes through pivot and recess inner wall connection for the installed part can the holding in the recess, also can be by the recess internal rotation play. When the mounting member is received in the recess, i.e. the mounting member fills the recess, the position at this time is the initial position of the mounting member, i.e. the initial position of the camera 150. At this time, the camera 150 is oriented perpendicular to the light emitting surface of the screen, that is, at this time, the camera 150 may be used as the rear camera 150 of the mobile terminal, as shown in fig. 1, and when the camera 150 is rotated out of the groove and is rotated to the maximum position, as shown in fig. 3 and 4, at this time, the camera 150 may be used as the front camera 150.

As another example, as shown in fig. 5 and 6, the present application provides a structure diagram of a mobile terminal 200. In the mobile terminal 200 shown in fig. 5, the mobile terminal includes a terminal main body 210 and a functional device module 220, the functional device module 220 is hidden in the terminal main body and is slidably exposed from the top of the terminal main body 210, specifically, the functional device module 220 includes a sliding part 222 and a functional device, the functional device is disposed on the sliding part, the sliding part 222 is slidably disposed in the housing and can extend out of or slide into the housing, wherein the functional device includes, but is not limited to, a receiver, a structured light assembly, a camera and a light supplement device, and as one mode, as shown in fig. 6, a camera 221 is disposed toward the front of the mobile terminal and is disposed in an upper region of the sliding part 222. The camera 221 can be carried by the slider 222 so as to be hidden in the housing or to protrude from the housing.

Referring to fig. 7, a block diagram of another mobile terminal provided in the present application is shown. The main difference with the mobile terminal provided in fig. 5 and 6 is that the functional device module 220 does not protrude from the inside of the housing.

Specifically, as an embodiment, a recess is provided at the top of the rear surface of the terminal body 210 of the mobile terminal, and the functional device module 220 is disposed in the recess and can be extended or retracted in the recess. The functional device module 220 includes a slider and a functional device, wherein the functional device includes but is not limited to a receiver, a structured light module, a camera, and a light supplement device. The slider includes first face and second face, and first face and second face are the opposite face, and when the slider was located the recess, the second face was as the partly of the back of mobile terminal body, and the first face is sheltered from by the front of mobile terminal body.

However, in the existing mobile terminal, when unlocking, an unlocking button needs to be clicked to light the screen, then an unlocking password, such as a fingerprint password, a digital password or a face image, is input in an unlocking interface, and then the screen is unlocked according to the unlocking password, so that the operation is complicated, and the user experience is not high.

In order to solve the above defect, an embodiment of the present application provides a screen unlocking method, please refer to fig. 8, which is used for improving user experience when a user unlocks a mobile terminal, and specifically, the method includes: s801 to S804.

S801: when the screen is in a screen extinguishing state and the camera is moved to a preset position, the camera is started and a face image collected by the camera is acquired.

The screen status includes a screen-off status and a screen-on status, and in particular, the screen status can be detected by a program module in a system of the mobile terminal, such as an isScreenOn function of PowerManager.

The camera is installed on the body of the mobile terminal and can be pulled or rotated, and the pulling or rotating mode can be manual or electric control.

When the screen is in a screen-off state and the camera is moved to a predetermined position, the specific implementation manner of turning on the camera and acquiring the face image acquired by the camera may be: judging whether the camera is moved to a preset position or not when the screen is in a screen extinguishing state; and if the mobile terminal is moved to the preset position, starting the camera and acquiring the face image acquired by the camera.

The camera is provided with an angle sensor capable of detecting the rotation angle of the camera or a displacement sensor capable of detecting the movement distance, so that the position relation between the camera and the mobile terminal body, namely the position of the camera, can be acquired, and whether the camera is moved to a preset position or not can be detected.

As an embodiment, the camera may be rotated to the front of the mobile terminal. As shown in fig. 1, the camera is connected to the body of the mobile terminal through a rotating component, and the camera can be rotated to the front of the mobile terminal to be used as the former camera, and can also be rotated to the back of the mobile terminal to be used as the rear camera.

The embodiment of detecting whether the camera is moved to the predetermined position may be: and acquiring rotation information of the camera, wherein the rotation information comprises a rotation direction and a rotation angle.

The rotation direction comprises a first direction and a second direction, wherein the first direction is a direction in which the camera is far away from the back face of the mobile terminal, and the second direction is a direction in which the camera is close to the back face of the mobile terminal. And the rotation angle may be an angle when the camera is rotated from the initial position away from the back surface of the mobile terminal, that is, an angle when the camera is rotated in the first direction, that is, the rotation angle of the camera is an included angle between a rotating component of the mobile terminal and the back surface, such as an included angle a shown in fig. 2.

Specifically, the embodiment of detecting the rotation direction and the rotation angle of the camera may be that a sensor for detecting the rotation direction and the rotation angle is provided on the rotating assembly, for example, an angle sensor or a hall sensor is provided on the rotating shaft of the rotating assembly for detecting the rotation direction and the rotation angle of the rotating shaft.

And after the rotation information is acquired, comparing the rotation information of the camera with preset rotation information, and determining whether the camera is moved to a preset position according to a comparison result.

The preset rotation information is preset information, specifically, the preset rotation information includes a preset direction and a preset angle, and can be set according to a user requirement, for example, when the rotation information of the camera is the preset rotation information, the camera rotates to the front of the mobile terminal, that is, the orientation of the camera is the same as the orientation of the light emitting surface of the screen, specifically, the optical axis of the camera is perpendicular to the light emitting surface of the screen.

Then when the rotation information includes the preset direction and the preset angle, the rotation information of the camera is compared with the preset rotation information, and the implementation mode that whether the rotation direction of the camera is consistent with the preset direction or not and whether the rotation direction is along the direction away from the back or not is judged, if the rotation direction is consistent, whether the rotation angle of the camera is matched with the preset angle or not is judged, if the rotation direction is matched, the rotation information of the camera is judged to be consistent with the preset rotation information, and if the rotation direction is not matched or the rotation direction is inconsistent, the rotation information of the camera is judged to be inconsistent with the preset rotation information. Wherein, the matching of the rotation angle and the preset angle can be understood as that the difference between the rotation angle and the preset angle is a smaller preset range, for example, the absolute value of the difference between the rotation angle and the preset angle is smaller than 2 °, and then the rotation angle is determined to be matched with the preset angle, otherwise, the rotation angle is determined to be not matched with the preset angle.

And if the judgment result is that the rotation information of the camera is consistent with the preset rotation information, judging that the camera is moved to the preset position, and if the judgment result is that the rotation information of the camera is inconsistent with the preset rotation information, judging that the camera is not moved to the preset position.

In another embodiment, the camera may be hidden in the mobile terminal body, may be manually pulled to be exposed from the top of the terminal body, and is located on the front side of the mobile terminal. Such as the structures shown in fig. 5, 6 and 7.

In this configuration, whether the camera is moved to the predetermined position is detected by determining whether the camera is pulled out of the body of the mobile terminal, and if so, determining that the camera is moved to the predetermined position, and if not, determining that the camera is still in the body of the mobile terminal and is not moved to the predetermined position.

Specifically, whether the mobile terminal is stretched out of the body of the mobile terminal is determined by arranging a distance sensor at the camera, when the camera is in the body of the mobile terminal, the distance sensor at the camera is shielded by the body of the mobile terminal, the distance value is kept at a lower value, and when the camera is stretched out of the body, the distance value acquired by the distance sensor at the camera is increased, so that whether the distance value acquired by the distance sensor is greater than a preset value or not can be determined, if so, it is determined that the camera is moved to a predetermined position, and if not, it is determined that the camera is not moved to the predetermined position. The preset value is a numerical value set by a user and used for indicating that the camera is not shielded by the camera body when the camera is stretched.

In addition, whether the camera is moved to the predetermined position can be determined according to the moving distance of the camera, specifically, the distance that the camera is pulled is obtained, the pulled distance is compared with the preset distance, and whether the camera is moved to the predetermined position is confirmed according to the comparison result.

As an embodiment, the camera can be moved along a third direction and a fourth direction, taking the mobile terminal as a vertical screen state and being placed vertically as an example, that is, with a view angle shown in fig. 5, the third direction refers to the camera moving in an upward direction, and in the third direction, the camera can protrude from the inside of the mobile terminal body, and the fourth direction is an opposite direction of the third direction, and with a view angle shown in fig. 5, the fourth direction refers to the camera moving in a downward direction. It should be noted that the position of the camera includes an initial position and a maximum position, where the initial position is a critical position of the camera in the mobile terminal body, that is, the camera cannot move any more in the fourth direction and can move in the third direction at the initial position, and the maximum position is that the camera cannot move any more in the third direction and can move in the fourth direction.

Obtaining the distance that the camera is pulled can be measured by a distance sensor, specifically, a plurality of distance sensors can be arranged in a sliding channel in the mobile terminal body, wherein the sliding channel is a sliding area of the camera in the mobile terminal body, and the camera is used for shootingThe camera is arranged on the sliding part, when the sliding part does not shield the distance sensor, the value collected by the distance sensor is a larger value, such as the width of a sliding channel, and when the sliding part moves to the distance sensor and shields the distance sensor, the distance value collected by the distance sensor is the distance value between the sliding part and the distance sensor, so that the position of the distance sensor where the camera reaches can be determined, and then the moving distance of the camera can be determined according to the distance between the installation positions of each distance sensor, such as 5 distance sensors in total, and the distance between the installation positions of each distance sensor is d, the camera is pulled along the third direction from the initial position, from bottom to top, then three distance sensors are shielded, such as the third, the fourth and the fifth, it means that the bottom end of the slider is located at the third distance sensor, and the moving distance of the camera is (M + d + c) -L_{First stage}Wherein M is the distance between the mounting position of the camera and the bottom end of the sliding part, c is the distance between the first distance sensor from bottom to top and the bottom of the sliding channel, and L_{First stage}Is the distance between the initial position of the camera and the bottom of the sliding channel.

As another embodiment, a distance sensor may be further disposed at the bottom of the sliding channel, and when the camera is located at the initial position, one end of the slider on which the camera is mounted is in contact with the distance sensor, and at this time, the distance value detected by the distance sensor is small and almost 0, and as the camera moves in the third direction, the one end of the slider on which the camera is mounted is spaced from the distance sensor more and more, so that the moving distance of the slider on which the camera is mounted can be obtained, and thus, the distance that the camera is pulled can be determined.

And then, after the distance of the camera pulled is obtained, comparing the pulled distance with a preset distance, and confirming whether the camera is moved to a preset position according to a comparison result.

The preset distance is a numerical value set by a user according to actual use, and the preset distance can indicate that the camera extends out of the mobile terminal body, and specifically can indicate that the camera is located at the maximum position.

And judging whether the pulled distance is greater than or equal to a preset distance, if so, judging that the camera is moved to a preset position, and if the pulled distance is less than the preset distance, judging that the camera is not moved to the preset position.

In addition, in some embodiments, the user may control the movement of the camera in the screen-off state through a physical key on the mobile terminal, specifically, the physical key may be a screen-locking key, or may be another key, or a combination key of multiple keys.

Specifically, if the mobile terminal is electrically controlled, a motor is arranged in the mobile terminal, and a user can control the rotation of the camera through an input gesture, specifically, a preset moving position can be adopted, when the user clicks a screen locking key, the camera automatically moves to a preset position, or in other words, the time for the user to press the screen locking key is different, and the moving distance of the camera is different.

Then, when the screen is in the screen-off state, the manner of determining whether the camera is moved to the predetermined position may be: and determining whether a preset operation input by a user is received or not when the screen is in a screen-off state, and judging whether the camera is moved to a preset position or not if the preset operation is received.

The preset operation may be that the user presses the screen locking key, and as an implementation manner, after the user clicks the screen locking key and keeps the screen locking key for the first preset time, the camera is automatically moved to the preset position, and at this time, the preset operation is that the user presses the screen locking key for the first preset time. As another embodiment, after the user clicks the screen locking key and keeps the screen locking key for the second preset time, the camera moves according to the second preset time, and the moving distance is proportional to the time, that is, the longer the pressing time is, the farther the camera moves.

Therefore, when the screen is in the screen off state, if the operation that the user presses the screen locking key is received, the camera is controlled to move to the preset position.

The camera is connected with the processor of the mobile terminal, can receive the instruction of the processor of the mobile terminal and open and shoot the image, then when the mobile terminal detects that the camera is moved to a preset position, the mobile terminal sends out a shooting instruction to the camera, the camera is controlled to start, and the camera collects the image of an object positioned in the view field of the camera. Specifically, the camera can judge whether a face image exists in the currently acquired image, as an implementation mode, the image acquired by the camera is a two-dimensional image, whether the face image is acquired can be determined by searching whether facial feature points exist in the image, and if the face image is acquired, the acquired face image is sent to a processor of the mobile terminal. As another embodiment, the camera includes structured light, and determines whether three-dimensional information of a human face exists according to three-dimensional information collected by the structured light, and if so, sends the collected human face image to the processor of the mobile terminal.

S802: and unlocking the screen according to the face image.

Specifically, the process of unlocking the screen includes judging whether an unlocking password input by a user is correct, and if the unlocking password input by the user is correct, releasing the locked state of the screen, and if the unlocking password input by the user is incorrect, maintaining the locked state of the screen. After the screen is successfully unlocked, the screen is lightened, and a preset interface after unlocking is entered, wherein the preset interface can be a system desktop or other interfaces.

The mode of detecting whether the unlocking can be successfully performed is as follows: and judging whether the face image meets a preset condition, if so, judging successful unlocking, and if not, judging unsuccessful unlocking.

The face image meeting the preset condition can be used as a correct key for unlocking the screen, specifically, preset feature information of the face image can be preset, if the face image is a two-dimensional image, the preset feature information is facial feature point information of the face image input by the user in advance, and if the face image is a three-dimensional image, the preset feature information is facial three-dimensional information of the face image input by the user in advance. And judging whether the face image meets the preset condition or not by acquiring feature point information of the face image, comparing the acquired feature information of the face image with preset feature information input by a user in advance, if so, judging that the face image meets the preset condition, determining that the face image has the authority to unlock the screen of the mobile terminal, and if not, judging that the face image does not meet the preset condition, and if not, unlocking the screen.

S804: and if the unlocking is successful, lightening the screen. And connecting the screen for unlocking after the face image is determined to meet the preset condition. Therefore, the user does not need to light the screen through the unlocking key firstly, the screen is unlocked in a mode of opening the camera and then collecting the face image, the camera is directly started to collect the face image after the camera is moved to the preset position, and the screen is unlocked after the face image meets the preset condition without redundant operation. If the unlocking is not successful, the screen-off state of the screen is maintained, namely, the screen is not lightened.

It should be noted that, after the camera is detected to be moved to the predetermined position, when the camera is started and the face image acquired by the camera is acquired, the screen can be lighted, a face acquisition interface is displayed on the screen, the interface can be a face acquisition window, and the preview image acquired by the camera is displayed in the face acquisition interface, so that a user can adjust the shooting angle between the face and the camera according to the preview image, and the situation that the face image cannot be acquired successfully by the camera due to different shooting angles is avoided.

Of course, after the camera is detected to be moved to the preset position, the screen is not lightened when the camera is started and the face image collected by the camera is obtained, the user directly aims the face at the camera, and the screen is unlocked when the face image is collected by the camera and the face image meets the preset condition. In this way, the user may not know that the camera is turned on at this time, so that the camera cannot acquire the face image and no electricity is wasted, and therefore, a reminding function can be provided.

Specifically, as shown in fig. 9, a screen unlocking method provided in an embodiment of the present application is shown, and is used for improving user experience when a user unlocks a mobile terminal, and specifically, the method includes: s901 to S905.

S901: and when the screen is in a screen-off state, detecting whether the camera is moved to a preset position.

S902: and if the mobile terminal is moved to the preset position, starting the camera and sending out reminding information.

When the camera is detected to be moved to the preset position, the reminding information is sent to remind a user of aligning the face of the user to the camera, and therefore even if the screen is not lightened when the camera is started, the user can start the camera through the reminding information or the camera. The reminding information can be voice reminding, for example, when the camera is detected to be moved to a preset position, the loudspeaker is turned on, and the voice reminding is played to remind a user of aligning the face to the camera.

As another embodiment, when the camera is moved to the predetermined position, the reminding message may be sent by controlling the flash to be alternately turned on and off at a preset frequency if the camera is moved to the predetermined position.

Specifically, the flash lamp may be arranged on the back of the mobile terminal, and the flash lamp may be controlled to alternately turn on and off at a preset frequency, so that the user may be reminded of the back flash.

As an embodiment, a flash lamp is disposed on the rotating assembly or the sliding member, specifically, the flash lamp is disposed near the camera, and the direction of the emitted light is the same as the shooting direction of the camera, and after the camera is turned on, the flash lamp flashes to remind the user to put the face of the person opposite to the camera.

S903: and acquiring the face image collected by the camera.

S904: and judging whether the face image meets a preset condition or not.

S905: unlocking and lighting up the screen.

It should be noted that, the above steps are parts of detailed description, and reference may be made to the foregoing embodiments, which are not repeated herein.

Referring to fig. 10, a screen unlocking method provided in an embodiment of the present application is shown, and the method is used for improving user experience when a user unlocks a mobile terminal, and specifically, the method includes: s1001 to S1007.

S1001: and when the screen is in a screen-off state, detecting whether the camera is moved to a preset position.

S1002: and if the mobile terminal is moved to the preset position, starting the camera and sending out reminding information.

S1003: and acquiring the face image collected by the camera.

S1004: and judging whether the face image meets a preset condition or not.

S1005: unlocking and lighting up the screen.

S1006: and judging whether the camera is moved to the initial position or not.

The initial position, the manner of moving to the initial position, and the detection method may refer to the above embodiments, and are not described herein again.

S1007: and closing the camera and displaying an unlocking interface on the screen.

The unlocking interface is internally provided with an unlocking key and can acquire information such as fingerprints input by a user, so that S1006 is executed when the face image is judged not to meet the preset condition, so that the user can unlock the screen by inputting a digital password or a fingerprint in the unlocking interface when the user can not unlock the screen through face recognition.

In addition, the operations of S1006 and S1007 are not limited to be performed after S1004, that is, after the camera is turned on and the face image acquired by the camera is acquired, an operation of determining whether the camera is moved to the initial position may be performed, so that when the user does not want to unlock the screen using face recognition after the camera is turned to the predetermined position, the screen may be unlocked in another manner on the unlocking interface. Moreover, the camera can be returned to the initial position, and the influence on the operation of a user is avoided.

Moreover, after the user rotates the camera to the preset position and inputs the correct face image to unlock the screen, the screen can be locked by rotating the camera, specifically, after the screen is unlocked, whether the camera is moved to the locking position or not is judged, and if yes, the screen is locked. The locking position is a position preset by a user for locking the screen, and specifically, the locking position may be a position between an initial position and a predetermined position, that is, when the initial position is moved to the predetermined position, the locking position is passed through. After the camera is moved to the locking position and the screen is locked, the camera is moved continuously to return to the initial position, and therefore the influence on a user is avoided.

In addition, in order to avoid misoperation of a user, whether the camera is moved to the locking position is judged, if yes, whether the residence time of the camera at the locking position is longer than a preset time length is judged, and if yes, the screen is locked. The preset time length can be set by a user according to requirements, for example, 2 seconds, when the user moves the camera to the locking position, the camera stays for 2 seconds, and the mobile terminal executes the screen locking operation.

Referring to fig. 11, a screen unlocking device 1100 provided in an embodiment of the present application is shown, and is configured to improve user experience when a user unlocks a mobile terminal, and specifically, the device includes: an acquisition unit 1101, an unlocking unit 1102, and a lighting unit 1103.

The acquiring unit 1101 is configured to, when the screen is in a screen-off state and the camera is moved to a predetermined position, start the camera and acquire a face image acquired by the camera.

And an unlocking unit 1102, configured to unlock a screen according to the face image.

A lighting unit 1103, configured to light the screen if the unlocking is successful.

In addition, the system also comprises an unlocking interface display unit which is used for judging whether the camera is moved to the initial position; if yes, the camera is closed, and an unlocking interface is displayed on the screen.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

Referring to fig. 4 again, based on the method and apparatus, the embodiment of the present application further provides a mobile terminal 100, which includes an electronic body 10, where the electronic body 10 includes a housing 12 and a main display 120 disposed on the housing 12. The housing 12 may be made of metal, such as steel or aluminum alloy. In this embodiment, the main display 120 generally includes a display panel 111, and may also include a circuit or the like for responding to a touch operation performed on the display panel 111. The Display panel 111 may be a Liquid Crystal Display (LCD) panel, and in some embodiments, the Display panel 111 is a touch screen 109.

Referring to fig. 12, in an actual application scenario, the mobile terminal 100 may be used as a smart phone terminal, in which case the electronic body 10 generally further includes one or more processors 102 (only one is shown in the figure), a memory 104, an RF (Radio Frequency) module 106, an audio circuit 110, a sensor 114, an input module 118, and a power module 122. It will be understood by those skilled in the art that the structure shown in fig. 12 is merely illustrative and is not intended to limit the structure of the electronic body 10. For example, the electronics body section 10 may also include more or fewer components than shown in FIG. 12, or have a different configuration than shown in FIG. 4.

Those skilled in the art will appreciate that all other components are peripheral devices with respect to the processor 102, and the processor 102 is coupled to the peripheral devices through a plurality of peripheral interfaces 124. The peripheral interface 124 may be implemented based on the following criteria: universal Asynchronous Receiver/Transmitter (UART), General Purpose Input/Output (GPIO), Serial Peripheral Interface (SPI), and Inter-Integrated Circuit (I2C), but the present invention is not limited to these standards. In some examples, the peripheral interface 124 may comprise only a bus; in other examples, the peripheral interface 124 may also include other elements, such as one or more controllers, for example, a display controller for interfacing with the display panel 111 or a memory controller for interfacing with a memory. These controllers may also be separate from the peripheral interface 124 and integrated within the processor 102 or a corresponding peripheral.

The memory 104 may be used to store software programs and modules, and the processor 102 executes various functional applications and data processing by executing the software programs and modules stored in the memory 104. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the electronic body portion 10 or the primary display 120 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The RF module 106 is configured to receive and transmit electromagnetic waves, and achieve interconversion between the electromagnetic waves and electrical signals, so as to communicate with a communication network or other devices. The RF module 106 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a Subscriber Identity Module (SIM) card, memory, and so forth. The RF module 106 may communicate with various networks such as the internet, an intranet, a wireless network, or with other devices via a wireless network. The wireless network may comprise a cellular telephone network, a wireless local area network, or a metropolitan area network. The Wireless network may use various Communication standards, protocols and technologies, including, but not limited to, Global System for Mobile Communication (GSM), Enhanced Data GSM Environment (EDGE), wideband code division multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Wireless Fidelity (WiFi) (e.g., Institute of Electrical and Electronics Engineers (IEEE) standard IEEE 802.10A, IEEE802.11 b, IEEE 802.2.1 g and/or IEEE802.11 n), voice over internet protocol (VoIP), world wide mail Access (Microwave for internet Access, Wi-1 wave), and other short message Communication protocols, as well as any other suitable communication protocols, and may even include those that have not yet been developed.

The audio circuitry 110, earpiece 101, sound jack 103, microphone 105 collectively provide an audio interface between a user and the electronic body portion 10 or the main display 120. Specifically, the audio circuit 110 receives sound data from the processor 102, converts the sound data into an electrical signal, and transmits the electrical signal to the earpiece 101. The earpiece 101 converts the electrical signal into sound waves that can be heard by the human ear. The audio circuitry 110 also receives electrical signals from the microphone 105, converts the electrical signals to sound data, and transmits the sound data to the processor 102 for further processing. Audio data may be retrieved from the memory 104 or through the RF module 106. In addition, audio data may also be stored in the memory 104 or transmitted through the RF module 106.

The sensor 114 is disposed in the electronic body portion 10 or the main display 120, examples of the sensor 114 include, but are not limited to: light sensors, motion sensors, pressure sensors, acceleration sensors 114F, proximity sensors 114J, distance sensors, and other sensors that can be used to detect the position at which the camera is moved.

In particular, the light sensor may comprise a light sensor, a pressure sensor. Among them, the pressure sensor may detect a pressure generated by pressing on the mobile terminal 100. That is, the pressure sensor detects pressure generated by contact or pressing between the user and the mobile terminal, for example, contact or pressing between the user's ear and the mobile terminal. Accordingly, the pressure sensor may be used to determine whether contact or pressing has occurred between the user and the mobile terminal 100, and the magnitude of the pressure.

Referring to fig. 4 again, in the embodiment shown in fig. 4, the light sensor and the pressure sensor are disposed adjacent to the display panel 111. The light sensor may turn off the display output by the processor 102 when an object is near the main display 120, for example, when the electronic body portion 10 is moved to the ear.

As one of the motion sensors, the acceleration sensor 114F can detect the magnitude of acceleration in various directions (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping) and the like for recognizing the attitude of the mobile terminal 100. In addition, the electronic body 10 may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer and a thermometer, which are not described herein,

in this embodiment, the input module 118 may include the touch screen 109 disposed on the main display 120, and the touch screen 109 may collect touch operations of the user (for example, operations of the user on or near the touch screen 109 using any suitable object or accessory such as a finger, a stylus, etc.) and drive the corresponding connection device according to a preset program. Optionally, the touch screen 109 may include a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 102, and can receive and execute commands sent by the processor 102. In addition, the touch detection function of the touch screen 109 may be implemented by various types, such as resistive, capacitive, infrared, and surface acoustic wave.

The main display 120 is used to display information input by a user, information provided to the user, and various graphic user interfaces of the electronic body section 10, which may be composed of graphics, text, icons, numbers, video, and any combination thereof, and in one example, the touch screen 109 may be provided on the display panel 111 so as to be integrated with the display panel 111.

The power module 122 is used to provide power supply to the processor 102 and other components. Specifically, the power module 122 may include a power management system, one or more power sources (e.g., batteries or ac power), a charging circuit, a power failure detection circuit, an inverter, a power status indicator light, and any other components associated with the generation, management, and distribution of power within the electronic body portion 10 or the primary display 120.

The mobile terminal 100 further comprises a locator 119, the locator 119 being configured to determine an actual location of the mobile terminal 100. In this embodiment, the locator 119 implements the positioning of the mobile terminal 100 by using a positioning service, which is understood to be a technology or a service for obtaining the position information (e.g., longitude and latitude coordinates) of the mobile terminal 100 by using a specific positioning technology and marking the position of the positioned object on an electronic map.

It should be noted that the mobile terminal shown in fig. 1 to 4 is different from the mobile terminal shown in fig. 5 to 6 and fig. 7 in that the installation manner of the camera on the mobile terminal body is different, and the functional components, the electronic devices and other arrangements may be the same, and specifically, refer to the description of fig. 12.

To sum up, the embodiment of the application provides a screen unlocking method, a screen unlocking device, a mobile terminal and a computer readable medium. Therefore, the operation that the screen is lightened through the screen locking key firstly and then the camera is started to collect the face can be avoided, but the camera is moved to the preset position to directly collect the image and unlock the screen. That is to say, according to the screen unlocking method, the screen unlocking device, the mobile terminal and the computer readable medium provided in the embodiments of the present application, when the screen is turned off, the camera may be moved to the predetermined position without lighting the screen, and then the face is recognized, and after the face recognition is passed, that is, when the screen is successfully unlocked, the screen is lighted again, so that the user normally uses the mobile phone. Compared with the prior art, the screen is firstly lightened, then the face is input, and after the face recognition is passed, the screen is successfully unlocked and then lightened, so that the electric quantity can be saved.

In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.

Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.

The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (mobile terminal) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.

It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments. In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. The screen unlocking method is applied to a mobile terminal, the mobile terminal comprises a screen locking key, a mobile terminal body and a camera, the screen locking key is a physical key, and the camera can be pulled or rotated, and the method comprises the following steps:

when the screen is in a screen off state, acquiring the duration of pressing the screen locking key by a user, and controlling the camera to move according to the duration, wherein the moving distance is in direct proportion to the duration;

judging whether the camera is moved to a preset position from an initial position, if so, starting the camera and acquiring a face image acquired by the camera, wherein the initial position is a critical position of the camera in a mobile terminal body;

carrying out screen unlocking according to the face image;

if the unlocking is successful, lighting the screen;

after the screen is unlocked, judging whether the camera is moved to a locking position, wherein the locking position is located between the initial position and the preset position;

if the camera is moved to the locking position, judging whether the residence time of the camera at the locking position is greater than a preset time length;

and if the time length is greater than the preset time length, locking the screen.

2. The method of claim 1, further comprising:

and if the unlocking is not successful, not lightening the screen.

3. The method according to claim 1, wherein the camera is hidden in the mobile terminal body, can be manually pulled to be exposed from the top of the terminal body, and the determining whether the camera is moved from the initial position to the predetermined position comprises:

acquiring the pulling distance of the camera;

and comparing the pulled distance with a preset distance, and confirming whether the camera is moved to a preset position from an initial position according to a comparison result.

4. The method of claim 1, wherein the determining whether the camera is moved from the initial position to the predetermined position comprises:

acquiring rotation information of the camera, wherein the rotation information comprises a rotation direction and a rotation angle;

and comparing the rotation information of the camera with preset rotation information, and confirming whether the camera is moved to a preset position from an initial position or not according to a comparison result.

5. The method of claim 1, wherein turning on the camera and obtaining the face image captured by the camera if the camera is moved to a predetermined position comprises:

if the mobile terminal is moved to the preset position, the camera is started and reminding information is sent out;

and acquiring the face image collected by the camera.

6. The method of claim 1, wherein the determining whether the camera is moved from the initial position to the predetermined position comprises:

determining whether a preset operation input by a user is received;

and if the preset operation is received, judging whether the camera is moved to a preset position from an initial position.

7. The method of claim 1, further comprising:

if the unlocking is not successful according to the face image, judging whether the camera is moved to an initial position or not;

if yes, the camera is closed, and an unlocking interface is displayed on the screen.

8. The utility model provides a screen unlocking device, its characterized in that is applied to mobile terminal, mobile terminal includes lock screen key, mobile terminal body and camera, the lock screen key is the physics button, the camera can be pulled or rotate, the device includes:

the acquisition unit is used for acquiring the duration of pressing the screen locking key by a user when the screen is in a screen off state, and controlling the camera to move according to the duration, wherein the moving distance is in direct proportion to the duration; judging whether the camera is moved to a preset position from an initial position, if so, starting the camera and acquiring a face image acquired by the camera, wherein the initial position is a critical position of the camera in a mobile terminal body;

the unlocking unit is used for unlocking the screen according to the face image;

the lighting unit is used for lighting the screen if the unlocking is successful; after the screen is unlocked, judging whether the camera is moved to a locking position, wherein the locking position is located between the initial position and the preset position; if the camera is moved to the locking position, judging whether the residence time of the camera at the locking position is greater than a preset time length; and if the time length is greater than the preset time length, locking the screen.

9. A mobile terminal is characterized by comprising a screen locking key, a mobile terminal body and a camera, wherein the screen locking key is a physical key, the camera can be pulled or rotated, the mobile terminal also comprises a memory and a processor, and the memory is coupled with the processor; the memory stores instructions that, when executed by the processor, cause the processor to perform the method of any of claims 1-7.

10. The mobile terminal of claim 9, wherein the camera is concealable within the mobile terminal body and is manually pulled to be exposed from a top of the terminal body.

11. The mobile terminal of claim 10, wherein the processor is further configured to:

acquiring the pulling distance of the camera;

and comparing the pulled distance with a preset distance, and confirming whether the camera is moved to a preset position according to a comparison result.

12. The mobile terminal of claim 9, wherein the camera can be manually rotated.

13. The mobile terminal of claim 12, wherein the processor is further configured to:

and comparing the rotation information of the camera with preset rotation information, and confirming whether the camera is moved to a preset position according to a comparison result.

14. A computer-readable medium having program code executable by a processor, wherein the program code causes the processor to perform the method of any one of claims 1-7.