CN107909686B - Method and device for unlocking human face, computer readable storage medium and electronic equipment - Google Patents

Method and device for unlocking human face, computer readable storage medium and electronic equipment Download PDF

Info

Publication number
CN107909686B
CN107909686B CN201711065922.0A CN201711065922A CN107909686B CN 107909686 B CN107909686 B CN 107909686B CN 201711065922 A CN201711065922 A CN 201711065922A CN 107909686 B CN107909686 B CN 107909686B
Authority
CN
China
Prior art keywords
electronic equipment
mode
unlocking
camera
instruction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201711065922.0A
Other languages
Chinese (zh)
Other versions
CN107909686A (en
Inventor
李小朋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201711065922.0A priority Critical patent/CN107909686B/en
Publication of CN107909686A publication Critical patent/CN107909686A/en
Application granted granted Critical
Publication of CN107909686B publication Critical patent/CN107909686B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00Individual registration on entry or exit
    • G07C9/00174Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00563Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00Individual registration on entry or exit
    • G07C9/00174Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00571Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys operated by interacting with a central unit

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Telephone Function (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application relates to a method and a device for unlocking a human face, a computer readable storage medium and electronic equipment. The face identification of face unlocking is needed when the camera is judged to be started, so that the ISP image signal processor of the electronic equipment is started to enter the first mode with low power consumption, the face unlocking is carried out through the first mode, the power consumption of the electronic equipment when the face unlocking is carried out on the electronic equipment is reduced, the face unlocking is not affected, and particularly when the face unlocking is needed frequently, the power consumption of the electronic equipment when the face unlocking is carried out can be obviously reduced.

Description

Method and device for unlocking human face, computer readable storage medium and electronic equipment
Technical Field
The present application relates to the field of electronic device application technologies, and in particular, to a method and an apparatus for unlocking a human face, a computer-readable storage medium, and an electronic device.
Background
Along with intelligent electronic equipment's development, in order to provide better experience, the mode of electronic equipment unblock is also diversified, for example have fingerprint unblock, password unblock etc. along with artificial intelligence's development, the people's face unblock is also used more and more. When the face unlocking is used, in the traditional technology, the camera of the front camera is called to perform face recognition, and then deep learning, living body detection and the like are performed, so that safe and rapid unlocking of the electronic equipment is realized. However, when the face is unlocked, the front camera is started every time, which causes the face unlocking power consumption of the electronic device to be too large.
Disclosure of Invention
The embodiment of the application provides a method and a device for unlocking a human face, a computer-readable storage medium and electronic equipment, which can reduce the power consumption of human face unlocking when the electronic equipment unlocks the human face.
A method of face unlocking, the method comprising:
if the starting of a camera of the electronic equipment is detected, judging whether an instruction of an unlocking action of the electronic equipment is received or not;
if the unlocking action instruction of the electronic equipment is judged to be received, controlling an ISP image signal processor to enter a first mode, wherein the first mode is a low power consumption mode of the ISP image signal processor;
and using the first mode to perform face recognition, and unlocking the electronic equipment if the face recognition is verified.
An apparatus for unlocking a human face, the apparatus comprising:
the judging module is used for judging whether an instruction of an unlocking action of the electronic equipment is received or not if the starting of a camera of the electronic equipment is detected;
the starting module is used for controlling the ISP image signal processor to enter a first mode if judging that an instruction of an unlocking action of the electronic equipment is received, wherein the first mode is a low power consumption mode of the ISP image signal processor;
and the unlocking module is used for carrying out face recognition by using the first mode and unlocking the electronic equipment if the face recognition verification is passed.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method.
An electronic device comprising a memory and a processor, wherein the memory stores computer readable instructions, and the instructions, when executed by the processor, cause the processor to execute the method for unlocking a human face.
According to the method and the device for unlocking the human face, the computer readable storage medium and the electronic equipment, whether an unlocking action instruction of the electronic equipment is received or not is judged by detecting the starting of a camera of the electronic equipment, if the unlocking action instruction of the electronic equipment is judged to be received, an ISP image signal processor is controlled to enter a low power consumption mode of a first mode, the first mode with low power consumption is used for recognizing the human face, and if the human face is recognized and verified, the electronic equipment automatically unlocks. The face identification of face unlocking is needed when the camera is judged to be started, so that the ISP image signal processor of the electronic equipment is started to enter the first mode with low power consumption, the face unlocking is carried out through the first mode, the power consumption of the electronic equipment when the face unlocking is carried out on the electronic equipment is reduced, and the face unlocking is not influenced. Especially, when the electronic equipment needs to be unlocked frequently in the using process, the power consumption of the electronic equipment can be obviously reduced when the face of the electronic equipment is unlocked without changing the original hardware of the electronic equipment, and the cost of the electronic equipment is not increased.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic diagram of an internal structure of an electronic device according to an embodiment of the present application;
FIG. 2 is a flowchart of an embodiment of a method for unlocking a human face according to the present application;
FIG. 3 is a flowchart of another embodiment of a method for unlocking a human face according to the present application;
FIG. 4 is a block diagram of an embodiment of a face unlocking apparatus;
fig. 5 is a block diagram of a partial structure of a mobile phone related to an electronic device provided in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
It will be understood that, as used herein, the terms "first," "second," and the like may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish one element from another. For example, a first mode can be referred to as a second mode, and similarly, a second mode can be referred to as a first mode, without departing from the scope of the present application. Both the first mode and the second mode are mode ends, but they are not the same mode.
Fig. 1 is a schematic diagram of an internal structure of an electronic device in one embodiment. As shown in fig. 1, the electronic device includes a processor, a memory, and a network interface connected by a system bus. Wherein, the processor is used for providing calculation and starting capability and supporting the operation of the whole computer equipment. The memory is used for storing data, programs and the like, and at least one computer program is stored on the memory, and the computer program can be executed by the processor to realize the method for unlocking the human face of the electronic device provided by the embodiment of the application. The Memory may include a non-volatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a Random-Access-Memory (RAM). For example, in one embodiment, the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The computer program can be executed by a processor to implement a method for unlocking a human face provided in the following embodiments. The internal memory provides a cached execution environment for the operating system computer programs in the non-volatile storage medium. The network interface may be an ethernet card or a wireless network card, etc. for communicating with an external computer device. The electronic device can be a mobile phone, a notebook computer, a tablet computer or a personal digital assistant or a wearable device.
When the electronic equipment is unlocked through a human face, the traditional mode of the electronic equipment is that a camera of the electronic equipment is started after the electronic equipment is lightened, and after the camera is started, a whole ISP (Image Signal Processing) processor is started, so that the whole power consumption of lightening the screen is increased rapidly in an instant, and the power consumption is increased along with the fact that a user is lightened continuously and the unlocking frequency is higher. The ISP image signal processor, which may also be referred to as an ISP processor, is mainly used to process an image signal output by an image sensor of a camera of an electronic device to match with image sensors of different manufacturers. And the ISP image signal processor is integrated with a circuit special for performing the processes of noise reduction, sharpening and the like on the image digital signal captured by the image sensor, and finally generates a frame of color image data.
However, when the electronic device performs face unlocking, in order to reduce the power consumption of the electronic device, it is only necessary to meet the requirement of face detection, after the camera is started, all functions of the ISP processor do not need to be started, but only relevant function modules, such as a face recognition detection function, need to be started, because the whole ISP processor is called up, there is no special requirement for functionality, particularly noise reduction function with high power consumption, and the whole ISP processor needs time for starting, therefore, after the electronic device performs screen lightening, when the electronic device judges that face unlocking is required, only the face detection module of the ISP processor is started, and all the modules are not required to be started, and other functions of the ISP image signal processor, such as an anti-shake function, a noise reduction function, and a sharpening function, may not be started during face unlocking, based on the concept of the technical scheme, the embodiment of the application provides a method for reducing power consumption of electronic equipment during face unlocking.
Referring to fig. 2, fig. 2 is a flowchart illustrating an embodiment of a method for unlocking a human face according to the present application, where the method includes:
step 200, if the starting of a camera of the electronic equipment is detected, judging whether an unlocking action instruction of the electronic equipment is received.
Specifically, the camera of the electronic device may refer to a front camera or a rear camera of the electronic device if the electronic device is provided with a fixed front camera and a fixed rear camera; if the electronic equipment is provided with a rotatable camera, especially when the camera can rotate to the angle of the face facing the face unlocking, the rotatable camera can be referred to. In short, the camera of the electronic device is a camera capable of unlocking a human face.
The instruction of the unlocking action refers to that when the electronic device is in a bright screen state, all actions capable of triggering the unlocking interface of the display screen are included in the instruction range of the unlocking action, and include an instruction of pressing down a key of the display unlocking interface, or an instruction of sliding the screen, or an instruction of opening an application program arranged on the unlocking display interface, such as an application program for making a call, or an unlocking virtual key.
If the electronic device detects that the camera of the electronic device is started, indicating that the electronic device is in a bright screen state, the electronic device judges whether an instruction of an unlocking action is received, for example, whether an instruction of pressing a button for displaying an unlocking interface or an instruction of sliding a screen is received, or an instruction of opening an application program arranged on the unlocking display interface, for example, an application program for dialing a phone call, or an unlocked virtual button and the like can trigger the action of displaying the screen unlocking interface.
If the electronic device determines that the instruction of the unlocking action is received, the process proceeds to step 220.
Step 220, if it is determined that an instruction of an unlocking action of the electronic device is received, controlling the ISP image signal processor to enter a first mode, where the first mode is a low power consumption mode of the ISP image signal processor.
Specifically, if the electronic device detects that the camera of the electronic device is started, it is further determined that an instruction of an unlocking action of the electronic device is received, which indicates that the camera of the electronic device is started, and the electronic device is to perform face unlocking, the ISP image signal processor is started to enter the low power consumption mode of the first mode of the ISP image signal processor, so that when the electronic device performs face unlocking, the detected face image is processed by using the low power consumption mode of the first mode of the ISP image signal processor, and the power consumption of the electronic device is reduced.
If the electronic equipment judges that the instruction of the unlocking action of the electronic equipment is received, the electronic equipment is indicated to carry out face unlocking, the ISP image signal processor is started to enter a low power consumption mode of the ISP image signal processor to carry out face unlocking, and therefore when the electronic equipment carries out face unlocking, the power consumption of the face unlocking of the electronic equipment is reduced.
And step 240, using the first mode to perform face recognition, and if the face recognition is verified, automatically unlocking the electronic equipment.
Specifically, the electronic device processes the image of face recognition by using the low power consumption of the first mode of the ISP image signal processor, and if the detected face information is matched with the face information of face unlocking prestored in the electronic device, it is determined that the face recognition verification is passed, and the electronic device automatically unlocks, so that the low power consumption of the electronic device is realized when the electronic device is unlocked by the face.
In one embodiment, the first mode includes only a portrait detection function.
Specifically, in order to reduce the power consumption of the electronic device when the electronic device is unlocked through a human face, only the human image detection function of the ISP image signal processor is started, and other functions of the ISP image signal processor are not started, for example, the functions of noise reduction, anti-shake, sharpening and the like of the ISP image signal processor are not started, so that the power consumption of the ISP image signal processor when the human face is unlocked and the human face is detected is reduced, and the power consumption of the whole electronic device when the human face is unlocked is reduced.
Furthermore, the electronic device adds one or two other functions to the portrait detection function of the ISP image signal processor, such as only starting the portrait detection function and the anti-shake function of the ISP image signal processor, or only starting the portrait detection function and the noise reduction function of the ISP image signal processor, and the like.
In one embodiment, the step of controlling the ISP image signal processor to enter the first mode comprises:
and when the ISP image signal processor is started, controlling all functions of the ISP image signal processor except for human face detection to be closed.
Specifically, when the electronic device is unlocked through a face, a camera of the electronic device is started, after the camera is started, functions of the whole ISP image signal processor are all started, and since it is determined that the electronic device is started to unlock the face, in order to reduce power consumption of the electronic device when the face is unlocked, all functions of the ISP image signal processor except for face detection, such as functions of anti-shake, sharpening, noise reduction, and the like, need to be controlled to be turned off.
In one embodiment, the step of determining whether an instruction for an unlocking action of the electronic device is received includes:
judging whether an instruction for opening an application program corresponding to a camera of the electronic equipment is received;
and if the instruction for opening the application program corresponding to the camera of the electronic equipment is not received, judging that the instruction for unlocking the electronic equipment is received.
Specifically, the electronic device determines whether to receive an instruction of an unlocking action of the electronic device, and may also determine whether to receive an instruction of opening an Application program corresponding to a camera of the electronic device, such as an Application program related to the camera on the electronic device, such as a camera, a video APP (Application, abbreviation of Application), a live APP, or a camera APP, in addition to determining whether to receive an action of triggering a display screen to unlock an interface, such as an instruction of pressing a display unlocking interface key, or an instruction of sliding a screen, or an instruction of opening an Application program set on an unlocking display interface. If the electronic equipment judges that an instruction for opening an application program corresponding to a camera of the electronic equipment is received, judging that the starting of the camera is caused by the opening of the application program, otherwise, if the electronic equipment judges that the instruction for opening the application program corresponding to the camera of the electronic equipment is not received, judging that an instruction for unlocking the electronic equipment is received.
In one embodiment, the method further comprises:
and if judging that an instruction for opening an application program corresponding to the camera of the electronic equipment is received, starting the camera to enter a second mode, wherein the power consumption of the second mode is greater than that of the first mode.
Specifically, if the electronic device determines that an instruction for opening an application program corresponding to a camera of the electronic device is received, it is determined that the camera is started due to the opening of the application program, and in order to meet requirements of the application program on high quality of an image, such as requirements of sharpness and beauty of the image, an ISP image signal processor of the camera is started to enter a second mode, where the second mode is a mode including functions other than human image detection, such as functions of noise reduction, sharpening, shake prevention, and the like, and therefore power consumption of the second mode is greater than power consumption of the first mode.
In one embodiment, the step of controlling the ISP image signal processor to enter the first mode if it is determined that the instruction of the unlocking action of the electronic device is received, where the first mode is a low power consumption mode of the ISP image signal processor further includes:
and turning off a Graphic Processing Unit (GPU) of the electronic equipment.
Specifically, a Graphics Processor (GPU), also called a display core, a vision processor, and a display chip, is a microprocessor dedicated to image operation on a personal computer, a workstation, a game machine, and some mobile devices (e.g., a tablet computer, a smart phone, etc.).
When the electronic equipment carries out face unlocking, in order to further reduce the power consumption of the electronic equipment, due to the fact that only the face detection module is needed, preview data processing is not needed, the data of the GPU can be closed, the GPU of the electronic equipment is closed, and therefore the power consumption of the electronic equipment when the face unlocking is carried out is further reduced.
In one embodiment, the method further comprises:
and if the command of the unlocking action of the electronic equipment is judged to be received, controlling the camera to enter a third mode, wherein the third mode is a low power consumption mode of the camera.
In particular, the image sensor is an important component constituting the digital camera. Depending on the Device, the Device can be classified into two categories, namely, a CCD (Charge Coupled Device) and a CMOS (Complementary Metal-Oxide Semiconductor).
In order to reduce the power consumption of the electronic equipment when the electronic equipment performs face unlocking, the ISP image signal processor can be started to enter the low power consumption mode of the ISP image signal processor from the angle of the ISP image signal processor, and the image sensor of the camera can be started to enter the low power consumption mode of the image sensor from the angle of the image sensor of the camera.
Taking a front camera of an electronic device as an example, two modes are designed for an image sensor of the front camera, which can also be called as two modes of the camera:
(1) the first is a low power consumption mode of the camera, which is referred to as a third mode in the embodiment of the present application, the image sensor of the camera is mainly used for portrait detection, when the camera of the electronic device is started, other functions of the image sensor of the camera are not opened, for example, the anti-shake function and the noise reduction function of the image sensor are not opened, and only the portrait detection function of the image sensor is started, or one or two other functions are added to the portrait detection function of the image sensor, for example, only the portrait detection function and the anti-shake function of the image sensor are started, or only the portrait detection function and the noise reduction function of the image sensor are started.
(2) The second mode of the camera, referred to as the fourth mode in the embodiment of the present application, may also be referred to as the normal mode of the camera, and belongs to a high power consumption mode. In order to ensure that the image sensor of the camera acquires high-quality images and meet the requirements of photographing or video, various functions of the image sensor of the camera are started, such as a face detection function, an anti-shake function, a noise reduction function and the like.
If the electronic equipment detects that the camera of the electronic equipment is started, further judging that an instruction of an unlocking action of the electronic equipment is received, indicating that the camera of the electronic equipment is started, and starting the camera to enter a low power consumption mode of the camera in order to unlock the face, so that the power consumption of the electronic equipment is reduced when the face of the electronic equipment is unlocked.
If the electronic equipment judges that the instruction of the unlocking action of the electronic equipment is received, the electronic equipment indicates that the face unlocking is to be carried out on the electronic equipment, the camera is started to enter a low power consumption mode of the camera to carry out the face unlocking, and therefore when the face unlocking is carried out on the electronic equipment, the power consumption of the face unlocking of the electronic equipment is reduced.
In one embodiment, the third mode includes only a portrait detection function.
Specifically, when the electronic device is unlocked through the face, the power consumption of the electronic device is reduced, only the portrait detection function of the image sensor in the camera is started, other functions of the image sensor in the camera are not started, for example, the noise reduction function and the anti-shaking function of the image sensor are not started, so that the power consumption of the camera when the face is unlocked and the face is detected is reduced, and the power consumption of the whole electronic device when the face is unlocked is reduced.
Furthermore, the electronic device adds one or two other functions to the portrait detection function of the image sensor, such as only starting the portrait detection function and the anti-shake function of the image sensor, or only starting the portrait detection function and the noise reduction function of the image sensor, and the like.
The camera of the electronic device refers to an imaging device of the electronic device, or is called a camera, and mainly includes a lens and an image sensor.
In one embodiment, the size of the portrait detected by the third mode is set to be equal to or smaller than a preset size threshold.
Specifically, in order to further reduce the power consumption of the electronic device when the face is unlocked, the electronic device may start that the size of a portrait detected by an image sensor of a camera of the electronic device is equal to or smaller than a preset size threshold, which meets the requirement of the face unlocking, where the pixel of the preset size threshold may be 640x480, that is, the size of an image detected by the portrait is smaller than or equal to 640x480, may be 640x480 pixels, or may be 320x 240 pixels, and the like. Because the image size of the face detection is started within a preset small range, the size of the image output by the image sensor of the camera becomes very small, the need of the face detection during face unlocking can be met, the power consumption of the electronic equipment during face unlocking can be reduced, and the image output speed of the electronic equipment during face unlocking can be increased.
In one embodiment, the image output frame rate of the portrait detection of the first mode is set to be output at a preset frame rate.
Specifically, the Frame rate (Frame rate) is a measure for measuring the number of display frames. The measurement unit is the number of display Frames Per Second (FPS) or "Hertz" (Hz). The number of frames per second (fps), or frame rate, indicates the number of times per second that the graphics processor can update while processing fields. If the frame rate is too high, graphics processor power is wasted.
Therefore, in order to further reduce the power consumption of the electronic device when the human face is unlocked, the electronic device may further start a frame rate of an image output by an image sensor of a camera of the electronic device, so as to meet the requirement of human face unlocking. The frame rate value range is 10-20 frames per second, the frame rate can be started at 12-18 frames per second, generally, the frame rate can be started at 15 frames per second to achieve a better balance state of image quality and power consumption, the use requirement of the human face during unlocking can be met, and compared with the normal 30-frame output frame rate per second, the power consumption of the electronic equipment can be greatly reduced.
In one embodiment, the clock frequency of the portrait detection of the third mode is set to decrease at a preset ratio above the original clock frequency.
In particular, clock frequency (also known as clock rate speed) refers to the fundamental frequency of the clock in the synchronous circuit, measured in "cycles per second", measured in SI units of hertz (Hz). There are a large number of semiconductor chips in an electronic device, each chip operating at a particular clock frequency. The clock signal provided by the clock generator to the chip is a continuous pulse signal, the pulse is equivalent to the pulse of the chip, and each time the pulse arrives, the transistor in the chip changes the state once, so that the whole chip can complete a certain task.
In order to further reduce the power consumption of the electronic equipment when the face is unlocked, the clock frequency of an image sensor of a camera of the electronic equipment during portrait detection can be reduced, and the requirement of face unlocking is met. Reducing the clock frequency of the image sensor of the camera of the electronic device may be programmed to enable the clock frequency of the electronic device using an Inter-Integrated Circuit (IIC) communication protocol. The clock frequency of the portrait detection in the first mode is reduced on the original clock frequency by a preset ratio, for example, the clock frequency of the portrait detection in the first mode can be reduced by 40% on the basis of the original clock frequency, that is, the clock frequency of the portrait detection in the first mode is 60% of the original clock frequency, so that the speed of the output frequency of the image during face detection is reduced, and the power consumption of the electronic device is reduced.
Referring to fig. 3, fig. 3 is a flowchart illustrating another embodiment of a method for unlocking a human face according to the present application, where the method includes:
step 301, the electronic device detects that the camera is started, and step 302 is entered;
step 302, the electronic device judges whether an instruction of an unlocking action of the electronic device is received, if the electronic device receives the instruction of the unlocking action, step 303 is entered, otherwise step 304 is entered;
step 303, if the electronic device determines that an instruction of an unlocking action of the electronic device is received, then the ISP processing of the electronic device enters a first mode, the camera of the electronic device enters a third mode, the electronic device performs portrait detection of face unlocking in a low power consumption mode, the portrait size of the portrait detection in the third mode is set to be equal to or smaller than a preset size threshold, the frame rate of image output of the portrait detection in the third mode is set to be output at a preset frame rate, and the clock frequency of the portrait detection in the third mode is set to be reduced on the basis of the original clock frequency by a preset ratio;
step 304, if the electronic device determines that the instruction of the unlocking action of the electronic device is not received, the ISP processing of the electronic device enters a second mode, and the camera of the electronic device enters a fourth mode to take a picture or video normally;
step 305, the ISP processor of the electronic device uses the first mode, the camera of the electronic device uses the third mode to perform face recognition, matches the detected face recognition information with face information of face unlocking pre-stored in the electronic device, performs face verification, and then enters step 306;
step 306, if the face recognition verification of the electronic equipment for face detection passes, step 307 is entered, otherwise, step 305 is returned;
and 307, if the face recognition verification of the portrait detection performed by the electronic equipment passes, the electronic equipment automatically unlocks.
According to the method and the device for unlocking the human face, the computer readable storage medium and the electronic equipment, whether an unlocking action instruction of the electronic equipment is received or not is judged by detecting the starting of a camera of the electronic equipment, if the unlocking action instruction of the electronic equipment is judged to be received, an ISP image signal processor is controlled to enter a low power consumption mode of a first mode, the first mode with low power consumption is used for recognizing the human face, and if the human face is recognized and verified, the electronic equipment automatically unlocks. The face identification of face unlocking is needed when the camera is judged to be started, so that the ISP image signal processor of the electronic equipment is started to enter the first mode with low power consumption, the face unlocking is carried out through the first mode, the power consumption of the electronic equipment when the face unlocking is carried out on the electronic equipment is reduced, and the face unlocking is not influenced. Especially, when the electronic equipment needs to be unlocked frequently in the using process, the power consumption of the electronic equipment can be obviously reduced when the face of the electronic equipment is unlocked without changing the original hardware of the electronic equipment, and the cost of the electronic equipment is not increased.
Referring to fig. 4, fig. 4 is a block diagram of an embodiment of a program module of a device for unlocking a human face, the device including:
the judging module 40 is configured to judge whether an instruction of an unlocking action of the electronic device is received if it is detected that a camera of the electronic device is started.
Specifically, if the electronic device detects that the camera of the electronic device is started, indicating that the electronic device is in a bright screen state, the electronic device determines whether an instruction of an unlocking action is received, for example, whether an instruction of pressing a button for displaying an unlocking interface is received, or an instruction of sliding a screen is received, or an instruction of opening an application program set on the unlocking display interface, for example, an application program for making a call, or an unlocked virtual button, or the like, which can trigger an action of displaying the screen unlocking interface.
The starting module 42 is configured to control the ISP image signal processor to enter a first mode if it is determined that an instruction of an unlocking action of the electronic device is received, where the first mode is a low power consumption mode of the ISP image signal processor.
Specifically, if the electronic device detects that the camera of the electronic device is started, it is further determined that an instruction of an unlocking action of the electronic device is received, which indicates that the camera of the electronic device is started, and the electronic device is to perform face unlocking, the ISP image signal processor is started to enter the low power consumption mode of the first mode of the ISP image signal processor, so that when the electronic device performs face unlocking, the detected face image is processed by using the low power consumption mode of the first mode of the ISP image signal processor, and the power consumption of the electronic device is reduced.
If the electronic equipment judges that the instruction of the unlocking action of the electronic equipment is received, the electronic equipment is indicated to carry out face unlocking, the ISP image signal processor is started to enter a low power consumption mode of the ISP image signal processor to carry out face unlocking, and therefore when the electronic equipment carries out face unlocking, the power consumption of the face unlocking of the electronic equipment is reduced.
And the unlocking module 44 is configured to perform face recognition by using the first mode, and if the face recognition is verified, the electronic device automatically unlocks.
Specifically, the electronic device processes the image of face recognition by using the low power consumption of the first mode of the ISP image signal processor, and if the detected face information is matched with the face information of face unlocking prestored in the electronic device, it is determined that the face recognition verification is passed, and the electronic device automatically unlocks, so that the low power consumption of the electronic device is realized when the electronic device is unlocked by the face.
In one embodiment, the first mode includes only a portrait detection function.
Specifically, in order to reduce the power consumption of the electronic device when the electronic device is unlocked through a human face, only the human face detection function of the ISP image signal processor is started, and other functions of the ISP image signal processor are not turned on, for example, functions of noise reduction, anti-shake, sharpening and the like of the ISP image signal processor are not turned on, so that the power consumption of the ISP image signal processor when the human face is unlocked and the human face is detected is reduced, and the power consumption of the whole electronic device when the human face is unlocked is reduced.
In one embodiment, the activation module 42 includes:
and the control unit is used for controlling all functions of the ISP image signal processor except for human face detection to be closed when the ISP image signal processor is started.
Specifically, when the electronic device is unlocked through a face, a camera of the electronic device is started, after the camera is started, functions of the whole ISP image signal processor are all started, and since it is determined that the electronic device is started to unlock the face, in order to reduce power consumption of the electronic device when the face is unlocked, all functions of the ISP image signal processor except for face detection, such as functions of anti-shake, sharpening, noise reduction, and the like, need to be controlled to be turned off.
In one embodiment, the determining module 40 includes:
the first judgment unit is used for judging whether an instruction for opening an application program corresponding to a camera of the electronic equipment is received;
and the second judging unit is used for judging that the instruction of the unlocking action of the electronic equipment is received if judging that the instruction of opening the application program corresponding to the camera of the electronic equipment is not received.
Specifically, the electronic device determines whether to receive an instruction of an unlocking action of the electronic device, and may also determine whether to receive an instruction of opening an Application program corresponding to a camera of the electronic device, such as an Application program related to the camera on the electronic device, such as a camera, a video APP (Application, abbreviation of Application), a live APP, or a camera APP, in addition to determining whether to receive an action of triggering a display screen to unlock an interface, such as an instruction of pressing a display unlocking interface key, or an instruction of sliding a screen, or an instruction of opening an Application program set on an unlocking display interface. If the electronic equipment judges that an instruction for opening an application program corresponding to a camera of the electronic equipment is received, judging that the starting of the camera is caused by the opening of the application program, otherwise, if the electronic equipment judges that the instruction for opening the application program corresponding to the camera of the electronic equipment is not received, judging that an instruction for unlocking the electronic equipment is received.
In one embodiment, the apparatus further comprises:
and the second mode entering module is used for starting the camera to enter a second mode if judging that an instruction for opening an application program corresponding to the camera of the electronic equipment is received, wherein the power consumption of the second mode is greater than that of the first mode.
Specifically, if the electronic device determines that an instruction for opening an application program corresponding to a camera of the electronic device is received, it is determined that the camera is started due to the opening of the application program, and in order to meet requirements of the application program on high quality of an image, such as requirements of sharpness and beauty of the image, an ISP image signal processor of the camera is started to enter a second mode, where the second mode is a mode including functions other than human image detection, such as functions of noise reduction, sharpening, shake prevention, and the like, and therefore power consumption of the second mode is greater than power consumption of the first mode.
In one embodiment, the apparatus further comprises:
and the closing module is used for closing the GPU of the electronic equipment.
Specifically, a Graphics Processor (GPU), also called a display core, a vision processor, and a display chip, is a microprocessor dedicated to image operation on a personal computer, a workstation, a game machine, and some mobile devices (e.g., a tablet computer, a smart phone, etc.).
When the electronic equipment carries out face unlocking, in order to further reduce the power consumption of the electronic equipment, due to the fact that only the face detection module is needed, preview data processing is not needed, the data of the GPU can be closed, the GPU of the electronic equipment is closed, and therefore the power consumption of the electronic equipment when the face unlocking is carried out is further reduced.
In one embodiment, the apparatus further comprises:
and the third mode entering module is used for controlling the camera to enter a third mode if judging that an instruction of an unlocking action of the electronic equipment is received, wherein the third mode is a low power consumption mode of the camera.
In particular, the image sensor is an important component constituting the digital camera. Depending on the Device, the Device can be classified into two categories, namely, a CCD (Charge Coupled Device) and a CMOS (Complementary Metal-Oxide Semiconductor).
In order to reduce the power consumption of the electronic equipment when the electronic equipment performs face unlocking, the ISP image signal processor can be started to enter the low power consumption mode of the ISP image signal processor from the angle of the ISP image signal processor, and meanwhile, the image sensor of the front camera can be started to enter the low power consumption mode of the image sensor from the angle of the image sensor of the front camera.
Two modes are designed for an image sensor of a front camera, and can also be called as two modes of the camera:
(1) the first is a low power consumption mode of the camera, which is referred to as a third mode in the embodiment of the present application, the image sensor of the camera is mainly used for portrait detection, when the camera of the electronic device is started, other functions of the image sensor of the camera are not opened, for example, the anti-shake function and the noise reduction function of the image sensor are not opened, and only the portrait detection function of the image sensor is started.
(2) The second mode is an existing mode of the camera, which is referred to as a fourth mode in the embodiment of the present application, and may also be referred to as a normal mode of the camera, and belongs to a high power consumption mode. In order to ensure that the image sensor of the camera acquires high-quality images and meet the requirements of photographing or video, various functions of the image sensor of the camera are started, such as a face detection function, an anti-shake function, a noise reduction function and the like.
If the electronic equipment detects that the camera of the electronic equipment is started, further judging that an instruction of an unlocking action of the electronic equipment is received, indicating that the camera of the electronic equipment is started, and starting the camera to enter a low power consumption mode of the camera in order to unlock the face, so that the power consumption of the electronic equipment is reduced when the face of the electronic equipment is unlocked.
If the electronic equipment judges that the instruction of the unlocking action of the electronic equipment is received, the electronic equipment indicates that the face unlocking is to be carried out on the electronic equipment, the camera is started to enter a low power consumption mode of the camera to carry out the face unlocking, and therefore when the face unlocking is carried out on the electronic equipment, the power consumption of the face unlocking of the electronic equipment is reduced.
In one embodiment, the third mode includes only a portrait detection function.
Specifically, when the electronic device is unlocked through the face, the power consumption of the electronic device is reduced, only the portrait detection function of the image sensor in the camera is started, other functions of the image sensor in the camera are not started, for example, the noise reduction function and the anti-shaking function of the image sensor are not started, so that the power consumption of the camera when the face is unlocked and the face is detected is reduced, and the power consumption of the whole electronic device when the face is unlocked is reduced.
The camera of the electronic device refers to an imaging device of the electronic device, or is called a camera, and mainly includes a lens and an image sensor.
In one embodiment, the size of the portrait detected by the third mode is set to be equal to or smaller than a preset size threshold.
Specifically, in order to further reduce the power consumption of the electronic device when the face is unlocked, the electronic device may start that the size of a portrait detected by an image sensor of a camera of the electronic device is equal to or smaller than a preset size threshold, which meets the requirement of the face unlocking, where the pixel of the preset size threshold may be 640x480, that is, the size of an image detected by the portrait is smaller than or equal to 640x480, may be 640x480 pixels, or may be 320x 240 pixels, and the like. Because the image size of the face detection is started within a preset small range, the size of the image output by the image sensor of the camera becomes very small, the need of the face detection during face unlocking can be met, the power consumption of the electronic equipment during face unlocking can be reduced, and the image output speed of the electronic equipment during face unlocking can be increased.
In one embodiment, the image output frame rate of the portrait detection of the first mode is set to be output at a preset frame rate.
Specifically, the Frame rate (Frame rate) is a measure for measuring the number of display frames. The measurement unit is the number of display Frames Per Second (FPS) or "Hertz" (Hz). The number of frames per second (fps), or frame rate, indicates the number of times per second that the graphics processor can update while processing fields. If the frame rate is too high, graphics processor power is wasted.
Therefore, in order to further reduce the power consumption of the electronic device when the human face is unlocked, the electronic device may further start a frame rate of an image output by an image sensor of a camera of the electronic device, so as to meet the requirement of human face unlocking. The frame rate value range is 10-20 frames per second, the frame rate can be started at 12-18 frames per second, generally, the frame rate can be started at 15 frames per second to achieve a better balance state of image quality and power consumption, the use requirement of the human face during unlocking can be met, and compared with the normal 30-frame output frame rate per second, the power consumption of the electronic equipment can be greatly reduced.
In one embodiment, the clock frequency of the portrait detection of the third mode is set to decrease at a preset ratio above the original clock frequency.
In particular, clock frequency (also known as clock rate speed) refers to the fundamental frequency of the clock in the synchronous circuit, measured in "cycles per second", measured in SI units of hertz (Hz). There are a large number of semiconductor chips in an electronic device, each chip operating at a particular clock frequency. The clock signal provided by the clock generator to the chip is a continuous pulse signal, the pulse is equivalent to the pulse of the chip, and each time the pulse arrives, the transistor in the chip changes the state once, so that the whole chip can complete a certain task.
In order to further reduce the power consumption of the electronic equipment when the face is unlocked, the clock frequency of an image sensor of a camera of the electronic equipment during portrait detection can be reduced, and the requirement of face unlocking is met. Reducing the clock frequency of the image sensor of the camera of the electronic device may be programmed to enable the clock frequency of the electronic device using an Inter-Integrated Circuit (IIC) communication protocol. The clock frequency of the portrait detection in the first mode is reduced on the original clock frequency by a preset ratio, for example, the clock frequency of the portrait detection in the first mode can be reduced by 40% on the basis of the original clock frequency, that is, the clock frequency of the portrait detection in the first mode is 60% of the original clock frequency, so that the speed of the output frequency of the image during face detection is reduced, and the power consumption of the electronic device is reduced.
The division of each module in the device for unlocking a human face is only used for illustration, and in other embodiments, the device for unlocking a human face may be divided into different modules as needed to complete all or part of the functions of the device for unlocking a human face.
The above-mentioned device for unlocking a human face can be implemented in the form of a computer program, and the computer program can be run on the electronic device shown in fig. 1.
The embodiment of the application also provides a computer readable storage medium. One or more non-transitory computer-readable storage media embodying a computer program that, when executed by one or more processors, causes the processors to perform the steps of:
a computer program product comprising instructions which, when run on a computer, cause the computer to perform the steps of the method of face unlocking described in the embodiments above. The embodiment of the application also provides the electronic equipment. The computer apparatus includes therein an Image Processing circuit, which may be implemented using hardware and/or software components, and may include various Processing units defining an ISP (Image Signal Processing) pipeline. FIG. 5 is a schematic diagram of an image processing circuit in one embodiment. As shown in fig. 5, for convenience of explanation, only aspects of the image processing technology related to the embodiments of the present application are shown.
As shown in fig. 5, the image processing circuit includes an ISP image signal processor 540 and a control logic 550. The image data captured by the imaging device 510 is first processed by the ISP image signal processor 540, and the ISP image signal processor 540 analyzes the image data to capture image statistics that may be used to determine and/or image one or more control parameters of the imaging device 510. The imaging device 510 may include a camera having one or more lenses 512 and an image sensor 514. Image sensor 514 may include an array of color filters (e.g., Bayer filters), and image sensor 514 may acquire light intensity and wavelength information captured with each imaging pixel of image sensor 514 and provide a set of raw image data that may be processed by ISP image signal processor 540. The sensor 520 (e.g., gyroscope) may provide parameters of the acquired image processing (e.g., anti-shake parameters) to the ISP image signal processor 540 based on the type of sensor 520 interface. The sensor 520 interface may utilize an SMIA (Standard Mobile Imaging Architecture) interface, other serial or parallel camera interfaces, or a combination of the above.
In addition, the image sensor 514 may also transmit raw image data to the sensor 520, the sensor 520 may provide the raw image data to the ISP image signal processor 540 based on the sensor 520 interface type, or the sensor 520 may store the raw image data in the image memory 530.
The ISP image signal processor 540 processes the raw image data pixel by pixel in a variety of formats. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits, and the ISP image signal processor 540 may perform one or more image processing operations on the raw image data, gathering statistical information about the image data. Wherein the image processing operations may be performed with the same or different bit depth precision.
The ISP image signal processor 540 may also receive image data from the image memory 530. For example, the sensor 520 interface sends raw image data to the image memory 530, and the raw image data in the image memory 530 is then provided to the ISP image signal processor 540 for processing. The image Memory 530 may be a part of a Memory device, a storage device, or a separate dedicated Memory within an electronic device, and may include a DMA (Direct Memory Access) feature.
Upon receiving raw image data from image sensor 514 interface or from sensor 520 interface or from image memory 930, ISP image signal processor 540 may perform one or more image processing operations, such as temporal filtering. The processed image data may be sent to image memory 530 for additional processing before being displayed. The ISP image signal processor 540 receives the processed data from the image memory 530 and performs image data processing on the processed data in the raw domain and in the RGB and YCbCr color spaces. The image data processed by ISP image signal processor 540 may be output to display 570 for viewing by a user and/or further processed by a Graphics Processing Unit (GPU). Further, the output of the ISP image signal processor 540 may also be transmitted to the image memory 530, and the display 570 may read image data from the image memory 530. In one embodiment, image memory 530 may be configured to implement one or more frame buffers. In addition, the output of the ISP image signal processor 540 may be transmitted to an encoder/decoder 560 so as to encode/decode image data. The encoded image data may be saved and decompressed before being displayed on the display 570 device. The encoder/decoder 560 may be implemented by a CPU or GPU or coprocessor.
The statistics determined by the ISP image signal processor 540 may be transmitted to the control logic 550 unit. For example, the statistical data may include image sensor 514 statistical information such as auto-exposure, auto-white balance, auto-focus, flicker detection, black level compensation, lens 512 shading correction, and the like. The control logic 550 may include a processor and/or microcontroller that executes one or more routines (e.g., firmware) that may determine control parameters of the imaging device 510 and control parameters of the ISP image signal processor 540 based on the received statistical data. For example, the control parameters of imaging device 510 may include sensor 520 control parameters (e.g., gain, integration time for exposure control, anti-shake parameters, etc.), camera flash control parameters, lens 512 control parameters (e.g., focal length for focusing or zooming), or a combination of these parameters. The ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (e.g., during RGB processing), and lens 512 shading correction parameters.
The following steps are the method for realizing the human face unlocking by using the image processing technology in the figure 5:
if the starting of a camera of the electronic equipment is detected, judging whether an instruction of an unlocking action of the electronic equipment is received or not;
if the unlocking action instruction of the electronic equipment is judged to be received, controlling an ISP image signal processor to enter a first mode, wherein the first mode is a low power consumption mode of the ISP image signal processor;
and using the first mode to perform face recognition, and unlocking the electronic equipment if the face recognition is verified.
In one embodiment, the step of determining whether an instruction for an unlocking action of the electronic device is received includes:
judging whether an instruction for opening an application program corresponding to a camera of the electronic equipment is received;
and if the instruction for opening the application program corresponding to the camera of the electronic equipment is not received, judging that the instruction for unlocking the electronic equipment is received.
In one embodiment, the method further comprises:
and if judging that an instruction for opening an application program corresponding to the camera of the electronic equipment is received, starting the ISP image signal processor to enter a second mode, wherein the power consumption of the second mode is greater than that of the first mode.
In one embodiment, the step of controlling the ISP image signal processor to enter the first mode if it is determined that the instruction of the unlocking action of the electronic device is received, where the first mode is a low power consumption mode of the ISP image signal processor further includes:
and turning off a Graphic Processing Unit (GPU) of the electronic equipment.
In one embodiment, the step of controlling the ISP image signal processor to enter the first mode comprises:
and when the ISP image signal processor is started, controlling all functions of the ISP image signal processor except for human face detection to be closed.
In one embodiment, the method further comprises:
and if the command of the unlocking action of the electronic equipment is judged to be received, controlling the camera to enter a third mode, wherein the third mode is a low power consumption mode of the camera.
In one embodiment, the third mode includes only a portrait detection function.
In one embodiment, the size of the portrait detected by the third mode is set to be equal to or smaller than a preset size threshold.
In one embodiment, the image output frame rate of the portrait detection of the third mode is set to be output at a preset frame rate.
In one embodiment, the clock frequency of the portrait detection of the third mode is set to decrease at a preset ratio above the original clock frequency.
The embodiment of the application also provides a computer program product. A computer program product comprising instructions which, when run on a computer, cause the computer to perform the steps of the method for unlocking a human face as described in the embodiments above.
Any reference to memory, storage, database, or other medium used herein may include non-volatile and/or volatile memory. Suitable non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and bus dynamic RAM (RDRAM).
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (12)

1. A method of face unlocking, the method comprising:
if the starting of a camera of the electronic equipment is detected, judging whether an instruction of an unlocking action of the electronic equipment is received or not;
if the instruction of the unlocking action of the electronic equipment is judged to be received, when an ISP image signal processor is started, controlling all functions of the ISP image signal processor except for human face detection to be closed, and closing a Graphic Processing Unit (GPU) of the electronic equipment;
using a first mode to perform face recognition, and unlocking the electronic equipment if the face recognition is verified;
if the command of the unlocking action of the electronic equipment is judged to be received, starting the camera to enter a third mode, wherein the third mode is a low power consumption mode of the camera;
an image output frame rate of portrait detection in the third mode is set to be output at a preset frame rate; the preset frame rate is smaller than the normal output frame rate;
and if the unlocking action instruction of the electronic equipment is judged not to be received, the ISP processing of the electronic equipment enters the second mode, and the camera of the electronic equipment enters the fourth mode to carry out normal photographing or video.
2. The method of claim 1, wherein the step of determining whether an instruction for unlocking the electronic device is received comprises:
judging whether an instruction for opening an application program corresponding to a camera of the electronic equipment is received;
and if the instruction for opening the application program corresponding to the camera of the electronic equipment is not received, judging that the instruction for unlocking the electronic equipment is received.
3. The method of claim 2, further comprising:
and if judging that an instruction for opening an application program corresponding to the camera of the electronic equipment is received, starting the ISP image signal processor to enter a second mode, wherein the power consumption of the second mode is greater than that of the first mode.
4. The method of claim 1, wherein the portrait size of the third mode of portrait detection is set equal to or less than a preset size threshold.
5. The method of claim 1, wherein the clock frequency of the third mode of portrait detection is set to decrease at a preset ratio above the original clock frequency.
6. An apparatus for unlocking a human face, the apparatus comprising:
the judging module is used for judging whether an instruction of an unlocking action of the electronic equipment is received or not if the starting of a camera of the electronic equipment is detected;
the starting module is used for controlling all functions of the ISP image signal processor except for face detection to be closed when the ISP image signal processor is started if the fact that the instruction of the unlocking action of the electronic equipment is received is judged;
a shutdown module, configured to shut down a Graphics Processing Unit (GPU) of the electronic device;
the unlocking module is used for carrying out face recognition by using a first mode and unlocking the electronic equipment if the face recognition is verified;
the third mode entering module is used for starting the camera to enter a third mode if judging that an instruction of an unlocking action of the electronic equipment is received, wherein the third mode is a low power consumption mode of the camera; an image output frame rate of portrait detection in the third mode is set to be output at a preset frame rate; the preset frame rate is smaller than the normal output frame rate;
and if the command of the unlocking action of the electronic equipment is judged not to be received, the ISP processing of the electronic equipment enters a second mode, and the camera of the electronic equipment enters a fourth mode to carry out normal photographing or video.
7. The apparatus of claim 6, wherein the determining module comprises:
the first judgment unit is used for judging whether an instruction for opening an application program corresponding to a camera of the electronic equipment is received;
and the second judging unit is used for judging that the instruction of the unlocking action of the electronic equipment is received if judging that the instruction of opening the application program corresponding to the camera of the electronic equipment is not received.
8. The apparatus of claim 7, further comprising:
and the second mode entering module is used for starting the ISP image signal processor to enter a second mode if judging that an instruction of opening an application program corresponding to the camera of the electronic equipment is received, wherein the power consumption of the second mode is greater than that of the first mode.
9. The apparatus of claim 6, wherein the portrait size of the portrait detection of the third mode is set equal to or less than a preset size threshold.
10. The apparatus of claim 6, wherein the clock frequency of the third mode of portrait detection is set to decrease at a preset ratio above the original clock frequency.
11. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1-5.
12. An electronic device comprising a memory and a processor, the memory having stored therein computer-readable instructions that, when executed by the processor, cause the processor to perform the method of unlocking a human face according to any one of claims 1-5.
CN201711065922.0A 2017-11-02 2017-11-02 Method and device for unlocking human face, computer readable storage medium and electronic equipment Expired - Fee Related CN107909686B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711065922.0A CN107909686B (en) 2017-11-02 2017-11-02 Method and device for unlocking human face, computer readable storage medium and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711065922.0A CN107909686B (en) 2017-11-02 2017-11-02 Method and device for unlocking human face, computer readable storage medium and electronic equipment

Publications (2)

Publication Number Publication Date
CN107909686A CN107909686A (en) 2018-04-13
CN107909686B true CN107909686B (en) 2021-02-02

Family

ID=61843245

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711065922.0A Expired - Fee Related CN107909686B (en) 2017-11-02 2017-11-02 Method and device for unlocking human face, computer readable storage medium and electronic equipment

Country Status (1)

Country Link
CN (1) CN107909686B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110225258B (en) * 2018-04-28 2021-08-20 Oppo广东移动通信有限公司 Data processing method and device, computer readable storage medium and electronic equipment
CN108875344A (en) * 2018-06-25 2018-11-23 Oppo(重庆)智能科技有限公司 A kind of electronic equipment control method, electronic appliance controlling device and electronic equipment
CN110874463A (en) * 2018-08-31 2020-03-10 Oppo广东移动通信有限公司 Screen unlocking method and electronic equipment
CN110969053B (en) * 2018-09-29 2023-12-22 深圳市神州云海智能科技有限公司 Method and device for classifying players and lottery robot
CN110493519B (en) * 2019-08-19 2021-03-23 惠州Tcl移动通信有限公司 Image acquisition method of mobile terminal, computer readable medium and computer device
CN117311484A (en) * 2022-06-24 2023-12-29 华为技术有限公司 Method for adjusting power consumption of equipment and electronic equipment

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202135331U (en) * 2011-06-25 2012-02-01 北京播思软件技术有限公司 Mobile terminal with power saving management mode
US20130004071A1 (en) * 2011-07-01 2013-01-03 Chang Yuh-Lin E Image signal processor architecture optimized for low-power, processing flexibility, and user experience
US9288413B2 (en) * 2012-07-12 2016-03-15 Gopro, Inc. Image capture accelerator
CN104284004A (en) * 2013-07-02 2015-01-14 华为终端有限公司 Screen unlocking method and mobile terminal
CN104424156A (en) * 2013-09-09 2015-03-18 中兴通讯股份有限公司 Core processing method and device of processor and terminal
US8879858B1 (en) * 2013-10-01 2014-11-04 Gopro, Inc. Multi-channel bit packing engine
US20150356802A1 (en) * 2014-06-10 2015-12-10 Center For Integrated Smart Sensors Foundation Low Power Door-Lock Apparatus Based On Battery Using Face Recognition
CN104468969A (en) * 2014-10-23 2015-03-25 深圳市金立通信设备有限公司 Photographing method
CN104410785B (en) * 2014-11-17 2019-01-15 联想(北京)有限公司 A kind of information processing method and electronic equipment
CN104601888A (en) * 2015-01-19 2015-05-06 联想(北京)有限公司 Control method and electronic equipment
CN105807893A (en) * 2016-03-11 2016-07-27 联想(北京)有限公司 Information processing method and electronic device
CN106341571A (en) * 2016-08-18 2017-01-18 深圳市金立通信设备有限公司 Image processing method and terminal
CN107172345B (en) * 2017-04-07 2020-02-04 深圳市金立通信设备有限公司 Image processing method and terminal

Also Published As

Publication number Publication date
CN107909686A (en) 2018-04-13

Similar Documents

Publication Publication Date Title
CN107909686B (en) Method and device for unlocking human face, computer readable storage medium and electronic equipment
CN109068067B (en) Exposure control method and device and electronic equipment
CN108322669B (en) Image acquisition method and apparatus, imaging apparatus, and readable storage medium
CN109068058B (en) Shooting control method and device in super night scene mode and electronic equipment
CN107766831B (en) Image processing method, image processing device, mobile terminal and computer-readable storage medium
CN109005364B (en) Imaging control method, imaging control device, electronic device, and computer-readable storage medium
CN108900782B (en) Exposure control method, exposure control device and electronic equipment
CN107886484B (en) Beautifying method, beautifying device, computer-readable storage medium and electronic equipment
EP3836534A1 (en) Imaging control method, apparatus, electronic device, and computer-readable storage medium
CN107734253B (en) Image processing method, image processing device, mobile terminal and computer-readable storage medium
CN107509044B (en) Image synthesis method, image synthesis device, computer-readable storage medium and computer equipment
CN110191291B (en) Image processing method and device based on multi-frame images
CN107820017B (en) Image shooting method and device, computer readable storage medium and electronic equipment
CN107592473A (en) Exposure parameter method of adjustment, device, electronic equipment and readable storage medium storing program for executing
CN108198152B (en) Image processing method and device, electronic equipment and computer readable storage medium
CN110290323B (en) Image processing method, image processing device, electronic equipment and computer readable storage medium
CN109672819B (en) Image processing method, image processing device, electronic equipment and computer readable storage medium
CN107657167A (en) Method, apparatus, computer-readable recording medium and the electronic equipment of face unblock
KR101436839B1 (en) Apparatus and mthod for self timer image capture by checking the number of person
CN108769508B (en) Data processing method, device, computer readable storage medium and electronic equipment
CN107862274A (en) U.S. face method, apparatus, electronic equipment and computer-readable recording medium
CN107454322A (en) Photographic method, device, computer can storage medium and mobile terminals
EP3820141A1 (en) Imaging control method and apparatus, electronic device, and readable storage medium
CN108401110B (en) Image acquisition method and device, storage medium and electronic equipment
US20210168273A1 (en) Control Method and Electronic Device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20210202