WO2019134094A1

WO2019134094A1 - Electronic device and facial recognition method therefor

Info

Publication number: WO2019134094A1
Application number: PCT/CN2018/071361
Authority: WO
Inventors: 田浦延
Original assignee: 深圳阜时科技有限公司
Priority date: 2018-01-04
Filing date: 2018-01-04
Publication date: 2019-07-11
Also published as: CN110226169A

Abstract

An electronic device and a facial recognition method therefor. The facial recognition method comprises: S1, when an electronic device requires facial recognition, determining whether the intensity of current ambient light is less than or equal to a preset threshold; S2, if the intensity of the current ambient light is less than or equal to the preset threshold, controlling the electronic device to perform front light supplement; S3, controlling an image sensor on the front side of the electronic device to acquire a facial image of an object in front of the electronic device; and S4, matching the acquired facial image with a preset facial image template to determine whether the identity of the object in front of the electronic device is valid. The electronic device operates the facial recognition method.

Description

Electronic device and face recognition method thereof

Technical field

The invention relates to an electronic device and a face recognition method thereof.

Background technique

With the trend of full-screen development of smart phones, the proportion of screens on the front of mobile phones is getting higher and higher. Therefore, other components such as buttons and fingerprint recognition modules cannot be set because the space is limited. Since the fingerprint recognition module cannot be set, in order to realize the identification, the industry has proposed to use the front camera on the front of the mobile phone to obtain facial information and perform facial recognition.

However, the recognition effect of the existing facial recognition technology needs to be improved.

Summary of the invention

The embodiments of the present invention aim to at least solve one of the technical problems existing in the prior art. To this end, embodiments of the present invention need to provide an electronic device and a face recognition method thereof.

The invention provides a face recognition method for an electronic device, comprising the following steps:

S1, when the electronic device needs to perform facial recognition, determine whether the current ambient light intensity is less than or equal to a preset threshold;

S2, when the current ambient light intensity is less than or equal to a preset threshold, the control electronic device performs front fill light;

S3, controlling an image sensor on the front side of the electronic device to collect a facial image of an object in front of the electronic device;

S4: Match the collected facial image with a preset facial image template to determine whether the identity of the object in front is legal.

In the embodiment of the present invention, when facial recognition is required, if the surrounding environment of the electronic device is dark, the electronic device is controlled to fill light, so that the electronic device can collect a clear facial image, improve the facial recognition effect, and improve the user experience.

In some embodiments, the step S1 further comprises: performing step S3 when the current ambient light intensity is greater than a preset threshold.

In some embodiments, the fill light in step S2 is performed simultaneously with the acquisition of the facial image in step S3.

In some embodiments, in the step S2: when the current ambient light intensity is less than or equal to the preset threshold, the fill light device on the front side of the control electronic device is turned on to perform front fill light.

In some embodiments, one or more of the brightness, color temperature, and color of the fill light device are further adjusted when the fill light device on the front of the control electronics is turned on.

In some embodiments, the fill light device on the front side of the electronic device includes a fill light source disposed at the top end of the electronic device.

In some embodiments, in the step S2: when the current ambient light intensity is less than or equal to the preset threshold, the display screen of the electronic device is adjusted to the maximum brightness to perform front fill light.

In some embodiments, in the step S2, if the sum of the current ambient light intensity and the maximum brightness of the display screen is still less than or equal to the preset threshold, the fill light source of the front end of the control electronic device is turned on, so that The supplemental light source performs front fill light together with the display screen.

In some embodiments, the step S1 further includes: determining a current working state of the electronic device; determining whether face recognition is required according to the current working state of the electronic device.

In some embodiments, the current working state of the electronic device includes a state of the screen, a bright screen unlocked state, and a bright screen unlocked state; and determining, according to the current working state of the electronic device, whether facial recognition is required:

Determining whether there is a screen wake-up operation when the electronic device is in the interest screen state; determining that face recognition is required when determining that there is a screen wake-up operation;

Determining that facial recognition is required when the electronic device is in a bright, ununlocked state;

When the electronic device is in the unlocked state of the bright screen, it is determined whether there is an application-initiated authentication request currently, and if there is an authentication request, it is determined that facial recognition is required.

In some embodiments, the screen wake-up operation includes: picking up the electronic device, touching the display of the electronic device, approaching the front preset range of the electronic device, and pressing one or more of the electronic device function buttons.

An embodiment of the present invention provides an electronic device including an image sensor, a fill light device, an ambient light sensor, and a processor. The processor is configured to: when the electronic device needs to perform face recognition, determine that the ambient light sensor collects Whether the current ambient light intensity is less than or equal to a preset threshold; when the current ambient light intensity is less than or equal to a preset threshold, controlling the fill light device to perform front fill light; and controlling the image sensor to collect a face image of an object in front of the electronic device Matching the acquired facial image with a preset facial image template to determine whether the identity of the object in front is legal.

In some embodiments, the processor is further configured to directly control the image sensor to acquire a facial image of an object in front of the electronic device when the current ambient light intensity is greater than a preset threshold.

In some embodiments, the image sensor is located at a front end of the electronic device.

In some embodiments, the fill light device includes a fill light source located at a top end of the electronic device.

In some embodiments, the fill light source is a flexible light.

In some embodiments, the processor is further configured to: when the current ambient light intensity is less than or equal to a preset threshold, control the fill light source to be turned on to perform front fill light.

In some embodiments, one or more of the brightness, color temperature, and color of the fill light source are further adjusted when the fill light source is turned on.

In some embodiments, when the fill light device includes a display screen located on the front side of the electronic device, and the display screen is further used to display a screen; the processor is further configured to: when the current ambient light intensity is less than or equal to the pre- When the threshold is set, the display is adjusted to the maximum brightness for front fill.

In some embodiments, when the light-filling device further includes a fill light source located at the top of the front surface of the electronic device, the processor is further configured to: if the sum of the current ambient light intensity and the maximum brightness of the display screen is still less than or Equal to the preset threshold, the fill light source is controlled to be turned on.

In some embodiments, the processor is further configured to: determine a current working state of the electronic device, and determine whether face recognition is required according to a current working state of the electronic device.

In some embodiments, the current working state of the electronic device includes a screen state, a bright screen unlocked state, and a bright screen unlocked state; the processor is further configured to:

When the electronic device is in the state of the interest screen, it is determined whether there is a screen wake-up operation; when it is determined that there is a screen wake-up operation, it is determined that face recognition is required;

Additional aspects and advantages of the embodiments of the invention will be set forth in part in

DRAWINGS

The above and/or additional aspects and advantages of the embodiments of the present invention will become apparent and readily understood from

1 is a schematic flow chart of a face recognition method according to a first embodiment of the present invention;

2 is a schematic flow chart of a face recognition method according to a second embodiment of the present invention;

FIG. 3 is a schematic diagram of functional modules of a mobile terminal according to an embodiment of the present invention.

Detailed ways

The embodiments of the present invention are described in detail below, and the examples of the embodiments are illustrated in the drawings, wherein the same or similar reference numerals indicate the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the drawings are intended to be illustrative of the invention and are not to be construed as limiting.

In the description of the present invention, it is to be understood that the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, features defining "first" or "second" may include one or more of the described features either explicitly or implicitly. In the description of the present invention, the meaning of "a plurality" is two or more unless specifically and specifically defined otherwise. "Contact" or "touch" includes direct or indirect contact.

In the description of the present invention, it should be noted that the terms "installation", "connected", and "connected" are to be understood broadly, and may be fixed or detachable, for example, unless otherwise explicitly defined and defined. Connected, or integrally connected; may be mechanically connected, or may be electrically connected or may communicate with each other; may be directly connected or indirectly connected through an intermediate medium, may be internal communication of two elements or interaction of two elements relationship. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood on a case-by-case basis.

The following disclosure provides many different embodiments or examples for implementing different structures of the present invention. In order to simplify the disclosure of the present invention, the components and settings of specific examples are described below. Of course, they are merely examples and are not intended to limit the invention. In addition, the present invention may be repeated with reference to the numerals and/or reference numerals in the various examples, which are for the purpose of simplification and clarity, and do not indicate the relationship between the various embodiments and/or settings discussed. Moreover, the present invention provides examples of various specific processes and materials, but one of ordinary skill in the art will recognize the use of other processes and/or the use of other materials.

Further, the described features, structures may be combined in one or more embodiments in any suitable manner. In the following description, numerous specific details are set forth However, those skilled in the art will appreciate that the technical solution of the present invention can be practiced without one or more of the specific details or other structures, components, and the like. In other instances, well-known structures or operations are not shown or described in detail to avoid obscuring the invention.

The facial recognition method refers to collecting facial information of an object through a camera, and matching the collected facial information with the registered facial template. If the matching is successful, the identity of the object is determined to be legal, and if the matching fails, the identity of the object is determined to be illegal.

The objects herein include, for example, human bodies or other living organisms. The face information includes, for example, 2D image information or 3D image information. When facial recognition is performed based on 2D image information, it can be realized by using an existing camera, and it is not necessary to additionally provide an imaging device. However, the camera can capture clear facial images under normal lighting conditions, and when the illumination environment is poor, it is impossible to collect clear facial images, thereby affecting facial recognition effects, for example, because the collected facial images are blurred. Long recognition process, even face recognition is not possible. In this way, the user experience is also poor.

In this regard, the embodiments of the present invention provide a face recognition method capable of realizing face recognition regardless of any illumination environment, and improving the face recognition effect. Referring to Fig. 1, Fig. 1 is a flow chart showing a face recognition method according to a first embodiment of the present invention. The face recognition method includes the following steps:

S1, when the electronic device needs to perform facial recognition, determine whether the current ambient light intensity is less than or equal to a preset threshold; when the current ambient light intensity is less than or equal to the preset threshold, step S2 is performed, when the current ambient light intensity is greater than a preset threshold. At step S3;

The facial recognition method operates on an electronic device. The electronic device is, for example, but not limited to, a suitable type of electronic product such as a consumer electronic product, a home-based electronic product, a vehicle-mounted electronic product, or a financial terminal product. Among them, consumer electronic products such as mobile phones, tablets, notebook computers, desktop monitors, computer integrated machines. Home-based electronic products such as smart door locks, TVs, refrigerators, wearable devices, etc. Vehicle-mounted electronic products such as car navigation systems, car DVDs, etc. Financial terminal products such as ATM machines, terminals for self-service business, etc.

The front side of the electronic device is provided with a corresponding sensing device, such as an ambient light sensor, for collecting the light intensity of the surrounding environment of the electronic device when the electronic device needs facial recognition. When the surrounding environment of the electronic device is bright, the collected light intensity is strong; when the surrounding environment of the electronic device is dark, the collected light intensity is weak. Of course, the illumination intensity of the surrounding environment of the electronic device can also be collected by other sensing devices, such as a camera disposed on the front of the electronic device.

In the embodiment of the present invention, a threshold value, that is, a preset threshold value, is preset. If the ambient light intensity is greater than the preset threshold, it indicates that the electronic device can collect a clear facial image in the current environment to implement facial recognition; if the ambient light intensity is less than or equal to the preset threshold, the electronic device is in the current environment. Unable to capture a clear facial image, causing facial recognition to fail.

When the current ambient light intensity is collected, and the current ambient light intensity is less than or equal to the preset threshold, the control electronic device performs front fill light, so that the illumination intensity under the environment of the electronic device is greater than a preset threshold to implement facial recognition.

The image sensor on the front side of the electronic device is, for example, a CCD or a CMOS image sensor, and the front image of the front object can be acquired by using the front camera provided on the front side of the existing electronic device.

Before the electronic device is used, the user needs to register the face information, form a face template, and store it for matching of the 2D image at the time of face recognition. Image matching, for example, adopts facial feature extraction, first extracts corresponding facial features, such as eyes, nose, eyebrows, lips, chin, etc. from the 2D image, and then extracts the extracted facial features and corresponding faces in the 2D image template. The features are compared. If the comparison is consistent, the matching is successful, and the identity of the object in front is legal. If the comparison is inconsistent, the matching fails, and the identity of the object in front is invalid.

In some embodiments, the above steps S2 and S3 are performed simultaneously, that is, while the control electronic device performs front fill light, the image sensor on the front side of the electronic device is controlled to collect the facial image. It should be noted that, at the same time, it does not require strict consistency in time, but also has a sequence of time. It's just that the time difference is short, basically negligible, giving people the feeling that the two are at the same time.

In some embodiments, step S2 further includes: controlling the fill light device on the front side of the electronic device to be turned on when the current ambient light intensity is less than or equal to the preset threshold. Further, one or more parameters of the brightness, color temperature or color of the light-filling device are also adjusted while controlling the light-filling device on the front side of the electronic device.

In some embodiments, the light-filling device on the front surface of the electronic device may be a display screen of the electronic device or a fill light source located at the top of the electronic device, and the fill light source is an additional component that is dedicated to fill light. , for example, a soft light. When the light is supplemented by the display of the electronic device, the existing structure can be used to achieve the light filling, which saves the cost. When the fill light is used to fill the light, although the cost is increased, it does not affect the normal operation of other components (such as the display screen), and can also achieve a better fill light effect.

Further, the fill light device comprises, for example, a plurality of LEDs or other light emitting elements. Moreover, the brightness, color and color temperature of the light-emitting element can be controlled as needed. In this embodiment, by controlling one or several parameters of the brightness, color, and color temperature of the LED, the light signal emitted by the light-filling device is softened, so that when the facial image is collected, the user does not feel too glaring and improves. user experience. It can be understood that the specific values of the foregoing parameters are not limited, and can be flexibly selected according to actual use conditions.

In some embodiments, in step S2: when the current ambient light intensity is less than or equal to the preset threshold, the display screen of the electronic device is adjusted to the maximum brightness to perform front fill light.

If the electronic device fills the front side of the electronic device through the display screen, when the current ambient light intensity is less than or equal to the preset threshold, the display screen is gradually increased to the maximum brightness to perform front fill light. The brightness of the display can be adjusted one by one to avoid discomfort caused by sudden increase in brightness.

Further, in step S2, if the sum of the current ambient light intensity and the maximum brightness of the display screen is still less than or equal to the preset threshold, the fill light source of the front end of the control electronic device is turned on, so that the fill light source and the light source are The display screen is used to complement the front side.

Since the brightness of the display itself is limited, if the brightness of the display cannot meet the fill light requirement, the fill light source at the top of the front side of the control electronic device is turned on, so that the fill light source and the display screen together fill the light. Therefore, in this embodiment, the display screen is first adjusted to the maximum brightness, and the current ambient light intensity is collected. If the current ambient light intensity is still less than or equal to the preset threshold, it indicates that the fill light of the display cannot meet the fill light requirement. The fill light source on the front side of the control electronics is turned on. If the current ambient light intensity is greater than the preset threshold, it means that the brightness of the display can meet the fill light requirement, so only the brightness of the display screen can be used to fill the light.

Of course, in order to make the control process simple, when the current ambient light intensity is less than or equal to the preset threshold, the display screen and the control fill light source are simultaneously turned on, so that the display screen and the fill light source are positively combined. Fill light. It's so simple and convenient.

Further, referring to FIG. 2, FIG. 2 is a schematic flow chart of a face recognition method according to a second embodiment of the present invention. In the facial recognition method of the electronic device, before the step S1, the method further includes:

Step S5, determining a current working state of the electronic device;

The current working state is divided according to the display state of the display screen, for example, including the state of the information screen, the unlit state of the bright screen, and the unlocked state of the bright screen. The state of the information screen means that the display screen is not lit and is in an extinguished state. The unlit state of the bright screen means that the display is lit, but the unlocked interface is displayed on the display. In this state, the electronic device is not unlocked and cannot enter the running page of the electronic device. The unlocked state of the bright screen means that the display is lit and the corresponding interface is displayed according to the specific operation. In this state, the electronic device has been unlocked, and the user can use the electronic device normally.

Step S6: Determine whether face recognition is required according to the current working state of the electronic device.

Specifically, when the electronic device is in the state of the interest screen, the user may use the electronic device at any time, so in order to quickly respond to the user's operation, some sensors on the electronic device are still in operation to monitor the electronic device. Use case to determine if there is a screen wake-up operation. For example, touch sensors, gravity sensors, distance sensors, and the like. The screen wake-up operation includes picking up one or more of an electronic device, a display screen of the touch electronic device, a preset range of the object near the front of the device, and a function button for pressing the electronic device. It can be understood that the screen wake-up operation of the electronic device can be flexibly set according to the needs of the user.

Taking the touch sensor as an example, in the embodiment of the present invention, when the electronic device is in the interest screen state, the touch sensor of the control electronic device performs touch detection, and touch action on the display screen (eg, normal touch operation, pressing operation, sliding operation) Test and respond. When the electronic device is in the interest screen state, the touch sensor will perform touch detection at the first scanning frequency (lower power consumption state). When it is detected that the object touches the display screen, it is determined that face recognition is required. When the electronic device is in the unscreened state of the bright screen or the unlocked state of the bright screen, the touch sensor performs touch detection at the second scanning frequency (higher power consumption state or normal power consumption state), thereby reducing the state of the electronic device Power consumption. Wherein the first scanning frequency is less than the second scanning frequency. Of course, the touch sensor can also be touch-detected in a normal power consumption state.

When the electronic device is in the unlit state of the bright screen, the user may use the electronic device at any time in this case, so it is determined that face recognition is required, and the process proceeds to step S1.

When the electronic device is in the bright-screen unlocked state, it is further determined whether there is currently an authentication request initiated by the application to the operating system, for example, the payment application initiates an authentication request for mobile payment. If there is an authentication request, it is determined that face recognition is required, and the process proceeds to step S1, otherwise the electronic device performs a normal operation.

In some embodiments, after step S4 above, the method further comprises: after the face recognition is successful, controlling the electronic device to perform a corresponding operation. For example, controlling electronic device unlocking, performing payment transaction operations, and the like.

Correspondingly, an embodiment of the present invention provides an electronic device for performing the method of the above embodiment. The electronic device is exemplified by a mobile terminal. Referring to FIG. 3, FIG. 3 is a schematic diagram of functional modules of a mobile terminal according to an embodiment of the present invention. The mobile terminal 100 includes an image sensor 101, a fill light device 102, an ambient light sensor 103, a processor 104, and a memory 105. The ambient light sensor 103 is disposed on the front side of the electronic device for collecting the light intensity of the environment surrounding the electronic device. The image sensor 101 is disposed on the front side of the electronic device for collecting a facial image of an object in front of the electronic device. The light-filling device 102 is configured to fill light when the environment around the electronic device is dark to facilitate image capturing of the image sensor 101. The processor 104 is configured to determine, when the electronic device needs to perform facial recognition, whether the current ambient light intensity is less than or equal to a preset threshold; when the current ambient light intensity is less than or equal to a preset threshold, the control electronic device performs front fill light; and the control electronic An image sensor on the front of the device collects a facial image of an object in front of the electronic device; matches the acquired facial image with a preset facial image template to determine whether the identity of the object in front is legal.

It should be noted that, in some embodiments, one or more component structures may be combined or omitted, for example, the processor 104 and the memory 105 are integrated into a control chip or the like. Additionally, the mobile terminal 100 can include other components (eg, communication circuitry, power supplies, buses, microphones, cameras, etc.) that are not combined or included in the components shown in FIG. Moreover, for the sake of brevity, only some of the components of the mobile terminal are shown in FIG.

Specifically, the image sensor 101 is disposed on the front side of the electronic device, such as a CCD or CMOS image sensor. The image sensor 101 does not require additional settings. For example, when the front camera is disposed on the front side of the existing electronic device, the front camera can be used to collect the face image. Of course, it is also possible to set an image sensor corresponding to the shooting parameters according to the shooting requirements, and to collect the facial image for facial recognition.

The processor 104 is for including any processing circuitry that is provided to control the operation and performance of the mobile terminal 100. The processor 104 is used to run an operating system, an app, a media playback application, or any other application software, and is used to handle interactions with a user, and the like. The processor 104 is, for example, a control IC in which the processing circuits are integrated, or a processor cluster including distributed processing circuits, for example, a central processing unit CPU for centrally controlling various components of the electronic device, and for an electronic device. Image processing GPU in graphics processing. Of course, other dedicated processors, such as a coprocessor for monitoring the detection results of the sensors of the electronic device, a baseband processor for electronic device communication, a face recognition processor for electronic device for face recognition, etc., may also be provided. Wait.

Memory 105, for example, includes one or more computer storage media including hard disks, floppy disks, Flash, ROM, RAM, and any other suitable type of storage component or any combination thereof. The memory 105 is used to store any program code files available to the processor 104, such as an operating system, application software, and functional modules, to name a few. The memory 105 is also used to store processing data processed by the processor 104 and processing results such as application data, user operation information, user setting information, multimedia data, and the like. It will be appreciated that the memory 105 can be provided separately or integrated with the processor 104.

Further, the computer storage medium in the memory 105 stores a plurality of program code files for the processor 104 to call to execute the unlock control method described in the foregoing embodiment, thereby implementing unlock control in the state of the electronic device.

In some embodiments, the light-filling device 102 is disposed on the front surface of the electronic device, for example, a display screen 106 including an electronic device, and a fill light source 107 located at the top of the front surface of the electronic device. The fill light source 107 is additionally provided and dedicated to supplement Light components, such as soft lights. The display screen 106 is also used to display a picture. When performing face recognition, one of the display screen 106 and the fill light source 107 is selected for supplemental light according to actual needs, or a combination of the two is used to fill light. For example, when the fill light source 107 is used to fill light, the processor 104 is configured to: when the current ambient light intensity is less than or equal to a preset threshold, control the fill light source to be turned on to perform front fill light.

When the light is supplemented by the display 106 of the electronic device, the light can be achieved by using the existing structure, and the cost is saved. When the fill light is applied by the fill light source 107, although the cost is increased, it does not affect the normal operation of other components (such as a display screen), and a better fill light effect can be achieved.

The fill light device 102 includes, for example, a plurality of LEDs or other light emitting elements. Further, the light-filling parameters such as brightness, color, and color temperature of the light-emitting element can be controlled as needed. In this embodiment, by controlling one or several fill light parameters of the brightness, color and color temperature of the LED, the light signal emitted by the light-filling device is softened, so that the user does not feel too glaring when performing face image acquisition. , improved user experience. For example, the processor 104 is configured to further adjust one or more parameters of the brightness, color temperature and color of the fill light source when the fill light source is turned on.

In some embodiments, the processor 104 is further configured to: when the current ambient light intensity is less than or equal to a preset threshold, adjust the display screen to the maximum brightness to perform front fill light.

Further, the processor 104 is further configured to: if the sum of the current ambient light intensity and the maximum brightness of the display 106 is still less than or equal to a preset threshold, control the fill light source of the front end of the electronic device to be turned on, so that the fill light The light source 107 performs front fill light together with the display screen 106.

Since the illumination capability of the display screen itself is limited, if the brightness of the display screen 106 cannot meet the fill light requirement, the fill light source 107 of the front end of the control electronic device is turned on, so that the fill light source 107 and the display screen 106 together perform front fill light. Therefore, in this embodiment, the display screen 106 is first adjusted to the maximum brightness, and the current ambient light intensity is collected. If the current ambient light intensity is still less than or equal to the preset threshold, it indicates that the fill light of the display screen 106 cannot meet the fill light requirement. At this time, the fill light source 107 at the front end of the control electronic device is turned on. If the current ambient light intensity is greater than the preset threshold, it means that the brightness of the display screen 106 can meet the fill light requirement, so that only the brightness of the display screen 106 can be used to fill the light.

Further, the processor 104 is further configured to: determine a current working state of the electronic device, and determine whether face recognition is required according to a current working state of the electronic device.

The current working state is divided according to the display state of the display screen, for example, including the state of the information screen, the unlit state of the bright screen, and the unlocked state of the bright screen. The state of the information screen means that the display screen is not lit and is in an extinguished state. The unlit state of the bright screen means that the display is lit, but the unlocked interface is displayed on the display. In this state, the electronic device is not unlocked and cannot enter the main page of the electronic device. The unlocked state of the bright screen means that the display is lit and the corresponding interface is displayed according to the specific operation. In this state, the electronic device has been unlocked, and the user can use the electronic device normally.

Specifically, when the electronic device is in the state of the interest screen, the user may use the electronic device at any time, so in order to quickly respond to the user's operation, some sensors on the electronic device are still in operation to monitor the electronic device. Use case to determine if there is a screen wake-up operation. For example, touch sensors, gravity sensors, distance sensors, and the like. The screen wake-up operation includes one or more of picking up the electronic device, touching the display of the electronic device, the object is close to the front preset range of the device, and pressing the function button of the electronic device. It can be understood that the screen wake-up operation of the electronic device can be flexibly set according to the needs of the user.

Taking the touch sensor 108 provided on the electronic device as an example, in the embodiment of the present invention, when the electronic device is in the interest screen state, the touch sensor 108 of the control electronic device performs touch detection, and touch action on the display screen 106 (for example, a normal touch) Operation, pressing operation, sliding operation) to detect and respond. When the electronic device is in the interest screen state, the touch sensor 108 will perform touch detection at the first scanning frequency (lower power consumption state). When it is detected that the object touches the display screen, it is determined that face recognition is required. When the electronic device is in the bright un unlocked state or the bright-screen unlocked state, the touch sensor 108 performs touch detection at the second scanning frequency (higher power consumption state or normal power consumption state), thereby reducing the electronic device state of the screen. Power consumption. Wherein the first scanning frequency is less than the second scanning frequency. Of course, the touch sensor 108 can also be touch-detected in a normal power consumption state at all times.

When the electronic device is in a bright, ununlocked state, the user may use the electronic device at any time in this case, thus determining that face recognition is required.

When the electronic device is in the bright-screen unlocked state, it is further determined whether there is currently an authentication request initiated by the application to the operating system, for example, the payment application initiates an authentication request for mobile payment. If there is an authentication request, it is determined that face recognition is required, otherwise the electronic device performs normal operations.

In the description of the present specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiment", "example", "specific example", or "some examples", etc. The specific features, structures, materials or characteristics described in the embodiments or examples are included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms does not necessarily mean the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples.

Although the embodiments of the present invention have been shown and described, it is understood that the above-described embodiments are illustrative and are not to be construed as limiting the scope of the invention. The embodiments are subject to changes, modifications, substitutions and variations.

Claims

A facial recognition method for an electronic device includes the following steps:

S1, when the electronic device needs to perform facial recognition, determine whether the current ambient light intensity is less than or equal to a preset threshold;

S2, when the current ambient light intensity is less than or equal to a preset threshold, the control electronic device performs front fill light;

S3, controlling an image sensor on the front side of the electronic device to collect a facial image of an object in front of the electronic device;

S4: Match the collected facial image with a preset facial image template to determine whether the identity of the object in front is legal.
The facial recognition method according to claim 1, wherein the step S1 further comprises: performing step S3 when the current ambient light intensity is greater than a preset threshold.
The face recognition method according to claim 1, wherein the fill light in the step S2 is performed simultaneously with the collection of the face image in the step S3.
The facial recognition method according to claim 1, wherein in the step S2: when the current ambient light intensity is less than or equal to a preset threshold, the light-filling device on the front of the electronic device is turned on to perform front fill light. .
The face recognition method according to claim 4, wherein one or more of brightness, color temperature and color of the light-filling device are further adjusted when the light-filling device on the front side of the control electronic device is turned on.
The face recognition method according to claim 4, wherein the light filling means on the front side of the electronic device comprises a fill light source disposed at a top end of the front surface of the electronic device.
The facial recognition method according to claim 1, wherein in the step S2, when the current ambient light intensity is less than or equal to a preset threshold, the display screen of the electronic device is adjusted to the maximum brightness to perform front fill light. .
The facial recognition method according to claim 7, wherein in the step S2, if the sum of the current ambient light intensity and the maximum brightness of the display screen is still less than or equal to a preset threshold, the front end of the electronic device is controlled. The fill light source is turned on to cause the fill light source to perform front fill light together with the display screen.
The facial recognition method according to any one of claims 1 to 8, wherein the step S1 further comprises: determining a current working state of the electronic device; determining whether a face is required according to a current working state of the electronic device Identification.
The facial recognition method according to claim 9, wherein the current working state of the electronic device comprises a state of the screen, a bright screen unlocked state, and a bright screen unlocked state; and according to the current working state of the electronic device, Determining if facial recognition is required includes:

Determining whether there is a screen wake-up operation when the electronic device is in the interest screen state; determining that face recognition is required when determining that there is a screen wake-up operation;

Determining that facial recognition is required when the electronic device is in a bright, ununlocked state;

When the electronic device is in the unlocked state of the bright screen, it is determined whether there is an application-initiated authentication request currently, and if there is an authentication request, it is determined that facial recognition is required.
The facial recognition method according to claim 10, wherein the screen wake-up operation comprises: picking up the electronic device, touching the display screen of the electronic device, approaching the front surface of the electronic device, and pressing the function button of the electronic device. One or several.
An electronic device includes an image sensor, a fill light device, an ambient light sensor, and a processor; the processor is configured to: determine whether the current ambient light intensity collected by the ambient light sensor is when the electronic device needs to perform face recognition And less than or equal to a preset threshold; when the current ambient light intensity is less than or equal to a preset threshold, controlling the fill light device to perform front fill light; controlling the image sensor to collect a face image of an object in front of the electronic device; The facial image is matched with a preset facial image template to determine whether the identity of the object in front is legal.
The electronic device according to claim 12, wherein the processor is further configured to directly control the image sensor to collect a facial image of an object in front of the electronic device when the current ambient light intensity is greater than a preset threshold.
The electronic device of claim 12 wherein said image sensor is located at a front end of said electronic device.
The electronic device of claim 12 wherein said fill light means comprises a fill light source located at a top end of the electronic device.
The electronic device of claim 15 wherein said fill light source is a flexible light.
The electronic device according to claim 15, wherein the processor is further configured to: when the current ambient light intensity is less than or equal to a preset threshold, control the fill light source to be turned on to perform front fill light.
The electronic device according to claim 17, wherein one or more parameters of brightness, color temperature and color of the fill light source are further adjusted when the fill light source is controlled to be turned on.
The electronic device according to claim 1, wherein said light filling means comprises a display screen located on the front side of the electronic device, and said display screen is further used for displaying a picture; said processor is further for: when the current environment When the light intensity is less than or equal to the preset threshold, the display screen is adjusted to the maximum brightness to perform front fill light.
The electronic device according to claim 19, wherein when the light-filling device further comprises a fill light source located at a top end of the electronic device, the processor is further configured to: if the current ambient light intensity and the maximum display screen If the sum of the brightness is still less than or equal to the preset threshold, then the fill light source is controlled to be turned on.
The electronic device according to any one of claims 12 to 20, wherein the processor is further configured to: determine a current working state of the electronic device, and determine whether face recognition is required according to a current working state of the electronic device. .
The electronic device according to claim 21, wherein the current working state of the electronic device comprises a state of the screen, a bright screen unlocked state, and a bright screen unlocked state; and the processor is further configured to:

When the electronic device is in the state of the interest screen, it is determined whether there is a screen wake-up operation; when it is determined that there is a screen wake-up operation, it is determined that face recognition is required;

Determining that facial recognition is required when the electronic device is in a bright, ununlocked state;

When the electronic device is in the unlocked state of the bright screen, it is determined whether there is an application-initiated authentication request currently, and if there is an authentication request, it is determined that facial recognition is required.
The electronic device according to claim 22, wherein the screen wake-up operation comprises: picking up the electronic device, touching the display screen of the electronic device, approaching the front preset range of the electronic device, and pressing one of the function buttons of the electronic device Kind or several.