WO2018121428A1

WO2018121428A1 - Living body detection method, apparatus, and storage medium

Info

Publication number: WO2018121428A1
Application number: PCT/CN2017/117958
Authority: WO
Inventors: 刘尧; 汪铖杰; 李季檩; 梁亦聪
Original assignee: 腾讯科技（深圳）有限公司
Priority date: 2016-12-30
Filing date: 2017-12-22
Publication date: 2018-07-05
Also published as: CN107992794A; WO2019080797A1; CN107992794B

Abstract

A living body detection method and an apparatus, comprising: when detection of a living body is required, a detection subject may be monitored; then determining whether or not a reflected optical signal is present in a pre-set position of the detection subject in an image sequence obtained by means of monitoring, and whether or not said reflected optical signal matches a pre-set optical signal sample; if present and matching, determining the detection subject as a living body.

Description

Living body detecting method, device and storage medium

The present application claims priority to Chinese Patent Application No. 201611257052.2, the entire disclosure of which is incorporated herein in .

Technical field

The present invention relates to the field of communications technologies, and in particular, to a living body detecting method, apparatus, and storage medium.

background

In recent years, identity verification technologies such as fingerprint recognition, eye pattern recognition, iris recognition, and face recognition have been greatly developed. Among them, face recognition technology is the most prominent, and it has been more and more widely applied to various identity authentication systems.

The identity authentication system based on face recognition mainly needs to solve two problems, one is face verification and the other is living body detection. Among them, the living body detection is mainly used to confirm that the collected face image and the like are from the user himself, rather than playing back or forging materials. Aiming at the current methods of detecting live objects, such as photo attacks, video playback attacks, synthetic face attacks, etc., a "randomized interaction" technique is proposed. The so-called "randomized interaction" technology refers to the movement of different parts of the face in the video. The change is cut in, and the random interactions that require the user's active cooperation, such as blinking, shaking, or lip recognition, etc., are used to judge whether the detected object is a living body or the like.

Technical content

An embodiment of the present invention provides a living body detecting method, including:

Receiving a living body detection request;

Monitoring the detected object to obtain an image sequence;

Determining whether the reflected light signal matches a preset optical signal sample when determining that there is a reflected light signal in the preset portion of the detection object in the image sequence;

When the reflected light signal matches the preset light signal sample, it is determined that the detection object is a living body.

Correspondingly, the embodiment of the invention further provides a living body detecting device, comprising:

One or more memories; one or more processors; wherein the one or more memories store one or more instruction modules, configured by Executing one or more processors to execute; wherein the one or more instruction modules include:

a receiving unit, configured to receive a living body detection request;

a monitoring unit, configured to monitor the detection object to obtain an image sequence;

a detecting unit, configured to determine whether the reflected light signal matches a preset optical signal sample when determining that the preset portion of the detection object has a reflected light signal in the image sequence; and when the reflected light signal and the When the optical signal samples are matched, it is determined that the detection object is a living body.

The present application also proposes a non-transitory computer readable storage medium storing computer readable instructions that cause at least one processor to perform the methods described above.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. Other drawings can also be obtained from those skilled in the art based on these drawings without paying any creative effort.

FIG. 1 is a schematic diagram of a scene of a living body detecting method according to an embodiment of the present invention;

FIG. 1b is another schematic diagram of a living body detecting method according to an embodiment of the present invention;

FIG. 1c is a flowchart of a living body detecting method according to an embodiment of the present invention;

2 is another flowchart of a living body detecting method according to an embodiment of the present invention;

FIG. 3 is a schematic structural diagram of a living body detecting apparatus according to an embodiment of the present invention; FIG.

FIG. 3b is another schematic structural diagram of a living body detecting apparatus according to an embodiment of the present invention; FIG.

FIG. 4 is a schematic structural diagram of a terminal according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by a person skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

In the research and practice of the prior art, the algorithm used in the existing scheme for living body detection has a low accuracy, and it cannot effectively resist synthetic face attacks. In addition, the cumbersome active interaction will also The pass rate of the correct sample is greatly reduced, so overall, the in vivo detection of the existing scheme is not good, which greatly affects the accuracy and security of the authentication.

In view of this, embodiments of the present invention provide a living body detecting method and apparatus.

The living body detecting device may be specifically integrated in a device such as a terminal, and may use the screen light intensity and color change of the terminal, or use other components or devices such as a flash or an infrared emitter as a light source to project onto the detection object, and then, The living body detection is performed by analyzing a preset portion of the detected object in the received image sequence, such as a reflected light signal of the face.

For example, in the case where the terminal is integrated in the terminal and the light source is a color mask, when the terminal receives the living body detection request, the detection interface can be started according to the living body detection request, wherein, as shown in FIG. 1a, the detection interface is In addition to the detection area, a non-detection area (the gray part marked in Fig. 1a) is also provided, which is mainly used for flashing a color mask, which can be used as a light source to project light to the detection object, for example, see 1b. Since the reflected light signal of the real living body and the forged living body (the carrier of the composite picture or video, such as a photo, a mobile phone or a tablet computer) is different, it is possible to determine whether or not the projected light is present in the preset portion of the detection object. And generating a reflected light signal, and the reflected light signal is matched with the preset light signal sample to determine the living body, for example, the detection object can be monitored (the monitoring situation can be performed by using the detection area in the detection interface) Displaying, and then determining whether the preset portion of the detected object in the monitored image sequence has a reflected light signal generated by the projected light, and whether the reflected light signal matches the preset optical signal sample, if present and preset If the optical signal samples match, it is determined that the detection object is a living body, otherwise, if it does not exist or does not match the preset optical signal sample, it is determined that the detection object is not a living body, and the like.

The details are described below separately. It should be noted that the serial numbers of the following embodiments are not intended to limit the preferred order of the embodiments.

Embodiment 1

The present embodiment will be described from the perspective of a living body detecting device (hereinafter referred to as a living body detecting device), which may be integrated into a device such as a terminal, which may be a mobile phone, a tablet computer, a notebook computer or a personal computer ( PC, Personal Computer) and other devices.

A living body detecting method includes: receiving a living body detecting request, and starting a light source according to the living body detecting request, wherein the light source is used for projecting light to the detecting object, and monitoring the detecting object to obtain an image sequence, when determining the image sequence The preset part of the detection object has a reflected light signal generated by the projected light, and when the reflected light signal matches the preset light signal sample, the detected object is determined to be a living body.

As shown in FIG. 1c, the specific process of the living body detection method can be as follows:

101. Receive a living body detection request.

For example, the biometric detection request triggered by the user may be received, or the biometric detection request sent by another device may be received, and the like.

In the embodiment of the present application, after receiving the living body detection request, according to the activity The body detection request activates a light source for projecting light to the detection object.

For example, the corresponding living body detection process may be invoked according to the living body detection request, the light source is activated according to the living body detection process, and the like.

The light source can be set according to the needs of the actual application, for example, by adjusting the brightness of the terminal screen, or by using other light-emitting components such as a flash or an infrared emitter or an external device, or The method is implemented by setting a color mask on the display interface, and the like, that is, the step of “starting the light source according to the living body detection request” may be implemented by any one of the following methods:

(1) Adjusting the brightness of the screen according to the living body detection request, so that the screen as a light source projects light to the detection object.

(2) The predetermined light-emitting component is turned on according to the living body detection request, so that the light-emitting component emits light as a light source to the detection object.

Wherein, the light emitting part may comprise a component such as a flash lamp or an infrared emitter.

(3) Starting a detection interface according to the living body detection request, the detection interface may flash a color mask, and the color mask is used as a light source to project light to the detection object.

The area of the flashing color mask may be determined according to the requirements of the actual application. For example, the detecting interface may include a detecting area and a non-detecting area, and the detecting area is mainly used for displaying a monitoring situation, and the non-detecting area may be used. In the flash color mask, the color mask is used as a light source to project light to the detection object, and so on.

The color mask and other parameters of the color mask can be set according to the requirements of the actual application. The color mask can be preset by the system and directly retrieved when the detection interface is started, or can be received at the same time. After the biometric detection request is automatically generated, that is, after the step of receiving the biometric detection request, the biometric detection method may further include:

A color mask is generated such that the light projected by the color mask can be changed according to a preset rule.

Optionally, in order to facilitate the subsequent recognition of the change of the light, the intensity of the change of the light can also be maximized.

The preset rule may be determined according to the needs of the actual application, and the manner of maximizing the intensity of the change of the light may also be various. For example, for the same color of light, the brightness of the screen before and after the change may be maximized. The intensity of the change of light, for example, the brightness of the screen before and after the change is set to the maximum and minimum, and for the light of different colors, the intensity of the change of the light can be maximized by adjusting the color difference before and after the change, and so on.

Optionally, in order to better detect the reflected light signal from the image frame difference, in addition to maximizing the intensity of the change of the light, the color selection may be selected to be the most robust to signal analysis. The color space, for example, in the color model (LAB) color space, the screen changes from the brightest red to the brightest green, the chromaticity of the reflected light changes the most, and so on.

102. Monitor the detected object to obtain an image sequence.

For example, the camera of the terminal can be specifically called, the detection object is photographed in real time, an image sequence is obtained, and the captured image sequence is displayed in the detection area, and the like.

Optionally, in order to reduce the influence of the numerical floating on the signal caused by the noise, after the image sequence is obtained, the image sequence may also be subjected to denoising processing. For example, taking the noise model as the Gaussian noise as an example, the timing multi-frame averaging and/or the same-frame multi-scale averaging can be used to reduce the noise as much as possible, and details are not described herein again.

103. Determine whether the reflected optical signal matches a preset optical signal sample when it is determined that the reflected portion of the detected object in the image sequence has a reflected light signal.

104. When the reflected optical signal matches the preset optical signal sample, determining that the detected object is a living body.

In addition, in the above step, if it is determined that the reflected portion of the detected object in the image sequence does not have a reflected light signal or the reflected light signal does not match the preset optical signal sample, the detected object may be determined to be inactive.

In an embodiment of the present application, the reflected signal may be generated by a light source that is projected by the light source to the detection object. The light source may be activated according to the living body detection request after receiving the living body detection request, or may be initiated in other cases. It should be noted that the present application does not limit the manner and timing of starting the light source, and it is only necessary to project light to the predetermined portion of the detection target when monitoring the detection target.

The method for determining whether there is a reflected light signal in the preset part of the image sequence in the image sequence may be various. For example, the reflected light information may be detected by using the inter-frame difference of the image. For example, the specific information may be as follows:

(1) Calculate the difference between frames in the image sequence.

The difference between the frames may be an interframe difference or a frame difference, where the interframe difference refers to a difference between two adjacent frames, and the frame difference is between frames corresponding to before and after the change of the projected light. difference.

For example, in the calculation of the inter-frame difference, the pixel coordinates of the adjacent frames in the image sequence may be respectively acquired when determining that the position change degree of the detection object is less than the preset change value, and then the inter-frame difference is calculated based on the pixel coordinates.

For example, taking the frame difference as an example, when determining that the position change degree of the detection object is less than the preset change value, the pixel coordinates of the frame corresponding to the frame before and after the change of the projected light are respectively obtained from the image sequence, and the frame is calculated based on the pixel coordinates. difference.

The method for calculating the inter-frame difference or the frame difference based on the pixel coordinates may be various, for example, as follows:

Transforming pixel coordinates of adjacent frames to minimize the registration error of the pixel coordinates, and filtering out pixel points whose correlation meets the preset condition according to the transformation result, according to the screening The pixel points calculate the interframe difference.

Alternatively, the pixel coordinates of the frame corresponding to the change of the projected light are transformed to minimize the registration error of the pixel coordinate, and the pixel corresponding to the preset condition is selected according to the transformation result, and the pixel is calculated according to the selected pixel point. Frame difference.

The preset change value and the preset condition may be set according to actual application requirements, and details are not described herein again.

It should be noted that, if it is determined that the position change degree of the detection object is greater than or equal to the preset change value, other adjacent frames or other frames corresponding to the change of the projected light may be acquired from the image sequence to perform calculation, or the image sequence may be reacquired. .

(2) determining, according to the difference between the frames (such as the interframe difference or the frame difference), whether the preset part of the detection object in the image sequence has a reflected light signal generated by the projected light. For example, any one of the following may be used. Ways:

The first way:

Determining whether a difference between the frames (such as an interframe difference or a frame difference) is greater than a preset threshold, and if so, determining that a reflected light signal generated by the projected light exists in a preset portion of the detected object in the image sequence, and if not, Then, it is determined that the reflected portion of the detected object in the image sequence does not have a reflected light signal generated by the projected light.

The preset threshold may be determined according to the requirements of the actual application, and details are not described herein again.

The second way:

The difference (such as inter-frame difference or frame difference) is classified and analyzed by a preset global feature algorithm or a classifier, and if the analysis result indicates that the inter-frame variation of the preset portion of the detection object is greater than a set value, determining the image sequence The reflected light signal generated by the projected light is present in the preset portion of the detection object. If the analysis result indicates that the inter-frame change of the preset portion of the detection object is not greater than the set value, it is determined that the preset portion of the detected object in the image sequence is not There is a reflected light signal generated by the projected light.

The setting value may be determined according to the requirements of the actual application, and the manner of “classifying and analyzing the inter-frame difference by using a preset global feature algorithm or a classifier” may also be various, for example, as follows:

The difference (such as the interframe difference or the frame difference) is analyzed to determine whether the reflected light signal generated by the projected light exists in the image sequence, and if the reflected light signal generated by the projected light does not exist, the indication detection is generated. The inter-frame change of the preset part of the object is not greater than the analysis result of the set value; if there is a reflected light signal generated by the projected light, whether the reflector of the reflected light information existing is determined by a preset global feature algorithm or a classifier If the preset part is the preset part, the analysis result indicating that the inter-frame change of the preset part of the detection target is greater than the set value is generated, and if it is not the preset part, generating the indication object The interframe change of the preset part is not greater than the analysis result of the set value.

Alternatively, the preset global feature algorithm or classifier can be used in the sequence of images. The image is classified to filter out the frame in which the preset portion exists, and the candidate frame is obtained, and the inter-frame difference of the candidate frame is analyzed to determine whether the reflected light signal generated by the projected light exists in the preset portion. Generating a reflected light signal generated by the light to generate an analysis result indicating that the inter-frame change of the preset portion of the detection target is not greater than a set value; and if there is a reflected light signal generated by the projected light, generating a pre-detection target Let the interframe change of the part be larger than the analysis result of the set value, and so on.

The global feature algorithm refers to an algorithm based on global features, wherein the global features may include mean variance of gray scale, gray level co-occurrence matrix, fast Fourier transform (FFT, Fast Fourier Transformation) and discrete cosine transform (DCT, Discrete) Cosine transform) The transformed spectrum. The classifier can include a Support Vector Machine (SVM), a neural network, a decision tree, and the like.

Optionally, the method for determining whether the reflected optical signal matches the preset optical signal sample may also be multiple. For example, any one of the following methods may be adopted:

Analyzing whether the parameter in the reflected light signal matches the parameter in the preset optical signal sample, and if yes, determining that the reflected light signal matches the preset optical signal sample, and if not, determining the reflected light signal and the preset optical signal sample Mismatch.

For example, it may be specifically determined whether a difference between a parameter value in the reflected optical signal and a parameter value in the preset optical signal sample is less than a preset difference range, and if less than the preset difference range, indicating a parameter value in the reflected optical signal The parameter values in the preset optical signal samples match, and if greater than the preset difference range, it indicates that the parameter values in the reflected optical signal do not match the parameter values in the preset optical signal samples, and the like.

Alternatively, it is also possible to determine whether the reflected light signal matches the preset optical signal sample by analyzing whether the shape of the reflected light signal on the image matches the shape presented on the preset light signal sample image, for example, if the reflected light The similarity between the shape of the signal presented on the image and the shape presented on the image of the preset optical signal sample is greater than the set value, and then the reflected light signal is determined to match the preset optical signal sample; otherwise, if the reflected light signal is on the image The similarity between the rendered shape and the shape presented on the preset optical signal sample image is less than or equal to the set value, then it is determined that the reflected optical signal does not match the preset optical signal sample, and so on.

The preset optical signal sample, the preset difference range, and the set value may be set according to actual application requirements. For example, if a human body part needs to be tested in vivo, the projected light may be irradiated on the person's face. The commonality of the emitted light signals generated after the above is taken as the preset optical signal sample, and the error range that may be generated by the corresponding parameters may be set accordingly as the preset difference range, or may be set accordingly. The corresponding shape (such as the face of a person generally has the facial features of the person, and the general appearance and position of the facial features, etc.) the set value of the similarity, and so on, and will not be described again here.

As can be seen from the above, in the embodiment, when the living body detection is required, the light source can be started to project light to the detection object, and the detection object is monitored, and then the monitored image is determined. Whether the reflected light signal generated by the projected light exists in the preset portion of the detected object in the sequence, and whether the reflected light signal matches the preset optical signal sample, and if present and matched, determining that the detected object is a living body; The solution does not require complicated interaction and operation with the user, and therefore, the requirement for hardware configuration can be greatly reduced. Moreover, since the scheme is based on detecting the reflected light signal of the preset part of the object, the real living body and forgery are The reflected light signal of the living body (the carrier of the composite picture or video, such as photos, mobile phones or tablets) is different. Therefore, the scheme can also effectively resist the synthetic face attack and improve the accuracy of the discrimination; therefore, in short, This solution can improve the detection of living organisms, thereby improving the accuracy and security of authentication.

Embodiment 2

The method described in the first embodiment will be further described in detail below by way of example.

In this embodiment, the living body detecting device is specifically integrated in the terminal, and the light source is specifically a color mask, and the preset portion of the detecting object is specifically a human face as an example.

As shown in FIG. 2, a living body detection method can be as follows:

201. The terminal receives a living body detection request.

For example, in the case of the user triggering, when the user activates the living body detecting function, for example, clicking the start button of the living body detection, the living body detecting request may be triggered to be generated, so that the terminal receives the living body detecting request.

202. The terminal generates a color mask, so that the light projected by the color mask can be changed according to a preset rule.

The preset rule may be determined according to the needs of the actual application, and the manner of maximizing the intensity of the change of the light may also be various. For example, for the same color of light, the brightness of the screen before and after the change may be maximized. The intensity of the light changes, for example, the brightness of the screen before and after the change is set to the maximum and minimum, and for the light of different colors, the intensity of the change of the light can be maximized by adjusting the color difference before and after the change, such as changing the screen from the darkest of black. The brightest white, and so on.

Optionally, in order to better detect the reflected light signal from the image frame difference, in addition to maximizing the intensity of the change of the light, the color selection may be selected to be the most robust to signal analysis. The color space, for example, in the color model (LAB) color space, the screen changes from red to brightest, green to brightest, its reflected light has the largest change in chromaticity, and so on.

203. The terminal starts the detection interface according to the living body detection request, and passes the detection boundary. The non-detection area in the face flashes a color mask such that the color mask acts as a light source to project light onto a subject, such as a person's face.

For example, the corresponding living body detection process may be invoked according to the living body detection request, the corresponding detection interface is started according to the living body detection process, and the like.

The detection interface may include a detection area and a non-detection area. The detection area is mainly used to display the acquired image sequence, and the non-detection area may be used to flash a color mask, and the color mask is used as a light source to detect the object. To project the light, you can participate in Figure 1b. In this way, the reflected light will be generated by the light on the object to be detected, and the reflected light will be different depending on the color and intensity of the light.

It should be noted that, in order to ensure that the light emitted by the color mask can be projected to the detection object, the detection object needs to be kept within a certain distance from the screen of the mobile device, for example, when the user needs to detect whether a certain face is a living body. You can take the mobile device to the right place directly in front of the face to monitor the face, and so on.

204. The terminal monitors the detection object to obtain a sequence of images.

For example, the camera of the terminal may be specifically called to capture the detected object in real time to obtain a sequence of images, and the captured image sequence is displayed in the detection area.

205. The terminal calculates an interframe difference in the sequence of images.

Wherein, using the inter-frame difference to detect the reflected light signal requires that the two-dimensional pixel points between the images in the image sequence can be as one-to-one correspondence as possible. Therefore, the inter-frame alignment method can be used to more precisely correct the pixel pair of the inter-frame difference in the case where the user's face is detected without a sharp position change. That is, when determining that the position change degree of the detection object is less than the preset change value, respectively acquiring the pixel coordinates of the adjacent frame in the image sequence, and then transforming the pixel coordinates to minimize the registration error of the pixel coordinate, and then The interframe difference is calculated based on the result of the transform, for example, as follows:

Let the pixel of the same point on the object in the two adjacent frames I and I' be p=[x,y,w] ^T and p ₀ =[x ₀ ,y ₀ ,w ₀ ] ^T , where w is Qi The secondary coordinate term solves the 3*3 transformation matrix M as follows:

[x',y',w']=Mp ₀

Here, the transformation type of the transformation matrix M employed is the homography transformation with the highest degree of freedom, so that the registration error can be minimized.

In the method of optimizing the solution M, the more common methods are the Mean Square Error (MSE) estimation and the Random Sample Consensus (RANSAC, Random Sample Consensus). Alternatively, in order to obtain more robust results, a homography flow can also be used.

Since even if the optimal transformation matrix M can be solved, there may be pixels that cannot be matched between frames. Therefore, it is possible to filter out the pixels with strong correlation and ignore the pixels with weak correlation, and then, based on the screening. The pixel points are calculated for inter-frame difference, so that the amount of calculation can be reduced on the one hand, and the result can be enhanced on the other hand. Alternatively, the step "calculate the inter-frame difference based on the transformation result" can include:

According to the transformation result, the pixel points whose correlation is in accordance with the preset condition are filtered, and the inter-frame difference is calculated according to the selected pixel points.

It should be noted that if it is determined that the position change degree of the detection object is greater than or equal to the preset change value, other adjacent frames may be acquired from the image sequence to perform calculation, or the image sequence may be re-acquired, and then calculated.

206. The terminal determines, according to the interframe difference, whether a reflected light signal generated by the projected light is present in a face of the image in the image sequence. If yes, step 207 is performed. If not, the terminal determines that the detected object is inactive.

For example, the terminal may determine whether the interframe difference is greater than a preset threshold, and if yes, determine a reflected light signal generated by the projected light in a face of the image sequence, and if not, determine a face of the person in the image sequence There is a reflected light signal generated by the projected light.

Optionally, in order to improve the accuracy of the detection and reduce the calculation amount of the detection, the cascading discriminant model may also be used for processing. For example, the global feature algorithm or the classifier may be used to preprocess the interframe difference to The occurrence of the reflected light signal is roughly determined so that the subsequent processing of most of the normal frames without the reflected light signal can be skipped, that is, only the frame in which the reflected light signal exists is processed later. That is, the step "the terminal determines whether the reflected light signal generated by the projected light is present in the face of the image in the image sequence according to the interframe difference" may include:

The inter-frame difference is classified and analyzed by a preset global feature algorithm or a classifier. If the analysis result indicates that the inter-frame variation of the person's face is greater than the set value, determining that the projected surface ray is generated by the person's face in the image sequence The reflected light signal, if the analysis result indicates that the inter-frame change of the person's face is not greater than the set value, determining that the reflected light signal generated by the projected light is not present in the face of the person in the image sequence.

Wherein, the set value may be determined according to the needs of the actual application, and the “by default” The global feature algorithm or the classifier can classify and analyze the inter-frame difference. There are also various ways, for example, the following:

The inter-frame difference is analyzed to determine whether there is a reflected light signal generated by the projected light in the image sequence. If there is no reflected light signal generated by the projected light, an inter-frame change indicating the face of the person is generated. An analysis result larger than the set value; if there is a reflected light signal generated by the projected light, the preset global feature algorithm or the classifier determines whether the reflector of the reflected light information exists as a human face, and if it is a human face, An analysis result indicating that the inter-frame change of the face of the person is greater than the set value is generated, and if it is not the face of the person, an analysis result indicating that the inter-frame change of the face of the person is not greater than the set value is generated.

Alternatively, the image in the image sequence may be classified by a preset global feature algorithm or a classifier to filter out a frame of the face of the person, obtain a candidate frame, and analyze an interframe difference of the candidate frame to determine the person. Whether there is a reflected light signal generated by the projected light on the face, and if there is no reflected light signal generated by the projected light, an analysis result indicating that the inter-frame change of the face of the person is not greater than a set value is generated; if the projection exists The reflected light signal generated by the light generates an analysis result indicating that the inter-frame variation of the person's face is greater than the set value, and the like.

The global feature algorithm refers to an algorithm based on global features, wherein the global features may include a mean variance of gray scales, a gray level co-occurrence matrix, a transformed spectrum such as FFT and DCT.

The classifier can be set according to the requirements of the actual application. For example, if it is only used to determine whether there is a reflected light signal, a simpler classifier can be used, and if it is used to determine whether it is a person's face or the like, it can be used. More complex classifiers, such as neural network classifiers, are used for processing and will not be described here.

It should be noted that, besides calculating the inter-frame difference to analyze whether the face of the person in the image sequence has the reflected light signal generated by the projected light, it is also possible to calculate the frame difference before and after the change of the projected light (ie, not necessarily The two adjacent frames are used to analyze whether there is a reflected light signal generated by the projected light in the face of the person in the image sequence. For details, refer to the first embodiment, and details are not described herein again.

207. The terminal determines whether the reflected optical signal matches the preset optical signal sample. If the terminal matches, determining whether the detected object is a living body, and if not, determining that the detected object is a non-living body.

For example, the terminal may analyze whether the parameter in the reflected optical signal matches the parameter in the preset optical signal sample, and if yes, determine that the reflected optical signal matches the preset optical signal sample, and if not, determine the reflected optical signal and the pre-determined Let the optical signal samples not match. For example, it may be specifically determined whether a difference between a parameter value in the reflected optical signal and a parameter value in the preset optical signal sample is less than a preset difference range, and if less than the preset difference range, indicating a parameter value in the reflected optical signal The parameter values in the preset optical signal samples are matched. If the value is greater than the preset difference range, it indicates that the parameter values in the reflected optical signal do not match the parameter values in the preset optical signal samples. and many more.

For another example, the terminal may also determine whether the reflected optical signal matches the preset optical signal sample by analyzing whether the shape of the reflected light signal on the image matches the shape presented on the preset optical signal sample image, for example, if The similarity between the shape of the reflected light signal on the image and the shape presented on the image of the preset light signal sample is greater than a set value, and then the reflected light signal is determined to match the preset light signal sample; otherwise, if the reflected light signal is If the similarity between the shape presented on the image and the shape presented on the preset light signal sample image is less than or equal to the set value, it is determined that the reflected light signal does not match the preset optical signal sample, and so on.

The preset optical signal sample, the preset difference range, and the set value may be set according to actual application requirements, and details are not described herein again.

Optionally, in order to further improve the accuracy of the detection, some interactive operations may also be appropriately added, for example, the user performs an action such as blinking or opening the mouth, that is, in the step “determining the presence of the projected light in the face of the image in the image sequence. After the generated reflected light signal", it may also include:

Generating prompt information indicating that the detection object (such as a person's face) performs a preset action, displaying the prompt information, and monitoring the detected object, and if the detected object performs the preset action, determining that the detected object is a living body Otherwise, if it is monitored that the detection object does not perform the preset action, it is determined that the detection object is not a living body.

The preset action can be set according to the requirements of the actual application. It should be noted that, in order to avoid cumbersome interaction, the number and difficulty of the preset action may be limited, for example, only one simple operation is needed. The interaction, such as blinking or opening the mouth, can not be repeated here.

As can be seen from the above, in this embodiment, a non-detection area can be disposed on the detection interface for flashing a color mask, wherein the color mask can be used as a light source to project light to a detection object, such as a person's face, so that when needed When the living body is detected, the face of the person can be monitored, and then the reflected light signal generated by the projected light is present in the face of the monitored image sequence, and the reflected light signal matches the preset light signal sample. If it exists and matches, it is determined that the person's face is a living body; since the solution does not need to perform cumbersome interaction operations and operations with the user, the requirement for hardware configuration can be greatly reduced, and the basis for the living body discrimination is determined by the solution. It is a reflected light signal of the preset part of the detection object, and the real living body is different from the reflected light signal of the forged living body (a carrier of a composite picture or video, such as a photo, a mobile phone or a tablet computer), so the solution can also Effectively resist synthetic face attacks and improve the accuracy of the judgment; therefore, in summary, the program Under limited to the hardware configuration of the terminal, to improve the detection effect in vivo, thereby improving authentication accuracy and safety.

Embodiment 3

In order to better implement the above method, an embodiment of the present invention further provides a living body detecting device, which is referred to as a living body detecting device. As shown in FIG. 3a, the living body detecting device includes one or more memories; one or more processors; The one or more memories are stored with one or more instruction modules configured to be executed by the one or more processors; wherein the one or more instruction modules include: a receiving unit 301, a monitoring unit 303, and Detection unit 304. In an embodiment of the present application, the one or more instruction modules may further include a startup unit 302. The specific functions of each unit are described as follows:

(1) receiving unit 301;

The receiving unit 301 is configured to receive a living body detection request.

For example, the receiving unit 301 may be specifically configured to receive a biometric detection request triggered by a user, or may also receive a biometric detection request sent by another device, and the like.

(2) starting unit 302;

The starting unit 302 is configured to start a light source according to the living body detection request, and the light source is used to project light to the detection object.

For example, the initiating unit 302 may be specifically configured to invoke a corresponding living body detection process according to the living body detection request, activate a light source according to the living body detection process, and the like.

The light source can be set according to the needs of the actual application, for example, by adjusting the brightness of the terminal screen, or by using other light-emitting components such as a flash or an infrared emitter or an external device, or By setting a color mask on the display interface, etc., the startup unit 302 can specifically perform any of the following operations:

(1) The activation unit 302 is specifically configured to adjust the brightness of the screen according to the living body detection request, so that the screen as a light source projects light to the detection object.

(2) The activation unit 302 is specifically configured to turn on the preset light-emitting component according to the living body detection request, so that the light-emitting component emits light as a light source to the detection object.

(3) The activation unit 302 is specifically configured to start a detection interface according to the living body detection request, and the detection interface may flash a color mask, and the color mask is used as a light source to project light to the detection object.

The color mask and other parameters of the color mask can be set according to the requirements of the actual application. The color mask can be preset by the system and directly retrieved when the detection interface is started, or can be received at the same time. Automatically generated after the live detection request, That is, as shown in FIG. 3b, the living body detecting device may further include a generating unit 305 as follows:

The generating unit 305 can be configured to generate a color mask such that the light projected by the color mask can be changed according to a preset rule.

Optionally, in order to facilitate the subsequent recognition of the change of the light, the generating unit 305 can also be used to maximize the intensity of the change of the light.

The preset rule may be determined according to the needs of the actual application, and the manner of maximizing the intensity of the change of the light may also be various, for example, as follows:

The generating unit 305 can be specifically configured to maximize the intensity of the change of the light by adjusting the brightness of the screen before and after the change for the light of the same color. For the light of different colors, the intensity of the change of the light is maximized by adjusting the color difference before and after the change.

Optionally, in order to better detect the reflected light signal from the image frame difference, in addition to maximizing the intensity of the change of the light, the color selection may be selected to be the most robust to signal analysis. For details, refer to the previous embodiment, and details are not described herein again.

(3) monitoring unit 303;

The monitoring unit 303 is configured to monitor the detection object to obtain a sequence of images.

For example, the monitoring unit 303 can be specifically used to call the camera of the terminal, capture the detected object in real time, obtain an image sequence, and display the captured image sequence in the detection area.

Optionally, in order to reduce the influence of the value floating on the signal caused by the noise, after the image sequence is obtained, the monitoring unit 303 may perform the denoising processing on the image sequence. For details, refer to the previous embodiment, and details are not described herein again.

(4) detecting unit 304;

The detecting unit 304 is configured to determine, when the reflected light signal exists in the preset part of the detection object in the image sequence, determine whether the reflected light signal matches the preset light signal sample; and when the reflected light signal matches the preset light signal sample, It is determined that the detection object is a living body.

The detecting unit 304 is further configured to determine, when the reflected portion of the detected object in the image sequence does not have the reflected light signal generated by the projected light, or the reflected light signal does not match the preset optical signal sample, determine the detected object. It is not a living body.

For example, the detecting unit 304 may include a calculating subunit, a determining subunit, and a determining subunit, as follows:

A calculation subunit that can be used to calculate the difference between frames in the sequence of images.

For example, the calculating subunit may be specifically configured to obtain pixel coordinates of adjacent frames in the image sequence when the degree of change of the position of the detecting object is less than a preset change value. Calculating the inter-frame difference on the pixel coordinates; for example, the pixel coordinates may be transformed to minimize the registration error of the pixel coordinates, and then, according to the transformation result, the pixel points whose correlation meets the preset condition are filtered, and according to the screening The resulting pixels calculate the interframe difference, and so on.

For example, the calculating sub-unit may be specifically configured to determine, when the degree of change of the position of the detecting object is less than a preset change value, respectively obtain pixel coordinates of the frame corresponding to the change of the projected light from the image sequence, and calculate the pixel coordinate based on the pixel coordinate Frame difference; for example, the pixel coordinates may be transformed to minimize the registration error of the pixel coordinates, and then, according to the transformation result, the pixel points whose correlation is in accordance with the preset condition are filtered, and the frame is calculated according to the selected pixel point. Poor, and so on.

The preset change value and the preset condition may be set according to actual application requirements.

The determining subunit may be configured to determine, according to the difference, whether the preset portion of the detection object in the image sequence has a reflected light signal generated by the projected light, and whether the reflected optical signal matches the preset optical signal sample.

The determining subunit may be configured to determine that the detected object is a living body when the determining subunit determines that the reflected light signal generated by the projected light is present, and the reflected optical signal matches the preset optical signal sample.

The determining subunit may be further configured to determine that the detected object is inactive when the determining subunit determines that the reflected light signal generated by the projected light does not exist, or the reflected optical signal does not match the preset optical signal sample.

The method for determining whether there is a reflected light signal generated by the projected light in the preset portion of the image sequence in the image sequence may be different according to the difference between the frames. For example, any one of the following methods may be adopted:

The first way:

The determining subunit may be specifically configured to determine whether the difference between the frames is greater than a preset threshold, and if yes, determining that the reflected light signal generated by the projected light exists in the preset part of the detected object in the image sequence; Determining that the preset portion of the detected object in the image sequence does not have a reflected light signal generated by the projected light.

The second way:

The determining sub-unit may be specifically configured to perform classification analysis on the difference between the frames by using a preset global feature algorithm or a classifier, and if the analysis result indicates that the inter-frame variation of the preset part of the detection object is greater than a set value, determining The preset part of the detection object in the image sequence has a reflected light signal generated by the projected light; if the analysis result indicates that the inter-frame change of the preset part of the detection object is not greater than a set value, determining the detected object in the image sequence The reflected light signal generated by the projected light does not exist in the preset portion.

Wherein, the set value may be determined according to the needs of the actual application, and the manner of “classifying and analyzing the inter-frame difference by using a preset global feature algorithm or a classifier” may also be Kind, for example, can be as follows:

The determining subunit may be specifically configured to analyze the difference between the frames to determine whether the reflected light signal generated by the projected light exists in the image sequence, and if there is no reflected light signal generated by the projected light, And generating an analysis result indicating that the inter-frame change of the preset part of the detection object is not greater than a set value; if there is a reflected light signal generated by the projected light, determining the reflected light information existing by using a preset global feature algorithm or a classifier Whether the reflector is a preset part of the detection object, and if it is the preset part, generating an analysis result indicating that the inter-frame change of the preset part of the detection object is greater than a set value, if not the preset part, generating An analysis result indicating that the inter-frame change of the preset portion of the detection object is not greater than the set value.

Alternatively, the determining subunit may be specifically configured to classify the image in the image sequence by using a preset global feature algorithm or a classifier to filter out a frame in which the preset part exists, obtain a candidate frame, and analyze the candidate frame. Inter-frame difference, to determine whether the preset part has a reflected light signal generated by the projected light, and if there is no reflected light signal generated by the projected light, generating an inter-frame change indicating that the preset part of the detection object is not greater than The analysis result of the set value; if there is a reflected light signal generated by the projected light, an analysis result indicating that the inter-frame change of the preset portion of the detection target is greater than the set value is generated.

The determining subunit may be configured to analyze whether the parameter in the reflected optical signal matches the parameter in the preset optical signal sample, and if yes, determine that the reflected optical signal matches the preset optical signal sample, and if not, determine the reflection The optical signal does not match the preset optical signal sample. For example, it may be specifically determined whether a difference between a parameter value in the reflected optical signal and a parameter value in the preset optical signal sample is less than a preset difference range, and if less than the preset difference range, indicating a parameter value in the reflected optical signal The parameter values in the preset optical signal samples match, and if greater than the preset difference range, it indicates that the parameter values in the reflected optical signal do not match the parameter values in the preset optical signal samples, and the like.

Alternatively, the determining subunit may be specifically configured to determine whether the reflected optical signal matches the preset optical signal sample by analyzing whether the shape of the reflected light signal on the image matches the shape presented on the preset optical signal sample image. For example, if the similarity between the shape of the reflected light signal on the image and the shape presented on the preset light signal sample image is greater than the set value, it is determined that the reflected light signal matches the preset light signal sample, otherwise, if Determining the reflected light signal and the preset light signal when the similarity between the shape of the reflected light signal on the image and the shape presented on the preset light signal sample image is less than or equal to the set value Samples do not match, and so on.

In the specific implementation, the foregoing units may be implemented as a separate entity, or may be implemented in any combination, and may be implemented as the same or a plurality of entities. For the specific implementation of the foregoing, refer to the foregoing method embodiments, and details are not described herein.

The device can be integrated into a device such as a terminal, and the terminal can be a device such as a mobile phone, a tablet computer, a notebook computer, or a PC.

As can be seen from the above, when the living body detection device of the present embodiment needs to perform the living body detection, the activation unit 302 can activate the light source to project the light to the detection object, and monitor the 303 through the detection area in the detection interface to monitor the detection object. And determining, by the detecting unit 304, whether the preset portion of the detected object in the monitored image sequence has a reflected light signal generated by the projected light, and whether the reflected light matches the preset optical signal sample, if present and matched, It is determined that the detection object is a living body; since the solution does not need to perform cumbersome interaction operations and operations with the user, the requirement for hardware configuration can be greatly reduced, and the basis for the living body discrimination is to detect the reflection of the preset part of the object. Optical signals, but the real living body and the fake living body (composite picture or video carrier, such as photos, mobile phones or tablets, etc.) have different reflected light signals. Therefore, the solution can effectively resist synthetic face attacks and improve The accuracy of the discrimination; therefore, in summary, the program can improve the living body Test results, to improve the accuracy of authentication and security.

Embodiment 4

Correspondingly, the embodiment of the present invention further provides a terminal. As shown in FIG. 4, the terminal may include a radio frequency (RF) circuit 401, a memory 402 including one or more computer readable storage media, and an input unit. 403. The display unit 404, the sensor 405, the audio circuit 406, the Wireless Fidelity (WiFi) module 407, the processor 408 including one or more processing cores, and the power source 409 and the like. It will be understood by those skilled in the art that the terminal structure shown in FIG. 4 does not constitute a limitation to the terminal, and may include more or less components than those illustrated, or a combination of certain components, or different component arrangements. among them:

The RF circuit 401 can be used for transmitting and receiving information or during a call, and receiving and transmitting signals. Specifically, after receiving downlink information of the base station, the downlink information is processed by one or more processors 408. In addition, the data related to the uplink is sent to the base station. . Generally, the RF circuit 401 includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, and a low noise amplifier (LNA, Low Noise Amplifier), duplexer, etc. In addition, the RF circuit 401 can also communicate with the network and other devices through wireless communication. The wireless communication can use any communication standard or protocol, including but not limited to a global mobile communication system (GSM, Global System of Mobile communication), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA) , Long Term Evolution (LTE), e-mail, Short Messaging Service (SMS), etc.

The memory 402 can be used to store software programs and modules, and the processor 408 executes various functional applications and data processing by running software programs and modules stored in the memory 402. The memory 402 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to Data created by the use of the terminal (such as audio data, phone book, etc.). Moreover, memory 402 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, memory 402 may also include a memory controller to provide access to memory 402 by processor 408 and input unit 403.

Input unit 403 can be used to receive input numeric or character information, as well as to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls. In particular, in one particular embodiment, input unit 403 can include a touch-sensitive surface as well as other input devices. Touch-sensitive surfaces, also known as touch screens or trackpads, collect touch operations on or near the user (such as the user using a finger, stylus, etc., any suitable object or accessory on a touch-sensitive surface or touch-sensitive Operation near the surface), and drive the corresponding connecting device according to a preset program. Alternatively, the touch sensitive surface may include two parts of a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information. The processor 408 is provided and can receive commands from the processor 408 and execute them. In addition, touch-sensitive surfaces can be implemented in a variety of types, including resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch-sensitive surface, the input unit 403 can also include other input devices. Specifically, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.

Display unit 404 can be used to display information entered by the user or information provided to the user, as well as various graphical user interfaces of the terminal, which can be composed of graphics, text, icons, video, and any combination thereof. The display unit 404 can include a display panel. Alternatively, the display panel can be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, the touch sensitive surface can cover the display panel when the touch sensitive surface is detected in it Upon or near a touch operation, the processor 408 is passed to determine the type of touch event, and the processor 408 then provides a corresponding visual output on the display panel based on the type of touch event. Although in FIG. 4, the touch-sensitive surface and display panel are implemented as two separate components to perform input and input functions, in some embodiments, the touch-sensitive surface can be integrated with the display panel to implement input and output functions.

The terminal may also include at least one type of sensor 405, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel according to the brightness of the ambient light, and the proximity sensor may close the display panel and/or the backlight when the terminal moves to the ear. . As a kind of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the terminal can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, no longer Narration.

The audio circuit 406, the speaker, and the microphone provide an audio interface between the user and the terminal. The audio circuit 406 can transmit the converted electrical signal of the audio data to the speaker, and convert it into a sound signal output by the speaker; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 406 and then converted. The audio data is then processed by the audio data output processor 408, sent via RF circuitry 401 to, for example, another terminal, or the audio data is output to memory 402 for further processing. The audio circuit 406 may also include an earbud jack to provide communication between the peripheral earphone and the terminal.

WiFi is a short-range wireless transmission technology, and the terminal can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 407, which provides wireless broadband Internet access for users. Although FIG. 4 shows the WiFi module 407, it can be understood that it does not belong to the necessary configuration of the terminal, and can be omitted as needed within the scope of not changing the essence of the invention.

Processor 408 is the control center of the terminal, which connects various portions of the entire handset using various interfaces and lines, by executing or executing software programs and/or modules stored in memory 402, and by invoking data stored in memory 402, The various functions of the terminal and processing data to monitor the mobile phone as a whole. Optionally, the processor 408 may include one or more processing cores; preferably, the processor 408 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application, and the like. The modem processor primarily handles wireless communications. It will be appreciated that the above described modem processor may also not be integrated into the processor 408.

The terminal also includes a power source 409 (such as a battery) that supplies power to the various components. Preferably, the power source can be logically coupled to the processor 408 through the power management system for power management. The system manages functions such as charging, discharging, and power management. The power supply 409 may also include any one or more of a DC or AC power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.

Although not shown, the terminal may further include a camera, a Bluetooth module, and the like, and details are not described herein again. In particular, in the present embodiment, the memory 402 described above will store one or more programs and be configured to be executed by one or more processors 408. The one or more programs described above may include the following instruction modules:

The starting unit 302 is configured to start a light source according to the living body detection request, and the light source is used to project light to the detection object;

The monitoring unit 303 is configured to monitor the detection object to obtain an image sequence;

The detecting unit 304 is configured to determine, when the reflected light signal generated by the projected light is present in the preset portion of the detection object in the image sequence, and the reflected light signal matches the preset optical signal sample, The test object is a living body.

The processor 408 in the terminal loads the executable file corresponding to the process of one or more applications into the memory 402 according to the following instruction, and the processor 408 runs the application stored in the memory 402, thereby Achieve a variety of functions:

Receiving a living body detection request, starting a light source according to the living body detection request, wherein the light source is used for projecting light to the detection object, and the object is monitored to obtain a sequence of images, and when the predetermined portion of the detection object in the image sequence is determined to have the projected light When the generated reflected light signal matches the preset optical signal sample, the detected object is determined to be a living body.

The method for determining whether the preset portion of the detection object in the image sequence has the reflected light signal generated by the projected light, and determining whether the reflected light signal matches the preset optical signal sample may be various. For details, refer to the foregoing. The embodiment is not described here.

The light source may be implemented in various manners, for example, by adjusting the brightness of the screen of the terminal, or by using other light-emitting components such as a flash or an infrared emitter or an external device, or By setting a color mask on the display interface, etc., that is, the application in the memory 402 can also implement the following functions:

The screen brightness is adjusted according to the living body detection request such that the screen as a light source projects light to the detection object.

Alternatively, the preset light-emitting component is turned on according to the living body detection request, so that the light-emitting component emits light as a light source to the detection object. Wherein, the light emitting part may comprise a component such as a flash lamp or an infrared emitter.

Alternatively, the detection interface is activated according to the living body detection request, and the detection interface may flash a color mask, and the color mask is used as a light source to project light to the detection object.

In addition, it should be noted that the color mask and other parameters of the color mask can be set according to the requirements of the actual application, and the color mask can be preset by the system and directly retrieved when the detection interface is started, or It can also be automatically generated after receiving the biometric detection request, that is, the application stored in the memory 402, and can also implement the following functions:

A color mask is generated such that the light projected by the color mask can be changed according to a preset rule and the intensity of the change of the light is maximized.

There are a plurality of ways to maximize the intensity of the change of the light. For details, refer to the previous embodiment, and details are not described herein again.

Optionally, in order to better detect the reflected light signal from the image frame difference, in addition to maximizing the intensity of the change of the light, the color selection may be selected to be the most robust to signal analysis. Color space.

Optionally, in order to reduce the influence of the numerical floating on the signal caused by the noise, after the image sequence is obtained, the image sequence may also be subjected to denoising processing, that is, the application stored in the memory 402 may also implement the following functions. :

The image sequence is subjected to denoising processing.

For example, taking the noise model as Gaussian noise as an example, it is possible to use timing multi-frame averaging and/or co-frame multi-scale averaging to reduce noise as much as possible, and the like.

For the specific implementation of the foregoing operations, refer to the foregoing embodiments, and details are not described herein again.

As can be seen from the above, when the terminal needs to perform the living body detection, the terminal can start the light source to project the light to the detection object, monitor the detection object, and then determine whether the preset part of the detection object exists in the monitored image sequence. Projecting a reflected light signal generated by the light, and whether the reflected light signal matches the preset optical signal sample, and if present and matched, determining that the detected object is a living body; since the solution does not require complicated interaction and operation with the user, Therefore, the requirement for the hardware configuration can be greatly reduced, and the basis for the living body discrimination is to detect the reflected light signal of the preset part of the object, and the real living body and the forged living body (the composite picture or video carrier, such as a photo) The reflected light signal of the mobile phone or tablet computer is different. Therefore, the solution can also effectively resist the synthetic face attack and improve the accuracy of the discrimination; therefore, in short, the solution can be limited in the terminal, especially the mobile terminal. Improve the detection of living body under hardware configuration, thus improving the identification The accuracy and security.

A person of ordinary skill in the art can understand that all or part of the steps of the foregoing embodiments can be completed by a program to instruct related hardware, and the program can be saved. The storage medium may include a read only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and the like.

Therefore, an embodiment of the present invention further provides a storage medium in which a data processing program is stored, and the data processing program is used to execute any one of the foregoing methods of the embodiments of the present invention.

The method and device for detecting a living body provided by the embodiments of the present invention are described in detail. The principles and embodiments of the present invention are described in the following. The description of the above embodiments is only for helping to understand the present invention. The method and its core idea; at the same time, those skilled in the art, according to the idea of the present invention, there will be changes in the specific embodiments and application scope. In summary, the content of this specification should not be construed as Limitations of the invention.

Claims

A living body detection method includes:

Receiving a living body detection request;

Monitoring the detected object to obtain an image sequence;

Determining whether the reflected light signal matches a preset optical signal sample when determining that there is a reflected light signal in the preset portion of the detection object in the image sequence;

When the reflected light signal matches the preset light signal sample, it is determined that the detection object is a living body.
The method of claim 1 further comprising:

When it is determined that the preset portion of the detection object in the image sequence does not have a reflected light signal or the reflected light signal does not match the preset optical signal sample, it is determined that the detection object is not a living body.
The method according to claim 1 or 2, wherein the reflected signal is generated by light rays projected by the light source to the detection object.
The method of claim 3, further comprising: activating the light source in accordance with the living body detection request.
The method of claim 4, wherein the actuating the light source according to the living body detection request comprises:

Initiating a detection interface according to the living body detection request, the detection interface includes a non-detection area, the non-detection area is used to flash a color mask, and the color mask is used as a light source to project light to the detection object; or

Adjusting a screen brightness according to the living body detection request, so that the screen as a light source projects light to the detection object; or

The preset light-emitting component is turned on according to the living body detection request, so that the light-emitting component emits light as a light source to the detection object.
The method according to claim 5, wherein after receiving the living body detection request, the method further comprises:

Generating a color mask such that the light projected by the color mask can be changed according to a preset rule;

Maximize the intensity of the change in the light.
The method of claim 6 wherein said maximizing said intensity of change of said light comprises:

For the same color of light, maximize the intensity of light changes by adjusting the brightness of the screen before and after the change;

For different colors of light, maximize the intensity of the light by adjusting the color difference before and after the change.
The method according to any one of claims 1 to 7, wherein determining whether the preset portion of the detection object in the image sequence has the reflected light signal comprises:

Calculating a difference between frames in the image sequence, where a difference between the frames is an interframe difference or a frame difference, where the frame difference is a difference between frames corresponding to before and after the change of the projected light;

Determining, according to the difference, whether a preset portion of the detection object in the image sequence has a reflected light signal generated by the projected light.
The method according to claim 8, wherein the determining, according to the difference, whether the preset portion of the detection object in the image sequence has a reflected light signal generated by the projected light, comprises:

Determining whether the difference is greater than a preset threshold;

If yes, determining that the preset portion of the detection object in the image sequence has a reflected light signal generated by the projected light;

If not, it is determined that the reflected portion of the detected object in the image sequence does not have a reflected light signal generated by the projected light.
The method according to claim 8, wherein the determining, according to the difference, whether the preset portion of the detection object in the image sequence has a reflected light signal generated by the projected light, comprises:

Performing classification analysis on the difference by a preset global feature algorithm or a classifier;

If the analysis result indicates that the inter-frame change of the preset portion of the detection object is greater than the set value, determining that the preset portion of the detection object in the image sequence has a reflected light signal generated by the projected light;

If the analysis result indicates that the inter-frame change of the preset portion of the detection object is not greater than the set value, determining that the preset portion of the detection object in the image sequence does not have the reflected light signal generated by the projected light.
The method according to claim 10, wherein the classifying and analyzing the difference by using a preset global feature algorithm or a classifier comprises:

And analyzing the difference to determine whether the reflected light signal generated by the projected light is present in the image sequence;

If there is no reflected light signal generated by the projected light, generating an analysis result indicating that an inter-frame change of the preset portion of the detection target is not greater than a set value;

If the reflected light signal generated by the projected light is present, determining whether the reflector of the reflected light information existing is a preset part of the detection object by using a preset global feature algorithm or a classifier, if the preset part is And generating an analysis result indicating that the inter-frame change of the preset part of the detection object is greater than a set value, and if not the preset part, generating an inter-frame change indicating that the preset part of the detection object is not greater than The analysis result of the fixed value.
The method according to claim 10, wherein the classifying and analyzing the difference by using a preset global feature algorithm or a classifier comprises:

Sorting the image in the image sequence by using a preset global feature algorithm or a classifier to filter out a frame in which the preset portion exists to obtain a candidate frame;

And analyzing an interframe difference of the candidate frame to determine whether the preset part has a reflected light signal generated by the projected light;

If there is no reflected light signal generated by the projected light, generating an analysis result indicating that an inter-frame change of the preset portion of the detection target is not greater than a set value;

If there is a reflected light signal generated by the projected light, an analysis result indicating that an inter-frame change of the preset portion of the detection target is greater than a set value is generated.
The method of claim 8 wherein said calculating a difference between frames in said sequence of images comprises:

When it is determined that the degree of change of the position of the detection object is less than a preset change value, respectively acquiring pixel coordinates of adjacent frames in the image sequence, and calculating an inter-frame difference based on pixel coordinates; or

When it is determined that the degree of change of the position of the detection object is less than a preset change value, pixel coordinates of frames corresponding to before and after the change of the projected light are respectively acquired from the image sequence, and the frame difference is calculated based on the pixel coordinates.
The method of claim 13 wherein calculating the interframe difference or frame difference based on the pixel coordinates comprises:

Transforming pixel coordinates to minimize registration errors of the pixel coordinates;

Filtering pixels corresponding to the preset conditions according to the transformation result;

The interframe difference or frame difference is calculated based on the selected pixel points.
The method according to any one of claims 1 to 14, wherein after the monitoring the object to be monitored to obtain a sequence of images, the method further comprises:

The image sequence is subjected to denoising processing.
A living body detecting method is performed by a terminal, and the method includes:

Receiving a living body detection request;

Monitoring the detected object to obtain an image sequence;

Determining whether the reflected light signal matches a preset optical signal sample when determining that there is a reflected light signal in the preset portion of the detection object in the image sequence;

When the reflected light signal matches the preset light signal sample, it is determined that the detection object is a living body.
The method of claim 16 further comprising:

Determining that the detection object is inactive when determining that the reflected portion of the detection object in the image sequence does not have the reflected light signal or the reflected light signal does not match the preset optical signal sample.
The method according to claim 16 or 17, wherein the reflected signal is generated by light rays projected by the light source to the detection object.
The method of claim 18, further comprising: activating the light source in accordance with the living body detection request.
The method of claim 19, wherein the actuating the light source according to the living body detection request comprises:

Initiating a detection interface according to the living body detection request, the detection interface includes a non-detection area, the non-detection area is used to flash a color mask, and the color mask is used as a light source to project light to the detection object; or

Adjusting a screen brightness according to the living body detection request, so that the screen as a light source projects light to the detection object; or

The preset light-emitting component is turned on according to the living body detection request, so that the light-emitting component emits light as a light source to the detection object.
The method according to claim 20, wherein after receiving the living body detection request, the method further comprises:

Generating a color mask such that the light projected by the color mask can be changed according to a preset rule;

Maximize the intensity of the change in the light.
The method of claim 21 wherein said maximizing the intensity of change of said light comprises:

For the same color of light, maximize the intensity of light changes by adjusting the brightness of the screen before and after the change;

For different colors of light, maximize the intensity of the light by adjusting the color difference before and after the change.
The method according to any one of claims 16 to 22, wherein determining whether a preset portion of the detection object in the image sequence has a reflected light signal comprises:

Calculating a difference between frames in the image sequence, where a difference between the frames is an interframe difference or a frame difference, where the frame difference is a difference between frames corresponding to before and after the change of the projected light;

Determining, according to the difference, whether a preset portion of the detection object in the image sequence has a reflected light signal generated by the projected light.
The method according to claim 23, wherein the determining, according to the difference, whether a preset portion of the detection object in the image sequence has a reflected light signal generated by the projected light, comprises:

Determining whether the difference is greater than a preset threshold;

If yes, determining that the preset portion of the detection object in the image sequence has a reflected light signal generated by the projected light;

If not, it is determined that the reflected portion of the detected object in the image sequence does not have a reflected light signal generated by the projected light.
The method of claim 23, wherein said determining is based on said difference Determining, by the preset portion of the detection object in the image sequence, whether there is a reflected light signal generated by the projected light, comprising:

Performing classification analysis on the difference by a preset global feature algorithm or a classifier;

If the analysis result indicates that the inter-frame change of the preset portion of the detection object is greater than the set value, determining that the preset portion of the detection object in the image sequence has a reflected light signal generated by the projected light;

If the analysis result indicates that the inter-frame change of the preset portion of the detection object is not greater than the set value, determining that the preset portion of the detection object in the image sequence does not have the reflected light signal generated by the projected light.
The method according to claim 25, wherein said classifying said difference by said preset global feature algorithm or classifier comprises:

And analyzing the difference to determine whether the reflected light signal generated by the projected light is present in the image sequence;

If there is no reflected light signal generated by the projected light, generating an analysis result indicating that an inter-frame change of the preset portion of the detection target is not greater than a set value;

If the reflected light signal generated by the projected light is present, determining whether the reflector of the reflected light information existing is a preset part of the detection object by using a preset global feature algorithm or a classifier, if the preset part is And generating an analysis result indicating that the inter-frame change of the preset part of the detection object is greater than a set value, and if not the preset part, generating an inter-frame change indicating that the preset part of the detection object is not greater than The analysis result of the fixed value.
The method according to claim 25, wherein said classifying said difference by said preset global feature algorithm or classifier comprises:

Sorting the image in the image sequence by using a preset global feature algorithm or a classifier to filter out a frame in which the preset portion exists to obtain a candidate frame;

And analyzing an interframe difference of the candidate frame to determine whether the preset part has a reflected light signal generated by the projected light;

If there is no reflected light signal generated by the projected light, generating an analysis result indicating that an inter-frame change of the preset portion of the detection target is not greater than a set value;

If there is a reflected light signal generated by the projected light, an analysis result indicating that an inter-frame change of the preset portion of the detection target is greater than a set value is generated.
The method of claim 23 wherein said calculating a difference between frames in said sequence of images comprises:

When it is determined that the degree of change of the position of the detection object is less than a preset change value, respectively acquiring pixel coordinates of adjacent frames in the image sequence, and calculating an inter-frame difference based on pixel coordinates; or

When it is determined that the degree of change of the position of the detection object is less than a preset change value, pixel coordinates of frames corresponding to before and after the change of the projected light are respectively acquired from the image sequence, and the frame difference is calculated based on the pixel coordinates.
The method of claim 28, wherein calculating an interframe difference or a frame difference based on pixel coordinates comprises:

Transforming pixel coordinates to minimize registration errors of the pixel coordinates;

Filtering pixels corresponding to the preset conditions according to the transformation result;

The interframe difference or frame difference is calculated based on the selected pixel points.
The method according to any one of claims 16 to 29, wherein after monitoring the detected object to obtain a sequence of images, the method further comprises:

The image sequence is subjected to denoising processing.
A living body detecting device includes:

One or more memories;

One or more processors; among them,

The one or more memories storing one or more instruction modules configured to be executed by the one or more processors; wherein

The one or more instruction modules include:

a receiving unit, configured to receive a living body detection request;

a monitoring unit, configured to monitor the detection object to obtain an image sequence;

a detecting unit, configured to determine whether the reflected light signal matches a preset optical signal sample when determining that the preset portion of the detection object has a reflected light signal in the image sequence; and when the reflected light signal and the When the optical signal samples are matched, it is determined that the detection object is a living body.
The device according to claim 31, wherein

The detecting unit is further configured to: when it is determined that the preset portion of the detection object does not have a reflected light signal, or the reflected light signal does not match the preset optical signal sample, determine that the detection object is non- Living body.
The apparatus of claim 31 or 32, wherein the one or more instruction modules further comprise:

The activation unit starts a light source according to the living body detection request, and the light source is used to project light to the detection object.
The device according to claim 33, wherein

The activation unit is specifically configured to start a detection interface according to the living body detection request, the detection interface includes a non-detection area, the non-detection area is used to flash a color mask, and the color mask is used as a light source to detect The object casts light; or,

The activation unit is configured to adjust a screen brightness according to the living body detection request, so that the screen is used as a light source to project light to the detection object; or

The activation unit is configured to turn on a preset light-emitting component according to the living body detection request, so that the light-emitting component emits light as a light source to the detection object.
The apparatus according to claim 34, further comprising a generating unit;

The generating unit is configured to generate a color mask, so that the light projected by the color mask can be changed according to a preset rule to maximize the intensity of the change of the light.
The device according to claim 35, wherein the generating unit is specifically configured to:

For the same color of light, maximize the intensity of light changes by adjusting the brightness of the screen before and after the change;

For different colors of light, maximize the intensity of the light by adjusting the color difference before and after the change.
The apparatus according to any one of claims 31 to 36, wherein the detecting unit comprises a calculating subunit, a judging subunit, and a determining subunit;

The calculating subunit is configured to calculate a difference between frames in the image sequence, where a difference between the frames is an interframe difference or a frame difference, where the frame difference is between frames corresponding to before and after the change of the projected light Poor

The determining subunit is configured to determine, according to the difference, whether a preset part of the detection object in the image sequence has a reflected light signal generated by the projected light;

The determining subunit is configured to determine, when the determining subunit determines the reflected light signal generated by the projected light, and the reflected light signal matches the preset optical signal sample, determining that the detecting object is a living body.
The device according to claim 37, wherein

The calculating subunit, specifically for determining that the degree of change of the position of the detection object is less than a preset change value, respectively acquiring pixel coordinates of adjacent frames in the image sequence, and calculating an interframe difference based on pixel coordinates; or

The calculating subunit, specifically for determining that the degree of change of the position of the detecting object is less than a preset change value, respectively acquiring pixel coordinates of a frame corresponding to the frame before and after the change of the projected light from the image sequence, and calculating the frame based on the pixel coordinates difference.
A non-transitory computer readable storage medium storing computer readable instructions for causing at least one processor to perform the method of any of claims 1-30.