WO2020055657A1

WO2020055657A1 - Liveness detection method, apparatus and computer-readable storage medium

Info

Publication number: WO2020055657A1
Application number: PCT/US2019/049686
Authority: WO
Inventors: Jingting DING; Liang Li
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2018-09-10
Filing date: 2019-09-05
Publication date: 2020-03-19
Anticipated expiration: 2021-03-10
Also published as: CN113408403A; TWI701605B; SG11202011085XA; US20200082192A1; CN109376592B; TW202011260A; US11093773B2; US20200167582A1; CN109376592A; US11210541B2

Abstract

A liveness detection method, a liveness detection apparatus, and a computer-readable storage medium are provided. The liveness detection method includes: controlling a display screen to display a color according to a predetermined color display sequence, the color display sequence including at least two different colors; capturing an image of a target object in the color display process; acquiring a color change sequence of a face of the target object in the image over time; and determining whether the target object is live based on a matching relationship between the color display sequence and the color change sequence.

Description

LIVENESS DETECTION METHOD, APPARATUS AND COMPUTER-READABLE

STORAGE MEDIUM

Cross-Reference to Related Applications

[0001] This application is based upon and claims priority to Chinese Patent

Application No. 201811051838.8, filed on September 10, 2018, the entire content of all of which is incorporated herein by reference.

Technical Field

[0002] Embodiments of the present specification relate to the field of computers, and in particular, to a liveness detection method, a liveness detection apparatus and a computer-readable storage medium.

Technical Background

[0003] Currently, more and more users like to use mobile phones and other terminals to complete electronic payment. A terminal such as a mobile phone generally authenticates the identity of a user before making an electronic payment.

[0004] One conventional method of identity authentication is face recognition. In the process of face recognition, there are often some lawbreakers who attempt to use representations of users (for example, photos or videos of users) to impersonate users themselves for identity authentication. In such case, how to determine that the detected object is live is a technical problem to be solved.

Summary of the Invention

[0005] The embodiments of the present specification provide a liveness detection method, a liveness detection apparatus, and a computer-readable storage medium to determine whether a detected object is live.

[0006] In a first aspect, a liveness detection method is provided, including: controlling a display screen to display a color according to a predetermined color display sequence, the color display sequence including at least two different colors; capturing an image of a target object in the color display process; acquiring a color change sequence of a face of the target object in the image over time; and determining whether the target object is live based on a matching relationship between the color display sequence and the color change sequence.

[0007] In a second aspect, a liveness detection apparatus is provided, including a control module, a capturing module, an acquiring module and a determining module; wherein: the control module is configured to control a display screen to display a color according to a predetermined color display sequence, the color display sequence including at least two different colors; the capturing module is configured to capture an image of a target obj ect in the color display process; the acquiring module is configured to acquire a color change sequence of a face of the target object in the image over time; and the determining module is configured to determine whether the target object is live based on a matching relationship between the color display sequence and the color change sequence.

[0008] In a third aspect, an electronic device is provided, including: a processor; and a memory arranged to store computer executable instructions that, when being executed, cause the processor to perform the following operations: controlling a display screen to display a color according to a predetermined color display sequence, the color display sequence including at least two different colors; capturing an image of a target obj ect in the color display process; acquiring a color change sequence of a face of the target obj ect in the image over time; and determining whether the target object is live based on a matching relationship between the color display sequence and the color change sequence. [0009] In a fourth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores one or more programs, and the one or more programs, when being executed, perform the following operations: controlling a display screen to display a color according to a predetermined color display sequence, the color display sequence including at least two different colors; capturing an image of a target object in the color display process; acquiring a color change sequence of a face of the target object in the image over time; and determining whether the target object is live based on a matching relationship between the color display sequence and the color change sequence.

[0010] At least one technical solution adopted by the embodiments of the present specification can achieve the following beneficial effects.

[0011] A display screen is controlled to display colors according to a color display sequence, a color change sequence of the face of a target object in a captured image is acquired, and whether the target object is live is determined based on a matching relationship between the color display sequence and the color change sequence. If the target object is not live, since the face of a target object in an image captured for a non-live object may not reflect the color change, the color display sequence may not match (for example, inconsistent with) the color change sequence in the case of a non-live object. Therefore, the liveness detection method provided by the embodiments of the present specification can determine whether the detected object is live. In addition, in the liveness detection process, a user or a detected object can perform the liveness authentication in a natural manner without the user actively cooperating (for example, the user makes actions such as a nod, a blink, etc. to cooperate with the liveness detection), and thus, the liveness detection method not only can reliably detect liveness, but also can greatly reduce the operational burden of the user. Moreover, the liveness detection method does not depend on a particular terminal, and even if the image capturing device is tampered with, the liveness detection can still be performed, thereby improving the reliability of liveness detection. Brief Description of the Drawings

[0012] FIG. 1 is a flow chart of a liveness detection method provided by an embodiment of the present specification;

[0013] FIG. 2 is a flow chart of another liveness detection method provided by an embodiment of the present specification;

[0014] FIG. 3 is a schematic structural diagram of an electronic device provided by an embodiment of the present specification; and

[0015] FIG. 4 is a structural block diagram of a liveness detection apparatus provided by an embodiment of the present specification.

Detailed Description

[0016] Embodiments of the present application provide a liveness detection method, a liveness detection apparatus, and a computer-readable storage medium.

[0017] In order to enable those skilled in the art to better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to accompanying drawings in the embodiments of the present application. Apparently, the described embodiments are only a part of embodiments of the present application, and not all the embodiments. All other embodiments obtained by those ordinary skilled in the art based on the embodiments of the present application without creative effort shall fall within the protection scope of the present application.

[0018] The liveness detection method provided by the embodiments of the present specification can detect whether the target object is live, and greatly reduce the operational burden of the user. The liveness detection method provided by the embodiments of the present specification can be widely applied to various identity authentication scenarios for liveness detection, such as a money borrowing scenario, a medical treatment scenario (such as paying after medical treatment), and a ride scenario (such as a deposit-free ride), and the like.

[0019] The liveness detection method provided by the embodiments of the present specification can be performed by a single electronic device, which may have a camera and a display screen. Examples of the electronic device are, for example, a mobile phone, a tablet computer, a palmtop computer, a desktop computer, and the like.

[0020] The technical solutions provided by the embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0021] FIG. 1 is a flowchart of a liveness detection method provided by an embodiment of the present specification. Referring to FIG. 1, the liveness detection method provided by an embodiment of the present specification can include:

[0022] step 110, controlling a display screen to display a color according to a predetermined color display sequence, the color display sequence including at least two different colors.

[0023] In the embodiments of the present specification, the colors included in the color display sequence can be various colors. For example, the colors included in the color display sequence can be red, white, blue, and black, and for another example, the colors included in the color display sequence can be black, yellow, red, white, etc.

[0024] In the embodiments of the present specification, the controlling a display screen to display a color according to a predetermined color display sequence in step 110 can include: controlling the display screen to sequentially display a single color according to the predetermined color display sequence. Since single color display can simplify color display control and facilitate subsequent image analysis and color recognition, the display screen can be controlled to sequentially display a single color in the embodiments of the specification. Of course, in the embodiments of the present specification, the display screen can also be controlled to display two or more colors simultaneously. If the colors included in the color display sequence are red, white, blue, and black, and taking displaying two colors simultaneously as an example, the display screen can be controlled to display in an order of red-white, white-blue, and blue-black.

[0025] In the following description, it is to be understood that reference to single color display is merely illustrative and is not intended to be limiting.

[0026] In the embodiments of the present specification, the display screen can sequentially display a single color according to the order of colors indicated by the color display sequence. For example, if the colors included in the color display sequence are red, white, blue, and black, the display screen will sequentially display four colors of red, white, blue, and black.

[0027] In the embodiments of the present specification, step 110 can be performed under a certain trigger condition. The triggering condition can be, for example, that a target obj ect is located within a viewfinder interface of the camera and a distance between the target object and the display screen is small. For example, the distance is less than a threshold, hereinafter referred to as a first threshold. The first threshold can be set as desired. For example, the first threshold is 30 cm, 40 cm, and the like.

[0028] In the embodiments of the present specification, the target object is an object to be subjected to liveness detection, such as a person, a photo of a person, a video of a person, or the like. After start of the liveness detection, the camera of the terminal can be turned on to capture an image of the target object. If an image of the target object is not captured, a prompt can be displayed on the display screen, for example,“please approach the terminal for image capturing,” and a sound can be played through a speaker. If an image of the target object is captured, it can be further determined whether the distance between the target object and the display screen is less than the first threshold (e.g., 30 cm). If the distance between the target object and the display screen is not less than the first threshold, then a prompt can be displayed on the display screen, for example, “please come closer to the terminal for detection,” and a sound can be played through a speaker. If the distance between the target object and the display screen is less than the first threshold, step

110 can be performed to control the display screen to display a color according to the predetermined color display sequence, such that light emitted by the display screen irradiates the face of the target object. In the embodiments of the present specification, before controlling the display screen to display colors, it is first determined whether the distance between the target obj ect and the display screen is less than the first threshold. Thus, when the distance between the target object and the display screen is relatively large, the display screen can be controlled not to display the colors for the moment since the light emitted by the display screen will probably not irradiate the face of the target object, so as to avoid invalid display of the display screen. When the distance between the target obj ect and the display screen is relatively small, by controlling the display screen to display a color according to the predetermined color display sequence, it can be ensured that the light emitted from the display screen irradiates the face of the target object, thereby facilitating subsequent capturing of an image of the target object, and ensuring that the color display of the display screen is more targeted and effective.

[0029] In an embodiment of the present specification, the controlling the display screen to sequentially display a single color according to the predetermined color display sequence can specifically include: acquiring a predetermined color display sequence; acquiring a brightness corresponding to each color in the color display sequence; and controlling the display screen to sequentially display a single color, at a brightness corresponding to the color, in the color display sequence and in an order of colors indicated by the color display sequence. Those skilled in the art will recognize that when the display screen simultaneously displays a plurality of colors according to a color display sequence, the steps described above can also be performed for each of the plurality of colors.

[0030] In the embodiments of the present specification, the electronic device can have a communication function of communicating with a remote server. In this case, the electronic device acquiring the predetermined color display sequence can specifically be: the terminal receiving the predetermined color display sequence from the server. Specifically, the electronic device can send a color display sequence acquisition request to the server, and after receiving the color display sequence acquisition request, the server can generate a color display sequence and send the color display sequence to the electronic device via a message. In this way, the electronic device can acquire the predetermined color display sequence by receiving a message from the server. This color sequence acquisition method allows the color displayed on the display screen of the electronic device to be controlled by the server.

[0031] Optionally, in the embodiments of the present specification, the electronic device can also have no communication function of communicating with a remote server. In this case, the electronic device acquiring the predetermined color display sequence can specifically be: the electronic device randomly generating a predetermined color display sequence. That is, in this case, the electronic device can actively generate a predetermined color display sequence without interacting with the server to obtain the color display sequence. This color sequence acquisition method can eliminate the need for the electronic device to have a communication function, thereby reducing the cost of the terminal.

[0032] Optionally, in the embodiments of the present specification, two adjacent colors in the color display sequence can be colors between which a distance in a three-dimensional color space is greater than a second threshold. The three-dimensional color space can be a red, green and blue (RGB) space, each color can be represented by an RGB value in the three-dimensional color space, and the RGB value can correspond to one point in the three-dimensional color space. In this way, each color will have a corresponding point in the three-dimensional color space. For two adjacent colors in the color display sequence, the distance between the two colors can be calculated by determining the corresponding point of each of the two colors in the three-dimensional color space, and the distance is compared with a second threshold. Here, the second threshold can be set as needed.

[0033] After acquiring the predetermined color display sequence, the display screen can be controlled to display a color in the order of colors indicated by the color display sequence, for example, sequentially displaying a single color, such that light emitted by the display screen irradiates the face of the target object. Of course, in the embodiments of the present specification, the brightness corresponding to each color in the color display sequence can also be acquired, and the display screen is controlled, for example, to sequentially display a single color, at a brightness corresponding to the color, in the color display sequence and in an order of colors indicated by the color display sequence.

[0034] In order to ensure that the color superimposed on the face can be quickly determined subsequently according to the captured image of the target object, in an embodiment of the present specification, acquiring a brightness corresponding to each color in the color display sequence can specifically include: determining a brightness of an i-th color in the color display sequence, wherein i is a positive integer; based on the brightness of the i-th color, determining a brightness of an (i+l)th color in the color display sequence, such that a difference between the brightness of the i-th color and the brightness of the (i+l)th color is greater than a third threshold. In this way, the brightness of adjacent two colors is closely related, which can ensure that the captured image of the target object has a better effect, such that the color superimposed on the face can be quickly determined from the image.

[0035] In step 120, an image of a target object in the color display process is captured.

[0036] In the embodiments of the present specification, in the process of the display screen of the electronic device displaying a color in the order indicated by the color display sequence (for example, sequentially displaying a single color), the camera of the electronic device can be controlled to capture an image of the target object. In the embodiments of the present specification, the captured image of the target object can be a video frame image, or can be a plurality of images (i.e., discontinuous images) taken at different time instances (time points). That is to say, an image of the target object can be taken at one time instance. In the embodiments of the present specification, when the captured image of the target object is a video frame image, the display screen of the electronic device can display a color according to the color display sequence (for example, sequentially display a single color) at the same time as the video frame image is captured. Once the display screen stops displaying, capturing of the video frame image of the target object can also be stopped accordingly. Of course, a time period for capturing the video frame image can also be shorter than a time period for the display screen displaying according to the color display sequence. When the captured image of the target object is a plurality of images captured for the target object at different time instances, the target object can be photographed to acquire an image at a certain time instance in the process of the display screen of the electronic device displaying according to the color display sequence. Once the display screen stops displaying, the photographing of the target object can also be stopped accordingly.

[0037] In the embodiments of the present specification, the video frame image can indicate that the captured image is a continuous multi -frame image.

[0038] Since the light emitted through the display screen can irradiate the face of the target object, the face of the target object in the captured image will indicate the light of a certain color if the target object is live. If the target object is not live, the face of the target object in the captured image may not indicate the light of a certain color.

[0039] In step 130, a color change sequence of a face of the target object in the image over time is acquired.

[0040] The step 130 of acquiring the color change sequence of the face of the target object in the image over time can specifically be: analyzing a face image of the target object in the image (for example, a video frame image or a photo taken at each different time point), to acquire a color superimposed on the face; and sorting the acquired colors in a chronological order to obtain a color change sequence of the face of the target object in the image over time. In the embodiments of the present specification, by analyzing the face image of the target object in the image, a color change sequence of the face of the target object in the image over time can be acquired. The acquisition of such a color change sequence is simple and fast, and the accuracy is relatively high. Taking a video frame image as an example, for one frame of image, if by analyzing the face image of the target object in this frame of image, it is obtained that the color superimposed on the face is red, and by analyzing the subsequent frames of images, it is obtained that the colors superimposed on the face are blue and green, the color change sequence of the face of the target object in the image over time can be acquired as red, blue, and green.

[0041] In step 140, it is determined whether the target object is live based on a matching relationship between the color display sequence and the color change sequence.

[0042] The matching relationship in the embodiments of the present specification can include matching and not matching, wherein the matching criteria can be determined as needed. For example, if the color display sequence is exactly the same as the color change sequence, then it can be determined that the two match; otherwise, the two do not match. As another example, the criteria for matching can be determined based on a threshold. For example, if a same portion of the color display sequence and the color change sequence exceeds a preset percentage (e.g., 80% or 90%), then it can be determined that the two match; otherwise, the two do not match.

[0043] In the embodiments of the present specification, if the color display sequence matches (e.g., is consistent with) the color change sequence, the target object can be determined to be live; if the color display sequence does not match (for example, is inconsistent with) the color change sequence, it can be determined that the target object is not live. For example, if the color display sequence is red, white, blue, and black, and the color change sequence is red, white, blue, and black, it can be known that the color display sequence is consistent with the color change sequence, thereby determining that the target object is live. For another example, if the color display sequence is red, white, blue, and black, and the color change sequence is red, blue, black, and white, it can be known that the color display sequence is inconsistent with the color change sequence, thereby determining that the target object is not live. Examples of non-live objects can be pictures, videos, and the like.

[0044] In the embodiments of the present specification, whether the target object is live can be determined by comparing whether the color display sequence matches the color change sequence. In some embodiments, when the color display sequence matches the color change sequence, instead of directly determining that the target object is live, it is also possible to further perform image analysis to further determine whether the target object is live. In an embodiment of the present specification, if the color display sequence matches the color change sequence, it may be further determined whether the face image of the target object in the image (e.g., a video frame image or a photo taken at each different time point) conforms to a three-dimensional reflection characteristic. If the face image of the target object in the image conforms to a three-dimensional reflection characteristic, it is determined that the target object is live. If the face of the target object in the image does not conform to the three-dimensional reflection characteristic, for example, the face image of the target object in the image being an image of partially specular reflection, it can be determined that the target object is not live. In the embodiments of the present specification, due to the shape and skin characteristics of the face, the reflection characteristics of the light on the face can cover: first, the diffuse reflection characteristic of the facial skin to the light, such that the reflected color light is uniformly distributed on most area of the face; and second, since the face is a three-dimensional shape, there will be shadows due to occlusion in some partial areas of the face (such as around the bridge of the nose). Thus, in determining whether the face image of the target object in the image (for example, a video frame image or a photo taken at each different time point) conforms to the three-dimensional reflection characteristic, if the color of the image in most areas of the face is evenly distributed, while there is a shadow around a specific part (such as the bridge of the nose), it can be determined that the face image of the target object in the image conforms to the three-dimensional reflection characteristic. On the contrary, if the color of the image of most parts of the face is not evenly distributed, or there is no shadow around a specific part (such as the bridge of the nose), it can be determined that the face image of the target object in the image does not conform to the three-dimensional reflection characteristic.

[0045] The liveness detection method provided by the embodiments of the present specification controls the display screen to display colors in an order of a color display sequence, acquires a color change sequence of the face of the target object in the captured image, and determines whether the target object is live based on a matching relationship between the color display sequence and the color change sequence. If the target object is not live, since the face of a target object in an image captured for a non-live object may not reflect the color change, the color display sequence may not be consistent with the color change sequence in the case of a non-live object. Therefore, the liveness detection method provided by the embodiments of the present specification can determine whether the detected object is live. In addition, in the liveness detection process, the user and the detected obj ect can perform the liveness authentication in a natural manner without the user actively cooperating (for example, the user makes actions such as a nod, a blink, etc. to cooperate with the liveness detection), and thus, the liveness detection method not only can reliably detect liveness, but also can greatly reduce the operational burden of the user.

[0046] Moreover, the liveness detection method provided by the embodiments of the present specification does not depend on one particular image capturing device, and even if the image capturing device is tampered with, the liveness detection can still be performed, thereby improving the reliability of liveness detection.

[0047] FIG. 2 is a flow chart of a liveness detection method provided by an embodiment of the present specification. It should be understood that FIG. 2 only illustrates an example in which the display screen sequentially displays a single color according to a predetermined color display sequence. It should also be understood that the foregoing description can be referred to for the relevant content of the steps described in FIG. 2. Referring to FIG. 2, the liveness detection method provided by the embodiments of the present specification can include:

[0048] step 210, turning on a camera, and starting liveness detection.

[0049] This step can be performed when a triggering operation is received, for example, when the terminal display prompts“whether to initiate authentication,” and the user clicks the“yes” option. The embodiment of the present specification does not limit the operation for triggering the execution of step 210. The triggering operation can be a click operation, a double-click operation, or an operation of drawing a specified graph.

[0050] Once the camera is turned on, an image of the target object can be captured. If the image of the target object is not captured, a prompt can be displayed on the display screen, for example,“please approach the terminal for image capturing” and a sound can be played through the speaker. If an image of the target object is captured, it can be further determined a distance between the target object and the display screen.

[0051] In step 220, it is determined whether a distance between the target object and the display screen is less than a first threshold.

[0052] The first threshold can be selected as needed. For example, the first threshold is 30 cm or 40 cm.

[0053] In step 230, when the distance between the target object and the display screen is less than the first threshold, the display screen is controlled to sequentially display a single color according to a predetermined color display sequence, such that light emitted by the display screen irradiates the face of the target object.

[0054] The controlling the display screen to sequentially display a single color according to the predetermined color display sequence can include: acquiring a predetermined color display sequence; acquiring a brightness corresponding to each color in the color display sequence; and controlling the display screen to sequentially display a single color, at a brightness corresponding to the color, in the color display sequence and in an order of colors indicated by the color display sequence.

[0055] The acquiring the predetermined color display sequence can include: receiving the predetermined color display sequence from the server; or randomly generating the predetermined color display sequence. Here, two adjacent colors in the color display sequence can be colors between which a distance in a three-dimensional color space is greater than a second threshold.

[0056] The acquiring a brightness corresponding to each color in the color display sequence can include: determining a brightness of an i-th color in the color display sequence, where i is a positive integer; and determining a brightness of an (i+l)th color in the color display sequence, such that a difference between the brightness of the i-th color and the brightness of the (i+l)th color is greater than a third threshold.

[0057] In step 240, in the color display process, an image of the target object is captured.

[0058] In the embodiments of the present specification, the image captured for the target object can be a video frame image or can be a photo taken at each different time point.

[0059] In step 250, a color change sequence of the face of the target object in the image over time is acquired.

[0060] The step 250 of acquiring the color change sequence of the face of the target object in the image over time can specifically include: analyzing a face image of the target object in the image to acquire a color superimposed on the face; and sorting the acquired colors in a chronological order to obtain a color change sequence of the face of the target object in the image over time.

[0061] In step 260, it is determined whether the color display sequence is consistent with the color change sequence. If it is consistent, step 270 is performed; and if it is not consistent, step 290 is performed. [0062] In step 270, if the color display sequence is consistent with the color change sequence, it is determined whether the face image of the target object in the image conforms to a three-dimensional reflection characteristic.

[0063] If the face image of the target obj ect in the image conforms to the three-dimensional reflection characteristic, step 280 is performed; if the face of the target object in the image does not conform to the three-dimensional reflection characteristic, step 290 is performed.

[0064] In step 280, it is determined that the target object is live.

[0065] In step 290, it is determined that the target object is not live.

[0066] The liveness detection method provided by the embodiments of the present invention controls the display screen to display colors in an order of a color display sequence, acquires a color change sequence of the face of the target object in the captured image, and determines that the target object is live when the color display sequence is consistent with the color change sequence. In the process, the user or the detected object can perform the liveness authentication in a natural manner without the user actively making actions such as a nod, a blink, etc. to cooperate with the liveness detection, and thus, the liveness detection method not only can reliably detect liveness, but also can greatly reduce the operational burden of the user to actively cooperate.

[0067] Moreover, the liveness detection method does not depend on one particular terminal, and even if the image capturing device is tampered with, the liveness detection can still be performed, thereby improving the reliability of liveness detection.

[0068] It should be understood by those skilled in the art that the two adjacent colors in the color display sequence can be colors between which a distance in a three-dimensional color space is greater than a second threshold. In an optional implementation, the color display sequence can only include black and white, wherein black and white in the color display sequence can be alternately set. In this way, it can also realize light emitted by the display screen irradiating the face of the target object. Subsequently, in the process of determining whether the target object is live, it is also possible to compare the order in which the colors are displayed on the display screen with the order of colors of the face of the target object in the image (for example, a video frame image or a photo taken at each different time point) change. If they are consistent, the target object can be determined to be live. Of course, in a possible implementation, when the order in which the colors are displayed on the display screen matches the change order of colors of the face of the target object in the image, instead of directly determining that the target object is live, it is also possible to further determine whether the face image of the target object in the image conforms to the three-dimensional reflection characteristic. If the face image of the target object in the image conforms to the three-dimensional reflection characteristic, it is determined that the target object is live. If the face image of the target object in the image does not conform to the three-dimensional reflection characteristic, it is determined that the target object is not live.

[0069] FIG. 3 is a schematic structural diagram of an electronic device provided in an embodiment of the present application. Referring to FIG. 3, at the hardware level, the electronic device includes a processor, and optionally also includes an internal bus, a network interface, and a memory. The memory can include an internal memory, such as a high-speed Random Access Memory (RAM), and can also include a non-volatile memory, such as at least one disk memory. Of course, the electronic device can also include hardware required for other services.

[0070] The processor, the network interface, and the memory can be interconnected by the internal bus, which can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus, or an EISA (Extended Industry Standard Architecture) bus. The bus can be an address bus, a data bus, a control bus, and the like. For ease of representation, only one double-headed arrow is shown in FIG. 3, but it does not mean that there is only one bus or one type of buses.

[0071] The memory is configured to store programs. Specifically, the program can include program codes, the program codes including computer operating instructions. The memory can include the internal memory and non-volatile memory and provides instructions and data to the processor.

[0072] The processor is configured to read the corresponding computer program from the non-volatile memory into the internal memory and then runs the computer program. The processor executes a program stored in the memory and can perform any of the liveness detection methods described above. For example, the processor can be specifically configured to control the display screen to display a color according to a predetermined color display sequence, the color display sequence including at least two different colors; capture an image of the target object in the color display process; acquire a color change sequence of the face of the target object in the image over time; and determine whether the target object is live based on a matching relationship between the color display sequence and the color change sequence.

[0073] The method performed by the electronic device disclosed in the embodiment shown in FIG. 3 of the present application can be applied to a processor or implemented by a processor. The processor can be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in a processor or an instruction in a form of software. The above processor can be a general-purpose processor, including a Central Processing Unit (CPU), a Network Processor (NP), etc.; or can be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, and discrete hardware component. The methods, steps, and logical block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can be any conventional processor or the like. The steps of the method disclosed in the embodiments of the present application can be directly implemented by a hardware decoding processor, or can be performed by a combination of hardware and software modules in the decoding processor. The software module can be located in a conventional storage medium such as a random access memory, a flash memory, a read only memory, a programmable read only memory or an electrically erasable programmable memory, a register, and the like. The storage medium is located in the memory, and the processor reads the information in the memory and combines the hardware to complete the steps of the above method.

[0074] The electronic device can also perform the functions of the embodiment shown in FIG. 2, and details are not described herein again.

[0075] Of course, in addition to the software implementation, the electronic device of the present application does not exclude other implementations, such as a logic device or a combination of software and hardware, etc. That is, the execution entity of the processing flow is not limited to each logical unit, and can also be hardware or logic devices.

[0076] An embodiment of the present application further provides a computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when being executed by a portable electronic device including a plurality of applications, enable the portable electronic device to perform the method of the embodiment of FIG. 1 and, specifically, to perform the following operations: controlling the display screen to display a color according to a predetermined color display sequence, the color display sequence including at least two different colors; capturing an image of the target object in the color display process; acquiring a color change sequence of the face of the target object in the image over time; and determining whether the target object is live based on a matching relationship between the color display sequence and the color change sequence.

[0077] The computer-readable storage medium provided by the embodiments of the present specification can be a non-transitory computer-readable storage medium. The computer- readable storage medium may be, for example, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk, and the like.

[0078] The electronic device and the computer-readable storage medium provided by the embodiments of the present specification control the display screen to display colors in an order of a color display sequence, acquire a color change sequence of the face of the target object in the captured image, and determine whether the target object is live based on a matching relationship between the color display sequence and the color change sequence. If the target object is not live, since the face of a target object in an image captured for a non-live object may not reflect the color change, the color display sequence may not be consistent with the color change sequence in the case of a non-live object. Therefore, the liveness detection method provided by the embodiments of the present specification can determine whether the detected object is live. In addition, in the liveness detection process, a user or a detected object can perform the liveness authentication in a natural manner without the user actively cooperating (for example, the user makes actions such as a nod, a blink, etc. to cooperate with the liveness detection), and thus, the liveness detection method not only can reliably detect liveness, but also can greatly reduce the operational burden of the user.

[0079] Moreover, the liveness detection method does not depend on one particular terminal, and even if the image capturing device is tampered with, the liveness detection can still be performed, thereby improving the reliability of liveness detection.

[0080] FIG. 4 is a structural block diagram of a liveness detection apparatus 400 according to an embodiment of the present specification. Referring to FIG. 4, the liveness detection apparatus 400 provided by the embodiments of the present specification can include: a control module 410, a capturing module 420, an acquiring module 430, and a determining module 440.

[0081] The control module 410 controls the display screen to display a color according to a predetermined color display sequence, the color display sequence including at least two different colors; the capturing module 420 captures an image of a target object in the color display process; the acquiring module 430 acquires a color change sequence of the face of the target object in the image captured by the capturing module 420 over time; and the determining module 440 determines whether the target object is live based on a matching relationship between the color display sequence and the color change sequence acquired by the acquiring module 430.

[0082] The liveness detection method provided by the embodiments of the present invention controls the display screen to display colors in an order of a color display sequence, acquires a color change sequence of the face of the target object in the captured image, and determines whether the target object is live based on a matching relationship between the color display sequence and the color change sequence. If the target object is not live, since the face of a target object in an image captured for a non-live object may not reflect the color change, the color display sequence may not be consistent with the color change sequence in the case of a non-live object. Therefore, the liveness detection method provided by the embodiments of the present specification can determine whether the detected object is live. In addition, in the liveness detection process, a user or a detected object can perform the liveness authentication in a natural manner without the user actively cooperating (for example, the user makes actions such as a nod, a blink, etc. to cooperate with the liveness detection), and thus, the liveness detection method not only can detect liveness, but also can greatly reduce the operational burden of the user.

[0083] Moreover, the liveness detection method does not depend on one particular terminal, and even if the image capturing device is tampered with, the liveness detection can still be performed, thereby improving the reliability of liveness detection.

[0084] Optionally, in an embodiment of the present specification, the determining module

440 is specifically configured to: if the color display sequence matches the color change sequence, determine that the target object is live; and if the color display sequence does not match the color change sequence, determine that the target object is not live.

[0085] Optionally, in an embodiment of the present specification, if the color display sequence matches the color change sequence, the determining module 440 does not directly determine that the target object is live, but can further determine whether the face image of the target object conforms to the three-dimensional reflection characteristic; and if so, it is determined that the target object is live.

[0086] Optionally, in an embodiment of the present specification, the control module 410 can be specifically configured to: control the display screen to sequentially display a single color according to a predetermined color display sequence.

[0087] Optionally, in an embodiment of the present specification, before the control module 410 controls the display screen to sequentially display a single color according to a predetermined color display sequence, the determining module 440 can be specifically configured to: determine whether a distance between the target object and the display screen is less than a first threshold.

[0088] Correspondingly, the control module 410 is specifically configured to: when the distance between the target object and the display screen is less than the first threshold, control the display screen to sequentially display a single color according to a predetermined color display sequence, such that the light emitted by the display screen irradiates the face of the target object.

[0089] Optionally, in an embodiment of the present specification, the control module 410 can be specifically configured to: acquire a predetermined color display sequence; acquire a brightness corresponding to each color in the color display sequence; control the display screen to sequentially display a single color, at a brightness corresponding to the color, in the color display sequence and in an order of colors indicated by the color display sequence.

[0090] Optionally, in an embodiment of the present specification, when acquiring the brightness corresponding to each color in the color display sequence, the control module 410 can be specifically configured to: determine the brightness of an i-th color in the color display sequence, wherein i is a positive integer; and determine a brightness of an (i+l)th color in the color display sequence, such that a difference between the brightness of the i-th color and the brightness of the (i+l)th color is greater than a third threshold.

[0091] In the embodiments of the present specification, two adjacent colors in the color display sequence can be colors between which a distance in a three-dimensional color space is greater than a second threshold.

[0092] In the embodiments of the present specification, the colors included in the color display sequence can be black and white.

[0093] Optionally, in an embodiment of the present specification, when acquiring a color change sequence of the face of the target object in the image over time, the acquiring module 430 can be specifically configured to: analyze a face image of the target object in the image to acquire a color superimposed on the face; and sort the acquired colors in a chronological order to obtain a color change sequence of the face of the target object in the image over time.

[0094] Optionally, in the embodiments of the present specification, when acquiring a predetermined color display sequence, the control module 410 can be specifically configured to: receive the predetermined color display sequence from the server; or randomly generate the predetermined color display sequence.

[0095] In summary, the above description is only the example embodiments of the present application, and is not intended to limit the scope of the present application. Any modification, equivalent substitution, improvement, etc. made within the spirit and principles of this application are intended to be included within the scope of the present application.

[0096] The apparatus, module or unit set forth in the above embodiments can be implemented by a computer chip or an entity, or by a product having a certain function. A typical implementation device is a computer. Specifically, the computer can be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices. [0097] The computer-readable medium includes permanent and non-permanent, removable and non-removable media. Information storage can be implemented by any method or technology. The information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, a phase change memory (PRAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), other types of random access memories (RAMs), a read only memory (ROM), an electrically erasable programmable read only memory (EEPROM), a flash memory or other memory technology, a compact disk read only memory (CD-ROM), a digital versatile disk (DVD) or other optical storage, a cassette-type magnetic tape, a magnetic disc storage or other magnetic storage device or any other non-transportable media, which can be used to store information that can be accessed by a computing device. As defined herein, the computer-readable media do not include computer-readable transitory media, such as modulated data signals and carrier waves.

[0098] It is also to be understood that the terms“include” or“comprise” or any other variations are intended to encompass a non-exclusive inclusion, such that a process, a method, an article, or a device comprising a series of elements not only comprises such elements, but also comprises other elements not explicitly listed, or can comprise elements inherent to such process, method, article, or device. An element defined by a phrase“including a ...” without further limitation does not exclude the existence of additional identical elements in the process, the method, the article, or the device that includes the element.

[0099] Although the specification has been described in conjunction with specific embodiments, many alternatives, modifications and variations will be apparent to those skilled in the art. Accordingly, the following claims embrace all such alternatives, modifications and variations that fall within the terms of the claims.

Claims

1. A liveness detection method, comprising:

controlling a display screen to display a color according to a predetermined color display sequence, the color display sequence including at least two different colors;

capturing an image of a target object in the color display process;

acquiring a color change sequence of a face of the target object in the image over time; and

determining whether the target object is live based on a matching relationship between the color display sequence and the color change sequence.

2. The method according to claim 1, wherein determining whether the target object is live based on a matching relationship between the color display sequence and the color change sequence comprises:

if the color display sequence matches the color change sequence, determining that the target object is live; and

if the color display sequence does not match the color change sequence, determining that the target object is not live.

3. The method according to claim 2, wherein if the color display sequence matches the color change sequence, determining that the target object is live comprises:

if the color display sequence matches the color change sequence, determining whether the face of the target object in the image conforms to a three-dimensional color reflection characteristic; and

if yes, determining that the target object is live.

4. The method according to claim 1, wherein controlling a display screen to display a color according to a predetermined color display sequence comprises:

controlling the display screen to sequentially display a single color according to the predetermined color display sequence.

5. The method according to claim 4, wherein before controlling the display screen to sequentially display a single color according to the predetermined color display sequence, the method further comprises:

determining whether a distance between the target object and the display screen is less than a first threshold; and

controlling the display screen to sequentially display a single color according to the predetermined color display sequence comprises: when the distance between the target object and the display screen is less than the first threshold, controlling the display screen to sequentially display a single color according to the predetermined color display sequence, such that light emitted by the display screen irradiates the face of the target object.

6. The method according to claim 4, wherein controlling the display screen to sequentially display a single color according to the predetermined color display sequence comprises:

acquiring the predetermined color display sequence;

acquiring a brightness corresponding to each color in the color display sequence; and controlling the display screen to sequentially display a single color, at a brightness corresponding to the color, in the color display sequence and in an order of colors indicated by the color display sequence.

7. The method according to claim 4, wherein two adjacent colors in the color display sequence are colors between which a distance in a three-dimensional color space is greater than a second threshold.

8. The method according to claim 6, wherein acquiring a brightness corresponding to each color in the color display sequence comprises:

determining a brightness of an i-th color in the color display sequence, wherein i is a positive integer; and

determining a brightness of an (i+l)th color in the color display sequence based on the brightness of the i-th color, such that a difference between the brightness of the i-th color and the brightness of the (i+l)th color is greater than a third threshold.

9. The method according to claim 4, wherein the color display sequence comprises colors of black and white.

10. The method according to claim 1, wherein acquiring a color change sequence of a face of the target object in the image over time comprises:

analyzing a face image of the target object in the image to acquire a color superimposed on the face; and

sorting acquired colors in a chronological order to obtain the color change sequence of the face of the target object in the image over time.

11. The method according to claim 6, wherein acquiring the predetermined color display sequence comprises:

receiving the predetermined color display sequence from a server; or

randomly generating the predetermined color display sequence.

12. A liveness detection apparatus, comprising a control module, a capturing module, an acquiring module and a determining module; wherein:

the control module is configured to control a display screen to display a color according to a predetermined color display sequence, the color display sequence including at least two different colors;

the capturing module is configured to capture an image of a target object in the color display process;

the acquiring module is configured to acquire a color change sequence of a face of the target object in the image over time; and

the determining module is configured to determine whether the target object is live based on a matching relationship between the color display sequence and the color change sequence.

13. An electronic device comprising:

a processor; and

a memory arranged to store computer executable instructions that, when being executed, cause the processor to perform the following operations:

capturing an image of a target object in the color display process;

14. A computer-readable storage medium storing one or more programs, the one or more programs, when being executed, performing the following operations: controlling a display screen to display a color according to a predetermined color display sequence, the color display sequence including at least two different colors;

capturing an image of a target object in the color display process;