US10824848B2 - Biological feature recognition method and apparatus, and storage medium - Google Patents

Biological feature recognition method and apparatus, and storage medium Download PDF

Info

Publication number
US10824848B2
US10824848B2 US16/201,701 US201816201701A US10824848B2 US 10824848 B2 US10824848 B2 US 10824848B2 US 201816201701 A US201816201701 A US 201816201701A US 10824848 B2 US10824848 B2 US 10824848B2
Authority
US
United States
Prior art keywords
heart rate
current
feature recognition
data
facial color
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US16/201,701
Other versions
US20190147223A1 (en
Inventor
Jie Chen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Publication of US20190147223A1 publication Critical patent/US20190147223A1/en
Assigned to TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED reassignment TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHEN, JIE
Application granted granted Critical
Publication of US10824848B2 publication Critical patent/US10824848B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G06K9/00234
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/162Detection; Localisation; Normalisation using pixel segmentation or colour matching
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/32User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/90Determination of colour characteristics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • G06V40/169Holistic features and representations, i.e. based on the facial image taken as a whole
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/40Spoof detection, e.g. liveness detection
    • G06V40/45Detection of the body part being alive
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/70Multimodal biometrics, e.g. combining information from different biometric modalities
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • G06T2207/30201Face
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/15Biometric patterns based on physiological signals, e.g. heartbeat, blood flow

Definitions

  • the present disclosure relates to the field of computer technologies, and specifically, to a biological feature recognition method and apparatus, and a storage medium.
  • an attendance checking device uses facial recognition
  • a full-frontal face image of a person whose attendance is checked is recorded in advance, and during attendance checking, the person whose attendance is checked only needs to face toward the attendance checking device, and after recognizing that a currently collected facial image matches the pre-stored facial image of the person whose attendance is checked, the attendance checking device prompts that attendance is successfully checked.
  • a facial-recognition attendance checking manner Compared with an original card-reading attendance checking manner, a facial-recognition attendance checking manner obviously reduces a probability that someone else uses a card of a person get attendance of the person checked. However, some one uses a photograph of another person to get attendance of the person checked. When similarity between a feature read by the attendance checking device from the photograph and a pre-stored feature is higher than a preset threshold, the attendance is also successfully checked. In view of the above, there is a large room for improvement to application of biological feature recognition.
  • embodiments of the present disclosure provide a biological feature recognition method, in which recognition succeeds only when current facial color data of a user matches current heart rate data of the user, thereby effectively avoiding the loophole of biological recognition in application.
  • the embodiments of the present disclosure further provide a corresponding apparatus.
  • a first aspect of the embodiments of the present disclosure provides a biological feature recognition method performed at a biological feature recognition apparatus having one or more processors and memory storing a plurality of programs to be executed by the one or more processors, the method comprising:
  • a second aspect of the embodiments of the present disclosure provides a biological feature recognition apparatus comprising one or more processors, memory, and a plurality of programs stored in the memory that, when executed by the one or more processors, cause the biological feature recognition apparatus to perform the aforementioned biological feature recognition method.
  • a third aspect of the embodiments of the present disclosure provides a non-transitory storage medium, storing computer readable instructions. When the instructions are executed, a computer is caused to execute the foregoing biological feature recognition method.
  • embodiments of the present disclosure provide a biological feature recognition method, in which recognition succeeds only when current facial color data of a user matches current heart rate data of the user, thereby effectively avoiding a loophole of biological recognition in application and improving recognition accuracy of a biological feature recognition apparatus.
  • FIG. 1 is a schematic diagram of collecting facial color data and heart rate data of a user and constructing a correspondence between the facial color data and the heart rate data of the user in a scenario in which the user runs on a running machine in an embodiment of the present disclosure
  • FIG. 2 is a schematic diagram of a curve of a correspondence between facial color data and heart rate data of a user in an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of performing recognition on a user by a biological feature recognition apparatus in an embodiment of the present disclosure
  • FIG. 4 is a schematic diagram of a curve of a correspondence between facial color data and heart rate data of a user in another embodiment of the present disclosure
  • FIG. 5 is a schematic diagram of a biological feature recognition method in an embodiment of the present disclosure.
  • FIG. 6 is a schematic diagram of a biological feature recognition apparatus in an embodiment of the present disclosure.
  • FIG. 7 is a schematic diagram of a biological feature recognition apparatus in another embodiment of the present disclosure.
  • FIG. 8 is a schematic diagram of a biological feature recognition apparatus in still another embodiment of the present disclosure.
  • Embodiments of the present disclosure provide a biological feature recognition method, in which recognition succeeds only when current facial color data of a user matches current heart rate data of the user, thereby effectively avoiding a loophole of biological recognition in application and improving recognition accuracy of a biological feature recognition apparatus.
  • the embodiments of the present disclosure further provide a corresponding apparatus. Details descriptions are separately provided below.
  • the embodiments of the present disclosure provide a biological feature recognition method, in which according to a principle that while a heart rate of a human body changes, a facial color also changes correspondingly, correspondences between facial color data and heart rate of users of fixed groups are constructed, and a correspondence between facial color data and heart rate data of each user includes corresponding facial color data of the user at different heart rates. Then, the correspondence is stored into a biological feature recognition apparatus, and the biological feature recognition apparatus may be a device such as an attendance checking device.
  • Heart rate changes and corresponding facial color changes of a user can be collected in a scenario in which the user runs on a running machine.
  • An attendance checking device is used as an example of the biological feature recognition apparatus. If the attendance checking device is responsible for checking attendance of 30 persons in a company, the attendance checking device needs to first record correspondences between facial color data and heart rate data of the 30 persons, so that for each person, a correspondence between facial color data and heart rate data of the person needs to be established first.
  • a user on a running machine 10 is one of the 30 persons
  • the user wears a heart rate collector 20 on a wrist
  • a camera 30 is mounted on the running machine 10
  • the camera 30 is configured to collect a facial image of the user during a running process of the user
  • the heart rate collector 20 is configured to collect heart rate data of the user during the running process of the user.
  • the heart rate collector 20 may be a smart band, and can measure a heart rate by measuring pulses.
  • the facial image and the heart rate data of the user can be transmitted to a data collection device 40 , the data collection device 40 may be a separate device or the biological feature recognition apparatus in this embodiment of the present disclosure.
  • the camera 30 can be communicably connected to the data collection device 40 in a wired manner, and the heart rate collector 20 can be communicably connected to the data collection device 40 in a wireless manner.
  • the data collection device 40 obtains a large number of facial images and a large number of pieces of heart rate data, and can match them by time.
  • the data collection device 40 needs to first determine facial color data from the facial images, and in this embodiment of the present disclosure, the facial color data may be quantified by a color temperature or three primary colors.
  • the three primary colors are: red (R), green (G), and blue (B).
  • R red
  • G green
  • B blue
  • a color temperature or three primary colors can be used for quantification, but also, for example, another physical parameter, such as brightness, can be used for quantification.
  • a color temperature is a scale indicating a light color of a light source, and its unit is Kelvin (K).
  • K Kelvin
  • a color temperature of a light source is determined by comparing a color of the light source with a theoretical hot blackbody radiator.
  • a Kelvin temperature of the hot blackbody radiator at a time point when the hot blackbody radiator matches the color of the light source is the color temperature of the light source, and the color temperature is directly related to the Planck's blackbody radiation law.
  • color temperatures of some common light sources are that: a color temperature of standard candlelight is 1930 K, a color temperature of a tungsten filament lamp ranges from 2760 to 2900 K, a color temperature of a fluorescent lamp is 3000 K, a color temperature of a flash is 3800 K, a color temperature of midday sunlight is 5600 K, a color temperature of an electronic flash is 6000 K, and so on.
  • a color temperature of a human facial color may range from a dozen K to dozens K.
  • the RGB is a color standard, in which various colors are obtained by changing channels of three colors, namely, red (R), green (G), and blue (B), and mutually superimposing them. Therefore, RGB is also referred to as three primary colors, and is represented as red (R), green (G), and blue (B) in English.
  • the so-called “amount” of the RGB is brightness, and is represented by an integer.
  • each color of the RGB has 256 levels of brightness, represented by a numeral from 0, 1, 2, . . . to 255. Therefore, for each facial image, values of corresponding R, G, and B of the facial image can be determined.
  • a solution of determining facial color data from a facial image may include a method for processing RGB and a method for processing a color temperature.
  • the method for processing RGB is extracting red (R) values of all pixels on a facial image, then, obtaining an average, and using the average of the R value as facial color data of the current facial image.
  • the method for processing a color temperature is first determining averages of R, G, and B of all pixels on a facial image and then substituting, according to a color temperature estimation algorithm, the averages of R, G, and B of the facial image into the color temperature estimation algorithm, to obtain a color temperature of the current facial image.
  • a unit of a heart rate is beats/minute. Therefore, after obtaining facial images in three consecutive minutes and heart rate data in the three minutes, data collection device 40 can construct a correspondence.
  • data in the three minutes is used as data herein, and the three minutes should be understood as a limitation to a test time period.
  • a facial image of a user is analyzed once at intervals of 20 seconds, and facial color data, such as R, G, and B values or a color temperature value of the user is obtained from the facial image.
  • a color temperature is used as an example for description below.
  • Table 1 is described by using trending data as an example, and data in a correspondence of each user is subject to actual measured values. Moreover, for ease of description, Table 1 merely lists data at intervals of 20 seconds. Actually, the pieces of data may be consecutive.
  • x may be a heart rate
  • y may be a facial color
  • x is a facial color
  • y is a heart rate
  • a, b, and t are constants
  • n is an integer greater than or equal to 2.
  • Each user has one correspondence between facial color data and heart rate data.
  • the correspondence may be indexed by facial images of the user.
  • a process of the indexing is similar to a process of card reading in existing attendance checking.
  • a facial feature of each user is basically unique. Therefore, when the user uses an attendance checking device provided by this application, the attendance checking device collects a facial image of the user, then, performs, according to the facial image of the user, feature comparison with pre-stored facial images of users, and when the facial image of the user matches a pre-stored user facial image, can extract a correspondence between facial color data and heart rate data of the user.
  • a correspondence between facial color data and heart rate data of the user is indexed by using the serial number of the user.
  • This process includes: setting a serial number for the user when recording the user, determining a serial number of a user having attendance checked through the foregoing feature comparison, and then, indexing the correspondence between facial color data and heart rate data of the user according to the serial number.
  • FIG. 2 is used to represent a correspondence between a heart rate and a facial color
  • one corresponding facial color value can be found by using one heart rate value on a curve shown in FIG. 2 .
  • the correspondence between the facial color data and the heart rate data of the user is stored into the biological feature recognition apparatus in this embodiment of the present disclosure.
  • a biological feature recognition apparatus 40 provided in this embodiment of the present disclosure includes a processor 401 , a memory 402 , a camera 403 , and a heart rate collector 404 .
  • the camera 403 collects a current facial image of the user on which feature recognition is being performed.
  • the user wears the heart rate collector 404 on a wrist, and a heart rate is collected by using pulses.
  • the heart rate collector 404 is configured to collect current heart rate data of the user.
  • the memory 402 stores a correspondence between facial color data and heart rate data of the user. The correspondence may be understood by referring to corresponding descriptions of FIG. 1 and FIG. 2 .
  • the processor 401 is configured to: obtain the facial image collected by the camera, determine the current facial color data from the current facial image, and obtain current heart rate data of the user from the heart rate collector; determine, according to the facial image of the user, a correspondence between facial color data and heart rate data of the user from pre-stored correspondences between facial color data and heart rate data of a plurality of users, where the process is similar to a process of card reading in existing attendance checking, and a facial feature of each user is basically unique, so that when the user uses an attendance checking device provided by this application, the attendance checking device collects a facial image of the user, then, performs, according to the facial image of the user, feature comparison with pre-stored facial images of users, and when the facial image of the user is matched, can extract a correspondence between facial color data and heart rate data of the user; then, determine whether the obtained current facial color data matches the current heart rate data; and determine that recognition succeeds if the current facial color data matches the current heart rate data and determine that recognition fails if the current facial color data does
  • a color temperature value of a current facial color is 29 K
  • current heart rate data obtained by the processor 401 is 98 beats/minute, and it could be determined, according to that the current facial color is 29 K, from a curve of FIG. 4 that matching heart rate data corresponding to the color temperature value is 99 beats/minute, it could be determined that a heart rate difference between the matching heart rate data and the current heart rate data is 1 beat/minute. If a preset heart rate threshold is 3 beats/minute, indicating that the heart rate difference falls within a preset heart rate threshold range, it could be determined that the current facial color data matches the current heart rate data.
  • a color temperature value of a current facial color obtained by the processor 401 is 28.5 K, and it could be determined, according to that the current heart rate data is 99 beats/minute, from the curve of FIG. 4 that a matching color temperature value corresponding to the current heart rate data is 29 K, it could be determined that a facial color difference between the matching color temperature value and the color temperature value of the current facial color is 0.5 K. If a facial color threshold is 1 K, indicating that the facial color difference falls within a preset facial color threshold range, it could be determined that the current facial color data matches the current heart rate data.
  • an embodiment of the biological feature recognition method provided in this embodiment of the present disclosure includes:
  • 501 Obtain a facial image of a user on which feature recognition is being performed and current heart rate data of the user.
  • a facial image of a user is usually collected by a camera.
  • the camera generally is only in responsible for collecting images. Then, current facial color data of the user can be determined by using the image collected by the camera. This process may be understood by referring to descriptions in the foregoing related parts. Details are not described herein again.
  • embodiments of the present disclosure provide a biological feature recognition method, in which recognition succeeds only when current facial color data of a user matches current heart rate data of the user, thereby effectively avoiding a loophole of biological recognition in application and improving recognition accuracy of a biological feature recognition apparatus.
  • the method may further include:
  • the correspondence is obtained by collecting in advance corresponding facial color data of the user at different heart rates.
  • the correspondence is established in advance. As described in descriptions of FIG. 1 and FIG. 2 , data collection may be first performed and a correspondence may be established for a user whose correspondence between facial color data and heart rate data needs to be recorded. Subsequently, an established correspondence of each user is introduced into a biological feature recognition apparatus. In this way, in subsequent biological feature recognition processes, the correspondence can be directly used for recognition.
  • the determining, according to the correspondence between the facial color data and the heart rate data of the user, whether the obtained current facial color data matches the current heart rate data includes:
  • matching heart rate data can be determined from a correspondence between facial color data and heart rate data of the user by using the current facial color data, and then, the matching heart rate data is compared with the current heart rate data, to determine a heart rate difference between the matching heart rate data and the current heart rate data.
  • the heart rate difference falls within a preset heart rate threshold range, it is determined that the current facial color data matches the current heart rate data.
  • the determining, according to the correspondence between the facial color data and the heart rate data of the user, whether the obtained current facial color data matches the current heart rate data includes:
  • matching facial color data when current facial color data is matched with current heart rate data, matching facial color data can be determined from a correspondence between facial color data and heart rate data of the user by using the current heart rate data, then, the matching facial color data is compared with the current facial color data, to determine a facial color difference between the matching facial color data and the current facial color data.
  • a current facial color and a heart rate of a user are monitored simultaneously, then, it is determined whether the current facial color and the current heart rate coincide with a correspondence that is trained in advance. If the current facial color and the current heart rate coincide with the correspondence, it could be determined that the user is a normal user. Otherwise, the facial authentication is malicious.
  • an embodiment of a biological feature recognition apparatus 60 provided in this embodiment of the present disclosure includes:
  • an obtaining unit 601 configured to obtain a facial image of a user on which feature recognition is being performed and current heart rate data of the user;
  • a first determining unit 602 configured to determine, according to the facial image obtained by the obtaining unit 601 , current facial color data of the user and a correspondence between facial color data and heart rate data of the user;
  • a second determining unit 603 configured to determine, according to the correspondence between the facial color data and the heart rate data of the user determined by the first determining unit 602 , whether the current facial color data obtained by the obtaining unit 601 matches the current heart rate data;
  • a recognition unit 604 configured to determine that user recognition succeeds if the second determining unit 603 determines that the current facial color data matches the current heart rate data and determine that user recognition fails if the current facial color data does not match the current heart rate data.
  • the obtaining unit 601 obtains a facial image of a user on which feature recognition is being performed and current heart rate data of the user; the first determining unit 602 determines, according to the facial image obtained by the obtaining unit 601 , current facial color data of the user and a correspondence between facial color data and heart rate data of the user; the second determining unit 603 determines, according to the correspondence between the facial color data and the heart rate data of the user determined by the first determining unit 602 , whether the current facial color data obtained by the obtaining unit 601 matches the current heart rate data; and the recognition unit 604 determines that user recognition succeeds if the second determining unit 603 determines that the current facial color data matches the current heart rate data and determines that user recognition fails if the current facial color data does not match the current heart rate data.
  • embodiments of the present disclosure provide a biological feature recognition apparatus, in which recognition succeeds only when current facial color data of a user matches current heart rate data of the user, thereby effectively avoiding a loophole of biological recognition in application and improving recognition accuracy of a biological feature recognition apparatus.
  • the apparatus 60 further includes a receiving unit 605 and a storage unit 606 .
  • the receiving unit 605 is configured to receive the correspondence between the facial color data and the heart rate data of the user.
  • the storage unit 606 is configured to store the correspondence received by the receiving unit, where the correspondence is obtained by collecting in advance corresponding facial color data of the user at different heart rates.
  • the second determining unit 603 is configured to:
  • the second determining unit 603 is configured to:
  • FIG. 8 is a schematic structural diagram of the biological feature recognition apparatus 60 according to an embodiment of the present disclosure.
  • the biological feature recognition apparatus 60 includes a processor 610 , a camera 660 , a heart rate collector 670 , a memory 650 , and a transceiver 630 .
  • the camera 660 may be configured to collect a facial image of a user on which feature recognition is being performed.
  • the heart rate collector 670 is configured to collect current heart rate data of the user.
  • the memory 650 may include a read-only memory and a random access memory, and provides an operation instruction and data to the processor 610 .
  • a part of the memory 650 may further include a non-transitory random access memory (NVRAM).
  • NVRAM non-transitory random access memory
  • the memory 650 stores the following element, executable module, or data structure, or a subset thereof, or an extension set thereof.
  • the biological feature recognition apparatus by invoking the operation instruction (the operation instruction may be stored in an operating system) stored by the memory 650 , the biological feature recognition apparatus performs the following steps:
  • embodiments of the present disclosure provide a biological feature recognition apparatus, in which recognition succeeds only when current facial color data of a user matches current heart rate data of the user, thereby effectively avoiding a loophole of biological recognition in application and improving recognition accuracy of a biological feature recognition apparatus.
  • the processor 610 controls an operation of the biological feature recognition apparatus 60 , and the processor 610 may also be referred to as a central processing unit (CPU).
  • the memory 650 may include a read-only memory and a random access memory, and provides an instruction and data to the processor 610 .
  • a part of the memory 650 may further include a non-transitory random access memory (NVRAM).
  • NVRAM non-transitory random access memory
  • all components of the biological feature recognition apparatus 60 are coupled by using a bus system 620 , and in addition to a data bus, the bus system 620 may further include a power source bus, a control bus, a state signal bus, and the like. However, for ease of clear description, all types of buses in the diagram are marked as the bus system 620 .
  • the method disclosed in the foregoing embodiments of the present disclosure may be applied to the processor 610 , or in other words, may be implemented by the processor 610 .
  • the processor 610 may be an integrated circuit chip and has a signal processing capability. In an implementation process, steps in the foregoing method may be implemented through a hardware integrated logical circuit in the processor 610 , or an instruction in the form of software.
  • the processor 610 may be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), another programmable logic component, a discrete gate or a transistor logic device, and a discrete hardware component, and may implement or execute methods, steps, and logical block diagrams disclosed in the embodiments of the present disclosure.
  • the general-purpose processor may be a micro-processor, or the processor may alternatively be any conventional processor or the like.
  • the steps in the method disclosed in the embodiments of the present disclosure may be directly implemented by a hardware decoding processor, or may be implemented by combining hardware and software modules in a decoding processor.
  • the software module may be located in a mature storage medium in the field, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, or a register.
  • the storage medium is located in the memory 650 , and the processor 610 reads information in the memory 650 and performs the steps of the foregoing method in combination with hardware of the processor.
  • the transceiver 630 is configured to receive the correspondence between the facial color data and the heart rate data of the user.
  • the memory 650 is configured to store the correspondence, where the correspondence is obtained by collecting in advance corresponding facial color data of the user at different heart rates.
  • processor 610 is further configured to:
  • processor 610 is further configured to:
  • the foregoing biological feature recognition apparatus 60 may be understood by referring to the descriptions of FIG. 1 to FIG. 5 . Details are not described herein again.
  • the program may be stored in a computer readable storage medium.
  • the storage medium may include: a ROM, a RAM, a magnetic disk, or an optical disc.

Abstract

The present disclosure discloses a biological feature recognition method performed at a biological feature recognition apparatus. After obtaining a facial image of a user and current heart rate data of the user, the apparatus determines, according to the facial image, current facial color data of the user and a correspondence between facial color data and heart rate data of the user and then determines, according to the correspondence between the facial color data and the heart rate data of the user, whether the current facial color data matches the current heart rate data. If the current facial color data matches the current heart rate data, the apparatus determines that recognition succeeds, thereby effectively avoiding a loophole of biological recognition in application.

Description

PRIORITY CLAIM AND RELATED APPLICATION
This application is a continuation application of PCT/CN2017/093588, entitled “BIOLOGICAL CHARACTERISTIC RECOGNITION METHOD AND DEVICE, AND STORAGE MEDIUM” filed on Jul. 20, 2017, which claims priority to Chinese Patent Application No. 201610574489.2, filed with the State Intellectual Property Office of the People's Republic of China on Jul. 20, 2016, and entitled “BIOLOGICAL FEATURE RECOGNITION METHOD AND APPARATUS”, all of which are incorporated herein by reference in their entirety.
FIELD OF THE TECHNOLOGY
The present disclosure relates to the field of computer technologies, and specifically, to a biological feature recognition method and apparatus, and a storage medium.
BACKGROUND OF THE DISCLOSURE
With rapid development of biological recognition technologies, currently, devices for biological recognition, such as fingerprint recognition and facial recognition, also appear correspondingly, and are widely applied to access control and attendance checking.
In an example in which an attendance checking device uses facial recognition, a full-frontal face image of a person whose attendance is checked is recorded in advance, and during attendance checking, the person whose attendance is checked only needs to face toward the attendance checking device, and after recognizing that a currently collected facial image matches the pre-stored facial image of the person whose attendance is checked, the attendance checking device prompts that attendance is successfully checked.
Compared with an original card-reading attendance checking manner, a facial-recognition attendance checking manner obviously reduces a probability that someone else uses a card of a person get attendance of the person checked. However, some one uses a photograph of another person to get attendance of the person checked. When similarity between a feature read by the attendance checking device from the photograph and a pre-stored feature is higher than a preset threshold, the attendance is also successfully checked. In view of the above, there is a large room for improvement to application of biological feature recognition.
SUMMARY
To resolve the problem that biological recognition in application still has a loophole in the existing technology, embodiments of the present disclosure provide a biological feature recognition method, in which recognition succeeds only when current facial color data of a user matches current heart rate data of the user, thereby effectively avoiding the loophole of biological recognition in application. The embodiments of the present disclosure further provide a corresponding apparatus.
A first aspect of the embodiments of the present disclosure provides a biological feature recognition method performed at a biological feature recognition apparatus having one or more processors and memory storing a plurality of programs to be executed by the one or more processors, the method comprising:
obtaining, by the biological feature recognition apparatus, a facial image of a user on which feature recognition is being performed and current heart rate data of the user;
determining, by the biological feature recognition apparatus according to the facial image, current facial color data of the user and a correspondence between facial color data and heart rate data of the user;
determining, by the biological feature recognition apparatus according to the correspondence between the facial color data and the heart rate data of the user, whether the obtained current facial color data matches the current heart rate data;
in accordance with a determination that the current facial color data matches the current heart rate data, determining, by the biological feature recognition apparatus, that user recognition succeeds; and
in accordance with a determination that the current facial color data does not match the current heart rate data, determining, by the biological feature recognition apparatus, that user recognition fails.
A second aspect of the embodiments of the present disclosure provides a biological feature recognition apparatus comprising one or more processors, memory, and a plurality of programs stored in the memory that, when executed by the one or more processors, cause the biological feature recognition apparatus to perform the aforementioned biological feature recognition method.
A third aspect of the embodiments of the present disclosure provides a non-transitory storage medium, storing computer readable instructions. When the instructions are executed, a computer is caused to execute the foregoing biological feature recognition method.
Compared with the existing technology having a problem that a photograph of another person is used for recognition or a photograph is maliciously used for recognition, embodiments of the present disclosure provide a biological feature recognition method, in which recognition succeeds only when current facial color data of a user matches current heart rate data of the user, thereby effectively avoiding a loophole of biological recognition in application and improving recognition accuracy of a biological feature recognition apparatus.
BRIEF DESCRIPTION OF THE DRAWINGS
To more explicitly explain technical solutions in embodiments of the present disclosure, accompanying drawings needed in describing the embodiments are briefly introduced in the following. Apparently, the following accompanying drawings are only some embodiments of the present disclosure, and a person skilled in the art can derive other accompanying drawings from the accompanying drawings without creative work.
FIG. 1 is a schematic diagram of collecting facial color data and heart rate data of a user and constructing a correspondence between the facial color data and the heart rate data of the user in a scenario in which the user runs on a running machine in an embodiment of the present disclosure;
FIG. 2 is a schematic diagram of a curve of a correspondence between facial color data and heart rate data of a user in an embodiment of the present disclosure;
FIG. 3 is a schematic diagram of performing recognition on a user by a biological feature recognition apparatus in an embodiment of the present disclosure;
FIG. 4 is a schematic diagram of a curve of a correspondence between facial color data and heart rate data of a user in another embodiment of the present disclosure;
FIG. 5 is a schematic diagram of a biological feature recognition method in an embodiment of the present disclosure;
FIG. 6 is a schematic diagram of a biological feature recognition apparatus in an embodiment of the present disclosure;
FIG. 7 is a schematic diagram of a biological feature recognition apparatus in another embodiment of the present disclosure; and
FIG. 8 is a schematic diagram of a biological feature recognition apparatus in still another embodiment of the present disclosure.
DESCRIPTION OF EMBODIMENTS
Embodiments of the present disclosure provide a biological feature recognition method, in which recognition succeeds only when current facial color data of a user matches current heart rate data of the user, thereby effectively avoiding a loophole of biological recognition in application and improving recognition accuracy of a biological feature recognition apparatus. The embodiments of the present disclosure further provide a corresponding apparatus. Details descriptions are separately provided below.
The following clearly and completely describes the technical solutions in the embodiments of the present disclosure with reference to the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only some embodiments instead of all embodiments of the present disclosure. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present disclosure without any creative work fall within the protection scope of the present disclosure.
Currently, a relatively large bottleneck in facial recognition is how determine that a natural person, instead of a photograph, is recognized. With regard to the problem, the embodiments of the present disclosure provide a biological feature recognition method, in which according to a principle that while a heart rate of a human body changes, a facial color also changes correspondingly, correspondences between facial color data and heart rate of users of fixed groups are constructed, and a correspondence between facial color data and heart rate data of each user includes corresponding facial color data of the user at different heart rates. Then, the correspondence is stored into a biological feature recognition apparatus, and the biological feature recognition apparatus may be a device such as an attendance checking device.
To better understand use of a correspondence between facial color data and heart rate data of a user, a process of establishing a correspondence between facial color data and heart rate data of a user in this embodiment of the present disclosure is first introduced below with reference to FIG. 1.
Heart rate changes and corresponding facial color changes of a user can be collected in a scenario in which the user runs on a running machine.
An attendance checking device is used as an example of the biological feature recognition apparatus. If the attendance checking device is responsible for checking attendance of 30 persons in a company, the attendance checking device needs to first record correspondences between facial color data and heart rate data of the 30 persons, so that for each person, a correspondence between facial color data and heart rate data of the person needs to be established first.
As shown in FIG. 1, in an example, in which a user on a running machine 10 is one of the 30 persons, the user wears a heart rate collector 20 on a wrist, a camera 30 is mounted on the running machine 10, the camera 30 is configured to collect a facial image of the user during a running process of the user, and the heart rate collector 20 is configured to collect heart rate data of the user during the running process of the user. The heart rate collector 20 may be a smart band, and can measure a heart rate by measuring pulses.
After the camera 30 collects a facial image of the user, and the heart rate collector 20 collects heart rate data, the facial image and the heart rate data of the user can be transmitted to a data collection device 40, the data collection device 40 may be a separate device or the biological feature recognition apparatus in this embodiment of the present disclosure. The camera 30 can be communicably connected to the data collection device 40 in a wired manner, and the heart rate collector 20 can be communicably connected to the data collection device 40 in a wireless manner.
The data collection device 40 obtains a large number of facial images and a large number of pieces of heart rate data, and can match them by time. The data collection device 40 needs to first determine facial color data from the facial images, and in this embodiment of the present disclosure, the facial color data may be quantified by a color temperature or three primary colors. The three primary colors are: red (R), green (G), and blue (B). Certainly, not only a color temperature or three primary colors can be used for quantification, but also, for example, another physical parameter, such as brightness, can be used for quantification.
A color temperature is a scale indicating a light color of a light source, and its unit is Kelvin (K). A color temperature of a light source is determined by comparing a color of the light source with a theoretical hot blackbody radiator. A Kelvin temperature of the hot blackbody radiator at a time point when the hot blackbody radiator matches the color of the light source is the color temperature of the light source, and the color temperature is directly related to the Planck's blackbody radiation law.
For example, color temperatures of some common light sources are that: a color temperature of standard candlelight is 1930 K, a color temperature of a tungsten filament lamp ranges from 2760 to 2900 K, a color temperature of a fluorescent lamp is 3000 K, a color temperature of a flash is 3800 K, a color temperature of midday sunlight is 5600 K, a color temperature of an electronic flash is 6000 K, and so on. A color temperature of a human facial color may range from a dozen K to dozens K.
The RGB is a color standard, in which various colors are obtained by changing channels of three colors, namely, red (R), green (G), and blue (B), and mutually superimposing them. Therefore, RGB is also referred to as three primary colors, and is represented as red (R), green (G), and blue (B) in English.
In a computer, the so-called “amount” of the RGB is brightness, and is represented by an integer. Usually, each color of the RGB has 256 levels of brightness, represented by a numeral from 0, 1, 2, . . . to 255. Therefore, for each facial image, values of corresponding R, G, and B of the facial image can be determined.
A solution of determining facial color data from a facial image may include a method for processing RGB and a method for processing a color temperature.
Because at different heart rates, a facial color mainly changes from pale to red or from pale to red, the method for processing RGB is extracting red (R) values of all pixels on a facial image, then, obtaining an average, and using the average of the R value as facial color data of the current facial image.
The method for processing a color temperature is first determining averages of R, G, and B of all pixels on a facial image and then substituting, according to a color temperature estimation algorithm, the averages of R, G, and B of the facial image into the color temperature estimation algorithm, to obtain a color temperature of the current facial image.
A unit of a heart rate is beats/minute. Therefore, after obtaining facial images in three consecutive minutes and heart rate data in the three minutes, data collection device 40 can construct a correspondence. In examples of the present disclosure, an example in which each person is tested for three minutes is used for description. Therefore, data in the three minutes is used as data herein, and the three minutes should be understood as a limitation to a test time period.
For ease of description, in this embodiment of the present disclosure, only heart rate data and facial images at intervals of 20 seconds are analyzed. In this embodiment of the present disclosure, according to continuity of motion, a facial image of a user is analyzed once at intervals of 20 seconds, and facial color data, such as R, G, and B values or a color temperature value of the user is obtained from the facial image. A color temperature is used as an example for description below.
TABLE 1
Correspondence between heart rate data and facial color data
Facial image (at intervals of Heart rate data Color
20 seconds) (beats/minute) temperature value (K)
First facial image 72 13
Second facial image 78 16
Third facial image 85 20
Fourth facial image 92 25
Fifth facial image 99 29
Sixth facial image 105 36
Seventh facial image 110 42
Eighth facial image 115 49
Ninth facial image 121 56
The foregoing Table 1 is described by using trending data as an example, and data in a correspondence of each user is subject to actual measured values. Moreover, for ease of description, Table 1 merely lists data at intervals of 20 seconds. Actually, the pieces of data may be consecutive. A relationship between a heart rate and a facial color of a natural person is established by using a relational pair of heart rate data and facial color data (such as a color temperature after quantification). Such a data relationship may be a higher-order curve: y=axn+bxn-1+ . . . +t, where x may be a heart rate, y may be a facial color, or x is a facial color, and y is a heart rate, a, b, and t are constants, and n is an integer greater than or equal to 2.
Each user has one correspondence between facial color data and heart rate data. The correspondence may be indexed by facial images of the user. A process of the indexing is similar to a process of card reading in existing attendance checking. A facial feature of each user is basically unique. Therefore, when the user uses an attendance checking device provided by this application, the attendance checking device collects a facial image of the user, then, performs, according to the facial image of the user, feature comparison with pre-stored facial images of users, and when the facial image of the user matches a pre-stored user facial image, can extract a correspondence between facial color data and heart rate data of the user. Alternatively, after a serial number of the user is determined according to the facial image of the user, a correspondence between facial color data and heart rate data of the user is indexed by using the serial number of the user. This process includes: setting a serial number for the user when recording the user, determining a serial number of a user having attendance checked through the foregoing feature comparison, and then, indexing the correspondence between facial color data and heart rate data of the user according to the serial number.
If FIG. 2 is used to represent a correspondence between a heart rate and a facial color, one corresponding facial color value can be found by using one heart rate value on a curve shown in FIG. 2.
After the foregoing correspondence is established, the correspondence between the facial color data and the heart rate data of the user is stored into the biological feature recognition apparatus in this embodiment of the present disclosure.
As shown in FIG. 3, a biological feature recognition apparatus 40 provided in this embodiment of the present disclosure includes a processor 401, a memory 402, a camera 403, and a heart rate collector 404. When a user is using the biological feature recognition apparatus 40, the user faces toward the camera 403, the camera 403 collects a current facial image of the user on which feature recognition is being performed. The user wears the heart rate collector 404 on a wrist, and a heart rate is collected by using pulses. The heart rate collector 404 is configured to collect current heart rate data of the user. The memory 402 stores a correspondence between facial color data and heart rate data of the user. The correspondence may be understood by referring to corresponding descriptions of FIG. 1 and FIG. 2.
The processor 401 is configured to: obtain the facial image collected by the camera, determine the current facial color data from the current facial image, and obtain current heart rate data of the user from the heart rate collector; determine, according to the facial image of the user, a correspondence between facial color data and heart rate data of the user from pre-stored correspondences between facial color data and heart rate data of a plurality of users, where the process is similar to a process of card reading in existing attendance checking, and a facial feature of each user is basically unique, so that when the user uses an attendance checking device provided by this application, the attendance checking device collects a facial image of the user, then, performs, according to the facial image of the user, feature comparison with pre-stored facial images of users, and when the facial image of the user is matched, can extract a correspondence between facial color data and heart rate data of the user; then, determine whether the obtained current facial color data matches the current heart rate data; and determine that recognition succeeds if the current facial color data matches the current heart rate data and determine that recognition fails if the current facial color data does not match the current heart rate data.
As shown in FIG. 4, if the processor 401 determines that a color temperature value of a current facial color is 29 K, current heart rate data obtained by the processor 401 is 98 beats/minute, and it could be determined, according to that the current facial color is 29 K, from a curve of FIG. 4 that matching heart rate data corresponding to the color temperature value is 99 beats/minute, it could be determined that a heart rate difference between the matching heart rate data and the current heart rate data is 1 beat/minute. If a preset heart rate threshold is 3 beats/minute, indicating that the heart rate difference falls within a preset heart rate threshold range, it could be determined that the current facial color data matches the current heart rate data.
If the processor 401 determines that current heart rate data is 99 beats/minute, a color temperature value of a current facial color obtained by the processor 401 is 28.5 K, and it could be determined, according to that the current heart rate data is 99 beats/minute, from the curve of FIG. 4 that a matching color temperature value corresponding to the current heart rate data is 29 K, it could be determined that a facial color difference between the matching color temperature value and the color temperature value of the current facial color is 0.5 K. If a facial color threshold is 1 K, indicating that the facial color difference falls within a preset facial color threshold range, it could be determined that the current facial color data matches the current heart rate data.
It could be learned from the foregoing description that the solution provided in this embodiment of the present disclosure effectively avoids maliciously using a photograph for facial recognition and improves recognition accuracy of a biological feature recognition apparatus.
The foregoing describes establishing a correspondence between facial color data and heart rate data of a user and an exemplary scenario of using the biological feature recognition apparatus according to this embodiment of the present disclosure in this embodiment of the present disclosure. A biological feature recognition method in this embodiment of the present disclosure is described below with reference to FIG. 5.
As shown in FIG. 5, an embodiment of the biological feature recognition method provided in this embodiment of the present disclosure includes:
501: Obtain a facial image of a user on which feature recognition is being performed and current heart rate data of the user.
502: Determine, according to the facial image, current facial color data of the user and a correspondence between facial color data and heart rate data of the user.
In this embodiment of the present disclosure, a facial image of a user is usually collected by a camera. The camera generally is only in responsible for collecting images. Then, current facial color data of the user can be determined by using the image collected by the camera. This process may be understood by referring to descriptions in the foregoing related parts. Details are not described herein again.
503: Determine, according to the correspondence between the facial color data and the heart rate data of the user, whether the obtained current facial color data matches the current heart rate data.
504: Determine that user recognition succeeds if the current facial color data matches the current heart rate data and determine that user recognition fails if the current facial color data does not match the current heart rate data.
Compared with the existing technology having a problem that a photograph of another person is used for recognition or a photograph is maliciously used for recognition, embodiments of the present disclosure provide a biological feature recognition method, in which recognition succeeds only when current facial color data of a user matches current heart rate data of the user, thereby effectively avoiding a loophole of biological recognition in application and improving recognition accuracy of a biological feature recognition apparatus.
Optionally, in the obtaining a facial image of a user on which feature recognition is being performed, the method may further include:
receiving the correspondence between the facial color data and the heart rate data of the user; and
storing the correspondence, where the correspondence is obtained by collecting in advance corresponding facial color data of the user at different heart rates.
In this embodiment of the present disclosure, the correspondence is established in advance. As described in descriptions of FIG. 1 and FIG. 2, data collection may be first performed and a correspondence may be established for a user whose correspondence between facial color data and heart rate data needs to be recorded. Subsequently, an established correspondence of each user is introduced into a biological feature recognition apparatus. In this way, in subsequent biological feature recognition processes, the correspondence can be directly used for recognition.
Optionally, the determining, according to the correspondence between the facial color data and the heart rate data of the user, whether the obtained current facial color data matches the current heart rate data includes:
searching, according to the current facial color data, the correspondence for matching heart rate data corresponding to the current facial color data;
determining a heart rate difference between the matching heart rate data and the current heart rate data; and
when the heart rate difference falls within a preset heart rate threshold range, determining that the current facial color data matches the current heart rate data.
In this embodiment of the present disclosure, when current facial color data is matched with current heart rate data, matching heart rate data can be determined from a correspondence between facial color data and heart rate data of the user by using the current facial color data, and then, the matching heart rate data is compared with the current heart rate data, to determine a heart rate difference between the matching heart rate data and the current heart rate data. When the heart rate difference falls within a preset heart rate threshold range, it is determined that the current facial color data matches the current heart rate data.
Optionally, the determining, according to the correspondence between the facial color data and the heart rate data of the user, whether the obtained current facial color data matches the current heart rate data includes:
searching, according to the current heart rate data, the correspondence for matching facial color data corresponding to the current heart rate data;
determining a facial color difference between the matching facial color data and the current facial color data; and
when the facial color difference falls within a preset facial color threshold range, determining that the current facial color data matches the current heart rate data.
In this embodiment of the present disclosure, when current facial color data is matched with current heart rate data, matching facial color data can be determined from a correspondence between facial color data and heart rate data of the user by using the current heart rate data, then, the matching facial color data is compared with the current facial color data, to determine a facial color difference between the matching facial color data and the current facial color data.
When the facial color difference falls within a preset facial color threshold range, it is determined that the current facial color data matches the current heart rate data.
The above are the solutions provided several embodiments of the present disclosure. During facial detection and authentication, a current facial color and a heart rate of a user are monitored simultaneously, then, it is determined whether the current facial color and the current heart rate coincide with a correspondence that is trained in advance. If the current facial color and the current heart rate coincide with the correspondence, it could be determined that the user is a normal user. Otherwise, the facial authentication is malicious.
As shown in FIG. 6, an embodiment of a biological feature recognition apparatus 60 provided in this embodiment of the present disclosure includes:
an obtaining unit 601, configured to obtain a facial image of a user on which feature recognition is being performed and current heart rate data of the user;
a first determining unit 602, configured to determine, according to the facial image obtained by the obtaining unit 601, current facial color data of the user and a correspondence between facial color data and heart rate data of the user;
a second determining unit 603, configured to determine, according to the correspondence between the facial color data and the heart rate data of the user determined by the first determining unit 602, whether the current facial color data obtained by the obtaining unit 601 matches the current heart rate data; and
a recognition unit 604, configured to determine that user recognition succeeds if the second determining unit 603 determines that the current facial color data matches the current heart rate data and determine that user recognition fails if the current facial color data does not match the current heart rate data.
In this embodiment of the present disclosure, the obtaining unit 601 obtains a facial image of a user on which feature recognition is being performed and current heart rate data of the user; the first determining unit 602 determines, according to the facial image obtained by the obtaining unit 601, current facial color data of the user and a correspondence between facial color data and heart rate data of the user; the second determining unit 603 determines, according to the correspondence between the facial color data and the heart rate data of the user determined by the first determining unit 602, whether the current facial color data obtained by the obtaining unit 601 matches the current heart rate data; and the recognition unit 604 determines that user recognition succeeds if the second determining unit 603 determines that the current facial color data matches the current heart rate data and determines that user recognition fails if the current facial color data does not match the current heart rate data. Compared with the existing technology having a problem that a photograph of another person is used for recognition or a photograph is maliciously used for recognition, embodiments of the present disclosure provide a biological feature recognition apparatus, in which recognition succeeds only when current facial color data of a user matches current heart rate data of the user, thereby effectively avoiding a loophole of biological recognition in application and improving recognition accuracy of a biological feature recognition apparatus.
Optionally, referring to FIG. 7, in another embodiment of the biological feature recognition apparatus 60 provided in this embodiment of the present disclosure, the apparatus 60 further includes a receiving unit 605 and a storage unit 606.
The receiving unit 605 is configured to receive the correspondence between the facial color data and the heart rate data of the user.
The storage unit 606 is configured to store the correspondence received by the receiving unit, where the correspondence is obtained by collecting in advance corresponding facial color data of the user at different heart rates.
Optionally, the second determining unit 603 is configured to:
searching, according to the current facial color data, the correspondence for matching heart rate data corresponding to the current facial color data;
determining a heart rate difference between the matching heart rate data and the current heart rate data; and
when the heart rate difference falls within a preset heart rate threshold range, determining that the current facial color data matches the current heart rate data.
Optionally, the second determining unit 603 is configured to:
searching, according to the current heart rate data, the correspondence for matching facial color data corresponding to the current heart rate data;
determining a facial color difference between the matching facial color data and the current facial color data; and
when the facial color difference falls within a preset facial color threshold range, determining that the current facial color data matches the current heart rate data.
FIG. 8 is a schematic structural diagram of the biological feature recognition apparatus 60 according to an embodiment of the present disclosure. The biological feature recognition apparatus 60 includes a processor 610, a camera 660, a heart rate collector 670, a memory 650, and a transceiver 630. The camera 660 may be configured to collect a facial image of a user on which feature recognition is being performed. The heart rate collector 670 is configured to collect current heart rate data of the user. The memory 650 may include a read-only memory and a random access memory, and provides an operation instruction and data to the processor 610. A part of the memory 650 may further include a non-transitory random access memory (NVRAM).
In some implementations, the memory 650 stores the following element, executable module, or data structure, or a subset thereof, or an extension set thereof.
In this embodiment of the present disclosure, by invoking the operation instruction (the operation instruction may be stored in an operating system) stored by the memory 650, the biological feature recognition apparatus performs the following steps:
obtaining a facial image of a user on which feature recognition is being performed and current heart rate data of the user;
determining, according to the facial image, current facial color data of the user and a correspondence between facial color data and heart rate data of the user;
determining, according to the correspondence between the facial color data and the heart rate data of the user, whether the obtained current facial color data matches the current heart rate data; and
determining that user recognition succeeds if the current facial color data matches the current heart rate data and determine that user recognition fails if the current facial color data does not match the current heart rate data.
Compared with the existing technology having a problem that a photograph of another person is used for recognition or a photograph is maliciously used for recognition, embodiments of the present disclosure provide a biological feature recognition apparatus, in which recognition succeeds only when current facial color data of a user matches current heart rate data of the user, thereby effectively avoiding a loophole of biological recognition in application and improving recognition accuracy of a biological feature recognition apparatus.
The processor 610 controls an operation of the biological feature recognition apparatus 60, and the processor 610 may also be referred to as a central processing unit (CPU). The memory 650 may include a read-only memory and a random access memory, and provides an instruction and data to the processor 610. A part of the memory 650 may further include a non-transitory random access memory (NVRAM). In a specific application, all components of the biological feature recognition apparatus 60 are coupled by using a bus system 620, and in addition to a data bus, the bus system 620 may further include a power source bus, a control bus, a state signal bus, and the like. However, for ease of clear description, all types of buses in the diagram are marked as the bus system 620.
The method disclosed in the foregoing embodiments of the present disclosure may be applied to the processor 610, or in other words, may be implemented by the processor 610. The processor 610 may be an integrated circuit chip and has a signal processing capability. In an implementation process, steps in the foregoing method may be implemented through a hardware integrated logical circuit in the processor 610, or an instruction in the form of software. The processor 610 may be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), another programmable logic component, a discrete gate or a transistor logic device, and a discrete hardware component, and may implement or execute methods, steps, and logical block diagrams disclosed in the embodiments of the present disclosure. The general-purpose processor may be a micro-processor, or the processor may alternatively be any conventional processor or the like. The steps in the method disclosed in the embodiments of the present disclosure may be directly implemented by a hardware decoding processor, or may be implemented by combining hardware and software modules in a decoding processor. The software module may be located in a mature storage medium in the field, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, or a register. The storage medium is located in the memory 650, and the processor 610 reads information in the memory 650 and performs the steps of the foregoing method in combination with hardware of the processor.
Optionally, the transceiver 630 is configured to receive the correspondence between the facial color data and the heart rate data of the user.
The memory 650 is configured to store the correspondence, where the correspondence is obtained by collecting in advance corresponding facial color data of the user at different heart rates.
Optionally, the processor 610 is further configured to:
search, according to the current facial color data, the correspondence for matching heart rate data corresponding to the current facial color data;
determine a heart rate difference between the matching heart rate data and the current heart rate data; and
when the heart rate difference falls within a preset heart rate threshold range, determine that the current facial color data matches the current heart rate data.
Optionally, the processor 610 is further configured to:
search, according to the current heart rate data, the correspondence for matching facial color data corresponding to the current heart rate data;
determine a facial color difference between the matching facial color data and the current facial color data; and
when the facial color difference falls within a preset facial color threshold range, determine that the current facial color data matches the current heart rate data.
The foregoing biological feature recognition apparatus 60 may be understood by referring to the descriptions of FIG. 1 to FIG. 5. Details are not described herein again.
A person of ordinary skill in the art may understand that all or some of the steps of the method in the embodiments may be implemented by a program instructing relevant hardware. The program may be stored in a computer readable storage medium. The storage medium may include: a ROM, a RAM, a magnetic disk, or an optical disc.
The biological feature recognition method and apparatus provided in the embodiments of the present disclosure are described above in detail. Although the principles and implementations of the present disclosure are described by using specific examples in this specification, the descriptions of the foregoing embodiments are merely intended to help understand the method and the core idea of the method of the present disclosure. Meanwhile, a person of ordinary skill in the art may make modifications to the specific implementations and application range according to the idea of the present disclosure. In conclusion, the content of this specification should not be construed as a limit on the present disclosure.

Claims (12)

What is claimed is:
1. A biological feature recognition method performed at a biological feature recognition apparatus having one or more processors and memory storing a plurality of programs to be executed by the one or more processors, the method comprising:
obtaining, by the biological feature recognition apparatus, (i) a facial image of a user captured by a camera on which feature recognition is being performed and (ii) current heart rate data of the user detected by a heart rate collector;
determining, by the biological feature recognition apparatus according to the facial image, current facial color data of the user and a correspondence between facial color data and heart rate data of the user;
determining, by the biological feature recognition apparatus according to the correspondence between the facial color data and the heart rate data of the user, whether the obtained current facial color data matches the current heart rate data, further including:
estimating the user's heart rate from the obtained current facial color data according to the correspondence between the facial color data and the heart rate data of the user; and
comparing the estimated heart rate with the detected current heart rate data;
in accordance with a determination that the estimated heart rate matches the detected current heart rate data, determining, by the biological feature recognition apparatus, that user recognition succeeds; and
in accordance with a determination that the estimated heart rate does not match the detected current heart rate data, determining, by the biological feature recognition apparatus, that user recognition fails.
2. The method according to claim 1, wherein before the obtaining, by the biological feature recognition apparatus, a facial image of a user on which feature recognition is being performed, the method further comprises:
receiving, by the biological feature recognition apparatus, the correspondence between the facial color data and the heart rate data of the user, wherein the correspondence includes a higher-order curve determined using relational pairs of the heart rate data and the facial color data; and
storing, by the biological feature recognition apparatus, the correspondence, wherein the correspondence is obtained by collecting in advance, by the biological feature recognition apparatus, corresponding facial color data of the user at different heart rates.
3. The method according to claim 1, wherein the determining, by the biological feature recognition apparatus according to the correspondence between the facial color data and the heart rate data of the user, whether the obtained current facial color data matches the current heart rate data comprises:
searching, by the biological feature recognition apparatus according to the current facial color data, the correspondence for matching heart rate data corresponding to the current facial color data;
determining, by the biological feature recognition apparatus, a heart rate difference between the matching heart rate data and the current heart rate data; and
when the heart rate difference falls within a preset heart rate threshold range, determining, by the biological feature recognition apparatus, that the current facial color data matches the current heart rate data.
4. The method according to claim 1, wherein the determining, by the biological feature recognition apparatus according to the correspondence between the facial color data and the heart rate data of the user, whether the obtained current facial color data matches the current heart rate data comprises:
searching, by the biological feature recognition apparatus according to the current heart rate data, the correspondence for matching facial color data corresponding to the current heart rate data;
determining, by the biological feature recognition apparatus, a facial color difference between the matching facial color data and the current facial color data; and
when the facial color difference falls within a preset facial color threshold range, determining, by the biological feature recognition apparatus, that the current facial color data matches the current heart rate data.
5. A biological feature recognition apparatus comprising one or more processors, memory, and a plurality of programs stored in the memory that, when executed by the one or more processors, cause the biological feature recognition apparatus to perform the following operations:
obtaining, by the biological feature recognition apparatus, (i) facial image of a user captured by a camera on which feature recognition is being performed and (ii) current heart rate data of the user detected by a heart rate collector;
determining, by the biological feature recognition apparatus according to the facial image, current facial color data of the user and a correspondence between facial color data and heart rate data of the user;
determining, by the biological feature recognition apparatus according to the correspondence between the facial color data and the heart rate data of the user, whether the obtained current facial color data matches the current heart rate data, further including:
estimating the user's heart rate from the obtained current facial color data according to the correspondence between the facial color data and the heart rate data of the user; and
comparing the estimated heart rate with the detected current heart rate data;
in accordance with a determination that the estimated heart rate matches the detected current heart rate data, determining, by the biological feature recognition apparatus, that user recognition succeeds; and
in accordance with a determination that the estimated heart rate does not match the detected current heart rate data, determining, by the biological feature recognition apparatus, that user recognition fails.
6. The biological feature recognition apparatus according to claim 5, wherein the operations further comprise:
before obtaining, by the biological feature recognition apparatus, a facial image of a user on which feature recognition is being performed:
receiving, by the biological feature recognition apparatus, the correspondence between the facial color data and the heart rate data of the user, wherein the correspondence includes a higher-order curve determined using relational pairs of the heart rate data and the facial color data; and
storing, by the biological feature recognition apparatus, the correspondence, wherein the correspondence is obtained by collecting in advance, by the biological feature recognition apparatus, corresponding facial color data of the user at different heart rates.
7. The biological feature recognition apparatus according to claim 5, wherein the determining, by the biological feature recognition apparatus according to the correspondence between the facial color data and the heart rate data of the user, whether the obtained current facial color data matches the current heart rate data comprises:
searching, by the biological feature recognition apparatus according to the current facial color data, the correspondence for matching heart rate data corresponding to the current facial color data;
determining, by the biological feature recognition apparatus, a heart rate difference between the matching heart rate data and the current heart rate data; and
when the heart rate difference falls within a preset heart rate threshold range, determining, by the biological feature recognition apparatus, that the current facial color data matches the current heart rate data.
8. The biological feature recognition apparatus according to claim 5, wherein the determining, by the biological feature recognition apparatus according to the correspondence between the facial color data and the heart rate data of the user, whether the obtained current facial color data matches the current heart rate data comprises:
searching, by the biological feature recognition apparatus according to the current heart rate data, the correspondence for matching facial color data corresponding to the current heart rate data;
determining, by the biological feature recognition apparatus, a facial color difference between the matching facial color data and the current facial color data; and
when the facial color difference falls within a preset facial color threshold range, determining, by the biological feature recognition apparatus, that the current facial color data matches the current heart rate data.
9. A non-transitory computer readable storage medium, configured to store one or more computer programs, the computer programs comprising one or more processor executable instructions, which, when being executed by a biological feature recognition apparatus having one or more processors, cause the biological feature recognition apparatus to perform the following operations:
obtaining, by the biological feature recognition apparatus, (i) facial image of a user captured by a camera on which feature recognition is being performed and (ii) current heart rate data of the user detected by a heart rate collector;
determining, by the biological feature recognition apparatus according to the facial image, current facial color data of the user and a correspondence between facial color data and heart rate data of the user;
determining, by the biological feature recognition apparatus according to the correspondence between the facial color data and the heart rate data of the user, whether the obtained current facial color data matches the current heart rate data, further including:
estimating the user's heart rate from the obtained current facial color data according to the correspondence between the facial color data and the heart rate data of the user; and
comparing the estimated heart rate with the detected current heart rate data;
in accordance with a determination that the estimated heart rate matches the detected current heart rate data, determining, by the biological feature recognition apparatus, that user recognition succeeds; and
in accordance with a determination that the estimated heart rate does not match the detected current heart rate data, determining, by the biological feature recognition apparatus, that user recognition fails.
10. The non-transitory computer readable storage medium according to claim 9, wherein the operations further comprise:
before obtaining, by the biological feature recognition apparatus, a facial image of a user on which feature recognition is being performed:
receiving, by the biological feature recognition apparatus, the correspondence between the facial color data and the heart rate data of the user, wherein the correspondence includes a higher-order curve determined using relational pairs of the heart rate data and the facial color data; and
storing, by the biological feature recognition apparatus, the correspondence, wherein the correspondence is obtained by collecting in advance, by the biological feature recognition apparatus, corresponding facial color data of the user at different heart rates.
11. The non-transitory computer readable storage medium according to claim 9, wherein the determining, by the biological feature recognition apparatus according to the correspondence between the facial color data and the heart rate data of the user, whether the obtained current facial color data matches the current heart rate data comprises:
searching, by the biological feature recognition apparatus according to the current facial color data, the correspondence for matching heart rate data corresponding to the current facial color data;
determining, by the biological feature recognition apparatus, a heart rate difference between the matching heart rate data and the current heart rate data; and
when the heart rate difference falls within a preset heart rate threshold range, determining, by the biological feature recognition apparatus, that the current facial color data matches the current heart rate data.
12. The non-transitory computer readable storage medium according to claim 9, wherein the determining, by the biological feature recognition apparatus according to the correspondence between the facial color data and the heart rate data of the user, whether the obtained current facial color data matches the current heart rate data comprises:
searching, by the biological feature recognition apparatus according to the current heart rate data, the correspondence for matching facial color data corresponding to the current heart rate data;
determining, by the biological feature recognition apparatus, a facial color difference between the matching facial color data and the current facial color data; and
when the facial color difference falls within a preset facial color threshold range, determining, by the biological feature recognition apparatus, that the current facial color data matches the current heart rate data.
US16/201,701 2016-07-20 2018-11-27 Biological feature recognition method and apparatus, and storage medium Active 2037-12-02 US10824848B2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN201610574489.2A CN107644189B (en) 2016-07-20 2016-07-20 Biological feature recognition method and device
CN201610574489.2 2016-07-20
CN201610574489 2016-07-20
PCT/CN2017/093588 WO2018014851A1 (en) 2016-07-20 2017-07-20 Biological characteristic recognition method and device, and storage medium

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/093588 Continuation WO2018014851A1 (en) 2016-07-20 2017-07-20 Biological characteristic recognition method and device, and storage medium

Publications (2)

Publication Number Publication Date
US20190147223A1 US20190147223A1 (en) 2019-05-16
US10824848B2 true US10824848B2 (en) 2020-11-03

Family

ID=60991946

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/201,701 Active 2037-12-02 US10824848B2 (en) 2016-07-20 2018-11-27 Biological feature recognition method and apparatus, and storage medium

Country Status (4)

Country Link
US (1) US10824848B2 (en)
EP (1) EP3489850B1 (en)
CN (1) CN107644189B (en)
WO (1) WO2018014851A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110555918B (en) * 2018-06-01 2022-04-26 杭州海康威视数字技术股份有限公司 Attendance management method and attendance management equipment
CN110012256A (en) * 2018-10-08 2019-07-12 杭州中威电子股份有限公司 A kind of system of fusion video communication and sign analysis

Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101635743A (en) 2009-04-02 2010-01-27 浙江亚斯特科技有限公司 System and method using biologic characteristic certification result to validate identity of mobile terminal holder
CN103177494A (en) 2013-03-26 2013-06-26 姬志刚 Entrance guard system capable of being opened by door opener in normal state
CN103226857A (en) 2013-03-26 2013-07-31 姬志刚 Gate control all-in-one machine adopting multi-verification to obtain complete open password
CN104102868A (en) 2014-07-31 2014-10-15 中山市品汇创新专利技术开发有限公司 Multi-modal USB key authentication method based on face recognition technology
US8984622B1 (en) 2012-01-17 2015-03-17 Amazon Technologies, Inc. User authentication through video analysis
CN104699931A (en) 2013-12-09 2015-06-10 广州华久信息科技有限公司 Neural network blood pressure prediction method and mobile phone based on human face
CN104809371A (en) 2014-01-24 2015-07-29 北京奇虎科技有限公司 Device and method for determining validity of authentication information of head-wearing intelligent device
CN105188522A (en) 2013-03-08 2015-12-23 富士胶片株式会社 Pulse wave velocity measurement method and system, and imaging device
CN205179369U (en) 2014-11-26 2016-04-20 三星电子株式会社 Be used for with mating wearable equipment of smart machine
US20160110868A1 (en) * 2014-10-20 2016-04-21 Microsoft Corporation Facial Skin Mask Generation for Heart Rate Detection
US20160259492A1 (en) * 2015-03-02 2016-09-08 Emotiv Lifesciences Inc. System and method for embedded cognitive state metric system
US20170120929A1 (en) * 2015-10-30 2017-05-04 Ford Global Technologies, Llc Incapacitated driving detection and prevention
US20170245786A1 (en) * 2016-02-26 2017-08-31 Nelsen YEN Method of measuring the heart rate and respiratory rate of a human being
US20170287325A1 (en) * 2014-11-24 2017-10-05 Echostar Ukraine L.L.C. Remote control with enhanced modularity
US20180028896A1 (en) * 2012-02-10 2018-02-01 Salina Dearing Ray Process to Aid in Motivation of Personal Fitness, Health Monitoring and Validation of User
US20180184959A1 (en) * 2015-04-23 2018-07-05 Sony Corporation Information processing device, control method, and program
US20180203986A1 (en) * 2015-12-31 2018-07-19 Huawei Technologies Co., Ltd. Fingerprint Recognition Method and Apparatus, and Touchscreen Terminal

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9715621B2 (en) * 2014-12-22 2017-07-25 Mcafee, Inc. Systems and methods for real-time user verification in online education
US10154818B2 (en) * 2014-12-24 2018-12-18 Samsung Electronics Co., Ltd. Biometric authentication method and apparatus

Patent Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101635743A (en) 2009-04-02 2010-01-27 浙江亚斯特科技有限公司 System and method using biologic characteristic certification result to validate identity of mobile terminal holder
US8984622B1 (en) 2012-01-17 2015-03-17 Amazon Technologies, Inc. User authentication through video analysis
US20150186711A1 (en) * 2012-01-17 2015-07-02 Amazon Technologies, Inc. User authentication through video analysis
US20180028896A1 (en) * 2012-02-10 2018-02-01 Salina Dearing Ray Process to Aid in Motivation of Personal Fitness, Health Monitoring and Validation of User
CN105188522A (en) 2013-03-08 2015-12-23 富士胶片株式会社 Pulse wave velocity measurement method and system, and imaging device
CN103226857A (en) 2013-03-26 2013-07-31 姬志刚 Gate control all-in-one machine adopting multi-verification to obtain complete open password
CN103177494A (en) 2013-03-26 2013-06-26 姬志刚 Entrance guard system capable of being opened by door opener in normal state
CN104699931A (en) 2013-12-09 2015-06-10 广州华久信息科技有限公司 Neural network blood pressure prediction method and mobile phone based on human face
CN104809371A (en) 2014-01-24 2015-07-29 北京奇虎科技有限公司 Device and method for determining validity of authentication information of head-wearing intelligent device
CN104102868A (en) 2014-07-31 2014-10-15 中山市品汇创新专利技术开发有限公司 Multi-modal USB key authentication method based on face recognition technology
US20160110868A1 (en) * 2014-10-20 2016-04-21 Microsoft Corporation Facial Skin Mask Generation for Heart Rate Detection
US20170287325A1 (en) * 2014-11-24 2017-10-05 Echostar Ukraine L.L.C. Remote control with enhanced modularity
CN205179369U (en) 2014-11-26 2016-04-20 三星电子株式会社 Be used for with mating wearable equipment of smart machine
US20160259492A1 (en) * 2015-03-02 2016-09-08 Emotiv Lifesciences Inc. System and method for embedded cognitive state metric system
US20180184959A1 (en) * 2015-04-23 2018-07-05 Sony Corporation Information processing device, control method, and program
US20170120929A1 (en) * 2015-10-30 2017-05-04 Ford Global Technologies, Llc Incapacitated driving detection and prevention
US20180203986A1 (en) * 2015-12-31 2018-07-19 Huawei Technologies Co., Ltd. Fingerprint Recognition Method and Apparatus, and Touchscreen Terminal
US20170245786A1 (en) * 2016-02-26 2017-08-31 Nelsen YEN Method of measuring the heart rate and respiratory rate of a human being

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Tencent Technology, IPRP, PCT/CN2017/093588, Jan. 22, 2019, 6 pgs.
Tencent Technology, ISRWO, PCT/CN2017/093588, Oct. 18, 2017, 7 pgs.

Also Published As

Publication number Publication date
CN107644189A (en) 2018-01-30
US20190147223A1 (en) 2019-05-16
EP3489850A1 (en) 2019-05-29
WO2018014851A1 (en) 2018-01-25
CN107644189B (en) 2021-02-02
EP3489850B1 (en) 2021-04-14
EP3489850A4 (en) 2020-02-26

Similar Documents

Publication Publication Date Title
RU2711050C2 (en) Image and attribute quality, image enhancement and identification of features for identification by vessels and faces and combining information on eye vessels with information on faces and / or parts of faces for biometric systems
US9830506B2 (en) Method of apparatus for cross-modal face matching using polarimetric image data
CN112432709B (en) Method and system for measuring temperature of human body
Wang et al. Recognizing human faces under disguise and makeup
Aiping et al. Face detection technology based on skin color segmentation and template matching
CN106056083B (en) A kind of information processing method and terminal
US9947105B2 (en) Information processing apparatus, recording medium, and information processing method
US9852324B2 (en) Infrared image based facial analysis
US10824848B2 (en) Biological feature recognition method and apparatus, and storage medium
US10127428B2 (en) Fingerprint identification method and fingerprint identification device
US11410458B2 (en) Face identification method and apparatus, mobile terminal and storage medium
US20140148709A1 (en) System and method for integrating heart rate measurement and identity recognition
CN104063709B (en) Sight line detector and method, image capture apparatus and its control method
US11281922B2 (en) Face recognition system, method for establishing data of face recognition, and face recognizing method thereof
CN111553266A (en) Identification verification method and device and electronic equipment
CN111444555B (en) Temperature measurement information display method and device and terminal equipment
AU2017350177A1 (en) System and method for correcting color of digital image based on the human sclera and pupil
KR101769741B1 (en) Method and apparatus for recognizing iris through pupil detection
CN113837006A (en) Face recognition method and device, storage medium and electronic equipment
IL264041A (en) Personal authentication device
US10990817B2 (en) Method of detecting fraud during iris recognition
CN108366253B (en) Camera function testing method and intelligent module
Choi et al. Performance of the 14 skin-colored patches in accurately estimating human skin color
Hollingsworth et al. Recent research results in iris biometrics
US20220343681A1 (en) Evaluating method and system for face verification, and computer storage medium

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

AS Assignment

Owner name: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED, CHI

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CHEN, JIE;REEL/FRAME:050670/0851

Effective date: 20180709

Owner name: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED, CHINA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CHEN, JIE;REEL/FRAME:050670/0851

Effective date: 20180709

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4