WO2022166207A1 - Face recognition method and apparatus, device, and storage medium - Google Patents

Face recognition method and apparatus, device, and storage medium Download PDF

Info

Publication number
WO2022166207A1
WO2022166207A1 PCT/CN2021/118143 CN2021118143W WO2022166207A1 WO 2022166207 A1 WO2022166207 A1 WO 2022166207A1 CN 2021118143 W CN2021118143 W CN 2021118143W WO 2022166207 A1 WO2022166207 A1 WO 2022166207A1
Authority
WO
WIPO (PCT)
Prior art keywords
face
predetermined
face image
matching degree
image
Prior art date
Application number
PCT/CN2021/118143
Other languages
French (fr)
Chinese (zh)
Inventor
康家梁
卞凯
傅宜生
冀乃庚
Original Assignee
中国银联股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202110175970.5A external-priority patent/CN112818885B/en
Application filed by 中国银联股份有限公司 filed Critical 中国银联股份有限公司
Publication of WO2022166207A1 publication Critical patent/WO2022166207A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures

Definitions

  • the present application relates to the field of computer technology, and in particular, to a face recognition method, apparatus, device, and storage medium.
  • Face recognition is a hot research and application direction in the field of artificial intelligence vision. This technology has been widely used in commercial passenger flow analysis, security monitoring, mobile phone applications, and institutional information verification and comparison.
  • the face recognition scheme in the related art is to calculate the similarity between the face image collected on the spot and each face image in the face database, and the face image collected on the spot is similar to a certain face image in the face database. If the degree is greater than the predetermined threshold, the two are considered to match, otherwise, the two are considered to be unmatched.
  • Embodiments of the present application provide a face recognition method, apparatus, device, and storage medium, which can solve the technical problem of a relatively high risk of misrecognition during face recognition.
  • an embodiment of the present application provides a face recognition method, including:
  • the first M face matching degrees are obtained from the face matching degree sequence, and the face matching degree sequence is the target recognition object and each of the predetermined objects.
  • M is an integer greater than 1
  • the first predetermined condition includes at least one of the following: the target recognition object and a plurality of people of the predetermined object
  • the face matching degree is greater than a first predetermined threshold, and the difference between the maximum face matching degree and the first predetermined threshold is less than a predetermined value;
  • a first object matching the face of the target recognition object is determined from among the plurality of predetermined objects.
  • an embodiment of the present application provides a face recognition device, including:
  • a first acquisition module used for acquiring the first face image of the target recognition object
  • a first determination module configured to determine the face matching degree between the target recognition object and each of the predetermined objects according to the first face image and the face images of each predetermined object in the first face database
  • the second obtaining module is configured to obtain the first M face matching degrees from the face matching degree sequence when the face matching degree satisfies the first predetermined condition, and the face matching degree sequence is the target recognition A sequence obtained by arranging the face matching degrees of the objects and each of the predetermined objects in descending order; M is an integer greater than 1, and the first predetermined condition includes at least one of the following: the target recognition object and multiple The face matching degree of each of the predetermined objects is greater than a first predetermined threshold, and the difference between the largest face matching degree and the first predetermined threshold is less than a predetermined value;
  • the first calculation module is used to calculate the difference between each adjacent two described face matching degrees in the M described face matching degrees, and obtain M-1 difference values;
  • the second determination module is configured to determine, according to the M ⁇ 1 difference values, a first object matching the face of the target recognition object among the plurality of predetermined objects.
  • an embodiment of the present application provides a face recognition device, the device includes: a processor and a memory storing computer program instructions, the processor implements the first aspect when the computer program instructions are executed. face recognition method.
  • an embodiment of the present application provides a computer storage medium, where computer program instructions are stored thereon, and when the computer program instructions are executed by a processor, the face recognition method of the first aspect is implemented.
  • the face recognition method, device, device, and storage medium of the embodiments of the present application after determining the face matching degree between the target recognition object and each predetermined object in the face database, if the target recognition object and multiple predetermined objects appear If the face matching degree is greater than the first predetermined threshold, it means that there are multiple predetermined objects and the face matching degree of the target recognition object is relatively high. Also, if the difference between the maximum face matching degree and the first predetermined threshold is smaller than the predetermined value, it means that the maximum face matching degree is relatively close to the first predetermined threshold. In the above case, there is a risk of misidentification.
  • a larger M face matching degree is obtained, and then, the difference between the matching degrees of each adjacent two faces in the M face matching degree is calculated, and M-1 difference values are obtained; according to the M-1 difference values, A first object matching the face of the target recognition object is determined among the plurality of predetermined objects. Since the face recognition is not only performed by judging whether the maximum face matching degree is greater than the threshold, but more factors are considered in the face recognition process, so that the results of face recognition are more accurate and the risk of misrecognition is reduced.
  • FIG. 1 is a schematic flowchart of an embodiment of a face recognition method provided by the present application.
  • FIG. 2 is a schematic flowchart of another embodiment of a face recognition method provided by the present application.
  • FIG. 3 is a schematic flowchart of another embodiment of a face recognition method provided by the present application.
  • FIG. 4 is a schematic flowchart of still another embodiment of a face recognition method provided by the present application.
  • FIG. 5 is a schematic structural diagram of an embodiment of a face recognition device provided by the present application.
  • FIG. 6 shows a schematic diagram of a hardware structure of an embodiment of a face recognition device provided by the present application.
  • face recognition has been widely used in various fields.
  • the face recognition request is first sent to the biometrics-related platform through the face routing gateway, and then the biometrics-related platform performs face recognition.
  • efficient and accurate recognition services are becoming more and more important.
  • the face image of each predetermined object is pre-stored in the face database.
  • the face image of the target recognition object is first collected, and then, according to the collected face image and the human face
  • the face images of each predetermined object in the face database are used to calculate the face matching degree between the target recognition object and each predetermined object. If there is a face matching degree greater than a certain threshold, the two are considered to match, otherwise, the two are considered not to match.
  • Different recognition strategies may perform different optimizations based on the above process. For example, when performing face retrieval in the face database, if there is only one predetermined face in the face database and the matching degree of the face of the target recognition object exceeds the threshold, it will be considered as not. Risks occur as a result of unambiguous identification matches.
  • the risk of misrecognition is prone to occur, that is, there may be multiple face matching degrees that are all greater than the threshold, or the matching degrees of the faces that are greater than the threshold are relatively close to the threshold. In these cases, misrecognition is prone to occur, leading to a high risk of misidentification of faces.
  • the face recognition device can be a mobile electronic device or a non-mobile electronic device.
  • the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palmtop computer, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (personal digital assistant).
  • UMPC ultra-mobile personal computer
  • netbook or a personal digital assistant
  • non-mobile electronic devices can be servers, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (television, TV), teller machine or self-service machine, etc., this application Examples are not specifically limited.
  • Network Attached Storage NAS
  • personal computer personal computer, PC
  • television television
  • teller machine or self-service machine etc.
  • the face matching degree between the target recognition object and each predetermined object in the first face database After determining the face matching degree between the target recognition object and each predetermined object in the first face database, if the face matching degree between the target recognition object and multiple predetermined objects is greater than the first predetermined threshold, it means that there are multiple predetermined The face matching degree of the object and the target recognition object is relatively high. Also, if the difference between the maximum face matching degree and the first predetermined threshold is smaller than the predetermined value, it means that the maximum face matching degree is relatively close to the first predetermined threshold. For the above cases, there is a risk of misidentification.
  • a larger M face matching degree is obtained, and then, the difference between the matching degrees of each adjacent two faces in the M face matching degree is calculated, and M-1 difference values are obtained; according to the M-1 difference values, A first object matching the face of the target recognition object is determined among the plurality of predetermined objects. Since it is not only to judge whether the maximum face matching degree is greater than the threshold for face recognition, but more factors are considered in the face recognition process, so that the result of face recognition can be made more accurate and the number of misidentifications can be reduced. risk.
  • FIG. 1 is a schematic flowchart of an embodiment of a face recognition method provided by the present application.
  • the face recognition method 100 includes:
  • S102 Acquire a first face image of the target recognition object.
  • the first face image sent from the electronic device may be received.
  • the electronic device collects the user's face, obtains a first face image, and sends the first face image to the face recognition device.
  • the face recognition device receives the first face image sent by the electronic device.
  • the face recognition method 100 further includes: S104, according to the first face image and the face images of each predetermined object in the first face database, determine the face matching degree between the target recognition object and each predetermined object.
  • the similarity between the first face image and the face images of each predetermined object in the first face database may be calculated, and the face matching degree between the target recognition object and each predetermined object is determined according to the similarity.
  • the face recognition method 100 further includes: S106, in the case that the face matching degree satisfies the first predetermined condition, obtain the first M face matching degree from the face matching degree sequence, and the face matching degree sequence is the target recognition object and each face matching degree.
  • the difference between the maximum face matching degree and the first predetermined threshold is less than a predetermined value.
  • the face matching degree between the target recognition object and multiple predetermined objects is greater than the first predetermined threshold, it means that there are multiple predetermined objects and the face matching degree of the target recognition object is relatively high, that is to say, there are many The face of the predetermined object is similar to the face of the target recognition object. In this case, the risk of misidentification is more likely to occur.
  • the difference between the maximum face matching degree and the first predetermined threshold is smaller than the predetermined value, it means that the difference between the maximum face matching degree and the first predetermined threshold is relatively small, for example, the maximum face matching degree is in the first predetermined threshold.
  • the threshold fluctuates within a range of 0.5 above and below the threshold. This situation may be due to the influence of the environment and the angle of collecting face images, resulting in that the matching degree of the target recognition object and each predetermined object is not very high. In this case, the risk of misrecognition is also prone to occur.
  • the calculated face matching degrees are in descending order to obtain a face matching degree sequence, and then, the first M face matching degrees are obtained from the face matching degree sequence.
  • the face recognition method 100 further includes: S108, calculating the difference between the matching degrees of each adjacent two faces in the matching degrees of M faces, and obtaining M-1 difference values;
  • face recognition method can be applied to various scenarios such as payment scenarios, security monitoring, and attendance check-in, which are not limited here.
  • the following describes the face recognition method provided in this application by taking a payment scenario as an example.
  • the electronic device first collects the first face image of the target recognition object, and sends the first face image to the payment server (ie, the face recognition device).
  • the payment server ie, the face recognition device
  • the payment server After the payment server receives the first face image, based on the above-mentioned face recognition method 100, first according to the first face image and the face images of each predetermined object in the first face database, determine the target recognition object and each predetermined object face matching degree; then obtain the first M face matching degree; then, calculate the difference between the matching degrees of every two adjacent faces, and determine the first object matching the face of the target recognition object in a plurality of predetermined objects Finally, according to the result that the target recognition object and the face of the first object are successfully matched, the payment process is performed, and after the payment process is performed, the successful payment result is returned to the electronic device.
  • the electronic device After receiving the successful payment result sent by the payment server, the electronic device displays the payment successful information.
  • each face matching degree there is only the largest face matching degree greater than the first predetermined threshold, and the other face matching degrees are all below the first predetermined threshold, indicating the recognition result of this time. It is relatively reliable, and it can be directly determined that the predetermined object corresponding to the maximum face matching degree is successfully matched with the face of the target recognition object.
  • S110 may include:
  • the predetermined object corresponding to the maximum face matching degree is determined as the first object, wherein the second predetermined condition includes: the first object in the M-1 difference values A difference is greater than a predetermined difference threshold, and the first difference is the difference between the largest face matching degree and the second largest human face matching degree.
  • the predetermined difference threshold may be determined according to multiple positive samples for which face recognition is successful, where the multiple positive samples are multiple face image samples for which face recognition is successful.
  • the predetermined difference threshold is determined according to a plurality of positive samples of successful face recognition, which may specifically include:
  • the similarity difference value with the largest percentage may be counted among the similarity difference values, and the similarity difference value with the largest percentage may be determined as a predetermined difference threshold. For example, if the similarity difference corresponding to 80% of the face image samples is 5 points, 5 is determined as the predetermined difference threshold.
  • the method of determining the predetermined difference threshold is not limited to the above method, and after obtaining the similarity difference corresponding to each face image sample, the average value of the similarity difference corresponding to each face image sample can be calculated, A predetermined difference threshold is obtained.
  • the largest face matching degree ie the first face matching degree
  • the second largest face matching degree ie the second person face matching
  • the second predetermined condition may further include: the second difference value is not greater than the predetermined difference value threshold, and the second difference value is divided by the first difference value among the M-1 difference values outside difference.
  • the second predetermined condition includes: the first difference is greater than the predetermined difference threshold, and the remaining second differences are not greater than the predetermined difference threshold, that is to say, the largest face matching degree is the second largest person
  • the difference between the face matching degrees is relatively large, and the difference between the remaining face matching degrees is relatively small, that is, the overall face matching degree sequence shows a trend of "steep first, smooth subsequent".
  • the identification result of this time is considered to be credible. In this way, the accuracy of the face recognition result can be further guaranteed.
  • the first 5 faces are obtained from the face matching degree sequence. Matching degree, 5 face matching degrees are arranged in descending order.
  • the difference between the first human face matching degree and the second human face matching degree is greater than the predetermined difference threshold, and the difference between the second human face matching degree and the third human face matching degree
  • the difference between the third face matching degree and the fourth face matching degree, and the difference between the fourth face matching degree and the fifth face matching degree are respectively smaller than the predetermined difference thresholds, that is, the five face matching degrees show the "header" Steep, follow-up smooth" change trend, the recognition result is considered credible, and the predetermined object corresponding to the maximum face matching degree is determined to match the target recognition object, otherwise the recognition is considered to be pending.
  • the first two face matching degrees are obtained from the face matching degree sequence. , when the difference between the two face matching degrees is greater than the predetermined difference threshold, the recognition result of this time is considered to be credible, and it is determined that the predetermined object corresponding to the maximum face matching degree matches the target recognition object, otherwise it is considered that this time Identification pending.
  • auxiliary business methods can be carried out in cooperation with the business, such as requiring the user to input additional identity verification information, which includes at least one of the following: registered mobile phone number, ID number, etc.
  • additional identity verification information includes at least one of the following: registered mobile phone number, ID number, etc.
  • a face image of each predetermined object is pre-stored in the first face database, and the face matching degree between the target recognition object and each predetermined object is calculated by comparing a single image. Specifically, the similarity between the face image of the target recognition object and the face image of the predetermined object is determined as the face matching degree.
  • the first face database includes N face images of the same predetermined object, where N is an integer greater than 1.
  • S104 may include:
  • the Euclidean distance between the first face image and each of the N face images can be calculated to obtain the similarity; or, the difference between the first face image and each of the N face images can be calculated. Cosine distance to get similarity.
  • S1044 may specifically include one of the following:
  • the first similarity among the N similarities is greater than the first predetermined threshold
  • the first similarity is determined as the face matching degree between the target recognition object and the predetermined object
  • the first similarity is the first face image and the predetermined object.
  • the average value of at least part of the similarity degrees in the N similarities is determined as the face matching degree between the target recognition object and the predetermined object, and specifically, the average value of the N similarities can be determined as the target recognition object and the predetermined object. Face matching degree, or, multiple similarities greater than a certain threshold can be obtained from the N similarities, and the average value of the multiple similarities can be calculated to obtain the face matching degree;
  • weighted calculation is performed on the N similarities to obtain the face matching degree between the target recognition object and the predetermined object.
  • the first face database includes N face images of predetermined objects, and the N face images include a second face image collected during the face recognition setting, and during the face recognition process Added N-1 face images.
  • the weight value of the similarity between the first face image and the second face image is a1, a1 ⁇ [0, 1], then, the weight value of the similarity between the first face image and other face images i is an integer, and i ⁇ [2,N].
  • the face matching degree between the target recognition object and the predetermined object is: P1 ⁇ a1+P2 ⁇ a2+...PN ⁇ aN, Pi represents the similarity between the first face image and the ith face image in the N face images.
  • the similarity between the first face image and the second face image can be has a larger weight value.
  • the quality of the second face image collected during the face recognition setting is relatively high, specifically, the face angle, face size, face occlusion, closed eyes, Sharpness, pixel size and exposure parameters are within a certain range of parameters.
  • the first face database stores multiple face images of the same predetermined object, and the similarity between the first face image and each face image of the predetermined object is calculated to obtain a plurality of similarities, according to The multiple similarity degrees can accurately determine the face matching degree between the target recognition object and the predetermined object, so that the face recognition can be performed more accurately.
  • the face recognition method may further include:
  • the first face image is added to the first face database as the face image of the first object, wherein the second predetermined threshold is greater than the first predetermined threshold The value of the threshold.
  • the conditions for adding the first face image to the first face database must not only satisfy that the maximum face matching degree is greater than the second predetermined threshold, but also satisfy the following conditions: the face angle of the first face image, the Face size, face occlusion, closed eyes, clarity, pixel size, and exposure parameters are within a certain range of parameters, and after determining the object matching the target recognition object, the business using face recognition (such as payment business) )Completed successfully.
  • the first face database can include multiple face images of the same predetermined object.
  • the face recognition method 100 may further include:
  • a third face image is obtained from the face images of the first object in the first face database, and the third face The image is a face image other than the face image collected during the face recognition setting;
  • the face image with the smallest face matching degree in at least one third human face image is deleted.
  • the face matching degree corresponding to the third face image is: the object in the third face image obtained by recognizing the face in the third face image and the person of the first object face matching.
  • the face images of the first object in the first face database do not need to be deleted.
  • the face image 1 is a face image collected during face recognition setting
  • the face image 2 is a face image added to the first face database during the face recognition process.
  • the face image 3 of the target recognition object and the two face images of the first object determine the face matching degree Y1 between the target recognition object and the first object, and determine the target recognition object and the first object. face matching.
  • the face image 3 may be added to the first face database as the face image of the first object. In this way, the first face database has three face images of the first object.
  • the face image with the face image 4 as the first object may be added to the first face database.
  • the number of face images of the first object in the first face database is greater than the predetermined number threshold of 3, it is necessary to delete a face image of the first object, so that the face images of the first object in the first face database
  • the number is equal to the predetermined number threshold of three.
  • the face matching degree is the above-mentioned Y1
  • the face matching degree corresponding to the face image 4 is the above-mentioned Y1.
  • face images 2 to 4 the face image with the smallest face matching degree is deleted.
  • face images with poor quality in the first face database are deleted.
  • face images in the first face database are continuously updated, and the better-quality face images are saved. face image.
  • the accuracy of the face recognition result can be guaranteed.
  • the face image collected during face recognition setting (such as face image 1 in the above example) does not participate in the update of the first face database, but the face image ( For example, face image 2 to face image 4) in the above example participate in the update of the first face database.
  • the face recognition method 100 may further include:
  • the target recognition object matches the first object, the similarity between the first face image of the target recognition object and the fourth face image of the first object in the first face database is small.
  • the value of the first parameter corresponding to the fourth face image is increased by 1, that is, the number of mismatches of the fourth face image is increased by 1.
  • the value of the first parameter is greater than the predetermined threshold of the first number of times, it may be because the face matching of the fourth face image is too high due to individual angles and other reasons in the face recognition process, which leads to the fourth The face image was mistakenly added to the first face database.
  • the fourth face image can be deleted from the first face database, so that the face image added to the first face database by mistake can be deleted, so as to continuously optimize the first face database.
  • the face recognition method 100 may further include: in the case that the M-1 difference values do not satisfy the second predetermined condition, obtaining the identity verification information (such as the input of the target recognition object) ID number or verification code), and identify the target identification object according to the identity verification information.
  • identity verification information such as the input of the target recognition object ID number or verification code
  • the above-mentioned first face image and the face images of each predetermined object in the first face database may be two-dimensional Red Green Blue (RGB) face image.
  • RGB Red Green Blue
  • the second person including the three-dimensional face image can be face database for recognition.
  • the second face database can be pre-built.
  • three-dimensional face images may be collected when the user performs face recognition settings, so as to construct a second face database.
  • the camera hardware of the electronic device is different. If the hardware of the electronic device does not support the acquisition of three-dimensional face images, the three-dimensional face images of the predetermined objects in the second face database are empty. If the electronic device collects the three-dimensional face image of the predetermined object, and the collected three-dimensional face image meets the quality requirements, the collected three-dimensional face image is saved to the second face database.
  • each three-dimensional face image in the second face database corresponds to the second parameter value 3D_OKR one-to-one.
  • the second parameter value 3D_OKR corresponding to the three-dimensional face image represents the number of times of successful face recognition using the three-dimensional face image.
  • the initial value of the second parameter value 3D_OKR corresponding to the three-dimensional face image is 0.
  • the second parameter value 3D_OKR corresponding to a 3D face image is greater than the predetermined second time threshold POSITIVE_MAX_3DOKR, it means that the 3D face image is used for more successful face recognition, and the 3D face image is credible of. Therefore, if the recognition is successful according to the 3D face image, it is not necessary to additionally obtain the identity verification information input by the target recognition object for recognition, but the recognition result of the 3D face image can be used.
  • the second time threshold POSITIVE_MAX_3DOKR takes a value of 0, it means that the step of obtaining the identity verification information input by the target recognition object for recognition is omitted, and the 3D image-assisted recognition strategy can be directly used.
  • the face recognition method 100 may further include:
  • the first three-dimensional face image is successfully matched with the second three-dimensional face image of the second object in the second face database, and the second parameter value corresponding to the second three-dimensional face image is greater than the predetermined second time threshold. In this case, it is determined that the target recognition object matches the face of the second object.
  • the second object and the first object may be the same object, or may be different objects.
  • the sensorless verification can be performed assisted by the three-dimensional face image in the second face database, so as to reduce the user's input and perception, and improve the user experience.
  • the face recognition method 100 may further include:
  • the second parameter value 3D_OKR is not greater than the second threshold POSITIVE_MAX_3DOKR, obtain the identity verification information of the target recognition object, and the identity verification information is information other than face information;
  • the second parameter value 3D_OKR is decreased by 1.
  • the recognition result using the identity verification information is consistent with the face recognition result using the first three-dimensional face image, which may specifically include:
  • the identity verification information is successfully matched with the predetermined identity information of the second object, and the first three-dimensional face image is successfully matched with the second three-dimensional face image of the second object in the second face database;
  • the identity verification information does not match the predetermined identity information of the second object, and the first three-dimensional face image does not match the second three-dimensional face image of the second object in the second face database.
  • the face recognition result using the first three-dimensional face image is inconsistent with the recognition result using the identity verification information, which may specifically include:
  • the identity verification information does not match the predetermined identity information of the second object, and the first three-dimensional face image is successfully matched with the second three-dimensional face image of the second object in the second face database;
  • the identity verification information is successfully matched with the predetermined identity information of the second object, and the first three-dimensional face image does not match the second three-dimensional face image of the second object in the second face database.
  • the face recognition method 100 may further include:
  • the second parameter value 3D_OKR after subtracting 1 is smaller than the predetermined third threshold of times NEGATIVE_MAX_3DOKR, it means that the number of times of face recognition failure by using the second three-dimensional face image is relatively high, then delete the third face database in the second face database. 2D and 3D face images. In this way, the second face database is continuously updated, thereby continuously improving the quality of the three-dimensional face images in the second face database, and reducing the risk of using the three-dimensional face images in the second face database for face recognition.
  • the third time threshold NEGATIVE_MAX_3DOKR is smaller than the second time threshold POSITIVE_MAX_3DOKR.
  • FIG. 5 is a schematic structural diagram of an embodiment of a face recognition device provided by the present application.
  • the face recognition device 200 includes:
  • the first obtaining module 202 is used for obtaining the first face image of the target recognition object
  • the first determination module 204 is used to determine the face matching degree between the target recognition object and each predetermined object according to the first face image and the face image of each predetermined object in the first face database;
  • the second obtaining module 206 is configured to obtain the first M face matching degrees from the face matching degree sequence when the face matching degree satisfies the first predetermined condition, and the face matching degree sequence is the target recognition object and each predetermined object M is an integer greater than 1, and the first predetermined condition includes at least one of the following: the face matching degree of the target recognition object and a plurality of predetermined objects is greater than the first a predetermined threshold, the difference between the maximum face matching degree and the first predetermined threshold is less than a predetermined value;
  • the first calculation module 208 is used to calculate the difference between the matching degrees of each adjacent two faces in the M face matching degrees, and obtain M-1 difference values;
  • the second determining module 210 is configured to determine, according to the M ⁇ 1 difference values, a first object matching the face of the target recognition object among the plurality of predetermined objects.
  • the second determining module 210 may specifically be used to:
  • the predetermined object corresponding to the maximum face matching degree is determined as the first object, wherein the second predetermined condition includes: the first object in the M-1 difference values A difference is greater than a predetermined difference threshold, and the first difference is the difference between the largest face matching degree and the second largest human face matching degree.
  • the largest face matching degree ie the first face matching degree
  • the second largest face matching degree ie the second face matching degree
  • the predetermined difference threshold it can be considered that the face recognition result is more credible, and the largest face matching degree is determined.
  • the predetermined object corresponding to the degree matches the first object.
  • the second predetermined condition further includes: the second difference value is not greater than a predetermined difference value threshold, and the second difference value is in addition to the first difference value among M-1 difference values difference value.
  • the second predetermined condition includes: the first difference is greater than the predetermined difference threshold, and the remaining second differences are not greater than the predetermined difference threshold, that is to say, the largest face matching degree is the second largest person
  • the difference between the face matching degrees is relatively large, and the difference between the remaining face matching degrees is relatively small, that is, the overall face matching degree sequence shows a trend of "steep first, smooth subsequent".
  • the identification result of this time is considered to be credible. In this way, the accuracy of the face recognition result can be further guaranteed.
  • the first determining module 204 may include:
  • the first calculation unit is used to calculate the similarity between the first face image and each face image in the N face images for N face images of the same predetermined object in the first face database, and obtain N similarities degree, N is an integer greater than 1;
  • the first determining unit is configured to determine, according to the N similarities, the degree of face matching between the target recognition object and the predetermined object.
  • the first face database stores multiple face images of the same predetermined object, and the similarity between the first face image and each face image of the predetermined object is calculated to obtain a plurality of similarities, according to The multiple similarity degrees can accurately determine the face matching degree between the target recognition object and the predetermined object, so that the face recognition can be performed more accurately.
  • the first determining unit may include one of the following:
  • a first determination subunit used for determining the maximum similarity among the N similarities as the face matching degree between the target recognition object and the predetermined object
  • the second determination subunit is configured to determine the first similarity as the face matching degree between the target recognition object and the predetermined object when the first similarity among the N similarities is greater than the first predetermined threshold, and the first similarity is The degree is the similarity between the first face image and the second face image in the plurality of face images, and the second face image is the face image collected when the face recognition setting is performed;
  • a third determination subunit configured to determine the average value of at least part of the similarity among the N similarities as the face matching degree between the target recognition object and the predetermined object;
  • the fourth determination subunit is configured to perform weighted calculation on the N similarities according to the weight value of each similarity in the N similarities, so as to obtain the face matching degree between the target recognition object and the predetermined object.
  • the face recognition apparatus 200 may further include:
  • the adding module is configured to add the first face image as the face image of the first object to the first face database when the maximum face matching degree is greater than the second predetermined threshold, wherein the second predetermined threshold is a value greater than the first predetermined threshold.
  • the face recognition apparatus 200 may further include:
  • a third acquisition module configured to acquire a third person from the face images of the first object in the first face database when the number of face images of the first object in the first face database is greater than a predetermined number threshold face image, the third face image is a face image other than the face image collected during face recognition setting;
  • the first deletion module is used to delete the face image with the smallest face matching degree in at least one third face image according to the face matching degree corresponding to each third face image, wherein the third face image corresponds to the face image.
  • the face matching degree is: the face matching degree between the object in the third face image and the first object obtained by recognizing the face in the third face image.
  • the face images with poor quality in the first face database can be deleted, so that the face images in the first face database are continuously updated, and the face images with better quality are saved.
  • the accuracy of the face recognition result can be guaranteed.
  • the face recognition apparatus 200 may further include:
  • the third determining module is configured to determine, in the face image of the first object in the first face database, whether there is a fourth face image whose similarity with the first face image is less than a third predetermined threshold, the third predetermined The threshold is a value smaller than the first predetermined threshold;
  • the second calculation module is configured to add 1 to the first parameter value corresponding to the fourth human face image in the presence of the fourth human face image, where the first parameter value represents the relationship between the fourth human face image and at least one target recognition object The number of mismatches between the first face images;
  • the second deletion module is configured to delete the fourth human face image from the first human face database when the value of the first parameter is greater than the predetermined threshold of the first number of times.
  • the target recognition object matches the first object, the similarity between the first face image of the target recognition object and the fourth face image of the first object in the first face database is small.
  • the value of the first parameter corresponding to the fourth face image is increased by 1, that is, the number of mismatches of the fourth face image is increased by 1.
  • the value of the first parameter is greater than the predetermined threshold of the first number of times, it may be because the face matching of the fourth face image is too high due to individual angles and other reasons in the face recognition process, which leads to the fourth The face image was mistakenly added to the first face database.
  • the fourth face image can be deleted from the first face database, so that the face image added to the first face database by mistake can be deleted, so as to continuously optimize the first face database.
  • the face recognition apparatus 200 may further include:
  • a fourth acquisition module configured to acquire the first three-dimensional face image of the target recognition object when the M-1 differences do not meet the second predetermined condition
  • a matching module for matching the first three-dimensional face image with the three-dimensional face image of the predetermined object in the second face database
  • the fourth determination module is used to successfully match the first three-dimensional face image with the second three-dimensional face image of the second object in the second face database, and the second parameter value corresponding to the second three-dimensional face image is greater than a predetermined value.
  • the second number of times threshold it is determined that the target recognition object matches the face of the second object, wherein the second parameter value represents the number of successful face recognition using the second three-dimensional face image.
  • the sensorless verification can be performed assisted by the three-dimensional face image in the second face database, so as to reduce the user's input and perception, and improve the user experience.
  • the face recognition apparatus 200 may further include:
  • a fifth acquisition module configured to acquire the identity verification information of the target identification object when the second parameter value is not greater than the second number of times threshold
  • the identification module is used to identify the identity by using the identity verification information to obtain the identification result;
  • the third computing module is used to add 1 to the second parameter value when the recognition result using the identity verification information is consistent with the face recognition result using the first three-dimensional face image;
  • the fourth calculation module is configured to reduce the value of the second parameter by 1 when the face recognition result using the first three-dimensional face image is inconsistent with the recognition result using the identity verification information.
  • the face recognition apparatus 200 may further include:
  • a third deletion module configured to delete the second three-dimensional face image in the second face database when the second parameter value after subtracting 1 is less than a predetermined third threshold of times, and the The third threshold of times is smaller than the second threshold of times.
  • the second face database can be continuously updated, thereby continuously improving the quality of the three-dimensional face images in the second face database, and reducing the risk of using the three-dimensional face images in the second face database for face recognition.
  • the present application also provides a face recognition device comprising: a processor and a memory storing computer program instructions, the processor implements the steps of any one of the above-mentioned face recognition method embodiments when the processor executes the computer program instructions.
  • FIG. 6 shows a schematic diagram of a hardware structure of an embodiment of a face recognition device provided by the present application.
  • the face recognition device may include a processor 301 and a memory 302 storing computer program instructions.
  • the above-mentioned processor 301 may include a central processing unit (CPU), or a specific integrated circuit (Application Specific Integrated Circuit, ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.
  • CPU central processing unit
  • ASIC Application Specific Integrated Circuit
  • Memory 302 may include mass storage for data or instructions.
  • memory 302 may include a Hard Disk Drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a Universal Serial Bus (USB) drive or two or more A combination of more than one of the above.
  • Memory 302 may include removable or non-removable (or fixed) media, where appropriate.
  • Storage 302 may be internal or external to the integrated gateway disaster recovery device, where appropriate.
  • memory 302 is non-volatile solid state memory.
  • Memory may include read only memory (ROM), random access memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical or other physical/tangible memory storage devices.
  • ROM read only memory
  • RAM random access memory
  • magnetic disk storage media devices e.g., magnetic disks
  • optical storage media devices e.g., magnetic disks
  • flash memory devices e.g., electrical, optical or other physical/tangible memory storage devices.
  • a memory includes one or more tangible (non-transitory) computer-readable storage media (eg, memory devices) encoded with software including computer-executable instructions, and when the software is executed (eg, by a or multiple processors), it is operable to perform the operations described with reference to a method according to an aspect of the present disclosure.
  • the processor 301 reads and executes the computer program instructions stored in the memory 302 to implement any one of the face recognition methods in the foregoing embodiments.
  • the facial recognition device may also include a communication interface 303 and a bus 310 .
  • the processor 301 , the memory 302 , and the communication interface 303 are connected through the bus 310 and complete the mutual communication.
  • the communication interface 303 is mainly used to implement communication between modules, apparatuses, units and/or devices in the embodiments of the present application.
  • bus 310 includes hardware, software, or both, coupling the components of the online data flow metering device to each other.
  • bus 310 may include Accelerated Graphics Port (AGP) or other graphics bus, Enhanced Industry Standard Architecture (EISA) bus, Front Side Bus (FSB), HyperTransport (HT) interconnect, Industry Standard Architecture (ISA) ) bus, Infiniband Interconnect, Low Pin Count (LPC) bus, Memory Bus, Microchannel Architecture (MCA) bus, Peripheral Component Interconnect (PCI) bus, PCI-Express (PCI-X) bus, Serial Advanced Technology Attachment (SATA) bus, Video Electronics Standards Association Local (VLB) bus or other suitable bus or a combination of two or more of the above.
  • Bus 310 may include one or more buses, where appropriate. Although embodiments herein describe and illustrate a particular bus, this application contemplates any suitable bus or interconnect.
  • the embodiment of the present application may provide a computer storage medium for implementation.
  • Computer program instructions are stored on the computer storage medium; when the computer program instructions are executed by the processor, any one of the face recognition methods in the foregoing embodiments is implemented.
  • Examples of computer-readable storage media shown include non-transitory computer-readable storage media, such as read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk, etc. .
  • the functional blocks shown in the above-described structural block diagrams may be implemented as hardware, software, firmware, or a combination thereof.
  • it When implemented in hardware, it may be, for example, an electronic circuit, an application specific integrated circuit (ASIC), suitable firmware, a plug-in, a function card, or the like.
  • ASIC application specific integrated circuit
  • elements of the present application are programs or code segments used to perform the required tasks.
  • the program or code segments may be stored in a machine-readable medium or transmitted over a transmission medium or communication link by a data signal carried in a carrier wave.
  • a "machine-readable medium” may include any medium that can store or transmit information.
  • Machine-readable media may include non-transitory computer-readable storage media, such as including electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, machine
  • the readable medium may also include a radio frequency (RF) link, among others.
  • the code segments may be downloaded via a computer network such as the Internet, an intranet, or the like.
  • processors may be, but are not limited to, general purpose processors, special purpose processors, application specific processors, or field programmable logic circuits. It will also be understood that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can also be implemented by special purpose hardware for performing the specified functions or actions, or by special purpose hardware and/or A combination of computer instructions is implemented.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Image Analysis (AREA)
  • Collating Specific Patterns (AREA)
  • Chair Legs, Seat Parts, And Backrests (AREA)
  • Controlling Rewinding, Feeding, Winding, Or Abnormalities Of Webs (AREA)
  • Telephone Function (AREA)

Abstract

The present application discloses a face recognition method and apparatus, a device, and a storage medium. The face recognition method comprises: obtaining a first face image of a target recognition object; determining a face matching degree between the target recognition object and each predetermined object according to the first face image and a face image of each predetermined object in a first face library; when the face matching degree satisfies a first predetermined condition, obtaining first M face matching degrees from a face matching degree sequence, wherein the first predetermined condition comprises at least one of the following: the face matching degrees between the target recognition object and the plurality of predetermined objects are greater than a first predetermined threshold, and a difference between the maximum face matching degree and the first predetermined threshold is less than a predetermined value; calculating a difference between every two adjacent face matching degrees in the M face matching degrees to obtain M-1 differences; and according to the M-1 differences, determining, in the plurality of predetermined objects, a first object matched with the face of the target recognition object. The face recognition method disclosed in the present application can reduce the risk of misrecognition.

Description

人脸识别方法、装置、设备及存储介质Face recognition method, device, equipment and storage medium
相关申请的交叉引用CROSS-REFERENCE TO RELATED APPLICATIONS
本申请要求享有于2021年2月07日提交的名称为“人脸识别方法、装置、设备及存储介质”的中国专利申请202110175970.5的优先权,该申请的全部内容通过引用并入本文中。This application claims the priority of Chinese Patent Application No. 202110175970.5 filed on February 07, 2021, entitled "Facial Recognition Method, Apparatus, Equipment and Storage Medium", the entire content of which is incorporated herein by reference.
技术领域technical field
本申请涉及计算机技术领域,特别是涉及一种人脸识别方法、装置、设备及存储介质。The present application relates to the field of computer technology, and in particular, to a face recognition method, apparatus, device, and storage medium.
背景技术Background technique
人脸识别是人工智能视觉领域的热点研究和应用方向,该技术现已被广泛应用于商业客流分析、安防监控、手机应用、机构信息验证比对等场景。Face recognition is a hot research and application direction in the field of artificial intelligence vision. This technology has been widely used in commercial passenger flow analysis, security monitoring, mobile phone applications, and institutional information verification and comparison.
相关技术中的人脸识别方案是将现场采集的人脸图像与人脸库中的各个人脸图像进行相似度计算,在现场采集的人脸图像与人脸库中的某个人脸图像的相似度大于预定阈值的情况下,则认为两者匹配,否则,认为两者不匹配。The face recognition scheme in the related art is to calculate the similarity between the face image collected on the spot and each face image in the face database, and the face image collected on the spot is similar to a certain face image in the face database. If the degree is greater than the predetermined threshold, the two are considered to match, otherwise, the two are considered to be unmatched.
但是,上述人脸识别的方案较为简单,出现误识别的风险比较高。However, the above face recognition scheme is relatively simple, and the risk of misrecognition is relatively high.
发明内容SUMMARY OF THE INVENTION
本申请实施例提供一种人脸识别方法、装置、设备及存储介质,能够解决在人脸识别时出现误识别的风险比较高的技术问题。Embodiments of the present application provide a face recognition method, apparatus, device, and storage medium, which can solve the technical problem of a relatively high risk of misrecognition during face recognition.
第一方面,本申请实施例提供一种人脸识别方法,包括:In a first aspect, an embodiment of the present application provides a face recognition method, including:
获取目标识别对象的第一人脸图像;Obtain the first face image of the target recognition object;
根据所述第一人脸图像以及第一人脸库中各个预定对象的人脸图像, 确定所述目标识别对象与各个所述预定对象的人脸匹配度;Determine, according to the first face image and the face images of each predetermined object in the first face database, the degree of face matching between the target recognition object and each of the predetermined objects;
在所述人脸匹配度满足第一预定条件的情况下,从人脸匹配度序列中获取前M个人脸匹配度,所述人脸匹配度序列为所述目标识别对象与各个所述预定对象的人脸匹配度按照从大到小的顺序排列得到的序列;M为大于1的整数,所述第一预定条件包括以下至少一项:所述目标识别对象与多个所述预定对象的人脸匹配度大于第一预定阈值,最大的所述人脸匹配度与所述第一预定阈值的差值小于预定数值;In the case that the face matching degree satisfies the first predetermined condition, the first M face matching degrees are obtained from the face matching degree sequence, and the face matching degree sequence is the target recognition object and each of the predetermined objects. M is an integer greater than 1, and the first predetermined condition includes at least one of the following: the target recognition object and a plurality of people of the predetermined object The face matching degree is greater than a first predetermined threshold, and the difference between the maximum face matching degree and the first predetermined threshold is less than a predetermined value;
计算M个所述人脸匹配度中的每相邻两个所述人脸匹配度的差值,得到M-1个差值;Calculate the difference value of each adjacent two described human face matching degrees in the M described human face matching degrees, and obtain M-1 difference values;
根据所述M-1个差值,在多个所述预定对象中确定与所述目标识别对象的人脸匹配的第一对象。According to the M-1 difference values, a first object matching the face of the target recognition object is determined from among the plurality of predetermined objects.
第二方面,本申请实施例提供了一种人脸识别装置,包括:In a second aspect, an embodiment of the present application provides a face recognition device, including:
第一获取模块,用于获取目标识别对象的第一人脸图像;a first acquisition module, used for acquiring the first face image of the target recognition object;
第一确定模块,用于根据所述第一人脸图像以及第一人脸库中各个预定对象的人脸图像,确定所述目标识别对象与各个所述预定对象的人脸匹配度;a first determination module, configured to determine the face matching degree between the target recognition object and each of the predetermined objects according to the first face image and the face images of each predetermined object in the first face database;
第二获取模块,用于在所述人脸匹配度满足第一预定条件的情况下,从人脸匹配度序列中获取前M个人脸匹配度,所述人脸匹配度序列为所述目标识别对象与各个所述预定对象的人脸匹配度按照从大到小的顺序排列得到的序列;M为大于1的整数,所述第一预定条件包括以下至少一项:所述目标识别对象与多个所述预定对象的人脸匹配度大于第一预定阈值,最大的所述人脸匹配度与所述第一预定阈值的差值小于预定数值;The second obtaining module is configured to obtain the first M face matching degrees from the face matching degree sequence when the face matching degree satisfies the first predetermined condition, and the face matching degree sequence is the target recognition A sequence obtained by arranging the face matching degrees of the objects and each of the predetermined objects in descending order; M is an integer greater than 1, and the first predetermined condition includes at least one of the following: the target recognition object and multiple The face matching degree of each of the predetermined objects is greater than a first predetermined threshold, and the difference between the largest face matching degree and the first predetermined threshold is less than a predetermined value;
第一计算模块,用于计算M个所述人脸匹配度中的每相邻两个所述人脸匹配度的差值,得到M-1个差值;The first calculation module is used to calculate the difference between each adjacent two described face matching degrees in the M described face matching degrees, and obtain M-1 difference values;
第二确定模块,用于根据所述M-1个差值,在多个所述预定对象中确定与所述目标识别对象的人脸匹配的第一对象。The second determination module is configured to determine, according to the M−1 difference values, a first object matching the face of the target recognition object among the plurality of predetermined objects.
第三方面,本申请实施例提供了一种人脸识别设备,所述设备包括:处理器以及存储有计算机程序指令的存储器,所述处理器执行所述计算机程序指令时实现第一方面的人脸识别方法。In a third aspect, an embodiment of the present application provides a face recognition device, the device includes: a processor and a memory storing computer program instructions, the processor implements the first aspect when the computer program instructions are executed. face recognition method.
第四方面,本申请实施例提供了一种计算机存储介质,所述计算机存储介质上存储有计算机程序指令,所述计算机程序指令被处理器执行时实现第一方面的人脸识别方法。In a fourth aspect, an embodiment of the present application provides a computer storage medium, where computer program instructions are stored thereon, and when the computer program instructions are executed by a processor, the face recognition method of the first aspect is implemented.
根据本申请实施例的人脸识别方法、装置、设备及存储介质,在确定目标识别对象与人脸库中各个预定对象的人脸匹配度之后,如果出现目标识别对象与多个预定对象的人脸匹配度大于第一预定阈值,则说明有多个预定对象与目标识别对象的人脸匹配度较高。还有如果出现最大的人脸匹配度与第一预定阈值的差值小于预定数值,则说明最大的人脸匹配度与第一预定阈值比较接近。在上述情况中,容易出现误识别的风险。因此,获取较大的M个人脸匹配度,然后,计算M个人脸匹配度中的每相邻两个人脸匹配度的差值,得到M-1个差值;根据M-1个差值,在多个预定对象中确定与目标识别对象的人脸匹配的第一对象。由于并非仅判断最大的人脸匹配度是否大于阈值来进行人脸识别,而是在人脸识别过程中考虑了更多的因素,使得人脸识别的结果更加准确,减少误识别的风险。According to the face recognition method, device, device, and storage medium of the embodiments of the present application, after determining the face matching degree between the target recognition object and each predetermined object in the face database, if the target recognition object and multiple predetermined objects appear If the face matching degree is greater than the first predetermined threshold, it means that there are multiple predetermined objects and the face matching degree of the target recognition object is relatively high. Also, if the difference between the maximum face matching degree and the first predetermined threshold is smaller than the predetermined value, it means that the maximum face matching degree is relatively close to the first predetermined threshold. In the above case, there is a risk of misidentification. Therefore, a larger M face matching degree is obtained, and then, the difference between the matching degrees of each adjacent two faces in the M face matching degree is calculated, and M-1 difference values are obtained; according to the M-1 difference values, A first object matching the face of the target recognition object is determined among the plurality of predetermined objects. Since the face recognition is not only performed by judging whether the maximum face matching degree is greater than the threshold, but more factors are considered in the face recognition process, so that the results of face recognition are more accurate and the risk of misrecognition is reduced.
附图说明Description of drawings
为了更清楚地说明本申请实施例的技术方案,下面将对本申请实施例中所需要使用的附图作简单地介绍,显而易见地,下面所描述的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the technical solutions of the embodiments of the present application more clearly, the following briefly introduces the drawings required in the embodiments of the present application. Obviously, the drawings described below are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.
图1是本申请提供的一种人脸识别方法的一实施例的流程示意图。FIG. 1 is a schematic flowchart of an embodiment of a face recognition method provided by the present application.
图2是本申请提供的一种人脸识别方法的另一实施例的流程示意图。FIG. 2 is a schematic flowchart of another embodiment of a face recognition method provided by the present application.
图3是本申请提供的一种人脸识别方法的又一实施例的流程示意图。FIG. 3 is a schematic flowchart of another embodiment of a face recognition method provided by the present application.
图4是本申请提供的一种人脸识别方法的再一实施例的流程示意图。FIG. 4 is a schematic flowchart of still another embodiment of a face recognition method provided by the present application.
图5是本申请提供的一种人脸识别装置的一实施例的结构示意图。FIG. 5 is a schematic structural diagram of an embodiment of a face recognition device provided by the present application.
图6示出了本申请提供的人脸识别设备的一实施例的硬件结构示意图。FIG. 6 shows a schematic diagram of a hardware structure of an embodiment of a face recognition device provided by the present application.
具体实施方式Detailed ways
下面将详细描述本申请的各个方面的特征和示例性实施例,为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及具体实施例,对本申请进行进一步详细描述。应理解,此处所描述的具体实施例仅意在解释本申请,而不是限定本申请。对于本领域技术人员来说,本申请可以在不需要这些具体细节中的一些细节的情况下实施。下面对实施例的描述仅仅是为了通过示出本申请的示例来提供对本申请更好的理解。The features and exemplary embodiments of various aspects of the present application will be described in detail below. In order to make the purpose, technical solutions and advantages of the present application more clear, the present application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present application, but not to limit the present application. It will be apparent to those skilled in the art that the present application may be practiced without some of these specific details. The following description of the embodiments is merely to provide a better understanding of the present application by illustrating examples of the present application.
需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括……”限定的要素,并不排除在包括要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that, in this document, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any relationship between these entities or operations. any such actual relationship or sequence exists. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device that includes a list of elements includes not only those elements, but also includes not explicitly listed or other elements inherent to such a process, method, article or apparatus. Without further limitation, an element defined by the phrase "comprising" does not preclude the presence of additional identical elements in the process, method, article or device that includes the element.
随着人脸识别技术的发展,人脸识别已经广泛应用于各个领域。在人脸识别过程中,人脸识别请求先通过人脸路由网关,送至生物特征识别相关平台,然后由生物特征识别相关平台进行人脸识别。在人脸识别过程中,高效、准确的识别服务越来越重要。With the development of face recognition technology, face recognition has been widely used in various fields. In the face recognition process, the face recognition request is first sent to the biometrics-related platform through the face routing gateway, and then the biometrics-related platform performs face recognition. In the face recognition process, efficient and accurate recognition services are becoming more and more important.
在相关技术中,人脸库中预先存储各个预定对象的人脸图像,在对目标识别对象进行人脸识别时,先采集目标识别对象的人脸图像,然后,根据采集的人脸图像和人脸库中各个预定对象的人脸图像,计算目标识别对象与各个预定对象的人脸匹配度。如果有一个人脸匹配度大于一定阈值,则认为两者匹配,否则,认为两者不匹配。In the related art, the face image of each predetermined object is pre-stored in the face database. When performing face recognition on the target recognition object, the face image of the target recognition object is first collected, and then, according to the collected face image and the human face The face images of each predetermined object in the face database are used to calculate the face matching degree between the target recognition object and each predetermined object. If there is a face matching degree greater than a certain threshold, the two are considered to match, otherwise, the two are considered not to match.
不同识别策略可能基于上述过程进行不同的优化,如在人脸库中进行人脸检索,人脸库中有且仅有一个预定人脸与目标识别对象的人脸匹配度超过阈值,才认为不会发生风险,作为明确的识别匹配结果。Different recognition strategies may perform different optimizations based on the above process. For example, when performing face retrieval in the face database, if there is only one predetermined face in the face database and the matching degree of the face of the target recognition object exceeds the threshold, it will be considered as not. Risks occur as a result of unambiguous identification matches.
但是,在人脸库中的人脸图像数量较大的情况下,容易发生误识风险,即可能存在多个人脸匹配度均大于阈值,或者大于阈值的人脸匹配度 与该阈值比较接近。在这些情况下,很容易出现误识别,导致出现人脸误识别的风险比较高。However, in the case of a large number of face images in the face database, the risk of misrecognition is prone to occur, that is, there may be multiple face matching degrees that are all greater than the threshold, or the matching degrees of the faces that are greater than the threshold are relatively close to the threshold. In these cases, misrecognition is prone to occur, leading to a high risk of misidentification of faces.
为了解决人脸误识别的风险比较高的技术问题,本申请提供一种人脸识别方法,人脸识别方法可以应用于人脸识别设备。人脸识别设备可以是移动电子设备,也可以为非移动电子设备。示例性的,移动电子设备可以为手机、平板电脑、笔记本电脑、掌上电脑、车载电子设备、可穿戴设备、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本或者个人数字助理(personal digital assistant,PDA)等,非移动电子设备可以为服务器、网络附属存储器(Network Attached Storage,NAS)、个人计算机(personal computer,PC)、电视机(television,TV)、柜员机或者自助机等,本申请实施例不作具体限定。In order to solve the technical problem that the risk of face misrecognition is relatively high, the present application provides a face recognition method, which can be applied to a face recognition device. The face recognition device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palmtop computer, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (personal digital assistant). assistant, PDA), etc., non-mobile electronic devices can be servers, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (television, TV), teller machine or self-service machine, etc., this application Examples are not specifically limited.
在人脸识别方法中,先获取目标识别对象的第一人脸图像;根据第一人脸图像以及第一人脸库中各个预定对象的人脸图像,确定目标识别对象与各个预定对象的人脸匹配度。In the face recognition method, first obtain the first face image of the target recognition object; according to the first face image and the face images of each predetermined object in the first face database, determine the target recognition object and the person of each predetermined object face matching.
在确定目标识别对象与第一人脸库中各个预定对象的人脸匹配度之后,如果出现目标识别对象与多个预定对象的人脸匹配度均大于第一预定阈值,则说明有多个预定对象与目标识别对象的人脸匹配度较高。还有如果出现最大的人脸匹配度与第一预定阈值的差值小于预定数值,则说明最大的人脸匹配度与第一预定阈值较为接近。对于上述情况,很容易出现误识别的风险。After determining the face matching degree between the target recognition object and each predetermined object in the first face database, if the face matching degree between the target recognition object and multiple predetermined objects is greater than the first predetermined threshold, it means that there are multiple predetermined The face matching degree of the object and the target recognition object is relatively high. Also, if the difference between the maximum face matching degree and the first predetermined threshold is smaller than the predetermined value, it means that the maximum face matching degree is relatively close to the first predetermined threshold. For the above cases, there is a risk of misidentification.
因此,获取较大的M个人脸匹配度,然后,计算M个人脸匹配度中的每相邻两个人脸匹配度的差值,得到M-1个差值;根据M-1个差值,在多个预定对象中确定与目标识别对象的人脸匹配的第一对象。由于并非仅判断最大的人脸匹配度是否大于阈值来进行人脸识别,而是在人脸识别过程中考虑了更多的因素,如此,可以使得人脸识别的结果更加准确,减少误识别的风险。Therefore, a larger M face matching degree is obtained, and then, the difference between the matching degrees of each adjacent two faces in the M face matching degree is calculated, and M-1 difference values are obtained; according to the M-1 difference values, A first object matching the face of the target recognition object is determined among the plurality of predetermined objects. Since it is not only to judge whether the maximum face matching degree is greater than the threshold for face recognition, but more factors are considered in the face recognition process, so that the result of face recognition can be made more accurate and the number of misidentifications can be reduced. risk.
下面结合附图说明本申请提供的人脸识别方法。图1是本申请提供的一种人脸识别方法的一实施例的流程示意图。The following describes the face recognition method provided by the present application with reference to the accompanying drawings. FIG. 1 is a schematic flowchart of an embodiment of a face recognition method provided by the present application.
如图1所示,人脸识别方法100包括:As shown in FIG. 1, the face recognition method 100 includes:
S102,获取目标识别对象的第一人脸图像。S102: Acquire a first face image of the target recognition object.
在S102中,可以接收来自电子设备发送的第一人脸图像。比如,在用户使用电子设备进行支付时,电子设备对用户的人脸进行采集,得到第一人脸图像,并将第一人脸图像发送至人脸识别设备。人脸识别设备接收电子设备发送的第一人脸图像。In S102, the first face image sent from the electronic device may be received. For example, when a user makes payment using an electronic device, the electronic device collects the user's face, obtains a first face image, and sends the first face image to the face recognition device. The face recognition device receives the first face image sent by the electronic device.
人脸识别方法100还包括:S104,根据第一人脸图像以及第一人脸库中各个预定对象的人脸图像,确定目标识别对象与各个预定对象的人脸匹配度。The face recognition method 100 further includes: S104, according to the first face image and the face images of each predetermined object in the first face database, determine the face matching degree between the target recognition object and each predetermined object.
在S104中,可以计算第一人脸图像与第一人脸库中各个预定对象的人脸图像之间的相似度,根据相似度确定目标识别对象与各个预定对象的人脸匹配度。In S104, the similarity between the first face image and the face images of each predetermined object in the first face database may be calculated, and the face matching degree between the target recognition object and each predetermined object is determined according to the similarity.
人脸识别方法100还包括:S106,在人脸匹配度满足第一预定条件的情况下,从人脸匹配度序列中获取前M个人脸匹配度,人脸匹配度序列为目标识别对象与各个预定对象的人脸匹配度按照从大到小的顺序排列得到的序列;M为大于1的整数,第一预定条件包括以下至少一项:目标识别对象与多个预定对象的人脸匹配度大于第一预定阈值,最大的人脸匹配度与第一预定阈值的差值小于预定数值。The face recognition method 100 further includes: S106, in the case that the face matching degree satisfies the first predetermined condition, obtain the first M face matching degree from the face matching degree sequence, and the face matching degree sequence is the target recognition object and each face matching degree. A sequence obtained by arranging the face matching degrees of the predetermined objects in descending order; M is an integer greater than 1, and the first predetermined condition includes at least one of the following: the face matching degrees of the target recognition object and multiple predetermined objects are greater than For the first predetermined threshold, the difference between the maximum face matching degree and the first predetermined threshold is less than a predetermined value.
在S106中,在目标识别对象与多个预定对象的人脸匹配度大于第一预定阈值的情况下,说明有多个预定对象与目标识别对象的人脸匹配度较高,也就是说有多个预定对象的人脸与目标识别对象的人脸比较相似。在此情况下,比较容易出现误识别的风险。In S106, in the case that the face matching degree between the target recognition object and multiple predetermined objects is greater than the first predetermined threshold, it means that there are multiple predetermined objects and the face matching degree of the target recognition object is relatively high, that is to say, there are many The face of the predetermined object is similar to the face of the target recognition object. In this case, the risk of misidentification is more likely to occur.
还有如果出现最大的人脸匹配度与第一预定阈值的差值小于预定数值,说明最大的人脸匹配度与第一预定阈值相差比较小,比如,最大的人脸匹配度在第一预定阈值的上下0.5的范围内波动。出现这种情况有可能是受环境和采集人脸图像的角度的影响,导致目标识别对象与各个预定对象的人脸匹配度都不是很高,在此情况下,也容易出现误识别的风险。Also, if the difference between the maximum face matching degree and the first predetermined threshold is smaller than the predetermined value, it means that the difference between the maximum face matching degree and the first predetermined threshold is relatively small, for example, the maximum face matching degree is in the first predetermined threshold. The threshold fluctuates within a range of 0.5 above and below the threshold. This situation may be due to the influence of the environment and the angle of collecting face images, resulting in that the matching degree of the target recognition object and each predetermined object is not very high. In this case, the risk of misrecognition is also prone to occur.
针对上述情况,首先,将计算得到的人脸匹配度按照从大到小的顺序,得到人脸匹配度序列,然后,从人脸匹配度序列中获取前M个人脸匹配度。In view of the above situation, first, the calculated face matching degrees are in descending order to obtain a face matching degree sequence, and then, the first M face matching degrees are obtained from the face matching degree sequence.
人脸识别方法100还包括:S108,计算M个人脸匹配度中的每相邻两个人脸匹配度的差值,得到M-1个差值;The face recognition method 100 further includes: S108, calculating the difference between the matching degrees of each adjacent two faces in the matching degrees of M faces, and obtaining M-1 difference values;
S110,根据M-1个差值,在多个预定对象中确定与目标识别对象的人脸匹配的第一对象。S110, according to the M-1 difference values, determine a first object matching the face of the target recognition object among the plurality of predetermined objects.
在本申请实施例中,由于并非仅判断最大的人脸匹配度是否大于阈值来进行人脸识别,而是在人脸识别过程中考虑了更多的因素,如此,可以使得人脸识别的结果更加准确,减少误识别的风险。In the embodiment of the present application, since it is not only judged whether the maximum face matching degree is greater than the threshold to perform face recognition, but more factors are considered in the face recognition process, so that the result of face recognition can be made More accurate, reducing the risk of misidentification.
需要说明的是,人脸识别方法可以应用于支付场景、安防监控、考勤打卡等多种场景中,在此并不限定。It should be noted that the face recognition method can be applied to various scenarios such as payment scenarios, security monitoring, and attendance check-in, which are not limited here.
下面以支付场景为例说明本申请提供的人脸识别方法。The following describes the face recognition method provided in this application by taking a payment scenario as an example.
在利用电子设备进行支付的过程中,电子设备先采集目标识别对象的第一人脸图像,并将第一人脸图像发送至支付服务器(即人脸识别设备)。In the process of using the electronic device for payment, the electronic device first collects the first face image of the target recognition object, and sends the first face image to the payment server (ie, the face recognition device).
支付服务器接收到第一人脸图像之后,基于上述的人脸识别方法100,先根据第一人脸图像以及第一人脸库中各个预定对象的人脸图像,确定目标识别对象与各个预定对象的人脸匹配度;再获取前M个人脸匹配度;然后,计算每相邻两个人脸匹配度的差值,并在多个预定对象中确定与目标识别对象的人脸匹配的第一对象;最后,根据目标识别对象与第一对象人脸匹配成功的结果,执行支付流程,在执行完支付流程之后,将支付成功的结果返回至电子设备。After the payment server receives the first face image, based on the above-mentioned face recognition method 100, first according to the first face image and the face images of each predetermined object in the first face database, determine the target recognition object and each predetermined object face matching degree; then obtain the first M face matching degree; then, calculate the difference between the matching degrees of every two adjacent faces, and determine the first object matching the face of the target recognition object in a plurality of predetermined objects Finally, according to the result that the target recognition object and the face of the first object are successfully matched, the payment process is performed, and after the payment process is performed, the successful payment result is returned to the electronic device.
电子设备接收到支付服务器发送的支付成功的结果之后,显示支付成功的信息。After receiving the successful payment result sent by the payment server, the electronic device displays the payment successful information.
还需要说明的是,在各个人脸匹配度中,有且仅有最大的人脸匹配度大于第一预定阈值,其他的人脸匹配度均在第一预定阈值之下,说明此次识别结果比较可靠,可以直接确定最大的人脸匹配度对应的预定对象与目标识别对象的人脸匹配成功。It should also be noted that among each face matching degree, there is only the largest face matching degree greater than the first predetermined threshold, and the other face matching degrees are all below the first predetermined threshold, indicating the recognition result of this time. It is relatively reliable, and it can be directly determined that the predetermined object corresponding to the maximum face matching degree is successfully matched with the face of the target recognition object.
在本申请的一个或多个实施例中,S110可以包括:In one or more embodiments of the present application, S110 may include:
在M-1个差值满足第二预定条件的情况下,将最大的人脸匹配度对应的预定对象确定为第一对象,其中,第二预定条件包括:M-1个差值中的 第一差值大于预定差值阈值,第一差值为最大的人脸匹配度与次最大的人脸匹配度之间的差值。In the case that the M-1 difference values satisfy the second predetermined condition, the predetermined object corresponding to the maximum face matching degree is determined as the first object, wherein the second predetermined condition includes: the first object in the M-1 difference values A difference is greater than a predetermined difference threshold, and the first difference is the difference between the largest face matching degree and the second largest human face matching degree.
作为一些示例,可以根据人脸识别成功的多个正样本确定预定差值阈值,其中,多个正样本为人脸识别成功的多个人脸图像样本。As some examples, the predetermined difference threshold may be determined according to multiple positive samples for which face recognition is successful, where the multiple positive samples are multiple face image samples for which face recognition is successful.
在本申请实施例中,根据人脸识别成功的多个正样本确定预定差值阈值,具体可以包括:In the embodiment of the present application, the predetermined difference threshold is determined according to a plurality of positive samples of successful face recognition, which may specifically include:
对于每个人脸图像样本分别执行如下步骤:获取人脸图像样本与第一人脸库中预定对象的相似度;将各个相似度按照从大到小的顺序排列;获取排名第一的相似度以及排名第二的相似度;计算排名第一的相似度以及排名第二的相似度之间的相似度差值,如此,得到人脸图像样本对应的相似度差值;Perform the following steps for each face image sample: obtaining the similarity between the face image sample and the predetermined object in the first face database; arranging each similarity in descending order; obtaining the first similarity and The second-ranked similarity; calculate the similarity difference between the first-ranked similarity and the second-ranked similarity, so that the similarity difference corresponding to the face image sample is obtained;
在得到各个人脸图像样本分别对应的相似度差值之后,可以在这些相似度差值中,统计百分比最大的相似度差值,将百分比最大的相似度差值确定为预定差值阈值。比如,有80%的人脸图像样本对应的相似度差值为5分,则将5确定为预定差值阈值。After obtaining the similarity difference values corresponding to each face image sample, the similarity difference value with the largest percentage may be counted among the similarity difference values, and the similarity difference value with the largest percentage may be determined as a predetermined difference threshold. For example, if the similarity difference corresponding to 80% of the face image samples is 5 points, 5 is determined as the predetermined difference threshold.
当然,确定预定差值阈值的方式并不限于上述方式,还可以在得到各个人脸图像样本分别对应的相似度差值之后,计算各个人脸图像样本分别对应的相似度差值的平均值,得到预定差值阈值。Of course, the method of determining the predetermined difference threshold is not limited to the above method, and after obtaining the similarity difference corresponding to each face image sample, the average value of the similarity difference corresponding to each face image sample can be calculated, A predetermined difference threshold is obtained.
由于对人脸匹配度进行分析得出:在人脸匹配成功的样本中,最大的人脸匹配度(即第一个人脸匹配度)比第二大的人脸匹配度(即第二个人脸匹配度)要大很多。因此,在最大的人脸匹配度与次最大的人脸匹配度之间的差值大于预定差值阈值的情况下,可以认为本次人脸识别结果比较可信,并确定最大的人脸匹配度对应的预定对象与第一对象匹配。由此,优化了人脸识别方案,使得人脸识别的结果更加准确,减少误识别的风险。Due to the analysis of the face matching degree, it is concluded that in the samples with successful face matching, the largest face matching degree (ie the first face matching degree) is higher than the second largest face matching degree (ie the second person face matching) is much larger. Therefore, if the difference between the largest face matching degree and the next largest face matching degree is greater than the predetermined difference threshold, it can be considered that the face recognition result is more credible, and the largest face matching degree is determined. The predetermined object corresponding to the degree matches the first object. As a result, the face recognition scheme is optimized, so that the result of face recognition is more accurate, and the risk of misrecognition is reduced.
在本申请的一个或多个实施例中,第二预定条件还可以包括:第二差值不大于预定差值阈值,第二差值为M-1个差值中的除第一差值之外的差值。In one or more embodiments of the present application, the second predetermined condition may further include: the second difference value is not greater than the predetermined difference value threshold, and the second difference value is divided by the first difference value among the M-1 difference values outside difference.
在本申请实施例中,第二预定条件包括:第一差值大于预定差值阈 值,其余的第二差值不大于预定差值阈值,也就是说最大的人脸匹配度与次最大的人脸匹配度之间相差比较大,其余的人脸匹配度相差比较小,即人脸匹配度序列整体呈现出“首部陡峭,后续平滑”的变化趋势。在此情况下,认为本次识别结果可信。如此,可以进一步地保证人脸识别结果的准确性。In this embodiment of the present application, the second predetermined condition includes: the first difference is greater than the predetermined difference threshold, and the remaining second differences are not greater than the predetermined difference threshold, that is to say, the largest face matching degree is the second largest person The difference between the face matching degrees is relatively large, and the difference between the remaining face matching degrees is relatively small, that is, the overall face matching degree sequence shows a trend of "steep first, smooth subsequent". In this case, the identification result of this time is considered to be credible. In this way, the accuracy of the face recognition result can be further guaranteed.
下面通过具体的示例说明本申请实施例。The embodiments of the present application are described below through specific examples.
在确定目标识别对象与各个预定对象的人脸匹配度之后,如果目标识别对象与多个预定对象的人脸匹配度均大于第一预定阈值,则从人脸匹配度序列中获取前5个人脸匹配度,5个人脸匹配度按照从大到小的顺序排列。After determining the face matching degree between the target recognition object and each predetermined object, if the face matching degrees between the target recognition object and multiple predetermined objects are all greater than the first predetermined threshold, the first 5 faces are obtained from the face matching degree sequence. Matching degree, 5 face matching degrees are arranged in descending order.
在5个人脸匹配度中,如果第一个人脸匹配度与第二个人脸匹配度的差值大于预定差值阈值,以及第二个人脸匹配度与第三个人脸匹配度的差值、第三个人脸匹配度与第四个人脸匹配度的差值、第四个人脸匹配度与第五个人脸匹配度的差值分别小于预定差值阈值,即5个人脸匹配度呈现出“首部陡峭,后续平滑”的变化趋势,则认为本次识别结果可信,确定最大的人脸匹配度对应的预定对象与目标识别对象匹配,否则认为本次识别待定。Among the five face matching degrees, if the difference between the first human face matching degree and the second human face matching degree is greater than the predetermined difference threshold, and the difference between the second human face matching degree and the third human face matching degree, The difference between the third face matching degree and the fourth face matching degree, and the difference between the fourth face matching degree and the fifth face matching degree are respectively smaller than the predetermined difference thresholds, that is, the five face matching degrees show the "header" Steep, follow-up smooth" change trend, the recognition result is considered credible, and the predetermined object corresponding to the maximum face matching degree is determined to match the target recognition object, otherwise the recognition is considered to be pending.
在确定目标识别对象与各个预定对象的人脸匹配度之后,如果最大的人脸匹配度与第一预定阈值的差值小于预定数值,则从人脸匹配度序列中获取前两个人脸匹配度,在这两个人脸匹配度的差值大于预定差值阈值的情况下,则认为本次识别结果可信,确定最大的人脸匹配度对应的预定对象与目标识别对象匹配,否则认为本次识别待定。After determining the face matching degree between the target recognition object and each predetermined object, if the difference between the maximum face matching degree and the first predetermined threshold is less than the predetermined value, the first two face matching degrees are obtained from the face matching degree sequence. , when the difference between the two face matching degrees is greater than the predetermined difference threshold, the recognition result of this time is considered to be credible, and it is determined that the predetermined object corresponding to the maximum face matching degree matches the target recognition object, otherwise it is considered that this time Identification pending.
对于本次识别待定的情况,可以配合业务进行不同的辅助业务手段,如要求用户输入额外的身份验证信息,身份验证信息包括以下至少一项:注册手机号、身份证号等等。当然,对于本次识别待定的情况,也可直接拒绝,提示用户本次无法识别。For the situation that the identification is pending this time, different auxiliary business methods can be carried out in cooperation with the business, such as requiring the user to input additional identity verification information, which includes at least one of the following: registered mobile phone number, ID number, etc. Of course, if the identification is pending this time, it can also be rejected directly, prompting the user that the identification cannot be made this time.
在相关技术中,第一人脸库中预先存储有每个预定对象的一张人脸图像,采用单张图对比的方式计算目标识别对象与各个预定对象的人脸匹配度。具体地,将目标识别对象的人脸图像与预定对象的人脸图像的相似 度,确定为人脸匹配度。In the related art, a face image of each predetermined object is pre-stored in the first face database, and the face matching degree between the target recognition object and each predetermined object is calculated by comparing a single image. Specifically, the similarity between the face image of the target recognition object and the face image of the predetermined object is determined as the face matching degree.
但是,由于受到拍摄环境和拍摄角度的影响,有时候目标识别对象的人脸图像与预定对象的人脸图像之间的一个相似度无法准确地确定两者之间的人脸匹配度。如此,会导致人脸识别结果不够准确。However, due to the influence of the shooting environment and shooting angle, sometimes a similarity between the face image of the target recognition object and the face image of the predetermined object cannot accurately determine the face matching degree between the two. In this way, the face recognition result will be inaccurate.
为了解决由于无法准确地确定目标识别对象与预定对象的人脸匹配度,而导致的人脸识别结果不够准确的技术问题,在本申请的一个或多个实施例中,第一人脸库包括同一个预定对象的N个人脸图像,N为大于1的整数。In order to solve the technical problem that the face recognition result is not accurate enough because the face matching degree between the target recognition object and the predetermined object cannot be accurately determined, in one or more embodiments of the present application, the first face database includes N face images of the same predetermined object, where N is an integer greater than 1.
在本申请实施例中,如图2所示,S104可以包括:In this embodiment of the present application, as shown in FIG. 2 , S104 may include:
S1042,对于第一人脸库中同一个预定对象的N个人脸图像,计算第一人脸图像分别与N个人脸图像中的每个人脸图像的相似度,得到N个相似度;S1042, for N face images of the same predetermined object in the first face database, calculate the similarity between the first face image and each face image in the N face images respectively, and obtain N similarities;
S1044,根据N个相似度,确定目标识别对象与预定对象的人脸匹配度。S1044, according to the N similarities, determine the face matching degree between the target recognition object and the predetermined object.
在S1042中,可以计算第一人脸图像与N个人脸图像中的每个人脸图像的欧式距离,得到相似度;或者,计算第一人脸图像与N个人脸图像中的每个人脸图像的余弦距离,得到相似度。In S1042, the Euclidean distance between the first face image and each of the N face images can be calculated to obtain the similarity; or, the difference between the first face image and each of the N face images can be calculated. Cosine distance to get similarity.
在S1044中,S1044具体可以包括以下其中一项:In S1044, S1044 may specifically include one of the following:
将N个相似度中的最大相似度确定为目标识别对象与预定对象的人脸匹配度;Determine the maximum similarity among the N similarities as the face matching degree between the target recognition object and the predetermined object;
在N个相似度中的第一相似度大于第一预定阈值的情况下,将第一相似度确定为目标识别对象与预定对象的人脸匹配度,第一相似度为第一人脸图像与多个人脸图像中的第二人脸图像的相似度,第二人脸图像为在进行人脸识别设置时采集的人脸图像;In the case where the first similarity among the N similarities is greater than the first predetermined threshold, the first similarity is determined as the face matching degree between the target recognition object and the predetermined object, and the first similarity is the first face image and the predetermined object. similarity of the second face image in the plurality of face images, where the second face image is a face image collected during face recognition setting;
将N个相似度中的至少部分相似度的平均值确定为目标识别对象与预定对象的人脸匹配度,具体地,可以将N个相似度的平均值确定为目标识别对象与预定对象的人脸匹配度,或者,可以从N个相似度中获取大于一定阈值的多个相似度,计算多个相似度的平均值,得到人脸匹配度;The average value of at least part of the similarity degrees in the N similarities is determined as the face matching degree between the target recognition object and the predetermined object, and specifically, the average value of the N similarities can be determined as the target recognition object and the predetermined object. Face matching degree, or, multiple similarities greater than a certain threshold can be obtained from the N similarities, and the average value of the multiple similarities can be calculated to obtain the face matching degree;
根据N个相似度中各个相似度的权重值,对N个相似度进行加权计 算,得到目标识别对象与预定对象的人脸匹配度。According to the weight value of each similarity in the N similarities, weighted calculation is performed on the N similarities to obtain the face matching degree between the target recognition object and the predetermined object.
下面对N个相似度进行加权计算进行示例性地说明。The weighted calculation of the N similarities is exemplarily described below.
作为一些示例,第一人脸库中包括预定对象的N个人脸图像,N个人脸图中包括在进行人脸识别设置时采集的一个第二人脸图像,以及在进行人脸识别的过程中添加的N-1个人脸图像。As some examples, the first face database includes N face images of predetermined objects, and the N face images include a second face image collected during the face recognition setting, and during the face recognition process Added N-1 face images.
假设第一人脸图像与第二人脸图像的相似度的权重值为a1,a1∈[0,1],那么,第一人脸图像与其他人脸图像的相似度的权重值
Figure PCTCN2021118143-appb-000001
i为整数,且i∈[2,N]。
Assuming that the weight value of the similarity between the first face image and the second face image is a1, a1 ∈ [0, 1], then, the weight value of the similarity between the first face image and other face images
Figure PCTCN2021118143-appb-000001
i is an integer, and i∈[2,N].
目标识别对象与预定对象的人脸匹配度为:P1×a1+P2×a2+……PN×aN,Pi表示第一人脸图像与N个人脸图像中的第i个人脸图像的相似度。The face matching degree between the target recognition object and the predetermined object is: P1×a1+P2×a2+...PN×aN, Pi represents the similarity between the first face image and the ith face image in the N face images.
由于在某种程度上,在进行人脸识别设置时采集的第二人脸图像更具有说明意义,则在计算人脸匹配度时,第一人脸图像与第二人脸图像的相似度可以具有较大的权重值。Since the second face image collected during face recognition setting is more explanatory to a certain extent, when calculating the face matching degree, the similarity between the first face image and the second face image can be has a larger weight value.
需要说明的是,在进行人脸识别设置时采集的第二人脸图像的质量比较高,具体地,第二人脸图像的人脸角度、人脸大小、人脸遮挡情况、闭眼情况、清晰程度、像素大小以及曝光参数在一定的参数范围内。It should be noted that the quality of the second face image collected during the face recognition setting is relatively high, specifically, the face angle, face size, face occlusion, closed eyes, Sharpness, pixel size and exposure parameters are within a certain range of parameters.
在本申请实施例中,第一人脸库中存储有同一个预定对象的多个人脸图像,计算第一人脸图像与预定对象的每个人脸图像的相似度,得到多个相似度,根据多个相似度,可以准确地确定目标识别对象与预定对象的人脸匹配度,从而可以更加准确地进行人脸识别。In the embodiment of the present application, the first face database stores multiple face images of the same predetermined object, and the similarity between the first face image and each face image of the predetermined object is calculated to obtain a plurality of similarities, according to The multiple similarity degrees can accurately determine the face matching degree between the target recognition object and the predetermined object, so that the face recognition can be performed more accurately.
在本申请的一个或多个实施例中,S110之后,人脸识别方法还可以包括:In one or more embodiments of the present application, after S110, the face recognition method may further include:
在最大的人脸匹配度大于第二预定阈值的情况下,将第一人脸图像作为第一对象的人脸图像添加至第一人脸库中,其中,第二预定阈值为大于第一预定阈值的数值。In the case that the maximum face matching degree is greater than the second predetermined threshold, the first face image is added to the first face database as the face image of the first object, wherein the second predetermined threshold is greater than the first predetermined threshold The value of the threshold.
作为一些示例,第一人脸图像添加至第一人脸库的条件不仅要满足最大的人脸匹配度大于第二预定阈值,还可以满足如下条件:第一人脸图像的人脸角度、人脸大小、人脸遮挡情况、闭眼情况、清晰程度、像素大小 以及曝光参数在一定的参数范围内,以及在确定与目标识别对象匹配的对象之后,利用人脸识别进行的业务(比如支付业务)成功完成。As some examples, the conditions for adding the first face image to the first face database must not only satisfy that the maximum face matching degree is greater than the second predetermined threshold, but also satisfy the following conditions: the face angle of the first face image, the Face size, face occlusion, closed eyes, clarity, pixel size, and exposure parameters are within a certain range of parameters, and after determining the object matching the target recognition object, the business using face recognition (such as payment business) )Completed successfully.
如此,可以使得第一人脸库中包括同一预定对象的多个人脸图像。In this way, the first face database can include multiple face images of the same predetermined object.
在本申请的一个或多个实施例中,将第一人脸图像作为第一对象的人脸图像添加至第一人脸库中之后,人脸识别方法100还可以包括:In one or more embodiments of the present application, after adding the first face image as the face image of the first object to the first face database, the face recognition method 100 may further include:
在第一人脸库中第一对象的人脸图像数量大于预定数量阈值的情况下,在第一人脸库的第一对象的人脸图像中,获取第三人脸图像,第三人脸图像为除人脸识别设置时采集的人脸图像之外的人脸图像;In the case that the number of face images of the first object in the first face database is greater than the predetermined number threshold, a third face image is obtained from the face images of the first object in the first face database, and the third face The image is a face image other than the face image collected during the face recognition setting;
根据各个第三人脸图像分别对应的人脸匹配度,删除至少一个第三人脸图像中人脸匹配度最小的人脸图像。According to the face matching degrees corresponding to the respective third human face images, the face image with the smallest face matching degree in at least one third human face image is deleted.
在本申请实施例中,第三人脸图像对应的人脸匹配度为:对第三人脸图像中的人脸进行识别时计算得到的第三人脸图像中的对象与第一对象的人脸匹配度。In the embodiment of the present application, the face matching degree corresponding to the third face image is: the object in the third face image obtained by recognizing the face in the third face image and the person of the first object face matching.
需要说明的是,在第一人脸库中第一对象的人脸图像数量不大于预定数量阈值的情况下,不需要删除第一人脸库中第一对象的人脸图像。It should be noted that, in the case that the number of face images of the first object in the first face database is not greater than the predetermined number threshold, the face images of the first object in the first face database do not need to be deleted.
下面对本申请实施例进行示例性说明。The embodiments of the present application are exemplarily described below.
假设第一人脸库中具有第一对象的两个人脸图像,分别是人脸图像1和人脸图像2。其中,人脸图像1是人脸识别设置时采集的人脸图像,人脸图像2是进行人脸识别的过程中添加至第一人脸库中的人脸图像。It is assumed that there are two face images of the first object in the first face database, which are face image 1 and face image 2 respectively. The face image 1 is a face image collected during face recognition setting, and the face image 2 is a face image added to the first face database during the face recognition process.
在进行人脸识别时,根据目标识别对象的人脸图像3和第一对象的两个人脸图像,确定目标识别对象与第一对象的人脸匹配度Y1,并确定目标识别对象与第一对象的人脸匹配。在此情况下,可以将人脸图像3作为第一对象的人脸图像添加至第一人脸库中。如此,第一人脸库中具有第一对象的三个人脸图像。When performing face recognition, according to the face image 3 of the target recognition object and the two face images of the first object, determine the face matching degree Y1 between the target recognition object and the first object, and determine the target recognition object and the first object. face matching. In this case, the face image 3 may be added to the first face database as the face image of the first object. In this way, the first face database has three face images of the first object.
在此之后进行人脸识别时,根据目标识别对象的人脸图像4和第一对象的三个人脸图像,确定目标识别对象与第一对象的人脸匹配度Y2,并确定目标识别对象与第一对象的人脸匹配。在此情况下,可以将将人脸图像4作为第一对象的人脸图像添加至第一人脸库中。When performing face recognition after that, according to the face image 4 of the target recognition object and the three face images of the first object, determine the face matching degree Y2 between the target recognition object and the first object, and determine the target recognition object and the first object. Face matching of an object. In this case, the face image with the face image 4 as the first object may be added to the first face database.
由于此时第一人脸库中第一对象的人脸图像数量大于预定数量阈值 3,因此,需要删除第一对象的一个人脸图像,使得第一人脸库中第一对象的人脸图像数量等于预定数量阈值3。具体地,先获取第一人脸库中第一对象的各个第三人脸图像(即人脸图像2至人脸图像4)分别对应的人脸匹配度,其中,人脸图像3对应的人脸匹配度为上述的Y1,人脸图像4对应的人脸匹配度为上述的Y1。在人脸图像2至人脸图像4中,删除人脸匹配度最小的人脸图像。Since the number of face images of the first object in the first face database is greater than the predetermined number threshold of 3, it is necessary to delete a face image of the first object, so that the face images of the first object in the first face database The number is equal to the predetermined number threshold of three. Specifically, first obtain the face matching degrees corresponding to each of the third face images of the first object in the first face database (that is, face image 2 to face image 4), wherein the person corresponding to face image 3 The face matching degree is the above-mentioned Y1, and the face matching degree corresponding to the face image 4 is the above-mentioned Y1. Among face images 2 to 4, the face image with the smallest face matching degree is deleted.
如此,删除第一人脸库中质量不好的人脸图像。而且,经过不断向第一人脸库中添加人脸图像,以及不断删除脸库中质量不好的人脸图像,使得第一人脸库中的人脸图像不断更新,并保存质量较好的人脸图像。在利用更新后的第一人脸库进行人脸识别时,可以保证人脸识别结果的准确性。In this way, face images with poor quality in the first face database are deleted. Moreover, by continuously adding face images to the first face database and continuously deleting face images of poor quality in the face database, the face images in the first face database are continuously updated, and the better-quality face images are saved. face image. When using the updated first face database for face recognition, the accuracy of the face recognition result can be guaranteed.
需要说明的是,人脸识别设置时采集的人脸图像(比如上述示例中的人脸图像1)不参与第一人脸库的更新,而是在进行人脸识别时添加的人脸图像(比如上述示例中的人脸图像2至人脸图像4)参与第一人脸库的更新。It should be noted that the face image collected during face recognition setting (such as face image 1 in the above example) does not participate in the update of the first face database, but the face image ( For example, face image 2 to face image 4) in the above example participate in the update of the first face database.
在本申请的一个或多个实施例中,如图3所示,S110之后,人脸识别方法100还可以包括:In one or more embodiments of the present application, as shown in FIG. 3 , after S110, the face recognition method 100 may further include:
S112,在第一人脸库的第一对象的人脸图像中,确定是否存在与第一人脸图像的相似度小于第三预定阈值的第四人脸图像,第三预定阈值为小于第一预定阈值的数值;S112, in the face image of the first object in the first face database, determine whether there is a fourth face image whose similarity with the first face image is less than a third predetermined threshold, where the third predetermined threshold is less than the first the value of the predetermined threshold;
S114,在存在第四人脸图像的情况下,将第四人脸图像对应的第一参数值加1,第一参数值表示第四人脸图像与至少一个目标识别对象的第一人脸图像之间的不匹配次数;S114, in the presence of the fourth human face image, add 1 to the first parameter value corresponding to the fourth human face image, where the first parameter value represents the fourth human face image and the first human face image of the at least one target recognition object The number of mismatches between;
S116,在第一参数值大于预定的第一次数阈值的情况下,将第四人脸图像从第一人脸库中删除。S116, in the case that the first parameter value is greater than the predetermined first number of times threshold, delete the fourth human face image from the first human face database.
在本申请实施例中,如果目标识别对象与第一对象匹配,而目标识别对象的第一人脸图像与第一人脸库中第一对象的第四人脸图像的相似度较小。在此情况下,将第四人脸图像对应的第一参数值加1,也就是第四人脸图像的不匹配次数加1。在第一参数值大于预定的第一次数阈值的情况 下,说明可能是因为在人脸识别过程中由于个别角度等原因使得第四人脸图像的人脸匹配度过高,而导致第四人脸图像误添加至第一人脸库中。此时,可以将第四人脸图像从第一人脸库中删除,如此可以删除误添加至第一人脸库中的人脸图像,从而不断优化第一人脸库。In this embodiment of the present application, if the target recognition object matches the first object, the similarity between the first face image of the target recognition object and the fourth face image of the first object in the first face database is small. In this case, the value of the first parameter corresponding to the fourth face image is increased by 1, that is, the number of mismatches of the fourth face image is increased by 1. In the case where the value of the first parameter is greater than the predetermined threshold of the first number of times, it may be because the face matching of the fourth face image is too high due to individual angles and other reasons in the face recognition process, which leads to the fourth The face image was mistakenly added to the first face database. At this time, the fourth face image can be deleted from the first face database, so that the face image added to the first face database by mistake can be deleted, so as to continuously optimize the first face database.
在本申请的一个或多个实施例中,人脸识别方法100还可以包括:在M-1个差值不满足第二预定条件的情况下,可以获取目标识别对象输入的身份验证信息(比如身份证号码或者验证码),根据身份验证信息对目标识别对象进行识别。In one or more embodiments of the present application, the face recognition method 100 may further include: in the case that the M-1 difference values do not satisfy the second predetermined condition, obtaining the identity verification information (such as the input of the target recognition object) ID number or verification code), and identify the target identification object according to the identity verification information.
在本申请的一个或多个实施例中,上述中的第一人脸图像以及第一人脸库中各个预定对象的人脸图像可以均为二维的红绿蓝(Red Green Blue,RGB)人脸图像。在根据二维的人脸图像无法识别出与目标识别对象匹配的对象的情况下,由于三维人脸图像中包含人脸各个部位的高度信息,因此,可以根据包括三维人脸图像的第二人脸库进行识别。In one or more embodiments of the present application, the above-mentioned first face image and the face images of each predetermined object in the first face database may be two-dimensional Red Green Blue (RGB) face image. In the case where the object matching the target recognition object cannot be recognized according to the two-dimensional face image, since the three-dimensional face image contains the height information of each part of the face, the second person including the three-dimensional face image can be face database for recognition.
具体地,可以预先构建第二人脸库。其中,可以在用户进行人脸识别设置时采集三维人脸图像,以构建第二人脸库。但是,电子设备的摄像头硬件不同,如果电子设备的硬件不支持采集三维人脸图像,则第二人脸库中预定对象的三维人脸图像为空。如果电子设备采集到预定对象的三维人脸图像,并且采集的三维人脸图像符合质量要求,则将采集的三维人脸图像保存至第二人脸库中。Specifically, the second face database can be pre-built. Wherein, three-dimensional face images may be collected when the user performs face recognition settings, so as to construct a second face database. However, the camera hardware of the electronic device is different. If the hardware of the electronic device does not support the acquisition of three-dimensional face images, the three-dimensional face images of the predetermined objects in the second face database are empty. If the electronic device collects the three-dimensional face image of the predetermined object, and the collected three-dimensional face image meets the quality requirements, the collected three-dimensional face image is saved to the second face database.
另外,在进行诸如刷脸支付、门禁等刷脸场景下,电子设备进行人脸识别时,需要进行活体检测,往往都带有特定的硬件摄像头,可支持采集三维人脸图像。在识别对象通过活体检测,识别成功,以及完成业务(比如支付成功或者门禁开锁)后,将采集到的三维人脸图像添加至该识别对象的第二人脸库中。In addition, in face-swiping scenarios such as face-swiping payment, access control, etc., when electronic devices perform face recognition, they need to perform liveness detection, often with specific hardware cameras that can support the collection of three-dimensional face images. After the recognized object passes the live detection, the recognition is successful, and the business is completed (such as successful payment or access control unlocking), the collected three-dimensional face image is added to the second face database of the recognized object.
需要说明的是,第二人脸库中的各个三维人脸图像与第二参数值3D_OKR一一对应。三维人脸图像对应的第二参数值3D_OKR表示利用该三维人脸图像进行人脸识别成功的次数。三维人脸图像对应的第二参数值3D_OKR的初始数值为0。It should be noted that each three-dimensional face image in the second face database corresponds to the second parameter value 3D_OKR one-to-one. The second parameter value 3D_OKR corresponding to the three-dimensional face image represents the number of times of successful face recognition using the three-dimensional face image. The initial value of the second parameter value 3D_OKR corresponding to the three-dimensional face image is 0.
如果某个三维人脸图像对应的第二参数值3D_OKR大于预定的第二次 数阈值POSITIVE_MAX_3DOKR,说明利用该三维人脸图像进行人脸识别成功的次数比较多,进而说明该三维人脸图像是可信的。因此,如果根据该三维人脸图像识别成功,则不需要再额外获取目标识别对象输入的身份验证信息来进行识别,而是可以使用该三维人脸图像的识别结果。If the second parameter value 3D_OKR corresponding to a 3D face image is greater than the predetermined second time threshold POSITIVE_MAX_3DOKR, it means that the 3D face image is used for more successful face recognition, and the 3D face image is credible of. Therefore, if the recognition is successful according to the 3D face image, it is not necessary to additionally obtain the identity verification information input by the target recognition object for recognition, but the recognition result of the 3D face image can be used.
在本申请实施例中,第二次数阈值POSITIVE_MAX_3DOKR取值为0时,表示省略获取目标识别对象输入的身份验证信息来进行识别的步骤,可以直接使用三维图像辅助识别策略。In this embodiment of the present application, when the second time threshold POSITIVE_MAX_3DOKR takes a value of 0, it means that the step of obtaining the identity verification information input by the target recognition object for recognition is omitted, and the 3D image-assisted recognition strategy can be directly used.
在构建完第二人脸库之后,如果利用第一人脸库进行识别时存在误识别风险,则启动三维图像辅助识别策略。具体地,如图4所示,在S110之后,人脸识别方法100还可以包括:After the second face database is constructed, if there is a risk of misrecognition when using the first face database for identification, a three-dimensional image-assisted identification strategy is started. Specifically, as shown in FIG. 4, after S110, the face recognition method 100 may further include:
S118,在M-1个差值不满足第二预定条件的情况下,获取目标识别对象的第一三维人脸图像;S118, in the case that the M-1 differences do not meet the second predetermined condition, obtain a first three-dimensional face image of the target recognition object;
S120,将第一三维人脸图像与第二人脸库中预定对象的三维人脸图像进行匹配;S120, matching the first three-dimensional face image with the three-dimensional face image of the predetermined object in the second face database;
S122,在第一三维人脸图像与第二人脸库中第二对象的第二三维人脸图像匹配成功,且第二三维人脸图像对应的第二参数值大于预定的第二次数阈值的情况下,确定目标识别对象与第二对象的人脸匹配。S122, the first three-dimensional face image is successfully matched with the second three-dimensional face image of the second object in the second face database, and the second parameter value corresponding to the second three-dimensional face image is greater than the predetermined second time threshold. In this case, it is determined that the target recognition object matches the face of the second object.
需要说明的是,第二对象和第一对象可以是同一个对象,也可以是不同的对象。It should be noted that the second object and the first object may be the same object, or may be different objects.
在本申请实施例中,可以根据第二人脸库中的三维人脸图像辅助进行无感验证,减少用户的输入和感知,提升用户体验。In the embodiment of the present application, the sensorless verification can be performed assisted by the three-dimensional face image in the second face database, so as to reduce the user's input and perception, and improve the user experience.
在本申请的一个或多个实施例中,S110之后,人脸识别方法100还可以包括:In one or more embodiments of the present application, after S110, the face recognition method 100 may further include:
第二参数值3D_OKR不大于第二次数阈值POSITIVE_MAX_3DOKR的情况下,获取目标识别对象的身份验证信息,身份验证信息是除人脸信息之外的信息;When the second parameter value 3D_OKR is not greater than the second threshold POSITIVE_MAX_3DOKR, obtain the identity verification information of the target recognition object, and the identity verification information is information other than face information;
利用身份验证信息进行身份识别,得到识别结果;Use the identity verification information to identify the identity, and obtain the identification result;
在利用身份验证信息的识别结果与利用第一三维人脸图像的人脸识别结果一致的情况下,将第二参数值3D_OKR加1;In the case that the recognition result using the identity verification information is consistent with the face recognition result using the first three-dimensional face image, add 1 to the second parameter value 3D_OKR;
在利用第一三维人脸图像的人脸识别结果与利用身份验证信息的识别结果不一致的情况下,将第二参数值3D_OKR减1。When the face recognition result using the first three-dimensional face image is inconsistent with the recognition result using the identity verification information, the second parameter value 3D_OKR is decreased by 1.
在本申请实施例中,利用身份验证信息的识别结果与利用第一三维人脸图像的人脸识别结果一致,具体可以包括:In the embodiment of the present application, the recognition result using the identity verification information is consistent with the face recognition result using the first three-dimensional face image, which may specifically include:
身份验证信息与第二对象的预定身份信息匹配成功,以及第一三维人脸图像与第二人脸库中第二对象的第二三维人脸图像匹配成功;The identity verification information is successfully matched with the predetermined identity information of the second object, and the first three-dimensional face image is successfully matched with the second three-dimensional face image of the second object in the second face database;
或者,身份验证信息与第二对象的预定身份信息不匹配,以及第一三维人脸图像与第二人脸库中第二对象的第二三维人脸图像不匹配。Alternatively, the identity verification information does not match the predetermined identity information of the second object, and the first three-dimensional face image does not match the second three-dimensional face image of the second object in the second face database.
利用第一三维人脸图像的人脸识别结果与利用身份验证信息的识别结果不一致,具体可以包括:The face recognition result using the first three-dimensional face image is inconsistent with the recognition result using the identity verification information, which may specifically include:
身份验证信息与第二对象的预定身份信息不匹配,以及第一三维人脸图像与第二人脸库中第二对象的第二三维人脸图像匹配成功;The identity verification information does not match the predetermined identity information of the second object, and the first three-dimensional face image is successfully matched with the second three-dimensional face image of the second object in the second face database;
或者,身份验证信息与第二对象的预定身份信息匹配成功,以及第一三维人脸图像与第二人脸库中第二对象的第二三维人脸图像不匹配。Or, the identity verification information is successfully matched with the predetermined identity information of the second object, and the first three-dimensional face image does not match the second three-dimensional face image of the second object in the second face database.
在本申请的一个或多个实施例中,将第二参数值3D_OKR减1之后,人脸识别方法100还可以包括:In one or more embodiments of the present application, after subtracting 1 from the second parameter value 3D_OKR, the face recognition method 100 may further include:
在减1之后的第二参数值3D_OKR小于预定的第三次数阈值NEGATIVE_MAX_3DOKR的情况下,说明利用第二三维人脸图像进行人脸识别失败的次数比较多,则删除第二人脸库中的第二三维人脸图像。如此,不断更新第二人脸库,从而不断提高第二人脸库中的三维人脸图像的质量,降低利用第二人脸库中的三维人脸图像进行人脸识别的风险。In the case where the second parameter value 3D_OKR after subtracting 1 is smaller than the predetermined third threshold of times NEGATIVE_MAX_3DOKR, it means that the number of times of face recognition failure by using the second three-dimensional face image is relatively high, then delete the third face database in the second face database. 2D and 3D face images. In this way, the second face database is continuously updated, thereby continuously improving the quality of the three-dimensional face images in the second face database, and reducing the risk of using the three-dimensional face images in the second face database for face recognition.
在本申请实施例中,第三次数阈值NEGATIVE_MAX_3DOKR小于第二次数阈值POSITIVE_MAX_3DOKR。In this embodiment of the present application, the third time threshold NEGATIVE_MAX_3DOKR is smaller than the second time threshold POSITIVE_MAX_3DOKR.
与本申请提供的人脸识别方法对应地,本申请还提供一种人脸识别装置。图5是本申请提供的一种人脸识别装置的一实施例的结构示意图。如图5所示,人脸识别装置200包括:Corresponding to the face recognition method provided by the present application, the present application also provides a face recognition device. FIG. 5 is a schematic structural diagram of an embodiment of a face recognition device provided by the present application. As shown in Figure 5, the face recognition device 200 includes:
第一获取模块202,用于获取目标识别对象的第一人脸图像;The first obtaining module 202 is used for obtaining the first face image of the target recognition object;
第一确定模块204,用于根据第一人脸图像以及第一人脸库中各个预定对象的人脸图像,确定目标识别对象与各个预定对象的人脸匹配度;The first determination module 204 is used to determine the face matching degree between the target recognition object and each predetermined object according to the first face image and the face image of each predetermined object in the first face database;
第二获取模块206,用于在人脸匹配度满足第一预定条件的情况下,从人脸匹配度序列中获取前M个人脸匹配度,人脸匹配度序列为目标识别对象与各个预定对象的人脸匹配度按照从大到小的顺序排列得到的序列;M为大于1的整数,第一预定条件包括以下至少一项:目标识别对象与多个预定对象的人脸匹配度大于第一预定阈值,最大的人脸匹配度与第一预定阈值的差值小于预定数值;The second obtaining module 206 is configured to obtain the first M face matching degrees from the face matching degree sequence when the face matching degree satisfies the first predetermined condition, and the face matching degree sequence is the target recognition object and each predetermined object M is an integer greater than 1, and the first predetermined condition includes at least one of the following: the face matching degree of the target recognition object and a plurality of predetermined objects is greater than the first a predetermined threshold, the difference between the maximum face matching degree and the first predetermined threshold is less than a predetermined value;
第一计算模块208,用于计算M个人脸匹配度中的每相邻两个人脸匹配度的差值,得到M-1个差值;The first calculation module 208 is used to calculate the difference between the matching degrees of each adjacent two faces in the M face matching degrees, and obtain M-1 difference values;
第二确定模块210,用于根据M-1个差值,在多个预定对象中确定与目标识别对象的人脸匹配的第一对象。The second determining module 210 is configured to determine, according to the M−1 difference values, a first object matching the face of the target recognition object among the plurality of predetermined objects.
在本申请实施例中,由于并非仅判断最大的人脸匹配度是否大于阈值来进行人脸识别,而是在人脸识别过程中考虑了更多的因素,如此,可以使得人脸识别的结果更加准确,减少误识别的风险。In the embodiment of the present application, since it is not only judged whether the maximum face matching degree is greater than the threshold to perform face recognition, but more factors are considered in the face recognition process, so that the result of face recognition can be made More accurate, reducing the risk of misidentification.
在本申请的一个或多个实施例中,第二确定模块210具体可以用于:In one or more embodiments of the present application, the second determining module 210 may specifically be used to:
在M-1个差值满足第二预定条件的情况下,将最大的人脸匹配度对应的预定对象确定为第一对象,其中,第二预定条件包括:M-1个差值中的第一差值大于预定差值阈值,第一差值为最大的人脸匹配度与次最大的人脸匹配度之间的差值。In the case that the M-1 difference values satisfy the second predetermined condition, the predetermined object corresponding to the maximum face matching degree is determined as the first object, wherein the second predetermined condition includes: the first object in the M-1 difference values A difference is greater than a predetermined difference threshold, and the first difference is the difference between the largest face matching degree and the second largest human face matching degree.
由于对人脸匹配度进行分析得出:在人脸匹配成功的样本中,最大的人脸匹配度(即第一个人脸匹配度)比次最大的人脸匹配度(即第二个人脸匹配度)要大很多。因此,在最大的人脸匹配度与次最大的人脸匹配度之间的差值大于预定差值阈值的情况下,可以认为本次人脸识别结果比较可信,并确定最大的人脸匹配度对应的预定对象与第一对象匹配。由此,优化了人脸识别方案,使得人脸识别的结果更加准确,减少误识别的风险。Due to the analysis of the face matching degree, it is concluded that among the samples with successful face matching, the largest face matching degree (ie the first face matching degree) is higher than the second largest face matching degree (ie the second face matching degree) match) is much larger. Therefore, if the difference between the largest face matching degree and the next largest face matching degree is greater than the predetermined difference threshold, it can be considered that the face recognition result is more credible, and the largest face matching degree is determined. The predetermined object corresponding to the degree matches the first object. As a result, the face recognition scheme is optimized, so that the result of face recognition is more accurate, and the risk of misrecognition is reduced.
在本申请的一个或多个实施例中,第二预定条件还包括:第二差值不大于预定差值阈值,第二差值为M-1个差值中的除第一差值之外的差值。In one or more embodiments of the present application, the second predetermined condition further includes: the second difference value is not greater than a predetermined difference value threshold, and the second difference value is in addition to the first difference value among M-1 difference values difference value.
在本申请实施例中,第二预定条件包括:第一差值大于预定差值阈值,其余的第二差值不大于预定差值阈值,也就是说最大的人脸匹配度与 次最大的人脸匹配度之间相差比较大,其余的人脸匹配度相差比较小,即人脸匹配度序列整体呈现出“首部陡峭,后续平滑”的变化趋势。在此情况下,认为本次识别结果可信。如此,可以进一步地保证人脸识别结果的准确性。In this embodiment of the present application, the second predetermined condition includes: the first difference is greater than the predetermined difference threshold, and the remaining second differences are not greater than the predetermined difference threshold, that is to say, the largest face matching degree is the second largest person The difference between the face matching degrees is relatively large, and the difference between the remaining face matching degrees is relatively small, that is, the overall face matching degree sequence shows a trend of "steep first, smooth subsequent". In this case, the identification result of this time is considered to be credible. In this way, the accuracy of the face recognition result can be further guaranteed.
在本申请的一个或多个实施例中,第一确定模块204可以包括:In one or more embodiments of the present application, the first determining module 204 may include:
第一计算单元,用于对于第一人脸库中同一个预定对象的N个人脸图像,计算第一人脸图像分别与N个人脸图像中的每个人脸图像的相似度,得到N个相似度,N为大于1的整数;The first calculation unit is used to calculate the similarity between the first face image and each face image in the N face images for N face images of the same predetermined object in the first face database, and obtain N similarities degree, N is an integer greater than 1;
第一确定单元,用于根据N个相似度,确定目标识别对象与预定对象的人脸匹配度。The first determining unit is configured to determine, according to the N similarities, the degree of face matching between the target recognition object and the predetermined object.
在本申请实施例中,第一人脸库中存储有同一个预定对象的多个人脸图像,计算第一人脸图像与预定对象的每个人脸图像的相似度,得到多个相似度,根据多个相似度,可以准确地确定目标识别对象与预定对象的人脸匹配度,从而可以更加准确地进行人脸识别。In the embodiment of the present application, the first face database stores multiple face images of the same predetermined object, and the similarity between the first face image and each face image of the predetermined object is calculated to obtain a plurality of similarities, according to The multiple similarity degrees can accurately determine the face matching degree between the target recognition object and the predetermined object, so that the face recognition can be performed more accurately.
在本申请的一个或多个实施例中,第一确定单元可以包括以下其中一项:In one or more embodiments of the present application, the first determining unit may include one of the following:
第一确定子单元,用于将N个相似度中的最大相似度确定为目标识别对象与预定对象的人脸匹配度;a first determination subunit, used for determining the maximum similarity among the N similarities as the face matching degree between the target recognition object and the predetermined object;
第二确定子单元,用于在N个相似度中的第一相似度大于第一预定阈值的情况下,将第一相似度确定为目标识别对象与预定对象的人脸匹配度,第一相似度为第一人脸图像与多个人脸图像中的第二人脸图像的相似度,第二人脸图像为在进行人脸识别设置时采集的人脸图像;The second determination subunit is configured to determine the first similarity as the face matching degree between the target recognition object and the predetermined object when the first similarity among the N similarities is greater than the first predetermined threshold, and the first similarity is The degree is the similarity between the first face image and the second face image in the plurality of face images, and the second face image is the face image collected when the face recognition setting is performed;
第三确定子单元,用于将N个相似度中的至少部分相似度的平均值确定为目标识别对象与预定对象的人脸匹配度;a third determination subunit, configured to determine the average value of at least part of the similarity among the N similarities as the face matching degree between the target recognition object and the predetermined object;
第四确定子单元,用于根据N个相似度中各个相似度的权重值,对N个相似度进行加权计算,得到目标识别对象与预定对象的人脸匹配度。The fourth determination subunit is configured to perform weighted calculation on the N similarities according to the weight value of each similarity in the N similarities, so as to obtain the face matching degree between the target recognition object and the predetermined object.
在本申请的一个或多个实施例中,人脸识别装置200还可以包括:In one or more embodiments of the present application, the face recognition apparatus 200 may further include:
添加模块,用于在最大的人脸匹配度大于第二预定阈值的情况下,将第一人脸图像作为第一对象的人脸图像添加至第一人脸库中,其中,第二 预定阈值为大于第一预定阈值的数值。The adding module is configured to add the first face image as the face image of the first object to the first face database when the maximum face matching degree is greater than the second predetermined threshold, wherein the second predetermined threshold is a value greater than the first predetermined threshold.
在本申请的一个或多个实施例中,人脸识别装置200还可以包括:In one or more embodiments of the present application, the face recognition apparatus 200 may further include:
第三获取模块,用于在第一人脸库中第一对象的人脸图像数量大于预定数量阈值的情况下,在第一人脸库的第一对象的人脸图像中,获取第三人脸图像,第三人脸图像为除人脸识别设置时采集的人脸图像之外的人脸图像;A third acquisition module, configured to acquire a third person from the face images of the first object in the first face database when the number of face images of the first object in the first face database is greater than a predetermined number threshold face image, the third face image is a face image other than the face image collected during face recognition setting;
第一删除模块,用于根据各个第三人脸图像分别对应的人脸匹配度,删除至少一个第三人脸图像中人脸匹配度最小的人脸图像,其中,第三人脸图像对应的人脸匹配度为:对第三人脸图像中的人脸进行识别时计算得到的第三人脸图像中的对象与第一对象的人脸匹配度。The first deletion module is used to delete the face image with the smallest face matching degree in at least one third face image according to the face matching degree corresponding to each third face image, wherein the third face image corresponds to the face image. The face matching degree is: the face matching degree between the object in the third face image and the first object obtained by recognizing the face in the third face image.
在本申请实施例中,可以删除第一人脸库中质量不好的人脸图像,使得第一人脸库中的人脸图像不断更新,并保存质量较好的人脸图像。在利用更新后的第一人脸库进行人脸识别时,可以保证人脸识别结果的准确性。In the embodiment of the present application, the face images with poor quality in the first face database can be deleted, so that the face images in the first face database are continuously updated, and the face images with better quality are saved. When using the updated first face database for face recognition, the accuracy of the face recognition result can be guaranteed.
在本申请的一个或多个实施例中,人脸识别装置200还可以包括:In one or more embodiments of the present application, the face recognition apparatus 200 may further include:
第三确定模块,用于在第一人脸库的第一对象的人脸图像中,确定是否存在与第一人脸图像的相似度小于第三预定阈值的第四人脸图像,第三预定阈值为小于第一预定阈值的数值;The third determining module is configured to determine, in the face image of the first object in the first face database, whether there is a fourth face image whose similarity with the first face image is less than a third predetermined threshold, the third predetermined The threshold is a value smaller than the first predetermined threshold;
第二计算模块,用于在存在第四人脸图像的情况下,将第四人脸图像对应的第一参数值加1,第一参数值表示第四人脸图像与至少一个目标识别对象的第一人脸图像之间的不匹配次数;The second calculation module is configured to add 1 to the first parameter value corresponding to the fourth human face image in the presence of the fourth human face image, where the first parameter value represents the relationship between the fourth human face image and at least one target recognition object The number of mismatches between the first face images;
第二删除模块,用于在第一参数值大于预定的第一次数阈值的情况下,将第四人脸图像从第一人脸库中删除。The second deletion module is configured to delete the fourth human face image from the first human face database when the value of the first parameter is greater than the predetermined threshold of the first number of times.
在本申请实施例中,如果目标识别对象与第一对象匹配,而目标识别对象的第一人脸图像与第一人脸库中第一对象的第四人脸图像的相似度较小。在此情况下,将第四人脸图像对应的第一参数值加1,也就是第四人脸图像的不匹配次数加1。在第一参数值大于预定的第一次数阈值的情况下,说明可能是因为在人脸识别过程中由于个别角度等原因使得第四人脸图像的人脸匹配度过高,而导致第四人脸图像误添加至第一人脸库中。此 时,可以将第四人脸图像从第一人脸库中删除,如此可以删除误添加至第一人脸库中的人脸图像,从而不断优化第一人脸库。In this embodiment of the present application, if the target recognition object matches the first object, the similarity between the first face image of the target recognition object and the fourth face image of the first object in the first face database is small. In this case, the value of the first parameter corresponding to the fourth face image is increased by 1, that is, the number of mismatches of the fourth face image is increased by 1. In the case where the value of the first parameter is greater than the predetermined threshold of the first number of times, it may be because the face matching of the fourth face image is too high due to individual angles and other reasons in the face recognition process, which leads to the fourth The face image was mistakenly added to the first face database. At this time, the fourth face image can be deleted from the first face database, so that the face image added to the first face database by mistake can be deleted, so as to continuously optimize the first face database.
在本申请的一个或多个实施例中,人脸识别装置200还可以包括:In one or more embodiments of the present application, the face recognition apparatus 200 may further include:
第四获取模块,用于在M-1个差值不满足第二预定条件的情况下,获取目标识别对象的第一三维人脸图像;a fourth acquisition module, configured to acquire the first three-dimensional face image of the target recognition object when the M-1 differences do not meet the second predetermined condition;
匹配模块,用于将第一三维人脸图像与第二人脸库中预定对象的三维人脸图像进行匹配;a matching module for matching the first three-dimensional face image with the three-dimensional face image of the predetermined object in the second face database;
第四确定模块,用于在第一三维人脸图像与第二人脸库中第二对象的第二三维人脸图像匹配成功,且第二三维人脸图像对应的第二参数值大于预定的第二次数阈值的情况下,确定目标识别对象与第二对象的人脸匹配,其中,第二参数值表示利用第二三维人脸图像进行人脸识别成功的次数。The fourth determination module is used to successfully match the first three-dimensional face image with the second three-dimensional face image of the second object in the second face database, and the second parameter value corresponding to the second three-dimensional face image is greater than a predetermined value. In the case of the second number of times threshold, it is determined that the target recognition object matches the face of the second object, wherein the second parameter value represents the number of successful face recognition using the second three-dimensional face image.
在本申请实施例中,可以根据第二人脸库中的三维人脸图像辅助进行无感验证,减少用户的输入和感知,提升用户体验。In the embodiment of the present application, the sensorless verification can be performed assisted by the three-dimensional face image in the second face database, so as to reduce the user's input and perception, and improve the user experience.
在本申请的一个或多个实施例中,人脸识别装置200还可以包括:In one or more embodiments of the present application, the face recognition apparatus 200 may further include:
第五获取模块,用于在第二参数值不大于第二次数阈值的情况下,获取目标识别对象的身份验证信息;a fifth acquisition module, configured to acquire the identity verification information of the target identification object when the second parameter value is not greater than the second number of times threshold;
识别模块,用于利用身份验证信息进行身份识别,得到识别结果;The identification module is used to identify the identity by using the identity verification information to obtain the identification result;
第三计算模块,用于在利用身份验证信息的识别结果与利用第一三维人脸图像的人脸识别结果一致的情况下,将第二参数值加1;The third computing module is used to add 1 to the second parameter value when the recognition result using the identity verification information is consistent with the face recognition result using the first three-dimensional face image;
第四计算模块,用于在利用第一三维人脸图像的人脸识别结果与利用身份验证信息的识别结果不一致的情况下,将第二参数值减1。The fourth calculation module is configured to reduce the value of the second parameter by 1 when the face recognition result using the first three-dimensional face image is inconsistent with the recognition result using the identity verification information.
在本申请的一个或多个实施例中,人脸识别装置200还可以包括:In one or more embodiments of the present application, the face recognition apparatus 200 may further include:
第三删除模块,用于在减1之后的所述第二参数值小于预定的第三次数阈值的情况下,删除所述第二人脸库中的所述第二三维人脸图像,所述第三次数阈值小于所述第二次数阈值。A third deletion module, configured to delete the second three-dimensional face image in the second face database when the second parameter value after subtracting 1 is less than a predetermined third threshold of times, and the The third threshold of times is smaller than the second threshold of times.
如此,可以不断更新第二人脸库,从而不断提高第二人脸库中的三维人脸图像的质量,降低利用第二人脸库中的三维人脸图像进行人脸识别的风险。In this way, the second face database can be continuously updated, thereby continuously improving the quality of the three-dimensional face images in the second face database, and reducing the risk of using the three-dimensional face images in the second face database for face recognition.
本申请还提供一种人脸识别设备,人脸识别设备包括:处理器以及存储有计算机程序指令的存储器,处理器执行计算机程序指令时实现上述人脸识别方法的任意一项实施例的步骤。The present application also provides a face recognition device comprising: a processor and a memory storing computer program instructions, the processor implements the steps of any one of the above-mentioned face recognition method embodiments when the processor executes the computer program instructions.
图6示出了本申请提供的人脸识别设备的一实施例的硬件结构示意图。FIG. 6 shows a schematic diagram of a hardware structure of an embodiment of a face recognition device provided by the present application.
如图6所示,人脸识别设备可以包括处理器301以及存储有计算机程序指令的存储器302。As shown in FIG. 6 , the face recognition device may include a processor 301 and a memory 302 storing computer program instructions.
具体地,上述处理器301可以包括中央处理器(CPU),或者特定集成电路(Application Specific Integrated Circuit,ASIC),或者可以被配置成实施本申请实施例的一个或多个集成电路。Specifically, the above-mentioned processor 301 may include a central processing unit (CPU), or a specific integrated circuit (Application Specific Integrated Circuit, ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.
存储器302可以包括用于数据或指令的大容量存储器。举例来说而非限制,存储器302可包括硬盘驱动器(Hard Disk Drive,HDD)、软盘驱动器、闪存、光盘、磁光盘、磁带或通用串行总线(Universal Serial Bus,USB)驱动器或者两个或更多个以上这些的组合。在合适的情况下,存储器302可包括可移除或不可移除(或固定)的介质。在合适的情况下,存储器302可在综合网关容灾设备的内部或外部。在特定实施例中,存储器302是非易失性固态存储器。 Memory 302 may include mass storage for data or instructions. By way of example and not limitation, memory 302 may include a Hard Disk Drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a Universal Serial Bus (USB) drive or two or more A combination of more than one of the above. Memory 302 may include removable or non-removable (or fixed) media, where appropriate. Storage 302 may be internal or external to the integrated gateway disaster recovery device, where appropriate. In certain embodiments, memory 302 is non-volatile solid state memory.
存储器可包括只读存储器(ROM),随机存取存储器(RAM),磁盘存储介质设备,光存储介质设备,闪存设备,电气、光学或其他物理/有形的存储器存储设备。因此,通常,存储器包括一个或多个编码有包括计算机可执行指令的软件的有形(非暂态)计算机可读存储介质(例如,存储器设备),并且当该软件被执行(例如,由一个或多个处理器)时,其可操作来执行参考根据本公开的一方面的方法所描述的操作。Memory may include read only memory (ROM), random access memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical or other physical/tangible memory storage devices. Thus, typically, a memory includes one or more tangible (non-transitory) computer-readable storage media (eg, memory devices) encoded with software including computer-executable instructions, and when the software is executed (eg, by a or multiple processors), it is operable to perform the operations described with reference to a method according to an aspect of the present disclosure.
处理器301通过读取并执行存储器302中存储的计算机程序指令,以实现上述实施例中的任意一种人脸识别方法。The processor 301 reads and executes the computer program instructions stored in the memory 302 to implement any one of the face recognition methods in the foregoing embodiments.
在一些示例中,人脸识别设备还可包括通信接口303和总线310。其中,如图6所示,处理器301、存储器302、通信接口303通过总线310连接并完成相互间的通信。In some examples, the facial recognition device may also include a communication interface 303 and a bus 310 . Among them, as shown in FIG. 6 , the processor 301 , the memory 302 , and the communication interface 303 are connected through the bus 310 and complete the mutual communication.
通信接口303,主要用于实现本申请实施例中各模块、装置、单元和/ 或设备之间的通信。The communication interface 303 is mainly used to implement communication between modules, apparatuses, units and/or devices in the embodiments of the present application.
总线310包括硬件、软件或两者,将在线数据流量计费设备的部件彼此耦接在一起。举例来说而非限制,总线310可包括加速图形端口(AGP)或其他图形总线、增强工业标准架构(EISA)总线、前端总线(FSB)、超传输(HT)互连、工业标准架构(ISA)总线、无限带宽互连、低引脚数(LPC)总线、存储器总线、微信道架构(MCA)总线、外围组件互连(PCI)总线、PCI-Express(PCI-X)总线、串行高级技术附件(SATA)总线、视频电子标准协会局部(VLB)总线或其他合适的总线或者两个或更多个以上这些的组合。在合适的情况下,总线310可包括一个或多个总线。尽管本申请实施例描述和示出了特定的总线,但本申请考虑任何合适的总线或互连。The bus 310 includes hardware, software, or both, coupling the components of the online data flow metering device to each other. By way of example and not limitation, bus 310 may include Accelerated Graphics Port (AGP) or other graphics bus, Enhanced Industry Standard Architecture (EISA) bus, Front Side Bus (FSB), HyperTransport (HT) interconnect, Industry Standard Architecture (ISA) ) bus, Infiniband Interconnect, Low Pin Count (LPC) bus, Memory Bus, Microchannel Architecture (MCA) bus, Peripheral Component Interconnect (PCI) bus, PCI-Express (PCI-X) bus, Serial Advanced Technology Attachment (SATA) bus, Video Electronics Standards Association Local (VLB) bus or other suitable bus or a combination of two or more of the above. Bus 310 may include one or more buses, where appropriate. Although embodiments herein describe and illustrate a particular bus, this application contemplates any suitable bus or interconnect.
另外,结合上述实施例中的人脸识别方法,本申请实施例可提供一种计算机存储介质来实现。该计算机存储介质上存储有计算机程序指令;该计算机程序指令被处理器执行时实现上述实施例中的任意一种人脸识别方法。所示的计算机可读存储介质的示例包括非暂态计算机可读存储介质,如只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等。In addition, in combination with the face recognition method in the foregoing embodiment, the embodiment of the present application may provide a computer storage medium for implementation. Computer program instructions are stored on the computer storage medium; when the computer program instructions are executed by the processor, any one of the face recognition methods in the foregoing embodiments is implemented. Examples of computer-readable storage media shown include non-transitory computer-readable storage media, such as read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk, etc. .
需要明确的是,本申请并不局限于上文所描述并在图中示出的特定配置和处理。为了简明起见,这里省略了对已知方法的详细描述。在上述实施例中,描述和示出了若干具体的步骤作为示例。但是,本申请的方法过程并不限于所描述和示出的具体步骤,本领域的技术人员可以在领会本申请的精神后,作出各种改变、修改和添加,或者改变步骤之间的顺序。To be clear, the present application is not limited to the specific configurations and processes described above and illustrated in the figures. For the sake of brevity, detailed descriptions of known methods are omitted here. In the above-described embodiments, several specific steps are described and shown as examples. However, the method process of the present application is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the sequence of steps after comprehending the spirit of the present application.
以上所述的结构框图中所示的功能块可以实现为硬件、软件、固件或者它们的组合。当以硬件方式实现时,其可以例如是电子电路、专用集成电路(ASIC)、适当的固件、插件、功能卡等等。当以软件方式实现时,本申请的元素是被用于执行所需任务的程序或者代码段。程序或者代码段可以存储在机器可读介质中,或者通过载波中携带的数据信号在传输介质或者通信链路上传送。“机器可读介质”可以包括能够存储或传输信息的任何介质。机器可读介质可以包括非暂态计算机可读存储介质,比如包括电 子电路、半导体存储器设备、ROM、闪存、可擦除ROM(EROM)、软盘、CD-ROM、光盘、硬盘、光纤介质,机器可读介质还可以包括射频(RF)链路,等等。代码段可以经由诸如因特网、内联网等的计算机网络被下载。The functional blocks shown in the above-described structural block diagrams may be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic circuit, an application specific integrated circuit (ASIC), suitable firmware, a plug-in, a function card, or the like. When implemented in software, elements of the present application are programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted over a transmission medium or communication link by a data signal carried in a carrier wave. A "machine-readable medium" may include any medium that can store or transmit information. Machine-readable media may include non-transitory computer-readable storage media, such as including electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, machine The readable medium may also include a radio frequency (RF) link, among others. The code segments may be downloaded via a computer network such as the Internet, an intranet, or the like.
还需要说明的是,本申请中提及的示例性实施例,基于一系列的步骤或者装置描述一些方法或系统。但是,本申请不局限于上述步骤的顺序,也就是说,可以按照实施例中提及的顺序执行步骤,也可以不同于实施例中的顺序,或者若干步骤同时执行。It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, the present application is not limited to the order of the above steps, that is, the steps may be performed in the order mentioned in the embodiment, or may be different from the order in the embodiment, or several steps may be performed simultaneously.
上面参考根据本申请的实施例的方法、装置(系统)和计算机程序产品的流程图和/或框图描述了本申请的各方面。应当理解,流程图和/或框图中的每个方框以及流程图和/或框图中各方框的组合可以由计算机程序指令实现。这些计算机程序指令可被提供给通用计算机、专用计算机、或其它可编程数据处理装置的处理器,以产生一种机器,使得经由计算机或其它可编程数据处理装置的处理器执行的这些指令使能对流程图和/或框图的一个或多个方框中指定的功能/动作的实现。这种处理器可以是但不限于是通用处理器、专用处理器、特殊应用处理器或者现场可编程逻辑电路。还可理解,框图和/或流程图中的每个方框以及框图和/或流程图中的方框的组合,也可以由执行指定的功能或动作的专用硬件来实现,或可由专用硬件和计算机指令的组合来实现。Aspects of the present application are described above with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the present application. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine such that execution of the instructions via the processor of the computer or other programmable data processing apparatus enables the Implementation of the functions/acts specified in one or more blocks of the flowchart and/or block diagrams. Such processors may be, but are not limited to, general purpose processors, special purpose processors, application specific processors, or field programmable logic circuits. It will also be understood that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can also be implemented by special purpose hardware for performing the specified functions or actions, or by special purpose hardware and/or A combination of computer instructions is implemented.
以上所述,仅为本申请的具体实施方式,所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,上述描述的系统、模块和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。应理解,本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到各种等效的修改或替换,这些修改或替换都应涵盖在本申请的保护范围之内。The above are only specific implementations of the present application. Those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working process of the above-described systems, modules and units may refer to the foregoing method embodiments. The corresponding process in , will not be repeated here. It should be understood that the protection scope of the present application is not limited to this. Any person skilled in the art can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should all cover within the scope of protection of this application.

Claims (14)

  1. 一种人脸识别方法,包括:A face recognition method, comprising:
    获取目标识别对象的第一人脸图像;Obtain the first face image of the target recognition object;
    根据所述第一人脸图像以及第一人脸库中各个预定对象的人脸图像,确定所述目标识别对象与各个所述预定对象的人脸匹配度;According to the first face image and the face images of each predetermined object in the first face database, determine the face matching degree between the target recognition object and each of the predetermined objects;
    在所述人脸匹配度满足第一预定条件的情况下,从人脸匹配度序列中获取前M个人脸匹配度,所述人脸匹配度序列为所述目标识别对象与各个所述预定对象的人脸匹配度按照从大到小的顺序排列得到的序列;M为大于1的整数,所述第一预定条件包括以下至少一项:所述目标识别对象与多个所述预定对象的人脸匹配度大于第一预定阈值,最大的所述人脸匹配度与所述第一预定阈值的差值小于预定数值;In the case that the face matching degree satisfies the first predetermined condition, the first M face matching degrees are obtained from the face matching degree sequence, and the face matching degree sequence is the target recognition object and each of the predetermined objects. M is an integer greater than 1, and the first predetermined condition includes at least one of the following: the target recognition object and a plurality of people of the predetermined object The face matching degree is greater than a first predetermined threshold, and the difference between the maximum face matching degree and the first predetermined threshold is less than a predetermined value;
    计算M个所述人脸匹配度中的每相邻两个所述人脸匹配度的差值,得到M-1个差值;Calculate the difference value of each adjacent two described human face matching degrees in the M described human face matching degrees, and obtain M-1 difference values;
    根据所述M-1个差值,在多个所述预定对象中确定与所述目标识别对象的人脸匹配的第一对象。According to the M-1 difference values, a first object matching the face of the target recognition object is determined from among the plurality of predetermined objects.
  2. 根据权利要求1所述的方法,其中,所述根据所述M-1个差值,在多个所述预定对象中确定与所述目标识别对象的人脸匹配的第一对象,包括:The method according to claim 1, wherein, according to the M-1 difference values, determining a first object matching the face of the target recognition object among the plurality of predetermined objects comprises:
    在所述M-1个差值满足第二预定条件的情况下,将最大的所述人脸匹配度对应的所述预定对象确定为所述第一对象,其中,所述第二预定条件包括:所述M-1个差值中的第一差值大于预定差值阈值,所述第一差值为最大的所述人脸匹配度与次最大的所述人脸匹配度之间的差值。In the case that the M-1 difference values satisfy a second predetermined condition, the predetermined object corresponding to the largest face matching degree is determined as the first object, wherein the second predetermined condition includes : the first difference value among the M-1 difference values is greater than a predetermined difference value threshold, and the first difference value is the difference between the maximum matching degree of the human face and the second largest matching degree of the human face value.
  3. 根据权利要求2所述的方法,其中,所述第二预定条件还包括:第二差值不大于所述预定差值阈值,所述第二差值为所述M-1个差值中的除所述第一差值之外的差值。The method according to claim 2, wherein the second predetermined condition further comprises: a second difference value is not greater than the predetermined difference value threshold, and the second difference value is one of the M−1 difference values. Differences other than the first difference.
  4. 根据权利要求1所述的方法,其中,所述根据所述第一人脸图像以及第一人脸库中各个预定对象的人脸图像,确定所述目标识别对象与各个所述预定对象的人脸匹配度,包括:The method according to claim 1, wherein the target recognition object and the person of each predetermined object are determined according to the first face image and the face image of each predetermined object in the first face database Face matching, including:
    对于所述第一人脸库中同一个所述预定对象的N个人脸图像,计算所 述第一人脸图像分别与所述N个人脸图像中的每个人脸图像的相似度,得到N个相似度,N为大于1的整数;For N face images of the same predetermined object in the first face database, the similarity between the first face image and each face image in the N face images is calculated, and N face images are obtained. Similarity, N is an integer greater than 1;
    根据所述N个相似度,确定所述目标识别对象与所述预定对象的人脸匹配度。According to the N similarities, the face matching degree between the target recognition object and the predetermined object is determined.
  5. 根据权利要求4所述的方法,其中,所述根据所述N个相似度,确定所述目标识别对象与所述预定对象的人脸匹配度,包括以下其中一项:The method according to claim 4, wherein the determining, according to the N similarities, the degree of face matching between the target recognition object and the predetermined object, comprising one of the following:
    将所述N个相似度中的最大相似度确定为所述目标识别对象与所述预定对象的人脸匹配度;Determining the maximum similarity among the N similarities as the face matching degree between the target recognition object and the predetermined object;
    在所述N个相似度中的第一相似度大于所述第一预定阈值的情况下,将所述第一相似度确定为所述目标识别对象与所述预定对象的人脸匹配度,所述第一相似度为所述第一人脸图像与所述多个人脸图像中的第二人脸图像的相似度,所述第二人脸图像为在进行人脸识别设置时采集的人脸图像;In the case where the first similarity among the N similarities is greater than the first predetermined threshold, the first similarity is determined as the face matching degree between the target recognition object and the predetermined object, and the The first similarity is the similarity between the first face image and the second face image in the plurality of face images, and the second face image is the face collected during the face recognition setting image;
    将所述N个相似度中的至少部分相似度的平均值确定为所述目标识别对象与所述预定对象的人脸匹配度;determining the average value of at least part of the similarity among the N similarities as the face matching degree between the target recognition object and the predetermined object;
    根据所述N个相似度中各个相似度的权重值,对所述N个相似度进行加权计算,得到所述目标识别对象与所述预定对象的人脸匹配度。According to the weight value of each similarity in the N similarities, weighted calculation is performed on the N similarities, so as to obtain the face matching degree between the target recognition object and the predetermined object.
  6. 根据权利要求1所述的方法,其中,所述根据所述M-1个差值,在多个所述预定对象中确定所述目标识别对象对应的对象之后,所述方法还包括:The method according to claim 1, wherein after the object corresponding to the target recognition object is determined from the plurality of predetermined objects according to the M-1 difference values, the method further comprises:
    在最大的所述人脸匹配度大于第二预定阈值的情况下,将所述第一人脸图像作为所述第一对象的人脸图像添加至所述第一人脸库中,其中,所述第二预定阈值为大于所述第一预定阈值的数值。In the case that the maximum matching degree of the face is greater than the second predetermined threshold, the first face image is added to the first face database as the face image of the first object, wherein the The second predetermined threshold is a value greater than the first predetermined threshold.
  7. 根据权利要求6所述的方法,其中,所述将所述第一人脸图像作为所述第一对象的人脸图像添加至所述第一人脸库中之后,所述方法还包括:The method according to claim 6, wherein after adding the first face image as the face image of the first object to the first face database, the method further comprises:
    在所述第一人脸库中所述第一对象的人脸图像数量大于预定数量阈值的情况下,在所述第一人脸库的所述第一对象的人脸图像中,获取第三人脸图像,所述第三人脸图像为除人脸识别设置时采集的人脸图像之外的人 脸图像;In the case where the number of face images of the first object in the first face database is greater than a predetermined number threshold, obtain a third a face image, the third face image is a face image other than the face image collected during the face recognition setting;
    根据各个所述第三人脸图像分别对应的人脸匹配度,删除至少一个所述第三人脸图像中人脸匹配度最小的人脸图像,其中,所述第三人脸图像对应的人脸匹配度为:对所述第三人脸图像中的人脸进行识别时计算得到的所述第三人脸图像中的对象与所述第一对象的人脸匹配度。Delete at least one face image with the smallest face matching degree among the third face images according to the face matching degrees corresponding to each of the third face images, wherein the person corresponding to the third face image is deleted. The face matching degree is: the face matching degree between the object in the third human face image and the first object obtained by recognizing the human face in the third human face image.
  8. 根据权利要求4所述的方法,其中,所述根据所述M-1个差值,在多个所述预定对象中确定所述目标识别对象对应的第一对象之后,所述方法还包括:The method according to claim 4, wherein after the first object corresponding to the target identification object is determined from the plurality of predetermined objects according to the M-1 difference values, the method further comprises:
    在所述第一人脸库的所述第一对象的人脸图像中,确定是否存在与所述第一人脸图像的相似度小于第三预定阈值的第四人脸图像,所述第三预定阈值为小于所述第一预定阈值的数值;In the face image of the first object in the first face database, it is determined whether there is a fourth face image whose similarity with the first face image is less than a third predetermined threshold, the third face image The predetermined threshold is a value smaller than the first predetermined threshold;
    在存在所述第四人脸图像的情况下,将所述第四人脸图像对应的第一参数值加1,所述第一参数值表示所述第四人脸图像与至少一个所述目标识别对象的第一人脸图像之间的不匹配次数;In the case where the fourth human face image exists, add 1 to the first parameter value corresponding to the fourth human face image, where the first parameter value indicates that the fourth human face image and at least one of the targets The number of mismatches between the first face images of the identified object;
    在所述第一参数值大于预定的第一次数阈值的情况下,将所述第四人脸图像从所述第一人脸库中删除。In the case that the value of the first parameter is greater than a predetermined threshold of the first number of times, the fourth face image is deleted from the first face database.
  9. 根据权利要求2所述的方法,其中,所述计算M个所述人脸匹配度中的每相邻两个所述人脸匹配度的差值,得到M-1个差值之后,所述方法还包括:The method according to claim 2, wherein after calculating the difference between each adjacent two of the M face matching degrees, and obtaining M-1 difference values, the Methods also include:
    在所述M-1个差值不满足所述第二预定条件的情况下,获取所述目标识别对象的第一三维人脸图像;In the case that the M-1 difference values do not meet the second predetermined condition, acquiring a first three-dimensional face image of the target recognition object;
    将所述第一三维人脸图像与第二人脸库中所述预定对象的三维人脸图像进行匹配;matching the first three-dimensional face image with the three-dimensional face image of the predetermined object in the second face database;
    在所述第一三维人脸图像与所述第二人脸库中第二对象的第二三维人脸图像匹配成功,且所述第二三维人脸图像对应的第二参数值大于预定的第二次数阈值的情况下,确定所述目标识别对象与所述第二对象的人脸匹配,其中,所述第二参数值表示利用所述第二三维人脸图像进行人脸识别成功的次数。The first three-dimensional face image is successfully matched with the second three-dimensional face image of the second object in the second face database, and the second parameter value corresponding to the second three-dimensional face image is greater than a predetermined first In the case of a quadratic number threshold, it is determined that the target recognition object matches the face of the second object, wherein the second parameter value represents the number of times of successful face recognition using the second three-dimensional face image.
  10. 根据权利要求9所述的方法,其特征在于,所述计算M个所述人 脸匹配度中的每相邻两个所述人脸匹配度的差值,得到M-1个差值之后,所述方法还包括:The method according to claim 9, characterized in that, after calculating the difference between each adjacent two of the M face matching degrees, after obtaining M-1 difference values, The method also includes:
    在所述第二参数值不大于所述第二次数阈值的情况下,获取所述目标识别对象的身份验证信息;Under the condition that the second parameter value is not greater than the second threshold of times, obtain the identity verification information of the target identification object;
    利用所述身份验证信息进行身份识别,得到识别结果;Use the identity verification information to perform identity recognition to obtain the recognition result;
    在利用所述身份验证信息的识别结果与利用所述第一三维人脸图像的人脸识别结果一致的情况下,将所述第二参数值加1;When the recognition result using the identity verification information is consistent with the face recognition result using the first three-dimensional face image, add 1 to the second parameter value;
    在利用所述第一三维人脸图像的人脸识别结果与利用所述身份验证信息的识别结果不一致的情况下,将所述第二参数值减1。In the case that the face recognition result using the first three-dimensional face image is inconsistent with the recognition result using the identity verification information, the second parameter value is decreased by 1.
  11. 根据权利要求10所述的方法,其中,所述将所述第二参数值减1之后,所述方法还包括:The method according to claim 10, wherein after the decreasing the second parameter value by 1, the method further comprises:
    在减1之后的所述第二参数值小于预定的第三次数阈值的情况下,删除所述第二人脸库中的所述第二三维人脸图像,所述第三次数阈值小于所述第二次数阈值。In the case that the second parameter value after subtracting 1 is smaller than a predetermined third time threshold, delete the second three-dimensional face image in the second face database, and the third time threshold is smaller than the third time threshold Second time threshold.
  12. 一种人脸识别装置,包括:A face recognition device, comprising:
    第一获取模块,用于获取目标识别对象的第一人脸图像;a first acquisition module, used for acquiring the first face image of the target recognition object;
    第一确定模块,用于根据所述第一人脸图像以及第一人脸库中各个预定对象的人脸图像,确定所述目标识别对象与各个所述预定对象的人脸匹配度;a first determination module, configured to determine the face matching degree between the target recognition object and each of the predetermined objects according to the first face image and the face images of each predetermined object in the first face database;
    第二获取模块,用于在所述人脸匹配度满足第一预定条件的情况下,从人脸匹配度序列中获取前M个人脸匹配度,所述人脸匹配度序列为所述目标识别对象与各个所述预定对象的人脸匹配度按照从大到小的顺序排列得到的序列;M为大于1的整数,所述第一预定条件包括以下至少一项:所述目标识别对象与多个所述预定对象的人脸匹配度大于第一预定阈值,最大的所述人脸匹配度与所述第一预定阈值的差值小于预定数值;The second obtaining module is configured to obtain the first M face matching degrees from the face matching degree sequence when the face matching degree satisfies the first predetermined condition, and the face matching degree sequence is the target recognition A sequence obtained by arranging the face matching degrees of the objects and each of the predetermined objects in descending order; M is an integer greater than 1, and the first predetermined condition includes at least one of the following: the target recognition object and multiple The face matching degree of each of the predetermined objects is greater than a first predetermined threshold, and the difference between the largest face matching degree and the first predetermined threshold is less than a predetermined value;
    第一计算模块,用于计算M个所述人脸匹配度中的每相邻两个所述人脸匹配度的差值,得到M-1个差值;The first calculation module is used to calculate the difference between each adjacent two described face matching degrees in the M described face matching degrees, and obtain M-1 difference values;
    第二确定模块,用于根据所述M-1个差值,在多个所述预定对象中确定与所述目标识别对象的人脸匹配的第一对象。The second determining module is configured to determine, according to the M-1 difference values, a first object matching the face of the target recognition object from among the plurality of predetermined objects.
  13. 一种人脸识别设备,包括:处理器以及存储有计算机程序指令的存储器;A face recognition device, comprising: a processor and a memory storing computer program instructions;
    所述处理器执行所述计算机程序指令时实现如权利要求1-11任意一项所述的人脸识别方法的步骤。The processor implements the steps of the face recognition method according to any one of claims 1-11 when the processor executes the computer program instructions.
  14. 一种计算机存储介质,所述计算机存储介质上存储有计算机程序指令,所述计算机程序指令被处理器执行时实现如权利要求1-11任意一项所述的人脸识别方法的步骤。A computer storage medium, where computer program instructions are stored thereon, and when the computer program instructions are executed by a processor, the steps of the face recognition method according to any one of claims 1-11 are implemented.
PCT/CN2021/118143 2021-02-07 2021-09-14 Face recognition method and apparatus, device, and storage medium WO2022166207A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110175970.5 2021-02-07
CN202110175970.5A CN112818885B (en) 2021-02-07 Face recognition method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
WO2022166207A1 true WO2022166207A1 (en) 2022-08-11

Family

ID=75864573

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/118143 WO2022166207A1 (en) 2021-02-07 2021-09-14 Face recognition method and apparatus, device, and storage medium

Country Status (2)

Country Link
TW (1) TWI789128B (en)
WO (1) WO2022166207A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115880761A (en) * 2023-02-09 2023-03-31 数据空间研究院 Face recognition method, system, storage medium and application based on strategy optimization

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105868695A (en) * 2016-03-24 2016-08-17 北京握奇数据系统有限公司 Human face recognition method and system
CN108280422A (en) * 2018-01-22 2018-07-13 百度在线网络技术(北京)有限公司 The method and apparatus of face for identification
CN109977765A (en) * 2019-02-13 2019-07-05 平安科技(深圳)有限公司 Facial image recognition method, device and computer equipment
CN110059560A (en) * 2019-03-18 2019-07-26 阿里巴巴集团控股有限公司 The method, device and equipment of recognition of face
US20200210687A1 (en) * 2018-12-27 2020-07-02 Hong Fu Jin Precision Industry (Wuhan) Co., Ltd. Face recognition device, face recognition method, and computer readable storage medium
CN112818885A (en) * 2021-02-07 2021-05-18 中国银联股份有限公司 Face recognition method, device, equipment and storage medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110458062A (en) * 2019-07-30 2019-11-15 深圳市商汤科技有限公司 Face identification method and device, electronic equipment and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105868695A (en) * 2016-03-24 2016-08-17 北京握奇数据系统有限公司 Human face recognition method and system
CN108280422A (en) * 2018-01-22 2018-07-13 百度在线网络技术(北京)有限公司 The method and apparatus of face for identification
US20200210687A1 (en) * 2018-12-27 2020-07-02 Hong Fu Jin Precision Industry (Wuhan) Co., Ltd. Face recognition device, face recognition method, and computer readable storage medium
CN109977765A (en) * 2019-02-13 2019-07-05 平安科技(深圳)有限公司 Facial image recognition method, device and computer equipment
CN110059560A (en) * 2019-03-18 2019-07-26 阿里巴巴集团控股有限公司 The method, device and equipment of recognition of face
CN112818885A (en) * 2021-02-07 2021-05-18 中国银联股份有限公司 Face recognition method, device, equipment and storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115880761A (en) * 2023-02-09 2023-03-31 数据空间研究院 Face recognition method, system, storage medium and application based on strategy optimization

Also Published As

Publication number Publication date
TWI789128B (en) 2023-01-01
CN112818885A (en) 2021-05-18
TW202232367A (en) 2022-08-16

Similar Documents

Publication Publication Date Title
CN108229297B (en) Face recognition method and device, electronic equipment and computer storage medium
CN108269254B (en) Image quality evaluation method and device
US11321575B2 (en) Method, apparatus and system for liveness detection, electronic device, and storage medium
WO2019011165A1 (en) Facial recognition method and apparatus, electronic device, and storage medium
CN105335726B (en) Recognition of face confidence level acquisition methods and system
CN111242097A (en) Face recognition method and device, computer readable medium and electronic equipment
CN108280422B (en) Method and device for recognizing human face
WO2020143165A1 (en) Reproduced image recognition method and system, and terminal device
CN111931548B (en) Face recognition system, method for establishing face recognition data and face recognition method
CN110647823A (en) Method and device for optimizing human face base
WO2022166207A1 (en) Face recognition method and apparatus, device, and storage medium
US11023712B2 (en) Suspiciousness degree estimation model generation device
CN112560683A (en) Method and device for identifying copied image, computer equipment and storage medium
CN111783677A (en) Face recognition method, face recognition device, server and computer readable medium
CN109190495B (en) Gender identification method and device and electronic equipment
CN112818885B (en) Face recognition method, device, equipment and storage medium
CN114639143B (en) Portrait archiving method, device and storage medium based on artificial intelligence
CN114882576A (en) Face recognition method, electronic device, computer-readable medium, and program product
CN114519879A (en) Human body data archiving method, device, equipment and storage medium
CN114332993A (en) Face recognition method and device, electronic equipment and computer readable storage medium
CN113705428A (en) Living body detection method and apparatus, electronic device, and computer-readable storage medium
KR102027786B1 (en) Method and system for recognizing face of user based on multiple images
CN114972807B (en) Method and device for determining image recognition accuracy, electronic equipment and medium
CN117333926B (en) Picture aggregation method and device, electronic equipment and readable storage medium
EP4328796A1 (en) Template collection method, apparatus and system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21924204

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21924204

Country of ref document: EP

Kind code of ref document: A1