CN116052251A - Face image optimization method, device, equipment and storage medium - Google Patents

Face image optimization method, device, equipment and storage medium Download PDF

Info

Publication number
CN116052251A
CN116052251A CN202211733151.9A CN202211733151A CN116052251A CN 116052251 A CN116052251 A CN 116052251A CN 202211733151 A CN202211733151 A CN 202211733151A CN 116052251 A CN116052251 A CN 116052251A
Authority
CN
China
Prior art keywords
image
face
feature
score
images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211733151.9A
Other languages
Chinese (zh)
Inventor
陈稳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Jiadu Technology Software Development Co ltd
PCI Technology Group Co Ltd
PCI Technology and Service Co Ltd
Original Assignee
Guangzhou Jiadu Technology Software Development Co ltd
PCI Technology Group Co Ltd
PCI Technology and Service Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Jiadu Technology Software Development Co ltd, PCI Technology Group Co Ltd, PCI Technology and Service Co Ltd filed Critical Guangzhou Jiadu Technology Software Development Co ltd
Priority to CN202211733151.9A priority Critical patent/CN116052251A/en
Publication of CN116052251A publication Critical patent/CN116052251A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53Querying
    • G06F16/535Filtering based on additional data, e.g. user or group profiles
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T10/00Road transport of goods or passengers
    • Y02T10/10Internal combustion engine [ICE] based vehicles
    • Y02T10/40Engine management systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Collating Specific Patterns (AREA)

Abstract

The embodiment of the application provides a face image optimization method, a device, equipment and a storage medium, and relates to the technical field of image recognition, wherein the method comprises the following steps: selecting face images recorded in a preset screening period from a face image library as identification images, wherein a plurality of successfully identified face images corresponding to each user are recorded in the face image library; acquiring feature scores corresponding to feature factors of the identification image; acquiring a first index score associated with the identification image according to the feature scores corresponding to the feature factors and the corresponding weight combinations; acquiring the number of times of comparing the identification images to determine a second index score; and determining the recognition rate score of the corresponding recognition image according to the first index score, the second index score and the corresponding evaluation weight, and taking the recognition image with the highest recognition rate score as the preferable image. The scheme realizes the periodical automatic updating of the images in the face image library, and effectively improves the recognition success rate of the system.

Description

人脸图像优选方法、装置、设备及存储介质Face image optimization method, device, equipment and storage medium

技术领域technical field

本申请实施例涉及图像识别技术领域,尤其涉及一种人脸图像优选方法、装置、设备及存储介质。The embodiments of the present application relate to the technical field of image recognition, and in particular to a face image optimization method, device, equipment, and storage medium.

背景技术Background technique

随着人脸识别技术的发展与普及推广,人脸识别技术越来越广泛地应用在如人脸考勤、人脸支付、门禁过闸、人证核验等业务场景中。当然,在使用人脸识别技术的业务系统中必然需要先建立系统用户的人脸图像库,而系统的人脸图像库的来源一般为用户注册时提供的人脸图像,并由业务系统将用户的人脸图像保存至数据库中同时建立人脸图像库。当用户使用人脸识别功能时,人脸采集设备获取用户脸部的抓拍图像,将其与人脸图像库中的人脸图像进行对比,以确定是否成功识别。With the development and popularization of face recognition technology, face recognition technology is more and more widely used in business scenarios such as face attendance, face payment, access control, and witness verification. Of course, in a business system that uses face recognition technology, it is necessary to first establish a face image library for system users, and the source of the system's face image library is generally the face image provided by the user when registering, and the business system will use the user's face image database. Save the face images in the database and build a face image database at the same time. When the user uses the face recognition function, the face acquisition device obtains a snapshot image of the user's face, and compares it with the face images in the face image library to determine whether the recognition is successful.

但是,随着用户年龄增长,用户样貌可能发生变化,或者使用场景的不同,用户使用人脸识别功能时人脸采集设备抓拍的角度、光线等因素而导致抓拍图像与注册时的人脸图像差异大,导致用户在进行人脸识别时就可能发生多次识别失败,导致拒识率高、体验差的情况。However, as the user grows older, the user's appearance may change, or the use of the scene is different. When the user uses the face recognition function, the angle and light of the face capture device captured by the user will cause the captured image to be different from the face image at the time of registration. The difference is large, resulting in multiple recognition failures when the user performs face recognition, resulting in a high rejection rate and poor user experience.

相关技术中采用定时提醒用户按照相关要求重新注册或更新在业务系统中注册的人脸图像,但该方式对于用户来说操作繁琐,还要求用户自律并在规定时间更新图片,使得用户的使用体验差,而且对于业务系统来说由用户自主更新的方式不可控,业务系统难以提供有效的人脸识别功能。In related technologies, regular reminders are used to remind users to re-register or update the face images registered in the business system according to relevant requirements, but this method is cumbersome for users, and requires users to be self-disciplined and update pictures within a specified time, so that the user's experience is improved. Poor, and for the business system, the way of self-updating by users is uncontrollable, and it is difficult for the business system to provide effective face recognition functions.

发明内容Contents of the invention

本申请实施例提供了一种人脸图像优选方法、装置、设备及存储介质,解决了库内图像无法及时更新而导致拒识率高、体验差的问题,能够有效地筛选出高质量的人脸图像并将其更新至人脸图像库中,无需用户主动更新,实现了人脸图像库内图像周期性自动更新,并有效地提升了系统的识别成功率。The embodiment of the present application provides a face image optimization method, device, equipment and storage medium, which solves the problem of high rejection rate and poor experience caused by the inability to update the image in the library in time, and can effectively screen out high-quality faces. The face image is updated to the face image library without the user's active update, which realizes the periodic automatic update of the image in the face image library, and effectively improves the recognition success rate of the system.

第一方面,本申请实施例提供一种人脸图像优选方法,该方法包括:In the first aspect, the embodiment of the present application provides a face image optimization method, the method comprising:

从人脸图像库内选取在预设的筛选周期内记录的人脸图像作为识别图像,所述人脸图像库内记录有对应于每一用户的已成功识别的多张人脸图像;Select the face image recorded in the preset screening period from the face image library, which is recorded with a plurality of successfully identified face images corresponding to each user in the face image library;

获取识别图像的特征因素所对应的特征分值;Obtain the feature score corresponding to the feature factor of the recognized image;

根据特征因素对应的特征分值以及相应的权重组合,获取关联于识别图像的第一指标分数;Acquiring the first index score associated with the recognition image according to the feature score corresponding to the feature factor and the corresponding weight combination;

获取识别图像的比中次数,以确定第二指标分数;Obtain the number of comparisons of the recognized image to determine the second index score;

根据第一指标分数、第二指标分数以及相应的评估权值,确定对应的识别图像的识别率得分,并以识别率得分最高的识别图像为优选图像。According to the first index score, the second index score and the corresponding evaluation weight, the recognition rate score of the corresponding recognition image is determined, and the recognition image with the highest recognition rate score is selected as the preferred image.

第二方面,本申请实施例提供一种人脸图像优选装置,包括:In the second aspect, the embodiment of the present application provides a face image optimization device, including:

图像获取模块,配置为从人脸图像库内选取在预设的筛选周期内记录的人脸图像作为识别图像,人脸图像库内记录有对应于每一用户的已成功识别的多张人脸图像;The image acquisition module is configured to select the face images recorded in the preset screening period from the face image library as the recognition image, and the face image library is recorded with a plurality of successfully recognized faces corresponding to each user image;

特征分值确定模块,配置为获取识别图像的特征因素所对应的特征分值;The feature score determination module is configured to obtain the feature score corresponding to the feature factor of the recognition image;

第一分数确定模块,配置为根据特征因素对应的特征分值以及相应的权重组合,获取关联于识别图像的第一指标分数;The first score determination module is configured to obtain the first index score associated with the recognition image according to the feature score corresponding to the feature factor and the corresponding weight combination;

第二分数确定模块,配置为获取识别图像的比中次数,以确定第二指标分数;The second score determination module is configured to obtain the number of comparisons of the recognized image to determine the second index score;

图像选取模块,配置为根据第一指标分数、第二指标分数以及相应的评估权值,确定对应的识别图像的识别率得分,并以识别率得分最高的识别图像为优选图像。The image selection module is configured to determine the recognition rate score of the corresponding recognition image according to the first index score, the second index score and the corresponding evaluation weight, and use the recognition image with the highest recognition rate score as the preferred image.

第三方面,本申请实施例提供一种电子设备,包括:In a third aspect, the embodiment of the present application provides an electronic device, including:

一个或多个处理器;one or more processors;

存储装置,用于存储一个或多个程序,storage means for storing one or more programs,

当一个或多个程序被一个或多个处理器执行,使得一个或多个处理器实现第一方面实施例所述的人脸图像优选方法。When the one or more programs are executed by the one or more processors, the one or more processors implement the face image optimization method described in the embodiment of the first aspect.

第四方面,本申请实施例还提供一种存储计算机可执行指令的存储介质,计算机可执行指令在由处理器执行时用于执行第一方面实施例所述的人脸图像优选方法。In the fourth aspect, the embodiment of the present application further provides a storage medium storing computer-executable instructions, and the computer-executable instructions are used to execute the face image optimization method described in the embodiment of the first aspect when executed by a processor.

本申请通过对每个筛选周期内成功识别到的人脸图像基于特征因素进行评分,得到相应的第一指标分数,而且还在所选取的人脸图像中以各人脸图像作为对比的目标图像进行识别对比,获取相应的第二指标分数,结合第一指标分数和第二指标分数,从而得到对应于每一张人脸图像的识别率得分,进而从所有人脸图像中选取优选图像加入人脸图像库内,实现了人脸图像库内图像周期性自动更新,有效地提升了系统的识别成功率。This application scores the face images successfully identified in each screening cycle based on the characteristic factors to obtain the corresponding first index score, and also uses each face image as the target image for comparison among the selected face images Carry out recognition comparison, obtain the corresponding second index score, combine the first index score and the second index score, so as to obtain the recognition rate score corresponding to each face image, and then select the preferred image from all face images to add to the human face image. In the face image library, the image in the face image library is automatically updated periodically, which effectively improves the recognition success rate of the system.

附图说明Description of drawings

图1为本申请实施例提供的人脸图像优选方法的步骤流程图;Fig. 1 is the flow chart of the steps of the human face image optimization method provided by the embodiment of the present application;

图2为本申请实施例提供的确定比中次数的步骤流程图;Fig. 2 is a flow chart of steps for determining the number of times of comparison provided by the embodiment of the present application;

图3为本申请实施例提供的人脸图像优选装置的示意图;FIG. 3 is a schematic diagram of a human face image optimization device provided in an embodiment of the present application;

图4为本申请实施例提供的一种电子设备的结构示意图。FIG. 4 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

具体实施方式Detailed ways

下面结合附图和实施例对本申请实施例作进一步的详细说明。可以理解的是,此处所描述的具体实施例仅仅用于解释本申请实施例,而非对本申请实施例的限定。另外还需要说明的是,为了便于描述,附图中仅示出了与本申请实施例相关的部分而非全部结构。The embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It can be understood that the specific embodiments described here are only used to explain the embodiments of the present application, but not to limit the embodiments of the present application. In addition, it should be noted that, for the convenience of description, only a part but not all structures related to the embodiment of the present application are shown in the drawings.

本申请的说明书和权利要求书中的术语“第一”、“第二”等是用于区别类似的对象,而不用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施,且“第一”、“第二”等所区分的对象通常为一类,并不限定对象的个数,例如第一对象可以是一个,也可以是多个。在说明书以及权利要求书的描述中,“多个”表示为两个及以上。此外,说明书以及权利要求中“和/或”表示所连接对象的至少其中之一,字符“/”,一般表示前后关联对象是一种“或”的关系。The terms "first", "second" and the like in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific sequence or sequence. It should be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application can be practiced in sequences other than those illustrated or described herein, and that references to "first," "second," etc. distinguish Objects are generally of one type, and the number of objects is not limited. For example, there may be one or more first objects. In the specification and the description of the claims, "plurality" means two or more. In addition, "and/or" in the specification and claims means at least one of the connected objects, and the character "/" generally means that the related objects are an "or" relationship.

本申请的人脸图像优选方法可以应用于采用了人脸识别技术的业务系统中,如实现人脸考勤、人脸过闸等业务场景的业务系统中,对于上述的业务系统,其均配置有人脸图像库,人脸图像库内预存有用于进行人脸识别对比的人脸图像,当然,人脸图像库内还可以存储抓拍的能够成功识别到的人脸图像,可以想到的是,预存的人脸图像和抓拍的人脸图像在人脸图像库内可以通过不同的标识进行区分。可以想到的是,业务系统可以以应用软件的方式加载在电子设备中。The face image optimization method of the present application can be applied to business systems that use face recognition technology, such as business systems that implement business scenarios such as face attendance and face check-in. The face image library, the face image library is pre-stored with face images for face recognition comparison, of course, the captured face images that can be successfully recognized can also be stored in the face image library, it is conceivable that the pre-stored The face image and the captured face image can be distinguished by different identifiers in the face image database. It is conceivable that the service system can be loaded in the electronic device in the form of application software.

图1为本申请实施例提供的人脸图像优选方法的步骤流程图,如图所示,人脸图像优选方法包括如下步骤:Fig. 1 is the flow chart of the steps of the human face image optimization method provided by the embodiment of the present application. As shown in the figure, the human face image optimization method includes the following steps:

步骤S110、从人脸图像库内选取在预设的筛选周期内记录的人脸图像作为识别图像。Step S110, selecting the face images recorded in the preset screening period from the face image library as the recognition images.

可以理解的是,人脸图像库内记录有对应于每一用户的已成功识别的多张人脸图像,即在人脸图像库内,对于每一个在业务系统中已注册的用户,业务系统每次成功识别后均会将当前的抓拍到的人脸图像进行存储,例如对应于不同用户的人脸图像以该用户的系统ID(Identity Document,身份证标识号)进行标识,以便于后续的筛选流程。It can be understood that, in the face image library, there are recorded a plurality of successfully recognized face images corresponding to each user, that is, in the face image library, for each registered user in the business system, the business system After each successful recognition, the current captured face images will be stored. For example, the face images corresponding to different users will be identified with the user's system ID (Identity Document, ID card identification number), so that subsequent Screening process.

对于识别图像,业务系统从人脸图像库内选取人脸图像,当然,所选取的人脸图像是对应于同一个用户的,如根据用户的系统ID选取相应的人脸图像;此外,所选取的人脸图像还是对应于一个预设的筛选周期。应当想到的是,筛选周期是在业务系统中预设置的一个时长,如一个星期、一个月等时长,在该时长内,业务系统在每次成功识别后均会将当前的抓拍到的人脸图像进行存储,并且还将其关联于当前的筛选周期。For the recognition image, the business system selects the face image from the face image library. Of course, the selected face image corresponds to the same user, such as selecting the corresponding face image according to the user's system ID; in addition, the selected face image corresponds to the same user. The face images still correspond to a preset screening cycle. It should be considered that the screening cycle is a preset period of time in the business system, such as one week, one month, etc. During this period, the business system will record the current captured face after each successful recognition. The image is stored and also associated with the current screening cycle.

需要说明的是,在对每一个筛选周期内的所有识别图像完成筛选后,即选取出对应该筛选周期的优选图像后,业务系统可以删除该筛选周期内记录的其它识别图像,从而重新开始新的筛选周期计时。It should be noted that after the screening of all the identification images in each screening period is completed, that is, after the preferred image corresponding to the screening period is selected, the business system can delete other identification images recorded in the screening period, so as to start a new process. The timing of the screening cycle.

步骤S120、获取识别图像的特征因素所对应的特征分值。Step S120, acquiring feature scores corresponding to feature factors of the recognized image.

对于每一张识别图像,业务系统均对其进行计算以获取对应于不同特征因素的特征分值,如在一些实施例中,特征因素包括人脸角度、光线亮度、人脸遮挡、人脸表情和人脸占比,因此对应于各特征因素,业务系统分别对每张识别图像进行的分值计算,从而获取相应的特征分值。For each recognition image, the business system calculates it to obtain feature scores corresponding to different feature factors. For example, in some embodiments, feature factors include face angle, light brightness, face occlusion, and facial expression. and the proportion of faces, so corresponding to each feature factor, the business system calculates the score of each recognition image separately, so as to obtain the corresponding feature score.

例如,对应于人脸角度的第一特征分值,可以通过计算人脸图像中的人脸对应于倾斜角度(如欧拉角),对于倾斜角度的计算可以基于OpenCV并根据脸部的关键点计算对应的欧拉角,从而确定相应的特征分值,如倾斜角度越小,该项的特征分值越大。For example, the first feature score corresponding to the angle of the face can be calculated by calculating the face in the face image corresponding to the angle of inclination (such as the Euler angle). The calculation of the angle of inclination can be based on OpenCV and according to the key points of the face Calculate the corresponding Euler angle to determine the corresponding feature score, such as the smaller the tilt angle, the greater the feature score of the item.

对于光线亮度的第二特征分值,可以根据人脸图像中RGB分量计算相应的亮度,如用RGB三色光按照预设的比重计算得到亮度的值。For the second characteristic score of light brightness, the corresponding brightness can be calculated according to the RGB components in the face image, for example, the brightness value can be obtained by calculating the RGB three-color light according to the preset proportion.

对于人脸遮挡的第三特征分值,可以通过对人脸的遮挡范围大小计算得到,如以人脸的关键部分(如眼睛、鼻子、嘴巴以及脸部)的遮挡范围在整个人脸图像上的占比作为该项的特征分值。For the third feature score of face occlusion, it can be calculated by the size of the occlusion range of the face, such as the occlusion range of key parts of the face (such as eyes, nose, mouth and face) on the entire face image The proportion of is used as the characteristic score of this item.

对于人脸表情的第四特征分值,则可以根据对面部特征(如眼睛、鼻子、嘴巴以及眉毛)的动作识别,从而确定相应的人脸表情(如高兴、惊奇或正常等),而对于不同的人脸表情,可预设置不同的分值,从而确定第四特征分值。For the fourth feature score of human facial expression, the corresponding facial expression (such as happy, surprised or normal, etc.) can be determined according to the action recognition of facial features (such as eyes, nose, mouth and eyebrows), and for For different facial expressions, different scores can be preset, so as to determine the fourth feature score.

对于人脸占比的第五特征分值,则可根据人脸在整幅图像中的占比,确定第五特征分值。For the fifth feature score of the proportion of faces, the fifth feature score can be determined according to the proportion of faces in the entire image.

需要说明的是,对于各特征因素所对应的特征分值的计算,还可参考其它现有文献中所记载的技术方案,对此在本申请实施例中不作赘述。此外,为了便于计算第一指标分数,还可以对特征分值的实际值标准化至区间[0,1]内。It should be noted that for the calculation of the feature scores corresponding to each feature factor, reference may also be made to technical solutions recorded in other existing documents, which will not be described in detail in this embodiment of the present application. In addition, in order to facilitate the calculation of the first index score, the actual value of the feature score can also be standardized to the interval [0, 1].

步骤S130、根据特征因素对应的特征分值以及相应的权重组合,获取关联于识别图像的第一指标分数。Step S130, according to the characteristic score corresponding to the characteristic factor and the corresponding weight combination, obtain the first index score associated with the recognition image.

权重组合中的特征权值的项数与特征因素的数量相同,特征权值由业务系统预设置,并且业务系统对应特征因素配置相应的特征权值,且所有特征权值的总和为1。而第一指标分数则是与两者相关联的数值,即为所有特征因素与其对应的特征权值的乘积累计和。The number of feature weights in the weight combination is the same as the number of feature factors. The feature weights are preset by the business system, and the business system configures corresponding feature weights corresponding to the feature factors, and the sum of all feature weights is 1. The first index score is the value associated with the two, that is, the cumulative sum of the multiplication of all feature factors and their corresponding feature weights.

需要说明的是,第一特征权值和第三特征权值在所有的特征权值中取值最大,即人脸角度和人脸遮挡作为第一指标分数中占比最大的参数项,有助于筛选出更高质量的图像。It should be noted that the first feature weight and the third feature weight take the largest value among all feature weights, that is, the face angle and face occlusion are the largest parameter items in the first index score, which helps to filter out higher quality images.

步骤S140、获取识别图像的比中次数,以确定第二指标分数。Step S140, acquiring the matching times of the recognized images to determine the second index score.

对于所选取的识别图像,还需要获取对应于比中次数的第二指标分数。可以理解的是,在选取了筛选周期内记录的识别图像后,还需要对每张识别图像的比中次数进行统计,例如,将图像两两比对,若两张图像的相似度达到90%(该阈值可根据需求设置),则可以确定图像比中,比中次数加一,从而遍历所有识别图像,确定每张识别图像与所有识别图像比对后的比中次数,以获取每一张识别图像的第二指标分数。For the selected recognition image, it is also necessary to obtain a second index score corresponding to the number of comparisons. It is understandable that after selecting the recognition images recorded in the screening period, it is necessary to count the number of comparisons of each recognition image, for example, compare the images pair by pair, if the similarity between the two images reaches 90% (The threshold can be set according to requirements), then it can be determined that the image is compared, and the number of comparisons is increased by one, thereby traversing all the recognition images, and determining the number of comparisons after each recognition image is compared with all recognition images, so as to obtain each A second index score for the recognition image.

可以理解的是,对于第一指标分数以及第二指标分数的获取,两者不分先后,在一些实施例中,可以是先计算第二指标分数再计算第一指标分数,此外还可以是同时进行第一指标分数以及第二指标分数的计算。It can be understood that the first index score and the second index score are obtained in no particular order. In some embodiments, the second index score may be calculated first, and then the first index score may be calculated, or simultaneously Calculation of the first index score and the second index score is performed.

步骤S150、根据第一指标分数、第二指标分数以及相应的评估权值,确定对应的识别图像的识别率得分,并以识别率得分最高的识别图像为优选图像。Step S150: Determine the recognition rate score of the corresponding recognition image according to the first index score, the second index score and the corresponding evaluation weight, and use the recognition image with the highest recognition rate score as the preferred image.

同样的,对于评估权值,其对应于第一指标分数设置有第一评估权值,对应于第二指标分数设置有第二评估权值,第一评估权值和第二评估权值同样是业务系统中预设置的。识别率得分为第一指标分数、第二指标分数以及对应的评估权值的乘积之和,从而得到对应每一个识别图像的识别率得分,并且以所有识别图像中识别率得分最高的图像作为优选图像。Similarly, for the evaluation weight, the first evaluation weight is set corresponding to the first index score, and the second evaluation weight is set corresponding to the second index score. The first evaluation weight and the second evaluation weight are also Pre-set in the business system. The recognition rate score is the sum of the product of the first index score, the second index score and the corresponding evaluation weight, so as to obtain the recognition rate score corresponding to each recognition image, and the image with the highest recognition rate score among all recognition images is selected as the preferred image.

需要说明的是,在一些实施例中,第一评估权值小于第二评估权值,从而使得第二指标分数在识别率得分中占比最大,以将比中次数作为选取优选图像的重要参考指标,有助于提高识别率。It should be noted that, in some embodiments, the first evaluation weight is smaller than the second evaluation weight, so that the second index score accounts for the largest proportion in the recognition rate score, so that the number of comparisons can be used as an important reference for selecting the preferred image indicators, which help to improve the recognition rate.

由上述方案可知,应用了本申请提供的人脸图像优选方法的业务系统,其能够通过在每个筛选周期结束后对所记录的识别图像计算对应的识别率得分,从而在多张识别图像中选取识别率得分最高的识别图像作为优选图像,并将其添加至人脸图像库内,从而实现了人脸图像库内图片周期性自动更新,能够有效地提升了系统的识别成功率。It can be seen from the above scheme that the business system that applies the face image optimization method provided by this application can calculate the corresponding recognition rate score for the recorded recognition images after each screening cycle, so that the recognition rate in multiple recognition images Select the recognition image with the highest recognition rate as the preferred image, and add it to the face image library, thereby realizing the periodic automatic update of the pictures in the face image library, which can effectively improve the recognition success rate of the system.

图2为本申请实施例提供的确定比中次数的步骤流程图,如图2所示,人脸图像优选方法还包括如下步骤:Fig. 2 is the flow chart of steps for determining the number of comparisons provided by the embodiment of the present application. As shown in Fig. 2, the face image optimization method also includes the following steps:

步骤S210、提取所有识别图像的特征值数据。Step S210, extracting feature value data of all recognized images.

步骤S220、基于特征值数据,对所有识别图像分别进行两两比对,并记录比对结果作为比中次数。Step S220 , based on the feature value data, perform a pairwise comparison of all the recognized images, and record the comparison result as the number of comparisons.

可以理解的是,对于每一识别图像,所提取的特征值数据可以是在进行人脸识别的过程中所获取的关联于人脸特征的识别数据。在提取所有识别图像的特征值数据后,对识别图像基于特征值数据进行比对。It can be understood that, for each recognition image, the extracted feature value data may be recognition data associated with facial features acquired during the face recognition process. After extracting the eigenvalue data of all the recognition images, the recognition images are compared based on the eigenvalue data.

示例性的,在筛选周期内记录的人脸图像有4张,即识别图像有四张,如包括识别图像I、识别图像II、识别图像III和识别图像IV。对于每张识别图像均提取特征值数据,以便于基于特征值数据进行比对。当前选取识别图像I分别与识别图像II、识别图像III和识别图像IV进行比对,若比对的两张图像的特征值数据的相似度大于或等于90%,则确定两张图像比中,比中次数加一,因此,遍历所有图像,从而确定对应于识别图像I的比中次数。Exemplarily, there are four face images recorded in the screening period, that is, four recognition images, such as recognition image I, recognition image II, recognition image III and recognition image IV. The eigenvalue data are extracted for each recognition image, so as to facilitate the comparison based on the eigenvalue data. The currently selected recognition image I is compared with the recognition image II, recognition image III and recognition image IV respectively. If the similarity of the feature value data of the two compared images is greater than or equal to 90%, it is determined that the ratio of the two images is The number of comparisons is increased by one, so all images are traversed to determine the number of comparisons corresponding to the recognition image I.

对于识别图像II,则可以将其与识别图像I、识别图像III和识别图像IV进行比对,可以想到的是,若先前识别图像I和识别图像II已经进行了比对,则在本轮比对中,可以采用上一次的比对结果,以减少业务系统的计算工作量。For recognition image II, it can be compared with recognition image I, recognition image III, and recognition image IV. It is conceivable that if the previous recognition image I and recognition image II have been compared, then in the current round of comparison For alignment, the last comparison result can be used to reduce the calculation workload of the business system.

因此,通过将选取的识别图像进行比对后,获取各识别图像中比中次数,从而得到对应于各识别图像的第二指标分数,例如,以比中次数与比对次数的比值作为第二指标分数。Therefore, after comparing the selected identification images, the number of comparisons in each identification image is obtained, so as to obtain the second index score corresponding to each identification image, for example, the ratio of the number of comparisons to the number of comparisons is used as the second index score. indicator score.

需要说明的是,在一些实施例中,还将识别图像本身进行比对,即使得比中次数和比对次数均累计加一。It should be noted that, in some embodiments, the identification images themselves are also compared, that is, the number of comparisons and the number of comparisons are cumulatively increased by one.

由上述方案可知,通过在所记录的识别图像中进行比对,业务系统能够确定各图像的比中次数,并结合第一指标分数,对图像进行筛选,有助于选出更能代表筛选周期内记录结果的图像。It can be seen from the above scheme that by comparing the recorded identification images, the business system can determine the number of comparisons of each image, and combine the first index score to screen the images, which helps to select a more representative screening cycle. An image of the results recorded within.

在一些实施例中,筛选周期是预设置的时长,在筛选周期内用户进行人脸识别的次数是不受限制的,因此,在筛选周期内所记录的对应于不同用户的识别图像的数量不同。在对于识别图像的数量过多的情况,识别图像的数量大于预设数量时,选取预设数量的识别图像进行特征提取。In some embodiments, the screening period is a pre-set duration, and the number of times the user performs face recognition during the screening period is not limited. Therefore, the number of recognition images corresponding to different users recorded during the screening period is different. . In the case that the number of recognized images is too large and the number of recognized images is greater than a preset number, a preset number of recognized images is selected for feature extraction.

例如,在筛选周期内记录的识别图像大于预设数量的情况下,业务系统可以从中选取的满足预设数量的识别图像进行筛选,即在预设数量的识别图像中选出优选图像。可以想到的是,对于识别图像的选取方式,其可以是随机选取、按照记录的顺序选取等方式,所选取的数量满足预设数量即可。For example, when the number of identification images recorded in the screening period is greater than the preset number, the business system can select the identification images satisfying the preset number for screening, that is, select the preferred image from the preset number of identification images. It is conceivable that, for the selection manner of the recognition images, it may be randomly selected, selected according to the recorded order, etc., and the selected number only needs to satisfy the preset number.

需要说明的是,对于筛选周期内记录的识别图像的数量小于或等于预设数量的情况,业务系统可选取筛选周期内记录的所有的识别图像。It should be noted that, for the situation that the number of identification images recorded in the screening period is less than or equal to the preset number, the business system may select all the identification images recorded in the screening period.

因此,通过设置选取识别图像的数量上限,加载业务系统的电子设备能够减少因筛选周期内记录的识别图像过多而增大的计算工作量。Therefore, by setting the upper limit of the number of selected identification images, the electronic device loaded with the business system can reduce the increased computing workload due to too many identification images recorded during the screening period.

在一应用场景中,如业务系统应用在人脸考勤这一业务场景中,以企业员工作为目标用户,并且目标用户均在业务系统中完成注册。在每个筛选周期内,目标用户每次使用人脸识别功能进行考勤时,业务系统将当前采集到的人脸图像存储在人脸图像库中。若筛选周期在业务系统中设置为四周,目标用户在工作日考勤至少两次的情况下,对应于每一目标用户在该筛选周期内,人脸图像库内存储有至少40张成功识别到的人脸图像。In an application scenario, for example, the business system is applied in the business scenario of face-based time attendance, enterprise employees are used as target users, and the target users are all registered in the business system. In each screening cycle, each time the target user uses the face recognition function to check attendance, the business system stores the currently collected face images in the face image database. If the screening period is set to four weeks in the business system, and the target user checks in at least twice on a working day, corresponding to each target user within the screening period, there are at least 40 successfully recognized faces stored in the face image library. face image.

业务系统选取上述的人脸图像作为识别图像,并对每一张识别图像进行对应各项特征因素的特征分值计算,如对应人脸角度、光线亮度、人脸遮挡、人脸表情和人脸占比五项特征因素的特征分值计算。业务系统内对于上述的特征因素配置有相应的特征权值,如对应人脸角度的第一特征权值θ1、对应光线亮度的第二特征权值θ2、对应人脸遮挡的第三特征权值θ3、对应人脸表情的第四特征权值θ4和对应人脸占比的第五特征权值θ5,其中,θ1、θ2、θ3、θ4和θ5可以对应取值为0.3、0.1、0.3、0.1和0.2。因此,计算出识别图像的第一指标分数,如按照如下公式计算第一指标分数:The business system selects the above-mentioned face image as the recognition image, and calculates the feature score corresponding to each feature factor for each recognition image, such as corresponding to face angle, light brightness, face occlusion, face expression and face Calculate the characteristic score of the five characteristic factors. The business system configures corresponding feature weights for the above feature factors, such as the first feature weight θ 1 corresponding to the face angle, the second feature weight θ 2 corresponding to the brightness of light, and the third feature corresponding to face occlusion The weight θ 3 , the fourth feature weight θ 4 corresponding to the facial expression, and the fifth feature weight θ 5 corresponding to the proportion of the face, where θ 1 , θ 2 , θ 3 , θ 4 and θ 5 can correspond to The values are 0.3, 0.1, 0.3, 0.1 and 0.2. Therefore, the first index score of the recognized image is calculated, such as calculating the first index score according to the following formula:

Q=θ1A+θ2B+θ3O+θ4E+θ5PQ=θ 1 A+θ 2 B+θ 3 O+θ 4 E+θ 5 P

其中,Q为第一指标分数,A为人脸角度对应的第一特征分值,B为光线亮度对应的第二特征分值,O为人脸遮挡对应的第三特征分值,E为人脸表情对应的第四特征分值,P为人脸占比对应的第五特征分值。Among them, Q is the first index score, A is the first feature score corresponding to the face angle, B is the second feature score corresponding to the light brightness, O is the third feature score corresponding to face occlusion, and E is the face expression corresponding P is the fifth feature score corresponding to the face proportion.

而且,还对每一张识别图像进行特征提取,以将所记录的识别图像进行比对,从而获取每一张识别图像的比中次数,确定相应的第二指标分数T。此外,根据第一指标分数Q和第二指标分数T,业务系统还配置有相应的评估权值,如对应第一指标分数Q的第一评估权值S1和对应第二指标分数T的第二评估权值S2,其中,S1和S2可以对应取值为。业务系统对每一张识别图像均计算一个识别率得分,如采用如下计算公式计算识别率得分W:Moreover, feature extraction is also performed on each identification image, so as to compare the recorded identification images, so as to obtain the number of comparisons of each identification image, and determine the corresponding second index score T. In addition, according to the first index score Q and the second index score T, the business system is also configured with corresponding evaluation weights, such as the first evaluation weight S 1 corresponding to the first index score Q and the first evaluation weight S 1 corresponding to the second index score T. Two evaluation weights S 2 , where S 1 and S 2 can take corresponding values. The business system calculates a recognition rate score for each recognition image. For example, the following calculation formula is used to calculate the recognition rate score W:

W=S1Q+S2TW=S 1 Q+S 2 T

在获取到每一张识别图像的识别率得分后,业务系统可以识别率得分最高的识别图像存储在人脸图像库内,以将其作为人脸识别过程中用于比对的图像,实现人脸图像库的图像更新,无需用户手动更新,业务系统从多次人脸识别功能采集到的人脸图片筛选出识别率得分最高的人脸图像并自动更新到系统的人脸图像库中,保证图像质量与图像的高识别率,提升了用户体验效果,还能有效地提高系统的识别成功率。After obtaining the recognition rate score of each recognition image, the business system can store the recognition image with the highest recognition rate in the face image library, so as to use it as an image for comparison in the face recognition process to realize human The image update of the face image library does not require manual updating by the user. The business system screens out the face image with the highest recognition rate from the face images collected by multiple face recognition functions and automatically updates it to the system's face image library, ensuring The image quality and high image recognition rate improve the user experience effect and effectively improve the recognition success rate of the system.

图3为本申请实施例提供的人脸图像优选装置的示意图,该装置用于执行上述实施例提供的人脸图像优选方法,具备执行方法相应的功能模块和有益效果,如图所示,该装置包括:图像获取模块301、特征分值确定模块302、第一分数确定模块303、第二分数确定模块304和图像选取模块305。Fig. 3 is a schematic diagram of the human face image optimization device provided by the embodiment of the present application. The device is used to implement the human face image optimization method provided by the above embodiment, and has corresponding functional modules and beneficial effects for executing the method. As shown in the figure, the device The device includes: an image acquisition module 301 , a feature score determination module 302 , a first score determination module 303 , a second score determination module 304 and an image selection module 305 .

图像获取模块301配置为从人脸图像库内选取在预设的筛选周期内记录的人脸图像作为识别图像,人脸图像库内记录有对应于每一用户的已成功识别的多张人脸图像;The image acquisition module 301 is configured to select the face images recorded in the preset screening period from the face image library as the recognition image, and the face image library is recorded with a plurality of successfully recognized faces corresponding to each user image;

特征分值确定模块302配置为获取识别图像的特征因素所对应的特征分值;The feature score determination module 302 is configured to acquire feature scores corresponding to feature factors of the recognized image;

第一分数确定模块303配置为根据特征因素对应的特征分值以及相应的权重组合,获取关联于识别图像的第一指标分数;The first score determination module 303 is configured to obtain the first index score associated with the recognition image according to the feature score corresponding to the feature factor and the corresponding weight combination;

第二分数确定模块304配置为获取识别图像的比中次数,以确定第二指标分数;The second score determination module 304 is configured to obtain the number of comparisons of the recognized image to determine the second index score;

图像选取模块305配置为根据第一指标分数、第二指标分数以及相应的评估权值,确定对应的识别图像的识别率得分,并以识别率得分最高的识别图像为优选图像。The image selection module 305 is configured to determine the recognition rate score of the corresponding recognition image according to the first index score, the second index score and the corresponding evaluation weight, and select the recognition image with the highest recognition rate score as the preferred image.

在上述实施例的基础上,特征因素包括人脸角度、光线亮度、人脸遮挡、人脸表情和人脸占比。On the basis of the above embodiments, the feature factors include face angle, light brightness, face occlusion, face expression and face proportion.

在上述实施例的基础上,权重组合包括与特征因素数量相同的特征权值,第一指标分数为所有特征因素以及对应的特征权值的乘积累计和。On the basis of the above embodiments, the weight combination includes feature weights equal to the number of feature factors, and the first index score is the cumulative sum of products of all feature factors and corresponding feature weights.

在上述实施例的基础上,人脸角度、光线亮度、人脸遮挡、人脸表情和人脸占比依次对应第一特征权值、第二特征权值、第三特征权值、第四特征权值和第五特征权值;其中,第一特征权值和第三特征权值在所有的特征权值中取值最大。On the basis of the above-mentioned embodiments, face angle, light brightness, face occlusion, face expression, and face proportion correspond to the first feature weight, the second feature weight, the third feature weight, and the fourth feature in sequence. weight and the fifth feature weight; wherein, the first feature weight and the third feature weight take the largest value among all the feature weights.

在上述实施例的基础上,识别图像有至少两张,第二分数确定模块304还配置为:On the basis of the above embodiments, there are at least two recognition images, and the second score determination module 304 is also configured to:

提取所有识别图像的特征值数据;extract the eigenvalue data of all recognized images;

基于特征值数据,对所有识别图像分别进行两两比对,并记录比对结果作为比中次数。Based on the eigenvalue data, pairwise comparisons are performed on all recognized images, and the comparison results are recorded as the number of comparisons.

在上述实施例的基础上,第二分数确定模块304还配置为:On the basis of the above embodiments, the second score determination module 304 is further configured to:

当筛选周期内记录的识别图像的数量大于预设数量时,从中选取满足预设数量的识别图像。When the number of identification images recorded in the screening period is greater than the preset number, the identification images satisfying the preset number are selected.

在上述实施例的基础上,对应于第一指标分数的第一评估权值小于对应于第二指标分数的第二评估权值。Based on the above embodiment, the first evaluation weight corresponding to the first index score is smaller than the second evaluation weight corresponding to the second index score.

值得注意的是,上述人脸图像优选装置的实施例中,所包括的各个功能模块只是按照功能逻辑进行划分的,但并不局限于上述的划分,只要能够实现相应的功能即可;另外,各功能模块的具体名称也只是为了便于相互区分,并不用于限制本申请的保护范围。It is worth noting that, in the embodiment of the above-mentioned human face image optimization device, the various functional modules included are only divided according to the functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be realized; in addition, The specific names of the functional modules are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the present application.

图4为本申请实施例提供的一种电子设备的结构示意图,如图所示,该设备包括处理器401、存储器402、输入装置403和输出装置404,设备中处理器401的数量可以是一个或多个,图中以一个处理器401为例;设备中的处理器401、存储器402、输入装置403和输出装置404可以通过总线或其他方式连接,图中以通过总线连接为例。存储器402作为一种计算机可读的存储介质,可用于存储软件程序、计算机可执行程序以及模块,如本申请实施例中的人脸图像优选方法对应的程序指令/模块。处理器401通过运行存储在存储器402中的软件程序、指令以及模块,从而执行设备的各种功能应用以及数据处理,即实现上述的人脸图像优选方法。FIG. 4 is a schematic structural diagram of an electronic device provided by an embodiment of the present application. As shown in the figure, the device includes a processor 401, a memory 402, an input device 403, and an output device 404. The number of processors 401 in the device may be one or more, one processor 401 is taken as an example in the figure; the processor 401, memory 402, input device 403 and output device 404 in the device can be connected through a bus or in other ways, and a bus connection is used as an example in the figure. As a computer-readable storage medium, the memory 402 can be used to store software programs, computer-executable programs and modules, such as program instructions/modules corresponding to the face image optimization method in the embodiment of the present application. The processor 401 executes various functional applications and data processing of the device by running the software programs, instructions and modules stored in the memory 402, that is, realizes the above-mentioned face image selection method.

存储器402可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序;存储数据区可存储根据电子设备的使用所创建的数据等,如人脸图像、第一指标分值以及第二指标分值等。此外,存储器402可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实例中,存储器402可进一步包括相对于处理器401远程设置的存储器,这些远程存储器可以通过网络连接至终端设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 402 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system and at least one application required by a function; the data storage area can store data created according to the use of the electronic device, such as human The face image, the first index score and the second index score, etc. In addition, the memory 402 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage devices. In some examples, the memory 402 may further include a memory that is set remotely relative to the processor 401, and these remote memories may be connected to the terminal device through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

输入装置403可用于接收输入的数字或字符信息,以及产生与设备的用户设置以及功能控制有关的键信号输入。输出装置404可用于发送或显示与设备的用户设置以及功能控制有关的键信号输出,例如输出优选图像。The input device 403 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the device. The output device 404 may be used to send or display key signal output related to user settings and function control of the device, such as outputting a preferred image.

本申请实施例还提供一种存储有计算机可执行指令的存储介质,计算机可执行指令在由处理器执行时用于执行本申请任一实施例提供的人脸图像优选方法中的相关操作。The embodiment of the present application also provides a storage medium storing computer-executable instructions. When executed by a processor, the computer-executable instructions are used to perform related operations in the face image optimization method provided in any embodiment of the present application.

计算机可读的存储介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带、磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。Computer readable storage media includes both volatile and non-permanent, removable and non-removable media implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Flash memory or other memory technology, Compact Disc Read-Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, A magnetic tape cartridge, disk storage, or other magnetic storage device, or any other non-transmission medium, that can be used to store information that can be accessed by a computing device.

还需要说明的是,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括要素的过程、方法、商品或者设备中还存在另外的相同要素。It should also be noted that the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes Other elements not expressly listed, or elements inherent in the process, method, commodity, or apparatus are also included. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.

注意,上述仅为本申请的较佳实施例及所运用技术原理。本领域技术人员会理解,本申请不限于这里所述的特定实施例,对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本申请的保护范围。因此,虽然通过以上实施例对本申请进行了较为详细的说明,但是本申请不仅仅限于以上实施例,在不脱离本申请构思的情况下,还可以包括更多其他等效实施例,而本申请的范围由所附的权利要求范围决定。Note that the above are only preferred embodiments and technical principles used in this application. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present application. Therefore, although the present application has been described in detail through the above embodiments, the present application is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present application, and the present application The scope is determined by the scope of the appended claims.

Claims (10)

1. A face image optimization method, the method comprising:
selecting face images recorded in a preset screening period from a face image library as identification images, wherein a plurality of successfully identified face images corresponding to each user are recorded in the face image library;
acquiring feature scores corresponding to feature factors of the identification image;
acquiring a first index score associated with the identification image according to the feature scores and the corresponding weight combinations corresponding to the feature factors;
acquiring the number of times of comparison of the identification images to determine a second index score;
and determining the recognition rate score of the corresponding recognition image according to the first index score, the second index score and the corresponding evaluation weight, and taking the recognition image with the highest recognition rate score as a preferable image.
2. The face image optimization method of claim 1 wherein the characteristic factors include face angle, light brightness, face occlusion, face expression, and face duty cycle.
3. The face image optimization method according to claim 1 or 2, wherein the weight combination includes feature weights equal to the number of feature factors, and the first index score is a product cumulative sum of all the feature factors and the corresponding feature weights.
4. The face image optimization method according to claim 2, wherein the face angle, the light brightness, the face occlusion, the face expression, and the face duty ratio correspond to a first feature weight, a second feature weight, a third feature weight, a fourth feature weight, and a fifth feature weight in this order; the first feature weight and the third feature weight take the largest value among all feature weights.
5. The face image optimization method of claim 1, wherein the identification images are at least two, and the obtaining the number of times of comparing the identification images to determine the second index score comprises:
extracting the characteristic value data of all the identification images;
and respectively carrying out pairwise comparison on all the identification images based on the characteristic value data, and recording comparison results as the comparison times.
6. The face image optimization method according to claim 5, further comprising, before extracting the feature value data of all the identification images:
and when the number of the identification images recorded in the screening period is larger than a preset number, selecting the identification images meeting the preset number.
7. The face image preference method of claim 1, wherein a first evaluation weight corresponding to the first index score is smaller than a second evaluation weight corresponding to the second index score.
8. A face image preference apparatus, the apparatus comprising:
the image acquisition module is configured to select face images recorded in a preset screening period from a face image library as identification images, wherein a plurality of face images which are successfully identified and correspond to each user are recorded in the face image library;
the feature score determining module is configured to acquire feature scores corresponding to feature factors of the identification image;
the first score determining module is configured to acquire a first index score associated with the identification image according to the feature scores corresponding to the feature factors and the corresponding weight combinations;
a second score determining module configured to obtain the number of times of comparison of the identification image to determine a second index score;
the image selecting module is configured to determine an identification rate score of the corresponding identification image according to the first index score, the second index score and the corresponding evaluation weight, and take the identification image with the highest identification rate score as a preferred image.
9. An electronic device, comprising:
one or more processors;
storage means for storing one or more programs which when executed by one or more of the processors cause the one or more processors to implement the face image preference method of any one of claims 1 to 7.
10. A storage medium storing computer executable instructions which, when executed by a processor, are adapted to carry out the face image preference method of any one of claims 1 to 7.
CN202211733151.9A 2022-12-30 2022-12-30 Face image optimization method, device, equipment and storage medium Pending CN116052251A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211733151.9A CN116052251A (en) 2022-12-30 2022-12-30 Face image optimization method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211733151.9A CN116052251A (en) 2022-12-30 2022-12-30 Face image optimization method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN116052251A true CN116052251A (en) 2023-05-02

Family

ID=86123166

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211733151.9A Pending CN116052251A (en) 2022-12-30 2022-12-30 Face image optimization method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116052251A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116383795A (en) * 2023-06-01 2023-07-04 杭州海康威视数字技术股份有限公司 Biological feature recognition method and device and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109063691A (en) * 2018-09-03 2018-12-21 武汉普利商用机器有限公司 A kind of recognition of face bottom library optimization method and system
CN111104825A (en) * 2018-10-26 2020-05-05 北京陌陌信息技术有限公司 Face registry updating method, device, equipment and medium
CN111241927A (en) * 2019-12-30 2020-06-05 新大陆数字技术股份有限公司 Cascading type face image optimization method, system and equipment and readable storage medium
CN114429663A (en) * 2022-01-28 2022-05-03 北京百度网讯科技有限公司 Updating method of human face base, human face recognition method, device and system
CN114565958A (en) * 2022-01-20 2022-05-31 精伦电子股份有限公司 Face bottom library updating method and device, electronic equipment and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109063691A (en) * 2018-09-03 2018-12-21 武汉普利商用机器有限公司 A kind of recognition of face bottom library optimization method and system
CN111104825A (en) * 2018-10-26 2020-05-05 北京陌陌信息技术有限公司 Face registry updating method, device, equipment and medium
CN111241927A (en) * 2019-12-30 2020-06-05 新大陆数字技术股份有限公司 Cascading type face image optimization method, system and equipment and readable storage medium
CN114565958A (en) * 2022-01-20 2022-05-31 精伦电子股份有限公司 Face bottom library updating method and device, electronic equipment and storage medium
CN114429663A (en) * 2022-01-28 2022-05-03 北京百度网讯科技有限公司 Updating method of human face base, human face recognition method, device and system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116383795A (en) * 2023-06-01 2023-07-04 杭州海康威视数字技术股份有限公司 Biological feature recognition method and device and electronic equipment
CN116383795B (en) * 2023-06-01 2023-08-25 杭州海康威视数字技术股份有限公司 Biological feature recognition method and device and electronic equipment

Similar Documents

Publication Publication Date Title
JP7181437B2 (en) A technique for identifying skin tones in images under uncontrolled lighting conditions
US10037581B1 (en) Methods systems and computer program products for motion initiated document capture
CN112199530B (en) Multi-dimensional face library picture automatic updating method, system, equipment and medium
CN110175849B (en) Collecting method, device, equipment, server and system
CN112016485B (en) A passenger flow counting method and system based on face recognition
CN106713255B (en) User information management method and system
CN109726674A (en) A kind of face identification method and device
CN110334570A (en) The automatic banking process of recognition of face, device, equipment and storage medium
CN109787977B (en) Product information processing method, device and equipment based on short video and storage medium
CN110415113A (en) Finance data processing method, device, server and readable storage medium storing program for executing
CN113344132A (en) Identity recognition method, system, device, computer equipment and storage medium
WO2014126735A1 (en) Real time object scanning using a mobile phone and cloud-based visual search engine
CN107392614B (en) Method and device for realizing offline transaction
CN112528140A (en) Information recommendation method, device, equipment, system and storage medium
CN110929063A (en) Photo album generation method, terminal device and computer-readable storage medium
CN103609098B (en) Method and apparatus for being registered in telepresence system
CN116052251A (en) Face image optimization method, device, equipment and storage medium
CN108805046B (en) Method, apparatus, device and storage medium for face matching
CN110838102A (en) Intelligent image uploading method
CN108960999A (en) Consume recommended method and device, storage medium, terminal
CN113326810A (en) Face recognition method, system, device, electronic equipment and storage medium
CN106445107A (en) Method and device for sending information on basis of facial expressions
CN113518217A (en) Object recognition method, device, server and medium
CN113129252A (en) Image scoring method and electronic equipment
CN116155853A (en) Method and device for adding group members, storage medium, computer equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination