WO2022105650A1 - Update method for face image, storage medium, electronic device, and vehicle - Google Patents

Update method for face image, storage medium, electronic device, and vehicle Download PDF

Info

Publication number
WO2022105650A1
WO2022105650A1 PCT/CN2021/129692 CN2021129692W WO2022105650A1 WO 2022105650 A1 WO2022105650 A1 WO 2022105650A1 CN 2021129692 W CN2021129692 W CN 2021129692W WO 2022105650 A1 WO2022105650 A1 WO 2022105650A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
face image
face
quality
feature
Prior art date
Application number
PCT/CN2021/129692
Other languages
French (fr)
Chinese (zh)
Inventor
代芳
杨冬生
刘柯
王欢
Original Assignee
比亚迪股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 比亚迪股份有限公司 filed Critical 比亚迪股份有限公司
Publication of WO2022105650A1 publication Critical patent/WO2022105650A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/50Extraction of image or video features by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/56Extraction of image or video features relating to colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions

Definitions

  • the present disclosure relates to the technical field of image recognition, and in particular, to a face image updating method, a storage medium, an electronic device, and a vehicle.
  • face recognition technology is more and more widely used in the automotive field, such as face unlocking system outside the car, driver fatigue detection in the car, driver identification, etc.
  • face recognition technology it is necessary to ensure the security of face recognition and the ease of use of the face recognition system.
  • the vehicle-mounted face unlocking system has a long service cycle, it is necessary to update the standard face features to avoid the occurrence of people in different time periods of the same individual due to the variability of the face and the influence of factors such as light, age, fat and thinness. When the face images cannot be matched.
  • the present disclosure aims to solve one of the technical problems in the related art at least to a certain extent.
  • the present disclosure proposes a face image update method, storage medium, electronic device, and vehicle, so as to realize real-time update of a standard face image, thereby reducing the influence of face variability on the face recognition system, and improving human performance. Accuracy and ease of use of face recognition.
  • the present disclosure provides a method for updating a face image, the method comprising the following steps: collecting a face image to be recognized; evaluating the quality of the face image to be recognized to obtain a first quality score, and extracting The feature of the face image to be recognized is to obtain the first image feature; the pre-stored image feature of the pre-stored standard face image is obtained; according to the first quality score, the first image feature and the pre-stored image feature, determine whether to The pre-stored image feature is updated to the first image feature.
  • the quality evaluation of the to-be-recognized face image is performed to obtain a first quality score
  • feature extraction is performed on the to-be-recognized face image to obtain the first quality score.
  • image features and then determine whether to update the pre-stored image features to the first image features according to the first quality score, the first image features, and the pre-stored image features.
  • the standard face image can be updated in real time, thereby reducing the influence of face variability on the face recognition system, and improving the accuracy and ease of use of face recognition.
  • the present disclosure provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the above-mentioned method for updating a face image.
  • the computer-readable storage medium of the embodiment of the present disclosure when the computer program stored on the computer program corresponding to the above-mentioned method for updating a face image is executed, can realize real-time updating of a standard face image, thereby reducing the performance of the face recognition system. Affected by the variability of faces, the accuracy and ease of use of face recognition are improved.
  • the present disclosure provides an electronic device, including a memory, a processor, and a computer program stored on the memory.
  • the computer program is executed by the processor, the above-mentioned method for updating a face image is implemented. .
  • the electronic device can realize the real-time update of the standard face image by implementing the above-mentioned method for updating the face image, thereby reducing the influence of the face variability on the face recognition system and improving the accuracy of face recognition. flexibility and ease of use.
  • the present disclosure provides a vehicle including the above electronic device.
  • the vehicle of the embodiment of the present disclosure can realize real-time update of the standard face image through the above-mentioned electronic device, thereby reducing the influence of face variability on the face recognition system, and improving the accuracy and ease of use of face recognition.
  • FIG. 1 is a flowchart of a method for updating a face image according to a first embodiment of the present disclosure
  • FIG. 2 is a flowchart of a method for updating a face image according to a second embodiment of the present disclosure
  • FIG. 3 is a flowchart of a method for updating a face image according to a specific embodiment of the present disclosure
  • FIG. 4 is a structural block diagram of a vehicle according to an embodiment of the present disclosure.
  • FIG. 1 is a flowchart of a method for recognizing a face image according to an embodiment of the present disclosure.
  • the face image recognition method includes the following steps:
  • a face video stream to be recognized may be collected by a collection device (such as a camera on a vehicle terminal), and then an image of a face to be recognized may be obtained according to the face video stream to be recognized.
  • a collection device such as a camera on a vehicle terminal
  • the above-mentioned face image may be any one of a 2D image, a depth image and a 3D face image.
  • obtaining the face image to be identified according to the face video stream to be identified may include: obtaining an image containing a face according to the face video stream to be identified, and then performing face region extraction and key point positioning on the image, such as , an image containing a human face can be input into a preset face detection network, so as to obtain the face area and key point location, and then obtain key point information according to the key point location.
  • face region extraction and key point positioning on the image, such as , an image containing a human face can be input into a preset face detection network, so as to obtain the face area and key point location, and then obtain key point information according to the key point location.
  • the image in the above-mentioned face region can be used as the face image to be recognized, and the above-mentioned key points can be 5 points or 68 points.
  • quality evaluation is performed on the extracted face region to obtain a first quality score.
  • face alignment can be performed according to the above-mentioned key point information, and then the quality of the face region can be evaluated to obtain the first quality score.
  • the first quality score After the first quality score is obtained, it can be determined whether the first quality score is within the first preset quality range; if the first quality score is within the first preset quality range, the above-mentioned face image to be recognized is performed. Feature extraction, the step of obtaining the first image feature.
  • the first quality score it can be determined whether the first quality score is within the first preset quality range by comparing the relationship between the first quality score and the first quality threshold. If the above-mentioned first quality score represents the quality of the face image, the higher the first quality score, the better the quality of the face image. At this time, to achieve that the first quality score is within the first preset quality range, the first quality score needs to be greater than the first quality threshold. If the above-mentioned first quality score represents the quality loss of the face image, the higher the first quality score is, the worse the quality of the face image is. At this time, in order to realize that the first quality score is within the first preset quality range, the first quality score needs to be smaller than the first quality threshold.
  • the first quality threshold may be set by the user, for example, a percentage r1 of the first quality threshold and the possible maximum value of the first quality score may be set, where r1 is a certain value from 0 to 100%.
  • the above-mentioned step of acquiring the face image to be recognized is performed again.
  • the quality of the face image to be recognized is qualified. Specifically, if the first quality score is within the first preset quality range, it means that the quality of the face image to be recognized corresponding to the first quality score is qualified, and the subsequent update steps can be continued; If the quality score is not within the first preset quality range, it means that the quality of the face image to be recognized corresponding to the first quality score is unqualified, the image cannot realize face unlocking, and is not suitable for updating standard images.
  • feature extraction is performed on the face image to be recognized to obtain a feature matrix, and the feature matrix is used as the first image feature.
  • the face image to be recognized can also be extracted to obtain features capable of face recognition, for example, the HOG (Histogram of Oriented Gradient, histogram of directional gradient) feature, Haar feature ( At least one of a Haar feature), a color feature, and the like, which can then be used as the first image feature.
  • HOG Hetogram of Oriented Gradient, histogram of directional gradient
  • Haar feature At least one of a Haar feature
  • a color feature and the like
  • the living body feature of the above-mentioned face image to be recognized can also be obtained.
  • the living body feature is a feature describing whether the face included in the face image to be recognized is a living body face, and the living body feature may include local texture features, light reflection features, biological motion features, etc. in the face image.
  • pre-stored image features can be stored in a template library for face recognition.
  • the acquisition process of the pre-stored image features may be as follows: feature extraction is performed on the pre-stored standard face image to obtain a feature matrix, and then the feature matrix may be used as a pre-stored image feature.
  • the pre-stored image feature may be obtained after obtaining the pre-stored standard face image and pre-stored in the face recognition system, thereby improving the update processing efficiency; it may also be that when the first image feature is obtained, The face image is obtained by feature extraction.
  • the template library can be a database in a vehicle face recognition system, and the database can also include a pre-stored standard face image used for face recognition and unlocking, the pre-stored standard face image and its pre-stored image features There is a correspondence between them.
  • the above-mentioned pre-stored standard face images are pre-stored standard face images, the number of which may be one or more. Taking two as an example, the first standard face image and the second standard face image may be included.
  • the face image used in the user registration can be obtained as the initial first standard face image and the initial second standard face image.
  • the initial second standard may not be set. face image.
  • the living body characteristics of the face image to be recognized corresponding to the first quality score can be judged first, and after judging by living body characteristics (for example, judging that a living body face is recognized), according to the first quality score, the first image characteristics and the Pre-stored image features to determine whether to update the pre-stored image features to the first image features.
  • the collected image is subjected to live detection, so that the standard face image can be updated in real time according to the live face image, and the security of the face recognition system is improved.
  • the above-mentioned determining whether to update the pre-stored image feature to the first image feature according to the first quality score, the first image feature, and the pre-stored image feature may include:
  • the initial first standard face image is the face image obtained when the user registers, but the non-initial first standard face image is updated by the face image to be recognized owned. Because the face image to be recognized and the initial first standard face image may be acquired by the same acquisition device, or may be acquired by different acquisition devices. Therefore, in order to more accurately judge the first similarity, it is necessary to select an appropriate first preset similarity threshold. Specifically, it can be judged whether the collection devices of the face image to be recognized and the first standard face image are the same (for example, whether the type of the collection equipment is the same, or the same collection equipment); the first preset is determined according to the judgment result. Similarity threshold, wherein the first preset similarity threshold for which the determination result is the same determination is greater than the preset similarity threshold for which the determination result is different determination.
  • the two face images used for comparison are from the same type of acquisition device
  • heterogeneous comparison that is, the two face images used for comparison are from different types of collection devices.
  • the face image to be recognized is collected by the above collection settings
  • the first standard face image The image is collected by the face registration device.
  • the first similarity is greater than the first preset similarity threshold, it means that the current face image to be recognized satisfies the unlocking conditions of the face recognition system, and face unlocking can be performed, and then the first quality score can be judged again , to determine whether the current face image to be recognized is suitable for updating the pre-stored standard face image.
  • the similarity between the first image feature and the pre-stored image feature corresponding to the second standard face image is calculated to obtain the second similarity; Determine whether the second similarity is greater than the second preset similarity threshold; if the second similarity is greater than the second preset similarity threshold, perform face unlocking. If the second similarity is less than or equal to the second preset similarity threshold, first prompt information is sent (eg, a preset prompt picture, text information, etc. is displayed on the display screen of the vehicle terminal) to prompt the face unlock failure.
  • first prompt information is sent (eg, a preset prompt picture, text information, etc. is displayed on the display screen of the vehicle terminal) to prompt the face unlock failure.
  • the second preset quality range may be determined according to the quality of the first standard face image and the quality of the second standard face image. For example, taking the positive correlation between image quality and the first quality score as an example, the second preset quality range may be a range greater than a second quality threshold, and the second quality threshold may be the average of the scores of two standard face images, and the second quality The threshold should be greater than or equal to the above-mentioned first quality threshold.
  • face recognition unlocking can be implemented according to at least two standard images, thereby improving the accuracy and probability of face recognition unlocking and improving user experience.
  • the update method of the embodiment of the present disclosure may be performed in the process of unlocking through a face image, that is to say, the vehicle-mounted face recognition system may perform the unlocking interaction of the present disclosure while performing the conventional face recognition unlocking interaction.
  • Update method The manner of determining the second preset similarity threshold is similar to that of determining the first preset similarity threshold, and can be obtained by judging whether the face image to be recognized and the second standard face image are the same collection device.
  • the first quality score is within the second preset quality range by comparing the relationship between the first quality score and the second quality threshold.
  • the above-mentioned second quality threshold may be an average value of the first standard face image and the second standard face image. If the first quality score is greater than the second quality threshold, the first quality score is within the second preset quality range, and the pre-stored image feature corresponding to the first standard face image is updated to the first image feature; if the first quality score If it is less than or equal to the second quality threshold, the first quality score is not within the second preset quality range, and the pre-stored image feature corresponding to the second standard face image is updated to the first image feature.
  • the quality of the first standard face image obtained by a certain update may be high, resulting in that only the second standard face image is updated after successful face unlocking for several consecutive times, and the face image to be recognized cannot be The situation of face unlocking through the first standard image. Therefore, it is also possible to obtain the consecutive times of using the second standard face image to unlock the face; if the consecutive times reach the first preset times, update the pre-stored image feature corresponding to the current first standard face image to the current first image feature . Thus, the real-time performance of the standard face images in the template library can be guaranteed.
  • the standard face image in the template library is updated directly without comparing the first quality score and the first quality score.
  • a prompt message can be sent through the vehicle terminal to prompt the user that the template library is updated; if there is no update, no prompt can be given.
  • the method for updating a face image can realize real-time updating of a standard face image, thereby reducing the influence of the face recognition system on the variability of faces, and improving the accuracy and ease of use of face recognition. sex. Moreover, before face recognition, live detection is also performed, which improves the security of the face recognition system. Face recognition is performed according to at least two standard images, thereby further improving the accuracy of face recognition.
  • the present disclosure also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the above-mentioned method for updating a face image.
  • the computer-readable storage medium of the embodiment of the present disclosure when the computer program stored on the computer program corresponding to the above-mentioned method for updating a face image is executed, can realize real-time updating of a standard face image, thereby reducing the performance of the face recognition system. Affected by the variability of faces, the accuracy and ease of use of face recognition are improved.
  • the present disclosure also proposes an electronic device.
  • an electronic device includes a memory, a processor, and a computer program stored on the memory.
  • the computer program is executed by the processor, the above-mentioned method for updating a face image is implemented.
  • the electronic device can realize the real-time update of the standard face image by implementing the above-mentioned method for updating the face image, thereby reducing the influence of the face variability on the face recognition system and improving the accuracy of face recognition. flexibility and ease of use. Moreover, before face recognition, live detection is also performed, which improves the security of the face recognition system. Face recognition is performed according to at least two standard images, thereby further improving the accuracy of face recognition.
  • FIG. 4 is a structural block diagram of a vehicle according to an embodiment of the present disclosure.
  • the vehicle 1000 includes the aforementioned electronic device 100 .
  • the vehicle of the embodiment of the present disclosure can realize real-time update of the standard face image through the above-mentioned electronic device, thereby reducing the influence of face variability on the face recognition system, and improving the accuracy and ease of use of face recognition. Moreover, before face recognition, live detection is also performed, which improves the security of the face recognition system. Face recognition is performed according to at least two standard images, thereby further improving the accuracy of face recognition.
  • a "computer-readable medium” can be any device that can contain, store, communicate, propagate, or transport the program for use by or in conjunction with an instruction execution system, apparatus, or apparatus.
  • computer readable media include the following: electrical connections with one or more wiring (electronic devices), portable computer disk cartridges (magnetic devices), random access memory (RAM), Read Only Memory (ROM), Erasable Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM).
  • the computer readable medium may even be paper or other suitable medium on which the program may be printed, as the paper or other medium may be optically scanned, for example, followed by editing, interpretation, or other suitable medium as necessary process to obtain the program electronically and then store it in computer memory.
  • portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof.
  • various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system.
  • a suitable instruction execution system For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or a combination of the following techniques known in the art: Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, Programmable Gate Arrays (PGA), Field Programmable Gate Arrays (FPGA), etc.
  • first and second are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature delimited with “first”, “second” may expressly or implicitly include at least one of that feature.
  • plurality means at least two, such as two, three, etc., unless expressly and specifically defined otherwise.
  • the terms “installed”, “connected”, “connected”, “fixed” and other terms should be understood in a broad sense, for example, it may be a fixed connection or a detachable connection , or integrated; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between the two elements, unless otherwise specified limit.
  • installed may be a fixed connection or a detachable connection , or integrated; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between the two elements, unless otherwise specified limit.
  • a first feature "on” or “under” a second feature may be in direct contact with the first and second features, or indirectly through an intermediary between the first and second features touch.
  • the first feature being “above”, “over” and “above” the second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is level higher than the second feature.
  • the first feature being “below”, “below” and “below” the second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature has a lower level than the second feature.

Abstract

An update method for a face image, a storage medium, an electronic device, and a vehicle, relating to the technical field of image recognition. The update method for a face image comprises: acquiring a face image to be recognized; evaluating said face image to obtain a first quality score, and extracting features of said face image to obtain a first image feature; obtaining a pre-stored image feature of a pre-stored standard face image; and determining, according to the first quality score, the first image feature and the pre-stored image feature, whether to update the pre-stored image feature to the first image feature.

Description

人脸图像的更新方法、存储介质、电子设备以及车辆Face image update method, storage medium, electronic device, and vehicle
相关申请的交叉引用CROSS-REFERENCE TO RELATED APPLICATIONS
本公开要求于2020年11月23日提交的申请号为202011320274.0、名称为“人脸图像的更新方法、存储介质、电子设备以及车辆”的中国专利申请的优先权,其全部内容通过引用结合在本公开中。The present disclosure claims the priority of the Chinese Patent Application No. 202011320274.0, filed on November 23, 2020, and entitled "Method for Updating Face Image, Storage Medium, Electronic Device, and Vehicle", the entire contents of which are incorporated by reference in in this disclosure.
技术领域technical field
本公开涉及图像识别技术领域,尤其涉及一种人脸图像的更新方法、存储介质、电子设备以及车辆。The present disclosure relates to the technical field of image recognition, and in particular, to a face image updating method, a storage medium, an electronic device, and a vehicle.
背景技术Background technique
目前,人脸识别技术在汽车领域应用越来越广泛,如车外人脸解锁系统,车内驾驶员疲劳检测,驾驶员身份识别等。在人脸识别技术应用中,既要保证人脸识别的安全性,也需要满足人脸识别系统的易用性。由于车载人脸解锁系统使用周期较长,因此需要对标准人脸特征进行更新,避免出现由于人脸的易变性,受光照、年龄、胖瘦等因素影响,导致同一个体不同时间段内的人脸图像不能匹配的情况。At present, face recognition technology is more and more widely used in the automotive field, such as face unlocking system outside the car, driver fatigue detection in the car, driver identification, etc. In the application of face recognition technology, it is necessary to ensure the security of face recognition and the ease of use of the face recognition system. Since the vehicle-mounted face unlocking system has a long service cycle, it is necessary to update the standard face features to avoid the occurrence of people in different time periods of the same individual due to the variability of the face and the influence of factors such as light, age, fat and thinness. When the face images cannot be matched.
为解决上述问题,相关技术中提出了一种根据两次人脸解锁间隔时间对标准人脸特征进行更新的技术。然而,该技术需与时间关联,对于用户长时间没有进行解锁,且脸部形变较大,如短期增重或减重的情形,并不适用。同时,对两次间隔预设解锁时长没有统一标准,对系统易用性不友好。In order to solve the above problem, a technology of updating standard face features according to the interval time between two face unlocks is proposed in the related art. However, this technology needs to be related to time, and is not suitable for situations where the user has not unlocked for a long time and the face is deformed greatly, such as short-term weight gain or weight loss. At the same time, there is no unified standard for the preset unlocking time between two intervals, which is not friendly to the usability of the system.
发明内容SUMMARY OF THE INVENTION
本公开旨在至少在一定程度上解决相关技术中的技术问题之一。为此,本公开提出一种人脸图像的更新方法、存储介质、电子设备以及车辆,以实现对标准人脸图像进行实时更新,从而降低人脸识别系统受人脸易变性的影响,提升人脸识别的准确性和易用性。The present disclosure aims to solve one of the technical problems in the related art at least to a certain extent. To this end, the present disclosure proposes a face image update method, storage medium, electronic device, and vehicle, so as to realize real-time update of a standard face image, thereby reducing the influence of face variability on the face recognition system, and improving human performance. Accuracy and ease of use of face recognition.
第一方面,本公开提出了一种人脸图像的更新方法,所述方法包括以下步骤:采集待识别人脸图像;评估所述待识别人脸图像的质量以得到第一质量得分,并提取所述待识别人脸图像的特征以得到第一图像特征;获取预存标准人脸图像的预存图像特征;根据所述第一质量得分、所述第一图像特征和所述预存图像特征,确定是否将所述预存图像特征更新为所述第一图像特征。In a first aspect, the present disclosure provides a method for updating a face image, the method comprising the following steps: collecting a face image to be recognized; evaluating the quality of the face image to be recognized to obtain a first quality score, and extracting The feature of the face image to be recognized is to obtain the first image feature; the pre-stored image feature of the pre-stored standard face image is obtained; according to the first quality score, the first image feature and the pre-stored image feature, determine whether to The pre-stored image feature is updated to the first image feature.
本公开实施例的人脸图像的更新方法,在采集到待识别人脸图像时,对待识别人脸图像进行质量评估,得到第一质量得分,并对待识别人脸图像进行特征提取,得到第一图像 特征;进而根据第一质量得分、第一图像特征和预存图像特征,确定是否将预存图像特征更新为第一图像特征。由此,可以实现对标准人脸图像进行实时更新,从而降低人脸识别系统受人脸易变性的影响,提升人脸识别的准确性和易用性。In the face image updating method according to the embodiment of the present disclosure, when the to-be-recognized face image is collected, the quality evaluation of the to-be-recognized face image is performed to obtain a first quality score, and feature extraction is performed on the to-be-recognized face image to obtain the first quality score. image features; and then determine whether to update the pre-stored image features to the first image features according to the first quality score, the first image features, and the pre-stored image features. In this way, the standard face image can be updated in real time, thereby reducing the influence of face variability on the face recognition system, and improving the accuracy and ease of use of face recognition.
第二方面,本公开提出了一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时,实现上述的人脸图像的更新方法。In a second aspect, the present disclosure provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the above-mentioned method for updating a face image.
本公开实施例的计算机可读存储介质,在其上存储的与上述的人脸图像的更新方法对应的计算机程序被执行时,可以实现对标准人脸图像进行实时更新,从而降低人脸识别系统受人脸易变性的影响,提升人脸识别的准确性和易用性。The computer-readable storage medium of the embodiment of the present disclosure, when the computer program stored on the computer program corresponding to the above-mentioned method for updating a face image is executed, can realize real-time updating of a standard face image, thereby reducing the performance of the face recognition system. Affected by the variability of faces, the accuracy and ease of use of face recognition are improved.
第三方面,本公开提出了一种电子设备,包括存储器、处理器和存储在所述存储器上的计算机程序,所述计算机程序被所述处理器执行时,实现上述的人脸图像的更新方法。In a third aspect, the present disclosure provides an electronic device, including a memory, a processor, and a computer program stored on the memory. When the computer program is executed by the processor, the above-mentioned method for updating a face image is implemented. .
本公开实施例的电子设备,通过实现上述的人脸图像的更新方法,可以实现对标准人脸图像进行实时更新,从而降低人脸识别系统受人脸易变性的影响,提升人脸识别的准确性和易用性。The electronic device according to the embodiment of the present disclosure can realize the real-time update of the standard face image by implementing the above-mentioned method for updating the face image, thereby reducing the influence of the face variability on the face recognition system and improving the accuracy of face recognition. flexibility and ease of use.
第四方面,本公开提出了一种车辆,包括上述的电子设备。In a fourth aspect, the present disclosure provides a vehicle including the above electronic device.
本公开实施例的车辆,通过上述的电子设备,可以实现对标准人脸图像进行实时更新,从而降低人脸识别系统受人脸易变性的影响,提升人脸识别的准确性和易用性。The vehicle of the embodiment of the present disclosure can realize real-time update of the standard face image through the above-mentioned electronic device, thereby reducing the influence of face variability on the face recognition system, and improving the accuracy and ease of use of face recognition.
本公开附加的方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本公开的实践了解到。Additional aspects and advantages of the present disclosure will be set forth, in part, from the following description, and in part will be apparent from the following description, or may be learned by practice of the present disclosure.
附图说明Description of drawings
图1是本公开第一实施例的人脸图像的更新方法的流程图;1 is a flowchart of a method for updating a face image according to a first embodiment of the present disclosure;
图2是本公开第二实施例的人脸图像的更新方法的流程图;2 is a flowchart of a method for updating a face image according to a second embodiment of the present disclosure;
图3是本公开一个具体实施例的人脸图像的更新方法的流程图;3 is a flowchart of a method for updating a face image according to a specific embodiment of the present disclosure;
图4是本公开实施例的车辆的结构框图。FIG. 4 is a structural block diagram of a vehicle according to an embodiment of the present disclosure.
具体实施方式Detailed ways
下面详细描述本公开的实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的,旨在用于解释本公开,而不能理解为对本公开的限制。Embodiments of the present disclosure are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary, and are intended to explain the present disclosure and should not be construed as a limitation of the present disclosure.
下面参考附图1-4描述本公开实施例的人脸图像的更新方法、电子设备以及车辆。The method for updating a face image, an electronic device, and a vehicle according to embodiments of the present disclosure will be described below with reference to FIGS. 1-4 .
图1是本公开一个实施例的人脸图像的识别方法的流程图。FIG. 1 is a flowchart of a method for recognizing a face image according to an embodiment of the present disclosure.
如图1所示,人脸图像的识别方法包括以下步骤:As shown in Figure 1, the face image recognition method includes the following steps:
S11,采集待识别人脸图像。S11, collect a face image to be recognized.
作为一个示例,如图3所示,可通过采集设备(如车载终端上的摄像头)采集待识别的人脸视频流,进而根据待识别的人脸视频流获取待识别人脸图像。其中,上述人脸图像可以是2D图像、深度图像和3D人脸图像中的任一者。As an example, as shown in FIG. 3 , a face video stream to be recognized may be collected by a collection device (such as a camera on a vehicle terminal), and then an image of a face to be recognized may be obtained according to the face video stream to be recognized. The above-mentioned face image may be any one of a 2D image, a depth image and a 3D face image.
具体地,根据待识别的人脸视频流获取待识别人脸图像可包括:根据待识别的人脸视频流获取包含人脸的图像,进而对该图像进行人脸区域提取和关键点定位,例如,可以将包含人脸的图像输入至预设的人脸检测网络,从而得到人脸区域和关键点定位,进而根据关键点定位获取关键点信息。其中,可将上述人脸区域中的图像作为待识别人脸图像,上述关键点可以为5个点或者68个点。Specifically, obtaining the face image to be identified according to the face video stream to be identified may include: obtaining an image containing a face according to the face video stream to be identified, and then performing face region extraction and key point positioning on the image, such as , an image containing a human face can be input into a preset face detection network, so as to obtain the face area and key point location, and then obtain key point information according to the key point location. Wherein, the image in the above-mentioned face region can be used as the face image to be recognized, and the above-mentioned key points can be 5 points or 68 points.
S12,评估待识别人脸图像的质量以得到第一质量得分,并提取待识别人脸图像的特征以得到第一图像特征。S12 , evaluating the quality of the face image to be recognized to obtain a first quality score, and extracting features of the face image to be recognized to obtain first image features.
具体地,对提取得到的人脸区域进行质量评估,得到第一质量得分。例如,可以根据上述关键点信息进行人脸对齐,进而对人脸区域进行质量评估,得到第一质量得分。Specifically, quality evaluation is performed on the extracted face region to obtain a first quality score. For example, face alignment can be performed according to the above-mentioned key point information, and then the quality of the face region can be evaluated to obtain the first quality score.
在得到第一质量得分后,可判断第一质量得分是否处在第一预设质量范围内;如果上述第一质量得分处在第一预设质量范围内,则执行上述对待识别人脸图像进行特征提取,得到第一图像特征的步骤。After the first quality score is obtained, it can be determined whether the first quality score is within the first preset quality range; if the first quality score is within the first preset quality range, the above-mentioned face image to be recognized is performed. Feature extraction, the step of obtaining the first image feature.
作为一个示例,如图3所示,可以通过比较第一质量得分与第一质量阈值的关系判断第一质量得分是否处在第一预设质量范围内。如若上述第一质量得分表示人脸图像的质量,则第一质量得分越高,人脸图像的质量就越好。此时,要实现上述第一质量得分处在第一预设质量范围内,需要该第一质量得分大于第一质量阈值。如若上述第一质量得分表示人脸图像的质量损失,则第一质量得分越高,人脸图像的质量就越差。此时,若要实现上述第一质量得分处在第一预设质量范围内,需要该第一质量得分小于第一质量阈值。As an example, as shown in FIG. 3 , it can be determined whether the first quality score is within the first preset quality range by comparing the relationship between the first quality score and the first quality threshold. If the above-mentioned first quality score represents the quality of the face image, the higher the first quality score, the better the quality of the face image. At this time, to achieve that the first quality score is within the first preset quality range, the first quality score needs to be greater than the first quality threshold. If the above-mentioned first quality score represents the quality loss of the face image, the higher the first quality score is, the worse the quality of the face image is. At this time, in order to realize that the first quality score is within the first preset quality range, the first quality score needs to be smaller than the first quality threshold.
其中,上述第一质量阈值可以由用户自行设置,例如,可以设置上述第一质量阈值与上述第一质量得分可能达到的最大值的百分数r1,r1为0-100%中的某一值。The first quality threshold may be set by the user, for example, a percentage r1 of the first quality threshold and the possible maximum value of the first quality score may be set, where r1 is a certain value from 0 to 100%.
可选地,如果上述第一质量得分不处在第一预设质量范围内,则再次执行上述获取待识别的人脸图像的步骤。Optionally, if the above-mentioned first quality score is not within the first preset quality range, the above-mentioned step of acquiring the face image to be recognized is performed again.
由此,可以检测待识别人脸图像的质量是否合格。具体地,如若上述第一质量得分处在第一预设质量范围内,则说明与该第一质量得分对应的待识别人脸图像的质量合格,可继续执行之后的更新步骤;如若上述第一质量得分不处在第一预设质量范围内,则说明该第一质量得分对应的待识别人脸图像的质量不合格,该图像无法实现人脸解锁,更不适于用以更新标准图像。In this way, it can be detected whether the quality of the face image to be recognized is qualified. Specifically, if the first quality score is within the first preset quality range, it means that the quality of the face image to be recognized corresponding to the first quality score is qualified, and the subsequent update steps can be continued; If the quality score is not within the first preset quality range, it means that the quality of the face image to be recognized corresponding to the first quality score is unqualified, the image cannot realize face unlocking, and is not suitable for updating standard images.
在一个可行的实施方式中,若上述待识别人脸图像的质量合格,则对待识别人脸图像进行特征提取,得到第一图像特征。In a feasible implementation manner, if the quality of the above-mentioned face image to be recognized is qualified, feature extraction is performed on the face image to be recognized to obtain the first image feature.
具体地,对待识别人脸图像进行特征提取,得到特征矩阵,并将该特征矩阵作为第一 图像特征。Specifically, feature extraction is performed on the face image to be recognized to obtain a feature matrix, and the feature matrix is used as the first image feature.
可选地,还可以对待识别人脸图像进行提取,得到能进行人脸识别的特征,例如,可以提取待识别人脸图像的HOG(Histogram of Oriented Gradient,方向梯度直方图)特征、Haar特征(哈尔特征)、颜色特征等中的至少一者,进而可将该特征作为第一图像特征。Optionally, the face image to be recognized can also be extracted to obtain features capable of face recognition, for example, the HOG (Histogram of Oriented Gradient, histogram of directional gradient) feature, Haar feature ( At least one of a Haar feature), a color feature, and the like, which can then be used as the first image feature.
需要说明的是,在根据上述待识别人脸图像得到第一图像特征后,还可得到上述待识别人脸图像的活体特征。该活体特征为描述待识别人脸图像包括的人脸是否为活体人脸的特征,该活体特征可以包括人脸图像中的局部纹理特征、光照反射特征、生物运动特征等。It should be noted that, after obtaining the first image feature according to the above-mentioned face image to be recognized, the living body feature of the above-mentioned face image to be recognized can also be obtained. The living body feature is a feature describing whether the face included in the face image to be recognized is a living body face, and the living body feature may include local texture features, light reflection features, biological motion features, etc. in the face image.
S13,获取预存标准人脸图像的预存图像特征。S13: Acquire pre-stored image features of the pre-stored standard face image.
具体地,预存图像特征可存储在模板库中,以便进行人脸识别。预存图像特征的获得过程可以为:对预存标准人脸图像进行特征提取,得到特征矩阵,进而可将该特征矩阵作为预存图像特征。该预存图像特征可以是在得到预存标准人脸图像即获得的,并预存在人脸识别系统的,由此能够提高更新处理效率;还可以是在获取到第一图像特征时,对预存标准人脸图像进行特征提取得到的。Specifically, pre-stored image features can be stored in a template library for face recognition. The acquisition process of the pre-stored image features may be as follows: feature extraction is performed on the pre-stored standard face image to obtain a feature matrix, and then the feature matrix may be used as a pre-stored image feature. The pre-stored image feature may be obtained after obtaining the pre-stored standard face image and pre-stored in the face recognition system, thereby improving the update processing efficiency; it may also be that when the first image feature is obtained, The face image is obtained by feature extraction.
需要说明的是,模板库可以是车辆人脸识别系统中的数据库,该数据库中还可包含用以进行人脸识别解锁的预存标准人脸图像,该预存标准人脸图像及其预存图像特征之间存在对应关系。上述预存标准人脸图像为预先存储的标准人脸图像,其个数可以是一个,也可以是多个。以两个为例,可包括第一标准人脸图像和第二标准人脸图像。在用户进行人脸识别系统注册时,可以获取用户注册时使用的人脸图像作为初始的第一标准人脸图像与初始的第二标准人脸图像,当然,也可以不设置初始的第二标准人脸图像。It should be noted that the template library can be a database in a vehicle face recognition system, and the database can also include a pre-stored standard face image used for face recognition and unlocking, the pre-stored standard face image and its pre-stored image features There is a correspondence between them. The above-mentioned pre-stored standard face images are pre-stored standard face images, the number of which may be one or more. Taking two as an example, the first standard face image and the second standard face image may be included. When the user registers with the face recognition system, the face image used in the user registration can be obtained as the initial first standard face image and the initial second standard face image. Of course, the initial second standard may not be set. face image.
S14,根据第一质量得分、第一图像特征和预存图像特征,确定是否将预存图像特征更新为第一图像特征。S14, according to the first quality score, the first image feature, and the pre-stored image feature, determine whether to update the pre-stored image feature to the first image feature.
具体地,可先判断与第一质量得分对应的待识别人脸图像的活体特性,并在通过活体特性判断(如判定识别到活体人脸)后,根据第一质量得分、第一图像特征和预存图像特征,确定是否将预存图像特征更新为第一图像特征。Specifically, the living body characteristics of the face image to be recognized corresponding to the first quality score can be judged first, and after judging by living body characteristics (for example, judging that a living body face is recognized), according to the first quality score, the first image characteristics and the Pre-stored image features to determine whether to update the pre-stored image features to the first image features.
由此,对采集到的图像进行活体检测,从而实现根据活体人脸图像对标准人脸图像进行实时更新,提升了人脸识别系统的安全性。In this way, the collected image is subjected to live detection, so that the standard face image can be updated in real time according to the live face image, and the security of the face recognition system is improved.
在本公开的一个实施例中,如图2所示,上述根据第一质量得分、第一图像特征和预存图像特征,确定是否将预存图像特征更新为第一图像特征可包括:In an embodiment of the present disclosure, as shown in FIG. 2 , the above-mentioned determining whether to update the pre-stored image feature to the first image feature according to the first quality score, the first image feature, and the pre-stored image feature may include:
S21,计算第一图像特征与第一标准人脸图像对应的预存图像特征之间的相似度,得到第一相似度。S21: Calculate the similarity between the first image feature and the pre-stored image feature corresponding to the first standard face image to obtain the first similarity.
S22,判断第一相似度是否大于第一预设相似度阈值。S22: Determine whether the first similarity is greater than a first preset similarity threshold.
需要说明的是,在本公开实施例中,初始的第一标准人脸图像是在用户注册时获取的人脸图像,但非初始的第一标准人脸图像均是由待识别人脸图像更新得到的。由于待识别 人脸图像和初始的第一标准人脸图像可以是由同一采集设备采集得到,也可以是由不同的采集设备采集得到。因此,为了对第一相似度进行更准确的判断,需要选择合适的第一预设相似度阈值。具体地,可判断待识别人脸图像与第一标准人脸图像的采集设备是否相同(例如,可以是采集设备的类型是否相同,或者,是同一采集设备);根据判断结果确定第一预设相似度阈值,其中,判断结果为相同确定的第一预设相似度阈值大于判断结果为不同确定的预设相似度阈值。It should be noted that, in the embodiment of the present disclosure, the initial first standard face image is the face image obtained when the user registers, but the non-initial first standard face image is updated by the face image to be recognized owned. Because the face image to be recognized and the initial first standard face image may be acquired by the same acquisition device, or may be acquired by different acquisition devices. Therefore, in order to more accurately judge the first similarity, it is necessary to select an appropriate first preset similarity threshold. Specifically, it can be judged whether the collection devices of the face image to be recognized and the first standard face image are the same (for example, whether the type of the collection equipment is the same, or the same collection equipment); the first preset is determined according to the judgment result. Similarity threshold, wherein the first preset similarity threshold for which the determination result is the same determination is greater than the preset similarity threshold for which the determination result is different determination.
应当理解,同模比对,即用于比对的两张人脸图像来自同一类型采集设备,此时比对出的相似度需要考虑的因素更少,误差更小,因此其对应的第一预设相似度阈值相对较大;异模比对,即用于比对的两张人脸图像来自不同类型的采集设备,如待识别人脸图像由上述采集设置采集,而第一标准人脸图像由人脸注册设备采集,此时比对出的相似度需要考虑的因素更多,误差更大,因此其对应的第一预设相似度阈值相对较小。It should be understood that in the same-model comparison, that is, the two face images used for comparison are from the same type of acquisition device, at this time, fewer factors need to be considered and the error is smaller, so the corresponding first The preset similarity threshold is relatively large; heterogeneous comparison, that is, the two face images used for comparison are from different types of collection devices. For example, the face image to be recognized is collected by the above collection settings, and the first standard face image The image is collected by the face registration device. At this time, more factors need to be considered in the comparison of the similarity, and the error is larger, so the corresponding first preset similarity threshold is relatively small.
S23,如果第一相似度大于第一预设相似度阈值,则进行人脸解锁,并判断第一质量得分是否处在第二预设质量范围内,其中,第二预设质量范围对应的图像质量优于第一预设质量范围对应的图像质量。S23, if the first similarity is greater than the first preset similarity threshold, perform face unlocking, and determine whether the first quality score is within the second preset quality range, wherein the image corresponding to the second preset quality range The quality is better than the image quality corresponding to the first preset quality range.
具体地,如果第一相似度大于第一预设相似度阈值,则说明当前待识别人脸图像满足人脸识别系统的解锁条件,可进行人脸解锁,进而可对第一质量得分进行再次判断,确定当前待识别人脸图像是否适于更新预存标准人脸图像。Specifically, if the first similarity is greater than the first preset similarity threshold, it means that the current face image to be recognized satisfies the unlocking conditions of the face recognition system, and face unlocking can be performed, and then the first quality score can be judged again , to determine whether the current face image to be recognized is suitable for updating the pre-stored standard face image.
可选地,如果第一相似度小于或者等于第一预设相似度阈值,则计算第一图像特征与第二标准人脸图像对应的预存图像特征之间的相似度,得到第二相似度;判断第二相似度是否大于第二预设相似度阈值;如果第二相似度大于第二预设相似度阈值,则进行人脸解锁。如果第二相似度小于或者等于第二预设相似度阈值,则发出第一提示信息(如通过车载终端显示屏显示预设提示图片、文字信息等),以进行人脸解锁失败提示。Optionally, if the first similarity is less than or equal to the first preset similarity threshold, the similarity between the first image feature and the pre-stored image feature corresponding to the second standard face image is calculated to obtain the second similarity; Determine whether the second similarity is greater than the second preset similarity threshold; if the second similarity is greater than the second preset similarity threshold, perform face unlocking. If the second similarity is less than or equal to the second preset similarity threshold, first prompt information is sent (eg, a preset prompt picture, text information, etc. is displayed on the display screen of the vehicle terminal) to prompt the face unlock failure.
其中,上述第二预设质量范围可根据上述第一标准人脸图像的质量和上述第二标准人脸图像的质量确定。例如,以图像质量与第一质量得分正相关为例,第二预设质量范围可以是大于第二质量阈值的范围,该第二质量阈值可以是两标准人脸图像得分的均值,第二质量阈值应大于或等于上述的第一质量阈值。The second preset quality range may be determined according to the quality of the first standard face image and the quality of the second standard face image. For example, taking the positive correlation between image quality and the first quality score as an example, the second preset quality range may be a range greater than a second quality threshold, and the second quality threshold may be the average of the scores of two standard face images, and the second quality The threshold should be greater than or equal to the above-mentioned first quality threshold.
由此,可以实现根据至少两张标准图像进行人脸识别解锁,从而提高了人脸识别解锁的准确性和概率,提升用户体验。In this way, face recognition unlocking can be implemented according to at least two standard images, thereby improving the accuracy and probability of face recognition unlocking and improving user experience.
需要说明的是,本公开实施例的更新方法可在通过人脸图像进行解锁的过程中进行,也就是说,车载人脸识别系统可在进行常规人脸识别解锁交互的同时,执行本公开的更新方法。上述第二预设相似度阈值的确定方式与上述第一预设相似度阈值的确定方式相似,可以通过判断待识别人脸图像与第二标准人脸图像是否为相同的采集设备得到。It should be noted that the update method of the embodiment of the present disclosure may be performed in the process of unlocking through a face image, that is to say, the vehicle-mounted face recognition system may perform the unlocking interaction of the present disclosure while performing the conventional face recognition unlocking interaction. Update method. The manner of determining the second preset similarity threshold is similar to that of determining the first preset similarity threshold, and can be obtained by judging whether the face image to be recognized and the second standard face image are the same collection device.
S24,如果第一质量得分处在第二预设质量范围内,则将第一标准人脸图像对应的预 存图像特征更新为第一图像特征。S24, if the first quality score is within the second preset quality range, update the pre-stored image feature corresponding to the first standard face image to the first image feature.
S25,如果第一质量得分不处在第二预设质量范围内,则将第二标准人脸图像对应的预存图像特征更新为第一图像特征。S25, if the first quality score is not within the second preset quality range, update the pre-stored image feature corresponding to the second standard face image to the first image feature.
需要说明的是,在根据待识别人脸图像对标准人脸图像进行更新时,上述的人脸图像关键点信息、图像特征等也需要被更新到模板库中。It should be noted that when the standard face image is updated according to the face image to be recognized, the above-mentioned key point information and image features of the face image also need to be updated into the template library.
作为一个示例,如图3所示,可以通过比较第一质量得分与第二质量阈值的关系判断第一质量得分是否处于第二预设质量范围内。其中,上述第二质量阈值可以为第一标准人脸图像与第二标准人脸图像的均值。若第一质量得分大于第二质量阈值,则第一质量得分处在第二预设质量范围内,将第一标准人脸图像对应的预存图像特征更新为第一图像特征;若第一质量得分小于等于第二质量阈值,则第一质量得分不处在第二预设质量范围内,将第二标准人脸图像对应的预存图像特征更新为第一图像特征。As an example, as shown in FIG. 3 , it can be determined whether the first quality score is within the second preset quality range by comparing the relationship between the first quality score and the second quality threshold. The above-mentioned second quality threshold may be an average value of the first standard face image and the second standard face image. If the first quality score is greater than the second quality threshold, the first quality score is within the second preset quality range, and the pre-stored image feature corresponding to the first standard face image is updated to the first image feature; if the first quality score If it is less than or equal to the second quality threshold, the first quality score is not within the second preset quality range, and the pre-stored image feature corresponding to the second standard face image is updated to the first image feature.
在一些实施例中,可能存在某次更新得到的第一标准人脸图像的质量较高,导致连续多次人脸解锁成功后仅第二标准人脸图像进行更新,而待识别人脸图像不能通过第一标准图像进行人脸解锁的情况。因此还可获取利用第二标准人脸图像进行人脸解锁的连续次数;如果连续次数达到第一预设次数,则将当前第一标准人脸图像对应的预存图像特征更新为当前第一图像特征。由此,可保证模板库中标准人脸图像的实时性。In some embodiments, the quality of the first standard face image obtained by a certain update may be high, resulting in that only the second standard face image is updated after successful face unlocking for several consecutive times, and the face image to be recognized cannot be The situation of face unlocking through the first standard image. Therefore, it is also possible to obtain the consecutive times of using the second standard face image to unlock the face; if the consecutive times reach the first preset times, update the pre-stored image feature corresponding to the current first standard face image to the current first image feature . Thus, the real-time performance of the standard face images in the template library can be guaranteed.
需要说明的是,在人脸解锁成功后,即判断连续次数是否达到第一预设次数,如果达到,则直接进行模板库中标准人脸图像的更新,而不再比较第一质量得分与第二预设质量范围之间的关系。It should be noted that, after the face is successfully unlocked, it is determined whether the consecutive number of times reaches the first preset number of times, and if so, the standard face image in the template library is updated directly without comparing the first quality score and the first quality score. The relationship between the two preset quality ranges.
作为一个示例,在进行模板库中标准人脸图像更新时,如果有更新,则可通过车载终端发出提示信息,以提示用户模板库有更新;如果没有更新,则可不进行任何提示。当然,也可在有更新时不提示,无更新时提示;在有无更新时都不进行提示,此时更新过程后台运行,与用户无交互;还可在有无更新时都进行提示。As an example, when updating the standard face images in the template library, if there is an update, a prompt message can be sent through the vehicle terminal to prompt the user that the template library is updated; if there is no update, no prompt can be given. Of course, you can also not prompt when there is an update, and prompt when there is no update; no prompt when there is an update or not, at this time, the update process runs in the background without interaction with the user; you can also prompt when there is an update or not.
综上,本公开实施例的人脸图像的更新方法,可以实现对标准人脸图像进行实时更新,从而降低人脸识别系统受人脸易变性的影响,提升人脸识别的准确性和易用性。而且,在人脸识别前,还进行活体检测,提升了人脸识别系统的安全性。根据至少两张标准图像进行人脸识别,从而进一步提高了人脸识别的准确性。To sum up, the method for updating a face image according to the embodiment of the present disclosure can realize real-time updating of a standard face image, thereby reducing the influence of the face recognition system on the variability of faces, and improving the accuracy and ease of use of face recognition. sex. Moreover, before face recognition, live detection is also performed, which improves the security of the face recognition system. Face recognition is performed according to at least two standard images, thereby further improving the accuracy of face recognition.
本公开还提出了一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时,实现上述的人脸图像的更新方法。The present disclosure also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the above-mentioned method for updating a face image.
本公开实施例的计算机可读存储介质,在其上存储的与上述的人脸图像的更新方法对应的计算机程序被执行时,可以实现对标准人脸图像进行实时更新,从而降低人脸识别系统受人脸易变性的影响,提升人脸识别的准确性和易用性。The computer-readable storage medium of the embodiment of the present disclosure, when the computer program stored on the computer program corresponding to the above-mentioned method for updating a face image is executed, can realize real-time updating of a standard face image, thereby reducing the performance of the face recognition system. Affected by the variability of faces, the accuracy and ease of use of face recognition are improved.
本公开还提出一种电子设备。The present disclosure also proposes an electronic device.
在本公开中,电子设备包括存储器、处理器和存储在存储器上的计算机程序,该计算机程序被处理器执行时,实现上述的人脸图像的更新方法。In the present disclosure, an electronic device includes a memory, a processor, and a computer program stored on the memory. When the computer program is executed by the processor, the above-mentioned method for updating a face image is implemented.
本公开实施例的电子设备,通过实现上述的人脸图像的更新方法,可以实现对标准人脸图像进行实时更新,从而降低人脸识别系统受人脸易变性的影响,提升人脸识别的准确性和易用性。而且,在人脸识别前,还进行活体检测,提升了人脸识别系统的安全性。根据至少两张标准图像进行人脸识别,从而进一步提高了人脸识别的准确性。The electronic device according to the embodiment of the present disclosure can realize the real-time update of the standard face image by implementing the above-mentioned method for updating the face image, thereby reducing the influence of the face variability on the face recognition system and improving the accuracy of face recognition. flexibility and ease of use. Moreover, before face recognition, live detection is also performed, which improves the security of the face recognition system. Face recognition is performed according to at least two standard images, thereby further improving the accuracy of face recognition.
图4是本公开实施例的车辆的结构框图。FIG. 4 is a structural block diagram of a vehicle according to an embodiment of the present disclosure.
如图4所示,该车辆1000包括上述的电子设备100。As shown in FIG. 4 , the vehicle 1000 includes the aforementioned electronic device 100 .
本公开实施例的车辆,通过上述的电子设备,可以实现对标准人脸图像进行实时更新,从而降低人脸识别系统受人脸易变性的影响,提升人脸识别的准确性和易用性。而且,在人脸识别前,还进行活体检测,提升了人脸识别系统的安全性。根据至少两张标准图像进行人脸识别,从而进一步提高了人脸识别的准确性。The vehicle of the embodiment of the present disclosure can realize real-time update of the standard face image through the above-mentioned electronic device, thereby reducing the influence of face variability on the face recognition system, and improving the accuracy and ease of use of face recognition. Moreover, before face recognition, live detection is also performed, which improves the security of the face recognition system. Face recognition is performed according to at least two standard images, thereby further improving the accuracy of face recognition.
需要说明的是,在流程图中表示或在此以其他方式描述的逻辑和/或步骤,例如,可以被认为是用于实现逻辑功能的可执行指令的定序列表,可以具体实现在任何计算机可读介质中,以供指令执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用,或结合这些指令执行系统、装置或设备而使用。就本说明书而言,"计算机可读介质"可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。计算机可读介质的更具体的示例(非穷尽性列表)包括以下:具有一个或多个布线的电连接部(电子装置),便携式计算机盘盒(磁装置),随机存取存储器(RAM),只读存储器(ROM),可擦除可编辑只读存储器(EPROM或闪速存储器),光纤装置,以及便携式光盘只读存储器(CDROM)。另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。It should be noted that the logic and/or steps represented in the flowcharts or otherwise described herein, for example, may be considered to be an ordered listing of executable instructions for implementing the logical functions, and may be embodied in any computer readable medium for use by an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other system that can fetch and execute instructions from an instruction execution system, apparatus, or device), or in combination with these Used in order to execute a system, apparatus or device. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport the program for use by or in conjunction with an instruction execution system, apparatus, or apparatus. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections with one or more wiring (electronic devices), portable computer disk cartridges (magnetic devices), random access memory (RAM), Read Only Memory (ROM), Erasable Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer readable medium may even be paper or other suitable medium on which the program may be printed, as the paper or other medium may be optically scanned, for example, followed by editing, interpretation, or other suitable medium as necessary process to obtain the program electronically and then store it in computer memory.
应当理解,本公开的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。例如,如果用硬件来实现,和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA), 现场可编程门阵列(FPGA)等。It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or a combination of the following techniques known in the art: Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, Programmable Gate Arrays (PGA), Field Programmable Gate Arrays (FPGA), etc.
在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本公开的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不一定指的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施例或示例中以合适的方式结合。In the description of this specification, description with reference to the terms "one embodiment," "some embodiments," "example," "specific example," or "some examples", etc., mean specific features described in connection with the embodiment or example , structures, materials, or features are included in at least one embodiment or example of the present disclosure. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
在本公开的描述中,需要理解的是,术语“中心”、“纵向”、“横向”、“长度”、“宽度”、“厚度”、“上”、“下”、“前”、“后”、“左”、“右”、“竖直”、“水平”、“顶”、“底”“内”、“外”、“顺时针”、“逆时针”、“轴向”、“径向”、“周向”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本公开和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本公开的限制。In the description of the present disclosure, it is to be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", " Rear, Left, Right, Vertical, Horizontal, Top, Bottom, Inner, Outer, Clockwise, Counterclockwise, Axial, The orientations or positional relationships indicated by "radial direction", "circumferential direction", etc. are based on the orientations or positional relationships shown in the drawings, and are only for the convenience of describing the present disclosure and simplifying the description, rather than indicating or implying the indicated devices or elements It must have, be constructed, and operate in a particular orientation, and therefore should not be construed as a limitation of the present disclosure.
此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本公开的描述中,“多个”的含义是至少两个,例如两个,三个等,除非另有明确具体的限定。In addition, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature delimited with "first", "second" may expressly or implicitly include at least one of that feature. In the description of the present disclosure, "plurality" means at least two, such as two, three, etc., unless expressly and specifically defined otherwise.
在本公开中,除非另有明确的规定和限定,术语“安装”、“相连”、“连接”、“固定”等术语应做广义理解,例如,可以是固定连接,也可以是可拆卸连接,或成一体;可以是机械连接,也可以是电连接;可以是直接相连,也可以通过中间媒介间接相连,可以是两个元件内部的连通或两个元件的相互作用关系,除非另有明确的限定。对于本领域的普通技术人员而言,可以根据具体情况理解上述术语在本公开中的具体含义。In the present disclosure, unless otherwise expressly specified and limited, the terms "installed", "connected", "connected", "fixed" and other terms should be understood in a broad sense, for example, it may be a fixed connection or a detachable connection , or integrated; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between the two elements, unless otherwise specified limit. For those of ordinary skill in the art, the specific meanings of the above terms in the present disclosure can be understood according to specific situations.
在本公开中,除非另有明确的规定和限定,第一特征在第二特征“上”或“下”可以是第一和第二特征直接接触,或第一和第二特征通过中间媒介间接接触。而且,第一特征在第二特征“之上”、“上方”和“上面”可是第一特征在第二特征正上方或斜上方,或仅仅表示第一特征水平高度高于第二特征。第一特征在第二特征“之下”、“下方”和“下面”可以是第一特征在第二特征正下方或斜下方,或仅仅表示第一特征水平高度小于第二特征。In the present disclosure, unless expressly stated and defined otherwise, a first feature "on" or "under" a second feature may be in direct contact with the first and second features, or indirectly through an intermediary between the first and second features touch. Also, the first feature being "above", "over" and "above" the second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is level higher than the second feature. The first feature being "below", "below" and "below" the second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature has a lower level than the second feature.
尽管上面已经示出和描述了本公开的实施例,可以理解的是,上述实施例是示例性的,不能理解为对本公开的限制,本领域的普通技术人员在本公开的范围内可以对上述实施例进行变化、修改、替换和变型。Although the embodiments of the present disclosure have been shown and described above, it should be understood that the above-described embodiments are exemplary and should not be construed as limitations of the present disclosure, and those of ordinary skill in the art may interpret the above-described embodiments within the scope of the present disclosure. Embodiments are subject to variations, modifications, substitutions and variations.

Claims (11)

  1. 一种人脸图像的更新方法,其特征在于,包括以下步骤:A method for updating a face image, comprising the following steps:
    采集待识别人脸图像;Collect face images to be recognized;
    评估所述待识别人脸图像的质量以得到第一质量得分,并提取所述待识别人脸图像的特征以得到第一图像特征;Evaluating the quality of the face image to be identified to obtain a first quality score, and extracting features of the face image to be identified to obtain first image features;
    获取预存标准人脸图像的预存图像特征;Obtain the pre-stored image features of the pre-stored standard face image;
    根据所述第一质量得分、所述第一图像特征和所述预存图像特征,确定是否将所述预存图像特征更新为所述第一图像特征。According to the first quality score, the first image feature and the pre-stored image feature, it is determined whether to update the pre-stored image feature to the first image feature.
  2. 如权利要求1所述的人脸图像的更新方法,其特征在于,在提取所述待识别人脸图像的特征以得到第一图像特征之前,所述更新方法还包括:The method for updating a face image according to claim 1, wherein before extracting the feature of the face image to be recognized to obtain the first image feature, the updating method further comprises:
    判断所述第一质量得分是否处在第一预设质量范围内;determining whether the first quality score is within a first preset quality range;
    如果所述第一质量得分处在所述第一预设质量范围内,则执行所述提取所述待识别人脸图像的特征以得到第一图像特征的步骤。If the first quality score is within the first preset quality range, the step of extracting the feature of the face image to be recognized to obtain the first image feature is performed.
  3. 如权利要求2所述的人脸图像的更新方法,其特征在于,所述预存标准人脸图像包括第一标准人脸图像和第二标准人脸图像,其中,所述根据所述第一质量得分、所述第一图像特征和所述预存图像特征,确定是否将所述预存图像特征更新为所述第一图像特征,包括:The method for updating a face image according to claim 2, wherein the pre-stored standard face image comprises a first standard face image and a second standard face image, wherein the The score, the first image feature, and the pre-stored image feature, to determine whether to update the pre-stored image feature to the first image feature, including:
    计算所述第一图像特征与所述第一标准人脸图像对应的预存图像特征之间的相似度,得到第一相似度;Calculate the similarity between the first image feature and the pre-stored image feature corresponding to the first standard face image to obtain the first similarity;
    判断所述第一相似度是否大于第一预设相似度阈值;determining whether the first similarity is greater than a first preset similarity threshold;
    如果所述第一相似度大于所述第一预设相似度阈值,则进行人脸解锁,并判断所述第一质量得分是否处在第二预设质量范围内,其中,所述第二预设质量范围对应的图像质量优于所述第一预设质量范围对应的图像质量;If the first similarity is greater than the first preset similarity threshold, perform face unlocking, and determine whether the first quality score is within a second preset quality range, where the second preset It is assumed that the image quality corresponding to the quality range is better than the image quality corresponding to the first preset quality range;
    如果所述第一质量得分处在所述第二预设质量范围内,则将所述第一标准人脸图像对应的预存图像特征更新为所述第一图像特征;If the first quality score is within the second preset quality range, updating the pre-stored image feature corresponding to the first standard face image to the first image feature;
    如果所述第一质量得分不处在所述第二预设质量范围内,则将所述第二标准人脸图像对应的预存图像特征更新为所述第一图像特征。If the first quality score is not within the second preset quality range, updating the pre-stored image feature corresponding to the second standard face image to the first image feature.
  4. 如权利要求3所述的人脸图像的更新方法,其特征在于,所述根据所述第一质量得分、所述第一图像特征和所述预存图像特征,确定是否将所述预存图像特征所述第一图像特征,还包括:The method for updating a face image according to claim 3, characterized in that, according to the first quality score, the first image feature and the pre-stored image feature, determining whether to update the pre-stored image feature The first image feature further includes:
    如果所述第一相似度小于或者等于所述第一预设相似度阈值,则计算所述第一图像特征与所述第二标准人脸图像对应的预存图像特征之间的相似度,得到第二相似度;If the first similarity is less than or equal to the first preset similarity threshold, calculate the similarity between the first image feature and the pre-stored image feature corresponding to the second standard face image to obtain the first Second similarity;
    判断所述第二相似度是否大于第二预设相似度阈值;determining whether the second similarity is greater than a second preset similarity threshold;
    如果所述第二相似度大于所述第二预设相似度阈值,则进行人脸解锁。If the second similarity is greater than the second preset similarity threshold, face unlocking is performed.
  5. 如权利要求4所述的人脸图像的更新方法,其特征在于,所述更新方法还包括:The updating method of human face image as claimed in claim 4, is characterized in that, described updating method further comprises:
    如果所述第二相似度小于或者等于所述第二预设相似度阈值,则发出第一提示信息,以进行人脸解锁失败提示。If the second similarity is less than or equal to the second preset similarity threshold, first prompt information is sent to prompt a face unlock failure.
  6. 如权利要求4所述的人脸图像的更新方法,其特征在于,所述更新方法还包括:The updating method of human face image as claimed in claim 4, is characterized in that, described updating method further comprises:
    获取利用第二标准人脸图像进行人脸解锁的连续次数;Obtain the consecutive times of face unlocking using the second standard face image;
    如果所述连续次数达到第一预设次数,则将当前第一标准人脸图像对应的预存图像特征更新为当前第一图像特征。If the consecutive number of times reaches the first preset number of times, the pre-stored image feature corresponding to the current first standard face image is updated to the current first image feature.
  7. 如权利要求3-6中任一项所述的人脸图像的更新方法,其特征在于,所述更新方法还包括:The method for updating a face image according to any one of claims 3-6, wherein the method for updating further comprises:
    根据所述第一标准人脸图像的质量和所述第二标准人脸图像的质量确定所述第二预设质量范围。The second preset quality range is determined according to the quality of the first standard face image and the quality of the second standard face image.
  8. 如权利要求3-7中任一项所述的人脸图像的更新方法,其特征在于,所述更新方法还包括:The method for updating a face image according to any one of claims 3-7, wherein the method for updating further comprises:
    判断所述待识别人脸图像与所述第一标准人脸图像的采集设备是否相同;Determine whether the acquisition device of the face image to be recognized and the first standard face image is the same;
    根据判断结果确定所述第一预设相似度阈值,The first preset similarity threshold is determined according to the judgment result,
    其中,所述判断结果相同确定的第一预设相似度阈值大于所述判断结果不同确定的预设相似度阈值。Wherein, the first preset similarity threshold determined with the same judgment results is greater than the preset similarity threshold determined with different judgment results.
  9. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时,实现如权利要求1-8中任一项所述的人脸图像的更新方法。A computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the method for updating a face image according to any one of claims 1-8 is implemented.
  10. 一种电子设备,包括存储器、处理器和存储在所述存储器上的计算机程序,其特征在于,所述计算机程序被所述处理器执行时,实现如权利要求1-8中任一项所述的人脸图像的更新方法。An electronic device, comprising a memory, a processor and a computer program stored on the memory, characterized in that, when the computer program is executed by the processor, the implementation of any one of claims 1-8 method for updating face images.
  11. 一种车辆,其特征在于,包括如权利要求10所述的电子设备。A vehicle, characterized by comprising the electronic device as claimed in claim 10 .
PCT/CN2021/129692 2020-11-23 2021-11-10 Update method for face image, storage medium, electronic device, and vehicle WO2022105650A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011320274.0A CN114529961A (en) 2020-11-23 2020-11-23 Face image updating method, storage medium, electronic device and vehicle
CN202011320274.0 2020-11-23

Publications (1)

Publication Number Publication Date
WO2022105650A1 true WO2022105650A1 (en) 2022-05-27

Family

ID=81619581

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/129692 WO2022105650A1 (en) 2020-11-23 2021-11-10 Update method for face image, storage medium, electronic device, and vehicle

Country Status (2)

Country Link
CN (1) CN114529961A (en)
WO (1) WO2022105650A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114987389A (en) * 2022-07-18 2022-09-02 中国第一汽车股份有限公司 Vehicle control system, method, device, equipment and medium
CN115798023B (en) * 2023-02-13 2023-04-18 成都睿瞳科技有限责任公司 Face identification authentication method and device, storage medium and processor

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070098229A1 (en) * 2005-10-27 2007-05-03 Quen-Zong Wu Method and device for human face detection and recognition used in a preset environment
CN108446387A (en) * 2018-03-22 2018-08-24 百度在线网络技术(北京)有限公司 Method and apparatus for updating face registration library
CN110532991A (en) * 2019-09-04 2019-12-03 深圳市捷顺科技实业股份有限公司 A kind of face identification method, device and equipment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070098229A1 (en) * 2005-10-27 2007-05-03 Quen-Zong Wu Method and device for human face detection and recognition used in a preset environment
CN108446387A (en) * 2018-03-22 2018-08-24 百度在线网络技术(北京)有限公司 Method and apparatus for updating face registration library
CN110532991A (en) * 2019-09-04 2019-12-03 深圳市捷顺科技实业股份有限公司 A kind of face identification method, device and equipment

Also Published As

Publication number Publication date
CN114529961A (en) 2022-05-24

Similar Documents

Publication Publication Date Title
WO2022105650A1 (en) Update method for face image, storage medium, electronic device, and vehicle
CN109948408B (en) Activity test method and apparatus
US9639769B2 (en) Liveness detection
CN109117879B (en) Image classification method, device and system
WO2019100888A1 (en) Target object recognition method and device, storage medium and electronic apparatus
JP4369922B2 (en) Biological image collation device and collation method thereof
JP5277804B2 (en) Fingerprint authentication apparatus, fingerprint authentication program, and fingerprint authentication method
JP6046948B2 (en) Object detection apparatus, control method therefor, program, and storage medium
CN108269333A (en) Face identification method, application server and computer readable storage medium
US20090092299A1 (en) System and Method for Joint Classification Using Feature Space Cluster Labels
CN105706108A (en) Frequency spectrum resource scheduling device, method and system
JP6572537B2 (en) Authentication apparatus, method, and program
CN110807491A (en) License plate image definition model training method, definition detection method and device
US10664523B2 (en) Information processing apparatus, information processing method, and storage medium
US10325141B2 (en) Pattern registration
CN111931548B (en) Face recognition system, method for establishing face recognition data and face recognition method
CN111353451A (en) Battery car detection method and device, computer equipment and storage medium
JP2013061875A (en) Authentication system and reliability determination method
CN114037886A (en) Image recognition method and device, electronic equipment and readable storage medium
KR20100041562A (en) Method and system for performing user authentication by face recognizing and fingerprint recognizing of user needing an authentication
CN112699811A (en) Living body detection method, apparatus, device, storage medium, and program product
WO2021138893A1 (en) Vehicle license plate recognition method and apparatus, electronic device, and storage medium
CN115204893A (en) Face recognition method and device for electronic payment and computer equipment
JP2023001086A (en) Classification method based on neural network, and classification apparatus
TWI632509B (en) Face recognition apparatus and method thereof, method for increasing image recognition accuracy, and computer-readable storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21893797

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21893797

Country of ref document: EP

Kind code of ref document: A1