CN110781473B - Method for recognizing and preprocessing face picture - Google Patents
Method for recognizing and preprocessing face picture Download PDFInfo
- Publication number
- CN110781473B CN110781473B CN201910960067.2A CN201910960067A CN110781473B CN 110781473 B CN110781473 B CN 110781473B CN 201910960067 A CN201910960067 A CN 201910960067A CN 110781473 B CN110781473 B CN 110781473B
- Authority
- CN
- China
- Prior art keywords
- face
- face image
- score
- image
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/45—Structures or tools for the administration of authentication
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Image Processing (AREA)
- Image Analysis (AREA)
Abstract
The application discloses a user registration method based on a face image, a user registration server and a computer storage medium. The user registration method comprises the following steps: acquiring a face image of a user; performing quality evaluation on the face image to obtain a quality score; judging whether the mass fraction is greater than or equal to a preset fraction threshold value; if the score is larger than or equal to the score threshold, executing a subsequent registration process; and if the number of the face images is smaller than the score threshold, rotating the face images according to a preset angle step length and a preset rotating direction, and returning to the step of evaluating the quality of the face images. According to the method and the device, the processes of angle rotation and re-judgment of the face picture are added under the condition that the face quality score is unqualified, and the accuracy of face registration can be improved.
Description
Technical Field
The present application relates to the field of face recognition technology, and in particular, to a user registration method based on a face image, a user registration server, and a computer storage medium.
Background
At present, in the face image registration service of a face intelligent server, quality score detection is carried out on an input face image, if the quality score is lower than a threshold value, registration operation is abandoned, the face image cannot be registered and put in storage, and subsequent comparison and identification services cannot be carried out. For example, when a bank VIP client performs face registration on a PAD platform, if the client does not perform face shooting on a camera, the system may determine that the quality score of an input picture is too low, which may result in registration failure, and thus, VIP location and identification cannot be performed on the client.
Disclosure of Invention
The application mainly provides a user registration method based on a face image, a user registration server and a computer storage medium, so as to solve the problem that registration fails due to improper face angle in the input face image.
In order to solve the technical problem, the application adopts a technical scheme that: a user registration method based on a face image is provided. The user registration method comprises the following steps: acquiring a face image of a user; performing quality evaluation on the face image to obtain a quality score; judging whether the mass fraction is greater than or equal to a preset fraction threshold value; if the score is larger than or equal to the score threshold, executing a subsequent registration process; and if the number of the face images is smaller than the score threshold, rotating the face images according to a preset angle step length and a preset rotating direction, and returning to the step of evaluating the quality of the face images.
In order to solve the above technical problem, another technical solution adopted by the present application is: a user registration server based on a face image is provided. The user registration server includes: the acquisition module is used for acquiring a face image of a user; the quality evaluation module is used for carrying out quality evaluation on the face image so as to obtain a quality score; the judging module is used for judging whether the quality score is greater than or equal to a preset score threshold value; the subsequent processing module is used for executing a subsequent registration process after the judging module judges that the quality score is greater than or equal to the score threshold value; and the rotating module is used for rotating the face image according to a preset angle step length and a rotating direction after the judging module judges that the quality score is smaller than the score threshold value, and returning the rotated face image to the quality evaluating module.
In order to solve the above technical problem, the present application adopts another technical solution: there is provided a user registration server, the server comprising a processor and a memory; the memory has stored therein a computer program for execution by the processor to perform the steps of the user registration method as described above.
In order to solve the above technical problem, the present application adopts another technical solution: there is provided a computer storage medium storing a computer program which, when executed, implements the steps of the user registration method as described above.
The beneficial effect of this application is: according to the technical scheme, the process of angle rotation and re-judgment of the face picture is added under the condition that the face quality score is unqualified, and the accuracy of face registration can be improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts, wherein:
fig. 1 is a schematic flowchart of an embodiment of a user registration method based on a face image according to the present application;
fig. 2 is a schematic flowchart of another embodiment of a user registration method based on a face image according to the present application.
FIG. 3 is a schematic block diagram illustrating one embodiment of a user registration server provided herein;
FIG. 4 is a schematic structural diagram of an embodiment of a user registration server provided in the present application;
FIG. 5 is a schematic structural diagram of an embodiment of a storage medium provided in the present application;
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first", "second" and "third" in the embodiments of the present application are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first," "second," or "third" may explicitly or implicitly include at least one of the feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless explicitly specifically limited otherwise. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
As shown in fig. 1, fig. 1 is a schematic flowchart of an embodiment of a user registration method based on a face image, which includes the following steps:
step 10: and acquiring a face image of the user. In this embodiment, the system collects a face image through an internal or external camera. Of course, in other embodiments, the photographed facial image uploaded by the user may be received through the communication interface.
Step 20: and performing quality evaluation on the face image to obtain a quality score.
In a specific implementation process, face coordinates may be extracted from a face image, where the face coordinates refer to coordinates that can define an area in the image where a face is located. For example, when the region where the face is located is marked with a rectangle, the face coordinates may be coordinates of two diagonal points of the rectangle on the image. When the area where the face is located is marked by a circle, the face coordinates may be the coordinates of the center of the circle and the radius. Alternatively, the coordinates of the face region feature points may be obtained by positioning the face region feature points of the input face image by using an ASM algorithm, an AAM algorithm, or the like. The face region feature points here refer to five sense organs of a person, such as eyes, a nose, and the like. Face coordinates are further determined based on the coordinates of the feature points.
The face quality score is a judgment on the accuracy of the extracted face information. In this embodiment, the face image quality evaluation algorithm includes the following 4 parts, which respectively evaluate the symmetry, the definition, the illumination quality and the picture resolution of a face image in a face region defined by face coordinates in an image to obtain respective evaluation coefficients (0-100), then perform weighted calculation by the weight (0-1) occupied by each coefficient, and finally obtain the quality score of the input face image. Wherein the content of the first and second substances,
facial symmetry: using a similarity score between histograms of local features (left and right faces) as a local symmetry measure;
definition: the facial feature points found by the facial feature detector construct a mask (mask) on which there are no background pixels. The image sharpness score is calculated as the average laplacian response of the mask.
The lighting quality is as follows: the illumination quality is estimated by determining the length of the available range of gray scale intensities, removing 5% of the darkest and brightest pixels.
Picture resolution: the resolution quality score is defined as a linear function of its bounding box.
Integral fraction calculation formula:
wherein q (I) is the quality coefficient of the human face image, SiRespectively, the evaluation results of the above-mentioned face symmetry, sharpness, illumination quality and picture resolution, wiAre corresponding weighting coefficients, w0Is the basic mass fraction.
S30: and judging whether the mass fraction is greater than or equal to a preset fraction threshold value. For example, the quality score threshold is preset to be 30 in the present embodiment.
If the quality score is greater than or equal to the score threshold, the quality of the face image is determined to meet the registration standard, and the process proceeds to step S40 to execute the subsequent registration process. The subsequent registration process comprises the steps of associating the face image with the identity information of the user and storing the face image in the base so as to be convenient for subsequent login authentication. The face image can be subjected to face recognition to extract face features, and the face features are associated with the identity information of the user.
And if the quality score is smaller than the score threshold, determining that the quality of the face image does not meet the registration standard, entering step S50, rotating the face image according to a preset angle step and a rotation direction, and returning to S20 to perform quality evaluation and quality judgment on the rotated face image again.
Specifically, in the implementation of face image rotation, the face image is first converted into a matrix form, and the rotation matrix is used to rotate the face image. In this embodiment, the preset angle step is 90 degrees, and the rotation direction is clockwise or counterclockwise.
In the specific rotation process, in order to simplify the amount of calculation data, only the face region defined by the face coordinates may be selected to be rotated, and the peripheral image region other than the face region may not be rotated. At this time, in order to ensure consistency between the rotated image and the input image, it is necessary to first determine whether the face region is rotated when a subsequent registration process is executed; and if the rotation is carried out, rotating the peripheral image area except the human face area in the human face image. The rotation angle of the peripheral image area is equal to the difference value between the current angle of the face area and the angle during input, so that the content of the image subjected to the subsequent registration process is consistent with the content of the input image.
Through the mode, the technical scheme of the application increases the process of angle rotation and re-judgment of the face picture under the condition that the face quality score is unqualified, so that the problem that the quality score is too low to register due to improper angle of the face picture is avoided, and the accuracy of face registration can be improved.
As shown in fig. 2, fig. 2 is a schematic flowchart of another embodiment of a user registration method based on a face image according to the present application. Steps S10-S50 in the flowchart shown in FIG. 2 are the same as steps S10-S50 in the flowchart shown in FIG. 1 and will not be described again here. The flow shown in fig. 2 differs from the flow shown in fig. 1 in that: before step S50, step S60 is further added: and judging whether the rotation times of the face image reach a preset time threshold value or not.
If the number of times threshold is not reached, the flow proceeds to step S50;
if the number threshold is reached, the process proceeds to step S70, and a registration failure message is fed back to prompt the user to re-input the face image. In this embodiment, if the angle step is 90 degrees, the number threshold may be set to three times.
In other embodiments, the specific rotation mode may be set as required, for example, the face image or the face region is rotated by using a larger rotation step length, and the face image or the face region is rotated by using a smaller rotation step length after one rotation. In the case of, for example, setting the rotation step and the rotation range in conjunction with the mass fraction during rotation. Specifically, if the quality score obtained by a certain quality evaluation is smaller than the score threshold but higher than the quality scores obtained in the two previous and subsequent times by a preset difference threshold, the angle range between the angles corresponding to the two previous and subsequent quality scores is used as a rotation range, and the face image or the face region is rotated again within the rotation range by a relatively small rotation step length.
As shown in fig. 3, to solve the above technical problem, another technical solution adopted by the present application is: a user registration server based on a face image is provided. Wherein the user registration server includes:
the acquisition module 10 acquires a face image of a user through an internal or external camera;
and the quality evaluation module 11 is used for performing quality evaluation on the obtained face image to obtain a quality score.
The judging module 12 is configured to judge whether the quality score of the face region image is greater than or equal to a preset score threshold.
And a rotation module 13, configured to rotate the face region image according to a preset angle step and a rotation direction after the determination module determines that the quality score of the face region image is smaller than the score threshold, and return the rotated face image to the quality evaluation module. And rotating the rest parts of the face image except the face area corresponding to the face area image which is greater than or equal to the preset quality score threshold value after a plurality of times of rotation operations.
And the subsequent processing module 14 is configured to execute a subsequent registration process after the determination module determines that the quality score of the face region image is greater than or equal to the preset score threshold.
As shown in fig. 4, to solve the above technical problem, the present application adopts another technical solution: a user registration server 20 based on face images is provided. The apparatus comprises a processor 21 and a memory 22, wherein,
the memory 22 has stored therein a computer program;
the processor 21 is adapted to execute the computer program stored in the memory 22 to implement the steps of the method according to the first embodiment.
In order to solve the above technical problem, the present application adopts another technical solution: there is provided a computer storage medium storing a computer program that when executed performs any of the steps contained in the first embodiment described above.
Referring to fig. 5, fig. 5 is a schematic structural diagram of an embodiment of a storage medium provided in the present application.
The storage medium 40 stores program data which, when executed by a processor, implements the face image-based user registration method as described in fig. 1.
The program data is stored in a storage medium 40 and includes instructions for causing a server or processor to perform all or a portion of the steps of the methods described in the various embodiments of the present application.
Alternatively, the storage medium 40 may be various media that can store program data, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Compared with the prior art, the technical scheme has the advantages that the image is rotated to realize the preprocessing of the forward orientation of the face under the condition that the face in the face image is not in the forward orientation, and then the face recognition processing is carried out, so that the correct registration rate of the face image is improved, and the face image recognition service is finished at higher precision.
In the several embodiments provided in the present application, it should be understood that the disclosed method and apparatus may be implemented in other manners. For example, the above-described device embodiments are merely illustrative, and for example, the division of the modules or units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings, or which are directly or indirectly applied to other related technical fields, are intended to be included within the scope of the present application.
Claims (7)
1. A user registration method based on a face image is characterized by comprising the following steps:
acquiring a face image of a user;
extracting face coordinates from the face image;
performing quality evaluation in a face region defined by the face coordinates to obtain a quality score;
judging whether the quality score is greater than or equal to a preset score threshold value;
if the score is larger than or equal to the score threshold, judging whether the face area rotates; if the face image is rotated, rotating the peripheral image area except the face area in the face image, and then executing a subsequent registration process; wherein the rotation angle of the peripheral image area is equal to the difference between the current angle of the face area and the angle at the time of input;
and if the number of the face areas is smaller than the score threshold, rotating the face areas according to a preset angle step length and a preset rotating direction, and returning to the step of performing quality evaluation in the face areas defined by the face coordinates.
2. The method of claim 1, wherein before the step of rotating the face region according to the preset angle step and the rotation direction, the method further comprises:
judging whether the rotation times of the face area reach a preset time threshold value or not;
if the number of times reaches the threshold value, feeding back registration failure information;
and if the frequency threshold value is not reached, executing the step of rotating the face area according to a preset angle step length and a preset rotating direction.
3. The method of claim 2, wherein the angular step is 90 degrees and the number threshold is 3.
4. The method of claim 1, wherein the step of performing the subsequent registration procedure comprises:
and associating the face image with the identity information of the user and storing the face image in a base library.
5. A user registration server based on a face image, the user registration server comprising:
the acquisition module is used for acquiring a face image of a user;
the quality evaluation module is used for extracting face coordinates from the face image; performing quality evaluation in a face region defined by the face coordinates to obtain a quality score;
the judging module is used for judging whether the quality fraction is greater than or equal to a preset fraction threshold value;
the subsequent processing module is used for judging whether the face area rotates or not after the judging module judges that the quality score is greater than or equal to the score threshold value; if the face image is rotated, rotating the peripheral image area except the face area in the face image, and then executing a subsequent registration process; wherein the rotation angle of the peripheral image area is equal to the difference between the current angle of the face area and the angle at the time of input;
and the rotating module is used for rotating the face region according to a preset angle step length and a rotating direction after the judging module judges that the quality score is smaller than the score threshold value, and returning the rotated face region to the quality evaluation module.
6. A user registration server based on facial images is characterized in that the device comprises a processor and a memory; the memory has stored therein a computer program for execution by the processor to implement the steps of the method according to any one of claims 1-4.
7. A computer storage medium, characterized in that the computer storage medium stores a computer program which, when executed, implements the steps of the method according to any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910960067.2A CN110781473B (en) | 2019-10-10 | 2019-10-10 | Method for recognizing and preprocessing face picture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910960067.2A CN110781473B (en) | 2019-10-10 | 2019-10-10 | Method for recognizing and preprocessing face picture |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110781473A CN110781473A (en) | 2020-02-11 |
| CN110781473B true CN110781473B (en) | 2021-11-16 |
Family
ID=69385031
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910960067.2A Active CN110781473B (en) | 2019-10-10 | 2019-10-10 | Method for recognizing and preprocessing face picture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110781473B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101408929A (en) * | 2007-10-10 | 2009-04-15 | 三星电子株式会社 | Multiple-formwork human face registering method and apparatus for human face recognition system |
| CN103914676A (en) * | 2012-12-30 | 2014-07-09 | 杭州朗和科技有限公司 | Method and apparatus for use in face recognition |
| CN106557729A (en) * | 2015-09-30 | 2017-04-05 | 日本电气株式会社 | For processing the apparatus and method of facial image |
| CN106709886A (en) * | 2017-01-04 | 2017-05-24 | 竹间智能科技（上海）有限公司 | Automatic image retouching method and device |
| CN107958444A (en) * | 2017-12-28 | 2018-04-24 | 江西高创保安服务技术有限公司 | A kind of face super-resolution reconstruction method based on deep learning |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110026818A1 (en) * | 2009-07-30 | 2011-02-03 | Jonathan Yen | System and method for correction of backlit face images |
| CN108875471A (en) * | 2017-06-19 | 2018-11-23 | 北京旷视科技有限公司 | The method, apparatus and computer storage medium of facial image bottom library registration |
| CN109359508A (en) * | 2018-08-27 | 2019-02-19 | 贵阳朗玛信息技术股份有限公司 | A kind of head portrait processing method and processing device |
| CN109523271A (en) * | 2018-12-28 | 2019-03-26 | 上海汇付数据服务有限公司 | Face payment system and method |
-
2019
- 2019-10-10 CN CN201910960067.2A patent/CN110781473B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101408929A (en) * | 2007-10-10 | 2009-04-15 | 三星电子株式会社 | Multiple-formwork human face registering method and apparatus for human face recognition system |
| CN103914676A (en) * | 2012-12-30 | 2014-07-09 | 杭州朗和科技有限公司 | Method and apparatus for use in face recognition |
| CN106557729A (en) * | 2015-09-30 | 2017-04-05 | 日本电气株式会社 | For processing the apparatus and method of facial image |
| CN106709886A (en) * | 2017-01-04 | 2017-05-24 | 竹间智能科技（上海）有限公司 | Automatic image retouching method and device |
| CN107958444A (en) * | 2017-12-28 | 2018-04-24 | 江西高创保安服务技术有限公司 | A kind of face super-resolution reconstruction method based on deep learning |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110781473A (en) | 2020-02-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10635890B2 (en) | Facial recognition method and apparatus, electronic device, and storage medium | |
| US20200160040A1 (en) | Three-dimensional living-body face detection method, face authentication recognition method, and apparatuses | |
| CN109948408B (en) | Activity test method and apparatus | |
| US20200410074A1 (en) | Identity authentication method and apparatus, electronic device, and storage medium | |
| WO2018137623A1 (en) | Image processing method and apparatus, and electronic device | |
| WO2018086543A1 (en) | Living body identification method, identity authentication method, terminal, server and storage medium | |
| US20060056664A1 (en) | Security system | |
| CN108932456B (en) | Face recognition method, device and system and storage medium | |
| WO2019033574A1 (en) | Electronic device, dynamic video face recognition method and system, and storage medium | |
| WO2021051547A1 (en) | Violent behavior detection method and system | |
| CN111008935B (en) | Face image enhancement method, device, system and storage medium | |
| JP2016062253A (en) | Object identification apparatus, object identification method, and program | |
| JP6071002B2 (en) | Reliability acquisition device, reliability acquisition method, and reliability acquisition program | |
| US11373449B1 (en) | Systems and methods for passive-subject liveness verification in digital media | |
| WO2019200872A1 (en) | Authentication method and apparatus, and electronic device, computer program, and storage medium | |
| US11961329B2 (en) | Iris authentication device, iris authentication method and recording medium | |
| US20060120578A1 (en) | Minutiae matching | |
| CN110991231B (en) | Living body detection method and device, server and face recognition equipment | |
| CN109635021A (en) | A kind of data information input method, device and equipment based on human testing | |
| CN112036284B (en) | Image processing method, device, equipment and storage medium | |
| CN106980818B (en) | Personalized preprocessing method, system and terminal for face image | |
| CN110781473B (en) | Method for recognizing and preprocessing face picture | |
| Amjed et al. | Noncircular iris segmentation based on weighted adaptive hough transform using smartphone database | |
| CN110458024B (en) | Living body detection method and device and electronic equipment | |
| TWI796063B (en) | Liveness detection method and system threrof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |