WO2019128362A1

WO2019128362A1 - Human facial recognition method, apparatus and system, and medium

Info

Publication number: WO2019128362A1
Application number: PCT/CN2018/108994
Authority: WO
Inventors: 冯玉娜
Original assignee: 北京京东尚科信息技术有限公司; 北京京东世纪贸易有限公司
Priority date: 2017-12-28
Filing date: 2018-09-30
Publication date: 2019-07-04
Also published as: CN109977741A

Abstract

Provided are a human facial recognition method. The method comprises: acquiring a human facial image, and performing human facial recognition according to a light source environment where the human facial image is collected. The performing of human facial recognition according to a light source environment where the human facial image is collected specifically comprises: where the light source environment where the human facial image is collected is visible light, performing comparison and recognition on the human facial image and a human facial image registered under a visible light condition; or where the light source environment where the human facial image is collected is near-infrared light, performing comparison and recognition on the human facial image and a human facial image registered under a near-infrared light condition. Further provided are a human facial recognition apparatus and system, and a medium.

Description

Face recognition method, device, system and medium

Technical field

The present disclosure relates to the field of Internet technologies, and in particular, to a face recognition method, apparatus, system, and medium.

Background technique

Face recognition has always been a hot research in the field of biometrics. Visible face recognition is easily affected by external lighting conditions, which may result in inaccurate face recognition. Although the near-infrared technology is not affected by the influence of ambient light, the application of the device is limited, and the recognition method is contrary to people's daily life habits. In the prior art, there are some recognition methods combining visible light recognition and near-infrared light recognition, mainly including a visible-near-infrared face recognition method based on face synthesis, and a visible-near-infrared face recognition method based on unified subspace. And a visible-near-infrared face recognition method based on invariant features,

In the process of implementing the inventive concept, the inventors have found that at least the following problems exist in the prior art: in the prior art, the recognition method combining visible light recognition and near-infrared recognition is generally a face obtained under registration of a light source condition. Library. When identifying the authentication, when the face image is collected, the light source environment at the time of the acquisition is inconsistent with the registration time, and the collected face image processing needs to be converted and compared, and the essence is the face recognition under the different quality light sources.

Summary of the invention

In view of this, the present disclosure provides a face recognition method, apparatus, system, and medium that can achieve face image comparison under a homogeneous light source.

One aspect of the present disclosure provides a face recognition method. The method includes acquiring a face image and performing face recognition according to a light source environment in which the face image is collected. Performing face recognition according to the light source environment in which the face image is collected specifically includes: when the light source environment in which the face image is collected is visible light, the face image is in visible light condition The registered face map is compared and recognized; or, in the case where the light source environment in which the face image is collected is near-infrared light, the face image and the face map registered under the near-infrared light condition are registered. Perform alignment recognition.

According to an embodiment of the present disclosure, the method further includes determining whether the light source environment in which the face image is acquired is visible light or near-infrared light.

According to an embodiment of the present disclosure, acquiring a face image specifically includes acquiring a complete image frame including a face and a background environment, acquiring a face region from the complete image frame, and extracting the face image from the face region. . Determining whether the light source environment in which the face image is collected is visible light or near-infrared light, including graying out the complete image frame, obtaining a gray image frame, and judging according to the distribution of gray scales in the gray image frame The light source environment in which the face image is acquired is visible light or near-infrared light.

According to an embodiment of the present disclosure, determining, according to the distribution of gray scales in the grayscale image frame, whether the light source environment in which the face image is captured is visible light or near-infrared light includes the following operation process; calculating the grayscale image frame a first pixel number of the gray scale value in the initial closed interval, wherein one end point of the initial closed interval is a gray level minimum value of the gray image frame, and the other end point is the gray level minimum value And adding a preset value; calculating a second pixel number of the grayscale value in the grayscale image frame in the termination closed interval, wherein one end point of the termination closed interval is a grayscale maximum value of the grayscale image frame Subtracting the preset value, another endpoint is the grayscale maximum value; calculating a grayscale average value of the region other than the face region in the grayscale image frame; when the first pixel number is greater than When the second pixel number is less than the preset grayscale mean value, determining that the light source environment in which the face image is collected is near-infrared light; otherwise, determining that the face image is collected is The light source environment is visible light

According to an embodiment of the present disclosure, the preset value includes 15.

According to an embodiment of the present disclosure, the preset grayscale mean comprises 140.

According to an embodiment of the present disclosure, the method further includes separately registering the face map under visible light conditions and near-infrared light conditions.

Another aspect of the present disclosure provides a face recognition device. The device includes an acquisition module and an identification module. The acquisition module is used to acquire a face image. The identification module is configured to perform face recognition according to a light source environment in which the face image is collected. The identification module is specifically configured to compare the face image with a face image registered under visible light conditions when the light source environment in which the face image is collected is visible light; or, in the collection center In the case where the light source environment in which the face image is located is near-infrared light, the face image is compared with the face map registered under the near-infrared light condition.

According to an embodiment of the present disclosure, the apparatus further includes a light source determination module. The light source determining module is configured to determine whether the light source environment in which the face image is collected is visible light or near-infrared light.

According to an embodiment of the present disclosure, the acquisition module includes a complete image frame acquisition sub-module, a face region acquisition sub-module, and a face image extraction sub-module. The complete image frame acquisition sub-module is used to acquire a complete image frame including a face and a background environment. The face region acquisition sub-module is configured to acquire a face region from the complete image frame. a face image extraction sub-module for extracting the face image from the face region. The light source judging module includes a grayscale submodule and a light source judging submodule. Wherein, the grayscale sub-module is used to grayscale the complete image frame to obtain a grayscale image frame. The light source determining sub-module is configured to determine, according to the distribution of gray scales in the grayscale image frame, whether the light source environment in which the face image is collected is visible light or near-infrared light.

According to an embodiment of the present disclosure, determining, according to the distribution of gray scales in the grayscale image frame, whether the light source environment in which the face image is captured is visible light or near-infrared light comprises: calculating gray in the grayscale image frame a first number of pixels in the initial closed interval, wherein one end of the initial closed interval is a grayscale minimum of the grayscale image frame, and the other endpoint is the grayscale minimum plus a preset value; calculating a second pixel number of the grayscale value in the grayscale image frame in the termination closed interval, wherein one end point of the termination closed interval is a grayscale maximum value of the grayscale image frame minus The preset value, another endpoint is the grayscale maximum value; calculating a grayscale average value in the region other than the face region in the grayscale image frame; and when the first pixel number is greater than When the second pixel number is less than the preset grayscale mean value, determining that the light source environment in which the face image is collected is near-infrared light, otherwise determining the location where the face image is collected The light source environment is visible light.

According to an embodiment of the present disclosure, the apparatus further includes a registration module. The registration module is configured to separately register a face map under visible light conditions and near-infrared light conditions.

Another aspect of the present disclosure provides a system for face recognition including one or more processors, and a memory. The memory is used to store one or more programs. Wherein, when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the methods described above.

Another aspect of the present disclosure provides a computer readable medium having stored thereon executable instructions that, when executed by a processor, cause a processor to implement the methods described above.

Another aspect of the disclosure provides a computer program comprising computer executable instructions that, when executed, are used to implement a method as described above.

According to the embodiment of the present disclosure, the recognition error caused by the excessive difference of the face image under different quality light sources can be at least partially avoided, and thus the face recognition of the person under the homogenous light source can be realized, thereby improving the accuracy of the face recognition. Technical effect.

DRAWINGS

The above and other objects, features and advantages of the present disclosure will become more apparent from

FIG. 1 schematically illustrates an exemplary architecture of a face recognition method and apparatus according to an embodiment of the present disclosure;

FIG. 2 schematically shows a flowchart of a face recognition method according to an embodiment of the present disclosure; FIG.

FIG. 3 schematically shows a flowchart of a face recognition method according to another embodiment of the present disclosure; FIG.

FIG. 4 schematically shows a flowchart of a face recognition method according to still another embodiment of the present disclosure; FIG.

5A and 5B respectively schematically illustrate gray scale distributions in grayscale image frames corresponding to images acquired in visible light and near-infrared light environments;

FIG. 6 is a flow chart schematically illustrating determining a light source environment when a face image is acquired according to a gray scale distribution according to another embodiment of the present disclosure; FIG.

FIG. 7 is a schematic diagram showing an application scenario of a face recognition method according to various embodiments of the present disclosure; FIG.

FIG. 8 is a block diagram schematically showing a face recognition device according to an embodiment of the present disclosure;

FIG. 9 schematically illustrates a block diagram of a computer system suitable for implementing a robot in accordance with an embodiment of the present disclosure.

Detailed ways

Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. It should be understood, however, that the description is only illustrative, and is not intended to limit the scope of the disclosure. In addition, descriptions of well-known structures and techniques are omitted in the following description in order to avoid unnecessarily obscuring the concept of the present disclosure.

The terminology used herein is for the purpose of describing the particular embodiments, The use of the terms "comprising", "comprising" or "an"

All terms (including technical and scientific terms) used herein have the meaning commonly understood by one of ordinary skill in the art, unless otherwise defined. It should be noted that the terms used herein are to be interpreted as having a meaning consistent with the context of the present specification and should not be interpreted in an ideal or too rigid manner.

Where an expression similar to "at least one of A, B, and C, etc." is used, it should generally be interpreted in accordance with the meaning of the expression as commonly understood by those skilled in the art (for example, "having A, B, and C" "Systems of at least one of" shall include, but are not limited to, systems having A alone, B alone, C alone, A and B, A and C, B and C, and/or A, B, C, etc. ). Where an expression similar to "at least one of A, B or C, etc." is used, it should generally be interpreted according to the meaning of the expression as commonly understood by those skilled in the art (for example, "having A, B or C" "Systems of at least one of" shall include, but are not limited to, systems having A alone, B alone, C alone, A and B, A and C, B and C, and/or A, B, C, etc. ). Those skilled in the art will also appreciate that transitional conjunctions and/or phrases that are arbitrarily arbitrarily representing two or more optional items, whether in the specification, claims, or drawings, are to be construed as The possibility of one of the projects, either or both of these projects. For example, the phrase "A or B" should be understood to include the possibility of "A" or "B", or "A and B."

Embodiments of the present disclosure provide a face recognition method, apparatus, system, and medium. The method includes acquiring a face image and performing face recognition according to a light source environment in which the face image is collected. Performing face recognition according to the light source environment in which the face image is collected specifically includes: when the light source environment in which the face image is collected is visible light, the face image is registered with the person under visible light conditions The face image is compared and recognized; or, when the light source environment in which the face image is collected is near-infrared light, the face image is compared with the face image registered under the near-infrared light condition.

FIG. 1 schematically illustrates an exemplary architecture 100 of a face recognition method and apparatus in accordance with an embodiment of the present disclosure. It should be noted that FIG. 1 is only an example of a system architecture to which the embodiments of the present disclosure may be applied, to help those skilled in the art understand the technical content of the present disclosure, but does not mean that the embodiments of the present disclosure may not be used for other Device, system, environment, or scenario.

As shown in FIG. 1, the system architecture 100 according to this embodiment may include a camera 101, a network 102, and a server 103. The network 102 is used to provide a medium for communication links between the camera 101 and the server 103. Network 102 can include a variety of connection types, such as wired, wireless communication links, fiber optic cables, and the like.

The camera 101 can collect a face image and transmit the obtained face image to the server 103 via the network 102.

The server 103 may be a server that provides various services, such as processing for analyzing data such as receiving a face image.

In other embodiments, the terminal device 104 may also be included in the system architecture 100. A face image collected by the camera 101 or other cameras can be stored in the terminal device 104. And, the terminal device 104 can transmit the face image stored therein to the server 105 through the network 102 according to the user's operation, to request the server 105 to perform the identification authentication. The server 105 can process according to the user request and feed back the processing result to the terminal device 104.

The terminal device 104 can be a variety of electronic devices having a display screen and supporting web browsing, including but not limited to smartphones, tablets, laptop portable computers, desktop computers, and the like.

In some embodiments, the terminal device 104 and the camera 101 can be combined or the camera 101 can be an integral part of the terminal device 104.

It should be noted that the face recognition method provided by the embodiment of the present disclosure may be generally performed by the server 103. Correspondingly, the face recognition device provided by the embodiment of the present disclosure may be generally disposed in the server 103. The face recognition method provided by the embodiments of the present disclosure may also be performed by a server or server cluster different from the server 103 and capable of communicating with the server 103. Correspondingly, the face recognition device provided by the embodiment of the present disclosure may also be disposed in a server or server cluster different from the server 103 and capable of communicating with the server 103.

It should be understood that the number of terminal devices, networks, and servers in Figure 1 is merely illustrative. Depending on the implementation needs, there can be any number of terminal devices, networks, and servers.

FIG. 2 schematically illustrates a flow chart of a face recognition method in accordance with an embodiment of the present disclosure.

As shown in FIG. 2, according to an embodiment of the present disclosure, the face recognition method includes an operation S210 and an operation S220.

In operation S210, a face image is acquired.

In some embodiments, a face image acquired by the camera in real time can be acquired. In some embodiments, the face image acquired by the camera acquisition can be obtained from a network or other image storage location or the like.

In operation S220, face recognition is performed according to the light source environment in which the face image is collected.

Specifically, the operation S220 performs face recognition according to the light source environment in which the face image is collected, and includes: when the light source environment where the face image is collected is visible light, the face image and the visible light condition The registered face image is compared and recognized; or, when the light source environment in which the face image is collected is near-infrared light, the face image and the face map registered under the near-infrared light condition are performed. Alignment identification.

According to an embodiment of the present disclosure, when performing face recognition, face recognition under a homogenous light source may be performed according to a light source environment in which the face image is collected, and the face image to be recognized is homogenous with the face database. The face maps under the light source are compared, and the recognition error caused by the excessive difference of the face images under different quality light sources is avoided to some extent, and the accuracy of face recognition is improved.

FIG. 3 schematically shows a flowchart of a face recognition method according to another embodiment of the present disclosure.

As shown in FIG. 3, according to another embodiment of the present disclosure, the face recognition method further includes an operation S310 in addition to the operations S210 and S220. The operation S310 may be before the operation S220, or the operation S310 may be performed in parallel with the operation S220.

In operation S310, it is determined whether the light source environment in which the face image is collected is visible light or near-infrared light.

According to the embodiment of the present disclosure, the light source environment in which the face image is collected may be determined, so that the face image to be recognized may be compared with the face image under the homogenous light source in the face database to achieve homogeneity. Face recognition under the light source.

FIG. 4 schematically illustrates a flow chart of a face recognition method according to still another embodiment of the present disclosure.

As shown in FIG. 4, according to still another embodiment of the present disclosure, the face recognition method includes an operation S210, an operation S310, and an operation S220. The operation S210 includes operations S211 to S213, and operation S310 includes operations S311 and S312.

Specifically, acquiring the face image in operation S210 may include operations S211 to S213.

In operation S211, a complete image frame including a face and a background environment is acquired.

In some embodiments, a full image frame containing the background environment surrounding the face and face is acquired in real time by the camera. For example, when the face is collected by the camera in real time, the dedicated camera may be fixed to a complete image frame containing the face collected in a direction of 0.5 degrees upward from the shooting face level of 0.5 m-0.8 m. In other embodiments, a complete image frame containing a human face captured by the camera can be obtained from other locations, such as the network.

A face area is acquired from the complete image frame in operation S212.

For example, the face detection is performed using the Adaboost algorithm to obtain a face region.

The face image is extracted from the face region in operation S213.

For example, the face image is extracted from a face region using the Adaboost algorithm.

Specifically, operation S310 determines whether the light source environment in which the face image is collected is visible light or near-infrared light, and may include operations S311 and S312.

In operation S311, the complete image frame is grayed out to obtain a grayscale image frame.

In operation S312, it is determined whether the light source environment when collecting the face image is visible light or near-infrared light according to the distribution of gray scales in the grayscale image frame.

5A and 5B schematically illustrate gray scale distributions in grayscale image frames corresponding to images acquired in visible light and near-infrared light environments, respectively. FIG. 5A shows the gray scale distribution in the grayscale image frame obtained by the grayscale processing of the complete image frame acquired by the visible light source according to the experiment. FIG. 5B shows the gray scale distribution in the grayscale image frame obtained by the grayscale processing of the complete image frame acquired by the near-infrared light source obtained according to the experiment.

Gray _begin refers to the grayscale minimum in the grayscale image frame. Gray _end refers to the grayscale maximum in the grayscale image frame.

5A and 5B illustrate the number of pixels corresponding to respective grayscale values in the range of the minimum value to the maximum value of the grayscale value in the grayscale image frame.

For example, the grayscale image frame can be scanned line by line, and the number of pixels corresponding to each grayscale value is counted, for example, labeled as N0, N1, ..., N255, and the minimum grayscale value of the mark is Gray _begin , and the grayscale of the maximum is terminated. The value is Gray _end .

It can be seen from the comparison that there is a significant difference in the gray scale distribution in the gray image frame obtained by the complete image frame acquired under the visible light source and the complete image frame acquired under the near-infrared light source.

The grayscale image frame obtained by the complete image frame acquired under the visible light source has a grayscale value near the Gray _end . The grayscale image of the gray image frame obtained by the complete image frame acquired under the near-infrared light source has a larger number of pixels near the gray _begin .

FIG. 6 is a flow chart schematically showing a light source environment when a face image is acquired according to a gray scale distribution in operation S312 according to another embodiment of the present disclosure.

As shown in FIG. 6, operation S312 includes operations S3121 to S3124.

In operation S3121, calculating a first pixel number of the grayscale value in the initial closed interval in the grayscale image frame, wherein one end point of the initial closed interval is a grayscale minimum value of the grayscale image frame, and the other The endpoint is the grayscale minimum plus a preset value.

For example, calculate the number of pixels of the grayscale value in the [Gray _begin , Gray _begin + preset value] interval, and record it as P ₀ .

In operation S3122, calculating a second pixel number of the grayscale value in the grayout image frame in the termination closed interval, wherein an endpoint of the termination closed interval is a grayscale maximum value of the grayscale image frame minus the preset The value, the other endpoint is the grayscale maximum.

For example, calculate the number of pixels of the grayscale value in the [Gray _end - Preset, Gray _end ] interval, and record it as P ₁ .

In operation S3123, a grayscale average value of the region other than the face region in the grayscale image frame is calculated, for example, marked as Gray _Ave.

In operation S3124, when the first pixel number is greater than the second pixel number, and the grayscale average value is less than the preset grayscale mean value, determining that the light source environment in which the face image is collected is near-infrared light; otherwise, determining The light source environment in which the face image is acquired is visible light.

That is, if there is P ₀ >P ₁ and Gray _Ave <preset gray scale mean, it is judged that the face image is collected, and the light source environment is near-infrared light. Otherwise, the light source environment in which the face image is acquired is visible light.

According to an embodiment of the present disclosure, the preset value includes 15. It will be appreciated that the preset values may vary in particular different embodiments.

According to the experimental verification, when the preset value is 15, P ₀ is the number of pixels in the interval [Gray _begin , Gray _begin +15], and P ₁ is the pixel in the interval [Gray _end -15, Gray _end ]. When judging whether the gray scale distribution in the gray image frame satisfies P ₀ >P ₁ and Gray _Ave <140, it is determined whether the light source environment for collecting the face image is near-infrared light has a high accuracy.

The method according to various embodiments of the present disclosure will be described in detail below in conjunction with an exemplary embodiment of FIG.

FIG. 7 schematically illustrates an application scenario diagram of a face recognition method according to various embodiments of the present disclosure.

The specific application scenario may be as shown in FIG. 7, and the face image may be acquired in operation S210.

For example, a complete image frame containing a face may be acquired by a dedicated camera in operation S211, and the type of the light source that collects the face image is unknown at this time. Next, the face area obtained by the Adaboost face detection is performed on the complete image frame in operation S212. The face image is then extracted from the face region in operation S213.

Then, it can be determined by operation S310 whether the light source environment in which the face image is collected is visible light or near-infrared light.

Specifically, the complete image frame is grayed out in operation S311 to obtain a corresponding grayscale image frame. Then, the amount of pixels corresponding to each grayscale value in the grayscale image frame may be scanned line by line, for example, labeled as N0, N1, ..., N255, respectively, and the minimum grayscale value of the marker is Gray _begin , and the grayscale of the termination is maximum. The value is Gray _end (for example, assume Gray _begin = 10, Gray _end = 240). Also, for example, according to an embodiment of the present disclosure, the preset value may take a value of 15, and the preset grayscale mean may take a value of 140.

The number of pixels of the grayscale value in the interval [10, 25] is calculated in operation S312 P ₀ = N10 + N11 + ... + N25.

The number of pixels of the grayscale value in the range of the interval [225, 240] is calculated in operation S313 P ₁ = N225 + N226 + ... + N240.

In operation S313, the gradation mean Gray _{Ave of the} region other than the face region in the grayscale image frame is calculated.

It is then determined in operation S314 whether P0, P1, and Gray _Ave are satisfied: P0 > P1 and Gray _Ave < 140. If it is satisfied, it is determined that the light source environment when the face image is acquired is near-infrared light, otherwise it is visible light.

Finally, in operation S220, face recognition is performed according to the light source environment in which the face image is collected. The feature extraction is performed on the face image obtained in operation S210, and compared with the face map under the homogeneous light source type, and the consistency between the light source condition at the time of registration and the light source environment at the time of authentication is realized.

According to an embodiment of the present disclosure, the face recognition method further includes separately registering a face map under visible light conditions and near-infrared light conditions. By registering at the same time, the consistency of the face map (including the expression, the position of the acquired position, etc.) obtained by registration under visible light and near-infrared conditions can be ensured, and the error caused by the recognition process due to the difference of the registered image can be reduced.

FIG. 8 schematically shows a block diagram of a face recognition device in accordance with an embodiment of the present disclosure.

As shown in FIG. 8, device 800 includes an acquisition module 810 and an identification module 820.

The obtaining module 810 is configured to acquire a face image.

The identification module 820 is configured to perform face recognition according to a light source environment in which the face image is collected. The identification module 820 is specifically configured to compare the face image with a face image registered under visible light conditions when the light source environment in which the face image is collected is visible light; or, collect the person In the case where the light source environment in which the face image is located is near-infrared light, the face image is compared with the face map registered under the near-infrared light condition.

According to an embodiment of the present disclosure, the apparatus further includes a light source determination module 830.

The light source determining module 830 is configured to determine whether the light source environment in which the face image is collected is visible light or near-infrared light.

According to an embodiment of the present disclosure, the acquisition module 810 includes a full image frame acquisition sub-module 811, a face region acquisition sub-module 812, and a face image extraction sub-module 813.

The complete image frame acquisition sub-module 811 is used to acquire a complete image frame including a face and a background environment.

The face region acquisition sub-module 812 is configured to acquire a face region from the complete image frame.

The face image extraction sub-module 813 is configured to extract the face image from the face region.

According to an embodiment of the present disclosure, the light source determination mode 830 includes a grayscale sub-module 831 and a light source determination sub-module 832.

The grayscale sub-module 831 is used to grayscale the complete image frame to obtain a grayscale image frame.

The light source determining sub-module 832 is configured to determine, according to the distribution of gray scales in the grayscale image frame, whether the light source environment in which the face image is collected is visible light or near-infrared.

According to an embodiment of the present disclosure, determining, according to the distribution of gray scales in the grayscale image frame, whether the light source environment in which the face image is captured is visible light or near infrared, including: calculating a grayscale value in the grayscale image frame. a first number of pixels in the initial closed interval, wherein one end of the initial closed interval is a gray level minimum of the gray image frame, and the other end point is the gray level minimum plus a preset value; The second pixel number of the grayscale value in the ending closed interval, wherein one end point of the termination closed interval is the grayscale maximum value of the grayscale image frame minus the preset value, and the other endpoint is the a grayscale maximum value; calculating a grayscale average value of the region other than the face region in the grayscale image frame; and when the first pixel number is greater than the second pixel number, and the grayscale average value is less than a preset grayscale In the mean value, it is judged that the light source environment in which the face image is collected is near-infrared light, otherwise the light source environment in which the face image is collected is visible light.

According to an embodiment of the present disclosure, the preset value includes 15. According to an embodiment of the present disclosure, the preset grayscale mean comprises 140.

According to an embodiment of the present disclosure, the apparatus further includes a registration module 840. The registration module 840 is configured to separately register a face map under visible light conditions and near-infrared light conditions.

According to an embodiment of the present disclosure, the apparatus 800 may be used to implement the face recognition method described with reference to FIGS. 2 to 7.

It is to be understood that any of the modules, sub-modules, units, sub-units, or at least some of the functions of any of the plurality of the embodiments of the present disclosure may be implemented in one module. Any one or more of the modules, sub-modules, units, sub-units according to an embodiment of the present disclosure may be implemented by being split into a plurality of modules. Any one or more of the modules, sub-modules, units, sub-units in accordance with embodiments of the present disclosure may be implemented at least in part as hardware circuitry, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), System-on-a-chip, system on a substrate, system on a package, an application specific integrated circuit (ASIC), or any other reasonable means of hardware or firmware that integrates or encapsulates the circuit, or in software, hardware, and firmware. Any one of the implementations or in any suitable combination of any of them. Alternatively, one or more of the modules, sub-modules, units, sub-units in accordance with embodiments of the present disclosure may be implemented at least in part as a computer program module that, when executed, can perform the corresponding functions.

For example, the obtaining module 810, the identifying module 820, the light source determining module 830, the registration module 840, the complete image frame obtaining sub-module 811, the face region obtaining sub-module 812, the face image extracting sub-module 813, the graying sub-module 831, and The light source determination sub-module 832 can be implemented in one module, or any one of the modules can be split into multiple modules. Alternatively, at least some of the functionality of one or more of the modules may be combined with at least some of the functionality of the other modules and implemented in one module. According to an embodiment of the present invention, the obtaining module 810, the identifying module 820, the light source determining module 830, the registration module 840, the complete image frame obtaining sub-module 811, the face region obtaining sub-module 812, the face image extracting sub-module 813, and the grayscale At least one of the sub-module 831 and the light source determination sub-module 832 can be implemented at least in part as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, A system, an application specific integrated circuit (ASIC) on the package, or hardware or firmware in any other reasonable manner to integrate or package the circuit, or in a suitable combination of software, hardware, and firmware implementations. . Alternatively, the obtaining module 810, the identifying module 820, the light source determining module 830, the registration module 840, the complete image frame obtaining sub-module 811, the face region obtaining sub-module 812, the face image extracting sub-module 813, the graying sub-module 831, and At least one of the light source determination sub-modules 832 may be implemented at least in part as a computer program module that, when executed by the computer, may perform the functions of the respective modules.

FIG. 9 schematically illustrates a block diagram of a computer system suitable for implementing a robot in accordance with an embodiment of the present disclosure. The computer system shown in FIG. 9 is merely an example and should not impose any limitation on the function and scope of use of the embodiments of the present disclosure.

As shown in FIG. 9, a computer system 900 in accordance with an embodiment of the present disclosure includes a processor 901 that can be loaded into a random access memory (RAM) 903 according to a program stored in a read only memory (ROM) 902 or from a storage portion 908. The program performs various appropriate actions and processes. Processor 901 may, for example, comprise a general purpose microprocessor (e.g., a CPU), an instruction set processor, and/or a related chipset and/or a special purpose microprocessor (e.g., an application specific integrated circuit (ASIC)), and the like. Processor 901 may also include an onboard memory for caching purposes. The processor 901 may include a single processing unit or a plurality of processing units for performing different actions of the method flow according to the embodiments of the present disclosure described with reference to FIGS. 2-7.

In the RAM 903, various programs and data required for the operation of the system 900 are stored. The processor 901, the ROM 902, and the RAM 903 are connected to each other through a bus 904. The processor 901 performs various operations of the face recognition method described above with reference to FIGS. 2 to 7 by executing programs in the ROM 902 and/or the RAM 903. It is noted that the program can also be stored in one or more memories other than the ROM 902 and the RAM 903. The processor 901 can also perform various operations of the face recognition method described above with reference to FIGS. 2 to 7 by executing a program stored in the one or more memories.

System 900 may also include an input/output (I/O) interface 905 to which an input/output (I/O) interface 905 is also coupled, in accordance with an embodiment of the present disclosure. System 900 can also include one or more of the following components coupled to I/O interface 905: an input portion 906 including a keyboard, mouse, etc.; including, for example, a cathode ray tube (CRT), a liquid crystal display (LCD), and the like, and a speaker An output portion 907 of the like; a storage portion 908 including a hard disk or the like; and a communication portion 909 including a network interface card such as a LAN card, a modem, and the like. The communication section 909 performs communication processing via a network such as the Internet. Driver 610 is also coupled to I/O interface 905 as needed. A removable medium 911 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory or the like is mounted on the drive 910 as needed so that a computer program read therefrom is installed into the storage portion 908 as needed.

According to an embodiment of the present disclosure, the method described above with reference to the flowcharts may be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for executing the method illustrated in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication portion 909, and/or installed from the removable medium 911. The above-described functions defined in the system of the embodiments of the present disclosure are executed when the computer program is executed by the processor 901. The systems, devices, devices, modules, units, and the like described above may be implemented by a computer program module in accordance with an embodiment of the present disclosure.

It should be noted that the computer readable medium shown in the present disclosure may be a computer readable signal medium or a computer readable storage medium or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of computer readable storage media may include, but are not limited to, electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable Programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain or store a program, which can be used by or in connection with an instruction execution system, apparatus, or device. While in the present disclosure, a computer readable signal medium may include a data signal that is propagated in the baseband or as part of a carrier, carrying computer readable program code. Such propagated data signals can take a variety of forms including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer readable signal medium can also be any computer readable medium other than a computer readable storage medium, which can transmit, propagate, or transport a program for use by or in connection with the instruction execution system, apparatus, or device. . Program code embodied on a computer readable medium can be transmitted by any suitable medium, including but not limited to wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing. According to an embodiment of the present disclosure, the computer readable medium may include one or more memories other than the ROM 902 and/or the RAM 903 and/or the ROM 902 and the RAM 903 described above.

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products in accordance with various embodiments of the present disclosure. In this regard, each block of the flowchart or block diagrams can represent a module, a program segment, or a portion of code that includes one or more Executable instructions. It should also be noted that in some alternative implementations, the functions noted in the blocks may also occur in a different order than that illustrated in the drawings. For example, two successively represented blocks may in fact be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams or flowcharts, and combinations of blocks in the block diagrams or flowcharts, can be implemented by a dedicated hardware-based system that performs the specified function or operation, or can be used A combination of dedicated hardware and computer instructions is implemented.

In another aspect, the present disclosure also provides a computer readable medium, which may be included in the apparatus described in the above embodiments, or may be separately present and not incorporated into the apparatus. The computer readable medium described above carries one or more programs that, when executed by one of the devices, cause the device to perform a face recognition method in accordance with an embodiment of the present disclosure.

The method includes acquiring a face image and performing face recognition according to a light source environment in which the face image is collected. Performing face recognition according to the light source environment in which the face image is collected specifically includes: when the light source environment in which the face image is collected is visible light, the face image is registered with the person under visible light conditions The face image is compared and recognized; or, when the light source environment in which the face image is collected is near-infrared light, the face image is compared with the face image registered under the near-infrared light condition.

According to an embodiment of the present disclosure, acquiring the face image specifically includes acquiring a complete image frame including a face and a background environment, acquiring a face region from the complete image frame, and extracting the face image from the face region. Determining whether the light source environment in which the face image is collected is visible light or near-infrared light, including graying out the complete image frame, obtaining a gray image frame, and determining the person according to the gray scale distribution in the gray image frame The light source environment in which the face image is located is visible light or near-infrared light.

According to an embodiment of the present disclosure, determining, according to the distribution of gray scales in the grayscale image frame, whether the light source environment in which the face image is captured is visible light or near-infrared light includes a plurality of operation processes; calculating grayscale in the grayscale image frame The first pixel number of the order value in the initial closed interval, wherein one end point of the initial closed interval is the gray level minimum value of the gray image frame, and the other end point is the gray level minimum value plus a preset value Calculating a second pixel number of the grayscale value in the grayscale image frame in the termination closed interval, wherein an endpoint of the termination closed interval is a grayscale maximum value of the grayscale image frame minus the preset value, and An endpoint is the grayscale maximum; calculating a grayscale average of the region of the grayscale image frame other than the face region; when the first pixel number is greater than the second pixel number, and the grayscale average is less than When the gray level mean value is set, it is judged that the light source environment in which the face image is collected is near-infrared light; otherwise, the light source environment in which the face image is collected is visible light.

The embodiments of the present disclosure have been described above. However, the examples are for illustrative purposes only and are not intended to limit the scope of the disclosure. Although the various embodiments have been described above, this does not mean that the measures in the various embodiments are not advantageously used in combination. The scope of the disclosure is defined by the appended claims and their equivalents. Numerous alternatives and modifications may be made by those skilled in the art without departing from the scope of the present disclosure.

Claims

A face recognition method includes:

Obtaining a face image;

The face recognition is performed according to the light source environment in which the face image is collected, including:

In the case where the light source environment in which the face image is collected is visible light, the face image is compared and recognized with a face map registered under visible light conditions; or

In the case where the light source environment in which the face image is collected is near-infrared light, the face image is compared with the face map registered under the near-infrared light condition.
The method of claim 1 further comprising:

It is judged whether the light source environment in which the face image is collected is visible light or near-infrared light.
The method of claim 2 wherein:

Get face images, including:

Get a complete image frame including the face and background environment;

Obtaining a face region from the complete image frame;

Extracting the face image from the face region;

Determining whether the light source environment in which the face image is collected is visible light or near-infrared light, including:

Grayscale the complete image frame to obtain a grayscale image frame;

Determining, according to the distribution of gray scales in the grayscale image frame, whether the light source environment in which the face image is collected is visible light or near-infrared light.
The method according to claim 3, wherein determining whether the light source environment in which the face image is captured is visible light or near-infrared light according to a distribution of gray scales in the grayscale image frame comprises:

Calculating a first pixel number of the grayscale value in the initial closed interval in the grayscale image frame, wherein one end point of the initial closed interval is a grayscale minimum value of the grayscale image frame, and the other end point Adding a preset value to the grayscale minimum value;

Calculating a second pixel number of the grayscale value in the grayscale image frame in the termination closed interval, wherein one end point of the termination closed interval is a grayscale maximum value of the grayscale image frame minus the preset Value, the other endpoint is the grayscale maximum;

Calculating a grayscale average value of the region other than the face region in the grayscale image frame;

When the first pixel number is greater than the second pixel number, and the grayscale average value is less than the preset grayscale mean value, determining that the light source environment in which the face image is collected is near-infrared light; otherwise, determining the collection The light source environment in which the face image is located is visible light.
The method of claim 4 wherein said predetermined value comprises 15.
The method of claim 4 wherein said predetermined grayscale mean comprises 140.
The method of claim 1 further comprising:

At the same time, the face map is registered separately under visible light conditions and near-infrared light conditions.
A face recognition device comprising:

Obtaining a module for acquiring a face image;

An identification module, configured to perform face recognition according to a light source environment in which the face image is collected, including:

In a case where the light source environment in which the face image is collected is visible light, the face image is compared and recognized with a face map registered under visible light conditions; or

In the case where the light source environment in which the face image is collected is near-infrared light, the face image is compared with the face map registered under the near-infrared light condition.
The apparatus of claim 8 further comprising:

The light source determining module is configured to determine whether the light source environment in which the face image is collected is visible light or near-infrared light.
The device of claim 9 wherein:

Get the module, including:

a complete image frame acquisition sub-module for acquiring a complete image frame including a face and a background environment;

a face area acquisition sub-module for acquiring a face area from the complete image frame;

a face image extraction sub-module, configured to extract the face image from the face region;

The light source judgment module includes:

a grayscale sub-module for graying out the complete image frame to obtain a grayscale image frame;

The light source determining sub-module is configured to determine, according to the distribution of gray scales in the grayscale image frame, whether the light source environment in which the facial image is collected is visible light or near-infrared light.
The apparatus according to claim 10, wherein determining whether the light source environment in which the face image is captured is visible light or near-infrared light according to a distribution of gray scales in the grayscale image frame comprises:

Calculating a first pixel number of the grayscale value in the initial closed interval in the grayscale image frame, wherein one end point of the initial closed interval is a grayscale minimum value of the grayscale image frame, and the other end point Adding a preset value to the grayscale minimum value;

Calculating a second pixel number of the grayscale value in the grayscale image frame in the termination closed interval, wherein one end point of the termination closed interval is a grayscale maximum value of the grayscale image frame minus the preset Value, the other endpoint is the grayscale maximum;

Calculating a grayscale average value of the region other than the face region in the grayscale image frame;

When the first pixel number is greater than the second pixel number, and the grayscale average value is less than the preset grayscale mean value, determining that the light source environment in which the face image is collected is near-infrared light; otherwise, determining the collection The light source environment in which the face image is located is visible light.
The apparatus of claim 11 wherein said predetermined value comprises 15.
The apparatus of claim 11 wherein said predetermined grayscale mean comprises 140.
The apparatus of claim 8 further comprising:

The registration module is configured to register the face map separately under visible light conditions and near-infrared light conditions.
A system for face recognition, comprising:

One or more processors;

Memory for storing one or more programs,

Wherein the one or more programs are executed by the one or more processors, such that the one or more processors implement the method of any one of claims 1-7.
A computer readable medium having stored thereon executable instructions that, when executed by a processor, cause a processor to implement the method of any one of claims 1-7.