WO2018179723A1 - Appareil de traitement d'authentification faciale, procédé de traitement d'authentification faciale et système de traitement d'authentification faciale - Google Patents

Appareil de traitement d'authentification faciale, procédé de traitement d'authentification faciale et système de traitement d'authentification faciale Download PDF

Info

Publication number
WO2018179723A1
WO2018179723A1 PCT/JP2018/001863 JP2018001863W WO2018179723A1 WO 2018179723 A1 WO2018179723 A1 WO 2018179723A1 JP 2018001863 W JP2018001863 W JP 2018001863W WO 2018179723 A1 WO2018179723 A1 WO 2018179723A1
Authority
WO
WIPO (PCT)
Prior art keywords
face
unit
authentication
frame
target person
Prior art date
Application number
PCT/JP2018/001863
Other languages
English (en)
Japanese (ja)
Inventor
郁雄 渕上
孝治 堀内
中村　剛
Original Assignee
パナソニックＩｐマネジメント株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニックＩｐマネジメント株式会社 filed Critical パナソニックＩｐマネジメント株式会社
Publication of WO2018179723A1 publication Critical patent/WO2018179723A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis

Definitions

  • the present disclosure relates to a face authentication processing device, a face authentication processing method, and a face authentication processing system that perform authentication using a face image of a target person.
  • a face authentication technique In order to authenticate a target person, a face authentication technique is known in which a face image of the target person is acquired and verified against the face image of the registrant to determine whether the person is the person.
  • various technologies for detecting a so-called “spoofing” act of improper use on behalf of a regular registrant have been proposed.
  • Patent Document 1 a face image sequence for a predetermined time is input, and a face included in the face image sequence is impersonated based on temporal changes in predetermined color information extracted from the face image sequence.
  • An information processing apparatus for determining whether or not is disclosed. According to this conventional example, it is possible to accurately detect impersonation when a fake face is presented during face authentication.
  • a mask for disguise is obtained by acquiring information derived from changes in blood flow measured from a face image based on temporal changes in predetermined color information extracted from the face image sequence. It is possible to detect impersonation of a face image with little change, such as when wearing. However, in the conventional face authentication device, it is sometimes difficult to detect fraud against impersonation using a moving image of a face image.
  • the present disclosure is devised in view of the above-described conventional circumstances, and an object thereof is to provide a face authentication processing device, a face authentication processing method, and a face authentication processing system that can accurately detect impersonation during authentication. .
  • the present disclosure acquires a captured image obtained by capturing a target person, detects a face of the target person in an input image of the captured image, and a frame detection unit detects a linear frame in the input image.
  • An arrangement determining unit that determines whether a frame surrounding the face of the target person exists using the face position information acquired by detecting the face and the frame position information acquired by detecting the frame;
  • a face authentication processing device comprising: an authentication determination unit that determines the validity of an authentication result of face information of the target person based on a frame arrangement determination result.
  • the present disclosure is a face authentication processing method in a face authentication processing device that performs face authentication of a target person, obtains a captured image obtained by capturing the target person, and includes the face of the target person in an input image of the captured image , Detecting a straight frame in the input image, and surrounding the face of the target person using the face position information acquired by detecting the face and the frame position information acquired by detecting the frame
  • a face authentication processing method for determining whether or not a frame exists and determining the validity of the authentication result of the face information of the target person based on the frame arrangement determination result.
  • the present disclosure also includes an imaging unit that captures a target person, a face detection unit that acquires a captured image of the target person and detects the face of the target person in an input image of the captured image, and a straight line in the input image Whether there is a frame surrounding the face of the target person using the frame detection unit for detecting a frame, the face position information acquired by the face detection, and the frame position information acquired by the frame detection
  • An arrangement determination unit for determining whether or not, a face verification unit for comparing face information of the captured image of the target person with registered face information, a face verification result of the face information, and an arrangement determination result of the frame
  • An authentication determination unit that determines the validity of the authentication result of the face information of the target person, an authentication result output unit that outputs the authentication result to a control target, the imaging unit, the face detection unit, and the frame detection unit ,
  • the arrangement determination unit, the authentication determination unit Chino provides face recognition processing system comprising a display unit, a displaying at least one processing result.
  • impersonation at the time of authentication can be detected with high accuracy.
  • FIG. 1 is a diagram illustrating a first example of the configuration of the face authentication system according to the present embodiment.
  • FIG. 2 is a block diagram illustrating a functional configuration of the face authentication apparatus according to the first embodiment.
  • FIG. 3 is a diagram for explaining frame detection processing in the present embodiment.
  • FIG. 4 is a diagram for explaining the background removal processing in the present embodiment.
  • FIG. 5 is a diagram illustrating a first example of a functional configuration of the frame detection unit in the present embodiment.
  • FIG. 6 is a diagram illustrating a second example of a functional configuration of the frame detection unit in the present embodiment.
  • FIG. 7 is a diagram illustrating the arrangement determination process in the present embodiment.
  • FIG. 8 is a flowchart illustrating a procedure of a first example of face authentication processing according to the first embodiment.
  • FIG. 8 is a flowchart illustrating a procedure of a first example of face authentication processing according to the first embodiment.
  • FIG. 9 is a flowchart illustrating the procedure of a second example of the face authentication process in the first embodiment.
  • FIG. 10 is a block diagram illustrating a functional configuration of the face authentication apparatus according to the second embodiment.
  • FIG. 11 is a block diagram illustrating a functional configuration of the face authentication apparatus according to the third embodiment.
  • FIG. 12 is a flowchart illustrating a procedure of a first example of face authentication processing according to the third embodiment.
  • FIG. 13 is a flowchart illustrating a procedure of a second example of the face authentication process in the third embodiment.
  • FIG. 14 is a block diagram illustrating a functional configuration of the face authentication apparatus according to the fourth embodiment.
  • FIG. 15 is a diagram illustrating a second example of the configuration of the face authentication system according to the present embodiment.
  • FIG. 16 is a diagram illustrating a third example of the configuration of the face authentication system according to the present embodiment.
  • the present embodiment an embodiment that specifically discloses a face authentication processing device, a face authentication processing method, and a face authentication processing system according to the present disclosure (hereinafter referred to as “the present embodiment”) will be described in detail with reference to the drawings as appropriate. .
  • more detailed description than necessary may be omitted.
  • detailed descriptions of already well-known matters and repeated descriptions for substantially the same configuration may be omitted. This is to avoid the following description from becoming unnecessarily redundant and to facilitate understanding by those skilled in the art.
  • the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the claimed subject matter.
  • FIG. 1 is a diagram illustrating a first example of the configuration of the face authentication system according to the present embodiment.
  • a face authentication device and a face authentication system that performs authentication by matching a face image of a registrant using a face image of a moving image obtained by capturing the target person when performing face authentication of the target person is shown.
  • the present embodiment shows a configuration example capable of detecting fraud against impersonation or the like due to reproduction of a moving image of a regular registrant using a portable display terminal.
  • the face authentication system 100A is configured to include the face authentication device 10A.
  • the face authentication system 100A images the target person 30, performs face authentication, and outputs an authentication result to the control target 40.
  • a service use management device such as car sharing, an entrance / exit management device in a security area, and the like are assumed.
  • a car sharing usage management device based on the authentication result of the user's face authentication, if the user is a registered regular user (if the authentication result is approved), the vehicle is allowed to be used. If the user is not a user (if the authentication result is denied), the car is disabled.
  • Control relating to permission to use the vehicle can be realized, for example, by inputting an authentication result to the control computer of the automobile and enabling or disabling the operation of the vehicle according to the authentication result.
  • an entrance / exit management device based on the authentication result of the face authentication of the entrance / exit person, if it is an authorized person (when the authentication result is approval), it is allowed to pass, and if it is not an authorized person (authentication) When the result is denial), traffic is blocked, intruder detection is notified, etc.
  • the face authentication device 10 ⁇ / b> A includes an imaging unit 11, a display unit 12, an ID reading unit 13, and a calculation unit 20.
  • the imaging unit 11 is configured by a camera such as a surveillance camera, for example.
  • the imaging unit 11 includes an imaging lens, an imaging device, an image signal processing circuit, a communication interface, and the like.
  • the imaging unit 11 captures a moving image of an imaging region including the target person 30 and outputs the captured image to the calculation unit 20.
  • the ID reading unit 13 is configured by an information reading device such as a card reader, for example, reads ID information of the ID card 35 such as a membership card, identification card, driver's license, etc. possessed by the target person 30 and outputs the ID information to the calculation unit 20. To do.
  • the calculation unit 20 is configured by a computer such as a PC.
  • the calculation unit 20 includes a processor, a memory, a communication interface, and the like.
  • the display unit 12 is configured by a display device including a display device such as a liquid crystal display, and includes various types of information at the time of execution of processing in the calculation unit 20 such as an operation guidance screen, an input image of a captured image, a face detection result, a frame detection result, The verification result and the authentication result of face authentication are displayed. Processing in the face authentication apparatus of this embodiment such as frame detection will be described in detail later.
  • the display unit 12 is disposed, for example, in a monitoring room of the face authentication system 100A, and is provided so as to be visible to an administrator or operator of the face authentication system 100A.
  • the display unit 12 may be provided in the vicinity of the imaging unit 11 for guidance display to the target person 30.
  • FIG. 2 is a block diagram illustrating a functional configuration of the face authentication apparatus according to the first embodiment.
  • the calculation unit 20A of the face authentication device includes a face recognition unit 21, a frame detection unit 22, an arrangement determination unit 23, a face collation unit 24, and an validity determination unit 25 as functional components.
  • the arithmetic unit 20A implements the functions of the respective units by executing a predetermined program by the processor. In this embodiment, even when there is spoofing by moving image reproduction of a regular registrant using a portable display terminal, the outline of the display terminal is recognized by performing frame detection, and the moving image of the face image is used. Detect fraud that has occurred.
  • the face recognition unit 21 has a function of a face detection unit.
  • the face recognition unit 21 detects the face of the target person in the input image by face recognition processing using the input image of the captured image including the face image, and acquires face feature information and position information (face arrangement information).
  • the frame detection unit 22 uses the input image of the captured image and the background image to detect a linear frame in the input image from which the background image has been removed. If the captured image includes a frame such as a display terminal, the frame detection unit 22 Position information (frame layout information) is acquired.
  • the arrangement determination unit 23 uses the face arrangement information and the frame arrangement information to perform arrangement determination as to whether or not the face is located within the frame of the display terminal or the like. By this arrangement determination, it is detected that the display terminal exists in the captured image of the input image and the face image is displayed by the display terminal within the frame of the display terminal.
  • the face collation unit 24 collates the face in the captured image detected by the face recognition unit 21 using the facial feature information acquired from the captured image and the collation data of the registrant's face information, thereby registering the registrant. It is determined whether or not the face matches.
  • the collation data image data of the registrant's face image or feature data including feature information of the registrant's face is used.
  • the collation data is recorded as one of the ID information on the ID card possessed by the target person, and the collation data of the ID information read from the ID card is input to the face collation unit 24 of the arithmetic unit 20A.
  • the validity determination unit 25 has functions of an authentication determination unit and an authentication result output unit.
  • the validity determination unit 25 approves whether the face of the target person in the input image is valid based on the arrangement determination result by the arrangement determination unit 23 and the face comparison result by the face matching unit 24, that is, the validity of the authentication result of face authentication. It is determined whether or not, and the authentication result is output.
  • FIG. 3 is a diagram for explaining frame detection processing in the present embodiment.
  • an input image 51 of a captured image is a case where an image obtained by capturing a situation where a moving image in which a regular registrant's face is captured is reproduced on a portable display terminal is captured. It is shown.
  • the face of the registrant displayed on the display terminal is captured as a subject
  • the input image 51 includes a housing 53 of the display terminal and a person 54 on the display image in the display unit of the display terminal. It is included.
  • the frame detection unit 22 performs a known contour extraction (edge detection) process on the input image 51 to generate an edge image 52.
  • the edge image 52 includes the outline 55 of the housing of the display terminal and the outline 56 of the person in the display unit of the display terminal.
  • the frame detection unit 22 performs a straight line detection process on the edge image 52 and extracts a straight line portion (line segment) 57 in the image.
  • the straight line detection process for example, straight line detection using Hough transform may be used.
  • the frame detection unit 22 determines whether there are two parallel straight lines and a straight line perpendicular thereto in the straight line portion 57 in the extracted image, extracts a frame 58 surrounded by four sides, and extracts frame coordinates. To get.
  • FIG. 4 is a diagram for explaining the background removal processing in the present embodiment.
  • the illustrated example shows a case in which impersonation using the display terminal is not performed as the input image 61 of the captured image, and an image obtained by directly capturing the face of the target person is input.
  • the input image 61 includes a background 65 and a person 66.
  • the background image 62 an image including the background 65 in a state where no person is present in the same imaging area as the input image 61 is used.
  • the background image 62 is acquired by, for example, an image obtained by capturing only the background at a timing when there is no person, or an image obtained by extracting a fixed point that does not change in position (the amount of movement is not detected) in the captured image.
  • the frame detection unit 22 removes the background 65 in the input image 61 using the input image 61 and the background image 62, and generates an image 63 after the background is removed.
  • the image 63 after the background removal is an image of only a subject that has no background portion and moves, such as a person 66.
  • the image after the background removal includes the display terminal and a person.
  • FIG. 5 is a diagram illustrating a first example of a functional configuration of the frame detection unit in the present embodiment.
  • the frame detection unit 22A of the first example includes contour extraction units 221, 222, a background removal unit 223, a straight line detection unit 224, and a frame extraction unit 225 as functional components.
  • the first example is an example in which a contour is extracted for each of the input image and the background image, the contour of the background portion is removed from the contour of the captured image, and frame detection is performed on the edge image from which the background is removed.
  • the contour extraction unit 221 performs edge detection on the input image of the captured image and extracts the contour of the captured image.
  • the contour extracting unit 222 performs edge detection on the background image to extract the contour of the background image.
  • the background removing unit 223 removes the contour of the background image from the contour of the captured image, and generates an edge image with a contour that does not include the background.
  • the straight line detection unit 224 performs straight line detection processing such as Hough transform on the edge image, and extracts a straight line portion in the image.
  • the frame extraction unit 225 extracts a frame surrounded by four line segments in a straight line portion in the extracted image, and outputs it as frame coordinates. In this way, by removing the contour of the background image after extracting the contour of the input image and the contour of the background image, the background removal efficiency can be improved and frame detection can be performed with high accuracy.
  • FIG. 6 is a diagram illustrating a second example of the functional configuration of the frame detection unit in the present embodiment.
  • the frame detection unit 22B of the second example includes a background removal unit 226, a contour extraction unit 227, a straight line detection unit 224, and a frame extraction unit 225 as functional components.
  • the second example is an example in which the background image is removed from the input image, the contour is extracted from the image after the background removal, and frame detection is performed on the edge image from which the background has been removed.
  • the background removal unit 226 removes the background image from the captured image and generates a captured image that does not include the background.
  • the contour extraction unit 227 performs edge detection on the captured image after background removal, and extracts the contour of the captured image.
  • the straight line detection unit 224 performs straight line detection processing such as Hough transform on the edge image, and extracts a straight line portion in the image.
  • the frame extraction unit 225 extracts a frame surrounded by four line segments in a straight line portion in the extracted image, and outputs it as frame coordinates. As described above, when the conditions such as the brightness of the image are approximated between the captured image and the background image, the outline can be extracted from the image after the background is removed, and the frame detection can be executed with high accuracy.
  • FIG. 7 is a diagram for explaining the arrangement determination processing in the present embodiment.
  • the arrangement determination unit 23 acquires face arrangement information of the target person obtained as one of the face detection results by the face recognition unit 21.
  • the face arrangement information includes a face frame 68 indicating the face contour position in the input image of the captured image.
  • the arrangement determination unit 23 acquires frame arrangement information of the display terminal obtained as one of the frame detection results by the frame detection unit 22. As shown in FIG.
  • the frame arrangement information includes a frame 58 indicating the contour position of the display terminal detected in the captured image.
  • the placement determination unit 23 compares the positions of both the face frame 68 and the frame 58 and determines whether the face frame 68 exists in the area inside the frame 58, that is, the target person within the frame of the display terminal. It is determined whether or not the face is located.
  • the arrangement determination unit 23 outputs an arrangement determination result that there is a face image in the frame.
  • the validity determination unit 25 considers that the face image detected in the captured image is a face image displayed by the display terminal when the face image exists in the frame based on the result of the placement determination by the placement determination unit 23, and the face The collation result is determined to be invalid. Thus, when the determination result by the validity determination part 25 becomes invalid determination, the impersonation generation using the display terminal is detected. In the case of invalidity determination, the validity determination unit 25 outputs denial as the authentication result of face authentication.
  • FIG. 8 is a flowchart showing the procedure of a first example of face authentication processing in the first embodiment.
  • the calculation unit 20A of the face authentication apparatus captures the input image in the face recognition unit 21 (S11), and performs face recognition processing of the target person in the input image (S12).
  • the computing unit 20A determines whether or not the face recognition unit 21 has detected the face of the target person (S13), and continues the face recognition process until a face is detected in the input image.
  • the calculation unit 20A performs face matching of the detected target person in the face matching unit 24 (S14).
  • the calculation unit 20A determines whether or not the facial feature information of the target person matches the matching data of the registrant's face in the face matching performed by the face matching unit 24 (S15), and if they match (S15: Yes), Continue face recognition processing. On the other hand, when the feature information of the face of the target person does not match the collation data of the registrant's face (S15: No), the calculation unit 20A performs an invalid determination in the validity determination unit 25 and rejects it as a face authentication authentication result. Is output.
  • the calculation unit 20A performs frame detection in the input image at the frame detection unit 22 (S16), and the layout determination unit 23 performs layout determination between the face position by face detection and the frame position by frame detection ( S17).
  • the calculation unit 20A detects a frame in the input image and determines whether or not a face exists inside the frame, that is, whether or not a frame surrounding the outside of the target person's face exists. Determine (S18).
  • the calculation unit 20A determines invalidity in the validity determination unit 25, and outputs denial as the authentication result of face authentication.
  • the calculation unit 20A performs the validity determination in the validity determination unit 25 and outputs an approval as the authentication result of the face authentication.
  • the face detection and the frame detection may be executed in parallel, or one process is executed in series and then the other process is executed.
  • the execution timing and order of the processing are not limited. Face matching and placement determination may be performed in parallel with each other, or one of the processes may be performed in series and the other may be performed. Implementation timing and order are not limited.
  • FIG. 9 is a flowchart showing the procedure of a second example of the face authentication process in the first embodiment.
  • the second example of face authentication processing shows a processing example in the case where there are a plurality of faces in the input image of the captured image.
  • the images captured for face authentication include, for example, a plurality of face images including a plurality of face images of a person, a plurality of face images of a spoofed face image and a face image of the person or another person. May be detected.
  • the computing unit 20A of the face authentication apparatus captures the input image in the face recognition unit 21 (S21), and performs face recognition processing of the target person in the input image (S22). At this time, the calculation unit 20A acquires the face detection number (N) as the number of face images detected by the face recognition unit 21. The calculation unit 20A determines whether the face detection number (N) is greater than 0, that is, whether face detection including the target person has been performed (S23), and continues face recognition processing until a face is detected in the input image. To do. When one or more faces are detected and the face detection number (N) is 1 or more (S23: Yes), the calculation unit 20A performs frame detection in the input image in the frame detection unit 22 (S24).
  • the calculation unit 20A determines whether or not the facial feature information of the processing target matches the collation data of the registrant's face in the face matching performed by the face matching unit 24 (S26).
  • the arithmetic unit 20A performs face collation for the next k-th face (S25, S26), and repeats the same processing until there is no unprocessed face.
  • the calculation unit 20A performs invalidity determination in the validity determination unit 25, and outputs denial as the authentication result of face authentication To do.
  • the calculation unit 20A determines the position of the face by the face detection for the kth face in the placement determination unit 23. An arrangement determination with the position of the frame by frame detection is performed (S28). In the placement determination by the placement determination unit 23, the calculation unit 20A detects a frame in the input image and determines whether a face exists inside the frame, that is, whether there is a frame surrounding the outside of the face to be processed. Determine (S29).
  • the face detection and the frame detection may be executed in parallel, or one process is executed in series and then the other process is executed.
  • the execution timing and order of the processing are not limited. Face collation and placement determination may be performed in parallel for each of a plurality of detected faces, or one process is performed in series and the other is performed in parallel. Processing may be executed, and the execution timing and order of the processing are not limited.
  • a plurality of frames of a moving image may be used as an input image, frame detection may be performed on each frame, and a frame detection result obtained by integrating detection results on the plurality of frames may be acquired.
  • Good For example, there may be a case where a frame cannot be detected from an image of one frame, for example, when a person's hand is on the display unit of a portable display terminal.
  • the detection results in multiple frames are integrated. Therefore, the frame detection can be executed with high accuracy, and the stability of the frame detection can be improved.
  • fraud such as impersonation using a portable display terminal can be detected by frame detection, and impersonation at the time of authentication can be detected with high accuracy.
  • impersonation at the time of authentication can be detected with high accuracy.
  • the facial feature information and the biological information may be combined in the face matching using the biological information acquired from the captured image of the moving image captured by the imaging unit.
  • the reliability of face authentication can be improved by combining biometric information and face image information.
  • FIG. 10 is a block diagram illustrating a functional configuration of the face authentication apparatus according to the second embodiment.
  • the calculation unit 20B of the face authentication device according to the second embodiment includes, as functional components, a face recognition unit 21, a frame detection unit 22, an arrangement determination unit 23, a face collation unit 24, an validity determination unit 25a, and an ID authentication unit. 26.
  • the functions and operations of the face recognition unit 21, the frame detection unit 22, the arrangement determination unit 23, and the face collation unit 24 are the same as those in the first embodiment shown in FIG. The explanation will focus on the part.
  • the ID authentication unit 26 uses the ID information acquired by the ID reading unit 13 to authenticate ID information recorded on an ID card such as an identification card, a membership card, or a driver's license possessed by the target person. Note that the ID authentication unit 26 does not use the ID information acquired from the ID card, but input information such as a password or an identification code input by a user who is the target person, or for each person such as an iris or fingerprint of the target person.
  • the identification information may be authenticated using the unique identification information as the ID information.
  • the validity determination unit 25a has functions of an authentication determination unit and an authentication result output unit.
  • the validity determination unit 25a determines whether the face of the target person in the input image is valid based on the arrangement determination result by the arrangement determination unit 23, the face verification result by the face verification unit 24, and the ID authentication result by the ID authentication unit 26, that is, the face It is determined whether the authentication result is approval or not, and the authentication result is output.
  • fraud such as impersonation using a portable display terminal can be detected by frame detection, and impersonation at the time of authentication can be detected with high accuracy.
  • impersonation at the time of authentication can be detected with high accuracy.
  • FIG. 11 is a block diagram illustrating a functional configuration of the face authentication apparatus according to the third embodiment.
  • the calculation unit 20C of the face authentication device according to the third embodiment includes a face recognition unit 21, a frame detection unit 22, an arrangement determination unit 23, and a face matching unit 24a as functional components.
  • the functions and operations of the face recognition unit 21, the frame detection unit 22, and the arrangement determination unit 23 are the same as those in the first embodiment shown in FIG. To do.
  • the face matching unit 24a has functions of an authentication determination unit and an authentication result output unit.
  • the face collating unit 24a determines whether the frame is not detected in the captured image based on the arrangement determination result by the arrangement determining unit 23 or when the frame is detected but does not surround the outside of the face. The face in the captured image detected in this way is collated to determine whether or not it matches the registrant's face.
  • the face matching unit 24a determines whether the authentication result of face authentication is approval or not based on the result of face matching, and outputs the authentication result.
  • FIG. 12 is a flowchart showing a procedure of a first example of face authentication processing in the third embodiment.
  • the calculation unit 20C of the face authentication apparatus captures the input image in the face recognition unit 21 (S31), and performs face recognition processing of the target person in the input image (S32).
  • the calculation unit 20C determines whether or not the face recognition unit 21 has detected the face of the target person (S33), and continues the face recognition processing until a face is detected in the input image.
  • the calculation unit 20C performs frame detection in the input image at the frame detection unit 22 (S34), and the placement determination unit 23 determines the position of the face by face detection. Arrangement determination with the position of the frame by frame detection is performed (S35).
  • the calculation unit 20C detects a frame in the input image and determines whether a face exists inside the frame, that is, whether there is a frame surrounding the outside of the target person's face. Determination is made (S36). When there is a frame surrounding the outside of the target person's face (S36: Yes), the calculation unit 20C determines invalidity in the face matching unit 24a, and outputs a denial as the authentication result of the face authentication.
  • the calculation unit 20C performs face matching of the detected target person in the face matching unit 24a (S37).
  • the calculation unit 20C determines whether or not the facial feature information of the target person matches the matching data of the registrant's face in the face matching by the face matching unit 24a (S38), and if it matches (S38: Yes), Approval is output as the authentication result of face authentication.
  • the calculation unit 20C determines invalidity in the face collation unit 24a and rejects it as the authentication result of face authentication. Is output.
  • the face detection and the frame detection may be executed in parallel, or one process is executed in series and then the other process is executed.
  • the execution timing and order of the processing are not limited.
  • FIG. 13 is a flowchart showing the procedure of the second example of the face authentication process in the third embodiment.
  • the second example of face authentication processing shows a processing example in the case where there are a plurality of faces in the input image of the captured image.
  • the computing unit 20C of the face authentication apparatus captures the input image in the face recognition unit 21 (S41), and performs face recognition processing of the target person in the input image (S42). At this time, the calculation unit 20C acquires the face detection number (N) as the number of face images detected by the face recognition unit 21. The calculation unit 20C determines whether the face detection number (N) is greater than 0, that is, whether face detection including the target person has been performed (S43), and continues face recognition processing until a face is detected in the input image. To do. When one or more faces are detected and the face detection number (N) is 1 or more (S43: Yes), the calculation unit 20C performs frame detection in the input image in the frame detection unit 22 (S44).
  • the frame is determined to be positioned with respect to (S45).
  • the calculation unit 20C detects a frame in the input image and determines whether a face exists inside the frame, that is, whether a frame surrounding the outside of the processing target face exists. Determine (S46).
  • the calculation unit 20C performs face matching on the kth face in the face matching unit 24a (S48).
  • the calculation unit 20C determines whether or not the feature information of the face to be processed matches the collation data of the registrant's face in the face collation performed by the face collation unit 24a (S49).
  • the calculation unit 20C When there is an unprocessed face (S47: Yes), the calculation unit 20C performs the same arrangement determination and face matching for the next k-th face (S45, S46, S48, S49). When there is no unprocessed face (S47: No), the calculation unit 20C determines invalidity in the face matching unit 24a, and outputs denial as the authentication result of face authentication. On the other hand, when the feature information of the face to be processed matches the collation data of the registrant's face (S49: Yes), the calculation unit 20C determines that the face collation unit 24a is valid and approves it as the authentication result of face authentication. Is output.
  • the face detection and the frame detection may be executed in parallel, or one process is executed in series and then the other process is executed.
  • the execution timing and order of the processing are not limited.
  • fraud such as impersonation using a portable display terminal can be detected by frame detection, and impersonation at the time of authentication can be detected with high accuracy.
  • impersonation at the time of authentication can be detected with high accuracy.
  • FIG. 14 is a block diagram illustrating a functional configuration of the face authentication apparatus according to the fourth embodiment.
  • the calculation unit 20D of the face authentication device according to the fourth embodiment includes, as functional components, a face recognition unit 21, a frame detection unit 22, an arrangement determination unit 23, a face collation unit 24a, an validity determination unit 25b, and an ID authentication unit. 26.
  • the functions and operations of the face recognition unit 21, the frame detection unit 22, and the arrangement determination unit 23 are the same as those in the first embodiment shown in FIG. 2, and the functions and operations of the face matching unit 24a are 11 is the same as that of the third embodiment shown in FIG.
  • the ID authentication unit 26 uses the ID information acquired by the ID reading unit 13 to authenticate ID information recorded on an ID card such as an identification card, a membership card, or a driver's license possessed by the target person. Note that the ID authentication unit 26 does not use the ID information acquired from the ID card, but input information such as a password or an identification code input by a user who is the target person, or for each person such as an iris or fingerprint of the target person.
  • the identification information may be authenticated using the unique identification information as the ID information.
  • the validity determination unit 25b has functions of an authentication determination unit and an authentication result output unit.
  • the validity determination unit 25b determines whether the face of the target person in the input image is valid based on the face collation result by the face collation unit 24a and the ID authentication result by the ID authentication unit 26, that is, whether the authentication result of face authentication is approval or disapproval. And the authentication result is output.
  • fraud such as impersonation using a portable display terminal can be detected by frame detection, and impersonation at the time of authentication can be detected with high accuracy.
  • impersonation at the time of authentication can be detected with high accuracy.
  • FIG. 15 is a diagram illustrating a second example of the configuration of the face authentication system according to the present embodiment.
  • the face authentication system 100 ⁇ / b> B includes a face authentication device 10 ⁇ / b> B, captures an image of the target person 30, performs face authentication, and outputs an authentication result to the control target 40.
  • the face authentication device 10 ⁇ / b> B includes an imaging unit 11, a display unit 12, an input device 14, a storage device 15, and a calculation unit 20. Note that the functions and operations of the imaging unit 11, the display unit 12, and the calculation unit 20 are the same as those in the first example shown in FIG. 1, and description thereof will be omitted here, and different parts will be mainly described.
  • the input device 14 has a function of an ID input unit for inputting ID information.
  • the input device 14 includes input devices such as a touch panel, a keyboard, and a mouse. Based on an input operation by the target person 30 or another operator, an ID such as a member number, an identification number, and a driver's license number of the target person 30 Enter information.
  • the storage device 15 has a function of a storage unit that stores collation data.
  • the storage device 15 includes a storage device such as a memory and a hard disk.
  • the storage device 15 stores and accumulates registrant face collation data (face image image data, face feature information, etc.), and the ID of the target person 30.
  • the collation data corresponding to the information is read and output to the calculation unit 20.
  • the calculation unit 20 executes various calculation processes related to the face authentication described above and outputs an authentication result.
  • the target person 30 can input the password from the input device 14 and perform password authentication, or face authentication combining face verification and password authentication may be performed.
  • the face detection and the frame detection are executed as in the face authentication system 100A of the first example described above, and the portable display terminal is impersonated by the frame detection. It is possible to detect fraud such as, and the accuracy of face authentication of the target person 30 can be improved.
  • FIG. 16 is a diagram illustrating a third example of the configuration of the face authentication system according to the present embodiment.
  • the face authentication system 100 ⁇ / b> C includes a face authentication device 10 ⁇ / b> C and a server device 80.
  • the face authentication system 100 ⁇ / b> C images the target person 30 to perform face authentication, and outputs an authentication result to the control target 40.
  • the face authentication device 10 ⁇ / b> C and the server device 80 are connected via a network 70 so that various types of information can be transmitted and received.
  • the face authentication device 10 ⁇ / b> C includes an imaging unit 11, a display unit 12, an ID reading unit 13, and a control unit 16. Note that the functions and operations of the imaging unit 11, the display unit 12, and the ID reading unit 13 are the same as those in the first example shown in FIG. 1, and description thereof will be omitted here, and different parts will be mainly described.
  • the control unit 16 is configured by a computer such as a PC and has a communication unit having a communication function.
  • the control unit 16 encodes information used for authentication, such as image information of a captured image acquired by the imaging unit 11 and ID information acquired by the ID reading unit 13, and communicates with the server device 80. Further, the control unit 16 inputs processing information such as an authentication result of face authentication transmitted from the server device 80, and transmits it to the display unit 12 for display together with an operation guidance screen and an input image of a captured image.
  • the server device 80 includes an arithmetic device 81 and a storage device 82.
  • the calculation device 81 is configured by a computer including a processor, a memory, a communication interface, and the like, and executes various calculation processes related to face authentication, like the calculation unit 20 of the face authentication device 10A of the first example.
  • the storage device 82 has a function of a storage unit that stores collation data.
  • the storage device 82 includes a storage device such as a memory and a hard disk.
  • the storage device 82 stores and accumulates registrant's face collation data (face image image data, face feature information, etc.), and the ID of the target person 30.
  • the collation data corresponding to the information is read and output to the arithmetic unit 81.
  • the arithmetic device 81 executes various arithmetic processes related to the face authentication described above and outputs an authentication result.
  • Various calculation processes related to face authentication may be performed in the control unit 16 of the face authentication device 10C in the same manner as the calculation unit 20 of the face authentication device 10A of the first example, or with the control unit 16 of the face authentication device 10C. You may carry out by distributing with the arithmetic unit 81 of the server apparatus 80.
  • FIG. When performing the face authentication process in the control unit 16, the face authentication apparatus 10C acquires the collation data from the server device 80 via the network 70, and executes the face authentication process. In addition, the authentication result may be transmitted via the network 70 and notified not only to the control target 40 and the server device 80 but also to a management device at another location.
  • the face detection and the frame detection are executed as in the case of the face authentication system 100A of the first example, and the portable display terminal is impersonated by the frame detection. It is possible to detect fraud such as, and the accuracy of face authentication of the target person 30 can be improved. Further, by using the collation data accumulated in the storage device 82 of the server device 80, face authentication using a large number of collation data becomes possible.
  • the face authentication devices 10A, 10B, and 10C as examples of the face authentication processing device according to the present embodiment acquire a captured image obtained by capturing a target person, and detect the face of the target person in an input image of the captured image.
  • a face recognition unit 21 as a face detection unit
  • a frame detection unit 22 that detects a linear frame in the input image
  • face position information acquired by face detection and frame position information acquired by frame detection.
  • an arrangement determination unit 23 that determines whether or not a frame surrounding the face of the target person exists, and an authentication determination unit that determines the validity of the authentication result of the target person's face information based on the frame arrangement determination result.
  • the validity determining unit 25 or the face matching unit 24a is the validity of the authentication result of the target person's face information based on the frame arrangement determination result.
  • the frame of the captured image is detected, the presence / absence of the frame in the captured image and the arrangement of the frame with respect to the face are determined. Based on the determination result of the frame, fraud such as impersonation using a portable display terminal is detected. Detection is possible, and impersonation at the time of authentication can be detected with high accuracy. Thereby, the reliability and stability of face authentication can be improved, and a highly accurate face authentication processing device and face authentication processing system can be realized.
  • the computing unit 20A of the face authentication apparatus 10A includes a face matching unit 24 that matches face information of a captured image of the target person with registered face information, and the validity determining unit 25 includes a face matching result of the face information.
  • the validity of the authentication result of the face information of the target person is determined based on the frame arrangement determination result. Thereby, fraud such as impersonation using a portable display terminal can be detected, and impersonation at the time of authentication can be accurately detected.
  • the computing unit 20C of the face authentication device 10A includes a face matching unit 24a that matches face information of a captured image of the target person with registered face information, and the face matching unit 24a includes a target in the frame placement determination result.
  • face information is collated, and the validity of the authentication result of the target person's face information is determined based on the face collation result of the face information.
  • fraud such as impersonation using a portable display terminal can be detected, and impersonation at the time of authentication can be accurately detected.
  • the calculation units 20B and 20D of the face authentication device 10A include an ID authentication unit 26 that acquires and authenticates the ID information of the target person, and the validity determination units 25a and 25b further use the authentication result of the ID information, The validity of the authentication result of the target person's face information is determined. Thereby, the reliability of face authentication can be improved by combining ID information and face image information.
  • the frame detection units 22A and 22B of the face authentication device 10A have background removal units 223 and 226 that remove the background in the input image.
  • background removal units 223 and 226 that remove the background in the input image.
  • the background removal units 223 and 226 of the face authentication device 10A remove the background of the input image using the background when the target person is imaged as the background image.
  • the background removal units 223 and 226 use the background when the target person does not exist as the background image, and removes the background of the input image.
  • frame detection can be executed from an image of only a subject having a background and no movement, such as a person, and frame detection accuracy can be improved.
  • the frame detection units 22A and 22B of the face authentication apparatus 10A use a plurality of frames of moving images as input images, and acquire a detection result of a frame obtained by integrating the detection results of the plurality of frames. As a result, even if a frame cannot be detected in an image of one frame and frame detection results are missing, frame detection can be performed with high accuracy by integrating detection results in a plurality of frames. Stability can be improved.
  • the face authentication systems 100A, 100B, and 100C acquire the captured image of the target person and the captured image of the target person, and in the input image of the captured image
  • face recognition unit 21 as a face detection unit for detecting the face of the target person
  • frame detection unit 22 for detecting a linear frame in the input image
  • face position information obtained by face detection
  • frame detection unit 23 Using the acquired frame position information
  • the face determination unit 23 that determines whether there is a frame surrounding the face of the target person, and the face that matches the face information of the captured image of the target person with the registered face information
  • an authentication determination unit that determines the validity of the authentication result of the face information of the target person, and authentication that outputs the authentication result to the control target Result output
  • It includes a validity determination section 25 as an imaging unit 11, the face recognition unit 21, the frame detector 22, arranged determination unit 23, a display unit 12 for displaying at least one of the
  • the frame of the captured image is detected, and when the frame is detected, the arrangement of the frame with respect to the face is determined. Based on the determination result of the arrangement of the frame, fraud such as impersonation using a portable display terminal is detected. It can be detected. Thereby, the impersonation at the time of authentication can be detected with high accuracy, and the reliability and stability of face authentication can be improved.
  • the face authentication systems 100A, 100B, and 100C include an ID reading unit 13 that reads ID information of a target person, or an input device 14 as an ID input unit that inputs ID information, and an ID authentication unit that authenticates ID information. 26, the validity determination unit 25 further determines the validity of the authentication result of the face information of the target person using the authentication result of the ID information. Thereby, the reliability of face authentication can be improved by combining ID information and face image information.
  • the ID information includes the target person face collation data
  • the face collation unit 24 collates the face information of the captured image of the target person using the ID information collation data.
  • the face authentication systems 100B and 100C include storage devices 15 and 82 as storage units for storing the verification data of the target person's face, and the face verification unit 24 acquires the verification data from the storage devices 15 and 82.
  • the face information of the captured image of the target person is collated. Thereby, face collation can be performed using collation data stored in a storage device such as its own device or an external server device, and face authentication using a large number of collation data is possible.
  • the present disclosure is useful as a face authentication processing device, a face authentication processing method, and a face authentication processing system that can accurately detect impersonation during authentication.

Abstract

La présente invention comporte : une unité de reconnaissance faciale (21) qui acquiert une image capturée obtenue par capture d'une personne cible et détecte le visage de la personne cible dans l'image d'entrée de l'image capturée ; une unité de détection de trame (22) qui détecte une trame linéaire dans l'image d'entrée ; une unité de détermination de disposition (23) qui détermine si une trame entourant le visage de la personne cible existe à l'aide des informations de position de visage acquises par la détection des informations de position de visage et de trame acquises par la détection de la trame ; et une unité de détermination de validité (25) qui détermine la validité du résultat de reconnaissance des informations de visage de la personne cible sur la base d'un résultat de détermination de disposition de trame.
PCT/JP2018/001863 2017-03-30 2018-01-23 Appareil de traitement d'authentification faciale, procédé de traitement d'authentification faciale et système de traitement d'authentification faciale WO2018179723A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017-068599 2017-03-30
JP2017068599A JP2018169943A (ja) 2017-03-30 2017-03-30 顔認証処理装置、顔認証処理方法及び顔認証処理システム

Publications (1)

Publication Number Publication Date
WO2018179723A1 true WO2018179723A1 (fr) 2018-10-04

Family

ID=63677721

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/001863 WO2018179723A1 (fr) 2017-03-30 2018-01-23 Appareil de traitement d'authentification faciale, procédé de traitement d'authentification faciale et système de traitement d'authentification faciale

Country Status (2)

Country Link
JP (1) JP2018169943A (fr)
WO (1) WO2018179723A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7415796B2 (ja) 2020-05-25 2024-01-17 オムロン株式会社 生体判定装置および生体判定方法
CN117561551A (zh) 2021-07-27 2024-02-13 富士通株式会社 判定方法、判定程序以及信息处理装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014219703A (ja) * 2013-04-30 2014-11-20 セコム株式会社 顔認証システム
JP2015026317A (ja) * 2013-07-29 2015-02-05 オムロン株式会社 プログラマブル表示器、制御方法、およびプログラム
WO2015128961A1 (fr) * 2014-02-26 2015-09-03 株式会社日立製作所 Système d'authentification de visage
WO2017043314A1 (fr) * 2015-09-09 2017-03-16 日本電気株式会社 Dispositif d'acquisition de guidage, procédé d'acquisition de guidage et programme

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5083164B2 (ja) * 2008-10-09 2012-11-28 住友電気工業株式会社 画像処理装置及び画像処理方法
JP6657646B2 (ja) * 2015-08-06 2020-03-04 オムロン株式会社 障害物検知装置、障害物検知方法、および障害物検知プログラム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014219703A (ja) * 2013-04-30 2014-11-20 セコム株式会社 顔認証システム
JP2015026317A (ja) * 2013-07-29 2015-02-05 オムロン株式会社 プログラマブル表示器、制御方法、およびプログラム
WO2015128961A1 (fr) * 2014-02-26 2015-09-03 株式会社日立製作所 Système d'authentification de visage
WO2017043314A1 (fr) * 2015-09-09 2017-03-16 日本電気株式会社 Dispositif d'acquisition de guidage, procédé d'acquisition de guidage et programme

Also Published As

Publication number Publication date
JP2018169943A (ja) 2018-11-01

Similar Documents

Publication Publication Date Title
US11093731B2 (en) Analysis of reflections of projected light in varying colors, brightness, patterns, and sequences for liveness detection in biometric systems
US20210303829A1 (en) Face liveness detection using background/foreground motion analysis
KR102038851B1 (ko) 신원들을 검증하기 위한 방법 및 시스템
JP2020061171A (ja) カメラ付きデバイスに関連する生体認証のためのシステム及び方法
KR101626880B1 (ko) 비대면 실명확인 온라인 신분증 식별 및 인식 시스템 및 방법
US10108793B2 (en) Systems and methods for secure biometric processing
US20150358317A1 (en) Behavioral Authentication System using a biometric fingerprint sensor and User Behavior for Authentication
US20140363058A1 (en) Systems And Methods For Uniquely Identifying An Individual
US11496471B2 (en) Mobile enrollment using a known biometric
WO2019216091A1 (fr) Dispositif d'authentification faciale, procédé d'authentification faciale et système d'authentification faciale
KR20090008256A (ko) 얼굴 인식 시스템
KR102079952B1 (ko) 얼굴 인식 출입 방법 및 장치
KR101724971B1 (ko) 광각 카메라를 이용한 얼굴 인식 시스템 및 그를 이용한 얼굴 인식 방법
CN108959884B (zh) 人证核验装置和方法
US20230222842A1 (en) Improved face liveness detection using background/foreground motion analysis
WO2018179723A1 (fr) Appareil de traitement d'authentification faciale, procédé de traitement d'authentification faciale et système de traitement d'authentification faciale
US20060026427A1 (en) Method and system for entity authentication using an untrusted device and a trusted device
KR20130133676A (ko) 카메라를 통한 얼굴인식을 이용한 사용자 인증 방법 및 장치
US20160125239A1 (en) Systems And Methods For Secure Iris Imaging
KR101965749B1 (ko) 카메라 기반의 비접촉식 지문인식 장치
JP7248348B2 (ja) 顔認証装置、顔認証方法、及びプログラム
JP2006350683A (ja) 人物認証装置
CN109299945B (zh) 一种基于生物识别算法的身份验证的方法及装置
WO2022010022A1 (fr) Appareil d'identification de client par authentification personnelle sans contact et procédé associé
KR20220131583A (ko) 배경객체를 이용한 안면식별 장치 및 그 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18776735

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18776735

Country of ref document: EP

Kind code of ref document: A1