CN108875495B - Person-evidence verification device and person-evidence verification method - Google Patents
Person-evidence verification device and person-evidence verification method Download PDFInfo
- Publication number
- CN108875495B CN108875495B CN201710965338.4A CN201710965338A CN108875495B CN 108875495 B CN108875495 B CN 108875495B CN 201710965338 A CN201710965338 A CN 201710965338A CN 108875495 B CN108875495 B CN 108875495B
- Authority
- CN
- China
- Prior art keywords
- certificate
- document
- image
- face image
- human
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012795 verification Methods 0.000 title claims abstract description 121
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000001514 detection method Methods 0.000 claims abstract description 30
- 238000012015 optical character recognition Methods 0.000 claims description 21
- 238000012545 processing Methods 0.000 claims description 19
- 230000008859 change Effects 0.000 claims description 9
- 230000008569 process Effects 0.000 claims description 9
- 239000011248 coating agent Substances 0.000 claims description 4
- 238000000576 coating method Methods 0.000 claims description 4
- 238000004891 communication Methods 0.000 claims description 4
- 125000006850 spacer group Chemical group 0.000 claims description 3
- 238000000605 extraction Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 238000012216 screening Methods 0.000 description 4
- 230000007613 environmental effect Effects 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Collating Specific Patterns (AREA)
Abstract
A person verification device and a person verification method. The human certificate verification device comprises at least one camera, a certificate placement detection device, a certificate information reading device and a processor. The certificate placement detection device comprises a certificate placement area and is configured to detect whether a certificate is placed in the certificate placement area; the certificate information reading device is configured to read personal information stored in a certificate placed in the certificate placement area; the at least one camera is configured to photograph a face of a document holder to obtain a first image, and to photograph a document placed in a document placement area to obtain a second image when the document information reading device fails to read the document. The personnel verification device can complete personnel verification work under the condition that personal information cannot be read when certificates are damaged.
Description
Technical Field
The embodiment of the disclosure relates to a person verification device and a person verification method.
Background
With the improvement of accuracy of face recognition algorithm, the vigorous development of internet big data and the birth of faster and more efficient computing chips, face recognition systems have been widely applied in the fields of security, business and the like. The human face verification device is a typical application in the field of human face recognition, and can effectively and accurately judge whether the real-time human face image of the certificate holder is consistent with the human face image on the certificate (such as an identity card).
Most of the traditional personnel verification devices capture real-time face images through cameras, read personal information and photos stored in an identity card through a card reader by using NFC (Near Field Communication-near field communication) technology, and then complete a comparison verification function. However, in many cases, the frequent use and poor storage of the id card may cause the problem that the internal chip or the internal antenna of the id card is easily damaged or aged, which may not be readable, thereby affecting the normal use of the id card verification device.
Disclosure of Invention
At least one embodiment of the present disclosure provides a human verification device including at least one camera, a document placement detection device, a document information reading device, and a processor. The document placement detection device includes a document placement area and is configured to detect whether a document is placed within the document placement area; the certificate information reading device is configured to read personal information stored in the certificate placed in the certificate placement area; the at least one camera is configured to photograph a face of a document holder to obtain a first image, and to photograph the document placed in the document placement area to obtain a second image when the document information reading device fails to read the document; the processor is configured to obtain a result of: extracting the face image of the first image to obtain a first face image, extracting the personal information or the second image to obtain a second face image, and comparing whether the first face image and the second face image belong to the same person.
For example, in the human verification device provided in an embodiment of the present disclosure, the at least one camera includes a first camera and a second camera. The first camera is configured to take a photograph of the credential holder's face to obtain the first image. The second camera is configured to take a picture of the document placed in the document placement area to obtain the second image when the document information reading device fails to read the document.
For example, in the person verification apparatus provided in an embodiment of the present disclosure, the processor is further configured to perform an optical character recognition process on the second image to obtain the personal identification information.
For example, in the human verification device provided in an embodiment of the present disclosure, the processor is further configured to perform an optical character recognition process on the second image to determine whether a side of the document containing personal information faces a direction that can be photographed by the at least one camera.
For example, in the person verification apparatus provided in an embodiment of the present disclosure, the processor is further configured to determine whether the quality of the first face image meets a predetermined specification.
For example, the person verification apparatus provided in an embodiment of the present disclosure further includes a display screen configured to display the first image in real time.
For example, in the human certificate verification device provided in an embodiment of the present disclosure, the certificate information reading device includes a certificate information reading device antenna unit and a certificate information reading device analysis unit.
For example, in the human certificate verification device provided in an embodiment of the present disclosure, the certificate placement detection device is a proximity sensor. The human certificate verification device further comprises a cover plate arranged in the certificate placement area, and the proximity sensor is arranged between the cover plate and the antenna unit of the certificate information reading device.
For example, in a person verification apparatus provided in an embodiment of the present disclosure, the proximity sensor includes a transmitting end, a receiving end, and a spacer disposed between the transmitting end and the receiving end.
For example, in a person verification device provided in an embodiment of the present disclosure, an infrared coating is provided on a side of the cover plate facing the proximity sensor.
For example, in the human certificate verification device provided in an embodiment of the present disclosure, the certificate placement detection device is a light sensor. The human certificate verification device further comprises a cover plate arranged in the certificate placement area, and the light sensor is arranged between the cover plate and the antenna unit of the certificate information reading device.
For example, in the human certificate verification device provided in an embodiment of the present disclosure, the certificate includes an identity card, an access card, a stored value card, and a bank card.
For example, in the human certificate verification device provided in an embodiment of the present disclosure, the certificate includes a certificate with a chip integrated therein, and the certificate information reading device may read the personal information stored in the chip by using a short-range wireless communication.
At least one embodiment of the present disclosure also provides a person verification method, including: photographing the face of the certificate holder to obtain a first image; reading personal information stored in a document placed in a document placement area; photographing the certificate to obtain a second image under the condition that the certificate is failed to be read; the following results were obtained: processing the first image to obtain a first face image; processing the personal information or the second image to obtain a second face image; and comparing whether the first face image and the second face image belong to the same person.
For example, the person verification method provided in an embodiment of the present disclosure further includes: detecting whether the certificate is placed in the certificate placement area. If the certificate is placed in the certificate placement area, reading personal information stored in the certificate; and if the certificate is not placed in the certificate placement area, sending information prompting to change the certificate placement position.
For example, the person verification method provided in an embodiment of the present disclosure further includes: and performing optical character recognition processing on the second image to obtain personal identity information.
For example, the person verification method provided in an embodiment of the present disclosure further includes: and performing optical character recognition processing on the second image to judge whether one side of the certificate containing personal information faces the certificate placement area. And if the judgment result is yes, sending out information for prompting to change the placing orientation of the certificate.
For example, the person verification method provided in an embodiment of the present disclosure further includes: and judging whether the quality of the first face image meets a preset specification. If the quality of the first face image does not accord with the preset specification, sending out information for prompting to adjust the gesture; and if the quality of the first face image meets the preset specification, executing the operation of comparing whether the first face image and the second face image belong to the same person or not.
For example, in the method for verifying a person's certificate provided in an embodiment of the present disclosure, if the certificate is placed in the certificate placement area, the operation of photographing the face of the person to obtain the first image is started to be performed.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings of the embodiments will be briefly described below, and it is apparent that the drawings in the following description relate only to some embodiments of the present disclosure, not to limit the present disclosure.
FIG. 1 is a schematic diagram of a human verification device provided in one example of an embodiment of the present disclosure;
FIG. 2 is a schematic diagram of integrating a credential placement detection device into a credential information reading device antenna unit in one example of an embodiment of the present disclosure;
FIG. 3 is a schematic diagram of a credential placement detection device implemented as a proximity sensor in one example of an embodiment of the present disclosure;
FIG. 4 is a schematic diagram of a document placement detection device implemented as a light sensor in one example of an embodiment of the present disclosure;
FIG. 5 is a schematic diagram of a human verification method provided by an example in an embodiment of the present disclosure; and
fig. 6 is a schematic diagram of a person verification method provided by another example in an embodiment of the present disclosure.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present disclosure more apparent, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present disclosure. It will be apparent that the described embodiments are some, but not all, of the embodiments of the present disclosure. All other embodiments, which can be made by one of ordinary skill in the art without the need for inventive faculty, are within the scope of the present disclosure, based on the described embodiments of the present disclosure.
Unless defined otherwise, technical or scientific terms used in this disclosure should be given the ordinary meaning as understood by one of ordinary skill in the art to which this disclosure belongs. The terms "first," "second," and the like, as used in this disclosure, do not denote any order, quantity, or importance, but rather are used to distinguish one element from another. Likewise, the terms "a," "an," or "the" and similar terms do not denote a limitation of quantity, but rather denote the presence of at least one. The word "comprising" or "comprises", and the like, means that elements or items preceding the word are included in the element or item listed after the word and equivalents thereof, but does not exclude other elements or items. The terms "connected" or "connected," and the like, are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "upper", "lower", "left", "right", etc. are used merely to indicate relative positional relationships, which may also be changed when the absolute position of the object to be described is changed.
At least one embodiment of the present disclosure provides a human verification device including at least one camera, a document placement detection device, a document information reading device, and a processor. The certificate placement detection device comprises a certificate placement area and is configured to detect whether a certificate is placed in the certificate placement area; the certificate information reading device is configured to read personal information stored in a certificate placed in the certificate placement area; at least one camera is configured to photograph the face of the document holder to obtain a first image, and to photograph the document placed in the document placement area to obtain a second image when the document information reading device fails to read the document; the processor is configured to perform face image extraction on the first image to obtain a first face image, extract personal information or the second image to obtain a second face image, and compare whether the first face image and the second face image belong to the same person. At least one embodiment of the present disclosure also provides a person verification method.
The human license verification device and the human license verification method provided by the embodiment of the disclosure can complete human license verification even if the certificate is damaged and personal information cannot be read.
Embodiments of the present disclosure are described in detail below with reference to the attached drawings.
One example of an embodiment of the present disclosure provides a human verification device 10, as shown in fig. 1, the human verification device 10 including at least one camera, a document placement detection device 200, a document information reading device 300, and a processor 400. For example, in different examples, the human verification device 10 may include a first camera 101 and a second camera 102, or only the second camera 102, e.g., the second camera 102 may be rotated or moved so that images of different objects may be captured.
For example, the document placement detection device 200 includes a document placement area 201 and is configured to detect whether a document is placed within the document placement area 201. For example, when a document is placed in the document placement area 201, the document placement detection device 200 may detect that a document is placed in the document placement area 201, so that, for example, the second camera 102 may be turned on to take a picture of the document.
For example, in some embodiments of the present disclosure, credential placement detection device 200 can be embodied as a proximity sensor or a light sensor.
For example, the document information reading device 300 is configured to read personal information stored in a document placed in the document placement area 201. For example, the credential information reading device 300 can include a credential information reading device antenna unit 301 and a credential information reading device resolution unit 302.
For example, in some embodiments of the present disclosure, credential information reading device 300 can be embodied as a card reader, where credential information reading device antenna element 301 is a card reader antenna element and credential information reading device resolution element 302 is a card reader resolution element. For example, the document includes a document having a chip integrated therein, such as an identification card, at which time the document information reading device 300 (e.g., a card reader) may read personal information stored in the document using NFC (Near Field Communication-near field communication) technology, such as personal information including, but not limited to, name, gender, ethnicity, date of birth, address, head portrait, etc., and the personal information read by the document information reading device 300 may be used for subsequent comparison verification.
It should be noted that, in the case where the chip is integrated inside the document, the document information reading apparatus 300 may not be able to complete the task of reading the document when the chip or the antenna inside the identification card is damaged due to frequent use or improper storage of the document.
For example, at least one camera is configured to photograph the face of the document holder to obtain a first image, and to photograph the document placed in the document placement area 201 to obtain a second image when the document information reading device 300 fails to read the document.
For example, in one example of an embodiment of the present disclosure, the human verification device 10 includes a first camera 101 and a second camera 102. The first camera 101 is configured to take a picture of the face of the credential holder to obtain a first image, for example, by orienting the first camera 101 towards the credential holder (i.e., the user) and configured to take a picture of the face of the credential holder in real time or configured to take a picture of the face of the credential holder only if the credential placement detection device 200 detects that a credential is placed in the credential placement area 201.
The second camera 102 is configured to take a picture of a document placed in the document placement area 201 to obtain a second image when the document information reading device 300 fails to read the document. For example, in the event of a chip or antenna failure within the document, the document information reading device 300 fails to read the document, at which time the second camera 102 may be activated to take a picture of the document placed within the document placement area 201 to obtain a second image.
It should be noted that, the first image in the embodiment of the present disclosure refers to an image obtained by photographing the face of the credential holder, and the first image may include environmental image information in addition to the face image information of the credential holder. The second image in the embodiments of the present disclosure refers to an image obtained by directly photographing the side of the certificate carrying the personal information. The following embodiments are the same as this and will not be described in detail.
For example, when an identification card is placed in the document placement area 201 with the side with personal information facing the second camera 102, the second camera 102 may take a picture of the identification card to obtain a second image, where the second image includes textual information (including, but not limited to, name, gender, ethnicity, date of birth, address, identification card number, etc.) and image information (e.g., personal crown care photo).
For example, in another example of an embodiment of the present disclosure, the human verification device 10 may also include only one camera of the second camera 102. For example, the second camera 102 is configured to be rotatable or movable so that it can be switched between being directed toward the document holder and toward the document placement area 201. For example, when the human certificate verification device 10 is started, the second camera 102 may be directed to the certificate holder by default and configured to take a picture of the face of the certificate holder in real time, or configured to take a picture of the face of the certificate holder when the certificate placement detection device 200 detects that a certificate is placed in the certificate placement area 201. For another example, the human certification verification device 10 may be further configured to control the second camera 102 to rotate toward the document placing area 201 and photograph the document placed in the document placing area 201 to obtain the second image when the document information reading device 300 fails to read the document. It should be noted that, since the distance is far when photographing the document holder and the distance is near when photographing the document in the document placement area 201, the second camera 102 may be configured to automatically adjust the focal length to obtain a clear image when in operation.
For example, the processor 400 is configured to obtain the result of: extracting the face image of the first image to obtain a first face image, extracting the personal information or the second image to obtain a second face image, and comparing whether the first face image and the second face image belong to the same person. It should be noted that, in the embodiment of the present disclosure, the processor 400 may be configured to obtain the result of the above operation through its own processing, which will be described below by taking this as an example. Embodiments of the present disclosure include, but are not limited to, for example, processing may be provided elsewhere for the operations described above, such as in a cloud server connected to the verification device 10 via a network.
For example, the acquired first image may include other environmental image information in addition to the face image information of the credential holder, and the processor 400 may perform face image extraction on the first image to obtain the first face image of the credential holder. It should be noted that, when the processor in the embodiment of the present disclosure performs face image extraction, an existing method may be adopted, which is not described herein.
For example, when the document information reading device 300 successfully reads the document, the personal information stored in the document may be directly extracted, and at this time, the second face image may be obtained without performing face image extraction; when the document information reading device 300 fails to read the document, the processor 400 may perform face image extraction on the obtained second image to obtain a second face image, for example, when the document is an identity card, the obtained second face image is a personal crown-free photo on the identity card.
After obtaining the first face image and the second face image, the processor 400 may further compare the first face image and the second face image to determine whether the person belongs to the same person, i.e. complete the verification of the person. For example, when the processor 400 performs the comparison, the feature values of the first face image and the second face image may be extracted respectively, and then it is determined whether the similarity of the feature values of the first face image and the second face image exceeds a preset threshold, if yes, it is determined that the person verification is successful, otherwise, it is determined that the person verification is failed. For example, the preset threshold may be adjusted accordingly based on different people, different application scenarios, and different accuracy requirements.
It should be noted that, the embodiment of the present disclosure is not limited to the above-mentioned manner of face image recognition, and other existing face recognition algorithms (for example, a recognition algorithm based on a whole face image, a recognition algorithm based on a template, a recognition algorithm based on a neural network, etc.) may be adopted, which will not be described herein.
The human certificate verification device 10 provided in the embodiment of the present disclosure may first detect that a certificate is placed in the certificate placement area 201 through the certificate placement detection device 200 under the condition that the certificate is damaged and cannot read personal information, and then take a photograph of the certificate through the second camera 102 and extract human face image information through the processor 400, thereby completing human certificate verification. The human verification device 10 solves the problem that human verification cannot be completed when a certificate is damaged.
For example, as shown in fig. 1, the human verification device 10 may further include a display screen 500, and the display screen 500 may be configured to display the first image in real time for manual operation.
For example, a man-machine interface may be displayed on the display screen 500, and when the credential holder stands in front of the human verification device 10, an image of the credential holder, i.e., the first image, may be displayed on the display screen 500 in real time, and the facial contour may be identified, so that the credential holder adjusts the standing posture according to the identification. For example, the display screen 500 may be configured to illuminate the display screen 500 and display the first image in real time when the credential holder places the credential within the credential placement area 201, which may save power and reduce power consumption.
For another example, the display screen 500 may also be configured to display a hint message, such as a message that may be displayed that hint the credential holder to orient his face towards the camera; or when the document information reading device 300 fails to read, the reading failure information is displayed, and the document holder is prompted to face the side of the document containing the personal information to the second camera 102.
For example, as shown in fig. 1, the human verification device 10 may further include a structural shell 600, where the structural shell 600 is used to fix various components in the human verification device 10, such as a camera, a certificate placement detection device 200, a certificate information reading device 300, a processor 400, and a screen 500, so that the human verification device is structurally robust and can avoid damage to the external environment.
For example, in another example of an embodiment of the present disclosure, the processor 400 may be further configured to perform optical character recognition (OCR, optical Character Recognition) processing on the second image to obtain personal identity information. For example, existing OCR processing methods may be employed to implement OCR processing. Likewise, for the operation result obtained by the processor 400 in this example, it may be obtained by, for example, a cloud server process connected to the person verification apparatus 10 via a network, in addition to the process obtained by the processor 400 itself. The description of the operation results obtained by the processor 400 in the following examples is the same as above, and will not be repeated.
For example, in the case that the document is an identity card, when the document information reading apparatus 300 fails to read the identity card, the second camera 102 is activated to take a photograph of the identity card to obtain a second image. At this time, the second image includes text information (e.g., name, gender, ethnicity, date of birth, address, and identification number) and image information (e.g., personal crown photograph), as described above. The processor 400 may perform not only face image extraction on the image information in the second image to obtain the second face image, but also OCR extraction on the text information in the second image to obtain the personal identity information. For example, if the human verification device 10 is networked with a public security system or banking system, then the identity information may be used for blacklist screening, e.g., if the identity information is in a blacklist, an alarm may be triggered.
For example, in another example of an embodiment of the present disclosure, the processor 400 may be further configured to perform an optical character recognition process on the second image to determine whether the side of the document containing the personal information is oriented in a direction that can be captured by the at least one camera.
For example, when performing the OCR to extract the text information, if no personal identification information is extracted, the processor 400 may determine that the side of the document including the personal information is not oriented in a direction that can be photographed by at least one camera (e.g., the second camera 102) at this time, and may display a prompt on the screen 500, so that the document holder may be prompted to orient the side of the document including the personal information in a direction that can be photographed by the at least one camera.
For example, in another example of an embodiment of the present disclosure, the processor 400 may be further configured to determine whether the quality of the first face image meets a predetermined specification.
For example, the quality of the first face image may be comprehensively determined by 3D pose (face pitch/roll angle, right/left twist angle), whether or not the illumination is proper, whether or not the face is blocked, and a threshold range may be preset for all of these 4 items, and it is determined that the predetermined specification is met only if the 4 items are simultaneously within a reasonable range. For example, a face image that meets a predetermined specification should be a frontal, clear, properly exposed, face-free face image.
In embodiments of the present disclosure, the processor 400 may be implemented by an application specific integrated circuit chip, for example, the application specific integrated circuit chip may be disposed on a motherboard, for example, on the motherboard may also be disposed with a memory, a power circuit, and the like; the processor 400 may also be implemented in circuitry, or in software, hardware (circuitry), firmware, or any combination thereof. In embodiments of the present disclosure, processor 400 may include various computing structures, such as a Complex Instruction Set Computer (CISC) structure, a Reduced Instruction Set Computer (RISC) structure, or a structure that implements a combination of instruction sets. In some embodiments, the processor 400 may also be a microprocessor, such as an X86 processor or ARM processor, or may be a digital processor (DSP) or the like.
In embodiments of the present disclosure, the human verification device 10 may further include a memory, for example, which may be disposed on the motherboard, and which may hold instructions and/or data for execution by the processor 400. For example, the memory may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, random Access Memory (RAM) and/or cache memory (cache), and the like. The non-volatile memory may include, for example, read Only Memory (ROM), hard disk, flash memory, and the like. One or more computer program instructions may be stored on the computer readable storage medium that can be executed by the processor 400 to implement the desired functionality in embodiments of the present disclosure (implemented by the processor 400). Various applications and various data including, for example, a human-computer interaction interface program, a first image, a second image, a first face image, a second face image, and the like, may also be stored in the computer-readable storage medium.
For example, as shown in fig. 2, in one example of an embodiment of the present disclosure, credential placement detection device 200 can be integrated in a credential information reading device antenna unit 301, with antenna coils in the credential information reading device antenna unit 301 shown at 310 in fig. 2. In this way, the human verification apparatus 10 can be made more compact and integrated. It is to be readily understood that the document placement detection device 200 may be provided separately without being integrated with the document information reading device antenna unit 301, as is not limited in this regard by the embodiments of the present disclosure.
For example, as shown in fig. 3, in one example of an embodiment of the present disclosure, credential placement detection device 200 can be implemented as a proximity sensor 210.
For example, the human verification device 10 may further include a cover plate 800 provided at the document placing area, and the proximity sensor 210 is provided between the cover plate 800 and the document information reading device antenna unit 301. The cover plate 800 is secured between the structural shells of the human verification device 10.
For example, the proximity sensor 210 includes a transmitting end 211, a receiving end 212, and a spacer 213 disposed between the transmitting end 211 and the receiving end 212.
For example, when the document 700 is placed above the cover plate 800, the light emitted from the emitting end 211 of the proximity sensor 210 is reflected back by the document 700 (as indicated by the dashed line with an arrow in fig. 3), and the reflected light is received by the receiving end 212 of the proximity sensor 210, so that the function of detecting the placement of the document can be achieved.
In fig. 3, for clarity of illustration, a certain space is provided between the certificate 700 and the cover plate 800, and in actual use, the certificate 700 is directly placed on the cover plate 800, and the middle may be not provided with a space.
For example, as shown in fig. 3, in one example of an embodiment of the present disclosure, an infrared coating 214 may be provided on a side of the cover plate 800 facing the proximity sensor 210. For example, when the light emitted by the proximity sensor 210 is infrared light, the infrared coating 214 may enhance the transmittance of the infrared light.
For example, as shown in fig. 4, in another example of an embodiment of the present disclosure, credential placement detection device 200 can be implemented as a light sensor 220.
For example, the human certification verification device 10 may further include a cover plate 800 disposed at the certificate placement area, and the light sensor 220 is disposed between the cover plate 800 and the certificate information reading device antenna unit 301. The cover plate 800 is secured between the structural shells of the human verification device 10.
For example, the light sensor 220 can sense a change in external ambient light, and when the document 700 is placed on the cover plate 800, the intensity of light sensed by the light sensor 220 is rapidly weakened, so that the function of document placement detection can be realized.
It should be noted that, the cover plate 800 in the embodiment of the present disclosure may be a transparent cover plate, and the embodiment of the present disclosure is not limited thereto, and for example, when the certificate placement detection device 200 is implemented as another type of sensor, the cover plate 800 may also be an opaque cover plate.
In addition, in the embodiment of the present disclosure, the certificate may include, in addition to the above-mentioned identification card, various situations such as an access card, a stored value card, or a bank card, which is not limited in this disclosure, so long as the certificate/card can be adapted to the environment of the embodiment of the present disclosure. For example, a photo of the head of a cardholder may be printed on an access card, and when a chip or antenna inside the access card is damaged and cannot be read, a person verification operation may be performed by the person verification apparatus provided in the embodiment of the present disclosure. For another example, in many consumption scenarios, many merchants offer stored value cards for convenience, which may be held by a non-cardholder for consumption if the stored value card is lost once it is lost. If the head portrait photo of the cardholder is printed on the stored value card, the person verification device provided by the embodiment of the disclosure can be used for carrying out person verification, so that the malicious consumption of the non-cardholder can be avoided. For another example, in the case where the certificate is a bank card, upon verification with the person's certificate verification device provided in the embodiments of the present disclosure, after acquiring the second image, the processor may perform OCR extraction on the second image to obtain a bank card number. For example, if the verification device 10 can be networked to a public security system or a banking system, the banking card number obtained at this time can be used for blacklist screening, for example, if the banking card number is in the blacklist, an alarm can be triggered by the screening.
In the embodiment of the present disclosure, the human verification apparatus 10 is described in the physical form of the human verification all-in-one machine shown in fig. 1, but the embodiment of the present disclosure is not limited to the specific physical form of the human verification apparatus 10. For example, the person verification device 10 may be implemented as a person verification gate, a person ticket three-in-one verification gate, or the like.
Embodiments of the present disclosure also provide a person verification method, as shown in fig. 5, including the following operations.
Step S110: photographing the face of the certificate holder to obtain a first image;
step S120: reading personal information stored in a document placed in a document placement area;
step S130: photographing the certificate to obtain a second image; and
the following results were obtained:
step S140: processing the first image to obtain a first face image;
step S150: processing the personal information or the second image to obtain a second face image;
step S160: and comparing whether the first face image and the second face image belong to the same person.
For example, as shown in fig. 1, in the case where the person verification apparatus 10 includes the first camera 101 and the second camera 102, step S110 may be performed with the first camera 101; in the case where the person verification apparatus 10 includes only the second camera 102, the second camera 102 may be directed toward the document holder to perform step S110.
For example, as shown in fig. 1, step S120 may be performed using the credential information reading device 300. When the step S120 is successfully performed, the step S150 may be continuously performed; when the execution of step S120 fails, the process proceeds to step S130.
For example, as shown in fig. 1, in the case that the internal chip or antenna of the certificate is damaged, step S120 may fail to be executed, and at this time, the second camera 102 may be started to execute step S130.
It should be noted that, the descriptions of the first camera 101, the second camera 102, and the document information reading apparatus 300 may refer to the corresponding descriptions in the embodiments of the human verification apparatus 10, and are not repeated here.
For example, as shown in fig. 1, the processor 400 may be employed to perform step S140, step S150, and step S160. It should be noted that, in the embodiment of the present disclosure, the operation results of step S140, step S150 and step S160 may be obtained through the processing of the processor 400 itself, and the embodiment of the present disclosure includes, but is not limited to, for example, may also be obtained through a cloud server processing.
For example, in addition to the face image information of the credential holder, the first image acquired in step S110 may further include other environmental image information, and by executing step S140, the face image may be extracted from the first image to obtain the first face image of the credential holder.
For example, in the case that the step S120 is successfully performed, the personal information stored in the certificate may be directly extracted when the step S150 is performed, and at this time, the second face image may be obtained without performing face image extraction; in the case of failure in the execution of step S120, the face image extraction may be performed on the second image obtained in step S130 to obtain a second face image when step S150 is performed.
After the first face image and the second face image are obtained through step S140 and step S150, in step S160, the first face image and the second face image may be compared to determine whether they belong to the same person, that is, the person verification function is completed. For example, after step S160 is performed, the comparison result may be returned for subsequent operations.
It should be noted that, the description of the processor 400 may refer to the corresponding description in the above embodiment of the human verification device 10, and will not be repeated herein.
According to the human verification method provided by the embodiment of the disclosure, under the condition that the certificate is damaged and the reading of the personal information cannot be completed, the human verification work can be completed by photographing the certificate and extracting the human face image information through processing. The human certificate verification method solves the problem that human certificate verification cannot be completed when certificates are damaged. For example, the method can be applied to hotel check-in systems, building access control systems, public transportation gate systems, and the like.
In one example of an embodiment of the present disclosure, as shown in fig. 6, the above-described person verification method may further include the following operations.
Step S170: detecting whether the certificate is placed in the certificate placement area;
step S171: and sending out information for prompting to change the position of the certificate.
For example, as shown in fig. 1, the document placement detection device 200 may be employed to perform step S170. When it is detected in step S170 that a certificate is placed in the certificate placement area, the above-described step S120 is continued to be performed; when it is not detected in step S170 that the certificate is placed in the certificate placement area, it goes to execution step S171 to prompt the certificate holder to change the certificate placement position, for example, prompt information may be displayed on the screen 500 shown in fig. 1.
In one example of an embodiment of the present disclosure, as shown in fig. 6, the above-described person verification method may further include the following operations.
Step S180: judging whether the quality of the first face image meets a preset specification or not;
step S181: and sending out information for prompting to adjust the gesture.
For example, after the step S140 is performed to obtain the first face image, the processor 400 shown in fig. 1 may be used to perform the step S180 to determine whether the quality of the first face image meets the predetermined specification. For example, the quality of the first face image may be comprehensively determined by 3D pose (face pitch/roll angle, right/left twist angle), whether or not the illumination is proper, whether or not the face is blocked, and a threshold range may be preset for all of these 4 items, and it is determined that the predetermined specification is met only if the 4 items are simultaneously within a reasonable range. For example, a face image that meets a predetermined specification should be a frontal, clear, properly exposed, face-free face image.
For example, if the first face image quality meets the predetermined specification through the determination in step S180, step S160 is continuously performed; if the quality of the first face image does not meet the predetermined specification, the process goes to step S181, i.e. the information prompting to adjust the pose is sent. The prompt may be displayed, for example, on the screen 500 shown in fig. 1.
In one example of an embodiment of the present disclosure, the person verification method may further include: and performing optical character recognition processing on the second image to obtain personal identification information.
For example, in the case that the certificate is an identity card, when the execution of step S120 fails, step S130 is executed to obtain the second image. The second image includes text information (e.g., name, gender, ethnicity, date of birth, address, and identification number) and image information (e.g., personal crown photograph). In addition to performing step S150 to perform face image extraction on the image information in the second image to obtain the second face image, OCR extraction may also be performed on text information in the second image to obtain personal identity information. The personal identity information may be used, for example, for blacklist screening by the backend system.
In one example of an embodiment of the present disclosure, the person verification method may further include: and performing optical character recognition processing on the second image to judge whether one side of the certificate containing personal information faces the certificate placing area, and if so, sending information for prompting to change the certificate placing orientation.
For example, when character information is extracted by OCR, if personal identification information is not extracted, it may be determined that the side of the document including the personal information is directed to the document placement area (i.e., is not directed in a direction that can be photographed by the camera) at this time, and information prompting to change the document placement direction may be issued. This prompt may be displayed, for example, on screen 500 shown in fig. 1, so that the credential holder may be prompted to face the side of the credential containing the personal information away from the credential placement area (i.e., toward a direction that can be captured by the camera).
For example, as shown in fig. 6, in the human certificate verification method provided in this embodiment, step S110 may not be performed first at the beginning, but step S110 may be performed only when a certificate is placed in the certificate placement area (i.e., when the result of step S170 is yes). By adopting the method, the electric energy can be saved, and the power consumption can be reduced.
The foregoing is merely specific embodiments of the disclosure, but the scope of the disclosure is not limited thereto, and the scope of the disclosure should be determined by the claims.
Claims (19)
1. A human verification apparatus comprising: the device comprises at least one camera, a certificate placement detection device, a certificate information reading device and a processor; wherein,
the document placement detection device includes a document placement area and is configured to detect whether a document is placed within the document placement area,
the document information reading device is configured to read personal information stored in the document placed in the document placement area,
the at least one camera is configured to photograph a face of a document holder to obtain a first image, and to photograph the document placed in the document placement area to obtain a second image when the document information reading device fails to read the document,
the processor is configured to obtain a result of:
extracting the face image of the first image to obtain a first face image, extracting the personal information or the second image to obtain a second face image, and comparing whether the first face image and the second face image belong to the same person.
2. The human verification device of claim 1, wherein the at least one camera comprises a first camera and a second camera,
the first camera is configured to take a photograph of the credential holder's face to obtain the first image,
the second camera is configured to take a picture of the document placed in the document placement area to obtain the second image when the document information reading device fails to read the document.
3. The human verification device of claim 1, wherein,
the processor is further configured to perform an optical character recognition process on the second image to obtain personal identity information.
4. The human verification device of claim 1, wherein,
the processor is further configured to perform an optical character recognition process on the second image to determine whether a side of the document containing personal information is oriented in a direction that can be captured by the at least one camera.
5. The human verification device of claim 1, wherein,
the processor is further configured to determine whether the quality of the first face image meets a predetermined specification.
6. The human verification device of claim 1, further comprising a display screen configured to display the first image in real-time.
7. The human verification device of any one of claims 1 to 6, wherein the document information reading device comprises a document information reading device antenna unit and a document information reading device parsing unit.
8. The human verification device of claim 7, wherein the document placement detection device is a proximity sensor,
the human certificate verification device also comprises a cover plate arranged in the certificate placement area,
the proximity sensor is disposed between the cover plate and the credential information reading device antenna unit.
9. The human verification device of claim 8, wherein the proximity sensor comprises a transmitting end, a receiving end, and a spacer disposed between the transmitting end and the receiving end.
10. The human verification device of claim 8, wherein an infrared coating is provided on a side of the cover plate facing the proximity sensor.
11. The human verification device of claim 7, wherein the document placement detection device is a light sensor,
the human certificate verification device also comprises a cover plate arranged in the certificate placement area,
the light sensor is arranged between the cover plate and the antenna unit of the certificate information reading device.
12. The human verification device of any one of claims 1-6, wherein the document comprises an identification card, a door access card, a stored value card, a bank card.
13. The human certification verification device of any one of claims 1 to 6, wherein the certificate includes a certificate having a chip integrated therein, and the certificate information reading device reads the personal information stored in the chip by means of short-range wireless communication.
14. A human evidence verification method comprising:
photographing the face of the certificate holder to obtain a first image;
reading personal information stored in a document placed in a document placement area;
photographing the certificate to obtain a second image under the condition that the certificate is failed to be read;
the following results were obtained:
processing the first image to obtain a first face image;
processing the personal information or the second image to obtain a second face image;
and comparing whether the first face image and the second face image belong to the same person.
15. The person verification method according to claim 14, further comprising:
detecting whether the certificate is placed in the certificate placement area;
if the certificate is placed in the certificate placement area, reading the personal information stored in the certificate,
and if the certificate is not placed in the certificate placement area, sending information prompting to change the certificate placement position.
16. The person verification method according to claim 14, further comprising:
and performing optical character recognition processing on the second image to obtain personal identity information.
17. The person verification method according to claim 14, further comprising:
and performing optical character recognition processing on the second image to judge whether one side of the certificate containing personal information faces the certificate placement area, and if so, sending information for prompting to change the certificate placement orientation.
18. The person verification method according to claim 14, further comprising:
judging whether the quality of the first face image meets a preset specification or not;
if the quality of the first face image does not accord with the preset specification, sending out information for prompting to adjust the gesture;
and if the quality of the first face image meets the preset specification, executing the operation of comparing whether the first face image and the second face image belong to the same person or not.
19. The human verification method of claim 15, wherein,
and if the certificate is placed in the certificate placement area, starting to execute the operation of photographing the face of the certificate holder to obtain a first image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710965338.4A CN108875495B (en) | 2017-10-17 | 2017-10-17 | Person-evidence verification device and person-evidence verification method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710965338.4A CN108875495B (en) | 2017-10-17 | 2017-10-17 | Person-evidence verification device and person-evidence verification method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108875495A CN108875495A (en) | 2018-11-23 |
| CN108875495B true CN108875495B (en) | 2024-03-01 |
Family
ID=64325407
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710965338.4A Active CN108875495B (en) | 2017-10-17 | 2017-10-17 | Person-evidence verification device and person-evidence verification method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108875495B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109543649A (en) * | 2018-12-04 | 2019-03-29 | 贵州电网有限责任公司 | A kind of identification system and method based on recognition of face and information communication |
| CN109684987B (en) * | 2018-12-19 | 2021-02-23 | 南京华科和鼎信息科技有限公司 | Identity verification system and method based on certificate |
| CN109657627A (en) * | 2018-12-20 | 2019-04-19 | 北京旷视科技有限公司 | Auth method, device and electronic equipment |
| CN111476279A (en) * | 2020-03-24 | 2020-07-31 | 平安银行股份有限公司 | Similarity value-based identification method and device and computer equipment |
| CN114818750A (en) * | 2022-06-27 | 2022-07-29 | 北京清航紫荆装备科技有限公司 | Non-contact ID card information acquisition epidemic prevention equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08161641A (en) * | 1994-12-09 | 1996-06-21 | Toshiba Kansai Syst Kaihatsu Kk | Merchandise coupon collection processing unit |
| JP2007295374A (en) * | 2006-04-26 | 2007-11-08 | Konica Minolta Medical & Graphic Inc | Certificate photo taking device and image data transfer system |
| CN104112114A (en) * | 2013-10-30 | 2014-10-22 | 北京安捷天盾科技发展有限公司 | Identity verification method and device |
| CN104715271A (en) * | 2015-03-23 | 2015-06-17 | 北京中盾安全技术开发公司 | Witness verifying machine |
| CN105844246A (en) * | 2016-03-25 | 2016-08-10 | 杭州信鸽金融信息服务股份有限公司 | Face recognition and second-generation ID card identification system with single camera cabinet machine |
| WO2016131083A1 (en) * | 2015-02-20 | 2016-08-25 | S2D Pty Ltd | Identity verification. method and system for online users |
| CN205581878U (en) * | 2016-03-25 | 2016-09-14 | 杭州信鸽金融信息服务股份有限公司 | Two camera cabinet -type air conditioner testimony of a witness recognition device |
| CN106650623A (en) * | 2016-11-18 | 2017-05-10 | 广东工业大学 | Face detection-based method for verifying personnel and identity document for exit and entry |
| CN207264409U (en) * | 2017-10-17 | 2018-04-20 | 北京旷视科技有限公司 | The testimony of a witness veritifies device |
-
2017
- 2017-10-17 CN CN201710965338.4A patent/CN108875495B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08161641A (en) * | 1994-12-09 | 1996-06-21 | Toshiba Kansai Syst Kaihatsu Kk | Merchandise coupon collection processing unit |
| JP2007295374A (en) * | 2006-04-26 | 2007-11-08 | Konica Minolta Medical & Graphic Inc | Certificate photo taking device and image data transfer system |
| CN104112114A (en) * | 2013-10-30 | 2014-10-22 | 北京安捷天盾科技发展有限公司 | Identity verification method and device |
| WO2016131083A1 (en) * | 2015-02-20 | 2016-08-25 | S2D Pty Ltd | Identity verification. method and system for online users |
| CN104715271A (en) * | 2015-03-23 | 2015-06-17 | 北京中盾安全技术开发公司 | Witness verifying machine |
| CN105844246A (en) * | 2016-03-25 | 2016-08-10 | 杭州信鸽金融信息服务股份有限公司 | Face recognition and second-generation ID card identification system with single camera cabinet machine |
| CN205581878U (en) * | 2016-03-25 | 2016-09-14 | 杭州信鸽金融信息服务股份有限公司 | Two camera cabinet -type air conditioner testimony of a witness recognition device |
| CN106650623A (en) * | 2016-11-18 | 2017-05-10 | 广东工业大学 | Face detection-based method for verifying personnel and identity document for exit and entry |
| CN207264409U (en) * | 2017-10-17 | 2018-04-20 | 北京旷视科技有限公司 | The testimony of a witness veritifies device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108875495A (en) | 2018-11-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108875495B (en) | Person-evidence verification device and person-evidence verification method | |
| US10699103B2 (en) | Living body detecting method and apparatus, device and storage medium | |
| KR102387571B1 (en) | Liveness test method and apparatus for | |
| CN207264409U (en) | The testimony of a witness veritifies device | |
| US9672406B2 (en) | Touchless fingerprinting acquisition and processing application for mobile devices | |
| KR20200032206A (en) | Face recognition unlocking method and device, device, medium | |
| WO2020238232A1 (en) | Image recognition method, apparatus and device, and authentication method, apparatus and device | |
| EP3825905A1 (en) | Method and apparatus with liveness test and/or biometric authentication, computer program therefore and medium storing the same | |
| JP7253691B2 (en) | Verification device and verification method | |
| WO2019200872A1 (en) | Authentication method and apparatus, and electronic device, computer program, and storage medium | |
| KR101724971B1 (en) | System for recognizing face using wide angle camera and method for recognizing face thereof | |
| KR20150069799A (en) | Method for certifying face and apparatus thereof | |
| CN108596122A (en) | A kind of auth method, device, authentication machine and computer-readable medium | |
| JP6311237B2 (en) | Collation device and collation method, collation system, and computer program | |
| KR101725219B1 (en) | Method for digital image judging and system tereof, application system, and authentication system thereof | |
| CN108875553A (en) | Method, apparatus, system and the computer storage medium that the testimony of a witness is veritified | |
| JP7269897B2 (en) | Data registration device, biometric authentication device, and data registration program | |
| CN108875472B (en) | Image acquisition device and face identity verification method based on image acquisition device | |
| KR102050590B1 (en) | Method for digital image judging and system tereof, application system, and authentication system thereof | |
| US20230005301A1 (en) | Control apparatus, control method, and non-transitory computer readable medium | |
| RU127977U1 (en) | UNIVERSAL READER OF PASSPORT AND VISA DOCUMENTS | |
| KR20210074749A (en) | Liveness test method and liveness test apparatus | |
| TW201721509A (en) | Composite recognition system of human face and biological posture eliminates error judgement generated by pure facial recognition to achieve better accuracy, safety and economy convenience | |
| KR102114997B1 (en) | Passport recognition terminal and method for passport recognition using the same | |
| US20230316794A1 (en) | Method for improved id document detection, capture and segmentation using a visual representation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |