JP6512272B1 - Terminal device, service application acceptance method, program - Google Patents

Abstract

[PROBLEMS] To provide a terminal device capable of unmanning an application acceptance process for a service requiring an identity verification. A terminal device acquires personal information inputted by a subscriber of a service requiring personal identification on a portable terminal, and identifies personal identification information including a face image of the applicant and the personal information as an identification card. To obtain a captured image of the applicant's face. The terminal device performs automatic identity verification based on personal information, identification information, and a photographed image. [Selected figure] Figure 1

Description

The present invention, the terminal device, service application accepted method, and a program.

  For example, when trying to open an account at a bank, the applicant goes to the bank for identity verification, fills in personal information such as the name, address, etc. There are many things. On the other hand, Patent Document 1 discloses a bank account opening acceptance terminal capable of easily opening a bank account. Patent Document 1 describes that a face image of an applicant for account opening, which is photographed by a camera provided in a terminal, is compared with a person's photo of an identification card possessed by the applicant to carry out identification.

JP 2003-030452

  However, in the case of the bank account opening reception terminal described in Patent Document 1, the applicant needs to input unique information such as a name, an address, and a telephone number to the reception terminal. Therefore, it takes time for the opening application acceptance process per account.

Therefore the present invention is a terminal apparatus to solve the above problems, and its object is to provide service subscription accepted method, a program.

According to a first aspect of the present invention, a terminal apparatus includes: a personal information acquisition unit for acquiring, from the portable terminal, personal information input by a service applicant for a service requiring personal identification on the portable terminal; An identification card information acquisition unit that reads identification card information including a face image of the applicant and the personal information from the identification card, and a first image acquisition for acquiring a first photographed image obtained by photographing the face of the service applicant A personal identification part that performs automatic personal identification based on a part, the personal information, the identification information, and the first captured image, and an additional information acquisition part that acquires additional information for the service applicant When the e Preparations and a control unit based on the identification result and the additional information by the identification unit controls the application process to the service, the additional information, taking the own apparatus is installed space Information is based on the number of times the service applicant is included in an image taken during a predetermined period in the past by the camera, and the control unit is configured to determine the number of times the service applicant is included in the image. If it indicates that it is more than the number of times, the application process to the service is continued, and if the additional information indicates that the number of times is less than a predetermined number of times, a certain alert is necessary for the additional information. To continue the application process for the service.

According to a second aspect of the present invention, a service application acceptance method includes the steps of: acquiring, from the portable terminal, personal information inputted by a service applicant for a service requiring a personal identification from the portable terminal; Reading identification information from the identification including the image of the person's face and the personal information, acquiring the first photographed image obtained by photographing the face of the service applicant, the personal information, and the identification A step of performing automatic identity verification based on certificate information and the first photographed image, a step of acquiring additional information for the service applicant, and a result of identity verification by the step of performing identity verification Controlling an application process for the service based on additional information on the service applicant, the additional information being the service It is information based on the number of times the service applicant is included in an image taken during a predetermined period in the past by a camera for imaging a space in which the applicant exists, and in the controlling step, the additional information is the service applicant If the number of times included in the image indicates that the number of times included in the image is equal to or greater than a predetermined number, the application process to the service is continued, and if the number is smaller than the predetermined number, the additional information is Is added, and the application process for the service is continued.

According to a third aspect of the present invention, a program is a means for acquiring from a portable terminal personal information entered by a service applicant for a service requiring a personal identification from the portable terminal, the computer of the terminal device, A means for reading identification information including a face image of the service applicant and the personal information from the identification; a means for acquiring a first photographed image obtained by photographing the face of the service applicant, the personal information, and the identification Means for automatically performing identity verification based on certificate information and the first photographed image, means for acquiring additional information for the service applicant, result of identity verification by the means for performing identity verification, and the service application Function as a means for controlling the application process to the service based on additional information related to a person, the additional information being a space where the terminal device is installed It is information based on the number of times the service applicant is included in an image captured by a camera to be captured in a predetermined period in the past, and the controlling means is the number of times that the service applicant is included in the image Indicates that the predetermined number of times is equal to or more than the predetermined number, the application process to the service is continued, and the additional information indicates that the additional information requires a certain alert when the number is less than the predetermined number. Add information and continue to apply for the service.

  According to the terminal device of the present invention, it is possible to perform an application process of a service requiring an identity verification in a short time and unmanned.

It is a figure showing the outline of the service application acceptance system by one embodiment of the present invention. FIG. 5 illustrates a portion of an automated teller machine interface in accordance with an embodiment of the present invention. It is a hardware block diagram of the control apparatus of the cash dispenser according to one embodiment of the present invention. It is a functional block diagram of a control device etc. by one embodiment of the present invention. It is a figure which shows the processing flow of the service application reception system by one Embodiment of this invention. It is a figure which shows the minimum structure of the control apparatus with which the cash dispenser according to one embodiment of the present invention is equipped.

Hereinafter, a service application acceptance system including an automatic teller machine according to an embodiment of the present invention will be described with reference to FIGS.
FIG. 1 is a diagram showing an outline of a service application acceptance system according to an embodiment of the present invention.
As shown in FIG. 1, the reception system 100 includes an automatic teller machine 1, a portable terminal 2, an account opening system 3, a dedicated server 4, a shop terminal 5, and a shop camera 6.
The reception system 100 is a system for receiving an application for a service that requires identification. The reception system 100 automatically performs an identification process and an application process to a service in a short time. In the present embodiment, an application for opening an account of a financial institution such as a bank is described as an example of a service requiring personal identification. However, the reception system 100 issues credit cards, membership cards of various groups, public offices, etc. Can also be applied to the issuance of certificates by

  The cash dispenser 1 includes a first camera 51 that captures the face of a user who is an applicant for a service requiring personal identification, and the user and behind the user and both sides of the user within the angle of view. And a second camera 52 for performing photographing. The cash dispenser 1 has various functions for reading information necessary for personal identification, as will be described later with reference to FIG. Further, the cash dispenser 1 incorporates a control device 10 that performs an identification process using an image or the like captured by the first camera 51.

  The portable terminal 2 is an information processing apparatus for the user to input in advance personal information necessary for identification. The portable terminal 2 has communication means such as NFC (Near Field Communication: Near Field Communication) or Bluetooth (registered trademark). The portable terminal 2 transmits the personal information of the service applicant to the cash dispenser 1 using these communication means. Alternatively, the mobile terminal 2 may have a function of encoding personal information into a QR code (registered trademark) or the like and outputting it.

  The account opening system 3 is a system constituted by a computer provided with functions required to open a bank account. After confirming the identity of the cash dispenser 1, the cash dispenser 1 transmits to the account opening system 3 application request information for opening a bank account. The account opening system 3 performs an account opening process, and notifies the user of account information opened.

  The dedicated server 4 is a server provided in a store or the like in which the automated teller machine 1 is installed. The dedicated server 4 specifies additional information of the user who has applied for the service using the cash dispenser 1 based on the image captured by the store camera 6 provided in the store. The additional information of the user is, for example, information as to whether or not the user is a customer who has a record of coming to the store, or whether or not any trouble or the like has occurred in the past due to the relationship of the store.

The store terminal 5 is an information processing apparatus in which an employee of the store inputs additional information of a user who is applying for a service. The automated teller machine 1 has a function of automatically performing personal identification, but in order to increase the accuracy of the personal identification, judgment by an employee can be added.
The store camera 6 is a camera for capturing an image of the store. The store camera 6 captures an image of the store entrance and the vicinity of the cash dispenser 1.
Communication connection is established between the cash dispenser 1 and the account opening system 3, between the cash dispenser 1 and the dedicated server 4, and between the dedicated server 4 and the store terminal 5.

FIG. 2 is a diagram of a portion of an interface of a cash dispenser according to an embodiment of the present invention.
As shown in FIG. 2, the cash dispenser 1 has a main display 11, an NFC antenna 12, a small display 13, a code reader 14, a third camera 15, a coin slot 16, a card slot 17, a receipt slot 18, etc. Prepare. Although not shown in FIG. 2, the cash dispenser 1 has a sub-display provided above the main display 11 in addition to the first camera 51 and the second camera 52 described above as another hardware configuration. , Speakers, ten keys, etc. Further, the cash dispenser 1 has a function of communicating with the portable terminal 2 and the dedicated server 4 by Bluetooth (registered trademark), LAN (local area network) or the like, and a function of communicating with the account opening system 3 by a dedicated line. . For the convenience of description, these detailed descriptions are omitted. The code reader 14 and the NFC antenna 12 are an aspect of the code reader.

An operation guidance screen or the like is displayed on the main display 11.
The NFC antenna 12 is built in a horizontal pedestal 91 provided below the main display 11.
The small display 13 is provided on the horizontal pedestal surface of the horizontal pedestal 91. The small display 13 displays a guide screen for placing an IC card or the like on the horizontal pedestal 91.
The code reader 14 reads the paper medium placed on the pedestal surface of the horizontal pedestal 91 and the code information displayed on the portable terminal 2. The code information may be a barcode, a two-dimensional code or the like.
The third camera 15 captures an imaging target such as a card placed on the pedestal surface of the horizontal pedestal portion 91.
In the present embodiment, the coin insertion slot 16 is an insertion slot into which a bill is inserted.
The card insertion slot 17 draws in a credit card, a bank card, and other IC cards, and discharges the card after processing based on the information recorded in the cards is completed.
The receipt discharge port 18 discharges the receipt on which the processing result and the like are printed.

FIG. 3 is a hardware block diagram of a control device for a cash dispenser according to an embodiment of the present invention.
As shown in the figure, the control device 10 includes a central processing unit (CPU) 10-1, a read only memory (ROM) 10-2, a random access memory (RAM) 10-3, and a hard disk drive (HDD) 10-4. It is a computer provided with each hardware of communication module 10-5 grade | etc.,. The control device 10 controls each hardware described above.

FIG. 4 is a functional block diagram of a control device or the like according to an embodiment of the present invention.
The control device 10 is activated when the cash dispenser 1 is powered on, and executes a program stored in advance. Thus, the control unit 10 includes the control unit 101, the personal information acquisition unit 102, the identification information information acquisition unit 103, the first image acquisition unit 104, the second image acquisition unit 105, the identity confirmation unit 106, the behavior determination unit 107, A functional unit such as an additional information acquisition unit 108, a communication unit 109, and a storage unit 110 is provided. Here, only the service application acceptance function of the control device 10 will be described, and the description of other functions (for example, cash in / out processing etc.) of the automated teller machine 1 will be omitted.

The control unit 101 performs control of other functional units, control of service application acceptance processing, and the like, in addition to control of the conventional cash dispenser 1.
The personal information acquisition unit 102 acquires, from the portable terminal 2, personal information input to the portable terminal 2 by the user. The personal information acquisition unit 102 acquires personal information from the portable terminal 2 via the NFC antenna 12, for example, when the user brings the portable terminal 2 close to the horizontal pedestal 91. Alternatively, the display unit 201 is directed to the code reader 14 in a state in which the user displays the coded (QR code (registered trademark) or the like) personal information on the display unit 201 of the portable terminal 2. Then, the personal information acquisition unit 102 acquires the personal information read by the code reader 14. Alternatively, the personal information acquisition unit 102 may communicate with the portable terminal 2 using Bluetooth (registered trademark) to acquire personal information from the portable terminal 2.

The identification card information acquisition unit 103 acquires a face image of the user and personal information from an identification card such as a license owned by the user or a passport. For example, when the user directs the identification card to the third camera 15, the third camera 15 captures the identification card. The identification card information acquisition unit 103 analyzes the image of the identification card shot by the third camera 15, and recognizes characters displayed on the surface of the identification card by OCR (Optical Character Recognition) or the like. Further, the identification card information acquisition unit 103 recognizes the face image displayed on the surface of the identification card by image recognition processing.
In addition, when the identification card includes a storage medium such as an IC chip storing information including the personal information of the user and the face image, when the user directs the identification card to the third camera 15, the NFC antenna 12 communicates with the IC chip to acquire personal information and a face image. The identification card information acquisition unit 103 communicates with the IC chip via the NFC antenna 12 to acquire personal information and a face image.

The first image acquisition unit 104 acquires an image (first photographed image) obtained by photographing the face of the user by the first camera.
The second image acquisition unit 105 acquires an image (second captured image) of the user captured by the second camera. The image captured by the second camera includes the situation behind the user.

  Based on the personal information acquired by the personal information acquisition unit 102, the identification information acquired by the identification information acquisition unit 103, and the image acquired by the first image acquisition unit 104, the identity verification unit 106 Perform confirmation processing. For example, the personal identification unit 106 compares the personal information acquired by the personal information acquisition unit 102 with the personal information included in the identification information, and determines whether or not they match. In addition, the personal identification unit 106 compares the image acquired by the first image acquisition unit 104 with the face image included in the identification information, and determines whether or not both match. If the personal information and the face image match, the personal identification part 106 determines that the personal identification is successful. If either one does not match, the principal confirmation unit 106 determines that the principal confirmation has failed.

  The behavior determination unit 107 analyzes the image of the user captured by the second camera 52 and determines whether there is any suspicious point. For example, if there is another person immediately behind the user or an operation in which another person looks into the image is included in the image, the behavior determination unit 107 determines that there is a suspicious point. Alternatively, when the user is performing application processing while making a phone call, or performing application processing while receiving instructions from another person, or doing a gesture that cares about the surroundings excessively, the behavior determination unit 107 determines that there is a suspicious point. The behavior determination unit 107 outputs the determination result to the control unit 101. The control unit 101 may control the service application acceptance process of the user according to the determination result by the behavior determination unit 107.

The additional information acquisition unit 108 acquires additional information of the user from the dedicated server 4. The additional information of the user is, for example, information indicating the usage frequency of the store or the automated teller machine 1. This is an evaluation for the user based on the idea that if the user who frequently uses the store has a certain credit due to the usage history, and if the user who visits the store for the first time, he / she needs to be alert for a while. . The additional information acquisition unit 108 outputs the additional information to the control unit 101. The control unit 101 may control the service application acceptance process of the user according to the additional information.
The communication unit 109 communicates with the account opening system 3 and the dedicated server 4 or the like.
The storage unit 110 stores various information such as a program that exerts each function of the control unit 101 or the like, and images taken by the first camera 51 and the second camera 52.

Next, the mobile terminal 2 used for inputting personal information will be described.
The portable terminal 2 includes a display unit 201, an input unit 202, an application 203, a communication unit 204, and a storage unit 205.
The display unit 201 is a display. The input unit 202 is an input unit such as a touch panel provided integrally with the display. The application 203 is an application for providing a function of inputting personal information, checking input items, transmitting personal information to the cash dispenser 1, encoding the personal information and displaying the same on the display unit 201. The communication unit 204 is a communication unit such as NFC, Bluetooth (registered trademark), or a wireless LAN. The storage unit 205 stores personal information.

  The user uses the input unit 202 to input personal information to the mobile terminal 2 before applying for a service using the cash dispenser 1 at a store. Personal information includes name, gender, date of birth, address, telephone number, zip code, e-mail address and the like. When the user inputs personal information, the application 203 checks whether the input information is correct. For example, when the future date is input to the information on the date of birth or an address that does not exist is input to the application 203, the application 203 displays a message prompting re-input of those items. Also, in the case where there is an age or address restriction in the application service, and the information against the restriction is input, the application 203 displays on the display unit 201 a message notifying that the application for the service can not be performed. You may display it. Also, the application 203 may transmit the input personal information to an external server (not shown) via the communication unit 204, and inquire about whether the application for the service is eligible. The application 203 records personal information in the storage unit 205 when the user finishes inputting personal information.

After completing the input of the personal information, the user visits the store and applies for opening a bank account using the cash dispenser 1. The user activates the application 203 and performs a predetermined operation. The application 203 executes processing such as transmission of personal information and display of a QR code (registered trademark) including personal information in accordance with the operation of the user.
In addition, after a series of account opening processes are completed, the portable terminal 2 may receive completion information of the account opening process from the account opening system 3.

Next, the dedicated server 4 transmitting the additional information will be described.
The dedicated server 4 includes a control unit 401, a customer recognition unit 402, an approval information acquisition unit 403, a communication unit 404, and a storage unit 405.
The control unit 401 performs control such as generation and transmission of additional information. For example, when the control unit 401 receives a request for additional information from the cash dispenser 1, the control unit 401 generates additional information and transmits the additional information to the cash dispenser 1.
For example, when the store camera 6 is provided toward the store entrance, the customer recognition unit 402 analyzes an image captured by the store camera 6 and recognizes a visiting customer included in the image. The customer recognition unit 402 records the recognized customer in the storage unit 405. When the same customer comes to the store, the customer recognition unit 402 recognizes the customer by image analysis, and records the visit time in association with the customer recorded in the storage unit 405. Similarly, when the store camera 6 is provided to photograph the periphery of the cash dispenser 1, the customer recognition unit 402 recognizes a customer who uses the cash dispenser 1 and records it in the storage unit 405. . For example, based on this record, the customer recognition unit 402 may count the number of times the customer appears in the image in the past predetermined period (additional information).

  The approval information acquisition unit 403 acquires approval information from the shop terminal 5. The approval information is information indicating the recognition of the employee of the store with respect to the user who has applied for the service using the cash dispenser 1. For example, for a user who visits the store frequently, the employee inputs information to the store terminal 5 to the effect that the user is aware. Further, for the user who does not remember, the employee inputs information to the effect that the user has not recognized it in the shop terminal 5. Alternatively, when the user behaves suspiciously, the employee may input information indicating that there is a suspicious point. Alternatively, as a secondary check for unmanned identity verification in cash machine 1, the employee is required to present an identification card, and if the tutor can visually identify himself and the identity can be verified, identity verification will be performed. The completion information may be input to the shop terminal 5. When obtaining the information, the approval information acquisition unit 403 transmits it as the additional information to the automatic teller machine 1 via the communication unit 404.

  The communication unit 404 communicates with other devices such as the cash dispenser 1. For example, the communication unit 404 may receive, from another server, a user's blacklist or the like regarding opening of a bank account. The storage unit 405 stores an image captured by the store camera 6, a black list in which an image of a user who can not make an account application, a name, and the like are registered.

  When the additional information is acquired from the dedicated server 4, in the cash dispenser 1, the control unit 101 controls the account application service based on the additional information. For example, if the user is registered in the blacklist, the application processing may be stopped, or an alarm may be notified to a dedicated server or an external server. Alternatively, if the additional information indicates that the user is a customer who has visited the store for the first time or a customer that the employee has not recognized, the identity confirmation processing is verified with a credit system (not shown). , Or may notify the account opening system 3 of additional information on the shop side.

Next, the flow of the account opening application process will be described.
FIG. 5 is a diagram showing a process flow of the service application acceptance system according to the embodiment of the present invention.
The user inputs personal information to the portable terminal 2. The personal information includes name, age, gender, address, telephone number, zip code, e-mail address and the like. In the mobile terminal 2, the application 203 receives an input of personal information (step S501). The application 203 checks the input personal information, prompts re-input for an apparent input error, etc., and fixes the personal information. The user can calmly enter personal information using vacant time or the like, so there is no need to enter personal information on the spot. Therefore, it is possible to save the input time at the store and shorten the processing time for the account opening application. In addition, it is possible to prevent an input error caused by inputting on the spot or re-execution of processing due to an input error.

  When the input of the personal information is completed, the user visits the store and performs an account opening application process using the cash dispenser 1. For example, the user selects “open bank account” from the menu displayed on the main display 11. Then, the control unit 101 causes the main display 11 to display a message prompting the display unit 201 to be placed on the horizontal pedestal 91 with the display unit 201 upward. The user activates the application 203 of the mobile terminal 2 and places the mobile terminal 2 on the horizontal pedestal 91. Then, the NFC antenna 12 and the NFC chip of the portable terminal 2 start communication, and the personal information acquisition unit 102 acquires checked personal information input to the portable terminal 2 in advance (step S502). The personal information acquisition unit 102 records the acquired personal information in the storage unit 110. The personal information may be acquired through communication by Bluetooth (registered trademark) in addition to NFC. Alternatively, the personal information acquisition unit 102 acquires personal information by reading a QR code (registered trademark) or the like including personal information displayed on the display unit 201 of the portable terminal 2 with the code reader 14 of the cash dispenser 1. You may The personal information acquisition unit 102 outputs the acquired personal information to the personal identification unit 106.

  When the personal information acquisition unit 102 acquires the personal information, the control unit 101 directs the main display 11 the surface of the identification card (the face on which the user's face image and the personal information such as the name and address are described) upwards The display for prompting placement on the horizontal pedestal portion 91 is performed. The user places the identification card on the horizontal pedestal 91. Then, the third camera 15 shoots the surface of the identification card. The image captured by the third camera 15 includes a face image of the user and personal information. The identification card information acquisition unit 103 acquires an image captured by the third camera 15, and acquires identification card information from the image (step S503). For example, the identification card information acquisition unit 103 reads personal information such as a name and an address included in the image. In addition, the identification information acquisition unit 103 recognizes a face image from the image captured by the third camera 15. The identification card information acquisition unit 103 outputs the read personal information and the recognized face image to the person verification unit 106.

  When the identification card includes an IC chip that stores a face image and personal information, the identification card information acquisition unit 103 acquires a face image and personal information stored in the IC chip via the NFC antenna 12. The identification card information acquisition unit 103 outputs the read personal information and the recognized face image to the person verification unit 106.

  During the processes of step S502 and step S503, the first camera 51 and the second camera 52 shoot the user. In particular, the first camera 51 shoots the face of the user who is performing the application operation from the front. The first image acquisition unit 104 acquires an image captured by the first camera 51 (step S504). The first image acquisition unit 104 outputs the acquired captured image to the person verification unit 106. Although this photographed image is used for personal identification, the difference between the reading time of the identification information and the time for photographing the user who is actually applying at the store is within a predetermined time (approximately the same time). , You can prevent impersonation and perform highly accurate person verification.

  Next, the identity verification unit 106 performs identity verification processing (step S505). For example, the personal identification unit 106 compares the personal information acquired by the personal information acquisition unit 102 with the personal information read by the identification information acquisition unit 103 for each item such as name and address. If all the items that can be compared match, the identity verification unit 106 determines that the personal information matches. Further, the personal identification part 106 compares the photographed image by the first camera 51 with the face image recognized by the identification card information acquisition part 103, and for example, when the features of both coincide, it is determined that the face collation is coincident. Do. The personal identification unit 106 determines that the personal identification is successful if the personal information matches and the face collation matches, and determines that the personal identification fails if either one does not match. The personal confirmation unit 106 outputs the result of the main confirmation process to the control unit 101.

  When the identification card includes an IC chip storing a face image and personal information, the personal identification unit 106 compares the personal information acquired by the personal information acquisition unit 102 with the personal information acquired from the IC chip, the first camera A comparison is also made between the captured image according to 51 and the face image obtained from the IC chip. If either one does not match, the identity verification unit 106 determines that the identity verification has failed.

  Next, the control unit 101 controls the account application process depending on whether or not the identification of the user is successful (step S506). If the identity verification fails (Step S506; No), processing for coping with the failure of personal information or face matching is performed. For example, if the personal information does not match, the main display 11 displays a message such as "The personal information does not match. Please reconfirm the information entered in the identification card or the mobile terminal 2." and step S502 Alternatively, the user may be prompted to perform step S503 again. In addition, even when the face authentication does not match, confirmation of the identification card or reprocessing of step S503 may be promoted, or the first camera 51 may be urged to face the front. Alternatively, the control unit 101 may display on the main display 11 a message requesting that an identification card be presented to an employee. The employee who has been presented with the identification card inputs the result of identity verification to the shop terminal 5. The approval information acquisition unit 403 of the dedicated server 4 acquires the personal identification result, and transmits the information to the cash dispenser 1 via the communication unit 404. For example, the automated teller machine 1 acquires the personal identification result input to the shop terminal 5 through the communication unit 109. The control section 101 may proceed with the account opening application process as long as the identity verification process by the identity verification section 106 is successful, as long as the identity verification result indicates that the identity verification has been successful.

  If the identity verification is successful (step S506; Yes), the second image acquisition unit 105 acquires the image captured by the second camera 52 (step S508), and outputs the image to the behavior determination unit 107. The behavior determination unit 107 analyzes the acquired image, and determines whether a suspicious person is reflected or whether the user is performing a suspicious behavior. The behavior determination unit 107 outputs the determination result to the control unit 101.

  In addition, for example, the control unit 101 sends the captured image of the first camera 51 to the dedicated server 4, and inquires the dedicated server 4 about additional information on the person of the captured image. In the dedicated server 4, the customer recognition unit 402 collates the image recorded in the storage unit 405 with the photographed image, and searches for registration information (visit history) regarding a person of the photographed image. The customer recognition unit 402 transmits, for example, additional information such as “visited 10 times within one month”, “visited for the first time”, etc. to the automated teller machine 1.

  Alternatively, the customer recognition unit 402 searches the blacklist based on the photographed image, and if the person of the photographed image is registered in the blacklist, the fact is transmitted to the cash dispenser 1 as additional information.

  Alternatively, the customer recognition unit 402 identifies the person from the image captured by the store camera 6 based on the acquired captured image, and performs the account opening application service with the cash dispenser 1 after the same person visits this time. It may be determined whether or not any suspicious behavior has been taken. The customer recognition unit 402 transmits the result of the determination to the automatic teller machine 1 as additional information.

  Alternatively, the control unit 401 may display the photographed image on the shop terminal 5 and prompt the employee to input whether the person is a customer who often uses it. If the customer is a customer who often visits the shop, the fact is input to the shop terminal 5. The approval information acquisition unit 403 acquires the information input by the employee, and transmits the information to the cash dispenser 1 as additional information.

  In the cash dispenser 1, the control unit 101 acquires additional information (step S 509). The control unit 101 determines whether to continue the account opening application process based on the additional information (step S510). For example, in the case of a customer who is successfully identified and successfully visits the store, the control unit 101 determines that the account opening application process can be continued. Further, for example, when the user is registered in the blacklist or the identity confirmation can not be performed even if the identity confirmation processing is performed a predetermined number of times, the control unit 101 may determine that the account opening application processing can not be continued. Also, for example, even if the identity verification is successful, if there is a suspicious point in the user's behavior as a result of analyzing the image captured by the second camera 52 or the image captured by the store camera 6, or for the first time If the customer is visiting the store, it may be determined that the account opening application process can be continued after adding the additional information as reference information.

  Next, the control unit 101 controls the account opening application process according to the determination result of step S510. When the account opening application process can not be continued (step S511; No), the control unit 101 performs a predetermined cancellation process (step 512). For example, the control unit 101 causes the main display 11 to display a message notifying that application processing for account opening can not be performed.

When the account opening application process can be continued (step S511; Yes), the control unit 101 causes the communication unit 109 to transmit account opening request information including information necessary for opening an account such as personal information to the account opening system 3 Send to The control unit 101 may transmit the additional information together with the account opening request information. Alternatively, the additional information may be transmitted as warning information to another external server.

  According to the present embodiment, the user performs an open application for opening a bank account including identity verification in a short time and in a short time simply by performing a simple operation without entering personal information etc. in front of the cash dispenser 1. It can be carried out. Banks and stores can reduce costs such as labor costs by being able to apply for the opening of an unmanned account by means of the cash dispenser 1. In addition, since the occupation time of the cash dispenser 1 is short, no inconvenience to other users is caused, and the operation rate of the cash dispenser 1 is improved, and the other service using the cash dispenser 1 accordingly. It can be expected to improve earnings and increase usage fees. In addition, by installing the cash dispenser 1 in various stores or the like, various services that require personal identification can be used nearby, thereby improving the convenience of the user. For example, when the cash dispenser 1 of this embodiment is applied to the issuance of a certificate of a public institution, it is possible to eliminate the inconvenience of visiting a city hall or the like from a distance and waiting for a long time.

  In the process described above, the person verification process is performed by the person verification unit 106 of the control device 10, but may be configured to be performed by the dedicated server 4, for example. Further, the captured image for identity verification used by the identity verification unit 106 is not limited to the image captured by the first camera 51, and may be an image captured by the second camera 52. Moreover, the order of step S502 to step S504 may be arbitrary. Also, the processing of step S508 to step S509 may be performed in parallel with step S502 to step S504. Further, the installation place of the cash dispenser 1 is not limited to a commercial facility such as a convenience store, and may be a government office, a hospital, a station yard, or the like. Further, also in the case of other services requiring personal identification including the above-described account opening system 3, the reception system 100 may include a card issuing machine so that a card, a membership card, etc. can be issued on the spot.

FIG. 6 is a diagram showing a minimum configuration of a control device provided in the cash dispenser.
As shown in the figure, the control device 10 included in the cash dispenser 1 includes at least a personal information acquisition unit 102, an identification information information acquisition unit 103, a first image acquisition unit 104, and a personal identification unit 106. Just do it.

  The cash dispenser 1 described above has a computer system (control device 10) inside. And the process of each process mentioned above is memorize | stored in the computer readable recording medium in the form of a program, and the said process is performed when a computer reads and runs this program. Here, the computer readable recording medium refers to a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory or the like. Alternatively, the computer program may be distributed to a computer through a communication line, and the computer that has received the distribution may execute the program.

  Further, the program may be for realizing a part of the functions described above. Furthermore, it may be a so-called difference file (difference program) that can realize the above-described functions in combination with a program already recorded in the computer system.

The store entrance and the vicinity of the cash dispenser 1 are an example of a space in which the cash dispenser is installed. The store camera 6 is not limited to the store entrance or the periphery of the cash dispenser 1, but may be a camera for capturing the inside of the store.
Moreover, the apparatus which mounts the control apparatus 10 of this embodiment is not limited to a cash dispenser, You may be arbitrary terminal devices. The cash dispenser 1 is an example of a terminal device.

  Some or all of the above embodiments may be described as in the following appendices, but is not limited thereto.

(Supplementary Note 1)
A personal information acquisition unit that acquires from the portable terminal the personal information input by the service terminal for the service requiring service identification on the portable terminal;
An identification information acquisition unit that reads identification information including the face image of the service applicant and the personal information from the identification;
A first image acquisition unit that acquires a first captured image obtained by capturing the face of the service applicant;
A personal identification unit that performs automatic personal identification based on the personal information, the identification information, and the first captured image;
A terminal device comprising

(Supplementary Note 2)
The difference between the reading time of the identification card information and the photographing time of the first photographed image is within a predetermined time.
The terminal device according to appendix 1.

(Supplementary Note 3)
The identification card information acquiring unit further includes the identification card information of the service applicant displayed on the surface of the identification card, and the status of the service applicant recorded in a storage medium included in the identification card. Get certificate information,
The identity verification unit further performs identity verification based on the identification card information displayed on the surface of the identification card information and the identification card information recorded on the storage medium.
The terminal device according to Appendix 1 or 2.

(Supplementary Note 4)
A control unit that controls application processing to the service based on the result of the identification by the identification unit and the information on the service applicant;
The terminal device according to any one of supplementary notes 1 to 3, further comprising

(Supplementary Note 5)
A second image acquisition unit for acquiring a second photographed image obtained by photographing the service applicant including the rear of the service applicant;
A behavior determination unit that determines the behavior of the service applicant based on the second captured image;
And further
When it is determined that the behavior of the service applicant has a suspicious point, the control unit disables the application process for the service or advances by adding warning information.
The terminal device according to appendix 4.

(Supplementary Note 6)
The information processing apparatus further comprising an additional information acquisition unit that acquires additional information for the service applicant.
The control unit disables application processing for the service according to the additional information, or proceeds with the addition of warning information.
The terminal device according to Appendix 4 or 5.

(Appendix 7)
The additional information is an evaluation based on the number of times the service applicant is included in an image in a predetermined period in the past captured by a camera that captures a space in which the terminal device is installed.
The terminal device according to appendix 6.

(Supplementary Note 8)
The service that requires the identification is the account opening of a financial institution,
The terminal device according to any one of Appendixes 1 to 7.

(Appendix 9)
A personal information acquisition unit that acquires from the portable terminal the personal information input by the service terminal for the service requiring service identification on the portable terminal;
An identification information acquisition unit that reads identification information including the face image of the service applicant and the personal information from the identification;
A first image acquisition unit that acquires a first captured image obtained by capturing the face of the service applicant;
A personal identification unit that performs automatic personal identification based on the personal information, the identification information, and the first captured image;
Cash dispenser equipped with.

(Supplementary Note 10)
Acquiring from the portable terminal the personal information input by the service terminal for the service requiring service identification on the portable terminal;
Reading from the identification card identification information including the face image of the service applicant and the personal information;
Acquiring a first captured image obtained by capturing the face of the service applicant;
Performing automatic identity verification based on the personal information, the identification card information, and the first captured image;
How to receive a service application with

(Supplementary Note 11)
Terminal computer,
A means for acquiring, from the portable terminal, personal information inputted by the service terminal for a service requiring service identification on the portable terminal;
A means for reading from the identification card identification information including the face image of the service applicant and the personal information;
A unit for acquiring a first photographed image obtained by photographing the face of the service applicant;
A means for performing automatic identity verification based on the personal information, the identification card information, and the first photographed image;
Program to function as.

1 ... cash dispenser 2 ... portable terminal 3 ... account opening system 4 ... dedicated server 5 ... store terminal 51 ... first camera 52 ... second camera 10 ... Control device 11 Main display 12 NFC antenna 13 Compact display 14 Code reader 15 Third camera 16 Money slot 17 Card slot 18 Receipt discharge port 101 ... control unit 102 ... personal information acquisition unit 103 ... identification card information acquisition unit 104 ... first image acquisition unit 105 ... second image acquisition unit 106 ... -Identity confirmation unit 107-Behavior determination unit 108-Additional information acquisition unit 109-Communication unit 110-Storage unit 201-Display unit 202-Input unit 203-Application 204- · · Communication unit 205 · · · Storage unit 401 ... control unit 402 ... customer recognition section 403 ... authorization information obtaining unit 404 ... Communication unit 405 ... storage unit

Claims (7)

A personal information acquisition unit that acquires from the portable terminal the personal information input by the service terminal for the service requiring service identification on the portable terminal;
An identification information acquisition unit that reads identification information including the face image of the service applicant and the personal information from the identification;
A first image acquisition unit that acquires a first captured image obtained by capturing the face of the service applicant;
A personal identification unit that performs automatic personal identification based on the personal information, the identification information, and the first captured image;
An additional information acquisition unit that acquires additional information for the service applicant;
A control unit that controls an application process to the service based on the result of the identification by the identification unit and the additional information;
Equipped with
The additional information is information based on the number of times the service applicant is included in an image captured during a predetermined period in the past by a camera that captures a space in which the device is installed.
When the additional information indicates that the number of times the service applicant is included in the image is equal to or more than a predetermined number, the control unit continues the application process for the service, and the additional information indicates the number of times When it is indicated that the number is less than the predetermined number, information indicating that a certain alert is necessary is added to the additional information, and the application process for the service is continued.
Terminal equipment. The control unit performs identity verification on the service applicant when the number of times the service applicant is included in the image is less than a predetermined number.
The terminal device according to claim 1. A personal information acquisition unit that acquires from the portable terminal the personal information input by the service terminal for the service requiring service identification on the portable terminal;
An identification information acquisition unit that reads identification information including the face image of the service applicant and the personal information from the identification;
A first image acquisition unit that acquires a first captured image obtained by capturing the face of the service applicant;
A personal identification unit that performs automatic personal identification based on the personal information, the identification information, and the first captured image;
An approval information acquisition unit for acquiring approval information indicating the recognition of the service applicant from others;
A control unit that controls an application process for the service based on the result of the identification by the identification unit and the approval information;
Equipped with
When the approval information indicates that the service applicant is recognized by the other person, the control unit continues the application process for the service, and the approval information indicates that the service applicant is the others. If it indicates that the person has not been recognized or has been recognized as having a suspicious behavior, reference information corresponding to the approval information is added to the additional information for the service applicant, and the service is Continue to apply for
Terminal equipment. The difference between the reading time of the identification card information and the photographing time of the first photographed image is within a predetermined time.
The terminal device according to any one of claims 1 to 3. The identification card information acquiring unit further includes the identification card information of the service applicant displayed on the surface of the identification card, and the status of the service applicant recorded in a storage medium included in the identification card. Get certificate information,
The identity verification unit further performs identity verification based on the identification card information displayed on the surface of the identification card information and the identification card information recorded on the storage medium.
The terminal device according to any one of claims 1 to 4. Acquiring from the portable terminal the personal information input by the service terminal for the service requiring service identification on the portable terminal;
Reading from the identification card identification information including the face image of the service applicant and the personal information;
Acquiring a first captured image obtained by capturing the face of the service applicant;
Performing automatic identity verification based on the personal information, the identification card information, and the first captured image;
Acquiring additional information for the service applicant;
Controlling an application process to the service based on the result of the identity verification in the identity verification step and the additional information on the service applicant;
Have
The additional information is information based on the number of times the service applicant is included in an image captured during a predetermined period in the past by a camera that captures a space in which the service applicant exists.
In the controlling step, when the additional information indicates that the number of times the service applicant includes the image is equal to or more than a predetermined number, the application process to the service is continued, and the additional information is the number of times If the number of times is less than a predetermined number of times, information indicating that a certain alert is necessary is added to the additional information, and the application process for the service is continued.
Service application acceptance method. Terminal computer,
A means for acquiring, from the portable terminal, personal information inputted by the service terminal for a service requiring service identification on the portable terminal;
A means for reading from the identification card identification information including the face image of the service applicant and the personal information;
A unit for acquiring a first photographed image obtained by photographing the face of the service applicant;
A means for performing automatic identity verification based on the personal information, the identification card information, and the first photographed image;
Means for acquiring additional information for the service applicant,
Means for controlling application processing to the service based on the result of the principal confirmation by the means for performing the principal confirmation and additional information on the service applicant
To act as
The additional information is information based on the number of times the service applicant is included in an image captured during a predetermined period in the past by a camera that captures a space in which the terminal device is installed,
When the additional information indicates that the number of times the service applicant includes the image is equal to or more than a predetermined number, the controlling means continues the application process to the service, and the additional information is the number of times If the number of times is less than a predetermined number of times, information indicating that a certain alert is necessary is added to the additional information, and the application process for the service is continued.
program.

Images