WO2022034668A1 - Dispositif de traitement d'informations, procédé de traitement d'informations et support de stockage - Google Patents

Dispositif de traitement d'informations, procédé de traitement d'informations et support de stockage Download PDF

Info

Publication number
WO2022034668A1
WO2022034668A1 PCT/JP2020/030764 JP2020030764W WO2022034668A1 WO 2022034668 A1 WO2022034668 A1 WO 2022034668A1 JP 2020030764 W JP2020030764 W JP 2020030764W WO 2022034668 A1 WO2022034668 A1 WO 2022034668A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
data
user
biometric authentication
biometric
Prior art date
Application number
PCT/JP2020/030764
Other languages
English (en)
Japanese (ja)
Inventor
統 坂口
智弘 波多江
洋児 青木
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Priority to JP2022542549A priority Critical patent/JPWO2022034668A5/ja
Priority to PCT/JP2020/030764 priority patent/WO2022034668A1/fr
Publication of WO2022034668A1 publication Critical patent/WO2022034668A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis

Definitions

  • the present invention relates to an information processing device, an information processing method, and a recording medium.
  • Patent Document 1 describes ticketless boarding in which various procedures are performed by face recognition at multiple checkpoints (check-in lobby, security checkpoint, boarding gate, etc.) in the airport using passenger biometric information (face image). The system is disclosed.
  • Patent Document 1 discloses a configuration for using face recognition for business in an airport. However, Patent Document 1 does not envision a mechanism for verifying whether or not face authentication (biometric authentication) for passengers is properly executed between each terminal and a server.
  • an object of the present invention to provide an information processing device, an information processing method, and a recording medium that can easily verify whether or not biometric authentication is properly executed.
  • an acquisition unit that acquires the user's biometric information and the biometric authentication verification data from a terminal used for the user's biometric authentication, and the biometric authentication for the acquired biometric information.
  • An information processing apparatus including an authentication unit for executing the above and a control unit for associating the processing result in the biometric authentication with the verification data is provided.
  • the step of acquiring the user's biometric information and the biometric authentication verification data from the terminal used for the user's biometric authentication, and the biometric authentication for the acquired biometric information are performed.
  • An information processing method including a step to be executed and a step of associating the processing result in the biometric authentication with the verification data is provided.
  • a recording medium in which a program for executing the biometric authentication step and a step of associating the processing result in the biometric authentication with the verification data are recorded is provided.
  • an information processing device an information processing method and a recording medium that can easily verify whether or not biometric authentication is properly executed.
  • FIG. 1 is a schematic diagram showing an overall configuration example of the information processing system 1 according to the present embodiment.
  • the information processing system 1 is a computer system that supports operations related to a series of examination procedures performed on a user (traveler) U who uses the airport A.
  • the information processing system 1 is operated by, for example, a public institution such as an immigration control bureau or a trustee entrusted with the business by the institution.
  • the check-in terminal 20, the automatic baggage deposit machine 30, the security inspection device 40, the automated gate device 50, and the boarding gate device 60 are connected to the common management server 10 via the network NW.
  • the network NW is composed of a LAN (Local Area Network) including an airport A premises communication network, a WAN (Wide Area Network), a mobile communication network, and the like.
  • the connection method is not limited to the wired method and may be a wireless method.
  • FIG. 1 illustrates only the terminal device used for the procedure at the time of departure from the airport A for convenience of explanation.
  • the terminals of the check-in terminal 20, the automatic baggage deposit machine 30, the security inspection device 40, the automated gate device 50, and the boarding gate device 60 may be collectively referred to as an edge terminal 200.
  • the management server 10 is an information processing device that manages operations related to examination procedures at the time of entry and departure of user U.
  • the management server 10 is installed in, for example, a facility of an airport company, an airline company, or the like that operates the airport A. Further, the management server 10 may be a cloud server instead of a server installed in a facility where business is actually performed.
  • the management server 10 does not have to be a single server, and may be configured as a server group including a plurality of servers.
  • the examination procedure at the time of departure at Airport A is carried out sequentially at the five touch points TP1 to TP5.
  • the relationship between each device and the touch points TP1 to TP5 will be described.
  • the check-in terminal 20 is installed in the check-in lobby (hereinafter referred to as "touch point TP1") in the airport A.
  • the check-in terminal 20 is a self-terminal for performing a check-in procedure by the user U operating by himself / herself.
  • the check-in terminal 20 is also called a CUSS (Comon Use Self Service) terminal.
  • the automatic baggage deposit machine 30 is installed in an area adjacent to the baggage counter (manned counter) in the airport A or an area near the check-in terminal 20 (hereinafter referred to as "touch point TP2").
  • the automatic baggage deposit machine 30 is a self-terminal for performing a procedure (baggage deposit procedure) for depositing baggage that is not brought into the aircraft by the user U operating by himself / herself.
  • the automatic baggage deposit machine 30 is also called a CUBD (Comon Use Bag Drop) terminal.
  • CUBD Commission Use Bag Drop
  • the security inspection device 40 is installed at the security inspection site (hereinafter referred to as "touch point TP3") in Airport A.
  • the security inspection device 40 is a device for confirming whether or not the user U is wearing metals that can be dangerous substances by using a metal detector.
  • the phrase "security inspection device” in this embodiment is not limited to metal detectors, but also includes X-ray inspection devices that use X-rays to check for dangerous substances in carry-on baggage, etc., and security inspections. It is used in the sense that it also includes a terminal device of a passenger passage confirmation system (PRS: Passenger Recognition System) that determines whether or not the user U can pass at the entrance of the venue.
  • PRS Passenger Recognition System
  • the automated gate device 50 is installed at the immigration checkpoint (hereinafter referred to as "touch point TP4") in Airport A.
  • the automated gate device 50 is a device that automatically performs the departure examination procedure of the user U. After completing the departure examination procedure at Touchpoint TP4, User U moves to the departure area where duty-free shops and boarding gates are provided.
  • the boarding gate device 60 is a traffic control device installed for each boarding gate in the departure area (hereinafter referred to as "touch point TP5").
  • the boarding gate device 60 is also called an ABG (Automated Boarding Gates) terminal.
  • the boarding gate device 60 confirms that the user U is a passenger of an aircraft that can board from the boarding gate. After completing the procedure at Touchpoint TP5, User U boarded the aircraft and left the first country for the second country.
  • the management server 10 has a token ID information DB 11, a passage history information DB 12, a business information DB 13, and an authentication history information DB 14.
  • the database of the management server 10 is not limited to these databases.
  • FIG. 2 is a diagram showing an example of information stored in the token ID information DB 11.
  • the token ID information DB 11 includes a token ID, a group ID, a registered face image, a feature amount, a token issuing time, a token issuing device name, an invalid flag, and an invalidation time as data items.
  • the token ID is an identifier that uniquely identifies the ID information.
  • the token ID in the present embodiment is temporarily issued on condition that the collation result of the face image of the user U holding the passport at the touch point TP1 and the passport face image read from the passport match. .. Then, when the user U completes the procedure at the touch point TP5 (boarding gate), the token ID is invalidated. That is, the token ID is not an identifier that is used permanently, but a one-time ID that has a valid period (life cycle).
  • the group ID is an identifier for grouping the ID information.
  • the registered face image is a face image registered for the user U.
  • the feature amount is a value extracted from biological information (registered face image).
  • the phrase of the biological information in the present embodiment means the facial image and the feature amount extracted from the facial image, but the biological information is not limited to the facial image and the facial feature amount. That is, biometric authentication may be performed using an iris image, a fingerprint image, a palm print image, an auricle image, or the like as the biometric information of the user U.
  • the token issuance time is the time when the management server 10 issues the token ID.
  • the token issuing device name is the device name of the acquisition source of the registered face image that triggered the issuance of the token ID.
  • the invalid flag is flag information indicating whether or not the token ID is currently valid. When the token ID is issued, the invalid flag in the present embodiment becomes, for example, a value of "1" indicating a valid state of the token ID. Further, when a predetermined condition is satisfied, the invalid flag is updated to a value of "0" indicating, for example, the token ID is invalid.
  • the invalidation time is the time stamp when the invalidation flag is invalidated.
  • FIG. 3 is a diagram showing an example of information stored in the passage history information DB 12.
  • the passage history information DB 12 includes a passage history ID, a token ID, a passage time, a device name, a business system type, and a passage touch point as data items.
  • the passage history ID is an identifier that uniquely identifies the passage history information.
  • the transit time is a time stamp when the touch point is passed.
  • the device name is the machine name of the business terminal used for the procedure at the touch point.
  • the business system type is the type of the business system to which the business terminal belongs.
  • FIG. 4 is a diagram showing an example of information stored in the business information DB 13.
  • the business information DB 13 includes a token ID, passenger name, reservation number, departure place, destination, airline code, flight number, operation date, seat number, nationality, passport number, surname, first name, date of birth and gender. Is a data item.
  • the business information DB 13 stores business information related to a predetermined business for each token ID.
  • the "predetermined work” means the procedure work performed at the touch points TP1 to TP5, respectively.
  • the reservation number is an identifier that uniquely identifies the boarding reservation information.
  • An airline code is an identifier that uniquely identifies an airline.
  • the boarding reservation information included in the business information includes passenger name, reservation number, departure place, destination, airline code, flight number, date of operation, seat number, nationality, passport number, surname, first name, year of birth. Date and gender can be mentioned. Boarding reservation information can be obtained from recording media such as passports and boarding passes. The boarding reservation information can also be obtained from the airline reservation system (not shown) using the passport number or reservation number as a key. Then, the acquired boarding reservation information is stored as business information in the business information DB 13.
  • FIG. 5 is a diagram showing an example of information stored in the authentication history information DB 14.
  • the authentication history information DB 14 includes the authentication history ID, the authentication date and time, the authentication result, the verification score, and the verification data (1) to (n) as data items.
  • the authentication result is the success or failure of the authentication process.
  • the collation score is a score indicating the degree of similarity between the target face image acquired from the user U and the registered face image registered in advance for the registrant. When the collation score is equal to or higher than a predetermined threshold value, the management server 10 can authenticate that the collation target person is the same person as the registrant.
  • the verification data (1) to (n) are data for verifying whether or not the biometric authentication for each user U is properly executed. Examples of the verification data (1) to (n) include attribute information of the user U and shooting conditions (biological information acquisition conditions) of the biological image.
  • FIG. 6 is a functional block diagram of the management server 10.
  • the management server 10 has a storage unit 10A, a transmission / reception unit 10B, a data extraction unit 10C, a biometric authentication unit 10D, a token ID issuing unit 10E, a business processing unit 10F, and a verification unit 10G.
  • the function of the management server 10 is not limited to that shown in the figure.
  • the storage unit 10A stores the above-mentioned token ID information, passage history information, business information, authentication history information, and the like.
  • the transmission / reception unit 10B receives the request data D1 from the edge terminal 200 and transmits the processing result in the management server 10 to the edge terminal 200 as the response data D2.
  • the edge terminal 200 in the present embodiment corresponds to each terminal device of the check-in terminal 20, the automatic baggage deposit machine 30, the security inspection device 40, the automated gate device 50, and the boarding gate device 60.
  • the data extraction unit 10C determines the API to be called based on the command included in the received request data D1, extracts the control data, the face recognition data, and the business data included in the request data D1 to each API. Sort. Further, the data extraction unit 10C extracts the verification data included in the request data D1 and stores it in the storage unit 10A.
  • the biometric authentication unit 10D collates the target face image extracted from the request data D1 with the passport face image. Further, when the biometric authentication unit 10D determines in the data extraction unit 10C that the command content indicates a "face authentication execution request", the biometric authentication unit 10D stores the target face image extracted from the request data D1 in the storage unit 10A. Check with the face image (registered face image) of the registered registrant.
  • the token ID issuing unit 10E issues a token ID to the user U when the collation result of the target face image and the passport face image in the biometric authentication unit 10D are collated and matched.
  • the business processing unit 10F is a collection of X (X ⁇ 1) APIs that execute data processing related to business, and is called by the data extraction unit 10C.
  • X X ⁇ 1
  • the data extraction unit 10C first calls the biometric authentication unit 10D to execute the collation process, and the baggage deposit is based on the collation result. Call the business API related to the procedure. Since the biometric authentication unit 10D and any business API can be activated by the data extracted by the data extraction unit 10C, the face authentication technology can be easily applied to various business operations.
  • the verification unit 10G verifies the authentication result based on the verification data. Specifically, the verification unit 10G calculates the average value of the collation score and the authentication rate for each data item included in the verification data by statistical processing. In the statistical processing, the values of mean, standard deviation, variance, and correlation are calculated as appropriate. As a result, the verification unit 10G analyzes the causal relationship between the authentication result and the data item.
  • FIG. 7 is a diagram illustrating a data structure of request data D1 transmitted by the edge terminal 200 to the management server 10.
  • the request data D1 is composed of a header portion H1 and a body portion B1.
  • the header unit H1 is an area for storing control data such as communication protocol, authentication information, request method (POST, GET, etc.), command and resource media type information, and the like.
  • the body portion B1 is an area for storing control data B11, verification data B12, face authentication data B13, and business data B14.
  • the control data B11 is data for controlling the operation of the business API, and is composed of data items that do not depend on the business. It is assumed that the control data B11 has a different control target from the control data stored in the header unit H1.
  • the control data of the header unit H1 includes an execution command relating to at least one of a business data registration process, a business data search process, a token ID issuance process, and biometric authentication.
  • the control data B11 of the body portion B1 includes data items such as a device name, a system type, and a location of the source of the request data D1.
  • the verification data B12 is data for later verifying the authentication result in the management server 10, and includes data items indicating conditions at the time of acquisition of biometric information.
  • the business data B14 is a data group in which n (n ⁇ 1) business data are encapsulated, and one label is given to the business data B14.
  • the individual business data (1) to (n) are stored in a lower layer and are used for processing of the business processing unit 10F. Further, each of the business data (1) to (n) is given a label so that the data item can be identified.
  • FIG. 8 is a diagram illustrating the data structure of the response data D2 transmitted by the management server 10 to the edge terminal 200.
  • the response data D2 is composed of a header portion H2 and a body portion B2. Unlike the case of the request data D1, the response data D2 does not include the verification data and the face authentication data.
  • the body portion B2 is an area for storing the control data B21 and the business data B22.
  • the configurations of the header portion H2 and the body portion B2 are the same as those of the header portion H1 and the body portion B1 shown in FIG. 7, but the types of stored data items do not necessarily have to match.
  • FIGS. 9 to 14 the hardware configuration of each device constituting the information processing system 1 will be described with reference to FIGS. 9 to 14. Note that the devices having the same name but different codes in FIGS. 9 to 14 have the same functions, and therefore detailed description thereof will be omitted in the subsequent drawings.
  • FIG. 9 is a block diagram showing an example of the hardware configuration of the management server 10.
  • the management server 10 has a CPU (Central Processing Unit) 101, a RAM (Random Access Memory) 102, a storage device 103, and a communication I / F 104. Each device is connected to the bus line 105.
  • CPU Central Processing Unit
  • RAM Random Access Memory
  • the CPU 101 is a processor having a function of performing a predetermined operation according to a program stored in the storage device 103 and controlling each part of the management server 10.
  • the CPU 101 functions as the transmission / reception unit 10B, the data extraction unit 10C, the biometric authentication unit 10D, the token ID issuing unit 10E, the business processing unit 10F, and the verification unit 10G described above.
  • the RAM 102 is composed of a volatile storage medium and provides a temporary memory area necessary for the operation of the CPU 101.
  • the storage device 103 is composed of a storage medium such as a non-volatile memory and a hard disk drive, and functions as a storage unit 10A.
  • the storage device 103 stores a program executed by the CPU 101, data referred to by the CPU 101 when the program is executed, and the like.
  • the communication I / F 104 is a communication interface based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), and 4G, and is a module for communicating with the check-in terminal 20 and the like.
  • the communication I / F 104 functions as a transmission / reception unit 10B together with the CPU 101.
  • FIG. 10 is a block diagram showing an example of the hardware configuration of the check-in terminal 20.
  • the check-in terminal 20 includes a CPU 201, a RAM 202, a storage device 203, a communication I / F 204, an input device 206, a display device 207, a medium reading device 208, and a biological information acquisition device 209. Each device is connected to bus line 205.
  • the input device 206 is, for example, a pointing device such as a touch panel, a keyboard, or the like.
  • the display device 207 and the input device 206 are integrally formed as a touch panel.
  • the display device 207 is a liquid crystal display device, an OLED (Organic Light Emitting Diode) display device, or the like, and is used for displaying moving images, still images, characters, and the like.
  • the medium reading device 208 is a device that reads a medium such as a passport or an airline ticket of the user U and acquires the information recorded on the medium.
  • the ticket medium include a paper ticket, a mobile terminal for displaying a copy of an e-ticket, and the like.
  • the medium reading device 208 is composed of, for example, a code reader, an image scanner, a non-contact IC (Integrated Circuit) reader, an OCR (Optical Character Reader) device, and the like, and acquires information from various media held over the reading unit.
  • the biometric information acquisition device 209 is a device that acquires the face image of the user U as the biometric information of the user U.
  • the biological information acquisition device 209 is, for example, a digital camera that photographs the face of the user U standing in front of the check-in terminal 20, and photographs the face of the user U to acquire the face image.
  • FIG. 11 is a block diagram showing an example of the hardware configuration of the automatic baggage deposit machine 30.
  • the automatic baggage depositor 30 includes a CPU 301, a RAM 302, a storage device 303, a communication I / F 304, an input device 306, a display device 307, a medium reader 308, a biometric information acquisition device 309, and a baggage transfer device 310. And has an output device 311. Each device is connected to bus line 305.
  • the baggage transport device 310 is a device that transports the baggage to the aircraft on which the user U is boarding.
  • the baggage transfer device 310 transports the baggage attached to the baggage tag placed in the receiving unit by the user U toward the baggage handling place.
  • the output device 311 is a device that outputs a baggage tag attached to checked baggage.
  • the output device 311 outputs a baggage redemption certificate necessary for baggage redemption after arriving at the destination.
  • the baggage tag and the baggage redemption certificate are associated with at least one of the passport number, the reservation number and the token ID.
  • FIG. 12 is a block diagram showing an example of the hardware configuration of the security inspection device 40.
  • the security inspection device 40 includes a CPU 401, a RAM 402, a storage device 403, a communication I / F 404, an input device 406, a display device 407, a medium reading device 408, a biometric information acquisition device 409, and a metal detection gate 410. Have. Each device is connected to a bus line 405.
  • the metal detection gate 410 is a gate type metal detector, and detects metals worn by the user U passing through the metal detection gate 410.
  • FIG. 13 is a block diagram showing an example of the hardware configuration of the automated gate device 50.
  • the automated gate device 50 includes a CPU 501, a RAM 502, a storage device 503, a communication I / F 504, an input device 506, a display device 507, a medium reading device 508, a biometric information acquisition device 509, and a gate 511. Each device is connected to bus line 505.
  • the gate 511 is controlled by the CPU 501 to block the passage of the user U during standby. It shifts to the open state that allows the passage of user U.
  • the method of the gate 511 is not particularly limited, and is, for example, a flapper gate that opens and closes a flapper provided from one side or both sides of the passage, a turnstile gate in which three bars rotate, and the like.
  • FIG. 14 is a block diagram showing an example of the hardware configuration of the boarding gate device 60.
  • the boarding gate device 60 includes a CPU 601, a RAM 602, a storage device 603, a communication I / F 604, an input device 606, a display device 607, a biometric information acquisition device 609, and a gate 611. Each device is connected to a bus line 605.
  • FIG. 15 is a sequence diagram showing an example of processing of the check-in terminal 20 and the management server 10. This process is executed when the user U performs the check-in procedure using the check-in terminal 20.
  • the check-in terminal 20 determines whether or not the ticket medium of the user U is held over the reading unit (not shown) of the medium reading device 208 (step S101), and waits until the ticket medium is held over. (Step S101, NO).
  • the check-in terminal 20 determines that the ticket medium is held over the reading unit of the medium reading device 208 (step S101, YES)
  • the check-in terminal 20 acquires the boarding reservation information of the user U from the held ticket medium.
  • the acquired boarding reservation information includes the family name, first name, airline code, flight number, boarding date, departure place (boarding airport), destination (arrival airport), seat number, boarding time, arrival time and the like.
  • the check-in terminal 20 determines whether or not the passport of the user U is held over the reading unit of the medium reader 208 (step S103), and waits until the passport is held (step S103, NO).
  • the check-in terminal 20 determines that the passport is held over the reading unit of the medium reader 208 (step S103, YES)
  • the check-in terminal 20 acquires the passport information of the user U from the held passport (step S104).
  • the acquired passport information includes the passport face image of the user U, the identity verification information, the passport number, the passport issuing country, and the like.
  • the check-in terminal 20 photographs the face of the user U by the biological information acquisition device 209, and acquires the face image as the target face image (step S105). Before taking the face image, it is preferable to display a guidance message regarding the taking of the face image on the screen and obtain the consent of the user U.
  • the check-in terminal 20 transmits request data requesting face image matching and token ID issuance to the management server 10 (step S106).
  • FIG. 16 is a diagram showing an example of request data D1 transmitted by the check-in terminal 20 to the management server 10.
  • the request data D1 is composed of a header portion H1 and a body portion B1.
  • a command (“Issue-tokenId”) indicating a request for issuing a token ID is described at the end of the URL.
  • the body portion B1 is composed of control data B11, verification data B12, face authentication data B13, and business data B14.
  • the control data B11 includes the location of the terminal (“location”), the terminal (“terminal”), the device name (“deviceName”), the system type (“systemType”), and the system vendor information (“system”) at the airport A.
  • the transmission time of the request data D1 (“reqTimeStamp”), the ID of the camera used for taking the face image (“cameraId”), and the label information and data of each item of the model name of the camera (“cameraModel”) are described. There is.
  • the verification data B12 describes label information and data for each item of gender (“Sex”), age (“Age”), height (“Height”), and shooting angle (“Angle”). These data items and data values are used in the verification process described later. For example, it can be extracted that the authentication rate of a person whose height is considerably shorter (or higher) than the average value is low, or the authentication rate of a person of a specific age group is low.
  • the face authentication data B13 labels for each item of the passport face image file name (“PassportFaceImage”), the shooting time of the photographed face image (“quareryTimeStamp”), and the file name of the photographed face image (“quareryFaceImage”). Information and data are provided.
  • one label (“appdata”) is attached to the business data B14, and the business data is surrounded by a symbol (“ ⁇ ”) indicating a start portion and a symbol (“ ⁇ ”) indicating an end portion.
  • the label information and data of each data item are described hierarchically.
  • the management server 10 collates the target face image taken by the check-in terminal 20 with the passport face image of the user U on a one-to-one basis (step S107). That is, in the example of FIG. 16, the management server 10 collates the photographed face image of the file name (“Q201902250000025.jpg”) with the passport face image of the file name (“P2019225000001.jpg”).
  • the management server 10 associates the verification result (verification score) in step S107, the authentication result (success / failure of authentication), and the verification data acquired from the check-in terminal 20 and registers them in the authentication history information DB 14 ( Step S108).
  • the management server 10 determines that the collation result between the target face image and the passport face image is a collation match (step S109, YES)
  • the management server 10 issues a token ID (step S110).
  • the token ID is set to a unique value based on, for example, the date and time at the time of processing and the sequence number.
  • the management server 10 registers the relationship between the token ID and the registered face image in the token ID information DB 11 with the target face image as the registered face image (step S111).
  • the reason why the face image (target face image) taken in the field is used as the registered face image is that the validity period (life cycle) of the token ID is completed within the day, and the taken image is the subsequent authentication process.
  • the image taken in 1 and the quality (appearance) are closer than the passport face image.
  • the passport face image may be set as the registered face image (registered biometric information). For example, if the life cycle of the token ID is long (for example, in the aviation industry, if the member is valid for the token ID for a certain period of time, etc.), the face image of the passport or driver's license may be used as the registered face image. It is good to set.
  • the management server 10 registers the relationship between the token ID and the business information in the business information DB 13 using the passport information and the boarding reservation information as business information (step S112).
  • the control data required for face authentication and the business information required for business execution are managed in separate databases, but the registered face image and the business information are associated with each other by the token ID.
  • a plurality of data items (passenger name (“PassengerName”), passport number (“PassportNum”), nationality (“Nationality”), and date of birth (“DateofBirth”) stored in the business data B14 are stored. ), Gender (“Sex”), etc.) are registered in the business information DB 13 as business information.
  • the data stored as the business data B14 changes according to the content of the command.
  • the management server 10 transmits the response data including the issued token ID and the collation result information of the collation match to the check-in terminal 20 (step S113).
  • FIG. 17 is a diagram showing an example of response data D2 transmitted by the management server 10 to the check-in terminal 20.
  • the response data D2 is composed of a header portion H2 and a body portion B2. Unlike the case of the request data D1, the response data D2 does not include the verification data and the face authentication data. Further, unlike the case of the control data B11 shown in FIG. 16, label information and data of each data item of the issued token ID (“tokenId”) and the processing code (“StatusCd”) indicating the processing status are described. ing.
  • the issued token ID is "T2019022000000020"
  • the processing code is "000" indicating normal termination.
  • the business data B22 contains label information and data of the same data items as the business data B14 shown in FIG.
  • the management server 10 determines that the collation result of the passport face image and the target face image is a collation mismatch (step S109, NO)
  • the management server 10 transmits the response data including the collation result information of the collation mismatch to the check-in terminal 20. (Step S114).
  • step S115 the management server 10 refers to the collation result included in the response data and determines whether or not the identity verification of the user U has been successful.
  • step S115 when the check-in terminal 20 determines that the identity verification of the user U has been successful (step S115, YES), the check-in procedure such as confirmation of the itinerary and selection of a seat based on the input information of the user U is performed. Is executed (step S116). Then, the check-in terminal 20 transmits the request data D1 requesting the registration of the passage history information of the user U to the management server 10 (step S117).
  • the management server 10 registers the passage history information indicating the relationship between the token ID and the passage information of the touch point TP1 in the passage history information DB 12 (step S118).
  • the management server 10 transmits the response data to the check-in terminal 20 (step S119), and ends the process.
  • the check-in terminal 20 refers to the response data received from the management server 10 and determines that the identity verification of the user U has failed (step S115, NO)
  • the check-in terminal 20 notifies the user U of an error message. (Step S120).
  • the target face image (photographed face image) that matches the passport face image obtained from the passport in the check-in procedure is registered in the token ID information DB 11 as a registered face image, and the registered face image is registered by the issued token ID.
  • FIG. 18 is a sequence diagram showing an example of processing of the automatic baggage deposit machine 30 and the management server 10. This process is executed when the user U who has completed the check-in procedure receives the baggage check-in procedure as necessary.
  • the automatic baggage depository machine 30 constantly or periodically photographs the front of the device, and determines whether or not the face of the user U standing in front of the automatic baggage depository machine 30 is detected in the captured images (step S201). ). The automatic baggage deposit machine 30 waits until the face of the user U is detected in the image by the biological information acquisition device 309 (step S201, NO).
  • the automatic baggage deposit machine 30 determines that the face of the user U is detected by the biometric information acquisition device 309 (step S201, YES)
  • the automatic baggage deposit machine 30 photographs the face of the user U and targets the face image of the user U. Acquired as a face image (step S202).
  • the automatic baggage deposit machine 30 transmits the request data D1 requesting the execution of the collation process between the target face image and the registered face image to the management server 10 (step S203).
  • the management server 10 collates the face image of the user U (step S204). That is, the management server 10 collates the target face image included in the request data D1 received from the automatic baggage deposit machine 30 with the plurality of registered face images registered in the token ID information DB 11 on a one-to-N basis.
  • the registered face image to be collated is limited to the image associated with the token ID whose invalid flag value is "1" (valid).
  • the management server 10 associates the verification result (verification score) in step S204, the authentication result (success / failure of authentication), and the verification data acquired from the check-in terminal 20 and registers them in the authentication history information DB 14 ( Step S205).
  • the management server 10 determines whether or not the collation result is a collation match (step S206).
  • the management server 10 determines that the collation result is a collation mismatch (step S206, NO)
  • the management server 10 transmits response data including the collation result information of the mismatch to the automatic baggage deposit machine 30 (step S209). )
  • the process proceeds to step S210.
  • the management server 10 determines that the collation result is a collation match (step S206, YES)
  • the process proceeds to step S207.
  • step S207 the management server 10 acquires business information from the business information DB 13 using the token ID associated with the registered face image of the collation match in the token ID information DB 11 as a key. Then, the management server 10 transmits the response data to the automatic baggage deposit machine 30 (step S208). After that, the process proceeds to step S210.
  • step S210 the management server 10 refers to the collation result included in the response data and determines whether or not the identity verification of the target person has been successful.
  • the automatic baggage deposit machine 30 refers to the collation result included in the response data, and when it is determined that the identity verification is successful (step S210, YES), the automatic baggage deposit machine 30 executes the baggage deposit procedure of the user U (step S210, YES). Step S211).
  • the automatic baggage deposit machine 30 transmits the request data D1 requesting the registration of the passage history information of the user U to the management server 10 (step S212).
  • the management server 10 When the management server 10 receives the request data from the automatic baggage deposit machine 30, the management server 10 registers the passage history information indicating the relationship between the token ID and the passage information of the touch point TP2 of the user U in the passage history information DB 12 (step S213). ..
  • the management server 10 transmits the response data to the automatic baggage deposit machine 30 (step S214), and ends the process.
  • the automatic baggage deposit machine 30 refers to the response data and determines that the identity verification has failed (step S210, NO)
  • the automatic baggage deposit machine 30 notifies the user U of an error message (step S215).
  • FIG. 19 is a flowchart showing an example of the verification process of the management server 10. This process is executed, for example, when the current time reaches a predetermined start time.
  • the management server 10 determines whether or not the current time is the start time of the verification process (step S301).
  • the process proceeds to step S302.
  • the management server 10 determines that the current time is not the start time of the verification process (step S301, NO)
  • the standby state is maintained.
  • step S302 the management server 10 acquires the authentication history information from the authentication history information DB 14.
  • the management server 10 executes an authentication history information analysis process (statistical process) for each item of verification data (step S303).
  • the management server 10 outputs the verification result (step S304) and ends the process.
  • the verification result output method screen display, file output, database registration, etc. are appropriately selected.
  • the authentication history information (log data) of all biometric authentication executed during the operation of the system is stored in the management server 10. Further, since the authentication history information is associated with the biometric authentication processing result and the verification data, the management server 10 can verify the biometric authentication processing result for each data item of the verification data. As a result, for example, the administrator can identify a factor that lowers the success rate of biometric authentication based on the verification result, and can easily deal with it.
  • FIG. 20 is a block diagram showing an overall configuration example of the information processing system 2 in the present embodiment.
  • the information processing system 2 includes a management server 10, a plurality of biometric authentication terminals 70, and an administrator terminal 80.
  • the management server 10 is connected to a plurality of biometric authentication terminals 70 via a network NW1 such as the Internet. Further, the management server 10 is connected to the administrator terminal 80 via a network NW2 such as a LAN.
  • the biometric authentication terminal 70 is a terminal used by the user for biometric authentication.
  • Examples of the biometric authentication terminal 70 include terminals such as the check-in terminal 20 described in the first embodiment, an automatic ticket vending machine, a gate device installed in various facilities, and the like.
  • the type of the biometric authentication terminal 70 is not limited.
  • the administrator terminal 80 is a terminal used by the administrator for maintenance work of the management server 10. Examples of the administrator terminal 80 include a personal computer, a tablet terminal, and the like.
  • the management server 10 of the present embodiment has the user information DB 15 and the authentication history information DB 14.
  • the database of the management server 10 is not limited to these databases.
  • FIG. 21 is a diagram showing an example of information stored in the user information DB 15.
  • the user information DB 15 has user ID, registered face image, feature amount, name, gender, age and height as data items.
  • the data items stored in the user information DB 15 are not limited to these.
  • FIG. 22 is a block diagram showing an example of the hardware configuration of the biometric authentication terminal 70.
  • the biometric authentication terminal 70 includes a CPU 701, a RAM 702, a storage device 703, a communication I / F 704, an input device 706, a display device 707, a medium reading device 708, and a biometric information acquisition device 709. .. Each device is connected to a bus line 705.
  • FIG. 23 is a block diagram showing an example of the hardware configuration of the administrator terminal 80.
  • the administrator terminal 80 has a CPU 801 and a RAM 802, a storage device 803, a communication I / F 804, an input device 806, and a display device 807. Each device is connected to bus line 805.
  • FIG. 24 is a functional block diagram of the information processing system 2.
  • the management server 10 has a storage unit 10A, a transmission / reception unit 10B, a data extraction unit 10C, a biometric authentication unit 10D, and a verification unit 10G, as in the first embodiment. Unlike the first embodiment, the management server 10 of the present embodiment does not have to have the token ID issuing unit 10E and the business processing unit 10F.
  • the transmission / reception unit 10B receives the verification request from the administrator terminal 80
  • the transmission / reception unit 10B causes the verification unit 10G to execute the verification process.
  • the transmission / reception unit 10B transmits the verification result in the verification unit 10G to the administrator terminal 80.
  • FIG. 25 is a diagram showing an example of data items included in the verification data in the present embodiment.
  • the items of the verification data the subject ID, gender, height, standing position, face position, shooting location, eyeglasses, moving speed, and lighting conditions are listed.
  • FIG. 26 is a sequence diagram showing an example of processing of the biometric authentication terminal 70 and the management server 10. This process is executed, for example, when an inspector of the biometric authentication terminal 70 tests the accuracy of biometric authentication in the terminal.
  • the biometric authentication terminal 70 displays the verification data input screen on the display device 707 based on the input operation from the inspector (step S401).
  • the biometric authentication terminal 70 acquires the verification data input on the input screen (step S402).
  • the biometric authentication terminal 70 photographs the face of the collation target person by the biometric information acquisition device 709 and acquires a face image (step S403).
  • the biometric authentication terminal 70 transmits the request data including the target face image and the verification data to the management server 10 (step S404).
  • the management server 10 collates the target face image included in the request data with the registered face image of the registrant registered in advance in the database (step S405).
  • the management server 10 registers the authentication history information associated with the collation result and the verification data in step S405 in the authentication history information DB 14 (step S406).
  • the management server 10 transmits the response data to the biometric authentication terminal 70 (step S407).
  • the biometric authentication terminal 70 determines whether or not to end the biometric authentication test based on the input operation from the inspector (step S408).
  • the biometric authentication terminal 70 determines that the biometric authentication test is completed (step S408, YES)
  • the biometric authentication terminal 70 ends the process. If the biometric authentication terminal 70 determines that the biometric authentication test is not completed (step S408, NO), the process returns to step S401.
  • FIG. 27 is a diagram showing an example of a verification data input screen displayed on the biometric authentication terminal 70.
  • the subject ID is an identifier that uniquely identifies the subject.
  • the orientation of the face indicates which direction the subject is facing up, down, left, or right with respect to the camera.
  • the standing position indicates whether the subject is standing to the left, in the center, or to the right within the shooting range of the camera.
  • the moving speed is indicated when the subject is stationary, walking, or running.
  • the movement speed and the orientation of the face may be manually input by the administrator, or may be automatically determined on the terminal side based on the measured values of sensors (not shown).
  • FIG. 28 is a flowchart showing an example of the verification process of the management server 10. This process is executed, for example, when the administrator performs verification work of the authentication result.
  • the management server 10 displays a verification condition specification screen in response to an input operation from the administrator (step S501).
  • the management server 10 acquires the verification conditions input by the administrator on the verification condition specification screen (step S502).
  • the management server 10 executes an analysis process for the authentication history information stored in the authentication history information DB 14 based on the verification conditions (step S503).
  • the management server 10 executes the analysis process within the specified range.
  • the management server 10 displays the verification result display screen (step S504).
  • the verification result display screen for example, information obtained by analyzing the authentication result for each data item of the verification data is displayed.
  • the management server 10 determines whether or not to end the verification work based on the presence or absence of an input operation from the administrator (step S505).
  • the management server 10 determines that the verification work is completed (step S505, YES)
  • the management server 10 ends the process.
  • step S505 determines that the verification work is not completed (step S505, NO)
  • the process returns to step S501.
  • FIG. 29 is a diagram showing an example of a verification condition designation screen displayed on the administrator terminal 80.
  • verification conditions terminal-specific VC-1, model-specific VC-2, gender VC-3, face orientation VC-4, standing position VC-5, standing position VC-5, shooting location VC-6, time zone.
  • VC-7 the user's moving speed VC-8, and whether or not the glasses are worn VC-9.
  • FIG. 30 is a diagram showing an example of a verification result display screen displayed on the administrator terminal 80.
  • the verification result when "by terminal" is specified as the verification condition is displayed on the screen.
  • the horizontal axis of the graph showing the verification result is the average authentication rate
  • the vertical axis shows the terminal ID of the biometric authentication terminal 70.
  • the average authentication rate of the terminal whose terminal ID is "# 63" is relatively lower than that of other terminals.
  • the administrator performs re-verification under other verification conditions in order to identify the cause of the low average authentication rate in the terminal.
  • the biometric authentication test result and the verification data can be associated and registered in the database.
  • the manufacturer can efficiently execute the test of the biometric authentication terminal 70 and support the development work of the terminal.
  • FIG. 31 is a block diagram showing the configuration of the information processing apparatus 100 according to the present embodiment.
  • the information processing apparatus 100 includes an acquisition unit 100A, an authentication unit 100B, and a control unit 100C.
  • the acquisition unit 100A acquires the user's biometric information and biometric authentication verification data from the terminal used for the user's biometric authentication.
  • the authentication unit 100B and the biometric authentication for the acquired biometric information are executed.
  • the control unit 100C associates the processing result in biometric authentication with the verification data.
  • an information processing apparatus 100 that can easily verify whether or not biometric authentication is properly executed.
  • the present invention is applied to business at an airport.
  • the configuration of the present invention can be applied to business using biometric authentication in any industry such as railway industry, accommodation industry, service industry, and manufacturing industry.
  • the request data and the response data are described in the JSON format, but may be described in another data format such as the XML format. That is, any data format that can encapsulate business data is sufficient.
  • the management server 10 automatically executes the log data statistics / analysis processing has been described, but a part or all of the statistics / analysis processing is performed by a human being. You may do so. Further, the management server 10 may be configured to automatically identify data items that are the main cause of the decrease in the authentication rate and present them to the administrator.
  • Each embodiment also has a processing method in which a program for operating the configuration of the embodiment is recorded on a recording medium so as to realize the functions of the above-described embodiment, the program recorded on the recording medium is read out as a code, and the program is executed by a computer.
  • a computer-readable recording medium is also included in the scope of each embodiment. Further, not only the recording medium on which the above-mentioned program is recorded but also the program itself is included in each embodiment.
  • the recording medium for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a non-volatile memory card, or the like can be used.
  • a floppy (registered trademark) disk for example, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a non-volatile memory card, or the like
  • the program recorded on the recording medium that executes the process alone, but also the program that operates on the OS and executes the process in cooperation with other software and the function of the expansion board is also an embodiment. Is included in the category of.
  • An acquisition unit that acquires the user's biometric information and the biometric authentication verification data from the terminal used for the user's biometric authentication.
  • An authentication unit that executes the biometric authentication for the acquired biometric information,
  • a control unit that associates the processing result in the biometric authentication with the verification data, Information processing device equipped with.
  • Appendix 2 Verification unit that verifies the processing result based on the verification data, The information processing apparatus according to Appendix 1, further comprising.
  • the verification unit verifies the correlation between the value of the data item included in the verification data and the processing result for each data item.
  • the information processing device according to Appendix 2.
  • the verification unit identifies the terminal whose authentication rate in biometric authentication is less than a predetermined value among the plurality of terminals.
  • the information processing apparatus according to Appendix 2 or 3.
  • the acquisition unit acquires the control data for controlling the execution of the biometric authentication and the business data generated when a predetermined business is executed on the terminal, together with the biometric information and the verification data.
  • a business processing unit that processes the business data when the user is authenticated by the biometric authentication.
  • the verification data includes the attribute information of the user when the biometric information is a biometric image.
  • the information processing apparatus according to any one of Supplementary Provisions 1 to 5.
  • the attribute information includes at least one of gender, age, and height.
  • the information processing apparatus according to Appendix 6.
  • the verification data includes the imaging conditions of the biological image when the biological information is a biological image.
  • the information processing apparatus according to any one of Supplementary Provisions 1 to 5.
  • the shooting conditions further include at least one of a lighting condition, a shooting direction and a shooting location.
  • the information processing apparatus according to Appendix 8.
  • the imaging condition further includes the moving speed of the user at the time of capturing the biological image.
  • the information processing apparatus according to Appendix 8 or 9.
  • the imaging condition includes information on whether or not a predetermined article is included in the region of the acquisition site of the biological image at the time of photographing the biological image.
  • the information processing apparatus according to any one of Supplementary note 8 to 10.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Tourism & Hospitality (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Economics (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Devices For Checking Fares Or Tickets At Control Points (AREA)

Abstract

Un dispositif de traitement d'informations selon la présente invention comprend : une unité d'acquisition qui acquiert, à partir d'un terminal destiné à être utilisé dans une authentification biologique d'un utilisateur, des informations biologiques de l'utilisateur et des données de vérification pour l'authentification biologique; une unité d'authentification qui exécute l'authentification biologique par rapport aux informations biologiques acquises; et une unité de commande qui associe les données de vérification et un résultat de traitement dans l'authentification biologique.
PCT/JP2020/030764 2020-08-13 2020-08-13 Dispositif de traitement d'informations, procédé de traitement d'informations et support de stockage WO2022034668A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2022542549A JPWO2022034668A5 (ja) 2020-08-13 情報処理装置、情報処理方法及びプログラム
PCT/JP2020/030764 WO2022034668A1 (fr) 2020-08-13 2020-08-13 Dispositif de traitement d'informations, procédé de traitement d'informations et support de stockage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/030764 WO2022034668A1 (fr) 2020-08-13 2020-08-13 Dispositif de traitement d'informations, procédé de traitement d'informations et support de stockage

Publications (1)

Publication Number Publication Date
WO2022034668A1 true WO2022034668A1 (fr) 2022-02-17

Family

ID=80247081

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/030764 WO2022034668A1 (fr) 2020-08-13 2020-08-13 Dispositif de traitement d'informations, procédé de traitement d'informations et support de stockage

Country Status (1)

Country Link
WO (1) WO2022034668A1 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008065651A (ja) * 2006-09-08 2008-03-21 Ntt Data Corp 顔画像認証方法、顔画像認証装置、および、プログラム
JP2013167986A (ja) * 2012-02-15 2013-08-29 Hitachi Ltd 画像認識システム、画像認識方法

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008065651A (ja) * 2006-09-08 2008-03-21 Ntt Data Corp 顔画像認証方法、顔画像認証装置、および、プログラム
JP2013167986A (ja) * 2012-02-15 2013-08-29 Hitachi Ltd 画像認識システム、画像認識方法

Also Published As

Publication number Publication date
JPWO2022034668A1 (fr) 2022-02-17

Similar Documents

Publication Publication Date Title
JP7482381B2 (ja) 情報処理装置、情報処理方法及び記録媒体
JP7380723B2 (ja) 情報処理装置、情報処理方法及びプログラム
US11113912B2 (en) Information processing apparatus, information processing method, and storage medium
US20240127132A1 (en) Information processing apparatus, information processing method, and storage medium
US20220058760A1 (en) Information processing apparatus, information processing method, and storage medium
US20220343673A1 (en) Information processing apparatus, information processing method and storage medium
JP7298733B2 (ja) サーバ装置、システム、サーバ装置の制御方法及びコンピュータプログラム
US20240028682A1 (en) Information processing apparatus, information processing method, and storage medium
JP2024023992A (ja) 情報処理装置、情報処理方法及びプログラム
WO2022034668A1 (fr) Dispositif de traitement d'informations, procédé de traitement d'informations et support de stockage
JP7298737B2 (ja) サーバ装置、システム、サーバ装置の制御方法及びコンピュータプログラム
US20230377398A1 (en) Information processing apparatus, information processing method, and storage medium
JP7279784B2 (ja) 情報処理装置、情報処理方法及びプログラム
CN114586054A (zh) 管理服务器、系统、令牌发放方法和存储介质
JP7031798B2 (ja) プログラム、情報処理装置及び情報処理方法
JP7040690B1 (ja) サーバ装置、システム、サーバ装置の制御方法及びコンピュータプログラム
US20230360805A1 (en) Information processing apparatus, information processing method, and storage medium
US20220414195A1 (en) Information processing apparatus, information processing method, and storage medium
US20220060851A1 (en) Information processing apparatus, information processing method, and storage medium
JP2023115090A (ja) サーバ装置、サーバ装置の制御方法及びコンピュータプログラム
JP2023115091A (ja) サーバ装置、システム、サーバ装置の制御方法及びコンピュータプログラム
JP2021149856A (ja) 行動観察システム及び行動観察方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20949530

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022542549

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20949530

Country of ref document: EP

Kind code of ref document: A1