WO2024252924A1 - 情報処理装置、情報処理システム、情報処理方法及びプログラム - Google Patents

情報処理装置、情報処理システム、情報処理方法及びプログラム Download PDF

Info

Publication number
WO2024252924A1
WO2024252924A1 PCT/JP2024/018742 JP2024018742W WO2024252924A1 WO 2024252924 A1 WO2024252924 A1 WO 2024252924A1 JP 2024018742 W JP2024018742 W JP 2024018742W WO 2024252924 A1 WO2024252924 A1 WO 2024252924A1
Authority
WO
WIPO (PCT)
Prior art keywords
target
entering
eye distance
image
respect
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2024/018742
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
佳奈子 丸崎
政義 山浦
智弘 波多江
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Corp
Original Assignee
NEC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Corp filed Critical NEC Corp
Priority to JP2025526043A priority Critical patent/JPWO2024252924A1/ja
Publication of WO2024252924A1 publication Critical patent/WO2024252924A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • E—FIXED CONSTRUCTIONS
    • E05—LOCKS; KEYS; WINDOW OR DOOR FITTINGS; SAFES
    • E05B—LOCKS; ACCESSORIES THEREFOR; HANDCUFFS
    • E05B49/00—Electric permutation locks; Circuits therefor ; Mechanical aspects of electronic locks; Mechanical keys therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07B—TICKET-ISSUING APPARATUS; FARE-REGISTERING APPARATUS; FRANKING APPARATUS
    • G07B15/00—Arrangements or apparatus for collecting fares, tolls or entrance fees at one or more control points
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00—Individual registration on entry or exit
    • G07C9/20—Individual registration on entry or exit involving the use of a pass
    • G07C9/22—Individual registration on entry or exit involving the use of a pass in combination with an identity check of the pass holder
    • G07C9/25—Individual registration on entry or exit involving the use of a pass in combination with an identity check of the pass holder using biometric data, e.g. fingerprints, iris scans or voice recognition
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00—Individual registration on entry or exit
    • G07C9/20—Individual registration on entry or exit involving the use of a pass
    • G07C9/27—Individual registration on entry or exit involving the use of a pass with central registration

Definitions

  • This disclosure relates to an information processing device, an information processing system, an information processing method, and a program.
  • Patent Document 1 discloses a technology that captures an image of an object in the area in front of the gate device, and estimates the positional relationship between the gate device and the object using a reference value set based on the eye distance of the object in the captured image and the attributes of the object in the captured image (for example, gender, generation, age (adult or child, etc.), and race).
  • Patent Document 1 does not take into account individual differences in the eye distance of an object entering a gate device when calculating the positional relationship between the gate device and the object. Therefore, the technology in Patent Document 1 has the problem that it may erroneously calculate the positional relationship between the object entering the gate device and the gate device.
  • the present disclosure aims to provide an information processing device, information processing system, information processing method, and program that can accurately calculate the positional relationship between an object entering a gate device and the gate device.
  • the information processing device of the present disclosure includes: a first image acquisition unit that acquires a first image including the registration target, the first image being captured under a condition in which a relative position of the registration target with respect to a photographing device is determined; an individual difference information calculation unit that calculates individual difference information of the eye distance of the registration target based on the eye distance of the registration target in the first image; A registration unit that links and registers face information of the registration target in the first image and individual difference information of an eye distance of the registration target; a second image acquisition unit that acquires a second image including the entry object before the entry into the gate device; a position calculation unit that calculates a relative position of the entering target with respect to the gate device based on an eye-to-eye distance of the entering target in the second image; and a position correction unit that corrects the relative position of the entering target with respect to the gate device based on individual difference information of the eye distance of the entering target that is registered in association with the facial information of the entering target after authenticating the entering target using the facial information of the entering target in
  • the information processing system of the present disclosure includes: a first image acquisition unit that acquires a first image including the registration target, the first image being captured under a condition in which a relative position of the registration target with respect to a photographing device is determined; an individual difference information calculation unit that calculates individual difference information of the eye distance of the registration target based on the eye distance of the registration target in the first image; A registration unit that links and registers face information of the registration target in the first image and individual difference information of an eye distance of the registration target; a second image acquisition unit that acquires a second image including the entry object before the entry into the gate device; a position calculation unit that calculates a relative position of the entering target with respect to the gate device based on an eye-to-eye distance of the entering target in the second image; and a position correction unit that corrects the relative position of the entering target with respect to the gate device based on individual difference information of the eye distance of the entering target that is registered in association with the facial information of the entering target after authenticating the entering target using the facial information of the entering target in
  • the information processing method of the present disclosure includes: The computer A first image including the registration target is acquired, the first image being captured under a condition in which a relative position of the registration target with respect to a photographing device is determined; Calculating individual difference information of the eye distance of the registration target based on the eye distance of the registration target in the first image; registering face information of the registration target in the first image and individual difference information of the eye distance of the registration target in association with each other; acquiring a second image including the entering object before entering the gate device; Calculating a relative position of the entering object with respect to the gate device based on an eye-to-eye distance of the entering object in the second image; After authenticating the entering target using the facial information of the entering target in the second image, the relative position of the entering target with respect to the gate device is corrected based on individual difference information of the eye distance of the entering target that is linked to and registered in association with the facial information of the entering target.
  • the program of the present disclosure is A first image including the registration target is acquired, the first image being captured under a condition in which a relative position of the registration target with respect to a photographing device is determined; Calculating individual difference information of the eye distance of the registration target based on the eye distance of the registration target in the first image; registering face information of the registration target in the first image and individual difference information of the eye distance of the registration target in association with each other; acquiring a second image including the entering object before entering the gate device; Calculating a relative position of the entering object with respect to the gate device based on an eye-to-eye distance of the entering object in the second image; After authenticating the entering target using the facial information of the entering target in the second image, a computer executes a process to correct the relative position of the entering target with respect to the gate device based on individual difference information of the eye distance of the entering target that is linked to and registered in association with the facial information of the entering target.
  • the present disclosure provides an information processing device, information processing system, information processing method, and program that can accurately calculate the positional relationship between an object entering a gate device and the gate device.
  • FIG. 1 is a block diagram showing an example of a configuration of an information processing device 1 according to an embodiment.
  • 1 is a block diagram showing an example of a configuration of an information processing system 2 according to an embodiment.
  • 2 is a block diagram showing an example of a configuration of a registration processing device 20 of an information processing system 2 according to an embodiment.
  • FIG. 2 is a block diagram showing an example of a configuration of a master device 30 of an information processing system 2 according to the embodiment.
  • FIG. 2 is a block diagram showing an example of the configuration of a ticket gate processing device 40 of the information processing system 2 according to the embodiment.
  • FIG. 1 is a diagram showing an example of the arrangement of a second photographing device 50 and a ticket gate device 60 of an information processing system 2 according to an embodiment.
  • FIG. 4 is a flowchart showing an operation of a registration processing device 20 of the information processing system 2 according to the embodiment. 4 is a flowchart showing the operation of a ticket gate processing device 40 of the information processing system 2 according to the embodiment.
  • 2 is a block diagram showing an example of a configuration of a registration processing device 70 of the information processing system 3 according to the embodiment.
  • FIG. 2 is a block diagram showing an example of the configuration of a ticket gate processing device 80 of the information processing system 3 according to the embodiment.
  • FIG. FIG. 5 is a block diagram showing an example of the configuration of a computer 500 according to the embodiment.
  • the information processing device 1 includes a first image acquisition unit 21, an individual difference information calculation unit 25, and a registration unit 26.
  • the information processing device 1 also includes a second image acquisition unit 41, a position calculation unit 44, and a position correction unit 47.
  • the first image acquisition unit 21 acquires a first image including a registration target, which is captured under conditions in which the relative position of the registration target with respect to the image capture device is determined.
  • the personal difference information calculation unit 25 calculates personal difference information of the eye distance of the registration target based on the eye distance of the registration target in the first image.
  • the registration unit 26 links and registers the face information of the registration target in the first image and the personal difference information of the eye distance of the registration target.
  • the second image acquisition unit 41 acquires a second image including the entering target before entering the gate device.
  • the position calculation unit 44 calculates the relative position of the entering target with respect to the gate device based on the eye distance of the entering target in the second image.
  • the position correction unit 47 corrects the relative position of the entering target with respect to the gate device based on the individual difference information of the eye distance of the entering target registered in association with the facial information of the entering target.
  • the information processing device 1 corrects the relative position of an object entering the gate device with respect to the gate device, taking into account individual differences in the eye-to-eye distance of the object entering the gate device. Therefore, the information processing device 1 can accurately calculate the positional relationship between the object entering the gate device and the gate device.
  • the information processing system 2 includes a first photographing device 10, a registration processing device 20, a master device 30, a ticket gate processing device 40, a second photographing device 50, and a ticket gate device 60.
  • the registration processing device 20, the master device 30, and the ticket gate processing device 40 of the information processing system 2 are embodiments of the information processing device 1 according to the first embodiment.
  • the ticket gate device 60 is an example of a gate device according to the first embodiment.
  • the first image capturing device 10 is, for example, a camera and has a function of capturing images.
  • the first image capturing device 10 communicates with the registration processing device 20.
  • the first photographing device 10 photographs a first image including a registration target under a condition where the relative position of the registration target with respect to the first photographing device 10 is determined.
  • the first photographing device 10 photographs a first image including a registration target under a condition where the distance between the first photographing device 10 and the registration target is constant.
  • the first photographing device 10 photographing under a condition where the distance between the first photographing device and the registration target is constant, the difference in eye distance due to the difference in distance between the first photographing device and the registration target at the time of photographing does not affect the individual difference in the eye distance of the registration target described later.
  • the first photographing device 10 is installed in, for example, a photo booth. Then, the first photographing device 10 transmits the first image including the registration target to the registration processing device 20.
  • the registration processing device 20 is, for example, a server.
  • the registration processing device 20 communicates with the first image capturing device 10 and the master device 30.
  • the registration processing device 20 includes a first image acquisition unit 21 , a first face detection unit 22 , a first face information extraction unit 23 , a first eye distance measurement unit 24 , a personal difference information calculation unit 25 and a registration unit 26 .
  • the first image acquisition unit 21 acquires from the first image capturing device 10 a first image including a registration target captured by the first image capturing device 10 .
  • the first face detection unit 22 detects a face to be registered in the first image from the first image.
  • the first face information extraction unit 23 extracts face information of the target from the face of the target in the first image.
  • the face information is information that represents the features of the face of the target.
  • the face information is the positional relationship and size of the face features such as the eyes and nose of the target.
  • the first eye distance measurement unit 24 measures the eye distance of the registered subject from the face of the registered subject in the first image.
  • the eye distance represents, for example, the distance between the center of the pupil of the right eye and the center of the pupil of the left eye.
  • the unit of the eye distance is calculated, for example, in pixels.
  • the personal difference information calculation unit 25 calculates personal difference information of the eye distance of the registered subject based on the eye distance of the registered subject and the standard value of eye distance (i.e. the eye distance of a standard person).
  • the standard value of eye distance is, for example, the average value of the eye distances of multiple registered subjects measured by the first eye distance measurement unit 24.
  • the personal difference information calculation unit 25 calculates the difference between the eye distance of the registered subject and the standard value of eye distance as the personal difference information of the eye distance of the registered subject.
  • the personal difference information calculation unit 25 calculates the ratio of the eye distance of the registered subject to the standard value of eye distance as the personal difference information of the eye distance of the registered subject.
  • the individual difference information calculation unit 25 may calculate the individual difference information of the eye distance of the registration subject taking into consideration the attributes of the registration subject, such as the gender and age. For example, when the registration subject is male, the individual difference information calculation unit 25 may calculate the difference between the eye distance of the registration subject and the standard value of eye distance for men as the individual difference information of the eye distance of the registration subject.
  • the standard value of eye distance for men is, for example, the average value of the eye distance of multiple male persons.
  • the registration unit 26 links the face information of the person to be registered with the individual difference information of the eye distance of the person to be registered and registers it in the master device 30. Note that the registration unit 26 may link the face information of the person to be registered with other information such as the ID of the person to be registered and register it in the master device 30.
  • the master device 30 is, for example, a server.
  • the master device 30 communicates with the registration processing device 20 and the ticket gate processing device 40.
  • the master device 30 includes a storage unit 31.
  • the storage unit 31 stores face information of at least one person to be registered and individual difference information of the eye distance of the person to be registered in association with each other.
  • the second photographing device 50 is, for example, a camera and has a function of photographing an image.
  • the second photographing device 50 communicates with the ticket gate processing device 40.
  • the second photographing device 50 is installed near the ticket gate device 60.
  • the second photographing device 50 photographs a second image including the entering target before entering the ticket gate device 60.
  • the second photographing device 50 transmits the second image including the entering target to the ticket gate processing device 40.
  • the ticket gate processing device 40 is, for example, a server.
  • the ticket gate processing device 40 communicates with the master device 30, the second photographing device 50 and the ticket gate device 60.
  • the ticket gate processing device 40 includes a second image acquisition unit 41, a second face detection unit 42, a second eye distance measurement unit 43, a position calculation unit 44, a second face information extraction unit 45, an authentication unit 46, a position correction unit 47 and a ticket gate control unit 48.
  • the second image acquisition unit 41 acquires a second image including the entering object before entering the ticket gate device 60 , which is photographed by the second photographing device 50 .
  • the second face detection unit 42 detects the face of an intruding target within the second image from the second image.
  • the second eye distance measuring unit 43 measures the eye distance of the entering target from the face of the entering target in the second image.
  • the position calculation unit 44 calculates the relative position of the entering target with respect to the ticket gate device based on the eye-to-eye distance of the entering target.
  • the relative position of the entering target with respect to the ticket gate device 60 indicates the distance and direction of the entering target from the ticket gate device 60.
  • the position calculation unit 44 calculates the relative position of the entering target with respect to the ticket gate device 60 based on the eye-to-eye distance of the entering target and a reference value.
  • the reference value is a value for calculating the relative position of a standard person with respect to the ticket gate device 60 from the eye-to-eye distance of a standard person.
  • the reference value of the eye-to-eye distance is determined according to the eye-to-eye distance of a standard person. Therefore, the calculated relative position of the entering target with respect to the ticket gate device 60 needs to be corrected.
  • the second face information extraction unit 45 extracts face information of the entering target from the face of the entering target in the second image.
  • the authentication unit 46 compares the facial information of the entry target with the facial information of the registered target, and performs authentication processing of the entry target based on the comparison result. Specifically, when facial information of the registered target that matches the facial information of the entry target to a predetermined degree or more is stored in the master device 30, the authentication unit 46 determines that the authentication of the entry target is successful. On the other hand, when facial information of the registered target that matches the facial information of the entry target to a predetermined degree or more is not stored in the master device 30, the authentication unit 46 determines that the authentication of the entry target is unsuccessful. Also, for example, as shown in FIG. 6, the authentication unit 46 starts authentication processing of the entry target A at an authentication start position P1 in front of the entrance of the ticket gate device 60.
  • the authentication start position P1 is a position 800 mm away from a position P3 at the end of the ticket gate device 60.
  • the position correction unit 47 acquires the individual difference information of the eye distance of the entering target registered in association with the facial information of the entering target.
  • the position correction unit 47 corrects the relative position of the entering target with respect to the ticket gate device based on the individual difference information of the eye distance of the entering target.
  • the position correction unit 47 corrects the reference value used by the position calculation unit 44 to a reference value corresponding to the entering target using the individual difference information of the eye distance of the entering target.
  • the position correction unit 47 calculates the relative position of the entering target with respect to the ticket gate device 60 based on the eye distance of the entering target and the corrected reference value.
  • the position correction unit 47 corrects the eye distance of the entering target to an eye distance corresponding to a standard person using the individual difference information of the eye distance of the entering target.
  • the position correction unit 47 calculates the relative position of the entering target with respect to the ticket gate device 60 based on the corrected eye distance and the reference value.
  • the ticket gate control unit 48 determines whether the entry target has reached the ticket arrival position.
  • the ticket arrival position is the position where it is determined that the entry target will enter the ticket gate device 60. For example, as shown in FIG. 6, the ticket gate control unit 48 determines whether the entry target A has reached the ticket arrival position P2.
  • the ticket arrival position P2 is a position 300 mm away from the end position P3 of the ticket gate device 60. If the ticket gate control unit 48 determines that the entry target has reached the ticket arrival position, the ticket gate control unit 48 controls the ticket gate device 60 based on the authentication result. For example, if the authentication is successful, the ticket gate control unit 48 controls the gate of the ticket gate device 60 to open, and allows the entry target to pass through the ticket gate device 60.
  • the ticket gate control unit 48 controls the gate of the ticket gate device 60 to close, and does not allow the entry target to pass through the ticket gate device 60.
  • the ticket gate control unit 48 controls the ticket gate device 60 based on the authentication result until the determination completion position P4 is reached.
  • the determination completion position P4 is a position 600 mm away from the end position P3 of the ticket gate device 60. If the ticket gate device 60 does not have a physical gate, the ticket gate control unit 48 may control the registration subject to be notified by voice or display whether or not the registration subject is permitted to pass through the ticket gate device 60.
  • the ticket gate device 60 is a gate installed at a ticket gate of a railway station, for example.
  • the ticket gate device 60 communicates with the ticket gate processing device 40.
  • the ticket gate device 60 is a ticket gate that allows an entering target to enter without a ticket by performing face authentication processing on the entering target.
  • the ticket gate device 60 may be a ticket gate that requires the entering target to have a ticket, but uses face authentication to check whether the entered target with the ticket that requires personal identification matches the entered target.
  • the ticket gate device 60 may be a gate device that does not have a ticket gate function, for example, a gate device installed at an airport boarding gate or at the entrance to a building.
  • the first image acquisition unit 21 of the registration processing device 20 acquires a first image including a registration target captured by the first photographing device 10 from the first photographing device 10 (step S101).
  • the first image is an image captured by the first photographing device 10 under conditions in which the distance between the first photographing device 10 and the registration target is a predetermined distance.
  • the first face detection unit 22 detects the face to be registered in the first image from the first image (step S102).
  • the first face information extraction unit 23 extracts face information of the registration target from the face to be registered in the first image (step S103).
  • the first eye distance measurement unit 24 measures the eye distance of the registration target from the face of the registration target in the first image (step S104).
  • the personal difference information calculation unit 25 calculates personal difference information of the eye distance of the registration target based on the eye distance of the registration target and the standard value of eye distance (step S105).
  • the personal difference information of the eye distance of the registration target represents the difference between the eye distance of the registration target and the standard value of eye distance.
  • the registration unit 26 links the face information of the person to be registered with the individual difference information of the eye distance of the person to be registered and registers them in the master device 30 (step S106).
  • the order of processing steps S101 to S106 in the registration processing device 20 is not limited to the example of this embodiment.
  • the registration processing device 20 may perform the processing of step S103 after the processing of step S104.
  • the second image acquisition unit 41 of the ticket gate processing device 40 acquires a second image including the entering target before entering the ticket gate device 60, photographed by the second photographing device 50 (step S201).
  • the second face detection unit 42 detects the face of the entering target in the second image from the second image (step S202).
  • the second eye distance measurement unit 43 measures the eye distance of the entering target from the face of the entering target in the second image (step S203).
  • the position calculation unit 44 calculates the relative position of the entering target with respect to the ticket gate device 60 based on the eye distance of the entering target (step S204). Specifically, the position calculation unit 44 calculates the relative position of the entering target with respect to the ticket gate device 60 based on the eye distance of the entering target and a reference value.
  • the second face information extraction unit 45 extracts face information of the intrusion target from the face of the intrusion target in the second image (step S205).
  • the authentication unit 46 compares the face information of the intrusion target with the face information of the registered target stored in the master device 30, and performs authentication processing of the intrusion target based on the comparison result (step S206).
  • step S207 determines whether the authentication of the entry target is successful. If it is determined that the authentication of the entry target is successful (YES in step S207), the process proceeds to step S208. On the other hand, if it is determined that the authentication of the entry target is unsuccessful (NO in step S207), the process proceeds to step S210, which will be described later.
  • step S208 the position correction unit 47 acquires from the master device 30 the personal difference information of the eye distance of the entering target stored in the master device 30 in association with the facial information of the entering target.
  • the position correction unit 47 corrects the relative position of the entering target with respect to the ticket gate device 60 calculated by the position calculation unit 44 based on the personal difference information of the eye distance of the entering target (step S209).
  • the position correction unit 47 corrects the reference value used by the position calculation unit 44 to a reference value corresponding to the entering target using the personal difference information of the eye distance of the entering target.
  • the position correction unit 47 calculates the relative position of the entering target with respect to the ticket gate device 60 based on the eye distance of the entering target and the corrected reference value.
  • the position correction unit 47 corrects the eye distance of the entering target to the eye distance corresponding to a standard person using the personal difference information of the eye distance of the entering target.
  • the position correction unit 47 calculates the relative position of the entry target with respect to the ticket gate device 60 based on the corrected eye-to-eye distance and the reference value.
  • step S210 the ticket gate control unit 48 determines whether the entry target has reached the ticket receiving position. If it is determined that the entry target has reached the ticket receiving position (YES in step S210), the process proceeds to step S211. On the other hand, if it is determined that the entry target has not reached the ticket receiving position (NO in step S210), the process returns to step S201.
  • step S211 the ticket gate control unit 48 controls the ticket gate device 60 based on the authentication result. For example, if the authentication is successful, the ticket gate control unit 48 opens the gate of the ticket gate device 60 to allow the entry target to enter. On the other hand, if the authentication is unsuccessful, the ticket gate control unit 48 opens the gate of the ticket gate device 60 to prevent the entry target from entering.
  • step S210 if the ticket gate processing device 40 can track the entering target in the newly acquired second image, it does not have to perform the authentication process in step S206. And, if the ticket gate processing device 40 can store the individual difference information of the eye distance of the entering target in its own device, it does not have to perform the process of acquiring the individual difference information of the eye distance of the entering target in step S208.
  • the order of the processing of steps S201 to S211 in the ticket gate processing device 40 is not limited to the example of this embodiment.
  • the ticket gate processing device 40 may perform the processing of steps S203 to S204 after the processing of steps S205 to S206.
  • the information processing system 2 corrects the relative position of the target entering the ticket gate device 60 with respect to the ticket gate device 60, taking into account individual differences in the eye-to-eye distance of the target entering the ticket gate device 60. In this way, the information processing system 2 can accurately calculate the positional relationship between the target entering the ticket gate device 60 and the ticket gate device 60.
  • the technology according to Patent Document 1 is used in a ticket gate device, which is a gate device.
  • the technology according to Patent Document 1 has the problem that it cannot determine whether the entering target has actually reached the ticket receiving position at the ticket gate device. For example, if the eye distance of the entering target is larger than that of a standard person, it is determined that the entering target has reached the ticket receiving position at a point farther from the ticket gate device than it should be. On the other hand, if the eye distance of the entering target is smaller than that of a standard person, it is determined that the entering target has reached the ticket receiving position at a point closer to the ticket gate device than it should be.
  • the information processing system 2 corrects the relative position of the entering target with respect to the ticket gate device 60, taking into account individual differences in the eye-to-eye distance of the entering target entering the ticket gate device 60. Therefore, the information processing system 2 can accurately determine whether the entering target has actually reached the ticket receiving position.
  • the information processing system 2 does not need to control the permission or denial of passage of the ticket gate device 60 for entering targets that would not normally pass through the ticket gate device 60, such as an entering target that changes course midway to use a different ticket gate device 60.
  • the information processing system 2 can reduce the possibility that the order in which multiple entering targets pass through the ticket gate device as determined by the system will be swapped, even if there is a large difference in the eye-to-eye distance between multiple targets when they pass through the gate close together.
  • the resolution of the first image captured by the first image capturing device 10 may differ from that of the second image captured by the second image capturing device 50.
  • the distance between the first image capturing device and the object corresponding to the eye distance of the object in the first image may differ from the distance between the second image capturing device and the object corresponding to the eye distance of the object at the same distance in the second image.
  • the resolution of the first image is 2160 x 3840 (pix)
  • the distance between the first image capturing device 10 and the object corresponding to the eye distance of the object in the first image of 300 (pix) is assumed to be 1 m.
  • the distance between the second image capturing device 50 and the object corresponding to the eye distance of the object in the second image of 300 (pix) may not be 1 m.
  • the difference in resolution between the first image and the second image may affect the calculation result of the positional relationship between the ticket gate device 60 and the entry object entering the ticket gate device 60.
  • the information processing system 3 further includes a registration processing device 70 and a ticket gate processing device 80.
  • the registration processing device 70 includes a first resolution correction unit 71 in addition to the configuration of the registration processing device 20 of the information processing system 2 .
  • the first resolution correction unit 71 acquires the resolution of the first image from setting information, etc. of the first photographing device 10.
  • the first resolution correction unit 71 also acquires the resolution of the second image from setting information, etc. of the second photographing device 50.
  • the first resolution correction unit 71 corrects the resolution of the first image acquired by the first image acquisition unit 21 so as to be the same as the resolution of the second image acquired by the second image acquisition unit 41.
  • the first face detection unit 22 detects the face of the registration target in the first image from the first image whose resolution has been corrected.
  • the ticket gate processing device 80 further includes a second resolution correction unit 81 in addition to the configuration of the ticket gate processing device 40 of the information processing system 2 .
  • the second resolution correction unit 81 acquires the resolution of the first image from setting information, etc. of the first photographing device 10.
  • the second resolution correction unit 81 also acquires the resolution of the second image from setting information, etc. of the second photographing device 50.
  • the second resolution correction unit 81 corrects the resolution of the second image acquired by the second image acquisition unit 41 so as to be the same as the resolution of the first image by the first image acquisition unit 21.
  • the second face detection unit 42 detects the face of the entering target in the second image from the second image whose resolution has been corrected.
  • the information processing system 3 may further include a registration processing device 70 in addition to the first photographing device 10, the master device 30, the ticket gate processing device 40, the second photographing device 50, and the ticket gate device 60 of the information processing system 2.
  • the information processing system 3 may further include a ticket gate processing device 80 in addition to the first photographing device 10, the registration processing device 20, the master device 30, the second photographing device 50, and the ticket gate device 60 of the information processing system 2.
  • the positional relationship between the ticket gate device 60 and the object entering the ticket gate device 60 can be calculated with high accuracy.
  • Each functional component of each device (such as the first photographing device 10, the registration processing device 20, the master device 30, the ticket gate processing device 40, the second photographing device 50, the ticket gate device 60, the registration processing device 70 and the ticket gate processing device 80) of the information processing device 1 and the information processing systems 2 and 3 according to the above-mentioned embodiments may be realized by hardware (e.g., a hardwired electronic circuit) that realizes each functional component, or may be realized by a combination of hardware and software (e.g., a combination of an electronic circuit and a program that controls it).
  • hardware e.g., a hardwired electronic circuit
  • software e.g., a combination of an electronic circuit and a program that controls it.
  • Fig. 11 is a block diagram showing an example of a hardware configuration of a computer 500 according to an embodiment.
  • the computer 500 may be a portable computer such as a smartphone or a tablet terminal, or a stationary computer such as a PC (Personal Computer).
  • the computer 500 may be a dedicated computer or a general-purpose computer. For example, by installing a specific application on the computer 500, the computer 500 can have a desired function.
  • Computer 500 has bus 501, processor 502, memory 503, storage device 504, input/output interface (I/F) 505, and network interface (I/F) 506.
  • Bus 501 is a data transmission path for processor 502, memory 503, storage device 504, input/output interface 505, and network interface 506 to transmit and receive data to and from each other.
  • the method of connecting processor 502 and the like to each other is not limited to bus connection.
  • the processor 502 is a variety of processors, such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or an FPGA (Field-Programmable Gate Array).
  • the memory 503 is a primary storage device realized using RAM (Random Access Memory) or the like.
  • the storage device 504 is an auxiliary storage device realized using a hard disk, SSD (Solid State Drive), memory card, or ROM (Read Only Memory) or the like.
  • the input/output interface 505 is an interface for connecting the computer 500 to an input/output device.
  • an input device such as a keyboard and an output device such as a display device are connected to the input/output interface 505.
  • the network interface 506 is an interface for connecting the computer 500 to a network.
  • This network may be a LAN (Local Area Network) or a WAN (Wide Area Network).
  • Storage device 504 stores programs for implementing desired functions.
  • storage device 504 of computer 500 stores programs for implementing each function.
  • Processor 502 reads these programs into memory 503 and executes them to implement each function.
  • These programs include instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments.
  • the programs may be stored on a non-transitory computer-readable medium or tangible storage medium.
  • computer-readable media or tangible storage media include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray® disk or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device.
  • the programs may be transmitted on a transitory computer-readable medium or communication medium.
  • transitory computer-readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.
  • Each component of the information processing device 1 and each device of the information processing systems 2 and 3 according to the embodiment may be realized by a single device or by multiple devices.
  • the registration processing devices 20, 70, the master device 30, and the ticket gate processing devices 40, 80 are not limited to servers, and may be realized by edge terminals.
  • a first image acquisition unit that acquires a first image including the registration target, the first image being captured under a condition in which a relative position of the registration target with respect to a photographing device is determined; an individual difference information calculation unit that calculates individual difference information of the eye distance of the registration target based on the eye distance of the registration target in the first image; A registration unit that links and registers face information of the registration target in the first image and individual difference information of an eye distance of the registration target; a second image acquisition unit that acquires a second image including the entry object before the entry into the gate device; a position calculation unit that calculates a relative position of the entering target with respect to the gate device based on an eye-to-eye distance of the entering target in the second image; and a position correction unit that corrects a relative position of the entering target with respect to the gate device based on individual difference information of an eye distance of the entering target that is registered in
  • the position calculation unit is Calculating a relative position of the approaching object with respect to the gate device based on the eye-to-eye distance of the approaching object and a reference value;
  • the reference value is a value for calculating a relative position of a standard person with respect to the gate device from the eye distance of the standard person,
  • the position correction unit is correcting the reference value to a reference value corresponding to the intrusion target using individual difference information of the eye distance of the intrusion target;
  • the information processing device further comprising: a step of calculating a relative position of the entering object with respect to the gate device based on the eye-to-eye distance of the entering object and the corrected reference value.
  • the position calculation unit is Calculating a relative position of the approaching object with respect to the gate device based on the eye-to-eye distance of the approaching object and a reference value; the reference value is a value for calculating a relative position of a standard person with respect to the gate device from the eye distance of the standard person,
  • the position correction unit is correcting the eye distance of the intrusion target to an eye distance corresponding to the standard person using personal difference information of the eye distance of the intrusion target;
  • the information processing device further comprising: a step of calculating a relative position of the entering object with respect to the gate device based on the corrected eye-to-eye distance and the reference value.
  • a first image acquisition unit that acquires a first image including the registration target, the first image being captured under a condition in which a relative position of the registration target with respect to a photographing device is determined; an individual difference information calculation unit that calculates individual difference information of the eye distance of the registration target based on the eye distance of the registration target in the first image; A registration unit that links and registers face information of the registration target in the first image and individual difference information of an eye distance of the registration target; a second image acquisition unit that acquires a second image including the entry object before the entry into the gate device; a position calculation unit that calculates a relative position of the entering target with respect to the gate device based on an eye-to-eye distance of the entering target in the second image; and a position correction unit that corrects a relative position of the entering target with respect to the gate device based on individual difference information of an eye distance of the entering target that is registered in association with the face information of the entering target after authenticating the entering target using the face information of the entering target in the second image.
  • the position calculation unit is Calculating a relative position of the approaching object with respect to the gate device based on the eye-to-eye distance of the approaching object and a reference value;
  • the reference value is a value for calculating a relative position of a standard person with respect to the gate device from the eye distance of the standard person,
  • the position correction unit is correcting the reference value to a reference value corresponding to the intrusion target using individual difference information of the eye distance of the intrusion target;
  • the information processing system further comprising: a step of calculating a relative position of the approaching object with respect to the gate device based on the eye-to-eye distance of the approaching object and the corrected reference value.
  • the position calculation unit is Calculating a relative position of the approaching object with respect to the gate device based on the eye-to-eye distance of the approaching object and a reference value; the reference value is a value for calculating a relative position of a standard person with respect to the gate device from the eye distance of the standard person,
  • the position correction unit is correcting the eye distance of the intrusion target to an eye distance corresponding to the standard person using personal difference information of the eye distance of the intrusion target;
  • the information processing system further comprising: calculating a relative position of the entering object with respect to the gate device based on the corrected eye-to-eye distance and the reference value.
  • a first image including the registration target is acquired, the first image being captured under a condition in which a relative position of the registration target with respect to a photographing device is determined; Calculating individual difference information of the eye distance of the registration target based on the eye distance of the registration target in the first image; registering face information of the registration target in the first image and individual difference information of the eye distance of the registration target in association with each other; acquiring a second image including the entering object before entering the gate device; Calculating a relative position of the entering object with respect to the gate device based on an eye-to-eye distance of the entering object in the second image; and after authenticating the entering target using facial information of the entering target in the second image, correcting a relative position of the entering target with respect to the gate device based on individual difference information of an eye distance of the entering target that is linked to and registered with the facial information of the entering target.
  • Calculating the relative position of the entering target with respect to the gate device based on the eye-to-eye distance of the entering target includes calculating the relative position of the entering target with respect to the gate device based on the eye-to-eye distance of the entering target and a reference value, the reference value is a value for calculating a relative position of a standard person with respect to the gate device from the eye distance of the standard person,
  • the information processing method described in Appendix 11, wherein correcting the relative position of the entering target with respect to the gate device based on individual difference information of the eye distance of the entering target includes correcting the reference value to a reference value corresponding to the entering target using the individual difference information of the eye distance of the entering target, and calculating the relative position of the entering target with respect to the gate device based on the eye distance of the entering target and the corrected reference value.
  • Calculating the relative position of the entering target with respect to the gate device based on the eye-to-eye distance of the entering target includes calculating the relative position of the entering target with respect to the gate device based on the eye-to-eye distance of the entering target and a reference value, the reference value is a value for calculating a relative position of a standard person with respect to the gate device from the eye distance of the standard person,
  • the information processing method described in Appendix 11, wherein correcting the relative position of the entering target with respect to the gate device based on the individual difference information of the eye distance of the entering target includes: correcting the eye distance of the entering target to an eye distance corresponding to the standard person using the individual difference information of the eye distance of the entering target; and calculating the relative position of the entering target with respect to the gate device based on the corrected eye distance and the reference value.
  • a first image including the registration target is acquired, the first image being captured under a condition in which a relative position of the registration target with respect to a photographing device is determined; Calculating individual difference information of the eye distance of the registration target based on the eye distance of the registration target in the first image; registering face information of the registration target in the first image and individual difference information of the eye distance of the registration target in association with each other; acquiring a second image including the entering object before entering the gate device; Calculating a relative position of the entering object with respect to the gate device based on an eye-to-eye distance of the entering object in the second image; a program that causes a computer to execute a process of correcting a relative position of the entering target with respect to the gate device, based on individual difference information of the eye distance of the entering target that is linked to and registered with the facial information of the entering target, after authenticating the entering target using the facial information of the entering target in the second image.
  • the process of calculating the relative position of the entering target with respect to the gate device based on the eye-to-eye distance of the entering target includes a process of calculating the relative position of the entering target with respect to the gate device based on the eye-to-eye distance of the entering target and a reference value, the reference value is a value for calculating a relative position of a standard person with respect to the gate device from the eye distance of the standard person,
  • the process of correcting the relative position of the entering target with respect to the gate device based on individual difference information of the eye distance of the entering target includes a process of correcting the reference value to a reference value corresponding to the entering target using the individual difference information of the eye distance of the entering target, and calculating the relative position of the entering target with respect to the gate device based on the eye distance of the entering target and the corrected reference value.
  • the process of calculating the relative position of the entering target with respect to the gate device based on the eye-to-eye distance of the entering target includes a process of calculating the relative position of the entering target with respect to the gate device based on the eye-to-eye distance of the entering target and a reference value, the reference value is a value for calculating a relative position of a standard person with respect to the gate device from the eye distance of the standard person,
  • the process of correcting the relative position of the entering target with respect to the gate device based on individual difference information of the eye distance of the entering target includes a process of correcting the eye distance of the entering target to an eye distance corresponding to the standard person using the individual difference information of the eye distance of the entering target, and calculating the relative position of the entering target with respect to the gate device based on the corrected eye distance and the reference value.
  • Information processing device 2 3 Information processing system 10 First photographing device 20 Registration processing device 21 First image acquisition unit 22 First face detection unit 23 First face information extraction unit 24 First eye distance measurement unit 25 Personal difference information calculation unit 26 Registration unit 30 Master device 31 Memory unit 40 Ticket gate processing device 41 Second image acquisition unit 42 Second face detection unit 43 Second eye distance measurement unit 44 Position calculation unit 45 Second face information extraction unit 46 Authentication unit 47 Position correction unit 48 Ticket gate control unit 50 Second photographing device 60 Ticket gate device 70 Registration processing device 71 First resolution correction unit 80 Ticket gate processing device 81 Second resolution correction unit 500 Computer 501 Bus 502 Processor 503 Memory 504 Storage device 505 Input/output interface (I/F) 506 Network interface (I/F)

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Finance (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Devices For Checking Fares Or Tickets At Control Points (AREA)
PCT/JP2024/018742 2023-06-08 2024-05-21 情報処理装置、情報処理システム、情報処理方法及びプログラム Ceased WO2024252924A1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2025526043A JPWO2024252924A1 (cg-RX-API-DMAC7.html) 2023-06-08 2024-05-21

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2023094915 2023-06-08
JP2023-094915 2023-06-08

Publications (1)

Publication Number Publication Date
WO2024252924A1 true WO2024252924A1 (ja) 2024-12-12

Family

ID=93795437

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2024/018742 Ceased WO2024252924A1 (ja) 2023-06-08 2024-05-21 情報処理装置、情報処理システム、情報処理方法及びプログラム

Country Status (2)

Country Link
JP (1) JPWO2024252924A1 (cg-RX-API-DMAC7.html)
WO (1) WO2024252924A1 (cg-RX-API-DMAC7.html)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019058800A1 (ja) * 2017-09-19 2019-03-28 日本電気株式会社 照合システム
WO2019058801A1 (ja) * 2017-09-19 2019-03-28 日本電気株式会社 照合システム
WO2019151116A1 (ja) * 2018-01-31 2019-08-08 日本電気株式会社 情報処理装置
WO2019151117A1 (ja) * 2018-01-31 2019-08-08 日本電気株式会社 情報処理装置
WO2021059537A1 (ja) * 2019-09-27 2021-04-01 日本電気株式会社 情報処理装置、端末装置、情報処理システム、情報処理方法及び記録媒体
WO2021166223A1 (ja) * 2020-02-21 2021-08-26 日本電気株式会社 生体認証装置、生体認証方法、および生体認証用プログラム
WO2023012900A1 (ja) * 2021-08-03 2023-02-09 日本電気株式会社 情報処理装置、情報処理方法及び記憶媒体

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019058800A1 (ja) * 2017-09-19 2019-03-28 日本電気株式会社 照合システム
WO2019058801A1 (ja) * 2017-09-19 2019-03-28 日本電気株式会社 照合システム
WO2019151116A1 (ja) * 2018-01-31 2019-08-08 日本電気株式会社 情報処理装置
WO2019151117A1 (ja) * 2018-01-31 2019-08-08 日本電気株式会社 情報処理装置
WO2021059537A1 (ja) * 2019-09-27 2021-04-01 日本電気株式会社 情報処理装置、端末装置、情報処理システム、情報処理方法及び記録媒体
WO2021166223A1 (ja) * 2020-02-21 2021-08-26 日本電気株式会社 生体認証装置、生体認証方法、および生体認証用プログラム
WO2023012900A1 (ja) * 2021-08-03 2023-02-09 日本電気株式会社 情報処理装置、情報処理方法及び記憶媒体

Also Published As

Publication number Publication date
JPWO2024252924A1 (cg-RX-API-DMAC7.html) 2024-12-12

Similar Documents

Publication Publication Date Title
KR20200116138A (ko) 안면 인식을 위한 방법 및 시스템
CN107591207A (zh) 一种疫情排查方法、装置、系统及设备
JP2020014067A (ja) ステレオ撮像装置
TW202232367A (zh) 人臉識別方法、裝置、設備及存儲介質
WO2017043314A1 (ja) ガイダンス取得装置、ガイダンス取得方法及びプログラム
US11380130B2 (en) Face authentication device having database with small storage capacity
US12626399B2 (en) Information processing device, information processing system, and estimation method
US20210378520A1 (en) Free flow fever screening
JP2025159100A5 (cg-RX-API-DMAC7.html)
CN112292847B (zh) 图像处理设备、移动设备、方法和存储介质
WO2023084765A1 (ja) 処理実行装置、ユーザ端末、認証システム、処理実行方法、認証方法、及び、コンピュータ可読媒体
US11514547B2 (en) Vision sensor dynamic watermarking via noise characterization
JP7396494B2 (ja) 温度管理装置、システム、方法及びプログラム
US20230106309A1 (en) Photographing control device, system, method, and non-transitory computer-readable medium storing program
US20250329107A1 (en) Image processing apparatus and method
EP4090007B1 (en) Imaging control apparatus for controlling exposure of imaging apparatus based on subject authentication result, imaging control method, and storage medium
US12058433B2 (en) Image processing method
CN117356101A (zh) 信息处理装置、信息处理方法和程序
CN119314219B (zh) 一种双目面部识别设备、双目面部识别设备的标定方法
KR20220008621A (ko) 인증 장치
JP2010231450A (ja) 撮影データ認証装置、撮影データ認証システム、撮影データ認証方法及びプログラム
JP7800674B2 (ja) 検出システム、検出方法、及びプログラム
JP7287571B2 (ja) 撮影制御装置、システム、方法及びプログラム
JP7452628B2 (ja) 判定装置、方法及びプログラム
JP7786546B2 (ja) 画像処理システム、画像処理方法及び画像処理プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24819157

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2025526043

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 24819157

Country of ref document: EP

Kind code of ref document: A1