WO2023166629A1 - 情報処理システム、情報処理方法、及び記録媒体 - Google Patents

情報処理システム、情報処理方法、及び記録媒体 Download PDF

Info

Publication number
WO2023166629A1
WO2023166629A1 PCT/JP2022/008942 JP2022008942W WO2023166629A1 WO 2023166629 A1 WO2023166629 A1 WO 2023166629A1 JP 2022008942 W JP2022008942 W JP 2022008942W WO 2023166629 A1 WO2023166629 A1 WO 2023166629A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
information processing
camera
target
processing system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2022/008942
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
有加 荻野
貴裕 戸泉
竜一 赤司
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Corp
Original Assignee
NEC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Corp filed Critical NEC Corp
Priority to EP22929774.2A priority Critical patent/EP4488932A4/en
Priority to JP2024504104A priority patent/JPWO2023166629A1/ja
Priority to PCT/JP2022/008942 priority patent/WO2023166629A1/ja
Priority to US18/710,664 priority patent/US20250014387A1/en
Publication of WO2023166629A1 publication Critical patent/WO2023166629A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/16—Image acquisition using multiple overlapping images; Image stitching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/197—Matching; Classification
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07—Target detection

Definitions

  • This disclosure relates to the technical fields of information processing systems, information processing methods, and recording media.
  • Japanese Patent Application Laid-Open No. 2002-200001 discloses a technique for detecting that a subject has entered a predetermined distance range using a distance measurement sensor, and starting imaging when the subject has entered the predetermined distance range.
  • Patent Document 2 discloses acquiring a stereoscopic image based on images taken from a plurality of different viewpoints.
  • Patent Document 3 discloses that an image is captured when the corneal vertex of the subject's eye coincides with the intersection of the optical axes of the illumination optical system and the imaging optical system.
  • Patent Document 4 discloses displaying an object existing at the intersection of the optical axes of camera A and camera B on a screen.
  • the purpose of this disclosure is to improve the technology disclosed in prior art documents.
  • One aspect of the information processing system disclosed herein is an acquisition unit that acquires a first image and a second image captured so that optical axes intersect at a predetermined point; a position of a target in the first image; determining means for determining whether a difference between the position of the target in the two images is within a predetermined range; and control to capture an iris image of the target when the difference is within the predetermined range. and a control means for
  • At least one computer obtains a first image and a second image captured so that the optical axes intersect at a predetermined point, and the position of the object in the first image and the and the position of the target in the second image is within a predetermined range, and if the difference is within the predetermined range, an iris image of the target is captured. do.
  • One aspect of the recording medium of this disclosure acquires a first image and a second image captured so that the optical axes intersect at a predetermined point in at least one computer, and obtains a position of a target in the first image, determining whether or not a difference between the position of the target in the second image and the position of the target is within a predetermined range, and controlling to capture an iris image of the target when the difference is within the predetermined range.
  • a computer program for executing an information processing method is recorded.
  • FIG. 2 is a block diagram showing the hardware configuration of the information processing system according to the first embodiment
  • FIG. 1 is a block diagram showing a functional configuration of an information processing system according to a first embodiment
  • FIG. 3 is a top view showing optical axes of cameras in the information processing system according to the first embodiment
  • FIG. 4 is a plan view showing an example of a first image and a second image acquired by the information processing system according to the first embodiment
  • FIG. 4 is a flowchart showing the flow of operations of the information processing system according to the first embodiment
  • 9 is a flowchart showing the flow of operations of an information processing system according to the second embodiment
  • FIG. 11 is a plan view showing an example of a first image and a second image acquired by an information processing system according to a third embodiment; It is a top view which shows the trigger position and focus position in the information processing system which concerns on 4th Embodiment.
  • FIG. 14 is a flow chart showing the flow of operations of an information processing system according to the fourth embodiment;
  • FIG. 12 is a block diagram showing a functional configuration of an information processing system according to a fifth embodiment;
  • FIG. 14 is a flow chart showing the flow of operations of an information processing system according to the fifth embodiment;
  • FIG. 12 is a block diagram showing a functional configuration of an information processing system according to a sixth embodiment;
  • FIG. 21 is a top view showing an example arrangement of the first camera, the second camera, and the third camera in the information processing system according to the seventh embodiment
  • FIG. 20 is a top view showing an arrangement example of a first camera, a second camera, and a third camera in an information processing system according to an eighth embodiment
  • FIG. 21 is a front view showing an arrangement example of a fourth camera and mirrors in an information processing system according to a ninth embodiment
  • FIG. 21 is a plan view showing an example of a first image and a second image acquired by an information processing system according to a ninth embodiment
  • FIG. 21 is a top view showing an arrangement example of a fifth camera and mirrors in an information processing system according to a tenth embodiment
  • FIG. 21 is a plan view showing an example of a first image and a second image acquired by an information processing system according to a tenth embodiment
  • FIG. 22 is a block diagram showing a functional configuration of an information processing system according to an eleventh embodiment
  • FIG. FIG. 22 is a flow chart showing the flow of operations of the information processing system according to the eleventh embodiment
  • FIG. FIG. 22 is a flow chart showing the flow of operations of an information processing system according to a twelfth embodiment
  • FIG. FIG. 22 is a flow chart showing the flow of operations of an information processing system according to a thirteenth embodiment
  • FIG. FIG. 16 is a flow chart showing the flow of operations of an information processing system according to a fourteenth embodiment
  • FIG. FIG. 21 is a plan view showing an example of a first image and a second image acquired by an information processing system according to a fourteenth embodiment, and their search areas;
  • FIG. 1 An information processing system according to the first embodiment will be described with reference to FIGS. 1 to 5.
  • FIG. 1 An information processing system according to the first embodiment will be described with reference to FIGS. 1 to 5.
  • FIG. 1 is a block diagram showing the hardware configuration of an information processing system according to the first embodiment.
  • an information processing system 10 includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device .
  • Information processing system 10 may further include an input device 15 and an output device 16 .
  • the information processing system 10 also includes a camera 18 .
  • the processor 11 , RAM 12 , ROM 13 , storage device 14 , input device 15 , output device 16 and camera 18 are connected via a data bus 17 .
  • the processor 11 reads a computer program.
  • processor 11 is configured to read a computer program stored in at least one of RAM 12, ROM 13 and storage device .
  • the processor 11 may read a computer program stored in a computer-readable recording medium using a recording medium reader (not shown).
  • the processor 11 may acquire (that is, read) a computer program from a device (not shown) arranged outside the information processing system 10 via a network interface.
  • the processor 11 controls the RAM 12, the storage device 14, the input device 15 and the output device 16 by executing the read computer program.
  • the processor 11 implements a functional block for executing processing for capturing an image of the object. That is, the processor 11 may function as a controller that executes each control in the information processing system 10 .
  • the processor 11 includes, for example, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array), DSP (Demand-Side Platform), ASIC (Application Specific Integral ted circuit).
  • the processor 11 may be configured with one of these, or may be configured to use a plurality of them in parallel.
  • the RAM 12 temporarily stores computer programs executed by the processor 11.
  • the RAM 12 temporarily stores data temporarily used by the processor 11 while the processor 11 is executing the computer program.
  • the RAM 12 may be, for example, a D-RAM (Dynamic Random Access Memory) or an SRAM (Static Random Access Memory). Also, instead of the RAM 12, other types of volatile memory may be used.
  • the ROM 13 stores computer programs executed by the processor 11 .
  • the ROM 13 may also store other fixed data.
  • the ROM 13 may be, for example, a P-ROM (Programmable Read Only Memory) or an EPROM (Erasable Read Only Memory). Also, instead of the ROM 13, other types of non-volatile memory may be used.
  • the storage device 14 stores data that the information processing system 10 saves for a long period of time.
  • Storage device 14 may act as a temporary storage device for processor 11 .
  • the storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.
  • the input device 15 is a device that receives input instructions from the user of the information processing system 10 .
  • Input device 15 may include, for example, at least one of a keyboard, mouse, and touch panel.
  • the input device 15 may be configured as a mobile terminal such as a smart phone or a tablet.
  • the input device 15 may be a device capable of voice input including, for example, a microphone.
  • the output device 16 is a device that outputs information about the information processing system 10 to the outside.
  • the output device 16 may be a display device (eg, display) capable of displaying information regarding the information processing system 10 .
  • the output device 16 may be a speaker or the like capable of outputting information about the information processing system 10 by voice.
  • the output device 16 may be configured as a mobile terminal such as a smart phone or a tablet.
  • the output device 16 may be a device that outputs information in a format other than an image.
  • the output device 16 may be a speaker that outputs information about the information processing system 10 by voice.
  • the camera 18 is a camera installed at a location where an image of the target can be captured.
  • the object here is not limited to humans, and may include animals such as dogs, cats, snakes, and birds, robots, and the like.
  • the camera 18 may take an image of the entire object, or may take an image of part of the object.
  • the camera 18 may be a camera that captures still images or a camera that captures moving images.
  • the camera 18 may be configured as a visible light camera, or may be configured as a near-infrared camera.
  • a plurality of cameras 18 may be provided.
  • the multiple cameras 18 may be of the same type or of different types.
  • the camera 18 may have a function of automatically turning off the power when not capturing an image, for example. In this case, for example, the liquid lens, the motor, or the like having a short life may be preferentially turned off. A specific configuration of the camera 18 will be described in detail in another embodiment described later.
  • FIG. 1 exemplifies the information processing system 10 including a plurality of devices, all or part of these functions may be realized by one device (imaging device).
  • this imaging device is configured with only the processor 11, the RAM 12, the ROM 13, and the imaging unit 18 described above, and the other components (that is, the storage device 14, the input device 15, and the output device 16) are, for example, An external device connected to the imaging device may be provided.
  • the imaging device may implement a part of arithmetic functions by an external device (for example, an external server, cloud, etc.).
  • FIG. 2 is a block diagram showing the functional configuration of the information processing system according to the first embodiment.
  • the information processing system 10 is configured as a system for capturing an image of a target. More specifically, the information processing system 10 is configured to capture an iris image of a target.
  • the use of the iris image captured by the information processing system 10 is not particularly limited, but it may be used for biometric authentication, for example.
  • the information processing system 10 may be configured as part of a system (so-called walk-through authentication system) that performs biometric authentication by imaging a walking target.
  • the information processing system 10 includes an acquisition unit 110, a determination unit 120, and a control unit 130 as components for realizing its functions. ing.
  • Each of the acquisition unit 110, the determination unit 120, and the control unit 130 may be a processing block realized by, for example, the above-described processor 11 (see FIG. 1).
  • the acquisition unit 110 is configured to be able to acquire the first image and the second image.
  • the first image and the second image are images captured such that the optical axes of the optical system for capturing each image intersect at a predetermined point.
  • the first image and the second image may be captured by the camera 18 (see FIG. 1) described above.
  • the first image and the second image may be captured by two cameras 18 whose optical axes intersect each other.
  • the first image and the second image may be captured by one camera 18 via a mirror or the like.
  • a specific arrangement example of the camera 18 that captures the first image and the second image will be described later in detail.
  • the determination unit 120 is configured to be able to execute determination processing using the first image and the second image acquired by the acquisition unit 110 . Specifically, the determination unit 120 is configured to determine whether or not the difference between the position of the target in the first image and the position of the target in the second image is within a predetermined range. Note that the "difference" here may be, for example, the distance between the first coordinates indicating the position of the target in the first image and the coordinates indicating the position of the target in the second image (that is, the Euclidean distance).
  • the determination unit 120 determines, for example, the first coordinates indicating the position of the target in the first image and the second coordinates indicating the position of the target in the second image. Alternatively, the determination unit 120 determines whether the degree of overlap between the first detection region in the first image and the second detection region in the second image is within a predetermined range.
  • the "predetermined range” here means that there is no large difference between the position of the object in the first image and the position of the object in the second image (in other words, , the difference is within a preset threshold), and an appropriate value may be set in advance.
  • the predetermined range may be set by a person.
  • the values may be optimized through repeated learning, and the determination unit 120 may perform normalization (that is, matching scales) of the first image and the second image when calculating the difference.
  • the determination unit 120 may acquire the scale ratio between the first image and the second image in advance, and perform the normalization process based on the scale ratio.
  • a process of normalizing the first and second images may be performed using internal parameters (eg, focus, pixel size information, etc.) of the camera 18 capturing the images and the second image.
  • the control unit 130 is configured to be able to control the imaging of the target iris image based on the determination result of the determination unit 120 . Specifically, when the determination unit determines that the difference between the position of the target in the first image and the position of the target in the second image is within a predetermined range, the control unit 130 controls the iris image of the target. may be controlled to image the camera 18.
  • the camera 18 controlled here that is, the camera 18 that captures the iris image
  • FIG. 3 is a top view showing optical axes of cameras in the information processing system according to the first embodiment.
  • FIG. 4 is a plan view showing an example of a first image and a second image acquired by the information processing system according to the first embodiment;
  • the first camera 181 is configured to capture the first image and the second camera 182 is configured to capture the second image.
  • the first camera 181 and the second camera 182 are arranged so that their optical axes intersect each other at a predetermined point.
  • the predetermined point where the optical axes intersect will be referred to as a "trigger point" as appropriate.
  • the position of the target in the first image and the position of the target in the second image are A relatively large difference is generated between the positions.
  • the target is captured near the left end of the image, while in the second image, the target is captured near the right end of the image.
  • the difference between the target position in the first image and the target position in the second image is large (that is, not within the predetermined range), it can be determined that the target exists at a position distant from the trigger point.
  • the difference between the position of the target in the first image and the position of the target in the second image is a relatively small value.
  • the object appears near the center of the image.
  • FIG. 5 is a flow chart showing the operation flow of the information processing system according to the first embodiment.
  • the acquisition unit 110 acquires the first image and the second image (step S101). Although it is preferable that the first image and the second image are typically captured at the same time, some error may be allowed. Alternatively, if the difference in imaging timing between the first image and the second image is known, the predetermined range may be set in consideration of the difference.
  • the first image and the second image acquired by the acquisition unit 110 are output to the determination unit 120 .
  • the determination unit 120 detects the position of the object from each of the first image and the second image acquired by the acquisition unit 110 (step S102).
  • the target position may be detected, for example, as the position of a preset site.
  • the determination unit 120 may detect the positions of the eyes, nose, mouth, entire face, hands, feet, etc. of the object as the positions of the object.
  • the determination unit 120 may detect the right eye position of the first image and the right eye position of the second image, respectively. , the left eye position of the first image and the left eye position of the second image, respectively.
  • the determination unit 120 may detect the center coordinates of the right eye in the first image and the center coordinates of the right eye in the second image, or may detect the center coordinates of the left eye in the first image and the center coordinates of the second image. and the center coordinates of the left eye may be detected, respectively.
  • the determination unit 120 may detect the center coordinates (center point) of the right and left eyes in the first image and the center coordinates of the right and left eyes in the second image. The above is an example of detecting the eyes, but in the case of detecting other parts, the position of the object may also be detected based on various parts.
  • the determination unit 120 may detect the nose position of the first image and the nose position of the second image, respectively.
  • the determining unit 120 may determine the center coordinates of the nose in the first image (for example, the center coordinates between the top and bottom ends of the nose, or the center coordinates between the right and left ends of the nose) and the nose in the second image. , and may be detected respectively.
  • the determination unit 120 detects the position of the entire face in the first image and the position of the entire face in the second image.
  • the determination unit 120 determines the center coordinates of the entire face in the first image (for example, the center coordinates between the upper and lower ends of the entire face, or the center coordinates between the right and left ends of the entire face) and the second image. and the center coordinates of the entire face in the image may be detected.
  • the determination unit 120 may detect a plurality of positions of each part described above, and set the central position of the plurality of positions as the target position.
  • the determination unit 120 may detect the position of the right eye, the position of the left eye, and the position of the nose, and set the central position of the positions of the right eye, the left eye, and the nose as the target position. Note that if the target is not detected from at least one of the first image and the second image, subsequent processing may be omitted, and the processing may be restarted from step S101.
  • the determination unit 120 determines whether the difference between the target position in the first image and the target position in the second image is within a predetermined range (step S103). A determination result by the determination unit 120 is output to the control unit 130 . If the difference between the target position in the first image and the target position in the second image is not within the predetermined range (step S103: NO), the process is restarted from step S101.
  • control unit 130 controls to capture the iris image of the target. (step S104). Only one iris image may be captured, or a plurality of images may be captured. An iris image may be captured as each frame of a moving image.
  • trigger determination is performed based on the first image and the second image captured so that the optical axes intersect.
  • An iris image is taken according to the result.
  • trigger determination is performed using the first image and the second image, so there is no need to separately provide a sensor or the like for detecting the position of the target.
  • a distance sensor, a proximity sensor, or the like it is conceivable to use a distance sensor, a proximity sensor, or the like to perform trigger determination, but in this embodiment, the distance sensor, the proximity sensor, and the like are unnecessary.
  • FIG. 6 is a flow chart showing the operation flow of the information processing system according to the second embodiment.
  • the same reference numerals are assigned to the same processes as those shown in FIG.
  • the acquisition unit 110 acquires the first image and the second image (step S101).
  • the first image and the second image acquired by the acquisition unit 110 are output to the determination unit 120 .
  • the determination unit 120 detects the position of the object from each of the first image and the second image acquired by the acquisition unit 110 (step S102). Then, the determination unit 120 determines whether or not the difference between the target position in the first image and the target position in the second image is within a predetermined range (step S103). A determination result by the determination unit 120 is output to the control unit 130 . If the difference between the target position in the first image and the target position in the second image is not within the predetermined range (step S103: NO), the process is restarted from step S101.
  • the control unit 130 uses the first image and the second image to , to specify the eye position of the object (step S201).
  • the method of identifying the eye positions of the target is not particularly limited, but for example, an area (face area) where the target's face exists may be detected, and the eye positions may be estimated from the detected face area.
  • control unit 130 performs control so that an iris image of the target is captured based on the specified eye position (step S202).
  • the control unit 130 may perform control such that the camera 18 is moved to a position where the specified eye position can be imaged and image capturing is started.
  • the control unit 130 may select a camera 18 capable of capturing an image of a specified eye position from among a plurality of cameras 18 having different heights, and perform control to start capturing an image.
  • the control unit 130 may rotate the mirror of the camera 18 to change the imaging range so that the specified eye position can be imaged, and perform control to start imaging.
  • a mirror is installed within the image pickup range of the camera 18 (that is, the camera 18 picks up an image of the target via the mirror), and the mirror is driven to rotate according to the eye position of the target
  • imaging can be started.
  • an iris image can be acquired by rotationally driving a mirror according to the eye position of the object.
  • the movement of the camera 18, the selection of the camera 18, and the driving of the mirrors described above may be performed based on a position other than the eye position (that is, the position of a part different from the eye).
  • the camera 18 may be moved, the camera 18 may be selected, or the mirror may be rotated based on the nose position or face position of the subject.
  • a face image can be acquired by using the face position or the nose position located near the center of the face as a reference.
  • an iris image is captured based on the specified eye positions.
  • the iris image of the object can be captured more appropriately. Specifically, it is possible to perform imaging after the iris of the object is contained within the imaging range.
  • FIG. 7 is a plan view showing an example of the first image and the second image acquired by the information processing system according to the third embodiment.
  • the positions of the right eye and left eye of the target are detected as the positions of the target in the first image and the second image.
  • the location of the subject may be detected as coordinates indicating the location of the subject's right eye and coordinates indicating the location of the subject's left eye.
  • the position of the right eye may be the center point of the right eye area, the position of the area indicating the right eye area, the center point of the iris area of the right eye, or the iris area of the right eye. It may be the position of the indicated area or the central point in the pupil region of the right eye.
  • the position of the left eye may be the center point of the left eye area, the position of the area indicating the left eye area, the center point of the iris area of the left eye, or the left eye area. It may be the position of the area indicating the iris region, or the central point in the pupillary region of the left eye.
  • the trigger determination may be made using both the subject's right and left eye positions. For example, the difference between the position of the subject's right eye in the first image and the position of the subject's right eye in the second image, and the difference between the position of the subject's left eye in the first image and the position of the subject's left eye in the second image.
  • control may be performed to capture an iris image.
  • control may be performed such that an iris image is captured when one of the differences between the right eye and the left eye falls within a predetermined range.
  • the positions of the right eye and left eye are detected as the target position.
  • the trigger determination is performed based on the position of the target's eye (in other words, the position of the iris).
  • the object of transmission may be a human or a machine).
  • imaging control based on the positions of the eyes can be performed as in the above-described second embodiment.
  • FIG. 8 An information processing system 10 according to the fourth embodiment will be described with reference to FIGS. 8 and 9.
  • FIG. 8 It should be noted that the fourth embodiment may differ from the above-described first to third embodiments only in a part of configuration and operation, and other parts may be the same as those of the first to third embodiments. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.
  • FIG. 8 is a top view showing the trigger position and focus position in the information processing system according to the fourth embodiment.
  • the information processing system assumes a situation in which a target approaches a camera that captures an image of the target's iris.
  • the trigger position in this example, the first camera that captures the first image
  • the focus position that is, the in-focus position
  • the optical axis of the second camera 182 that captures the second image is set.
  • a plurality of iris images are captured in succession. Capturing iris images is continuously performed at least until the subject passes the trigger point and reaches the focus position.
  • the iris images captured at the focus position are included in the plurality of captured iris images.
  • capturing the iris image may be performed even after reaching the focus position.
  • the capturing of iris images may be terminated after a predetermined number of images are captured after the object is brought into focus.
  • the imaging range may be adjusted to match the position of the eye of the subject.
  • the iris image of the subject may be captured by estimating the height of the subject and matching the height of the eye position estimated from the height.
  • the position (depth information) of the target can be specified using the first image and the second image, so the height of the target can be estimated with high accuracy.
  • the height of the object may be estimated (calculated) using depth information, the size of the object in the image, and the imaging angle of the camera. In this case, the height of the object can be properly estimated even if there is no reference object that serves as a reference for length in the image.
  • FIG. 9 is a flow chart showing the operation flow of the information processing system according to the fourth embodiment.
  • the same reference numerals are assigned to the same processes as those shown in FIG.
  • the acquisition unit 110 first acquires the first image and the second image (step S101).
  • the first image and the second image acquired by the acquisition unit 110 are output to the determination unit 120 .
  • the determination unit 120 detects the position of the object from each of the first image and the second image acquired by the acquisition unit 110 (step S102). Then, the determination unit 120 determines whether or not the difference between the target position in the first image and the target position in the second image is within a predetermined range (step S103). A determination result by the determination unit 120 is output to the control unit 130 . If the difference between the target position in the first image and the target position in the second image is not within the predetermined range (step S103: NO), the process is restarted from step S101.
  • step S103 if the difference between the target position in the first image and the target position in the second image is within the predetermined range (step S103: YES), the control unit 130 continuously captures iris images (step S401). . After that, the control unit 130 determines whether or not to end continuous imaging (step S402). The control unit 130 may determine to end the continuous imaging when the object passes the focus position (see FIG. 8), for example. Alternatively, the control unit 130 may determine to end imaging when the difference between the position of the target in the first image and the position of the target in the second image is no longer within a predetermined range.
  • step S402 When it is not determined to end imaging (step S402: NO), continuous imaging of iris images is continued. On the other hand, if it is determined to end the imaging (step S402: YES), the continuous imaging of the iris images is terminated and the series of operations is terminated.
  • the trigger position (that is, the position where the optical axes intersect) is set behind the focus position of the camera that captures the iris. , iris images are taken continuously when the object reaches the trigger position. In this way, the iris of an object approaching the camera can be appropriately imaged at the focus position.
  • FIG. 10 An information processing system 10 according to the fifth embodiment will be described with reference to FIGS. 10 and 11.
  • FIG. The fifth embodiment may differ from the above-described fourth embodiment only in a part of configuration and operation, and the other parts may be the same as those of the first to fourth embodiments. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.
  • FIG. 10 is a block diagram showing the functional configuration of an information processing system according to the fifth embodiment.
  • the same reference numerals are given to the same components as those shown in FIG.
  • the information processing system 10 includes an acquisition unit 110, a determination unit 120, a control unit 130, a selection unit 140, and and an authentication unit 150 . That is, the information processing system 10 according to the fifth embodiment further includes a selection unit 140 and an authentication unit 150 in addition to the configuration of the first embodiment (see FIG. 2). Note that each of the selection unit 140 and the authentication unit 150 may be a processing block realized by, for example, the above-described processor 11 (see FIG. 1).
  • the selection unit 140 is configured to be able to select at least one high-quality iris image from among a plurality of iris images captured continuously after trigger determination.
  • the quality of the iris image may be determined, for example, by calculating a quality score (that is, a score indicating image quality).
  • the selection unit 140 may select one image with the highest quality score from a plurality of iris images.
  • the selection unit 140 may select a predetermined number of images in descending order of quality score.
  • the selection unit 140 may select images whose quality scores exceed a predetermined value.
  • the authentication unit 150 is configured to be able to execute biometric authentication processing (that is, iris authentication) based on the iris image of the target captured as a result of control by the control unit 130 .
  • biometric authentication processing that is, iris authentication
  • an existing technique can be appropriately adopted, so a detailed description thereof will be omitted here.
  • the authentication unit 150 may be configured to be able to execute various processes according to the result of iris authentication.
  • the authentication unit 150 may be configured to be able to unlock the gate when the iris authentication is successful.
  • FIG. 11 is a flow chart showing the operation flow of the information processing system according to the fifth embodiment.
  • the same reference numerals are assigned to the same processes as those shown in FIG.
  • the acquisition unit 110 acquires the first image and the second image (step S101).
  • the first image and the second image acquired by the acquisition unit 110 are output to the determination unit 120 .
  • the determination unit 120 detects the position of the object from each of the first image and the second image acquired by the acquisition unit 110 (step S102). Then, the determination unit 120 determines whether or not the difference between the target position in the first image and the target position in the second image is within a predetermined range (step S103). A determination result by the determination unit 120 is output to the control unit 130 . If the difference between the target position in the first image and the target position in the second image is not within the predetermined range (step S103: NO), the process is restarted from step S101.
  • step S103 YES
  • the control unit 130 continuously captures iris images (step S401). . After that, the control unit 130 determines whether or not to end continuous imaging (step S402). If it is not determined to end the imaging (step S402: NO), continuous iris images are continued.
  • step S402 determines whether it is determined to end the imaging. If it is determined to end the imaging (step S402: YES), the continuous imaging of the iris images is terminated, and the selection unit 140 selects at least the highest quality iris images from among the plurality of iris images that have been captured so far. One image is selected (step S501). Then, using the iris image selected by the selection unit 140, the authentication unit performs iris authentication (step S502).
  • a high-quality image is selected from a plurality of iris images, and authentication processing is performed using the selected image. be done. In this way, the authentication process can be performed using a high-quality iris image, so highly accurate biometric authentication can be achieved.
  • FIG. 12 is a block diagram showing the functional configuration of an information processing system according to the sixth embodiment.
  • symbol is attached
  • the information processing system 10 includes a first camera 183, a second camera 182, and a third camera 183 as the cameras 18.
  • the first camera 181 is provided as a camera that captures a first image.
  • the second camera 182 is provided as a camera that captures a second image.
  • the first image and the second image captured by the first camera 181 and the second camera 182 are configured to be acquired by the acquisition unit 110 .
  • the first camera 181 and the second camera 182 are arranged so that their optical axes intersect, as shown in FIG.
  • the third camera 183 is provided as a near-infrared camera that captures an iris image. Therefore, the third camera 183 can be controlled by the controller 130 .
  • a specific arrangement example of the first camera 181, the second camera 182, and the third camera will be described in detail in another embodiment described later.
  • the above-described first camera 181 and second camera 182 may be calibrated in advance. In this case, it is possible to obtain a highly accurate target position (depth information) using stereo vision. Since the first camera 181 and the second camera 182 are arranged so that their optical axes intersect, the stereo search range is limited to the center of the angle of view, and corresponding point information (for example, Information on eye coordinates, face part coordinates, etc.) can be used to acquire highly accurate depth information.
  • point information for example, Information on eye coordinates, face part coordinates, etc.
  • the first image is captured by the first camera 181
  • the second image is captured by the second camera 182
  • the iris image is captured by the third camera 183.
  • the first image, the second image, and the third image can be captured appropriately using a plurality of cameras.
  • the position of the object can be determined with higher accuracy than when the first image and the second image are captured by a single camera.
  • FIG. 13 is a top view showing an arrangement example of the first camera, the second camera, and the third camera in the information processing system according to the seventh embodiment.
  • symbol is attached
  • a third camera 183 is arranged in front of an object approaching the camera.
  • the “front” here is a position where the target's face can be imaged from the front (that is, a position directly facing the target).
  • the first camera 181 and the second camera 182 are arranged on the left and right sides of the third camera, respectively.
  • the first camera 181 is arranged on the right side of the third camera 183
  • the second camera 182 is arranged on the left side of the third camera 183.
  • 182 may be arranged, and the first camera 181 may be arranged to the left of the third camera 183 .
  • the third camera 183 is arranged in front of the object, and the first camera 181 and the second camera 182 are arranged on the left and right sides of the third camera 183, respectively. placed. In this way, an iris image can be captured at an appropriate angle from the front of the subject. Also, the first image and the second image can be captured appropriately so that the optical axes intersect.
  • FIG. 14 is a top view showing an arrangement example of the first camera, the second camera, and the third camera in the information processing system according to the eighth embodiment.
  • the same reference numerals are given to the same components as those shown in FIG. 14
  • each of the first camera 181, the second camera 182, and the third camera 183 is arranged at a position where the object can be imaged obliquely.
  • the "oblique” here means an angle deviated from the front of the object.
  • FIG. 14 shows an example in which the first camera 181 and the second camera 182 are arranged on the right side of the object, and the third camera 183 is arranged on the left side of the object. It is not limited to this arrangement.
  • the first camera 181, the second camera 182, and the third camera 183 may all be arranged on the right side of the object.
  • the first camera 181 may be arranged on the right side as viewed from the target, and the second camera 182 may be arranged on the left side as viewed from the target.
  • each of the first camera 181, the second camera 182, and the third camera 183 captures an oblique image of the target at an angle that is deviated from the front. are arranged as follows. In this way, the first image, the second image, and the iris image of the object can be captured without hindering the movement of the object approaching the camera.
  • FIG. 15 and 16 An information processing system 10 according to the ninth embodiment will be described with reference to FIGS. 15 and 16.
  • FIG. The ninth embodiment may differ from the above-described first to eighth embodiments only in a part of configuration and operation, and other parts may be the same as those of the first to eighth embodiments. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.
  • FIG. 15 is a front view showing an arrangement example of the fourth camera and mirrors in the information processing system according to the ninth embodiment.
  • a fourth camera 184 is provided as a camera that captures the first image and the second image.
  • the fourth camera 184 is arranged to face straight up, and a mirror 200 is arranged above the camera. Therefore, the fourth camera 184 includes the mirror 200 in its imaging range.
  • a fourth camera 184 captures an object (that is, the first image and the second image) through this mirror 200 .
  • the mirror 200 has a first surface 201 and a second surface 202 with different angles.
  • the first surface is a surface provided for capturing a first image
  • the second surface 202 is a surface provided for capturing a second image. Therefore, the first plane 201 and the second plane 202 form an angle such that the optical axis of the fourth camera 184 intersects at the trigger point.
  • the entire mirror 200 is arranged at an angle of, for example, 45 degrees with respect to the horizontal direction. By angling the mirror 200 in this manner, the fourth camera 184 can capture an image of the front (that is, the front side of the paper surface) through the mirror 200 .
  • first surface 201 and the second surface 202 of the mirror 200 do not have to be clearly separated regions as shown in FIG. , and the other portion may be used as the second surface 202 .
  • first surface 201 and the second surface 202 of the mirror may be configured to be provided by separate mirrors.
  • a first mirror having a first surface 201 and a second mirror having a second surface 202 may be provided separately so as to form different angles with each other.
  • FIG. 16 is a plan view showing an example of the first image and the second image acquired by the information processing system according to the ninth embodiment.
  • the first image and the second image are acquired as one image.
  • the acquired images include a first image captured via the first surface 201 of the mirror 200 and a second image captured via the second surface 202 .
  • the object is arranged so that the optical axes when capturing each image intersect at the trigger point. It can be determined that the point has been reached.
  • the first image and the second image are transmitted through the first surface 201 and the second surface 202 of the mirror 200. imaged. In this way, it is possible to capture both the first image and the second image with one camera (that is, the fourth camera 184). Therefore, it is possible to reduce costs compared to a configuration in which a plurality of cameras captures the first image and the second image.
  • the mirror 200 has two surfaces, but the mirror may have three or more surfaces.
  • mirror 200 may comprise a third surface in addition to first surface 201 and second surface 202 .
  • Such a configuration may be realized, for example, by bending one mirror at two locations, or may be realized by three mirrors.
  • Each of the three planes may be provided as, for example, a plane for imaging the object from the right, a plane for imaging from the front, and a plane for imaging from the left.
  • a third image captured through the third plane may be used to determine that the subject has reached the trigger point.
  • the determination unit 120 determines the difference between the target position in the first image, the target position in the second image, and the target position in the third image. is within a predetermined range. Then, when the difference between them is within a predetermined range, the iris image of the target may be picked up. Further, of the three surfaces, the surface for capturing an image from the front may be used for face authentication. Alternatively, face authentication may be performed using face images reflected from a surface for imaging the object from the right side, a surface for imaging the object from the front, and a surface for imaging the object from the left side. .
  • the weight of the face image obtained from the plane for imaging the target from the front (that is, the degree of influence on face authentication) is changed from the other planes (that is, the plane for imaging the target from the right and left sides). You may make it larger than the acquired face image. This is because it is more likely that a face image with high reliability (for example, a frontal face image) can be obtained when the target is imaged from the front rather than when the target is imaged from the right or left side. .
  • FIG. 17 and 18 An information processing system 10 according to the tenth embodiment will be described with reference to FIGS. 17 and 18.
  • FIG. The tenth embodiment may differ from the above-described first to ninth embodiments only in a part of configuration and operation, and may be the same as the first to ninth embodiments in other respects. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.
  • FIG. 17 is a top view showing an arrangement example of the fifth camera and mirrors in the information processing system according to the tenth embodiment.
  • a fifth camera 185 is provided as a camera that captures the first image and the second image.
  • a mirror 250 is provided in the imaging range of the fifth camera 185 .
  • the fifth camera 185 and the mirror 250 are arranged so that the optical axis extending directly from the fifth camera 185 toward the trigger position intersects with the optical axis extending from the fifth camera 185 via the mirror 250 toward the trigger position. ing.
  • FIG. 18 is a plan view showing an example of the first image and the second image acquired by the information processing system according to the tenth embodiment.
  • the first image and the second image are obtained as one image.
  • the second image captured via the mirror 250 is included in the first image obtained by directly capturing the target.
  • the object is arranged so that the optical axes when capturing each image intersect at the trigger point. It can be determined that the point has been reached.
  • the target is reflected near the center of the first image (that is, near the center of the entire acquired image), and near the center of the second image (that is, near the center of the mirror 250 portion) The target is captured. Therefore, in such a case, it can be determined that the target exists at the trigger point.
  • the target is directly imaged by the fifth camera 185 and also imaged via the mirror 250 .
  • the first image and the second image can be captured with one camera (that is, the fifth camera 185). Therefore, it is possible to reduce costs compared to a configuration in which a plurality of cameras captures the first image and the second image.
  • By increasing the number of mirrors or by bending the mirrors to increase the number of surfaces more images can be acquired with one camera. For example, when a first mirror and a second mirror are installed in the imaging range of the fifth camera 185, a second image is acquired through the first mirror, and a third image is acquired through the second mirror. can be obtained. In this case, by further using the third image in addition to the first and second images, it is possible to control the imaging timing with higher accuracy.
  • FIG. 19 An information processing system 10 according to the eleventh embodiment will be described with reference to FIGS. 19 and 20.
  • FIG. The eleventh embodiment may differ from the first to tenth embodiments described above only partially in configuration and operation, and may be the same as the first to tenth embodiments in other respects. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.
  • FIG. 19 is a block diagram showing the functional configuration of an information processing system according to the eleventh embodiment.
  • the same symbols are attached to the same components as those shown in FIG. 19
  • the information processing system 10 according to the eleventh embodiment includes an acquisition unit 110, a determination unit 120, a control unit 130, an identification unit 160, and is configured with That is, the information processing system 10 according to the eleventh embodiment further includes an identification unit 160 in addition to the configuration of the first embodiment (see FIG. 2).
  • the specifying unit 160 may be a processing block realized by, for example, the above-described processor 11 (see FIG. 1).
  • the specifying unit 160 is configured to be able to specify a target for trigger determination (in other words, a target for capturing an iris image). As a result of the identification by the identification unit 160 , the determination unit 120 performs trigger determination using the positional difference between the first image and the second image of the target identified by the identification unit 160 .
  • the specifying method of the specifying unit 160 is not particularly limited, and may be any method that can ensure that the target in the first image and the target in the second image are the same person.
  • the identification unit 160 may identify the target using face authentication, for example. In this case, face authentication may be performed using the first image and the second image, or may be performed using an image captured separately.
  • FIG. 20 is a flow chart showing the operation flow of the information processing system according to the eleventh embodiment.
  • the same reference numerals are given to the same processes as those shown in FIG.
  • the acquisition unit 110 acquires the first image and the second image (step S101).
  • the first image and the second image acquired by the acquisition unit 110 are output to the determination unit 120 and the identification unit 160 .
  • the identifying unit 160 identifies a target for trigger determination (step S1101).
  • the determining unit 120 detects the position of the target specified by the specifying unit 160 from each of the first image and the second image acquired by the acquiring unit 110 (step S1102).
  • step S1101 and the processing of step S1102 may be executed in succession. That is, step S1101 may be executed after executing step S1102. In this case, if the determining unit 120 determines that the target position is within the predetermined range, the specifying unit 160 may specify the target.
  • the determination unit 120 determines whether the difference between the position of the identified target in the first image and the position of the identified target in the second image is within a predetermined range (step S1103). A determination result by the determination unit 120 is output to the control unit 130 . If the difference between the position of the identified target in the first image and the position of the identified target in the second image is not within the predetermined range (step S1103: NO), the process restarts from step S101.
  • control unit 130 displays the iris image of the target. Control is performed so as to take an image (step S104).
  • the target appearing in the first image and the target appearing in the second image are the same person (that is, the specified target)
  • a trigger determination is made for that object. Therefore, for example, when a first target is captured in the first image and a second target is captured in the second image, the position of the first target in the first image and the position of the second target in the second image are The difference from the position of the second target will not be used for trigger determination.
  • trigger determination is performed using the first image and the second image after the target is specified. In this way, erroneous trigger determination based on different target positions can be prevented.
  • FIG. 21 is a flow chart showing the operation flow of the information processing system according to the twelfth embodiment.
  • the same reference numerals are given to the same processes as those shown in FIG.
  • the acquisition unit 110 acquires the first image and the second image (step S101).
  • the first image and the second image acquired by the acquisition unit 110 are output to the determination unit 120 .
  • the determination unit 120 determines whether or not multiple objects are captured in the first image and the second image (step S1201). If a plurality of objects are captured in the first image and the second image (step S1201: YES), the determination unit 120 selects one object from the plurality of objects (step S1202). The determination unit 120 may select, for example, the object closest to the camera (for example, the object that is most captured). Note that the following processing is executed for the target selected in step S1202. If multiple objects are not captured in the first image and the second image (step S1201: NO), the process of step S1202 may be omitted.
  • the determination unit 120 detects the position of the object from each of the first image and the second image acquired by the acquisition unit 110 (step S102). Then, the determination unit 120 determines whether or not the difference between the target position in the first image and the target position in the second image is within a predetermined range (step S103). A determination result by the determination unit 120 is output to the control unit 130 .
  • step S103 If the difference between the target position in the first image and the target position in the second image is not within the predetermined range (step S103: NO), the process restarts from step S101. On the other hand, if the difference between the position of the target in the first image and the position of the target in the second image is within the predetermined range (step S103: YES), control unit 130 controls to capture the iris image of the target. (Step S104).
  • the information processing system 10 when a plurality of objects appear in the first image and the second image, one object selected from among the objects is A trigger determination is made. In this way, even when there are a plurality of objects, it is possible to capture iris images of the objects at appropriate timing.
  • FIG. 10 An information processing system 10 according to the thirteenth embodiment will be described with reference to FIG. It should be noted that the thirteenth embodiment may differ from the first to twelfth embodiments described above only in a part of the operation, and other parts may be the same as those of the first to twelfth embodiments. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.
  • FIG. 22 is a flow chart showing the operation flow of the information processing system according to the thirteenth embodiment.
  • the same reference numerals are given to the same processes as those shown in FIG.
  • the acquisition unit 110 acquires the first image and the second image (step S101).
  • the first image and the second image acquired by the acquisition unit 110 are output to the determination unit 120 .
  • the determination unit 120 detects the position of the object from each of the first image and the second image acquired by the acquisition unit 110 (step S102). Then, the determination unit 120 determines whether or not the difference between the target position in the first image and the target position in the second image is within a predetermined range (step S103). If the difference between the target position in the first image and the target position in the second image is not within the predetermined range (step S103: NO), the process is restarted from step S101.
  • the determination unit 120 determines that there is a companion who passes the target at the same time. It is determined whether or not to do so (step S1301). Examples of companions include a person walking alongside the target, a baby held by the target, and the like.
  • the determination unit 120 may determine the presence of the companion using the first image and the second image, or may determine the presence of the companion using other images.
  • control unit 130 controls to capture an iris image of the subject (step S104).
  • control unit 130 captures an iris image of the target and an iris image of the companion in parallel with different cameras (step S1302). Note that even if there are a plurality of companions, the iris images can be taken in parallel by the number of cameras. If the number of cameras is insufficient, only the selected companion may be imaged, as in the twelfth embodiment (see FIG. 21) described above.
  • the iris image of each subject is captured by a different camera. By doing so, it is possible to capture the iris images of the targets at appropriate timing even when there are a plurality of targets.
  • FIG. The fourteenth embodiment may differ from the above-described first to thirteenth embodiments only in a part of the operation, and other parts may be the same as those of the first to thirteenth embodiments. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.
  • FIG. 23 is a flow chart showing the operation flow of the information processing system according to the fourteenth embodiment.
  • the same reference numerals are given to the same processes as those shown in FIG.
  • the acquisition unit 110 acquires the first image and the second image (step S101).
  • the first image and the second image acquired by the acquisition unit 110 are output to the determination unit 120 .
  • the determination unit 120 detects the position of the object in the first image (step S1401). Then, the determination unit 120 determines a search area in the second image from the position of the target in the first image (step S1402).
  • the search area is that determined on the second image as the area to search for the presence of the object. A method for determining the search area will be specifically described later.
  • the determination unit 120 searches for an object in the search area in the second image (step S1403). If the existence of the object can be detected in the search area (step S1404), the determination unit 120 detects the position of the object detected in the search area as the position of the object in the second image (step S1405). Note that if the existence of the target cannot be detected in the search area, the process may be restarted from step S101.
  • the determination unit 120 determines whether the difference between the position of the target in the first image and the position of the target in the second image is within a predetermined range. is determined (step S103). A determination result by the determination unit 120 is output to the control unit 130 .
  • step S103 If the difference between the target position in the first image and the target position in the second image is not within the predetermined range (step S103: NO), the process restarts from step S101. On the other hand, if the difference between the position of the target in the first image and the position of the target in the second image is within the predetermined range (step S103: YES), control unit 130 controls to capture the iris image of the target. (Step S104).
  • FIG. 24 is a plan view showing an example of the first image and the second image acquired by the information processing system according to the fourteenth embodiment, and their search areas.
  • a search area is determined as an area corresponding to the area in which the object is detected in the first image.
  • the target is detected near the left end of the first image.
  • the area near the left end of the second image is determined as the search area, but since the object is not included therein, the object is not detected from the second image.
  • the region near the center of the second image is determined as the search region. Since the target is included in the search area, the target is detected from the second image.
  • the area in which the target exists in the first image is set as the target search area in the second image. In this way, it is not necessary to search the entire image when detecting the position of the object in the second image. As a result, the process of detecting the position of the object in the second image can be performed at high speed with low load.
  • a processing method is also implemented in which a program for operating the configuration of each embodiment described above is recorded on a recording medium, the program recorded on the recording medium is read as code, and executed by a computer. Included in the category of form. That is, a computer-readable recording medium is also included in the scope of each embodiment. In addition to the recording medium on which the above program is recorded, the program itself is also included in each embodiment.
  • a floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, CD-ROM, magnetic tape, non-volatile memory card, and ROM can be used as recording media.
  • the program recorded on the recording medium alone executes the process, but also the one that operates on the OS and executes the process in cooperation with other software and functions of the expansion board. included in the category of Furthermore, the program itself may be stored on the server, and part or all of the program may be downloaded from the server to the user terminal.
  • the information processing system includes acquisition means for acquiring a first image and a second image captured so that optical axes intersect at a predetermined point, a position of a target in the first image, and the second image. determining means for determining whether or not the difference between the position of the target and the position of the target is within a predetermined range; and control for controlling to capture an iris image of the target when the difference is within the predetermined range
  • An information processing system comprising means.
  • control means specifies eye positions of the target from the first image and the second image, and performs control so that the iris image is captured based on the specified eye positions.
  • the information processing system according to appendix 3 is the information processing system according to appendix 1 or 2, wherein the positions of the target in the first image and the second image are the positions of the right eye and the left eye of the target. .
  • Appendix 4 In the information processing system according to appendix 4, the predetermined position is set on the back side of the focus position as viewed from a camera that captures the iris image, and the control means controls the difference so that the difference is within the predetermined range. 4. The information processing system according to any one of Appendices 1 to 3, wherein control is performed so that the iris images of the target approaching the camera for capturing the iris images are continuously captured.
  • the information processing system according to appendix 5 uses selection means for selecting at least one iris image of high quality from among a plurality of iris images captured in succession, and the selected iris image. 4.
  • the obtaining means obtains the first image captured by a first camera, the second image captured by a second camera installed at an angle different from that of the first camera, and 6.
  • Appendix 7 In the information processing system according to appendix 7, the third camera is arranged in front of the target, and the first camera and the second camera are arranged on the left and right sides of the third camera.
  • each of the first camera, the second camera, and the third camera is arranged at a position that obliquely images the target at an angle deviated from the front. 7.
  • the obtaining means obtains the first image captured by the fourth camera through the first surface of the mirror and the second surface of the mirror by the fourth camera. 6. The information processing system according to any one of Appendices 1 to 5, wherein the second image captured through the camera is acquired.
  • Appendix 10 In the information processing system according to appendix 10, the acquisition means acquires the first image directly captured by a fifth camera and the second image captured by the fifth camera via a mirror. 6. The information processing system according to any one of Appendices 1 to 5.
  • appendix 11 The information processing system according to appendix 11 further includes specifying means for specifying the target, and the determining means determines the position of the specified target in the first image and the position of the specified target in the second image. 11. The information processing system according to any one of appendices 1 to 10, wherein it is determined whether or not the difference between , and is within the predetermined range.
  • control means selects one person from the plurality of objects when the plurality of objects are captured in the first image and the second image. 12.
  • Appendix 13 In the information processing system according to appendix 13, when the plurality of objects are captured in the first image and the second image, the control means displays the iris images of the plurality of objects for each of the objects. 12. The information processing system according to any one of appendices 1 to 11, wherein control is performed so that different cameras are used to capture images.
  • At least one computer acquires a first image and a second image captured so that the optical axes intersect at a predetermined point, and the position of the target in the first image and the determining whether or not the difference between the position of the target in the second image and the position of the target is within a predetermined range, and controlling to capture an iris image of the target when the difference is within the predetermined range; It is an information processing method.
  • At least one computer acquires a first image and a second image captured so that the optical axes intersect at a predetermined point, and the position of the target in the first image and the first image. determining whether or not the difference between the positions of the target in the two images is within a predetermined range, and controlling to capture an iris image of the target when the difference is within the predetermined range.
  • the information processing apparatus includes an acquisition unit that acquires a first image and a second image captured so that optical axes intersect at a predetermined point, a position of a target in the first image, and the second image. determining means for determining whether or not the difference between the position of the target and the position of the target is within a predetermined range; and control for controlling to capture an iris image of the target when the difference is within the predetermined range
  • An information processing apparatus comprising means.
  • the computer program according to attachment 18 acquires, in at least one computer, a first image and a second image captured so that the optical axes intersect at a predetermined point, the position of the target in the first image, and the position of the target in the first image. determining whether or not the difference between the positions of the target in the two images is within a predetermined range, and controlling to capture an iris image of the target when the difference is within the predetermined range.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
PCT/JP2022/008942 2022-03-02 2022-03-02 情報処理システム、情報処理方法、及び記録媒体 Ceased WO2023166629A1 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP22929774.2A EP4488932A4 (en) 2022-03-02 2022-03-02 INFORMATION PROCESSING SYSTEM, INFORMATION PROCESSING METHOD, AND RECORDING MEDIUM
JP2024504104A JPWO2023166629A1 (https=) 2022-03-02 2022-03-02
PCT/JP2022/008942 WO2023166629A1 (ja) 2022-03-02 2022-03-02 情報処理システム、情報処理方法、及び記録媒体
US18/710,664 US20250014387A1 (en) 2022-03-02 2022-03-02 Information processing system, information processing method, and recording medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/008942 WO2023166629A1 (ja) 2022-03-02 2022-03-02 情報処理システム、情報処理方法、及び記録媒体

Publications (1)

Publication Number Publication Date
WO2023166629A1 true WO2023166629A1 (ja) 2023-09-07

Family

ID=87883245

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/008942 Ceased WO2023166629A1 (ja) 2022-03-02 2022-03-02 情報処理システム、情報処理方法、及び記録媒体

Country Status (4)

Country Link
US (1) US20250014387A1 (https=)
EP (1) EP4488932A4 (https=)
JP (1) JPWO2023166629A1 (https=)
WO (1) WO2023166629A1 (https=)

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08210847A (ja) * 1995-02-06 1996-08-20 Ikegami Tsushinki Co Ltd 画像処理方法
JP2004038531A (ja) * 2002-07-03 2004-02-05 Matsushita Electric Ind Co Ltd 物体の位置検出方法および物体の位置検出装置
JP2004046451A (ja) * 2002-07-10 2004-02-12 Matsushita Electric Ind Co Ltd 目画像撮像装置および個体認証装置
JP2005065813A (ja) 2003-08-21 2005-03-17 Konan Medical Inc スリットランプ
JP2006338236A (ja) 2005-06-01 2006-12-14 Matsushita Electric Ind Co Ltd 眼画像撮影装置およびそれを用いた認証装置
JP2007213369A (ja) * 2006-02-10 2007-08-23 Matsushita Electric Ind Co Ltd 生体認証装置および生体認証方法
JP2008310480A (ja) * 2007-06-13 2008-12-25 Panasonic Corp 虹彩撮影装置および虹彩認証装置
WO2009016846A1 (ja) * 2007-08-02 2009-02-05 Panasonic Corporation 虹彩認証装置および虹彩認証システム
JP2010212881A (ja) 2009-03-09 2010-09-24 Olympus Imaging Corp 撮影装置及び撮影制御方法
JP2017062756A (ja) * 2015-09-24 2017-03-30 日本電産リード株式会社 虹彩認証装置
JP2017142772A (ja) * 2016-02-05 2017-08-17 富士通株式会社 虹彩認証装置及び虹彩認証プログラム

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1671258A4 (en) * 2003-09-04 2008-03-19 Sarnoff Corp METHOD AND DEVICE FOR CARRYING OUT AN IRIS DETECTION FROM ONE IMAGE
US9514538B2 (en) * 2012-05-25 2016-12-06 National University Corporation Shizuoka University Pupil detection method, corneal reflex detection method, facial posture detection method, and pupil tracking method
FR3026291A1 (fr) * 2014-09-26 2016-04-01 Morpho Dispositif destine a etre utilise pour identifier ou authentifier un sujet

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08210847A (ja) * 1995-02-06 1996-08-20 Ikegami Tsushinki Co Ltd 画像処理方法
JP2004038531A (ja) * 2002-07-03 2004-02-05 Matsushita Electric Ind Co Ltd 物体の位置検出方法および物体の位置検出装置
JP2004046451A (ja) * 2002-07-10 2004-02-12 Matsushita Electric Ind Co Ltd 目画像撮像装置および個体認証装置
JP2005065813A (ja) 2003-08-21 2005-03-17 Konan Medical Inc スリットランプ
JP2006338236A (ja) 2005-06-01 2006-12-14 Matsushita Electric Ind Co Ltd 眼画像撮影装置およびそれを用いた認証装置
JP2007213369A (ja) * 2006-02-10 2007-08-23 Matsushita Electric Ind Co Ltd 生体認証装置および生体認証方法
JP2008310480A (ja) * 2007-06-13 2008-12-25 Panasonic Corp 虹彩撮影装置および虹彩認証装置
WO2009016846A1 (ja) * 2007-08-02 2009-02-05 Panasonic Corporation 虹彩認証装置および虹彩認証システム
JP2010212881A (ja) 2009-03-09 2010-09-24 Olympus Imaging Corp 撮影装置及び撮影制御方法
JP2017062756A (ja) * 2015-09-24 2017-03-30 日本電産リード株式会社 虹彩認証装置
JP2017142772A (ja) * 2016-02-05 2017-08-17 富士通株式会社 虹彩認証装置及び虹彩認証プログラム

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4488932A4

Also Published As

Publication number Publication date
EP4488932A4 (en) 2025-03-19
US20250014387A1 (en) 2025-01-09
EP4488932A1 (en) 2025-01-08
JPWO2023166629A1 (https=) 2023-09-07

Similar Documents

Publication Publication Date Title
US12182322B2 (en) Visibility improvement method based on eye tracking, machine-readable storage medium and electronic device
JP7675970B2 (ja) 非制約環境において人間の視線及びジェスチャを検出するシステムと方法
JP5137833B2 (ja) 視線方向検出装置および視線方向検出方法
US9489574B2 (en) Apparatus and method for enhancing user recognition
JP5529660B2 (ja) 瞳孔検出装置及び瞳孔検出方法
JP5949319B2 (ja) 視線検出装置及び視線検出方法
US20160011658A1 (en) Systems and methods of eye tracking calibration
WO2019179442A1 (zh) 智能设备的交互目标确定方法和装置
CN111919222B (zh) 识别图像中的对象的装置和方法
JP5001930B2 (ja) 動作認識装置及び方法
CN107209849A (zh) 眼睛跟踪
CN121330011A (zh) 弹性动态投影映射系统和方法
KR102159767B1 (ko) 시선 추적을 이용한 시인성 개선 방법, 저장 매체 및 전자 장치
US10299982B2 (en) Systems and methods for blind and visually impaired person environment navigation assistance
WO2017147748A1 (zh) 一种可穿戴式系统的手势控制方法以及可穿戴式系统
JP6288770B2 (ja) 顔検出方法、顔検出システム、および顔検出プログラム
CN115279254A (zh) 程序、信息处理装置和终端装置
JP2018197974A (ja) 視線検出用コンピュータプログラム、視線検出装置及び視線検出方法
KR101961266B1 (ko) 시선 추적 장치 및 이의 시선 추적 방법
KR20210099780A (ko) 전자 장치 및 그 제어 방법
KR101919138B1 (ko) 원거리 멀티 생체 인식 방법 및 장치
CN113557492A (zh) 利用二维摄像头来辅助对象控制的方法、系统和非暂时性计算机可读记录介质
WO2023228730A1 (ja) 情報処理装置、情報処理システム、情報処理方法およびプログラムが格納された非一時的なコンピュータ可読媒体
CN110291771B (zh) 一种目标对象的深度信息获取方法及可移动平台
WO2023166629A1 (ja) 情報処理システム、情報処理方法、及び記録媒体

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22929774

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 18710664

Country of ref document: US

ENP Entry into the national phase

Ref document number: 2024504104

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2022929774

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2022929774

Country of ref document: EP

Effective date: 20241002

WWW Wipo information: withdrawn in national office

Ref document number: 2022929774

Country of ref document: EP