WO2021090366A1 - 撮像装置 - Google Patents

撮像装置 Download PDF

Info

Publication number
WO2021090366A1
WO2021090366A1 PCT/JP2019/043285 JP2019043285W WO2021090366A1 WO 2021090366 A1 WO2021090366 A1 WO 2021090366A1 JP 2019043285 W JP2019043285 W JP 2019043285W WO 2021090366 A1 WO2021090366 A1 WO 2021090366A1
Authority
WO
WIPO (PCT)
Prior art keywords
infrared light
iris
image
authentication
imaging device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2019/043285
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
有加 荻野
慶一 蝶野
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Corp
Original Assignee
NEC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Corp filed Critical NEC Corp
Priority to EP19951954.7A priority Critical patent/EP4057213A4/en
Priority to US17/767,975 priority patent/US11936963B2/en
Priority to JP2021554440A priority patent/JP7482380B2/ja
Priority to PCT/JP2019/043285 priority patent/WO2021090366A1/ja
Publication of WO2021090366A1 publication Critical patent/WO2021090366A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/08—Mirrors
    • G02B5/0808—Mirrors having a single reflecting layer
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00—Details of cameras or camera bodies; Accessories therefor
    • G03B17/18—Signals indicating condition of a camera member or suitability of light
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/12—Details of acquisition arrangements; Constructional details thereof
    • G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/147—Details of sensors, e.g. sensor lenses
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/197—Matching; Classification
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/60—Static or dynamic means for assisting the user to position a body part for biometric acquisition
    • G06V40/67—Static or dynamic means for assisting the user to position a body part for biometric acquisition by interactive indications to the user
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/70—Multimodal biometrics, e.g. combining information from different biometric modalities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/51—Housings
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body

Definitions

  • the present invention relates to an imaging device used for iris recognition.
  • Patent Document 1 a plurality of iris cameras capable of photographing an iris from a distance are arranged side by side in the vertical direction near the passage path of the person to be authenticated, and the authentication device uses the iris image captured by the iris camera.
  • An iris recognition system that authenticates the iris of the person to be certified is disclosed.
  • the line of sight of the person to be certified faces a plurality of iris cameras other than the iris camera arranged at the optimum height for capturing the iris image. If this happens, the accuracy of iris recognition may decrease.
  • an object of the present invention is to provide an imaging device capable of improving the accuracy of iris recognition in view of the above problems.
  • a visible light camera that captures the face of a person to be certified, a plurality of infrared light cameras provided in the same housing as the visible light camera, and a plurality of infrared light cameras that capture the iris of the person to be certified, and a plurality of infrared cameras.
  • An optical filter that covers each light-receiving surface of the infrared camera and is provided on the housing so as not to cover the light-receiving surface of the visible light camera, has a passing band in the infrared region, and has a blocking band in the visible region.
  • an imaging device capable of improving the accuracy of iris recognition.
  • FIG. 1 is a block diagram showing an overall configuration example of the iris authentication system 1.
  • the iris authentication system 1 captures the iris of the user U who is the authentication target, and authenticates by collating the captured image with the registered iris image.
  • the pattern of the iris is invariant for all and is immutable for life. Therefore, the identity can be confirmed by collating the iris pattern acquired at the time of the authentication process with the iris image registered in advance in the database.
  • the iris recognition system 1 in the present embodiment can be applied to, for example, identity verification for entry / exit to various facilities, identity verification for entry / exit at airports, seaports, and borders, identity verification at administrative agencies, and the like.
  • the iris recognition system 1 includes an imaging device 10, a control device 20, and an authentication device 30. Each device is connected to a network NW such as a LAN (Local Area Network) or the Internet.
  • NW such as a LAN (Local Area Network) or the Internet.
  • the image pickup device 10 takes an image of the user U existing in the authentication area based on the control information input from the control device 20, and outputs the captured image to the control device 20.
  • the imaging device 10 in the present embodiment includes a visible light camera 11, an iris imaging camera 12, a bandpass filter 13, a half mirror 14, and a display unit 15.
  • the visible light camera 11 is an imaging device that captures images of the user U's face, eyes, and the like with visible light.
  • the visible light camera 11 captures an entire image (first image) including at least a part of the face of the person to be authenticated.
  • a digital camera using a CMOS (Complementary Metal Oxide Semiconductor) image sensor, a CCD (Charge Coupled Device) image sensor, or the like can be used so as to be suitable for image processing in the control device 20.
  • the visible light camera 11 may further include a light source that irradiates the user U with illumination light.
  • the iris imaging camera 12 is an imaging device including an infrared light irradiation device 12a and an infrared light camera 12b, and captures an image (second image) of the eye of the user U with infrared light. That is, the imaging device 10 in the present embodiment has two types of cameras that image the user U with light in different wavelength ranges.
  • the infrared light irradiation device 12a includes a light emitting element that emits infrared light such as an infrared light LED.
  • the wavelength of the infrared light emitted from the infrared light irradiation device 12a can be, for example, a near-infrared region of about 800 nm.
  • the infrared light camera 12b includes a light receiving element configured to have sensitivity to infrared light.
  • a digital camera using a CMOS image sensor, a CCD image sensor, or the like can be used as the infrared light camera 12b.
  • By acquiring an iris image captured by infrared light a high-contrast image can be obtained regardless of the color of the iris, and the influence of reflection by the cornea can be reduced.
  • the bandpass filter 13 is an optical filter having a pass band in the infrared region and a blocking band in the visible region. That is, the bandpass filter 13 does not transmit visible light incident from the user U side, but can selectively transmit infrared light having a desired wavelength.
  • the half mirror 14 reflects a part of the visible light incident from the user U side and transmits the other part of the visible light. Further, the bandpass filter 13 and the half mirror 14 in the present embodiment have a mirror surface that reflects visible light. As a result, the user U can confirm his / her face reflected on the mirror surface of the band pass filter 13 and the half mirror 14.
  • the display unit 15 is a liquid crystal display, an OLED (Organic Light Emitting Diode) display, or the like, and displays information related to iris recognition by means of moving images, still images, characters, and the like.
  • the display mode of the display unit 15 can be entered by, for example, characters such as “passable” and “impossible”, figures such as “circle” and “X”, and colors such as “red” and “green”. It may indicate whether or not it is possible, but it is not particularly limited.
  • the control device 20 is a computer such as a server that controls various processes in the image pickup device 10. Specifically, the control device 20 detects the position of the eyes of the user U (authentication target person) based on the entire image captured by the visible light camera 11, and infrared rays according to the height of the eyes of the user U. The optical camera 12b is selected and the iris of the user U is imaged.
  • control device 20 extracts the iris image from the image of the eye captured by the infrared light camera 12b, and requests the authentication device 30 to execute the iris recognition based on the iris image. Then, the control device 20 displays the authentication result of the authentication device 30 on the display unit 15. In the state where characters or the like are displayed on the display unit 15, the line of sight of the user U is likely to be guided toward the display unit 15, so that the control device 20 captures the iris of the user U with the infrared light camera 12b. It is preferable to control the display unit 15 to be hidden before the display.
  • the authentication device 30 is a computer such as a server that executes an authentication process in response to an authentication request from the control device 20. Specifically, the authentication device 30 executes a collation process of the iris image (or feature amount) captured by the infrared light camera 12b and the registered iris image (or feature amount) registered in the biological information database 31. Then, the user U is authenticated based on the collation result.
  • the biological information database 31 is a database that stores the biological information of the registrant. Specifically, the biological information database 31 stores the left and right eye images of the registrant, the iris image detected from the eye image, the iris feature amount calculated from the iris image, and the like in association with the registrant's ID. To do.
  • the biological information database 31 may be configured as another device independent of the authentication device 30.
  • FIG. 2 is a perspective view of the image pickup apparatus 10.
  • FIG. 3 is a front view of the image pickup apparatus 10.
  • FIG. 4 is a transmission side view of the image pickup apparatus 10.
  • the bandpass filter 13, the half mirror 14, and the display unit 15 are arranged on the same surface side of the housing 16.
  • the bandpass filter 13 is arranged above the half mirror 14 in the vertical direction.
  • the display unit 15 is arranged below the half mirror 14 in the vertical direction.
  • the visible light camera 11 and the iris imaging camera 12 described above are housed inside the housing 16 (see FIGS. 3 and 4).
  • the bottom portion of the housing 16 is connected to the upper end portion of the support column 17.
  • the length of the support column 17 can be appropriately changed according to the height range of the person to be certified.
  • a visible light camera 11, a iris imaging camera 12 (infrared light irradiation device 12a / infrared light camera 12b), and a power cable (not shown) of the display unit 15 can be passed through the support column 17 along the central axis. It is preferable that an internal space is formed.
  • the lower end of the support column 17 is connected to a disk-shaped support base 18.
  • FIG. 3 shows a state in which the bandpass filter 13, the half mirror 14, and the cover 15a (see FIG. 4) covering the front surface of the display unit 15 are removed from the housing 16.
  • four infrared light irradiation devices 12a are arranged vertically and in a straight line on the left side of the housing 16 in a front view. Further, on the right side of the four infrared light irradiation devices 12a, three infrared light cameras 12b are arranged side by side in the vertical direction and in a straight line.
  • only one bandpass filter 13 is provided on the housing 16 so as to cover the light receiving surface of each of the plurality of infrared light cameras 12b and not to cover the light receiving surface of the visible light camera 11. ing. Therefore, only infrared light having a predetermined wavelength can be selectively incident on the infrared light camera 12b. Further, there is an advantage that it can be easily attached to the housing 16 and the manufacturing cost can be suppressed.
  • the half mirror 14 is provided so as to cover the light receiving surface of the visible light camera 11. Since the infrared light is not incident on the visible light camera 11, the control device 20 can detect the face (particularly eyes) of the user U from the entire image with high accuracy.
  • the visible light camera 11 is arranged below the infrared light camera 12b and the bandpass filter 13. Therefore, the visible light camera 11 can easily image the face of the user U as compared with the case where the visible light camera 11 is arranged above the infrared light camera 12b and the bandpass filter 13.
  • the three infrared light cameras 12b are arranged at regular intervals D1 in the vertical direction. This facilitates the association between the eye height position (or height range) of the user U to be imaged and the infrared light camera 12b used for iris imaging.
  • the distance D2 between the infrared light camera 12b and the visible light camera 11 at the lowest position may be different from the distance D1 or may be the same length.
  • a transparent cover 15a formed of acrylic resin or the like is provided on the front surface of the display unit 15.
  • a half mirror 14 may be provided instead of the cover 15a.
  • the light receiving surfaces of the three infrared light cameras 12b are aligned at different heights in the vertical direction.
  • the focal positions of the plurality of infrared light cameras 12b are aligned in a straight line in the vertical direction.
  • each of the plurality of infrared light cameras 12b has an angle of view set so that the iris of both eyes of the user U can be imaged at the same time. In this case, it is possible to acquire many features as compared with the case where only one eye is imaged by one imaging.
  • FIG. 5 is a diagram for explaining the visual field range of the image pickup apparatus 10 in the vertical direction.
  • the image pickup process is performed by any of the three infrared light cameras 12b.
  • the field of view of the three infrared light cameras 12b arranged in the vertical direction is indicated by broken lines. In the field of view ranges A and B, and B and C, some regions overlap at position P1.
  • the three visual field ranges A, B, and C together form one large visual field range.
  • the length of the visual field range in the vertical direction is indicated by reference numeral H.
  • the horizontal length of the field of view is common among the three infrared light cameras 12b.
  • the field of view D of the visible light camera 11 is widely set so that the whole body of the user U can be imaged.
  • the angle of view of the visible light camera 11 is set so that the viewing range D includes a height of about 3 m from the ground in the vertical direction.
  • the control device 20 determines the gaze region to be read out at high speed by the selected infrared light camera 12b.
  • the gaze area is determined, for example, in consideration of the distance between the eyes arranged in the horizontal direction and the general size of the eyes.
  • the control device 20 controls the imaging process of the imaging device 10 so that the iris is included in the gaze area. As a result, the control device 20 can acquire a high-resolution iris image. That is, even when a general-purpose infrared camera 12b is used, the level of the captured image required for iris recognition can be satisfied.
  • FIG. 6 is a block diagram showing a hardware configuration example of the control device 20.
  • the control device 20 is a computer that performs calculation, control, and storage, such as a CPU (Central Processing Unit) 201, a RAM (Random Access Memory) 202, a ROM (Read Only Memory) 203, an HDD (Hard Disk Drive) 204, and a communication I / It includes an F (interface) 205, a display device 206, and an input device 207.
  • the CPU 201, RAM 202, ROM 203, HDD 204, communication I / F 205, display device 206, and input device 207 are connected to each other via a bus 208 or the like.
  • the CPU 201 is a processor having a function of performing a predetermined operation according to a program stored in the ROM 203 and the HDD 204 and controlling each part of the control device 20.
  • the RAM 202 is composed of a volatile storage medium and provides a temporary memory area necessary for the operation of the CPU 201.
  • the ROM 203 is composed of a non-volatile storage medium and stores necessary information such as a program used for the operation of the control device 20.
  • the HDD 204 is a storage device composed of a non-volatile storage medium and storing data required for processing, an operation program of the control device 20, and the like.
  • Communication I / F205 is a communication interface based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), and 4G, and is a module for communicating with other devices.
  • the display device 206 is a liquid crystal display, an OLED display, or the like, and is used for displaying moving images, still images, characters, and the like.
  • the input device 207 is a keyboard, a pointing device, a button, or the like, and accepts operations by the administrator of the control device 20.
  • the display device 206 and the input device 207 may be integrally formed as a touch panel.
  • FIG. 7 is a block diagram showing a hardware configuration example of the authentication device 30.
  • the authentication device 30 includes a CPU 301, a RAM 302, a ROM 303, an HDD 304, a communication I / F 305, a display device 306, and an input device 307.
  • the CPU 301, RAM 302, ROM 303, HDD 304, communication I / F 305, display device 306, and input device 307 are connected to each other via a bus 308 or the like.
  • the function of each device of the authentication device 30 is the same as that of the control device 20 described above.
  • FIGS. 6 and 7 are examples, and devices other than these may be added or some devices may not be provided. Further, some devices may be replaced with another device having the same function. Further, some functions of the present embodiment may be provided by other devices via the network NW, or the functions of the present embodiment may be distributed and realized by a plurality of devices. As described above, the hardware configuration shown in FIGS. 7 and 8 can be changed as appropriate.
  • FIG. 8 is a sequence diagram showing an example of processing of the iris authentication system 1 in the present embodiment.
  • step S101 when the visible light camera 11 takes an image of the user U existing in the authentication area (step S101), the visible light camera 11 outputs the entire image of the user U to the control device 20 (step S102).
  • steps S101 and S102 are repeated at regular intervals.
  • control device 20 calculates the eye height position of the user U (step S104).
  • control device 20 selects one infrared light camera 12b according to the eye height calculated in step S104 from the plurality of infrared light cameras 12b (step S105).
  • control device 20 outputs the imaging control information that causes the infrared light camera 12b selected in step S105 to image the iris of the user U (step S106). That is, the control device 20 irradiates the face of the user U with infrared light from the plurality of infrared light irradiation devices 12a, and also causes the infrared light camera 12b to include the eye height position of the user U in the visual field range. Control is performed so that the eyes of the user U are imaged.
  • the infrared light is emitted from the infrared light irradiating device 12a corresponding to at least the eye height position of the user U toward the face of the user U.
  • the infrared light of one or both of the highest position and the center position is synchronized with the image pickup process.
  • Infrared light may be irradiated from the irradiation device 12a toward the face of the user U.
  • the infrared light camera 12b when the infrared light camera 12b images the eyes of the user U based on the image pickup control information received from the control device 20 (step S107), the infrared light camera 12b outputs the image of the eyes to the control device 20 (step S108).
  • the size of the eye image captured by each of the plurality of infrared light cameras 12b is set so that one image includes both eyes.
  • the processes of steps S107 and S108 are repeatedly executed at a predetermined frame rate.
  • control device 20 acquires the image of the user U's eyes from the infrared light camera 12b, the control device 20 identifies the positions of the irises of both eyes in the image of the eyes and extracts the iris images for both eyes (step S109). ..
  • control device 20 transmits an authentication request based on the iris images of both eyes of the user U to the authentication device 30 (step S110).
  • the authentication device 30 When the authentication device 30 receives the authentication request from the control device 20, the authentication device 30 collates the iris images of both eyes of the user U with the iris images of the registrants stored in advance in the biological information database 31. The authentication device 30 executes iris recognition based on the collation result of the collation process (step S111), and transmits the authentication result to the control device 20 (step S112).
  • control device 20 When the control device 20 receives the authentication result from the authentication device 30, it outputs display control information for displaying the authentication result on the display unit 15 (step S113).
  • the display unit 15 displays the authentication result on the screen based on the display control information input from the control device 20 (step S114).
  • the authentication accuracy is improved by using an image obtained by capturing the user's face from the front.
  • the user U can visually recognize the plurality of cameras from the outside, there may be a problem that the user U looks at a camera other than the camera at the optimum height for capturing the iris image.
  • each light receiving surface of the plurality of infrared light cameras 12b is collectively covered by one bandpass filter 13 (optical filter). That is, since the image pickup apparatus 10 of the present embodiment has a configuration in which the user U cannot visually recognize the plurality of infrared light cameras 12b from the outside, the user U naturally faces the front of the image pickup apparatus 10 as described above. Such a problem does not occur. As described above, according to the present embodiment, since the image pickup device 10 can image the face of the user U by the infrared light camera 12b located in front of the user U, the authentication device 30 can perform the iris recognition of the user U with higher accuracy. it can.
  • the bandpass filter 13 in the present embodiment is visually recognized as a mirror surface when viewed from the user U side.
  • An image of the user U is displayed on the bandpass filter 13.
  • the user U naturally faces the image pickup apparatus 10 in order to directly look at his / her face reflected in the bandpass filter 13.
  • the accuracy of the iris authentication can be further improved.
  • FIG. 9 is a perspective view of the image pickup apparatus 10 according to the present embodiment.
  • the image pickup apparatus 10 in the present embodiment further includes three line-of-sight guidance portions 101 in the plane of the bandpass filter 13.
  • the three line-of-sight guidance units 101 are arranged at heights corresponding to the positions of the three infrared light cameras 12b shown in FIG.
  • the line-of-sight guidance unit 101 is a member for guiding the line-of-sight of the user U to any height of the plurality of infrared light cameras 12b.
  • the image pickup apparatus 10 further includes an indicator 102 on the side surface of the housing 16.
  • the indicator 102 is a member that indicates the operating status of the device.
  • an LED capable of emitting light in a plurality of kinds of colors is preferably used as the line-of-sight guidance unit 101 and the indicator 102.
  • the control device 20 executes the imaging process in the infrared light camera 12b at the highest position
  • the control device 20 causes the line-of-sight guidance unit 101 at the highest position to emit light to direct the line of sight of the user U in a desired direction.
  • the indicator 102 may indicate, for example, the operating status of "the device is stopped" by “red” and “the device is operating” by “green”, but is not particularly limited.
  • FIG. 10 is a sequence diagram showing an example of processing of the iris authentication system 1 in the present embodiment.
  • step S201 when the visible light camera 11 takes an image of the user U existing in the authentication area (step S201), the visible light camera 11 outputs the entire image of the user U to the control device 20 (step S202).
  • steps S201 and S202 are repeated at regular intervals.
  • control device 20 calculates the eye height position of the user U (step S204).
  • control device 20 selects one each of the infrared light camera 12b and the line-of-sight guidance unit 101 according to the eye height calculated in step S204 from the plurality of infrared light cameras 12b (step). S205).
  • the control device 20 outputs lighting control information in order to guide the line-of-sight direction of the user U to the line-of-sight guidance unit 101 selected in step S205 (step S206).
  • the line-of-sight guidance unit 101 selected in step S205 lights up based on the lighting control information from the control device 20 (step S207). That is, the control device 20 refers to the infrared light camera 12b selected in order to guide the line of sight of the user U toward the infrared light camera 12b located in the front direction with respect to the eye level position of the user U. Control is performed so that only the corresponding line-of-sight guidance unit 101 is turned on.
  • the control device 20 outputs display control information to the display unit 15 in order to display a guidance message regarding iris authentication to the user U (step S208).
  • the display unit 15 displays a guidance message on the screen based on the display control information from the control device 20 (step S209).
  • guidance messages such as "Authentication will start, so look at the face reflected in the mirror” and "Look at the direction of the LED that is lit” are displayed. , Not limited to this.
  • the control device 20 "Failed in the authentication process. The eyes will be photographed, so please face the front.”
  • An error message such as "Please remove the sunglasses” may be displayed on the display unit 15.
  • control device 20 outputs the imaging control information that causes the infrared light camera 12b selected in step S205 to image the iris of the user U (step S210). That is, the control device 20 irradiates the face of the user U with infrared light from the plurality of infrared light irradiation devices 12a, and also causes the infrared light camera 12b to include the eye height position of the user U in the visual field range. Control is performed so that the eyes of the user U are imaged.
  • the infrared light camera 12b when the infrared light camera 12b images the eyes of the user U based on the image pickup control information received from the control device 20 (step S211), the infrared light camera 12b outputs the image of the eyes to the control device 20 (step S212).
  • the size of the eye image captured by each of the plurality of infrared light cameras 12b is set so that one image includes both eyes.
  • the processes of steps S211 and S212 are repeatedly executed at a predetermined frame rate.
  • control device 20 acquires the image of the user U's eyes from the infrared light camera 12b, the control device 20 identifies the positions of the irises of both eyes in the image of the eyes and extracts the iris images for both eyes (step S213). ..
  • control device 20 transmits an authentication request based on the iris images of both eyes of the user U to the authentication device 30 (step S214).
  • the authentication device 30 When the authentication device 30 receives the authentication request from the control device 20, the authentication device 30 collates the iris images of both eyes of the user U with the iris images of the registrants stored in advance in the biological information database 31. The authentication device 30 executes iris recognition based on the collation result of the collation process (step S215), and transmits the authentication result to the control device 20 (step S216).
  • control device 20 When the control device 20 receives the authentication result from the authentication device 30, it outputs display control information for displaying the authentication result on the display unit 15 (step S217).
  • the display unit 15 displays the authentication result on the screen based on the display control information input from the control device 20 (step S218).
  • a plurality of line-of-sight guidance units 101 corresponding to a plurality of infrared light cameras 12b arranged at different heights in the vertical direction are further provided.
  • the line of sight of the user U can be guided in a desired direction as compared with the case of the first embodiment, so that the accuracy of iris authentication can be further improved.
  • FIG. 11 is a block diagram showing a configuration example of the image pickup apparatus 100 according to the third embodiment.
  • the image pickup apparatus 100 includes a visible light camera 100A, a plurality of infrared light cameras 100B, and an optical filter 100C.
  • the visible light camera 100A captures the user's face.
  • the plurality of infrared light cameras 100B are provided in the same housing as the visible light camera 100A, and capture the iris of the user.
  • the optical filter 100C is provided on the housing so as to cover the light receiving surface of each of the plurality of infrared light cameras 100B and not to cover the light receiving surface of the visible light camera 100A, and has a pass band in the infrared region and has a visible region. Has a blocking band. According to this embodiment, the accuracy of iris recognition can be improved.
  • the control device 20 calculates the eye height of the user U from the entire image captured by the visible light camera 11, and among a plurality of infrared light cameras 12b having different heights, the eye height One infrared camera 12b was selected according to the situation.
  • the control device 20 selects, for example, the optimum eye image according to the eye height calculated based on the entire image from the images input from each of the plurality of infrared light cameras 12b, and selects an iris image. Should be extracted.
  • the eye height of the user U fluctuates in time (for example, the user U is walking).
  • the optimum eye image can be selected according to the eye height calculated based on the whole image. Further, when the eyes of the user U are located in the area where the viewing ranges of the two adjacent infrared light cameras 12b overlap, a more appropriate iris image is selected from the two iris images. Can be used for authentication.
  • the visible light camera 11 is arranged below the plurality of infrared light cameras 12b and the bandpass filter 13 arranged in the vertical direction.
  • the visible light camera 11 may be arranged on the side of a plurality of infrared light cameras 12b arranged in the vertical direction, for example.
  • 12 and 13 are a front view and a perspective view of the image pickup apparatus 10 in the modified embodiment.
  • the visible light camera 11 is arranged on the right side of the infrared light camera 12b located at the center.
  • the half mirror 14 is arranged on the right side of the bandpass filter 13 corresponding to the arrangement of the visible light camera 11 shown in FIG.
  • an appropriate infrared light camera 12b can be selected from the plurality of infrared light cameras 12b.
  • FIG. 14 to 23 are front views of the image pickup apparatus 10 in the modified embodiment.
  • the positional relationship between the plurality of infrared light irradiation devices 12a, the plurality of infrared light cameras 12b, and the display unit 15 on the same surface side of the housing 16 is not particularly limited. Further, the number and shape of each device are not particularly limited.
  • the display unit 15 may be arranged above the plurality of infrared light irradiation devices 12a and the plurality of infrared light cameras 12b in the vertical direction (FIG. 14). And FIG. 15). Further, the display unit 15 may have a shape longer in the vertical direction (vertical direction) than in the horizontal direction (horizontal direction), and the length in the vertical direction may be appropriately changed (see FIGS. 16 and 17).
  • the visible light camera 11 includes the display unit 15 and the plurality of infrared light cameras. It may be arranged between 12b (see FIG. 15).
  • the visible light camera 11 may be arranged in the center in the horizontal direction (see FIGS. 14, 19, 20, 22, 22).
  • the visible light camera 11 does not have to be aligned with the plurality of infrared light irradiation devices 12a in the vertical direction (see FIGS. 14, 16, 18, 19, 19, 20, and 23).
  • the visible light camera 11 may be arranged on the left side of the plurality of infrared light cameras 12b (see FIG. 18), or may be arranged above the plurality of infrared light cameras 12b (FIG. 15, FIG. 19, see FIG. 20).
  • the plurality of infrared light irradiation devices 12a and the plurality of infrared light cameras 12b may be arranged in a straight line in the vertical direction and alternately (see FIGS. 16 and 17).
  • the display unit 15 and the visible light camera 11 may be arranged on the right side of the plurality of infrared light irradiation devices 12a and the plurality of infrared light cameras 12b (see FIGS. 16 and 17).
  • a part of the plurality of infrared light cameras 12b may be arranged below the plurality of infrared light irradiation devices 12a (see FIG. 20).
  • each of the infrared light irradiation device 12a and the infrared light camera 12b may be increased or decreased (see FIGS. 21, 22, and 23).
  • three infrared light cameras 12b are provided symmetrically around the four infrared light irradiation devices 12a, for a total of six.
  • two visible light cameras 11 are provided side by side so as to correspond to the arrangement of the infrared light cameras 12b which are divided into two rows on the left and right.
  • four infrared light irradiation devices 12a are provided symmetrically around the three infrared light cameras 12b, for a total of eight devices.
  • a plurality of infrared light cameras 12b may be arranged separately on different axes in the vertical direction.
  • four infrared light irradiation devices 12a and four infrared light cameras 12b are divided into two rows in the left-right direction (horizontal direction), and alternate in the left-right direction and the up-down direction (vertical direction). Is located in.
  • the authentication device 30 performs one-factor authentication based on the iris image.
  • the authentication device 30 may perform two-factor authentication in which both the face image and the iris image are used for collation and the results of both are integrated for authentication.
  • the control device 20 detects the face image of the user U from the entire image input from the visible light camera 11 and transmits the face image together with the iris image acquired from the infrared light camera 12b to the authentication device 30. May be good.
  • FIG. 24 is a perspective view of the image pickup apparatus 10 in the modified embodiment.
  • a configuration is shown in which a drive device 103 capable of driving the housing 16 in the vertical direction is further provided below the support column 17.
  • the control device 20 can output the drive control information for moving the housing 16 up and down according to the eye height to the drive device 103.
  • the drive device 103 adjusts the height of the housing 16 based on the drive control information.
  • the drive device 103 includes a motor, and the housing 16 is driven in the vertical direction by the driving force generated by the motor. In this case, it becomes possible to flexibly correspond to the heights of a plurality of authentication target persons.
  • the configuration of the iris recognition system 1 is an example, and devices other than the image pickup device 10, the control device 20, and the authentication device 30 may be further provided.
  • a gate device having an opening / closing member (for example, a door) that opens / closes based on the authentication result in the authentication device 30 and a guide member (for example, a rope, a fence, a guide light) that defines a movement path of the user U may be further provided. ..
  • a guide member for example, a rope, a fence, a guide light
  • another camera other than the visible light camera 11 and the infrared light camera 12b may be further provided.
  • the image pickup device 10 and the control device 20 may be integrally provided in the same device, or may be provided at a distant place.
  • the control device 20 and the authentication device 30 may be integrally provided in the same device, or may be provided at distant places.
  • Each embodiment also has a processing method in which a program for operating the configuration of the embodiment is recorded on a recording medium so as to realize the functions of the above-described embodiment, the program recorded on the recording medium is read out as a code, and the program is executed by a computer. It is included in the category of. That is, a computer-readable recording medium is also included in the scope of each embodiment. Further, not only the recording medium on which the above-mentioned program is recorded but also the program itself is included in each embodiment.
  • the recording medium for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a non-volatile memory card, or the like can be used.
  • a floppy (registered trademark) disk for example, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a non-volatile memory card, or the like
  • the program that executes the process by the program recorded on the recording medium alone, but also the program that operates on the OS and executes the process in cooperation with the functions of other software and the expansion board is also in each embodiment. It is included in the category of.
  • a visible light camera that captures the user's face A plurality of infrared light cameras provided in the same housing as the visible light camera and capturing the iris of the user, and It is provided on the housing so as not to cover the light receiving surface of the visible light camera while covering each light receiving surface of the plurality of infrared light cameras, has a pass band in the infrared region, and has a blocking band in the visible region.
  • Optical filter and An imaging device comprising.
  • the optical filter has a mirror surface that reflects light in the visible region.
  • the imaging device according to Appendix 1.
  • the half mirror reflects a part of the light in the visible region incident from the user side and transmits the other part to the visible light camera side.
  • the imaging device according to Appendix 4.
  • Appendix 6 The plurality of infrared light cameras simultaneously capture the iris of both eyes of the user.
  • the imaging device according to any one of Appendix 1 to 5.
  • Appendix 8 Further equipped with an indicator showing the operating status of the device, The imaging device according to any one of Appendix 1 to 7.
  • Appendix 9 The plurality of infrared light cameras are arranged side by side in the vertical direction.
  • the imaging device according to any one of Appendix 1 to 8.
  • a line-of-sight guidance unit that guides the user's line of sight at any height of the plurality of infrared light cameras is further provided.
  • the imaging device according to Appendix 9 or 10.
  • the visible light camera is arranged below the plurality of infrared light cameras arranged in the vertical direction.
  • the imaging device according to any one of Supplementary note 9 to 11.
  • the visible light camera is arranged on the side of a plurality of the infrared light cameras arranged in the vertical direction.
  • the imaging device according to any one of Supplementary note 9 to 11.
  • Appendix 14 The imaging apparatus according to any one of Appendix 1 to 13 and A control device that controls the image pickup device based on the entire image including the face of the user captured by the visible light camera, and a control device.
  • An authentication device that executes iris recognition of the user based on the iris image captured by the infrared light camera, and Iris recognition system with.
  • the control device causes the infrared light camera, which corresponds to the height of the user's eyes obtained from the whole image, to image the iris among the plurality of infrared light cameras.
  • the iris recognition system according to Appendix 14.
  • the authentication device is the image captured by the infrared camera according to the height of the user's eyes obtained from the entire image among the iris images captured by the plurality of infrared cameras. Perform the iris recognition based on the iris image, The iris recognition system according to Appendix 14.
  • Appendix 17 Further provided with a drive device for driving the housing in the vertical direction, The control device controls the drive of the drive device based on the eye level position of the user obtained from the whole image.
  • the iris recognition system according to Appendix 14.
  • the authentication device executes face authentication of the user based on the whole image, and authenticates the user based on the results of the face authentication and the iris authentication.
  • the iris recognition system according to Appendix 15.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Ophthalmology & Optometry (AREA)
  • Optics & Photonics (AREA)
  • Vascular Medicine (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Image Input (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Collating Specific Patterns (AREA)
PCT/JP2019/043285 2019-11-05 2019-11-05 撮像装置 Ceased WO2021090366A1 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP19951954.7A EP4057213A4 (en) 2019-11-05 2019-11-05 IMAGING DEVICE
US17/767,975 US11936963B2 (en) 2019-11-05 2019-11-05 Imaging device
JP2021554440A JP7482380B2 (ja) 2019-11-05 2019-11-05 撮像装置
PCT/JP2019/043285 WO2021090366A1 (ja) 2019-11-05 2019-11-05 撮像装置

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2019/043285 WO2021090366A1 (ja) 2019-11-05 2019-11-05 撮像装置

Publications (1)

Publication Number Publication Date
WO2021090366A1 true WO2021090366A1 (ja) 2021-05-14

Family

ID=75849679

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/043285 Ceased WO2021090366A1 (ja) 2019-11-05 2019-11-05 撮像装置

Country Status (4)

Country Link
US (1) US11936963B2 (https=)
EP (1) EP4057213A4 (https=)
JP (1) JP7482380B2 (https=)
WO (1) WO2021090366A1 (https=)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2023135640A1 (https=) * 2022-01-11 2023-07-20
JPWO2024166383A1 (https=) * 2023-02-10 2024-08-15

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102023110954A1 (de) * 2023-04-27 2024-10-31 Veridos Gmbh Vorrichtung zur Iriserkennung beim Vorbeigehen

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002122899A (ja) * 2000-10-16 2002-04-26 Matsushita Electric Ind Co Ltd 虹彩撮像装置
JP2004167046A (ja) * 2002-11-21 2004-06-17 Yunitoron:Kk 虹彩撮影装置
WO2009016846A1 (ja) 2007-08-02 2009-02-05 Panasonic Corporation 虹彩認証装置および虹彩認証システム
JP2017151556A (ja) * 2016-02-22 2017-08-31 富士通株式会社 電子機器、認証方法および認証プログラム
JP2018109935A (ja) * 2016-12-28 2018-07-12 グローリー株式会社 顔照合装置及び顔照合方法

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4148700B2 (ja) * 2002-05-30 2008-09-10 松下電器産業株式会社 目画像撮像装置
JP4310979B2 (ja) 2002-08-26 2009-08-12 パナソニック株式会社 認証装置
EP1671258A4 (en) * 2003-09-04 2008-03-19 Sarnoff Corp METHOD AND DEVICE FOR CARRYING OUT AN IRIS DETECTION FROM ONE IMAGE
JP2005242677A (ja) 2004-02-26 2005-09-08 Ntt Comware Corp 複合認証システムおよびその方法ならびにプログラム
JP2006163683A (ja) * 2004-12-06 2006-06-22 Matsushita Electric Ind Co Ltd 眼画像撮影装置およびそれを用いた認証装置
JP2008310463A (ja) 2007-06-13 2008-12-25 Panasonic Corp 生体認証装置
KR20100057983A (ko) * 2008-11-24 2010-06-03 한국전자통신연구원 생체 인식 시스템의 다중 영상 획득 장치
JP5879562B2 (ja) 2011-12-22 2016-03-08 パナソニックＩｐマネジメント株式会社 カメラ付きミラー装置、ミラー付き什器
WO2014192876A1 (ja) * 2013-05-30 2014-12-04 独立行政法人産業技術総合研究所 撮像システム及び撮像方法
KR102237479B1 (ko) * 2014-06-03 2021-04-07 (주)아이리스아이디 홍채 인식 단말기 및 방법
WO2016117452A1 (ja) * 2015-01-19 2016-07-28 旭硝子株式会社 光学装置および光学部材
JP2019506694A (ja) * 2016-01-12 2019-03-07 プリンストン・アイデンティティー・インコーポレーテッド 生体測定分析のシステムおよび方法
CN109313379A (zh) 2016-06-17 2019-02-05 夏普株式会社 图像摄像装置及滤光片
CN106295536B (zh) 2016-08-02 2019-05-03 北京无线电计量测试研究所 自适应式虹膜识别装置及利用该装置进行虹膜识别的方法
KR102773928B1 (ko) * 2016-11-04 2025-03-04 삼성전자주식회사 눈을 촬영하여 정보를 획득하는 방법 및 장치
JP7580271B2 (ja) * 2017-11-07 2024-11-11 スリーエム イノベイティブ プロパティズ カンパニー 光学フィルム及びそれを含むシステム
WO2019118716A1 (en) * 2017-12-13 2019-06-20 Princeton Identity, Inc. Systems and methods of multi-modal biometric analisis

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002122899A (ja) * 2000-10-16 2002-04-26 Matsushita Electric Ind Co Ltd 虹彩撮像装置
JP2004167046A (ja) * 2002-11-21 2004-06-17 Yunitoron:Kk 虹彩撮影装置
WO2009016846A1 (ja) 2007-08-02 2009-02-05 Panasonic Corporation 虹彩認証装置および虹彩認証システム
JP2017151556A (ja) * 2016-02-22 2017-08-31 富士通株式会社 電子機器、認証方法および認証プログラム
JP2018109935A (ja) * 2016-12-28 2018-07-12 グローリー株式会社 顔照合装置及び顔照合方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4057213A4

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2023135640A1 (https=) * 2022-01-11 2023-07-20
WO2023135640A1 (ja) 2022-01-11 2023-07-20 日本電気株式会社 撮像システム、撮像装置、撮像方法、及び記録媒体
JP7764899B2 (ja) 2022-01-11 2025-11-06 日本電気株式会社 撮像システム、撮像装置、撮像方法、及び記録媒体
JPWO2024166383A1 (https=) * 2023-02-10 2024-08-15
WO2024166383A1 (ja) * 2023-02-10 2024-08-15 日本電気株式会社 情報処理装置、情報処理方法及び記録媒体
JP7845514B2 (ja) 2023-02-10 2026-04-14 日本電気株式会社 情報処理装置、情報処理方法及び記録媒体

Also Published As

Publication number Publication date
EP4057213A1 (en) 2022-09-14
US11936963B2 (en) 2024-03-19
JPWO2021090366A1 (https=) 2021-05-14
EP4057213A4 (en) 2022-10-12
US20230188814A1 (en) 2023-06-15
JP7482380B2 (ja) 2024-05-14

Similar Documents

Publication Publication Date Title
US7715595B2 (en) System and method for iris identification using stereoscopic face recognition
KR100842501B1 (ko) 홍채 인식 시스템의 눈위치 표시장치
US20050084137A1 (en) System and method for iris identification using stereoscopic face recognition
JP7590005B2 (ja) 虹彩撮像装置、虹彩撮像方法およびプログラム
EP2953057B1 (en) Iris recognition terminal and method
JP7482380B2 (ja) 撮像装置
JP2002352235A (ja) 虹彩認識システムの焦点距離を合わせる装置及び方法
JP7223303B2 (ja) 情報処理装置、情報処理システム、情報処理方法及びプログラム
JP2010509657A (ja) 生体識別のための方法及び装置
CN1328309A (zh) 基于生物测量的身份鉴定装置、身份鉴定系统、身份鉴定卡及身份鉴定方法
US20250371909A1 (en) Gate system
JP2003006628A (ja) アイリス認識装置
WO2022003801A1 (ja) ゲート装置、ゲートシステム、ゲート制御方法
JP6945391B2 (ja) 生体認証装置
EP4033400B1 (en) System for acquiring iris image to enlarge iris recognition range
KR101548624B1 (ko) 홍채의 포커싱이 자동 조절되는 홍채 인식 시스템 및 그 방법
JP2008310463A (ja) 生体認証装置
JP7696106B2 (ja) 生体情報取得装置および生体認証システム
KR102756408B1 (ko) 출입자 통제 및 관리 시스템
WO2002007068A1 (en) An authentication device for forming an image of at least a partial area of an eye retina
US20040179721A1 (en) Image apparatus and face authentication apparatus
KR100557037B1 (ko) 홍채 인식 시스템의 눈위치 표시장치
KR100410972B1 (ko) 홍채 인식 시스템의 촛점 거리 지시 장치
EP2381427A1 (en) Method and device for automatic renewal of an identitiy document
KR100547333B1 (ko) 홍채 시스템의 거리 표시 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19951954

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021554440

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2019951954

Country of ref document: EP

Effective date: 20220607