Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
  • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
  • G06V40/18—Eye characteristics, e.g. of the iris
  • G06V40/19—Sensors therefor

Definitions

• This disclosure relates to the technical fields of information processing systems, information processing methods, and recording media.
• Patent Document 1 discloses capturing an image after controlling the lighting so as to meet criteria for face matching.
• Patent Document 2 discloses identifying whether external light is reflected in an iris image, and, if so, excluding the reflected area to perform iris authentication.
• Patent Document 3 discloses providing a cylindrical mechanism to prevent external light from directly entering the camera.
• One aspect of the information processing system disclosed herein includes an image capture means for capturing an image of a target including the iris of the target, an image capture time acquisition means for acquiring an image capture time of the image capture by the image capture means, and an adjustment means for adjusting a setting value for the image capture by the image capture means based on a change in the light environment according to the image capture time.
• One aspect of the information processing method disclosed herein is an information processing system that includes an image capture means for capturing an image of a target including the iris of the target, and obtains the image capture time of the image capture means, and adjusts the settings of the image capture means based on the change in the light environment according to the image capture time.
• One aspect of the recording medium disclosed herein is an information processing system having an image capture means for capturing an image of a subject including the iris of the subject, in which a computer program is recorded to execute an information processing method for acquiring a capture time for the image capture by the image capture means, and adjusting a setting value for the image capture by the image capture means based on a change in the light environment according to the capture time.
• FIG. 1 is a block diagram showing a hardware configuration of an information processing system according to a first embodiment.
• 1 is a block diagram showing a functional configuration of an information processing system according to a first embodiment.
• 4 is a flowchart showing a flow of operations of the information processing system according to the first embodiment.
• FIG. 11 is a block diagram showing a functional configuration of an information processing system according to a second embodiment.
• 10 is a flowchart showing a flow of operations of an information processing system according to a second embodiment.
• FIG. 13 is a block diagram showing a functional configuration of an information processing system according to a third embodiment. 13 is a flowchart showing a flow of operations of an information processing system according to a third embodiment.
• FIG. 13 is a block diagram showing a functional configuration of an information processing system according to a fourth embodiment.
• 13 is a flowchart showing a flow of a pre-calibration operation in the information processing system according to the fourth embodiment.
• 13 is a flowchart showing a flow of operations of an information processing system according to a fourth embodiment.
• FIG. 13 is a block diagram showing a functional configuration of an information processing system according to a fifth embodiment.
• 13 is a flowchart showing a flow of a pre-calibration operation in the information processing system according to the fifth embodiment.
• 13 is a flowchart showing the flow of operations of an information processing system according to a fifth embodiment.
• 23 is a flowchart showing a flow of a pre-calibration operation in the information processing system according to the sixth embodiment.
• 20 is a flowchart showing the flow of operations of an information processing system according to a sixth embodiment.
• 23 is a flowchart showing the flow of operations of the information processing system according to the seventh embodiment.
• FIG. 1 An information processing system according to a first embodiment will be described with reference to FIGS. 1 to 3.
• FIG. 1 An information processing system according to a first embodiment will be described with reference to FIGS. 1 to 3.
• FIG. 1 An information processing system according to a first embodiment will be described with reference to FIGS. 1 to 3.
• FIG. 1 An information processing system according to a first embodiment will be described with reference to FIGS. 1 to 3.
• FIG. 1 An information processing system according to a first embodiment will be described with reference to FIGS. 1 to 3.
• Fig. 1 is a block diagram showing the hardware configuration of the information processing system according to the first embodiment.
• the information processing system 10 includes a processor 11, a RAM (Random Access Memory) 12, and a ROM (Read Only Memory) 13.
• the information processing system 10 may further include a storage device 14, an input device 15, and an output device 16.
• the information processing system 10 also includes a camera 18.
• the above-mentioned processor 11, RAM 12, ROM 13, storage device 14, input device 15, output device 16, and camera 18 are connected via a data bus 17.
• the processor 11 reads a computer program.
• the processor 11 is configured to read a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14.
• the processor 11 may read a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown).
• the processor 11 may obtain (i.e., read) a computer program from a device (not shown) disposed outside the information processing system 10 via a network interface.
• the processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the computer program that the processor 11 reads.
• a functional block for adjusting the camera setting values according to the shooting time is realized within the processor 11.
• the processor 11 may function as a controller that executes each control in the information processing system 10.
• the processor 11 may be configured as, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (field-programmable gate array), a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), or a quantum processor.
• the processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.
• RAM 12 temporarily stores computer programs executed by processor 11.
• RAM 12 temporarily stores data that processor 11 uses temporarily while processor 11 is executing a computer program.
• RAM 12 may be, for example, a D-RAM (Dynamic Random Access Memory) or an SRAM (Static Random Access Memory). Also, other types of volatile memory may be used instead of RAM 12.
• ROM 13 stores computer programs executed by processor 11. ROM 13 may also store other fixed data. ROM 13 may be, for example, a P-ROM (Programmable Read Only Memory) or an EPROM (Erasable Read Only Memory). Also, other types of non-volatile memory may be used instead of ROM 13.
• the storage device 14 stores data that the information processing system 10 stores long-term.
• the storage device 14 may operate as a temporary storage device for the processor 11.
• the storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.
• the input device 15 is a device that receives input instructions from a user of the information processing system 10.
• the input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel.
• the input device 15 may be configured as a mobile terminal such as a smartphone or a tablet.
• the input device 15 may be, for example, a device that includes a microphone and is capable of voice input.
• the output device 16 is a device that outputs information related to the information processing system 10 to the outside.
• the output device 16 may be a display device (e.g., a display) that can display information related to the information processing system 10.
• the output device 16 may be configured as a mobile terminal such as a smartphone or a tablet.
• the output device 16 may also be a device that outputs information in a format other than an image.
• the output device 16 may be a speaker that outputs information related to the information processing system 10 as audio.
• Camera 18 is configured to be able to capture an image of a target including the target's iris.
• the target here is not limited to humans, but may include animals such as cats and dogs, robots, etc.
• Camera 18 may be configured as a near-infrared camera, for example.
• multiple cameras 18 may be provided.
• camera 18 may include multiple types of cameras.
• camera 18 may include a near-infrared camera and a visible light camera.
• camera 18 may be a camera that captures still images, or may be a camera that captures videos.
• camera 18 according to this embodiment is configured to be able to adjust settings related to shooting (for example, camera parameters such as gain and exposure time).
• the information processing system 10 may be configured to include only the above-mentioned processor 11, RAM 12, ROM 13, and camera 18, and the other components (i.e., the storage device 14, the input device 15, and the output device 16) may be provided by external devices connected to the information processing system 10.
• the calculation functions of the information processing system 10 may be realized by external devices (e.g., an external server, a cloud, etc.).
• Fig. 2 is a block diagram showing the functional configuration of the information processing system according to the first embodiment.
• the information processing system 10 is configured as a system that captures a target image using a camera 18.
• the camera 18 is configured to be capable of capturing an image that includes at least the target's iris.
• the camera 18 may be configured to be capable of capturing an image that includes other than the iris (e.g., a facial image, etc.).
• the information processing system 10 according to the first embodiment may be installed in various facilities such as airports, stores, offices, theme parks, etc.
• the target image captured by the camera 18 may be used for biometric authentication in various facilities.
• the target image may be provided as a system for determining whether or not the target can pass through a gate by iris authentication using features related to the target's iris.
• the information processing system 10 is configured to include, as components for realizing its functions, a camera 18, a shooting time acquisition unit 110, and an adjustment unit 120.
• Each of the shooting time acquisition unit 110 and the adjustment unit 120 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).
• the shooting time acquisition unit 110 is configured to be able to acquire the shooting time, which is the time related to shooting by the camera 18.
• the shooting time may be not only the time indicating the timing of shooting, but also the time immediately before shooting, the time immediately after shooting, or information indicating the time period when shooting is performed (for example, what time of day, morning or afternoon).
• the shooting time acquisition unit 110 may acquire the shooting time from the camera 18.
• the shooting time acquisition unit 110 may acquire the shooting time from a control unit that controls the camera 18.
• the shooting time acquisition unit 110 may acquire the time when the previous shooting was performed after shooting was performed by the camera 18.
• the shooting time acquisition unit 110 may acquire the time when the next shooting is performed before shooting is performed by the camera 18.
• Information related to the shooting time acquired by the shooting time acquisition unit 110 is configured to be output to the adjustment unit 120.
• the adjustment unit 120 is configured to be able to adjust the setting values related to the shooting by the camera 18.
• the setting values here may be, for example, various camera parameters such as shutter speed, gain, and aperture value.
• the setting values may include parameters related to the lighting used when shooting with the camera 18 (for example, parameters related to the intensity and direction of the lighting).
• the adjustment unit 120 is configured to adjust the setting values of the camera based on changes in the light environment according to the shooting time acquired by the shooting time acquisition unit 110. For example, the adjustment unit 120 may adjust the exposure of the camera 18 to be lowered in a bright environment with a lot of light. Alternatively, the adjustment unit 120 may adjust the exposure of the camera 18 to be higher in a dark environment with a little light.
• the adjustment unit 120 may adjust the setting value every time shooting is performed by the camera 18, or may adjust the setting value at a predetermined period of time. Alternatively, the adjustment unit 10 may adjust the setting value when a specific operation by the user is detected.
• Fig. 3 is a flowchart showing the flow of operations of the information processing system according to the first embodiment.
• the shooting time acquisition unit 110 first acquires the shooting time (step S101). Information related to the shooting time acquired by the shooting time acquisition unit 110 is output to the adjustment unit 120.
• the adjustment unit 120 reads out information relating to changes in the light environment according to the shooting time acquired by the shooting time acquisition unit 110 (hereinafter referred to as "light environment information" as appropriate) (step S102).
• the adjustment unit 120 may read out the light environment information according to the acquired shooting time from the light environment information stored in advance.
• the light environment information according to the shooting time may be stored in a storage unit provided separately from the adjustment unit 120. A specific configuration for storing the light environment information will be described in detail in another embodiment described later.
• the adjustment unit 120 adjusts the setting values related to the photographing by the camera 18 based on the read light environment information (step S103). After the setting values are adjusted by the adjustment unit 120, photographing by the camera 18 may be performed immediately. Alternatively, after the setting values are adjusted by the adjustment unit 120, photographing may not be performed immediately, but may be performed after a predetermined time has passed.
• the settings related to shooting are adjusted based on the change in the lighting environment according to the shooting time.
• This technical effect is particularly evident, for example, when performing processing that requires high quality images (for example, when performing iris authentication).
• the information processing system 10 according to the second embodiment will be described with reference to Fig. 4 and Fig. 5.
• the second embodiment differs from the first embodiment described above only in some configurations and operations, and other parts may be the same as the first embodiment. Therefore, hereinafter, parts that differ from the first embodiment already described will be described in detail, and other overlapping parts will be omitted as appropriate.
• Fig. 4 is a block diagram showing the functional configuration of the information processing system according to the second embodiment.
• the same components as those shown in Fig. 2 are denoted by the same reference numerals.
• the information processing system 10 according to the second embodiment is configured to include a camera 18, a shooting time acquisition unit 110, an adjustment unit 120, and a shooting time acquisition unit 130 as components for realizing its functions. That is, the information processing system 10 according to the second embodiment further includes a shooting time acquisition unit 130 in addition to the configuration of the first embodiment (see FIG. 2).
• the shooting time acquisition unit 130 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).
• the shooting time acquisition unit 130 is configured to be able to acquire the shooting time, which is the time when the target image is captured by the camera 18.
• the shooting time may be, for example, information indicating a season such as spring, summer, autumn, or winter, or information indicating a month such as January, August, or October.
• the shooting time acquisition unit 130 may acquire the shooting time, for example, from a calendar function of the camera 18.
• the shooting time acquisition unit 130 may acquire the shooting time from a calendar function of a device other than the camera 18 (for example, a smartphone, etc.).
• the shooting time acquisition unit 130 may acquire the shooting time by connecting to an external device or the Internet, etc.
• the shooting time acquisition unit 130 may acquire the shooting time in accordance with the operation of the shooting time acquisition unit 110.
• the shooting time acquisition unit 130 may acquire the shooting time each time the shooting time acquisition unit 110 acquires the shooting time.
• the information regarding the shooting time acquired by the shooting time acquisition unit 130 is configured to be output to the adjustment unit 120.
• FIG. 5 is a flowchart showing the flow of operations of the information processing system according to the second embodiment. Note that in Fig. 5, the same processes as those described in Fig. 3 are denoted by the same reference numerals.
• the shooting time acquisition unit 110 first acquires the shooting time (step S101). Then, the shooting time acquisition unit 130 acquires the shooting time (step S201). Note that the process of step S101 and the process of step S201 may be executed one after the other, or may be executed simultaneously in parallel. Information relating to the shooting time acquired by the shooting time acquisition unit 110 and information relating to the shooting time acquired by the shooting time acquisition unit 130 are each output to the adjustment unit 120.
• the adjustment unit 120 reads out light environment information corresponding to the shooting time acquired by the shooting time acquisition unit 110 and the shooting time acquired by the shooting time acquisition unit 130 (step S202). That is, the adjustment unit 120 reads out light environment information corresponding to both the shooting time and the shooting time. For example, if the acquired shooting time is "11:00 a.m.” and the shooting time is "spring,” the adjustment unit reads out light environment information corresponding to "11:00 a.m. in the spring.”
• the adjustment unit 120 adjusts the setting values related to the image capture by the camera 18 based on the read light environment information (step S203). That is, the adjustment unit 120 adjusts the setting values based on the light environment information corresponding to both the image capture time and the image capture period.
• the settings related to shooting are adjusted taking into account not only the shooting time but also changes in the lighting environment depending on the shooting time. In this way, it is possible to shoot the target image with appropriate settings depending on the shooting time. Specifically, it is possible to shoot the target image appropriately even in a location where the brightness and direction of the light change depending on the shooting time.
• the information processing system 10 according to the third embodiment will be described with reference to Fig. 6 and Fig. 7.
• the third embodiment differs from the first and second embodiments only in part of the configuration and operation, and other parts may be the same as the first and second embodiments. Therefore, hereinafter, the parts that differ from the embodiments already described will be described in detail, and the explanation of other overlapping parts will be omitted as appropriate.
• Fig. 6 is a block diagram showing the functional configuration of the information processing system according to the third embodiment.
• the same components as those shown in Fig. 2 are denoted by the same reference numerals.
• the information processing system 10 according to the third embodiment is configured to include a camera 18, a shooting time acquisition unit 110, an adjustment unit 120, and a weather acquisition unit 140 as components for realizing its functions. That is, the information processing system 10 according to the third embodiment further includes a weather acquisition unit 140 in addition to the configuration of the first embodiment (see FIG. 2).
• the weather acquisition unit 140 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).
• the weather acquisition unit 140 is configured to be able to acquire the weather when the target image is captured by the camera 18.
• the weather may be information indicating specific weather conditions, such as sunny, cloudy, rainy, etc.
• the weather may be information including the probability of precipitation, the amount of precipitation, the temperature, the wind direction, etc.
• the weather acquisition unit 140 may acquire the weather by connecting to an external device or the Internet.
• the weather acquisition unit 140 may acquire weather information from the scenery, background, etc. included in the image captured by the camera 18.
• the weather acquisition unit 140 may estimate the weather information based on the brightness of the image and the state of the clouds included in the image.
• a machine learning model may be used to estimate the weather information.
• the weather acquisition unit 140 may acquire the shooting time in accordance with the operation of the shooting time acquisition unit 110. For example, the weather acquisition unit 140 may acquire the weather every time the shooting time acquisition unit 110 acquires the shooting time.
• the weather information acquired by the weather acquisition unit 140 is configured to be output to the adjustment unit 120.
• FIG. 7 is a flowchart showing the flow of operations of the information processing system according to the third embodiment.
• the same processes as those described in Fig. 3 are denoted by the same reference numerals.
• step S101 acquires the shooting time
• step S301 acquires the weather at the time of shooting
• step S101 and the process of step S301 may be executed one after the other, or may be executed simultaneously in parallel.
• Information relating to the shooting time acquired by the shooting time acquisition unit 110 and information relating to the weather acquired by the weather acquisition unit 140 are each output to the adjustment unit 120.
• the adjustment unit 120 reads out light environment information corresponding to the shooting time acquired by the shooting time acquisition unit 110 and the weather acquired by the weather acquisition unit 140 (step S302). That is, the adjustment unit 120 reads out light environment information corresponding to both the shooting time and the weather. For example, if the acquired shooting time is "1:00 PM” and the weather is "sunny," the adjustment unit reads out light environment information corresponding to "1:00 PM on a sunny day.”
• the adjustment unit 120 adjusts the setting values related to the image capture by the camera 18 based on the read light environment information (step S303). That is, the adjustment unit 120 adjusts the setting values based on the light environment information corresponding to both the image capture time and the weather.
• the settings related to shooting are adjusted taking into account changes in the lighting environment depending on the weather, in addition to the shooting time. In this way, it is possible to shoot the target image with appropriate settings depending on the weather. Specifically, it is possible to shoot the target image appropriately even in a location where the brightness and direction of the light change depending on the weather.
• the information processing system 10 may include the shooting time acquisition unit 130 (see FIG. 4) described in the second embodiment in addition to the weather acquisition unit 140.
• the adjustment unit 130 may adjust the settings of the camera 18 based on the shooting time, shooting time period, and changes in the light environment according to the weather.
• the information processing system 10 according to the fourth embodiment will be described with reference to Figures 8 to 10.
• the fourth embodiment differs from the first to third embodiments in part of its configuration and operation, and other parts may be the same as the first to third embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and other overlapping parts will be omitted as appropriate.
• Fig. 8 is a block diagram showing the functional configuration of the information processing system according to the fourth embodiment.
• the same components as those shown in Fig. 2 are denoted by the same reference numerals.
• the information processing system 10 according to the fourth embodiment is configured to include a camera 18, a shooting time acquisition unit 110, an adjustment unit 120, and a first light environment storage unit 210 as components for realizing its functions. That is, the information processing system 10 according to the fourth embodiment further includes a first light environment storage unit 210 in addition to the configuration of the first embodiment (see FIG. 2).
• the first light environment storage unit 210 may be realized, for example, by the above-mentioned processor 11 or storage device 14 (see FIG. 1).
• the first light environment storage unit 210 is configured to be able to generate and store the first light environment information.
• the first light environment information is information indicating the relationship between the change in the light environment at the location where the target image is captured and the capture time.
• the first light environment information may be information that links the capture time and the light environment corresponding to that time and stores it.
• the first light environment storage unit 210 generates the first light environment information by performing pre-capturing. Specifically, the first light environment storage unit 210 generates the first light environment information by performing pre-capturing using an object (hereinafter, appropriately referred to as an "adjustment member") that mimics the reflectance of the iris for near-infrared light.
• an object hereinafter, appropriately referred to as an "adjustment member”
• the adjustment member may be made using a material that has a reflectance close to that of the iris (for example, a material whose reflectance difference falls within a predetermined value).
• the adjustment member may be an object (for example, a spherical member) that is made to mimic the shape of the iris.
• the camera that takes the pre-shooting image may be the same camera as the camera 18 that takes the target image, or may be a different camera of the same type or with similar performance.
• the first light environment information stored in the first light environment storage unit 210 can be read out by the adjustment unit 120 as needed.
• Fig. 9 is a flowchart showing the flow of the pre-calibration operation in the information processing system according to the fourth embodiment.
• a pre-calibration operation is performed to store the first optical memory information.
• an image of the adjustment member is first captured (step S41).
• An instruction to capture an image of the adjustment member may be output by the first optical environment memory unit 210.
• the first light environment storage unit 210 analyzes the captured image of the adjustment member (step S42).
• the analysis is a process for generating first light environment information, and may be, for example, a process for determining the pixel value (brightness) of the image. Note that, if multiple images of the adjustment member have been captured, the first light environment storage unit 210 may analyze each of the multiple images.
• the first light environment storage unit 210 generates first light environment information from the image analysis results (step S43).
• the first light environment information may be generated from the analysis results of a plurality of images.
• the first light environment information may be generated from the analysis results of a plurality of images taken at different times.
• the first light environment storage unit 210 stores the generated first light environment information (step S44).
• Fig. 10 is a flowchart showing the flow of operations of the information processing system according to the fourth embodiment.
• the same processes as those described in Fig. 3 are denoted by the same reference numerals.
• the shooting time acquisition unit 110 first acquires the shooting time (step S101). Information related to the shooting time acquired by the shooting time acquisition unit 110 is output to the adjustment unit 120.
• the adjustment unit 120 reads out the first light environment information stored in the first light environment storage unit 210, the first light environment information corresponding to the shooting time acquired by the shooting time acquisition unit 110 (step S401). Then, the adjustment unit 120 adjusts the setting values related to shooting by the camera 18 based on the read out first light environment information (step S402). That is, the adjustment unit 120 adjusts the setting values related to shooting based on the change in the light environment indicated by the read out first light environment information.
• the setting value is adjusted based on the first light environment information generated by pre-capturing.
• the first light environment information is information generated by pre-capturing an image using an object that mimics the reflectance of an iris for near-infrared light, and therefore accurately reflects changes in the light environment according to the time of capture. Therefore, by adjusting the setting value using the first light environment information, it becomes possible to adjust the setting value easily and accurately.
• the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 11 to Fig. 13.
• the fifth embodiment differs from the first to fourth embodiments in some configurations and operations, and other parts may be the same as the first to fourth embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and other overlapping parts will be omitted as appropriate.
• Fig. 11 is a block diagram showing the functional configuration of the information processing system according to the fifth embodiment.
• the same reference numerals are used to designate the same elements as those described in Fig. 2.
• the information processing system 10 is configured to include a near-infrared camera 18a, a visible light camera 18b, a shooting time acquisition unit 110, an adjustment unit 120, and a second light environment storage unit 210 as components for realizing its functions. That is, the information processing system 10 according to the fourth embodiment is equipped with two types of cameras 18 (near-infrared camera 18a and visible light camera 18b).
• the near-infrared camera 18a is configured as a camera for capturing a target image (i.e., an image including the iris of the target)
• the visible light camera 18b may be configured as a camera for capturing an image other than the target image (for example, an image used auxiliary).
• the information processing system 10 further includes a second light environment storage unit 220.
• the second light environment storage unit 220 may be realized, for example, by the above-mentioned processor 11 or storage device 14 (see FIG. 1).
• the second light environment storage unit 220 is configured to generate and store the second light environment information.
• the second light environment information is information indicating the relationship between the change in the light environment of visible light and near-infrared light at the location where the target image is captured and the capture time.
• the second light environment information may be information that links and stores the capture time, the light environment of visible light corresponding to that time, and the light environment of near-infrared light.
• the second light environment storage unit 220 generates the second light environment information by performing pre-capturing. Specifically, the second light environment storage unit 220 generates the second light environment information by performing pre-capturing using a near-infrared light camera and a visible light camera.
• the second light environment storage unit 220 may generate the second light environment information by analyzing the near-infrared image and the visible light image captured at the same time (or the same time period). By performing such pre-capturing, it is possible to accurately grasp the change in the light environment related to near-infrared light according to the capture time, and the change in the light environment related to visible light according to the capture time.
• the camera that performs the pre-shooting may be the same camera as the camera that captures the target image (i.e., the near-infrared camera 18a and the visible light camera 18b), or may be a different camera of the same type or with similar performance.
• the second light environment information stored in the second light environment storage unit 220 can be read out by the adjustment unit 120 as needed.
• Fig. 12 is a flowchart showing the flow of the pre-calibration operation in the information processing system according to the fifth embodiment.
• a pre-calibration operation is performed to store the second optical memory information.
• a pre-image is captured by the visible light camera 18b (step S51).
• a pre-image is captured by the near-infrared camera 18a (step S52).
• the process of step S51 and the process of step S52 may be performed one after the other, or may be performed simultaneously in parallel.
• These pre-images may be images of the adjustment members, as described in the fourth embodiment.
• the second light environment storage unit 220 analyzes the visible light image captured by the visible light camera 18b and the near-infrared image captured by the near-infrared camera 18a (step S53).
• the analysis here is a process for generating second light environment information, and may be a process for determining, for example, the pixel value (brightness) of the image. Note that if multiple visible light images and multiple near-infrared images have been captured, the second light environment storage unit 220 may analyze each of the multiple images.
• the second light environment storage unit 220 generates second light environment information from the image analysis results (step S54).
• the second light environment information may be generated from the analysis results of the visible light image and near-infrared image taken during the same time period.
• the second light environment information may be generated from the analysis results of the visible light image and near-infrared image taken at 9:00 a.m., the analysis results of the visible light image and near-infrared image taken at 10:00 a.m., and the analysis results of the visible light image and near-infrared image taken at 11:00 a.m.
• the second light environment storage unit 220 stores the generated second light environment information (step S55).
• Fig. 13 is a flowchart showing the flow of operations of the information processing system according to the fifth embodiment.
• the same processes as those described in Fig. 3 are denoted by the same reference numerals.
• the shooting time acquisition unit 110 first acquires the shooting time (step S101). Information related to the shooting time acquired by the shooting time acquisition unit 110 is output to the adjustment unit 120.
• the adjustment unit 120 controls the visible light camera 18b to capture an image of the target (step S501).
• the visible light image captured here is acquired by the adjustment unit 120.
• the adjustment unit 120 reads out, from the second light environment information stored in the second light environment storage unit 220, second light environment information corresponding to the shooting time acquired by the shooting time acquisition unit 110 and the visible light image captured by the visible light camera 18b (step S502). For example, the adjustment unit 120 reads out, from multiple pieces of second light environment information corresponding to the acquired shooting times, the information that is closest to the light environment in which the visible light image was captured.
• the adjustment unit 120 adjusts the setting values related to the shooting by the near-infrared camera 18a based on the read second light environment information (step S503). That is, the adjustment unit 120 adjusts the setting values related to the shooting by the near-infrared camera 18a based on the change in the light environment of near-infrared light indicated by the read second light environment information.
• the setting value is adjusted based on the visible light image captured by the visible light camera 18b and the second light environment information.
• the setting value of the near-infrared light camera 18a according to the capture time can be calculated from the visible light image (i.e., the current light environment related to visible light) and the second light environment information, making it possible to adjust the setting value more easily and accurately.
• the information processing system 10 according to the sixth embodiment will be described with reference to Fig. 14 to Fig. 16.
• the sixth embodiment differs from the first to fifth embodiments in some operations, and other operations may be the same as those of the first to fifth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit descriptions of other overlapping parts as appropriate.
• Fig. 14 is a block diagram showing the functional configuration of the information processing system according to the sixth embodiment.
• the same elements as those shown in Fig. 2 are denoted by the same reference numerals.
• the information processing system 10 is configured to include, as components for realizing its functions, a camera 18, a shooting time acquisition unit 110, an adjustment unit 120, a third light environment storage unit 210, and a video data transmission unit 310. That is, the information processing system 10 according to the sixth embodiment further includes, in addition to the configuration of the first embodiment (see FIG. 2), a third light environment storage unit 210 and a video data transmission unit 310. Each of the third light environment storage unit 210 and the video data transmission unit 310 may be realized, for example, by the above-mentioned processor 11 or storage device 14 (see FIG. 1).
• the video data transmission unit 310 is configured to be able to transmit video data taken at the location where the target image is taken to a remote location. Specifically, the video data transmission unit 310 transmits the video data taken at the location where the target image is taken to the location where the third light environment storage unit 230 is located. For example, the video data transmission unit 310 may transmit video data taken at a facility where the camera 18 is installed to a factory or the like where a system including the camera 18 is manufactured. The video data transmission unit 310 may be configured to be able to transmit video data using, for example, wireless communication. By making it possible to transmit video data to a remote location, it becomes possible to perform pre-calibration at a location different from the actual shooting location.
• the video data preferably includes multiple pieces of data taken at different times in order to grasp changes in the light environment according to the shooting time.
• the camera that takes the video may be the same camera as the camera 18 that takes the target image, or may be another camera of the same type or similar performance.
• the third light environment storage unit 230 is configured to be able to generate and store third light environment information.
• the third light environment information is information indicating the relationship between the change in the light environment at the location where the camera 18 is installed and the shooting time.
• the third light environment information may be information that links the shooting time and the light environment corresponding to that time and stores it.
• the third light environment storage unit 230 generates the third light environment information based on video data (i.e., video data transmitted by the video data transmission unit 310) captured at the location where the camera 18 is installed. By using the video data, it is possible to accurately grasp the change in the light environment according to the shooting time (i.e., the change in the light environment over time).
• the third light environment information stored in the third light environment storage unit 230 can be read out by the adjustment unit 120 as appropriate.
• Fig. 15 is a flowchart showing the flow of the pre-calibration operation in the information processing system according to the sixth embodiment.
• a pre-calibration operation is performed to store the third optical memory information.
• a video is first captured (step S61).
• An instruction to capture the video may be output by the video data transmission unit 310 or the third light environment memory unit 230.
• the video data transmission unit 310 transmits the captured video data to the third light environment storage unit 230 (step S62).
• the third light environment storage unit 230 then analyzes the transmitted video data (step S63).
• the analysis here is a process for generating third light environment information, and may be, for example, a process for determining the pixel values (brightness) of each frame included in the video data.
• the third light environment storage unit 230 generates third light environment information from the analysis results of the video data (step S64).
• the third light environment information may be generated from the analysis results of each time period of the video data.
• the third light environment information may be information indicating the change in the light environment in each time period based on the analysis results of the 10:00 to 11:00 o'clock portions of the video data, the analysis results of the 11:00 to 12:00 o'clock portions, and the analysis results of the 12:00 to 12:00 o'clock portions.
• the third light environment storage unit 230 stores the generated third light environment information (step S65).
• Fig. 16 is a flowchart showing the flow of operations of the information processing system according to the sixth embodiment.
• the same processes as those described in Fig. 3 are denoted by the same reference numerals.
• the shooting time acquisition unit 110 first acquires the shooting time (step S101). Information related to the shooting time acquired by the shooting time acquisition unit 110 is output to the adjustment unit 120.
• the adjustment unit 120 reads out the third light environment information stored in the third light environment storage unit 230, which corresponds to the shooting time acquired by the shooting time acquisition unit 110 (step S601). Then, the adjustment unit 120 adjusts the setting values related to shooting by the camera 18 based on the read third light environment information (step S602). That is, the adjustment unit 120 adjusts the setting values related to shooting based on the change in the light environment indicated by the read third light environment information.
• the setting value is adjusted based on the third light environment information generated from the video data.
• the setting value according to the shooting time can be calculated from the third light environment information, making it possible to adjust the setting value more easily and accurately.
• the information processing system 10 according to the seventh embodiment will be described with reference to Fig. 17 and Fig. 18.
• the seventh embodiment differs from the first to sixth embodiments in some operations, and other operations may be the same as those of the first to sixth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit descriptions of other overlapping parts as appropriate.
• Fig. 17 is a block diagram showing the functional configuration of the information processing system according to the seventh embodiment.
• the same components as those shown in Fig. 2 are denoted by the same reference numerals.
• the information processing system 10 according to the seventh embodiment is configured to include a camera 18, a shooting time acquisition unit 110, an adjustment unit 120, and a similar target identification unit 320 as components for realizing its functions. That is, the information processing system 10 according to the seventh embodiment further includes a similar target identification unit 320 in addition to the configuration of the first embodiment (see FIG. 2).
• the similar target identification unit 320 may be realized, for example, by the above-mentioned processor 11 or storage device 14 (see FIG. 1).
• the similar target identification unit 320 identifies a target (hereinafter, appropriately referred to as a "similar target") that is similar in height to the current target (i.e., the target to be photographed) from among multiple targets photographed in the past by the camera 18.
• the similar target identification unit 320 may, for example, store the height of the target each time it is photographed, and identify the similar target by comparing the height of the current target with the height of past targets (i.e., the stored height). If there is no past target with the same height as the current target, the similar target identification unit 320 may identify the past target with the closest height to the current target as the similar target.
• the similar target identification unit 320 may identify any one of the past targets with the same height as the similar target, or may identify all past targets with the same height as the similar target. In other words, multiple similar targets may be identified. Information regarding the similar targets identified by the similar target identification unit 320 is configured to be output to the adjustment unit 120.
• Fig. 18 is a flowchart showing the flow of operations of the information processing system according to the seventh embodiment.
• the same processes as those described in Fig. 3 are denoted by the same reference numerals.
• the shooting time acquisition unit 110 first acquires the shooting time (step S101). Information related to the shooting time acquired by the shooting time acquisition unit 110 is output to the adjustment unit 120.
• the similar object identification unit 320 identifies a similar object that is close in height to the current object (step S701).
• the adjustment unit 120 then reads out information that corresponds to the shooting time acquired by the shooting time acquisition unit 110 and indicates the change in the lighting environment when the similar object was previously photographed (step S702). For example, if the acquired shooting time portion is "15:00 p.m.” and the previously photographed object "Mr. A" has been identified as a similar object, the adjustment unit 120 reads out "information that indicates the change in the lighting environment when Mr. A was photographed at 15:00 p.m.”
• the adjustment unit 120 adjusts the settings related to the image capture by the camera 18 based on the read light environment information (step S702). That is, the adjustment unit 120 adjusts the settings related to the image capture based on the image capture time and the change in the light environment corresponding to the similar object.
• the setting value is adjusted based on the change in the lighting environment when a similar object was photographed in the past.
• the change in the lighting environment according to the height of the object for example, the difference between the way the light hits a tall person and the way the light hits a short person
• each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-mentioned embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and executed on a computer.
• computer-readable recording media are also included in the scope of each embodiment.
• each embodiment includes not only the recording medium on which the above-mentioned program is recorded, but also the program itself.
• the recording medium may be, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, magnetic tape, non-volatile memory card, or ROM.
• the scope of each embodiment is not limited to programs recorded on the recording medium that execute processes by themselves, but also includes programs that operate on an OS in conjunction with other software or functions of an expansion board to execute processes.
• the program itself may be stored on a server, and part or all of the program may be made downloadable from the server to a user terminal.
• the program may be provided to the user in, for example, a SaaS (Software as a Service) format.
• the information processing system described in Appendix 1 is an information processing system including an imaging means for capturing an image of a target including the iris of the target, an imaging time acquisition means for acquiring an imaging time related to the imaging by the imaging means, and an adjustment means for adjusting a setting value related to the imaging by the imaging means based on a change in the lighting environment according to the imaging time.
• Appendix 2 The information processing system described in Appendix 2 is the information processing system described in Appendix 1, further comprising a shooting time acquisition means for acquiring the shooting time of the target image, and the adjustment means adjusts the setting values related to shooting of the shooting means based on the shooting time and changes in the lighting environment according to the shooting time.
• Appendix 3 The information processing system described in Appendix 3 is the information processing system described in Appendix 1 or 2, further comprising a weather acquisition means for acquiring the weather when the target image is photographed, and the adjustment means adjusts the setting values related to the photographing of the photographing means based on the photographing time and changes in the light environment according to the weather.
• Appendix 4 The information processing system described in Appendix 4 is the information processing system described in any one of Appendixes 1 to 3, further comprising a first light environment storage means for generating and storing first light environment information indicating a relationship between a change in the light environment at a location where the target image is captured and the capturing time by pre-capturing an image using an object that mimics the reflectance of the iris for near-infrared light, and the adjustment means for adjusting a setting value related to capturing of the image capturing means based on the first light environment information.
• a first light environment storage means for generating and storing first light environment information indicating a relationship between a change in the light environment at a location where the target image is captured and the capturing time by pre-capturing an image using an object that mimics the reflectance of the iris for near-infrared light
• the adjustment means for adjusting a setting value related to capturing of the image capturing means based on the first light environment information.
• Appendix 5 The information processing system described in Appendix 5 is the information processing system described in any one of Appendixes 1 to 4, further comprising a second light environment storage means for generating and storing second light environment information indicating a relationship between a change in the light environment of visible light and near-infrared light at a location where the target image is captured and the capture time by pre-capturing using a visible light camera and a near-infrared camera, wherein the adjustment means adjusts settings related to capture of the imaging means, which is the near-infrared camera, based on the image captured by the visible light camera when capturing the target image and the second light environment information.
• a second light environment storage means for generating and storing second light environment information indicating a relationship between a change in the light environment of visible light and near-infrared light at a location where the target image is captured and the capture time by pre-capturing using a visible light camera and a near-infrared camera, wherein the adjustment means adjusts settings related to capture of the imaging
• Appendix 6 The information processing system described in Appendix 6 is an information processing system described in any one of Appendixes 1 to 5, further comprising a third light environment storage means for generating and storing third light environment information indicating a relationship between changes in the light environment at a location where the imaging means is installed and the imaging time based on video data captured at the location where the imaging means is installed, and the adjustment means adjusts setting values related to imaging of the imaging means based on the third light environment information.
• Appendix 7 The information processing system described in Appendix 7 is the information processing system described in Appendix 6, further comprising a transmitting means for transmitting video data captured at a location where the imaging means is installed to a second location different from the location where the imaging means is installed, and a generating means for analyzing the video data at the second location and generating the third light environment information.
• Appendix 8 The information processing system described in Appendix 8 is the information processing system described in any one of Appendixes 1 to 7, further comprising an identification means for identifying a similar target of a similar height to the current target from among targets previously photographed by the photographing means, and the adjustment means adjusts a setting value related to photographing of the photographing means based on a change in the lighting environment according to the photographing time when the similar target was photographed.
• Appendix 9 The information processing method described in Appendix 9 is an information processing method in an information processing system having an imaging means for capturing an image of a target including an iris of the target, which obtains a shooting time for the shooting by the imaging means, and adjusts a setting value for the shooting by the imaging means based on a change in the lighting environment according to the shooting time.
• the recording medium described in Appendix 10 is a recording medium having a computer program recorded thereon for executing an information processing method in an information processing system having an imaging means for capturing an image of a target including the iris of the target, the method comprising: acquiring a shooting time for capturing an image by the imaging means; and adjusting a setting value for capturing an image by the imaging means based on a change in the lighting environment according to the shooting time.
• Appendix 11 The computer program described in Appendix 11 is a computer program for executing an information processing method in an information processing system having an imaging means for capturing an image of a target including an iris of the target, which acquires an imaging time related to the imaging by the imaging means, and adjusts a setting value related to the imaging by the imaging means based on a change in the lighting environment according to the imaging time.

Landscapes

• Engineering & Computer Science (AREA)
• Health & Medical Sciences (AREA)
• General Health & Medical Sciences (AREA)
• Ophthalmology & Optometry (AREA)
• Human Computer Interaction (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Multimedia (AREA)
• Theoretical Computer Science (AREA)
• Studio Devices (AREA)

Priority Applications (2)

Applications Claiming Priority (1)

Publications (1)

Family

ID=93589093

Family Applications (1)

Country Status (2)

Citations (4)

• 2023
  • 2023-05-23 JP JP2025521684A patent/JPWO2024241482A1/ja active Pending
  • 2023-05-23 WO PCT/JP2023/019124 patent/WO2024241482A1/ja not_active Ceased

Patent Citations (4)

Also Published As

Similar Documents

Legal Events