Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
  • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
  • G06V40/18—Eye characteristics, e.g. of the iris

Definitions

• This disclosure relates to the technical fields of information processing devices, information processing methods, and recording media.
• Patent Document 1 For example, a device has been proposed that, when performing user authentication using an infrared image, displays an infrared image if the infrared image contains both of a person's eyes, but does not display an infrared image if the infrared image does not contain both of a person's eyes (see Patent Document 1).
• Patent Document 2 Other prior art documents related to this disclosure include Patent Document 2.
• the objective of this disclosure is to provide an information processing device, an information processing method, and a recording medium that aim to improve upon the technology described in prior art documents.
• One aspect of the information processing device includes a visible light camera that captures an image of an object, a near-infrared camera that captures the image of the object, a change means that changes the imaging range of the near-infrared camera, and a control means that controls the change means so that, when a predetermined condition is satisfied based on a visible light image captured by the visible light camera, the imaging range of the near-infrared camera is set higher than when the predetermined condition is not satisfied.
• the imaging range of the near-infrared camera is set higher than when the predetermined condition is not satisfied.
• a computer program is recorded to cause a computer constituting an information processing device having a visible light camera that captures an image of an object and a near-infrared camera that captures the object to execute an information processing method in which, when a predetermined condition is satisfied based on a visible light image captured by the visible light camera, the imaging range of the near-infrared camera is set higher than when the predetermined condition is not satisfied.
• FIG. 1 is a block diagram illustrating an example of an information processing device.
• FIG. 2 is a diagram illustrating an example of an imaging range of a near-infrared camera.
• FIG. 13 is a block diagram showing another example of an information processing device.
• FIG. 1 is a diagram illustrating an example of a near-infrared camera.
• FIG. 13 is a diagram showing another example of a near-infrared camera.
• FIG. 13 is a block diagram showing another example of an information processing device.
• the information processing device 1 includes a visible light camera 11, a near-infrared camera 12, a change unit 13, and a control unit 14.
• the visible light camera 11 is a camera having a light receiving element capable of receiving visible light.
• the near-infrared camera 12 is a camera having a light receiving element capable of receiving near-infrared light. Since various existing aspects can be applied to the visible light camera 11 and the near-infrared camera 12, detailed explanations thereof will be omitted.
• the visible light camera 11 and the near-infrared camera 12 may be stored in different housings, or may be stored in the same housing.
• the change unit 13 is configured to be able to change the imaging range of the near-infrared camera 12.
• the change unit 13 may change the imaging range of the near-infrared camera 12 by changing the optical axis direction of the near-infrared camera 12.
• the change unit 13 may change the imaging range of the near-infrared camera 12 by rotating the near-infrared camera 12 around a predetermined rotation axis.
• the change unit 13 may change the imaging range of the near-infrared camera 12 by changing the angle of the mirror.
• the control unit 14 controls the change unit 13 so that, when a predetermined condition is satisfied based on the visible light image captured by the visible light camera 11, the imaging range of the near-infrared camera 12 is set higher than when the predetermined condition is not satisfied.
• “higher” means higher in the vertical direction.
• the dotted line represents the imaging range of the near-infrared camera 12 when the predetermined condition is not satisfied.
• "When the predetermined condition is satisfied, the imaging range of the near-infrared camera 12 is set higher than when the predetermined condition is not satisfied” may mean shifting the imaging range of the near-infrared camera 12 above the head of the target (see the human figure in FIG. 2).
• an information processing method is performed in which, when a predetermined condition is met based on a visible light image captured by the visible light camera 11, the imaging range of the near-infrared camera 12 is set higher than when the predetermined condition is not met.
• the information processing device 1 may be realized by a computer reading a computer program recorded on a recording medium.
• the recording medium has recorded thereon a computer program for causing the computer constituting the information processing device 1, which includes the visible light camera 11 and the near-infrared camera 12, to execute an information processing method in which, when a predetermined condition is satisfied based on a visible light image captured by the visible light camera 11, the imaging range of the near-infrared camera 12 is set higher than when the predetermined condition is not satisfied.
• the images captured by the visible light camera 11 and the near-infrared camera 12 may be used for biometric authentication.
• the visible light image captured by the visible light camera 11 may be used for face authentication.
• the near-infrared image captured by the near-infrared camera 12 may be used for iris authentication.
• the clothes of a subject e.g., a person to be subjected to biometric authentication
• the clothes of a subject may be captured by the near-infrared camera 12
• the clothes of a subject may be visible in the near-infrared image. This may lead to an increase in subjects who feel resistant to biometric authentication or who feel resistant to being photographed for biometric authentication.
• the control unit 14 controls the change unit 13 so that the imaging range of the near-infrared camera 12 is set higher than when the predetermined condition is not satisfied.
• the predetermined condition may be "the imaging range of the near-infrared camera 12 includes the clothing of the subject (e.g., the subject of biometric authentication)." If the imaging range of the near-infrared camera 12 is changed to the upper side when this predetermined condition is satisfied, it is possible to prevent the imaging range of the near-infrared camera 12 from including the clothing of the subject. Therefore, according to the information processing device 1, it is possible to reduce resistance to biometric authentication using a near-infrared image captured by the near-infrared camera 12 and resistance to photographing for biometric authentication.
• Second Embodiment The second embodiment of the information processing device, the information processing method, and the recording medium will be described with reference to Fig. 3 to Fig. 5. In the following, the second embodiment of the information processing device, the information processing method, and the recording medium will be described using the information processing device 2.
• the information processing device 2 includes a calculation device 21, a storage device 22, a communication device 23, a visible light camera 26, and a near-infrared camera 27.
• the information processing device 2 may include an input device 24 and an output device 25.
• the information processing device 2 does not need to include at least one of the input device 24 and the output device 25.
• the calculation device 21, the storage device 22, the communication device 23, the input device 24, the output device 25, the visible light camera 26, and the near-infrared camera 27 may be connected via a data bus 28.
• the visible light camera 26 and the near-infrared camera 27 may be stored in different housings or in the same housing.
• the computing device 21 may include, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), a TPU (Tensor Processing Unit), and a quantum processor.
• a CPU Central Processing Unit
• GPU Graphics Processing Unit
• FPGA Field Programmable Gate Array
• TPU Torsor Processing Unit
• quantum processor a quantum processor
• the storage device 22 may include, for example, at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, an optical magnetic disk device, an SSD (Solid State Drive), and an optical disk array.
• the storage device 22 may include a non-transient recording medium.
• the storage device 22 is capable of storing desired data.
• the storage device 22 may temporarily store a computer program executed by the arithmetic device 21.
• the storage device 22 may temporarily store data that is temporarily used by the arithmetic device 21 when the arithmetic device 21 is executing a computer program.
• the communication device 23 may be capable of communicating with devices external to the information processing device 2.
• the communication device 23 may perform wired communication or wireless communication.
• Wired communication is not limited to communication via a network, but also includes communication via a cable such as a USB (Universal Serial Bus) cable.
• Wireless communication is not limited to communication via a network, but also includes short-range wireless communication such as Bluetooth (registered trademark).
• the input device 24 is a device capable of accepting information input to the information processing device 2 from the outside.
• the input device 24 may include an operating device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by an operator of the information processing device 2.
• the input device 24 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the information processing device 2, such as a USB memory. Note that when information is input to the information processing device 2 via the communication device 23 (in other words, when the information processing device 2 obtains information via the communication device 23), the communication device 23 may function as an input device.
• the output device 25 is a device capable of outputting information to the outside of the information processing device 2.
• the output device 25 may output visual information such as characters and images, auditory information such as sound, or tactile information such as vibration, as the above information.
• the output device 25 may include at least one of a display, a speaker, a printer, and a vibration motor, for example.
• the output device 25 may be capable of outputting information to a recording medium that is detachable from the information processing device 2, such as a USB memory. Note that when the information processing device 2 outputs information via the communication device 23, the communication device 23 may function as an output device.
• the computing device 21 may have, as logically realized functional blocks or physically realized processing circuits, an image acquisition unit 211, a face detection unit 212, a person detection unit 213, a clothing determination unit 214, an orientation control unit 215, an eye detection unit 216, a face authentication unit 217, an iris authentication unit 218, and an integrated authentication unit 219.
• At least one of the image acquisition unit 211, the face detection unit 212, the person detection unit 213, the clothing determination unit 214, the orientation control unit 215, the eye detection unit 216, the face authentication unit 217, the iris authentication unit 218, and the integrated authentication unit 219 may be realized in a form in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed.
• the image acquisition unit 211, face detection unit 212, person detection unit 213, clothing determination unit 214, orientation control unit 215, eye detection unit 216, face authentication unit 217, iris authentication unit 218, and integrated authentication unit 219 are functional blocks, at least some of the image acquisition unit 211, face detection unit 212, person detection unit 213, clothing determination unit 214, orientation control unit 215, eye detection unit 216, face authentication unit 217, iris authentication unit 218, and integrated authentication unit 219 may be realized by the calculation device 21 executing a predetermined computer program.
• the arithmetic device 21 may obtain (in other words, read) the above-mentioned specific computer program from the storage device 22.
• the arithmetic device 21 may read the above-mentioned specific computer program stored in a computer-readable and non-transient recording medium using a recording medium reading device (not shown) provided in the information processing device 2.
• the arithmetic device 21 may obtain (in other words, download or read) the above-mentioned specific computer program from a device (not shown) external to the information processing device 2 via the communication device 23.
• the recording medium for recording the above-mentioned specific computer program executed by the arithmetic device 21 may be at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium capable of storing a program.
• the image acquisition unit 211 acquires a visible light image captured by the visible light camera 26.
• the face detection unit 212 detects a facial area of a person included in the visible light image.
• the detection result of the face detection unit 212 may be output to at least one of the orientation control unit 215, the eye detection unit 216, and the face authentication unit 217. Note that existing technology can be applied to the method of detecting a facial area of a person included in a visible light image, so detailed explanation is omitted.
• the person detection unit 213 detects people included in the visible light image.
• the person detection unit 213 detects people whose head regions are included in the visible light image. Note that the face region of the person detected by the person detection unit 213 does not have to be included in the visible light image.
• the detection result of the person detection unit 213 may be output to the clothing determination unit 214.
• the clothing determination unit 214 identifies the clothing of the person included in the visible light image.
• the clothing determination unit 214 may identify the clothing of the person included in the visible light image by, for example, pattern recognition.
• the clothing determination unit 214 may identify the clothing of the person included in the visible light image by using a computational model that outputs the clothing of the person included in the visible light image.
• An example of such a computational model is a computational model that uses a neural network (for example, CNN: Convolutional Neural Network).
• a neural network for example, CNN: Convolutional Neural Network
• the clothing determination unit 214 determines whether the clothing worn by the person in the visible light image is specific clothing.
• the specific clothing may be a swimsuit.
• the specific clothing may be clothing that is opaque to visible light but transparent to near-infrared light (e.g., clothing of a relatively dark color).
• the determination result of the clothing determination unit 214 is output to the orientation control unit 215.
• the orientation control unit 215 changes the imaging range of the near-infrared camera 27. As shown in FIG. 4, when the near-infrared camera 27 is supported by a support member 27a that is rotatable around a rotation axis AX1, the orientation control unit 215 may change the imaging range of the near-infrared camera 27 by rotating the support member 27a around the rotation axis AX1 with a motor (not shown). As shown in FIG.
• the orientation control unit 215 may change the imaging range of the near-infrared camera 27 by rotating the mirror M around the rotation axis AX2 with a motor (not shown).
• the orientation control unit 215 corresponds to an example of the control unit 14 in the first embodiment described above.
• the angle of rotation may be determined based on the results of person detection. For example, if a face has been detected, the angle at which the face is captured at the very bottom of the near-infrared image by the near-infrared camera may be calculated from the size of the face detected in the visible light image and its position on the image, and the rotation angle may be determined by calculating the difference from the current angle. If a head or person area is detected instead of a face, the area of the body parts may be estimated from the size of the detected head or person area, the angle at which the body parts below the neck are outside the screen of the near-infrared image may be calculated, and the rotation angle may be determined by calculating the difference from the current angle.
• the orientation control unit 215 changes the imaging range of the near-infrared camera 27 so that the imaging range of the near-infrared camera 27 becomes the initial setting range. In this case, if the imaging range of the near-infrared camera 27 is the initial setting range before the imaging range of the near-infrared camera 27 is changed, the orientation control unit 215 does not need to change the imaging range of the near-infrared camera 27.
• the orientation control unit 215 changes the imaging range of the near-infrared camera 27 so that the clothing of the person included in the visible light image is not included in the imaging range of the near-infrared camera 27.
• the imaging range of the near-infrared camera 27 moves upward from the initial setting range.
• the orientation control unit 215 may change the imaging range of the near-infrared camera 27 so that the clothing of the person included in the visible light image is not included in the imaging range of the near-infrared camera 27 and the eyes of the person are included.
• the orientation control unit 215 may change the imaging range of the near-infrared camera 27 based on the information and the visible light image so that the imaging range of the near-infrared camera 27 does not include the clothing of the person included in the visible light image and includes the eyes of the person.
• the near-infrared camera 27 captures an image.
• the image acquisition unit 211 acquires a near-infrared image captured by the near-infrared camera 27.
• the eye detection unit 216 detects the eye region of a person included in the near-infrared image.
• the eye detection unit 216 may detect the eye region of a person included in the near-infrared image based on the detection result of the face detection unit 212.
• the detection result of the eye detection unit 216 may be output to the iris authentication unit 218. Since existing technology can be applied to the method of detecting the eye region of a person included in the near-infrared image, detailed explanation thereof will be omitted.
• the face authentication unit 217 performs face authentication using the visible light image.
• the face authentication unit 217 may identify the face area of a person (e.g., a subject of face authentication) included in the visible light image based on the detection result of the face detection unit 212.
• the face authentication unit 217 may extract features related to the face area of a person (e.g., a subject of face authentication) included in the visible light image from the visible light image.
• the face authentication unit 217 may compare the extracted features with the features included in the feature data 221 to calculate a face matching score.
• the iris authentication unit 218 performs iris authentication using the near-infrared image.
• the iris authentication unit 218 may identify the eye region of a person (e.g., a subject of iris authentication) included in the near-infrared image based on the detection result of the eye detection unit 216.
• the iris authentication unit 218 may extract features related to the eye region of a person (e.g., a subject of iris authentication) included in the near-infrared image from the near-infrared image.
• the iris authentication unit 218 may compare the extracted features with features included in the feature data 221 to calculate an iris matching score.
• the integrated authentication unit 219 may calculate an integrated score based on, for example, the face matching score calculated by the face authentication unit 217 and the iris matching score calculated by the iris authentication unit 218. If the integrated score is equal to or greater than a threshold, the integrated authentication unit 219 may determine that the subject (i.e., a person who is the subject of face authentication and also the subject of iris authentication) is a registrant. If the integrated score is less than the threshold, the integrated authentication unit 219 may determine that the subject is not a registrant.
• the subject i.e., a person who is the subject of face authentication and also the subject of iris authentication
• the orientation control unit 215 changes the imaging range of the near-infrared camera 27 so that the clothing of the person included in the visible light image is not included in the imaging range of the near-infrared camera 27. Therefore, according to the information processing device 2, it is possible to reduce resistance to biometric authentication using a near-infrared image captured by the near-infrared camera 27 and resistance to photographing for biometric authentication. As a result, biometric authentication can be introduced even in places where the person to be authenticated is likely to be wearing a swimsuit, such as a pool or a beach. This makes it possible to introduce biometric authentication payment to pools, beaches, etc., and to realize entry and exit management to paid swimming areas using biometric authentication.
• the orientation control unit 215 may change the imaging range of the near-infrared camera 27 so that the imaging range of the near-infrared camera 27 does not include the clothing of the person in the visible light image and includes the eyes of the person. Therefore, according to the information processing device 2, it is possible to capture a near-infrared image that can be used for iris authentication while avoiding the inclusion of the person's clothing in the imaging range.
• the near-infrared camera 27 may not capture images. In this case, when multiple people are not detected from the visible light image captured by the visible light camera 26 after the person detection unit 213 detects multiple people from the visible light image, the near-infrared camera 27 may resume capturing images. In other words, when a person other than the subject of biometric authentication is included in the visible light image, the near-infrared camera 27 may temporarily stop capturing images.
• the orientation control unit 215 may change the imaging range of the near-infrared camera 27 so that the clothes of the person determined by the clothing determination unit 214 to be wearing specific clothing are not included in the imaging range of the near-infrared camera 27.
• the orientation control unit 215 may change the imaging range of the near-infrared camera 27 based on the multiple head regions corresponding to the multiple people respectively so that the body parts (e.g., the part below the neck or the torso part) of all the multiple people included in the visible light image are not included in the imaging range of the near-infrared camera 27.
• the orientation control unit 215 may control the output device 25 to issue a warning.
• the orientation control unit 215 may, for example, control the output device 25 to display a visible light image captured by the visible light camera 26 while issuing a warning message indicating that only the subject of biometric authentication is captured in the image.
• the information processing device 2 may acquire information about the environment around the information processing device 2 (in other words, the environment around the subject of biometric authentication).
• the information about the environment may include at least one of information about the installation location of the information processing device 2 and information about the weather.
• the orientation control unit 215 may change the imaging range of the near-infrared camera 27 so that the clothes of the subject of biometric authentication are not included in the imaging range of the near-infrared camera 27. In this case, the clothing determination unit 214 may not perform a determination.
• the clothing determination unit 214 may not need to determine whether the clothing of the person included in the visible light image is specific clothing. In this case, the clothing determination unit 214 may identify the position in the visible light image of the clothing of the person included in the visible light image. In other words, the clothing determination unit 214 may identify the position of the clothing of the person in the imaging range of the visible light camera 26.
• the orientation control unit 215 may change the imaging range of the near-infrared camera 27 based on the position of the clothing identified by the clothing determination unit 214 so that the clothing of the person included in the visible light image is not included in the imaging range of the near-infrared camera 27, regardless of the type of clothing of the person.
• the arithmetic unit 21 of the information processing device 3 has a water droplet detection unit 311 and a guidance presentation unit 312 as a logically realized functional block or as a physically realized processing circuit.
• the water droplet detection unit 311 detects water droplets on the face of a person (e.g., a person to be subjected to biometric authentication) included in a visible light image based on the visible light image captured by the visible light camera 26.
• the water droplet detection unit 311 may detect water droplets on the face of a person included in a visible light image using a computational model that, when a visible light image is input, outputs a determination result as to whether or not water droplets are attached to the person's face.
• a computational model is a computational model that uses a neural network (e.g., CNN).
• the guidance presentation unit 312 controls the output device 25 so that information is presented that guides a person (e.g., a person who is the subject of biometric authentication) to take action, such as "Please wipe off the water droplets from your face.”
• a person e.g., a person who is the subject of biometric authentication
• the water droplet detection unit 311 may detect, in addition to water droplets on the face, an article covering the person's eyes, such as goggles.
• the guidance presentation unit 312 may control the output device 25 so that information for guiding the behavior of the person (e.g., the subject of biometric authentication), such as "Please remove the article,” is presented.
• An information processing device comprising:
• Appendix 2 an estimation means for estimating a situation based on the visible light image, The information processing device described in Appendix 1, wherein the control means controls the change means so that, when the situation satisfies the specified condition, the imaging range of the near-infrared camera is set higher than when the situation does not satisfy the specified condition.
• the situation includes information regarding clothing of the subject;
• the information processing device according to claim 2, wherein the control means controls the change means so that clothing of the target is not included in an imaging range of the near-infrared camera when the situation satisfies the predetermined condition.
• the predetermined condition includes that the subject is wearing a swimsuit, The information processing device described in Appendix 3, wherein the control means controls the change means so that the target's clothing is not included in the imaging range of the near-infrared camera when the situation satisfies the specified condition that the target's clothing is a swimsuit.
• the context includes information about an environment surrounding the subject;
• the predetermined condition includes an environment in which the object may get wet;
• the information processing device according to any one of appendixes 2 to 4, wherein the control means controls the change means so that a body part of the target is not included in an imaging range of the near-infrared camera when the situation satisfies the predetermined condition that the environment is one in which the target may get wet.
• Appendix 6 an estimation means for estimating head regions of the target and other persons when the visible light image includes, in addition to the target, other persons around the target;
• the information processing device according to any one of appendixes 1 to 5, wherein the control means controls the change means so that body parts of the target and the other person are not included in the imaging range of the near-infrared camera based on the estimated head region.
• An information processing device including a visible light camera for capturing an image of an object and a near-infrared camera for capturing an image of the object, When a predetermined condition is satisfied based on the visible light image captured by the visible light camera, the imaging range of the near-infrared camera is set to be higher than when the predetermined condition is not satisfied.
• a computer constituting an information processing device including a visible light camera for capturing an image of an object and a near-infrared camera for capturing an image of the object, When a predetermined condition is satisfied based on a visible light image captured by the visible light camera, the imaging range of the near-infrared camera is set to an upper side compared to when the predetermined condition is not satisfied.

Landscapes

• Engineering & Computer Science (AREA)
• Health & Medical Sciences (AREA)
• General Health & Medical Sciences (AREA)
• Ophthalmology & Optometry (AREA)
• Human Computer Interaction (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Multimedia (AREA)
• Theoretical Computer Science (AREA)
• Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Priority Applications (2)

Applications Claiming Priority (1)

Publications (1)

Family

ID=92262690

Family Applications (1)

Country Status (2)

Citations (3)

Family Cites Families (3)

• 2023
  • 2023-02-10 JP JP2024576067A patent/JP7845514B2/ja active Active
  • 2023-02-10 WO PCT/JP2023/004613 patent/WO2024166383A1/ja not_active Ceased

Patent Citations (3)

Also Published As

Similar Documents

Legal Events