WO2021220412A1 - 撮像システム、撮像方法、及びコンピュータプログラム - Google Patents

撮像システム、撮像方法、及びコンピュータプログラム Download PDF

Info

Publication number
WO2021220412A1
WO2021220412A1 PCT/JP2020/018151 JP2020018151W WO2021220412A1 WO 2021220412 A1 WO2021220412 A1 WO 2021220412A1 JP 2020018151 W JP2020018151 W JP 2020018151W WO 2021220412 A1 WO2021220412 A1 WO 2021220412A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
imaging
subject
imaging system
pixel density
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2020/018151
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
有加 荻野
慶一 蝶野
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Corp
Original Assignee
NEC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Corp filed Critical NEC Corp
Priority to PCT/JP2020/018151 priority Critical patent/WO2021220412A1/ja
Priority to US17/920,908 priority patent/US20230171481A1/en
Priority to JP2022518498A priority patent/JP7364059B2/ja
Publication of WO2021220412A1 publication Critical patent/WO2021220412A1/ja
Anticipated expiration legal-status Critical
Priority to JP2023173512A priority patent/JP7613531B2/ja
Priority to JP2024228445A priority patent/JP2025031910A/ja
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/34—Smoothing or thinning of the pattern; Morphological operations; Skeletonisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/82—Camera processing pipelines; Components thereof for controlling camera response irrespective of the scene brightness, e.g. gamma correction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris

Definitions

  • This disclosure relates to the technical fields of imaging systems, imaging methods, and computer programs that image subjects.
  • Patent Document 1 discloses a technique of detecting a subject's face and eyes to identify an area of interest in the iris.
  • Patent Document 2 discloses a technique of generating a low-resolution image from a high-resolution image and performing pupil detection from the low-resolution image.
  • Patent Document 3 discloses a technique of synthesizing a plurality of images to generate a composite image having a wide angle of view.
  • An iris camera that captures an image for iris recognition is generally set to have a high pixel count and a narrow angle of view. Therefore, it is difficult to capture a wide-angle image in which the eye position of the subject can be detected by the iris camera due to restrictions on the communication speed and the angle of view range.
  • This disclosure has been made in view of the above problems, and an object of the present invention is to provide an imaging system, an imaging method, and a computer program capable of appropriately capturing an image around the eyes of a subject.
  • One aspect of the imaging system of the present disclosure is a first control means that controls the imaging means so as to capture a first image of the subject with a first pixel density, and a position of the eyes of the subject from the first image.
  • a detection means for detecting the above a setting means for setting a peripheral area around the eyes of the subject based on the position of the eyes, and a second pixel density higher than the first pixel density, the peripheral area.
  • One aspect of the imaging method of the present disclosure is to control the imaging means so as to capture the first image of the subject with the first pixel density, detect the position of the eyes of the subject from the first image, and obtain the eyes.
  • the imaging means is set so as to set a peripheral region around the eyes of the subject based on the position of, and to capture a second image of the peripheral region with a second pixel density higher than the first pixel density.
  • One aspect of the computer program of the present disclosure is to control the imaging means so as to capture the first image of the subject with the first pixel density, detect the position of the eyes of the subject from the first image, and the eyes.
  • the peripheral region around the eyes of the subject is set based on the position of, and the imaging means is used to capture a second image of the peripheral region with a second pixel density higher than the first pixel density. Operate the computer to control.
  • FIG. 1 is a block diagram showing a hardware configuration of the imaging system according to the first embodiment.
  • the imaging system 10 includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14.
  • the imaging system 10 may further include an input device 15 and an output device 16.
  • the processor 11, the RAM 12, the ROM 13, the storage device 14, the input device 15, and the output device 16 are connected via the data bus 17.
  • Processor 11 reads a computer program.
  • the processor 11 is configured to read a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14.
  • the processor 11 may read a computer program stored in a computer-readable recording medium using a recording medium reading device (not shown).
  • the processor 11 may acquire (that is, may read) a computer program from a device (not shown) located outside the imaging system 10 via a network interface.
  • the processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the read computer program.
  • a functional block for capturing an image of a subject is realized in the processor 11.
  • processor 11 a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (field-programmable gate array), a DSP (Demand-Side Platform), and an ASIC (Appli) are used. Alternatively, a plurality of them may be used in parallel.
  • CPU Central Processing Unit
  • GPU Graphics Processing Unit
  • FPGA field-programmable gate array
  • DSP Demand-Side Platform
  • ASIC Application Specific integrated circuit
  • the RAM 12 temporarily stores the computer program executed by the processor 11.
  • the RAM 12 temporarily stores data temporarily used by the processor 11 when the processor 11 is executing a computer program.
  • the RAM 12 may be, for example, a D-RAM (Dynamic RAM).
  • the ROM 13 stores a computer program executed by the processor 11.
  • the ROM 13 may also store fixed data.
  • the ROM 13 may be, for example, a P-ROM (Programmable ROM).
  • the storage device 14 stores data stored by the imaging system 10 for a long period of time.
  • the storage device 14 may operate as a temporary storage device of the processor 11.
  • the storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.
  • the input device 15 is a device that receives an input instruction from the user of the imaging system 10.
  • the input device 15 may include, for example, at least one of a keyboard, a mouse and a touch panel.
  • the output device 16 is a device that outputs information about the imaging system 10 to the outside.
  • the output device 16 may be a display device (for example, a display) capable of displaying information about the imaging system 10.
  • FIG. 2 is a block diagram showing a functional configuration of the imaging system according to the first embodiment.
  • the imaging system 10 is connected to the iris camera 20.
  • the imaging system 10 includes a first control unit 110, an eye position detection unit 120, an ROI setting unit 130, and a second control unit 140 as processing blocks for realizing the function.
  • the first control unit 110, the eye position detection unit 120, the ROI setting unit 130, and the second control unit 140 may be realized, for example, in the processor 11 (see FIG. 1) described above.
  • the first control unit 110 is configured to control the iris camera 20 so that the first image of the subject can be captured.
  • the first image is an image used to detect the position of the eyes of the subject, and is captured with a relatively low first pixel density.
  • the first image is captured so that, for example, the entire subject is within the imaging range.
  • the eye position detection unit 120 detects the eye position of the subject (that is, where the eyes are) by using the first image captured under the control of the first control unit 110.
  • the method of detecting the eye position of the subject from the image an existing technique can be appropriately adopted, and therefore a more specific description thereof will be omitted here.
  • Information about the eye position of the subject detected by the eye position detection unit 120 is output to the ROI setting unit.
  • the ROI setting unit 130 is configured to be able to set an ROI (Region Of Interest) for capturing the iris of the subject based on the eye position of the subject detected by the eye position detection unit 120.
  • the ROI is set as the area through which the eyes of the subject will pass at the in-focus point of the iris camera 20.
  • the information about the ROI set by the ROI setting unit 130 is output to the second control unit 140.
  • the second control unit 140 is configured to control the iris camera 20 so that a second image of the subject can be captured.
  • the second image is an image captured as an image of a region set by the ROI setting unit 130, and is captured with a second pixel density higher than the first pixel density (that is, the pixel density when the first image is captured). Will be done. As a result, the second image becomes an image obtained by capturing the region around the eyes of the subject with high resolution.
  • FIG. 3 is a flowchart showing an operation flow of the imaging system according to the first embodiment.
  • the first control unit 110 first controls the iris camera 20 so as to capture the first image of the subject (step S101). ..
  • the first image is captured with the first pixel density.
  • the eye position detection unit 120 detects the eye position of the subject from the first image (step S102). Then, the ROI setting unit 130 sets the ROI based on the detected eye position (step S103).
  • the second control unit 140 controls the iris camera 20 so as to capture the second image at the set ROI (step S104).
  • the second image is captured with a second pixel density higher than the first pixel density.
  • FIG. 4 is a conceptual diagram showing the imaging timing and imaging range of the first image and the second image according to the first embodiment.
  • the second image is captured at the second pixel density.
  • the amount of data in the first image can be made relatively small. Therefore, it is possible to prevent the amount of data of the first image, which requires a relatively wide angle of view, from becoming large.
  • the period required for communication and processing of the first image can be shortened, and the processing from the acquisition of the first image to the acquisition of the second image (for example, the processing of detecting the eye position and the ROI) can be performed. Processing to set, etc.) can be executed smoothly.
  • the iris camera 20 has a first image (that is, an image for detecting the eye position and setting the ROI) and a second image (that is, a high-definition iris). Images) and can be imaged respectively. Therefore, the iris image of the subject can be appropriately captured without incurring the above-mentioned increase in cost and high complexity of the system.
  • the imaging system 10 According to the imaging system 10 according to the first embodiment, the eye position can be specified with a low-quality image even with the iris camera having a narrow angle of view, and the iris region can be specified. In addition, it is not necessary to make the user aware of the camera.
  • the first control unit 110 may capture the first image at the timing when the subject reaches a predetermined trigger position, for example.
  • the timing at which the subject reaches the trigger position may be detected by, for example, various sensors installed around the trigger position.
  • the second control unit 140 may capture a second image at the timing when the subject reaches a preset focusing point of the iris camera 20, for example.
  • the second control unit 140 may predict the timing when the subject reaches the in-focus point and continuously capture a plurality of second images in the vicinity of the timing.
  • the second image captured by the control of the second control unit 140 may be input to a biometric authentication unit (not shown) and used for iris authentication of the subject.
  • the biometric authentication unit may be provided as a part of the imaging system 10, or may be provided outside the imaging system 10 (for example, an external server, a cloud, or the like). Since the existing technology can be appropriately adopted for the authentication process using the iris image (that is, the second image), a more specific description here will be omitted.
  • the imaging system 10 according to the second embodiment will be described with reference to FIGS. 5 to 7.
  • the second embodiment is different from the first embodiment described above only in a part of the configuration and operation, and the other parts are substantially the same. Therefore, in the following, the parts different from the first embodiment will be described in detail, and the description of other overlapping parts will be omitted as appropriate.
  • the hardware configuration of the imaging system 10 according to the second embodiment may be the same as the hardware configuration of the first embodiment described with reference to FIG. Therefore, the description of the hardware configuration of the imaging system 10 according to the second embodiment will be omitted.
  • FIG. 5 is a block diagram showing a functional configuration of the imaging system according to the second embodiment.
  • the same components as those shown in FIG. 2 are designated by the same reference numerals.
  • the imaging system 10 according to the second embodiment may be collectively referred to as a first iris camera 21, a second iris camera 22, and a third iris camera 23 (hereinafter collectively referred to as "iris camera 20"). ) Are connected. That is, the imaging system 10 according to the second embodiment is configured to be able to control imaging by a plurality of iris cameras 20. Further, the imaging system 10 includes a first control unit 110, an eye position detection unit 120, an ROI setting unit 130, and a second control unit 140 as processing blocks for realizing the function.
  • FIG. 6 is a flowchart showing an operation flow of the imaging system according to the second embodiment.
  • the same reference numerals are given to the same processes as those shown in FIG.
  • each iris camera 21 and the second iris camera so that the first control unit 110 first captures the first image of the subject.
  • Each of the 22 and the third iris camera 23 is controlled (step S201). It is preferable that each iris camera 20 captures the first image at the same timing, but the timing of imaging may be slightly different.
  • the eye position detection unit 120 detects the eye position of the subject from the plurality of first images (step S102). Then, the ROI setting unit 130 sets the ROI based on the detected eye position (step S103).
  • the second control unit 140 controls the iris camera 20 so as to capture the second image at the set ROI (step S104).
  • the second image may be captured by one of the first iris camera 21, the second iris camera 22, and the third iris camera 23. That is, it is not necessary for all the iris cameras 20 to separately capture the second image.
  • the iris camera 20 that captures the second image may be determined according to, for example, the ROI set by the ROI setting unit 130. Specifically, the second image may be captured by the iris camera 20 that includes the ROI in the imaging range.
  • FIG. 7 is a conceptual diagram showing the imaging timing and imaging range of the first image and the second image according to the second embodiment.
  • the same reference numerals are given to the same components as those shown in FIG. 7
  • the first image is captured by a plurality of iris cameras 20, and the eye position is detected and the ROI is set from the first image.
  • the eyes may not be included in the imaging range depending on the situation.
  • an appropriate ROI can be set from the eye position, and the second image (that is, a high-definition iris image) can be captured more appropriately.
  • the plurality of first images do not have to be captured by the plurality of iris cameras 20, and a plurality of first images may be captured by one iris camera 20. Specifically, for example, the position of one camera may be appropriately moved to capture the first image from a plurality of angles. Even in this case, the above-mentioned technical effect can be obtained by synthesizing a plurality of first images to generate a wide-angle image.
  • the imaging system 10 according to the third embodiment will be described with reference to FIGS. 8 and 9.
  • the third embodiment is different from the first and second embodiments described above only in a part of the configuration and operation, and the other parts are substantially the same. Therefore, in the following, the parts different from the first and second embodiments will be described in detail, and the description of other overlapping parts will be omitted as appropriate.
  • the hardware configuration of the imaging system 10 according to the third embodiment may be the same as the hardware configuration of the first embodiment described with reference to FIG. Therefore, the description of the hardware configuration of the imaging system 10 according to the third embodiment will be omitted.
  • FIG. 8 is a block diagram showing a functional configuration of the imaging system according to the second embodiment.
  • the same components as those shown in FIGS. 2 and 5 are designated by the same reference numerals.
  • the image pickup system 10 according to the third embodiment has a first control unit 110, an eye position detection unit 120, an ROI setting unit 130, and a third processing block for realizing the function. 2
  • a control unit 140 and an image composition unit 210 are provided. That is, the image pickup system 10 according to the second embodiment is configured to further include an image synthesizing unit 210 in addition to the configuration of the second embodiment (see FIG. 5).
  • the image synthesizing unit 210 is configured to be capable of synthesizing the first image captured by each of the first iris camera 21, the second iris camera 22, and the third iris camera 23.
  • the first iris camera 21, the second iris camera 22, and the third iris camera 23 are installed so that their imaging ranges do not greatly overlap each other. Therefore, one wide-angle image can be generated by synthesizing the first images captured by each iris camera 20.
  • the wide-angle image generated by the image synthesizing unit 210 is output to the eye position detecting unit 110.
  • the image synthesizing unit 210 may be realized, for example, in the processor 11 (see FIG. 1) described above.
  • FIG. 9 is a flowchart showing an operation flow of the imaging system according to the third embodiment.
  • the same reference numerals are given to the same processes as those shown in FIGS. 3 and 6.
  • the imaging system 10 when the imaging system 10 according to the third embodiment operates, the first iris camera 21 and the second iris camera so that the first control unit 110 first captures the first image of the subject.
  • Each of the 22 and the third iris camera 23 is controlled (step S201).
  • the image synthesizing unit 210 synthesizes a plurality of first images captured by the first iris camera 21, the second iris camera 22, and the third iris camera 23 (step S202).
  • the eye position detection unit 120 detects the eye position of the subject from the wide-angle image obtained by synthesizing the plurality of first images (step S102).
  • the ROI setting unit 130 sets the ROI based on the detected eye position (step S103).
  • the second control unit 140 controls the iris camera 20 so as to capture the second image at the set ROI (step S104).
  • the images captured by the plurality of iris cameras 20 are combined to generate one wide-angle image.
  • the iris camera 20 is often set to have a relatively narrow angle of view because it is required to capture an image of the iris of the subject with high definition.
  • a wide-angle image is generated from the first image captured by the plurality of iris cameras 20. Therefore, even when the angle of view of each iris camera is narrow, it is possible to acquire a wide-angle image suitable for detecting the eye position.
  • the imaging system 10 according to the fourth embodiment will be described with reference to FIGS. 10 and 11. It should be noted that the fourth embodiment is different from the first to third embodiments described above only in a part of the configuration and the operation, and the other parts are substantially the same. Therefore, in the following, the parts different from the first to third embodiments will be described in detail, and the description of other overlapping parts will be omitted as appropriate.
  • the hardware configuration of the imaging system 10 according to the fourth embodiment may be the same as the hardware configuration of the first embodiment described with reference to FIG. Therefore, the description of the hardware configuration of the imaging system 10 according to the fourth embodiment will be omitted.
  • FIG. 10 is a block diagram showing a functional configuration of the imaging system according to the fourth embodiment.
  • the same components as those shown in FIGS. 2, 5 and 8 are designated by the same reference numerals.
  • the imaging system 10 according to the fourth embodiment has a first control unit 110, an eye position detection unit 120, an ROI setting unit 130, and a first processing block for realizing the function. 2 A control unit 140 and an eye area determination unit 220 are provided. That is, the imaging system 10 according to the fourth embodiment is configured to further include an eye region determination unit 220 in addition to the configuration of the second embodiment (see FIG. 5).
  • the eye area determination unit 220 is configured to be able to determine whether or not the first image captured by each of the first iris camera 21, the second iris camera 22, and the third iris camera 23 includes an eye area. Has been done. In other words, the eye area determination unit 220 is configured to be able to determine which of the plurality of first images captured by the second iris camera 22 and the third iris camera 23 includes the eye area. Has been done.
  • the determination result of the eye region determination unit 220 (that is, information about the first image including the eye region) is output to the eye position detection unit 110.
  • the eye area determination unit 220 may be realized, for example, in the processor 11 (see FIG. 1) described above.
  • FIG. 11 is a flowchart showing an operation flow of the imaging system according to the fourth embodiment.
  • the same reference numerals are given to the same processes as those shown in FIGS. 3, 6, and 9.
  • the imaging system 10 when the imaging system 10 according to the fourth embodiment operates, the first iris camera 21 and the second iris camera so that the first control unit 110 first captures the first image of the subject.
  • Each of the 22 and the third iris camera 23 is controlled (step S201).
  • the eye region determination unit determines the presence or absence of the eye region with respect to the plurality of first images captured by the first iris camera 21, the second iris camera 22, and the third iris camera 23 (step S203). Subsequently, the eye position detection unit 120 detects the eye position of the subject from the first image determined to include the eye region (step S102). Then, the ROI setting unit 130 sets the ROI based on the detected eye position (step S103).
  • the second control unit 140 controls the iris camera 20 so as to capture the second image at the set ROI (step S104).
  • the imaging system 10 it is determined whether or not the first image captured by the plurality of iris cameras 20 includes the eye region, and the eye region is determined.
  • the eye position is detected from the first image containing. Therefore, it is possible to detect the eye position more efficiently than in the case of detecting the eye position from all the first images.
  • the imaging system 10 according to the fifth embodiment will be described with reference to FIG.
  • the fifth embodiment specifically describes another method for capturing the first image, and the hardware configuration, functional configuration, and operation flow of the system are described from the first described above. It may be the same as the fifth embodiment. Therefore, in the following, the parts different from the first to fifth embodiments will be described in detail, and the description of other overlapping parts will be omitted as appropriate.
  • FIG. 12 is a conceptual diagram showing the imaging timing and imaging range of the first image and the second image according to the fifth embodiment.
  • the same reference numerals are given to the same components as those shown in FIGS. 4 and 7.
  • the first image is captured by each of the first iris camera 21, the second iris camera 22, and the third iris camera 23 at different timings. .. Specifically, the first iris camera 21 captures the first image at the timing when the subject 500 reaches the first trigger point. The second iris camera 22 captures the first image at the timing when the subject 500 reaches the second trigger point. The third iris camera 23 captures the first image at the timing when the subject 500 reaches the third trigger point. In this way, if the plurality of trigger points are staggered and installed, a plurality of first images will be captured at different timings.
  • the eye position of the subject 500 may be detected from each of the plurality of first images captured as described above.
  • the eye position may be detected using all of the plurality of first images, or the first image including the eye region is determined from the plurality of first images, and only the first image including the eye region is determined. May be used to detect the eye position.
  • the plurality of iris cameras 20 are set so that the portion where the imaging ranges overlap with each other is sufficiently large. In this way, even if the heights of the subjects 500 are different, at least one iris camera 20 can capture the face of the subject 500 without interruption.
  • a plurality of first images are captured at different timings. Even in this case, it is possible to detect the eye position of the subject 500 as in the case of simultaneously capturing a plurality of first images.
  • the imaging system 10 according to the sixth embodiment will be described with reference to FIG.
  • the third embodiment specifically describes the method for reducing the resolution when capturing the first image, and the hardware configuration, functional configuration, and operation flow of the system will be described in the above-mentioned first embodiment. It may be the same as the first to fifth embodiments. Therefore, in the following, the parts different from the first to fifth embodiments will be described in detail, and the description of other overlapping parts will be omitted as appropriate.
  • FIG. 13 is a conceptual diagram showing an operation when a low-resolution first image is captured by thinning out pixels.
  • the resolution of the first image is reduced by thinning out the pixels of the iris camera 20.
  • the first control unit 110 reduces the number of pixels to be read when the first image is captured by using a technique such as binning.
  • the second control unit 140 prevents the pixels from being thinned out when the second image is captured (however, the imaging region is limited to the ROI). In this way, the pixel density of the second image is higher than that of the first image.
  • the amount of pixel thinning may be changed depending on the location of the imaging region. That is, the amount of pixel thinning does not have to be uniform over the entire imaging region. For example, the thinning amount may be reduced for a region where the eye region is likely to exist, and may be increased for a region where the eye region is unlikely to exist.
  • the resolution of the first image can be reduced by thinning out the pixels. Therefore, it is possible to prevent the amount of data of the first image from becoming large and shorten the period required for communication and processing of the first image.
  • the imaging system 10 according to the seventh embodiment will be described with reference to FIG.
  • the seventh embodiment specifically describes a method for reducing the amount of data when capturing the first image, and the hardware configuration, functional configuration, and operation flow of the system will be described in the above-described fifth embodiment. It may be the same as the first to sixth embodiments. Therefore, in the following, the parts different from the first to sixth embodiments will be described in detail, and the description of other overlapping parts will be omitted as appropriate.
  • FIG. 14 is a conceptual diagram showing an operation when the first image is captured by limiting the imaging region to a small size.
  • the data amount reduction of the first image is realized by limiting (that is, narrowing) the image pickup area of the iris camera 20 to a small size.
  • the first control unit 110 is at least one of the upper end portion and the lower end portion (for example, a region where it is presumed that the eyes of the subject are unlikely to be located) at the time of capturing the first image.
  • the pixels are not read.
  • the amount of data in the first image is reduced. Since the first image is captured in a state where the pixels are thinned out as described in the sixth embodiment, the pixel density is also low. Therefore, the amount of data in the first image is significantly reduced.
  • At least one pixel of the right end portion and the left end portion of the imaging region may not be read.
  • the eyes of the subject are included in the right end portion and the left end portion of the imaging area. Is less likely to occur. Therefore, the amount of data in the first image can be efficiently reduced by not reading at least one pixel of the right end portion and the left end portion of the imaging region.
  • the data amount of the first image can be further reduced by narrowing the image pickup area of the iris camera 20. Therefore, it is possible to prevent the amount of data of the first image from becoming large and shorten the period required for communication and processing of the first image.
  • the imaging system detects the position of the eyes of the subject from the first control means that controls the imaging means so as to capture the first image of the subject with the first pixel density, and the first image.
  • the detection means for setting the peripheral region around the eyes of the subject based on the position of the eyes, and the second pixel density higher than the first pixel density, the first of the peripheral regions.
  • the image pickup system is characterized by including a second control means for controlling the image pickup means so as to capture two images.
  • the first control means processes the pixels of the imaging means so as to thin out the pixels so that the first pixel density becomes lower than the second pixel density.
  • Appendix 3 The imaging system according to Appendix 3 is described in Appendix 1 or 2, wherein the first control means reduces the amount of data of the first image by limiting the imaging region of the imaging means to a small size. Imaging system.
  • the imaging means includes a plurality of cameras, and the first control means controls the imaging means so that each of the plurality of cameras captures the first image.
  • Appendix 5 The imaging system according to Appendix 5, wherein the detection means detects the position of the eyes of the subject from a composite image obtained by synthesizing a plurality of the first images. Is the imaging system described in 1.
  • the imaging system according to Appendix 6 is characterized in that the first control means controls the imaging means so as to capture the first image when the subject reaches a predetermined trigger position.
  • the imaging system according to any one of 1 to 5.
  • Appendix 7 The imaging system according to Appendix 7 is characterized in that the second imaging means controls the imaging means so as to capture the second image when the subject reaches a preset focusing point.
  • the imaging system according to any one of Supplementary note 1 to 6.
  • Appendix 9 In the imaging method described in Appendix 9, the imaging means is controlled so as to capture the first image of the subject with the first pixel density, the position of the eyes of the subject is detected from the first image, and the position of the eyes is detected. Based on the above, a peripheral region around the eyes of the subject is set, and the imaging means is controlled so as to capture a second image of the peripheral region with a second pixel density higher than the first pixel density. It is an imaging method characterized by performing.
  • Appendix 10 controls the imaging means so as to capture the first image of the subject with the first pixel density, detects the position of the eyes of the subject from the first image, and positions the eyes. Based on the above, a peripheral region around the eyes of the subject is set, and the imaging means is controlled so as to capture a second image of the peripheral region with a second pixel density higher than the first pixel density. It is a computer program characterized by operating a computer in such a manner.
  • Imaging system 20 Iris camera 21 1st iris camera 22 2nd iris camera 23 3rd iris camera 110 1st control unit 120 Eye position detection unit 130 ROI setting unit 140 2nd control unit 210 Image synthesis unit 220 Eye area determination unit 500 subject

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Studio Devices (AREA)
  • Collating Specific Patterns (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
PCT/JP2020/018151 2020-04-28 2020-04-28 撮像システム、撮像方法、及びコンピュータプログラム Ceased WO2021220412A1 (ja)

Priority Applications (5)

Application Number Priority Date Filing Date Title
PCT/JP2020/018151 WO2021220412A1 (ja) 2020-04-28 2020-04-28 撮像システム、撮像方法、及びコンピュータプログラム
US17/920,908 US20230171481A1 (en) 2020-04-28 2020-04-28 Imaging system, imaging method, and computer program
JP2022518498A JP7364059B2 (ja) 2020-04-28 2020-04-28 撮像システム、撮像方法、及びコンピュータプログラム
JP2023173512A JP7613531B2 (ja) 2020-04-28 2023-10-05 撮像システム、撮像方法、及びコンピュータプログラム
JP2024228445A JP2025031910A (ja) 2020-04-28 2024-12-25 撮像システム、撮像方法、及びコンピュータプログラム

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/018151 WO2021220412A1 (ja) 2020-04-28 2020-04-28 撮像システム、撮像方法、及びコンピュータプログラム

Publications (1)

Publication Number Publication Date
WO2021220412A1 true WO2021220412A1 (ja) 2021-11-04

Family

ID=78332316

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/018151 Ceased WO2021220412A1 (ja) 2020-04-28 2020-04-28 撮像システム、撮像方法、及びコンピュータプログラム

Country Status (3)

Country Link
US (1) US20230171481A1 (https=)
JP (3) JP7364059B2 (https=)
WO (1) WO2021220412A1 (https=)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12501189B2 (en) * 2022-08-31 2025-12-16 Meta Platforms Technologies, Llc Region of interest sampling and retrieval for artificial reality systems

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005292542A (ja) * 2004-04-01 2005-10-20 Matsushita Electric Ind Co Ltd 目画像撮像装置および携帯端末装置
JP2007504562A (ja) * 2003-09-04 2007-03-01 サーノフ コーポレーション １つの画像から虹彩認証を行う方法および装置
WO2009016846A1 (ja) * 2007-08-02 2009-02-05 Panasonic Corporation 虹彩認証装置および虹彩認証システム
JP2012129709A (ja) * 2010-12-14 2012-07-05 Canon Inc 情報処理装置、情報処理方法及びプログラム
US20130088583A1 (en) * 2011-10-07 2013-04-11 Aoptix Technologies, Inc. Handheld Iris Imager
WO2018038158A1 (ja) * 2016-08-24 2018-03-01 日本電気株式会社 虹彩撮像装置、虹彩撮像方法および記録媒体

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10340345A (ja) * 1997-06-06 1998-12-22 Oki Electric Ind Co Ltd 個体識別装置
JP3797839B2 (ja) * 1999-12-22 2006-07-19 沖電気工業株式会社 個人識別装置及び個人識別方法
JP5637816B2 (ja) * 2010-10-29 2014-12-10 キヤノン株式会社 撮像装置、放射線撮影装置および放射線撮影システム
JP2013046232A (ja) * 2011-08-24 2013-03-04 Nippon Hoso Kyokai <Nhk> 固体撮像装置
JP2015226255A (ja) * 2014-05-29 2015-12-14 株式会社ニコン 撮像装置および自動車

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007504562A (ja) * 2003-09-04 2007-03-01 サーノフ コーポレーション １つの画像から虹彩認証を行う方法および装置
JP2005292542A (ja) * 2004-04-01 2005-10-20 Matsushita Electric Ind Co Ltd 目画像撮像装置および携帯端末装置
WO2009016846A1 (ja) * 2007-08-02 2009-02-05 Panasonic Corporation 虹彩認証装置および虹彩認証システム
JP2012129709A (ja) * 2010-12-14 2012-07-05 Canon Inc 情報処理装置、情報処理方法及びプログラム
US20130088583A1 (en) * 2011-10-07 2013-04-11 Aoptix Technologies, Inc. Handheld Iris Imager
WO2018038158A1 (ja) * 2016-08-24 2018-03-01 日本電気株式会社 虹彩撮像装置、虹彩撮像方法および記録媒体

Also Published As

Publication number Publication date
JP7613531B2 (ja) 2025-01-15
JPWO2021220412A1 (https=) 2021-11-04
JP7364059B2 (ja) 2023-10-18
US20230171481A1 (en) 2023-06-01
JP2025031910A (ja) 2025-03-07
JP2023174759A (ja) 2023-12-08

Similar Documents

Publication Publication Date Title
JP5906028B2 (ja) 画像処理装置、画像処理方法
US10244163B2 (en) Image processing apparatus that generates a virtual viewpoint image, image generation method, and non-transitory computer-readable storage medium
KR101803712B1 (ko) 화상처리장치, 제어 방법, 프로그램 및 기록 매체
US9113080B2 (en) Method for generating thumbnail image and electronic device thereof
KR102399017B1 (ko) 이미지 생성 방법 및 장치
US9460337B2 (en) Information processor and information processing method
US20130021490A1 (en) Facial Image Processing in an Image Capture Device
US10127456B2 (en) Information processing apparatus that corrects image distortion to set a passage detection line, information processing method, and medium
US10070043B2 (en) Image processing system, image processing method, and program
US10223031B2 (en) Memory control apparatus and memory control method
US20220417382A1 (en) Buffer management for plug-in architectures in computation graph structures
JP2025031910A (ja) 撮像システム、撮像方法、及びコンピュータプログラム
US11617024B2 (en) Dual camera regions of interest display
CN110290299A (zh) 成像方法、装置、存储介质及电子设备
US12033433B2 (en) Iris recognition apparatus, iris recognition method, computer program and recording medium
KR20200096426A (ko) 동체 검출 장치, 동체 검출 방법, 동체 검출 프로그램
JP2018041201A (ja) 表示制御プログラム、表示制御方法および情報処理装置
US20150326830A1 (en) Information processing apparatus, information processing method, program, and information processing system
JP2011253381A (ja) 目標追跡装置及び目標追跡方法
US11763596B2 (en) Image capturing support apparatus, image capturing support method, and computer-readable recording medium
JP2016076853A (ja) 画像処理装置、画像処理方法、撮像装置
JP2013153392A5 (https=)
US11069029B2 (en) Information processing device, system, information processing method, and storage medium
JP6062483B2 (ja) デジタルカメラ
JP7472482B2 (ja) 情報処理装置、範囲決定方法、プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20934049

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022518498

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20934049

Country of ref document: EP

Kind code of ref document: A1