WO2016070781A1 - Système et procédé d'imagerie optoélectronique à combinaison de lumière visible et d'identification biométrique de terminal mobile - Google Patents

Système et procédé d'imagerie optoélectronique à combinaison de lumière visible et d'identification biométrique de terminal mobile Download PDF

Info

Publication number
WO2016070781A1
WO2016070781A1 PCT/CN2015/093647 CN2015093647W WO2016070781A1 WO 2016070781 A1 WO2016070781 A1 WO 2016070781A1 CN 2015093647 W CN2015093647 W CN 2015093647W WO 2016070781 A1 WO2016070781 A1 WO 2016070781A1
Authority
WO
WIPO (PCT)
Prior art keywords
imaging
optical
visible light
wavelength
image
Prior art date
Application number
PCT/CN2015/093647
Other languages
English (en)
Chinese (zh)
Inventor
倪蔚民
金城
Original Assignee
苏州思源科安信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 苏州思源科安信息技术有限公司 filed Critical 苏州思源科安信息技术有限公司
Publication of WO2016070781A1 publication Critical patent/WO2016070781A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/197—Matching; Classification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/40—Spoof detection, e.g. liveness detection
    • G06V40/45—Detection of the body part being alive
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/70—Multimodal biometrics, e.g. combining information from different biometric modalities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/14—Vascular patterns

Definitions

  • the invention relates to the field of biometric photoelectric, in particular to a visible light and biometric combined photoelectric imaging system and method for mobile terminals with high security.
  • Mobile terminals include smart phones, tablets, wearable devices, etc.
  • mobile terminal devices are inevitably the most widely used devices in the future.
  • mobile terminals in real-world applications have been widely used in mobile secure payment, account secure login, and online banking, such as the application of balance treasure, WeChat, and bank account management, although in their use, for life. It has brought great convenience, but a new type of economic crime caused by the weak security features of mobile terminals has gradually emerged.
  • the conventional method for identity verification in the prior art is password input, but the means of identity verification is very low in security, and only a simple virus program needs to be implanted on the mobile terminal to leak the password. , causing corresponding losses.
  • the biometric identification method is used for mobile terminal security identity authentication; for example, the fingerprint recognition technology developed by Apple based on AuthenTec, which is applied to mobile phone terminals, greatly improves the mobile terminal.
  • the combination of the visible light photoelectric imaging system and the iris vein biometric photoelectric imaging system for the self-photographing function is not realized.
  • the self-photographing visible light photoelectric imaging system and the iris vein biometric photoelectric imaging system are separately and independently implemented, the cost thereof is greatly increased, and the volume of the more important mobile terminal cannot provide a mounting space for accommodating three or more separate independent optical imaging systems.
  • the iris vein has more advantages in biosecurity and fingerprint recognition in terms of anti-counterfeiting safety, if it is applied to important occasions such as mobile phone large-value payment, it is still necessary to further upgrade the security technology of anti-counterfeiting in vivo detection. To eliminate the threat of security risks. After all, biometrics itself is designed to be safe, and its own security is the most basic and important.
  • the RGB-IR independent channel optoelectronic imaging system can realize the combined imaging of visible light and biometrics.
  • the mutual wavelength background isolation or cut-off depth between independent channels has not yet met the actual demand.
  • the high-security mobile terminal visible light and biometric combined photoelectric imaging system and method need to solve the following serious problems:
  • a visible light and biometric combined photoelectric imaging system for mobile terminal applications which is visible to the self-timer function.
  • the photo-electric imaging system and the iris vein bio-identification photoelectric imaging system are combined, and the volume is controlled within 8.5 mm*8.5 mm*6 mm, and the power consumption is low.
  • the visible light and biometric combined photoelectric imaging system requires a set of high-security anti-counterfeiting living body detection methods to ensure the safety of the biometric identification itself.
  • the visible light and biometric combined photoelectric imaging system needs to obtain high quality image photoelectric imaging method.
  • the visible light and biometric combined photoelectric imaging system requires a set of imaging methods to improve the success rate of biometric recognition.
  • the visible light and biometric combined photoelectric imaging system needs to greatly reduce the cost, and the cost can be reduced to less than 10 dollars to be applied on a large scale.
  • the technical problem to be solved by the present invention is to provide a visible light and biometric combined photoelectric imaging system for mobile terminals with high security.
  • biometrics described in the present invention are designated as irises and veins.
  • the present invention provides a visible light and biometric combined photoelectric imaging system for a mobile terminal, including a visible light photoelectric imaging and a biometric photoelectric imaging system; the visible light photoelectric imaging and the biometric photoelectric imaging are both performed by a processor chip and an LED.
  • the optical filter is configured to control a driver-controlled visible-infrared variable wavelength optical filter through an optical filter;
  • the visible-infrared variable wavelength optical filter is configured to have visible-infrared light with an image sensor Broadband imaging wavelength distributions are matched filter wavelength ranges;
  • the optical imaging lens is configured as an autofocus optical imaging lens controlled by an optical imaging lens focus driver;
  • the autofocus optical imaging lens is configured to have visible light with an image sensor Infrared light broadband imaging wavelength range in which the wavelength distributions are matched;
  • the optical center of the LED illumination source is configured as an off-axis optical path position of the optical axis of the imaging system.
  • the visible light imaging wavelength is radiated by the LED illumination source, and the visible light-infrared variable wavelength optical filter is switched to filter the infrared light imaging wavelength.
  • Autofocus optical imaging lens physical refraction focusing visible light imaging wavelength and imaging array of image sensor receiving visible light wavelength constitute optical path of visible light photoelectric imaging; infrared light imaging wavelength is radiated by said LED illumination source, visible light-infrared variable wavelength optical filter Switching to filtering visible light imaging wavelengths, autofocusing optical imaging lens physical refraction focusing infrared light imaging wavelength, and imaging array of image sensor receiving infrared light wavelength constitutes optical path of biometric photoelectric imaging; the visible light photoelectric imaging adopts visible light imaging wavelength of 400- 650 nm, the focusing work distance WD is at least in the range of 30-100 cm; the biometric photoelectric imaging adopts infrared light imaging wavelength of 750-950 nm, and the focusing work distance WD is at least 30-100 cm; the coaxial Optical path
  • the visible-infrared variable wavelength optical filter, the autofocus optical imaging lens, the angle between the optical center line of the image sensor and the optical axis of the imaging system has an angle of 0 degrees; the off
  • the biometric photoelectric imaging has the following optical imaging requirements: the imaging wavelength WI of the biometric photoelectric imaging satisfies: 750 nm ⁇ WI ⁇ 950 nm; the focused work object distance WD of the biometric photoelectric imaging satisfies: 10 cm ⁇ WD ⁇ 30 cm;
  • the optical spatial resolution OSRI of the visible light photoelectric imaging satisfies in the image plane: when the modulation transfer function is equal to 60%, 1/(4*PS) ⁇ OSRI ⁇ 1/(2*PS).
  • the image sensor, the LED current driver, the autofocus optical imaging lens focus driver, and the optical filter control driver are each controlled by a processor chip;
  • the processor chip is configured to connect an image sensor, control image pixel value data output by the image sensor imaging array; connect the LED current driver to drive the LED illumination source radiation intensity, radiation angle and position, radiation time; connect autofocus optics
  • An imaging lens focus driver is used to drive the autofocus optical imaging lens to physically focus; and an optical filter control driver is coupled to drive the visible-infrared variable wavelength optical filter wavelength range change.
  • the physical scale PS of the imaging pixel unit receiving the visible light-infrared light wavelength in the imaging array of the image sensor satisfies the following condition: 1 um / Pixel ⁇ PS ⁇ 3 um / pixel; the wavelength pixel unit received by the image sensor imaging array has a photoelectrically converted value Y, and its value Y is:
  • the EXP is an integration time or exposure time of the image sensor imaging array
  • EXP synchronization is equal to the LED illumination source radiation time
  • GAIN is the digital and analog gain of the image sensor imaging array
  • the maximum GAIN satisfies the image sensor Signal-to-noise ratio SNR, SNR ⁇ 36db decibel
  • ADCG is the ADC voltage analog-to-digital conversion quantization resolution of the image sensor imaging array
  • E is the radiance or irradiance received by the image sensor imaging array
  • I is the radiation intensity of the LED illumination source 106; the minimum value of I satisfies I ⁇ 100 mw / sr; ⁇ is the radiation angle of the LED illumination source, that is, the off-axis clamp between the radiation optical center line of the LED illumination source and the optical axis of the imaging system Angle; ⁇ satisfied: 5 degrees ⁇ ⁇ ⁇ 30 degrees; WD is the focus working distance of the optical imaging system; FNO is the numerical aperture of the autofocus optical imaging lens, that is, the relative aperture distance reciprocal; FNO meets: 0.5*PS/(1.22 * ⁇ ) ⁇ FNO ⁇ 2.0*PS/(1.22* ⁇ );
  • ⁇ is the imaging wavelength
  • ⁇ is the biological tissue optical effect reflectivity of the imaged object
  • C is the optical coefficient of the optical imaging system
  • ⁇ is the object angle of view of the incident light
  • ⁇ satisfies: 0 ⁇ ⁇ ⁇ FOV/2
  • FOV is the full field of view of the photoelectric imaging system
  • OM is the optical magnification of the photoelectric imaging system
  • PSU is the image sensor imaging The physical scale area ratio of the imaging pixel unit of the array
  • Q is a photoelectric conversion constant of the photoelectric imaging system; the digital value Y of the image sensor imaging array receiving pixel unit photoelectric conversion is output as the imaged image raw RAW pixel data I ⁇ Y ⁇ ; the imaging array of the image sensor is configured as a global frame An imaging mode or a scroll line imaging mode; the image sensor is configured as a RAW RGB pixel output format, using RGB channel compensation gain or RGB channel balance gain;
  • the g( ⁇ ), r( ⁇ ), b( ⁇ ) are photoelectric quantum conversion efficiency sensitivity wavelength distribution functions of the RGB spectrum of the image sensor, respectively, and f( ⁇ ) is a visible light-infrared variable wavelength optical filter Transmittance wavelength distribution function, S( ⁇ ) is the radiance wavelength distribution function of the LED illumination source; L( ⁇ ) is the transmittance wavelength distribution function of the autofocus optical imaging lens; the equivalent is to compensate the gain by the R channel or
  • the B channel compensation gain is a normalized standard;
  • the image resolution ROI of the image sensor is configured to be: ROI ⁇ 2560 pixels * 1280 pixels; the image sensor has a chief ray incident angle CRA (Chief Ray Angle) ⁇ 25 degrees.
  • CRA chief ray incident angle
  • the LED illumination source has: visible light and infrared light imaging wavelengths of independent or mixed radiation; half-peak radiation field of view angle ⁇ ; The half-peak radiation field of view angle ⁇ satisfies:
  • the FOV is a full field of view of the imaging system
  • EFL is the equivalent focal length of the autofocus optical imaging lens
  • DI is the number of image-facing pixel units of the image sensor imaging array
  • PS is the physical scale of the pixel unit of the image sensor imaging array; used to optimize the photoelectric imaging system One or more different radiation angles and positions of the imaging field of view and imaging quality effects; continuous or pulsed radiation time and radiation intensity synchronized with image sensor imaging for jointly optimizing the imaging quality effects of the optoelectronic imaging system; said LED illumination
  • the light source is packaged in an SMD surface mount package.
  • the visible light-infrared variable wavelength optical filter has: when changed to a visible light imaging wavelength:
  • the light transmittance in the visible light imaging wavelength range is Ti ⁇ 90.0%, and the light transmittance outside the visible light imaging wavelength range is To ⁇ 1.0%;
  • the optical cutoff rate Fi ⁇ 10.0% in the infrared imaging wavelength range, and the optical cutoff ratio outside the infrared imaging wavelength range is Fo ⁇ 99.0%
  • the light transmittance in the infrared light imaging wavelength range is Ti ⁇ 90.0%, and the light transmittance outside the infrared light imaging wavelength range is To ⁇ 1.0%.
  • the autofocus optical imaging lens is configured to have a fixed focal length, and any of a liquid driving lens, a liquid crystal driving lens, a VCM voice coil driving lens, a MEMS driving lens, an EDOF wavefront phase modulation lens, or a wafer level array microlens One type;
  • the autofocus optical imaging lens has a focal length EFL, and the numerical aperture FNO satisfies:
  • the optical distortion DOL absolute value of the autofocus optical imaging lens is configured as: DOL absolute value ⁇ 1%;
  • the relative illumination rate IOR of the autofocus optical imaging lens is configured to: IOR ⁇ 50%;
  • the IOR edge field of view brightness of the optical imaging lens / central field of view brightness of the optical imaging lens;
  • the autofocus optical imaging lens and image sensor are configured to match the principal ray incident angle CRA with each other.
  • An imaging method for visible light photoelectric imaging comprising the following steps: 1 processor chip performs optical filter control driver, LED current driver, image sensor, autofocus optical imaging lens focus driver initialization working state configuration; 2 processor chip Control optical filter control driver, LED current driver, image sensor, autofocus optical imaging lens focus driver enters low power standby or shutdown mode; processor chip determines whether it needs to acquire visible image, turn to step 4, continue to step 3
  • the 4 processor chip controls the visible light-infrared variable wavelength optical filter to be a visible light imaging wavelength through an optical filter control driver; the processor chip controls the LED current driver to drive the LED illumination source to generate visible light imaging wavelength continuous or synchronous pulse mode radiation;
  • the processor chip controls the imaging array of the image sensor to receive the original image RAW RGB pixel data I ⁇ Y ⁇ of the global frame imaging mode or the scroll line imaging mode output; 5 processor chip according to the imaging original image RAW pixel data I ⁇ Y ⁇ Pixel unit photoelectric conversion relationship, driving image sensor and LED current driver and autofocus optical imaging lens focus driver to realize feedback control; 6 processor chip for original image R
  • An imaging method for biometric photoelectric imaging comprising the steps of: 1. processor chip performing optical filter control driver, LED current driver, image sensor, autofocus optical imaging lens focus driver initializing working state Configuration; 2. Processor chip control optical filter control driver, LED current driver, image sensor, autofocus optical imaging lens focus driver enters low power standby or shutdown mode; 3. Processor chip determines whether it needs to acquire biological imaging image, Is the step (4), continue to step (3); 4. The processor chip changes the visible-infrared variable wavelength optical filter to the infrared light imaging wavelength through the optical filter control driver; 5. The processor chip controls the LED current driver to drive the LED illumination The light source generates infrared radiation imaging wavelength continuous or synchronous pulse mode radiation; 6.
  • the processor chip controls the image sensor's imaging array to receive the global frame imaging mode or the scroll line imaging mode output of the original image RAW RGB pixel data I ⁇ Y ⁇ ; Processor chip based on imaged raw image RAW The pixel data I ⁇ Y ⁇ and the pixel unit photoelectric conversion relationship drive the image sensor and the LED current driver and the autofocus optical imaging lens focus driver to realize the feedback control; 8. The processor chip outputs the image I ⁇ Y ⁇ ; 9. returns to the step (2) cycle.
  • the image sensor initialization working state is configured as a RAW RGB pixel output format
  • the RGB channel compensation gain or the RGB channel balance gain processing can be configured by initializing the working state.
  • Setting a corresponding RGB channel digital and/or analog gain simplification of the image sensor; the feedback control includes the following steps: First, the processor chip can According to the imaged raw image RAW pixel data I ⁇ Y ⁇ output by the image sensor and the corresponding formula EQ1, feedback control image sensor reset integration time, digital and/or analog gain setting, feedback control LED current driver to drive the radiation intensity of the LED illumination source And radiation time, used to control image brightness, signal-to-noise ratio and motion blur to improve image quality; secondly, the processor chip can calculate the mirror total reflection interference in the image based on the imaged raw image RAW pixel data I ⁇ Y ⁇ output by the image sensor Degree and relative illumination brightness balance, feedback control LED current driver drives LED illumination source to control radiation angle and position to improve imaging quality; finally, the processor chip can calculate the
  • a driving autofocus method comprises the following steps: 1. defining a local region of interest to be searched and a search parameter according to a predetermined focus working object range; 2. processor chip controlling autofocus optical imaging lens focusing driver according to step 1 Defining a local region of interest to be searched and search parameters, driving the autofocus optical imaging lens to perform a continuous focus position search in a monotonic direction; 3. processor chip controlling the image sensor acquisition step 2 in a monotonous direction in a continuous focus position Searching for the output of the original image RAW RGB pixel data; 4. The processor chip calculates the focus quality of the focus position search image in real time; 5. The processor determines that the image corresponding to the best focus quality is the best focus image.
  • a biometric anti-counterfeiting bio-detection method a real-time detection method for biological tissue spectroscopy activity characteristics generated by visible-infrared light imaging wavelength radiation.
  • the real-time detection method of the biological tissue spectral activity characteristic generated by the visible light-infrared light imaging wavelength radiation comprises the following steps: 1) processor chip through optical The filter control driver changes the visible-infrared variable wavelength optical filter to visible light imaging wavelength; the processor chip drives the LED current driver to drive the LED illumination source to generate visible imaging wavelength radiation; the processor chip acquires the visible imaging wavelength of the image sensor imaging array Image Ivs; 2) the processor chip controls the driver to change the visible-infrared variable wavelength optical filter to the infrared light imaging wavelength through the optical filter control driver; the processor chip drive controls the LED current driver to drive the LED illumination source to generate the infrared light imaging wavelength radiation; The processor chip acquires the infrared light imaging wavelength image Iir of the image sensor imaging array; 3) the processor chip calculates the contrast C data of the visible light imaging wavelength image Ivs and the infrared light imaging wavelength image Iir in steps a and b, respectively,
  • C is the contrast between the iris area and the outer area of the iris
  • C is the contrast between the vein area and the extra-venous area
  • Yiris represents the iris area pixel
  • Youtiris represents the iris area pixel
  • Yvein represents the vein area pixel
  • Youtvein represents the extra-venous region pixel; the function S is the corresponding region pixel statistical evaluation function, and the pixel statistical evaluation function includes: histogram statistics, frequency statistics, average statistics, weighted average statistics, median statistics , energy value statistics, variance statistics, gradient statistics or space-frequency domain filters; 4) processor chip real-time calculation of visible image imaging wavelength radiation and infrared light imaging wavelength radiation image contrast Ivs_C and Iir_C activity change rate ⁇ ;
  • step 5 Preset values of the spectral properties of the biological tissue according to the visible light-infrared light imaging wavelength, and step 4
  • the active contrast ratio of the data value ⁇ is correspondingly changed, and the judgment condition ⁇ >300% realizes real-time detection of the biological living state; the above-mentioned steps 1 and 2 are equivalent and can be swapped.
  • An imaging method for improving the success rate of biometric recognition includes the following steps: I. acquiring infrared light imaging wavelength biological image Iir ⁇ P ⁇ enroll ⁇ generated by at least two or more LED illumination sources at different radiation angles and positions during registration; II At least two or more biometric template Template ⁇ P ⁇ enroll ⁇ are obtained by using the biological image Iir ⁇ P ⁇ enroll ⁇ , and the cross-matching of the feature templates is successful, and then saved as a registered bio-feature template; III. One or more acquisitions are recognized.
  • the feature template Template ⁇ P ⁇ enroll ⁇ performs cross comparison and obtains the recognition result.
  • An imaging method for improving the success rate of biometric recognition comprising: the following steps: i. acquiring infrared light imaging wavelength biological image generated by at least two or more LED illumination sources at different radiation intensities when registering Iir ⁇ Renroll ⁇ ;ii, using the biological image Iir ⁇ Renroll ⁇ to obtain at least two or more biometric templates Template ⁇ Renroll ⁇ , after the cross-matching of the feature templates is successful, save as a registered bio-feature template; iii, collect one when identifying Or the above-mentioned LED illumination source, the infrared light imaging wavelength biological image Iir ⁇ Rrecogn ⁇ generated at different radiation intensities; iv, using one or more biological images Iir ⁇ Rrecogn ⁇ to calculate the generated feature template Template ⁇ Rrecogn ⁇ and the registered creature Cross-aligning between feature templates Template ⁇ Renroll ⁇ and obtaining recognition results.
  • An imaging method for improving the success rate of biometric recognition includes the following steps: a registration of at least two or more LED illumination sources generated at different radiation wavelength ranges of infrared light imaging wavelength biological images Iir ⁇ Wenroll ⁇ ; b using biological The image Iir ⁇ Wenroll ⁇ calculates at least two or more biometric template Template ⁇ Wenroll ⁇ , and after the cross-matching between the feature templates is successful, saves as a registered bio-feature template; c collects one or more LED illumination sources when recognizing Infrared light imaging wavelength biological image Iir ⁇ Wrecogn ⁇ generated at different radiation wavelength ranges; d uses one or more biological images Iir ⁇ Wrecogn ⁇ to calculate the generated feature template Template ⁇ Wrecogn ⁇ and registered biometric template Template ⁇ Wenroll ⁇ Cross-aligning and obtaining recognition results.
  • the present invention realizes a high security mobile terminal visible light and biometric combined photoelectric imaging system and a method thereof:
  • the visible light and biometric combined photoelectric imaging system in mobile terminal application realizes the visible light photoelectric imaging satisfying the self-timer function and the photoelectric imaging combination of various iris vein biometrics, and its volume is controlled within 8.5mm*8.5mm*6mm, low power consumption .
  • the visible light and biometric combined photoelectric imaging system in the mobile terminal application realizes a set of high-security anti-counterfeiting living body detection methods to ensure the safety of the biometric identification itself.
  • the visible light and biometric combined photoelectric imaging system in mobile terminal application realizes obtaining high quality image photoelectric imaging method.
  • the visible light and biometric combined photoelectric imaging system can greatly reduce the cost, and the cost can be reduced to less than 10 dollars to be applied on a large scale.
  • FIG. 1 is a general structural view of a visible light and biometric combined photoelectric imaging system of the present invention
  • Embodiment 1 A mobile terminal visible light and biometric combined photoelectric imaging system and method are provided.
  • the method comprises an imaging method with visible light photoelectric imaging, an imaging method for biometric photoelectric imaging, a biological anti-counterfeiting living body detecting method, and an imaging method for improving the success rate of biometric recognition.
  • the combined optoelectronic imaging system sequentially sets a visible-infrared variable wavelength optical filter (101 or 104) (for filtering visible or infrared light imaging wavelengths) from top to bottom along the optical axis 100 of the imaging system.
  • a visible-infrared variable wavelength optical filter (101 or 104) (for filtering visible or infrared light imaging wavelengths) from top to bottom along the optical axis 100 of the imaging system.
  • a fixed mount 103 for autofocus optical imaging lens 102 for refracting focused imaging wavelengths
  • an autofocus optical imaging lens for fixed mounting of autofocus optical imaging lenses
  • Image sensor 105 for photoelectric conversion output imaging image
  • illumination source 106 including visible light and infrared light - LED illumination source for generating visible light imaging wavelength radiation for visible light photoimaging and for generating infrared light imaging for biometric photoelectric imaging) Wavelength radiation
  • imaging system fixed mounting substrate 107 for providing visible light and biometric photoelectric imaging fixed mounting carrier
  • imaging system fixed mounting substrate 107 connected to mobile terminal motherboard 110 (for implementing mobile terminal function circuit carrier), in mobile terminal Integrated LED current driver 108 on the main board 110 (for driving and controlling the illumination of the LED illumination source 106 Degree, radiation angle and position, and radiation time)
  • autofocus optical imaging lens focus driver 111 for driving autofocus optical imaging lens 102 autofocus
  • optical filter control driver 112 for driving visible light-infrared light variable The wavelength optical filter changes the wavelength range
  • a processor chip 109 for driving control
  • the visible light and biometric combined optoelectronic imaging system of Embodiment 1 of the present invention includes an optical pathway for visible light photo imaging and an optical pathway for biometric photoelectric imaging.
  • optical pathways for visible light imaging include the following:
  • the LED illumination source 106 radiates the visible light imaging wavelength, the visible-infrared variable wavelength optical filter (101 or 104) switches to the filtered infrared light imaging wavelength, the autofocus optical imaging lens 102 physically refracts the focused visible imaging wavelength, and the image sensor 105 is imaged.
  • the array receives visible wavelengths.
  • optical pathways for biometric optoelectronic imaging include the following:
  • the LED illumination source 106 radiates the infrared light imaging wavelength, the visible-infrared variable wavelength optical filter (101 or 104) is switched to filter the visible light imaging wavelength, and the autofocus optical imaging lens 102 physically refracts the focused infrared light imaging wavelength, the image sensor 105 The imaging array receives the wavelength of the infrared light.
  • the imaging array of the image sensor 105 is configured such that the unit pixel has an imaging wavelength spectrum that receives a broadband distribution of visible-infrared light;
  • the LED illumination source 106 visible light and infrared LED illumination source
  • the visible-infrared variable wavelength optical filter (101 or 104) is configured to have a visible-infrared broadband imaging wavelength with the image sensor 105
  • the filter wavelength ranges that match each other are distributed;
  • the autofocus optical imaging lens 102 is configured to have a range of focus wavelengths that match the visible-infrared broadband imaging wavelength distribution of the image sensor 105.
  • the on-axis optical path position is at an angle between the optical center line of the visible-infrared variable wavelength optical filter (101 or 104), the autofocus optical imaging lens 102, and the image sensor 105 and the optical axis 100 of the imaging system. 0 degree angle.
  • the optical center of the LED illumination source 106 is configured as an off-axis optical path position of the imaging system optical axis 100.
  • the off-axis optical path position is an angle of 5-30 degrees between the radiation optical centerline of the illumination source 106 and the imaging system optical axis 100.
  • the processor chip 109 has the following functions:
  • Connecting the optical filter control driver 112 effects a wavelength range change of the visible light-infrared variable wavelength optical filter.
  • the autofocus optical imaging lens 102 is configured to have a fixed focal length, and may be any one of a liquid driving lens, a liquid crystal driving lens, a VCM voice coil driving lens, a MEMS driving lens, an EDOF wavefront phase modulation lens, or a wafer level array microlens. .
  • the visible-infrared variable wavelength optical filter (101 or 104) described above controls the driver 112, and can drive two independent (visible and infrared) optical filters, such as VCM voice coil electromagnetic force, respectively. Achieve wavelength range changes. Specifically, the electromagnetic force is applied to the voice coil cavity to realize the electromagnetic force to push the elastic mechanical transmission mechanism to shift the displacement of the two independent filters (visible light or infrared light) to the coaxial optical path position of the imaging system optical axis 100. The drive wavelength range changes. Further, the visible-infrared variable wavelength optical filter (101 or 104) described above may employ a dielectric thin film tunable wavelength optical filter. The optical filter wavelength filter range change is achieved by the optical filter control driver 112 applying different sized film dielectric value tunings.
  • the visible-infrared variable wavelength optical filter of the present invention is not limited to the above examples, and other types should be equally understood.
  • the imaging wavelength of the invention includes a visible light imaging wavelength of 400-650 nm and an infrared light imaging wavelength of 750-950 nm; the imaging wavelength in the specific embodiment 1 includes a visible light imaging wavelength of 400-650 nm and an infrared light imaging wavelength of 810-880 nm.
  • the infrared light imaging wavelength range in essence, the imaging wavelength range is a bandwidth characteristic, which can also be equivalently interpreted as being represented by an imaging wavelength center (wavelengthcenter) and a half-peak bandwidth (FWHM), such as 810-880 nm.
  • the range can be expressed as a central wavelength of 850 nm ⁇ 30 nm half-peak bandwidth.
  • a narrow band may be used as a center wavelength of 850 nm ⁇ 15 nm half-peak bandwidth.
  • the variation of the imaging wavelength range of the present invention is not limited to the above examples, and other ranges should be equally understood.
  • the visible light photoelectric imaging adopts the visible light imaging wavelength, the focusing work object distance is at least 30-100 cm, and the photoelectric imaging system adopts the infrared light imaging wavelength, and the focusing work object distance WD is at least 10-30 cm.
  • Biometric optoelectronic imaging has the following optical imaging requirements:
  • the imaging wavelength WI of the biometric photoelectric imaging satisfies: 750 nm ⁇ WI ⁇ 950 nm;
  • Focusing work distance WD of biometric photoelectric imaging meets: 10cm ⁇ WD ⁇ 30cm;
  • the pixel spatial resolution (PSR) of biometric photoelectric imaging should satisfy: PSR ⁇ 10 pixels/mm;
  • optical magnification OM optical magnification
  • the PS described above is a physical scale of each imaging pixel unit of the image sensor 105;
  • the PSR is a pixel spatial resolution of the biometric photoelectric imaging;
  • Visible light imaging has the following optical imaging requirements:
  • the imaging wavelength WI of visible light photoelectric imaging satisfies: 400 nm ⁇ WI ⁇ 650 nm;
  • the focused work distance WD of visible light photoelectric imaging satisfies: 30cm ⁇ WD ⁇ 100cm;
  • the pixel spatial resolution PSR (pixel spatial resolution) of visible light photoelectric imaging should satisfy: PSR ⁇ 3pixel/mm;
  • OM PS * PSR
  • the PS described above is a physical scale of each imaging pixel unit of the image sensor 105;
  • the PSR is a pixel spatial resolution of visible light photoelectric imaging;
  • the physical scale PS of the imaging pixel unit receiving the visible-infrared light wavelength in the imaging array of the image sensor 105 satisfies the following condition: 1 um / pixel ⁇ PS ⁇ 3 um / pixel (micron per pixel);
  • the value Y of the photoelectric conversion of the wavelength pixel unit received by the image sensor 105 imaging array is:
  • EXP is the integration time integration time or exposure time of the imaging array of the image sensor 105, unit: S seconds; EXP synchronization is equal to the radiation time of the LED illumination source 106;
  • GAIN is the digital and analog gain of the image sensor 105 imaging array, no unit
  • the maximum value GAIN satisfies the signal-to-noise ratio SNR of the image sensor 105, and the SNR ⁇ 36db decibel
  • ADCG is the ADC voltage analog-to-digital conversion quantization resolution of the image sensor 105 imaging array, unit: LSB/V, numerical position per volt;
  • E is the radiance or irradiance received by the image sensor 105 imaging array, in units of lux (lux) or mw/cm 2 (per milliwatt per square centimeter);
  • I is the radiation intensity of the LED illumination source 106, unit milliwatts per sphericity (mw/sr);
  • I minimum value satisfies I ⁇ 100mw/sr
  • ⁇ is the radiation angle of the LED illumination source 106, that is, the off-axis angle between the radiation optical center line of the LED illumination source 106 and the imaging system optical axis 100;
  • WD is the focus working distance of the optical imaging system
  • FNO is the numerical aperture of the autofocus optical imaging lens 102, that is, the relative aperture distance reciprocal
  • FNO is satisfied: 0.5*PS/(1.22* ⁇ ) ⁇ FNO ⁇ 2.0*PS/(1.22* ⁇ )
  • ⁇ is the imaging wavelength
  • ⁇ is the optical reflectance of the biological tissue of the imaged object (iris or vein) (the wavelength of the radiation from the LED illumination source is absorbed by the iris or vein biological tissue, and the reflection and scattering produce the optical reflectance of the biological tissue);
  • C is the optical coefficient of the optical imaging system
  • ⁇ is the object angle of view of the incident light
  • FOV the full field of view of the photoelectric imaging system
  • OM is the optical magnification of the photoelectric imaging system
  • the PSU is a physical scale area ratio of the imaging pixel unit of the imaging array of the image sensor 105;
  • Q is the photoelectric conversion constant of the photoelectric imaging system; the unit is volts per milliwatt per square centimeter per second, V / (mw / cm 2 - sec) or ke - / (mw / cm 2 - sec);
  • the digital value Y of the image sensor 105 imaging array receiving pixel unit photoelectric conversion is further output as the imaged image raw RAW pixel data I ⁇ Y ⁇ .
  • the imaging array of image sensor 105 is configured as a global frame imaging mode (Global Shutter) or a rolling line imaging mode (Rolling Shutter).
  • Global Shutter global frame imaging mode
  • Rolling Shutter rolling line imaging mode
  • the Global Shutter mode described in Embodiment 1 of the present invention includes an imaging mode of global frame integration and global frame readout, or an imaging mode of global frame integration and scroll line readout.
  • the rolling line imaging mode (Rolling Shutter) described in Embodiment 1 of the present invention includes an imaging mode of rolling line integration and rolling line reading.
  • Image sensor 105 is configured as a RAW RGB pixel output format, using RGB channel compensation gain or RGB channel balance gain.
  • the above [ ⁇ 1, ⁇ h] is an imaging wavelength range, and the preferred visible light imaging wavelength in the specific embodiment 1 of the present invention is [400 nm, 650 nm], and the infrared imaging wavelength is [800 nm, 900 nm], as an equivalent understanding, further The infrared imaging wavelength range can also be changed to [810 nm, 880 nm].
  • g( ⁇ ), r( ⁇ ), b( ⁇ ) are the photoelectric quantum conversion efficiency sensitivity wavelength distribution functions of the RGB spectrum of the image sensor 105, respectively, and f( ⁇ ) is a visible-infrared variable wavelength optical filter (101) Or 104) a transmittance wavelength distribution function, S( ⁇ ) is a radiance wavelength distribution function of the LED illumination source 106; L( ⁇ ) is a transmittance wavelength distribution function of the autofocus optical imaging lens 102.
  • the R channel compensation gain or the B channel compensation gain can be equivalently used as a normal standard.
  • the image resolution ROI of the image sensor 105 is configured to:
  • ROI 2560 pixels * 1280 pixels.
  • the image sensor 105 has a chief ray incident angle CRA (Chief Ray Angle) ⁇ 25 degrees.
  • CRA Choef Ray Angle
  • the image sensor 105 according to the first embodiment of the present invention can further reduce the volume by using a package such as Bare Die (COB), ShellUT CSP, NeoPAC CSP, TSV CSP or the like.
  • COB Bare Die
  • ShellUT CSP ShellUT CSP
  • NeoPAC CSP NeoPAC CSP
  • TSV CSP TSV CSP
  • the LED illumination source 106 of the embodiment 1 of the present invention has visible and infrared imaging wavelengths of independent or mixed radiation. Furthermore, the LED illumination source (106 visible light and infrared light LED) according to the embodiment 1 of the present invention has a half-peak radiation viewing angle ⁇ .
  • the half-peak radiation field of view angle ⁇ satisfies:
  • the FOV is a full field of view of the imaging system
  • EFL is the equivalent focal length of the autofocus optical imaging lens 102;
  • DI is the image sensor 105 The number of image-facing pixel units of the array image;
  • PS is the physical scale of the pixel unit of the imaging array of the image sensor 105;
  • the LED (the above-mentioned LED illumination source) is theoretically a Lambertian point source with 360-degree angle radiation.
  • the convex lens or concave mirror can refract or reflect the light radiated by the LED point source to control the convergence of light. The effect of the half-peak radiation field of view of the LED illumination source.
  • the convex lens can be made of an optical matrix material such as high refractive and transmittance optical plastic, and the concave mirror can be made of a high optical reflectivity metal matrix material.
  • the LED can adopt an epoxy resin matrix material with high refractive index and high transmittance, and incorporate a scattering color agent that absorbs the wavelength of visible light transmitted infrared light to perform lens functional encapsulation, thereby realizing LED half-peak radiation field of view angle control convergence light energy.
  • the surface is black to achieve visual aesthetic requirements.
  • the LED illumination source 106 of the embodiment 1 of the present invention has one or more different radiation angles and positions for optimizing the imaging field of view and imaging quality effects of the optoelectronic imaging system. If using different radiation positions and different radiation angles on the left and/or right side of the optical axis 100 of the imaging system (left side Pl, right side Pr, left and right sides Pl & Pr, [5-30] radiation angle any one or more Such angles as 5 degrees, 20 degrees), as an example of different radiation angles and position changes can also be used (upper side Pt, lower side Pb, upper and lower sides Pt & Pb, [5-30] radiation angle any one or more angles Such as 10 degrees, 30 degrees).
  • a variety of radiation angles can optimize the degree of specular total reflected light interference and improve the imaging quality of the photoelectric imaging system.
  • a variety of radiation locations can optimize the relative illumination brightness balance of the imaging field of view and improve the imaging quality of the optoelectronic imaging system.
  • the different radiation angles and positional variations of the present invention are not limited to the above examples, and other different radiation angles and positions should be equally understood.
  • the LED illumination source 106 of the embodiment 1 of the present invention has continuous or pulsed radiation time and radiation intensity synchronized with imaging of the image sensor 105 for jointly optimizing the imaging quality effects of the optoelectronic imaging system.
  • the continuous or pulsed radiation time and radiation intensity of the LED illumination source 106 in synchronism with the image sensor 105 can optimize image brightness, signal to noise ratio and motion blur, and improve the imaging quality of the optoelectronic imaging system.
  • the LED illumination source 106 can be further reduced in size by encapsulation such as SMD surface patches.
  • the visible-infrared variable wavelength optical filter (101 or 104) according to the first embodiment of the present invention has a range of visible light and infrared light imaging wavelengths. Furthermore, the visible-infrared variable wavelength optical filter (101 or 104) described in Embodiment 1 of the present invention has:
  • the light cutoff ratio outside the visible light imaging wavelength range is Fo ⁇ 99.0%
  • the light transmittance outside the visible light imaging wavelength range is To ⁇ 1.0%.
  • the optical cutoff rate in the wavelength range of infrared light imaging is Fi ⁇ 10.0%
  • the light transmittance in the wavelength range of infrared light imaging is Ti ⁇ 90.0%
  • the light transmittance outside the wavelength range of the infrared light imaging is To ⁇ 1.0%.
  • the autofocus optical imaging lens 102 of the embodiment 1 of the present invention has physical refractive focused visible light and infrared light imaging wavelengths. Furthermore, the autofocus optical imaging lens 102 of the embodiment 1 of the present invention has imaging wavelengths for visible light and infrared light:
  • the autofocus optical imaging lens 102 described above can be implemented by surface multi-layer anti-reflection or anti-reflection coating on an aspheric optical plastic such as optical grade PMMA, optical grade PC and other optical matrix materials; and can pass 3-5P aspherical optics
  • aspheric optical plastic such as optical grade PMMA, optical grade PC and other optical matrix materials
  • the plastic injection molding process is realized, and the total length of TTL optics is ⁇ 6mm.
  • the autofocus optical imaging lens has a focal length EFL, and the numerical aperture FNO satisfies:
  • optical distortion DOL disortion of lens
  • the absolute value of DOL is ⁇ 1%.
  • the IOR edge field brightness of the optical imaging lens / central field of view brightness of the optical imaging lens.
  • the autofocus optical imaging lens 102 is configured to have a fixed focal length including any one of a liquid drive lens, a liquid crystal drive lens, a VCM voice coil drive lens, a MEMS drive lens, an EDOF wavefront phase modulation lens, or a wafer level microarray lens.
  • the liquid-driven lens described above includes a fixed focus lens, a liquid lens, and a voltage driver 111 for controlling the liquid lens;
  • the liquid crystal drive lens described above includes a fixed focus lens, a liquid crystal lens, and a voltage driver 111 for controlling the liquid crystal lens;
  • the liquid driving lens and the liquid crystal driving lens described above both adjust the optical power by changing the dioptric power of the incident light to realize the autofocus function.
  • the VCM voice coil drive lens described above includes a fixed focus lens, a VCM voice coil, and a current driver 111 for controlling the VCM voice coil; the VCM voice coil drive lens described above is realized by changing the optical back focus and optical image distance adjustment. Auto focus function.
  • the MEMS (Micro Electro Mechanical System) driving lens described above includes a fixed focus lens, a MEMS lens, and an electrostatic actuator 111 for controlling the MEMS lens.
  • the MEMS drive lens described above achieves an autofocus function by changing the optical position of the MEMS lens.
  • the wafer-level array microlens described above implements 3D panoramic deep reconstruction through Computational Imaging.
  • the EDOF wavefront phase modulation lens described above includes a lens and a wavefront phase modulation optical element; the EDOF wavefront phase modulation described above is modulated by the wavefront phase modulation optical element, and the inverse filter demodulation reconstruction realizes the extended depth of field function.
  • Embodiment 1 of the present invention further includes an OSI optical image stabilization driver for the imaging system, and a motion vector information feedback optical image stabilization driver provided by a sensor such as a gyroscope integrated by the mobile terminal is used to control the optical motion blur of the compensation imaging system, which can further Optimize the imaging quality effects of photoelectric imaging systems.
  • OSI optical image stabilization driver for the imaging system
  • a motion vector information feedback optical image stabilization driver provided by a sensor such as a gyroscope integrated by the mobile terminal is used to control the optical motion blur of the compensation imaging system, which can further Optimize the imaging quality effects of photoelectric imaging systems.
  • the motion vector information provided by the gyroscope, the linear velocity meter or the like according to the embodiment 1 of the present invention is used for feedback optical image stabilization driver OIS control to compensate optical motion blur of the imaging system, or for feedback 3-axis motion vector information That is, the angular velocity and/or the linear velocity is less than the predetermined threshold to control the optical motion blur of the imaging system, and the imaging quality effect of the photoelectric imaging system can be further optimized.
  • the LED illumination source 106 of the embodiment 1 of the present invention is configured with an optical linear polarizer, and an orthogonal state 90 corresponding to the configuration in the imaging optical path (before or after the autofocus optical imaging lens 102)
  • the optical linear polarizer can completely remove the imaging interference of the specular total reflected light by forming orthogonal polarization linear polarization at the transmitting and receiving ends.
  • an optical polarizer capable of tunable polarization can be disposed in the imaging optical path (before or after the autofocus optical imaging lens 102), and the specular total reflected light can be completely removed by controlling the polarization state of the tunable optical polarizer. Imaging interference.
  • Embodiment 1 of the present invention has different optical imaging requirements due to biometric photoelectric imaging and visible light photoelectric imaging, imaging wavelength, pixel spatial resolution, optical magnification, optical spatial resolution, focusing Crop distance range.
  • the biometric optoelectronic imaging described above has the following optical imaging requirements:
  • Biofocus photoelectric imaging's focused work distance WD meets:
  • PS is the physical scale of each imaging pixel unit of the image sensor
  • PSR is the pixel spatial resolution of the biometric photoelectric imaging
  • Embodiment 1 of the present invention enable high-resolution extraction of iris and vein biometric details to improve combined biometric performance.
  • the focused work distance WD of visible light photoelectric imaging satisfies:
  • the pixel spatial resolution PSR (pixel spatial resolution) of visible light photoelectric imaging should satisfy: PSR ⁇ 3pixel/mm;
  • optical magnification OM optical magnification
  • the present invention provides an imaging method for visible light photoelectric imaging, comprising the following steps:
  • Processor chip 109 controls control of said optical filter, said LED illumination source, said image sensor and said optical imaging lens into a low power standby or shutdown mode, optical filter control driver 112, LED current driver 108 , the image sensor 105, the autofocus optical imaging lens focus driver 111 enters a low power standby or shutdown mode;
  • the processor chip 109 changes the visible-infrared variable wavelength optical filter (101 or 104) through the optical filter control driver 112 to allow imaging wavelengths through visible light;
  • the processor chip 109 controls the LED current driver 108 to drive the LED illumination source 106 to produce radiation in a visible light imaging wavelength continuous or sync pulse mode;
  • the processor chip 109 controls the imaging array of the image sensor 105 to receive the original image RAW RGB pixel data I ⁇ Y ⁇ output in the global frame imaging mode or the scroll line imaging mode;
  • the feedback control in step 7 of the imaging method for visible light photoelectric imaging described above includes:
  • the processor chip 109 can feedback control the reset integration time of the image sensor 105, the digital and/or analog gain setting, and the feedback control LED according to the imaged raw image RAW pixel data I ⁇ Y ⁇ output by the image sensor 105 and the corresponding formula EQ1.
  • the current driver 108 drives the radiation intensity of the LED illumination source 106, and the radiation time is used to improve imaging quality.
  • the processor chip 109 can calculate the degree of specular total reflection interference in the image according to the imaged raw image RAW pixel data I ⁇ Y ⁇ output by the image sensor 105.
  • the feedback control LED current driver 108 drives the LED illumination source 106 for controlling the radiation angle and position. To improve the quality of the image.
  • the processor chip 109 can control the autofocus optical imaging lens focus driver 111 to drive the autofocus optical imaging lens 102 to achieve visible light photoimage focusing work object distance WD according to the focus quality value feedback control of the calculated imaged raw RAW pixel data I ⁇ Y ⁇ . 30cm-100cm.
  • a conventionally known autofocus method such as maximum focus peak blurring to accurate iterative search can be employed.
  • the processor chip 109 can pass the light sensor (depending on the use, a separate device can be provided on the processor chip 109, the method of which is set as the prior art, or the corresponding processing can be purchased in the market.
  • the chip implements such a light sensor function to control the intensity of the radiation of the visible light of the LED illumination source 106 by the LED current driver 108 based on the current ambient light level.
  • the LED current driver is turned off to drive the visible light of the LED illumination source 106.
  • interpolation reconstruction described in the step 8 of the imaging method for visible light photoelectric imaging described above may employ a conventionally known interpolation algorithm.
  • the processor chip 109 controls the optical filter, the LED illumination source, the image sensor and the optical imaging lens to enter a low power standby or shutdown mode, in particular, an optical filter control driver 112, LED
  • the current driver 108, the image sensor 105, the autofocus optical imaging lens focus driver 111 enters a low power standby or shutdown mode;
  • the processor chip determines whether it is necessary to acquire the biological imaging image, and proceeds to step 4, and proceeds to step 3;
  • the processor chip 109 changes the visible-infrared variable wavelength optical filter (101 or 104) through the optical filter control driver 112 to allow imaging of the wavelength by infrared light;
  • the processor chip 109 controls the LED current driver 108 to drive the LED illumination source 106 to generate infrared radiation imaging wavelength continuous or synchronous pulse mode radiation;
  • the processor chip 109 controls the imaging array of the image sensor 105 to receive the original image RAW RGB pixel data I ⁇ Y ⁇ output in the global frame imaging mode or the scroll line imaging mode;
  • the image sensor 105 initializing operation state is configured as a RAW RGB pixel output format, and the RGB channel compensation gain or RGB channel balance gain processing can set the corresponding RGB channel number of the image sensor 105 by initializing the working state configuration. And/or analog gain simplification implementation. Further image imaging sensor 105, disable color matrix correction CCM, disable interpolation interpolation, disable gamma correction, disable automatic white balance AWB, use these functions to reduce the contrast of biological images, especially texture high frequency edge parts, affecting biological image quality.
  • the feedback control in step 7 of the imaging method for biometric photoelectric imaging described above includes:
  • the processor chip 109 can feedback control the reset integration time of the image sensor 105, the digital and/or analog gain setting, and the feedback control LED according to the imaged raw image RAW pixel data I ⁇ Y ⁇ output by the image sensor 105 and the corresponding formula EQ1.
  • the current driver 108 drives the radiation intensity of the LED illumination source 106, and the radiation time, which is used to control image brightness, signal to noise ratio, and motion blur to improve image quality.
  • the processor chip 109 can calculate the degree of specular total reflection interference and the relative illumination brightness balance in the image according to the imaged raw image RAW pixel data I ⁇ Y ⁇ output by the image sensor 105, and the feedback control LED current driver 108 drives the LED illumination source 106. Control the radiation angle and position to improve image quality.
  • the processor chip 109 can control the autofocus optical imaging lens.
  • the focus driver 111 drives the autofocus optical imaging lens 102 to realize the biometric photoelectric imaging focusing work distance WD according to the focus quality value feedback control of the calculated imaged raw RAW pixel data I ⁇ Y ⁇ . At least 10cm-30cm.
  • a conventionally known autofocus method such as maximum focus peak blurring to accurate iterative search can be employed.
  • the processor chip 109 can perform optical black level correction BLC of the image sensor, automatic exposure feedback control AEC, and automatic gain feedback control AGC through the imaged raw RAW pixel data output by the image sensor 105.
  • the specific embodiment 1 of the present invention provides a fast autofocus method by the above-mentioned mobile terminal visible light and biometric combined photoelectric imaging system, comprising the following steps:
  • the EFL is a fixed focal length of the autofocus optical imaging lens
  • WD is the predetermined biological focus work distance range, 10-30cm;
  • the search step size SStep and the number of searches SNO can be determined by the following formula:
  • the PS is a physical scale of the imaging pixel unit of the image sensor 105;
  • k is a fuzzy circle diameter scale acceptable to the biometric algorithm
  • the methods used include: gradient statistics, frequency statistics, high-pass or band-pass spatial filters, high-frequency energy value statistics, variance statistics, spatial-frequency domain filters, etc.; the focus quality evaluation function QS of the present invention is not limited to the above examples. Other methods should be interpreted equally.
  • EI is the image focus quality threshold acceptable for biometric algorithms.
  • the method of determining the focus quality of the present invention is not limited to the above examples, and other methods should be equivalently understood.
  • a real-time detection method for the spectral properties of biological tissues produced by visible-infrared light imaging wavelength radiation.
  • the processor chip 109 changes the visible-infrared variable wavelength optical filter (101 or 104) to a visible light imaging wavelength through an optical filter control driver 112;
  • the processor chip 109 drives the LED current driver 108 to drive the LED illumination source 106 to generate visible imaging wavelength radiation;
  • the processor chip 109 changes the visible-infrared variable wavelength optical filter (101 or 104) to the infrared light imaging wavelength through the optical filter control driver 112;
  • the processor chip 109 drives the LED current driver 108 to drive the LED illumination source 106 to generate infrared light imaging wavelength radiation;
  • the processor chip 109 calculates the contrast C data of the visible light imaging wavelength image Ivs and the infrared light imaging wavelength image Iir in steps 1, 2, respectively Ivs_C, and Iir_C;
  • C is the contrast between the iris area and the outer area of the iris
  • Yiris represents the iris area pixel
  • Youtvein indicates the pixel outside the vein
  • the processor chip 109 calculates the image contrast Ivs_C and the Iir_C activity change rate ⁇ of the visible light imaging wavelength radiation and the infrared light imaging wavelength radiation, respectively, in real time;
  • the specific embodiment 1 (according to the mobile terminal visible light and biometric combined photoelectric imaging system) provides an imaging method for improving the biometric success rate, comprising the following steps:
  • Infrared light imaging wavelength biological image Iir ⁇ P ⁇ enroll ⁇ generated when at least two or more LED illumination sources 106 are acquired at different radiation angles and positions during registration;
  • the cross-alignment is obtained by performing the cross-matching of the three biometric templates Template ⁇ 1, 2, 3 ⁇ as Template1-Template2, Template1-Template3, and Template2-Template3 respectively; only when the above feature templates are cross-aligned Once successful, the stability and recognition rate of the registered biometric template for subsequent identification can be guaranteed.
  • Infrared light imaging wavelength biological image Iir ⁇ Renroll ⁇ generated by at least two or more LED illumination sources 106 at different radiation intensities when registering;
  • Active infrared light imaging wavelength biological images such as producing 1x, 2x, 4x or more different visible and/or infrared light intensity;
  • the cross-alignment is obtained by performing the cross-matching of the three biometric templates Template ⁇ 1, 2, 3 ⁇ as Template1-Template2, Template1-Template3, and Template2-Template3 respectively; only when the above feature templates are cross-aligned Once successful, the stability and recognition rate of the registered biometric template for subsequent identification can be guaranteed.
  • Infrared light imaging wavelength biological image Iir ⁇ Rrecogn ⁇ generated when one or more LED illumination sources 106 are generated at different radiation intensities
  • the specific embodiment 1 (according to the mobile terminal visible light and biometric combined photoelectric imaging system) further provides another imaging method for improving the biometric success rate, comprising the following steps:
  • Infrared light imaging wavelength biological image Iir ⁇ Wenroll ⁇ generated when at least two or more LED illumination sources 106 are generated in different radiation wavelength ranges during registration;
  • the cross-alignment is obtained by performing the cross-matching of the three biometric templates Template ⁇ 1, 2, 3 ⁇ as Template1-Template2, Template1-Template3, and Template2-Template3 respectively; only when the above feature templates are cross-aligned Once successful, the stability and recognition rate of the registered biometric template for subsequent identification can be guaranteed.
  • Infrared light imaging wavelength biological image Iir ⁇ Wrecogn ⁇ generated when one or more LED illumination sources 106 are generated at different radiation wavelength ranges;
  • the visible light wavelength radiation of the LED illumination source of the specific embodiment of the present invention can also be replaced by a display screen provided by the mobile terminal itself, such as an RGB backlight source with an adjustable brightness of the LCD display screen, or an organic substance having RGB radiation.
  • a display screen provided by the mobile terminal itself, such as an RGB backlight source with an adjustable brightness of the LCD display screen, or an organic substance having RGB radiation.
  • Light-emitting OLED Light-emitting OLED.
  • the optical filter control driver can be replaced by a manual controller such as a manual switcher.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Image Input (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Studio Devices (AREA)

Abstract

L'invention concerne un système et un procédé d'imagerie optoélectronique à combinaison de lumière visible et d'identification biométrique de terminal mobile. Le système comporte une source de lumière du type à diode électroluminescente (DEL), un filtre optique, une lentille d'imagerie optique et un capteur d'image ; le capteur d'image est configuré de telle sorte qu'un pixel unitaire présente un spectre de distribution de longueur d'onde d'imagerie à large bande capable de recevoir une lumière visible au niveau de la lumière infrarouge ; la source de lumière du type à DEL est configurée pour émettre une lumière ayant une longueur d'onde d'imagerie de lumière visible ou de lumière infrarouge, et présente une plage de longueurs d'onde de rayonnement correspondant à la lumière visible au niveau de la distribution de longueur d'onde d'imagerie à large bande de lumière infrarouge du capteur d'image ; le filtre optique est conçu pour être un filtre optique de longueur d'onde pouvant changer entre la lumière visible et la lumière infrarouge, et le filtre optique de longueur d'onde pouvant changer entre la lumière visible et la lumière infrarouge est conçu pour avoir une plage de longueurs d'onde de filtration correspondant à la lumière visible au niveau de la distribution de longueur d'onde d'imagerie à large bande de lumière infrarouge du capteur d'image ; la lentille d'imagerie optique est conçue pour avoir une plage de longueurs d'onde de mise au point correspondant à la lumière visible au niveau de la distribution de longueur d'onde d'imagerie à large bande de lumière infrarouge du capteur d'image.
PCT/CN2015/093647 2014-11-03 2015-11-03 Système et procédé d'imagerie optoélectronique à combinaison de lumière visible et d'identification biométrique de terminal mobile WO2016070781A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410611916.0A CN104301633B (zh) 2014-11-03 2014-11-03 移动终端可见光和生物识别组合光电成像系统及移动终端
CN2014106119160 2014-11-03

Publications (1)

Publication Number Publication Date
WO2016070781A1 true WO2016070781A1 (fr) 2016-05-12

Family

ID=52321177

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/093647 WO2016070781A1 (fr) 2014-11-03 2015-11-03 Système et procédé d'imagerie optoélectronique à combinaison de lumière visible et d'identification biométrique de terminal mobile

Country Status (2)

Country Link
CN (5) CN105354557B (fr)
WO (1) WO2016070781A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3654826A4 (fr) * 2017-07-17 2021-03-24 Welch Allyn, Inc. Capture d'image rétinienne à foyer traversant
US11045088B2 (en) 2015-02-27 2021-06-29 Welch Allyn, Inc. Through focus retinal image capturing
US11096574B2 (en) 2018-05-24 2021-08-24 Welch Allyn, Inc. Retinal image capturing
US11819272B2 (en) 2015-11-02 2023-11-21 Welch Allyn, Inc. Retinal image capturing

Families Citing this family (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10025963B2 (en) * 2014-06-30 2018-07-17 Symbol Technologies, Llc System for, and method of, detecting the presence of a mobile communication device in proximity to an imaging reader and for automatically configuring the reader to read an electronic code displayed on the device upon such detection
CN105354557B (zh) * 2014-11-03 2019-04-16 苏州思源科安信息技术有限公司 一种生物识别防伪造物活体检测方法
MX2017014648A (es) * 2015-05-15 2018-04-11 Airfusion Inc Aparato portatil y metodo para apoyo de decision para fusion y analisis de datos de sensores multiples automatizados en tiempo real.
CN111242092A (zh) * 2015-07-29 2020-06-05 财团法人工业技术研究院 生物辨识装置与穿戴式载体
CN106570441A (zh) * 2015-10-09 2017-04-19 微软技术许可有限责任公司 用于姿态识别的系统
CN105320943A (zh) * 2015-10-22 2016-02-10 北京天诚盛业科技有限公司 生物识别装置及其进行生物识别的方法
WO2017127994A1 (fr) * 2016-01-25 2017-08-03 Schott Glass Technologies (Suzhou) Co. Ltd. Système de détection optique de paramètres
CN109076147B (zh) * 2016-03-23 2021-03-02 徐鹤菲 支持近红外光与可见光成像的复合成像系统和移动终端
CN105956528A (zh) * 2016-04-22 2016-09-21 沈洪泉 一种用于移动终端虹膜识别的引导指示的人机接口系统
US10819894B2 (en) 2016-04-22 2020-10-27 Suzhou Siyuan Kean Information Technology Co., Ltd Human machine interface system and method of providing guidance and instruction for iris recognition on mobile terminal
CN106372601B (zh) * 2016-08-31 2020-12-22 上海依图信息技术有限公司 一种基于红外可见双目图像的活体检测方法及装置
CN106407964B (zh) * 2016-11-15 2023-11-07 刘霁中 一种利用可见光源采集虹膜的装置、方法及终端设备
US10055637B2 (en) * 2016-12-07 2018-08-21 Synaptics Incorporated Optical sensor with substrate light filter
CN106599668B (zh) * 2016-12-29 2019-11-08 中国科学院长春光学精密机械与物理研究所 一种目标身份识别系统
CN106603569A (zh) * 2017-01-03 2017-04-26 中国科学院上海光学精密机械研究所 多生物特征融合社会保险身份认证系统和身份认证方法
CN108229325A (zh) 2017-03-16 2018-06-29 北京市商汤科技开发有限公司 人脸检测方法和系统、电子设备、程序和介质
CN107223258A (zh) * 2017-03-31 2017-09-29 中控智慧科技股份有限公司 图像采集方法和设备
CN107292285B (zh) * 2017-07-14 2020-01-14 Oppo广东移动通信有限公司 虹膜活体检测方法及相关产品
CN107664631B (zh) * 2017-07-25 2024-02-13 南京农业大学 基于智能手机检测生物标识物的设备、检测方法及其样品的制备
CN107506696A (zh) 2017-07-29 2017-12-22 广东欧珀移动通信有限公司 防伪处理方法及相关产品
CN110909695B (zh) 2017-07-29 2023-08-18 Oppo广东移动通信有限公司 防伪处理方法及相关产品
US11151235B2 (en) 2017-08-01 2021-10-19 Apple Inc. Biometric authentication techniques
WO2019027503A1 (fr) * 2017-08-01 2019-02-07 Apple Inc. Techniques d'authentification biométrique
CN107517340B (zh) * 2017-09-22 2020-11-27 信利光电股份有限公司 一种摄像模组及电子设备
US11410458B2 (en) 2018-04-12 2022-08-09 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Face identification method and apparatus, mobile terminal and storage medium
US10956714B2 (en) 2018-05-18 2021-03-23 Beijing Sensetime Technology Development Co., Ltd Method and apparatus for detecting living body, electronic device, and storage medium
CN109147116A (zh) * 2018-07-25 2019-01-04 深圳市飞瑞斯科技有限公司 智能锁及控制智能锁开启的方法
CN109840514A (zh) * 2019-03-04 2019-06-04 深圳三人行在线科技有限公司 一种活体检测的方法和设备
CN110197161B (zh) * 2019-05-31 2021-05-14 Oppo广东移动通信有限公司 静脉识别方法及相关产品
CN110664405B (zh) * 2019-09-27 2021-12-03 天津大学 基于焦点质量度量估计微波乳房成像平均介电特性的方法
CN111067524B (zh) * 2019-12-26 2021-12-03 天津大学 一种估计微波乳房成像的平均介电特性的方法
CN111692992A (zh) * 2020-06-22 2020-09-22 征图智能科技(江苏)有限公司 基于多图分时曝光的高精度2d尺寸测量方法
WO2022087833A1 (fr) * 2020-10-27 2022-05-05 深圳市汇顶科技股份有限公司 Source de lumière, module photographique et dispositif terminal
CN112818918B (zh) * 2021-02-24 2024-03-26 浙江大华技术股份有限公司 一种活体检测方法、装置、电子设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1892676A (zh) * 2005-06-03 2007-01-10 沈洪泉 面部/虹膜组合光学成像的装置及方法
CN103605954A (zh) * 2013-11-01 2014-02-26 武汉虹识技术有限公司 一种基于单传感器及光谱控制的图像捕捉装置
CN103870819A (zh) * 2014-04-04 2014-06-18 沈洪泉 移动终端安全身份认证的虹膜识别光学成像模组及使用法
CN203733133U (zh) * 2013-02-06 2014-07-23 北京中科虹霸科技有限公司 一种具有人机交互机制的移动终端虹膜识别装置
CN104301633A (zh) * 2014-11-03 2015-01-21 倪蔚民 移动终端可见光和生物识别组合光电成像系统及方法

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU6099100A (en) * 1999-07-14 2001-02-05 Veridicom, Inc. Ultra-rugged i.c. sensor and method of making the same
CN100478979C (zh) * 2002-11-26 2009-04-15 中国科学院计算技术研究所 利用身材信息辅助人脸信息的身份识别方法
CN1330275C (zh) * 2003-12-07 2007-08-08 倪蔚民 基于虹膜纹理分析的生物测定方法
CN100349542C (zh) * 2004-05-29 2007-11-21 倪蔚民 实时自动无侵害的虹膜光学成像装置
CN1779694A (zh) * 2004-11-26 2006-05-31 上海银晨智能识别科技有限公司 基于红外成像的图像识别装置
JP2007318233A (ja) * 2006-05-23 2007-12-06 Nikon Corp 撮像装置、および画像処理プログラム
CN101411606B (zh) * 2007-10-15 2010-09-08 倪蔚民 组合虹膜和皮层组织的生物测定系统
CN101369311B (zh) * 2008-09-26 2011-08-03 北京中科虹霸科技有限公司 一种采用主动视觉反馈的小型化虹膜识别模块
US8164682B2 (en) * 2008-10-14 2012-04-24 Omnivision Technologies, Inc. Dithered focus evaluation
US8364971B2 (en) * 2009-02-26 2013-01-29 Kynen Llc User authentication system and method
US8340456B1 (en) * 2011-10-13 2012-12-25 General Electric Company System and method for depth from defocus imaging
CN102622589A (zh) * 2012-03-13 2012-08-01 辉路科技（北京）有限公司 一种基于gpu的多光谱人脸检测方法
CN103324908A (zh) * 2012-03-23 2013-09-25 桂林电子科技大学 用于虹膜识别的快速虹膜采集判断控制方法
JP2014078052A (ja) * 2012-10-09 2014-05-01 Sony Corp 認証装置および方法、並びにプログラム
CN103136421B (zh) * 2013-01-31 2015-08-26 贵阳科安科技有限公司 用于虹膜成像装置的系统级光电优化设计方法
CN103106401B (zh) * 2013-02-06 2017-02-22 北京中科虹霸科技有限公司 一种具有人机交互机制的移动终端虹膜识别装置
CN103310235B (zh) * 2013-05-31 2016-04-27 中国科学院信息工程研究所 一种基于参数识别与估计的隐写分析方法
CN103945136B (zh) * 2014-04-04 2017-03-08 苏州思源科安信息技术有限公司 高用户使用体验度的虹膜图像光电成像系统
CN103955717A (zh) * 2014-05-13 2014-07-30 第三眼（天津）生物识别科技有限公司 一种虹膜活性检测的方法
CN203896434U (zh) * 2014-06-17 2014-10-22 深圳市天城威视科技有限公司 智能双色灯摄像机

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1892676A (zh) * 2005-06-03 2007-01-10 沈洪泉 面部/虹膜组合光学成像的装置及方法
CN203733133U (zh) * 2013-02-06 2014-07-23 北京中科虹霸科技有限公司 一种具有人机交互机制的移动终端虹膜识别装置
CN103605954A (zh) * 2013-11-01 2014-02-26 武汉虹识技术有限公司 一种基于单传感器及光谱控制的图像捕捉装置
CN103870819A (zh) * 2014-04-04 2014-06-18 沈洪泉 移动终端安全身份认证的虹膜识别光学成像模组及使用法
CN104301633A (zh) * 2014-11-03 2015-01-21 倪蔚民 移动终端可见光和生物识别组合光电成像系统及方法

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11045088B2 (en) 2015-02-27 2021-06-29 Welch Allyn, Inc. Through focus retinal image capturing
US11819272B2 (en) 2015-11-02 2023-11-21 Welch Allyn, Inc. Retinal image capturing
EP3654826A4 (fr) * 2017-07-17 2021-03-24 Welch Allyn, Inc. Capture d'image rétinienne à foyer traversant
US11096574B2 (en) 2018-05-24 2021-08-24 Welch Allyn, Inc. Retinal image capturing
US11779209B2 (en) 2018-05-24 2023-10-10 Welch Allyn, Inc. Retinal image capturing

Also Published As

Publication number Publication date
CN105376469B (zh) 2018-11-13
CN104301633B (zh) 2016-01-20
CN104301633A (zh) 2015-01-21
CN105357426A (zh) 2016-02-24
CN105354557B (zh) 2019-04-16
CN105357426B (zh) 2019-01-15
CN105426848A (zh) 2016-03-23
CN105426848B (zh) 2020-12-18
CN105354557A (zh) 2016-02-24
CN105376469A (zh) 2016-03-02

Similar Documents

Publication Publication Date Title
WO2016070781A1 (fr) Système et procédé d'imagerie optoélectronique à combinaison de lumière visible et d'identification biométrique de terminal mobile
WO2016058527A1 (fr) Procédé de détection de corps vivant anti-falsification d'iris par imagerie rgb-ir
US10579871B2 (en) Biometric composite imaging system and method reusable with visible light
CN106716451B (zh) 虹膜识别装置及其制造方法和应用
EP3001867B1 (fr) Smartphone configuré pour la reconnaissance biométrique de motif d'iris et des caractéristiques faciaux associées d'un sujet
US10152631B2 (en) Optical system for an image acquisition device
WO2014205021A1 (fr) Acquisition d'images à mode multiple pour l'imagerie de l'iris
WO2016019882A1 (fr) Dispositif de formation d'image de reconnaissance de veine et procédé d'authentification sécurisée de terminal mobile
CN106993117A (zh) 一种智能移动设备的附加镜头和光照调整系统
KR101608316B1 (ko) 실외 및 실내에서의 홍채이미지 획득장치 및 방법
CN103632135B (zh) 一种基于双图像传感器的虹膜图像捕捉装置
CN105445903B (zh) 成像镜头、虹膜成像模组以及虹膜识别装置
KR200367917Y1 (ko) 광학적 안정성을 갖는 홍채 인식용 카메라 모듈
CN103605954A (zh) 一种基于单传感器及光谱控制的图像捕捉装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15857332

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15857332

Country of ref document: EP

Kind code of ref document: A1