WO2017161520A1 - Système d'imagerie composite et terminal mobile prenant en charge une imagerie par lumière visible et lumière proche infrarouge - Google Patents

Système d'imagerie composite et terminal mobile prenant en charge une imagerie par lumière visible et lumière proche infrarouge Download PDF

Info

Publication number
WO2017161520A1
WO2017161520A1 PCT/CN2016/077101 CN2016077101W WO2017161520A1 WO 2017161520 A1 WO2017161520 A1 WO 2017161520A1 CN 2016077101 W CN2016077101 W CN 2016077101W WO 2017161520 A1 WO2017161520 A1 WO 2017161520A1
Authority
WO
WIPO (PCT)
Prior art keywords
infrared light
imaging
infrared
visible light
image sensor
Prior art date
Application number
PCT/CN2016/077101
Other languages
English (en)
Chinese (zh)
Inventor
徐鹤菲
Original Assignee
徐鹤菲
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 徐鹤菲 filed Critical 徐鹤菲
Priority to CN201680085013.0A priority Critical patent/CN109076147B/zh
Priority to PCT/CN2016/077101 priority patent/WO2017161520A1/fr
Publication of WO2017161520A1 publication Critical patent/WO2017161520A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/20—Filters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/20—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
    • H04N23/21—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only from near infrared [NIR] radiation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems

Definitions

  • the present invention relates to the field of image processing, biometrics, and optical imaging technologies, and more particularly to a composite imaging system that supports a visible light imaging mode and a near infrared light imaging mode.
  • the mobile terminal is used as a means of identity confirmation mainly relying on passwords and cards, and has problems such as difficulty in memory, easy to be stolen, and low security.
  • iris recognition has the highest security and accuracy, and has the advantages of being unique, not requiring memory, being able to be stolen, and having a high level of security.
  • an iris recognition function is added to a mobile terminal (such as a mobile phone), and a near-infrared camera module needs to be added to the front of the mobile phone, and the front visible light camera module for self-photographing is independent. That is, the front panel of the mobile phone needs to open two holes, one for self-timer and one for iris imaging, which is complicated in industrial design and has an unattractive appearance.
  • the iris imaging design implemented by the near-infrared camera module generally uses near-infrared light imaging of the 760 nm-880 nm spectrum band. This requires an additional near-infrared source (between 760 nm and 880 nm) for fill-light illumination, and the near-infrared camera module needs to be able to receive this infrared band of energy.
  • the iris recognition on the mobile phone is mainly used for the user's own identity recognition, and the user experience generally needs to be used in advance.
  • the existing front-mounted self-photographing head of the mobile phone cannot accept the infrared light source or receive a large attenuation due to the coating filtration itself. Therefore, the prior art iris recognition requires a separate near-infrared camera for imaging the iris, and cannot be multiplexed with the existing visible light imaging (spectral frequency of 380-760 nm) camera (such as the existing front color camera of the smartphone). ).
  • the existing visible light imaging spectral frequency of 380-760 nm
  • the use of a single camera in near-infrared and visible-light dual-band imaging mainly has the following implementation methods: adding a mechanical switchable near-infrared optical filter (see CN203838720U) in the imaging system, using dual-band infrared and visible light A transmission spectrum filter (see U.S. Patent No. 8,408,821, Chinese Patent Publication No. CN104394306A), and an image sensor using both visible and near-infrared light detecting pixels (see U.S. Patent No. 7,915, 562, Chinese Patent Publication No. CN104284179A).
  • a mechanical switchable near-infrared optical filter see CN203838720U
  • dual-band infrared and visible light A transmission spectrum filter see U.S. Patent No. 8,408,821, Chinese Patent Publication No. CN104394306A
  • an image sensor using both visible and near-infrared light detecting pixels see U.S. Patent No. 7,915, 562, Chinese Patent Publication No. CN104
  • the mechanically switchable near-infrared light filter is difficult to be widely used in mobile devices due to its relatively large volume.
  • the use of filters with infrared and visible light-band transmission spectra causes the visible portion and the near-infrared portion to interfere with each other, thereby affecting the quality of the photograph and the accuracy of the recognition.
  • US7915652 only involves the image sensor design of dual-spectrum imaging, but does not provide the entire imaging system design; the sub-region multi-spectral filter used in CN104284179A is the color filter matrix attached to the surface of the image sensor (Color) Filter Array) instead of a separate optical filter.
  • the present invention provides a design of a biometric composite imaging system that achieves multiplexing of near-infrared light and visible light imaging functions by using a fixed focal length lens assembly, a filter assembly, and an image sensor, and a mobile terminal design including the composite imaging system. Therefore, the visible light imaging function of the front-end self-timer of the mobile terminal can be satisfied, and the biometric function of the near-infrared light imaging can be satisfied.
  • FIG. 1 is a schematic illustration of a composite imaging system 100 for biometrics in accordance with the present invention
  • FIG. 2 is a schematic diagram showing the depth of field of the visible light and near-infrared light of the lens assembly 130;
  • Figure 3 is a schematic illustration of a composite imaging system with a near infrared source in accordance with the present invention
  • FIG. 4 is a schematic diagram showing the internal structure of an image sensor according to an embodiment of the present invention.
  • FIGS. 5A to 5D illustrate an embodiment of a mobile terminal including a composite imaging system, in which FIGS. 5A and 5B illustrate a structural configuration of the mobile terminal, and FIGS. 5C and 5D illustrate the mobile terminal in use.
  • User experience map FIGS. 5A and 5B illustrate a structural configuration of the mobile terminal, and FIGS. 5C and 5D illustrate the mobile terminal in use.
  • FIGS. 6A to 6D illustrate another embodiment of a mobile terminal including a composite imaging system, in which FIGS. 6A and 6B illustrate a structural configuration of the mobile terminal, and FIGS. 6C and 6D illustrate the mobile terminal in use User experience graph.
  • the composite imaging system 100 includes an image sensor 110, a filter assembly 120, and a lens assembly 130.
  • the filter assembly 120 includes a visible light band pass filter 121 and a near infrared light band pass filter 122 (shown as being filled with a backslash)
  • the image sensor 110 includes an area for near infrared light imaging.
  • A shown in the figure as filled with backslashes
  • region B for visible light imaging
  • transition region C between A and B regions shown as filled with horizontal lines).
  • the lens assembly 130, the filter assembly 120, and the image sensor 110 are sequentially disposed along the incident light path. It should be noted that between the three components shown in Figure 1. The distance is only exemplary.
  • the full spectrum of light is incident through the lens assembly 130 and reaches the filter assembly 120, wherein the visible bandpass filter 121 allows visible light (eg, wavelengths of 380-760 nm) to pass, while the near infrared bandpass filter 122 allows near Infrared light (for example, having a wavelength of 780-880 nm) passes.
  • the visible light band pass filter 121 and the near infrared light band pass filter 122 can be realized by plating.
  • the visible light passing through the visible light band pass filter 121 is substantially imaged in the area B of the image sensor, while the near infrared light passing through the near infrared light band pass filter 122 is substantially imaged in the area A of the image sensor.
  • the imaging of the regions B and A of the image sensor can be separately distinguished by image processing software, wherein the imaging of the region B corresponds to normal visible light imaging, for example, the user performs imaging during daily self-timer using a mobile terminal such as a mobile phone, and the area A
  • the imaging corresponds to imaging in the near-infrared mode, such as imaging when the user uses the mobile phone for iris recognition. In this way, switching between visible light and near-infrared light imaging can be conveniently performed without the need to equip moving parts to switch the filter, which greatly improves stability.
  • the area of the filter assembly 120 is larger than the area of the image sensor 110.
  • the filter assembly 120 can be a separate component from the image sensor 110 or can be packaged over the surface of the wafer of image sensors by a packaging process.
  • the near-infrared light passing through the near-infrared bandpass filter 122 and the visible light passing through the visible bandpass filter 121 may overlap at the transition region C of the image sensor.
  • the filter assembly 120 should be close to the image sensor 110, for example, less than 2 mm, in which the wide-angle diffusion propagation of light is small and can even be ignored. Even if the image sensor 110 has a transition region C, its area is limited and mainly affects visible light imaging.
  • the pixel region corresponding to the transition region C can be removed from the visible light image by the image processing software to obtain acceptable visible light imaging.
  • FIG. 2 is a schematic diagram of the depth of field of the lens assembly 130 for clear imaging of visible light and near-infrared light.
  • the lens assembly 130 has a certain field of view and receives light from the full spectrum.
  • Lens assembly 130 uses a fixed focal length of optical transmission Mirror, the depth of field range d1 of the optical lens for clear imaging of the visible spectrum is overlapped with the depth range d2 of the optical lens for clear imaging of the near-infrared spectrum, so that the system can obtain clear images in both visible and near-infrared bands. ,as shown in picture 2.
  • an achromatic optical lens in which visible light and near-infrared light are confocal may be used.
  • FIG. 3 is a schematic diagram of a composite imaging system with a near-infrared light source in accordance with the present invention, in addition to the schematic positional relationship of image sensor 110, filter assembly 120, and lens assembly 130 of FIG. 1A, further A near infrared source 150 is shown.
  • biometric imaging such as iris
  • iris information is easily interfered by visible light from the outside environment, for example, visible light reflection spots formed by window reflections on the surface of the eye or reflections of various environmental lights by users wearing glasses. Reflective bright spots can block the iris, which in turn affects recognition rate and user experience.
  • the near-infrared source 150 can include one or more infrared LEDs having a central spectral range, such as within 780-880 nm, for near-infrared illumination of the biometric features to enhance biometric imaging.
  • the near-infrared source 150 can be independent of the composite imaging system 100, as shown in Figure 3, or as part of a composite imaging system.
  • the near-infrared source 150 has a specific emission tilt angle when installed, and only needs to be illuminated in the near-infrared band of the biometric features within the specific imaging space range ⁇ shown in FIG. 3, without having to be within the entire imaging space range ⁇ . The object is illuminated.
  • the exiting main optical axis of the near-infrared source 150 is not parallel to the central optical axis of the imaging system to avoid "brightness" effects when imaging biometric features (eg, iris), affecting the performance of the biometric system.
  • the launch tilt of the near-infrared source can be flexibly adjusted based on different object distances and relative placement of the composite imaging system 100. Generally, the range of the launch tilt is set between 0 and 45 degrees, and as the object distance increases, the tilt angle can be correspondingly reduced.
  • FIG. 4 is a schematic diagram showing the internal structure of an image sensor according to an embodiment of the present invention.
  • the image sensor 110 is a complete image sensor pixel combination array that transmits digital image pixel data collected by the image sensor to a backend encryption chip or processor through a data transmission interface (such as a MIPI interface).
  • a data transmission interface such as a MIPI interface.
  • the image sensor 110 in the composite imaging system 100 of the present invention can use an image sensor of a large number of pixels, with the accuracy and minimum resolution requirements of the number of pixels.
  • the outer diameter of the monocular iris in the image needs to be 120 pixels. If the iris can be recognized by a lens with a horizontal FOV of 60 degrees at a normal use distance (30 CM), the image sensor needs to have at least 3773 pixels in the horizontal direction, and 2120 pixels in the vertical direction according to the image aspect ratio of 16:9. The pixel, that is, the total number of pixels is 8M.
  • CMOS image sensor having a pixel number of 8 M or more, for example, a 13 M pixel CMOS image sensor (4680 (W) x 3456 (H)).
  • the color filter 114 does not cover the entire silicon base 116 of the image sensor, but covers the visible light imaging region therein, that is, only the visible light region B of the image sensor has a color filter. 114, then the microlens 112 is attached to the color filter 114; while in the near infrared light imaging area A, the color filter is removed, and the microlens 112 is directly attached to the silicon base of the image sensor.
  • the color filter removal design enhances the corresponding spectral sensitivity of the corresponding image sensor area A for the near-infrared spectral range, and enhances the absorption of light energy in the near-infrared band of 760-880 nm, thereby optimizing the enhancement of the area for iris imaging. Image effect.
  • the infrared LED light source with smaller energy can also maintain the strong near-infrared spectral energy reception, and can image the richer iris details, thereby reducing the power consumption requirement of the system for the active illumination source, and realizing the Low power consumption design for near-infrared biometric imaging of mobile terminal devices.
  • the area of the transition region C of the image sensor 110 is small, and the transition region C is omitted in FIG. 4 for the sake of simplicity of description.
  • the color filter corresponding to the transition region C can be retained or removed as needed.
  • the composite imaging system of the embodiment of the present invention innovatively employs a dual-band filter design, and can further employ an improved image sensor for sub-area imaging, wherein The visible light imaging area has a color filter and the color filter is removed on the near infrared light imaging area.
  • the image sensor can output pixel data corresponding to the visible light and near-infrared light bands in different regions, so that it can be conveniently switched between the visible light imaging mode and the near-infrared light imaging mode, for example, the user can click on the mobile terminal touch screen.
  • the button or physical button displayed on the screen switches the imaging mode.
  • the visible light imaging mode (such as daily self-timer) only the imaging of the visible light imaging region of the image sensor can be output, and the imaging of the transition region of the image sensor can be further removed by the image processing software, and the acquired image is not subject to near-infrared light. The effect is reddish.
  • the image sensor In the near-infrared light imaging mode for biometric recognition, the image sensor can output only the imaging of the near-infrared light imaging region, and the acquired biometric image is not affected by visible light of various complex environments to generate environmental noise.
  • the present invention does not require physical positional switching of the filter, but can realize switching and multiplexing of the visible light and near-infrared light imaging modes only by software, and does not require movement for the filter.
  • the component is capable of enhancing the stability of the system and structure in the falling environment of the mobile terminal.
  • the software control image signal processor ISP selects the corresponding visible light imaging region to work, and invokes the corresponding visible light imaging ISP parameter setting to optimize the effect of visible light imaging. If in the near-infrared light imaging mode, the ISP selects the corresponding near-infrared light imaging area to work, and the corresponding ISP parameter setting of the near-infrared light imaging is called to optimize the effect of the near-infrared light imaging.
  • the software control image signal processor ISP selects the corresponding visible light imaging region to work, and invokes the corresponding visible light imaging ISP parameter setting to optimize the effect of visible light imaging.
  • the ISP selects the corresponding near-infrared light imaging area to work, and the corresponding ISP parameter setting of the near-infrared light imaging is called to optimize the effect of the near-infrared light imaging.
  • the ISP selects the corresponding near-infrared light imaging area to work, and the corresponding ISP parameter setting of the near-infrared light imaging is called to
  • the composite imaging system may further include an image encryption unit to provide a function of encrypting the acquired biometric image.
  • the image encryption unit may be implemented by a processor (not shown) or included in the processor or included in an image sensor or a composite imaging system in a separate modular unit. In the group. After the composite imaging system enters the near-infrared light imaging mode and acquires the infrared image, the image encryption unit activates the image encryption function, encrypts the obtained biometric image, and outputs the encrypted data for further processing. When the composite imaging system enters the visible light imaging mode, the image encryption unit does not activate, and the obtained visible light image is not encrypted, so that the image sensor directly outputs the obtained visible light image.
  • 5A-5D illustrate one embodiment of a mobile terminal 100 that includes a composite imaging system of the present invention.
  • 5A and 5B show the structural configuration of the mobile terminal 100
  • FIGS. 5C and 5D respectively show user experience diagrams when the mobile terminal is used in the iris recognition mode and the self-photographing mode, respectively.
  • the mobile terminal 100 includes a composite imaging system 100, a near-infrared light source 150, and a screen implemented as a camera module.
  • the near-infrared source 150 can include one or more infrared LEDs in the 780-880 nm band.
  • the composite imaging system 100 is disposed on one side of the front side of the screen of the mobile terminal, such as the top of the screen or the bottom of the screen, which is the top in FIG. 5A.
  • the near-infrared light source 150 and the composite imaging system 100 are arranged on the same side of the front side of the screen of the mobile terminal, which are shown in the figure as being arranged on the top of the front side of the screen, that is, in the N direction of the screen, wherein the near infrared
  • the horizontal distance of the location of the light source 150 from the center of the composite imaging system 100 is in the range of 2-8 cm, which facilitates the elimination of reflected spots when worn by the user of the glasses.
  • the near-infrared light source 150 is placed under the touch panel of the mobile terminal.
  • the near-infrared light source 150 can be placed on the bottom layer of the front button of the mobile terminal (below the thickness direction of the mobile terminal), such as the Home button.
  • the bottom layer so that it is not necessary to specifically open holes in other locations to cause a visual appearance.
  • the surface of the touch panel of the near-infrared light source can be coated with an infrared anti-reflection film, which is consistent with the overall color of the front surface of the mobile terminal, and the color of the coating can be silver white, gold or black.
  • the composite imaging system 100 is in the N direction of the screen, i.e., above the length of the mobile end, and the screen is in the S direction of the composite imaging system 100.
  • the filter assembly 120 and the image sensor 110 are configured as shown in FIG. 5B: the visible band pass filter 121 is placed above the near-infrared bandpass filter 122 (ie, In the N direction), the visible light imaging region B of the corresponding image sensor is placed above the near-infrared light imaging region A (N direction).
  • the transition region C is located between the visible light imaging region and the near infrared light imaging region.
  • the area of the visible light imaging area is greater than 50% of the area of the image sensor, and the area of the near infrared light imaging area is less than 50% of the area of the image sensor, and the transition area C is located in the visible light imaging area and the near infrared light imaging area.
  • the area between them is less than 15% of the area of the image sensor.
  • it may be preferably designed such that the visible light imaging region height is 80% of the height of the entire image sensor, and the near-infrared light imaging region height is 20% of the height of the entire image sensor.
  • an eye image preview window 160 can be provided in the screen.
  • the eye image preview window 160 only outputs an image of the corresponding near-infrared light imaging region (ie, biometric imaging) for guiding the user to cooperate to acquire the biometric image.
  • the position of the eye image preview window 160 may be placed on the upper or lower side of the screen on the screen of the mobile terminal.
  • the eye image preview window 160 is located on the upper side of the screen, that is, near the side of the composite imaging system 100, which facilitates the user's eyes when in use.
  • the direction of the composite imaging system 100 is gaze, thereby reducing the occlusion of the iris texture features on the eyelids and eyelashes of the human eye, so as to obtain a better and richer iris image, which is advantageous for recognition.
  • the user can tilt the upper portion of the mobile terminal (ie, the side including the composite imaging system 100) toward the user side as shown in FIG. 5C, so that the user's eyes are gazing at the eye image preview window 160.
  • An image can be output in the eye image preview window 160 so that a biometric image (eg, an iris image) can be acquired for subsequent pre-processing or encryption recognition processes.
  • composite imaging system 100 captures visible and near-infrared light from biometrics.
  • near-infrared light from biometrics enters the interior of the mobile terminal through the composite imaging system 100, and passes through the near-infrared (S) near-infrared bandpass filter 122 to the image sensor.
  • the direction of emission of the infrared source 150 can be appropriately tilted toward the system 100 or the upper portion of the screen of the mobile terminal by a certain angle, as shown in FIG. 5C.
  • the divergence angle of the near-infrared light source 150 can be flexibly adjusted according to different object distances and the placement positions of different systems.
  • the visible light imaging mode such as the user's daily self-timer, as shown in FIG. 5D
  • the upper portion of the mobile terminal does not need to be tilted toward the user side as in FIG. 5C, and the near-infrared light source 150 does not operate. The user looks at the middle of the screen.
  • the light of the self-timer region of interest mainly passes through the visible (N) visible light bandpass filter 121 and reaches the upper (N) visible light imaging region of the image sensor. , get a self-portrait image.
  • FIGS. 6A-6D illustrate another embodiment of a mobile terminal 100 that includes a composite imaging system of the present invention.
  • 6A and 6B show the structural configuration of the mobile terminal 100
  • FIGS. 6C and 6D respectively show user experience diagrams when the mobile terminal is used in the iris recognition mode and the self-photographing mode, respectively.
  • the near-infrared source 150 is located in the lower portion of the screen (i.e., the S-direction)
  • the composite imaging system 100 is located in the upper portion of the screen (i.e., the N-direction).
  • the filter assembly 120 and the image sensor 110 are configured as shown in FIG.
  • the visible band pass filter 121 is placed below the near-infrared bandpass filter 122 (S); and the visible light image of the image sensor
  • the area B is placed below the near-infrared light imaging area A (S)
  • the transition area C is located between the visible light imaging area B and the near-infrared light imaging area A.
  • the mobile terminal when used, when the mobile terminal enters the near-infrared light imaging mode to perform near-infrared light imaging of the biometric feature (eg, into the iris recognition mode), it may be provided in an area above the screen.
  • the eye image preview window 160 is used to guide the user to cooperate to collect the biometric image. This is advantageous for the user's eyes to naturally look at the direction of the composite imaging system 100, thereby reducing the occlusion of the iris texture features on the eyelids and eyelashes of the human eye, so as to obtain a better and richer iris image, which is advantageous for recognition.
  • the user can tilt the upper portion of the mobile terminal (ie, the side including the composite imaging system 100) toward the direction away from the user side as shown in FIG. 6C, so that the user pans through the image while looking at the eye image preview window 160.
  • a unit (not shown) performs translation control to ensure that the preview image in the eye image preview window 160 is a preview of the near-infrared light imaging area of the image sensor,
  • An image of the user's eyes can be outputted in the eye image preview window 160 so that a biometric image (eg, an iris image) can be acquired for subsequent pre-processing or encryption recognition processes.
  • the near-infrared light source 150 is placed under the mobile terminal such that the biometric features (e.g., the iris) can be more fully illuminated when the upper portion of the mobile terminal is tilted away from the user.
  • the emission direction of the near-infrared light source 150 may be inclined at a certain angle toward the upper direction of the system 100 or the screen of the mobile terminal.
  • the tilt angle of the near-infrared light source 150 can be flexibly adjusted according to different object distances and placement positions of different systems.
  • the visible light imaging mode such as the user's daily self-timer, as shown in FIG. 6D
  • the upper portion of the mobile terminal can be tilted toward the user side, and the near-infrared light source 150 does not operate.
  • an auxiliary near-infrared light source (not shown) may be incorporated in the displayed screen in front of the mobile terminal.
  • the auxiliary near-infrared light source can assist the near-infrared light illumination of the biometric feature, thereby saving power of the near-infrared light source disposed on the mobile terminal.
  • the iris of the human eye can be illuminated by the infrared screen portion of the screen that is illuminated by the control of the software, and the screen can be illuminated with the OLED light source in the normal mode.
  • the single camera module works in visible light and near-infrared light imaging mode, which simplifies the hardware design, has no moving parts to switch the filter, greatly improves the stability, and realizes the visible light and near-infrared light imaging mode by software. Switch between.
  • Sub-regional near-infrared light imaging requires only a portion of the image sensor to receive illumination from the near-infrared source, rather than the entire image sensor, thereby reducing the total power consumption of the image sensor for the infrared illumination source, ie, using less energy and Smaller emission angle of infrared
  • the LED light source can also maintain sufficient absorption of near-infrared spectral energy in the infrared region to obtain a biometric image rich in texture details.
  • the composite imaging system of the present invention can encrypt the acquired biometric image to ensure the security of the user's personal sensitive information.
  • the present invention takes iris recognition as an example to illustrate the imaging function multiplexing composite imaging system of the present invention.
  • aspects of the present invention are not limited to the recognition of the iris of the human eye, but can also be applied to other biological features that can be used for identification, such as whitening, fingerprints, retina, nose, face (two-dimensional or three-dimensional), Eye lines, lip lines and veins.
  • A8 The composite imaging system of A1, wherein the area of the filter assembly is greater than the area of the image sensor.
  • A9. The composite imaging system of A1, wherein the image sensor has an image resolution greater than 2400 pixels in the horizontal direction of both eyes of the human eye.
  • A10. The composite imaging system of A1, wherein the image sensor comprises a color filter, wherein the color filter covers only the visible light imaging region of the image sensor.
  • A11. The composite imaging system of A1, wherein the filter assembly is less than 2 mm from the image sensor.
  • B15 The mobile terminal of B14, further comprising an image shifting unit for performing panning control of the eye image in the near infrared imaging mode to ensure that the preview image in the eye image preview window is near infrared light of the image sensor A preview of the imaging area imaging.
  • B16. The mobile terminal of B12, wherein the near-infrared light source is placed under the button on the front side of the mobile terminal.
  • B17. The mobile terminal of B16, wherein the surface of the aperture portion of the near-infrared light source is plated with an infrared anti-reflection film that allows transmission of a light source in the near-infrared band.
  • the mobile terminal of B16 wherein the color of the infrared anti-reflection film is consistent with the color of the front surface of the mobile terminal.
  • B19. The mobile terminal of B12, wherein the screen comprises an auxiliary near-infrared light source, and the auxiliary near-infrared light source of the screen assists the near-infrared light illumination of the biometric feature when in the near-infrared light imaging mode.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Health & Medical Sciences (AREA)
  • Toxicology (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Image Input (AREA)
  • Studio Devices (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

L'invention concerne un système d'imagerie composite (100) prenant en charge un mode d'imagerie par lumière visible et un mode d'imagerie par lumière proche infrarouge, comprenant un ensemble lentille (130), un ensemble filtre de lumière (130) et un capteur d'image (110) disposés le long du trajet de lumière incidente. L'ensemble lentille comprend une lentille optique à longueur focale fixe. L'ensemble filtre de lumière comprend un filtre passe-bande de lumière visible (121), qui permet à la lumière d'une bande d'onde de lumière visible de passer à travers ce dernier, et un filtre passe-bande de lumière proche infrarouge (122) qui permet à une bande d'onde de lumière proche infrarouge de passer à travers ce dernier. Le capteur d'image comprend une région d'imagerie par lumière visible (B), une région d'imagerie par lumière proche infrarouge (A), et une région de transition (C) entre les deux régions précédentes. Le capteur d'image fonctionne en mode d'imagerie par lumière visible et/ou en mode d'imagerie par lumière proche infrarouge ; en mode d'imagerie par lumière visible, la région d'imagerie par lumière visible image la lumière visible passant à travers le filtre passe-bande de lumière visible ; en mode d'imagerie par lumière proche infrarouge, la région d'imagerie par lumière proche infrarouge image la lumière proche infrarouge passant à travers le filtre passe-bande de lumière proche infrarouge. L'invention concerne également un terminal mobile.
PCT/CN2016/077101 2016-03-23 2016-03-23 Système d'imagerie composite et terminal mobile prenant en charge une imagerie par lumière visible et lumière proche infrarouge WO2017161520A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201680085013.0A CN109076147B (zh) 2016-03-23 2016-03-23 支持近红外光与可见光成像的复合成像系统和移动终端
PCT/CN2016/077101 WO2017161520A1 (fr) 2016-03-23 2016-03-23 Système d'imagerie composite et terminal mobile prenant en charge une imagerie par lumière visible et lumière proche infrarouge

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/077101 WO2017161520A1 (fr) 2016-03-23 2016-03-23 Système d'imagerie composite et terminal mobile prenant en charge une imagerie par lumière visible et lumière proche infrarouge

Publications (1)

Publication Number Publication Date
WO2017161520A1 true WO2017161520A1 (fr) 2017-09-28

Family

ID=59899878

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/077101 WO2017161520A1 (fr) 2016-03-23 2016-03-23 Système d'imagerie composite et terminal mobile prenant en charge une imagerie par lumière visible et lumière proche infrarouge

Country Status (2)

Country Link
CN (1) CN109076147B (fr)
WO (1) WO2017161520A1 (fr)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108685563A (zh) * 2018-06-20 2018-10-23 河北大学 手机套件、多功能手机及基于手机的近红外成像方法
CN110175493A (zh) * 2018-07-13 2019-08-27 神盾股份有限公司 光学指纹感测装置
CN110798602A (zh) * 2019-11-29 2020-02-14 维沃移动通信有限公司 摄像模组、电子设备、拍摄控制方法及装置
CN110868574A (zh) * 2019-12-17 2020-03-06 深圳市摩西尔工业检测设备有限公司 高色度还原的照相设备及还原方法
CN112135004A (zh) * 2019-06-25 2020-12-25 株式会社理光 图像处理装置、图像形成装置及图像处理方法
CN112135003A (zh) * 2019-06-25 2020-12-25 株式会社理光 图像处理装置、图像形成装置及图像处理方法
CN112902945A (zh) * 2019-11-19 2021-06-04 珠海市一微半导体有限公司 一种运用于室内导航的移动机器人
US11076080B2 (en) 2019-12-05 2021-07-27 Synaptics Incorporated Under-display image sensor for eye tracking
CN113225485A (zh) * 2021-03-19 2021-08-06 浙江大华技术股份有限公司 图像采集组件、融合方法、电子设备及存储介质
US11153513B2 (en) 2019-08-19 2021-10-19 Synaptics Incorporated Light source for camera
US11516374B2 (en) 2019-06-05 2022-11-29 Synaptics Incorporated Under-display image sensor

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI729813B (zh) * 2020-05-18 2021-06-01 友達光電股份有限公司 血管成像系統

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010026400A1 (en) * 2000-03-28 2001-10-04 Fuji Photo Optical Co., Ltd. Dual-use visible-light/infrared image pickup device
CN202794585U (zh) * 2012-08-30 2013-03-13 广州中国科学院先进技术研究所 一种多通道集成滤光片
CN104301633A (zh) * 2014-11-03 2015-01-21 倪蔚民 移动终端可见光和生物识别组合光电成像系统及方法
CN104394306A (zh) * 2014-11-24 2015-03-04 北京中科虹霸科技有限公司 用于虹膜识别的多通道多区域镀膜的摄像头模组及设备
CN105338227A (zh) * 2014-08-06 2016-02-17 南昌欧菲光电技术有限公司 成像模组及移动终端

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102004001556A1 (de) * 2004-01-10 2005-08-04 Robert Bosch Gmbh Nachtsichtsystem für Kraftfahrzeuge mit partiellem optischem Filter
JP2011237638A (ja) * 2010-05-11 2011-11-24 Fujifilm Corp 撮影装置
CN102510450A (zh) * 2011-10-17 2012-06-20 北京瑞澜联合通信技术有限公司 图像传感器、摄像装置及图像数据生成方法
CN103152517B (zh) * 2013-02-06 2018-06-22 北京中科虹霸科技有限公司 用于移动虹膜识别设备的成像模组及移动设备
WO2014205020A1 (fr) * 2013-06-18 2014-12-24 Delta ID Inc. Appareil d'imagerie optimisé pour imagerie de l'iris
CN103870805B (zh) * 2014-02-17 2017-08-15 北京释码大华科技有限公司 一种移动终端生物特征成像方法和装置
CN103870819B (zh) * 2014-04-04 2016-03-09 苏州思源科安信息技术有限公司 移动终端安全身份认证的虹膜识别光学成像模组及使用法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010026400A1 (en) * 2000-03-28 2001-10-04 Fuji Photo Optical Co., Ltd. Dual-use visible-light/infrared image pickup device
CN202794585U (zh) * 2012-08-30 2013-03-13 广州中国科学院先进技术研究所 一种多通道集成滤光片
CN105338227A (zh) * 2014-08-06 2016-02-17 南昌欧菲光电技术有限公司 成像模组及移动终端
CN104301633A (zh) * 2014-11-03 2015-01-21 倪蔚民 移动终端可见光和生物识别组合光电成像系统及方法
CN104394306A (zh) * 2014-11-24 2015-03-04 北京中科虹霸科技有限公司 用于虹膜识别的多通道多区域镀膜的摄像头模组及设备

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108685563A (zh) * 2018-06-20 2018-10-23 河北大学 手机套件、多功能手机及基于手机的近红外成像方法
CN110175493A (zh) * 2018-07-13 2019-08-27 神盾股份有限公司 光学指纹感测装置
CN110175493B (zh) * 2018-07-13 2021-04-16 神盾股份有限公司 光学指纹感测模块
US11516374B2 (en) 2019-06-05 2022-11-29 Synaptics Incorporated Under-display image sensor
CN112135004A (zh) * 2019-06-25 2020-12-25 株式会社理光 图像处理装置、图像形成装置及图像处理方法
CN112135003A (zh) * 2019-06-25 2020-12-25 株式会社理光 图像处理装置、图像形成装置及图像处理方法
US11153513B2 (en) 2019-08-19 2021-10-19 Synaptics Incorporated Light source for camera
CN112902945A (zh) * 2019-11-19 2021-06-04 珠海市一微半导体有限公司 一种运用于室内导航的移动机器人
CN110798602A (zh) * 2019-11-29 2020-02-14 维沃移动通信有限公司 摄像模组、电子设备、拍摄控制方法及装置
US11076080B2 (en) 2019-12-05 2021-07-27 Synaptics Incorporated Under-display image sensor for eye tracking
CN110868574A (zh) * 2019-12-17 2020-03-06 深圳市摩西尔工业检测设备有限公司 高色度还原的照相设备及还原方法
CN113225485A (zh) * 2021-03-19 2021-08-06 浙江大华技术股份有限公司 图像采集组件、融合方法、电子设备及存储介质

Also Published As

Publication number Publication date
CN109076147B (zh) 2021-03-02
CN109076147A (zh) 2018-12-21

Similar Documents

Publication Publication Date Title
WO2017161520A1 (fr) Système d'imagerie composite et terminal mobile prenant en charge une imagerie par lumière visible et lumière proche infrarouge
US10579871B2 (en) Biometric composite imaging system and method reusable with visible light
CN205666883U (zh) 支持近红外光与可见光成像的复合成像系统和移动终端
US11134848B2 (en) Mobile hyperspectral camera system and human skin monitoring using a mobile hyperspectral camera system
KR100383712B1 (ko) 다중 조명원을 이용해 안경을 통해 눈을 조명하고촬영하는 방법 및 장치
JP6539654B2 (ja) 視線検知装置
US20170140221A1 (en) Dual function camera for infrared and visible light with electrically-controlled filters
US9690970B2 (en) Method and device for mobile terminal biometric feature imaging
US20180131880A1 (en) System and method of efficient illuminator-sensor synchronization to capture images
CN206370880U (zh) 一种双摄像头成像系统和移动终端
WO2017049923A1 (fr) Appareil de traitement d'image mobile multifonction, procédé de traitement, et application
WO2016058528A1 (fr) Système d'imagerie optoélectronique tourné vers l'avant et à reconnaissance faciale/d'iris intégrée de terminal mobile, et procédé associé
US20170061210A1 (en) Infrared lamp control for use with iris recognition authentication
US11126014B2 (en) Eyewear, eyewear systems and associated methods for enhancing vision
WO2016041437A1 (fr) Module d'imagerie à reconnaissance de l'iris pour terminal mobile, et procédé d'acquisition d'image
US20100278394A1 (en) Apparatus for Iris Capture
KR20150037628A (ko) 생체인식 카메라
US20140104392A1 (en) Generating image information
WO2013175465A1 (fr) Affichage monté sur la tête, doté d'un système intégré de suivi de globe oculaire
JP2002330318A (ja) 携帯端末装置
US12047670B2 (en) Electronic equipment
KR20080005972A (ko) 다중분광 생체계측 센서
JP4385284B2 (ja) 撮像装置及び撮像方法
CN108108708A (zh) 支持多光谱生物特征的复合成像系统及移动终端
CN213718047U (zh) 电子设备

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16894875

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 16.01.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 16894875

Country of ref document: EP

Kind code of ref document: A1