EP1610266A1 - Imaging device, method thereof, and program - Google Patents

Imaging device, method thereof, and program Download PDF

Info

Publication number
EP1610266A1
EP1610266A1 EP04808065A EP04808065A EP1610266A1 EP 1610266 A1 EP1610266 A1 EP 1610266A1 EP 04808065 A EP04808065 A EP 04808065A EP 04808065 A EP04808065 A EP 04808065A EP 1610266 A1 EP1610266 A1 EP 1610266A1
Authority
EP
European Patent Office
Prior art keywords
luminance level
image
blood vessel
light
pattern
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP04808065A
Other languages
German (de)
French (fr)
Other versions
EP1610266A4 (en
EP1610266B1 (en
Inventor
Hideo c/o Sony Corporation Sato
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of EP1610266A1 publication Critical patent/EP1610266A1/en
Publication of EP1610266A4 publication Critical patent/EP1610266A4/en
Application granted granted Critical
Publication of EP1610266B1 publication Critical patent/EP1610266B1/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/4887Locating particular structures in or on the body
    • A61B5/489Blood vessels
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/117Identification of persons
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/117Identification of persons
    • A61B5/1171Identification of persons based on the shapes or appearances of their bodies or parts thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/12Details of acquisition arrangements; Constructional details thereof
    • G06V10/14Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/141Control of illumination
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/13Sensors therefor
    • G06V40/1312Sensors therefor direct reading, e.g. contactless acquisition
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/72Combination of two or more compensation controls
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/74Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/14Vascular patterns

Definitions

  • This invention relates to an imaging device, method, and program and is suitably applied to a case of imaging blood vessels, for example.
  • a blood vessel formation pattern of blood vessels of a body has been attracted as one of unique body characteristics.
  • an imaging device 1 as shown in Fig. 11 has been proposed, for example.
  • This imaging device 1 has laser light sources 2 for emitting near-infrared light.
  • a first filter 3 for allowing light of specific near-infrared light bandwidth out of the near-infrared light to pass therethrough
  • a second filter 4 for allowing light of near-infrared light bandwidth which is absorbed in hemoglobin in blood vessels, out of light obtained through the first filter 3, and an imaging element 5 are arranged in order.
  • the imaging device 1 emits near-infrared light from the light sources 2 in a situation where, for example, a finger FG of a body is inserted between the first filter 3 and the second filter 4, resulting in irradiating the finger FG with the light through the first filter 3. Since this near-infrared light is specifically absorbed in instinct hemoglobin of blood vessel tissues inside the finger FG, scattered light obtained though the finger FG enters the imaging element 5 through the second filter 4 as blood vessel pattern light representing a formation pattern of the blood vessel tissues.
  • the imaging element 5 performs photoelectric conversion on the blood vessel pattern light with a plurality of photoelectric conversion elements that is arranged in a matrix in correspondence with pixels, in order to treat a signal obtained by the photoelectric conversion elements as a blood vessel image signal.
  • the imaging device 1 is provided with a physical shielding unit 7 for covering not only all units 2 to 5 existing on the light path of near-infrared light emitted from the light sources 2 but also the finger FG, so as to eliminates influence of light (hereinafter, referred to as outside light) in the air arriving at the finger FG on the near-infrared light.
  • a physical shielding unit 7 for covering not only all units 2 to 5 existing on the light path of near-infrared light emitted from the light sources 2 but also the finger FG, so as to eliminates influence of light (hereinafter, referred to as outside light) in the air arriving at the finger FG on the near-infrared light. This, however, arises a large scale problem due to the shielding unit 7.
  • an imaging device irradiates, for example, a finger with irradiation light of a luminance level higher than that of light in the air arriving at a body, performs photoelectric conversion on blood vessel pattern light obtained through the finger, with a solid imaging element, and adjusts imaging sensitivity of the solid imaging element by limiting the amount of the resultant signal per unit time (for example, refer to patent reference 1).
  • this imaging device can relatively reduce the amount of signal being accumulated in the solid imaging element as a result of the photoelectric conversion of the blood vessel pattern light and the outside light arriving at this time, imaging can be performed without physically blocking the irradiation route of the irradiation light and the finger and without substantive influence of the outside light on the imaging sensitivity of the solid imaging element to the blood vessel pattern light.
  • Patent Reference 1 Japanese Patent Application NO. 2003-371022
  • the imaging device however, has a drawback in which an uneven blood vessel image is created because the reflex pathway of near-infrared light varies in a body due to the positions of the light sources and individuals and thus the solid imaging element cannot perform the photoelectric conversion on uniform blood vessel pattern light.
  • This invention has been made in view of foregoing and intends to propose a communication terminal device capable of simply realizing actual use of an imaging device and method capable of improving image quality.
  • this invention provides an imaging device with: a light source control means for controlling light sources so as to irradiate a body with irradiation light of a luminance level higher than that in the air arriving at the body; a sensitivity adjustment means for adjusting the imaging sensitivity of a solid imaging element for performing photoelectric conversion on pattern scattered light obtained through the inside of the body; and a masking means for masking the luminance level deterioration region of a pattern image obtained from the solid imaging element to treat the masked image as an image to be composed with a reference image.
  • this invention provides a program causing a computer to execute an imaging method and process, with: a light source control step of controlling light sources so as to irradiate a body with irradiation light of a luminance level higher than that in the air arriving at the body; a sensitivity adjustment step of adjusting the imaging sensitivity of a solid imaging element for performing photoelectric conversion on pattern scattered light obtained through the inside of the body; and a masking step of masking a luminance level deterioration region of a pattern image obtained from the solid imaging element to treat the masked image as an image to be composed with a reference image.
  • light sources are controlled so as to irradiate a body with irradiation light of a luminance level higher than that in the air arriving at the body, the imaging sensitivity of a solid imaging element for performing photoelectric conversion on pattern scattered light obtained through the inside of the body is adjusted, and the luminance level deterioration region of a pattern image obtained from the solid imaging element is masked.
  • the unevenness of the image can be masked to use the image as an image to be composed with a reference image. Therefore, an even image representing the inside of the body can be obtained regardless of the positions of the light sources and individuals, thus making it possible to realize an imaging device, and an imaging method and program capable of improving image quality.
  • Fig. 1 shows an imaging device according to this embodiment.
  • This imaging device 10 is designed to execute a mode (hereinafter, referred to as normal imaging mode) to image subjects such as bodies and backgrounds as imaging targets.
  • a mode hereinafter, referred to as normal imaging mode
  • a CCD camera unit 11 guides the outside light in the air arriving from a front subject, to a CCD 11E via a lens 11A, an aperture 11C, a lens 11B, and an ultraviolet cut filter 11D in order.
  • the ultraviolet cut filter 11D comprises an RGB filter for allowing visible light and near-infrared light to pass therethrough.
  • an MCU (Micro Control Unit) 12 adjusts the amount of the outside light entering the CCD 11E by controlling an aperture value of the aperture 11C with an auto exposure control process and also adjusts a focus distance and a focus position by controlling the positions of the lens 11A and 11B with an auto focus control process.
  • the CCD 11E of the CCD camera unit 11 performs photoelectric conversion on the outside light arriving through the ultraviolet cut filter 11D, with a plurality of photoelectric conversion elements arranged in correspondence with pixels, reads charge signals being accumulated in the photoelectric conversion elements as a result of the photoelectric conversion, as an image signal S1 according to a readout clock supplied from a clock generator (not shown), and sends this to an A/D (Analog/Digital) conversion unit 14.
  • A/D Analog/Digital
  • the A/D conversion unit 14 creates a digital image signal D1 by digitizing the image signal S1 and sends this to a data processing unit 15.
  • the data processing unit 14 stores and keeps the digital image signal D1 in, for example, an internal memory (not shown).
  • the imaging device 10 executes the normal imaging mode to image subjects such as bodies and backgrounds as imaging targets.
  • this imaging device 10 has two near-infrared light sources LS (LSa and LSb) for emitting near-infrared light toward the arrival direction of the outside light, in almost the same level as the position of the CCD camera unit 11, and is designed to execute a mode (hereinafter, referred to as a blood vessel imaging mode) to image blood vessel tissues inside a finger FG positioned in an irradiation direction, as an imaging target (hereinafter, referred to as specific imaging target).
  • a blood vessel imaging mode a mode
  • specific imaging target an imaging target
  • a mode switching unit 20 (Fig. 1) drives both a light source control unit 21A and a sensitivity adjustment unit 21B of a blood vessel imaging control unit 21.
  • the light source control unit 21A controls an output and so on, to the near-infrared light sources LS so as to have a preset value as a luminance level higher than that of the outside light which is normally obtained in the air, with the result that the near-infrared light sources LS irradiate the finger FG with near-infrared light of a luminance level higher than that of the outside light.
  • this near-infrared light is specifically absorbed in the instinct hemoglobin of the blood vessel tissues (not shown) inside the finger FG, and passes through or is reflected by the other tissues.
  • the outside light arriving at this time is attenuated by being blocked by bones and becomes light which can be ignored because of near-infrared light of a higher luminance level.
  • near-infrared light obtained through the finger FG is guided to the CCD 11E via the lens 11A, the aperture 11C, the lens 11B, and the ultraviolet cut filter 11D shown in Fig. 1 in order, as blood vessel pattern light representing a formation pattern of blood vessel tissues. Then in each photoelectric conversion elements of the CCD 11E, a charge signal obtained as a result of the photoelectric conversion of the blood vessel pattern light is accumulated.
  • the sensitivity adjustment unit 21B adjusts the imaging sensitivity of the CCD 11E to the blood vessel pattern light by electrically limiting the amount of charge signal being accumulated in each photoelectric conversion elements of the CCD 11E with an exposure time control process called an electronic shutter.
  • the sensitivity adjustment unit 21B performs resetting at prescribed reset timing within a period (hereinafter, referred to as charge accumulation period) tl from rising of the readout clock to next rising which is next readout timing (Fig. 3(A)), so as to limit the amount of charge signal being accumulated in each photoelectric conversion element of the CCD 11E within the charge accumulation period t1 as compared with the amount of charge signal in the normal imaging mode (Fig. 3(B)) (Fig. 3(A)).
  • charge accumulation period a period from rising of the readout clock to next rising which is next readout timing
  • the photoelectric conversion elements of the CCD 11E can previously prevent the charge signals being accumulated in the photoelectric conversion elements from being saturated within the charge accumulation period tl (Fig. 4) due to the near-infrared light emitted from the near-infrared light sources LS has a higher luminance level than that of the outside light.
  • the amount of charge signals being accumulated in the photoelectric conversion elements as a result of the photoelectric conversion of the blood vessel pattern light and the outside light arriving at this time are relatively reduced, so that the imaging sensitivity of the CCD 11E to the blood vessel pattern light is not affected by the outside light.
  • the CCD 11E reads the charge signals being accumulated after the amount of charge signal is limited with the exposure time control process of the sensitivity adjustment unit 21B, as a blood vessel image signal S2 (Fig. 1) at readout timing of the readout clock, and sends this to the A/D conversion unit 14.
  • the A/D conversion unit 14 digitizes the blood vessel image signal S2 to create a digital blood vessel image signal D2 and sends this to the data processing unit 15.
  • the data processing unit 15 extracts a unique blood vessel formation pattern from the blood vessel image of the digital blood vessel image signal D2, and stores and keeps the extracted blood vessel formation pattern in an internal memory (not shown). In this case, the data processing unit 15 extracts a pattern representing an inside of a body, thereby being capable of preventing direct steal from a body as compared with a case of extracting a pattern of fingerprints or the like existing on the body surface and thus keeping the pattern as identification information with high confidentiality in the internal memory (not shown).
  • the imaging device 10 executes the blood vessel imaging mode and can perform imaging without physically blocking the irradiation route of near-infrared light and an imaging target and without substantial influence of the outside light on the imaging sensitivity of the CCD 11E to blood vessel pattern light.
  • the imaging device 10 drives the light source control unit 21A and the sensitivity adjustment unit 21B according to switching of the mode switching unit 20 to the blood vessel imaging mode out of the normal imaging mode and the blood vessel imaging mode, thereby being capable of reducing power consumed by the light source control unit 21A and using the CCD camera unit 11 for imaging both normal subjects and blood vessels.
  • a finger FG is irradiated with light of wavelength including both wavelength which is specifically absorbed in oxygenation hemoglobin and wavelength which is specifically absorbed in deoxygenization hemoglobin out of hemoglobin (transport protein) of blood vessel tissues inside the finger FG, specifically, near-infrared light of wavelength from 700 [nm] to 900 [nm].
  • the imaging device 10 can create a blood vessel image signal S2 faithfully representing capillary vessel tissues containing oxygenation and deoxygenization hemoglobin, with the CCD camera unit 11.
  • the wavelength is not strictly limited to one which is specifically absorbed in oxygenation and deoxygenization hemoglobin, not only hemoglobin can be previously prevented from varying due to concentration of energy on blood vessel tissues but also an S/N ratio can be improved and manufacturing can be simplified.
  • the imaging device 10 emits near-infrared light of a luminance level higher than that of the outside light, toward an opposite side of the outside light entering the CCD 11E, from the near-infrared light sources LSa and LSb arranged in almost the same level as the CCD camera 11 (Fig. 2). Therefore, only by placing the finger FG in front of the CCD camera unit 11, the blood vessel image of the finger FG can be created as a digital blood vessel image signal D2 from blood vessel pattern light that is not substantially affected by the outside light arriving at this time.
  • blood vessel pattern light entering the CCD 11E through the finger FG becomes uneven light because the near-infrared light sources LSa and LSb existing near the finger FG emit near-infrared light of a luminance level higher than the outside light and the light amount of a part near the near-infrared light sources LSa and LSb is more than that of the other part.
  • a charge signal of blood vessel light having a great light amount specifically, as shown in Fig. 5, a charge signal of blood vessel pattern light of a part near the near-infrared light sources LSa and LSb may be saturated even if the signal is limited with the exposure time control process.
  • the blood vessel image based on the digital blood vessel image signal D2 has unclear regions SAR having pseudo outlines due to the saturation. If this blood vessel image is used as identification information, the accuracy of the identification process deteriorates (hereinafter, such a region is called luminance level saturation region). Further, the luminance level saturation region SAR becomes apparent because individuals have different reflex pathways inside bodies and the light amount of blood vessel pattern light entering the CCD 11E through the body is also different.
  • the imaging device 10 is designed to alternatively emit light from the near-infrared light sources LSa and LSb, and mask the luminance level saturation regions SAR included in the blood vessel images obtained via the CCD camera unit 11 and the A/D conversion unit 14.
  • the light source control unit 21A of the blood vessel imaging control unit 21 alternatively set the near-infrared light sources LSa and LSb to ON/OFF every unit time.
  • blood vessel pattern light (Fig. 6(A)) obtained through the finger FG from the near-infrared light source LSb is given to the data processing unit 15 as a digital blood vessel image signal D2 (Fig. 1) of a blood vessel image BMa having a luminance level saturation region SAR corresponding to a part near the near-infrared light source LSb.
  • blood vessel pattern light obtained through the finger FG from the near-infrared light source LSa is given to the data processing unit 15 as a digital blood vessel image signal D2 (Fig. 1) of a blood vessel image BMb having a luminance level saturation region SAR corresponding to a part near the near-infrared light source LSa.
  • the data processing unit 15 is designed to perform masking with the digital blood vessel image signal D2 of the blood vessel image BMa and the digital blood vessel image signal D2 of the blood vessel image BMa which are alternatively and sequentially given from the A/D conversion unit 14, as one unit.
  • the data processing unit 15 masks the luminance level saturation regions SAR of the blood vessel images BMa and BMb of both digital blood vessel image signals D2 (Fig. 6(B)), and combines the blood vessel images BMa and BMb based on, for example, the blood vessel image BMa having the minimum ratio of the luminance level saturation region SAR to the entire image (Fig. 6(C)).
  • This composition result is a blood vessel image in which the luminance level saturation regions SAR of the blood vessel images BMa and BMb are supplemented by each other's corresponding good regions. Then the data processing unit 15 extracts a blood vessel formation pattern from the composition result, and stores and keeps the extracted unique blood vessel formation pattern in an internal memory (not shown).
  • the imaging device 10 can eliminate the evenness of a blood vessel image caused due to a luminance level saturation region SAR, regardless of the positions of the near-infrared light sources LSa and LSb and individuals.
  • the imaging device 10 alternatively irradiates a body with irradiation light of a luminance level higher than that in the air arriving at the body, from the near-infrared light sources LSa and LSb every unit time. Then the imaging device 10 electrically adjusts the imaging sensitivity of the CCD 11E which performs the photoelectric conversion on blood vessel pattern light obtained every unit time, masks the luminance level saturation regions SAR of the blood vessel images BMa and BMb (Fig. 6) based on the blood vessel pattern light, and composes the images with, for example, the blood vessel image BMa as a reference image.
  • this imaging device 10 can eliminate the evenness of an image even if the image based on uneven blood vessel pattern light that is created because there is a difference in reflex pathway of near-infrared light inside a body depending on the positions of the light sources and individuals, thereby being capable of obtaining an even image representing the inside of the body regardless of the positions of the light sources and individuals.
  • a body is sequentially irradiated with irradiation light of a luminance level higher than that in the air arriving at the body, from the near-infrared light sources LSa and LSb every unit time, and the luminance level saturation regions SAR of the blood vessel images BMa and BMb obtained after the imaging sensitivity of the CCD 11E for performing the photoelectric conversion on blood vessel pattern light obtained through the inside of the body is electrically adjusted, and the images are combined, thereby being capable of creating an even image representing the inside of the body, regardless of the positions of the light sources and individuals and thus improving image quality.
  • an imaging device 30 (Fig. 1) uses three kinds of luminance levels for near-infrared light in the blood vessel imaging mode as shown in Fig. 7, irradiates a finger FG with near-infrared light of the three kinds of luminance levels in order, from the near-infrared light sources LSa and LSb, and masks the luminance level saturation regions SAR and so on included in the blood vessel images sequentially obtained via the CCD camera unit 11 and the A/D conversion unit 14.
  • a light source control unit 31A (Fig. 1) of a blood vessel imaging control unit 21 sequentially and variably controls output and so on to near-infrared light sources LS so that a luminance level higher than that of the outside light normally obtained in the air has a preset first, second or third value in order, and irradiates a finger FG with near-infrared light in the first luminance level state (hereinafter, referred to as low luminance level), a second luminance level state (hereinafter, referred to as intermediate luminance level), and a third luminance level state (hereinafter, referred to as high luminance level) in order, from the near-infrared light sources LS every unit time.
  • the imaging sensitivity of the CCD 11E deteriorates because a light amount decreases as light is farther from the near-infrared light sources LSa and LSb. Therefore, blood vessel pattern light (Fig. 7(A)) obtained through the finger FG is given to a data processing unit 35 as a digital blood vessel image signal D2 (Fig. 1) of a blood vessel image BMc in which there is a large unclear region (hereinafter, referred to as luminance level lack region) having pseudo outlines according to the deterioration of the imaging sensitivity caused by the lack of light amount.
  • blood vessel pattern light obtained through the finger FG (Fig. 7(A)) is given to the data processing unit 35 as a digital blood vessel image signal D2 (Fig. 1) of a blood vessel image BMe in which a luminance level saturation region SAR becomes large as light is close to the near-infrared light sources LSa and LSb.
  • the data processing unit 35 (Fig. 1) is designed to perform masking with the digital blood vessel image signals D2 of the blood vessel images BMc, BMd, and BMe given from the A/D conversion unit 14 as one unit.
  • the data processing unit 35 masks the luminance level lack regions WAR and the luminance level saturation regions SAR of the blood vessel images BMc, BMd, and BMe (Fig. 7(B)).
  • the data processing unit 35 composes the blood vessel images BMc, BMd, and BMe obtained after the masking, based on, for example, the blood vessel image BMd having the minimum ratio of the luminance level lack region WAR and luminance level saturation region SAR to the entire image (Fig. 7(C)).
  • This composition result is a blood vessel image in which the blood vessel images BMc, BMd, and BMe are supplemented by each other's good regions.
  • the data processing unit 35 extracts a blood vessel formation pattern from the composition result, and stores and keeps the extracted unique blood vessel formation pattern in an internal memory (not shown).
  • the imaging device 30 (Fig. 1) performs the image control process, thereby being capable of eliminating the evenness of a blood vessel image due to a luminance level saturation region SAR, regardless of the positions of the near-infrared light sources LSa and LSb and individuals.
  • this imaging device 30 sequentially irradiates a body with irradiation light of three kinds of luminance levels higher than that in the air arriving at the body every unit time. Then the imaging device 30 electrically adjusts the imaging sensitivity of the CCD 11E for performing the photoelectric conversion on blood vessel pattern light obtained every unit time, masks the luminance level lack regions WAR and the luminance level saturation regions SAR of blood vessel images BMc, BMd, and BMe (Fig. 7) based on the blood vessel pattern light and then composes the images with, for example, the blood vessel image BMd as a reference image.
  • this imaging device 30 can eliminate the unevenness of an image even if the image based on uneven blood vessel pattern light is created because there is a difference in reflex pathway of near-infrared light inside a body depending on the positions of the light sources and individuals, thus being capable of obtaining an even image representing an inside of the body, regardless of the positions of the light sources and individuals.
  • this imaging device 30 can reduce driving power by an amount used for setting the near-infrared light sources LSa and LSb to ON/OFF (irradiation or non-irradiation of irradiation light). As a result, power consumption can be reduced as compared with the first embodiment.
  • a body is sequentially irradiated with irradiation light of three kinds of luminance levels higher than a luminance level of the air arriving at the body, every unit time, the luminance level lack regions WAR and the luminance level saturation region SAR of the blood vessel images BMc, BMd, and BMe obtained after the imaging sensitivity of the CCD 11 for performing the photoelectric conversion on blood vessel pattern light obtained through the inside of the body is electrically adjusted are masked, and then the images are composed, thereby being capable of reducing power consumption as compared with the first embodiment in which irradiation light is emitted and not emitted, as well as obtaining the same effects as the first embodiment.
  • an imaging device 40 executes an exposure time control process so as to sequentially use three kinds of reset timing TM1, TM2, and TM3 which becomes faster in order every charge storage period t1 for the CCD 11E, as shown in Fig. 8, and masks luminance level lack regions WAR and luminance level saturation regions SAR included in blood vessel images obtained via the CCD 11E and the A/D conversion unit 14.
  • a sensitivity adjustment unit 41B (Fig. 1) of a blood vessel imaging control unit 21 limits the amount of charge signal being accumulated in each photoelectric conversion element of the CCD 11E within the charge accumulation period t1 by sequentially performing resetting at the first, second and third reset timing TM1, TM2, and TM3. Then the CCD 11E reads the charge signals Sa, Sb, and Sc being accumulated after the amount of charge signal is limited with the exposure time control process of the sensitivity adjustment unit 41B (Fig. 1), as blood vessel image signals S2 (Fig. 1) at readout timing of a readout clock, and sends them to the A/D conversion unit 14.
  • the blood vessel image signal S2 corresponding to the charge signal Sa is given to a data processing unit 45 as a digital blood vessel image signal D2 (Fig. 1) of a blood vessel image BMf in which a ratio of a luminance level lack region WAR to the entire image becomes high as the region is farther from the near-infrared light sources LSa and LSb because the imaging sensitivity deteriorates due to the shortest period (hereinafter, referred to as exposure period) t2 from the reset timing TM1 to readout timing.
  • exposure period shortest period
  • the blood vessel image signal S2 corresponding to the charge signal Sc is given to the data processing unit 45 as a digital blood vessel image signal D2 (Fig. 1) of a blood vessel image BMg in which a ratio of a luminance level saturation region SAR to the entire image becomes large as the region is close to the near-infrared light sources LSa and LSb because the imaging sensitivity is high due to the longest exposure period t2.
  • the blood vessel image signal S2 corresponding to the charge signal Sb is given to the data processing unit 35 (Fig. 1) as a digital blood vessel image signal D2 of a blood vessel image BMh having a luminance level lack region WAR and a luminance level saturation region SAR both in equal proportion because the imaging sensitivity is middle due to an intermediate exposure period t2.
  • the sensitivity adjustment unit 41B executes the exposure time control process so as to sequentially use three kinds of reset timing TM1, TM2 and TM3 which becomes faster in order, every charge accumulation period t1 for the CCD 11E. Therefore, as described with reference to Fig. 7, blood vessel images BMf to BMh which are the same as those of the second embodiment in which a finger FG is sequentially irradiated with near-infrared light of three kinds of luminance levels in order can be obtained..
  • the data processing unit 45 masks the luminance level lack regions WAR and the luminance level saturation regions SAR of the blood vessel images BMf, BMg, and BMh by executing the masking process on the digital blood vessel image signals D2 of the blood vessel images BMf, BMg, and BMh given from the A/D conversion unit 14, and composes the resultant images, extracts a blood vessel formation pattern from the composition result, and stores and keeps the extracted unique blood vessel formation pattern in an internal memory (not shown).
  • the imaging device 40 performs the image control process, thereby being capable of eliminating the evenness of a blood vessel image corresponding to a luminance level saturation region SAR. regardless of the positions of the near-infrared light sources LSa and LSb and individuals.
  • this imaging device 40 irradiates a body with irradiation light of a luminance level higher than that in the air arriving at the body, adjusts the imaging sensitivity of the CCD 11E for performing the photoelectric conversion on blood vessel pattern light obtained through the inside of the body by sequentially changing the amount of charge signal being accumulated in the CCD 11E per charge accumulation period t1 (Fig. 8), masks the luminance level lack regions WAR and the luminance level saturation regions SAR of the images BMf, BMg and BMh (Fig. 9) based on the charge signals Sa, Sb and Sc obtained from the CCD 11E, and then composes the images.
  • this imaging device 40 is capable of eliminating an evenness of the image, thereby being capable of obtaining an even image representing the inside of the body, regardless of the positions of the light sources and individuals.
  • this imaging device 40 is capable of obtaining an even image representing an inside of a body without variably controlling power or the like to the near-infrared light sources LSa and LSb, resulting in being capable of significantly reducing power consumption as compared with the first and second embodiments.
  • a body is irradiated with irradiation light of a luminance level higher than that in the air arriving at the body
  • the imaging sensitivity of the CCD 11E for performing the photoelectric conversion on blood vessel pattern light obtained through an inside of the body is adjusted by sequentially changing the amount of charge signal being accumulated in the CCD 11E per charge accumulation period t1 (Fig. 8), and the images BMf, BMg, and BMf (Fig.
  • the above first embodiment has described a case of sequentially and alternatively irradiating a body with irradiation light from the near-infrared light sources LSa and LSb every unit time.
  • This invention is not limited to this and, for example, as shown in Fig. 10, a plurality of near-infrared light sources can be arranged to sequentially irradiate the body with irradiation light from these near-infrared light sources in order.
  • one movable near-infrared light source LSa can be provided to irradiate the body with irradiation light from different irradiation positions every unit time.
  • near-infrared light is emitted with blood vessels inside a finger of a body as an irradiation target, and blood vessel pattern light obtained through the finger is imaged.
  • This invention is not limited to this and irradiation light which has a specificity for tissues can be emitted with tissues inside retina of a body or all body as an irradiation target and pattern scattered light obtained through the body can be imaged.
  • the near-infrared light sources LS are arranged in almost the same level as the positions of the CCD camera unit 11.
  • This invention is not limited to this and one or two or more near-infrared light sources can be arranged at other different positions. In this case, even if the positions of the light sources are changed, an even image representing an inside of a body can be obtained.
  • the above embodiment has described a case where, as a technique of the blood vessel imaging control unit 21 to control the light sources 21 and the CCD 11E corresponding to the light source control unit 21A (31A) and the sensitivity adjustment unit 21B (41B) of the blood vessel imaging control unit 21, in the first embodiment, a body is sequentially and alternatively irradiated with irradiation light of a luminance level higher than that in the air arriving at the body, from the near-infrared light sources LSa and LSb every unit time, and the imaging sensitivity of the CCD 11E for performing the photoelectric conversion on blood vessel pattern light obtained through the inside of the body is electrically adjusted.
  • a body is sequentially irradiated with irradiation light of three kinds of luminance levels higher than that in the air arriving at the body in order every unit time, and the imaging sensitivity of the CCD 11E for performing the photoelectric conversion on blood vessel pattern light obtained through the inside of the body is electrically adjusted.
  • a body is irradiated with irradiation light of a luminance level higher than that in the air arriving at the body, and the imaging sensitivity of the CCD 11E for performing the photoelectric conversion on blood vessel pattern light obtained through the inside of the body is adjusted by sequentially changing the amount of charge signal being accumulated in the CCD 11E within the charge accumulation period t1 (Fig. 8).
  • This invention is not limited to these and, when a body is sequentially irradiated with irradiation light of three kinds of luminance levels, resetting can be performed at reset timing which is associated with the luminance levels. Alternatively, other combinations can be applied.
  • the above embodiment has described a case of using the CCD 11E as a solid imaging element.
  • This invention is not limited to this and another solid imaging element such as a CMOS (ComplementSARy Metal Oxide Semiconductor) can be used.
  • CMOS ComplementSARy Metal Oxide Semiconductor
  • the above embodiment has described a case where, as a masking means for masking luminance level deterioration regions (luminance level lack regions WAR and luminance level saturation regions SAR) of pattern images obtained from a solid imaging element and creating the masked images as images to be composed with a reference image, the data processing units 15, 35 and 45 for composing blood vessel images after masking their luminance level deterioration regions, and storing and keeping a unique blood vessel formation pattern extracted from the composition result in an internal memory (not shown) are applied.
  • This invention is not limited to this and a data processing unit for performing other processes can be applied for processes which are executed after the composition result is obtained.
  • the above embodiment has described a case where the light sources 21 and the CCD 11E are controlled by corresponding light source control unit 21A (31A), sensitivity control unit 21B (41B) and data processing unit 15 (35, 45).
  • This invention is not limited to this and a control process of each of the control units can be realized by programs.
  • the mode switching unit 20 (Fig. 1) is applied as a mode switching means for driving an irradiation means and a sensitivity adjustment means according to switching to a mode to image pattern light out of a mode to image light in the air arriving from a subject and the mode to image pattern light.
  • This invention is not limited to this and only the mode to image pattern light can be executed.
  • This invention can be used for a case of imaging blood vessels inside a body.

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Vascular Medicine (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)
  • Image Input (AREA)
  • Studio Devices (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)

Abstract

To realize an imaging device, imaging method and program capable of improving image quality. This invention controls light sources so as to irradiate a body with irradiation light of a luminance level higher than that in the air arriving at the body, adjusts the imaging sensitivity of a solid imaging element for performing photoelectric conversion on pattern scattered light obtained through the inside of the body, and masks the luminance level deterioration region of a pattern image obtained from the solid imaging element to treat the masked image as an image to be composed with a reference image. <IMAGE>

Description

Technical Field
This invention relates to an imaging device, method, and program and is suitably applied to a case of imaging blood vessels, for example.
Background Art
Recently, a blood vessel formation pattern of blood vessels of a body has been attracted as one of unique body characteristics. As a device for imaging the blood vessel formation pattern, an imaging device 1 as shown in Fig. 11 has been proposed, for example.
This imaging device 1 has laser light sources 2 for emitting near-infrared light. On the light path of the near-infrared light emitted from the laser light sources 2, a first filter 3 for allowing light of specific near-infrared light bandwidth out of the near-infrared light to pass therethrough, a second filter 4 for allowing light of near-infrared light bandwidth which is absorbed in hemoglobin in blood vessels, out of light obtained through the first filter 3, and an imaging element 5 are arranged in order.
In this case, the imaging device 1 emits near-infrared light from the light sources 2 in a situation where, for example, a finger FG of a body is inserted between the first filter 3 and the second filter 4, resulting in irradiating the finger FG with the light through the first filter 3. Since this near-infrared light is specifically absorbed in instinct hemoglobin of blood vessel tissues inside the finger FG, scattered light obtained though the finger FG enters the imaging element 5 through the second filter 4 as blood vessel pattern light representing a formation pattern of the blood vessel tissues.
The imaging element 5 performs photoelectric conversion on the blood vessel pattern light with a plurality of photoelectric conversion elements that is arranged in a matrix in correspondence with pixels, in order to treat a signal obtained by the photoelectric conversion elements as a blood vessel image signal.
In this case, the imaging device 1 is provided with a physical shielding unit 7 for covering not only all units 2 to 5 existing on the light path of near-infrared light emitted from the light sources 2 but also the finger FG, so as to eliminates influence of light (hereinafter, referred to as outside light) in the air arriving at the finger FG on the near-infrared light. This, however, arises a large scale problem due to the shielding unit 7.
To solve this problem, such an imaging device has been proposed by the applicant of this invention that irradiates, for example, a finger with irradiation light of a luminance level higher than that of light in the air arriving at a body, performs photoelectric conversion on blood vessel pattern light obtained through the finger, with a solid imaging element, and adjusts imaging sensitivity of the solid imaging element by limiting the amount of the resultant signal per unit time (for example, refer to patent reference 1).
Since this imaging device can relatively reduce the amount of signal being accumulated in the solid imaging element as a result of the photoelectric conversion of the blood vessel pattern light and the outside light arriving at this time, imaging can be performed without physically blocking the irradiation route of the irradiation light and the finger and without substantive influence of the outside light on the imaging sensitivity of the solid imaging element to the blood vessel pattern light.
Patent Reference 1 Japanese Patent Application NO. 2003-371022
The imaging device, however, has a drawback in which an uneven blood vessel image is created because the reflex pathway of near-infrared light varies in a body due to the positions of the light sources and individuals and thus the solid imaging element cannot perform the photoelectric conversion on uniform blood vessel pattern light.
Disclosure of the invention
This invention has been made in view of foregoing and intends to propose a communication terminal device capable of simply realizing actual use of an imaging device and method capable of improving image quality.
To solve the above problem, this invention provides an imaging device with: a light source control means for controlling light sources so as to irradiate a body with irradiation light of a luminance level higher than that in the air arriving at the body; a sensitivity adjustment means for adjusting the imaging sensitivity of a solid imaging element for performing photoelectric conversion on pattern scattered light obtained through the inside of the body; and a masking means for masking the luminance level deterioration region of a pattern image obtained from the solid imaging element to treat the masked image as an image to be composed with a reference image.
Further, this invention provides a program causing a computer to execute an imaging method and process, with: a light source control step of controlling light sources so as to irradiate a body with irradiation light of a luminance level higher than that in the air arriving at the body; a sensitivity adjustment step of adjusting the imaging sensitivity of a solid imaging element for performing photoelectric conversion on pattern scattered light obtained through the inside of the body; and a masking step of masking a luminance level deterioration region of a pattern image obtained from the solid imaging element to treat the masked image as an image to be composed with a reference image.
According to this invention, light sources are controlled so as to irradiate a body with irradiation light of a luminance level higher than that in the air arriving at the body, the imaging sensitivity of a solid imaging element for performing photoelectric conversion on pattern scattered light obtained through the inside of the body is adjusted, and the luminance level deterioration region of a pattern image obtained from the solid imaging element is masked. As a result, even in a case where an image is created based on an uneven pattern scattered light which is obtained because there is a difference in reflex pathway of near-infrared light inside the body depending on the positions of the light sources and individuals, the unevenness of the image can be masked to use the image as an image to be composed with a reference image. Therefore, an even image representing the inside of the body can be obtained regardless of the positions of the light sources and individuals, thus making it possible to realize an imaging device, and an imaging method and program capable of improving image quality.
Brief Description of the Drawings
  • Fig. 1 is a schematic diagram showing a construction of an imaging device according to the first embodiment.
  • Fig. 2 is a schematic diagram showing the positions of near-infrared light sources and a light flow of near-infrared light.
  • Fig. 3 is a schematic diagram explaining an electric shutter.
  • Fig. 4 is a schematic diagram explaining adjustment of imaging sensitivity of the electric shutter.
  • Fig. 5 is a schematic diagram explaining a luminance level saturation region.
  • Fig. 6 is a schematic diagram explaining a blood vessel imaging control process according to the first embodiment.
  • Fig. 7 is a schematic diagram explaining a blood vessel imaging control process according to the second embodiment.
  • Fig. 8 is a schematic diagram showing an example of exposure time control.
  • Fig. 9 is a schematic diagram explaining a blood vessel imaging control process according to the third embodiment.
  • Fig. 10 is a schematic diagram explaining a blood vessel imaging control process according to another embodiment.
  • Fig. 11 is a schematic diagram showing a construction of a conventional imaging device.
  • Best Mode for carrying out the Invention
    One embodiment to which this invention is applied will be described in detail with reference to the accompanying drawings.
    (1) First Embodiment (1-1) Construction of imaging device
    Fig. 1 shows an imaging device according to this embodiment. This imaging device 10 is designed to execute a mode (hereinafter, referred to as normal imaging mode) to image subjects such as bodies and backgrounds as imaging targets.
    In this case, a CCD camera unit 11 guides the outside light in the air arriving from a front subject, to a CCD 11E via a lens 11A, an aperture 11C, a lens 11B, and an ultraviolet cut filter 11D in order. In this connection, the ultraviolet cut filter 11D comprises an RGB filter for allowing visible light and near-infrared light to pass therethrough.
    At this time, an MCU (Micro Control Unit) 12 adjusts the amount of the outside light entering the CCD 11E by controlling an aperture value of the aperture 11C with an auto exposure control process and also adjusts a focus distance and a focus position by controlling the positions of the lens 11A and 11B with an auto focus control process.
    Then the CCD 11E of the CCD camera unit 11 performs photoelectric conversion on the outside light arriving through the ultraviolet cut filter 11D, with a plurality of photoelectric conversion elements arranged in correspondence with pixels, reads charge signals being accumulated in the photoelectric conversion elements as a result of the photoelectric conversion, as an image signal S1 according to a readout clock supplied from a clock generator (not shown), and sends this to an A/D (Analog/Digital) conversion unit 14.
    The A/D conversion unit 14 creates a digital image signal D1 by digitizing the image signal S1 and sends this to a data processing unit 15.
    The data processing unit 14 stores and keeps the digital image signal D1 in, for example, an internal memory (not shown).
    As described above, the imaging device 10 executes the normal imaging mode to image subjects such as bodies and backgrounds as imaging targets.
    In addition to the above units, as shown in Fig. 2, this imaging device 10 has two near-infrared light sources LS (LSa and LSb) for emitting near-infrared light toward the arrival direction of the outside light, in almost the same level as the position of the CCD camera unit 11, and is designed to execute a mode (hereinafter, referred to as a blood vessel imaging mode) to image blood vessel tissues inside a finger FG positioned in an irradiation direction, as an imaging target (hereinafter, referred to as specific imaging target).
    In this case, when a prescribed blood vessel imaging command is entered via an operating unit (not shown), a mode switching unit 20 (Fig. 1) drives both a light source control unit 21A and a sensitivity adjustment unit 21B of a blood vessel imaging control unit 21.
    The light source control unit 21A controls an output and so on, to the near-infrared light sources LS so as to have a preset value as a luminance level higher than that of the outside light which is normally obtained in the air, with the result that the near-infrared light sources LS irradiate the finger FG with near-infrared light of a luminance level higher than that of the outside light.
    As shown in Fig. 2, this near-infrared light is specifically absorbed in the instinct hemoglobin of the blood vessel tissues (not shown) inside the finger FG, and passes through or is reflected by the other tissues. The outside light arriving at this time, on the other hand, is attenuated by being blocked by bones and becomes light which can be ignored because of near-infrared light of a higher luminance level.
    In this case, near-infrared light obtained through the finger FG is guided to the CCD 11E via the lens 11A, the aperture 11C, the lens 11B, and the ultraviolet cut filter 11D shown in Fig. 1 in order, as blood vessel pattern light representing a formation pattern of blood vessel tissues. Then in each photoelectric conversion elements of the CCD 11E, a charge signal obtained as a result of the photoelectric conversion of the blood vessel pattern light is accumulated.
    At this time, the sensitivity adjustment unit 21B adjusts the imaging sensitivity of the CCD 11E to the blood vessel pattern light by electrically limiting the amount of charge signal being accumulated in each photoelectric conversion elements of the CCD 11E with an exposure time control process called an electronic shutter.
    Specifically, as shown in Fig. 3, the sensitivity adjustment unit 21B performs resetting at prescribed reset timing within a period (hereinafter, referred to as charge accumulation period) tl from rising of the readout clock to next rising which is next readout timing (Fig. 3(A)), so as to limit the amount of charge signal being accumulated in each photoelectric conversion element of the CCD 11E within the charge accumulation period t1 as compared with the amount of charge signal in the normal imaging mode (Fig. 3(B)) (Fig. 3(A)).
    As a result, as shown in Fig. 4(A), the photoelectric conversion elements of the CCD 11E can previously prevent the charge signals being accumulated in the photoelectric conversion elements from being saturated within the charge accumulation period tl (Fig. 4) due to the near-infrared light emitted from the near-infrared light sources LS has a higher luminance level than that of the outside light. Further, as shown in Fig. 4(B), the amount of charge signals being accumulated in the photoelectric conversion elements as a result of the photoelectric conversion of the blood vessel pattern light and the outside light arriving at this time are relatively reduced, so that the imaging sensitivity of the CCD 11E to the blood vessel pattern light is not affected by the outside light.
    Then the CCD 11E reads the charge signals being accumulated after the amount of charge signal is limited with the exposure time control process of the sensitivity adjustment unit 21B, as a blood vessel image signal S2 (Fig. 1) at readout timing of the readout clock, and sends this to the A/D conversion unit 14. The A/D conversion unit 14 digitizes the blood vessel image signal S2 to create a digital blood vessel image signal D2 and sends this to the data processing unit 15.
    The data processing unit 15 extracts a unique blood vessel formation pattern from the blood vessel image of the digital blood vessel image signal D2, and stores and keeps the extracted blood vessel formation pattern in an internal memory (not shown). In this case, the data processing unit 15 extracts a pattern representing an inside of a body, thereby being capable of preventing direct steal from a body as compared with a case of extracting a pattern of fingerprints or the like existing on the body surface and thus keeping the pattern as identification information with high confidentiality in the internal memory (not shown).
    As described above, the imaging device 10 executes the blood vessel imaging mode and can perform imaging without physically blocking the irradiation route of near-infrared light and an imaging target and without substantial influence of the outside light on the imaging sensitivity of the CCD 11E to blood vessel pattern light.
    In this case, the imaging device 10 drives the light source control unit 21A and the sensitivity adjustment unit 21B according to switching of the mode switching unit 20 to the blood vessel imaging mode out of the normal imaging mode and the blood vessel imaging mode, thereby being capable of reducing power consumed by the light source control unit 21A and using the CCD camera unit 11 for imaging both normal subjects and blood vessels.
    In addition to the above configuration, by the light source control unit 21A of this imaging device 10, a finger FG is irradiated with light of wavelength including both wavelength which is specifically absorbed in oxygenation hemoglobin and wavelength which is specifically absorbed in deoxygenization hemoglobin out of hemoglobin (transport protein) of blood vessel tissues inside the finger FG, specifically, near-infrared light of wavelength from 700 [nm] to 900 [nm].
    Thereby, the imaging device 10 can create a blood vessel image signal S2 faithfully representing capillary vessel tissues containing oxygenation and deoxygenization hemoglobin, with the CCD camera unit 11. In addition, in this case, since the wavelength is not strictly limited to one which is specifically absorbed in oxygenation and deoxygenization hemoglobin, not only hemoglobin can be previously prevented from varying due to concentration of energy on blood vessel tissues but also an S/N ratio can be improved and manufacturing can be simplified.
    By the way, in the blood vessel imaging mode, the imaging device 10 emits near-infrared light of a luminance level higher than that of the outside light, toward an opposite side of the outside light entering the CCD 11E, from the near-infrared light sources LSa and LSb arranged in almost the same level as the CCD camera 11 (Fig. 2). Therefore, only by placing the finger FG in front of the CCD camera unit 11, the blood vessel image of the finger FG can be created as a digital blood vessel image signal D2 from blood vessel pattern light that is not substantially affected by the outside light arriving at this time.
    In this case, however, blood vessel pattern light entering the CCD 11E through the finger FG becomes uneven light because the near-infrared light sources LSa and LSb existing near the finger FG emit near-infrared light of a luminance level higher than the outside light and the light amount of a part near the near-infrared light sources LSa and LSb is more than that of the other part.
    Therefore, a charge signal of blood vessel light having a great light amount, specifically, as shown in Fig. 5, a charge signal of blood vessel pattern light of a part near the near-infrared light sources LSa and LSb may be saturated even if the signal is limited with the exposure time control process. In this case, the blood vessel image based on the digital blood vessel image signal D2 has unclear regions SAR having pseudo outlines due to the saturation. If this blood vessel image is used as identification information, the accuracy of the identification process deteriorates (hereinafter, such a region is called luminance level saturation region). Further, the luminance level saturation region SAR becomes apparent because individuals have different reflex pathways inside bodies and the light amount of blood vessel pattern light entering the CCD 11E through the body is also different.
    Therefore, in the blood vessel imaging mode, as shown in Fig. 6, the imaging device 10 is designed to alternatively emit light from the near-infrared light sources LSa and LSb, and mask the luminance level saturation regions SAR included in the blood vessel images obtained via the CCD camera unit 11 and the A/D conversion unit 14.
    Specifically, the light source control unit 21A of the blood vessel imaging control unit 21 alternatively set the near-infrared light sources LSa and LSb to ON/OFF every unit time. In this case, blood vessel pattern light (Fig. 6(A)) obtained through the finger FG from the near-infrared light source LSb is given to the data processing unit 15 as a digital blood vessel image signal D2 (Fig. 1) of a blood vessel image BMa having a luminance level saturation region SAR corresponding to a part near the near-infrared light source LSb.
    Similarly, blood vessel pattern light (Fig. 6(A)) obtained through the finger FG from the near-infrared light source LSa is given to the data processing unit 15 as a digital blood vessel image signal D2 (Fig. 1) of a blood vessel image BMb having a luminance level saturation region SAR corresponding to a part near the near-infrared light source LSa.
    The data processing unit 15 is designed to perform masking with the digital blood vessel image signal D2 of the blood vessel image BMa and the digital blood vessel image signal D2 of the blood vessel image BMa which are alternatively and sequentially given from the A/D conversion unit 14, as one unit. The data processing unit 15 masks the luminance level saturation regions SAR of the blood vessel images BMa and BMb of both digital blood vessel image signals D2 (Fig. 6(B)), and combines the blood vessel images BMa and BMb based on, for example, the blood vessel image BMa having the minimum ratio of the luminance level saturation region SAR to the entire image (Fig. 6(C)).
    This composition result is a blood vessel image in which the luminance level saturation regions SAR of the blood vessel images BMa and BMb are supplemented by each other's corresponding good regions. Then the data processing unit 15 extracts a blood vessel formation pattern from the composition result, and stores and keeps the extracted unique blood vessel formation pattern in an internal memory (not shown).
    By performing the image control process as described above, the imaging device 10 can eliminate the evenness of a blood vessel image caused due to a luminance level saturation region SAR, regardless of the positions of the near-infrared light sources LSa and LSb and individuals.
    (1-2) Operations and effects of the first embodiment
    According to the above configuration, the imaging device 10 alternatively irradiates a body with irradiation light of a luminance level higher than that in the air arriving at the body, from the near-infrared light sources LSa and LSb every unit time. Then the imaging device 10 electrically adjusts the imaging sensitivity of the CCD 11E which performs the photoelectric conversion on blood vessel pattern light obtained every unit time, masks the luminance level saturation regions SAR of the blood vessel images BMa and BMb (Fig. 6) based on the blood vessel pattern light, and composes the images with, for example, the blood vessel image BMa as a reference image.
    Therefore, this imaging device 10 can eliminate the evenness of an image even if the image based on uneven blood vessel pattern light that is created because there is a difference in reflex pathway of near-infrared light inside a body depending on the positions of the light sources and individuals, thereby being capable of obtaining an even image representing the inside of the body regardless of the positions of the light sources and individuals.
    According to the above configuration, a body is sequentially irradiated with irradiation light of a luminance level higher than that in the air arriving at the body, from the near-infrared light sources LSa and LSb every unit time, and the luminance level saturation regions SAR of the blood vessel images BMa and BMb obtained after the imaging sensitivity of the CCD 11E for performing the photoelectric conversion on blood vessel pattern light obtained through the inside of the body is electrically adjusted, and the images are combined, thereby being capable of creating an even image representing the inside of the body, regardless of the positions of the light sources and individuals and thus improving image quality.
    (2) Second Embodiment (2-1) Construction of imaging device
    There is different points from the first embodiment in that an imaging device 30 (Fig. 1) uses three kinds of luminance levels for near-infrared light in the blood vessel imaging mode as shown in Fig. 7, irradiates a finger FG with near-infrared light of the three kinds of luminance levels in order, from the near-infrared light sources LSa and LSb, and masks the luminance level saturation regions SAR and so on included in the blood vessel images sequentially obtained via the CCD camera unit 11 and the A/D conversion unit 14.
    Specifically, a light source control unit 31A (Fig. 1) of a blood vessel imaging control unit 21 sequentially and variably controls output and so on to near-infrared light sources LS so that a luminance level higher than that of the outside light normally obtained in the air has a preset first, second or third value in order, and irradiates a finger FG with near-infrared light in the first luminance level state (hereinafter, referred to as low luminance level), a second luminance level state (hereinafter, referred to as intermediate luminance level), and a third luminance level state (hereinafter, referred to as high luminance level) in order, from the near-infrared light sources LS every unit time.
    In a case of the low luminance level, the imaging sensitivity of the CCD 11E deteriorates because a light amount decreases as light is farther from the near-infrared light sources LSa and LSb. Therefore, blood vessel pattern light (Fig. 7(A)) obtained through the finger FG is given to a data processing unit 35 as a digital blood vessel image signal D2 (Fig. 1) of a blood vessel image BMc in which there is a large unclear region (hereinafter, referred to as luminance level lack region) having pseudo outlines according to the deterioration of the imaging sensitivity caused by the lack of light amount.
    Similarly, in a case of the high luminance level, in contrast with the blood vessel pattern light obtained at the low luminance level, blood vessel pattern light obtained through the finger FG (Fig. 7(A)) is given to the data processing unit 35 as a digital blood vessel image signal D2 (Fig. 1) of a blood vessel image BMe in which a luminance level saturation region SAR becomes large as light is close to the near-infrared light sources LSa and LSb. In a case of the intermediate luminance level, blood vessel pattern light obtained through the finger FG is given to the data processing unit 35 (Fig. 1) as a digital blood vessel image signal D2 of a blood vessel image BMd having a luminance level lack region WAR and a luminance level saturation region SAR both in equal proportion.
    Then the data processing unit 35 (Fig. 1) is designed to perform masking with the digital blood vessel image signals D2 of the blood vessel images BMc, BMd, and BMe given from the A/D conversion unit 14 as one unit. The data processing unit 35 masks the luminance level lack regions WAR and the luminance level saturation regions SAR of the blood vessel images BMc, BMd, and BMe (Fig. 7(B)).
    Then the data processing unit 35 (Fig. 1) composes the blood vessel images BMc, BMd, and BMe obtained after the masking, based on, for example, the blood vessel image BMd having the minimum ratio of the luminance level lack region WAR and luminance level saturation region SAR to the entire image (Fig. 7(C)). This composition result is a blood vessel image in which the blood vessel images BMc, BMd, and BMe are supplemented by each other's good regions. Then the data processing unit 35 (Fig. 1) extracts a blood vessel formation pattern from the composition result, and stores and keeps the extracted unique blood vessel formation pattern in an internal memory (not shown).
    As described above, the imaging device 30 (Fig. 1) performs the image control process, thereby being capable of eliminating the evenness of a blood vessel image due to a luminance level saturation region SAR, regardless of the positions of the near-infrared light sources LSa and LSb and individuals.
    (2-2) Operations and effects of the second embodiment
    According to the above configuration, this imaging device 30 sequentially irradiates a body with irradiation light of three kinds of luminance levels higher than that in the air arriving at the body every unit time. Then the imaging device 30 electrically adjusts the imaging sensitivity of the CCD 11E for performing the photoelectric conversion on blood vessel pattern light obtained every unit time, masks the luminance level lack regions WAR and the luminance level saturation regions SAR of blood vessel images BMc, BMd, and BMe (Fig. 7) based on the blood vessel pattern light and then composes the images with, for example, the blood vessel image BMd as a reference image.
    Therefore, this imaging device 30 can eliminate the unevenness of an image even if the image based on uneven blood vessel pattern light is created because there is a difference in reflex pathway of near-infrared light inside a body depending on the positions of the light sources and individuals, thus being capable of obtaining an even image representing an inside of the body, regardless of the positions of the light sources and individuals.
    In addition, this imaging device 30 can reduce driving power by an amount used for setting the near-infrared light sources LSa and LSb to ON/OFF (irradiation or non-irradiation of irradiation light). As a result, power consumption can be reduced as compared with the first embodiment.
    According to the above configuration, a body is sequentially irradiated with irradiation light of three kinds of luminance levels higher than a luminance level of the air arriving at the body, every unit time, the luminance level lack regions WAR and the luminance level saturation region SAR of the blood vessel images BMc, BMd, and BMe obtained after the imaging sensitivity of the CCD 11 for performing the photoelectric conversion on blood vessel pattern light obtained through the inside of the body is electrically adjusted are masked, and then the images are composed, thereby being capable of reducing power consumption as compared with the first embodiment in which irradiation light is emitted and not emitted, as well as obtaining the same effects as the first embodiment.
    (3) Third embodiment (3-1) Construction of imaging device
    There are different points from the first embodiment in that an imaging device 40 (Fig. 1) executes an exposure time control process so as to sequentially use three kinds of reset timing TM1, TM2, and TM3 which becomes faster in order every charge storage period t1 for the CCD 11E, as shown in Fig. 8, and masks luminance level lack regions WAR and luminance level saturation regions SAR included in blood vessel images obtained via the CCD 11E and the A/D conversion unit 14.
    Specifically, a sensitivity adjustment unit 41B (Fig. 1) of a blood vessel imaging control unit 21 limits the amount of charge signal being accumulated in each photoelectric conversion element of the CCD 11E within the charge accumulation period t1 by sequentially performing resetting at the first, second and third reset timing TM1, TM2, and TM3. Then the CCD 11E reads the charge signals Sa, Sb, and Sc being accumulated after the amount of charge signal is limited with the exposure time control process of the sensitivity adjustment unit 41B (Fig. 1), as blood vessel image signals S2 (Fig. 1) at readout timing of a readout clock, and sends them to the A/D conversion unit 14.
    In this case, as shown in Fig. 9, the blood vessel image signal S2 corresponding to the charge signal Sa is given to a data processing unit 45 as a digital blood vessel image signal D2 (Fig. 1) of a blood vessel image BMf in which a ratio of a luminance level lack region WAR to the entire image becomes high as the region is farther from the near-infrared light sources LSa and LSb because the imaging sensitivity deteriorates due to the shortest period (hereinafter, referred to as exposure period) t2 from the reset timing TM1 to readout timing.
    Similarly, the blood vessel image signal S2 corresponding to the charge signal Sc is given to the data processing unit 45 as a digital blood vessel image signal D2 (Fig. 1) of a blood vessel image BMg in which a ratio of a luminance level saturation region SAR to the entire image becomes large as the region is close to the near-infrared light sources LSa and LSb because the imaging sensitivity is high due to the longest exposure period t2. The blood vessel image signal S2 corresponding to the charge signal Sb is given to the data processing unit 35 (Fig. 1) as a digital blood vessel image signal D2 of a blood vessel image BMh having a luminance level lack region WAR and a luminance level saturation region SAR both in equal proportion because the imaging sensitivity is middle due to an intermediate exposure period t2.
    As described above, the sensitivity adjustment unit 41B (Fig. 1) executes the exposure time control process so as to sequentially use three kinds of reset timing TM1, TM2 and TM3 which becomes faster in order, every charge accumulation period t1 for the CCD 11E. Therefore, as described with reference to Fig. 7, blood vessel images BMf to BMh which are the same as those of the second embodiment in which a finger FG is sequentially irradiated with near-infrared light of three kinds of luminance levels in order can be obtained..
    In this case, as in the case of the second embodiment, the data processing unit 45 masks the luminance level lack regions WAR and the luminance level saturation regions SAR of the blood vessel images BMf, BMg, and BMh by executing the masking process on the digital blood vessel image signals D2 of the blood vessel images BMf, BMg, and BMh given from the A/D conversion unit 14, and composes the resultant images, extracts a blood vessel formation pattern from the composition result, and stores and keeps the extracted unique blood vessel formation pattern in an internal memory (not shown).
    As described above, the imaging device 40 performs the image control process, thereby being capable of eliminating the evenness of a blood vessel image corresponding to a luminance level saturation region SAR. regardless of the positions of the near-infrared light sources LSa and LSb and individuals.
    (3-2) Operations and effects of the third embodiment
    According to the above configuration, this imaging device 40 irradiates a body with irradiation light of a luminance level higher than that in the air arriving at the body, adjusts the imaging sensitivity of the CCD 11E for performing the photoelectric conversion on blood vessel pattern light obtained through the inside of the body by sequentially changing the amount of charge signal being accumulated in the CCD 11E per charge accumulation period t1 (Fig. 8), masks the luminance level lack regions WAR and the luminance level saturation regions SAR of the images BMf, BMg and BMh (Fig. 9) based on the charge signals Sa, Sb and Sc obtained from the CCD 11E, and then composes the images.
    Therefore, even if an image based on uneven blood vessel pattern light is obtained because there is a difference in reflex pathway of near-infrared light inside a body depending on the positions of the light sources and individuals, this imaging device 40 is capable of eliminating an evenness of the image, thereby being capable of obtaining an even image representing the inside of the body, regardless of the positions of the light sources and individuals.
    In addition, this imaging device 40 is capable of obtaining an even image representing an inside of a body without variably controlling power or the like to the near-infrared light sources LSa and LSb, resulting in being capable of significantly reducing power consumption as compared with the first and second embodiments.
    According to the above configuration, a body is irradiated with irradiation light of a luminance level higher than that in the air arriving at the body, the imaging sensitivity of the CCD 11E for performing the photoelectric conversion on blood vessel pattern light obtained through an inside of the body is adjusted by sequentially changing the amount of charge signal being accumulated in the CCD 11E per charge accumulation period t1 (Fig. 8), and the images BMf, BMg, and BMf (Fig. 9) based on the charge signals Sa, Sb, and Sc obtained from the CCD 11E are composed after their luminance level lack regions WAR and luminance level saturation regions SAR are masked, thereby being capable of significantly reducing power consumption as compared with the first and second embodiments because variable control of power to the near-infrared light sources LSa and LSb is not performed, as well as obtaining the same effects as the first and second embodiments.
    (4) Other embodiments
    Note that the above first embodiment has described a case of sequentially and alternatively irradiating a body with irradiation light from the near-infrared light sources LSa and LSb every unit time. This invention, however, is not limited to this and, for example, as shown in Fig. 10, a plurality of near-infrared light sources can be arranged to sequentially irradiate the body with irradiation light from these near-infrared light sources in order. Alternatively, one movable near-infrared light source LSa can be provided to irradiate the body with irradiation light from different irradiation positions every unit time.
    In this case, by performing masking with digital blood vessel image signals D2 of blood vessel images obtained from blood vessel pattern light obtained through the finger from the near-infrared light sources as one unit, a composed blood vessel image with high image quality can be obtained because many blood vessel images are used to be composed.
    Further, in this case, near-infrared light is emitted with blood vessels inside a finger of a body as an irradiation target, and blood vessel pattern light obtained through the finger is imaged. This invention, however, is not limited to this and irradiation light which has a specificity for tissues can be emitted with tissues inside retina of a body or all body as an irradiation target and pattern scattered light obtained through the body can be imaged.
    Further, in this case, the near-infrared light sources LS (LSa and LSb) are arranged in almost the same level as the positions of the CCD camera unit 11. This invention, however, is not limited to this and one or two or more near-infrared light sources can be arranged at other different positions. In this case, even if the positions of the light sources are changed, an even image representing an inside of a body can be obtained.
    Furthermore, the above embodiment has described a case where, as a technique of the blood vessel imaging control unit 21 to control the light sources 21 and the CCD 11E corresponding to the light source control unit 21A (31A) and the sensitivity adjustment unit 21B (41B) of the blood vessel imaging control unit 21, in the first embodiment, a body is sequentially and alternatively irradiated with irradiation light of a luminance level higher than that in the air arriving at the body, from the near-infrared light sources LSa and LSb every unit time, and the imaging sensitivity of the CCD 11E for performing the photoelectric conversion on blood vessel pattern light obtained through the inside of the body is electrically adjusted. In the second embodiment, on the other hand, a body is sequentially irradiated with irradiation light of three kinds of luminance levels higher than that in the air arriving at the body in order every unit time, and the imaging sensitivity of the CCD 11E for performing the photoelectric conversion on blood vessel pattern light obtained through the inside of the body is electrically adjusted. In the third embodiment, a body is irradiated with irradiation light of a luminance level higher than that in the air arriving at the body, and the imaging sensitivity of the CCD 11E for performing the photoelectric conversion on blood vessel pattern light obtained through the inside of the body is adjusted by sequentially changing the amount of charge signal being accumulated in the CCD 11E within the charge accumulation period t1 (Fig. 8). This invention, however, is not limited to these and, when a body is sequentially irradiated with irradiation light of three kinds of luminance levels, resetting can be performed at reset timing which is associated with the luminance levels. Alternatively, other combinations can be applied.
    Furthermore, the above embodiment has described a case of using the CCD 11E as a solid imaging element. This invention, however, is not limited to this and another solid imaging element such as a CMOS (ComplementSARy Metal Oxide Semiconductor) can be used.
    Furthermore, the above embodiment has described a case where, as a masking means for masking luminance level deterioration regions (luminance level lack regions WAR and luminance level saturation regions SAR) of pattern images obtained from a solid imaging element and creating the masked images as images to be composed with a reference image, the data processing units 15, 35 and 45 for composing blood vessel images after masking their luminance level deterioration regions, and storing and keeping a unique blood vessel formation pattern extracted from the composition result in an internal memory (not shown) are applied. This invention, however, is not limited to this and a data processing unit for performing other processes can be applied for processes which are executed after the composition result is obtained.
    Furthermore, the above embodiment has described a case where the light sources 21 and the CCD 11E are controlled by corresponding light source control unit 21A (31A), sensitivity control unit 21B (41B) and data processing unit 15 (35, 45). This invention, however, is not limited to this and a control process of each of the control units can be realized by programs.
    Furthermore, the above embodiment has described a case where the mode switching unit 20 (Fig. 1) is applied as a mode switching means for driving an irradiation means and a sensitivity adjustment means according to switching to a mode to image pattern light out of a mode to image light in the air arriving from a subject and the mode to image pattern light. This invention, however, is not limited to this and only the mode to image pattern light can be executed.
    Industrial Applicability
    This invention can be used for a case of imaging blood vessels inside a body.

    Claims (9)

    1. An imaging device comprising:
      light source control means for controlling light sources so as to irradiate a body with irradiation light of a luminance level higher than a luminance level of the air arriving at the body;
      sensitivity adjustment means for adjusting imaging sensitivity of a solid imaging element for performing photoelectric conversion on pattern scattered light obtained through an inside of the body; and
      masking means for masking a luminance level deterioration region of a pattern image obtained from the solid imaging element to treat an image masked as an image to be composed with a reference image.
    2. The imaging device according to claim 1, wherein:
      the light source control means controls the light sources so as to sequentially irradiate the body with irradiation light every unit time; and
      the masking means masks the luminance level deterioration region of the pattern image obtained from the solid imaging element every unit time and composes the pattern image with the reference image.
    3. The imaging device according to claim 1, wherein:
      the light source control means controls the light sources so as to sequentially irradiate the body every unit time at luminance levels different from each other; and
      the masking means masks the luminance level deterioration region of the pattern image obtained from the solid imaging element every unit time and composes the pattern image with the reference image.
    4. The imaging device according to claim 1, wherein:
      the sensitivity adjustment means adjusts the imaging sensitivity by sequentially changing an amount being accumulated in the solid imaging element as a result of the photoelectric conversion per unit time; and
      the masking means masks the luminance level deterioration region of the pattern image based on the amount obtained from the solid imaging element and composes the pattern image with the reference image.
    5. An imaging method comprising:
      a light source control step of controlling light sources so as to irradiate a body with irradiation light of a luminance level higher than a luminance level of the air arriving at the body;
      a sensitivity adjustment step of adjusting imaging sensitivity of a solid imaging element for performing photoelectric conversion on pattern scattered light obtained through an inside of the body; and
      a masking step of masking a luminance level deterioration region of a pattern image obtained from the solid imaging element to treat an image masked as an image to be composed with a reference image.
    6. The imaging method according to claim 5, wherein,
         in the light source control step, the light sources are controlled so as to sequentially irradiate the body with the irradiation light every unit time; and
         in the masking step, the luminance level deterioration region of the pattern image obtained from the solid imaging element every unit time is masked and the pattern image is composed with the reference image.
    7. The imaging method according to claim 5, wherein,
         in the light source control step, the light sources are controlled so as to sequentially irradiate the body with the irradiation light of luminance levels different from each other every unit time; and
         in the masking step, the luminance level deterioration region of the pattern image obtained from the solid imaging element every unit time is masked and the pattern image is composed with the reference image.
    8. The imaging method according to claim 5, wherein,
         in the sensitivity adjustment step, the imaging sensitivity is adjusted by sequentially changing an amount being accumulated in the solid imaging element as a result of the photoelectric conversion per unit time; and
         in the masking step, the luminance level deterioration region of the pattern image based on the amount obtained from the solid imaging element is masked and the pattern image is composed with the reference image.
    9. A program causing a computer to execute a process comprising:
      a light source control step of controlling light sources so as to irradiate a body with irradiation light of a luminance level higher than a luminance level of the air arriving at the body;
      a sensitivity adjustment step of adjusting imaging sensitivity of a solid imaging element for performing photoelectric conversion on pattern scattered light obtained through an inside of the body; and
      a masking step of masking a luminance level deterioration region of a pattern image obtained from the solid imaging element to treat an image masked as an image to be composed with a reference image.
    EP04808065.9A 2003-12-24 2004-12-22 Imaging device, method thereof, and program Expired - Fee Related EP1610266B1 (en)

    Applications Claiming Priority (3)

    Application Number Priority Date Filing Date Title
    JP2003428406A JP4280993B2 (en) 2003-12-24 2003-12-24 Imaging apparatus, method thereof, and program
    JP2003428406 2003-12-24
    PCT/JP2004/019715 WO2005062252A1 (en) 2003-12-24 2004-12-22 Imaging device, method thereof, and program

    Publications (3)

    Publication Number Publication Date
    EP1610266A1 true EP1610266A1 (en) 2005-12-28
    EP1610266A4 EP1610266A4 (en) 2014-06-25
    EP1610266B1 EP1610266B1 (en) 2016-03-02

    Family

    ID=34708930

    Family Applications (1)

    Application Number Title Priority Date Filing Date
    EP04808065.9A Expired - Fee Related EP1610266B1 (en) 2003-12-24 2004-12-22 Imaging device, method thereof, and program

    Country Status (8)

    Country Link
    US (2) US7840258B2 (en)
    EP (1) EP1610266B1 (en)
    JP (1) JP4280993B2 (en)
    KR (1) KR101102224B1 (en)
    CN (2) CN1754184B (en)
    HK (1) HK1087822A1 (en)
    TW (1) TW200525135A (en)
    WO (1) WO2005062252A1 (en)

    Families Citing this family (20)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    DE602005022650D1 (en) 2004-04-26 2010-09-16 Rohm & Haas Elect Mat Improved plating process
    CN1770173B (en) * 2004-11-05 2011-05-04 株式会社日立制作所 Finger identification apparatus
    US7851222B2 (en) 2005-07-26 2010-12-14 Applied Materials, Inc. System and methods for measuring chemical concentrations of a plating solution
    JP5352960B2 (en) * 2006-04-27 2013-11-27 セイコーエプソン株式会社 Biometric information acquisition apparatus, biometric information acquisition method, and biometric authentication apparatus
    JP4182988B2 (en) * 2006-04-28 2008-11-19 日本電気株式会社 Image reading apparatus and image reading method
    JP4182987B2 (en) * 2006-04-28 2008-11-19 日本電気株式会社 Image reading device
    JP4153971B2 (en) * 2006-05-16 2008-09-24 セイコーエプソン株式会社 Biometric information acquisition apparatus, biometric information acquisition method, and biometric authentication apparatus
    JP4912814B2 (en) * 2006-09-29 2012-04-11 シスメックス株式会社 Non-invasive living body measurement device
    JP4752719B2 (en) * 2006-10-19 2011-08-17 ソニー株式会社 Image processing apparatus, image acquisition method, and program
    JP4636340B2 (en) 2007-07-10 2011-02-23 ソニー株式会社 Biological imaging device
    JP2009031903A (en) * 2007-07-25 2009-02-12 Sony Corp Biometric authentication device
    CN101380225B (en) * 2007-09-04 2011-01-12 北京大学 Method and device for collecting blood-vessel image under near infrared light
    JP2009129365A (en) * 2007-11-27 2009-06-11 Sony Corp Image-taking apparatus and method thereof
    JP5430203B2 (en) * 2009-03-31 2014-02-26 キヤノン株式会社 Image processing apparatus and image processing method
    JP5268997B2 (en) * 2010-06-02 2013-08-21 株式会社日立メディアエレクトロニクス Biometric authentication device
    CN104270267B (en) * 2014-09-26 2019-03-15 新华三技术有限公司 A kind of port switching method and single-board device
    CN112969030B (en) * 2015-06-17 2023-04-28 松下知识产权经营株式会社 Image pickup apparatus
    CN107468209B (en) * 2016-06-07 2021-10-08 松下知识产权经营株式会社 Image pickup apparatus
    JP6846330B2 (en) * 2017-11-27 2021-03-24 株式会社日立製作所 Biometric device and biometric system
    CN110705411B (en) * 2019-09-23 2022-06-21 Oppo广东移动通信有限公司 Fingerprint identification method and device, equipment and storage medium

    Citations (3)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    JP2000097635A (en) * 1998-09-28 2000-04-07 Omron Corp Optical sensor
    US6204881B1 (en) * 1993-10-10 2001-03-20 Canon Kabushiki Kaisha Image data processing apparatus which can combine a plurality of images at different exposures into an image with a wider dynamic range
    US6654062B1 (en) * 1997-11-13 2003-11-25 Casio Computer Co., Ltd. Electronic camera

    Family Cites Families (11)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    US4704633A (en) * 1985-04-01 1987-11-03 Fuji Photo Film Co., Ltd. Method for reading out image information on an image having a wide dynamic range
    CN1012557B (en) * 1990-03-17 1991-05-08 北京海淀龙兴医疗设备科技开发公司 Detection imaging method of soft tissue and its apparatus
    US5185808A (en) * 1991-06-06 1993-02-09 Eastman Kodak Company Method for merging images
    JP3891499B2 (en) * 1995-04-14 2007-03-14 パイオニア株式会社 Brightness adjustment device for plasma display panel
    US7890158B2 (en) * 2001-06-05 2011-02-15 Lumidigm, Inc. Apparatus and method of biometric determination using specialized optical spectroscopy systems
    JP2003087653A (en) 2001-09-06 2003-03-20 Ricoh Co Ltd Imaging apparatus
    JP2003187235A (en) 2001-12-18 2003-07-04 Hitachi Software Eng Co Ltd Finger vein recognition device
    JP4147033B2 (en) * 2002-01-18 2008-09-10 オリンパス株式会社 Endoscope device
    JP2003242487A (en) * 2002-02-15 2003-08-29 Canon Inc Image recognizing device
    JP4556107B2 (en) * 2003-10-30 2010-10-06 ソニー株式会社 Imaging apparatus and method, and communication terminal apparatus
    JP4385284B2 (en) * 2003-12-24 2009-12-16 ソニー株式会社 Imaging apparatus and imaging method

    Patent Citations (3)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    US6204881B1 (en) * 1993-10-10 2001-03-20 Canon Kabushiki Kaisha Image data processing apparatus which can combine a plurality of images at different exposures into an image with a wider dynamic range
    US6654062B1 (en) * 1997-11-13 2003-11-25 Casio Computer Co., Ltd. Electronic camera
    JP2000097635A (en) * 1998-09-28 2000-04-07 Omron Corp Optical sensor

    Non-Patent Citations (1)

    * Cited by examiner, † Cited by third party
    Title
    See also references of WO2005062252A1 *

    Also Published As

    Publication number Publication date
    KR20060114626A (en) 2006-11-07
    US8401603B2 (en) 2013-03-19
    TW200525135A (en) 2005-08-01
    HK1087822A1 (en) 2006-10-20
    JP2005191749A (en) 2005-07-14
    CN101822531B (en) 2012-10-10
    US20110015506A1 (en) 2011-01-20
    US7840258B2 (en) 2010-11-23
    CN101822531A (en) 2010-09-08
    WO2005062252A1 (en) 2005-07-07
    EP1610266A4 (en) 2014-06-25
    US20060142649A1 (en) 2006-06-29
    TWI312065B (en) 2009-07-11
    CN1754184B (en) 2012-07-11
    JP4280993B2 (en) 2009-06-17
    EP1610266B1 (en) 2016-03-02
    KR101102224B1 (en) 2012-01-05
    CN1754184A (en) 2006-03-29

    Similar Documents

    Publication Publication Date Title
    US8401603B2 (en) Imaging device, method thereof, and program
    KR101106396B1 (en) Imaging device and communication terminal device
    US7634116B2 (en) Information processing device
    US7809429B2 (en) Imaging apparatus
    US7486884B2 (en) Imaging device and imaging method
    CN108886049A (en) Imaging device, driving method and electronic equipment
    JP2006235254A (en) Imaging apparatus
    KR20050048511A (en) Image pick­up apparatus, fingerprint certification apparatus and image pick­up method
    CN107427186B (en) Endoscope apparatus
    US11418730B2 (en) Use of IR pre-flash for RGB camera&#39;s automatic algorithms
    CN108024701A (en) Endoscope apparatus and video processor
    JP4125264B2 (en) Image acquisition apparatus and image acquisition method
    JP3627111B2 (en) Camera with built-in flash
    JP7013730B2 (en) Image generation control device, image generation control method, and image generation control program
    US10616468B2 (en) Focus detection device and focus detection method
    US7899215B2 (en) In vivo identification information creation apparatus and identification apparatus
    JP2006317674A (en) Camera and camera system
    JP2006223516A (en) Eyeball observation device
    JP2006034782A (en) Electronic endoscope apparatus and electronic scope
    JP2003107566A (en) Camera with electronic flash unit
    JP2005055570A (en) Camera
    JP2004226534A (en) Camera, electronic flash light device and camera system
    JP2010056727A (en) Auxiliary light emitting device and imaging apparatus
    JP2005142638A (en) Image pickup apparatus
    JPH025015A (en) Focal point detecting device

    Legal Events

    Date Code Title Description
    PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

    Free format text: ORIGINAL CODE: 0009012

    17P Request for examination filed

    Effective date: 20050810

    AK Designated contracting states

    Kind code of ref document: A1

    Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU MC NL PL PT RO SE SI SK TR

    AX Request for extension of the european patent

    Extension state: AL BA HR LV MK YU

    DAX Request for extension of the european patent (deleted)
    RBV Designated contracting states (corrected)

    Designated state(s): DE FR GB

    A4 Supplementary search report drawn up and despatched

    Effective date: 20140528

    RIC1 Information provided on ipc code assigned before grant

    Ipc: H04N 5/225 20060101ALI20140522BHEP

    Ipc: G06T 1/00 20060101AFI20140522BHEP

    Ipc: H04N 5/235 20060101ALI20140522BHEP

    17Q First examination report despatched

    Effective date: 20140901

    GRAP Despatch of communication of intention to grant a patent

    Free format text: ORIGINAL CODE: EPIDOSNIGR1

    INTG Intention to grant announced

    Effective date: 20150430

    GRAS Grant fee paid

    Free format text: ORIGINAL CODE: EPIDOSNIGR3

    GRAP Despatch of communication of intention to grant a patent

    Free format text: ORIGINAL CODE: EPIDOSNIGR1

    INTG Intention to grant announced

    Effective date: 20151007

    GRAA (expected) grant

    Free format text: ORIGINAL CODE: 0009210

    AK Designated contracting states

    Kind code of ref document: B1

    Designated state(s): DE FR GB

    REG Reference to a national code

    Ref country code: GB

    Ref legal event code: FG4D

    REG Reference to a national code

    Ref country code: DE

    Ref legal event code: R096

    Ref document number: 602004048717

    Country of ref document: DE

    REG Reference to a national code

    Ref country code: DE

    Ref legal event code: R097

    Ref document number: 602004048717

    Country of ref document: DE

    REG Reference to a national code

    Ref country code: FR

    Ref legal event code: PLFP

    Year of fee payment: 13

    PLBE No opposition filed within time limit

    Free format text: ORIGINAL CODE: 0009261

    STAA Information on the status of an ep patent application or granted ep patent

    Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

    26N No opposition filed

    Effective date: 20161205

    REG Reference to a national code

    Ref country code: FR

    Ref legal event code: PLFP

    Year of fee payment: 14

    PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

    Ref country code: FR

    Payment date: 20201223

    Year of fee payment: 17

    Ref country code: DE

    Payment date: 20201211

    Year of fee payment: 17

    Ref country code: GB

    Payment date: 20201223

    Year of fee payment: 17

    REG Reference to a national code

    Ref country code: DE

    Ref legal event code: R119

    Ref document number: 602004048717

    Country of ref document: DE

    GBPC Gb: european patent ceased through non-payment of renewal fee

    Effective date: 20211222

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: GB

    Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

    Effective date: 20211222

    Ref country code: DE

    Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

    Effective date: 20220701

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: FR

    Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

    Effective date: 20211231