CN101887516A - Vein imaging apparatus, vein image interpolation method and program - Google Patents

Abstract

The invention discloses a kind of vein imaging picture pick-up device, vein image interpolation method and program.Comprise that according to the image-forming component of vein imaging apparatus of the present invention the vein image data that generate the vein image data based on the near infrared light that is converged by lens array, vein is passed in scattering and transmission in vivo generate the district, and comprise by the pixel of shading and thermonoise output data that to generate from described output valve by the output of the pixel of shading be thermonoise output and generate the district.Vein imaging apparatus according to the present invention is measured thermonoise based on the thermonoise output data, and is estimated the picture temperature based on the measurement result of this thermonoise.Vein imaging apparatus according to the present invention carries out the interpolation processing of image based on the temperature in the estimated imaging processing process.

Description

Vein imaging apparatus, vein image interpolation method and program

Technical field

The present invention relates to vein imaging apparatus, vein image interpolation method and program.

Background technology

The considerable technology that is used to protect right in a networked society that biological personal authentication is future.In the business transaction of carrying out on the internet that money, content and right can be stolen on network at any time by personation, biological personal authentication is as to only noticeable especially by encrypting the technology the field that can't protect protected.Yet, use the biological personal authentication of fingerprint and iris possibly can't solve the problem of forgery.At this problem, use personal authentication's technology of a part that is not easy the imaged vein pattern from the outside because judge precision and be difficult to forge and personation and be expected to become follow-on biological personal authentication.

On the other hand, when exploitation is used to take the formation method of vein image, because the position limit strictness of light source, so be difficult to make imaging device with planar structure.In order to address this problem, it was suggested the first-class method of wide-angle lens of using.Yet,, also be difficult to limit the distance between finger and the imaging device, and require the user finger must be placed on the same distance place even use this method.Therefore, can't guarantee the reproducibility that authenticates.Though it is desirable adopting the contact or the contactless device of large sensor on the principle, big size sensor increases owing to expensive optical material causes cost.In addition, because the rising of thermonoise that produces in the sensor and temperature increases pro rata, so when external temperature uprises in the imaging process, thereby produce the problem of the image quality reduction authentication precision reduction of the image that is used to authenticate.

As mentioned above, imaging device is subjected to the influence of external temperature very big, thereby the temperature of knowing imaging device is very important.Disclose in the 2006-349957 Japanese Unexamined Patent Application and a kind ofly be used for providing temperature-detecting device and be used to adjust the temperature of optical component so that detected temperature remains on the equipment of the temperature adjustment device in the preset range with the temperature that is used to detect the optical component that exposure sources uses.

Summary of the invention

Yet, in equipment is provided with as the 2006-349957 Japanese Unexamined Patent Application when disclosed temperature-detecting device and temperature adjustment device, produces and be difficult to produce the more problem of mini-plant.

Given this, expectation provides a kind of and can prevent because the deterioration of the image quality that causes of thermonoise and can make more vein imaging apparatus, vein image interpolation method and the program of mini-plant.

According to one embodiment of present invention, provide a kind of vein imaging apparatus, having comprised: lens array comprises a plurality of light-receiving camera lenses that are arranged as array; Near-infrared luminous source, near-infrared luminous source are arranged on the terminal of lens array and launch near infrared light to the part of biosome; Image-forming component, comprise that the vein image data that are used for generating based on the near infrared light that is converged by lens array, vein is passed in scattering and transmission in vivo the vein image data generate the district, and comprise by the pixel of shading and thermonoise output data that to generate from described output valve by the output of the pixel of shading be thermonoise output and generate the district; The thermal noise measurement unit is based on generating the amplitude that the thermonoise output data of exporting in the district is measured thermonoise from the thermonoise output data; The temperature estimation unit is based on estimated to carry out the imaging temperature that vein imaging is handled by the amplitude of the measured thermonoise in thermal noise measurement unit; And the vein image interpolation unit, use the vein image data that generated by vein image data generation district to generate vein image, and carry out the interpolation processing of vein image based on the imaging temperature that obtains by the estimation of temperature estimation unit.

According to above configuration, the amplitude of thermonoise is measured in the thermal noise measurement unit based on the thermonoise output data that is generated district's output by the thermonoise output data.The temperature estimation unit is based on the imaging temperature of the imaging processing of being estimated to carry out vein by the amplitude of the measured thermonoise in thermal noise measurement unit.The vein image interpolation unit uses the vein image data that generated from vein image data generation district to generate vein image, and based on the interpolation processing of carrying out vein image by the estimated imaging temperature of temperature estimation unit.

The vein image interpolation unit is preferably based in the noise reduction process of the Integral Processing of the predetermined amount of time that is carried out vein image by the estimated imaging temperature of temperature estimation unit and vein image at least one.

In image-forming component, be arranged in a plurality of pixels that the vein image data generate the district preferably corresponding to of light-receiving camera lens.The vein image interpolation unit preferably uses from the vein image data that are positioned at the pixel output around the pixel of vein image data that output is used to generate vein image and carries out interpolation processing.

Vein imaging apparatus can also comprise thermonoise output pretreatment unit, this thermonoise output pretreatment unit carries out pre-service to the thermonoise output data that generates district's output from the thermonoise output data, so that the thermal noise measurement unit can be handled thermonoise quantitatively.

Thermonoise output pretreatment unit can add up predetermined amount of time the thermonoise output data accumulated process and the peak of thermonoise output data handled at least one.

Vein imaging apparatus can also comprise the driving control unit of carrying out the drive controlling of image-forming component at least.Driving control unit can be controlled the light-receiving time of image-forming component and at least one in the frame rate based on the amplitude of the thermonoise that is measured by the thermal noise measurement unit.

Vein imaging apparatus can also comprise the vein pattern extraction unit that extracts vein pattern from described vein image.The vein pattern extraction unit can be based on the filter characteristic that is changed the wave filter that is used to extract vein pattern by the estimated imaging temperature of temperature estimation unit.

Vein imaging apparatus can also comprise the warning unit, is used for giving a warning when the imaging temperature by the output of temperature estimation unit is equal to or higher than predetermined threshold.

According to another embodiment of the invention, a kind of vein image interpolation method is provided, may further comprise the steps: generate the amplitude that the thermonoise output data of exporting in the district is measured thermonoise based on thermonoise output data from vein imaging apparatus, described vein imaging apparatus comprises the lens array that comprises a plurality of light-receiving camera lenses that are arranged as array, be arranged on the terminal of lens array and to the near-infrared luminous source and the image-forming component of the part emission near infrared light of biosome, described image-forming component comprises based on being converged by lens array, scattering and the transmission near infrared light that the passes vein vein image data that generate the vein image data generate the district and comprise by the pixel of shading and generate from being that the thermonoise output data of thermonoise output generates the district by the output valve of the pixel of shading output in vivo; Estimate to carry out the imaging temperature of the imaging processing of vein based on the amplitude of measured thermonoise; And use the vein image data that generated by vein image data generation district to generate vein image, and carry out the interpolation processing of vein image based on estimated imaging temperature.

According to another embodiment of the invention, a kind of following functional programs of computer realization that makes the control vein imaging apparatus is provided: the thermal noise measurement function, based on generating the amplitude that the thermonoise output data of exporting in the district is measured thermonoise from the thermonoise output data; The temperature assessment function is estimated to carry out the imaging temperature of the imaging processing of vein based on the amplitude of the thermonoise that obtains by the thermal noise measurement functional measurement; And vein image interpolation function, use generates vein image by the vein image data that vein image data generation district is generated, and based on the interpolation processing of carrying out vein image by the estimated imaging temperature of temperature assessment function, wherein vein imaging apparatus comprises the lens array that comprises a plurality of light-receiving camera lenses that are arranged as array, the near-infrared luminous source that is arranged on the terminal of lens array and launches near infrared light to the part of biosome, and image-forming component, described image-forming component comprises based on being converged by lens array, scattering and the transmission near infrared light that the passes vein vein image data that generate the vein image data generate the district and comprise by the pixel of shading and generate from being that the thermonoise output data of thermonoise output generates the district by the output valve of the pixel of shading output in vivo.

As mentioned above, according to embodiments of the invention, equipment can be produced forr a short time and can be prevented because the image quality aggravation that thermonoise causes.

Description of drawings

Fig. 1 is the block diagram that is used to illustrate according to the configuration of the vein imaging apparatus of the first embodiment of the present invention;

Fig. 2 is the key diagram that is used to illustrate according to the vein imaging apparatus of present embodiment;

Fig. 3 is the key diagram that is used to illustrate according to the vein imaging apparatus of present embodiment;

Fig. 4 A is the key diagram that is used to illustrate the image of being taken by the micro lens array;

Fig. 4 B is the key diagram that is used to illustrate the image of being taken by the micro lens array;

Fig. 5 is the key diagram that is used to illustrate according to the image-forming component of present embodiment;

Fig. 6 A is the key diagram that is used to illustrate according to the image-forming component of present embodiment;

Fig. 6 B is the key diagram that is used to illustrate according to the image-forming component of present embodiment;

Fig. 6 C is the key diagram that is used to illustrate according to the image-forming component of present embodiment;

Fig. 7 is the key diagram that is used to illustrate according to the image-forming component of present embodiment;

Fig. 8 is the key diagram that is used to illustrate according to the pixel selection unit of present embodiment;

Fig. 9 is used to illustrate the key diagram that obtains the method for data from specific pixel;

Figure 10 is used to illustrate the key diagram that obtains the method for data from specific pixel;

Figure 11 is the process flow diagram that is used to illustrate according to the positional displacement interpolation method of present embodiment;

Figure 12 is the block diagram that is used to illustrate according to the hardware configuration of the vein imaging apparatus of each embodiment of the present invention.

Embodiment

Describe the preferred embodiments of the present invention in detail hereinafter with reference to accompanying drawing.Notice that in this instructions and accompanying drawing, the structural detail with substantially the same function and structure is denoted by like references and omits the repeat specification to these structural details.

To provide description in the following order.

(1) purpose

(2) first embodiment

(1-1) about the configuration of vein imaging apparatus

Configuration about image-generating unit

Example about the structure of image-generating unit

About the image that obtains by the micro lens array

About image-forming component

Configuration about graphics processing unit

Configuration about the authentication processing unit

About obtaining data from specific pixel

(1-2) about vein image interpolation method

(3) about hardware configuration according to the vein imaging apparatus of each embodiment of the present invention

(4) sum up

＜purpose 〉

Before the vein imaging apparatus and vein image interpolation method described according to each embodiment of the present invention, at first use declarative description purpose of the present invention to the summary of vein imaging apparatus.

At biological identification, particularly in vena identification, use the method that charge-coupled device (CCD), complementary metal oxide semiconductor (CMOS) (CMOS) etc. are used as the camera of image-forming component mainly to be used.Yet it is big that this vena identification equipment ratio is used for the fingerprint authenticated device, thereby be applied in the limited range of application.

Consider this situation, in following vein imaging apparatus according to each embodiment of the present invention, using lens array and a kind of of large sensor is micro lens array (MLA), and this makes vein imaging apparatus to be produced thinlyyer.

In addition, the large scale sensor device is made by silicon etc., and in the equipment that uses silicon, thermonoise rises along with temperature and increases.Especially, in the sensor device that forms with film such as TFT sensor etc., the noise under the high temperature significantly occurs, and this makes captured vein image severe exacerbation.In addition, because the continuous deterioration of vein image, the authentication precision under the high temperature can reduce.

In view of above problem, following vein imaging apparatus according to each embodiment of the present invention is intended to measure thermonoise by the pixel around the imaging region that uses image-forming component, by means of the optimum sampling and the Flame Image Process of each member realize proofreading and correct automatically at each temperature.

(first embodiment)

＜about the configuration of vein imaging apparatus 〉

At first, with reference to of the configuration of Fig. 1 to Fig. 3 detailed description according to the vein imaging apparatus of the first embodiment of the present invention.Fig. 1 is the block diagram that is used to illustrate according to the configuration of the vein imaging apparatus of present embodiment.Fig. 2 is the planimetric map according to the vein imaging apparatus of present embodiment.Fig. 3 is along the obtained cross-sectional view of the A-A line of Fig. 2.

As shown in Figure 1, comprise for example 3 unit according to the vein imaging apparatus 10 of present embodiment, i.e. imaging unit, graphics processing unit and authentication processing unit, and comprise storage unit 141.

Image-generating unit carries out the processing of the imaging of the part (for example finger) to biosome.As shown in Figure 1, this image-generating unit mainly comprises for example micro lens array 101, near-infrared luminous source 105, image-forming component 109 and driving control unit 121.

Processing when graphics processing unit carries out obtaining of the picture data (view data) relevant with the vein that is generated by image-generating unit and to the various Flame Image Process of the view data that obtained, thus generation is present in the image (vein image) of the vein of biosome inside.As shown in Figure 1, this graphics processing unit mainly comprises for example pixel data cutting unit 123, thermonoise output pretreatment unit 125, thermal noise measurement unit 127, temperature estimation unit 129, warning unit 131, pixel selection unit 133, vein image interpolation unit 135.

The authentication processing unit carries out the authentication processing by the vein image of graphics processing unit generation.As shown in Figure 1, this authentication processing unit mainly comprises for example vein pattern extraction unit 137 and authentication ' unit 139.

[about the configuration of image-generating unit]

At first, below will describe the configuration of image-generating unit in detail.

The near-infrared luminous source 105 that micro lens array (MLA) 101 will be described from behind is transmitted into the part of biosome and the near infrared light that the vein of biosome inside is passed in transmission (below be also referred to as the vein transmitted light) and converges on the image-forming component of describing later 109.As hereinafter described, this micro lens array 101 comprises a plurality of light-receiving camera lenses.Micro lens array 101 is made by the material that for example is more vulnerable to heat affecting than glass material.By using this material, can be by means of for example micro lens array of the molded arbitrary dimension of large-lot production at an easy rate.This example that is more vulnerable to the material of heat affecting than glass material comprises plastic resin.

The near infrared light that near-infrared luminous source 105 will have the predetermined wavelength band is transmitted on the part that is placed on the biosome on the vein imaging apparatus 10.Because near infrared light has the characteristic that transmission is well passed bodily tissue and absorbed by the haemoglobin in the blood (reduced hemoglobin), so when near infrared light was transmitted into finger, palm or the back of the hand, the vein that is distributed in finger, palm or the back of the hand inside was revealed as the shade in the image.The shade that is apparent in the vein in the image is called vein pattern.To this vein pattern imaging, 105 emissions of near-infrared luminous source have the wavelength of about 600nm to 1300nm or are preferably the near infrared light of the wavelength of 700nm to 900nm for suitably.

If the near infrared light wavelength that near-infrared luminous source 105 is launched less than 600nm or greater than 1300nm, is then reduced by the number percent of the light of the absorption of the haemoglobin in the blood, be difficult to obtain suitable vein pattern and become.In addition, if the near infrared light wavelength that near-infrared luminous source 105 is launched is about 700nm to 900nm, then near infrared light is absorbed especially by deoxyhemoglobin and oxygenated haemoglobin, therefore can obtain suitable vein pattern.

For example can use light emitting diode (LED) as this near-infrared luminous source 105.In addition, also can use the light emitting diode that to launch the light that comprises above-mentioned wavelength band and the combination that limits the light filter of light emitted wavestrip optically, rather than use light emitting diode with above-mentioned wavelength band.In addition, near-infrared luminous source 105 can with the light quantity of being adjusted by the distribution of the light of light emitted is adjusted filter set altogether.

For this near-infrared luminous source 105, near infrared light emission sequential and the near infrared light intensity launched etc. are controlled by the driving control unit of describing later 121.

Image-forming component 109 has the imaging surface of a plurality of pixels 111 of arranging with lattice structure, and generates the vein image data based on the vein transmitted light that is focused on by micro lens array 101 with near infrared light.Can use for example conducts such as CCD type imageing sensor, CMOS type imageing sensor, thin film transistor (TFT) (TFT) type imageing sensor according to the image-forming component 109 of present embodiment.The vein image data that image-forming component 109 outputs are generated.In addition, in the storage unit 141 that image-forming component 109 can be described the vein image data recording that is generated in the back.

In addition, in the vein imaging apparatus 10 according to present embodiment, as described later, a plurality of pixels 111 are assigned to a light-receiving camera lens of micro lens array 101.Therefore, in the vein imaging apparatus 10 according to present embodiment, the near infrared light (vein transmitted light) that is converged by a light-receiving camera lens is with a plurality of pixel 111 imagings.

The picture element scan sequential of this image-forming component 109 etc. are by driving control unit 121 controls of describing later.

Driving control unit 121 can be by for example CPU (CPU (central processing unit)), ROM (ROM (read-only memory)), RAM realizations such as (random access memory).Driving control unit 121 is carried out the drive controlling of near-infrared luminous source 105 and image-forming component 109.In addition, driving control unit 121 is adjusted the drive controlling of image-forming component 109 at least based on the relevant information of the amplitude of the thermonoise that sends with the thermal noise measurement unit of describing from behind 127.More specifically, driving control unit 121 is carried out the drive controlling of the frame rate of light-receiving time (shutter speed) of image-forming component 109 and image-forming component 109 based on predetermined synchronizing signal.Driving control unit 121 can be carried out the emission sequential drive controlling relevant with emissive porwer with the near infrared light in near-infrared luminous source 105.

More specifically, about the control of image-forming component 109, it is the drive controlling of unit control along such image-forming component 109 of the pixel of a certain direction of image-forming component 109 with the pixel count that driving control unit 121 is carried out along the drive controlling conduct of a certain direction of image-forming component 109.In other words, on the sectional view of getting according to a certain direction of the image-forming component 109 of present embodiment, think that image-forming component 109 comprises for example 7 pixels.In this case, driving control unit 121 is by carrying out drive controlling along on the direction of this profile line pixel being divided into 7 groups.

Driving control unit 121 when control near-infrared luminous source 105 and image-forming component 109, various parameters and database in the storage unit of can reference record describing in the back 141.

[about the example of the structure of image-generating unit]

Next, with reference to the example of Fig. 2 to Fig. 6 detailed description according to the structure of the image-generating unit of present embodiment.

Micro lens array 101 according to the vein imaging apparatus 10 of present embodiment for example comprises that as shown in Figure 2 a plurality of micro lens 103 are the light-receiving camera lens, and micro lens 103 is arranged on the predetermined plate with comb mesh pattern.Each micro lens 103 for example will guide to the image-forming component of describing later 109 (pixel 111 of image-forming component 109 particularly) by the vein transmitted light that the plane of incidence enters into this micro lens 103 as shown in Figure 3.Micro lens array 101 be field curvature little and on depth direction undistorted lens array, therefore by using this micro lens array 101 can obtain suitable view data.The focal position of each micro lens 103 of formation micro lens array 101 is set at the position as vein layer imageable target, that have vein V of vein imaging apparatus 10.

Known human skin has the 3-tier architecture that comprises epidermal area, skin corium and hypodermis layer, and above-mentioned vein layer is present in the skin corium.Skin corium is positioned at about 0.1mm to 0.3mm place under the finger surface and has the thickness of about 2mm to 3mm.Thus, be set in the position (for example, finger surface is the position of about 1.5mm to 2.0mm down) that skin corium exists, can converge the light that the vein layer is passed in transmission efficiently by focal position with micro lens 103.

In addition, the quantity that is arranged in according to the micro lens 103 in the micro lens array 101 of present embodiment is not limited to example shown in Figure 2.Be arranged in according to the quantity of the micro lens 103 in the micro lens array 101 of present embodiment and can freely set according to the size of the biosome of wanting imaging, the size of image-forming component 109 etc.

For example be arranged in the opposing ends place of micro lens array 101 as shown in Figure 2 as a plurality of light emitting diodes of the example in near-infrared luminous source 105.The end that is arranged with light emitting diode is preferably corresponding to the top and bottom of the part of biosome (in Fig. 2 and example shown in Figure 3 is finger F G).By arranging light emitting diode by this way, can be from the emission of the direction up and down near infrared light of finger F G.

In addition, be not limited to example shown in Figure 2 according to the quantity in the near-infrared luminous source 105 of present embodiment, but can freely set according to the size of micro lens array 101, the emitting area in near-infrared luminous source 105 etc.

In addition, directivity control panel 107 is placed between micro lens array 101 and the near-infrared luminous source 105, for example as shown in Figures 2 and 3.These directivity control panel 107 controls are from the directivity of the direct sunshine 12 of near-infrared luminous source 105 emissions, so that direct sunshine 12 does not directly enter into the micro lens 103 of micro lens array 101.

The near infrared light of launching from near-infrared luminous source 105 for example propagates into the surface of finger F G as shown in Figure 3 upward, and enters in the finger F G as direct sunshine 12.Because human body is the suitable scatterer of near infrared light, so the direct sunshine 12 that enters in the finger F G is propagated scattering on all directions simultaneously.The part of this scattered light is surperficial to finger from countermarch by above-mentioned vein layer as back scatter light 13, and sees through vein V on the way.The vein transmitted light that sees through vein enters into each micro lens 103 that constitutes micro lens array 101.

Herein, directivity control panel 107 is placed on the boundary of 103 on neighboring micro head.This directivity control panel 107 makes the directivity that can control the vein transmitted light, and the light that enters into each micro lens 103 can separate with adjacent micro lens 103.Thereby, in vein imaging apparatus 10, can select to converge in the vein transmitted light on the image-forming component 109 (particularly, pixel 111) according to present embodiment.

[about the image that obtains by the micro lens array]

Next, describe the feature of the image that obtains by the micro lens array in detail with reference to Fig. 4 A and Fig. 4 B.Fig. 4 A and Fig. 4 B are the key diagrams that is used to illustrate the image of being taken by the micro lens array.

Usually, if a certain image is taken by using the micro lens array, then for example shown in Fig. 4 A, captured image is the image of putting upside down respectively with respect to its upper and lower sides of original image and left and right sides.In addition, because a plurality of pixel 111 is assigned to a light-receiving camera lens (micro lens 103), so produce the image that upper and lower sides and left and right sides are put upside down at whole pixels 111 of distributing to a micro lens 103.For example, shown in Fig. 4 B,, then produce the image that upper and lower sides and left and right sides are put upside down at each of 9 pixels 111 if the individual pixel 111 in 9 (3 * 3) is assigned to a micro lens 103.

As described later, carry out the interpolation processing of image by the view data of each generation of a plurality of pixels 111 corresponding with one of micro lens 103 according to vein imaging apparatus 10 uses of present embodiment.

[about image-forming component]

Next, describe image-forming component 109 in detail with reference to Fig. 5 and Fig. 6 A to Fig. 6 C according to the vein imaging apparatus 10 of present embodiment.Fig. 5 and Fig. 6 A to Fig. 6 C are the key diagrams that is used to illustrate according to the image-forming component of present embodiment.

In the image-forming component 109 according to the vein imaging apparatus 10 of present embodiment, the zones that form pixels 111 in the image-forming component 109 for example are divided into two zones 151 and 153 as shown in Figure 5.One of them zone 151 is the vein image data generation districts that are used to generate the vein image data.Another zone 153 is that the thermonoise output data that generates the thermonoise output data of the amplitude be used to estimate thermonoise generates the district.

Generate in the district 151 in the vein image data, a plurality of pixel (not shown) are arranged in array, and the vein transmitted light that is converged by a plurality of micro lens 103 of micro lens array 101 arrives pixel 111.The vein image data that generated district's 151 outputs by the vein image data are and the relevant data of the light intensity that pixel detected that generate this view data.

Generate in the district 153 in the thermonoise output data, a plurality of pixel (not shown) are arranged in array.As shown in Figure 5, the thermonoise output data generates district 153 and is blocked by for example photomask 155, does not generate district 153 so that exterior light can not enter into the thermonoise output data.Therefore, the data that generate district's 153 outputs from this thermonoise output data are not the data that generate as the result who exterior light is detected by the pixel that comprises this zone, but with depend on equipment in temperature or ambient temperature and the relevant data of thermonoise that produce.The size that is arranged on the thermonoise output data generation district 153 on this image-forming component 109 can be determined according to the size of the micro lens array 101 that uses with image-forming component 109.

For example, as shown in Figure 5, one side above-mentioned thermonoise output data generation district 153 can be along an end that is arranged on image-forming component 109 of image-forming component 109.Perhaps, shown in Fig. 6 A and Fig. 6 B, the thermonoise output data generates district 153 and can be provided with along the relative edge of image-forming component 109 or can be provided with along 4 limits of image-forming component 109 shown in Fig. 6 C.

[about the configuration of graphics processing unit]

Next, return with reference to Fig. 1.With the configuration of detailed description according to the graphics processing unit of the vein imaging apparatus 10 of present embodiment.

Pixel data cutting unit 123 is realized by for example CPU, ROM and RAM.As shown in Figure 7, for example, pixel data cutting unit 123 is based on judging from the pulse that is used for scanning imagery element 109 of driving control unit 121 input the pixel data that sends from image-forming component 109 is from which output in two zones of image-forming component 109.As illustrated in Figure 7,, use three kinds of pulses in order to obtain output from two zones of image-forming component 109, pulse is obtained in pulse, the thermonoise output of usefulness synchronously, the vein image data are obtained pulse on vertical (or level) direction of pixel spare.Therefore, pixel data cutting unit 123 can judge that sending the thermonoise output data still is to send the vein image data according to these pulses.

Pixel data cutting unit 123 obtains the thermonoise output pretreatment unit 125 that pulse is described later for the data (being the thermonoise output data) that obtain in high (Hi) state time period are sent to thermonoise output.In addition, will to be used to obtain the pulse of vein image data be that the data (being the vein image data) that obtain in the high state time period are sent to the pixel selection unit of describing later 133 to pixel data cutting unit 123.

Thermonoise output pretreatment unit 125 is by for example realizations such as CPU, ROM, RAM.125 pairs of thermonoise output datas that send from pixel data cutting unit 123 of thermonoise output pretreatment unit are carried out pre-service so that the thermal noise measurement unit of describing later 127 can be handled thermonoise quantitatively.Above-mentioned pretreated example comprises that the accumulated process of thermonoise output data of the predetermined amount of time that adds up and the peak that the thermonoise output data is carried out handle.Thermonoise output pretreatment unit 125 can be implemented at least one in accumulated process and the peak processing.Perhaps, thermonoise output pretreatment unit 125 can implement accumulated process and both are handled in the peak, and can comprise the pre-service beyond these processing.

The thermonoise output data that generates district's 153 outputs from the thermonoise output data is time dependent unsettled output.The numerical stability of the expression thermonoise output by carrying out above-mentioned processing, can make comprising in the thermonoise output data is in the degree that can be estimated quantitatively.Thus, can improve the precision of the measurement processing of being undertaken by the thermal noise measurement unit of describing later 127.

Thermonoise output data generation district 153 will carry out pretreated thermonoise output data and be sent to thermal noise measurement unit 127.

Thermal noise measurement unit 127 is by for example realizations such as CPU, ROM, RAM.The thermonoise output data that is sent by thermonoise output pretreatment unit 125 is analyzed in thermal noise measurement unit 127, and measures the amplitude of the thermonoise that produces in the image-forming component 109.Thermal noise measurement unit 127 is sent to driving control unit 121 and temperature estimation unit 129 with the measurement result of thermonoise as thermonoise information.

Driving control unit 121 can reduce the driving frequency of image-forming component 109 according to the amplitude of 127 thermonoises that send from the thermal noise measurement unit, and may be controlled to the light-receiving time (being shutter speed) and the frame rate of pixel spare 109.Along with thermonoise increases, from the S/N (noise) of the data of image-forming component 109 outputs than reducing.Thereby, the driving frequency that driving control unit 121 can be by reducing image-forming component 109, increasing the light-receiving time and the frame rate that slows down, the S/N that prevents the data-signal that caused by thermonoise is than reducing.

Temperature estimation unit 129 is by for example realizations such as CPU, ROM, RAM.Temperature estimation unit 129 comes estimating apparatus to carry out the temperature (imaging temperature) of imaging processing based on promptly relevant with the amplitude of 127 thermonoises that send from the thermal noise measurement unit information of thermonoise information.Herein, the temperature that vein imaging apparatus 10 carries out imaging processing can be that the external temperature of the position of vein imaging apparatus 10 is installed, and perhaps can be the temperature that vein imaging apparatus 10 reaches.Temperature estimation unit 129 has the amplitude that includes in image-forming component 109 thermonoise that produces and carries out corresponding relation between the temperature of imaging processing at interior database.Temperature estimation unit 129 is based on the amplitude Estimation temperature of this database root according to thermonoise.Database can be expressed this corresponding relation by representing the relationship expression between these two parameters.

For example, while above-mentioned database can be in the production run of vein imaging apparatus 10 measures the amplitude of the thermonoise that is produced and generate by changing temperature.The database of Sheng Chenging comprises the feature of each vein imaging apparatus 10 distinctive thermonoises like this, thus thermonoise that accurately produces in the estimating apparatus and the relation between the temperature.

Temperature estimation unit 129 can be estimated from the reduction of the S/N ratio of the data-signal of image-forming component 109 output based on the estimated result of temperature.The result of the evaluation experimental that concerns usefulness between for example, temperature that the degree of the reduction of this S/N ratio can be when using for clear and definite mounting equipment and S/N compare etc. and generate database in advance and estimate by the database that uses such generation.

Temperature estimation unit 129 is sent to warning unit 131, pixel selection unit 133, vein image interpolation unit 135 and the vein pattern extraction unit 137 described later with the estimated result (for example representing that Current Temperatures is 70 ℃ a information) of temperature.When temperature estimation unit 129 was estimated the degree of for example S/N ratio reduction, temperature estimation unit 129 can send the estimated result of estimated result (for example the expression expection reduces the information of about 10dB) and temperature.

Warning unit 131 is by for example realizations such as CPU, ROM, RAM.Warning unit 131 is with reference to the estimated result of the temperature that sends from temperature estimation unit 129 etc., and when the temperature of vein imaging apparatus 10 or ambient temperature are equal to or higher than predetermined threshold, warning unit 131 judges that being difficult to carry out normal vein imaging handles (and even vena identification processing), thus the output warning.

In addition, when the authentication ' unit 139 described from behind of warning unit 131 receive expression from the authentification failure of the vein pattern of a certain user's acquisition when pre-determined number or more information, warning unit 131 can judgment device self be in the environment that not permission equipment carries out operate as normal, thereby can export warning.

In addition, judge that when warning unit 131 temperature reach equipment and can not carry out normal vein imaging when handling the level of (and even vena identification processing), the vein imaging that warning unit 131 can stop being implemented by equipment self is handled and the vena identification processing.

Pixel selection unit 133 is by for example realizations such as CPU, ROM, RAM.The pixel of the vein image data be used to generate vein image is selected to generate in pixel selection unit 133 from a plurality of pixels 111 corresponding with one of micro lens 103.Describing the pixel selection of being carried out pixel selection unit 133 hereinafter with reference to Fig. 8 handles.Fig. 8 is used for the key diagram that pixel selection that pixels illustrated selected cell 133 carried out is handled.

Fig. 8 shows following situation: a micro lens 103 in the micro lens array 101 is corresponding to 8 * 8=64 pixel 111, and micro lens 103 is the camera lenses that the size of object dwindled half.In this case, the size of object is contracted to half size.Thereby by using 4 * 4=16 the pixel that is positioned at middle body in 64 pixels can obtain the view data of object.Even in this case, also focus on from the light of object on the pixel beyond the pixel of middle body, the view data of the part acquisition beyond 4 * 4=16 the pixel of middle body also can be used for the product volume image.

At this moment, serve as the reference cell zone of reference cell of pixel selection as mentioned above because the multiplying power of micro lens 103 is the zones that comprise 4 * 4=16 pixel.In addition, if there is not the deviation etc. of image focusing position, then the light that is converged by micro lens 103 focuses on the part of central authorities basically of 8 * 8=64 pixel.Thereby 4 * 4 pixels of middle body are selected to be positioned in pixel selection unit 133 from 8 * 8 pixels corresponding with one of micro lens 103.

In addition, pixel selection unit 133 is with reference to the estimated result of the temperature that sends from temperature estimation unit 129, and when expection from the S/N of the data-signal of pixel 111 output when reducing, the reference cell zone is also selected to be positioned at and detect the pixel of light on every side in pixel selection unit 133.

Pixel selection unit 133 will be sent to the vein image interpolation unit of describing later 135 about the information (for example being used to specify the information of selected pixel) of the pixel of such selection and the vein image data that obtain from selected pixel.

Vein image interpolation unit 135 is by for example realizations such as CPU, ROM, RAM.Vein image interpolation unit 135 is based on the 133 vein image data that send generate vein image from the pixel selection unit.In addition, vein image interpolation unit 135 is based on about the information of the temperature that sends from temperature estimation unit 129 (information of expression temperature, about the estimated result of the reduction of S/N ratio etc.) vein image that is generated being carried out interpolation processing.

When generating vein image, vein image interpolation unit 135 is proofreaied and correct the output valve that comprises the vein image data based on the information about temperature that sends from temperature estimation unit 129.More specifically, vein image interpolation unit 135 does not use the output valve itself that comprises in the vein image data to generate image, carries out the correction of output valve and be based on following formula 1.

Output valve after the correction=(data output valve-black-level reference value)/(white level reference value-black-level reference value) (expression formula 1)

In above-mentioned expression formula 1, when the black-level reference value is a image imaging as 109 pairs of simple black of pixel spare from the output valve of the data of image-forming component 109 outputs, and the white level reference value when being image imaging as 109 pairs of simple whites of pixel spare from the output valve of the data of image-forming component 109 outputs.In above-mentioned expression formula 1, the output valve of data is by the output valve of the data of image-forming component 109 outputs when 109 pairs of object image-formings of pixel spare.

When the imaging temperature uprised, with respect to the ratio increase of data output valve thermonoise, thereby the contrast of image reduced, and general image bleaches.Given this problem changes the value of black-level reference value according to the vein image interpolation unit 135 of present embodiment based on the information about temperature that sends from temperature estimation unit 129, and automatically prevents the image degradation that the increase by thermonoise causes.More specifically, in above-mentioned expression formula 1, the correction coefficient of the black-level reference value when being multiplied by normal temperature is set, and the value of this correction coefficient is adjusted in vein image interpolation unit 135 based on the information about temperature that sends from temperature estimation unit 129.

The example of the interpolation processing of being undertaken by vein image interpolation unit 135 comprises the noise reduction process of the vein image that is generated.Perhaps, vein image interpolation unit 135 can carry out Integral Processing to a plurality of two field pictures and be used to improve the processing of the image quality of vein image according to the information about temperature that sends from temperature estimation unit 129.When a plurality of two field pictures are carried out integration, handle and to spend more time, thereby the user of vein imaging apparatus 10 must wait for the longer time.Yet, can limit because of environment temperature etc. cause can not be to the generation of the situation of vein imaging (and even can not carry out vena identification and handle).

In addition, vein image interpolation unit 135 can for example use many taps interpolation filter to carry out following interpolation processing according to the information about temperature that sends from temperature estimation unit 129.As shown in Figure 8, the view data that vein image interpolation unit 135 can not only use the pixel that comprises from the reference cell zone to obtain is also used from being positioned at around the reference cell zone and detecting the interpolation processing (the synthetic processing) that view data that the pixel of light obtains is carried out vein image.Make at S/N than increase the image quality (S/N ratio) that also can improve vein image when reducing with thermonoise even more than handle.

The vein image that vein image interpolation unit 135 will carry out interpolation processing is sent to the vein pattern extraction unit of describing later 137.

[about the configuration of authentication processing unit]

Vein pattern extraction unit 137 is by for example realizations such as CPU, ROM, RAM.Vein pattern extraction unit 137 has for example to 135 vein images that send carry out pretreated function, the function of extraction vein pattern and the function of carrying out the aftertreatment of vein pattern extraction that vein pattern extracts from the vein image interpolation unit.

The pretreated example that above-mentioned vein pattern extracts comprises the processing of which position that the profile that detects finger from vein image and identification finger are positioned at vein image and uses the profile of detected finger to rotate captured image and proofread and correct the processing of the angle of captured image.

The extraction of above-mentioned vein pattern is by the profile detection is handled and the captured image applications difference filter of angle correction procedure carries out to having finished.Difference filter is the wave filter of the bigger value of the big part place output of the difference between pixel of being paid close attention to and neighbor as output valve.In other words, difference filter is that the computing of the difference by using the pixel paid close attention to and the gray-scale value between its neighbor strengthens the line in the image or the wave filter at edge.

Usually, if use wave filter h (x, y) to the grid point on the two dimensional surface (x, y) as the view data u of variable (x y) carries out filtering, then shown in following formula 2, generate view data v (x, y)." * " expression convolution integral in expression formula 2.

$v(x,y)=u(x,y)*h(x,y)$

$=\underset{m_1}{\mathrm{\Σ}}\underset{m_2}{\mathrm{\Σ}}h(m_1,m_2)u(x-m_1,y-m_2)$

$=\underset{m_1}{\mathrm{\Σ}}\underset{m_2}{\mathrm{\Σ}}u(m_1,m_2)h(x-m_1,y-m_2)$ (expression formula 2)

In extraction, can use such as differential filters such as primary space differential filter or quadratic space differential filters as above-mentioned difference filter according to the vein pattern of present embodiment.The primary space differential filter is the wave filter that calculates the difference of the gray-scale value between the adjacent pixels on the pixel paid close attention to and horizontal direction and the vertical direction, and the quadratic space differential filter is the wave filter for the big part of the variable quantity of the difference of the pixel extraction gray-scale value of being paid close attention to.

Can use following Gauss Laplce (LOG) wave filter as the quadratic space differential filter.LOG wave filter (expression formula 4) is represented by the second derivative of Gaussian filter (expression formula 3), is promptly used the smoothing filter of Gaussian function.In following formula 3, σ represents the standard deviation of Gaussian function, promptly represents the variable of the level and smooth degree of Gaussian filter.In addition, the σ in the following formula 4 be with expression formula 3 in the parameter of standard deviation of same expression Gaussian function, and can change output valve when carrying out LOG filtering by the value that changes σ.

$h_{\mathrm{gauss}}(x,y)=\frac{1}{2{\mathrm{\π\σ}}^2}\exp \{-\frac{(x^2+y^2)}{2{\mathrm{\σ}}^2}\}$ (expression formula 3)

$h_{\mathrm{Log}}(x,y)={\▿}^2\·h_{\mathrm{gauss}}(x,y)$

$=(\frac{{\∂}^2}{{\∂x}^2}+\frac{{\∂}^2}{{\∂y}^2})h_{\mathrm{gauss}}$

$=\frac{(x^2+y^2-2{\mathrm{\σ}}^2)}{2{\mathrm{\π\σ}}^6}\exp \{-\frac{(x^2+y^2)}{{2\mathrm{\σ}}^2}\}$ (expression formula 4)

The example of the aftertreatment that above-mentioned vein pattern extracts comprises threshold process, binary conversion treatment and the thinning processing that the captured image of having used differential filtering is carried out.After above aftertreatment, can extract the profile of vein pattern.

Can change the filter characteristic (for example, the coefficient value in each expression formula of expression wave filter) of above-mentioned wave filter according to the information that sends from temperature estimation unit 129 about temperature according to the vein pattern extraction unit 137 of present embodiment.As mentioned above, vein image interpolation unit 135 carries out suitable image interpolation process according to the increase of the thermonoise that is caused by high temperature.Because this interpolation processing, the situation that the extraction that may adopt still the wave filter of setting in the mode that is used for extracting at normal temperatures vein pattern can't carry out suitable vein pattern is handled.Given this problem, vein pattern extraction unit 137 changes filter characteristic according to the information about temperature, even also can extract suitable vein pattern thus from the image of at high temperature taking.

Vein pattern that vein pattern extraction unit 137 will extract like this and profile are sent to the authentication ' unit of describing later 139.In addition, vein pattern extraction unit 137 can be stored in vein pattern and the profile that extracts in the storage unit of describing later 141.Vein pattern extraction unit 137 can also be stored in the storage unit 141 carrying out the parameter that generates when each is handled, the progress of processing etc.

Authentication ' unit 139 is by for example realizations such as CPU, ROM, RAM.Authentication ' unit 139 compares by the vein pattern that will be generated by vein pattern extraction unit 137 and registered template vein pattern is authenticated.

Vein pattern authentication unit 139 authenticates the vein pattern that is generated based on the vein pattern that is generated by vein pattern extraction unit 137 and the template of registered vein pattern.The storage unit 141 that 139 requests of vein pattern authentication unit are described later discloses the vein patterns of being registered, and registration vein pattern that is obtained and the vein pattern that transmits from vein pattern extraction unit 137 are compared.Comparison between the vein pattern of registering vein pattern and being transmitted can for example be carried out based on the related coefficient of following calculating.Judge that in result as a comparison authentication ' unit 139 is judged the authentication success of the vein pattern that is sent under registration vein pattern and the similar situation of vein pattern that is sent.When judging that registration vein pattern and the vein pattern that is sent are not similar, authentication ' unit 139 is judged authentification failure.

Related coefficient is by following formula 5 definition, and it is two data x={x of expression _iAnd y={y _iBetween the statistics index of similarity, be from-1 to 1 real number value.If related coefficient is designated as the value near 1, mean that then two data are similar, and if related coefficient is designated as the value near 0, then mean 2 data dissmilarities.In addition, if related coefficient is designated as approaching-1 value then means the opposite in sign of two data.

$r=\frac{\underset{i}{\mathrm{\Σ}}(x_i-\stackrel{\‾}{x})(y_i-\stackrel{\‾}{y})}{\sqrt{\underset{i}{\mathrm{\Σ}}{(x_i-\stackrel{\‾}{x})}^2}\sqrt{\underset{i}{\mathrm{\Σ}}{(y_i-\stackrel{\‾}{y})}^2}}$ (expression formula 5)

: the mean value of data x

: the mean value of data y

In addition, authentication ' unit 139 can constantly wait authentication result with authentication and associate, and with authentication result as the authentication historical record in storage unit 141.Historical by generating above authentication, can know who has asked vein pattern authentication and requestor when to ask vein pattern authentication, but also know who has used vein imaging apparatus 10 and user when to use vein imaging apparatus 10.

In addition, when the authentification failure of the vein pattern that obtains from a certain user pre-determined number or more for a long time, authentication ' unit 139 will represent that failed pre-determined number or more message of authentication processing is sent to and warns unit 131.By this information being sent to warning unit 131, when judging because thermal expansions that environment temperature causes etc. and can not carry out normal vena identification when handling can warn the user of vein imaging apparatus 10 normally not authenticate.

The user's of storage unit 141 storage vein imaging apparatus 10 registration vein pattern with other related data of registration vein pattern.Except these data, vein image that storage unit 141 also can store the vein image data that generated by image-generating unit, generated by vein image interpolation unit 133 and the vein pattern that extracts by vein pattern extraction unit 137 etc.In addition, in storage unit 141, can store necessary various programs, data etc. in the interpolation processing of carrying out vein image interpolation unit 135.In addition, except these data, storage unit 141 also can be stored various parameters or the progress of processing, the various databases etc. that need store when vein imaging apparatus 10 carries out a certain the processing.This storage unit 141 can freely be read and write by the each processing unit that comprises in image-generating unit, graphics processing unit and the authentication processing unit.

[about obtaining data] from specific pixel

Describe the method that obtains data from specific pixel in detail hereinafter with reference to Fig. 9 and Figure 10.Fig. 9 and Figure 10 are used to illustrate the key diagram that obtains the method for data from specific pixel.

Image-forming component 109 according to the vein imaging apparatus 10 of present embodiment is sandwich type elements.For example, to show image-forming component 109 are examples by 3 layers of this situation of sandwich type element that constitutes to Fig. 9.

In the vein imaging apparatus 10 according to present embodiment, image-forming component 10 vertically promptly carries out line scanning along the direction of y axle among the figure along finger.Below will be called vertical direction, will promptly be called horizontal direction with the direction of vertical direction quadrature along the direction of x axle among the figure along the direction of y axle among the figure.

As shown in Figure 9, in the vein imaging apparatus 10 according to present embodiment, view data is exported along the time shaft of vertical synchronization with horizontal behavior unit by driving control unit 121.In other words, export to the data sync of the pixel that some along continuous straight runs is arranged ground floor shown in Figure 9 to, the data of the pixel that some along continuous straight runs is arranged export the second layer to, and the data of the pixel that some along continuous straight runs is arranged export the 3rd layer to.By this way, according to the control of driving control unit 121, image-forming component 109 can be exported by multilayer.

Therefore, pixel selection unit 133 can be sent to driving control unit 121 with the information about the pixel that will select, and driving control unit 121 can be selected the output of certain one deck gained of sandwich type element, and by the specific pixel on the sequential control selection horizontal line.

In the example depicted in fig. 9, the method that separately drives the vertical synchronization row has been described.Perhaps as shown in figure 10, also can in horizontal line, separate driving by means of circuit.

In the example depicted in fig. 10, on same horizontal line, there are 3 kinds of pixels 111, are about to data and export the pixel of first flat seam to, export data the pixel of second flat seam to and data are exported to the pixel of the 3rd flat seam.Therefore, the output of certain one deck gained by selecting sandwich type element also is used to select the sequential control of specific pixel on the vertical row, and driving control unit 121 can be provided by the data that provided by any pixel.

Perhaps, the separately driving and interior the separating of horizontal line that can be used in combination in the vertical row drives.

Example according to the function of the vein imaging apparatus 10 of present embodiment has below been described.Above-mentioned each element can use general assembly or circuit to constitute, perhaps can by the function of each element special-purpose hardware constitute.In addition, the function of each element can be fully by realizations such as CPU.Thereby can the technical merit when realizing present embodiment suitably change the configuration that to use.

In addition, can write the computer program that is used to realize according to above-mentioned each function of the vein imaging apparatus of present embodiment, and in the personal computer that can control imaging device etc., realize this computer program with micro lens array, near-infrared luminous source and image-forming component.The computer readable recording medium storing program for performing of storage aforementioned calculation machine program can also be set.Recording medium can be for example disk, CD, magneto-optic disk and flash memory.Perhaps, aforementioned calculation machine program service recorder medium but not via net distribution.

Can in such as the messaging device of computing machine or server etc., such as portable terminals such as portable phone or PHS or portable information terminal (PDA), ATM (Automatic Teller Machine) (ATM), Access Management Access equipment, implement according to the vein imaging apparatus 10 of present embodiment.In addition, can on various devices such as controller, implement according to the vein imaging apparatus 10 of present embodiment such as game machine, game machine.

In the above description, suppose that the registration vein pattern of before having registered as template is recorded in the vein imaging apparatus 10.Perhaps, the registration vein pattern can be stored in such as in recording mediums such as dvd media, blu-ray media, compact flash (registered trademark), memory stick or SD storage card, the IC-card that is equipped with non-contact type IC chip or the electronic equipment etc., perhaps can be stored in via being connected in the server of vein imaging apparatus 10 such as communication networks such as internets.

＜about vein image interpolation method 〉

Next, describe the vein image interpolation method performed in detail with reference to Figure 11 according to the vein imaging apparatus of present embodiment.Figure 11 is the process flow diagram that is used to illustrate according to the vein image interpolation method of present embodiment.

At first, the user of vein imaging apparatus 10 will be placed on the micro lens array 101 of vein imaging apparatus 10 such as the part of biosomes such as finger.The image-generating unit of vein imaging apparatus 10 is carried out the imaging processing (step S101) to the part of the biosome that is placed on it.

In addition, the thermonoise of vein imaging apparatus 10 output pretreatment unit 125 is at the data that generate district's 153 outputs from the thermonoise output data of image-forming component 109, the accumulated process of the thermonoise output data of the predetermined amount of time that is used to add up and the peak that the thermonoise output data is carried out handled.In addition, thermal noise measurement unit 127 carries out the measurement processing (step S103) of thermonoise based on the thermonoise output data that sends from thermonoise output pretreatment unit 125.Thermal noise measurement unit 127 is sent to driving control unit 121 and temperature estimation unit 129 with the measurement result of thermonoise.Herein, driving control unit 121 is carried out the drive controlling (step S105) of image-forming component 109 according to the measurement result of the thermonoise that is sent.

After this, temperature estimation unit 129 is estimated as the temperature (step S107) the processing procedure based on the measurement result of 127 thermonoises that send from the thermal noise measurement unit.In addition, temperature estimation unit 129 can also be estimated the reduction degree of S/N ratio based on estimated temperature.Temperature estimation unit 129 is sent to warning unit 131, pixel selection unit 133, vein image interpolation unit 135 and vein pattern extraction unit 137 interior with information temperature correlation with temperature estimated result and the estimated result etc. that comprises the reduction degree of S/N ratio.

The estimated result of the 131 pairs of temperature in warning unit that are sent to about the information of temperature judges (step S109), and judges whether temperature surpasses the threshold value that needs warning.When temperature reached the level that needs warning, vein imaging apparatus 10 was exported warning (step S111) on display screen.

When temperature did not also reach the level that needs warning, pixel selection unit 133 was handled based on the selection about the information and executing pixel of temperature that receives.More specifically, pixel selection unit 133 is at each micro lens 103 that constitutes micro lens array 101, from corresponding to the pixel of selecting output to be used to generate the view data of vein image a plurality of pixels of one of micro lens 103.

Next, vein image interpolation unit 135 generates vein image by using the view data that 133 selected pixels obtain from the pixel selection unit, after this, vein image interpolation unit 135 carries out image interpolation process (step S113) according to the temperature in the imaging processing process to the vein image that is generated.More specifically, vein image interpolation unit 135 carries out the interpolation processing of image of Integral Processing, noise reduction process and the use neighborhood pixels of a plurality of two field pictures.

When having finished the interpolation processing of image, the vein image that vein image interpolation unit 135 will carry out interpolation processing is sent to vein pattern extraction unit 137.The temperature change of vein pattern extraction unit 137 by according to imaging the time is used to extract the filter characteristic of the wave filter of vein pattern, from the vein image that is sent, extract vein pattern (step S115), and the vein pattern that is extracted is sent to authentication ' unit 139.

Authentication ' unit 139 is by using the vein pattern that sends from vein pattern extraction unit 137 and being stored in registration vein pattern (template) storage unit 141 grades, carries out the authentication processing (step S117) of the vein pattern that sent.

According to said process, can be automatically interpolation be carried out in the deterioration of the image quality that caused by the thermonoise under the high temperature.

In the above description, carrying out the measurement processing of thermonoise and the estimation of the temperature in the imaging processing process after the imaging processing of biosome handles.Perhaps, vein imaging apparatus 10 can carry out the measurement processing of thermonoise and the estimation processing of the temperature in the imaging processing process in advance before the imaging processing of carrying out biosome.

＜about hardware configuration 〉

Describe the hardware configuration of vein imaging apparatus 10 according to an embodiment of the invention in detail hereinafter with reference to Figure 12.Figure 12 is used to illustrate the block diagram of the hardware configuration of vein imaging apparatus 10 according to an embodiment of the invention.

Vein imaging apparatus 10 comprises micro lens array 101, near-infrared luminous source 105 and image-forming component 109, and in addition, vein imaging apparatus 10 also comprises CPU 901, ROM 903 and RAM 905.In addition, vein imaging apparatus 10 also comprises host bus 907, bridge 909, external bus 911, interface 913, input media 915, output unit 917, memory storage 919, driver 921, connectivity port 923 and communicator 925.

CPU 901 is as processing unit and control module, and its controls all or part of operation in the vein imaging apparatus 10 according to the various programs in ROM 903, RAM905, memory storage 919 or the removable recording medium 927 of being stored in.ROM 903 storage CPU 901 employed programs, processing parameter etc.The parameter that the main storage of RAM 905 CPU 901 are in operation employed program, change in operational process etc.CPU 901, ROM 903 and RAM 905 are by interconnecting as the host bus 907 such as the internal bus of cpu bus etc.

Host bus 907 is connected to such as external buss 911 such as periphery component interconnection/interface (PCI) buses via bridge 909.

Input media 915 be for example mouse, keyboard, touch panel, button, switch and control lever etc. by the operating means of user operation.In addition, input media 915 can be to use the remote control (perhaps telepilot) of infrared ray or other radiowave, or with the operation compatibility of vein imaging apparatus 10, such as external connection devices such as portable phone or PDA 929.In addition, input media 915 for example comprises based on the information of being used the input of aforesaid operations device by the user and generates input signal and export it input control circuit of CPU 901 to.The user of vein imaging apparatus 10 can or provide the instruction of handling operation to the vein imaging apparatus 10 various data of input by operating this input media 915.

Output unit 917 comprises and can or acoustically the information that obtains be notified to user's equipment from vision.The example of this equipment comprises such as display device such as CRT display device, liquid crystal indicator, plasm display device, EL display device or lamps, such as voice output or printer, portable phone or facsimile recorders such as loudspeaker or earphones.The result that the various processing that output unit 917 outputs are for example undertaken by vein imaging apparatus 10 obtain.Particularly, the display device result that will be obtained by the various processing of vein imaging apparatus 10 is shown as text or image.Voice output will comprise voice data, sound data of regeneration etc. and be transformed into simulating signal and with its output at interior voice signal.

Memory storage 919 is configuration devices that are used for data storage as the example of the storage unit of vein imaging apparatus 10.Memory storage 919 can comprise such as hard disk drive magnetic memory apparatus such as (HDD), semiconductor storage, light storage device, magneto optical storage devices etc.These memory storage 919 storages are for example by program, the various data of CPU 901 operations or the various data of obtaining from the outside.

Driver 921 is read/write devices of using for recording medium, and it is built in or is connected to vein imaging apparatus 10.Driver 921 reading and recording export RAM905 to such as the information in the removable recording mediums 927 such as disk, CD, magneto-optic disk or semiconductor memory and with this information on connecting it.In addition, driver 921 information can be write connect on it such as in the removable recording mediums 927 such as disk, CD, magneto-optic disk or semiconductor memory.The example of removable recording medium 927 comprises dvd media, HD-DVD medium and blu-ray media.In addition, the example of removable recording medium 927 comprise compact flash (registered trademark) (CF), memory stick or secure digital (SD) storage card.In addition, removable recording medium 927 can be integrated circuit (IC) card or the electronic equipment that is equipped with non-contact type IC chip.

Connectivity port 923 is the ports that are used for device is connected directly to vein imaging apparatus 10.The example of connectivity port 923 comprises USB (universal serial bus) (USB) port, such as IEEE1394 port and small computer system interface (SCSI) ports such as i.Link.In addition, the example of connectivity port 923 comprises RS-232 port, optoacoustic terminal, HDMI (High Definition Multimedia Interface) (HDMI) port.By external connection device 929 is connected to connectivity port 923, vein imaging apparatus 10 can directly obtain various data or various data are offered external connection device 929 from external connection device 929.

Communicator 925 is the communication interfaces that for example are made of communicator that is used to be connected to communication network 931 etc.Communicator 925 can be the communication card that is used for wired or wireless Local Area Network, bluetooth or Wireless USB (WUSB).Perhaps, communicator 925 can be router, the router of Asymmetrical Digital Subscriber Line (ADSL) usefulness or the modulator-demodular unit of various communication usefulness that optical communication is used.This communicator 925 can be for example abideed by such as regulation agreements such as TCP/IP and is sent on the internet or with other communicator and received signal etc.In addition, the communication network 931 that is connected to communicator 925 comprises wired or wireless network etc., and can be internet, the LAN of family, infrared data communication (network), airwave communication, satellite communication etc.

The example that can realize according to the hardware configuration of the function of the vein imaging apparatus 10 of each embodiment of the present invention has below been described.Above-mentioned each element can use general assembly or circuit to constitute, perhaps can by the function of each element special-purpose hardware constitute.Therefore can the technical merit when realizing present embodiment suitably change the configuration that to use.

＜sum up

As mentioned above, according to each embodiment of the present invention, thereby be in authentication and the imaged vein imaging device that the such harsh and unforgiving environments of 70 degree for example Celsius also can carry out biosome as pixel spare even can realize the duty that obtains image-forming component automatically.By the duty of automatic acquisition image-forming component, can carry out self-adaptation drive method and picture signal and handle, and can not rely on temperature and realize being used for the Image Acquisition and the authentication processing of biological identification.

Image-forming component according to each embodiment of the present invention is used to generate the zone that also has the exterior light of blocking the imaging region of vein image data except having.By detecting the increase that noise (thermonoise) in this zone detects the noise that is caused by working temperature.Because the vein imaging apparatus according to present embodiment can change with the relative temperature of detected Noise Estimation equipment, therefore can change the drive controlling method and the image-signal processing method of image-forming component according to this temperature information.

Can accurately carry out the accumulation process, picture signal processing of shutter speed and frame etc. by the noise level of measuring the special-purpose pixel that is equal to imageing sensor according to the vein imaging apparatus of each embodiment of the present invention.Can be arranged in the image-forming component owing to be used for the zone of detection noise, therefore can obtain the structure of the production cost of the equipment that do not influence.By importing dividually on the time about the data of noise and captured view data, thereby the driving circuit that is used to import about the data of noise also can be used to import captured view data.

It will be understood by those of skill in the art that according to designing requirement and other factors, can carry out various modifications, combination, sub-portfolio and change, as long as these modifications, combination, sub-portfolio and change are in the scope of claims or its equivalents.

The application comprises the relevant theme of disclosed theme among the patented claim JP 2009-117986 formerly with the Japan that was filed in Jap.P. office on May 14th, 2009, and the full content of described Japan patented claim formerly is incorporated herein by reference.

Claims (11)

1. vein imaging apparatus comprises:

Lens array, described lens array comprise a plurality of light-receiving camera lenses that are arranged as array;

Near-infrared luminous source, described near-infrared luminous source are arranged on the terminal of described lens array and launch near infrared light to the part of biosome;

Image-forming component, described image-forming component comprises:

The vein image data generate the district, are used for generating based on the near infrared light that is converged by described lens array, pass vein in described biosome inscattering and transmission the view data of described vein; And

The thermonoise output data generates the district, comprises that be thermonoise output by the pixel of shading and generation from described output valve by the output of the pixel of shading;

The amplitude of thermonoise is measured in thermal noise measurement unit, described thermal noise measurement unit based on the thermonoise output data that generates district's output from described thermonoise output data;

The temperature estimation unit, described temperature estimation unit is based on the imaging temperature of the imaging processing of being estimated to carry out described vein by the amplitude of the measured thermonoise in described thermal noise measurement unit; And

The vein image interpolation unit, described vein image interpolation unit uses the vein image data that generated by described vein image data generation district to generate vein image, and carries out the interpolation processing of described vein image based on the imaging temperature of being estimated by described temperature estimation unit.

2. vein imaging apparatus according to claim 1, wherein said vein image interpolation unit is based in the noise reduction process of the Integral Processing of the predetermined amount of time of being carried out described vein image by the estimated imaging temperature of described temperature estimation unit and described vein image at least one.

3. vein imaging apparatus according to claim 1,

Wherein, in described image-forming component, be arranged in a plurality of pixels that described vein image data generate the district one corresponding to described light-receiving camera lens, and

Wherein, described vein image interpolation unit uses from the vein image data that are positioned at the pixel output around the pixel of described vein image data that output is used to generate described vein image and carries out described interpolation processing.

4. vein imaging apparatus according to claim 2,

Wherein, in described image-forming component, be arranged in a plurality of pixels that described vein image data generate the district one corresponding to described light-receiving camera lens, and

Wherein, described vein image interpolation unit uses from the vein image data that are positioned at the pixel output around the pixel of described vein image data that output is used to generate described vein image and carries out described interpolation processing.

5. vein imaging apparatus according to claim 1, also comprise thermonoise output pretreatment unit, described thermonoise output pretreatment unit carries out pre-service to the described thermonoise output data that generates district's output from described thermonoise output data, so that described thermal noise measurement unit is handled described thermonoise quantitatively.

6. vein imaging apparatus according to claim 4, wherein said thermonoise output pretreatment unit carry out the predetermined amount of time that adds up described thermonoise output data accumulated process and the peak of described thermonoise output data handled at least one.

7. vein imaging apparatus according to claim 1 also comprises the driving control unit of carrying out the drive controlling of described image-forming component at least,

Wherein said driving control unit is based on controlling the light-receiving time of described image-forming component and at least one in the frame rate by the amplitude of the measured thermonoise in described thermal noise measurement unit.

8. vein imaging apparatus according to claim 1 also comprises the vein pattern extraction unit that extracts vein pattern from described vein image,

Wherein said vein pattern extraction unit is based on the filter characteristic that is changed the wave filter that is used to extract vein pattern by the estimated imaging temperature of described temperature estimation unit.

9. vein imaging apparatus according to claim 1 also comprises the warning unit, and described warning unit gives a warning when the imaging temperature by described temperature estimation unit output is equal to or higher than predetermined threshold.

10. vein image interpolation method may further comprise the steps:

Generate the amplitude that the thermonoise output data of exporting in the district is measured thermonoise based on the thermonoise output data from vein imaging apparatus, described vein imaging apparatus comprises:

Lens array, described lens array comprise a plurality of light-receiving camera lenses that are arranged as array;

Near-infrared luminous source, described near-infrared luminous source are arranged on the terminal of described lens array and launch near infrared light to the part of biosome; And

Image-forming component, described image-forming component comprise that the vein image data that generate the vein image data based on the near infrared light that is converged by described lens array, pass vein in described biosome inscattering and transmission generate the district and comprise by the pixel of shading and thermonoise output data that to generate from described output valve by the output of the pixel of shading be thermonoise output and generate the district;

Carry out the imaging temperature of the imaging processing of described vein based on the amplitude Estimation of measured thermonoise; And

Use generates vein image by the described vein image data that described vein image data generation district is generated, and carries out the interpolation processing of described vein image based on estimated described imaging temperature.

11. the following functional programs of computer realization of a feasible control vein imaging apparatus:

The thermal noise measurement function is based on generating the amplitude that the thermonoise output data of exporting in the district is measured thermonoise from the thermonoise output data;

The temperature assessment function is based on the imaging temperature of the imaging processing of estimating to carry out vein by the amplitude of the measured thermonoise of described thermal noise measurement function; And

The vein image interpolation function uses the vein image data that generated by vein image data generation district to generate vein image, and based on the interpolation processing of carrying out described vein image by the estimated described imaging temperature of described temperature assessment function,

Wherein said vein imaging apparatus comprises: lens array, described lens array comprise a plurality of light-receiving camera lenses that are arranged as array; Near-infrared luminous source, described near-infrared luminous source are arranged on the terminal of described lens array and launch near infrared light to the part of biosome; And image-forming component, described image-forming component comprises that the vein image data that generate the vein image data based on the near infrared light that is converged by described lens array, pass vein in described biosome inscattering and transmission generate the district and comprise by the pixel of shading and thermonoise output data that to generate from described output valve by the output of the pixel of shading be thermonoise output and generates the district.

Images