CN104902165B - Imaging device, regulating device and adjusting method - Google Patents

Imaging device, regulating device and adjusting method Download PDF

Info

Publication number
CN104902165B
CN104902165B CN201510094575.9A CN201510094575A CN104902165B CN 104902165 B CN104902165 B CN 104902165B CN 201510094575 A CN201510094575 A CN 201510094575A CN 104902165 B CN104902165 B CN 104902165B
Authority
CN
China
Prior art keywords
light
receiving element
image
region
filter unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201510094575.9A
Other languages
Chinese (zh)
Other versions
CN104902165A (en
Inventor
山中祐治
增田宪介
丸山刚
永井祥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ricoh Co Ltd
Original Assignee
Ricoh Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ricoh Co Ltd filed Critical Ricoh Co Ltd
Publication of CN104902165A publication Critical patent/CN104902165A/en
Application granted granted Critical
Publication of CN104902165B publication Critical patent/CN104902165B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/12Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/125Colour sequential image capture, e.g. using a colour wheel
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/71Circuitry for evaluating the brightness variation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/73Circuitry for compensating brightness variation in the scene by influencing the exposure time

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Spectrometry And Color Measurement (AREA)
  • Color Television Image Signal Generators (AREA)
  • Optical Filters (AREA)
  • Diffracting Gratings Or Hologram Optical Elements (AREA)
  • Studio Devices (AREA)

Abstract

A kind of imaging device, including filter unit, including the filtered region with different wave length selectivity;Light receiving element array, is configured to receive the light for being transmitted through filter unit;Storage unit, is configured to receive the position of the light of transmission on light receiving element array for each filtered region, storage location information, positional information instruction;Area detector, is configured to when light enters filter unit from object, is detected based on positional information, the corresponding image-region of light of detection and transmission from the image of light receiving element array output;And color detector, it is configured based on the output valve of image-region come the color of detection object.Positional information instruction indicates the registration between the spectral responsivity of each pixel and desired wavelength selectivity by using the position on the identified light receiving element array of spectral response registration, spectral response registration.A kind of regulating device and adjusting method are also provided.

Description

Imaging device, regulating device and adjusting method
Technical field
The present invention relates to there is the color of detection object imaging device, adjust imaging device regulating device with And adjusting method.
Background technology
Traditionally, it is known that a kind of imaging device, for example, such as the institute in 2013-214950 Japanese Laid-Open Patent Publication Disclosed, which is come from by spatially separating light into multiple light beams with different wavelength characteristics to receive The light of object, and export to include and correspond to by the image of the multiple regions of separated light beam.It is special in No. 2013-214950 Japan Open in the imaging device disclosed in patent gazette, filter unit is disposed in the microlens array of the configuration with full light camera Stage before, filter unit include multiple filtered regions with different wave length selectivity.Pass sequentially through filter unit and micro- The light of lens array transmission is by light receiving element array received, and output light field image, in light field image, corresponding to composition The topography (hereinafter referred to as " macroscopical pixel) of each lenticule of microlens array is arranged.
Each macroscopical pixel in light field image has multiple images corresponding with multiple filtered regions of filter unit Region.By being taken out from macroscopical pixel and rearranging the output valve for the image-region for being related to common filtered region, according to transmission By the intensity of the light beam of each filtered region, multiple images can be generated.For example, then it can be used for using multiple images The purpose of the color of detection object.
However, for example, in the imaging device disclosed in the announcement of 2013-214950 Japanese Laid-Open Patent, it is difficult to Accurately identify where correspond to each other with what filtered region in each macroscopical pixel in light field image, and have The problem of worrying the color of such as detection object.
It is therefore desirable to be able to accurately identification corresponds to the position of each filtered region of filter unit in image Imaging device, regulating device and adjusting method.
The content of the invention
The purpose of the present invention is solve the problems, such as at least in part in the conventional technology.
According to embodiment, there is provided a kind of imaging device, including:Filter unit, including with the more of different wave length selectivity A filtered region;Light receiving element array, is configured to receive the light and output image that are transmitted through filter unit;Storage is single Member, is configured to receive on light receiving element array for each filtered region, storage location information, positional information instruction It is transmitted through the position of the light of each filtered region;Area detector, is configured to when the light from object enters the list that filters When first, based on positional information, each filtered region is detected and is transmitted through from the image of light receiving element array output The corresponding image-region of light;And color detector, it is configured to the output valve based on the image-region detected, detectable substance The color of body.Indicate to connect by using the identified light of spectral response registration corresponding to the positional information of each filtered region The position on element is received, spectral response registration is indicated between the spectral responsivity of each pixel and desired wavelength selectivity Registration, when the monochromatic inspection light with different wavelength sequentially enters filter unit, based on light receiving element export One group of image calculate the spectral responsivity of each pixel.
According to another embodiment, there is provided a kind of regulating device for being used to adjust imaging device, imaging device include filtering Unit, light receiving element array and storage unit, filter unit include multiple filter areas with different wavelength selectivities Domain, light receiving element array are configured to receive the light and output image that are transmitted through filter unit, and storage unit is configured to For each filtered region, storage location information, positional information instruction receives on light receiving element array to be transmitted through often The position of the light of one filtered region.The regulating device includes:Photogenerator is examined, is configured so that with different wave length Monochrome examines light to sequentially enter the filter unit;Spectral response registration calculator, is configured to when inspection light enters filtering One group of image based on the output of light receiving element array during unit, calculates the spectral responsivity of each pixel, and calculates and refer to Show the spectral response registration of the registration between desired wavelength selectivity and spectral responsivity;And location indentifier, quilt It is configured to be transmitted through each filter on light receiving element array by using the spectral response registration obtained to identify The position of the light in light region, and the positional information for the position that storage instruction identifies is used as corresponding to each in the memory unit The positional information of a filtered region.
According to another embodiment, there is provided a kind of adjusting method for being used to adjust imaging device, imaging device include filtering Unit, light receiving element array and storage unit, filter unit include multiple filtered regions with different wave length selectivity, Light receiving element array be configured to receive be transmitted through filter unit light and output image, storage unit be configured to for Each filtered region, storage location information, positional information instruction receives on light receiving element array is transmitted through each The position of the light of filtered region.Its adjusting method includes:So that the monochromatic inspection light with different wave length sequentially enters optical filtering Unit;When examining light to enter filter unit, one group of image being exported based on light receiving element calculates the spectrum of each pixel Responsiveness;Spectral response registration is calculated, spectral response registration is indicated between desired wavelength selectivity and spectral responsivity Registration;By using the spectral response registration obtained, the light that identification is transmitted through each filtered region connects in light Receive the position being received on element arrays;And the positional information conduct pair for the position that storage instruction identifies in the memory unit Should be in the positional information of each filtered region.
When considered in conjunction with the accompanying drawings, by reading the detailed description of the currently preferred embodiment below for the present invention, Above and other purpose, feature, advantage and the technology and industrial significance of this invention will be better understood when.
Brief description of the drawings
Fig. 1 is the schematic diagram of the optical system according to the embodiment in imaging device;
The example of the geometry designs of Fig. 2 diagram filter units;
Fig. 3 illustrates the spectral transmission of filter unit;
Fig. 4 is the plan from the microlens array in terms of the direction of optical axis;
The light field image that Fig. 5 diagrams are shot by imaging device;
Macroscopical pixel of Fig. 6 diagram amplifications;
Fig. 7 illustrates the example of the detailed configuration of imaging device according to first embodiment;
The example of the configuration of photogenerator is examined in Fig. 8 diagrams;
Fig. 9 is the explanatory drawin of the definition of the monochromaticjty of light;
Figure 10 illustrates the spectral responsivity of some pixel and relative between the X color matching functions of XYZ color system Relation;
The example of the hardware configuration of Figure 11 diagram arithmetic processors;
Figure 12 illustrates the example of the detailed configuration of imaging device according to second embodiment;And
Figure 13 is the flow chart of the program of the processing of the regulating device in imaging device is adjusted.
Embodiment
The typical case of image-forming apparatus according to the present invention, regulating device and adjusting method is described in detail below with reference to attached drawing Embodiment.Although the imaging device for applying the invention to the configuration with full light camera is presented in following embodiment to be described Example, but imaging device not limited to this applicatory.The present invention is widely used in having by spatially separating light into Multiple light beams of different wave length characteristic correspond to by multiple areas of separated light beam to receive the light from object and export to include Any imaging device of the image in domain.
First embodiment
Fig. 1 is the schematic diagram of the optical system according to the embodiment in imaging device.In Fig. 1, for ease of understanding Explanation, the main lens 1 as imaging len is illustrated as simple lens, and main lens 1 aperture location be illustrated in it is single thoroughly The center of mirror.
In the aperture location of main lens 1, filter unit 2 is arranged.Although filter unit 2 is illustrated as seeming to filter in Fig. 1 Light unit 2 is disposed in the main lens 1 for being illustrated as simple lens, but actually filter unit 2 is not to be disposed in lens Inside.
Filter unit 2 includes multiple filtered regions with different wave length selectivity.In the present embodiment, based on by CIE The color matching functions of the XYZ color system of definition handles the optical filter quilt of the tristimulus values of the color with spectral transmission For filter unit 2.
Fig. 2 illustrates the example of the geometry designs of the filter unit 2 according to the present embodiment.As shown in Fig. 2, according to the present embodiment Filter unit 2 equipped with designed by the color matching functions based on XYZ color system three filtered region FX、FYAnd FZ
Fig. 3 illustrates the spectral transmission of the filter unit 2 according to the present embodiment.In figure 3, solid line represents filtered region FX's Spectral transmission TX(λ), chain-dotted line represent filtered region FYSpectral transmission TY(λ), and dotted line represent filtered region FZSpectrum Transmit TZ(λ).These spectral transmissions TX(λ)、TY(λ) and TZ(λ) substitutes the color of XYZ color system by using transmission It is obtained with function.The filtered region F of filter unit 2X、FYAnd FZWith respective wavelength selectivity different from each other.Figure Filter unit 2 shown in 2 and 3 is an example, and the present invention is not limited thereto.The number of filtered region in filter unit 2 Mesh can be two, four or more, as long as configuration includes multiple filtered regions with different wave length selectivity.
Near the spot position of main lens 1, arrangement includes the microlens array 3 of multiple lenticules (lenslet).This Outside, reception is transmitted through filter unit 2 and 3 light of microlens array and the light receiving element array 4 of output image is disposed in light In the image planes of system.In light receiving element array 4, a pixel of each light receiving element correspondence image, light-receiving member Part array 4 is monochromatic sensor, is not mounted within for the optical filter of each pixel on monochromatic sensor.Form lenticule battle array Ratio between the size of the diameter of each lenticule of row 3 and each light receiving element of composition light receiving element array 4 On relation for approximation 30:1 to 2:1.
Fig. 4 is the plan from the microlens array 3 in terms of the direction of optical axis P (referring to Fig. 1).Shown in white in Fig. 4 Part be each lenticule, and the part shown in black is light shield part.Light shaded portions are flat without curvature Face region and curvature do not meet the region of design load specification in the mill.Because for the light from these regions, setting Unexpected light beam is possible to be transmitted to light receiving element in meter, so the region is configured to provide by shielded Based on the electric signal that design is assumed.In order to obtain accurate measured value, this configuration is meaningful.
In the imaging device according to the present embodiment, the hole of main lens 1 is entered into and through in the light launched from object Ob The light beam group in footpath is received by microlens array 3, and by light receiving element array 4.Light beam group into main lens 1 is one group Countless light beam, and the different positions in each light beam aperture for passing through main lens 1.In the imaging according to the present embodiment In device, including three filtered region FX、FYAnd FZFilter unit 2 be disposed in the aperture location of main lens 1.Therefore, lead to The light beam of the diverse location in the aperture of main lens 1 is crossed by filtering from three with different spectral transmissions (wavelength selectivity) Region FX、FYAnd FZIt is transmitted and becomes three kinds of light beams with different wavelength characteristics.
The light beam transmitted from filter unit 2 is once condensed upon near microlens array 3, then passes through microlens array 3 effect is spread, and is transmitted through three filtered region F of filter unit 2X、FYAnd FZLight beam reach light-receiving member The different positions of part array 4.In other words, three filtered region F of filter unit 2 are transmitted through according to light beamX、FYAnd FZIn what filtered region, the light beam for being transmitted through the aperture location of main lens 1 puts down in the sensor of light receiving element array 4 Light-receiving position on face is different.Therefore in the imaging device according to the present embodiment, can measure by by from object Ob's The value that the photodegradation that a specific point is sent is obtained by tristimulus values X, Y on wavelength and Z.
Fig. 5 illustrates the light field image by being shot according to the imaging device of the present embodiment.When image is by according to the present embodiment When imaging device is shot, light field image as shown in Figure 5 is obtained, in the light field image, topography is arranged, each office Portion's image has the shape of small circular.It is main to be included in each topography in light field image to have the reason for circular shape The shape in the aperture of lens 1 has circular shape.Be included in each small circular topography in light field image be referred to as it is " grand See pixel ".Each macroscopical pixel is formed below each lenticule for forming microlens array 3.
Macroscopical pixel of Fig. 6 diagram amplifications.The internal structure of macroscopical pixel corresponds to the aperture location for being arranged in main lens 1 Filter unit 2 structure (referring to Fig. 2).Specifically, as shown in fig. 6, light by being shot according to the imaging device of the present embodiment Each macroscopical pixel that field picture includes is by equipped with corresponding to filtered region FXImage-region MX, corresponding to filtered region FYImage-region MYAnd corresponding to filtered region FZImage-region MZ.Image-region M in each macroscopical pixelX、 MYAnd MZThe filtered region F of filter unit 2 is transmitted through by receivingX、FYAnd FZEach light beam obtain respectively.Fig. 6 It the reason for turning upside down is optics that the internal structure of shown macroscopical pixel is compared to the structure of the filter unit 2 shown in Fig. 2 The transfer of system.Due to depending on optical system, so correspondence is not limited to this example.
, can the image-region M based on macroscopical pixel in the imaging device according to the present embodimentX、MYAnd MZOutput Value, measurement correspond to the spectral energy of the object space of macroscopical pixel.The image-region M of macroscopical pixelX、MYAnd MZOutput Value is arranged to v=[vX,vY,vZ]t.Here, the transposition of symbol " t " representing matrix.For output valve, can obtain for every One image-region MX、MYAnd MZLight receiving element output average value or for each image-region MX、MYWith And MZThe output valve of light receiving element of a selection be obtained and be adopted as typical value.Here, when for each Image-region MX、MYAnd MZThe average value of output of light receiving element be considered as each image-region MX、MYAnd MZ's During output valve, it is possible to suppress the influence of electronics random noise and obtain relative to the sane signal of noise.
By the way that the value obtained from the photodegradation that object Ob is sent into tristimulus values X, Y on wavelength and Z is multiplied With the spectral sensitivity of light receiving element array 4, to obtain the image-region M of macroscopical pixelX、MYAnd MZOutput valve.Due to The spectral sensitivity of light receiving element array 4 in the design phase it is known that therefore, by by each output valve divided by light receiving element The spectral sensitivity of array 4, can obtain tristimulus values X, Y and Z of the light from object Ob.Based on tristimulus values X, Y and Z, then can be with the color of detection object Ob (in the color value of XYZ color system).
Here, in the imaging device according to the present embodiment, it is necessary to identified in the actual device manufactured really What light receiving element of light receiving element array 4 and the M of macroscopical pixelX、MYAnd MZWhat image-region in the middle is right each other Should, with the image-region M based on macroscopical pixelX、MYAnd MZOutput valve carry out the color of detection object Ob.In other words, because Each actual device involves error, the correction error such as in optical system, therefore such as light-receiving member in production Each image-region M for corresponding to macroscopical pixel in part array 4X、MYAnd MZLight receiving element can be different from each other.
In the imaging device according to the present embodiment, each for corresponding to macroscopical pixel in light receiving element array 4 Image-region MX、MYAnd MZLight receiving element position, i.e. be transmitted through each filtered region F of filter unit 2X、FY And FZThe position that is received on light receiving element array 4 of light be identified in the method that will be described later, and represent should The positional information of position is stored in storage unit.Imaging device is configured to the position by using storage in the memory unit Confidence ceases, from the image-region M of the macroscopical pixel of light field image detection exported by light receiving element array 4X、MYAnd MZ, and Based on the image-region M detectedX、MYAnd MZOutput valve carry out the color of detection object Ob.
Fig. 7 illustrates the example of the concrete configuration of the imaging device according to the present embodiment.Imaging device 10 shown in Fig. 7 has Lens module 20, camera unit 30 and arithmetic processor 40.
Lens module 20 is equipped with the first lens 1a, the second lens 1b and filter unit 2.First lens 1a and second Lens 1b forms main lens 1.However, this configuration is only example, and any other configuration can be used, as long as filtering Unit 2 is disposed in the aperture location for the optical element for forming main lens 1.
Camera unit 30 is equipped with microlens array 3, light receiving element array 4 and frame memory 31.Frame memory 31 The light field image that interim storage is exported by light receiving element array 4.
As shown in fig. 7, the arithmetic processor of various calculation process is carried out on the image obtained by camera unit 30 40 equipped with spectral response registration calculator 41, location indentifier 42, area detector 43 and color detector 44 place Manage function.Arithmetic processor 40 is further equipped with storage unit 45, which is realized by non-volatile ram, and is deposited Store up positional information.Believe for example, storage unit 45 can store the position identified by location indentifier 42 in the form of inquiry table Breath, location indentifier 42 will be described later on.Storage unit 45 can be arranged on the outside of arithmetic processor 40.
The spectral response for being used for the storage location information in storage unit 45 among the processing function of arithmetic processor 40 Registration calculator 41 and location indentifier 42, in response to before actual device is transported or after being transported Random time is called by adjusting the predetermined operation that operator carries out in adjusting.Whenever light receiving element array 4 is being shot In the image of object during output light field image, for by actually using light field image come the output area of the color of detection object Detector 43 and color detector 44 are called.
Light is examined into the optical filtering list of optical system with monochromaticjty while examining the wavelength of light to be changed successively During member 2, spectral response registration calculator 41 is calculated based on the one group of light field image exported by light receiving element array 4 Form the spectral responsivity of each pixel of light field image and calculate and represent spectral responsivity and desired wavelength selectivity Between registration spectral response registration processing.
Light is examined to be produced by inspection photogenerator 60 as shown in Figure 7.The reality of the configuration of photogenerator 60 is examined in Fig. 8 diagrams Example.Examine photogenerator 60 that there is the light source 61 and spectroscopic unit 62 of such as xenon lamp, spectroscopic unit 62 is transmitted to be sent out from light source 61 The light gone out and the inspection light for by the light sent from light source 61 being used as that there is monochromaticjty.For example, as shown in figure 8, spectroscopic unit 62 Equipped with diffraction grating 63, slit 64 and shift unit 65, diffraction grating 63 makes from the optical dispersion that light source 61 is sent into difference The light beam of wavelength, slit 64 optionally transmit the light beam of the different wave length by 63 dispersion of diffraction grating, and shift unit 65 changes Slit 64 is relative to the position of diffraction grating 63, the wavelength for the light that transmitted with change by slit 64.
In the inspection photogenerator 60 with the configuration shown in Fig. 8, pass through diffraction grating 63 from the light that light source 61 is sent It is each wavelength by dispersion.In order to obtain the light beam of specific wavelength from by the light of 63 dispersion of diffraction grating, there is narrow The slit 64 of gap is disposed in before diffraction grating 63 (in the opposite side of light source 61).By changing slit by shift unit 65 64 position, the homogeneous beam (inspection light beam) that can to have different wave length sequentially enter imaging device 10.
Fig. 9 is the explanatory drawin of the definition of the monochromaticjty of light.As shown in figure 9, in the present embodiment, halfwidth degree (FWHM:Half High whole-line width) equal to or less than the light of 40nm it is considered as the light with monochromaticjty.Due to when halfwidth degree becomes larger, light Precise decreasing of the responsiveness relative to target wavelength is composed, thus less halfwidth degree is preferable.However, due to as compromise The result is that signal quantity reduce, thus, it is preferable that use the halfwidth in the range of it can obtain enough signal-to-noise ratio Small light beam is spent as inspection light.
For example, in imaging device 10 is adjusted, it is as described above examine photogenerator 60 to be used for so that from 400nm to The homogeneous beam of every 5nm in 700nm enters optical system, and shoots light field image for each wavelength.This operation One group of 61 light field image can be obtained.
Spectral response registration calculator 41 is primarily based on the image sets obtained by this way and calculates composition light field image Each pixel spectral responsivity.In other words, some pixel is focused, and same position the pixel value from 61 A image sets are extracted to obtain the spectral responsivity of the pixel.Spectral response registration calculator 41 is for forming light field image Each pixel carry out this processing, to calculate the spectral responsivity of each pixel.
Then, spectral response registration calculator 41 calculates expression above-mentioned for forming each pixel of light field image The spectral response registration of the registration between spectral responsivity and desired wavelength selectivity obtained in mode.
Figure 10 illustrates the spectral responsivity of some pixel and between the color matching functions of the X of XYZ color system Relation.The solid line of Figure 10 represents the color matching functions for X, and the aggregation of the triangle stain of drafting represents the light of some pixel Compose responsiveness.The spectral responsivity that Figure 10 discloses some pixel is not completely corresponding to color matching functions.
For example, spectral response registration calculator 41 can calculate spectral response registration by method as shown below.
Values of slave 400nm to the 700nm based on color matching functions per 5nm, color matching functions is by below equation (1) In represented 61 n dimensional vector n x represent.
X=[x400,x405,...,x700] (1)
Similarly, 61 n dimensional vector n ks of the spectral responsivity of some pixel represented by equation (2) are represented.
K=[k400,k405,...,k700] (2)
Because we wonder that the spectral responsivity for the pixel for forming light field image that composition is shot by imaging device 10 is more Close to desired wavelength selectivity (color matching functions), so the inner product of vector x and vector k " S=xk " are calculated, and by It is considered as spectral response registration.Spectral response registration calculator 41 carries out this for forming each pixel of light field image Processing, to calculate the spectral response registration of each pixel.
Location indentifier 42 uses each obtained by the processing carried out by spectral response registration calculator 41 The spectral response registration of pixel identifies the image-region M in macroscopical pixelX、MYAnd MZEach position, and storing Storage location information in unit 45, image-region MX、MYAnd MZThe filtered region F of filter unit 2 is corresponded to respectivelyX、FYAnd FZ
There are some location indentifiers 42 to identify the image-region M in macroscopical pixelX、MYAnd MZPosition possible side Method.For example, it is maximum relative to the color matching functions of the X among the pixel for forming macroscopical pixel to have spectral response registration A pixel be considered as image-region MXInterior pixel and the method for the positional information for storing the pixel.This method is logical Cross in the color detection of the progress of color detector 44 and cause sizable change, the change described later on while improving precision Change.
In addition, it is maximum pixel and surrounding pixel relative to the color matching functions of X to have spectral response registration It is considered as image-region MXInterior pixel and the method for the positional information for storing the pixel.Although this method is compared to above-mentioned Method causes the reduction in the precision in color detection, but its have can suppress due to change caused by average effect with And the advantages of passing through the scope for adjusting pixel around come balance quality and change.
In addition, the spectral response registration of the promising color matching functions relative to X sets threshold value, by relative to the face of X The pixel that the spectral response registration of color matching function is equal to or more than threshold values is considered as among the pixel for forming macroscopical pixel Image-region MXInterior pixel and the method for the positional information for storing the pixel.This method can be ensured in color detection Performance of the middle precision more than certain level.
Although identify image-region MXPosition situation by as example, and up to the present illustrated, but can be with Image-region M is identified in identical methodYAnd MZPosition.
Based on the positional information being stored in storage unit 45, area detector 43 is from the image in shooting object, i.e. When the light from object enters filter element 2, the light field image exported by light receiving element array 4 detects each macroscopical picture Each image-region M of elementX、MYAnd MZ.According to the area detector 43 of the present embodiment according to the position of macroscopical pixel again cloth Put detected image MX、MYAnd MZOutput valve, to generate intermediate image.
Specifically, area detector 43 detects the image-region M of the macroscopical pixel of each being included in light field imageX, And detected image-region M is rearranged according to the position (i, j) of each macroscopical pixelX(for example, forming image-region MX Pixel average value) output valve, with generate corresponding to filter unit 2 filtered region intermediate image.In other words, example Such as, when (i, j)=(1,1) is true, then the image-region M in macroscopical pixel of the left upper end of light field imageXOutput Value is considered as the value of the pixel of the left upper end of intermediate image.This is carried out for all macroscopical pixels being included in light field image Processing, to generate intermediate image, intermediate image is the filtered region F by being transmitted through filter unit 2XThe two dimension that is formed of light Image.
Area detector 43 is for being included in the image-region M in each macroscopical pixel in light field imageYAnd MZCarry out Identical processing, to generate the filtered region F corresponding to filter unit 2YIntermediate image and the filter corresponding to filter unit 2 Light region FZIntermediate image.
Color detector 44 is based on the image-region M detected by area detector 43X、MYAnd MZImage-region it is defeated Go out value, in the above-mentioned methods the color of detection object.According to the color detector 44 of the present embodiment by using by region detection (three intermediate images correspond to the filtered region F of filter unit 2 to three intermediate images that device 43 is generatedX、FYAnd FZ), energy The color in the diverse location of object is enough detected separately.
Area detector 43 may be configured to obtain three image-region MX、MYAnd MZRepresentative output valve, rather than Generation corresponds to three image-region MX、MYAnd MZEach intermediate image.In this case, color detector 44 is based on Three image-region MX、MYAnd MZRepresentative output valve detection object color.
As up to the present illustrated, in the imaging device 10 according to the present embodiment, each picture of light field image The spectral response registration of element is calculated in adjusting, corresponds respectively to the filtered region F of filter unit 2X、FYAnd FZFigure As region MX、MYAnd MZEach position, be identified by using spectral response registration, and positional information is stored in In storage unit 45.Shot in the image of object and the color of detection object, can made by using imaging device 10 in reality With the positional information being stored in storage unit 45, and correctly detect the light obtained from the image taking by object The image-region M of the macroscopical pixel of each of field pictureX、MYAnd MZ.Then, based on detecting to obtain image-region MX、MYAnd MZCan suitably detection object color.
The example of the hardware configuration of Figure 11 diagram arithmetic processors 40.For example, as shown in figure 11, arithmetic processor 40 has CPU (central processing unit) 51, wherein storage cause the ROM (read-only storage) 52 of the program of the operations of CPU 51, as CPU 51 RAM (random access memory) 53, the non-volatile ram as storage unit 45 during executive program as working storage The 54 and image RAM 55 of view data of the interim storage from camera unit 30.
For example, CPU 51 reads the program being stored in ROM 52 and executive program using RAM 53, therefore, in the figure 7 Processing function (spectral response registration calculator 41, location indentifier 42, the area detector 43 of shown arithmetic processor 40 And color detector 44) be implemented.For example, the part of arithmetic processor 40 or all processing functions can be by such as The specialized hardware of ASIC (application-specific integrated circuit) or FPGA (field programmable gate array) is realized.
As being up to the present explained in detail using specific example, in the imaging device 10 according to the present embodiment, It can accurately identify the filtered region F corresponding to filter unit 2 in imageX、FYAnd FZPosition, suitably carry out thing Color detection of body etc..
Second embodiment
Next, it will illustrate second embodiment.In a second embodiment, regulating device in adjusting for form light field figure Each pixel of picture calculate the processing of spectral response registration, and identifies image district using spectral response registration Domain MX、MYAnd MZPosition and in storage unit 45 storage location information processing.The component identical with first embodiment Identical reference symbol will be allocated, will it is appropriate the repetitive description thereof will be omitted, and only have the characteristic point of second embodiment will below Illustrated.
Figure 12 illustrates the example of the concrete configuration of imaging device according to second embodiment.Imaging device 70 shown in Figure 12 With lens module 20, camera unit 30 and arithmetic processor 80.Lens module 20 and camera unit 30 and first embodiment It is identical.Different from arithmetic processor 40 according to first embodiment arithmetic processor 80 only equipped with area detector 43 and face Color detector 44, and not equipped with spectral response registration calculator 41 and location indentifier 42.
In a second embodiment, regulating device 90 as shown in figure 12 is used to adjust for imaging device 70.Regulating device 90 In addition to examining photogenerator 60, also with arithmetic processor 100, examine photogenerator 60 identical with first embodiment.Adjust The arithmetic processor 100 of regulating device 90 has spectral response registration calculator 101 and location indentifier 102, spectral response Registration calculator 101 is identical with spectral response registration calculator 41 according to first embodiment, location indentifier 102 and root It is identical according to the location indentifier 42 of first embodiment.
Regulating device 90 is so that examine photogenerator 60 to work in imaging device 70 is adjusted, to change inspection light successively Wavelength while to have monochromaticjty examine light to enter the filter unit 2 of imaging device 70.Whenever each wavelength When inspection light enters filter unit 2, regulating device 90 obtains the one group of light exported by light receiving element array 4 from imaging device 70 Field picture, and this group of light field image is input to arithmetic processor 100.
The spectral response registration calculator 101 of arithmetic processor 100 is based on this group of light field obtained from imaging device 70 Image, calculate form light field image each pixel spectral responsivity, and calculate represent spectral responsivity with it is desired The spectral response registration of registration between wavelength selectivity, arithmetic processor 100 are similar to light according to first embodiment Spectrum response registration calculator 41.
The location indentifier 102 of arithmetic processor 100 is by the processing institute that is carried out by spectral response registration calculator 101 The spectral response registration of each pixel obtained, to identify the filter area that filter unit 2 is corresponded respectively in macroscopical pixel Domain FX、FYAnd FZImage-region MX、MYAnd MZEach position, and the storage location information in storage unit 45, fortune Calculate processor 100 and be similar to location indentifier 42 according to first embodiment.
Figure 13 is the flow chart of the program of the processing of regulating device 90 in imaging device 70 is adjusted.Here, exist Flow in the flow chart of Figure 13 from step S101 to S105 is suitable for the adjusting according to first embodiment to imaging device 10.
In imaging device 70 is adjusted, regulating device 90 first so that examine photogenerator 60 work, with according to Secondary change causes the 2 (step of filter unit for examining light to enter imaging device 70 with monochromaticjty while examining the wavelength of light S101)。
Next, the spectral response registration calculator 101 of regulating device 90 obtains the light-receiving member by imaging device 70 This group of light field image (step S102) that part array 4 exports, and light field image is formed to calculate based on this group of light field image The spectral responsivity (step S103) of each pixel.
Next, each pixel calculating of the spectral response registration calculator 101 for forming light field image represents to exist Spectral response registration (the step of registration between spectral responsivity and desired wavelength selectivity that step S103 is calculated Rapid S104).
Next, 102 use of location indentifier of regulating device 90 by spectral response registration calculator 101 by being carried out The processing spectral response registration of each pixel that is obtained identify the filter corresponding to filter unit 2 in macroscopical pixel Light region FX、FYAnd FZImage-region MX、MYAnd MZEach position (step S105), and terminate the tune of imaging device 70 Section.
As up to the present illustrated, in a second embodiment, regulating device 90 is configured to for light field image Each pixel calculate the processing of spectral response registration, and identifies image-region by using spectral response registration MX、MYAnd MZPosition and in storage unit 45 storage location information processing.Therefore, can reduce in imaging device While the load of processing in 70, the advantages of identical with first embodiment is obtained.
First variation
In the first and second embodiment kinds, diffraction grating 63, slit 64 and shift unit 65, which are formed, examines photogenerator 60 spectroscopic unit 62.However, the invention is not restricted to this example, for example, using the absorption filter of pigment or using more The dielectric interferometric filter of layer is used as spectroscopic unit 62.
Second variation
In the first and second embodiment, xenon lamp is used as examining the light source 61 of photogenerator 60.However, the present invention is unlimited In xenon lamp and halogen lamp, for example, light emitting diode etc. is used as light source 61.Because although halogen lamp is in the luminous intensity of short wavelength side Less than xenon lamp, but it has the intensity in big wave-length coverage similar to xenon lamp, and therefore, halogen lamp can be used as light source 61.In addition, Although light emitting diode is generally narrow compared to the scope of xenon lamp and halogen lamp wavelength, light emitting diode is used as light Source 61.
According to embodiment as described above, there is each filter area that can accurately identify and correspond to filter unit in image The advantages of position in domain.
Although the present invention is described for complete and clear disclosure, appended right with respect to specific embodiment It is required that being not limited thereby, but it is interpreted to embody and fully belongs to the people in the art set forth herein instructed substantially The all modifications and alternative constructions that member is contemplated that.

Claims (10)

1. a kind of imaging device, it is characterised in that including:
Filter unit, the filter unit include multiple filtered regions with different wave length selectivity;
Light receiving element array, the light receiving element array, which is configured to receive, is transmitted through the light of the filter unit and defeated Go out image;
Storage unit, the storage unit are configured to for filtered region each described, storage location information, the position Information instruction receives the position for the light for being transmitted through each filtered region on the light receiving element array;
Area detector, the area detector are configured to when the light from object enters the filter unit, based on institute Positional information is stated, each described filter area is detected and be transmitted through from the described image of light receiving element array output The corresponding image-region of the light in domain;And
Color detector, the color detector are configured to the output valve based on the image-region detected, detect the thing The color of body,
Wherein, the positional information corresponding to filtered region each described indicates to be known by using spectral response registration Position on other light receiving element, the spectral response registration indicate spectral responsivity and the expectation of each pixel Wavelength selectivity between registration, when the monochromatic inspection light with different wavelength sequentially enters the filter unit When, the spectral responsivity of each pixel is calculated based on one group of image of light receiving element output.
2. imaging device as claimed in claim 1, it is characterised in that further comprise:
Spectral response registration calculator, the spectral response registration calculator are configured to calculate the described of each pixel Spectral response registration;And
Location indentifier, the location indentifier are configured to identify in the light by using the spectral response registration The position for the light for being transmitted through each filtered region is received on receiving element array, and in the storage The positional information for the position that storage instruction identifies is as institute's rheme corresponding to each filtered region in unit Confidence ceases.
3. imaging device as claimed in claim 1 or 2, it is characterised in that
The spectral response registration is the inner product of the desired wavelength selectivity and the spectral responsivity.
4. imaging device as claimed in claim 1 or 2, it is characterised in that
The filter unit includes at least three filtered regions with the spectral-transmission favtor based on color matching functions.
5. a kind of regulating device for being used to adjust imaging device, it is characterised in that the imaging device includes filter unit, light connects Element arrays and storage unit are received, the filter unit includes multiple filtered regions with different wavelength selectivities, institute Light receiving element array is stated to be configured to receive the light and output image that are transmitted through the filter unit, the storage unit quilt It is configured to for filtered region each described, storage location information, the positional information instruction is in the light receiving element battle array The position for the light for being transmitted through each filtered region is received on row, the regulating device includes:
Photogenerator is examined, it is described to examine photogenerator to be configured so that the monochromatic inspection light with different wave length sequentially enters The filter unit;
Spectral response registration calculator, the spectral response registration calculator are configured to when the inspection light enters filtering During unit, based on one group of image of light receiving element array output, the spectral responsivity of each pixel, Yi Jiji are calculated Calculate the spectral response registration for indicating the registration between desired wavelength selectivity and the spectral responsivity;And
Location indentifier, the location indentifier are configured to identify in institute by using the spectral response registration obtained The position that the light for being transmitted through each filtered region is received on light receiving element array is stated, and is being stored The positional information for the position that storage instruction identifies is believed as the position corresponding to each filtered region in unit Breath.
6. regulating device as claimed in claim 5, it is characterised in that
The inspection photogenerator includes light source and spectroscopic unit, and the spectroscopic unit is configured to transmission and is sent from the light source Light, and the light is used as the inspection light.
7. regulating device as claimed in claim 6, it is characterised in that the spectroscopic unit includes:
Diffraction grating, the optical dispersion that the diffraction grating is configured as making sending from the light source is into different wave length Light,
Slit, the slit are configured to optionally transmit as the diffraction grating dispersion with described in different wave length Light, and
Shift unit, the shift unit are configured to change position of the slit relative to the diffraction grating, with selection It is transmitted through the wavelength of the light of the slit.
8. regulating device as claimed in claim 6, it is characterised in that the spectroscopic unit is the absorption filter using pigment With one in the interferometric filter for using multi-layer dielectric.
9. regulating device as claimed in claim 6, it is characterised in that the light source is xenon lamp, halogen lamp and light emitting diode In any one.
10. a kind of adjusting method for being used to adjust imaging device, it is characterised in that the imaging device includes filter unit, light Receiving element array and storage unit, the filter unit include multiple filtered regions with different wave length selectivity, institute Light receiving element array is stated to be configured to receive the light and output image that are transmitted through the filter unit, the storage unit quilt It is configured to for filtered region each described, storage location information, the positional information instruction is in the light receiving element battle array The position for the light for being transmitted through each filtered region is received on row, the adjusting method includes:
So that the monochromatic inspection light with different wave length sequentially enters the filter unit;
When the inspection light enters the filter unit, based on one group of image of light receiving element output, calculate each The spectral responsivity of a pixel;
Spectral response registration is calculated, the spectral response registration indicates desired wavelength selectivity and the spectral responsivity Between registration;
By using the spectral response registration obtained, identification is transmitted through the light of each filtered region in institute State the position being received on light receiving element array;And
The positional information for the position that storage instruction identifies, which is used as, in the storage unit corresponds to each described filter The positional information in light region.
CN201510094575.9A 2014-03-04 2015-03-03 Imaging device, regulating device and adjusting method Expired - Fee Related CN104902165B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2014-042115 2014-03-04
JP2014042115A JP6260354B2 (en) 2014-03-04 2014-03-04 Imaging device, adjustment device, and adjustment method

Publications (2)

Publication Number Publication Date
CN104902165A CN104902165A (en) 2015-09-09
CN104902165B true CN104902165B (en) 2018-04-24

Family

ID=54018720

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510094575.9A Expired - Fee Related CN104902165B (en) 2014-03-04 2015-03-03 Imaging device, regulating device and adjusting method

Country Status (3)

Country Link
US (1) US9609292B2 (en)
JP (1) JP6260354B2 (en)
CN (1) CN104902165B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104580877B (en) * 2013-10-29 2018-03-06 华为技术有限公司 The device and method that image obtains
US10072970B1 (en) 2015-12-15 2018-09-11 Lockheed Martin Corporation Hyperspectral notch filter imaging
CN105680317A (en) * 2016-01-12 2016-06-15 上海理工大学 Broadband spectrum beam-splitting beam-combining based wavelength-adjustable light source establishing method
JP6834134B2 (en) * 2016-01-21 2021-02-24 オムロン株式会社 Imaging device and information code reader
US10670779B1 (en) 2016-09-08 2020-06-02 Lockheed Martin Corporation Multi-layered optical element
CN113497065B (en) * 2020-03-18 2024-03-26 吉林求是光谱数据科技有限公司 Imaging spectrum chip with spectrum and imaging functions and preparation method thereof
CN111586300B (en) * 2020-05-09 2022-02-08 展讯通信(上海)有限公司 Color correction method, device and readable storage medium
CN114360364A (en) * 2022-01-12 2022-04-15 西安工业大学 Multispectral imaging module and portable display device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6760475B1 (en) * 1999-10-13 2004-07-06 Cambridge Research & Instrumentation Inc. Colorimetric imaging system
JP2006024832A (en) * 2004-07-09 2006-01-26 Fuji Film Microdevices Co Ltd Solid-state imaging device and digital camera
CN1938856A (en) * 2004-05-27 2007-03-28 佛文恩股份有限公司 Vertical color filter sensor group and semiconductor integrated circuit fabrication method for fabricating same
CN1943042A (en) * 2004-05-27 2007-04-04 佛文恩股份有限公司 Vertical color filter sensor group with carrier-collector elements
CN101069287A (en) * 2004-12-03 2007-11-07 易特斯股份公司 A multi-colour sensitive device for color image sensing
CN101981411A (en) * 2008-03-31 2011-02-23 伊雷克托科学工业股份有限公司 Method and apparatus for multiplexed image acquisition and processing

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2642260A4 (en) * 2010-11-16 2015-12-09 Nikon Corp Multiband camera, and multiband image capturing method
US9250131B2 (en) * 2011-01-17 2016-02-02 Ricoh Co., Ltd. Multi-imaging system with interleaved images
JP5693379B2 (en) * 2011-05-27 2015-04-01 富士フイルム株式会社 Imaging device
JP6004235B2 (en) * 2012-02-03 2016-10-05 パナソニックIpマネジメント株式会社 Imaging apparatus and imaging system
JP6060659B2 (en) 2012-03-09 2017-01-18 株式会社リコー Imaging device
JP6322939B2 (en) * 2012-12-03 2018-05-16 株式会社リコー Imaging system and color inspection system
JP6277695B2 (en) 2013-12-03 2018-02-14 株式会社リコー Imaging device, adjustment device, and adjustment method
JP2015228641A (en) * 2014-05-07 2015-12-17 株式会社リコー Imaging apparatus, exposure adjustment method and program

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6760475B1 (en) * 1999-10-13 2004-07-06 Cambridge Research & Instrumentation Inc. Colorimetric imaging system
CN1938856A (en) * 2004-05-27 2007-03-28 佛文恩股份有限公司 Vertical color filter sensor group and semiconductor integrated circuit fabrication method for fabricating same
CN1943042A (en) * 2004-05-27 2007-04-04 佛文恩股份有限公司 Vertical color filter sensor group with carrier-collector elements
JP2006024832A (en) * 2004-07-09 2006-01-26 Fuji Film Microdevices Co Ltd Solid-state imaging device and digital camera
CN101069287A (en) * 2004-12-03 2007-11-07 易特斯股份公司 A multi-colour sensitive device for color image sensing
CN101981411A (en) * 2008-03-31 2011-02-23 伊雷克托科学工业股份有限公司 Method and apparatus for multiplexed image acquisition and processing

Also Published As

Publication number Publication date
US20150256801A1 (en) 2015-09-10
JP2015170869A (en) 2015-09-28
JP6260354B2 (en) 2018-01-17
CN104902165A (en) 2015-09-09
US9609292B2 (en) 2017-03-28

Similar Documents

Publication Publication Date Title
CN104902165B (en) Imaging device, regulating device and adjusting method
JP6340884B2 (en) Measuring apparatus, measuring system and measuring method
US8842216B2 (en) Movable pixelated filter array
JP5475057B2 (en) Variable angle spectroscopic imaging measurement method and apparatus
JP5358039B1 (en) Imaging device
CN104034418B (en) spectroscopic measurement device
EP2637004B1 (en) Multispectral imaging color measurement system and method for processing imaging signals thereof
JP5541644B2 (en) Method for determining calibration parameters of a spectrometer
US9307127B2 (en) Image capturing device and image capturing system
US11706506B2 (en) Imaging apparatus
US20140300753A1 (en) Imaging pipeline for spectro-colorimeters
US9188841B2 (en) Imaging device
JP2015228641A (en) Imaging apparatus, exposure adjustment method and program
KR20220137629A (en) Imaging unit and measuring device
US20220299369A1 (en) System, Method and Apparatus for Wide Wavelength Range Imaging with Focus and Image Correction
JP2010276469A (en) Image processor and image processing method of ranging apparatus
EP3993382A1 (en) Colour calibration of an imaging device
WO2019073881A1 (en) Imaging device and image processing device
WO2017026296A1 (en) Sample measurement apparatus
WO2020213418A1 (en) Imaging device, signal processing device, signal processing method, and signal processing program
JPWO2018012478A1 (en) Colorimeter
JP6432138B2 (en) Measuring apparatus, color information acquisition apparatus and manufacturing method
CN111194399A (en) Apparatus, system and method for measuring light
JP6277695B2 (en) Imaging device, adjustment device, and adjustment method
WO2024047944A1 (en) Member for calibration, housing device, calibration device, calibration method, and program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180424

Termination date: 20210303