CN105580360B - Photographic device - Google Patents
Photographic device Download PDFInfo
- Publication number
- CN105580360B CN105580360B CN201480049327.6A CN201480049327A CN105580360B CN 105580360 B CN105580360 B CN 105580360B CN 201480049327 A CN201480049327 A CN 201480049327A CN 105580360 B CN105580360 B CN 105580360B
- Authority
- CN
- China
- Prior art keywords
- signal
- pixel
- color
- light
- photoelectric conversion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 claims abstract description 10
- 238000006243 chemical reaction Methods 0.000 claims description 107
- 230000002194 synthesizing effect Effects 0.000 abstract 1
- 238000000034 method Methods 0.000 description 9
- 230000005622 photoelectricity Effects 0.000 description 7
- 239000004615 ingredient Substances 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 238000001228 spectrum Methods 0.000 description 3
- 238000010521 absorption reaction Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
- H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
- H01L27/144—Devices controlled by radiation
- H01L27/146—Imager structures
- H01L27/14601—Structural or functional details thereof
- H01L27/1462—Coatings
- H01L27/14621—Colour filter arrangements
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
- H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
- H01L27/144—Devices controlled by radiation
- H01L27/146—Imager structures
- H01L27/14643—Photodiode arrays; MOS imagers
- H01L27/14645—Colour imagers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
- H04N23/843—Demosaicing, e.g. interpolating colour pixel values
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/17—Colour separation based on photon absorption depth, e.g. full colour resolution obtained simultaneously at each pixel location
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2209/00—Details of colour television systems
- H04N2209/04—Picture signal generators
- H04N2209/041—Picture signal generators using solid-state devices
- H04N2209/042—Picture signal generators using solid-state devices having a single pick-up sensor
- H04N2209/045—Picture signal generators using solid-state devices having a single pick-up sensor using mosaic colour filter
- H04N2209/046—Colour interpolation to calculate the missing colour values
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Power Engineering (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Condensed Matter Physics & Semiconductors (AREA)
- Electromagnetism (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Color Television Image Signal Generators (AREA)
- Solid State Image Pick-Up Elements (AREA)
Abstract
Photographic device includes multiple first pixels, and it includes the pixels of multiple color components, and the first signal is generated according to incident light；Multiple second pixels generate second signal according to the light transmitted from least part of first pixel；And signal generation portion, generate the signal for synthesizing first signal with the second signal.
Description
Technical field
The present invention relates to a kind of photographic devices.
Background technique
Conventionally, there is known a kind of photographing element (referring to patent document 1) for being configured with colored filter.
Existing technical literature
Patent document
Patent document 1: Japanese Unexamined Patent Publication 2007-282109 bulletin
Summary of the invention
In previous technology, the light to each pixel incidence is the light for having transmitted colored filter.Thus, for example just receiving
For the G pixel of the light of G (green), the light other than G is absorbed by colored filter, and is not used.In addition, in G pixel,
The trimmed book body of G is also not all used, and a part of the light of the G is absorbed or reflected by colored filter.Like this, exist
The utilization efficiency of incident light is very low in previous technology.
First method according to the present invention, photographic device include multiple first pixels, and it includes the pictures of multiple color components
Element generates the first signal according to incident light；Multiple second pixels are transmitted according to from least part of first pixel
Light generate second signal；And first signal is synthesized to obtain by signal generation portion, generation with the second signal
Signal.
Second method according to the present invention, in the photographic device of first method, it is preferable that first pixel is to incidence
The light of defined color component in light carries out photoelectric conversion to generate first signal, and makes the light of remaining color component
Transmission, the signal generation portion generate luminance signal by the way that first signal to be added with the second signal.
Third Way according to the present invention, in the photographic device of second method, it is preferable that first pixel includes pair
The light of first color component carries out the pixel of photoelectric conversion, carries out the pixel of photoelectric conversion to the light of the second color component and to the
The light of three color components carries out the pixel of photoelectric conversion, and the signal generation portion generates color difference letter using first signal
Number.
Fourth way according to the present invention, in the photographic device of Third Way, it is preferable that the signal generation portion is each
Location of pixels carries out color interpolation processing using first signal to find out first color component to the third color
The signal of ingredient is asked based on the ratio between first color component~third color component signal and the luminance signal
Out first color component to the third color component picture signal, and based on described image signal or based on described
Picture signal and the luminance signal generate the colour difference signal.
5th mode according to the present invention, in the photographic device of third or fourth way, it is preferable that first color
Ingredient is red, and second color component is green, and the third color component is blue, and first pixel is by visiing
Ear array arranges.
6th mode according to the present invention, photographic device include photographing element, have the first photoelectric conversion layer and second
Photoelectric conversion layer, first photoelectric conversion layer, which is two-dimensionally arranged with, carries out light to the light of the defined color component in incident light
Electricity is converted and makes the light transmissive pixel of remaining color component, second photoelectric conversion layer and first photoelectric conversion layer
The configuration of stacking ground is two-dimensionally arranged in same optical path and carries out photoelectricity turn to the light transmitted from first photoelectric conversion layer
The pixel changed；And image production part, using the output signal from first photoelectric conversion layer and from described second
The output signal of photoelectric conversion layer, to generate colour picture signal, described image generating unit will be by that will come from first photoelectricity
The output signal of conversion layer is added with the output signal from second photoelectric conversion layer, to generate the colour picture signal
In luminance signal.
7th mode according to the present invention, in the photographic device of the 6th mode, it is preferable that first photoelectric conversion layer
The first pixel of photoelectric conversion is carried out with the light to the first color component, photoelectric conversion is carried out to the light of the second color component
Second pixel and the third pixel that photoelectric conversion is carried out to the light of third color component, described image generating unit are used from described
The output signal of first photoelectric conversion layer generates the colour difference signal in the colour picture signal.
Eighth mode according to the present invention, in the photographic device of the 7th mode, it is preferable that described image generating unit is directed to
Each pixel of the photographing element carries out color interpolation using the output signal of first photoelectric conversion layer and handles to find out
The signal of the first color component to the third color component is stated, based on first color component to the third color component
The ratio between signal and the luminance signal find out the picture signal of first color component to the third color component, and
The colour difference signal is generated based on described image signal or based on described image signal and the luminance signal.
9th mode according to the present invention, the 7th or eighth mode photographic device in, it is preferable that first color
Ingredient be it is red, second color component is green, and the third color component is blue, first pixel to described the
Three pixels are arranged by Bayer array.
Invention effect
Using the present invention, the utilization efficiency of incident light can be improved.
Detailed description of the invention
Fig. 1 is the block diagram for illustrating the structural example of digital camera.
Fig. 2 is the figure for illustrating the summary of photographing element.
Fig. 3 is the figure of the configuration example of pixels illustrated.
Fig. 4 is the figure for illustrating to generate the method for Y-signal.
Fig. 5 is the figure for illustrating to generate the method for CbCr signal.
Fig. 6 is to show in the case where being not configured with colored filter in photographing element and the feelings configured with colored filter
The figure of relative spectral example under condition.
Specific embodiment
Hereinafter, being illustrated referring to attached drawing for mode for carrying out the present invention.Fig. 1 is to illustrate of the invention one
The figure of the structure of the digital camera 1 of embodiment.Digital camera 1 has imaging optical system 10, photographing element 11, control unit
12, operation portion 13, image processing part 14, LCD monitor 15 and buffer storage 16.In addition, being installed in digital camera 1
There is storage card 17.
Control unit 12 is made of the peripheral circuit of microprocessor and the microprocessor, by executing in ROM (not shown)
The control program saved in (Read Only Memory: read-only memory), to carry out various controls to digital camera 1.
Photographing element 11 is made of multiple pixels, is received the light beam from subject via imaging optical system 10, is carried out
Photoelectric conversion simultaneously exports analog picture signal or data image signal.In the feelings for exporting analog picture signal from photographing element 11
Under condition, it is AD converted using A/D converter circuit (not shown) to become data image signal.The data image signal is stored in
Buffer storage 16.
It is carried out at various images in image processing part 14 for the data image signal saved in buffer storage 16
Reason, and be shown in LCD monitor 15 or be stored in storage card 17.Storage card 17 is made of non-volatile flash memory etc.,
It is detachable relative to digital camera 1.
Operation portion 13 is made of the various operation buttons such as release button and/or mode switch button, power knob, and by taking the photograph
Shadow person operation.Operation portion 13 exports operation signal corresponding with operation of the cameraman to above-mentioned each operation button to control unit 12.
Image processing part 14 is by structures such as ASIC (Application Specific Integrated Circuit: specific integrated circuit)
At.Image processing part 14 carries out the various images such as interpolation, compression, white balance to obtained image data is shot by photographing element 11
Processing and/or aftermentioned image generation processing.
< photographing element illustrates >
Fig. 2 is the figure for showing the summary of photographing element 11 of present embodiment.In addition, being shown in FIG. 2 photographing element
11 light incident side is set as the state of upside.Therefore, in the following description, the direction of the light incident side of photographing element 11 is set
For " top ", perhaps the direction of light incident side opposite side is set as " lower section " or "lower" by "upper".Photographing element 11 has upper
Portion's photoelectric conversion layer 31 and lower part photoelectric conversion layer 32.Top photoelectric conversion layer 31 and 32 laminated configuration of lower part photoelectric conversion layer in
Same optical path.Light of the top photoelectric conversion layer 31 as absorbing color component as defined in (photoelectric conversion) (details is as described later)
Organic photoelectric film constitute.The light for not absorbed the color component of (photoelectric conversion) by top photoelectric conversion layer 31 can be from top photoelectricity
Conversion layer 31 transmits and is incident to lower part photoelectric conversion layer 32, and carries out photoelectric conversion by lower part photoelectric conversion layer 32.Lower part light
Electric conversion layer 32 is made of the organic photoelectric film for absorbing the light of whole wavelength of (photoelectric conversion) visible light.Top photoelectric conversion layer
31 and lower part photoelectric conversion layer 32 be formed on the same semiconductor substrate, and each location of pixels correspond.Such as top light
The pixel of the first row first row of electric conversion layer 31 and the pixel of the first row first row of lower part photoelectric conversion layer 32 are corresponding.
(a) of Fig. 3 is the figure for showing the pixel configuration of top photoelectric conversion layer 31.In (a) of Fig. 3, it will laterally be set as x
Axis will longitudinally be set as y-axis, and the coordinate of pixel P is labeled as P (x, y).In top photoelectric conversion layer 31, each pixel is with for example
Bayer (Bayer) array configures.That is, R pixel is alternately configured with G pixel in odd-numbered line, in idol as shown in (a) of Fig. 3
G pixel is alternately configured with B pixel on several rows, which carries out photoelectric conversion to the light of R (red), and the G pixel is (green to G
Color) light carry out photoelectric conversion, the B pixel is to the light of B (blue) progress photoelectric conversion.Each picture of photoelectric conversion layer 31 on top
Be not photoelectrically converted in element (absorption) color component light from top photoelectric conversion layer 31 transmit.For example, in top photoelectricity
In the pixel P (1,1) of conversion layer 31, since the light of R component is absorbed and is photoelectrically converted, so the face other than R component
The light transmission of color ingredient is gone over.
(b) of Fig. 3 is the figure for showing the pixel configuration of lower part photoelectric conversion layer 32.In addition, each picture shown in (b) of Fig. 3
Plain position is identical as (a) of Fig. 3.Such as the pixel of pixel P (1,1) and top photoelectric conversion layer 31 of lower part photoelectric conversion layer 32
P (1,1) is corresponding.The picture of light in lower part photoelectric conversion layer 32 two-dimensionally configured with the whole wavelength that can absorb visible light
Element.Therefore, each pixel of lower part photoelectric conversion layer 32 by not by top photoelectric conversion layer 31 absorb (i.e. from top photoelectric conversion
31 transmission of layer) whole visible light all absorbs and carries out photoelectric conversion.Thus, for example, the pixel P of lower part photoelectric conversion layer 32
The visible light that (1,1) will not absorbed by the pixel P (1,1) of top photoelectric conversion layer 31 will contain the face other than R component
The visible absorption of color ingredient simultaneously carries out photoelectric conversion.
< image generates processing >
Hereinafter, believing for the color image for generating YCbCr form using the signal exported from above-mentioned photographing element 11
Number image generation processing be illustrated.Firstly, using Fig. 4, to the Y-signal (luminance signal) generated in colour picture signal
Method is illustrated.
As described above, each pixel of top photoelectric conversion layer 31 absorbs a certain light in RGB and comes in photographing element 11
Photoelectric conversion is carried out, each pixel reception of lower part photoelectric conversion layer 32 (is not absorbed from what top photoelectric conversion layer 31 transmitted
) light of color component carries out photoelectric conversion.Therefore, if by the output signal from top photoelectric conversion layer 31 and coming from down
The output signal of portion's photoelectric conversion layer 32 is added, then can obtain the visible light that opposite photographing element 11 irradiates and directly carry out photoelectricity
Conversion and generate signal, can access in the past it is defeated in the case where being not configured with colored filter on photographing element
The same black-and-white signal of signal out.
Therefore, as shown in figure 4, image processing part 14 is by will be from top photoelectric conversion layer 31 on each location of pixels
Output signal is added with the output signal of photoelectric conversion layer 32 from below, to generate the Y-signal (brightness in colour picture signal
Signal).In addition, r indicates the output signal of the R pixel from top photoelectric conversion layer 31 in Fig. 4, g indicates to come from top light
The output signal of the G pixel of electric conversion layer 31, b indicate the output signal of the B pixel from top photoelectric conversion layer 31.In addition, w
Indicate that the output signal from the pixel for being configured at lower part photoelectric conversion layer 32, the pixel absorb whole wavelength of visible light
Light.Image processing part 14 finds out the Y letter in the position of the R pixel of top photoelectric conversion layer 31 according to calculating formula below (1)
Number, the Y-signal in the position of G pixel is found out according to calculating formula below (2), is found out according to calculating formula below (3) in B pixel
Position Y-signal.In addition, image processing part 14 standardizes Y-signal in the range of 0~1.
Y=r+w (1)
Y=g+w (2)
Y=b+w (3)
Hereinafter, being illustrated using Fig. 5 to the method for generating the CbCr signal (colour difference signal) in colour picture signal.
Firstly, image processing part 14 is directed to the picture signal of the Bayer array exported from top photoelectric conversion layer 31, it is used on one side
White balance, the matrix conversion of spectrum adjusting carry out demosaicing (Demosaic) processing (color interpolation processing), on one side to find out
The signal value of the R component of each pixel, G component and B component.Hereinafter, by the signal of the R component handled by demosaicing
Labeled as r ' signal, the signal of the G component handled by demosaicing is labeled as g ' signal, will be by demosaicing at
The signal of obtained B component is managed labeled as b ' signal.Image processing part 14 in the range of 0~1 by r ' signal, g ' signal and
B ' signal normalization.
Then, image processing part 14 is asked using Y-signal and the r ' g ' b ' signal handled by above-mentioned demosaicing
Rgb signal in colour picture signal out.Firstly, being illustrated for the case where R signal found out in colour picture signal.?
In present embodiment, use shown in calculating formula (4) using the relational expression that the SDTV that ITU-R BT.601 standard determines is used as
One example.
Y=0.299R+0.587G+0.114B (4)
It is assumed that the ratio between the R signal, G-signal and B signal in colour picture signal are handled with by above-mentioned demosaicing
The ratio between the r signal, g signal and the b signal that arrive are identical, that is, R:G:B=r ': g ': b ', it is concluded that calculating formula (5) and calculating formula
(6)。
G=(g ' ÷ r ') R (5)
B=(b ' ÷ r ') R (6)
If by calculating formula (5) and calculating (6) substitution calculating formula (4), calculating formula below (7) are obtained.
Y=0.299R+0.587R (g ' ÷ r ')+0.114R (b ' ÷ r ') (7)
If calculating formula (7) are deformed, calculating formula below (8) are obtained.
R=[r ' ÷ (0.299r '+0.587g '+0.114b ')] Y (8)
Image processing part 14 is substituted by the r ' g ' b ' signal and Y-signal that will handle above by demosaicing and is calculated
Formula (8), to find out the R signal in colour picture signal.
Similarly, image processing part 14 is by will be by r ' g ' b ' signal and Y-signal that above-mentioned demosaicing is handled
It substitutes into calculating formula (9) and (10), to find out the G-signal and B signal in colour picture signal.In addition, calculating formula (9) and
It (10) is the expression formula being created that with above-mentioned R signal the case where under similar circumstances.
G=[g ' ÷ (0.299r '+0.587g '+0.114b ')] Y (9)
B=[b ' ÷ (0.299r '+0.587g '+0.114b ')] Y (10)
In this way, image processing part 14 uses the ratio between r ' signal, g ' signal and b ' signal and Y-signal to find out color image
Rgb signal in signal.
Then, image processing part 14 will substitute into calculating below according to the rgb signal that above-mentioned calculating formula (8)~(10) are found out
Formula (11) and (12) find out Cr signal and Cb signal.In addition, calculating formula (11) and (12) are with ITU-R BT.601
The relational expression for the SDTV that standard determines.
Cr=0.500R-0.419G-0.081B (11)
Cb=-0.169R-0.331G+0.500B (12)
In addition, image processing part 14 can also be by substituting into calculating formula (13) below for Y-signal, R signal and B signal
And (14) find out Cr signal and Cb signal.In addition, calculating formula (13) and (14) are also with ITU-R BT.601 standard
The relational expression of the SDTV of decision.
Cr=0.713 (R-Y) (13)
Cb=0.564 (B-Y) (14)
As described above, image processing part 14 uses the letter exported from top photoelectric conversion layer 31 and lower part photoelectric conversion layer 32
Number generate the colour picture signal of YCbCr form.
According to embodiments described above, then function and effect below are obtained.
(1) digital camera 1 includes photographing element 11, has two-dimensionally configured with to the defined color in incident light
The light of ingredient carries out photoelectric conversion and makes top photoelectric conversion layer 31, the Yi Jiyu of the light transmissive pixel of remaining color component
Top photoelectric conversion layer 31 in same optical path laminated configuration and be two-dimensionally arranged with to from top photoelectric conversion layer 31 transmit
Light carry out photoelectric conversion pixel lower part photoelectric conversion layer 32；And image processing part 14, using from top photoelectricity
The output signal of the output signal of conversion layer 31 and photoelectric conversion layer 32 from below, to generate the color image of YCbCr form
Signal.Image processing part 14 passes through the output signal from top photoelectric conversion layer 31 and photoelectric conversion layer 32 from below
Output signal is added to generate the luminance signal in colour picture signal (Y-signal).The digital camera 1 of present embodiment as a result,
It is compared with the past, it can be improved the utilization efficiency of incident light, and high signal output can be obtained, can be improved the S/N of Y-signal
Than (signal-to-noise ratio).
Herein, as a reference, be shown in FIG. 6 the case where colored filter is not configured in previous photographing element with
Bayer array is configured with the relative spectral example in the case where colored filter.In addition, horizontal axis indicates wavelength, the longitudinal axis in Fig. 6
Indicate output, peak value outputting standard is all turned to 1 by each spectrum.For example, when the spectrum being conceived near wavelength 550nm, and not
The case where configuring colored filter is compared, and the G output in the case where being configured with colored filter with Bayer array is obvious, and its is defeated
It is lower out.That is, in the case where being configured with colored filter with Bayer array, compared with the case where colored filter is not configured,
Even the wavelength close to the peak value of G also could not enough sharp whole light that needs that much or many.In addition, the light of the wavelength different from G is used
Ratio it is very low.In this way, the utilization efficiency of incident light is very low in the previous photographing element for being configured with colored filter.
In contrast, in the digital camera of present embodiment 1, it can utilize and be absorbed in previous photographing element by colored filter
The light fallen, it is compared with the past, it can be improved the utilization efficiency of incident light.
(2) in digital camera 1, image processing part 14 carries out at demosaicing each pixel of top photoelectric conversion layer 31
(color interpolation processing) is managed to generate r ' g ' b ' signal, the ratio between r ' g ' b ' signal and Y-signal is used to generate colour picture signal
In rgb signal, CbCr signal is generated according to the change type (calculating formula (11) and calculating formula (12)) of regulation.In this way, at this
It is not to be directly used as the r ' g ' b ' signal handled by demosaicing as previous photographing element in embodiment
Rgb signal in colour picture signal, but the rgb signal in colour picture signal is found out using Y-signal.Its reason is such as
Under.
For example, being the location of pixels of R pixel in top photoelectric conversion layer 31, it is unable to get the information of G component and B component,
It therefore, is attached according to the R pixel for the signal value of G component obtained from the result handled as demosaicing and B component
The signal value of close G pixel and B pixel be worth obtained from interpolation.It on the other hand, is R picture in top photoelectric conversion layer 31
The location of pixels of element contains information related with G component and B component from below in the output signal of photoelectric conversion layer 32.Cause
This, if prediction can obtain handling to obtain with by demosaicing using the output signal of photoelectric conversion layer 32 from below
Picture signal compare the higher picture signal of color reprodubility.Therefore, the digital camera 1 of present embodiment is utilized top light
The Y-signal that electric conversion layer 31 is added with lower part photoelectric conversion layer 32, to find out the rgb signal in colour picture signal.It is logical
It crosses in such manner, it is possible to obtain color reprodubility than previous higher picture signal.
(variation 1)
In the above-described embodiment, it is illustrated for following example, that is, use is to from top photoelectric conversion
The output signal of layer 31 carries out the ratio between r ' ' g ' b ' signal obtained from the result of demosaicing processing and Y-signal, to find out colour
The example of rgb signal in picture signal.But it is also possible to by being gone to the output signal from top photoelectric conversion layer 31
R ' ' g ' b ' signal obtained from the result of mosaic processing is directly used as the rgb signal in colour picture signal, according to above-mentioned meter
Formula (11) and (12) or calculating formula (13) and (14) generate CbCr signal.
(variation 2)
In the above-described embodiment, for the example for being configured with pixel with Bayer array in top photoelectric conversion layer 31
It is illustrated, but the configuration of pixel can also be without being limited thereto.In addition, in the above-described embodiment, in top light
Be illustrated in electric conversion layer 31 configured with the example of R pixel, G pixel and B pixel, however, it is not limited to this for example,
It can be configured with and receive the Cy pixel of the light of Cy (cyan), the Mg pixel for the light for receiving Mg (magenta) and receive Ye (yellow)
Light Ye pixel.
(variation 3)
In the above-described embodiment, it is said for lower part photoelectric conversion layer 32 by the example that organic photoelectric film is constituted
It is bright, but can also be made of photodiode.
In the above description, various embodiments and variation are illustrated, but the present invention is not limited to
These contents.In the range of the thought of technology of the invention it is conceivable that other modes be also contained in the scope of the present invention
It is interior.
The disclosure of following basis for priority application is cited in the addition present invention as citation.
Japanese Patent Application 2013 the 142761st (application on July 8th, 2013)
Description of symbols
1 digital camera, 10 imaging optical systems, 11 photographing elements, 12 control units, 14 image processing parts, 31 top photoelectricity
Conversion layer, 32 lower part photoelectric conversion layers.
Claims (5)
1. a kind of photographic device comprising:
First camera section, have to the first color of light in incident light carry out photoelectric conversion and output signal the first pixel,
With the second pixel for carrying out photoelectric conversion and output signal to the second color of light in the incident light；
Second camera section has the third picture that photoelectric conversion and output signal are carried out to the light for having transmitted first pixel
Element and the 4th pixel that photoelectric conversion and output signal are carried out to the light for having transmitted second pixel；And
The signal of first pixel is added with the signal of the third pixel and generates luminance signal by signal generation portion,
The signal of second pixel is added with the signal of the 4th pixel and generates luminance signal, uses first pixel
Signal and the signal of second pixel carry out color interpolation processing to calculate second color of light in first pixel
Signal and the second pixel in first color of light signal, signal and second pixel based on first pixel
Signal and the signal of first color of light calculated respectively for first pixel and second pixel and described
The signal of second color of light and the luminance signal generate picture signal.
2. photographic device as described in claim 1, which is characterized in that
The signal of signal and generated second color of light of the signal generation portion based on first pixel and described
Luminance signal to correct the signal of first pixel and the signal of second color of light generated, and is based on after correcting
First pixel signal and revised second color of light signal and the luminance signal, come generate color difference letter
Number.
3. photographic device as described in claim 1, which is characterized in that
The signal of signal and generated first color of light of the signal generation portion based on second pixel and described
Luminance signal to correct the signal of second pixel and the signal of first color of light generated, and is based on after correcting
Second pixel signal and revised first color of light signal and the luminance signal, come generate color difference letter
Number.
4. photographic device as described in claim 1, which is characterized in that
The first camera section also has the 5th pixel that photoelectric conversion and output signal are carried out to third color of light,
The second camera section, which also has, carries out the 6th of photoelectric conversion and output signal to the light for having transmitted the 5th pixel
Pixel,
The signal generation portion carries out color interpolation using the signal of first pixel, the second pixel and the 5th pixel and handles
Calculate the first pixel, the second pixel and the 5th pixel respectively in the signal of first color of light, second color of light
The signal of signal and the third color of light, the letter of the signal of first color of light based on calculating, second color of light
Number, the signal of the third color of light and the luminance signal find out described image signal.
5. photographic device as claimed in claim 4, which is characterized in that
Signal of the signal generation portion based on first color of light, the signal of second color of light and the third color
The ratio between signal of light and the luminance signal, find out the first color to third color color component picture signal, and base
In the picture signal and the luminance signal of color component of first color to third color, to generate colour difference signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811340819.7A CN109346493A (en) | 2013-07-08 | 2014-07-04 | Photographic device |
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2013142761A JP6136669B2 (en) | 2013-07-08 | 2013-07-08 | Imaging device |
| JP2013-142761 | 2013-07-08 | ||
| PCT/JP2014/067886 WO2015005234A1 (en) | 2013-07-08 | 2014-07-04 | Imaging device |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811340819.7A Division CN109346493A (en) | 2013-07-08 | 2014-07-04 | Photographic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105580360A CN105580360A (en) | 2016-05-11 |
| CN105580360B true CN105580360B (en) | 2018-12-07 |
Family
ID=52279918
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201480049327.6A Active CN105580360B (en) | 2013-07-08 | 2014-07-04 | Photographic device |
| CN201811340819.7A Pending CN109346493A (en) | 2013-07-08 | 2014-07-04 | Photographic device |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811340819.7A Pending CN109346493A (en) | 2013-07-08 | 2014-07-04 | Photographic device |
Country Status (5)
| Country | Link |
|---|---|
| US (3) | US20160249025A1 (en) |
| EP (1) | EP3021577B1 (en) |
| JP (1) | JP6136669B2 (en) |
| CN (2) | CN105580360B (en) |
| WO (1) | WO2015005234A1 (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6136669B2 (en) * | 2013-07-08 | 2017-05-31 | 株式会社ニコン | Imaging device |
| JP2016134587A (en) * | 2015-01-22 | 2016-07-25 | ソニー株式会社 | Solid state image pickup device and electronic equipment |
| KR20160092125A (en) * | 2015-01-26 | 2016-08-04 | 삼성디스플레이 주식회사 | Display apparatus |
| US10644073B2 (en) | 2016-12-19 | 2020-05-05 | Samsung Electronics Co., Ltd. | Image sensors and electronic devices including the same |
| US12009379B2 (en) * | 2017-05-01 | 2024-06-11 | Visera Technologies Company Limited | Image sensor |
| CN107846537B (en) * | 2017-11-08 | 2019-11-26 | 维沃移动通信有限公司 | A kind of CCD camera assembly, image acquiring method and mobile terminal |
| JP7442990B2 (en) | 2018-11-07 | 2024-03-05 | 三星電子株式会社 | Signal processing device and signal processing method |
| CN110677606B (en) * | 2019-09-16 | 2022-06-10 | Oppo广东移动通信有限公司 | Pixel structure, CIS and terminal |
| CN110690237B (en) * | 2019-09-29 | 2022-09-02 | Oppo广东移动通信有限公司 | Image sensor, signal processing method and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1574902A (en) * | 2003-06-04 | 2005-02-02 | 株式会社尼康 | Imaging device |
| CN101171835A (en) * | 2005-05-11 | 2008-04-30 | 松下电器产业株式会社 | Solid-state imaging pickup device, camera, automobile and monitoring device |
| CN101281921A (en) * | 2007-04-06 | 2008-10-08 | 索尼株式会社 | Solid-state imaging device and imaging apparatus |
| CN101345248A (en) * | 2007-07-09 | 2009-01-14 | 博立码杰通讯(深圳)有限公司 | Multi-optical spectrum light-sensitive device and preparation thereof |
| CN102983143A (en) * | 2011-09-06 | 2013-03-20 | 索尼公司 | Imaging device, imaging apparatus, manufacturing apparatus and manufacturing method |
Family Cites Families (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US2010307A (en) * | 1931-06-06 | 1935-08-06 | Le Roy J Leishman | Means and method for coloring light formed images |
| US6940061B2 (en) | 2002-02-27 | 2005-09-06 | Agilent Technologies, Inc. | Two-color photo-detector and methods for demosaicing a two-color photo-detector array |
| KR100505681B1 (en) * | 2003-03-31 | 2005-08-02 | 삼성전자주식회사 | Interpolator providing for high resolution by interpolation with adaptive filtering for Bayer pattern color signal, digital image signal processor comprising it, and method thereof |
| JP4840967B2 (en) * | 2005-12-01 | 2011-12-21 | キヤノン株式会社 | Imaging apparatus, image processing method, program, and storage medium |
| US7711261B2 (en) | 2006-04-11 | 2010-05-04 | Nikon Corporation | Imaging device, camera and image processing method |
| JP4935162B2 (en) | 2006-04-11 | 2012-05-23 | 株式会社ニコン | Imaging apparatus, camera, and image processing method |
| KR100818987B1 (en) * | 2006-09-19 | 2008-04-04 | 삼성전자주식회사 | Apparatus for photographing image and operating method for the same |
| JP4895834B2 (en) * | 2007-01-23 | 2012-03-14 | Ｈｏｙａ株式会社 | Image processing device |
| KR100877069B1 (en) * | 2007-04-23 | 2009-01-09 | 삼성전자주식회사 | Apparatus and method for photographing image |
| JP5032954B2 (en) * | 2007-11-27 | 2012-09-26 | 日本放送協会 | Color imaging device |
| JP4377428B2 (en) * | 2007-12-12 | 2009-12-02 | アキュートロジック株式会社 | Solid-state imaging device and imaging apparatus using the same |
| KR20090120159A (en) * | 2008-05-19 | 2009-11-24 | 삼성전자주식회사 | Apparatus and method for combining images |
| US8471939B2 (en) * | 2008-08-01 | 2013-06-25 | Omnivision Technologies, Inc. | Image sensor having multiple sensing layers |
| WO2010053029A1 (en) * | 2008-11-04 | 2010-05-14 | コニカミノルタオプト株式会社 | Image inputting apparatus |
| JP2010288150A (en) * | 2009-06-12 | 2010-12-24 | Toshiba Corp | Solid-state imaging device |
| JP4547462B1 (en) * | 2009-11-16 | 2010-09-22 | アキュートロジック株式会社 | IMAGING ELEMENT, IMAGING ELEMENT DRIVE DEVICE, IMAGING ELEMENT DRIVE METHOD, IMAGE PROCESSING DEVICE, PROGRAM, AND IMAGING DEVICE |
| JP2011166477A (en) * | 2010-02-10 | 2011-08-25 | Konica Minolta Opto Inc | Solid-state imaging element and image input device |
| JP5644177B2 (en) * | 2010-05-07 | 2014-12-24 | ソニー株式会社 | Solid-state imaging device, manufacturing method thereof, and electronic apparatus |
| WO2012028847A1 (en) * | 2010-09-03 | 2012-03-08 | Isis Innovation Limited | Image sensor |
| KR101890748B1 (en) * | 2011-02-01 | 2018-08-23 | 삼성전자주식회사 | Pixel of multi stacked CMOS image sensor and method of manufacturing the same |
| WO2012169127A1 (en) * | 2011-06-07 | 2012-12-13 | パナソニック株式会社 | Solid-state image pickup apparatus |
| JP2013070030A (en) * | 2011-09-06 | 2013-04-18 | Sony Corp | Imaging device, electronic apparatus, and information processor |
| US20130075607A1 (en) * | 2011-09-22 | 2013-03-28 | Manoj Bikumandla | Image sensors having stacked photodetector arrays |
| JP2013084785A (en) * | 2011-10-11 | 2013-05-09 | Sony Corp | Solid-state imaging device, and imaging device |
| JP5556823B2 (en) * | 2012-01-13 | 2014-07-23 | 株式会社ニコン | Solid-state imaging device and electronic camera |
| US8569700B2 (en) * | 2012-03-06 | 2013-10-29 | Omnivision Technologies, Inc. | Image sensor for two-dimensional and three-dimensional image capture |
| US9184198B1 (en) * | 2013-02-20 | 2015-11-10 | Google Inc. | Stacked image sensor with cascaded optical edge pass filters |
| JP6136669B2 (en) * | 2013-07-08 | 2017-05-31 | 株式会社ニコン | Imaging device |
-
2013
- 2013-07-08 JP JP2013142761A patent/JP6136669B2/en active Active
-
2014
- 2014-07-04 CN CN201480049327.6A patent/CN105580360B/en active Active
- 2014-07-04 WO PCT/JP2014/067886 patent/WO2015005234A1/en active Application Filing
- 2014-07-04 US US14/903,196 patent/US20160249025A1/en not_active Abandoned
- 2014-07-04 CN CN201811340819.7A patent/CN109346493A/en active Pending
- 2014-07-04 EP EP14823363.8A patent/EP3021577B1/en active Active
-
2017
- 2017-08-23 US US15/684,474 patent/US10136108B2/en active Active
-
2018
- 2018-10-18 US US16/164,159 patent/US20190052846A1/en not_active Abandoned
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1574902A (en) * | 2003-06-04 | 2005-02-02 | 株式会社尼康 | Imaging device |
| CN101171835A (en) * | 2005-05-11 | 2008-04-30 | 松下电器产业株式会社 | Solid-state imaging pickup device, camera, automobile and monitoring device |
| CN101281921A (en) * | 2007-04-06 | 2008-10-08 | 索尼株式会社 | Solid-state imaging device and imaging apparatus |
| CN101345248A (en) * | 2007-07-09 | 2009-01-14 | 博立码杰通讯(深圳)有限公司 | Multi-optical spectrum light-sensitive device and preparation thereof |
| CN102983143A (en) * | 2011-09-06 | 2013-03-20 | 索尼公司 | Imaging device, imaging apparatus, manufacturing apparatus and manufacturing method |
Also Published As
| Publication number | Publication date |
|---|---|
| EP3021577A1 (en) | 2016-05-18 |
| WO2015005234A1 (en) | 2015-01-15 |
| EP3021577A4 (en) | 2017-03-01 |
| US20170353700A1 (en) | 2017-12-07 |
| JP6136669B2 (en) | 2017-05-31 |
| US20160249025A1 (en) | 2016-08-25 |
| JP2015015684A (en) | 2015-01-22 |
| US10136108B2 (en) | 2018-11-20 |
| EP3021577B1 (en) | 2020-02-12 |
| CN105580360A (en) | 2016-05-11 |
| US20190052846A1 (en) | 2019-02-14 |
| CN109346493A (en) | 2019-02-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105580360B (en) | Photographic device | |
| US10257484B2 (en) | Imaging processing device and imaging processing method | |
| US8896744B2 (en) | Solid-state imaging device and camera module with IR filter having wavelength characteristics to block both IR and selected visible light band depending on detection target of pixel cells | |
| EP2664153B1 (en) | Imaging system using a lens unit with longitudinal chromatic aberrations and method of operating | |
| US11095830B2 (en) | Image-capturing device and image processing device | |
| CN112714252B (en) | Image pickup apparatus | |
| EP2156659A1 (en) | Pixel array having wide dynamic range and good color reproduction and resolution and image sensor using the pixel array | |
| US9060159B2 (en) | Image processing device and method, and imaging device | |
| US11917306B2 (en) | Electronic device that corrects images captured on a side opposite a displaying surface | |
| US10056418B2 (en) | Imaging element for generating a pixel signal corresponding to light receiving elements | |
| JP6399146B2 (en) | Imaging device | |
| CN115023938A (en) | Electronic device | |
| KR100905269B1 (en) | Image sensor with infrared ray correction | |
| US20240194712A1 (en) | Solid-state imaging apparatus and electronic device | |
| JP2019004507A (en) | Imaging device | |
| US8964071B2 (en) | Solid-state imaging device, camera module, and imaging method having first and second green pixel cells | |
| JPH10243409A (en) | Two-board type image pickup device | |
| KR101208602B1 (en) | Camera Module | |
| JP2015220532A (en) | Imaging device and imaging method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |