WO2014033976A1 - 固体撮像素子、撮像装置および信号処理方法 - Google Patents
固体撮像素子、撮像装置および信号処理方法 Download PDFInfo
- Publication number
- WO2014033976A1 WO2014033976A1 PCT/JP2013/001778 JP2013001778W WO2014033976A1 WO 2014033976 A1 WO2014033976 A1 WO 2014033976A1 JP 2013001778 W JP2013001778 W JP 2013001778W WO 2014033976 A1 WO2014033976 A1 WO 2014033976A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- light
- photosensitive cell
- incident
- refractive index
- spectral
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
- H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
- H10F39/80—Constructional details of image sensors
- H10F39/806—Optical elements or arrangements associated with the image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/12—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
-
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
- H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
- H10F39/80—Constructional details of image sensors
- H10F39/806—Optical elements or arrangements associated with the image sensors
- H10F39/8063—Microlenses
-
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
- H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
- H10F39/80—Constructional details of image sensors
- H10F39/806—Optical elements or arrangements associated with the image sensors
- H10F39/8067—Reflectors
Definitions
- This application relates to a technology for increasing the sensitivity and coloration of a solid-state imaging device.
- image sensors In recent years, there has been a remarkable increase in functionality and performance of digital cameras and digital movies using solid-state image sensors such as CCDs and CMOSs (hereinafter sometimes referred to as “image sensors”). In particular, due to rapid progress in semiconductor manufacturing technology, the pixel structure in an image sensor has been miniaturized. As a result, the pixels of the image sensor and the drive circuit are highly integrated, and the performance of the image sensor is increasing. In particular, in recent years, a camera using a backside illumination type image sensor that receives light on the back surface side rather than the surface (front surface) side on which the wiring layer of the solid-state image sensor is formed has been developed, and its characteristics are attracting attention. ing. On the other hand, with the increase in the number of pixels of the image sensor, the amount of light received by one pixel is reduced, which causes a problem that the sensitivity of the camera is reduced.
- ⁇ Deterioration of camera sensitivity is caused not only by the increase in the number of pixels but also by the use of color filters for color separation.
- a subtractive color filter using an organic pigment as a coloring matter is arranged facing each photosensitive cell of the image sensor. Since the color filter absorbs light other than the color component to be used, when such a color filter is used, the light utilization rate of the camera is lowered.
- each color filter of R, G, B is Only the R, G, B light is transmitted and the remaining light is absorbed. Therefore, the light used in the color camera with the Bayer array is about 1/3 of the entire incident light.
- the use of the color filter causes a decrease in light use efficiency and causes a decrease in sensitivity of the color camera.
- Patent Document 1 discloses a colorization technique for increasing the light utilization rate by using a spectral element that separates light according to a wavelength instead of a color filter. According to this technique, light is incident on different photosensitive cells depending on the wavelength range by the spectral elements arranged corresponding to the photosensitive cells. Each photosensitive cell receives light on which components in different wavelength ranges are superimposed from a plurality of spectral elements. As a result, a color signal can be generated by signal calculation using a photoelectric conversion signal output from each photosensitive cell.
- Patent Document 2 discloses a colorization technique in which a spectral element is applied to an image sensor having an oblique pixel arrangement (so-called honeycomb arrangement). According to this technique, as in Patent Document 1, the light utilization rate can be increased.
- Embodiments of the present invention can provide a novel solid-state imaging device and imaging apparatus including a spectral element.
- a solid-state imaging device includes a first photosensitive cell, a second photosensitive cell, a third photosensitive cell, and a fourth photosensitive cell, respectively.
- a second microlens arranged to cover the second light-splitting element and the third photosensitive cell and to cover a part of the fourth photosensitive cell.
- a microlens array including lenses.
- the microlens array light incident on a region facing the second photosensitive cell in a region where the first and second microlenses are not provided enters the second photosensitive cell; Of the area where the first and second microlenses are not provided, the light incident on the area facing the fourth photosensitive cell is configured to enter the fourth photosensitive cell.
- the first spectral element causes light of a first color component out of light incident through the first microlens to enter the first photosensitive cell, and passes through the first microlens. Out of the incident light, the light of the second color component is incident on the second photosensitive cell.
- the second spectroscopic element causes light of a third color component of light incident through the second microlens to enter the third photosensitive cell, and passes through the second microlens. Out of the incident light, the light of the fourth color component is incident on the fourth photosensitive cell.
- FIG. 2 is a perspective view schematically showing an arrangement relationship among a photosensitive cell array 200, a spectral element array 100, and a microlens array 400 in the solid-state imaging device 10.
- A is a top view which shows an example of the basic composition of the solid-state image sensor 10
- (b) is an AA 'sectional view
- (c) is a BB' sectional view. It is a figure which shows the example of the intensity
- 1 is a block diagram illustrating a schematic configuration of an imaging apparatus according to Embodiment 1.
- FIG. 2 is a diagram illustrating a lens and an image sensor in Embodiment 1.
- FIG. 2 is a diagram illustrating an example of a pixel array of an image sensor according to Embodiment 1.
- FIG. It is a figure which shows the modification of the pixel arrangement
- 1 is a plan view showing a basic structure of an image sensor in Embodiment 1.
- FIG. 2 is a partial plan view focusing on a microlens 4.
- FIG. (A) is the sectional view on the AA 'line in FIG. 6A
- (b) is the sectional view on the BB' line in FIG. 6A.
- FIGS. 4A to 4C are process cross-sectional views illustrating an example of a method for manufacturing the spectral element array 100.
- FIG. 6 is a flowchart illustrating a procedure of color information generation processing in the first embodiment.
- (A)-(d) is a figure for demonstrating that the read-out order of a signal changes as a calculation unit shifts 1 pixel at a time.
- FIG. 6 is a plan view illustrating a structure of an image sensor in a modified example of the first embodiment.
- a solid-state imaging device includes a plurality of units each including a first photosensitive cell, a second photosensitive cell, a third photosensitive cell, and a fourth photosensitive cell.
- a microlens including one microlens and a second microlens disposed to cover the second light-splitting element and the third photosensitive cell and to cover a part of the fourth photosensitive cell
- An array comprising the first and second microlenses Of the area not provided, light incident on the area facing the second photosensitive cell is incident on the second photosensitive cell, and the area where the first and second microlenses are not provided.
- a microlens array configured such that light incident on a region facing the fourth photosensitive cell is incident on the fourth photosensitive cell.
- the first spectral element causes light of a first color component out of light incident through the first microlens to enter the first photosensitive cell, and passes through the first microlens.
- the light of the second color component is incident on the second photosensitive cell.
- the second spectroscopic element causes light of a third color component of light incident through the second microlens to enter the third photosensitive cell, and passes through the second microlens.
- the light of the fourth color component is incident on the fourth photosensitive cell.
- each of the first and second spectral elements is lower than a refractive index of the high refractive index transparent portion and the high refractive index transparent portion.
- a low refractive index transparent portion having a refractive index and provided around the high refractive index transparent portion, and at least one of the shape and size of the high refractive index transparent portion in the first spectral element is the It differs from that of the high refractive index transparent portion in the second spectral element.
- the high refractive index transparent part in the first spectral element and the high refractive index transparent part in the second spectral element are the imaging surface. Are arranged in parallel with each other.
- the direction of the high refractive index transparent portion in the first spectral element is the high in the first spectral element facing an adjacent unit block.
- the direction of the high refractive index transparent portion in the second spectral element facing the adjacent unit block is 90 degrees different from the direction of the transparent refractive index portion. It is 90 degrees different from the orientation.
- the spectral element array is arranged on the imaging surface in the direction of spectroscopy by the two closest first spectral elements.
- the parallel components are orthogonal to each other, and the components parallel to the imaging surface in the direction of spectroscopy by the two closest second spectral elements are orthogonal to each other.
- the first light-splitting element may transmit half of the light of the second color component included in incident light. Incident light is incident on a second photosensitive cell, and the remaining half of the light of the second color component is incident on the second photosensitive cell in any adjacent unit block, and the second spectral element is incident Half of the light of the fourth color component included in the light is incident on the fourth photosensitive cell, and the other half of the light of the fourth color component is input to the fourth light component in any adjacent unit block. The light is incident on the photosensitive cell.
- the second light-sensitive cell includes the first light-splitting element and the first unit in any adjacent unit block.
- Received and received light of the second color component incident from one spectral element and light of the first and second color component incident without passing through the first and second microlenses The fourth light sensing cell outputs the light of the fourth color component incident from the fourth spectral element in the second spectral element and any adjacent unit block. And the light of the third and fourth color components incident without passing through the first and second microlenses, and outputs a photoelectric conversion signal corresponding to the received light.
- the first spectral element may emit substantially all of the light of the first color component included in incident light.
- the light is incident on the first light-sensitive cell facing the second light-receiving element, and the second light-splitting element makes substantially all of the light of the third color component included in the incident light incident on the third light-sensitive cell facing the second light-sensitive element.
- the second color component is a complementary color of the first color component
- the fourth color component Is a complementary color of the third color component.
- the first color component is one of magenta and green
- the second color component is magenta
- the third color component is one of red including a part of green and blue including a part of green
- the fourth color component includes a part of green.
- the other is blue, including red and part of green.
- An imaging apparatus includes a solid-state imaging device according to any one of items (1) to (10), an optical system that forms an image on the solid-state imaging device, and the solid-state imaging device.
- a signal processing unit for processing a signal output from the first photosensitive cell, a first photoelectric conversion signal output from the first photosensitive cell, and a second photoelectric conversion signal output from the second photosensitive cell A signal processing unit that generates color information by calculation using the third photoelectric conversion signal output from the third photosensitive cell and the fourth photoelectric conversion signal output from the fourth photosensitive cell.
- a method according to an aspect of the present invention is a method for processing a signal output from a solid-state imaging device according to any one of items (1) to (10), wherein the first photosensitive cell.
- a program according to an aspect of the present invention is a program for processing a signal output from a solid-state imaging device according to any one of items (1) to (10), and The first photoelectric conversion signal output from the first photosensitive cell, the second photoelectric conversion signal output from the second photosensitive cell, and the third photoelectric signal output from the third photosensitive cell. Obtaining a conversion signal and a fourth photoelectric conversion signal output from the fourth photosensitive cell; and generating color information using the first to fourth photoelectric conversion signals. .
- spectral spatial separation of light having different wavelength ranges or color components
- a spatial minimum unit for detecting light is referred to as a “photosensitive cell” or “pixel”.
- the xyz coordinates shown in the figure are used for the description.
- the imaging surface of the imaging device 10 is an “xy plane”, and the “x axis” is the horizontal direction on the imaging surface, the “y axis” is the vertical direction on the imaging surface, and the “z axis” is the direction perpendicular to the imaging surface.
- horizontal direction and vertical direction mean directions on the imaging surface corresponding to the horizontal direction and vertical direction of the generated image, respectively.
- FIG. 1 is a perspective view schematically showing a part of an image sensor 10 according to an embodiment.
- the imaging element 10 includes a photosensitive cell array 200 including a plurality of photosensitive cells 2 (hereinafter also referred to as “pixels”) two-dimensionally arranged on an imaging surface, and a spectral including a plurality of spectral elements.
- An element array 100 and a microlens array 400 including a plurality of microlenses 4 are provided.
- Light incident on the image sensor 10 enters the microlens array 400, the spectral element array 100, and the photosensitive cell array 200 in this order, and is converted into an electrical signal by each photosensitive cell 2.
- the spectral element array 100 is represented by a quadrangular prism for the sake of simplicity, but actually does not have such a shape but has a more detailed structure.
- each light sensing cell 2 When each light sensing cell 2 receives light, it outputs an electrical signal corresponding to the intensity of the light received by photoelectric conversion (hereinafter also referred to as “photoelectric conversion signal” or “pixel signal”). Each photosensitive cell 2 receives light spectrally separated by the spectral elements included in the spectral element array 100.
- the photosensitive cell array 200 includes a plurality of unit blocks each including four photosensitive cells. Two spectral elements having different spectral characteristics are arranged opposite to the two photosensitive cells in each unit block.
- the spectral element array 100 is constituted by these spectral elements as a whole. Further, a microlens 4 is arranged to face each spectral element.
- FIG. 2 is a schematic diagram showing the basic structure of the image sensor 10.
- FIG. 2 (a) shows four photosensitive cells 2a to 2d constituting one unit block of the photosensitive cell array 200, two spectral elements 1a and 1b arranged facing each other, and two microlenses. It is a top view which shows 4a, 4b.
- FIGS. 2B and 2C are diagrams schematically showing an AA ′ line cross-section and a BB ′ line cross-section in FIG. 2A, respectively.
- the four photosensitive cells 2a to 2d are arranged in two rows and two columns, but the present invention is not limited to such an example.
- the four photosensitive cells 2a to 2d may be arranged in a shape that meanders in an oblique direction.
- the first light-splitting element 1a is disposed facing the first light-sensitive cell 2a
- the second light-splitting element 1b is disposed facing the third light-sensitive cell 2c.
- the first microlens 4a is disposed so as to cover the first light-splitting element 1a and the first photosensitive cell 2a and to cover a part of the second photosensitive cell 2b
- the second microlens 4b is disposed so as to cover the second light-splitting element 1b and the third light-splitting element 1c and to cover a part of the fourth photosensitive cell 2d.
- the light incident on the microlens 4a is focused on the spectroscopic element 1a and dispersed according to the wavelength range (color component).
- the light incident on the microlens 4b is collected on the light-splitting element 1b and dispersed according to the wavelength range (color component).
- the light incident on the region facing the second photosensitive cell 2b in the region where the microlenses 4a and 4b are not provided enters the second photosensitive cell 2b without being dispersed.
- light that has entered a region facing the fourth photosensitive cell 2d in the region in which the microlenses 4a and 4b are not provided enters the fourth photosensitive cell 2d without being split.
- a region in the microlens array 400 where the microlenses 4a and 4b are not provided may be referred to as a “non-spectral part”.
- the symbols W represents the intensity of visible light focused on the spectral elements 1a and 1b by the microlenses 4a and 4b, respectively.
- the first spectral element 1a causes the first color component light (intensity C1) out of the light (intensity W) incident through the first microlens 4a to be incident on the first photosensitive cell 2a.
- Light of the second color component (intensity C2) is configured to enter the second photosensitive cell.
- the second light-splitting element 1b makes the third color component light (intensity C3) incident on the third photosensitive cell 2c out of the light (intensity W) incident through the second microlens 4b.
- the fourth color component light (intensity C4) is incident on the fourth photosensitive cell 2d.
- the wavelength range of the light of the first color component and the wavelength range of the light of the second color component are completely different because the first color component and the second color component have a complementary color relationship. There is no need to separate them, and they may partially overlap. Similarly, the wavelength range of the light of the third color component and the wavelength range of the light of the fourth color component may partially overlap.
- the first to fourth color components include, for example, magenta (Mg), green (G), red including approximately half of the green component (R + 1 / 2G, hereinafter referred to as “Yr”), and approximately half of the green component. It may be blue (B + 1 / 2G, hereinafter referred to as “Cb”). However, other combinations may be used as long as the four color components are included in visible light.
- FIG. 3 shows an example of the intensity distribution with respect to the wavelength of each color component (hereinafter also referred to as “spectral distribution”) when the first to fourth color components are G, Mg, Cb, and Yr, respectively.
- G is a color component mainly containing a component in the green wavelength range (around 500 nm to 600 nm), and may contain some components in other wavelength ranges.
- Mg is a color component mainly containing components in the blue wavelength range (around 400 nm to 500 nm) and red wavelength range (around 600 nm to 700 nm), and may contain some components in the green wavelength range.
- Cb is a color component mainly containing a component of blue to green on the short wavelength side (around 400 nm to 550 nm), and may contain some components in other wavelength regions.
- Yr is a color component mainly containing components of green to red (near 550 nm to 700 nm) on the long wavelength side, and may contain some components in other wavelength regions.
- Such spectral elements 1a and 1b can be constituted by, for example, a “high refractive index transparent portion” which will be described in detail later and a “low refractive index transparent portion” provided therearound.
- it may be constituted by a microlens whose shape and refractive index are appropriately designed.
- it can be realized by using a multilayer filter (dichroic mirror) that reflects light in a specific wavelength range and transmits light in other wavelength ranges.
- a multilayer filter dichroic mirror
- the light reflected by the multilayer filter can be totally reflected and guided to an adjacent photosensitive cell.
- the photosensitive cells 2a to 2d receive light of the intensity represented by C1, C2 + kW, C3, and C4 + kW, respectively, as shown in FIGS. 2 (b) and 2 (c).
- Each photosensitive cell outputs a photoelectric conversion signal corresponding to these intensities. Since the signals output from each photosensitive cell have different color information, if a 3 ⁇ 4 matrix having appropriately set parameters is used, RGB color signals can be calculated by calculation with the matrix.
- photoelectric conversion signals output from the photosensitive cells 2a, 2b, 2c, and 2d are S2a, S2b, S2c, and S2d, respectively, and signals corresponding to the color components C1, C2, C3, C4, and W
- S2a to S2d can be expressed by the following equations 1 to 4, respectively.
- S2a C1s
- S2c C3s
- the signals C1s, C2s, and C3s can all be expressed as linear combinations of the RGB signals Rs, Gs, and Bs
- the signals S2a to S2d can also be expressed as linear combinations of Rs, Gs, and Bs. That is, with a11 to a43 as predetermined coefficients, S2a to S2d can be expressed by Equation 5 below.
- the signals Rs, Gs, and Bs can be obtained by performing the inverse operation of Equation 5.
- An RGB color image can be obtained by executing this calculation for each unit block.
- color information can be obtained by signal calculation using a spectral element without using a color filter that absorbs part of light. Therefore, loss of light can be prevented and imaging sensitivity can be increased. Furthermore, since the information on the light (kW) incident on the photosensitive cells 2b and 2d through the region where the microlenses 4a and 4b are not disposed (non-spectral part 3) can be obtained, the non-spectral part 3 It is possible to increase the resolution as compared to a configuration in which no resolution is provided.
- the spectral elements 1a and 1b divide the incident light W and make it incident on the two photosensitive cells, if the coefficient k is a relatively small value, the signal value is particularly large or particularly small for a specific pixel. It is possible to avoid this. In other words, it is possible to improve the dynamic range characteristics of the image sensor 10 with respect to incident light.
- FIG. 4A is a block diagram illustrating an overall configuration of the imaging apparatus according to the first embodiment.
- the imaging apparatus according to the present embodiment is a digital electronic camera, and includes an imaging unit 300 and a signal processing unit 500 that generates a signal (image signal) indicating an image based on a signal transmitted from the imaging unit 300. ing. Note that the imaging device may generate only a still image or may have a function of generating a moving image.
- the imaging unit 300 is a solid that converts an optical lens 12 for imaging a subject, an infrared cut filter 11, and optical information imaged through the optical lens 12 and the infrared cut filter 11 into an electrical signal by photoelectric conversion.
- An image sensor 10 image sensor
- the imaging unit 300 further generates a basic signal for driving the imaging device 10, receives an output signal from the imaging device 10, and sends it to the signal processing unit 500, and signal generation / reception.
- an element driving unit 14 that drives the image sensor 10 based on the basic signal generated by the unit 13.
- the optical lens 12 is a known lens, and may be a lens unit having a plurality of lenses such as a zoom lens and a focus lens.
- the infrared cut filter 11 removes infrared rays, transmits visible light, and enters the solid-state imaging device 10.
- a crystal low-pass filter for reducing moire patterns generated due to the pixel arrangement may be provided.
- the image sensor 10 is typically a CMOS or a CCD, and can be manufactured by a known semiconductor manufacturing technique.
- the signal generation / reception unit 13 and the element driving unit 14 are configured by an LSI such as a CCD driver, for example.
- the signal processing unit 500 generates an image signal by processing a signal sent from the imaging unit 300, a memory 30 for storing various data generated in the process of generating the image signal, and a generated signal And an image signal output unit 16 for sending the image signal to the outside.
- the image signal generation unit 15 can be suitably realized by a combination of hardware such as a known digital signal processor (DSP) and software that executes image processing including image signal generation processing.
- the memory 30 is configured by a DRAM or the like. The memory 30 records the signal transmitted from the imaging unit 300 and temporarily records the image data generated by the image signal generation unit 15 and the compressed image data. These image data are sent to a recording medium (not shown) or a display unit via the image signal output unit 16.
- the imaging apparatus of the present embodiment may include known components such as an electronic shutter, a viewfinder, a power source (battery), and a flashlight, but a description thereof is omitted because it is not particularly necessary for understanding the present invention.
- known components can be used in appropriate combinations for the components other than the image sensor 10 and the image signal generation unit 15.
- FIG. 4B is a diagram schematically illustrating a state in which light transmitted through the lens 12 is incident on the image sensor 10 during exposure.
- the lens 12 can be generally composed of a plurality of lenses arranged in the optical axis direction, but is drawn as a single lens for simplicity.
- a photosensitive cell array including a plurality of photosensitive cells (pixels) arranged two-dimensionally is disposed on the imaging surface 10a of the imaging element 10. Each photosensitive cell is typically a photodiode, and outputs a photoelectric conversion signal (pixel signal) corresponding to the amount of incident light by photoelectric conversion.
- Light transmitted through the lens 12 and the infrared cut filter 11 is incident on the imaging surface 10a.
- the intensity of light incident on the imaging surface 10a and the distribution (spectral distribution) of the amount of incident light for each wavelength range differ depending on the incident position.
- the photosensitive cell array 200 includes a plurality of photosensitive cells 2 that are two-dimensionally arranged in a direction rotated by 45 degrees with respect to each of the x-axis direction and the y-axis direction on the imaging surface 10a.
- a “diagonal arrangement” or a “honeycomb arrangement” can increase the resolution in the horizontal direction and the vertical direction as compared with a normal square lattice arrangement.
- the photosensitive cell array 200 includes a plurality of unit blocks 40, and each unit block 40 includes four photosensitive cells 2a, 2b, 2c, and 2d.
- the unit block 40 in the present embodiment is composed of four photosensitive cells 2a to 2d arranged in a meandering manner obliquely with respect to the horizontal and vertical directions. That is, the first and second photosensitive cells 2a and 2b are arranged in the first direction, the second and third photosensitive cells 2b and 2c are arranged in the second direction intersecting the first direction, and the first The third and fourth photosensitive cells 2c and 2d are arranged in the first direction.
- the arrangement of the photosensitive cells 2 is not such an oblique arrangement, but may be, for example, a square lattice arrangement shown in FIG. 5B or another arrangement.
- Each unit block may include five or more photosensitive cells.
- a wiring for connecting each photosensitive cell 2 to a readout circuit (not shown) is provided. However, these wirings are not shown in the drawings of the present application for the sake of simplicity.
- a spectral element array including a plurality of spectral elements and a microlens array including a plurality of microlenses are arranged on the light incident side.
- two spectral elements and two microlenses are provided for the four photosensitive cells included in each unit block.
- the spectroscopic element in the present embodiment is an optical element that directs incident light in different directions according to the wavelength range by using diffraction of light generated at the boundary between two types of translucent members having different refractive indexes.
- This type of spectroscopic element consists of a high refractive index transparent part (core part) made of a material having a relatively high refractive index and a low contact with each side face of the core part made of a material having a relatively low refractive index. It has a refractive index transparent part (cladding part). Due to the difference in refractive index between the core part and the clad part, a phase difference occurs between the light transmitted through the core part and diffraction occurs.
- the phase difference varies depending on the wavelength of light, it becomes possible to spatially separate light according to the wavelength range (color component).
- the light of the first color component can be directed in half in the first direction and the second direction, and the light other than the first color component can be directed in the third direction. It is also possible to direct light in different wavelength ranges (color components) in the three directions.
- the terms “high refractive index” and “low refractive index” do not mean absolute high or low refractive index, but merely a result of relative comparison of refractive indexes. That is, “low refractive index” means that the refractive index of the low refractive index transparent portion is lower than the refractive index of the high refractive index transparent portion. On the other hand, “high refractive index” means that the refractive index of the high refractive index transparent portion is higher than the refractive index of the low refractive index transparent portion. Therefore, if the refractive index of the low refractive index transparent part is lower than the refractive index of the high refractive index transparent part, the value of each refractive index is arbitrary.
- the low refractive index transparent portion is formed in a layered manner in the spectral element array 100.
- the low refractive index transparent portion is also referred to as a “low refractive index transparent layer”.
- the individual high refractive index transparent portions embedded in the low refractive index transparent layer locally reduce the phase velocity of light incident on the low refractive index transparent portion.
- each high refractive index transparent part may be called a "spectral element.” This spectral element may be called a “phase shifter”.
- the shape of the high refractive index transparent portion in each spectral element is plate-like, and in the case of the configuration shown in FIG. 5A, the side in the direction rotated counterclockwise by 45 degrees counterclockwise from the x-axis direction is the shortest and 45 degrees left from the y-axis direction. It is a rectangular parallelepiped with the longest side in the direction of rotation.
- the shape of the high refractive index transparent portion is a rectangular parallelepiped having the shortest side in the x-axis direction and the longest side in the y-axis direction.
- the shape of the high refractive index transparent portion is not necessarily a strict rectangular parallelepiped, and the edge may be rounded, or the side surface may have a taper or a reverse taper.
- the term “plate-like” refers to a shape in which the length of the shortest side of the high refractive index transparent portion is no more than half the length of each side in the other two directions orthogonal to the side. Widely include.
- FIG. 6A is a plan view showing the basic structure of the image sensor 10.
- Four photosensitive cells 2a to 2d represented by thick solid lines in FIG. 6A constitute one unit block.
- two types of spectral elements 1a and 1b are arranged at a rate of one for every two pixels in each of the horizontal direction (x direction) and the vertical direction (y direction).
- the plurality of light-splitting elements 1a arranged in the vertical direction have different directions by 90 degrees.
- the plurality of light-splitting elements 1b arranged in the vertical direction are also different in direction by 90 degrees.
- the direction of the spectral element 1a in one unit block is 90 degrees different from the direction of the spectral element 1a facing the adjacent unit block.
- the direction of the spectral element 1b in one unit block is 90 degrees different from the direction of the spectral element 1b facing the adjacent unit block.
- the directions of the two types of spectral elements 1a and 1b included in one unit block are parallel.
- the components parallel to the imaging surface in the direction of the spectrum by the two first light-splitting elements 1a closest to each other are orthogonal to each other.
- components parallel to the imaging surface in the direction of the spectrum by the two second light-splitting elements 1b that are closest to each other are also orthogonal to each other.
- a microlens 4 is disposed on each of the spectral elements 1a and 1b. In the following description, the microlenses 4a and 4b are not distinguished from each other and are simply expressed as the microlens 4.
- FIG. 6B is a diagram showing an arrangement state of the microlenses 4.
- Each microlens 4 has a shape close to a square, but the shape of the corner is rounded. Therefore, the region surrounded by the corner portions of the four adjacent microlenses 4 does not have a light collecting function. Incident light transmitted through the region is directly incident on the photosensitive cell immediately below without being split. For this reason, this region is referred to as “non-spectral part 3”.
- the spectral elements 1a and 1b having a refractive index relatively higher than that of the surroundings function as a waveguide for drawing light, a part of the light transmitted through the non-spectral part 3 is attracted to the spectral elements 1a and 1b. . Therefore, when the size of the non-spectral part 3 is too small, light may not enter the opposing photosensitive cells 2b and 2d.
- the size and shape of the non-spectral part 3 are appropriately designed so that light that has passed through the non-spectral part 3 is directly incident on the photosensitive cells 2b and 2d.
- FIGS. 7A and 7B are diagrams respectively showing the AA ′ line cross section and the BB ′ line cross section in FIG. 6A, and the photosensitive cells 2 a to 2 d, the spectral elements 1 a and 1 b included in one unit block.
- the arrangement relationship of the microlenses 4 is also shown.
- a plurality of microlenses 4 are formed on the surface of the image sensor 10, and the spectral elements 1 a and 1 b are disposed below the microlenses 4.
- the low refractive index transparent layer 6 is filled around the spectral elements 1a and 1b which are high refractive index transparent portions.
- a photosensitive cell 2a is disposed immediately below the spectral element 1a, and the photosensitive cell 2b is positioned immediately below the region between the spectral element 1a and the spectral element 1b 'on the adjacent unit block. Is arranged.
- a light sensing cell 2c is arranged immediately below the light-splitting element 1b, and light sensing is performed immediately below the region between the light-splitting element 1b and the light-splitting element 1a 'on the adjacent unit block.
- Cell 2d is arranged.
- a microlens 4 for efficiently condensing light to each photosensitive cell is disposed corresponding to the photosensitive cells 2 a and 2 c with a transparent layer 6 interposed therebetween.
- the spectroscopic elements 1 a and 1 b have a rectangular cross section that is long in the direction in which light is transmitted, and perform spectroscopic analysis by light diffraction caused by a difference in refractive index between itself and the transparent layer 6.
- the light-splitting element 1a causes green (G) light to enter the opposing photosensitive cell 2a and allows magenta (Mg) light to be incident on the adjacent photosensitive cell 2b in half.
- the spectroscopic element 1b makes blue (Cb) light including about half of the green component (green on the short wavelength side) incident on the opposite photosensitive cell 2c, and about half of the green component (on the adjacent photosensitive cell 2d). Red (Yr) light including green on the long wavelength side is incident.
- the length and thickness of the spectral elements 1a and 1b are designed so that the spectral elements 1a and 1b have the spectral characteristics described above.
- the spectral distribution of G light, Mg light, Cb light, and Yr light generated by spectroscopy when white light is incident on the spectral elements 1a and 1b has the characteristics shown in FIG. 3, for example.
- the spectroscopic elements 1a and 1b can be made of, for example, silicon nitride (SiN).
- the low refractive index transparent layer 6 can be formed of, for example, silicon dioxide (SiO 2 ).
- the material of the spectral element array 100 is not limited to this example.
- a substance that absorbs light in a specific wavelength region may be added to a part of the high refractive index transparent portion or the low refractive index transparent layer 6 constituting the spectral elements 1a and 1b.
- a first low refractive index transparent layer 6a constituting a part of the low refractive index transparent layer 6 is deposited on the photosensitive cell array 200.
- the first low refractive index transparent layer 6a can be deposited using a known thin film deposition technique. For example, CVD (chemical vapor deposition) or sputtering can be used.
- a transparent film 9 made of a material having a refractive index higher than that of the low refractive index transparent layer 6 is deposited on the first low refractive index transparent layer 6a.
- the transparent layer 9 can also be deposited using a known thin film deposition technique.
- an etching mask pattern 7 is formed on the transparent layer 9 by lithography. By designing a photomask pattern used in the lithography technique, an etching mask pattern 7 having an arbitrary planar shape can be formed.
- etching the transparent layer 9 using the etching mask pattern 7 as a mask unnecessary portions are removed from the transparent layer 9 so that a high refractive index transparent portion (in the illustrated example, “Spectral elements 1a, 1b”).
- This etching can be performed by anisotropic dry etching. During the etching, a taper of the high refractive index transparent portion can be formed.
- the region between the high refractive index transparent portions is embedded by the second low refractive index transparent layer 6b constituting the low refractive index transparent layer 6. Then, the formation of the low refractive index transparent layer 6 is completed.
- the second low refractive index transparent layer 6b can be formed so as to cover the upper surface of the high refractive index transparent portion.
- the distance between the lower end of the high refractive index transparent part and the photosensitive cell array 200 can be controlled by adjusting the thickness of the first low refractive index transparent layer 6a. Between the spectral element 1a and the spectral element 1b having different spectral characteristics, the distance between the lower end of the high refractive index transparent portion and the photosensitive cell array 200 may be different. For this reason, when manufacturing the spectral element array 100 in this embodiment, the process of changing the thickness of the 1st low refractive index transparent layer 6a according to a position is performed.
- Such a process is performed by etching a part of the first low-refractive-index transparent layer 6a from the surface before depositing the transparent layer 9, or by applying another layer on the first low-refractive-index transparent layer 6a. What is necessary is just to form the pattern of a low refractive index transparent layer.
- the pattern of another low refractive index transparent layer can be formed by, for example, a lift-off method.
- FIG. 9 is a perspective view showing a part of a structure in which a pattern of another low refractive index transparent layer 6a 'is formed on the first low refractive index transparent layer 6a.
- the pattern of the other low refractive index transparent layer 6a ' may be, for example, a stripe shape extending in the y direction.
- the height may differ between the spectral element 1a and the spectral element 1b having different spectral characteristics.
- the transparent layer 9 having a different thickness depending on the location may be deposited.
- Such a transparent layer 9 is formed by depositing a transparent layer 9 having a substantially uniform thickness on the first low-refractive-index transparent layer 6a having a concavo-convex step as shown in FIG. It can be formed by planarizing the top surface of layer 9. When such flattening is performed, the upper surfaces of the high refractive index transparent portions constituting the spectral element array 100 are all at the same level.
- the upper surface of the high refractive index transparent part located in a specific region is masked, and the upper surface of the unmasked high refractive index transparent part is Selective etching may be performed.
- the manufacturing method of said spectral element array is an example, and is not limited to such a method.
- one of the microlenses 4 in the present embodiment is disposed so as to cover the first light-splitting element 1a and the first photosensitive cell 2a and to cover the second photosensitive cell 2b.
- the other one of the microlenses 4 is disposed so as to cover the second light-splitting element 1b and the third photosensitive cell 2c and to cover the fourth photosensitive cell 2d. Since the non-spectral part 3 exists in a region facing the second photosensitive cell 2b and the third photosensitive cell 2c, the incident light W that is incident on the photosensitive cells 2b and 2d without being condensed or dispersed. '(Hereinafter sometimes referred to as “direct incident light”).
- the intensity of the directly incident light W ′ is kW (k is a real number satisfying 0 ⁇ k ⁇ 1).
- R, G, and B represent the intensities of the red, green, and blue color components included in the incident light, respectively.
- FIG. 10A is a diagram showing the color components of light received by each photosensitive cell, assuming that there is no direct incident light W ′.
- Each photosensitive cell receives light of any color component of G, Mg, Cb, and Yr by the action of the spectral elements 1a and 1b.
- the second and fourth photosensitive cells 2b and 2d further receive the direct incident light W ′.
- FIG. 10C shows the light reception status of the photosensitive cells 2a, 2b, 2c, and 2d belonging to one unit block.
- the photosensitive cells 2a, 2b, 2c, and 2d receive light of an intensity represented by G, Mg + W ′, Cb, and Yr + W ′, respectively.
- the signal of each component included in the photoelectric conversion signal is represented by adding a suffix “s” to a symbol indicating each component. That is, R, G, B, Mg, Cb, Yr, W, and W ′ component signals are represented as Rs, Gs, Bs, Mgs, Cbs, Yrs, Ws, and W ′s, respectively.
- Ws Rs + Gs + Bs
- Mgs Rs + Bs
- Yrs Rs + (1/2) Gs
- Cbs Bs + (1/2) Gs.
- the signals S2a to S2d output from the photosensitive cells 2a to 2d are expressed by the following equations 6 to 9, respectively.
- RGB color signals can be obtained using signals from the four photosensitive cells 2a to 2d.
- the image signal generator 15 shown in FIG. 4A generates color information Rs, Gs, and Bs by performing calculations of equations 14 to 15 using the photoelectric conversion signals S2a to S2d.
- the image signal generation unit 15 can obtain color information for each pixel by performing the same calculation for all pixels while shifting the calculation unit of four pixels one pixel at a time in the horizontal and vertical directions. Can be generated.
- FIG. 11 is a flowchart showing a procedure of color information generation processing in the present embodiment.
- the image signal generation unit 15 acquires four photoelectric conversion signals.
- the four photoelectric conversion signals are designated as S1, S2, S3, and S4 in the order of extraction.
- the image signal generation unit 15 performs substitution processing in step S12 in consideration of which of the signals S1 to S4 corresponds to S2a to S2d. This process will be described with reference to FIG.
- FIG. 12 is a conceptual diagram showing that calculation processing is performed while shifting the calculation unit by one pixel in the horizontal direction.
- FIG. 12B shows the signal reading order when the operation unit is shifted by one pixel in the horizontal direction from the state shown in FIG.
- FIG. 12C shows the signal reading order in a state where the operation unit is further shifted by one pixel in the horizontal direction.
- S1 Cbs
- S2 Yrs + W ′s
- S3 Gs
- S4 Mgs + W ′s
- S1 S2c
- S2 S2d
- S3 S2a
- S4 S2b.
- FIG. 12D shows the signal readout order in a state where the operation unit is further shifted by one pixel in the horizontal direction.
- S1 Yrs + W ′s
- S2 Gs
- S3 Mgs + W ′s
- the image signal generation unit 15 can execute the above calculation processing for any calculation unit on the imaging surface by executing the above substitution processing.
- the description has been given focusing on one row, but the same processing is performed on the other rows.
- the image signal generation unit 15 uses the signals S2a, S2b, S2c, and S2d obtained by the above processing to perform the RGB conversion processing based on the equations 14 to 15 on all the pixels in step S14 shown in FIG. Finally, in step S16, a color image signal composed of the converted RGB signals is output. At this time, RGB signal correction processing may be performed as necessary.
- the generated color image signal can be output to a recording medium (not shown) or a display unit by the image signal output unit 16.
- a color image signal can be obtained by the addition / subtraction process using the photoelectric conversion signals S2a to S2d.
- the imaging device 10 in the present embodiment since an optical element that absorbs light is not used, light loss can be significantly reduced as compared with the conventional technology using a color filter or the like. Further, since the microlens is larger than the pixel size, the signal amount of each pixel is sufficiently large, and the color reproducibility is improved accordingly.
- a colorization method using the color signals Mgs, Gs, Yrs, and Cbs is disclosed in, for example, Patent Document 4 as a method with excellent color reproducibility.
- the basic colorization method is the same as that of Patent Document 4, but also includes directly incident light represented by kW, and therefore, when the coefficient k is too large, the color modulation property decreases. There are things to do. However, excellent color reproducibility can be maintained by setting the coefficient k to an appropriate value.
- the coefficient k is a comparatively small numerical value of 1 ⁇ 4, and the incident light W is divided and incident on a plurality of photosensitive cells.
- the dynamic range characteristic can be improved.
- the dynamic lens characteristics can be improved as compared with the techniques disclosed in Patent Documents 2 and 4.
- a color signal is represented as Ci
- a pixel signal with a relatively large signal amount is represented as W + Ci
- a pixel signal with a relatively small signal amount is represented as W ⁇ Ci. .
- Ci is an R signal or a B signal
- the non-spectral part 3 in the gap between the microlenses 4, there is also an effect that a reduction in resolution can be prevented.
- the non-spectral part 3 does not exist, the light from the spectral elements 1a and 1b is incident on the photosensitive cells 2b and 2d, but there is no light directly incident thereon. This means that light incident on a region on the microlens array facing the photosensitive cells 2a and 2c cannot be detected. For this reason, when the non-spectral part 3 does not exist, the photosensitive cells 2a and 2c do not contribute to the resolution, and the resolution is determined by the number and pitch of the microlenses.
- the resolution is 1 ⁇ 2 of the normal performance determined by the number of pixels.
- the non-spectral part 3 is provided in an approximately equal number to the microlenses 4, the light incident on the non-spectral part 3 by the photosensitive cells 2 b and 2 d facing the non-spectral part 3. Information can be obtained. As a result, it is possible to prevent a decrease in resolution and maintain the resolution characteristics at a normal level determined by the number of pixels and the pixel pitch.
- the value k depending on the size of the non-spectral part 3 is determined in consideration of the balance between the dynamic range characteristic and the resolution characteristic.
- k 1/4, but the coefficient k is not limited to this value.
- the spectral element 1a that separates the light-sensitive cell array 200 from magenta and green and the blue that includes approximately half of the green component and the red that includes approximately half of the green component.
- the spectral element array 100 including the spectral elements 1b to be split into the two is disposed.
- a microlens array 400 having a plurality of microlenses 4 arranged to face each spectral element and a non-spectral part 3 between them is arranged.
- the (Mg + kW) signal, the G signal, the (Yr + kW) signal, and the Cb signal are obtained in the unit block of the pixel composed of the four photosensitive cells 2a to 2d, and an RGB color signal is obtained from these signals.
- light loss can be suppressed by not using a color filter that absorbs most of the light, and imaging sensitivity can be increased by using a microlens having a size larger than the pixel size.
- the light does not concentrate on a specific pixel, there is a great practical effect that the dynamic range characteristic is excellent.
- the image signal generation unit 15 generates RGB color image signals. However, it is not always necessary to generate all RGB color image signals. It may be configured to generate only one or two color image signals depending on the application.
- each spectral element has the above-described spectral performance strictly, but the spectral performance may be slightly shifted. That is, the photoelectric conversion signal actually output from each photosensitive cell may be deviated from the photoelectric conversion signals shown in Equations 6 to 9. Even when the spectral performance of each spectral element deviates from the ideal performance, good color information can be obtained by correcting the signal according to the degree of deviation.
- the expression for converting the pixel signal into the RGB signal the expressions shown in Expressions 14 to 15 are examples, and other conversion expressions may be used. For example, RGB signals may be obtained by calculation using the matrix shown in Equation 5.
- a more ideal RGB signal can be obtained by correcting the signal using a conversion matrix that takes into account the deviation of the actual spectral performance from the ideal spectral performance.
- a conversion matrix can be obtained by, for example, imaging a color chart having a plurality of color patterns and determining an optimum matrix element while comparing an actually obtained signal with an ideal signal.
- the basic structure of the image sensor 10 is not limited to the configuration shown in FIG. 6A.
- the spectral element 1a and the spectral element 1b are arranged in a switched configuration, the effect of this embodiment is not changed.
- the shape of the non-spectral part 3 is different from the shape shown in FIG. 6B, the effectiveness is not changed.
- the microlens 4 has a circular shape, its effectiveness is not changed.
- the signal calculation performed by the image signal generation unit 15 in the present embodiment can be executed not by the imaging apparatus itself but by another device.
- the color information can also be generated by causing an external device that has received an input of the photoelectric conversion signal output from the image sensor 10 to execute a program that defines the signal calculation processing in the present embodiment.
- the spectral element in the present invention allows light of a desired color component to enter each photosensitive cell. Anything is possible if possible.
- a microprism may be used as the spectral element.
- different types of spectral elements for example, a high refractive index transparent portion and a microprism
- the solid-state imaging device and the imaging apparatus of the present invention are effective for all cameras using the solid-state imaging device.
- it can be used for consumer cameras such as digital still cameras and digital video cameras, and industrial solid-state surveillance cameras.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Solid State Image Pick-Up Elements (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Color Television Image Signal Generators (AREA)
- Optical Filters (AREA)
Abstract
Description
(式1) S2a=C1s
(式2) S2b=C2s+kWs=kC1s+(1+k)C2s
(式3) S2c=C3s
(式4) S2d=C4s+kWs=kC3s+(1+k)C4s
図4Aは、実施形態1による撮像装置の全体構成を示すブロック図である。本実施形態の撮像装置は、デジタル式の電子カメラであり、撮像部300と、撮像部300から送出される信号に基づいて画像を示す信号(画像信号)を生成する信号処理部500とを備えている。なお、撮像装置は静止画のみを生成してもよいし、動画を生成する機能を備えていてもよい。
(式6) S2a=Gs
(式7) S2b=Mgs+W’s=Rs+Bs+k(Rs+Gs+Bs)
(式8) S2c=Cbs=Bs+(1/2)Gs
(式9) S2d=Yrs+W’s=Rs+(1/2)Gs+k(Rs+Gs+Bs)
(式10) S2a=Gs
(式11) S2b=(5/4)Rs+(1/4)Gs+(5/4)Bs
(式12) S2c=Bs+(1/2)Gs
(式13) S2d=(5/4)Rs+(3/4)Gs+(1/4)Bs
(式14) Rs=-(1/10)S2a+(2/5)S2b-(3/5)S2c+(2/5)S2d
(式15) Gs=S2a
(式16) Bs=(-1/2)S2a+S2c
2,2a,2b,2c,2d 撮像素子の光感知セル
3 非分光部
4 マイクロレンズ
5 撮像素子の配線層
6 透明層
10 撮像素子
11 赤外カットフィルタ
12 光学レンズ
13 信号発生/受信部
14 素子駆動部
15 画像信号生成部
16 画像信号出力部
30 メモリ
40 光感知セルの単位ブロック
100 分光要素アレイ
200 光感知セルアレイ
300 撮像部
400 マイクロレンズアレイ
500 信号処理部
Claims (13)
- 各々が第1の光感知セル、第2の光感知セル、第3の光感知セル、および第4の光感知セルを含む複数の単位ブロックが撮像面に2次元的に配列された光感知セルアレイと、
前記第1の光感知セルに対向して配置された第1の分光要素、および前記第3の光感知セルに対向して配置された第2の分光要素を含む分光要素アレイと、
前記第1の分光要素および前記第1の光感知セルを覆い、かつ前記第2の光感知セルの一部を覆うように配置された第1のマイクロレンズ、および前記第2の分光要素および前記第3の光感知セルを覆い、かつ前記第4の光感知セルの一部を覆うように配置された第2のマイクロレンズを含むマイクロレンズアレイであって、前記第1および第2のマイクロレンズが設けられていない領域のうち前記第2の光感知セルに対向する領域に入射した光が前記第2の光感知セルに入射し、前記第1および第2のマイクロレンズが設けられていない領域のうち前記第4の光感知セルに対向する領域に入射した光が前記第4の光感知セルに入射するように構成されたマイクロレンズアレイと、
を備え、
前記第1の分光要素は、前記第1のマイクロレンズを介して入射する光のうち、第1の色成分の光を前記第1の光感知セルに入射させ、前記第1のマイクロレンズを介して入射する光のうち、第2の色成分の光を前記第2の光感知セルに入射させ、
前記第2の分光要素は、前記第2のマイクロレンズを介して入射する光のうち、第3の色成分の光を前記第3の光感知セルに入射させ、前記第2のマイクロレンズを介して入射する光のうち、第4の色成分の光を前記第4の光感知セルに入射させる、
固体撮像素子。 - 前記第1および第2の分光要素の各々は、高屈折率透明部と、前記高屈折率透明部の屈折率よりも低い屈折率を有し前記高屈折率透明部の周囲に設けられた低屈折率透明部とを有し、
前記第1の分光要素における前記高屈折率透明部の形状およびサイズの少なくとも一方は、前記第2の分光要素における前記高屈折率透明部のものと異なっている、
請求項1に記載の固体撮像素子。 - 前記第1の分光要素における前記高屈折率透明部および前記第2の分光要素における前記高屈折率透明部は、前記撮像面に垂直な板状の形状を有し、互いに平行に配置されている、請求項2に記載の固体撮像素子。
- 前記第1の分光要素における前記高屈折率透明部の向きは、隣接単位ブロックに対向する前記第1の分光要素における前記高屈折率透明部の向きと90度異なっており、
前記第2の分光要素における前記高屈折率透明部の向きは、隣接単位ブロックに対向する前記第2の分光要素における前記高屈折率透明部の向きと90度異なっている、
請求項3に記載の固体撮像素子。 - 前記分光要素アレイは、最近接する2つの前記第1の分光要素による分光の方向の前記撮像面に平行な成分が互いに直交し、最近接する2つの前記第2の分光要素による分光の方向の前記撮像面に平行な成分が互いに直交するように構成されている、請求項1から4のいずれかに記載の固体撮像素子。
- 前記第1の分光要素は、入射光に含まれる前記第2の色成分の光の半分を前記第2の光感知セルに入射させ、前記第2の色成分の光の残りの半分をいずれかの隣接単位ブロックにおける前記第2の光感知セルに入射させ、
前記第2の分光要素は、入射光に含まれる前記第4の色成分の光の半分を前記第4の光感知セルに入射させ、前記第4の色成分の光の残りの半分をいずれかの隣接単位ブロックにおける前記第4の光感知セルに入射させる、
請求項1から5のいずれかに記載の固体撮像素子。 - 前記第2の光感知セルは、前記第1の分光要素およびいずれかの隣接単位ブロックにおける前記第1の分光要素から入射する前記第2の色成分の光と、前記第1および第2のマイクロレンズを介さずに入射する前記第1および第2の色成分の光とを受け、受けた光に応じた光電変換信号を出力し、
前記第4の光感知セルは、前記第2の分光要素およびいずれかの隣接単位ブロックにおける前記第4の分光要素から入射する前記第4の色成分の光と、前記第1および第2のマイクロレンズを介さずに入射する前記第3および第4の色成分の光とを受け、受けた光に応じた光電変換信号を出力する、
請求項1から6のいずれかに記載の固体撮像素子。 - 前記第1の分光要素は、入射光に含まれる前記第1の色成分の光のほぼ全てを対向する前記第1の光感知セルに入射させ、
前記第2の分光要素は、入射光に含まれる前記第3の色成分の光のほぼ全てを対向する前記第3の光感知セルに入射させる、請求項1から7のいずれかに記載の固体撮像素子。 - 前記第2の色成分は、前記第1の色成分の補色であり、前記第4の色成分は、前記第3の色成分の補色である、請求項1から8のいずれかに記載の固体撮像素子。
- 前記第1の色成分は、マゼンタおよび緑の一方であり、
前記第2の色成分は、マゼンタおよび緑の他方であり、
前記第3の色成分は、緑の一部を含む赤、および緑の一部を含む青の一方であり、
前記第4の色成分は、緑の一部を含む赤、および緑の一部を含む青の他方である、
請求項1から9のいずれかに記載の固体撮像素子。 - 請求項1から10のいずれかに記載の固体撮像素子と、
前記固体撮像素子に像を形成する光学系と、
前記固体撮像素子から出力される信号を処理する信号処理部であって、前記第1の光感知セルから出力される第1の光電変換信号、前記第2の光感知セルから出力される第2の光電変換信号、前記第3の光感知セルから出力される第3の光電変換信号、および前記第4の光感知セルから出力される第4の光電変換信号を用いた演算によって色情報を生成する信号処理部と、
を備える撮像装置。 - 請求項1から10のいずれかに記載の固体撮像素子から出力される信号を処理する方法であって、
前記第1の光感知セルから出力される第1の光電変換信号、前記第2の光感知セルから出力される第2の光電変換信号、前記第3の光感知セルから出力される第3の光電変換信号、および前記第4の光感知セルから出力される第4の光電変換信号を取得するステップと、
前記第1から第4の光電変換信号を用いて色情報を生成するステップと、
を含む方法。 - 請求項1から10のいずれかに記載の固体撮像素子から出力される信号を処理するためのプログラムであって、
コンピュータに対し、
前記第1の光感知セルから出力される第1の光電変換信号、前記第2の光感知セルから出力される第2の光電変換信号、前記第3の光感知セルから出力される第3の光電変換信号、および前記第4の光感知セルから出力される第4の光電変換信号を取得するステップと、
前記第1から第4の光電変換信号を用いて色情報を生成するステップと、
を実行させるプログラム。
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201380003730.0A CN103907189B (zh) | 2012-09-03 | 2013-03-15 | 固体摄像元件、摄像装置和信号处理方法 |
| JP2014506679A JP6039649B2 (ja) | 2012-09-03 | 2013-03-15 | 固体撮像素子、撮像装置および信号処理方法 |
| US14/353,312 US9425229B2 (en) | 2012-09-03 | 2013-03-15 | Solid-state imaging element, imaging device, and signal processing method including a dispersing element array and microlens array |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2012193028 | 2012-09-03 | ||
| JP2012-193028 | 2012-09-03 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2014033976A1 true WO2014033976A1 (ja) | 2014-03-06 |
Family
ID=50182819
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2013/001778 Ceased WO2014033976A1 (ja) | 2012-09-03 | 2013-03-15 | 固体撮像素子、撮像装置および信号処理方法 |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US9425229B2 (ja) |
| JP (1) | JP6039649B2 (ja) |
| CN (1) | CN103907189B (ja) |
| WO (1) | WO2014033976A1 (ja) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20160047320A (ko) * | 2014-10-22 | 2016-05-02 | 삼성전자주식회사 | 색분리 소자를 포함하는 적층형 이미지 센서 및 상기 이미지 센서를 포함하는 촬상 장치 |
| WO2019202890A1 (ja) * | 2018-04-17 | 2019-10-24 | 日本電信電話株式会社 | カラー撮像素子および撮像装置 |
| JP2020096375A (ja) * | 2014-11-07 | 2020-06-18 | 株式会社半導体エネルギー研究所 | 撮像装置 |
| JP2022027780A (ja) * | 2018-04-17 | 2022-02-14 | 日本電信電話株式会社 | カラー撮像素子および撮像装置 |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102797794B1 (ko) | 2019-09-25 | 2025-04-22 | 니폰 덴신 덴와 가부시끼가이샤 | 촬상소자 및 촬상장치 |
| US11640645B2 (en) | 2019-10-25 | 2023-05-02 | Samsung Electronics Co., Ltd. | Apparatus and method of acquiring image by employing color separation lens array |
| CN113257846A (zh) * | 2020-02-11 | 2021-08-13 | 三星电子株式会社 | 图像传感器和包括图像传感器的电子设备 |
| CN114447008A (zh) * | 2020-10-30 | 2022-05-06 | 三星电子株式会社 | 包括分色透镜阵列的图像传感器和包括图像传感器的电子装置 |
| KR102899037B1 (ko) * | 2021-01-04 | 2025-12-11 | 삼성전자주식회사 | 이미지 센서 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001309395A (ja) * | 2000-04-21 | 2001-11-02 | Sony Corp | 固体撮像素子及びその製造方法 |
| WO2009019818A1 (ja) * | 2007-08-06 | 2009-02-12 | Panasonic Corporation | 撮像用光検出装置 |
| WO2009153937A1 (ja) * | 2008-06-18 | 2009-12-23 | パナソニック株式会社 | 固体撮像装置 |
| WO2010070869A1 (ja) * | 2008-12-19 | 2010-06-24 | パナソニック株式会社 | 撮像装置 |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS5990467A (ja) | 1982-11-15 | 1984-05-24 | Mitsubishi Electric Corp | 固体撮像素子 |
| JPH0628450B2 (ja) | 1983-01-28 | 1994-04-13 | 松下電器産業株式会社 | 固体撮像装置 |
| JP2000151933A (ja) | 1998-11-06 | 2000-05-30 | Nec Corp | 撮像素子及びその製造方法 |
| JP4652634B2 (ja) | 2001-08-31 | 2011-03-16 | キヤノン株式会社 | 撮像装置 |
| US8502130B2 (en) * | 2008-12-22 | 2013-08-06 | Candela Microsystems (S) Pte. Ltd. | Light guide array for an image sensor |
| CN102160180A (zh) * | 2009-07-24 | 2011-08-17 | 松下电器产业株式会社 | 摄像装置以及固体摄像元件 |
| US8810698B2 (en) * | 2009-10-07 | 2014-08-19 | Panasonic Intellectual Property Corporation Of America | Two sided solid state image sensor and an image capture device |
| JP5237998B2 (ja) * | 2010-07-12 | 2013-07-17 | パナソニック株式会社 | 固体撮像素子、撮像装置および信号処理方法 |
| JP5503459B2 (ja) * | 2010-08-24 | 2014-05-28 | パナソニック株式会社 | 固体撮像素子および撮像装置 |
| WO2012172735A1 (ja) * | 2011-06-16 | 2012-12-20 | パナソニック株式会社 | 固体撮像素子、撮像装置および信号処理方法 |
| WO2014034149A1 (ja) * | 2012-09-03 | 2014-03-06 | パナソニック株式会社 | 固体撮像素子および撮像装置 |
-
2013
- 2013-03-15 JP JP2014506679A patent/JP6039649B2/ja not_active Expired - Fee Related
- 2013-03-15 US US14/353,312 patent/US9425229B2/en not_active Expired - Fee Related
- 2013-03-15 WO PCT/JP2013/001778 patent/WO2014033976A1/ja not_active Ceased
- 2013-03-15 CN CN201380003730.0A patent/CN103907189B/zh not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001309395A (ja) * | 2000-04-21 | 2001-11-02 | Sony Corp | 固体撮像素子及びその製造方法 |
| WO2009019818A1 (ja) * | 2007-08-06 | 2009-02-12 | Panasonic Corporation | 撮像用光検出装置 |
| WO2009153937A1 (ja) * | 2008-06-18 | 2009-12-23 | パナソニック株式会社 | 固体撮像装置 |
| WO2010070869A1 (ja) * | 2008-12-19 | 2010-06-24 | パナソニック株式会社 | 撮像装置 |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20160047320A (ko) * | 2014-10-22 | 2016-05-02 | 삼성전자주식회사 | 색분리 소자를 포함하는 적층형 이미지 센서 및 상기 이미지 센서를 포함하는 촬상 장치 |
| KR102338897B1 (ko) * | 2014-10-22 | 2021-12-13 | 삼성전자주식회사 | 색분리 소자를 포함하는 적층형 이미지 센서 및 상기 이미지 센서를 포함하는 촬상 장치 |
| JP2020096375A (ja) * | 2014-11-07 | 2020-06-18 | 株式会社半導体エネルギー研究所 | 撮像装置 |
| WO2019202890A1 (ja) * | 2018-04-17 | 2019-10-24 | 日本電信電話株式会社 | カラー撮像素子および撮像装置 |
| JP2019184986A (ja) * | 2018-04-17 | 2019-10-24 | 日本電信電話株式会社 | カラー撮像素子および撮像装置 |
| US10886321B2 (en) | 2018-04-17 | 2021-01-05 | Nippon Telegraph And Telephone Corporation | Color image-capture element and image capture device |
| JP2022027780A (ja) * | 2018-04-17 | 2022-02-14 | 日本電信電話株式会社 | カラー撮像素子および撮像装置 |
| US11515352B2 (en) | 2018-04-17 | 2022-11-29 | Nippon Telegraph And Telephone Corporation | Image-capture element and image capture device |
| JP7265195B2 (ja) | 2018-04-17 | 2023-04-26 | 日本電信電話株式会社 | カラー撮像素子および撮像装置 |
| US11967603B2 (en) | 2018-04-17 | 2024-04-23 | Nippon Telegraph And Telephone Corporation | Image-capture element and image capture device |
| US12294013B2 (en) | 2018-04-17 | 2025-05-06 | Nippon Telegraph And Telephone Corporation | Image-capture element and image capture device |
Also Published As
| Publication number | Publication date |
|---|---|
| JP6039649B2 (ja) | 2016-12-07 |
| CN103907189A (zh) | 2014-07-02 |
| US20140284455A1 (en) | 2014-09-25 |
| CN103907189B (zh) | 2017-03-15 |
| US9425229B2 (en) | 2016-08-23 |
| JPWO2014033976A1 (ja) | 2016-08-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6039649B2 (ja) | 固体撮像素子、撮像装置および信号処理方法 | |
| JP5237998B2 (ja) | 固体撮像素子、撮像装置および信号処理方法 | |
| JP5503459B2 (ja) | 固体撮像素子および撮像装置 | |
| JP5503458B2 (ja) | 固体撮像素子および撮像装置 | |
| JP6039558B2 (ja) | 固体撮像装置 | |
| WO2013042323A1 (ja) | ライトフィールド撮像装置、および画像処理装置 | |
| WO2011010455A1 (ja) | 撮像装置および固体撮像素子 | |
| JPWO2010070869A1 (ja) | 撮像装置 | |
| JP5997149B2 (ja) | 固体撮像素子、撮像装置、および信号処理方法 | |
| JP5852006B2 (ja) | 固体撮像素子、撮像装置および信号処理方法 | |
| JP5894573B2 (ja) | 固体撮像素子、撮像装置および信号処理方法 | |
| JP6039567B2 (ja) | 固体撮像装置 | |
| JP2014086743A (ja) | 固体撮像素子、撮像装置、および信号処理方法 | |
| JP2014086742A (ja) | 固体撮像素子、撮像装置、および信号処理方法 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| ENP | Entry into the national phase |
Ref document number: 2014506679 Country of ref document: JP Kind code of ref document: A |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 14353312 Country of ref document: US |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13832408 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 13832408 Country of ref document: EP Kind code of ref document: A1 |
