WO2011151948A1 - 3次元撮像装置 - Google Patents
3次元撮像装置 Download PDFInfo
- Publication number
- WO2011151948A1 WO2011151948A1 PCT/JP2011/000763 JP2011000763W WO2011151948A1 WO 2011151948 A1 WO2011151948 A1 WO 2011151948A1 JP 2011000763 W JP2011000763 W JP 2011000763W WO 2011151948 A1 WO2011151948 A1 WO 2011151948A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- light
- region
- transmission
- imaging device
- transmits
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/214—Image signal generators using stereoscopic image cameras using a single 2D image sensor using spectral multiplexing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/218—Image signal generators using stereoscopic image cameras using a single 2D image sensor using spatial multiplexing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/236—Image signal generators using stereoscopic image cameras using a single 2D image sensor using varifocal lenses or mirrors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
Definitions
- the present invention relates to a monocular three-dimensional imaging technique for generating a plurality of images having parallax.
- image sensors In recent years, there has been a remarkable increase in functionality and performance of digital cameras and digital movies using solid-state image sensors such as CCDs and CMOSs (hereinafter sometimes referred to as “image sensors”).
- image sensors due to advances in semiconductor manufacturing technology, the pixel structure in a solid-state image sensor has been miniaturized. As a result, higher integration of pixels and drive circuits of solid-state image sensors has been attempted. For this reason, in a few years, the number of pixels of the image sensor has increased significantly from about 1 million pixels to over 10 million pixels. Furthermore, the quality of the image obtained by imaging has improved dramatically.
- a thin liquid crystal display or a plasma display enables high-resolution and high-contrast display without taking up space, and high performance is realized.
- Such a flow of improving the quality of video is spreading from a two-dimensional image to a three-dimensional image.
- polarized glasses are required, but high-quality three-dimensional display devices are being developed.
- a representative technique having a simple configuration includes a technique of acquiring an image for the right eye and an image for the left eye, respectively, using an imaging system including two cameras.
- an imaging system including two cameras In such a so-called two-lens imaging method, since two cameras are used, the imaging apparatus becomes large and the cost can be high. Therefore, a method of acquiring a plurality of images having parallax using one camera has been studied.
- Patent Document 1 discloses a method using two polarizing plates whose transmission axes are orthogonal to each other and a rotating polarizing filter.
- FIG. 13 is a schematic diagram showing a configuration of an imaging system according to the method.
- the imaging device includes a polarizing plate 11 with 0-degree polarization, a polarizing plate 12 with 90-degree polarization, a reflecting mirror 13, a half mirror 14, a circular polarizing filter 15, a driving device 16 that rotates the circular polarizing filter, the optical lens 3, and an optical device.
- An imaging device 9 that acquires an image formed by the lens is provided.
- the half mirror 14 reflects the light transmitted through the polarizing plate 11 and reflected by the reflecting mirror 13, and transmits the light transmitted through the polarizing plate 12.
- the light transmitted through the polarizing plates 11 and 12 disposed at remote locations passes through the half mirror 14, the circular polarizing filter 15, and the optical lens 3, and enters the imaging device 9, and the image Is acquired.
- the principle of imaging in this method is that by rotating the circular polarizing filter 15, light incident on each of the two polarizing plates 11 and 12 is captured at different timings, and two images having parallax are acquired. That's it.
- Patent Document 2 discloses a method of simultaneously capturing two images with parallax without using mechanical drive.
- An image pickup apparatus does not have a mechanical drive unit by collecting light incident from two incident areas with a reflecting mirror and receiving the light with an image pickup element in which two types of polarizing filters are alternately arranged. Two images with parallax are acquired.
- FIG. 14 is a schematic diagram showing the configuration of an imaging system in this method.
- This imaging system includes two polarizing plates 11 and 12 whose transmission axes are orthogonal to each other, a reflecting mirror 13, an optical lens 3, and an imaging device 1.
- the imaging device 1 includes a plurality of pixels 10 and polarizing filters 17 and 18 arranged in a one-to-one correspondence with the pixels on the imaging surface.
- the polarizing filters 17 and 18 are alternately arranged on all pixels.
- the directions of the transmission axes of the polarizing filters 17 and 18 coincide with the directions of the transmission axes of the polarizing plates 11 and 12, respectively.
- incident light passes through the polarizing plates 11 and 12, is reflected by the reflecting mirror 13, passes through the optical lens 3, and enters the imaging surface of the imaging device 1.
- Light that passes through the polarizing plates 11 and 12 and enters the image sensor 1 passes through the polarizing filters 17 and 18 and is photoelectrically converted by the pixels immediately below them.
- the polarizing filters 17 and 18 are obtained from the pixel group facing to each other.
- the amount of light received by the image sensor is greatly reduced because the amount of light decreases when incident light passes through the polarizing plate and the polarizing filter.
- Patent Document 3 a technique that can acquire two images having parallax and a normal image with one image sensor is disclosed in Patent Document 3.
- two images having a parallax and a normal image are combined into one image sensor by mechanically switching some of the constituent elements when acquiring two images having a parallax and acquiring a normal image. Obtained at.
- the point that two polarizing filters are arranged on the optical path when acquiring two images having parallax is the same as the technique disclosed in Patent Document 2.
- these polarizing filters are mechanically removed from the optical path.
- Patent Document 4 discloses a technique for simultaneously acquiring two images having parallax using a color filter.
- FIG. 15 is a diagram schematically showing an imaging system using this technique.
- the imaging system in this technique includes a lens 3, a lens diaphragm 19, a light flux limiting plate 20 on which two color filters 20a and 20b having different transmission wavelength ranges are arranged, and a photosensitive film 21.
- the color filters 20a and 20b are filters that transmit, for example, red and blue light, respectively.
- the incident light passes through the lens 3, the lens diaphragm 19, and the light beam limiting plate 20, and forms an image on the photosensitive film.
- a magenta color image is formed on the photosensitive film by the light transmitted through the two color filters.
- the positions of the color filters 20a and 20b are different, parallax occurs in the image formed on the photosensitive film.
- an image having parallax can be created using two color filters.
- FIG. 16 is a diagram schematically showing a light flux limiting plate in this technique.
- a light flux limiting plate in which an R region 22R that transmits red light, a G region 22G that transmits green light, and a B region 22B that transmits blue light are provided on a plane perpendicular to the optical axis of the imaging optical system. 22 is used.
- the light transmitted through these areas is received by a color imaging device having R pixels for red, G pixels for green, and B pixels for blue, whereby an image of light transmitted through each area is acquired.
- Patent Document 6 discloses a technique for acquiring a plurality of images having parallax using a configuration similar to the configuration of FIG.
- FIG. 17 is a diagram schematically showing the light flux limiting plate disclosed in Patent Document 6. As shown in FIG. Also with this technique, an image with parallax can be created by transmitting incident light through the R region 23R, the G region 23G, and the B region 23B provided on the light flux limiting plate 23.
- an image with parallax can be generated by arranging RGB color filters on the light flux limiting plate.
- the amount of incident light is reduced.
- Patent Document 7 discloses a technique capable of obtaining a plurality of images having parallax and a normal image having no problem in light quantity by using an aperture having RGB color filters. Yes.
- this technique only light that has passed through the RGB color filter is received when the diaphragm is closed, and the RGB color filter area is removed from the optical path when the diaphragm is opened, so that all incident light can be received. .
- an image with parallax can be obtained when the diaphragm is closed, and a normal image with a high light utilization rate can be obtained when the diaphragm is opened.
- a plurality of images having parallax can be acquired, but the amount of light received by the imaging device is reduced because a polarizing plate or a color filter is used.
- a mechanism for removing the polarizing plate or the color filter from the optical path by mechanical driving When such a mechanical drive is used, there is a problem that the apparatus is increased in size and cost.
- the present invention provides a three-dimensional imaging technique capable of generating a plurality of images having parallax using a color filter and generating an image with a high light utilization rate without performing mechanical driving.
- the three-dimensional imaging device of the present invention is arranged to receive a light transmission portion having N transmission regions (N is an integer of 3 or more) having different transmission wavelength ranges, and light transmitted through the light transmission portion.
- the solid-state imaging device includes a photosensitive cell array and a color filter array disposed to face the photosensitive cell array.
- the photosensitive cell array and the color filter array are composed of a plurality of unit elements, and each unit element is arranged in one-to-one correspondence with the N photosensitive cells and the N photosensitive cells.
- N color filters having different transmission wavelength ranges are included.
- the transmission wavelength ranges of the N transmission regions and the N color filters are set so that light passing through at least one of the N transmission regions can pass through at least two of the N color filters.
- the signal processing unit generates a signal indicating at least two of the intensities of light incident on each of the N transmission regions based on a signal output from the N photosensitive cells. Thus, data of at least two images having parallax is generated.
- the signal processing unit generates a signal indicating the intensity of light incident on each of the N transmissive regions by using a signal output from the N photosensitive cells. The data of the image is generated.
- the first region and the second region included in the N transmissive regions pass through the center of the light transmissive portion with respect to a line segment that bisects the area of the light receiving surface of the light transmissive portion. Are arranged on opposite sides.
- At least a part of the third region included in the N transmission regions is located between the first region and the second region.
- the third region is a transparent region.
- the transmission wavelength region of the first region and the transmission wavelength region of the second region are set to complementary complementary wavelength regions.
- the area of the first region and the area of the second region are equal, and the area of the third region is larger than the areas of the first region and the second region.
- the transmission region having the widest transmission wavelength region among the N transmission regions has a transmission wavelength region wider than the color filter having the widest transmission wavelength region among the N color filters.
- each of the N transmission regions is transparent or configured to transmit light in a complementary color wavelength region.
- N 3.
- the N transmission regions are a cyan region that transmits cyan light, a yellow region that transmits yellow light, and a transparent region, respectively.
- the N transmission regions are a cyan region that transmits cyan light, a yellow region that transmits yellow light, and a magenta region that transmits magenta light, respectively.
- each of the N color filters is a red filter that transmits red light, a green filter that transmits green light, and a blue filter that transmits blue light.
- each unit element includes four photosensitive cells arranged in a matrix, and four color filters arranged in a one-to-one correspondence with the four photosensitive cells.
- the color filters arranged in the first row and first column and the second row and first column are transparent filters or green filters that transmit green light, and the remaining two color filters are red that transmit red light. It is a blue filter which transmits a filter and blue light.
- N 4.
- the N transmission regions are a cyan region that transmits cyan light, a yellow region that transmits yellow light, a magenta region that transmits magenta light, and a transparent region, respectively.
- each of the N color filters is a magenta filter that transmits magenta light, a green filter that transmits green light, a cyan filter that transmits cyan light, and a yellow filter that transmits yellow light.
- the signal processing unit adds a signal indicating the intensity of light incident on one of the N transmissive areas to a signal indicating the intensity of light incident on another transmissive area. As a result, the level of the signal indicating the intensity of light incident on the other transmission region is increased.
- the signal processing unit indicates a signal indicating an intensity of light incident on a transmission area having the widest transmission wavelength range among the N transmission areas, and indicates an intensity of light incident on another transmission area. By adding to the signal, the level of the signal indicating the intensity of light incident on the other transmission region is increased.
- the signal processing unit acquires color information using a signal indicating the intensity of light incident on a transmission region having the widest transmission wavelength region among the N transmission regions.
- an image with a high light utilization rate can be obtained by appropriately setting the transmission region and the transmission wavelength region of the color filter.
- FIG. 2 is a schematic diagram illustrating a schematic configuration of a light-transmitting plate, an optical system, and an image sensor in the first embodiment.
- FIG. 3 is a diagram illustrating a basic configuration of a color filter of an image sensor in the first embodiment.
- FIG. 5 is a diagram illustrating another basic configuration of the color filter of the image sensor according to the first embodiment.
- FIG. 6 is a diagram illustrating still another basic configuration of the color filter of the image sensor according to the first embodiment.
- FIG. 5 is a diagram illustrating a basic configuration of a color filter of an image sensor in the second embodiment.
- FIG. 1 is a block diagram showing the overall configuration of the imaging apparatus according to the first embodiment of the present invention.
- the imaging apparatus according to the present embodiment is a digital electronic camera, and includes an imaging unit 100 and a signal processing unit 200 that generates a signal (image signal) indicating an image based on a signal from the imaging unit 100. .
- the imaging unit 100 includes an imaging element (image sensor) 1 including a plurality of photosensitive cells arranged on an imaging surface, and a light-transmitting plate 2 that has three transmission regions having different transmission wavelength ranges and transmits incident light. And an optical lens 3 for forming an image on the imaging surface of the imaging device, and an infrared cut filter 4.
- the image pickup unit 100 also generates a basic signal for driving the image pickup device 1, receives an output signal from the image pickup device 1 and sends it to the signal processing unit 200, and signal generation / reception.
- an element driving unit 6 that drives the image sensor 1 based on the basic signal generated by the unit 5.
- the image sensor 1 is typically a CCD or CMOS sensor, and is manufactured by a known semiconductor manufacturing technique.
- the signal generation / reception unit 5 and the element driving unit 30 are composed of an LSI such as a CCD driver, for example.
- the signal processing unit 200 processes the signal output from the imaging unit 100 to generate an image signal, the memory 30 that stores various data used for generating the image signal, and the generated image And an interface (IF) unit 8 for sending a signal to the outside.
- the image signal generation unit 7 can be suitably realized by a combination of hardware such as a known digital signal processor (DSP) and software that executes image processing including image signal generation processing.
- the memory 30 is configured by a DRAM or the like.
- the memory 30 records the signal obtained from the imaging unit 100 and temporarily records the image data generated by the image signal generation unit 7 and the compressed image data. These image data are sent to a recording medium (not shown) or a display unit via the interface unit 8.
- the imaging apparatus of the present embodiment may include known components such as an electronic shutter, a viewfinder, a power source (battery), and a flashlight, but a description thereof is omitted because it is not particularly necessary for understanding the present invention.
- FIG. 2 is a diagram schematically showing the arrangement relationship of the light transmitting plate 2, the lens 3, and the imaging element 1 in the imaging unit 100.
- the translucent plate 2 has three transmission regions C1, C2, and C3 having different transmission wavelength ranges, and transmits incident light.
- the lens 3 is a known lens, collects the light transmitted through the translucent plate 2, and forms an image on the imaging surface 1 a of the imaging device 1. In the following description, on the plane parallel to the imaging surface 1a, the direction from the region C1 to the region C2 is the x direction, and the direction perpendicular to the x direction is the y direction.
- FIG. 3 is a front view of the translucent plate 2 in the present embodiment.
- the shape of the translucent plate 2 in the present embodiment is circular as in the case of the lens 3, but may be other shapes.
- a color filter (Cy filter) that transmits light in the cyan (Cy) wavelength region is disposed.
- a color filter (Ye filter) that transmits light in the yellow (Ye) wavelength region is disposed in the region C2.
- These color filters may be any known color filter.
- the region C1 and the region C2 in the present embodiment are configured to transmit light in the Cy wavelength region and light in the Ye wavelength region, respectively, and not to transmit light in other wavelength regions. Not limited to this, it may be composed of any member.
- the region C1 and the region C2 are arranged apart from each other in the x direction.
- the distance L between the region C1 and the region C2 is determined according to the size of the lens 3 so that the acquired image has an appropriate parallax.
- the distance L can be set to several mm to several cm, for example.
- the other region C3 in the light transmitting plate 2 is a transparent region formed of a transparent member that transmits visible light in the entire wavelength region included in the white light (W).
- the transparent member may be any member that transmits light with high transmittance.
- the areas of the region C1 and the region C2 are equal, and the area of the region C3 is designed to be larger than the areas of the regions C1 and C2.
- the configuration of the light transmitting plate 2 described above is only the configuration in the present embodiment, and the present invention is not limited to such a configuration. If the light transmission part of the present invention has three or more transmission regions having different transmission wavelength ranges, the characteristics, material, shape, and size of each transmission region are arbitrary.
- a color filter (Mg filter) that transmits light in the magenta (Mg) wavelength region may be disposed in the region C3 instead of the transparent member.
- a light shielding region may be included in a part of the translucent plate 2.
- a photosensitive cell array arranged two-dimensionally and a color filter array arranged to face the photosensitive cell array are formed.
- the photosensitive cell array and the color filter array have a plurality of unit elements, and each unit element includes four photosensitive cells and four color filters opposed to them.
- Each photosensitive cell is typically a photodiode, and outputs an electrical signal (photoelectric conversion signal) corresponding to the amount of received light by photoelectric conversion.
- Each color filter is manufactured using a known pigment or the like, and is designed to selectively transmit light in a specific wavelength range.
- FIG. 4 is a diagram schematically showing a part of the color filter array in the present embodiment.
- a large number of color filters 110 are arranged in a matrix on the imaging surface 1a.
- the four adjacent color filters 110 and the four photosensitive cells 120 facing them constitute one unit element.
- a color filter (R filter) that transmits light in the red (R) wavelength region is arranged in the first row and the first column.
- a color filter (G filter) that transmits light in the green (G) wavelength region is arranged in the first row, second column, and second row, first column.
- a color filter (B filter) that transmits light in the blue wavelength region is arranged in the second row and the second column.
- the arrangement of the color filters 110 in the present embodiment is a known Bayer arrangement based on 2 rows and 2 columns.
- the arrangement of the photosensitive cells 120 and the color filters 110 is not necessarily a Bayer arrangement, and may be any known arrangement. Further, the arrangement of the photosensitive cells 120 and the color filters 110 need not be arranged along the x direction and the y direction, and may be inclined with respect to the x direction and the y direction. In this case, information on the parallax in the oblique direction is obtained instead of information on the parallax on the left and right.
- one unit element has four photosensitive cells and four color filters, and it is sufficient that at least three photosensitive cells and three color filters are included in one unit element. If the number of photosensitive cells and color filters included in each unit element is the same as or larger than the number of transmissive regions in the light transmissive plate 2, image information can be obtained by signal calculation described later.
- each photosensitive cell receives light that has passed through the opposing color filter out of the light transmitted through the regions C1, C2, and C3 of the translucent plate 2 and outputs a photoelectric conversion signal corresponding to the amount of light received. To do.
- the photoelectric conversion signal output by each photosensitive cell is sent to the signal processing unit 200 through the signal generation / reception unit 5.
- the image signal generation unit 7 in the signal processing unit 200 generates a right-eye image, a left-eye image, and a color image based on the signal transmitted from the imaging unit 100.
- signals corresponding to the intensities of light incident on the regions C1, C2, and C3 of the translucent plate 2 are denoted by Ci1, Ci2, and Ci3 with a suffix “i”, respectively.
- the spectral transmittance of the transparent region C3, the lens 3, and the infrared cut filter 4 in the light transmitting plate 2 is Tw
- the spectral transmittance of the Cy filter is Tcy
- the spectral transmittance of the Ye filter is Tye.
- the spectral transmittances of the R, G, and B color filters are expressed as Tr, Tg, and Tb, respectively.
- Tw, Tcy, Tye, Tr, Tg, and Tb are functions that depend on the wavelength ⁇ of incident light.
- Signals indicating the intensity of light transmitted through the R, G, and B color filters and received by the light-sensitive cell immediately below are denoted by Rs, Gs, and Bs with a suffix “s”, respectively.
- the integral calculation of the spectral transmittance in the wavelength range of visible light is represented by the symbol ⁇ .
- the integral operation ⁇ TwTcyTrd ⁇ for the wavelength ⁇ is represented as ⁇ TwTcyTr.
- Rs is proportional to the result of adding Ci1 ⁇ TwTcyTr, Ci2 ⁇ TwTyeTr, and Ci3 ⁇ TwTr.
- Gs is proportional to the sum of Ci1 ⁇ TwTcyTg, Ci2 ⁇ TwTyeTg, and Ci3 ⁇ TwTg
- Bs is proportional to the sum of Ci1 ⁇ TwTcyTb, Ci2 ⁇ TwTyeTb, and Ci3 ⁇ TwTb.
- the light incident on C1 to C3 includes almost the same amount of any wavelength component in the visible light region. If the proportionality coefficient in these relationships is 1, Rs, Gs, and Bs can be expressed by the following equations 1 to 3.
- Equations 1 to 3 ⁇ TwTcyTr, ⁇ TwTyeTr, and ⁇ TwTr are represented by Mx11, Mx12, and Mx13, respectively. It will be expressed as Mx33. Then, the relationship between Rs, Gs, and Bs and Ci1, Ci2, and Ci3 can be expressed by the following Expression 4 using a matrix.
- Equation 4 can be transformed into the following Equation 5. That is, a signal indicating the intensity of light incident on the regions C1, C2, and C3 can be expressed using the photoelectric conversion signals Rs, Gs, and Bs.
- the image signal generation unit 7 performs signal calculation based on Expression 5 and generates signals Ci1, Ci2, and Ci3 for each unit element.
- the signals Ci1, Ci2, and Ci3 generated for each unit element in this way represent three images formed by light incident on each of the regions C1, C2, and C3.
- the images represented by the signals Ci1 and Ci2 correspond to images when the subject is viewed from the regions C1 and C2 that are located apart in the x direction, they can be handled as a left-eye image and a right-eye image. . That is, the two images represented by the signals Ci1 and Ci2 have parallax according to the distance between the regions C1 and C2. Therefore, information indicating the depth of the subject can be obtained from these images.
- Ci3 can be said to be a signal indicating a normal image, not an image indicating parallax. Since Ci3 may have a portion similar to Ci1 and Ci2, the signal level of the images Ci1 and Ci2 indicating parallax can be increased by adding the signal of Ci3 to the signals of Ci1 and Ci2 at such a portion. In the present embodiment, since the area of the region C3 is larger than the areas of the regions C1 and C2, the signal level of Ci3 is higher than the signal levels of Ci1 and Ci2. Therefore, adding a part of Ci3 to Ci1 and Ci2 is effective in obtaining a good image showing parallax.
- the area of the region C3 is larger than the areas of the regions C1 and C2.
- an image signal with a higher signal level can be obtained as the area of the region C3 is larger.
- Image signals Ci1, Ci2, and Ci3 obtained by the above processing are expressed using photoelectric conversion signals Rs, Gs, and Bs, but these correspond to monochrome images, not color images.
- the above-described signal calculation processing is not performed, and color processing in a normal Bayer array may be performed from each obtained photoelectric conversion signal.
- the loss of incident light and the color temperature shift may occur due to the Cy filter and Ye filter disposed on the light-transmitting plate 2.
- the light transmittance of these color filters is high, the loss of the incident light is reduced. It can be smaller than the case. Further, even if an overall color shift occurs, it can be dealt with by adjusting the white balance.
- a good color image with a high light utilization rate can be obtained.
- color information may be obtained by using only the term Ci3 in Equation 4 instead of performing color processing in a normal Bayer array from each photoelectric conversion signal. That is, after obtaining Ci3 based on Equation 5, a color image can also be obtained by setting Mx13 ⁇ Ci3 as the R light amount, Mx23 ⁇ Ci3 as the G light amount, and Mx33 ⁇ Ci3 as the B light amount.
- the translucent plate 2 including the region C1 in which the Cy filter is disposed, the region C2 in which the Ye filter is disposed, and the region C3 made of a transparent member, and the Bayer array are arranged.
- the color image pickup device 1 is used.
- the image signal generation unit 7 By executing a signal operation based on a 3 ⁇ 3 matrix obtained by an integral operation relating to spectral transmittance such as an optical system or a color filter, for each photoelectric conversion signal, the image signal generation unit 7 has two parallaxes. An image and a normal image with a high light utilization rate are generated. Furthermore, if color processing used in a normal Bayer array or color processing using the signal Ci3 is performed, a color image with a high light utilization rate can be obtained.
- the image signal generation unit 7 in the present embodiment can generate two images having parallax, a black and white image and a color image with high light utilization as described above, but it is essential to generate all of these images. is not.
- the image signal generation unit 7 only needs to be configured to generate at least two pieces of image data having parallax.
- the color filter array in the image sensor 1 is a Bayer type color array in which RGB color filters are arranged, but other color filters or other arrays may be used.
- RGB color filters are used as in the Bayer type colorization, but the R filters and B filters may be arranged in the same column.
- the same color can be obtained by using a transparent member that transmits visible light in the entire wavelength range included in white light (W) instead of the G filter.
- W white light
- the arrangement relationship of each component shown in FIG. 2 is merely an example, and the present invention is not limited to such an arrangement relationship.
- the lens 3 may be arranged farther from the imaging element 1 than the translucent plate 2 as long as an image can be formed on the imaging surface 1a.
- positioned among them is also possible.
- the lens 3 and the translucent plate 2 do not need to be independent components, and as shown in FIG. 7B, both may be configured as one integrated optical element 3a. In the configuration shown in FIG. 7B, regions C1 and C2 that transmit light in different wavelength ranges are provided in part of the lens.
- the translucent plate 2 and the imaging surface of the imaging device 1 do not necessarily have to be arranged in parallel.
- an optical element 52 that reflects light, such as a mirror or a prism between the two, the translucent plate 2 and the imaging surface of the imaging element 1 intersect on a plane. It can comprise so that it may be located in.
- the image pickup apparatus of the present embodiment generates an image by signal calculation from a photoelectric conversion signal obtained by image pickup.
- an image generation process by signal calculation may be executed by another apparatus independent of the image pickup apparatus.
- the same effect as described above can be obtained by causing another device to read a signal acquired by the imaging device having the imaging unit 100 according to the present embodiment and causing the other device to execute a program that defines the signal calculation processing. Can be obtained.
- Embodiment 2 Next, a second embodiment of the present invention will be described with reference to FIGS.
- the imaging apparatus according to the present embodiment is different from the imaging apparatus according to the first embodiment in the configuration of the transmissive region in the translucent plate 2 and the configuration of the color filter array of the imaging element 1.
- a different point from Embodiment 1 is demonstrated and description is abbreviate
- FIG. 8 is a front view of the translucent plate 2 in the present embodiment.
- the shape of the translucent plate 2 is circular like the optical lens 3, but may be other shapes.
- a Cy filter that transmits cyan light in the region C1, an Mg filter that transmits magenta light in the region C2, a Ye filter that transmits yellow light in the region C3, and the other region C4 are transparent regions formed of a transparent member. (W).
- FIG. 9 is a diagram showing a basic configuration of a color filter array formed on the imaging surface 1a of the imaging device 1 in the present embodiment.
- the color filter array includes Mg filters, G filters, Cy filters, and Ye filters based on 2 rows and 2 columns.
- FIG. 9 shows an example in which an Mg filter is arranged in the first row and first column, a G filter in the first row and second column, a Cy filter in the second row and first column, and a Ye filter in the second row and second column.
- the arrangement of these color filters is arbitrary.
- each photosensitive cell receives light that has passed through the opposing color filter out of the light that has passed through each of the regions C1 to C4 of the translucent plate 2.
- a photoelectric conversion signal in each photosensitive cell will be described.
- the light incident on the regions C1 to C4 includes almost the same amount of any wavelength component in the visible light region.
- the notation of the symbols is the same as that of the first embodiment.
- the spectral transmittances Tmg, Tcy, and Tye of the Mg, Cy, and Ye filters of the light transmitting plate 2 are the same as the spectral transmittances of the Mg, Cy, and Ye filters in the color filter array, respectively.
- the signals that pass through the Mg, Cy, and Ye color filters in the color filter array and are photoelectrically converted by the photosensitive cell immediately below are represented by Ms, Cs, and Ys, respectively.
- Ms is proportional to the result of adding Ci1 ⁇ TwTcyTmg, Ci2 ⁇ TwTmgTmg, Ci3 ⁇ TwTyeTmg, and Ci4 ⁇ TwTmg.
- Gs is proportional Ci1 ⁇ TwTcyTg, Ci2 ⁇ TwTmgTg, Ci3 ⁇ TwTyeTg, the result of the sum of Ci4shigumaTwTg, Cs is, Ci1 ⁇ TwTcyTcy, Ci2 ⁇ TwTmgTcy, Ci3 ⁇ TwTyeTcy, proportional to the result of summing the Ci4shigumaTwTcy, Ys is, Ci1 ⁇ TwTcyTye, Ci2 ⁇ TwTmgTye, Ci3 ⁇ TwTyeTye, the Ci4 ⁇ TwTye Proportional to the total result.
- Ms, Gs, Cs and Ys can be expressed by the following equations 6 to 9, respectively.
- Ms Ci1 ⁇ TwTcyTmg + Ci2 ⁇ TwTmgTmg + Ci3 ⁇ TwTyeTmg + Ci4 ⁇ TwTmg
- Gs Ci1 ⁇ TwTcyTg + Ci2 ⁇ TwTmgTg + Ci3 ⁇ TwTyeTg + Ci4 ⁇ TwTg
- Cs Ci1 ⁇ TwTcyTcy + Ci2 ⁇ TwTmgTcy + Ci3 ⁇ TwTyeTcy + Ci4 ⁇ TwTcy
- Ys Ci1 ⁇ TwTcyTye + Ci2 ⁇ TwTmgTye + Ci3 ⁇ TwTyeTye + Ci4 ⁇ TwTye
- Equation 6 to 9 ⁇ TwTcyTmg, ⁇ TwTmgTmg, ⁇ TwTyeTmg, and ⁇ TwTmg are represented by Mx11, Mx12, Mx13, and Mx14, respectively.
- ⁇ TwTcy is represented by Mx31, Mx32, Mx33, and Mx34, respectively
- ⁇ TwTcyTye, ⁇ TwTmgTye, ⁇ TwTyeTye, and ⁇ TwTye are represented by Mx41, Mx42, Mx43, and Mx44, respectively.
- Equation 10 the relationship between Ms, Gs, Cs, and Ys and Ci1, Ci2, Ci3, and Ci4 is expressed by Equation 10 below using a matrix.
- Expression 10 can be transformed into the following Expression 11. That is, a signal indicating the intensity of light incident on the regions C1, C2, C3, and C4 can be expressed using the photoelectric conversion signals Ms, Gs, Cs, and Ys.
- Ci1 and Ci3 correspond to images when the subject is viewed from the regions C1 and C3 arranged apart in the x direction, they can be handled as left-eye images and right-eye images.
- Ci2 corresponds to an image when viewed from a region C2 disposed in an oblique direction with respect to the regions C1 and C3, and thus is an image showing parallax in an oblique direction with respect to Ci1 and Ci3.
- the image indicated by Ci4 is an image (monochrome image) by light incident on the transparent region C4, and is a normal image that does not exhibit parallax. Therefore, as the area of the region C4 is increased as compared with the regions C1, C2, and C3, a signal Ci4 indicating an image (monochrome image) with a high signal level can be obtained.
- the luminance signal Yl and the equation difference signals RY and BY shown in the following equations 12 to 14 may be obtained without performing the above processing.
- Yl Ms + Gs + Cs + Ys
- RY Ms ⁇ Gs ⁇ Cs + Ys
- BY Ms ⁇ Gs + Cs ⁇ Ys
- a color image can be obtained by converting the luminance signal Yl and the color difference signals RY and BY obtained from Equations 12 to 14 into RGB signals by a method used in the NTSC system or the like.
- the obtained color image is an image having a high light utilization rate because the light transmittance of the Cy filter, Mg filter, and Ye filter disposed on the light transmitting plate 2 is relatively high.
- the color information may be obtained using only the term relating to the signal Ci4 indicating the image by the light incident on the transparent region C4.
- the Cy filter, the Mg filter, and the Ye filter are arranged at positions apart from each other, and the other region is formed of a transparent member, and 2 rows and 2 columns.
- a color imaging device having a color filter array composed of color filters of magenta (Mg), green (G), cyan (Cy), and yellow (Ye) having the basic configuration is used.
- a plurality of images and light having parallax are obtained by performing an operation based on a 4 ⁇ 4 matrix obtained by an integral operation related to spectral transmittance such as an optical system and a color filter on the photoelectric conversion signal output from the image sensor.
- a normal image having a high utilization rate can be obtained.
- by performing color processing that directly uses each photoelectric conversion signal of the image sensor 1 to generate a luminance signal and a color difference signal a color image with a high light utilization rate can be obtained.
- the translucent plate 2 includes a region C1 in which a Cy filter is disposed, a region C2 in which an Mg filter is disposed, a region C3 in which a Ye filter is disposed, and a transparent region C4.
- the configuration of the four regions including the region is not limited to the above configuration. There is no problem in any configuration as long as the transmission wavelength range of each region is different and the transmittance is relatively high.
- the combination of color filters in the image sensor is not limited to the combination of Mg, G, Cy, and Ye. As long as the transmission wavelength ranges of the color filters are different, the color combinations of the color filters are arbitrary.
- the light transmissive plate includes three and four transmission regions, respectively, and the number of types of color filters included in each unit element in the image sensor is the same as the number of transmission regions, respectively. There are 3 types and 4 types. However, the number of transmissive regions and the number of types of color filters in the present invention are not limited to the above numbers. For example, the number of types of color filters included in each unit element may exceed the number of transmissive regions. Even in that case, image information can be obtained by signal calculation based on a relational expression between the photoelectric conversion signal of each photosensitive cell and the amount of light incident on the transmission region.
- the number of transmissive regions and the number of types of color filters included in each unit element may be more than four.
- the three-dimensional imaging device of the present invention includes a light transmission unit having n transmission regions (n is an integer of 3 or more) having different transmission wavelength regions, and n colors having different transmission wavelength regions in each unit element. What is necessary is just to have a filter. However, light transmitted through at least one of the n transmission regions is transmitted through at least two color filters in one unit element.
- FIG. 10 is a diagram showing an example of the light transmitting portion 2a when generalized in this way.
- the light transmitting portion 2a has a rectangular shape, but may have another shape.
- the light transmission part 2a has n transmission regions C1 to Cn, and the other regions are light shielding regions.
- the transmission wavelength regions of the transmission regions C1 to Cn are different from each other.
- the transmission regions C1 to Cn are preferably designed to be transparent or to transmit light in a complementary color wavelength region.
- region are drawn so that all may be the same, these may differ from each other.
- FIG. 11 is a diagram showing an example of the arrangement of color filters in each unit element of the image sensor when generalized in this way. As shown in the figure, each unit element has color filters D1 to Dn. The transmission wavelength ranges of the color filters D1 to Dn are different from each other. The arrangement of the color filters is not limited to the arrangement shown in the figure, and any arrangement may be used.
- the transmission region having the widest transmission wavelength region among the transmission regions C1 to Cn is wider than the color filter having the widest transmission wavelength region among the color filters D1 to Dn. It is preferable that each transmission region and each color filter are designed to have a transmission wavelength region.
- the image signals Ci1, Ci2, Ci3,..., Cin by the light incident on each transmission region of the light transmission unit 2a and the light-sensitive cells corresponding to the respective color filters of the image sensor are output.
- the relationship between the photoelectric conversion signals Ds1, Ds2, Ds3,..., Dsn can be expressed by the following Expression 15.
- the optical characteristics of the imaging system are configured so that the determinant of the n ⁇ n matrix having Mx11 to Mxnn as elements does not become a value close to zero. If the elements of the inverse matrix of the n ⁇ n matrix in Expression 15 are iM11 to iMnn, Expression 15 can be transformed into Expression 16 below.
- signals Ci1 to Cin indicating the intensity of light incident on the transmission regions C1 to Cn can be generated from the photoelectric conversion signals Ds1 to Dsn. Thereby, n pieces of image data having parallax can be generated.
- the signal level of the other signal can be increased by adding any one of the signals Ci1 to Cin to the other signal.
- RGB color signals can be obtained by using signals corresponding to light incident on a transmission region having the widest transmission wavelength region or a transmission region having the largest transmission region. preferable.
- the imaging apparatus may be configured to generate at least two of these signals without generating all of the signals Ci1 to Cin. Even with such a configuration, at least two pieces of image data having parallax can be obtained.
- the positions are sufficiently separated.
- two transmissive regions C1 and C2 are arranged on opposite sides of a line segment AA ′ that divides the area of the light receiving surface of the light transmissive portion 2a through the center of the light transmissive portion 2a.
- another transmissive region C3 is provided between the transmissive regions C1 and C2, and the transmissive regions C1 and C2 are completely separated.
- the transmissive region C3 is configured from a transparent member.
- C3 has a larger area than the transmission regions C1 and C2.
- the three-dimensional imaging device of the present invention is effective for all cameras using a solid-state imaging device.
- it can be used for consumer cameras such as digital still cameras and digital video cameras, and industrial solid-state surveillance cameras.
- Solid-state image sensor 1a Imaging surface of a solid-state image sensor 2 Translucent plate 2a Light transmissive part 3 Optical lens 3a Optical element with which the function of the translucent plate and the optical lens was integrated 4 Infrared cut filter 5 Signal generation / reception part 6 Element driving unit 7 Image signal generating unit 8 Interface unit 9 Imaging device 10 Pixel 11 0-degree polarization polarizing plate 12 90-degree polarization polarizing plate 13 Reflecting mirror 14 Half mirror 15 Circular polarizing filter 16 Driving device 17 for rotating the polarizing filter 17 , 18 Polarizing filter 19 Lens stop 20, 22, 23 Light flux limiting plate 20a Color filter that transmits red light 20b Color filter that transmits blue light 21 Photosensitive film 22R, 23R R light transmission region 22G of light limiting plate , 23G G light transmission region of light flux limiting plate 22B, 23B B light transmission region of light flux limiting plate 30 Memory 52 Optical element that reflects light 100 Imaging unit 110 Color filter 120 Photosensitive cell 200 Signal processing unit
Abstract
Description
図1は、本発明の第1の実施形態における撮像装置の全体構成を示すブロック図である。本実施形態の撮像装置は、デジタル式の電子カメラであり、撮像部100と、撮像部100からの信号に基づいて画像を示す信号(画像信号)を生成する信号処理部200とを備えている。
(式1)Rs=Ci1ΣTwTcyTr+Ci2ΣTwTyeTr+Ci3ΣTwTr
(式2)Gs=Ci1ΣTwTcyTg+Ci2ΣTwTyeTg+Ci3ΣTwTg
(式3)Bs=Ci1ΣTwTcyTb+Ci2ΣTwTyeTb+Ci3ΣTwTb
次に図8、9を参照しながら本発明の第2の実施形態を説明する。本実施形態の撮像装置は、透光板2における透過領域の構成および撮像素子1の色フィルタアレイの構成が実施形態1の撮像装置と異なっている。以下、実施形態1と異なる点を説明し、重複する点については説明を省略する。
(式6)Ms=Ci1ΣTwTcyTmg+Ci2ΣTwTmgTmg+Ci3ΣTwTyeTmg+Ci4ΣTwTmg
(式7)Gs=Ci1ΣTwTcyTg+Ci2ΣTwTmgTg+Ci3ΣTwTyeTg+Ci4ΣTwTg
(式8)Cs=Ci1ΣTwTcyTcy+Ci2ΣTwTmgTcy+Ci3ΣTwTyeTcy+Ci4ΣTwTcy
(式9)Ys=Ci1ΣTwTcyTye+Ci2ΣTwTmgTye+Ci3ΣTwTyeTye+Ci4ΣTwTye
(式12)Yl=Ms+Gs+Cs+Ys
(式13)RY=Ms-Gs-Cs+Ys
(式14)BY=Ms-Gs+Cs-Ys
1a 固体撮像素子の撮像面
2 透光板
2a 光透過部
3 光学レンズ
3a 透光板と光学レンズの機能が一体化された光学素子
4 赤外カットフィルタ
5 信号発生/受信部
6 素子駆動部
7 画像信号生成部
8 インターフェース部
9 撮像装置
10 画素
11 0度偏光の偏光板
12 90度偏光の偏光板
13 反射鏡
14 ハーフミラー
15 円形の偏光フィルタ
16 偏光フィルタを回転させる駆動装置
17、18 偏光フィルタ
19 レンズ絞り
20、22、23 光束制限板
20a 赤系統の光を透過させる色フィルタ
20b 青系統の光を透過させる色フィルタ
21 感光フィルム
22R、23R 光束制限板のR光透過領域
22G、23G 光束制限板のG光透過領域
22B、23B 光束制限板のB光透過領域
30 メモリ
52 光を反射する光学素子
100 撮像部
110 色フィルタ
120 光感知セル
200 信号処理部
Claims (20)
- 透過波長域が互いに異なるN個(Nは3以上の整数)の透過領域を有する光透過部と、
光感知セルアレイ、および前記光感知セルアレイに対向して配置された色フィルタアレイを有し、前記光透過部を透過した光を受けるように配置された固体撮像素子であって、前記光感知セルアレイおよび前記色フィルタアレイは、複数の単位要素から構成され、各単位要素は、N個の光感知セル、および前記N個の光感知セルに1対1に対応して配置された、透過波長域が互いに異なるN個の色フィルタを含む固体撮像素子と、
前記固体撮像素子の撮像面に像を形成する光学系と、
前記固体撮像素子から出力される信号を処理する信号処理部と、
を備え、
前記N個の透過領域および前記N個の色フィルタの透過波長域は、前記N個の透過領域の少なくとも1つを透過する光が前記N個の色フィルタの少なくとも2つを透過できるように設定され、
前記信号処理部は、前記N個の光感知セルから出力される信号に基づいて、前記N個の透過領域の各々に入射する光の強度のうち少なくとも2つの強度を示す信号を生成することによって視差を有する少なくとも2つの画像のデータを生成する、3次元撮像装置。 - 前記信号処理部は、前記N個の光感知セルから出力される信号を用いて、前記N個の透過領域の各々に入射する光の強度を示す信号を生成することによってN個の画像のデータを生成する、請求項1に記載の3次元撮像装置。
- 前記N個の透過領域に含まれる第1の領域および第2の領域は、前記光透過部の中心を通り前記光透過部の受光面の面積を2分割する線分に対して、互いに反対側に配置されている、請求項1または2に記載の3次元撮像装置。
- 前記N個の透過領域に含まれる第3の領域の少なくとも一部は、前記第1の領域と前記第2の領域との間に位置している、請求項3に記載の3次元撮像装置。
- 前記第3の領域は透明領域である、請求項4に記載の3次元撮像装置。
- 前記第1の領域の透過波長域および前記第2の領域の透過波長域は、互いに異なる補色の波長域に設定されている、請求項3から5のいずれかに記載の3次元撮像装置。
- 前記第1の領域の面積および前記第2の領域の面積は等しく、
前記第3の領域の面積は、前記第1の領域の面積および前記第2の領域の面積よりも大きい、請求項4から6のいずれかに記載の3次元撮像装置。 - 前記N個の透過領域のうち透過波長域が最も広い透過領域は、前記N個の色フィルタのうち透過波長域が最も広い色フィルタよりも広い透過波長域を有している、請求項1から7のいずれかに記載の3次元撮像装置。
- 前記N個の透過領域の各々は、透明であるか、または補色の波長域の光を透過させるように構成されている、請求項1から8のいずれかに記載の3次元撮像装置。
- N=3である、請求項1から9のいずれかに記載の3次元撮像装置。
- 前記N個の透過領域は、それぞれ、シアン光を透過させるシアン領域、黄光を透過させる黄領域、および透明領域である、請求項10に記載の3次元撮像装置。
- 前記N個の透過領域は、それぞれ、シアン光を透過させるシアン領域、黄光を透過させる黄領域、およびマゼンタ光を透過させるマゼンタ領域である、請求項10に記載の3次元撮像装置。
- 前記N個の色フィルタは、それぞれ、赤光を透過させる赤フィルタ、緑光を透過させる緑フィルタ、および青光を透過させる青フィルタである、請求項10から12のいずれかに記載の3次元撮像装置。
- 各単位要素は、行列状に配置された4つの光感知セルと、前記4つの光感知セルに1対1に対応して配置された4つの色フィルタを含み、
前記4つの色フィルタのうち、1行1列目および2行1列目に配置された色フィルタは、透明フィルタまたは緑光を透過させる緑フィルタであり、残りの2つの色フィルタは、赤光を透過させる赤フィルタおよび青光を透過させる青フィルタである、請求項10から13のいずれかに記載の3次元撮像装置。 - N=4である、請求項1から9のいずれかに記載の3次元撮像装置。
- 前記N個の透過領域は、それぞれ、シアン光を透過させるシアン領域、黄光を透過させる黄領域、マゼンタ光を透過させるマゼンタ領域、および透明領域である、請求項15に記載の3次元撮像装置。
- 前記N個の色フィルタは、それぞれ、マゼンタ光を透過させるマゼンタフィルタ、緑光を透過させる緑フィルタ、シアン光を透過させるシアンフィルタ、および黄光を透過させる黄フィルタである、請求項15または16に記載の3次元撮像装置。
- 前記信号処理部は、前記N個の透過領域のうちの1つの透過領域に入射する光の強度を示す信号を、他の透過領域に入射する光の強度を示す信号に加えることによって、前記他の透過領域に入射する光の強度を示す信号のレベルを大きくする、請求項1から17のいずれかに記載の3次元撮像装置。
- 前記信号処理部は、前記N個の透過領域のうち透過波長域が最も広い透過領域に入射する光の強度を示す信号を、他の透過領域に入射する光の強度を示す信号に加えることによって、前記他の透過領域に入射する光の強度を示す信号のレベルを大きくする、請求項18に記載の3次元撮像装置。
- 前記信号処理部は、前記N個の透過領域のうち透過波長域が最も広い透過領域に入射する光の強度を示す信号を用いてカラー情報を取得する、請求項1から19のいずれかに記載の3次元撮像装置。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201180003089.1A CN102474648B (zh) | 2010-06-02 | 2011-02-10 | 三维摄像装置 |
US13/388,313 US8902291B2 (en) | 2010-06-02 | 2011-02-10 | Three-dimensional image pickup device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010127239A JP5227368B2 (ja) | 2010-06-02 | 2010-06-02 | 3次元撮像装置 |
JP2010-127239 | 2010-06-02 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2011151948A1 true WO2011151948A1 (ja) | 2011-12-08 |
Family
ID=45066342
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2011/000763 WO2011151948A1 (ja) | 2010-06-02 | 2011-02-10 | 3次元撮像装置 |
Country Status (4)
Country | Link |
---|---|
US (1) | US8902291B2 (ja) |
JP (1) | JP5227368B2 (ja) |
CN (1) | CN102474648B (ja) |
WO (1) | WO2011151948A1 (ja) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012098599A1 (ja) * | 2011-01-17 | 2012-07-26 | パナソニック株式会社 | 撮像装置 |
WO2012144162A1 (ja) * | 2011-04-22 | 2012-10-26 | パナソニック株式会社 | 3次元撮像装置、光透過部、画像処理装置、およびプログラム |
EP2605519A1 (en) * | 2011-12-15 | 2013-06-19 | Thomson Licensing | Anaglyphic stereoscopic image capture device |
US20140078379A1 (en) * | 2012-09-14 | 2014-03-20 | Kensuke Masuda | Image capturing device and image capturing system |
WO2014203639A1 (ja) * | 2013-06-21 | 2014-12-24 | オリンパス株式会社 | 撮像装置、画像処理装置、撮像方法及び画像処理方法 |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5454424B2 (ja) * | 2010-09-03 | 2014-03-26 | ソニー株式会社 | 撮像方法 |
JP2012203274A (ja) * | 2011-03-28 | 2012-10-22 | Sony Corp | 撮像装置および電子機器 |
JP5914881B2 (ja) * | 2011-05-19 | 2016-05-11 | パナソニックIpマネジメント株式会社 | 3次元撮像装置、画像処理装置、画像処理方法、およびプログラム |
WO2012157209A1 (ja) * | 2011-05-19 | 2012-11-22 | パナソニック株式会社 | 3次元撮像装置、撮像素子、光透過部、および画像処理装置 |
JP2012257022A (ja) * | 2011-06-08 | 2012-12-27 | Sony Corp | 画像処理装置および方法、並びにプログラム |
JP5831105B2 (ja) * | 2011-09-30 | 2015-12-09 | ソニー株式会社 | 撮像装置及び撮像方法 |
EP2699003A1 (en) | 2012-08-17 | 2014-02-19 | Thomson Licensing | Method of conversion of an anaglyph image into a full-color 3d image |
US10249262B2 (en) * | 2012-12-04 | 2019-04-02 | Apple Inc. | Displays with adjustable circular polarizers |
KR102112298B1 (ko) * | 2013-09-30 | 2020-05-18 | 삼성전자주식회사 | 컬러 영상 및 깊이 영상을 생성하는 방법 및 장치 |
DE102014213397A1 (de) * | 2014-07-10 | 2016-01-14 | Conti Temic Microelectronic Gmbh | Verfahren zur Farbrekonstruktion in einem kamerabasierten Fahrerassistenzsystem |
JP6595161B2 (ja) * | 2014-07-31 | 2019-10-23 | ソニーセミコンダクタソリューションズ株式会社 | 画像処理装置、画像処理方法、及び、撮像装置 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002344999A (ja) * | 2001-05-21 | 2002-11-29 | Asahi Optical Co Ltd | ステレオ画像撮像装置 |
JP2008153931A (ja) * | 2006-12-18 | 2008-07-03 | Matsushita Electric Ind Co Ltd | 固体撮像装置、カメラ、車両及び監視装置 |
JP2009276294A (ja) * | 2008-05-16 | 2009-11-26 | Toshiba Corp | 画像処理方法 |
WO2010058545A1 (ja) * | 2008-11-19 | 2010-05-27 | パナソニック株式会社 | 撮像装置 |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0748878B2 (ja) | 1986-03-19 | 1995-05-24 | 日本放送協会 | 立体画像撮像表示システム |
JPS62291292A (ja) | 1986-06-11 | 1987-12-18 | Sharp Corp | 撮像装置 |
JPH02171737A (ja) | 1988-12-26 | 1990-07-03 | Minolta Camera Co Ltd | ステレオカメラ用撮影レンズ |
JP3863319B2 (ja) | 1999-06-29 | 2006-12-27 | 富士フイルムホールディングス株式会社 | 視差画像撮像装置及びカメラ |
US6807295B1 (en) * | 1999-06-29 | 2004-10-19 | Fuji Photo Film Co., Ltd. | Stereoscopic imaging apparatus and method |
JP3869702B2 (ja) | 2001-10-30 | 2007-01-17 | ペンタックス株式会社 | ステレオ画像撮像装置 |
US20060092314A1 (en) * | 2004-10-31 | 2006-05-04 | Silverstein D A | Autofocus using a filter with multiple apertures |
CA2627999C (en) * | 2007-04-03 | 2011-11-15 | Her Majesty The Queen In Right Of Canada, As Represented By The Minister Of Industry Through The Communications Research Centre Canada | Generation of a depth map from a monoscopic color image for rendering stereoscopic still and video images |
WO2009153937A1 (ja) * | 2008-06-18 | 2009-12-23 | パナソニック株式会社 | 固体撮像装置 |
US20100103276A1 (en) * | 2008-10-28 | 2010-04-29 | Border John N | Split aperture capture of rangemap for 3d imaging |
JP5386512B2 (ja) * | 2009-01-30 | 2014-01-15 | 興和株式会社 | 眼科撮影装置 |
US8363093B2 (en) * | 2009-07-27 | 2013-01-29 | Eastman Kodak Company | Stereoscopic imaging using split complementary color filters |
JP5406151B2 (ja) * | 2010-09-24 | 2014-02-05 | パナソニック株式会社 | 3次元撮像装置 |
JP5914881B2 (ja) * | 2011-05-19 | 2016-05-11 | パナソニックIpマネジメント株式会社 | 3次元撮像装置、画像処理装置、画像処理方法、およびプログラム |
-
2010
- 2010-06-02 JP JP2010127239A patent/JP5227368B2/ja not_active Expired - Fee Related
-
2011
- 2011-02-10 US US13/388,313 patent/US8902291B2/en active Active
- 2011-02-10 WO PCT/JP2011/000763 patent/WO2011151948A1/ja active Application Filing
- 2011-02-10 CN CN201180003089.1A patent/CN102474648B/zh active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002344999A (ja) * | 2001-05-21 | 2002-11-29 | Asahi Optical Co Ltd | ステレオ画像撮像装置 |
JP2008153931A (ja) * | 2006-12-18 | 2008-07-03 | Matsushita Electric Ind Co Ltd | 固体撮像装置、カメラ、車両及び監視装置 |
JP2009276294A (ja) * | 2008-05-16 | 2009-11-26 | Toshiba Corp | 画像処理方法 |
WO2010058545A1 (ja) * | 2008-11-19 | 2010-05-27 | パナソニック株式会社 | 撮像装置 |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012098599A1 (ja) * | 2011-01-17 | 2012-07-26 | パナソニック株式会社 | 撮像装置 |
US8902293B2 (en) | 2011-01-17 | 2014-12-02 | Panasonic Corporation | Imaging device |
WO2012144162A1 (ja) * | 2011-04-22 | 2012-10-26 | パナソニック株式会社 | 3次元撮像装置、光透過部、画像処理装置、およびプログラム |
US9544570B2 (en) | 2011-04-22 | 2017-01-10 | Panasonic Intellectual Property Management Co., Ltd. | Three-dimensional image pickup apparatus, light-transparent unit, image processing apparatus, and program |
EP2605519A1 (en) * | 2011-12-15 | 2013-06-19 | Thomson Licensing | Anaglyphic stereoscopic image capture device |
EP2605520A1 (en) * | 2011-12-15 | 2013-06-19 | Thomson Licensing | Anaglyphic stereoscopic image capture device |
CN103163718A (zh) * | 2011-12-15 | 2013-06-19 | 汤姆森特许公司 | 彩色立体的立体图像捕获设备 |
US9247233B2 (en) | 2011-12-15 | 2016-01-26 | Thomson Licensing | Anagylphic stereoscopic image capture device |
US20140078379A1 (en) * | 2012-09-14 | 2014-03-20 | Kensuke Masuda | Image capturing device and image capturing system |
US9307127B2 (en) * | 2012-09-14 | 2016-04-05 | Ricoh Company, Ltd. | Image capturing device and image capturing system |
WO2014203639A1 (ja) * | 2013-06-21 | 2014-12-24 | オリンパス株式会社 | 撮像装置、画像処理装置、撮像方法及び画像処理方法 |
JP2015005921A (ja) * | 2013-06-21 | 2015-01-08 | オリンパス株式会社 | 撮像装置、画像処理装置、撮像方法及び画像処理方法 |
Also Published As
Publication number | Publication date |
---|---|
CN102474648B (zh) | 2015-06-03 |
JP2011254331A (ja) | 2011-12-15 |
CN102474648A (zh) | 2012-05-23 |
US8902291B2 (en) | 2014-12-02 |
US20120133743A1 (en) | 2012-05-31 |
JP5227368B2 (ja) | 2013-07-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5227368B2 (ja) | 3次元撮像装置 | |
US9041770B2 (en) | Three-dimensional image capture device | |
JP5879549B2 (ja) | ライトフィールド撮像装置、および画像処理装置 | |
JP5923754B2 (ja) | 3次元撮像装置 | |
WO2011142063A1 (ja) | 3次元撮像装置 | |
JP5995084B2 (ja) | 3次元撮像装置、撮像素子、光透過部、および画像処理装置 | |
JP5903670B2 (ja) | 3次元撮像装置、画像処理装置、画像処理方法および画像処理プログラム | |
JP5507362B2 (ja) | 3次元撮像装置および光透過板 | |
JP5927570B2 (ja) | 3次元撮像装置、光透過部、画像処理装置、およびプログラム | |
JP5406163B2 (ja) | 3次元撮像装置および画像処理装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201180003089.1 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11789363 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13388313 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 11789363 Country of ref document: EP Kind code of ref document: A1 |