JP2010109798A - Imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus for improving brightness of images captured via a polarization section for transmitting light in different polarization states. <P>SOLUTION: The imaging apparatus includes: a polarization filter section including a plurality of polarizing filter units including a polarization region for transmitting light in a prescribed polarization state and a non-polarization region for transmitting incident light as it is; and an image pickup device including a plurality of pixels for receiving light that has transmitted through the polarization region and light that has transmitted through the non-polarization region, thus preventing deterioration in visual resolution. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging apparatus.

Conventionally, as shown in Patent Document 1, a light receiving module in which a polarizing element array having respective polarizer regions that transmit light of different polarization directions is superimposed on a light receiving element array is known.
JP 2007-086720 A

  According to Patent Document 1, since a polarized image is picked up, the amount of light incident on the light receiving array is reduced, and even if a non-polarized image is generated from the image picked up by the light receiving array, the polarizer is used. This results in a darker image than the non-polarized image taken without intervention. In other words, even if an unpolarized image is generated from an image obtained by imaging light transmitted through each polarizer region that passes through different polarization regions, the light is greatly cut by the polarizer region. A polarized image becomes a dark image and the image quality is lowered. In addition, since humans have high sensitivity characteristics with respect to luminance, when the brightness of an image decreases, the resolution of an apparent image also decreases.

  In order to solve the above-described problem, in the first aspect of the present invention, an imaging apparatus includes: a polarization region that transmits light in a predetermined polarization state; and a non-polarization region that transmits incident light as it is. A polarization filter unit including a plurality of polarization filter units, and an imaging device having a plurality of pixels that respectively receive light transmitted through the polarization regions and light transmitted through the non-polarization regions.

  The polarization filter unit may include a plurality of polarization regions that transmit light having different polarization states and a plurality of non-polarization regions that transmit incident light as they are.

  The polarizing filter unit may have more non-polarizing regions than the polarizing regions.

  The image sensor may further include a color filter unit including a plurality of color filter units each including a plurality of color filters that respectively transmit light of different colors, and the plurality of pixels of the imaging element each transmit light that has passed through the polarization region and the color filter. And the light transmitted through the non-polarized light region and the color filter, respectively.

  The polarizing filter portion and the color filter portion may overlap each other so that the respective polarizing regions and the respective non-polarizing regions substantially coincide with the respective color filters.

  In order to solve the above-described problem, in the second aspect of the present invention, in the imaging device, a polarization filter unit that transmits light in a predetermined polarization state, and a plurality of components that receive light transmitted through the polarization filter unit And a second image sensor having a plurality of pixels that receive incident light without passing through the polarizing filter section.

  The polarization filter unit may include a plurality of polarization filter units each including a plurality of polarization filters that transmit respective lights having different polarization states, and the plurality of pixels of the first image sensor include the plurality of polarization filters. Each transmitted light may be received.

  A first color filter unit that transmits light of a specific color; and a second color filter unit that includes a plurality of color filter units each including a plurality of color filters that respectively transmit light of different colors. A plurality of pixels of one image sensor receive light transmitted through the polarization filter unit and the first color filter unit, and a plurality of pixels of the second image sensor receive light transmitted through the plurality of color filters, respectively. Each may receive light.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

First Embodiment FIG. 1 illustrates an example of an imaging apparatus 100 according to a first embodiment. The imaging apparatus 100 includes a polarization filter unit 101, an imaging element 102, an image processing unit 103, a display unit 104, and a recording unit 105.

  The polarization filter unit 101 includes a plurality of polarization filter units including a polarization region that transmits light in a predetermined polarization state and a non-polarization region that transmits incident light as it is. The image sensor 102 includes a plurality of pixels that respectively receive light that has passed through the polarization regions of the polarization filter unit 101 and light that has passed through the non-polarization regions. Image data captured by the image sensor 102 is output to the image processing unit 103. The imaging apparatus 100 includes an imaging element driving driver, an AD converter, and the like. The image sensor drive driver reads out image data captured by the image sensor 102 and outputs the image data to the AD converter. The AD converter converts the received image data into digital signal image data. The image processing unit 103 acquires the image data of the digital signal converted by the AD converter. The imaging device 100 may include an information processing device such as a CPU, and the information processing device may control an imaging element driving driver, an AD converter, and the like.

  The image processing unit 103 may generate non-polarized image data including a pixel value of a pixel that receives light transmitted through the non-polarized region from the acquired image data. Further, non-polarized image data may be generated from the pixel value of a pixel that receives light transmitted through the non-polarized region. The non-polarized image data refers to image data obtained by imaging unpolarized light. Further, the image processing unit 103 converts the non-polarized image data from the pixel value of the pixel that has received the light transmitted through the non-polarized region of the acquired image data and the pixel value of the pixel that has received the light transmitted through the polarized region. It may be generated in a pseudo manner. For example, by adding the pixel values of a plurality of pixels that receive light of different polarization states, the non-polarized pixel values of the plurality of pixels can be generated in a pseudo manner. Further, the image processing unit 103 may calculate the Stokes parameter based on the acquired image data. The Stokes parameter is a parameter indicating the polarization state. The image processing unit 103 may correct the generated non-polarized image data using the calculated Stokes parameters. In addition, the image processing unit 156 may perform image processing such as gamma correction and pixel interpolation processing on the image data. The image processing unit 103 outputs the generated non-polarized image data to the display unit 104 and the recording unit 105. The image processing unit 103 may be realized by an information processing device such as a CPU, or may be realized by an electronic circuit or the like.

  The display unit 104 displays the transmitted non-polarized image data. The display unit 104 includes a display such as liquid crystal, organic EL, or plasma, and a display control unit that controls the display. The display control unit may be realized by an information processing device such as a CPU. The recording unit 105 records the sent image data. A recording medium such as a flash memory and a recording control unit are included. The recording control unit may be realized by an information processing device such as a CPU.

  FIG. 2 shows an example of the polarization filter unit 101 according to the first embodiment. FIG. 2 shows an example in which a region for 2 × 2 pixels is used as one polarization filter unit 110. Each polarization filter corresponds to each pixel. The polarization filter unit 101 includes a plurality of polarization filter units 110 including a polarization region that transmits light in a predetermined polarization state and a non-polarization region that transmits incident light as it is. The polarization filter unit 110 may include a plurality of polarization regions that transmit light having different polarization states and a plurality of non-polarization regions that transmit incident light as they are.

  As can be seen from FIG. 2, the polarization filter unit 110 includes a non-polarization region 111 that transmits incident light as it is, and a first polarization region that transmits linearly polarized light in the vertical direction out of the incident light. 112 and a second polarization region 113 that transmits linearly polarized light in the diagonally right direction out of the incident light. The polarization filter unit 110 has two non-polarization regions 111, one first polarization region 112, and one second polarization region 113. For example, the first polarizing region 112 and the second polarizing region 113 may be polarizers. Further, the non-polarizing region 111 may be a cavity or a film that transmits incident light as it is. In FIG. 2, the positions where the non-polarization region 111, the first polarization region 112, and the second polarization region 113 are disposed in the respective polarization filter units 110 are all the same, but for each polarization filter unit 110. The positions where the non-polarizing region 111, the first polarizing region 112, and the second polarizing region 113 are disposed may be changed.

  Each pixel of the image sensor 102 receives light transmitted through the non-polarization region 111, light transmitted through the first polarization region 112, and light transmitted through the second polarization region 113, respectively. That is, the light transmitted through each non-polarization region 111 is received by the pixel corresponding to each non-polarization region 111. Further, the light transmitted through each first polarization region 112 is received by a pixel corresponding to each first polarization region 112. Further, the light transmitted through each second polarization region 113 is received by the pixels corresponding to each second polarization region 113. Thus, since the polarization filter unit 101 has the non-polarization region 111 that transmits the incident light as it is, the luminance resolution and resolution are improved, and a bright image can be obtained. That is, although the amount of light transmitted through the polarization region is reduced, the luminance resolution is increased by providing the non-polarization region 111 that does not decrease the amount of transmitted light. In addition, the polarizing filter unit 101 has more non-polarizing regions 111 than polarizing regions. Thereby, the resolution and resolution of luminance can be further increased, and a bright image can be obtained.

  Since the image data captured by the image sensor 102 via the polarization filter unit 101 is image data including a polarization component and a non-polarization component, the image processing unit 103 can calculate a Stokes parameter based on the image data. it can. When the polarizing filter unit 101 shown in FIG. 2 is used, the Stokes parameters S0, S1, and S2 can be calculated. Further, the image processing unit 103 generates non-polarized image data based on the acquired image data. For example, the image processing unit 103 may generate non-polarized image data from the pixel value of a pixel that has received light transmitted through the non-polarized region 111.

  In addition, the image processing unit 103 uses the pixel value of the pixel that has received the light transmitted through the first polarization region 112 and the second polarization region 113, and the light transmitted through the first polarization region 112 and the second polarization region 113. The pixel values when the received pixels receive non-polarized light are respectively calculated in a pseudo manner, and the pixel values of the pixels receiving the light transmitted through the non-polarized region 111 and the non-polarized image from the calculated pixel values. Data may be generated in a pseudo manner. In addition, the image processing unit 103 uses the pixel value of the pixel that has received the light transmitted through the first polarization region 112 and the second polarization region 113 and the pixel value of the pixel that has received the light transmitted through the non-polarization region 111. The pixel values when the pixels receiving the light transmitted through the first polarizing region 112 and the second polarizing region 113 receive non-polarized light are respectively calculated in a pseudo manner, and the light transmitted through the non-polarizing region 111 is calculated. Non-polarized image data may be generated in a pseudo manner from the pixel value of the received pixel and the calculated pixel value. Further, the image processing unit 103 may correct the generated non-polarized image data using Stokes parameters. Since the generated non-polarized image data is a bright image, it is possible to prevent degradation in image quality and apparent resolution.

  FIG. 3 shows another example of the polarizing filter unit 101 according to the first embodiment. FIG. 3 shows an example in which a region of 3 × 3 pixels is used as one polarizing filter unit 110. Each polarization filter corresponds to each pixel. Components having the same functions as those in FIG. 2 are given the same reference numerals. The polarization filter unit 101 includes a plurality of polarization filter units 110, and the polarization filter unit 110 includes a non-polarization region 111, a first polarization region 112, a second polarization region 113, a third polarization region 114, and a fourth. A polarization region 115 is included. The polarizing filter unit 110 has five non-polarizing regions 111, and has one first polarizing region 112, second polarizing region 113, third polarizing region 114, and fourth polarizing region 115 one by one. . Specifically, the polarizing filter unit 110 is provided with non-polarizing regions 111 at the four corners and the center, the first non-polarizing region 112 on the left side of the center, and the second polarizing region 113 on the upper side of the center. The third polarizing region 114 is disposed below the center, and the fourth polarizing region 115 is disposed on the right side of the center.

  The third polarization region 114 transmits laterally linearly polarized light. The third polarizing region 114 may be a polarizer, for example. The fourth polarization region 115 transmits circularly polarized light. The fourth polarization region 115 may include a polarizer that transmits linearly polarized light in the vertical direction and a quarter-wave plate. At this time, the slow axis of the quarter wave plate is set to 45 degrees with respect to the longitudinal linearly polarized light. The non-polarization region 111, the first polarization region 112, and the second polarization region 113 have been described with reference to FIG. In FIG. 3, the positions where the non-polarizing region 111, the first polarizing region 112, the second polarizing region 113, the third polarizing region 114, and the fourth polarizing region 115 are disposed in the respective polarizing filter units 110 are shown. Although all were the same, the position where the non-polarizing region 111, the first polarizing region 112, the second polarizing region 113, the third polarizing region 114, and the fourth polarizing region 115 are arranged for each polarizing filter unit 110. It may be changed.

  Each pixel of the image sensor 102 has a light transmitted through the non-polarized region 111, a light transmitted through the first polarized region 112, a light transmitted through the second polarized region 113, and a third polarized region 114, respectively. Each of the transmitted light and the light transmitted through the fourth polarization region 115 are received. Thus, since the polarization filter unit 101 has the non-polarization region 111 that transmits the incident light as it is, the resolution of the luminance and the resolution increase. In other words, the amount of light transmitted through the polarization region is reduced, but by providing the non-polarization region 111 that does not decrease the amount of transmitted light, the luminance resolution is increased and a bright image can be obtained. In addition, the polarizing filter unit 101 has more non-polarizing regions 111 than polarizing regions. Thereby, the resolution of the luminance and the resolution can be further increased, and a bright image can be obtained.

  When the polarization filter unit 101 shown in FIG. 3 is used, the image processing unit 103 can calculate the Stokes parameters S0, S1, S2, and S3. Further, the image processing unit 103 generates non-polarized image data from the image data obtained using the polarization filter unit 101 shown in FIG. Since the generated non-polarized image data is a bright image, it is possible to prevent deterioration in image quality and apparent resolution. In addition, although the polarizing filter part 101 was demonstrated using FIG.2 and FIG.3, it is not limited to these. In short, the polarizing filter unit 101 only needs to have more non-polarizing regions than polarizing regions. Further, the image processing unit 103 may not generate non-polarized image data. That is, since the image data captured by the image sensor 102 is bright image data, it is possible to prevent a decrease in the apparent resolution.

Second Embodiment FIG. 4 shows an example of an imaging apparatus 100 according to a second embodiment. In addition, the same code | symbol is attached | subjected about the structure similar to 1st Embodiment. Only the parts different from the first embodiment will be described. The imaging apparatus 100 includes a polarization filter unit 101, an imaging element 102, an image processing unit 103, a display unit 104, a recording unit 105, and a color filter unit 106.

  The color filter unit 106 includes a plurality of color filter units each including a plurality of color filters that respectively transmit light of different colors. In addition, light that has passed through each of the non-polarized regions and each of the polarized regions of the polarizing filter unit 101 is incident on each of the color filters of the color filter unit 106. Light transmitted through each of the color filters of the color filter unit 106 is incident on each pixel of the image sensor 102 and is received by each pixel. That is, each pixel of the image sensor 102 receives light that has passed through the respective non-polarization regions and polarization regions of the polarization filter unit 101 and the color filters of the color filter unit 106, respectively.

  FIG. 5 illustrates an example of the polarization filter unit 101 and the color filter unit 106 according to the second embodiment. FIG. 5 shows an example in which a region of 3 × 3 pixels is set as one polarization filter unit 110 and one color filter unit 120. Each polarization filter corresponds to each pixel. Each color filter corresponds to each pixel. Moreover, the same code | symbol is attached | subjected about what has a function similar to the component already demonstrated in FIG. 2, FIG.

  The polarizing filter unit 101 includes a plurality of polarizing filter units 110, and the polarizing filter unit 110 includes a non-polarizing region 111, a first polarizing region 112, and a second polarizing region 113. The polarization filter unit 110 has five non-polarization regions 111 and two first polarization regions 112 and two second polarization regions 113 respectively. Specifically, the polarizing filter unit 110 is provided with non-polarizing regions 111 at the four corners and the center, the first polarizing regions 112 are respectively provided on the upper and lower sides of the center, and the first polarizing regions 112 are provided on the left and right sides of the center. A two-polarization region 113 is provided. As described above, since the non-polarized region 111 is provided, the luminance resolution is increased. In other words, the amount of light transmitted through the polarization region is reduced, but by providing the non-polarization region 111 that does not decrease the amount of transmitted light, the resolution and resolution of luminance are increased, and a bright image can be obtained. In addition, the polarizing filter unit 101 has more non-polarizing regions 111 than polarizing regions. Thereby, the resolution of the luminance and the resolution can be further increased, and a bright image can be obtained. In FIG. 5, the positions where the non-polarization region 111, the first polarization region 112, and the second polarization region 113 are disposed in the respective polarization filter units 110 are all the same. In addition, the positions where the non-polarizing region 111, the first polarizing region 112, and the second polarizing region 113 are disposed may be changed.

  The color filter unit 106 includes a plurality of color filter units 120 each including a plurality of color filters that respectively transmit light of different colors. The color filter unit 120 includes an R color filter 121 that transmits red light, that is, light in a red wavelength band (for example, a wavelength band of 600 to 700 nm), and green light, that is, a green wavelength band (for example, , 500 to 600 nm wavelength band) G light filter 122 that transmits light, and blue light, that is, B color filter 123 that transmits light in the blue wavelength band (for example, 400 to 500 nm wavelength band). And have. The color filter unit 120 has five G color filters 122 and two R color filters 121 and two B color filters 123. Specifically, the color filter unit 120 is provided with R color filters 121 at the upper left corner and the lower right corner, respectively, and the B color filter 123 is provided at the lower left corner and the upper right corner. Each is arranged. G color filters 122 are arranged at the center and the top, bottom, left, and right of the center, respectively. In FIG. 5, the positions where the R color filter 121, the G color filter 122, and the B color filter 123 are all disposed in the respective color filter units 120 are the same. In addition, the positions where the R color filter 121, the G color filter 122, and the B color filter 123 are disposed may be changed. At this time, it is only necessary to provide color filters so that the light that passes through the non-polarization regions 111 passes through the respective color filters.

  As can be seen from FIG. 5, it can be seen that the light transmitted through the first polarizing region 112 and the second polarizing region 113 of the polarizing filter unit 101 respectively enter the G color filter of the color filter unit 106. It can also be seen that the light transmitted through the non-polarization region 111 is incident on the R color filter 121, the G color filter 122, and the B color filter 123, respectively. Therefore, a color image with high luminance can be obtained, and a decrease in apparent resolution can be prevented.

  The image processing unit 103 may generate a non-polarized color image from image data captured using the polarization filter unit 101 and the color filter unit 106 shown in FIG. 5, and generates a pseudo non-polarized color image. May be. When the polarization filter unit 101 of FIG. 5 is used, the image processing unit 103 can calculate the Stokes parameters S0, S1, and S2. The image processing unit 103 may correct the generated non-polarized image data using the calculated Stokes parameter. The light transmitted through the first polarizing region 112 and the second polarizing region 113 is transmitted through the G color filter. However, the light is not a G color filter, but other colors such as a B color filter. You may make it permeate | transmit each filter. In addition, the light transmitted through the first polarizing region 112 and the second polarizing region 113 are transmitted through the color filters that transmit the same color wavelength band, but the color filters that transmit the different color wavelength bands. You may make it each permeate | transmit.

  FIG. 6 illustrates another example of the polarization filter unit 101 and the color filter unit 106 according to the second embodiment. FIG. 6 shows an example in which a region for 3 × 3 pixels is set as one polarization filter unit 110 and one color filter unit 120. Each polarization filter corresponds to each pixel. Each color filter corresponds to each pixel. In addition, components having the same functions as those already described are given the same reference numerals.

  The polarization filter unit 101 includes a plurality of polarization filter units 110, and the polarization filter unit 110 includes a non-polarization region 111, a first polarization region 112, a second polarization region 113, a third polarization region 114, and a fourth. It has a polarizing region 115. The polarizing filter unit 110 has five non-polarizing regions 111, and each has a first polarizing region 112, a second polarizing region 113, a third polarizing region 114, and a fourth polarizing region 115. . Specifically, the polarization filter unit 110 is provided with non-polarization regions 111 at the four corners and the center, the first polarization region 112 on the center upper side, the second polarization region 113 on the left side of the center, A third polarizing region 114 is disposed below the center, and a fourth polarizing region 115 is disposed on the right side of the center. As described above, since the non-polarized region 111 is provided, the luminance resolution and the resolution are improved. In other words, the amount of light transmitted through the polarization region is reduced, but by providing the non-polarization region 111 that does not decrease the amount of transmitted light, the resolution and resolution of luminance are increased, and a bright image can be obtained. In addition, the polarizing filter unit 101 has more non-polarizing regions 111 than polarizing regions. Thereby, the luminance resolution can be further increased, and a bright image can be obtained. In FIG. 6, the positions where the non-polarizing region 111, the first polarizing region 112, the second polarizing region 113, the third polarizing region 114, and the fourth polarizing region 115 are disposed in the respective polarizing filter units 110 are shown. Although all were the same, the position where the non-polarizing region 111, the first polarizing region 112, the second polarizing region 113, the third polarizing region 114, and the fourth polarizing region 115 are arranged for each polarizing filter unit 110. It may be changed.

  The color filter unit 106 includes a plurality of color filter units 120 each including a plurality of color filters that respectively transmit light of different colors. The color filter unit 106 in FIG. 6 is the same as the color filter unit 106 shown in FIG. As can be seen from FIG. 6, the light transmitted through the first polarizing region 112, the second polarizing region 113, the third polarizing region 114, and the fourth polarizing region 115 of the polarizing filter unit 101 is the color filter unit 106. It can be seen that the light enters each of the G color filters. It can also be seen that the light transmitted through the non-polarization region 111 is incident on the R color filter 121, the G color filter 122, and the B color filter 123, respectively. Therefore, a color image with high luminance can be obtained, and a decrease in apparent resolution can be prevented. In FIG. 6, the positions where the R color filter 121, the G color filter 122, and the B color filter 123 are all arranged in the respective color filter units 120 are the same. In addition, the positions where the R color filter 121, the G color filter 122, and the B color filter 123 are disposed may be changed. At this time, it is only necessary to provide color filters so that the light that passes through the non-polarization regions 111 passes through the respective color filters.

  The image processing unit 103 may generate a non-polarized color image from image data captured using the polarization filter unit 101 and the color filter unit 106 shown in FIG. 6, or generates a pseudo-non-polarized color image. May be. Further, when the polarizing filter unit 101 of FIG. 6 is used, the Stokes parameters S0, S1, S2, and S3 can be calculated. The light transmitted through the first polarizing region 112, the second polarizing region 113, the third polarizing region 114, and the fourth polarizing region 115 is transmitted through the G color filter. Instead, for example, other color filters such as a B color filter may be transmitted. The light transmitted through the first polarizing region 112, the second polarizing region 113, the third polarizing region 114, and the fourth polarizing region 115 is transmitted through the color filters that transmit the same wavelength band. However, they may be transmitted through color filters that transmit wavelength bands of different colors. Moreover, although the polarizing filter part 101 was demonstrated using FIG.5 and FIG.6, it is not limited to these. In short, the polarizing filter unit 101 only needs to have more non-polarizing regions than polarizing regions. Further, the image processing unit 103 may not generate non-polarized color image data. That is, since the image data captured by the image sensor 102 is bright image data, it is possible to prevent a decrease in the apparent resolution. In this case, color image data may simply be generated without generating non-polarized image data from image data captured by the image sensor 102.

Third Embodiment FIG. 7 shows an example of an imaging apparatus 150 according to a third embodiment. The imaging device 150 includes a half mirror 151, a mirror 152, a polarization filter unit 153, a first imaging element 154, a second imaging element 155, an image processing unit 156, a display unit 157, and a recording unit 158.

  The half mirror 151 is divided into reflected light and transmitted light. The light transmitted through the half mirror 151 is incident on the polarization filter unit 153. The light reflected by the half mirror 151 is incident on the mirror 152. The mirror 152 reflects incident light. The mirror 152 reflects the incident light so that the light is incident on the second image sensor 155.

  The polarization filter unit 153 transmits light in a predetermined polarization state. In addition, the polarization filter unit 153 may include a plurality of polarization filter units each including a plurality of polarization filters that transmit light having different polarization states. The first image sensor 154 includes a plurality of pixels that receive the respective lights transmitted through the polarization filter unit 153. The second image sensor 155 has a plurality of pixels that receive the respective lights reflected by the mirror. That is, the second image sensor 155 receives light from a subject that has not passed through the polarization filter unit 153. The respective image data captured by the first image sensor 154 and the second image sensor 155 are output to the image processing unit 103. The imaging device 150 includes an imaging element driver and an AD converter. The image sensor drive driver reads out image data captured by the first image sensor 154 and the second image sensor 155 and outputs the image data to an AD converter or the like. The AD converter converts each image data captured by the first image sensor 154 and the second image sensor 155 into image data of a digital signal. The image processing unit 103 acquires the image data of the digital signal converted by the AD converter. The imaging device 150 may include an information processing device such as a CPU, and the information processing device may control an imaging element driving driver, an AD converter, and the like.

  The image processing unit 156 may calculate the Stokes parameters based on the acquired image data captured by the first image sensor 154 and image data captured by the second image sensor. In addition, the image processing unit 156 may perform image processing such as gamma correction and pixel interpolation processing on the image data. Further, the image processing unit 103 may artificially generate unpolarized image data from the image data captured by the first image sensor 154. Further, the image processing unit 156 may combine the non-polarized state image data generated from the image data captured by the first image sensor 154 and the image data captured by the second image sensor 155. The image processing unit 156 may output the image data captured by the second image sensor 155 to the display unit 157 and the recording unit 158. Further, the image processing unit 156 may output the combined image data to the display unit 157 and the recording unit 158.

  The display unit 157 displays the transmitted non-polarized image data. The display unit 104 includes a display such as liquid crystal, organic EL, or plasma, and a display control unit that controls the display. The display control unit may be realized by an information processing device such as a CPU. The recording unit 158 records the sent image data. It has a recording medium such as a flash memory and a control unit. The recording control unit may be realized by an information processing device such as a CPU.

  FIG. 8 shows an example of the polarization filter unit 153 according to the third embodiment. The polarization filter unit 153 transmits light in a predetermined polarization state. The polarizing filter unit 153 may include a plurality of polarizing filter units 160 each including a plurality of polarizing filters that transmit respective lights having different polarization states. FIG. 8 shows an example in which a region for 2 × 2 pixels is used as one polarization filter unit 160. Each polarization filter corresponds to each pixel.

  As can be seen from FIG. 8, the polarizing filter unit 153 includes a plurality of polarizing filter units 160. In addition, the polarization filter unit 160 transmits the first polarization filter 161 that transmits the linearly polarized light in the horizontal direction out of the incident light, and transmits the linearly polarized light in the diagonally right direction out of the incident light. A second polarizing filter 162. The first polarizing filter 161 and the second polarizing filter 162 may be polarizers, for example. That is, the polarizing filter unit 160 transmits only the light in the polarization direction without transmitting the incident light as it is. In FIG. 8, the first polarizing filter 161 and the second polarizing filter 162 are all located at the same positions in the respective polarizing filter units 160, but the first polarizing filter unit 160 is different from the first polarizing filter unit 160. You may make it change the position in which the filter 161 and the 2nd polarizing filter 162 are arrange | positioned.

  Each pixel of the first image sensor 154 receives the light transmitted through the first polarizing filter 161 and the light transmitted through the second polarizing filter 162, respectively. That is, the light transmitted through each first polarizing filter 161 is received by each pixel corresponding to each first polarizing filter 161. Further, the light transmitted through each second polarizing filter 162 is received by each pixel corresponding to each second polarizing filter 162. In addition, each pixel of the second image sensor 155 receives the light of the subject that has entered without passing through the polarization filter unit 153, so that the luminance resolution can be increased and a bright image can be captured. .

  Further, the image processing unit 156 calculates Stokes parameters based on the image data of polarized light imaged by the first image sensor 154 and the image data of unpolarized light imaged by the second image sensor 155. be able to. When the polarizing filter unit 153 shown in FIG. 8 is used, the Stokes parameters S0, S1, and S2 can be calculated. Further, the image processing unit 156 may generate non-polarized image data from the image data captured by the first image sensor 154. Alternatively, unpolarized image data generated from image data captured by the first image sensor 154 and image data captured by the second image sensor 155 may be combined to generate one piece of image data. Further, the image processing unit 156 may correct the synthesized image data or the image data captured by the second image sensor 155 using the calculated Stokes parameter. The image processing unit 156 outputs the image data captured by the second image sensor 155 or the synthesized image data to the display unit 157 and the recording unit 158. The display unit 157 displays the transmitted image data. The recording unit 158 records the sent image data. As described above, since the second image sensor 155 that captures the light that has not been transmitted through the polarization filter unit 153 is provided, the Stokes parameter can be calculated, and the luminance resolution is increased. It is possible to prevent a decrease in apparent resolution.

  FIG. 9 shows another example of the polarizing filter unit 153 according to the third embodiment. FIG. 8 shows an example in which a region for 3 × 3 pixels is used as one polarizing filter unit 160. Each polarization filter corresponds to each pixel. As can be seen from FIG. 8, the polarizing filter unit 153 includes a plurality of polarizing filter units 160. The polarizing filter unit 160 includes three first polarizing filters 161, two second polarizing filters 162, and three third polarizing filters 163, respectively. The third polarizing filter 163 transmits circularly polarized light. That is, the polarization filter unit 153 transmits only the light in the polarization direction without transmitting the incident light as it is. The third polarizing filter 163 may include a polarizer that transmits linearly polarized light in the vertical direction and a quarter-wave plate. At this time, the slow axis of the quarter wave plate is set to 45 degrees with respect to the longitudinal linearly polarized light. The first polarizing filter 161 and the second polarizing filter 162 have been described with reference to FIG. In FIG. 9, the first polarizing filter 161, the second polarizing filter 162, and the third polarizing filter 163 are all located at the same positions in the respective polarizing filter units 160, but the polarizing filter unit 160. Each time the first polarizing filter 161, the second polarizing filter 162, and the third polarizing filter 163 are disposed, the positions may be changed.

  Each pixel of the first image sensor 154 receives light transmitted through the first polarizing filter 161, light transmitted through the second polarizing filter 162, and light transmitted through the third polarizing filter 163, respectively. . That is, the light transmitted through each first polarizing filter 161 is received by each pixel corresponding to each first polarizing filter 161. Further, the light transmitted through each second polarizing filter 162 is received by each pixel corresponding to each second polarizing filter 162. Further, the light transmitted through each third polarizing filter 163 is received by each pixel corresponding to each third polarizing filter 163. In addition, each pixel of the second image sensor 155 receives the light of the incident subject without passing through the polarization filter unit 153, so that the resolution of luminance can be increased.

  When the polarization filter unit 153 shown in FIG. 9 is used, the image processing unit 156 can calculate the Stokes parameters S0, S1, S2, and S3. The image processing unit 156 may generate non-polarized image data from the image data captured by the first image sensor 154. Alternatively, unpolarized image data generated from image data captured by the first image sensor 154 and image data captured by the second image sensor 155 may be combined to generate one piece of image data. Further, the image processing unit 156 may correct the synthesized image data or the image data captured by the second image sensor 155 using the calculated Stokes parameter. The image processing unit 156 outputs the image data captured by the second image sensor 155 or the synthesized image data to the display unit 157 and the recording unit 158. The display unit 157 displays the transmitted image data. The recording unit 158 records the sent image data. As described above, since the second image sensor 155 that captures unpolarized light is provided, the Stokes parameter can be calculated and the luminance resolution is increased, so that the image quality is decreased and the apparent resolution is decreased. Can be prevented. In addition, although the polarizing filter part 153 was demonstrated using FIG.8 and FIG.9, it is not limited to these.

Fourth Embodiment FIG. 10 illustrates an example of an imaging device 150 according to a fourth embodiment. In addition, the same code | symbol is attached | subjected about the structure similar to 3rd Embodiment. Only the parts different from the third embodiment will be described. The imaging device 150 includes a half mirror 151, a mirror 152, a polarization filter unit 153, a first imaging device 154, a second imaging device 155, an image processing unit 156, a display unit 157, a recording unit 158, a first color filter unit 165, and A second color filter unit 166 is provided.

  The first color filter unit 165 transmits light of a specific color. The first color filter unit 165 may transmit green light, that is, light in the green wavelength band. Light that has passed through the respective polarization filters of the polarization filter unit 153 is incident on the first color filter unit 165. The light transmitted through the first color filter unit 165 is incident on each pixel of the first image sensor 154 and received by each pixel. That is, each pixel of the first image sensor 154 receives the light transmitted through the respective polarizing filters of the first polarizing filter unit 153 and transmitted through the first color filter unit 165.

  The second color filter unit 166 includes a plurality of color filter units each including a plurality of color filters that respectively transmit light of different colors. The light reflected by the mirror 152 is incident on each color filter of the second color filter unit 166. Light transmitted through the color filters of the second color filter unit 166 is incident on each pixel of the second image sensor 155 and received by each pixel. That is, each pixel of the second image sensor receives light that has passed through each color filter of the second color filter unit 166.

  FIG. 11 illustrates an example of the second color filter unit 166 according to the fourth embodiment. FIG. 11 shows an example in which a region of 2 × 2 pixels is used as one color filter unit 170. The second color filter unit 166 includes a plurality of color filter units 170. The color filter unit 170 includes an R color filter 171 that transmits red light, that is, light in the red wavelength band, and a G color filter 172 that transmits green light, that is, light in the green wavelength band. And a B color filter 173 that transmits blue light, that is, light in the blue wavelength band. The color filter unit 170 has two G color filters 172 and one R color filter 171 and one B color filter 173. Specifically, the color filter unit 170 is provided with an R color filter 171 at the lower left, a G color filter 172 at the upper left and the lower right, and a B color filter 173 at the upper right. It is installed.

  As can be seen from FIG. 11, the second image sensor 155 captures light that passes through the RGB color filters and does not pass through the polarization filter unit 153, thereby obtaining a color image with high luminance. It is possible to prevent a decrease in the apparent resolution.

  FIG. 12 illustrates another example of the second color filter unit 166 according to the fourth embodiment. FIG. 12 shows an example in which an area for 3 × 3 pixels is used as one color filter unit 170. The second color filter unit 166 includes a plurality of color filter units 170. The color filter unit 170 includes an R color filter 171, a G color filter 172, and a B color filter 173. Have. The color filter unit 170 has five G color filters 172 and two R color filters 171 and two B color filters 173. Specifically, the color filter unit 170 is provided with G color filters 172 at the four corners and at the center, R color filters 171 at the center left and right sides, and B at the center top and bottom sides. The color filters 173 are provided.

  As shown in FIG. 12, since the second image sensor 155 captures light that passes through the RGB color filters and does not pass through the polarization filter unit 153, a high-luminance color image is obtained. It is possible to prevent a decrease in the apparent resolution. The polarization filter unit 153 may transmit light of a predetermined polarization state, and has a plurality of polarization filter units each including a plurality of polarization filters that transmit light of different polarization states. It may be. Moreover, what is shown in FIG. 8 or FIG. 9 may be used. Moreover, although the 2nd color filter part 166 was demonstrated using FIG.11 and FIG.12, it is not limited to these.

  In the second and fourth embodiments, the color filter unit has an RGB color filter. However, other color filters such as cyan, magenta, and yellow may be used. .

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

1 illustrates an example of an imaging apparatus 100 according to a first embodiment. An example of the polarizing filter part 101 of 1st Embodiment is shown. The other example of the polarizing filter part 101 of 1st Embodiment is shown. An example of the imaging device 100 of 2nd Embodiment is shown. An example of the polarization filter unit 101 and the color filter unit 106 of the second embodiment is shown. Another example of the polarizing filter unit 101 and the color filter unit 106 of the second embodiment is shown. An example of the imaging device 150 of 3rd Embodiment is shown. An example of the polarizing filter part 153 of 3rd Embodiment is shown. Another example of the polarizing filter unit 153 according to the third embodiment is shown. An example of the imaging device 150 of 4th Embodiment is shown. An example of the 2nd color filter part 166 of 4th Embodiment is shown. Another example of the second color filter unit 166 of the fourth embodiment is shown.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Image pick-up device 101 Polarization filter part 102 Image pick-up element 103 Image processing part 104 Display part 105 Recording part 106 Color filter part 110 Polarization filter unit 111 Non-polarization area 112 1st polarization area 113 2nd polarization area 114 3rd polarization area 115 4th Polarization region 120 Color filter unit 121 R color filter 122 G color filter 123 B color filter 150 Imaging device 151 Half mirror 152 Mirror 153 Polarization filter unit 154 First image sensor 155 Second image sensor 156 Image processor 157 Display unit 158 Recording unit 160 Polarizing filter unit 161 First polarizing filter 162 Second polarizing filter 163 Third polarizing filter 165 First color filter unit 166 Second color filter unit 170 Color filter unit 171 R color filter 172 G color filter 173 color of the B filter

Claims (8)

A polarization filter unit having a plurality of polarization filter units each including a polarization region that transmits light in a predetermined polarization state and a non-polarization region that transmits incident light as it is;
An imaging apparatus comprising: an imaging element having a plurality of pixels that respectively receive light transmitted through each of the polarization regions and light transmitted through each of the non-polarization regions. The polarizing filter unit is
The imaging apparatus according to claim 1, comprising: a plurality of polarization regions that transmit light having different polarization states; and a plurality of non-polarization regions that transmit incident light as they are. The polarizing filter unit is
The imaging device according to claim 1, wherein the non-polarization region is larger than the polarization region. A color filter unit having a plurality of color filter units each including a plurality of color filters that respectively transmit light of different colors;
The plurality of pixels of the image sensor are
The imaging device according to any one of claims 1 to 3, wherein the imaging device receives light respectively transmitted through the polarization region and the color filter and light transmitted through the non-polarization region and the color filter. The imaging device according to claim 4, wherein the polarization filter unit and the color filter unit overlap each other so that each of the polarization regions and each of the non-polarization regions substantially match each of the color filters. A polarizing filter that transmits light of a predetermined polarization state;
A first imaging device having a plurality of pixels that receive light transmitted through the polarizing filter section;
An imaging device comprising: a second imaging element having a plurality of pixels that receive incident light without passing through the polarizing filter unit. The polarizing filter section is
Having a plurality of polarizing filter units each including a plurality of polarizing filters that transmit respective lights having different polarization states;
The plurality of pixels of the first image sensor are
The imaging device according to claim 6, wherein each of the plurality of polarizing filters receives light that has passed through the polarizing filter. A first color filter that transmits light of a specific color;
A second color filter unit having a plurality of color filter units each including a plurality of color filters that respectively transmit light of different colors,
The plurality of pixels of the first image sensor are
Receiving light transmitted through the polarizing filter unit and the first color filter unit;
The plurality of pixels of the second image sensor are
The imaging device according to claim 6, wherein the imaging device receives light respectively transmitted through the plurality of color filters.

Images