WO2012039087A1 - Élément imageur et dispositif imageur - Google Patents

Élément imageur et dispositif imageur Download PDF

Info

Publication number
WO2012039087A1
WO2012039087A1 PCT/JP2011/003934 JP2011003934W WO2012039087A1 WO 2012039087 A1 WO2012039087 A1 WO 2012039087A1 JP 2011003934 W JP2011003934 W JP 2011003934W WO 2012039087 A1 WO2012039087 A1 WO 2012039087A1
Authority
WO
WIPO (PCT)
Prior art keywords
polarizer
photosensitive cell
polarization
unit
rotating
Prior art date
Application number
PCT/JP2011/003934
Other languages
English (en)
Japanese (ja)
Inventor
シング　ビラハム　パル
Original Assignee
パナソニック株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニック株式会社 filed Critical パナソニック株式会社
Publication of WO2012039087A1 publication Critical patent/WO2012039087A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/30—Polarising elements
    • G02B5/3025—Polarisers, i.e. arrangements capable of producing a definite output polarisation state from an unpolarised input state
    • G02B5/3033—Polarisers, i.e. arrangements capable of producing a definite output polarisation state from an unpolarised input state in the form of a thin sheet or foil, e.g. Polaroid
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof

Definitions

  • the present invention relates to an imaging device that can acquire polarization information and an imaging device including the imaging device.
  • Patent Document 1 discloses an image sensor in which fine polarizers are arranged at a pitch of about 100 ⁇ m, for example.
  • Patent Document 2 discloses an imaging apparatus having a mechanism for rotating a polarizing plate.
  • Patent Document 3 discloses an endoscope that acquires a polarization image by alternately using two polarizing plates having a polarization transmission axis orthogonal to each other.
  • Patent Document 2 there is a problem of pixel shift due to a large rotating polarizing plate, and resolution and SN ratio are lowered. Moreover, it is difficult to reduce the size of an apparatus for rotating the polarizing plate.
  • the present invention has been made in order to solve the above-described problems, and has as its main purpose an imaging that does not require a device for rotating or moving a large polarizing plate and can acquire polarization information from each pixel. It is to provide an element.
  • Another object of the present invention is to provide an imaging device that includes the imaging device described above and can output polarization information.
  • the imaging device of the present invention includes a plurality of polarizer units each including one polarizer or N polarizers (N is an integer of 2 or more) having different polarization transmission axis directions, and a plurality of photosensitive cells. And a photosensitive cell array arranged such that linearly polarized light transmitted through the polarizer is incident on each photosensitive cell, and each polarizer unit is rotated about the central axis of each polarizer unit. And a MEMS rotating element for rotating the polarization plane of linearly polarized light incident on each photosensitive cell.
  • each polarizer unit includes four polarizers having different polarization transmission axis directions, and each polarization transmission axis direction is different by 45 °.
  • the MEMS rotating element rotates each polarizer unit by rotating the polarizer unit by an angle that is a multiple of 45 ° in synchronization with a timing at which charge accumulation in the photosensitive cell array is reset.
  • the plane of polarization of linearly polarized light incident on the cell is changed.
  • the MEMS rotating element temporarily changes a polarization plane of linearly polarized light incident on each photosensitive cell by quiescing the polarizer unit during a period in which charge accumulation is performed in the photosensitive cell array. Fix it.
  • one polarizer faces one photosensitive cell during the period in which the charge accumulation is performed in the photosensitive cell array.
  • the MEMS rotating element includes a rotating unit that supports each polarizer unit, and a fixed unit that rotates the rotating unit by electrostatic force.
  • the imaging apparatus of the present invention includes a plurality of polarizer units each including one polarizer or N polarizers (N is an integer of 2 or more) having different polarization transmission axis directions, and a plurality of photosensitive cells. And a photosensitive cell array arranged such that linearly polarized light transmitted through the polarizer is incident on each photosensitive cell, and each polarizer unit is rotated about the central axis of each polarizer unit.
  • an imaging device including a MEMS rotating element that rotates a polarization plane of linearly polarized light incident on each photosensitive cell, a driving circuit that drives the MEMS rotating element, and imaging for forming an image on the imaging device And a lens.
  • each of a plurality of polarizer units each including one or several polarizers is rotated by a MEMS rotating element, a large apparatus for rotating or replacing a large polarizing plate is provided. It is unnecessary.
  • light having a different polarization main axis can be incident on each pixel, it is possible to obtain a polarized image with high resolution.
  • FIG. 1 shows schematic structure of the imaging part in embodiment of the imaging device by this invention.
  • A is a figure which shows typically the one part plane structure of the rotating polarizer array 160 in 1st Embodiment
  • (b) is a figure which shows the cross-sectional structure typically.
  • A) is a figure which shows typically the plane structure for 1 pixel of the rotating polarizer array 160
  • (b) is a figure which shows typically the cross section and the cross section of the photosensitive cell array 120 corresponding.
  • it is a figure which shows the relationship between polarizer 14A, 14B, 14C, 14D in an initial state, and photosensitive cell 12a, 12b, 12c, 12d.
  • a 1st example it is a figure which shows the relationship between polarizer 14A, 14B, 14C, 14D in a 2nd state, and photosensitive cell 12a, 12b, 12c, 12d.
  • a 1st example it is a figure which shows the relationship between polarizer 14A, 14B, 14C, 14D in a 3rd state, and photosensitive cell 12a, 12b, 12c, 12d.
  • a 1st example it is a figure which shows the relationship between polarizer 14A, 14B, 14C, 14D in a 4th state, and photosensitive cell 12a, 12b, 12c, 12d.
  • a 2nd example it is a figure which shows the relationship between polarizer 14A, 14B, 14C, 14D in an initial state, and photosensitive cell 12a, 12b, 12c, 12d.
  • a 2nd example it is a figure which shows the relationship between polarizer 14A, 14B, 14C, 14D in a 2nd state, and photosensitive cell 12a, 12b, 12c, 12d.
  • a 2nd example it is a figure which shows the relationship between polarizer 14A, 14B, 14C, 14D in a 3rd state, and photosensitive cell 12a, 12b, 12c, 12d.
  • FIG. 1 it is a figure which shows the relationship between polarizer 14A, 14B, 14C, 14D in a 4th state, and photosensitive cell 12a, 12b, 12c, 12d.
  • A is a figure which shows typically the plane structure for 4 pixels of the rotating polarizer array 160 in 2nd Embodiment
  • (b) is a figure which shows the cross section and the cross section of the corresponding photosensitive cell array 120 typically.
  • FIG. It is a figure which shows typically the plane structure for 36 pixels of the rotating polarizer array 160 in 2nd Embodiment.
  • (A) to (d) is a diagram showing the rotation of the polarizer unit 140 in the second embodiment.
  • FIG. 1 is a block diagram illustrating a schematic configuration of an imaging apparatus according to an embodiment of the present invention. It is a block diagram which shows an example of the main components of the signal processing part 200 in embodiment of this invention.
  • a graph showing light intensities (pixel values or luminances) I 1 to I 4 transmitted through four types of polarizers having polarization transmission axes ( ⁇ i 0 °, 45 °, 90 °, 135 °) having different directions. is there. It is a graph which shows the amplitude, phase, and average value of the fluctuation curve of polarization luminance.
  • FIG. 1 is a diagram illustrating a schematic configuration of an imaging unit in an embodiment of an imaging apparatus according to the present invention.
  • the imaging unit includes an imaging element (image sensor) 10 and a photographing lens 20 for forming an image on the imaging surface of the imaging element 10.
  • the imaging element 10 includes a photosensitive cell array 120 in which a plurality of photosensitive cells (photoelectric conversion elements) are arranged along the imaging surface, a rotating polarizer array 160 that controls a polarization plane of light incident on each photosensitive cell, and the like. It has. Since each photosensitive cell corresponds to a pixel, the photosensitive cell array 120 may be referred to as a pixel array 120.
  • the photographic lens 20 is schematically described as a single lens in FIG. 1, but is usually an optical system in which a plurality of lenses are combined, and has a known configuration.
  • FIG. 2A schematically shows a part of the planar configuration of the rotating polarizer array 160
  • FIG. 2B shows a cross section thereof.
  • FIG. 2A for simplicity, only a region corresponding to the size of four pixels in the rotating polarizer array 160 is shown.
  • the actual rotating polarizer array 160 has a size that covers all the photosensitive cells (all pixels) included in the opposing photosensitive cell array 120.
  • FIG. 3A is a plan view of a region for one pixel in the rotating polarizer array 160
  • FIG. 3B schematically shows a cross section thereof and a cross section of one corresponding photosensitive cell 12. As shown in FIG. Show.
  • the rotating polarizing element 160 of the present embodiment includes a plurality of polarizer units 140 and a MEMS rotating element 16 that rotates each polarizer unit 140 around the central axis of each polarizer unit 140.
  • each polarizer unit 140 includes four polarizers 14 having different polarization transmission axis directions.
  • each polarizer unit 140 includes one polarizer 14. Contains.
  • the polarizer 14 covers one corresponding photosensitive cell 12, and linearly polarized light polarized in the direction of the polarization transmission axis of the polarizer 14 is incident on the photosensitive cell 12.
  • the MEMS rotating element 16 has a rotating portion 16b that supports each polarizer unit 140 and a fixing portion 16a that rotates the rotating portion 16b by electrostatic force. is doing.
  • the fixing unit 16a may be separated for each polarizer unit 140, or integrated with the fixing unit 16a of another polarizer unit 140 and continuously in one rotating polarizer array 160 as shown in FIG. You may do it.
  • the MEMS rotating element 16 can be manufactured by a micromachining technique using a known semiconductor manufacturing technique.
  • the fixed portion 16a and the rotating portion 16b can be formed by preparing a single crystal silicon substrate and performing fine processing by a thin film deposition process, a photolithography process, and an etching process.
  • the fixed portion 16a and the rotating portion 16b can be formed of, for example, a polycrystalline silicon thin film or a silicon dioxide film.
  • An example of a method for manufacturing such a MEMS rotating element 16 is disclosed in Non-Patent Document 1, for example.
  • the diameter of the rotating unit 16b can be determined according to the pixel size.
  • the diameter of the rotating unit 16b can be set to, for example, 14 ⁇ m.
  • the size of the polarizer 14 is limited by the rotating unit 16b.
  • the MEMS rotating element 16 includes electrodes 15a and 15b that generate an electrostatic force for rotating the rotating portion 16b, and wiring (not shown).
  • the rotating portion 16b rotates by a desired angle. Since the rotation unit 16b rotates together with the polarizer unit 140, the polarization transmission axis direction of the polarizer 14 included in the polarizer unit 140 can be rotated by a predetermined angle.
  • the movement of the rotating unit 16b can be controlled so as to rotate in a state where the polarization transmission axes of all the polarizers 14 are aligned in the same direction.
  • the present invention is not limited to such an example.
  • the directions of the polarization transmission axes of the individual polarizers 14 do not need to match.
  • Each polarizer 14 is preferably rotated by the same angle (for example, 45 °) by one rotation operation.
  • the imaging unit of FIG. 1 includes a MEMS driving circuit 40 that drives the MEMS rotating element 16 of the rotating polarizer array 160.
  • the MEMS drive circuit 40 may be incorporated in the image sensor 10 or may be mounted as another component.
  • the electrodes 15a and 15b in FIG. 3A are connected to the MEMS drive circuit 40 through the wiring described above.
  • each polarizer 14A, 14B, 14C, 14D in the drawing indicates the direction (main axis direction) of the polarization transmission axis of the polarizer.
  • the light transmitted through the polarizer 14 is linearly polarized light polarized in the direction of the polarization transmission axis of the polarizer 14.
  • 4A to 4D show four polarizers 14A, 14B, 14C, and 14D in which the directions of polarization transmission axes are aligned in the same direction.
  • the arrangement pitch of the photosensitive cells in the photosensitive cell array 120 matches the arrangement pitch of the polarizers 14 in the rotating polarizer array 160. These arrangement pitches are sometimes referred to as “pixel pitches”.
  • the actual photosensitive cell array 120 is disposed at a position to receive light transmitted through each polarizer 14 of the rotating polarizer array 160 as described above.
  • the photosensitive cell array 120 is composed of photosensitive cells 12 arranged in rows and columns.
  • FIG. 4A shows the relationship between the polarization transmission axis directions of the four polarizers 14A, 14B, 14C, and 14D included in the rotating polarizer array 160 in the initial state and the photosensitive cells 12a, 12b, 12c, and 12d. ing.
  • the light transmitted through the four polarizers 14A, 14B, 14C, and 14D is linearly polarized light that is polarized in the Y-axis direction, and is incident on the photosensitive cells 12a, 12b, 12c, and 12d, respectively.
  • charges corresponding to the amount of incident light are generated and accumulated by photoelectric conversion.
  • the charges accumulated in each of the photosensitive cells 12a, 12b, 12c, and 12d are read out as pixel signals. After the charge reading is completed, the accumulated charge is reset.
  • the charge accumulation period is defined by the reciprocal of the signal reading frame rate (fps: frame per second).
  • FIG. 4B shows a state in which the polarizers 14A, 14B, 14C, and 14D are rotated by 45 ° by the action of the individual MEMS rotating elements 16, respectively.
  • the light transmitted through the four polarizers 14A, 14B, 14C, and 14D is polarized in a direction rotated by 45 ° clockwise from the Y axis, and the photosensitive cells 12a, 12b, and 12c, respectively. , 12d.
  • the photosensitive cells 12a, 12b, 12c, and 12d While in the state of FIG. 4B, in the photosensitive cells 12a, 12b, 12c, and 12d, charges corresponding to the amount of incident light are generated and accumulated by photoelectric conversion.
  • the charges accumulated in each of the photosensitive cells 12a, 12b, 12c, and 12d are read out as pixel signals. After the charge reading is completed, the accumulated charge is reset.
  • the rotation of the polarizers 14A, 14B, 14C, and 14D is performed in synchronization with the charge accumulation reset timing.
  • the time during which the polarizers 14A, 14B, 14C, and 14D are rotating is excluded from the charge accumulation period. For this reason, the polarization direction of light incident on each photosensitive cell does not change during the charge accumulation period. As a result, it is possible to obtain polarization information of light incident on the photosensitive cell based on the read pixel signal. Acquisition of polarization information in pixel units will be described in detail later.
  • FIG. 4C shows a state in which the polarizers 14A, 14B, 14C, and 14D are further rotated by 45 ° by the action of the individual MEMS rotating elements 16, respectively.
  • the light transmitted through the four polarizers 14A, 14B, 14C, and 14D is polarized in a direction (X-axis direction) rotated by 90 ° clockwise from the Y-axis, and each of the photosensitive cells. It enters 12a, 12b, 12c, 12d.
  • charges corresponding to the amount of incident light are generated and accumulated by photoelectric conversion.
  • the charges accumulated in each of the photosensitive cells 12a, 12b, 12c, and 12d are read out as pixel signals. After the charge reading is completed, the accumulated charge is reset.
  • FIG. 4D shows a state in which the polarizers 14A, 14B, 14C, and 14D are further rotated by 45 ° by the action of the individual MEMS rotating elements 16, respectively.
  • the light transmitted through the four polarizers 14A, 14B, 14C, and 14D is polarized in a direction rotated by 135 ° clockwise from the Y axis, and the photosensitive cells 12a, 12b, and 12c, respectively. , 12d.
  • charges corresponding to the amount of incident light are generated and accumulated by photoelectric conversion.
  • the charges accumulated in each of the photosensitive cells 12a, 12b, 12c, and 12d are read out as pixel signals. After the charge reading is completed, the accumulated charge is reset.
  • the polarizers 14A, 14B, 14C, and 14D are further rotated by 45 ° by the action of the individual MEMS rotating elements 16, and return to the state shown in FIG. 4A.
  • each polarizer 14 returns from the state of FIG. 4A to the original state (the state of FIG. 4A) through the state of FIG. 4B, the state of FIG. 4C, and the state of FIG. 4D.
  • this periodic operation is repeated, light transmitted through a polarizer having a different polarization transmission axis is sequentially incident on each photosensitive cell during one period. Since the pixel signal is read out in synchronization with the rotational motion of the polarizer 14, polarization information can be acquired.
  • the polarization transmission axis direction is set to four directions.
  • pixel signals may be acquired in a state where the polarization transmission axis directions are different by 60 °.
  • the rotation angle of the polarizer 14 is not limited to 45 ° or 60 °. Any other angle can be set. Two types of pixel signals may be output in a state where the polarization transmission axis directions are different by 90 °. In this case, the polarizer 14 may repeat this operation with one cycle of the operation of rotating 90 ° clockwise and then rotating 90 ° counterclockwise. Although complete polarization information cannot be obtained, it is possible to detect polarization components whose polarization directions are orthogonal.
  • planar shapes of the polarizer 14 and the photosensitive cell 12 shown in FIGS. 4A to 4D are both circular.
  • the planar shapes of the polarizer 14 and the photosensitive cell (light receiving region) 12 are not limited to a circular shape.
  • the planar shape and size of the polarizer 14 and the photosensitive cell 12 are such that light transmitted through the polarizer 14 efficiently enters each photosensitive cell 12 and light that does not transmit through the corresponding polarizer 14 corresponds to each light. It is designed not to enter the sensing cell 12.
  • the planar shape of the photosensitive cell 12 does not have to be circular, and may be an ellipse or a polygon.
  • the planar shape of the polarizer 14 is not necessarily circular, and may be an ellipse or a polygon.
  • the planar shape of each polarizer 14 may be a square or an octagon.
  • the planar shape of the polarizer 14 preferably has a symmetrical shape with a rotation of (360 / N) degrees around the central axis.
  • the light sensing cell 12 may be covered with a microlens.
  • the photosensitive cell array 120 may be realized by a backside illuminated image sensor. When the photosensitive cell array 120 is realized by a normal surface irradiation type image sensor, a wiring (not shown) exists between the photosensitive cell 12 and the photosensitive cell 12.
  • FIGS. 5A to 5D Next, another example of the rotation operation of the polarizer 14 will be described with reference to FIGS. 5A to 5D.
  • the polarization transmission axis directions of the four polarizers 14A, 14B, 14C, and 14D shown in the figure are different by 45 °, but the other points are the same as the examples shown in FIGS. 4A to 4D. Are the same.
  • FIG. 5A shows the relationship between the polarization transmission axis directions of the four polarizers 14A, 14B, 14C, and 14D included in the rotating polarizer array 160 in the initial state and the photosensitive cells 12a, 12b, 12c, and 12d. ing.
  • the light transmitted through the four polarizers 14A, 14B, 14C, and 14D is linearly polarized light that is polarized in different directions by 45 °, and is incident on the photosensitive cells 12a, 12b, 12c, and 12d, respectively.
  • charges corresponding to the amount of incident light are generated and accumulated by photoelectric conversion.
  • the charges accumulated in each of the photosensitive cells 12a, 12b, 12c, and 12d are read out as pixel signals. After the charge reading is completed, the accumulated charge is reset.
  • four polarizers 14A, 14B, 14C, and 14D form one basic configuration. This basic configuration is two-dimensionally and periodically arranged in one rotating polarizer array 160. The four polarizers 14A, 14B, 14C, and 14D can rotate independently, but in the present embodiment, they rotate by the same angle in the same direction.
  • FIG. 5B shows a state in which the polarizers 14A, 14B, 14C, and 14D are rotated by 45 ° by the action of the individual MEMS rotating elements 16, respectively.
  • the light transmitted through the four polarizers 14A, 14B, 14C, and 14D is polarized in a direction rotated by 45 ° clockwise from the polarization transmission axis direction shown in FIG. 5A.
  • the light enters the sensing cells 12a, 12b, 12c, and 12d.
  • the photosensitive cells 12a, 12b, 12c, and 12d While in the state of FIG. 5B, in the photosensitive cells 12a, 12b, 12c, and 12d, charges corresponding to the amount of incident light are generated and accumulated by photoelectric conversion.
  • the charges accumulated in each of the photosensitive cells 12a, 12b, 12c, and 12d are read out as pixel signals. After the charge reading is completed, the accumulated charge is reset.
  • FIG. 5C shows a state in which the polarizers 14A, 14B, 14C, and 14D are further rotated by 45 ° by the action of the individual MEMS rotating elements 16, respectively.
  • the light transmitted through the four polarizers 14A, 14B, 14C, and 14D is incident on the photosensitive cells 12a, 12b, 12c, and 12d, respectively.
  • the photosensitive cells 12a, 12b, 12c, and 12d While in the state of FIG. 5C, in the photosensitive cells 12a, 12b, 12c, and 12d, charges corresponding to the amount of incident light are generated and accumulated by photoelectric conversion.
  • the charges accumulated in each of the photosensitive cells 12a, 12b, 12c, and 12d are read out as pixel signals. After the charge reading is completed, the accumulated charge is reset.
  • FIG. 5D shows a state in which the polarizers 14A, 14B, 14C, and 14D are further rotated by 45 ° by the action of the individual MEMS rotating elements 16.
  • the light transmitted through the four polarizers 14A, 14B, 14C, and 14D is incident on the photosensitive cells 12a, 12b, 12c, and 12d, respectively.
  • the photosensitive cells 12a, 12b, 12c, and 12d While in the state of FIG. 5D, in the photosensitive cells 12a, 12b, 12c, and 12d, charges corresponding to the amount of incident light are generated and accumulated by photoelectric conversion.
  • the charges accumulated in each of the photosensitive cells 12a, 12b, 12c, and 12d are read out as pixel signals. After the charge reading is completed, the accumulated charge is reset.
  • the polarizers 14A, 14B, 14C, and 14D are further rotated by 45 ° by the action of the individual MEMS rotating elements 16, and return to the state shown in FIG. 5A.
  • each polarizer 14 rotates by 45 °.
  • this periodic operation is repeated, light transmitted through four polarizers having different polarization transmission axes is sequentially incident on each photosensitive cell 12 during one period. Since pixel signals are read out in synchronization with the rotational movement of the polarizer 14, polarization information can be acquired.
  • the interval between the photosensitive cell array 120 and the rotating polarizer array 160 is 1 mm or less. In a more preferred embodiment, they are in contact.
  • one polarizer unit 140 includes one polarizer 14, but the present invention is not limited to such an example.
  • the number of the polarizers 14 included in one polarizer unit 140 may be N (N is an integer of 2 or more).
  • FIG. 6 is a plan view showing a planar configuration example of one polarizer unit 140 including four polarizers 14 having different polarization transmission axis directions.
  • FIG. It is a top view of the area
  • An arrow is described on each polarizer 14 in FIG. This arrow indicates the direction (main axis direction) of the polarization transmission axis of the polarizer.
  • the polarization transmission axis directions of the polarizers 14 included in one polarizer unit 140 are different by 45 °.
  • the MEMS rotating element 16 in this example also includes a rotating portion 16b that supports the polarizer unit 140 and a fixing portion 16a that rotates the rotating portion 16b by electrostatic force, as shown in FIG.
  • These configurations are basically the same as those shown in FIGS. 3A and 3B. The difference is that one rotating unit 16b supports four polarizers 14A, 14B, 14C, and 14D.
  • the rotation unit 16b rotates together with the polarizer unit 140, the polarization transmission axis directions of the four polarizers 14A, 14B, 14C, and 14D included in the polarizer unit 140 are rotated by a predetermined angle. Can do.
  • the four polarizers 14A, 14B, 14C, 14D rotate about the center O of the polarizer unit 140, not the center of each.
  • FIG. 7 is a plan view showing nine polarizer units 140.
  • the polarizers 14A, 14B, 14C, and 14D in the individual polarizer units 140 have the same arrangement pattern.
  • the actual rotating polarizer array 160 includes a number of polarizer units 140.
  • the polarizer unit 140 when the polarizer unit 140 in the state shown in FIG. 8A is rotated clockwise by 90 °, the polarizer unit 140 is in the state shown in FIG. 8B.
  • the polarizer 14A in the state of FIG. 8A, it has a polarization transmission axis parallel to the Y-axis direction, but in the state shown in FIG. 8B, polarization transmission parallel to the X-axis direction. Has an axis. That is, when the polarizer unit rotates 90 °, the polarizer 14A rotates 90 ° around the rotation center of the polarizer unit 140 and rotates the polarization transmission axis direction by 90 °. The same applies to the other polarizer units 14B, 14C, and 14D included in the same polarizer unit 140.
  • the polarizer unit 140 when the polarizer unit 140 is rotated by 90 °, the polarization plane of the light incident on each light sensing cell 12 is rotated by 45 °.
  • the polarizer 14 itself covering each photosensitive cell 12 is sequentially changed by the rotation of the polarizer unit 140. That is, also in this embodiment, the polarization plane of the light incident on each photosensitive cell 12 can be rotated.
  • each photosensitive cell 12 when light polarized in a specific direction is incident, each photosensitive cell 12 generates and accumulates a charge corresponding to the amount of incident light by photoelectric conversion.
  • the charge accumulated in each of the photosensitive cells 12 is read out as a pixel signal. After the charge reading is completed, the accumulated charge is reset.
  • the rotation of the polarizer unit 140 is performed in synchronization with the timing at which the accumulated charge is reset. When charge accumulation is performed, the rotation of the polarizer unit 140 is stopped.
  • FIG. 9 shows an example of a configuration in which one polarizer unit 140 covers the photosensitive cells 12 having a larger number than the polarizers 14 included therein.
  • the polarizer 14A covers the photosensitive cells 12a, 12b, 12c, and 12d.
  • the polarizer 14B covers the photosensitive cells 12e, 12f, 12g, and 12h.
  • the polarizer 14C covers the photosensitive cells 12i, 12j, 12k, and 12l.
  • the polarizer 14D covers the photosensitive cells 12m, 12n, 12o, and 12p.
  • the polarizer unit 140 rotates 90 ° clockwise, for example, the polarization transmission axis direction of the polarizer 14A rotates 90 °, and the polarizer 14A moves to a position covering the photosensitive cells 12e, 12f, 12g, and 12h. .
  • the other polarizers 14B, 14C, and 14D move their positions while rotating the polarization transmission axis direction in the same manner as the polarizer 14A.
  • each polarizer 14 since the polarizer unit 140 is rotated by 90 °, the shape of each polarizer 14 does not have to be a circle, and may be a square as shown in FIG.
  • the number of photosensitive cells 12 covered by one polarizer 14 is not limited to four.
  • the number of photosensitive cells 12 covered by one polarizer 14 is preferably n ⁇ n.
  • FIG. 10 is a block diagram illustrating a schematic configuration of the imaging apparatus according to the present embodiment.
  • the imaging apparatus of the present embodiment includes an imaging unit 100, a signal processing unit 200 that performs various signal processing, an imaging display unit 300 that displays an image acquired by imaging, a recording medium 400 that records image data, and each unit And a system control unit 500 for controlling the system.
  • the imaging unit 100 includes an imaging element (image sensor) 10 having the rotating polarizer array 160 having each configuration described above, and a photographing lens 20 for forming an image on the imaging surface of the imaging element 10. is doing.
  • the photographic lens 20 in the present embodiment has a known configuration, and is actually a lens unit that includes a plurality of lenses.
  • the photographing lens 20 is driven by a mechanism (not shown), and necessary operations for optical zooming, automatic exposure (AE) and automatic focus (AF) are performed as necessary.
  • the imaging unit 100 includes an imaging element driving unit 30 and a MEMS driving circuit 40 that drive the imaging element 10.
  • the image sensor driving unit 30 is composed of, for example, a driver LSI.
  • the image sensor drive unit 30 drives the image sensor 10 to read an analog signal from the image sensor 10 and convert it into a digital signal.
  • the MEMS driving circuit 40 rotates the polarization transmission axis direction of the polarizer in a plane parallel to the imaging area by driving the MEMS rotating element 16 of the rotating polarizer array 160 described above.
  • the signal processing unit 200 in the present embodiment includes an image processing unit (image processor) 220, a memory 240, and an interface (IF) unit 260.
  • the signal processing unit 200 is connected to a display unit 300 such as a liquid crystal display panel and a recording medium 400 such as a memory card.
  • the image processing unit 220 performs various signal processes necessary for operations such as color correction, resolution change, automatic exposure, automatic focus, and data compression, and executes polarization information acquisition processing according to the present invention.
  • the image processing unit 220 is preferably realized by a combination of hardware such as a known digital signal processor (DSP) and software that executes image processing including polarization information processing according to the present invention.
  • DSP digital signal processor
  • the memory 240 is configured by a DRAM or the like. The memory 240 records the image data obtained from the imaging unit 100 and temporarily records the image data subjected to various image processing by the image processing unit 220. These image data are converted into analog signals and then displayed on the display unit 300 or recorded on the recording medium 400 via the interface unit 260 as digital signals.
  • a system control unit 500 including a central processing unit (CPU) (not shown) and a flash memory.
  • CPU central processing unit
  • the imaging apparatus of the present embodiment may include known components such as a viewfinder, a power source (battery), and a flashlight, but a description thereof is omitted because it is not particularly necessary for understanding the present invention.
  • FIG. 11 is a block diagram illustrating an example of main components of the signal processing unit 200 in the present embodiment.
  • polarization image information can be acquired from a subject and output as two types of polarization images (polarization degree image ⁇ and polarization phase image ⁇ ).
  • the signal output from the imaging unit 100 is sent to the image processing unit 220, processed by the image processing unit 220, and then stored in the polarization degree image frame memory 222 and the polarization phase image frame memory 224.
  • Polarization degree image frame memory 222 outputs polarization degree image ( ⁇ ) data
  • polarization phase image frame memory 224 outputs polarization phase image ( ⁇ ) data.
  • I i is the luminance observed when the rotation angle ⁇ of the polarization transmission axis is ⁇ i .
  • FIG. 12 shows luminances I 1 to I 4 corresponding to four samples ( ⁇ i , I i ) obtained from one pixel.
  • A, B, and C are unknown constants, and represent the amplitude, phase, and average value of the polarization luminance fluctuation curve, respectively.
  • polarization information means amplitude modulation degree (modulation degree) ⁇ and phase information ⁇ in a sine function curve indicating the dependence of luminance on the polarization principal axis angle.
  • the values ⁇ and ⁇ (0 ⁇ ⁇ ⁇ ⁇ ) are calculated by the following (formula 2) and (formula 3), respectively.
  • polarization information can be acquired from all pixels based on the pixel signal (pixel value) to be read even if the polarization transmission axis of the polarizer is changed by driving the MEMS rotating element 16. .
  • the effect of the present invention can also be obtained, for example, by adopting a configuration in which light sequentially transmitted through a polarizer in which the polarization transmission axis has two different directions enters each photosensitive cell.
  • a polarizer in which the polarization transmission axis has two different directions enters each photosensitive cell.
  • orthogonal polarization components can be detected, which is also useful in technical fields such as endoscopes.
  • the imaging device and imaging apparatus of the present invention can be applied to various fields of polarization imaging technology.
  • the imaging device and imaging apparatus of the present invention are useful as key devices for security, medical care, communication, and analysis.
  • Imaging unit (image sensor) DESCRIPTION OF SYMBOLS 12 Photosensitive cell 12a-12d Photosensitive cell 12e-12p Photosensitive cell 14 Polarizer 14A-14D Polarizer 15a Electrode 15b Electrode 16 MEMS rotating element 16a Fixed part 16b Rotating part 20 Shooting lens 30 Imaging element drive part 40 Drive circuit 100 Imaging unit 120 Photosensitive cell array 140 Polarizer unit 160 Rotating polarizer array 200 Signal processing unit 220 Image processing unit (image processor) 222 Polarization image frame memory 224 Polarization phase image frame memory 226 Luminance image frame memory 240 Memory 260 Interface (IF) section 300 Imaging display section 400 Recording medium 500 System control section

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Mechanical Light Control Or Optical Switches (AREA)
  • Solid State Image Pick-Up Elements (AREA)

Abstract

L'invention concerne un dispositif imageur comprenant : une pluralité d'unités de polarisation (140) comprenant chacune un seul polariseur (14) ou N (N entier supérieur ou égal à 2) polariseurs (14) dont les axes de transmission de polarisation possèdent des directions différentes ; un réseau (120) de cellules photosensibles comportant une pluralité de cellules photosensibles (12) agencées le long d'un plan image et adapté pour permettre à la lumière polarisée linéairement traversant les polariseurs (14) de pénétrer dans chacune des cellules photosensibles (12) ; et un élément de rotation MEMS (16) apte à provoquer la rotation de chacune des unités de polarisation (140) sur son axe central de manière à provoquer la rotation d'un plan de polarisation de la lumière polarisée linéairement qui pénètre dans chacune des cellules photosensibles (12).
PCT/JP2011/003934 2010-09-24 2011-07-08 Élément imageur et dispositif imageur WO2012039087A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2010213652 2010-09-24
JP2010-213652 2010-09-24

Publications (1)

Publication Number Publication Date
WO2012039087A1 true WO2012039087A1 (fr) 2012-03-29

Family

ID=45873593

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2011/003934 WO2012039087A1 (fr) 2010-09-24 2011-07-08 Élément imageur et dispositif imageur

Country Status (1)

Country Link
WO (1) WO2012039087A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2014020791A1 (ja) * 2012-08-02 2016-07-21 パナソニックＩｐマネジメント株式会社 偏光カラー撮像装置
US20200185436A1 (en) * 2016-08-18 2020-06-11 Sony Corporation Imaging apparatus and imaging method
TWI704391B (zh) * 2019-11-27 2020-09-11 國立中央大學 反射式電子顯示裝置

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008099589A1 (fr) * 2007-02-13 2008-08-21 Panasonic Corporation Système, procédé et dispositif de traitement d'image et format d'image
JP2008209162A (ja) * 2007-02-23 2008-09-11 Matsushita Electric Works Ltd 距離画像センサ

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008099589A1 (fr) * 2007-02-13 2008-08-21 Panasonic Corporation Système, procédé et dispositif de traitement d'image et format d'image
JP2008209162A (ja) * 2007-02-23 2008-09-11 Matsushita Electric Works Ltd 距離画像センサ

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2014020791A1 (ja) * 2012-08-02 2016-07-21 パナソニックＩｐマネジメント株式会社 偏光カラー撮像装置
US20200185436A1 (en) * 2016-08-18 2020-06-11 Sony Corporation Imaging apparatus and imaging method
US11056518B2 (en) * 2016-08-18 2021-07-06 Sony Corporation Imaging apparatus and imaging method
TWI704391B (zh) * 2019-11-27 2020-09-11 國立中央大學 反射式電子顯示裝置

Similar Documents

Publication Publication Date Title
JP4932978B2 (ja) 撮像素子および撮像装置
US10425624B2 (en) Solid-state image capturing device and electronic device
US5616912A (en) Three dimensional imaging apparatus, camera, and microscope using discrete shutter control to produce parallax for obtaining three dimensional images
JP6879919B2 (ja) 固体撮像素子、電子機器、及び、固体撮像素子の製造方法
US20100134662A1 (en) Image capture device and method
JP5000395B2 (ja) 撮像表示方法および撮像表示装置
US20130076919A1 (en) Optical image stabilization using tangentially actuated mems devices
US20120019736A1 (en) Imaging device
KR20150004858A (ko) 스펙트럼 편광 이미징 센서
JP2007201915A (ja) 平面カメラユニット
US20210014416A1 (en) Camera module
CN102192788B (zh) 热式光检测器、热式光检测装置及电子设备
US20140285703A1 (en) Liquid crystal optical device, solid state imaging device, portable information terminal, and display device
US11012635B2 (en) Optical device including pinhole array aperture and related methods
WO2012039087A1 (fr) Élément imageur et dispositif imageur
JP5254323B2 (ja) 光学歪み計測装置
JP5115068B2 (ja) 撮像装置
KR20210102026A (ko) 이미지 센서 및 이를 포함하는 전자 장치
JP2009139356A (ja) 偏光計測装置
JP5491964B2 (ja) 立体撮像装置
US20150014514A1 (en) Sensor
KR20140061234A (ko) 이미지 생성 장치 및 이미지 생성 방법
CN113257846A (zh) 图像传感器和包括图像传感器的电子设备
WO2019176209A1 (fr) Dispositif d'imagerie à semi-conducteurs
US9148558B2 (en) Camera module having first and second imaging optical system controlled in relation to imaging modes and imaging method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11826540

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11826540

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP