JP2015166723A - Imaging device and imaging system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device with which a plurality of polarized images or spectral images can be obtained by imaging using a single imaging optical system.SOLUTION: The imaging device includes: a lens optical system L having a lens L2, a diaphragm S, and first and second optical regions D1, D2 different from each other in at least either spectral transmittance characteristics or transmissive polarization characteristics; an imaging element N where light that has passed through the lens optical system enters; and an array type optical element K disposed between the lens optical system and the imaging element and including a plurality of optical elements disposed on a plane perpendicular to the optical axis of the lens optical system. The imaging element N includes a plurality of first rows comprising a plurality of first pixels and a plurality of second rows comprising a plurality of second pixels, alternately arranged to each other; the first and second optical regions of the lens optical system are unequally arranged with respect to the optical axis; and in a view in a direction parallel to the optical axis of the lens optical system, the optical element on at least the optical axis of the array type optical element K is located to cover pixels in the corresponding first row and of the adjoining second row.

Description

  The present application relates to an imaging apparatus such as a camera and an imaging system.

  In the field of in-vehicle cameras, an imaging device is disclosed in which a polarizer having different polarization axes for each individual eye is provided in the optical path of a compound eye camera in order to detect a road surface state and a lane (Patent Document 1). ).

  In addition, an imaging apparatus that acquires both a non-polarized image and a polarized image has been put into practical use in medical and beauty cameras such as an endoscope system and a skin diagnostic system.

  These imaging apparatuses are provided with polarized illumination that irradiates a living tissue with non-polarized light and light that vibrates in the direction of a predetermined polarization axis. When illuminating a living tissue with light having a predetermined polarization component, the reflected light on the surface of the living body becomes a specular reflection light in which the polarization component is maintained, and the reflected light in the deep part of the living body is a scattered reflected light whose polarization component is disturbed. Become. Accordingly, a polarizing filter that transmits light that vibrates in a direction parallel to the polarization axis of polarized illumination and a polarizing filter that transmits light that vibrates in a direction perpendicular to the polarization axis of illumination are disposed on the imaging device side. Images of the surface and the deep part of the living body can be acquired.

 An imaging apparatus for acquiring images having different polarization characteristics is disclosed (Patent Documents 2 and 3).

JP 2010-25915 A JP 2008-237243 A JP 2011-97987 A

  However, in the above-described conventional technology, an imaging apparatus that can capture a plurality of images with different polarization characteristics with a simpler configuration has been demanded.

  One non-limiting exemplary embodiment of the present application provides an imaging apparatus capable of capturing a plurality of images having different polarization characteristics with a simpler configuration.

  An imaging apparatus according to an embodiment of the present invention includes a lens, a diaphragm, a lens optical system having first and second optical regions in which at least one of spectral transmittance characteristics and transmission polarization characteristics is different from each other, and the lens An array that includes an image sensor on which light that has passed through an optical system enters, and a plurality of optical elements that are disposed between the lens optical system and the image sensor and that are disposed on a plane perpendicular to the optical axis of the lens optical system. The image sensor includes a plurality of first rows each including a plurality of first pixels and a plurality of second rows each including a plurality of second pixels, which are alternately arranged. The first and second optical regions of the lens optical system are non-uniformly arranged with respect to the optical axis, and at least an optical element on the optical axis of the arrayed optical element is an element of the lens optical system. Optical axis and flat When viewed from a direction, it is positioned so as to cover the first row and the second pixel row adjacent thereto corresponding.

  The array-like optical element causes light beams that have passed through the first optical region to enter the plurality of first pixels and the plurality of second pixels, and the light beams that have passed through the second optical region are the first light beam. It may be incident on the second pixel.

  An imaging apparatus according to another embodiment of the present invention includes a lens, a diaphragm, and a lens optical system having first and second optical regions in which at least one of spectral transmittance characteristics and transmission polarization characteristics is different from each other; An image sensor that receives light that has passed through the lens optical system, and a plurality of optical elements that are disposed between the lens optical system and the image sensor and that are disposed on a plane perpendicular to the optical axis of the lens optical system. The image pickup device includes a plurality of first rows each including a plurality of first pixels and a plurality of second rows each including a plurality of second pixels, which are alternately arranged. And the first and second optical regions of the lens optical system are non-uniformly arranged with respect to the optical axis, and include a plurality of optical elements including optical elements on at least the optical axis of the arrayed optical element. Element boundaries are When viewed from the optical axis parallel to the direction of the lens optical system, the boundary between the first row and the second row of the pixels adjacent thereto, is offset in a predetermined direction.

  The array-like optical element may cause light rays that have passed through the first optical region to be incident on the plurality of first pixels, and light rays that have passed through the second optical region may be incident on the second pixels. Good.

  The first optical region may be configured by a polarization filter that mainly transmits light oscillating in a predetermined polarization axis direction, and the second optical region may transmit non-polarized light.

  The first optical region is configured by a polarization filter that mainly transmits light oscillating in the direction of the first polarization axis, and the second optical region is a second different from the first polarization axis. You may be comprised by the polarizing filter which mainly permeate | transmits the light which vibrates in the direction of a polarizing axis.

  The arrayed optical element may be a lenticular lens.

  An imaging apparatus according to another embodiment of the present invention includes a lens, a diaphragm, a lens optical system having first, second, third, and fourth optical regions, and light that has passed through the lens optical system. An image sensor that is incident, and an array-like optical element that is disposed between the lens optical system and the image sensor and includes a plurality of optical elements disposed on a plane perpendicular to the optical axis of the lens optical system, In at least two of the first, second, third, and fourth optical regions, at least one of spectral transmittance characteristics and transmission polarization characteristics is different from each other, and the imaging device is two-dimensionally The array includes a plurality of first pixels, a plurality of second pixels, a plurality of third pixels, and a plurality of fourth pixels, each of the first pixels, the second pixels, the third pixels, and The fourth pixels are arranged in the two-dimensional two arrangement directions. Located adjacent to each other to form a pixel group, at least two of the first, second, third, and fourth optical regions of the lens optical system are non-uniform with respect to the optical axis. Each optical element of the arrayed optical element is positioned so as to cover the corresponding pixel group when viewed from a direction parallel to the optical axis of the lens optical system.

  The arrayed optical element causes the light beam that has passed through the first optical region to enter the plurality of first pixels, the plurality of second pixels, and the plurality of fourth pixels, and the second optical element. A light beam that has passed through a region is incident on the second pixel, and a light beam that has passed through the third optical region is incident on the plurality of second pixels, the plurality of third pixels, and the plurality of fourth pixels. The light beam that has been incident and has passed through the fourth optical region may be incident on the fourth pixel.

  An imaging apparatus according to another embodiment of the present invention includes a lens, a diaphragm, a lens optical system having first, second, third, and fourth optical regions, and light that has passed through the lens optical system. An image sensor that is incident, and an array-like optical element that is disposed between the lens optical system and the image sensor and includes a plurality of optical elements disposed on a plane perpendicular to the optical axis of the lens optical system, In at least two of the first, second, third, and fourth optical regions, at least one of spectral transmittance characteristics and transmission polarization characteristics is different from each other, and the imaging device is two-dimensionally The array includes a plurality of first pixels, a plurality of second pixels, a plurality of third pixels, and a plurality of fourth pixels, each of the first pixels, the second pixels, the third pixels, and The fourth pixels are arranged in the two-dimensional two arrangement directions. Located adjacent to each other to form a pixel group, at least two of the first, second, third, and fourth optical regions of the lens optical system are unequal with respect to the optical axis. The boundaries of the plurality of optical elements of the arrayed optical element are predetermined with respect to the corresponding boundary positions of the plurality of pixel groups when viewed from a direction parallel to the optical axis of the lens optical system. It is offset in the direction.

  The arrayed optical element causes light rays that have passed through the first optical region to enter the plurality of first pixels, light rays that have passed through the second optical region to enter the second pixels, and The light beam that has passed through the third optical region may be incident on the plurality of third pixels, and the light beam that has passed through the fourth optical region may be incident on the fourth pixel.

  The arrayed optical element may be a microlens array.

  The first optical region is configured by a polarization filter that mainly transmits light oscillating in the direction of the first polarization axis, and the second optical region and the fourth optical region transmit unpolarized light. The third optical region may be configured by a polarization filter that mainly transmits light that is transmitted and vibrates in the direction of the second polarization axis orthogonal to the first polarization axis.

  The arrayed optical element may be formed on the imaging element.

  The imaging apparatus may further include a microlens provided between the arrayed optical element and the imaging element, and the arrayed optical element may be formed on the imaging element via the microlens. .

  The microlens may be a refractive index distribution element formed in a binary shape or a refractive index distribution element formed in a multi-level shape.

  A distance measuring device according to another embodiment of the present invention includes a plurality of the imaging devices described above.

  According to the imaging device according to one embodiment of the present invention, it is possible to simultaneously acquire a plurality of images having different polarization characteristics or a plurality of images having different spectral characteristics using a single imaging system. There is little crosstalk between these multiple images, or the balance of the dynamic range is excellent.

It is a schematic diagram which shows Embodiment 1 of the imaging device A by this invention. It is the front view which looked at the 1st and 2nd optical area | regions D1 and D2 of the optical element L1 in Embodiment 1 of this invention from the to-be-photographed object side. It is a perspective view of the array-like optical element K in Embodiment 1 of this invention. (A) is an enlarged view of the arrayed optical element K and the image sensor N shown in FIG. 1 in the first embodiment, and (b) is a pixel on the arrayed optical element K and the image sensor N. FIG. (A) is an enlarged view showing the arrayed optical element K and the image sensor N in Embodiment 2, and (b) is the positional relationship between the arrayed optical element K and the pixels on the image sensor N. FIG. (A) And (b) is a figure which shows the positional relationship of the lenticular lens K and the pixel on the image pick-up element N in the modification of this Embodiment 2. FIG. It is a perspective view of array-like optical element K 'in Embodiment 3 of the present invention. (A) is the front view which looked at the optical area | region D1, D2, D3, D4 of the optical element L1 in this Embodiment 3 from the to-be-photographed object side, (b) and (c) are a micro lens array and an image pick-up element. It is a figure which shows the positional relationship with the pixel on N. (A) is the front view which looked at optical area | region D1, D2, D3, D4 of the optical element L1 in this Embodiment 4 from the to-be-photographed object side, (b) and (c) are a micro lens array and an image pick-up element. It is a figure which shows the positional relationship with the pixel on N. (A) And (b) is the figure which expands and shows the array-like optical element K and the image pick-up element N in this Embodiment 5. FIG. (A) is sectional drawing of the refractive index distribution element which can be provided on the image pick-up element in this Embodiment 5, (b) is a front view of a refractive index distribution element. It is a perspective view of the distance measuring device in the sixth embodiment.

  An embodiment of an imaging apparatus and an imaging system according to the present invention is as follows.

(Embodiment 1)
FIG. 1 is a schematic diagram illustrating an imaging apparatus A according to the first embodiment. The imaging apparatus A according to the present embodiment includes a lens optical system L having V as an optical axis, an array-like optical element K disposed near the focal point of the lens optical system L, an imaging element N, a signal processing unit C1, and the like. Is provided. An arrow H in FIG. 1 indicates the horizontal direction when the imaging apparatus is used.

  The lens optical system L includes a stop S on which light from a subject (not shown) enters, an optical element L1 on which light that has passed through the stop S enters, and a lens L2 on which light that has passed through the optical element L1 enters. Including. The lens optical system L has optical regions D1 and D2. In the present embodiment, the lens optical system L is image side telecentric.

  The lens L2 may be configured by a single lens or may be configured by a plurality of lenses. Moreover, the structure arrange | positioned separately in multiple sheets before and behind the aperture_diaphragm | restriction S may be sufficient. In FIG. 1, it is illustrated as a single sheet configuration.

  The optical element L1 is disposed in the vicinity of the stop S, and includes a portion located in the optical region D1 and a portion located in the optical region D2. A polarization filter that transmits light that vibrates in the direction of the first polarization axis (transmission axis) is disposed in the optical region D1, and light that vibrates in the direction of all the polarization axes (transmission axes) is disposed in the optical region D2. The flat glass which permeate | transmits is arrange | positioned. In addition, since the end face of the polarizing filter and the end face of the flat glass are present at the interface between the optical area D1 and the optical area D2, a light blocking area SS is provided for blocking light incident on the end face of the polarizing filter and the flat glass. ing.

  FIG. 2 is a front view of the optical regions D1 and D2 as viewed from the subject side. In FIG. 2, the broken line s indicates the opening area of the stop S. The optical regions D1 and D2 are located within the aperture in a cross section perpendicular to the optical axis V of the lens optical system L defined by the stop S. As shown in FIG. 2, the optical region D <b> 1 and the optical region D <b> 2 are disposed asymmetrically with respect to the optical axis V in a plane perpendicular to the optical axis V. Specifically, the area of the optical region D1 is larger than the area of the optical region D2, and the boundary between the optical region D1 and the optical region D2 does not pass through the optical axis V. The optical region D1 includes the optical axis V, and the optical region D2 does not include the optical axis V. In the present embodiment, the boundary between the optical area D1 and the optical area D2 is perpendicular to the horizontal direction H when the imaging apparatus is used.

  In the present embodiment, the light that has passed through the two optical regions D1 and D2 enters the arrayed optical element K after passing through the lens L2. FIG. 3 is a perspective view of the arrayed optical element K. FIG. The arrayed optical element is a lenticular lens having a plurality of cylindrical lenses M1. Each cylindrical lens M1 extends in the x direction (first direction), and a plurality of cylindrical lenses M1 are arranged in the y direction (second direction). The y direction corresponds to the horizontal direction in FIGS. That is, the extending direction of each cylindrical lens M1 is parallel to the boundary between the optical region D1 and the optical region D2. The cross section perpendicular to the x direction of each cylindrical lens M1 has a curved shape protruding toward the image sensor N side. In the present embodiment, the x direction and the y direction are orthogonal to each other.

  As shown in FIG. 1, the lenticular lens K is disposed in the vicinity of the focal point of the lens optical system L, and is disposed at a position away from the imaging surface Ni by a predetermined distance.

  4A is an enlarged view of the arrayed optical element K and the image sensor N shown in FIG. 1, and FIG. 4B is a diagram illustrating the array of the optical element K and the pixels on the image sensor N. It is a figure which shows a positional relationship. The arrayed optical element K is arranged so that the surface on which the cylindrical lens M1 is formed faces the imaging surface Ni 1 side.

  In the present embodiment, the light that has passed through the two optical regions D1 and D2 enters the arrayed optical element K after passing through the lens L2. The array-like optical element K makes the light beam B1 that has passed through the optical region D1 incident on the plurality of pixels P1 and the plurality of pixels P2 in the image sensor N, and the light beam B2 that has passed through the optical region D2 enters the plurality of pixels P2 in the image sensor N. Let The image sensor N converts light incident on the pixels P1 and P2 into a pixel signal corresponding to the intensity of the incident light by photoelectric conversion. The pixel signal refers to a signal indicating luminance information generated by photoelectric conversion in each of the pixels P1 and P2. The signal processing unit C1 receives a pixel signal from the image sensor N, and generates and outputs image information of an image by light oscillating in the direction of the first polarization axis from the luminance information of the pixel group of the pixel P1. In addition, image information of an image using light that vibrates in the direction of the first polarization axis and light that vibrates in an arbitrary direction is generated and output from the luminance information of the pixel group of the pixel P2. The signal processing unit C1 may be configured by an electronic circuit or the like, or may be configured by an arithmetic device, a memory, and software.

  The imaging element N includes an imaging surface Ni and a plurality of pixels P. As shown in FIG. 4B, the plurality of pixels P are two-dimensionally arranged in the x direction and the y direction. When the arrangement in the y direction and the x direction is referred to as a row and a column, respectively, the plurality of pixels P are arranged, for example, in m rows and 1 columns (l and m are integers of 2 or more) on the imaging surface Ni. . That is, a group of pixels in which 1 to 1 pixels are arranged in the x direction is arranged in m rows from the 1st to mth rows in the y direction.

  Of the pixel group of m rows, each position of the center C′j in the x direction of the l pixels arranged in the j row (1 ≦ j <m) is the l pixels arranged in the j + 1 row. Is substantially the same as each position of the center C′j + 1 in the x direction.

  Similarly, it can be considered that a pixel group of one column of a plurality of pixels in which a plurality of pixels are arranged in the y direction is arranged in l columns from 1 to l in the x direction. In this case, the center position in the y direction of the m pixels arranged in the u-th column (1 ≦ u <l) in the l-th pixel group is the m-th pixel arranged in the u + 1-th column. It is substantially the same as each center position in the y direction.

  The plurality of pixels P are each arranged in the x direction, and are divided into a plurality of pixels P1 and a plurality of pixels P2 constituting a row. Each of the plurality of pixels P1 and the plurality of pixels P2 is arranged in one row in the x direction as described above. In the y direction, the rows of the pixels P1 and the rows of the pixels P2 are alternately arranged.

  Each cylindrical lens M1 of the arrayed optical element K is viewed from a direction parallel to the optical axis V of the lens optical system L, and one row composed of a plurality of pixels P1 on the imaging surface Ni and a plurality of pixels P2 adjacent thereto. It is located so as to cover one line consisting of. That is, the position of the boundary of the cylindrical lens M1 of the arrayed optical element K is the position of the boundary of the pixel group of one row composed of a plurality of pixels P1 and one row composed of a plurality of pixels P2 adjacent thereto. When viewed from a direction parallel to the optical axis V of the system L, they coincide. On the imaging surface Ni, a microlens Ms is provided so as to cover the surfaces of the pixels P1 and P2.

  In the present embodiment, the plurality of pixels P1 and the plurality of pixels P2 all have the same shape on the imaging surface Ni. For example, the plurality of pixels P1 and the plurality of pixels P2 have the same rectangular shape and have the same area.

  In addition, each of the pixels P1 and P2 is located below the microlens Ms, and the photoelectric conversion unit EX provided inside from the imaging surface Ni and the color filters R (red) and G (G) provided on the photoelectric conversion unit. Green) and B (blue). In the arrangement shown in FIG. 4B, R (red), G (green), and B (blue) color filters of the pixels P1 and P2 are arranged and formed. Specifically, pixels having G (green) and R (red) filters are repeatedly arranged in the x direction in a unit region corresponding to one cylindrical lens M1 of the arrayed optical element K on the imaging surface. In a unit region adjacent to the unit region in the y direction, pixels having B (blue) and G (green) filters are repeatedly arranged in the x direction.

  Accordingly, if only the pixel group row of the pixel P1 is viewed, the pixel group row of the pixel group having the B (blue) and G (green) filters and the pixel group having the G (green) and R (red) filters are included. Rows of pixel groups of pixels having filters are alternately arranged. Similarly, if only the pixel group row of the pixel P2 is viewed, the pixel group row of pixels having B (blue) and G (green) filters and pixels having G (green) and R (red) filters. The rows of the pixel groups of the pixels having the filter are alternately arranged. Therefore, regardless of whether the image is composed only of the pixel group row of the pixel P1 or only the pixel group row of the pixel P2, each image is obtained from the R, G, and B pixels. Since a pixel signal based on the obtained luminance value is included, a color image can be generated by interpolation processing.

  In the arrayed optical element K, a light beam (light beam B1 indicated by a solid line in FIG. 1) that has passed through the optical region D1 (shown in FIGS. 1 and 2) on the optical element L1 is converted into a pixel P1 and a pixel on the imaging surface Ni. The light beam that has reached P2 and has passed through the optical region D2 (light beam B2 indicated by a broken line in FIG. 1) is designed to reach the pixel P2 on the imaging surface Ni. Specifically, the above configuration is realized by appropriately setting parameters such as the refractive index of the arrayed optical element K, the distance from the imaging surface Ni, and the radius of curvature of the surface of the cylindrical lens M1.

  The diaphragm S is an area through which light beams of all angles of view pass. Therefore, by inserting a surface having an optical characteristic for controlling the polarization characteristic in the vicinity of the stop S, the polarization characteristics of the light beams of all angles of view can be similarly controlled. That is, in the present embodiment, the optical element L1 may be provided in the vicinity of the stop S. By disposing the optical element L1 in the first and second optical regions D1 and D2 located in the vicinity of the stop, polarization characteristics corresponding to the number of divisions of the regions can be given to the light beam.

  In FIG. 1, the light passing through the diaphragm S is provided at a position where it directly enters the optical element L1 (without passing through another optical member). The optical element L1 may be provided closer to the subject than the stop S. In this case, the light that has passed through the optical element L1 may directly enter the diaphragm S (without passing through another optical member).

  With the above configuration, using the luminance information of the pixel groups of the pixels P1 and P2, the first color image information having polarization information that vibrates in the direction of the first polarization axis and the direction of the first polarization axis. The second color image information having the information on the oscillating polarization and the non-polarization information oscillating in an arbitrary direction can be acquired simultaneously. That is, in this configuration, a total of six channels of image information can be simultaneously acquired by combining the first and second optical regions D1 and D2 with the R, G, and B pixels.

  In addition, the crosstalk component of the second color image information can be reduced for the first color image information as compared with the case where the optical region D1 and the optical region D2 are divided evenly across the optical axis. . When the optical region D1 and the optical region D2 are equally divided across the optical axis, the light passing near the boundary between the first and second optical regions D1 and D2 reaches both the pixels P1 and P2. Therefore, the first color image information includes a part of the second color image information, and the second color image information includes a part of the first color image information. Crosstalk information is included between them. On the other hand, as in this embodiment, the optical region D1 includes the optical axis and the optical region D2 does not include the optical axis, so that the second color image information includes the first color image information. A part of the first color image information is included, but the second color image information can be hardly included in the first color image information. The configuration as in the present embodiment is useful for applications in which crosstalk of specific image information is desired to be reduced, for example, living body observation, when acquiring a plurality of pieces of image information.

  In the present embodiment, the polarization filter that transmits light that vibrates in the direction of the first polarization axis (transmission axis) and all the polarization axes (transmission axes) in the optical regions D1 and D2 on the optical element L1, respectively. Is composed of a flat glass that transmits light oscillating in the direction of, but the optical regions D1 and D2 are each a polarizing filter that transmits light oscillating in the direction of the first polarization axis (transmission axis) and the first polarization axis. You may comprise by the polarizing filter which permeate | transmits the light which vibrates in the direction of the 2nd polarization axis (transmission axis) orthogonal to. With such a configuration, light that vibrates in the direction of the first polarization axis that has passed through the optical region D1 vibrates in the direction of the second polarization axis that has passed through the optical region D2 to the plurality of pixels P1 and the plurality of pixels P2. The incident light is incident on the plurality of pixels P2. Here, by adjusting the areas of the optical region D1 and the optical region D2 so that the light beam incident on the pixel P2 from the optical region D1 and the light beam incident on the pixel P2 from the optical region D2 are substantially equal, The obtained image information is substantially equal to non-polarized image information. Therefore, the first color image information that vibrates in the direction of the first polarization axis and the non-polarized second color image information can be acquired simultaneously.

  Further, a configuration may be adopted in which filters having different spectral transmittance characteristics are arranged in the optical regions D1 and D2 on the optical element L1 so that the imaging element is monochrome. For example, the optical region D1 is configured by a spectral filter that mainly transmits light in the first wavelength band, and the optical region D2 is configured by a spectral filter that transmits light in the second wavelength band. Here, if the first wavelength band is narrower than the second wavelength band and the two images are combined, a narrow-band spectral image can be generated.

  In the present embodiment, the lens optical system L is image-side telecentric, but the imaging apparatus of the present embodiment may use an image-side non-telecentric lens optical system L. In this case, the principal ray is obliquely incident on the cylindrical lens M1 arranged outward from the optical axis V in the direction of the arrow H of the arrayed optical element K, and light is incident on the pixel P1 or the pixel P2 adjacent to the corresponding pixel P1, P2. Leaks. For this reason, when using the image side non-telecentric lens optical system L, it is preferable to increase the offset amount of the cylindrical lens M1 of the arrayed optical element K from the center where the optical axis V is located to the outside. The offset amount is determined according to the incident angle of the principal ray on the cylindrical lens M1. What is necessary is just to set according to the incident angle of a light beam. Thereby, crosstalk in which light enters the adjacent pixels can be suppressed. At this time, the cylindrical lens M1 of the arrayed optical element K is disposed at a position shifted from the row of the corresponding pixel toward the center side toward the outside away from the center. However, at least the cylindrical lens M1 on the optical axis V is positioned so as to cover one row of the corresponding pixels P1 and one row of the pixels P2 when viewed from a direction parallel to the optical axis of the lens optical system L.

(Embodiment 2)
This embodiment differs from Embodiment 1 in that the boundary position of each cylindrical lens M1 of the arrayed optical element K is offset with respect to the boundary position between the pixels P1 and P2. Here, detailed description of the same contents as in the first embodiment is omitted in this embodiment.

  5A is an enlarged view of the arrayed optical element K and the image sensor N shown in FIG. 1, and FIG. 5B is a diagram illustrating the relationship between the arrayed optical element K and the pixels on the image sensor N. It is a figure which shows a positional relationship. As shown in FIGS. 5A and 5B, when viewed from a direction parallel to the optical axis V of the lens optical system L, the boundary position Mb between the cylindrical lenses (optical elements) M1 of the arrayed optical element K is: It is offset by Δs with respect to the boundary position Nb between the pixels P1 and P2 of the imaging surface Ni on the imaging element N. The direction of the offset is the horizontal direction when the imaging device is used on a plane perpendicular to the optical axis V.

  The boundary position Mb between the optical elements M1 is a portion where the curved surfaces constituting each of the two adjacent optical elements M1 are connected. The boundary position Mb is, for example, a straight line extending in the horizontal direction (row direction). The boundary position Nb between the pixel group Pg1 and the pixel group Pg2 on the imaging surface Ni is a position equidistant from the pixel P1 in the pixel group Pg1 and the pixel P2 in the pixel group Pg2. The boundary position Nb is, for example, a straight line extending in the horizontal direction (row direction). When the micro lens array Ms is provided on the surface of the imaging surface Ni, the boundary position Nb may coincide with the boundary position Mc in the vertical direction (column direction) of each lens in the micro lens array Ms.

  Although not shown, the boundary position of each optical element M1 of the arrayed optical element K from the center of the imaging surface of the lens optical system L (optical axis and its vicinity) to the periphery of the imaging surface (outside of the optical axis and its vicinity). Mb is offset (shifted) in the vertical direction (column direction) with respect to the boundary position Nb between the pixel groups Pg. Here, the offset refers to the boundary position Mb of each optical element M1 of the arrayed optical element K in one direction with respect to the boundary position Nb between the pixel groups Pg when viewed from a direction parallel to the optical axis of the lens optical system L. It means that it is shifted. When the lens optical system L is an image side telecentric optical system, the offset amount at the center of the imaging surface and the offset amount at the periphery of the imaging surface are the same. That is, on the entire imaging surface, the boundary position Mb of each optical element M1 is offset in the vertical direction (column direction) with respect to the boundary position Nb between the corresponding pixel groups Pg, and the offset amount is from the optical axis. It is equal regardless of distance. Here, by setting the offset amount Δs to a predetermined value, most of the light that has passed through the optical region D1 can be incident on the pixel P1, and most of the light that has passed through the optical region D2 can be incident on the pixel P2. it can. That is, almost all of the light beam B1 transmitted through the optical region D1 having a larger area than the optical region D2 is incident on the plurality of pixels P1, and almost all of the light beam B2 transmitted through the optical region D2 is incident on the plurality of pixels P2. be able to. When the lens optical system L is an image-side non-telecentric optical system, each optical element of the arrayed optical element K is gradually changed from the center of the imaging surface to the periphery of the imaging surface and gradually changing according to the light incident angle. The pixels P1 and P2 on the imaging surface Ni of the element M1 or the imaging element N may be arranged.

  With the above configuration, using the luminance information of the pixel groups of the pixels P1 and P2, the first color image information having polarization information that vibrates in the direction of the first polarization axis and the non-polarized light that vibrates in an arbitrary direction The second color image information having the above information can be acquired simultaneously. That is, in this configuration, a total of six channels of image information can be simultaneously acquired by combining the information of the light transmitted through the optical regions D1 and D2 and the RGB pixels.

  In addition, when acquiring polarized image information and non-polarized image information, the intensity of light transmitted through the polarizing filter is reduced to approximately half. For this reason, by making the area of the optical region D1 larger than that of the optical region D2 and increasing the number of light rays incident on the pixel P2 compared to the pixel P1, it becomes possible to compensate for the decrease in light intensity with the amount of light rays. . Therefore, according to the present embodiment, the difference in light amount between the first color image information (polarized image information) and the second color image information (non-polarized image information) can be reduced. That is, according to the present embodiment, the dynamic ranges are ensured in a balanced manner in both the first color image information and the second color image information by making the areas of the optical regions D1 and D2 different by an appropriate ratio. be able to.

  In this embodiment, the color filter on the image sensor is configured with R (red), G (green), and B (blue), but other color filter configurations may be used. For example, as shown in FIGS. 6A and 6B, the color filter on the image sensor may be R (red), G (green), B (blue), and X (color in an arbitrary band). For example, in the case of FIG. 6A, the color of an arbitrary band is a band of white (entire visible light range), a complementary color system band such as cyan, or a non-visible light band such as near infrared or near ultraviolet. is there. With such a configuration, one type of spectral information can be added when two images are acquired simultaneously. In the case of FIG. 6B, the color X in an arbitrary band may be a non-visible light band such as near infrared or near ultraviolet, or a predetermined narrow band. With such a configuration, since the pixel P1 is limited to image information of only a predetermined band, the resolution of the image information corresponding to the information in the optical region D1 can be improved. For example, a polarizing filter that transmits light that vibrates in the direction of the first polarization axis is disposed in the optical region D1, and a flat glass that transmits light that vibrates in the direction of all the polarization axes (transmission axes) is disposed in the optical region D2. When the color filter array is the array shown in FIG. 6B and the color filter X is near infrared or near ultraviolet, near-infrared polarization or near-ultraviolet polarization using the luminance information of the pixel group of the pixel P1. A high-resolution polarized image can be generated, and a color image can be generated using luminance information of the P2 pixel group. Further, a spectral filter that mainly transmits near-infrared light or near-ultraviolet light is disposed in the optical region D1, a flat glass that transmits the visible light band is disposed in the optical region D2, and the color filter array is shown in FIG. In the case where the color filter X is white, the near-infrared light having high-resolution and high-sensitivity information having near-infrared light or near-ultraviolet light information using the luminance information of the pixel group of the pixel P1. Alternatively, image information having near-ultraviolet light information can be generated, and a color image can be generated using luminance information of the pixel group of the pixel P2. Further, in such a configuration, an imaging system including illumination of near infrared light or near ultraviolet light may be configured.

  As in the first embodiment, the lens optical system L of the image pickup apparatus according to the present embodiment is an image side telecentric, but the image pickup apparatus may use an image side non-telecentric lens optical system L. In this case, for the same reason as in the first embodiment, when the image side non-telecentric lens optical system L is used, the offset amount of the cylindrical lens M1 of the arrayed optical element K is set according to the distance from the optical axis V. Is preferably set. At this time, the cylindrical lens M1 of the arrayed optical element K is arranged at a position shifted toward the center side from the row of the corresponding pixel toward the outer side away from the center in the + y direction, and the shift amount increases as it moves away from the center in the −y direction. As the distance further increases, the shift amount gradually increases in the opposite direction, and is arranged at a position shifted from the pixel row to the center side. However, unlike Embodiment 1, the boundary of the cylindrical lens M1 on the optical axis of the arrayed optical element K is adjacent to the row of pixels P1 when viewed from the direction parallel to the optical axis of the lens optical system L. The pixel P2 is offset in a predetermined direction with respect to the boundary with the row of the pixel P2.

(Embodiment 3)
The third embodiment is different from the first embodiment in that the area division of the optical element L1 in FIG. 1 is four and the array-like optical element K ′ is replaced with a microlens from a lenticular lens. . Here, a detailed description of the same contents as in the first embodiment is omitted.

  FIG. 7 is a schematic perspective view of the arrayed optical element K ′. The arrayed optical element K ′ is a microlens array having the microlens M2 as an optical element. The microlenses M2 are arranged in two dimensions in the x direction and the y direction. The cross section of each microlens M2 (each cross section perpendicular to the x direction and the y direction) has a curved surface shape and protrudes toward the image sensor N side. Each of the microlenses M2 is a unit of a total of 16 units arranged in the x direction and 4 in the y direction among the plurality of pixels arranged in the x direction and the y direction on the imaging surface Ni of the color imaging element N. Arranged corresponding to the pixels in the region.

  FIG. 8A is a front view of the optical element L1 as seen from the subject side. The optical element L1 includes optical surface regions D1, D2, D3, and D4. At least two of the optical surface regions D1, D2, D3, and D4 are non-uniformly arranged with respect to the optical axis V. In the present embodiment, the optical surface regions D1 and D3 are larger than the fan shape divided by two orthogonal lines passing through the optical axis V in a cross section perpendicular to the optical axis of the optical path defined by the stop S. On the other hand, the optical surface regions D2 and D4 are larger than this sector shape. For this reason, the optical regions D1 and D3 are non-uniformly arranged with respect to the optical regions D2 and D4. The area of the optical region D1 and the area of the optical region D3 are equal, and the area of the optical region D2 and the area of the optical region D4 are equal.

  In at least two of the optical regions D1, D2, D3, and D4, at least one of the spectral transmittance characteristic and the transmission polarization characteristic is different from each other. In the present embodiment, a polarizing filter that transmits light that vibrates in the direction of the first polarization axis (transmission axis) is disposed in the optical region D1, and the optical region D2 and the fourth optical region D4 include Flat glass that transmits light oscillating in the direction of all the polarization axes (transmission axes) is arranged, and the third optical region D3 has a second transmission axis (transmission axis) perpendicular to the first polarization axis. A polarizing filter that transmits light oscillating in the direction is disposed.

  FIG. 7B is a diagram showing a positional relationship between the microlens M2 that is an optical element of the arrayed optical element and the pixels on the image sensor N, as viewed from a direction parallel to the optical axis V of the lens optical system L. is there. The arrayed optical element includes a plurality of pixels P1, a plurality of pixels P2, a plurality of pixels P3, and a plurality of pixels P4 arranged in two dimensions in the x and y directions. Each pixel P1, P2, P3, and P4 is located adjacent to the two-dimensional arrangement direction of the x direction and the y direction, and constitutes a pixel group of 2 rows and 2 columns. The pixel group of 2 rows and 2 columns is further two-dimensionally arranged in the x direction and the y direction.

As shown in FIG. 7B, each microlens M2 that is an optical element of the arrayed optical element K ′ has two rows and two columns corresponding to each other when viewed from a direction parallel to the optical axis V of the lens optical system K ′. It is located so as to cover the pixel group. That is, the boundary of the microlens M2 in the arrayed optical element K ′ coincides with the position of the boundary of a plurality of 2 × 2 pixel groups in the image sensor N.
As shown in FIG. 7C, R, G, and B color filters may or may not be provided for each pixel. Hereinafter, the third embodiment will be described on the assumption of the configuration of FIG.

  In the arrayed optical element K, the light beam that has passed through the optical region D1 on the optical element L1 reaches the pixels P1, P2, and P4 on the imaging surface Ni, and the light beam that has passed through the optical region D2 is on the imaging surface Ni. The light beam that has reached the pixel P2 and passed through the third optical region D3 has reached the pixels P3, P2, and P4 on the image pickup surface Ni, and the light beam that has passed through the fourth optical region D4 is on the image pickup surface Ni. Designed to reach pixel P4. Specifically, the above configuration is realized by appropriately setting parameters such as the refractive index of the arrayed optical element K, the distance from the imaging surface Ni, and the radius of curvature of the microlens M2 surface.

  Accordingly, since light oscillating mainly in the direction of the first polarization axis is incident on the pixel group of the pixel P1, first color image information having information on polarization oscillating in the direction of the first polarization axis is acquired. can do. In addition, light that vibrates in the direction of the first polarization axis, light that vibrates in the direction of the second polarization axis, and light that vibrates in all directions of the polarization axes are incident on the pixel group of the pixel P2. Second color image information having the following information can be acquired. In addition, since light oscillating mainly in the direction of the second polarization axis is incident on the pixel group of the pixel P3, third color image information having information on polarization oscillating in the direction of the second polarization axis is acquired. can do. In addition, light that vibrates in the direction of the first polarization axis, light that vibrates in the direction of the second polarization axis, and light that vibrates in all directions of the polarization axes are incident on the pixel group of the pixel P4. 4th color image information which has the following information can be acquired. Since the second color image information and the fourth color image information are substantially equal, they may be averaged.

  With the above configuration, using the luminance information of the pixel groups of the pixels P1, P2, P3, and P4, the first color image information having polarization information that vibrates in the direction of the first polarization axis, and the non-polarized light The second color image information having information and the third color image information having information of polarized light oscillating in the direction of the second polarization axis can be simultaneously acquired. That is, in this configuration, a total of nine channels of image information can be simultaneously acquired by combining light information transmitted through the optical regions D1, D2, D3, and D4 and RGB pixels.

  In addition, compared with the case where the optical regions D1, D2, D3, and D4 are divided equally in the x and y directions across the optical axis, the first color image and the third color image are respectively The crosstalk component of the color image and the fourth color image can be reduced. When the optical regions D1, D2, D3, and D4 are equally divided vertically and horizontally with the optical axis in between, the light transmitted in the vicinity of each region boundary can be a crosstalk component. For example, the most light that has passed through the optical region D1 enters the pixel P1, but a small amount of light that passes through the vicinity of the boundary with the other optical regions also enters the pixel P1, so that the light passes through the optical regions D2, D3, and D4. Light is also incident slightly. In particular, since the optical regions D2 and D4 are separated from the optical region D1 by a boundary line, the amount of crosstalk light is relatively larger than the light transmitted through the optical region D3 that is in contact with the optical region D1 at a point. . The same applies when focusing on the pixels P2, P3, and P4.

  In contrast, in the present embodiment, by setting the optical region as shown in FIG. 8A, most of the light transmitted through the optical regions D1 and D3 is incident on the pixels P1 and P3, respectively, and the pixel P2 And the pixel P4 are slightly incident as crosstalk light, but there is no problem because the pixels P2 and P4 are pixels for acquiring non-polarized information. Further, most of the light transmitted through the optical regions D2 and D4 enters the pixels P2 and P4, respectively, and hardly enters the pixels P1 and P3. That is, the crosstalk component of the non-polarized image (second color image and fourth color image) can be hardly included in the polarized image (first color image and third color image). . The configuration as in the present embodiment includes first color image information having polarization information oscillating in the direction of the first polarization axis, second color image information having non-polarization information, and second color information. When obtaining third color image information having polarization information oscillating in the direction of the polarization axis at the same time, the polarization information is used to reduce crosstalk between the images (first color image and second color image), for example, Useful for ecological observation.

(Embodiment 4)
The present embodiment is different from the third embodiment in that the boundary position of each microlens M2 of the arrayed optical element K is offset with respect to the boundary position between the pixels P1, P2, P3, and P4. . Here, detailed description of the same contents as in the third embodiment is omitted in this embodiment.

  FIG. 9A is a front view of the optical element L1 as viewed from the subject side. The optical element L1 includes optical surface regions D1, D2, D3, and D4. The boundaries of the optical surface regions D1, D2, D3, and D4 form two orthogonal straight lines that do not pass through the optical axis V. For this reason, at least two of the optical surface regions D1, D2, D3, and D4 are non-uniformly arranged with respect to the optical axis V.

  It is formed by being divided into four parts in the vertical and horizontal directions within a plane perpendicular to the optical axis V. A polarizing filter that transmits light that vibrates in the direction of the first polarization axis (transmission axis) is disposed in the optical region D1, and the optical region D2 vibrates in a direction of 45 ° with respect to the first polarization axis. A polarizing filter that transmits light that transmits light is disposed. In the optical region D3, a polarizing filter that transmits light that vibrates in a direction of 90 ° with respect to the first polarization axis is disposed. In the optical region D3, the first filter is disposed. A polarizing filter that transmits light oscillating in a direction of 135 ° with respect to the polarization axis is disposed. As shown in FIG. 9A, the area of each optical region is the largest in the optical region D1, then the optical regions D2 and D4, and the smallest optical region is the optical region D3.

  FIG. 9B is a diagram showing a positional relationship between the microlens M2 that is an optical element of the array-like optical element and the pixels on the imaging element N. The array optical element is arranged so that one of the microlenses M2 corresponds to a pixel group of two rows and two columns of pixels P1, P2, P3, and P4 on the imaging surface Ni. Are offset by a predetermined amount in the x direction and the y direction. For example, as shown in FIG. 9B, ΔSx is in the x direction, and is offset by ΔSy in the y direction. As shown in FIG. 9C, each pixel may or may not be provided with R, G, and B color filters. Hereinafter, the third embodiment will be described on the assumption of the configuration of FIG.

  The arrayed optical element K is designed so that the light beams that have passed through the optical regions D1, D2, D3, and D4 on the optical element L1 reach the pixels P1, P2, P3, and P4 on the imaging surface Ni, respectively. . Specifically, the above configuration is realized by appropriately setting parameters such as the refractive index of the arrayed optical element K, the distance from the imaging surface Ni, the radius of curvature of the microlens M2 surface, and the offset amount of the microlens M2. To do. Of the optical regions D1, D2, D3, and D4, since the area of the optical region D1 is the largest, the amount of light incident on the pixel P1 is the largest. Further, since the area of the optical region D3 is the smallest, the amount of light incident on the pixel P3 is the smallest.

  With the above configuration, the first color image information having the polarization information oscillating in the direction of the first polarization axis using the luminance information of the pixel groups of the pixels P1, P2, P3, and P4, and the first Second color image information having information on polarized light oscillating in the direction of 45 ° with respect to the polarization axis, and third color image having information on polarized light oscillating in the direction of 90 ° with respect to the first polarization axis The fourth color image information having the information and polarization information oscillating in the direction of 135 ° with respect to the first polarization axis can be acquired simultaneously. That is, in this configuration, a total of 12 channels of image information can be simultaneously acquired by combining the light information transmitted through the optical regions D1, D2, D3, and D4 and the RGB pixels.

  The present embodiment is preferably applied to, for example, an imaging device for a living body that uses polarized illumination that emits polarized light that vibrates in a direction of 90 ° with respect to the first polarization axis. When illuminating a living body with light having a predetermined polarization component, the reflected light on the surface of the living body becomes a specular reflection light in which the polarization component is maintained, and the reflected light in the deep part of the living body becomes a scattered reflected light with a disturbed polarization component. . Therefore, if the polarization axis on the illumination side and the polarization axis on the imaging device side are made parallel, information on the living body surface can be acquired, and if the polarization axis on the illumination side and the polarization axis on the imaging device side are orthogonal, information on the deep part of the living body is acquired. it can. Further, since the specular reflection light on the living body surface is less attenuated than the reflection light in the deep part of the living body, a relatively bright image is obtained.

  In the present embodiment, the information on the deep part of the living body is acquired by the light transmitted through the optical region D1 by using the polarization illumination that emits the polarized light that vibrates in the direction of 90 ° with respect to the first polarization axis. Can do. In this case, although the intensity of the reflected light at the deep part of the living body is small, the area of the optical region D1 is the largest. Therefore, the decrease in intensity can be compensated for by increasing the amount of light incident on the pixel P1.

In addition, information on the surface of the living body can be acquired by the light transmitted through the optical region D3. Since the intensity of the specular reflection light on the surface of the living body is large, the amount of light incident on the pixel P3 is reduced by making the area of the optical region D3 the smallest, compared to the amount of light incident on the other pixels,
It can suppress that light quantity becomes remarkably large. Information between the deep part of the living body and the surface of the living body can be obtained by the light transmitted through the intermediate optical areas D2 and D4. With the above configuration, the dynamic range of the first, second, third, and fourth color image information can be ensured with a good balance.

(Embodiment 5)
The fifth embodiment is different from the first to fourth embodiments in that an arrayed optical element is formed on the imaging surface of the imaging element N. Here, detailed description of the same contents as in the first to fourth embodiments will be omitted in the present embodiment.

  FIGS. 10A and 10B are enlarged views of the arrayed optical element K and the imaging element N, and only the light rays that have passed through one optical region are illustrated. In the present embodiment, the optical element Md1 (cylindrical lens or microlens) is formed on the imaging surface Ni of the color imaging element N. Pixels P are arranged in a matrix on the imaging surface Ni, as in the first embodiment. One optical element Md1 corresponds to the plurality of pixel groups. Also in the present embodiment, similarly to the first embodiment, light beams that have passed through different optical regions can be guided to different pixels. FIG. 10B is a diagram showing a modification of the present embodiment. In the configuration shown in FIG. 10B, the microlens Ms is formed so as to cover the pixel P, and the optical element Md1 is laminated on the surface of the microlens Ms via the low refractive index layer W. In the configuration shown in FIG. 10B, the light collection efficiency can be increased as compared with the configuration in FIG.

  If the arrayed optical element K is separated from the color image sensor N as in the first to fourth embodiments, it is difficult to align the arrayed optical element K and the image sensor N. However, as in the present embodiment. In addition, since the optical element Md1 is formed on the image pickup element N, alignment can be performed by a wafer process, so that alignment can be facilitated and alignment accuracy can be increased.

  In the fifth embodiment, the microlens Ms provided on each pixel of the image sensor may be provided with a microlens having another shape. For example, you may use the refractive index distribution element which condenses light by distribution of the material from which refractive index differs as disclosed by Unexamined-Japanese-Patent No. 2008-10773. FIG. 11A is a cross-sectional view showing an example of the gradient index element Ms ′, and FIG. 11B is a front view of the gradient index element. In FIGS. 11A and 11B, the optical member portion indicated by oblique lines and the surrounding portion are composed of materials and media having different refractive indexes. As shown in FIG. 11B, the gradient index element Ms ′ has, for example, a plurality of cylindrical optical members having a ring shape on a plane parallel to the plane on which the pixels are formed and extending in a direction perpendicular to the plane. Are arranged by being arranged concentrically. The refractive index distribution of the refractive index distribution element Ms ′ can be adjusted by the refractive index difference between the optical member and the surrounding portion, the size of the cylinder, the interval between the concentrically arranged cylinders, and the like. The shape of the optical member is not limited to a cylinder, and may be non-rotational symmetric with respect to the optical axis. Further, in FIGS. 11A and 11B, a two-level binary optical element is used, but a multi-level optical element having three or more levels may be used.

  The gradient index element Ms ′ having such a structure can be manufactured by using, for example, a semiconductor photolithography technique. For example, since a conventional microlens having a lens surface is manufactured by thermally deforming a resin, it is difficult to make the curved surfaces of the lens surfaces different between a plurality of microlenses provided in a plurality of pixel shapes of an image sensor. there were. On the other hand, when the refractive index distribution element Ms ′ is used, the optical characteristics can be changed by changing the dimensions of the above-described optical member among a plurality of pixels of the imaging element. Therefore, even when a light ray is incident on the pixel of the image sensor N from an oblique direction by the lens optical system L and the arrayed optical element K, the light can be efficiently collected on the pixel.

(Embodiment 6)
The present embodiment is a distance measuring device using a plurality of imaging devices shown in the first embodiment. FIG. 12 is a schematic diagram of a distance measuring device using two imaging devices. In FIG. 12, the same components as those in the imaging apparatus shown in FIG. In the present embodiment, in each imaging device, the arrangement direction E of the plurality of cylindrical lenses constituting the arrayed optical element K is orthogonal to the baseline direction B of the distance measuring device. In the distance measuring apparatus, the parallax is extracted by pattern matching, and the distance to the subject is calculated using the extracted parallax by the principle of triangulation. Therefore, when the arrangement direction E of the lenticular optical elements is made orthogonal to the base line direction B of the distance measuring device by making the arrangement direction E of the lenticular optical elements orthogonal to the base line direction B of the distance measuring device. In comparison, the resolution of the parallax extraction can be increased.

  According to the distance measuring apparatus of the present embodiment, since crosstalk in specific image information is reduced, distance measurement can be performed using an image with excellent polarization characteristics or a spectral image in a specific band. This makes it possible to measure the distance even in a situation where it is difficult to acquire a correct image in normal shooting. Note that this embodiment may be combined with any of Embodiments 2 to 5 in addition to Embodiment 1.

  The imaging apparatus according to the present invention is useful as an imaging apparatus for skin diagnosis cameras, endoscope observation cameras, living body observation cameras such as capsule endoscopes, in-vehicle cameras, surveillance cameras, digital still cameras, and digital video cameras. . Further, it can be applied to an imaging system such as a microscope and an electronic mirror.

A Imaging device L Lens optical system L1 Optical element L2 Lens D1, D2, D3, D4 Optical region S Aperture K Array-like optical element N Imaging element Ni Imaging surface M1, Md1 Optical element Ms Microlenses P1 to P2 on the pixel Imaging element Upper pixel C1 signal processing unit

Claims (17)

A lens, an aperture, and a lens optical system having first and second optical regions in which at least one of spectral transmittance characteristics and transmission polarization characteristics is different from each other;
An image sensor on which light having passed through the lens optical system is incident;
An arrayed optical element including a plurality of optical elements disposed between the lens optical system and the imaging element and disposed in a plane perpendicular to the optical axis of the lens optical system;
The imaging device includes a plurality of first rows each composed of a plurality of first pixels and a plurality of second rows composed of a plurality of second pixels, which are alternately arranged.
The first and second optical regions of the lens optical system are non-uniformly arranged with respect to the optical axis;
The optical elements on at least the optical axis of the arrayed optical element cover the pixels in the corresponding first row and the second row adjacent thereto as viewed from the direction parallel to the optical axis of the lens optical system. An imaging device located in   The array-like optical element causes light beams that have passed through the first optical region to enter the plurality of first pixels and the plurality of second pixels, and the light beams that have passed through the second optical region are the first light beam. The imaging device according to claim 1, wherein the imaging device is made incident on two pixels. A lens, a stop, and a lens optical system having first and second optical regions in which at least one of spectral transmittance characteristics and transmission polarization characteristics is different from each other;
An image sensor on which light having passed through the lens optical system is incident;
An array-like optical element comprising a plurality of optical elements disposed between the lens optical system and the imaging element and disposed in a plane perpendicular to the optical axis of the lens optical system;
The imaging device includes a plurality of first rows each composed of a plurality of first pixels and a plurality of second rows composed of a plurality of second pixels, which are alternately arranged.
The first and second optical regions of the lens optical system are non-uniformly arranged with respect to the optical axis;
A boundary between a plurality of optical elements including at least an optical element on the optical axis of the arrayed optical element is the first row and a second adjacent to the first row when viewed from a direction parallel to the optical axis of the lens optical system. An imaging device that is offset in a predetermined direction with respect to the boundary with the pixels in the row.   The array-shaped optical element causes light rays that have passed through the first optical region to enter the plurality of first pixels, and light rays that have passed through the second optical region to enter the second pixels. Item 4. The imaging device according to Item 3. The first optical region is constituted by a polarizing filter that mainly transmits light that vibrates in the direction of a predetermined polarization axis,
The imaging device according to claim 1, wherein the second optical region transmits non-polarized light. The first optical region is constituted by a polarization filter that mainly transmits light oscillating in the direction of the first polarization axis,
The second optical region is configured by a polarization filter that mainly transmits light that vibrates in a direction of a second polarization axis different from the first polarization axis.
The imaging device according to claim 1.   The imaging apparatus according to claim 1, wherein the arrayed optical element is a lenticular lens. A lens, an aperture, and a lens optical system having first, second, third and fourth optical regions;
An image sensor on which light having passed through the lens optical system is incident;
An array-like optical element comprising a plurality of optical elements disposed between the lens optical system and the imaging element and disposed in a plane perpendicular to the optical axis of the lens optical system;
In at least two of the first, second, third and fourth optical regions, at least one of the spectral transmittance characteristic and the transmission polarization characteristic is different from each other;
The image sensor includes a plurality of first pixels, a plurality of second pixels, a plurality of third pixels, and a plurality of fourth pixels, which are two-dimensionally arranged, and each of the first pixels, the second pixels The third pixel, the fourth pixel, and the fourth pixel are adjacent to each other in the two-dimensional two arrangement directions to constitute a pixel group,
At least two of the first, second, third and fourth optical regions of the lens optical system are non-uniformly arranged with respect to the optical axis;
Each optical element of the arrayed optical element is positioned so as to cover the corresponding pixel group when viewed from a direction parallel to the optical axis of the lens optical system.   The arrayed optical element causes the light beam that has passed through the first optical region to enter the plurality of first pixels, the plurality of second pixels, and the plurality of fourth pixels, and the second optical element. A light beam that has passed through a region is incident on the second pixel, and a light beam that has passed through the third optical region is incident on the plurality of second pixels, the plurality of third pixels, and the plurality of fourth pixels. The imaging apparatus according to claim 8, wherein a light beam that is incident and passes through the fourth optical region is incident on the fourth pixel. A lens, an aperture, and a lens optical system having first, second, third and fourth optical regions;
An image sensor on which light having passed through the lens optical system is incident;
An array-like optical element comprising a plurality of optical elements disposed between the lens optical system and the imaging element and disposed in a plane perpendicular to the optical axis of the lens optical system;
In at least two of the first, second, third and fourth optical regions, at least one of the spectral transmittance characteristic and the transmission polarization characteristic is different from each other;
The image sensor includes a plurality of first pixels, a plurality of second pixels, a plurality of third pixels, and a plurality of fourth pixels, which are two-dimensionally arranged, and each of the first pixels, the second pixels The third pixel, the fourth pixel, and the fourth pixel are located adjacent to each other in the two-dimensional two arrangement directions, and constitute a pixel group,
At least two of the first, second, third and fourth optical regions of the lens optical system are non-uniformly arranged with respect to the optical axis;
The boundaries of the plurality of optical elements of the arrayed optical element are offset in a predetermined direction with respect to the corresponding boundary positions of the plurality of pixel groups when viewed from a direction parallel to the optical axis of the lens optical system. , Imaging device.   The arrayed optical element causes light rays that have passed through the first optical region to enter the plurality of first pixels, light rays that have passed through the second optical region to enter the second pixels, and The imaging device according to claim 10, wherein a light beam that has passed through a third optical region is incident on the plurality of third pixels, and a light beam that has passed through the fourth optical region is incident on the fourth pixel.   The imaging device according to claim 8, wherein the arrayed optical element is a microlens array. The first optical region is constituted by a polarization filter that mainly transmits light oscillating in the direction of the first polarization axis,
The second optical region and the fourth optical region transmit unpolarized light;
The third optical region is constituted by a polarization filter that mainly transmits light that vibrates in the direction of the second polarization axis orthogonal to the first polarization axis.
The imaging device according to claim 8.   The imaging device according to claim 1, wherein the arrayed optical element is formed on the imaging element. A microlens provided between the arrayed optical element and the imaging element;
The arrayed optical element is formed on the imaging element through the microlens,
The imaging device according to claim 1. The microlens is a refractive index distribution element formed in a binary shape or a refractive index distribution element formed in a multi-level shape.
The imaging device according to claim 15.   A distance measuring device comprising a plurality of the imaging devices according to claim 1.

Images