WO2019026600A1

WO2019026600A1 - Camera module and image capture device

Info

Publication number: WO2019026600A1
Application number: PCT/JP2018/026658
Authority: WO
Inventors: 典宏田部; 宜邦野村; 龍平秦
Original assignee: ソニーセミコンダクタソリューションズ株式会社
Priority date: 2017-07-31
Filing date: 2018-07-17
Publication date: 2019-02-07
Also published as: JP2019029851A

Abstract

This technology relates to a camera module and an image capture device which make it possible to obtain more appropriate spectral information. This camera module is provided with: a pixel array unit having an imaging region in which pixels for capturing an image are provided, and a sensing region in which pixels different from at least the pixels in the imaging region and capable of acquiring spectral information are provided; an imaging optical system that guides light from outside to the imaging region; and a sensing optical system that guides the light from outside to the sensing region. This technology is applicable to an image capture device.

Description

Camera module and imaging device

The present technology relates to a camera module and an imaging device, and more particularly to a camera module and an imaging device capable of obtaining more appropriate spectral information.

Conventionally, pixels provided with color filters of R (red), G (green), and B (blue) are disposed at the central portion of the light receiving surface, and at least R, G, B at the peripheral portion of the light receiving surface. There has been proposed a camera module in which pixels provided with color filters of other colors different from each color are arranged (see, for example, Patent Document 1).

In such a camera module, RGB information, that is, color image information of a target subject is acquired by pixels of respective colors of R, G, and B at the central portion of the angle of view. Further, in the peripheral portion of the angle of view, that is, in the vicinity of the end of the angle of view, spectral information of the light source is acquired by pixels of other colors different from R, G and B. Therefore, not only target image information but also spectral information can be obtained using a single solid-state imaging device.

JP 2012-59865 A

However, with the above-mentioned technology, there were cases where it was not possible to obtain appropriate spectral information.

For example, in the above-described camera module, one optical system is used, and light from a subject is led to a pixel for acquiring image information or a pixel for acquiring spectral information.

Therefore, information of an object at the center of the angle of view of the camera module is obtained as image information, and information of an object at the peripheral portion of the angle of view is obtained as spectral information. Therefore, when the object of interest for spectral detection is at the center of the angle of view, it is not possible to obtain appropriate information as spectral information.

The present technology has been made in view of such a situation, and makes it possible to obtain more appropriate spectral information.

The camera module according to the first aspect of the present technology includes an imaging area provided with pixels for capturing an image, and a sensing area provided with pixels capable of acquiring spectral information different from at least pixels of the imaging area. And an imaging optical system for guiding light from the outside to the imaging area, and a sensing optical system for guiding light from the outside to the sensing area.

According to a first aspect of the present technology, there is provided an imaging area provided with a pixel for capturing an image, and a pixel having a sensing area provided with a pixel capable of acquiring spectral information different from at least the pixels of the imaging area. An array unit, an imaging optical system that guides light from the outside to the imaging area, and a sensing optical system that guides light from the outside to the sensing area are provided in the camera module.

The imaging device according to the second aspect of the present technology is an imaging device similar to the camera module according to the first aspect.

According to the first and second aspects of the present technology, more appropriate spectral information can be obtained.

In addition, the effect described here is not necessarily limited, and may be any effect described in the present disclosure.

It is a figure explaining this art. It is a figure which shows the structural example of a camera module. It is a figure which shows the structural example of an imaging part. It is a figure which shows the structural example of a sensing optical system. It is a figure which shows the structural example of a sensing optical system. It is a figure which shows the structural example of a sensing optical system. It is a figure which shows the structural example of a sensing optical system. It is a figure which shows the structural example of a sensing optical system. It is a figure which shows the structural example of a sensing optical system. It is a figure which shows the example of another arrangement | positioning of a sensing area | region. It is a figure which shows the example of another arrangement | positioning of a sensing area | region. It is a figure showing an example of composition of an imaging device. It is a figure which shows the usage example of a camera module.

Hereinafter, embodiments to which the present technology is applied will be described with reference to the drawings.

<About the outline of this technology>
The present technology arranges a pixel for obtaining target image information and a pixel for obtaining spectral information on a light receiving surface of an imaging unit, and an optical system for obtaining image information and the optical system By providing an optical system for obtaining different spectral information, appropriate spectral information can be obtained.

For example, the present technology can be applied to various electronic devices such as a camera module having an image sensor and an optical system, a digital still camera including such a camera module, a digital video camera, and a mobile phone.

Further, the information acquired together with the image information is not limited to the spectral information, and may be any information as long as it is information on the subject of the image information.

That is, the information on the subject in the image information may be, for example, distance information to the subject, parallax information or shape information on the subject, information on heat of the subject, information on HDR (High Dynamic Range), or the like.

In the following, the description will be continued with an example in which the present technology is applied to a camera module capable of acquiring image information and spectral information.

First, an overview of the present technology will be described.

A camera module to which the present technology is applied is configured, for example, as shown in FIG. FIG. 1 shows a cross section of the camera module 11 as viewed from a direction perpendicular to the optical axis direction of the optical system of the camera module 11.

The camera module 11 includes an imaging unit 21, an imaging optical system 22, a sensing optical system 23-1, and a sensing optical system 23-2.

The imaging unit 21 is formed of, for example, a solid-state imaging device such as a complementary metal oxide semiconductor (CMOS) image sensor, and the light receiving surface of the imaging unit 21 includes a plurality of pixels that receive light incident from an external object and photoelectrically convert it. It is done.

Here, in the imaging region R11 which is a region of the central portion of the light receiving surface of the imaging unit 21, image information of the subject, that is, pixels for capturing an image of the subject are provided. In particular, in this example, a region surrounded by the light shielding plate 24-1 and the light shielding plate 24-2 disposed substantially perpendicular to the light receiving surface of the imaging unit 21 is an imaging region R11.

Hereinafter, the pixels provided in the imaging region R11 are also referred to as imaging pixels, and an image signal of an image composed of pixel signals obtained by the imaging pixels, that is, an image of a subject is also referred to as a captured image.

On the other hand, in the region near the end of the light receiving surface of the imaging unit 21, that is, in the sensing region R12-1 and the sensing region R12-2 which are peripheral regions of the light receiving surface, pixels for obtaining spectral information of the object are provided. It is done.

In particular, in this example, a region surrounded by the light shielding plate 24-1 and the light shielding plate 24-3 disposed substantially perpendicular to the light receiving surface of the imaging unit 21 is a sensing region R12-1. Further, in the light receiving surface of the imaging unit 21, a region surrounded by the light shielding plate 24-2 and the light shielding plate 24-4 disposed substantially perpendicularly to the light receiving surface is a sensing region R12-2.

Hereinafter, when it is not necessary to distinguish the light shielding plates 24-1 to 24-4, the light shielding plates 24-1 to 24-4 may be simply referred to as the light shielding plate 24, and the sensing regions R12-1 and R12-2 need to be particularly distinguished from each other. If not, it is also simply referred to as sensing region R12.

Furthermore, hereinafter, the pixels provided in the sensing region R12 are also referred to as sensing pixels, and an image formed of pixel signals obtained by the sensing pixels is also referred to as a sensing image.

The pixels provided in the sensing area R12 include at least pixels in which spectral information different from the spectral information obtained by the pixels provided in the imaging area R11 is obtained.

For example, it is assumed that the captured image is a RGB color image. In this case, in the imaging region R11, a pixel provided with a color filter of R (red) (hereinafter also referred to as R pixel) and a pixel provided with a G (green) color filter (hereinafter referred to as G) Pixels (also referred to as pixels) and pixels provided with color filters of B (blue) (hereinafter also referred to as B pixels) are arranged as imaging pixels. For example, in the imaging region R11, R pixels, G pixels, and B pixels are arranged in a Bayer arrangement.

Spectral information on each of the R, G, and B color components can be obtained from the pixels provided in such an imaging region R11.

On the other hand, in the sensing area R12, pixels provided with color filters of other colors different from at least the colors R, G, and B are disposed as sensing pixels.

For example, other colors different from the colors R, G, and B are W (white), C (cyan), M (magenta), Y (yellow), and the like.

Hereinafter, in particular, a pixel provided with a W color filter is also referred to as a W pixel, a pixel provided with a C color filter is also referred to as a C pixel, and a pixel provided with an M color filter is also referred to as an M pixel. The pixel provided with the color filter of is also referred to as a Y pixel.

In addition, for example, pixels provided with IR (infrared) color filters in the sensing region R12 (hereinafter also referred to as IR pixels) and pixels provided with E (emerald) color filters (hereinafter referred to as E pixels) Naturally, it may be provided as a sensing pixel.

In the sensing region R12, a plurality of pixels of different colors are arranged in a predetermined pattern. For example, a predetermined arrangement pattern in which pixels of a plurality of different colors, that is, pixels provided with a plurality of different color filters are arranged adjacent to each other is referred to as an array unit.

The array unit includes the pixels of all the color components in the sensing area R12, and the array unit is the minimum unit of the repeating pattern consisting of the combination of the pixels of the plurality of color components, that is, the pixels are repeatedly arranged periodically. It is an area of a pixel array that is the smallest unit of the array pattern of pixels. For example, assuming that C pixel, M pixel, and Y pixel are provided in sensing region R12, at least one pixel of each color component of those C pixel, M pixel, and Y pixel is included in the array unit. It is done.

The pixel arrangement of the sensing region R12 is a pixel arrangement in which such arrangement units are repeatedly arranged in a vertical direction and a horizontal direction, that is, in a matrix form (periodically arranged).

In other words, the pixel array of the sensing region R12 is a pixel array in which a plurality of pixels of each color component are periodically and repeatedly arranged.

The W pixel, C pixel, M pixel, Y pixel, IR pixel and E pixel are pixels provided with color filters (wavelength components) different from the color components of R pixel, G pixel and B pixel. is there. Therefore, it is possible to obtain information of a color different from each color (wavelength) of R pixel, G pixel, and B pixel, that is, different spectral information, from W pixel, C pixel, M pixel, Y pixel, IR pixel, E pixel. It is.

Below, R pixel, G pixel, and B pixel are provided in imaging region R11, and at least W pixel, C pixel, M pixel, Y pixel, IR pixel, and E pixel are provided in sensing region R12. The description will be continued assuming that any pixel is provided. Of course, the R pixel, the G pixel, and the B pixel may be provided in the sensing region R12. Also, the color filters provided to the pixels in the imaging area R11 and the color filters provided to the pixels in the sensing area R12 may be formed in any manner. That is, the color filter of each pixel of the imaging area R11 and the sensing area R12 may be, for example, a general absorption type organic material, a dielectric multilayer film, or the like, or may be formed of a plasmon resonance body. The technique for forming the color filter of the pixel by a plasmon resonator is described in, for example, Japanese Patent Application Laid-Open No. 2012-59865.

A pixel signal obtained by receiving light from the outside and photoelectrically converting it by the sensing pixel arranged in the sensing region R12, that is, spectral information obtained from the sensing image is the light receiving amount of light of each color component (wavelength component) Information indicating That is, it is the spectral information of the light from the light source within the angle of view of the camera module 11.

Such spectral information is used, for example, in various image processing such as white balance adjustment for a captured image, sensing processing such as detection of an activity state of a subject in the captured image, and the like.

The imaging optical system 22 is an imaging lens composed of one or a plurality of optical lenses, and guides light incident from the outside to the imaging area R11 of the imaging unit 21. That is, the imaging optical system 22 condenses light incident from the outside to form an image on the imaging region R11.

The sensing optical system 23-1 is made of, for example, a diffusion plate (diffuser), a cylindrical lens, or the like, and guides light incident from the outside to the sensing region R12-1 of the imaging unit 21. Similarly, the sensing optical system 23-2 includes, for example, a diffusion plate or a cylindrical lens, and guides light incident from the outside to the sensing area R12-2 of the imaging unit 21.

Hereinafter, sensing optical system 23-1 and sensing optical system 23-2 will be simply referred to as sensing optical system 23 unless it is necessary to distinguish them.

In the camera module 11 configured as described above, different optical systems are used to obtain a captured image and a sensing image.

For example, it is assumed that one imaging lens is used to obtain a captured image and a sensing image. That is, light collected by one imaging lens is incident on the imaging region R11 and the sensing region R12.

In this case, the captured image is an image of the subject at the center of the angle of view of the imaging lens, that is, an image of the subject at the center of the field of view of the imaging lens. In addition, the sensing image is an image of a subject in the peripheral portion (portion near the end) of the angle of view of the imaging lens.

Therefore, in this example, spectral information on the subject on the captured image can not be obtained. In other words, when an object of interest related to spectral detection, that is, a subject whose spectral information is to be acquired is at the center of the angle of view of the imaging lens, spectral information on the subject can not be obtained. That is, appropriate spectral information can not be obtained.

On the other hand, in the camera module 11 shown in FIG. 1, an imaging optical system 22 is provided as an optical system for obtaining a captured image, and sensing optical as an optical system for obtaining spectral information separately from the imaging optical system 22. A system 23 is provided.

Therefore, in the camera module 11, by arranging the sensing optical system 23 according to the object of interest for spectral detection, it is possible to obtain spectral information of the object of interest, that is, appropriate spectral information. For example, if the sensing optical system 23 is appropriately disposed, the angle of view of the imaging optical system 22, that is, spectral information of the same angle of view as the angle of view of the captured image, or the angle of view corresponding to the central portion of the angle of view of the captured image Spectral information can be obtained.

In this case, spectral information can be obtained for an object at least at the central portion of the captured image. That is, appropriate spectral information can be acquired by a single sensor called the imaging unit 21.

Moreover, in this case, since only the imaging optical system 22 and the sensing optical system 23 need be provided for one imaging unit 21, the number of parts of the camera module 11 can be reduced, and cost reduction and miniaturization can be realized. can do.

For example, in order to obtain spectral information of an angle of view equivalent to the angle of view of a captured image, a lens and a color filter may be disposed as a module for each area including a plurality of pixels of an imaging unit to obtain a multi-wavelength image. Conceivable. However, in such a case, since it is necessary to provide a lens array and a color filter array separately from the imaging unit, the number of parts increases, which makes it difficult to miniaturize the camera module and also increases the cost.

On the other hand, in the camera module 11, it is not necessary to provide a color filter array separately from the imaging unit, and it is not necessary to provide a lens for each color filter, so the number of parts may be small. Cost reduction can be realized.

The sensing optical system 23 is not necessarily required to have an optical element (optical member) such as an optical lens, and it may be any type as long as it can guide light from the outside to the sensing region R12. It may be

That is, for example, the sensing optical system 23 includes a pinhole array formed of pinholes of a cylindrical structure or a polygonal prism structure formed by the light shielding plate 24 or the like, such a pinhole array and a diffusion plate, a lens array, a lens array and a diffusion It may be a plate or the like.

First Embodiment
<Configuration Example of Camera Module>
Now, further specific embodiments to which the present technology is applied will be described below.

FIG. 2 is a diagram showing a configuration example of a camera module to which the present technology is applied. In FIG. 2, portions corresponding to the case in FIG. 1 are denoted with the same reference numerals, and the description thereof will be appropriately omitted.

FIG. 2 is a view of the camera module 11 as viewed from the optical axis direction of the imaging optical system 22. As shown in FIG. Hereinafter, the optical axis direction of the imaging optical system 22 is also referred to as Z direction, the left and right direction is also referred to as X direction in the drawing, and the up and down direction is also referred to as Y direction in the drawing. These X direction, Y direction, and Z direction are directions orthogonal to each other.

In the camera module 11, the area at the center of the light receiving surface of the imaging unit 21 is an imaging area R11. Further, in the drawing of the light receiving surface of the imaging unit 21, the area at the left end is the sensing area R12-1, and similarly, the area at the right end of the light receiving surface of the imaging unit 21 is the sensing area R12-2. It has become.

Further, an imaging optical system 22 is disposed on the front side in the drawing of the imaging region R11. In particular, here, when viewed from the Z direction, that is, in the XY plane, the area of the area of the cross section of the imaging optical system 22 is smaller than the area of the imaging area R11. More specifically, when viewed from the Z direction, the imaging optical system 22 is included in the imaging region R11.

A sensing optical system 23-1 is disposed on the near side in the drawing of the sensing area R12-1, and a sensing optical system 23-2 is disposed on the near side in the drawing of the sensing area R12-2.

In the camera module 11, when viewed from the Z direction, the area of the cross section of the imaging optical system 22 is smaller than the imaging area R11, so that the sensing is performed immediately above the sensing area R12 adjacent to the imaging optical system 22. An optical system 23 can be arranged. Thereby, it is possible to prevent deviation between the angle of view of the imaging optical system 22 and the angle of view of the sensing optical system 23, and to obtain spectral information with an angle of view substantially the same as the angle of view of the imaging optical system 22. It will be.

<Configuration Example of Imaging Unit>
Further, the imaging unit 21 is configured, for example, as shown in FIG.

The imaging unit 21 illustrated in FIG. 3 includes a pixel array 51, a row scanning circuit 52, a PLL (Phase Locked Loop) 53, a DAC (Digital Analog Converter) 54, a column ADC (Analog Digital Converter) circuit 55, a column scanning circuit 56, and A sense amplifier 57 is provided.

The pixel array 51 has a plurality of pixels 61 arranged in a two-dimensional manner. The pixels 61 are respectively disposed at points where horizontal signal lines H connected to the row scanning circuit 52 and vertical signal lines V connected to the column ADC circuit 55 intersect, and photodiodes performing photoelectric conversion, It is composed of several types of transistors for reading out the accumulated signal.

That is, the pixel 61 includes the photodiode 71, the transfer transistor 72, the floating diffusion 73, the amplification transistor 74, the selection transistor 75, and the reset transistor 76, as shown enlarged on the right side of FIG. .

The photodiode 71 is a photoelectric conversion element that receives light incident from the outside and performs photoelectric conversion, and accumulates the charge obtained by photoelectric conversion. The charge stored in the photodiode 71 is transferred to the floating diffusion 73 via the transfer transistor 72.

The floating diffusion 73 is connected to the gate of the amplification transistor 74. When the pixel 61 is a target of signal readout, the row scanning circuit 52 controls the selection transistor 75 via the horizontal signal line H to turn on the selection transistor 75.

When the selection transistor 75 is turned on in this manner, the pixel 61 is in the selected state. The signal of the selected pixel 61 is read out to the vertical signal line V as a pixel signal corresponding to the accumulated charge amount of the charge accumulated in the photodiode 71 by driving the amplification transistor 74 with a source follower (Source Follower). . That is, a voltage signal corresponding to the charge transferred from the photodiode 71 and accumulated in the floating diffusion 73 is output from the selection transistor 75 to the vertical signal line V as a pixel signal.

When the reset transistor 76 is turned on by the row scanning circuit 52, the charge stored in the floating diffusion 73 is discharged, and the floating diffusion 73 is reset.

The row scanning circuit 52 sequentially outputs driving signals for driving (transferring, selecting, resetting, and the like) the pixels 61 of the pixel array 51 for each row. The PLL 53 generates and outputs a clock signal of a predetermined frequency required to drive each block in the imaging unit 21 based on a clock signal supplied from the outside.

The DAC 54 generates and outputs a ramp signal having a shape (generally sawtooth shape) that returns to a predetermined voltage value after the voltage drops at a predetermined inclination from a predetermined voltage value.

The column ADC circuit 55 includes the comparators 81 and the counters 82 in the number corresponding to the columns of the pixels 61 of the pixel array 51, and from the pixel signals output from the pixels 61, CDS (Correlated Double Sampling) A sampling operation is performed to extract a signal level, and a digital pixel signal is output.

That is, the comparator 81 compares the ramp signal supplied from the DAC 54 with the pixel signal (luminance value) output from the pixel 61, and supplies the resultant comparison result signal to the counter 82. Then, the counter 82 A / D converts the pixel signal by counting a counter clock signal of a predetermined frequency in accordance with the comparison result signal output from the comparator 81.

The column scanning circuit 56 sequentially supplies a signal for outputting a pixel signal to the counter 82 of the column ADC circuit 55 at a predetermined timing. The sense amplifier 57 amplifies the pixel signal supplied from the column ADC circuit 55 and outputs the amplified signal to the outside of the imaging unit 21.

In the imaging unit 21, the area portion of the pixel array 51 is a light receiving surface, and the imaging region R11 and the sensing region R12 described above are provided on the light receiving surface.

Therefore, among the pixels 61 constituting the pixel array 51, the pixels 61 provided in the imaging region R11 function as imaging pixels. Further, among the pixels 61 constituting the pixel array 51, the pixels 61 provided in the sensing region R12 function as sensing pixels. In addition, color filters of respective color components such as R, G, B, C, M, and Y are formed in the opening portion of the pixel 61.

<Example of configuration of sensing optical system>
Subsequently, a more specific configuration example of the sensing optical system 23 will be described with reference to FIG. In FIG. 4, portions corresponding to the case in FIG. 2 are denoted with the same reference numerals, and the description thereof will be appropriately omitted.

In FIG. 4, the portion shown by the arrow Q11 is a view of the camera module 11 as viewed in the Z direction, as in the case of FIG.

4 is an enlarged view of the sensing area R12-2 of the camera module 11, and the part shown by the arrow Q13 is the sensing area R12-2 of the camera module 11 and the sensing optical system. It is the figure which expanded a part of 23-2.

The portion shown by the arrow Q12 is a view of the sensing region R12-2 as viewed from the Z direction, and each square represents a sensing pixel corresponding to the pixel 61 shown in FIG.

In particular, the hatching (pattern) applied to the square representing the sensing pixel here represents the color of the color filter provided on the sensing pixel. That is, the sensing pixels subjected to the same hatch are pixels of the same color component provided with the same color filter, and the pixels hatched different from each other are provided with different color filters, different colors It is a pixel of a component.

In this example, sensing pixels of four types of color components are formed in the sensing region R12, and the above-described array unit is formed by four sensing pixels (2 pixels × 2 pixels) adjacent to each other.

Four sensing pixels of different color components are provided in the rectangular area of 2 pixels × 2 pixels constituting the array unit, and sensing of all color components provided in the sensing area R12 is arrayed in the array unit. Pixel is included. That is, here, the array unit includes sensing pixels of four types of color components.

In addition, in the sensing region R12, each region of 2 pixels × 2 pixels, which is an arrangement unit, is surrounded by a light shielding plate 121 formed immediately above the sensing region R12. The light shielding plate 121 corresponds to the light shielding plate 24 shown in FIG.

Hereinafter, each rectangular area surrounded by the light shielding plate 121 in the sensing area R12 is also referred to as a light shielding area. For example, in FIG. 4, a region R <b> 41 of 2 pixels × 2 pixels is one light shielding region.

Further, although the example in which the area of one array unit is one light shielding area has been described here, the light shielding area is an area including sensing pixels of all color components provided on the sensing area R12, ie, It may be a region including a region of at least one sequence unit. Therefore, for example, an area of 4 pixels × 4 pixels, that is, an area consisting of 4 array units adjacent to each other may be regarded as one light shielding area.

When the sensing area R12-2 of the camera module 11 and the sensing optical system 23-2 are viewed in the X direction, it can be seen that light from the outside is incident on each light blocking area as shown by the arrow Q13.

In this example, the region of each array unit is surrounded by the light shielding plate 121 to be a light shielding region, and for each of the four light shielding regions, the pinhole 122-1 to the pinhole 122-4 are formed by the light shielding plate 121. Each is formed.

Hereinafter, the pinholes 122-1 to 122-4 will be simply referred to as pinholes 122 unless it is necessary to distinguish them.

In FIG. 4, a light shielding plate 121 which is long in a direction (Z direction) perpendicular to the light receiving surface of the imaging unit 21 is provided, and a rectangular prism-shaped space portion formed by the light shielding plate 121 is long. It is one pinhole 122.

Here, each pinhole 122 has a quadrangular prism shape, but the pinhole 122 may have any shape such as a cylindrical shape or a polygonal prism shape.

Further, focusing on one pinhole 122, the length of the light shielding plate 121 forming the pinhole 122 in the Z direction with respect to the length in the X direction and the length in the Y direction of the light shielding region adjacent to the pinhole 122 Is getting longer. In other words, the pinhole 122 is an aspect-added pinhole whose length in the Z direction is longer than the length in the X direction or Y direction, that is, the depth in the Z direction is deeper.

Furthermore, the diameter of each pinhole 122, that is, the diameter (length) in the X direction or Y direction is made longer than the length in the X direction or Y direction of the light shielding region, that is, the region of the array unit. . In other words, the area of the opening of the pinhole 122 is made larger than the area of the light shielding region, ie, the arrangement unit. Thereby, one pinhole 122 can guide light from the outside to a region consisting of at least sensing pixels constituting an array unit.

In this embodiment, a pinhole array composed of a plurality of pinholes 122 arranged in (arranged) in the X direction and the Y direction disposed (provided) immediately above the sensing region R12 portion on the light receiving surface is used as the sensing optical system 23. There is. Although a plurality of pinholes 122 are provided here, only one pinhole 122 may be provided immediately above the sensing region R12, and the pinhole 122 may be used as the sensing optical system 23.

In the camera module 11, the light incident from the external subject is guided to the sensing pixels in the light shielding area of the sensing area R <b> 12 by the respective pinholes 122 constituting the sensing optical system 23. In the portion shown by the arrow Q13, the subject is on the left side in the figure, and light from the subject passes through the pinhole 122 from the left side in the figure and enters the sensing pixel.

In particular, here, the sensing region R12 is provided adjacent to the imaging region R11, and the depth in the Z direction of the pinhole 122 is sufficiently relative to the width (length in the X direction or Y direction) of the light shielding region. It's getting deeper.

Therefore, among the light incident from the outside, only the light incident from the direction of the optical axis of the imaging optical system 22, that is, the direction substantially perpendicular to the light receiving surface of the imaging unit 21, as shown by the arrow in the figure The hole 122 leads to the light shielding area of the sensing area R12. In other words, light incident on the pinhole 122 at an angle (incident angle) of a certain degree or more is blocked by the light blocking plate 121 or the like and is not incident on the light blocking area.

Therefore, in the sensing pixel of each light-shielded area, only light incident from the subject substantially directly in front of the imaging unit 21, that is, only light incident from the subject substantially at the center of the angle of view of the imaging optical system 22 (captured image) It will be photoelectrically converted.

As a result, the sensing image includes information of the subject substantially directly in front of the imaging unit 21, that is, information of the subject substantially at the center of the captured image.

In a block subsequent to the imaging unit 21 in the camera module 11, spectral information is generated based on pixel signals read from each sensing pixel in the light-shielded area, that is, a sensing image.

Specifically, for example, since four sensing pixels having different color components are provided in one light shielding region, spectral information indicating the intensity (incident light amount) of incident light of each of the four color components in one light shielding region Is obtained. Then, an average value, a weighted average value, a sum, a weighted addition value, and the like for each color component of spectral information obtained in all the light-shielded regions are determined, and they are used as one final spectral information.

In this example, since the imaging optical system such as an imaging lens is not provided in the sensing optical system 23, the camera module 11 can not obtain spectral information for each area in the central portion of the captured image. That is, two-dimensional spectral information for each region can not be obtained. Therefore, spectral information obtained by the camera module 11 is information of each color component in the entire region of the central part of the angle of view of the captured image, that is, 0-dimensional spectral information.

The pixel arrangement of the sensing region R12 is a pixel arrangement in which arrangement units are periodically (regularly) repeated. That is, the color arrangement of the sensing pixels in the light shielding area is the same in all the light shielding areas. As described above, by making the color array of sensing pixels in the light shielding region the same in all the light shielding regions, sensing pixels such as signal processing for obtaining one final spectral information from spectral information of each light shielding region. It is possible to prevent the signal processing in the subsequent stage of the signal from becoming complicated. That is, for example, signal processing in the subsequent stage can be easily performed as compared with the case where the sensing pixels of each color component are randomly arranged in the entire sensing region R12.

As described above, by using the sensing optical system 23 as an optical system different from the imaging optical system 22 and further configuring the sensing optical system 23 with a pinhole array, spectral information of the central part of the angle of view of the captured image is obtained. You can get it. That is, since the subject in the central portion of the captured image is highly likely to be an object of interest for spectral detection, more appropriate spectral information can be obtained.

Moreover, in the camera module 11, since the pinhole array as the sensing optical system 23 is configured by the pinhole 122 with an aspect, accurate spectral information can be obtained without being affected by the incident angle dependency of the color filter. be able to.

The color filter provided in the sensing pixel has an incident angle dependency, and the spectral characteristics of the color filter change according to the incident angle of light on the color filter. That is, the wavelength distribution of the light reception intensity of the light received by the sensing pixel changes according to the incident angle of the light to the sensing pixel (color filter).

In a normal camera module, the peripheral area of the light receiving surface, that is, the area near the end is used as a sensing area, and light is guided to the sensing area by the imaging optical system common to the imaging area. Light will be incident at an angle. Therefore, the spectrum changes due to the incident angle dependency of the above-mentioned color filter depending on the position of the sensing pixel, and accurate spectral information can not be detected.

On the other hand, in the camera module 11, the sensing optical system 23 is provided separately from the imaging optical system 22, and the sensing optical system 23 is configured by the pinhole 122 with an aspect. Therefore, light is incident on each sensing pixel from a direction substantially perpendicular to the light receiving surface, so that accurate spectral information can be detected without being affected by the incident angle dependency of the color filter. Moreover, regardless of the position of the sensing pixel, the incident angle of light is substantially the same for all sensing pixels, that is, light is incident under the same optical condition, and thus dispersion of spectral information may occur depending on the position of the sensing pixel. Absent.

Furthermore, in the camera module 11, it is sufficient to provide a pinhole array as the sensing optical system 23, and the number of parts can be reduced, so that the cost and size of the camera module 11 can be reduced.

The configurations of the sensing region R12-1 and the sensing optical system 23-1 are the same as the configurations of the sensing region R12-2 and the sensing optical system 23-2.

In the example of FIG. 4, the example in which the pinhole 122 is formed by the light shielding plate 121 has been described, but in addition, the pinhole 122 is formed by a member such as a mirror or metal or a reflector. It is also good. That is, in place of the light shielding plate 121, the pinhole 122 may be formed by surrounding the light shielding region with a reflecting member such as a mirror, a metal, or a reflecting plate.

In such a case, among the light incident on the pinhole 122, light having a slight angle is also reflected by the reflection member and guided to the sensing pixel, and is received by the sensing pixel. As a result, it is possible to obtain spectral information for a wider area than in the case where the pinhole 122 is formed by the light shielding plate 121.

Furthermore, by adjusting the aspect ratio of the pinhole 122 which is a pinhole with an aspect, that is, the ratio of the length in the X direction or Y direction of the pinhole 122 to the length (depth) in the Z direction of the pinhole 122 Spectral information can be detected for a desired area of area.

For example, by providing a pinhole 122 with an appropriate aspect ratio, it is also possible to detect spectral information at an angle of view substantially the same as the angle of view of the imaging optical system 22.

Specifically, for example, the length in the X direction and the length in the Y direction of the imaging region R11 are X (for example, X mm) and Y (for example, Y mm), respectively, and the focal length of the imaging optical system 22 is f (f For example, suppose that it is fmm).

Further, the length in the X direction and the length in the Y direction of the pinhole 122 are respectively X ′ (eg, X ′ mm) and Y ′ (eg, Y ′ mm), and the length in the Z direction of the pinhole 122 (Depth) is assumed to be Z '(e.g., Z' mm).

Here, the length of the pinhole 122 in the Z direction is the length of the light shielding plate 121 in the Z direction. The Z direction is a direction perpendicular to the imaging area R11 and the sensing area R12, and can also be referred to as a depth direction (longitudinal direction) of the pinhole 122, that is, an optical axis direction of the sensing optical system 23. Here, it is assumed that the pinhole 122 has a quadrangular prism shape, and the opening of the pinhole 122 has a rectangular shape.

Furthermore, the aspect ratio of the pinhole 122 in the X direction to the Z direction (depth) is X '/ Z', and the aspect ratio of the pinhole 122 in the Y direction to the Z direction is Y '/ Z'.

At this time, if the pinhole 122 is formed so that X ′ / Z ′ = X / f and Y ′ / Z ′ = Y / f are generally satisfied, the angle of view of the imaging optical system 22 and the pinhole 122 (sensing The angle of view of the optical system 23), that is, the angle of view of the spectral information, is substantially the same.

For example, if attention is focused on the Y direction and the angle of half of the angle of view of the imaging optical system 22 in the Y direction is θy, then tan (θy) = Y / 2f holds. Therefore, if the length Z ′ (depth) of the pinhole 122 in the Z direction and the length Y ′ of the pinhole 122 in the Y direction are determined so that tan (θy) = Y ′ / 2Z ′ holds. As a result, the half angle of the angle of view of the pinhole 122 in the Y direction also becomes θy.

As described above, the ratio of the length Z ′ in the depth direction of the pinhole 122 to the length X ′ or Y ′ which is the length in the X direction or the Y direction perpendicular to the depth direction of the pinhole 122 is imaging If the pinhole 122 is formed to be approximately equal to the ratio of the focal length f of the optical system 22 to X or Y which is the length in the X direction or Y direction of the imaging region R11, the angle of view of the imaging optical system 22 Spectral information of substantially the same angle of view can be obtained.

Second Embodiment
<Example of configuration of sensing optical system>
In addition, in order to obtain spectral information for a wider area, a pinhole array and a diffusion plate may be combined to form the sensing optical system 23.

In such a case, the sensing optical system 23 is configured, for example, as shown in FIG. In FIG. 5, parts corresponding to those in FIG. 4 are given the same reference numerals, and the description thereof will be omitted as appropriate.

In FIG. 5, the portion shown by the arrow Q21 shows the camera module 11 viewed from the Z direction, and the portion shown by the arrow Q22 shows an enlarged view of the portion of the sensing region R12-2. The portion shown by the arrow Q21 and the portion shown by the arrow Q22 are the same as the portion shown by the arrow Q11 and the portion shown by the arrow Q12 of FIG.

Further, a portion indicated by an arrow Q23 is a view of a sensing region R12-2 of the camera module 11 and a part of the sensing optical system 23-2 as viewed from the X direction.

In this example, the pinhole 122 is formed by the light shielding plate 121, which is the same as the case in FIG. 4, but in the pinhole array composed of the pinhole 122, the side opposite to the imaging unit 21 side, that is, the object It differs from the case in FIG. 4 in that a diffusion plate 151 is provided on the side.

In the example shown in FIG. 5, the sensing optical system 23 is configured of a pinhole array consisting of pinholes 122 and a diffusion plate 151 disposed on the object side of the pinhole array.

In this case, light from the subject first enters the diffusion plate 151 and is diffused by the diffusion plate 151. Then, the light is incident from the subject, and the light diffused by the diffusion plate 151 is incident to the sensing pixels in the light shielding area through the respective pinholes 122.

Therefore, in comparison with the example shown in FIG. 4, even light having an angle to a certain degree among light incident on the diffusion plate 151 is diffused by the diffusion plate 151 and is received by the sensing pixel. Spectral information for a wide area can be obtained. In particular, depending on the degree of diffusion in the diffusion plate 151, it is also possible to obtain spectral information with an angle of view equivalent to that of the imaging optical system 22.

As described above, even when the sensing optical system 23 includes the pinhole array including the pinhole 122 and the diffusion plate 151, appropriate spectral information can be obtained without being affected by the incident angle dependency of the color filter. Can. In particular, the spectral information obtained in this embodiment is 0-dimensional spectral information as in the example shown in FIG.

The configurations of the sensing region R12-1 and the sensing optical system 23-1 are the same as the configurations of the sensing region R12-2 and the sensing optical system 23-2. Also, the sensing optical system 23 may be configured by one pinhole 122 and the diffusion plate 151.

Third Embodiment
<Example of configuration of sensing optical system>
Furthermore, the wavelength resolution of spectral information may be improved by substantially increasing the types of color filters of the sensing pixel by utilizing the incident angle dependency of the color filter provided in the sensing pixel.

In such a case, the sensing optical system 23 is configured, for example, as shown in FIG. In FIG. 6, parts corresponding to those in FIG. 4 are given the same reference numerals, and the description thereof will be omitted as appropriate.

In FIG. 6, a portion indicated by an arrow Q31 is a view of the camera module 11 as viewed from the Z direction. The portion shown by the arrow Q31 is the same as the portion shown by the arrow Q11 in FIG.

6 is an enlarged view of the sensing area R12-2 of the camera module 11, and the part shown by the arrow Q33 is a sensing area R12-2 of the camera module 11 and a sensing optical system. It is the figure which expanded the part of 23-2.

The portion shown by the arrow Q32 is a view of the sensing region R12-2 as viewed from the Z direction, and each square represents a sensing pixel corresponding to the pixel 61 shown in FIG.

A hatched hatched square representing a sensing pixel represents the color of a color filter provided in the sensing pixel, and here, sensing pixels of seven color components are provided in the sensing region R12.

Here, the entire sensing region R12-2 is surrounded by the light shielding plate 181 formed immediately above the sensing region R12-2, and the entire sensing region R12-2 is one light shielding region. The light blocking plate 181 corresponds to the light blocking plate 24 shown in FIG.

When the sensing area R12-2 and the sensing optical system 23-2 of the camera module 11 are viewed in the X direction, light from an external subject passes through the diffuser plate 182 and the cylindrical lens 183, as indicated by an arrow Q33. It is incident on the sensing pixel.

In this example, the entire sensing region R12-2 is surrounded by the light shielding plate 181 to be one light shielding region, and the light shielding region is a diffusion plate 182 and a cylindrical lens which is an optical lens (imaging lens) 183 are provided. The diffusion plate 182 and the cylindrical lens 183 constitute a sensing optical system 23-2.

In FIG. 6, a cylindrical lens 183 having a cross section substantially the same size as the sensing area R12-2 is disposed on the subject side of the imaging unit 21, and the cylindrical lens 183 is opposite to the subject side, that is, the sensing area R12-2 side. A diffuser plate 182 is further arranged on the side.

In this case, light from the subject is incident on the diffusion plate 182, diffused by the diffusion plate 182, and then incident on the cylindrical lens 183. Then, the light incident on the cylindrical lens 183 from the diffusion plate 182 is collected by the cylindrical lens 183 and guided to each sensing pixel in the light shielding area.

Light incident on the sensing pixel from the subject through the cylindrical lens 183 and the diffusion plate 182 is photoelectrically converted in the sensing pixel, and a pixel signal corresponding to the amount of charge obtained as a result is read out from each sensing pixel Information is generated.

In this example, since the diffusion plate 182 is provided, spectral information obtained by the camera module 11 is information of each color component in the entire area including the central portion of the angle of view of the captured image and the peripheral area thereof. That is, the spectral information obtained in this embodiment is the zeroth-order spectral information similar to the example shown in FIG.

Also in this case, as in the first embodiment and the second embodiment, it is possible to obtain appropriate spectral information for the central portion of the angle of view of the captured image and the region around it.

However, since the light diffused by the diffusion plate 182 is condensed by the cylindrical lens 183 and forms an image in each area of the light shielding area (sensing area R12), even light from the same subject depends on the position of the sensing pixel The incident angles of light to the sensing pixels are different.

That is, the cylindrical lens 183 causes the light from the diffusion plate 182 to be incident on sensing pixels at different positions on the light shielding region at different incident angles.

Specifically, for example, in the sensing pixel at the position indicated by the arrow W11 at the center of the sensing region R12, light from near the center position of the diffusion plate 182 is from a direction substantially perpendicular to the light receiving surface as shown by the arrow AR11. It will be incident. That is, the incident angle of light is approximately 0 degrees.

On the other hand, for example, in the sensing pixel at the position indicated by the arrow W12 near the end of the sensing region R12, the light from near the central position of the diffusion plate 182 is oblique to the light receiving surface as shown by the arrow AR12. It is incident from.

As described above, even with light emitted from the same position in the diffusion plate 182, the incident angle of light when entering the sensing pixels differs depending on the position on the light shielding area (sensing area R12) where the sensing pixels are present.

Therefore, even in the sensing pixels of the same color component, the spectral characteristics change depending on the position of the sensing pixels, so sensing pixels of the same color component arranged at different positions are substantially as sensing pixels of different color components. It will work.

Specifically, for example, it is assumed that there are sensing pixels of a predetermined color component at the position indicated by arrow W11 and the position indicated by arrow W12. In this case, spectral information of different color components can be obtained from pixel signals of those two sensing pixels.

As a result, the types of color components (color filters) of the sensing pixels in the sensing region R12 can be substantially increased, and the wavelength resolution of spectral information can be improved. That is, the number of wavelength channels of spectral information can be increased.

In addition, it can be understood in advance from which sensing pixel the information of which color component can be obtained from the color filter provided in the sensing pixel and the arrangement position of the sensing pixel on the sensing region R12.

Further, the configurations of the sensing region R12-1 and the sensing optical system 23-1 are the same as the configurations of the sensing region R12-2 and the sensing optical system 23-2.

Further, in the example shown in FIG. 6, the entire sensing area R12-2 is one light shielding area, and the diffusion plate 182 and the cylindrical lens 183 are provided for the light shielding area. In addition, for example, a plurality of light shielding regions may be provided in the sensing region R12-1 and the sensing region R12-2, and the diffusion plate 182 and the cylindrical lens 183 may be provided for each of the plurality of light shielding regions. That is, the sensing optical system 23 may be configured by one or more diffusion plates 182 and one or more cylindrical lenses 183. In addition, the sensing optical system 23 may be configured of another optical lens different from the cylindrical lens 183 and the diffusion plate 182. Further, in this embodiment, the color filter of each pixel, in particular the color filter of the sensing pixel, is a color filter in which the difference in spectral dependence at each incident angle of the dielectric multilayer film, the plasmon resonator, etc. is remarkable. desirable.

Fourth Embodiment
<Example of configuration of sensing optical system>
Further, the sensing area R12 is divided into a plurality of light shielding areas, and an imaging lens is provided as the sensing optical system 23 for each of the light shielding areas, so that the angle of view substantially the same as the angle of view of the imaging optical system 22 (captured image) Two-dimensional spectral information can be obtained.

In such a case, the sensing optical system 23 is configured, for example, as shown in FIG. In FIG. 7, portions corresponding to the case in FIG. 4 are denoted with the same reference numerals, and the description thereof will be appropriately omitted.

In FIG. 7, the portion indicated by the arrow Q41 is a view of the camera module 11 as viewed from the Z direction. The portion shown by the arrow Q41 is the same as the portion shown by the arrow Q11 in FIG.

7 is an enlarged view of the sensing area R12-2 of the camera module 11, and the part shown by the arrow Q43 is the sensing area R12-2 of the camera module 11 and the sensing optical system. It is the figure which expanded the part of 23-2.

The portion shown by the arrow Q42 shows the sensing region R12-2 as viewed from the Z direction, and each square represents a sensing pixel corresponding to the pixel 61 shown in FIG.

Further, here, the sensing region R12-2 is divided into three light shielding regions by the light shielding plate 211 formed immediately above the sensing region R12-2. The light shielding plate 211 corresponds to the light shielding plate 24 shown in FIG.

When the sensing area R12-2 of the camera module 11 and the sensing optical system 23-2 are viewed in the X direction, light from an external subject is transmitted through the imaging lens 212-1 to the imaging lens as shown by an arrow Q43. The light is incident on each of the three light shielding regions through each of 212-3.

In this example, each of three regions on the sensing region R12-2 is surrounded by the light shielding plate 211 to be a light shielding region, and the imaging lens 212-1 to the imaging lens 212 Three are provided. A sensing optical system 23-2 is configured of a lens array including the imaging lenses 212-1 to 212-3.

In FIG. 7, the imaging lens 212-1 is disposed on the object side of the uppermost light shielding area in the drawing, and the imaging lens on the object side of the light shielding area at the center of the sensing area R 12-2. An imaging lens 212-3 is disposed on the object side of the lowermost light shielding area in the drawing. Hereinafter, the imaging lenses 212-1 to 212-3 will be simply referred to as imaging lenses 212 unless it is necessary to distinguish them.

In this case, light from the subject is condensed by the imaging lens 212 and is guided to each sensing pixel of the light shielding area disposed immediately below the imaging lens 212. That is, the light from the subject is imaged on the light shielding area by the imaging lens 212.

Light incident on a sensing pixel from a subject through the imaging lens 212 is photoelectrically converted in the sensing pixel, and a pixel signal corresponding to the amount of charge obtained as a result is read from each sensing pixel to generate spectral information. Be done.

In this example, since the sensing optical system 23 is configured by the imaging lens 212, the image of the subject is formed by the imaging lens 212 in each light-shielded area. Further, the angle of view of each imaging lens 212 is substantially the same as the angle of view of the imaging optical system 22 (captured image).

Therefore, an image composed of pixel signals read out from the respective sensing pixels in the light shielding area is an image substantially the same as the captured image, and more specifically, an image which differs from the captured image only in color components. Therefore, the spectral information obtained by the camera module 11 is information (spectrum of each color component for each area) for the entire area (entire angle of view of the imaged image) including the central portion of the angle of view of the imaged image and its peripheral area. It becomes two-dimensional spectral information which shows).

That is, in the camera module 11, spectral information indicating the intensity (incident light quantity) of the incident light of each color component in each area in each area in the angle of view (observation visual field) of the imaging lens 212 is obtained for each light shielding area. . Then, an average value, a weighted average value, a sum, a weighted addition value, and the like for each color component are obtained for each region of spectral information obtained in all the light-shielded regions, and the final spectral information is obtained. In this case, two-dimensional spectral information can be obtained for the entire angle of view of the captured image.

The configurations of the sensing region R12-1 and the sensing optical system 23-1 are the same as the configurations of the sensing region R12-2 and the sensing optical system 23-2 shown in FIG.

In addition, since the sensing area R12 has a long shape in the vertical direction in the figure, the sensing area R12 is divided into a plurality of light shielding areas, and an image can be formed on the image of the subject for each of the light shielding areas. The lens 212 is disposed. However, the entire sensing area R12 may be one light blocking area, and one imaging lens capable of forming an image of an object may be disposed as the sensing optical system 23.

Fifth Embodiment
<Example of configuration of sensing optical system>
In addition, when the sensing area R12 is divided into a plurality of light blocking areas, and an imaging lens is provided as the sensing optical system 23 for each of the light blocking areas, the angle of view (observation field) differs for each light blocking area (imaging lens) The spectral information may be detected.

In such a case, the sensing optical system 23 is configured, for example, as shown in FIG. In FIG. 8, parts corresponding to the case in FIG. 4 are given the same reference numerals, and the description thereof will be omitted as appropriate.

In FIG. 8, the portion shown by the arrow Q51 is a view of the camera module 11 as viewed from the Z direction. The part shown by the arrow Q51 is the same as the part shown by the arrow Q11 in FIG.

8 is an enlarged view of the sensing area R12-2 of the camera module 11, and the area shown by the arrow Q53 is an enlarged view of the sensing area R12-1 of the camera module 11. FIG. Further, a portion indicated by an arrow Q54 is an enlarged view of a portion of the sensing area R12-2 of the camera module 11 and the sensing optical system 23-2.

The portion shown by the arrow Q52 is a view of the sensing region R12-2 as viewed from the Z direction, and each square represents a sensing pixel corresponding to the pixel 61 shown in FIG.

Further, here, the sensing region R12-2 is divided into three light shielding regions by the light shielding plate 241 formed immediately above the sensing region R12-2. The light shielding plate 241 corresponds to the light shielding plate 24 shown in FIG.

Furthermore, in the portion shown by the arrow Q52, the dotted lines surrounding each light shielding area represent the angle of view of the imaging optical system 22, that is, the captured image. With respect to the angle of view of the imaging optical system 22, the angle of view (observation field) of each light-shielded area is the left half in the figure of the area of angle of view of the imaging optical system 22.

On the other hand, as shown by arrow Q53, sensing region R12-1 is also divided into three light shielding regions by the light shielding plate, and the angle of view of each of the light shielding regions is represented by a dotted line surrounding those light shielding regions. In the drawing of the field angle region of the imaging optical system 22, the right half region is shown.

As described above, in the camera module 11, spectral information can be obtained at different angle of view (observation field of view) for each sensing region R12, that is, for each light-shielded region of the sensing region R12. In other words, each of the sensing optical systems 23 can guide light from an external subject at a different angle of view to each of the sensing regions R12 located immediately below the sensing optical systems 23. There is.

Moreover, the angle of view of each light shielding area is a partial area of the angle of view of the imaging optical system 22, and each area within the angle of view of the imaging optical system 22 is necessarily within the angle of view of at least one light shielding area of the sensing area R12. As a result, two-dimensional spectral information of the same angle of view as the angle of view of the imaging optical system 22 can be obtained.

In the example of FIG. 8, in the sensing area R12-1, spectral information for the right half of the field angle area of the imaging optical system 22 is obtained, and in the sensing area R12-2, the image of the imaging optical system 22 is Spectral information is obtained for the left half of the corner area.

Then, from the spectral information obtained in the sensing region R12-1 and the spectral information obtained in the sensing region R12-2, two-dimensional spectral information for the entire angle of view of the imaging optical system 22 can be obtained. .

Here, which region in the angle of view of the imaging optical system 22 corresponds to the angle of view of each light shielding region can be determined by appropriately selecting the sensing optical system 23.

That is, for example, it is possible to obtain spectral information of a desired angle of view (observation field) by selecting a lens such as an appropriate focal length or lens diameter as an imaging lens constituting the sensing optical system 23. .

As shown by the arrow Q52, when it is intended to obtain spectral information targeting the left half of the field angle region of the imaging optical system 22 in the sensing region R12-2, for example, as shown by the arrow Q54 The system 23-2 may be configured by an imaging lens such as an appropriate focal length.

The part shown by arrow Q54 is a view of the sensing area R12-2 of the camera module 11 and the part of the sensing optical system 23-2 as viewed from the X direction.

In this example, light from an external subject is incident on each of the three light shielding regions of the sensing region R12-2 through the imaging lenses 242-1 to 242-3.

That is, each of the three regions on the sensing region R12-2 is surrounded by the light shielding plate 241 to be a light shielding region, and the imaging lens 242-1 to the imaging lens 242 are provided on the object side with respect to those light shielding regions. -3 is provided.

A sensing optical system 23-2 is configured by a lens array including the imaging lenses 242-1 to 242-3 capable of forming an image of a subject on the sensing region R12-2.

In FIG. 8, the imaging lens 242-1 is disposed on the object side of the light shielding area with respect to the uppermost light shielding area in the figure, and the imaging lens on the object side of the light shielding area at the center of the sensing area R12-2. An imaging lens 242-3 is disposed on the object side of the lowermost light shielding area in the drawing. Hereinafter, the imaging lenses 242-1 to 242-3 will be simply referred to as an imaging lens 242 unless it is necessary to distinguish them.

In this case, the light from the subject is condensed by the imaging lens 242, and is guided to each sensing pixel of the light shielding area disposed immediately below the imaging lens 242. That is, light from the subject is imaged on the light shielding area by the imaging lens 242.

Light incident on the sensing pixel from the subject through the imaging lens 242 is photoelectrically converted in the sensing pixel, and a pixel signal corresponding to the amount of charge obtained as a result is read from each sensing pixel to generate spectral information. Be done.

In this example, since the sensing optical system 23 is configured by the imaging lens 242, the image of the subject is formed by the imaging lens 242 in each light-shielded area. Further, the angle of view of each imaging lens 242 is substantially the same as the area of the left half of the angle of view of the imaging optical system 22 (captured image).

Therefore, an image composed of pixel signals read out from the sensing pixels of each light-shielded area is an image of the left half of the captured image, more specifically, an image different from the image of the left half of the captured image by only the color component. Therefore, spectral information obtained in the sensing region R12-2 is two-dimensional spectral information indicating information (spectrum) of each color component for each region, for the region at the left half of the angle of view of the captured image.

The configurations of the sensing area R12-1 and the sensing optical system 23-1 are also the same as the sensing area R12-2 and the sensing optical system 23 shown in FIG. 8 except that the angle of view (observation visual field) of the sensing optical system 23-1 is different. The configuration is the same as that of the second embodiment.

An image consisting of pixel signals read from sensing pixels in each light-shielded area of sensing area R12-1 is an image in the right half of the captured image, more specifically, an image different from the image in the right half of the captured image . Therefore, spectral information obtained in the sensing region R12-1 is two-dimensional spectral information indicating information (spectrum) of each color component for each region, targeting the region on the right half of the angle of view of the captured image.

Therefore, from the spectral information for each sensing area R12, each color component for each area targeting the entire area (entire angle of view of the imaged image) finally including the central part of the angle of view of the imaged image and its peripheral area It is possible to obtain two-dimensional spectral information indicating the information (spectrum) of

The camera module 11 having the configuration shown in FIG. 8 can basically obtain spectral information similar to that of the camera module 11 having the configuration shown in FIG. 7.

However, in the example shown in FIG. 7, the angle of view of each light shielding area (imaging lens 212) is substantially the same as the angle of view of the imaging optical system 22, while in the example shown in FIG. The angle of view of the light shielding area (imaging lens 242) is a partial area within the angle of view of the imaging optical system 22.

Therefore, in the example shown in FIG. 8, when focusing on a predetermined area within the angle of view of the imaging optical system 22, the number of sensing pixels used to obtain spectral information of the predetermined area is shown in FIG. The spatial resolution of spectral information can be improved.

Furthermore, since the sensing area R12 has a long shape in the vertical direction in the figure, one sensing area R12 is divided into a plurality of light shielding areas, and the imaging lens 242 is disposed for each of the light shielding areas. It is a structure. However, one entire sensing area R12 may be one light blocking area, and one imaging lens may be disposed as the sensing optical system 23.

Further, although the example in which the optical member for guiding light to each light shielding area is the imaging lens 242 capable of forming the image of the subject on the sensing area R12 has been described here, it is not necessarily required to be the imaging lens , And other optical lenses. However, at least two or more sensing optical systems 23 of the plurality of sensing optical systems 23 need to be able to guide light from the outside to the sensing area R12 (light shielding area) at different angles of view.

Sixth Embodiment
<Example of configuration of sensing optical system>
By the way, as in the case of the incident angle dependency of the color filter described above, the spectral characteristic of the pixel is also caused by the presence or absence of an IR (Infrared) cut filter (infrared light blocking filter) for blocking incident infrared light. Is known to change.

Therefore, by arranging a sensing pixel provided with an IR cut filter and a sensing pixel provided with no IR cut filter, the types of color filters of the sensing pixel are substantially increased, and the wavelength resolution of spectral information is increased. It may be improved.

In such a case, the sensing optical system 23 is configured, for example, as shown in FIG. In FIG. 9, parts corresponding to those in FIG. 7 are assigned the same reference numerals, and the description thereof will be omitted as appropriate.

In FIG. 9, the portion shown by the arrow Q61 is a view of the camera module 11 as viewed from the Z direction. The portion shown by the arrow Q61 is the same as the portion shown by the arrow Q41 of FIG. 7, so the description thereof is omitted.

9 is an enlarged view of the imaging area R11 and the sensing area R12 of the camera module 11, and the part shown by the arrow Q63 is the sensing area R12-2 of the camera module 11 and the sensing. It is the figure which expanded the part of optical system 23-2.

The part shown by the arrow Q62 shows the view when the imaging area R11 and the sensing area R12 are viewed from the Z direction, and each square represents a sensing pixel corresponding to the pixel 61 shown in FIG.

Further, although imaging pixels corresponding to the pixels 61 shown in FIG. 3 are also provided in the imaging region R11, illustration of squares representing the respective imaging pixels is omitted here.

Generally, in the imaging pixel, an IR cut filter is provided so as not to receive unnecessary infrared light. Such an IR cut filter is formed, for example, immediately above or below a color filter provided in an imaging pixel.

On the other hand, in the sensing pixels formed in the sensing region R12, an IR cut filter may be provided, or an IR cut filter may not be provided, but in this example, the types of color filters are substantially increased. In order to cause this, an IR cut filter is provided in part of the sensing pixels.

Specifically, in the example of FIG. 9, an IR cut filter is provided for the pixels in the area R61 formed of the imaging area R11 and the sensing area R12-2.

That is, only the color filter is provided in the sensing pixel in the sensing region R12-1, and the IR cut filter is not provided. On the other hand, both the color filter and the IR cut filter are provided in the sensing pixel in the sensing region R12-2.

Here, for example, the arrangement of the color filter of the sensing pixel in the sensing region R12-1 and the arrangement of the color filter of the sensing pixel in the sensing region R12-2 are the same. That is, the color filter provided in the sensing pixel at the predetermined position in sensing region R12-1 is the same as the color filter provided in the sensing pixel at the position in sensing region R12-2 corresponding to the predetermined position. It has become a thing.

In the example shown in FIG. 9, it is necessary to newly provide an IR cut filter in the sensing pixel in the sensing region R12-2. However, since the IR cut filter is originally formed only in the imaging area R11 in which the imaging pixels are present, the IR cut filter may be formed in the area R61 slightly wider than the imaging area R11, so that the cost can be reduced. Is possible.

Here, the sensing region R12-1 is divided into three light shielding regions by a light shielding plate 271 formed immediately above the sensing region R12-1. Similarly, a sensing area R12-2 is divided into three light shielding areas by a light shielding plate 211 formed immediately above the sensing area R12-2. The light shielding plate 271 and the light shielding plate 211 correspond to the light shielding plate 24 shown in FIG.

Furthermore, when the sensing area R12-2 of the camera module 11 and the sensing optical system 23-2 are viewed in the X direction, light from an external subject is blocked via the imaging lens 212, as shown by arrow Q63. It is incident on the area.

The sensing optical system 23-2 shown in FIG. 9 has the same configuration as the sensing optical system 23-2 shown in FIG. From this, in the example of FIG. 9 as well, in the sensing region R12-2, information (spectrum) of each color component for each region is shown for the entire region including the central portion of the angle of view of the captured image and its peripheral region. Two-dimensional spectral information will be obtained.

Further, the configurations of the sensing region R12-1 and the sensing optical system 23-1 are the same as the configurations of the sensing region R12-2 and the sensing optical system 23-2 shown in FIG.

Therefore, also in the sensing region R12-1, spectral information similar to that obtained in the sensing region R12-2 can be obtained.

However, as described above, the IR cut filter is not provided in the sensing pixel in the sensing region R12-1, but the IR cut filter is provided in the sensing pixel in the sensing region R12-2.

Therefore, even in the sensing pixel provided with the same color filter, the spectral characteristics are different between the sensing pixel in the sensing region R12-1 and the sensing pixel in the sensing region R12-2. Therefore, spectral information of color components different from each other between the pixel signal of the sensing pixel in the sensing region R12-1 and the pixel signal of the sensing pixel in the sensing region R12-2 provided with the same color filter as the sensing pixel Is obtained.

From this, in the sensing region R12-1, spectral information which is similar to the spectral information obtained in the sensing region R12-2 but different in color component is obtained. As a result, one-dimensional final two-dimensional spectral information including information of more color components from the spectral information obtained in the sensing region R12-1 and the spectral information obtained in the sensing region R12-2 You can get

As described above, by providing the IR cut filter in a part of sensing pixels in the sensing area R12, the types of color components (color filters) of the sensing pixels in the sensing area R12 are substantially increased, and the wavelength of spectral information Resolution can be improved. That is, the number of wavelength channels of spectral information can be increased.

Note that which color component information can be obtained from which sensing pixel can be grasped in advance from the color filter provided in the sensing pixel and the presence or absence of the IR cut filter.

Further, in FIG. 9, the case where an IR cut filter is provided in some of the sensing pixels in the configuration shown in FIG. 7 has been described as an example, but in addition, in the examples shown in FIG. 4, FIG. 5, FIG. Is also applicable.

That is, when the camera module 11 is configured as shown in FIG. 4, FIG. 5, FIG. 6, and FIG. 8, for example, sensing in the sensing region R12 of either sensing region R12-1 or sensing region R12-2. The IR cut filter may be provided in the pixel, and the IR cut filter may not be provided in the sensing pixel in the other sensing region R12. This also substantially increases the types of color filters and can improve wavelength resolution.

Modified Example 1
<Configuration Example of Camera Module>
By the way, in the above, as illustrated in FIG. 2, in the imaging unit 21, an example in which the sensing region R12 is provided on the left and right of the imaging region R11 has been described.

However, as long as the imaging area R11 and the sensing area R12 are provided in the area of the pixel array 51, the sensing area R12 may be provided at any position, and any number of sensing areas R12 may be provided. .

Therefore, for example, as shown in FIG. 10, sensing regions R12 may be provided adjacent to the regions of the upper, lower, left, and right end portions of the imaging region R11. In FIG. 10, parts corresponding to the case in FIG. 2 are given the same reference numerals, and the description thereof will be omitted as appropriate.

FIG. 10 is a view of the camera module 11 as viewed from the optical axis direction (Z direction) of the imaging optical system 22.

In this example, the light receiving surface of the imaging unit 21, that is, the region at the central portion (central portion) of the pixel array 51 is used as the imaging region R11, and the region adjacent to the left in the figure of the imaging region R11 is the sensing region R12. It is considered to be -1.

In the drawing of the imaging area R11, the area adjacent to the right is the sensing area R12-2, and in the drawing of the imaging area R11, the area adjacent to the upper is the sensing area R12-3. In the figure of R11, the area adjacent to the lower side is taken as a sensing area R12-4.

In other words, the sensing region R12-1 to the sensing region R12-4 are provided in the left end, the right end, the upper end, and the lower end of the light receiving surface of the imaging unit 21, respectively.

The sensing area R12-3 and the sensing area R12-4 are areas in which a plurality of sensing pixels are formed as in the sensing area R12-1 and the sensing area R12-2.

Furthermore, in each of the sensing area R12-1 to the sensing area R12-4, the sensing optical system 23-1 to the sensing optical system 23-4 are respectively provided on the front side, that is, the object side.

Here, the sensing optical system 23-3 is an optical system for guiding the light from the subject to the sensing area R12-3, and the sensing optical system 23-4 is for guiding the light from the subject to the sensing area R12-4. It is an optical system. The sensing optical system 23-3 and the sensing optical system 23-4 have the same configuration as the sensing optical system 23-1 and the sensing optical system 23-2.

Here, an example in which the sensing area R12-1 to the sensing area R12-4 are provided for the imaging area R11 has been described. However, the invention is not limited to this, and at least one of the sensing area R12-1 to the sensing area R12-4 may be provided.

For example, only the sensing region R12-1 and the sensing region R12-2 may be provided for the imaging region R11, or only the sensing region R12-3 and the sensing region R12-4 may be provided.

Further, only the sensing region R12-1 may be provided for the imaging region R11, only the sensing region R12-2 may be provided, or only the sensing region R12-3 is provided. Alternatively, only the sensing region R12-4 may be provided.

<Modification 2>
<Configuration Example of Camera Module>
Furthermore, any one of the four corners of the light receiving surface of the pixel array 51 may be used as a sensing region.

In such a case, the camera module 11 is configured, for example, as shown in FIG. In FIG. 11, parts corresponding to the case in FIG. 2 are given the same reference numerals, and the description thereof will be omitted as appropriate.

FIG. 11 is a view of the camera module 11 as viewed from the optical axis direction (Z direction) of the imaging optical system 22.

In this example, either the region R31-1 or the region R31-2 in the light receiving surface of the imaging unit 21, that is, the central portion (central portion) of the pixel array 51 is used as an imaging region. That is, the region R31-1 and the region R31-2 correspond to the imaging region R11 shown in FIG. 1, and the imaging pixels described above are formed in the region R31-1 and the region R31-2.

Specifically, for example, when imaging of a captured image is performed at an angle of view of 16: 9 in the camera module 11, the region R31-1 is set as an imaging region, and imaging of the captured image is performed at an angle of view of 4: 3. Sometimes the region R31-2 is taken as the imaging region. Hereinafter, the region R31-1 and the region R31-2 will be simply referred to as the region R31 unless it is necessary to distinguish them.

The camera module 11 may be configured to be able to switch between the 16: 9 angle of view and the 4: 3 angle of view.

In this case, even when imaging is performed at any angle of view, the four corners of the light receiving surface of the imaging unit 21, that is, the region R32-1 of the upper left corner in the drawing of the light receiving surface and the upper right in the drawing of the light receiving surface. The regions of the corner region R32-2, the light receiving surface in the lower right corner region R32-3, and the light receiving surface in the lower left corner region R32-4 are not used as imaging regions.

Therefore, in the camera module 11, at least one of the regions R32-1 to R32-4 is used as a sensing region. The regions R32-1 to R32-4 correspond to the sensing region R12 shown in FIG. 1, and the sensing pixels described above are formed in the regions R32-1 to R32-4.

By using the four corner areas of the light receiving surface as sensing regions in this manner, the light receiving surface of the imaging unit 21 can be effectively used. Hereinafter, the regions R32-1 to R32-4 are simply referred to as a region R32 unless there is a need to distinguish them.

Further, in the example shown in FIG. 11, an imaging optical system 22 is provided on the near side, ie, the object side in the drawing of the regions R31-1 and R31-2 used as imaging regions. The imaging optical system 22 guides light from an external subject to a region R31-1 or a region R31-2 as an imaging region.

Further, in the drawing of the region R32-1 used as the sensing region, the sensing optical system 301-1 is provided on the front side, that is, the object side in the drawing of the region R32-2 used as the sensing region. Is provided with a sensing optical system 301-2.

Similarly, in the drawing of the region R32-3 used as the sensing region, the sensing optical system 301-3 is provided on the front side, and in the drawing of the region R32-4 used as the sensing region, sensing is performed on the front side An optical system 301-4 is provided.

Each of the sensing optical system 301-1 to sensing optical system 301-4 corresponds to the sensing optical system 23 shown in FIG. 1, and light from an external subject is taken from the area R32-1 to the area R32- Lead to each of the four. Hereinafter, sensing optical system 301-1 to sensing optical system 301-4 will be simply referred to as sensing optical system 301 unless it is necessary to distinguish them. Each sensing optical system 301 has a configuration similar to that of the sensing optical system 23 described above.

As described above, in the example illustrated in FIG. 11, an area at a corner of the light receiving surface, such as any one of the four areas R32 and one of the four areas R32, is used as a sensing area. Also in this case, appropriate spectral information can be obtained.

<Example of application to electronic devices>
Furthermore, the camera module 11 described above can be applied to various electronic devices such as an imaging device such as a digital still camera or a digital video camera, a mobile phone having an imaging function, and other devices having an imaging function.

FIG. 12 is a block diagram illustrating a configuration example of an imaging device as an electronic device to which the present technology is applied.

An imaging device 501 illustrated in FIG. 12 includes an optical system 511, a shutter device 512, a solid-state imaging device 513, a control circuit 514, a signal processing circuit 515, a monitor 516, and a memory 517. It can be imaged.

The optical system 511 includes one or a plurality of lenses, guides light from a subject (incident light) to the solid-state imaging device 513, and forms an image on the light receiving surface of the solid-state imaging device 513.

The shutter device 512 is disposed between the optical system 511 and the solid-state imaging device 513, and controls the light irradiation period and the light shielding period to the solid-state imaging device 513 according to the control of the control circuit 514.

The solid-state imaging device 513 accumulates signal charges for a certain period in accordance with the light imaged on the light receiving surface via the optical system 511 and the shutter device 512. The signal charge stored in the solid-state imaging device 513 is transferred in accordance with a drive signal (timing signal) supplied from the control circuit 514.

The control circuit 514 outputs a drive signal for controlling the transfer operation of the solid-state imaging device 513 and the shutter operation of the shutter device 512 to drive the solid-state imaging device 513 and the shutter device 512.

The signal processing circuit 515 performs various types of signal processing on the signal charge output from the solid-state imaging device 513. An image (image data) obtained by the signal processing circuit 515 performing signal processing is supplied to a monitor 516 for display, or supplied to a memory 517 for recording.

The present technology can also be applied to the imaging device 501 configured as described above. That is, for example, the optical system 511 corresponds to the imaging optical system 22 and the sensing optical system 23, and the solid-state imaging device 513 corresponds to the imaging unit 21. In other words, the optical system 511 to the solid-state imaging device 513 correspond to the camera module 11. Further, spectral information is generated by the signal processing circuit 515 based on the pixel signal output from the sensing pixel of the solid-state imaging device 513.

<Example of use of camera module>
FIG. 13 is a view showing a use example using the camera module 11 described above.

The camera module 11 described above can be used, for example, in various cases for sensing light such as visible light, infrared light, ultraviolet light, and X-rays as described below.

-A device that captures images for viewing, such as a digital camera or a portable device with a camera function-For safe driving such as automatic stop, recognition of driver's condition, etc. A device provided for traffic, such as an on-vehicle sensor for capturing images of the rear, surroundings, inside of a car, a monitoring camera for monitoring a traveling vehicle or a road, a distance measuring sensor for measuring distance between vehicles, etc. Devices used for home appliances such as TVs, refrigerators, air conditioners, etc. to perform imaging and device operation according to the gesture ・ Endoscopes, devices for performing blood vessel imaging by receiving infrared light, etc. Equipment provided for medical and healthcare use-Equipment provided for security, such as surveillance cameras for crime prevention, cameras for personal identification, etc.-Skin measuring equipment for photographing skin, photographing for scalp Beauty, such as a microscope Equipment provided for use-Equipment provided for sports use, such as action cameras and wearable cameras for sports applications, etc.-Used for agriculture, such as cameras for monitoring the condition of fields and crops apparatus

Note that the embodiments of the present technology are not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present technology.

Furthermore, the present technology can also be configured as follows.

(1)
A pixel array unit having an imaging area provided with pixels for capturing an image, and a sensing area provided with pixels capable of acquiring spectral information different from at least the pixels of the imaging area;
An imaging optical system for guiding external light to the imaging area;
A sensing optical system for guiding light from the outside to the sensing area.
(2)
The camera module according to (1), wherein the pixel array in the sensing area is an array unit in which an array unit including each of the pixels provided with each of a plurality of different color filters is repeatedly arranged.
(3)
The camera module according to (1) or (2), wherein the area of the cross section of the imaging optical system as viewed from the optical axis direction of the imaging optical system is smaller than the area of the imaging region.
(4)
The imaging region is provided at the center of the pixel array unit,
The camera module according to any one of (1) to (3), wherein the sensing area is provided in at least one of the upper end, the lower end, the left end, and the right end of the pixel array unit.
(5)
The imaging region is provided at the center of the pixel array unit,
The camera module according to any one of (1) to (3), wherein the sensing area is provided in at least one of the four corner areas of the pixel array unit.
(6)
The camera module according to any one of (1) to (5), wherein the sensing optical system is configured of a pinhole or a pinhole array provided immediately above the sensing area.
(7)
The pixel array in the sensing area is a pixel array in which an array unit including each of the pixels provided with each of a plurality of different color filters is repeatedly arranged.
The camera module according to (6), wherein the area of the opening portion of the pinhole or the area of the opening portion of the pinhole constituting the pinhole array is larger than the area of the array unit.
(8)
The ratio of the length in the depth direction to the length in the direction perpendicular to the depth direction in the pinhole or the pinhole constituting the pinhole array is the focal length of the imaging optical system and the imaging area The camera module according to (6) or (7), having substantially the same ratio as the depth direction and the length in the direction perpendicular to the depth direction.
(9)
The sensing optical system includes the pinhole or the pinhole array, and the pinhole or the diffusion plate disposed on the opposite side of the sensing area to the pinhole array (6) to (6) 8) The camera module according to any one of the above.
(10)
The sensing optical system includes one or more optical lenses and one or more diffusion plates disposed on the opposite side to the sensing area with respect to the optical lenses (1) to (5). The camera module according to any one of the above.
(11)
The camera module according to (10), wherein the optical lens is a cylindrical lens.
(12)
The camera module according to any one of (1) to (5), wherein the sensing optical system includes one or more imaging lenses.
(13)
The camera module according to any one of (1) to (5), including a plurality of sensing optical systems that guide light from the outside at different angles of view for each of the plurality of sensing regions.
(14)
The pixel array portion is provided with the sensing area consisting of pixels provided with an infrared light shielding filter, and the sensing area consisting of pixels not provided with the infrared light shielding filter (1) to (1) 13) The camera module according to any one of the above.
(15)
A pixel array unit having an imaging area provided with pixels for capturing an image, and a sensing area provided with pixels capable of acquiring spectral information different from at least the pixels of the imaging area;
An imaging optical system for guiding external light to the imaging area;
An imaging device that guides light from the outside to the sensing area.

DESCRIPTION OF SYMBOLS 11 Camera module, 21 imaging part, 22 imaging optical system, 23-1, 23-2, 23 sensing optical system, 121 light-shielding plate, 122-1 thru | or 122-4, 122 pin hole, 151 diffusion plate, 181 light-shielding plate, 182 diffusion plate, 183 cylindrical lens, 211 shading plate, 212-1 to 212-3, 212 imaging lens, 241 shading plate, 242-1 to 242-3, 242 imaging lens

Claims

A pixel array unit having an imaging area provided with pixels for capturing an image, and a sensing area provided with pixels capable of acquiring spectral information different from at least the pixels of the imaging area;
An imaging optical system for guiding external light to the imaging area;
A sensing optical system for guiding light from the outside to the sensing area.
The camera module according to claim 1, wherein the pixel array in the sensing area is a pixel array in which an array unit including each of the pixels provided with each of the plurality of different color filters is repeatedly arranged.
The camera module according to claim 1, wherein an area of a cross section of the imaging optical system, as viewed in a direction of an optical axis of the imaging optical system, is smaller than an area of the imaging region.
The imaging region is provided at the center of the pixel array unit,
The camera module according to claim 1, wherein the sensing area is provided in at least one of an upper end, a lower end, a left end, and a right end of the pixel array unit.
The imaging region is provided at the center of the pixel array unit,
The camera module according to claim 1, wherein the sensing area is provided in at least one of areas at four corners of the pixel array unit.
The camera module according to claim 1, wherein the sensing optical system is configured by a pinhole or a pinhole array provided immediately above the sensing area.
The pixel array in the sensing area is a pixel array in which an array unit including each of the pixels provided with each of a plurality of different color filters is repeatedly arranged.
The camera module according to claim 6, wherein an area of an opening portion of the pinhole or an area of an opening portion of a pinhole constituting the pinhole array is larger than an area of the array unit.
The ratio of the length in the depth direction to the length in the direction perpendicular to the depth direction in the pinhole or the pinhole constituting the pinhole array is the focal length of the imaging optical system and the imaging area The camera module according to claim 6, wherein the ratio of the length direction to the length direction in the vertical direction is substantially the same.
The sensing optical system according to claim 6, wherein the sensing optical system includes the pinhole or the pinhole array, and a diffusion plate disposed on the side opposite to the sensing region with respect to the pinhole or the pinhole array. Camera module.
The camera module according to claim 1, wherein the sensing optical system includes one or more optical lenses, and one or more diffusion plates disposed on the opposite side to the sensing area with respect to the optical lenses. .
The camera module according to claim 10, wherein the optical lens is a cylindrical lens.
The camera module according to claim 1, wherein the sensing optical system is configured of one or more imaging lenses.
The camera module according to claim 1, wherein each of the plurality of sensing optical systems guiding light from the outside at a different angle of view is provided to each of the plurality of sensing regions.
The pixel array portion is provided with the sensing area consisting of pixels provided with an infrared light shielding filter, and the sensing area consisting of pixels not provided with the infrared light shielding filter. Camera module.
A pixel array unit having an imaging area provided with pixels for capturing an image, and a sensing area provided with pixels capable of acquiring spectral information different from at least the pixels of the imaging area;
An imaging optical system for guiding external light to the imaging area;
An imaging device that guides light from the outside to the sensing area.