JP2003283932A - Compound-eye image input device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a compound-eye image input device capable of determining a view angle of the image, and thereby improving resolution in the compound- eye image input device imaging a plurality of scale-down images of an object on a photodetector, by the use of a microlens array having a plurality of arrayed microlenses. <P>SOLUTION: The device is constituted of a plurality of compound-eye image input portions C disposed on a bending plane 4, thereby the plurality of scale- down images of the object are imaged on the photodetector, by the use of the microlens array having the plurality of arrayed microlenses. The photodetectors are clustered on a unit-by-unit basis, and disposed in eccentric positions against the microlenses. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a compound eye image input device using a plurality of microlenses, and more particularly to a device having an adjustable angle of view.

[0002]

2. Description of the Related Art With the advent of the advanced information society accompanying the recent development of information processing technology, the ratio of image information among information used in various fields has remarkably increased. Therefore, conventionally, as an image input device for efficiently acquiring various image information with high quality, an image having a configuration in which an object image is acquired by a single optical system facing an object as a subject such as a digital camera or a video camera Input devices were widely used. However, in these image input devices, there is a limit to the size and weight reduction of the device due to its configuration. Therefore, in order to meet the demand for further size and weight reduction of the image input device, the compound eye structure seen in insects is imitated. A compound eye image input device has been developed. An example of such a compound-eye image input device is the compound-eye image input device A shown in FIG. 10, which is a technique disclosed in Japanese Patent Laid-Open No. 2001-61109. The compound eye image input device A is shown in FIG.
As shown in (a), a microlens array 1 having a plurality of microlenses 1a arranged in a lattice, a light receiving element 3 having a plurality of light receiving cells 3a formed in a plane, the microlens array 1 and the light receiving element. 3 and a lattice-shaped partition wall 2 arranged between the partition wall 3 and the grid-shaped partition wall 3. Here, a grid portion of the partition wall 2 corresponds to the microlens 1a, and further, a light receiving cell array 3b composed of a plurality of the light receiving cells 3a is configured correspondingly, as shown by a rectangular column by a broken line. In addition, a signal processing unit (unit) is formed. The compound-eye image input device A obtains a single high-resolution image based on a reduced image of a low-resolution subject image formed for each unit (hereinafter, abbreviated as a single-eye image Y). . Here, the flow of processing for acquiring image information using the compound-eye image input device A is shown in FIG.
Will be explained. When the image information of the subject X is obtained by using the compound eye image input apparatus A, first, the individual eye image Y of the subject is formed on the light receiving cell array 3b for each unit. As a result, a plurality of low-resolution unit images Y are formed on the light-receiving element 3 according to the number of units. Then, a high-resolution reconstructed image Z is reconstructed by performing a predetermined signal processing (reconstruction processing) on the basis of the formed plurality of unit images Y. Here, the individual-eye image Y is an image of the subject X taken from different viewpoints by a plurality of units, and parallax is included between the individual-eye images Y. At the time of the reconstructing process, the reconstructed image Z reconstructed based on the image information of the low-resolution single-eye image Y can be made high in resolution by the parallax. In this way, the compound eye image input device A
Despite being a very small and thin structure compared to an image input device using a single optical system, it is possible to realize a bright optical system and obtain high-resolution subject image information. .

[0003]

However, in the compound eye image input apparatus A, since the microlens array 1 and the light receiving element 3 are formed in a flat shape, the compound eye image input apparatus A can be obtained by the compound eye image input apparatus A. The angle of view is
There is no choice but to have a predetermined angle of view determined by the microlens array 1. Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide a compound-eye image capable of appropriately determining the angle of view and thereby further improving the resolution. It is to provide an input device.

[0004]

In order to achieve the above object, the present invention provides a compound eye image input section for forming a plurality of reduced images of an object on a light receiving element by a microlens array in which a plurality of microlenses are arranged. However, it is configured as a compound-eye image input device characterized in that a plurality of them are arranged on a curved surface. With such a configuration, the reconstructed image reconstructed based on the monocular image obtained by the compound-eye image input unit arranged on the curved surface is a wide image corresponding to the degree of curvature of the curved surface. The image will be taken at the corner. here,
A mode in which the degree of curvature of the curved surface is variable is also conceivable, and one example thereof is one in which the curved surface is formed of a flexible substrate. As a result, the user can change the degree of curvature of the curved surface as desired, and can acquire image information at an arbitrary angle of view according to the degree of curvature, and as a compound-eye image input device. The usability of is significantly improved. For example, if it is curved in a convex shape, the visual field direction of each compound-eye image input unit expands outward, so that image information can be acquired at a wider angle of view. On the other hand, if it is curved in a concave shape so that the visual field directions of the respective compound-eye image input units are concentrated inward, the same subject will be imaged by a plurality of compound-eye image input units, and the high resolution of the reconstructed image will be obtained. Can be realized. Furthermore, by arranging so as to surround the subject by curving it in a concave shape, it is possible to simultaneously image the omnidirectional shape of the subject. In addition, this configuration can be considered as a configuration in which the compound eye image input unit configured as an image sensor chip, for example, is arranged on the curved surface in a multi-chip form. Therefore, it is possible to arbitrarily increase the number of pixels as the compound-eye image input device according to the number of image sensor chips arranged on the curved surface, and the reconstructed image obtained after the reconstruction process can be enhanced. Can be refined.

Further, as the light receiving element, a plurality of light receiving cell arrays, which are independently provided for each predetermined area in which a reduced image of an object is formed by the microlens, are arranged in a grid pattern. As a result, a region of the light receiving element that is hidden by the partition wall or an image with large distortion due to the aberration of the microlens is formed,
It is possible to avoid the inconvenience of forming a light receiving cell in an area where only image information of low utility value is obtained, and to eliminate useless light receiving cells. Further, it becomes possible to utilize the region where the light receiving cell is not formed for wiring or processing circuit, and there is a secondary effect that the degree of freedom in device design is improved.

Further, the eccentricity of the light receiving cell array independently provided for each microlens with respect to the microlens may be set according to the position of the light receiving cell array with respect to the compound eye image input section. With such a configuration, it is possible to arbitrarily set the visual field direction for each unit according to the amount of eccentricity, and it is possible to adjust the angle of view that can be captured by the image input unit as necessary.
For example, it is desirable that the eccentricity of the light receiving cell array with respect to the microlens is set to be larger as the light receiving cell array in the peripheral portion of the image input section is set. It is desirable that the image input portion is eccentric toward the center. As a result, the visual field direction of each unit becomes outward as it approaches the peripheral portion, so that the angle of view as the compound-eye image input unit can be widened. On the other hand, it is conceivable that the cell element array is eccentric with respect to the microlenses in a direction opposite to the central direction of the image input section. In that case, since the visual field direction of each unit becomes inward as it approaches the peripheral portion, the visual field direction of the compound eye image input device can be concentrated, and the image information of the subject can be acquired in more detail.

[0007]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments and examples of the present invention will be described below with reference to the accompanying drawings to provide an understanding of the present invention. It should be noted that the following embodiments and examples are merely examples embodying the present invention and are not of the nature to limit the technical scope of the present invention. Here, FIG. 1 is a schematic configuration diagram of a compound eye image input device according to the present embodiment, FIG. 2 is a diagram showing details of connection between a compound eye image sensor chip and a flexible substrate, and FIG. 3 is a curve and angle of view of the flexible substrate. FIG. 4 is a diagram showing the structure of the light receiving element, FIG. 5 is a diagram showing the relationship between the eccentricity of the light receiving cell array and the field of view, and FIG. 6 is a flow chart of the processing relating to the acquisition of image information. FIG. 7, FIG. 7 is a view showing a geometrical optical relationship between a light receiving cell and a pixel of a subject, FIG. 8 is a view showing an example of an image acquired by the compound eye image input device according to the present embodiment, and FIG. FIG. 10 is a diagram showing an example of an image subjected to interpolation processing, and FIG. 10 is a schematic configuration diagram of a conventionally known compound eye image input device.

As shown in FIG. 1, a compound eye image input device B according to an embodiment of the present invention is configured by arranging a plurality of compound eye image sensor chips C (corresponding to an example of a compound eye image input section) on a flexible substrate 4. Composed. The flexible substrate 4
Is composed of a polyimide film having a film thickness of about 40 μm and a copper thin film, and its curvature can be arbitrarily changed. Further, the compound eye image sensor chip C is based on the compound eye image input device A disclosed in the above patent publication (Japanese Patent Laid-Open No. 2001-61109), and its configuration is as shown in FIG. Here, FIG. 2 is a vertical cross-sectional view schematically showing the structure of one compound eye image sensor chip C. The compound-eye image sensor chip C includes a microlens array 1 having a plurality of microlenses 1a arranged in a lattice, a light receiving element 3 having a plurality of light receiving cells 3a formed in a plane, the microlens array 1 and the light receiving element. Grid-shaped partition wall 2 arranged between
And is roughly configured. That is, in the compound-eye image sensor chip C, similar to the above-described conventionally known compound-eye image input device A, the microlens 1a, one grid portion of the partition wall 2 corresponding thereto, and the plurality of light receiving cells 3a.
An individual image is formed for each unit formed by the light receiving cell array 3b configured by. As a result, the compound-eye image sensor chip C can obtain a plurality of individual-eye images formed according to the number of units. here,
As the microlens array 1, for example, a refraction type microlens formed by using a thermal reflow method or a diffraction type microlens formed by using an electron beam drawing method can be used. As the partition wall 2, for example, a stainless steel plate having a plate thickness of 200 μm is laser-processed, or a photo-curable resin obtained by adding benzyl 3% as a photopolymerization initiator to pentaerythritol triacrylate (PETA) is used, and a laser is used. A three-dimensional molded product can be used by scanning. Further, as the light receiving element 3, a CCD element, a CMOS type image sensor or other solid-state image pickup element can be used. Next, a structure for connecting the compound eye image sensor chip C to the flexible substrate 4 will be described. As shown in FIG. 2, the compound eye image sensor chip C has a connection pin 9
Are connected via the printed circuit board 8 fixed on the flexible circuit board 4. Specifically, the light receiving element 3
Is fixed to the printed circuit board 8 by a wire bonding method, the microlens array 1 is fixed by a lens fixing member 7 formed according to the focal length, and the partition wall 2 is a predetermined part of the light receiving element 3. Is stuck in the position. With such a configuration, even when the flexible substrate 4 is deformed, it is possible to prevent excessive stress from acting on the compound-eye image sensor chip C, and particularly the bonding force is weak. It is possible to prevent the detachment of the bonding wire 6, the deformation of the light receiving element 3, and the change of the focal length and other optical characteristics.

Next, the change in the angle of view due to the bending of the flexible substrate 4 will be described with reference to FIG. Here, FIG. 3 shows a plan view from above of the compound-eye image device B in which the flexible substrate 4 is curved in a convex shape. When the angle of view of each unit in the compound eye image sensor chip C is θ, the bending angle between the adjacent compound eye image sensor chips C is α, and the number of the compound eye image sensor chips C is N, the compound eye image input device The angle of view Θ of B is expressed by the following expression 1.

[Equation 1] In this way, the angle of view Θ of the compound-eye image input device B can be arbitrarily expanded according to the bending angle α (degree of curvature).

Next, the structure of the light receiving element 3 provided in the compound eye image sensor chip C will be described with reference to FIG. Here, FIG. 4 shows a plan view of the light receiving element 3 viewed from above. The light receiving element 3 in the present embodiment has the light receiving cell array 3b arranged in a grid (hereinafter referred to as clustering) by disposing the light receiving element array 3b formed for each unit separately. Is. As a result, the light receiving cell 3a
In the area (FIG. 10A) hidden by the partition wall 2, or in the area where only the image information of low utility value can be obtained because an image having a large distortion is formed by the aberration of the microlens 1a. The disadvantage that the light receiving cells 3a are formed can be avoided. As a result, the light receiving cell 3a
It is possible to use the non-existing portion 3c as a region for arranging the wiring and the processing circuit, and the degree of freedom in device design is improved. Furthermore, each light receiving cell array 3 that is clustered
It is also possible to set the eccentric amount of b with respect to the microlens 1a according to the position of the light receiving cell array 3b. In the present embodiment shown in FIG. 4, the light receiving cell array 3 is
The case where b is set so that the closer to the optical axis of the microlens 1a indicated by “+”, the closer to the periphery of the light receiving element 3, the greater the eccentricity toward the center of the light receiving element 3 is shown. There is. FIG. 5 shows the influence on the visual field when the light receiving cell array 3b is decentered with respect to the microlens 1a. If the light receiving cell array 3b is clustered so as to be decentered with respect to the microlens 1a in the direction of the center D of the image input unit 3 as in the present embodiment, as shown in FIG. Since the visual field direction of each unit becomes outward as it approaches the peripheral portion, the entire compound eye image sensor chip C is compared with the case of FIG. 5A in which the light receiving cell array 3b and the microlens 1a are not eccentric. It is possible to widen the field of view (angle of view). Further, conversely to the above, a configuration in which the cell element array 3b is eccentric with respect to the microlens 1a in a direction opposite to the center direction of the light receiving element 3 may be considered. In this case, since the visual field direction of each unit becomes inward as it approaches the peripheral portion, it is easy to understand that the visual field direction of the compound eye image sensor chip C can be concentrated.

Next, the flow of processing for acquiring image information using the compound-eye image input device B according to this embodiment will be described.
This will be described with reference to FIG. When the image information of the subject Y is obtained by using the compound eye image input device B, as in the case of the conventionally known compound eye image input device A described above,
First, a plurality of individual images Y of the subject X are formed for each compound eye image sensor chip C. Here, in the compound-eye image input device B according to the present embodiment, since each of the compound-eye image sensor chips C is arranged in plural on the flexible substrate 4, each of the compound-eye image sensor chips C has the above-mentioned individual number. The eye image Y is acquired. Then, based on the individual eye image Y obtained by all the compound eye image sensor chips C,
The high-resolution reconstructed image Z is reconstructed by performing predetermined signal processing (reconstruction processing). Here, since the individual image Y is an image of the subject X taken in different visual field directions according to the degree of bending of the flexible substrate 4, the individual image Y includes parallax. Therefore, similar to the conventional method, at the time of the reconstruction processing, the high-resolution reconstructed image Z can be reconstructed based on the image information of the low-resolution monocular image Y due to this parallax. . As a result, in the compound-eye image input device B, as compared with the compound-eye image input device A having the conventional configuration, the image information (single-eye image Y) of the subject X that can be acquired by a plurality of arrangements (multi-chip) is obtained. Since the number is increased, the reconstructed image Z obtained by reconstructing based on the image information can have higher resolution.

Further, the outline of the process for reconstructing the reconstructed image Z from the single-eye image Y acquired by the compound-eye image sensor chip C will be described with reference to FIG. Here, if the bending angle α of the flexible substrate 4 and the object distance between the subject X and the compound-eye image input device B are known, it becomes possible to describe the optical system geometrically as shown in FIG.
An area (subject to light shading in the figure) of the subject X for which a certain light receiving cell 3a is acquiring image information, and a center point (pixel) x1 in that area (indicated by dark shading in the figure). Shown) can be specified. Here, the pixel information of x1 in the subject X thus identified is
The light-receiving cell 3a is considered to have been acquired. That is,
At the time of the reconstruction processing, as the pixel information of the position on the reconstructed image Z corresponding to x1 of the subject X, the light receiving cell 3
The pixel value of a is substituted (rearranged). If such processing is sequentially performed on all the light receiving cells 3a in all the compound eye image sensor chips C, a plurality of individual eye images Y obtained by the compound eye image sensor chips C in the multi-chip form are obtained. A single reconstructed image Z can be reconstructed using the image information. Here, in order to acquire a reconstructed image by the above method, it is necessary to measure the bending angle α of the flexible substrate 4. Among the measuring methods, an additional detecting device is added, in which a piezoelectric element is attached to the flexible substrate 4 and a bending angle is calculated according to an electric signal generated according to the displacement amount thereof, an optical fiber. Is attached along the flexible substrate 4 and a bending angle is calculated according to the amount of light loss in the optical fiber, or an LED, a laser or other light emitting element is attached at a predetermined position of the flexible substrate 4 to emit light. A method of calculating the bending angle according to the amount of deviation of the light emitted from the element can be considered. On the other hand, if the additional detection device is not added, the correlation calculation between the acquired individual eye images may be performed, and the bending angle may be calculated based on the shift amount at which the correlation coefficient becomes maximum.

Here, the single reconstructed image Z obtained by performing the above-mentioned processing is the image information (pixel value) of the light receiving cell 3a according to the position of the object X to which the light receiving cell 3a corresponds. Since the image is just rearranged, the subject X at a position that does not correspond to any of the light receiving cells 3a.
In the reconstructed image Z, the image information of (1) becomes a missing pixel in which the image information (pixel) is missing. Therefore, when there is a missing pixel as described above, it is necessary to interpolate using the pixel values around it. In such a case, assuming that the pixel value changes linearly in the horizontal or vertical direction around the deleted pixel, if the deleted pixels are N _del consecutive pixels, the i-th pixel is deleted. Pixel value P to be interpolated for the missing pixel
_del (i) can be calculated by applying the following Expression 2. However,
P1 and P2 are pixel values of pixels adjacent to the deleted pixel.

[0014]

[Equation 2]

Here, for the target deleted pixel,
The above equation 2 is applied in the horizontal and vertical directions, and the average value of the obtained values is set as the pixel value for the deleted pixel. As a result, the image obtained by performing the above-described interpolation processing on the missing pixels included in the reconstructed image Z is more subject X.
Can be a reconstructed image Z close to. Here, if there is no pixel information on a line in the horizontal direction or the vertical direction, interpolation processing cannot be performed on that line and the missing pixel cannot be compensated, but the same processing is performed again. By doing so, those missing pixels can also be interpolated.

Finally, an image acquired by using the compound-eye image input device B according to this embodiment will be described below. FIG. 8 is a computer simulation result showing the individual-eye images Y when the bending angle α of the compound-eye image input device B is changed, and the reconstructed image Z reconstructed based on the individual-eye images Y. Here, as a computer simulation condition, the compound eye image input device B has a 5 × 5 chip configuration, each compound eye image sensor chip C is composed of 2 × 2 units, and each unit is a 32 × 32 light receiving cell. To have. The width of each unit is 2.40 mm, the width of each cell array is 1.92 mm, and the opening of each cell is located at the center of the cell, and one side is 60 μm.
Assumed to be a square. On the other hand, as the subject X,
It was a flat surface with no unevenness, the number of pixels was 512 × 512 pixels, and the image was a gray scale 256 gradation. The compound-eye image input device B is assumed to be curved only in the lateral direction with the center line of the compound-eye image input device B as an axis, and the compound eye image sensor closest to the subject is the compound-eye image sensor arranged in the center. The object distance of the chip C was 1 m. Figure 8
(A) shows that the bending angle α of the compound-eye image input device B is 0.
At 0 degree, that is, a monocular image Y acquired by the planar-structured compound-eye image input device B, and a reconstructed image Z based on it. FIG. 8B shows a monocular image Y acquired when the bending angle α of the compound-eye image input device B is set to 1.0 degree, and a reconstructed image Z based on it. Figure 8
(C) shows the bending angle α of the compound-eye image input device B as 2.
It is a single-eye image Y acquired when it is set to 0 degrees, and a reconstructed image Z based on it. Thus, it can be read that the angle of view of the reconstructed image Z that can be acquired increases as the degree of curvature α increases. However, as the angle of view spreads, the area formed by the deleted pixels (black portion in a grid pattern in the figure) increases, resulting in deterioration of image quality. For this, the pixel can be easily interpolated by performing the above-described interpolation processing.
For example, FIG. 9 shows changes in the image due to the interpolation processing for the reconstructed image Z shown in FIG. Here, in FIG.
(A) is an original reconstructed image Z, (b) is an image after performing interpolation processing based on the above equation 2 on the image of (a),
(C) shows an image after the interpolation process based on the above Expression 2 is further performed on the image of (b). In this way, it is possible to make up a high resolution reconstructed image by compensating for the deleted image by performing a conventionally known simple interpolation process. Therefore, by using the compound-eye image input device B according to the present embodiment, the degree of curvature of the curved surface is changed according to the angle of view desired by the user, and image information is acquired at that desired angle of view. This makes it possible to significantly improve the usability as a compound eye image input device.

[0017]

EXAMPLE In the above embodiment, the flexible substrate 4
As an example, a polyimide film and a copper thin film are considered to be used, but a form in which a compound rubber image input device A arranged on the substrate is connected by a cable using an elastic rubber material can be considered. According to such a form, the degree of freedom with respect to the degree of curvature of the flexible substrate 4 is improved, and for example, the flexible substrate 4 is curved on a spherical surface to obtain image information of 360 degrees around the device. It becomes available. Furthermore, in a situation in which image information of the inside of a container-shaped subject having a narrow opening is imaged, first, the flexible substrate 4 is deformed and inserted into a shape that can pass through the opening, and a predetermined amount is inserted after the insertion. By restoring the shape, it becomes possible to use it as an endoscope, such as capturing internal image information.

[0018]

As described above, according to the present invention, the compound-eye image input unit for forming a plurality of object reduced images on the light receiving element is formed on the curved surface by the microlens array in which the plurality of microlenses are arranged. The multi-eye image input device is configured as a multi-eye image input device. With such a configuration, the reconstructed image reconstructed based on the monocular image obtained by the compound-eye image input unit arranged on the curved surface is a wide image corresponding to the degree of curvature of the curved surface. The image will be taken at the corner. Here, a form in which the degree of curvature of the curved surface is variable is also conceivable, and one example thereof is one in which the curved surface is formed of a flexible substrate. As a result, the user can change the degree of curvature of the curved surface as desired, and can acquire image information at an arbitrary angle of view according to the degree of curvature, and as a compound-eye image input device. The usability of is significantly improved. For example, if it is curved in a convex shape, the visual field direction of each compound-eye image input unit expands outward, so that image information can be acquired at a wider angle of view. On the other hand, if it is curved in a concave shape so that the visual field directions of the respective compound-eye image input units are concentrated inward, the same subject will be imaged by a plurality of compound-eye image input units, and the high resolution of the reconstructed image will be obtained. Can be realized. Furthermore, by arranging so as to surround the subject by curving it in a concave shape, it is possible to simultaneously image the omnidirectional shape of the subject. In addition, this configuration can be considered as a configuration in which the compound eye image input unit configured as an image sensor chip, for example, is arranged on the curved surface in a multi-chip form. Therefore, it is possible to arbitrarily increase the number of pixels as the compound-eye image input device according to the number of image sensor chips arranged on the curved surface, and the reconstructed image obtained after the reconstruction process can be enhanced. Can be refined.

Further, as the light receiving element, a plurality of light receiving cell arrays, which are independently provided for each predetermined region in which a reduced image of an object is formed by the microlens, are arranged in a grid pattern. As a result, a region of the light receiving element that is hidden by the partition wall or an image with large distortion due to the aberration of the microlens is formed,
It is possible to avoid the inconvenience of forming a light receiving cell in an area where only image information of low utility value is obtained, and to eliminate useless light receiving cells. Further, it becomes possible to utilize the region where the light receiving cell is not formed for wiring or processing circuit, and there is a secondary effect that the degree of freedom in device design is improved.

The eccentricity of the light receiving cell array independently provided for each microlens with respect to the microlens may be set according to the position of the light receiving cell array with respect to the compound eye image input section. With such a configuration, it is possible to arbitrarily set the visual field direction for each unit according to the amount of eccentricity, and it is possible to adjust the angle of view that can be captured by the image input unit as necessary.
For example, it is desirable that the eccentricity of the light receiving cell array with respect to the microlens is set to be larger as the light receiving cell array in the peripheral portion of the image input section is set. It is desirable that the image input portion is eccentric toward the center. As a result, the visual field direction of each unit becomes outward as it approaches the peripheral portion, so that the angle of view as the compound-eye image input unit can be widened. On the other hand, it is conceivable that the cell element array is eccentric with respect to the microlenses in a direction opposite to the central direction of the image input section. In that case, since the visual field direction of each unit becomes inward as it approaches the peripheral portion, the visual field direction of the compound eye image input device can be concentrated, and the image information of the subject can be acquired in more detail.

[Brief description of drawings]

FIG. 1 is a schematic configuration diagram of a compound eye image input device according to the present embodiment.

FIG. 2 is a diagram showing details of connection between a compound eye image sensor chip and a flexible substrate.

FIG. 3 is a diagram showing the relationship between the curvature of a flexible substrate and the angle of view.

FIG. 4 is a diagram showing a structure of a light receiving element.

FIG. 5 is a diagram showing a relationship between eccentricity of a light receiving cell array and a field of view.

FIG. 6 is a diagram schematically showing a flow of processing relating to acquisition of image information.

FIG. 7 is a diagram showing a geometrical optical relationship between a light receiving cell and a pixel of a subject.

FIG. 8 is a diagram showing an example of an image acquired by the compound-eye image input device according to the present embodiment.

FIG. 9 is a diagram showing an example of an image subjected to interpolation processing.

FIG. 10 is a schematic configuration diagram of a conventionally known compound eye image input device.

[Explanation of symbols]

A ... Compound eye image input device B ... Compound eye image input device C ... Image sensor chip X ... Subject Y ... Single-eye image Z ... Reconstructed image Θ ... Angle of view of compound eye image input device θ… View angle of unit α ... Bending angle of compound eye image input device 1 ... Micro lens array 1a ... Micro lens 2 ... Partition 3 ... Light receiving element 3a ... Light receiving cell 3b ... Light receiving cell array 3c ... Area without light receiving cell 4 ... Flexible substrate 6 ... Bonding wire 7 ... Lens fixing member 8 ... Printed circuit board 9… Connection pin

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Yoshiki Ichioka             4-15 Kamokogahara, Higashinada-ku, Kobe-shi, Hyogo             −131 F term (reference) 5C024 BX00 CX37 EX43 GX02

Claims (8)

[Claims] 1. A plurality of compound eye image input sections for forming a plurality of object reduced images on a light receiving element are arranged on a curved surface by a microlens array in which a plurality of microlenses are arranged. A characteristic compound eye image input device. 2. The compound eye image input device according to claim 1, wherein the degree of curvature of the curved surface is variable. 3. The compound eye image input device according to claim 1, wherein the curved surface is made of a flexible substrate. 4. The light-receiving element comprises a plurality of light-receiving cell arrays, which are independently provided for each predetermined region in which a reduced image of an object is formed by the microlens, are arranged in a grid pattern. 4. The compound eye image input device according to any one of 3 above. 5. The eccentricity of the light receiving cell array provided independently for each of the microlenses with respect to the microlenses is set according to the position of the light receiving cell array with respect to the compound eye image input section. The compound-eye image input device according to item 1. 6. The compound eye image input device according to claim 5, wherein the eccentric amount of the light receiving cell array with respect to the microlenses is set to be larger as it is closer to the light receiving cell array in the peripheral portion of the image input section. 7. The compound eye image input device according to claim 5, wherein the light receiving cell array is eccentric with respect to the microlenses in a central direction of the image input unit. 8. The compound eye image input device according to claim 5, wherein the light receiving cell array is eccentric with respect to the microlens in a direction opposite to a center direction of the image input unit.