JP3863319B2 - Parallax image capturing apparatus and camera - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a parallax image imaging device and a camera that capture parallax images obtained when a subject is viewed from different points. In particular, the present invention relates to a parallax image capturing device and a camera that simultaneously capture a plurality of parallax images.
[0002]
[Prior art]
In the field of image processing and image recognition, as a method for extracting information in the depth direction of an object, the amount of parallax between parallax images is detected using multiple parallax images obtained when the object is viewed from different points. In general, a method of calculating the depth of an object from the amount of parallax is taken.
[0003]
Conventionally, as an apparatus for capturing a plurality of parallax images, there has been a parallax image capturing apparatus illustrated in FIG. 1. The conventional parallax imaging device has a light passage portion 5 having an opening portion that allows light on the pupil plane of the optical lens 4 to pass therethrough, moves the opening portion in a direction parallel to the optical lens, and images that have passed through the opening portion. A plurality of parallax images are sequentially captured by causing the light receiving unit to capture images (Japanese Patent Laid-Open No. 10-42314).
[0004]
In FIG. 1, when the opening is at the position 6 a, an in-focus image 3 c of the object 3 is formed at a position away from the light receiving unit 7, and the defocused image 3 a is captured by the light receiving unit 7. . When the opening moves to the position 6b, the in-focus image 3c of the object 3 is formed at the same position, but the light-receiving unit 7 captures the out-of-focus image 3b at a position different from the image 3a. The A shift from the image 3a to the image 3b captured by the light receiving unit 7 is referred to as a parallax amount. If the amount of parallax is measured, the distance from the position 6a to 6b of the opening and the focal length of the optical lens 4 are known, so the distance from the optical lens 4 to the object 3 can be calculated by the lens formula. it can. When the amount of parallax is detected for all regions of the subject and the distance from the optical lens 4 to the region is calculated, the distance distribution of the subject can be obtained.
[0005]
As another method for capturing a parallax image, a plurality of openings are provided in the light passage unit 5, one of the openings is opened at a predetermined time interval, the remaining openings are closed, and a plurality of parallax images are sequentially captured. (Japanese Patent Laid-Open No. 10-271534).
[0006]
[Problems to be solved by the invention]
In order to obtain the depth of the subject, it is necessary to compare images between parallax images and detect the parallax amount. However, when a plurality of parallax images are captured by the method described above, there is a time difference from when the first parallax image is captured to when the second parallax image is captured. If the camera is held by hand, an error due to camera shake may occur during this time difference. Also, the subject may move during this time difference. Therefore, it is inevitable that an error occurs in a plurality of captured parallax images, and there is a problem that accurate depth information of the subject cannot be obtained.
[0007]
Accordingly, an object of the present invention is to provide a parallax imaging device and a camera that can detect a parallax amount with high accuracy and obtain an accurate depth of a subject in order to solve the above-described problems. This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention.
[0008]
[Means for Solving the Problems]
That is, the parallax image imaging device according to the first aspect of the present invention is a parallax image imaging device that captures a plurality of parallax images obtained when viewing the subject from different points, and is a single light that forms an image of the subject. An image forming unit on the axis, a light receiving unit in which a plurality of light receiving elements are arranged, and an object is imaged by the image forming unit, and light that has passed through the first and second regions in the image forming unit The light receiving part having the first and second openings to be irradiated with the first image passing through the first opening and the second image passing through the second opening are received by different light receiving parts. And an optical separation unit that causes the device to simultaneously image.
[0009]
You may provide the 1st and 2nd opening part optical filter which the 1st and 2nd opening part of a light passage part permeate | transmits a different light component, respectively.
[0010]
A first light-receiving unit optical filter that transmits again the light component that has passed through the first aperture optical filter, and a second light reception that transmits the light component that has passed through the second aperture optical filter again. The first light receiving unit optical filter and the second light receiving unit optical filter may be alternately arranged.
[0011]
The first and second aperture optical filters of the light passing portion may be aperture specific wavelength component transmission filters that transmit different specific wavelength components of light.
[0012]
The optical separation unit includes first and second light receiving unit specific wavelength component transmission filters that transmit the same wavelength components as the first and second aperture specific wavelength component transmission filters of the light passage unit, respectively. 1 and the second light receiving unit specific wavelength component transmission filters may be alternately arranged to cover the light receiving unit.
[0013]
The first light receiving unit specific wavelength component transmission filter has filters that transmit specific RGB wavelength components λR1, λG1, and λB1, respectively, and the second light receiving unit specific wavelength component transmission filter has specific RGB wavelength components λR2, λG2 And λB2 respectively, a filter that transmits the wavelength component λR1 and a filter that transmits the wavelength component λR2 are adjacent to each other, and a filter that transmits the wavelength component λG1 and a filter that transmits the wavelength component λG2 are adjacent to each other. You may arrange | position so that the filter which permeate | transmits component (lambda) B1 and the filter which permeate | transmits wavelength component (lambda) B2 may adjoin.
[0014]
The first and second aperture optical filters of the light passage portion may be aperture-specific polarization component transmission filters that transmit light having polarization planes in the horizontal direction and the vertical direction, respectively.
[0015]
The optical separation unit has a specific polarization component transmission / reception light-receiving unit filter that transmits light having horizontal and vertical polarization planes, and transmits specific polarization component transmission / reception light that has horizontal and vertical polarization planes. Partial filters may be alternately arranged to cover the light receiving unit.
[0016]
The optical separation unit has a polarization component separation unit that separates light having horizontal and vertical polarization planes, and the light receiving unit receives light having a horizontal polarization plane separated by the polarization component separation unit. You may have the 1st light-receiving surface which light-receives, and the 2nd light-receiving surface which light-receives the light which has the polarization plane of the perpendicular direction separated by the polarization component separation part.
[0017]
You may further provide the electrical separation part which isolate | separates the 1st and said 2nd image imaged by the light-receiving part.
[0018]
The light receiving element may be a charge coupled device, and the light receiving unit may be a photoelectric conversion imaging body in which a plurality of the charge coupled devices are arranged.
[0019]
The camera according to the second aspect of the present invention is a camera that acquires information related to a distance to a subject, and includes a first optical imaging unit having a single optical axis that forms an image of the subject and a plurality of light receiving elements. A first light receiving unit on which a subject is imaged by the first optical imaging unit, and light that has passed through the first and second regions in the first optical imaging unit is irradiated to the first light receiving unit. An optical passage that has a first and a second opening to be made, and a first image that has passed through the first opening and a second image that has passed through the second opening are simultaneously picked up by different light receiving elements. A separation unit and a distance calculation unit that calculates a distance from the first optical imaging unit to at least one point on the subject based on the first and second images are provided.
[0020]
A second optical imaging unit that forms an image of the subject, a second light receiving unit that forms an image of the subject by the second optical imaging unit, and a distance calculated by the distance calculation unit And a control unit that controls at least one of the focus of the unit, the stop, and the exposure time of the second light receiving unit.
[0021]
The second light receiving unit on which the subject is imaged by the first optical imaging unit and the distance calculated by the distance calculating unit, the focus of the first optical imaging unit, the stop, and the second light receiving unit And a controller that controls at least one of the exposure times.
[0022]
The light passing unit and the optical separating unit may further include a driving unit that moves outside the optical path while the subject is received by the light receiving unit.
[0023]
The light passing part further includes a third opening for irradiating the light receiving part with the light that has passed through the third region in the first optical imaging part, and the optical separation part includes With the second opening opened and the third opening closed, the first image passing through the first opening and the second image passing through the second opening are simultaneously applied to different light receiving elements. The light-receiving element may be caused to pick up an image and pass through the third opening in a state where the third opening is opened and the first and second openings are closed in the light passage portion.
[0024]
The first, second and third openings of the light passage part may have a liquid crystal light shutter.
[0025]
The distance calculation unit calculates a first pixel address of the captured first image and a second pixel address of the second image corresponding to the first pixel address, respectively, and sequentially calculates the first pixel. The distance from the optical imaging unit to at least one point on the subject may be calculated by reading the address and the second pixel address.
[0026]
You may further provide the recording part which records the image imaged by the 2nd light-receiving part, and the distance which the distance calculation part calculated.
[0027]
The above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.
[0028]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the claimed invention, and all combinations of features described in the embodiments are described below. However, this is not always essential for the solution of the invention.
[0029]
(Embodiment 1)
FIG. 2 is a configuration diagram of the camera according to the first embodiment of the present invention. The camera of this embodiment includes a parallax image capturing unit 10 as an example of a parallax image capturing device, a lens 52, a diaphragm 54, a shutter 56, a color filter 58, a CCD (charge coupled device) 60, and a multiplexer. 32, an A / D conversion unit 34, a memory 36, a distance calculation unit 38, a control unit 39, and a recording unit 40.
[0030]
The parallax image capturing unit 10 captures a parallax image of the subject and inputs an output signal to the multiplexer 32. The lens 52 forms an image of the subject, the aperture 54 adjusts the aperture amount, and the shutter 56 adjusts the exposure time. The color filter 58 decomposes RGB components of light received through the lens 52. The CCD 60 receives the subject image formed by the lens 52, converts it into an electrical signal, and outputs it to the multiplexer 32.
[0031]
The multiplexer 32 outputs the output signal of the parallax image capturing unit 10 or the CCD 60 to the A / D conversion unit 34. The A / D converter 34 converts the input analog signal into a digital signal and outputs it to the memory 36. The memory 36 stores the input digital signal. The memory 36 stores a subject image captured by the lens 52 on the CCD 60 and a subject parallax image captured by the parallax image capturing unit 10.
[0032]
The distance calculation unit 38 reads the parallax image from the memory 36, and calculates the distance from the camera to the subject based on the parallax image.
[0033]
Based on the color information, brightness, and saturation of the subject image read from the memory 36 and the distance information output by the distance calculation unit 38, the control unit 39 focuses the lens 52, the aperture amount of the aperture 54, and the shutter 56. Control at least one of the exposure times.
[0034]
The recording unit 40 records the subject image read from the memory 36 and the subject distance information output by the distance calculation unit 38. The recording unit 40 may be a magnetic recording medium such as a floppy disk or a nonvolatile memory such as a flash memory.
[0035]
Conventionally, main subjects are extracted based on the color distribution, luminance distribution, texture distribution, etc. of the image of the subject, but there are color distribution, luminance distribution, texture distribution, etc. between the main subject and other subjects. If it is not different, it is difficult to distinguish between the main subject and the other subjects, and it is difficult to determine which subject to adjust the shooting conditions such as focus, aperture, and exposure time. there were.
[0036]
According to the camera of the present embodiment, since the distance distribution of the subject captured in each pixel of the subject can be acquired, in addition to information such as the color distribution, luminance distribution, texture distribution, etc. of the subject image, Based on the distance distribution information, the main subject can be extracted more reliably. Therefore, it is possible to appropriately adjust the shooting conditions such as the focus, the aperture amount, and the exposure time for the extracted main subject.
[0037]
FIG. 3 is a configuration diagram of the parallax image capturing unit 10. The parallax image imaging unit 10 includes an optical imaging unit 12 that images the light of the subject, and first and second openings 15a and 15b that irradiate the imaging unit 16 with the light that has passed through the optical imaging unit 12. The light passing unit 14 and the imaging unit 16 that images the subject imaged by the optical imaging unit 12 are provided.
[0038]
The light passage unit 14 is placed on the pupil plane of the optical imaging unit 12, passes light through the first and second openings 15a and 15b, and blocks light except at the first and second openings. The first and second openings 15a and 15b of the light passage section 14 are, as an example of the opening optical filter, the first and second opening specific wavelength component transmission filters 22a and 22b that transmit different light components, respectively. Have. The first aperture specific wavelength component transmission filter 22a transmits light having three wavelength components: a red wavelength component λR1, a green wavelength component λG1, and a blue wavelength component λB1. The second aperture specific wavelength component transmission filter 22b transmits light having three wavelength components: a red wavelength component λR2, a green wavelength component λG2, and a blue wavelength component λB2.
[0039]
FIG. 4 is a configuration diagram of the imaging unit 16. The imaging unit 16 includes a plurality of light receiving elements arranged in a matrix, a light receiving unit 20 on which a subject is imaged by the optical imaging unit, and a light receiving unit specification as an example of a light receiving unit optical filter that covers the surface of the light receiving unit 20 A wavelength component transmission filter 18 is provided. The light receiving element of the light receiving unit 20 may be, for example, a photoelectric conversion element such as a CCD (charge coupled device), and the light receiving unit 20 may be a photoelectric conversion imaging body in which a plurality of CCDs are arranged.
[0040]
In FIG. 4, the light receiving part specific wavelength component transmission filter 18 has the same wavelength components as the first aperture specific wavelength component transmission filter 22a (red wavelength component λR1, green wavelength component λG1, and blue wavelength component). The same wavelength components as the first light receiving portion specific wavelength component transmission filter 18a that transmits light having λB1) and the second aperture specific wavelength component transmission filter 22b (wavelength component λR2 in the red region, wavelength component in the green region) and a second light receiving unit specific wavelength component transmission filter 18b that transmits light having a wavelength component of λG2 and a blue region of λB2).
[0041]
The first light receiving unit specific wavelength component transmission filter 18a includes filters that respectively transmit the wavelength components λR1, λG1, and λB1. The second light receiving unit specific wavelength component transmission filter 18b includes filters that transmit the wavelength components λR2, λG2, and λB2.
[0042]
Specify the first and second light receiving parts so that the filters that transmit the wavelength components λR1, λG1, and λB1 and the filters that transmit the wavelength components λR2, λG2, and λB2 are evenly distributed without any deviation. Wavelength component transmission filters 18a and 18b are arranged.
[0043]
For example, the first and second light receiving unit specific wavelength component transmission filters 18a and 18b are horizontally oriented so as to cover the light receiving unit 20 (a direction perpendicular to the direction in which the openings 15a and 15b in FIG. 3 are arranged). May be alternately arranged. In this case, in the first light receiving unit specific wavelength component transmission filter 18a, filters that respectively transmit the wavelength components λR1, λG1, and λB1 are sequentially arranged in the horizontal direction. Further, in the second light receiving unit specific wavelength component transmission filter 18b, filters that respectively transmit the wavelength components λR2, λG2, and λB2 are sequentially arranged in the horizontal direction.
[0044]
Further, the filter that transmits the wavelength component λR1 and the filter that transmits the wavelength component λR2 are adjacent to each other in the vertical direction (the direction in which the openings 15a and 15b in FIG. 3 are arranged) and transmit the wavelength component λG1 and the wavelength component. The filters that transmit λG2 are adjacent to each other in the vertical direction, and the filter that transmits wavelength component λB1 and the filter that transmits the wavelength component λB2 are adjacent to each other in the vertical direction.
[0045]
Thus, the effect | action by arrange | positioning the light-receiving part specific wavelength component transmission filters 18a and 18b is demonstrated together with FIG.
[0046]
The light component that has passed through the first aperture specific wavelength component optical filter 22a passes through the light receiving unit specific wavelength component transmission filter 18a again and is received at the corresponding position of the light receiving unit 20. The light component that has passed through the second opening specific wavelength component optical filter 22 a is transmitted again through the light receiving unit specific wavelength component transmitting filter 18 b and is received at the corresponding position of the light receiving unit 20.
[0047]
Therefore, the first image formed through the first opening and the second image formed through the second opening are optically separated, and the light receiving unit 20 Different light receiving elements can be imaged simultaneously.
[0048]
FIG. 5 is a configuration diagram of a processing unit for a captured parallax image. In FIG. 5, the light receiving unit specific wavelength component transmission filter 18, the light receiving unit 20, the A / D conversion unit 34, the memory 36, and the distance calculation unit 38 are shown.
[0049]
The A / D conversion unit 34 converts the output signal of the light receiving unit 20 into a digital signal and outputs it to the memory 36. In this figure, the multiplexer is omitted, but in the actual operation, the output signal of the light receiving unit 20 is sent to the A / D conversion unit via the multiplexer.
[0050]
The memory 36 includes parallax image storage units 37a and 37b. The parallax image storage units 37a and 37b store the first image 20a and the second image 20b that are transmitted through the light receiving unit specific wavelength component transmission filter 18 and captured by the light receiving unit 20, respectively.
[0051]
The operation of the parallax image storage units 37a and 37b will be described with reference to FIGS.
[0052]
Whether each pixel of the light receiving unit 20 has received the light transmitted through the first or second light receiving unit specific wavelength component transmission filter 18a, 18b in FIG. 4 is determined by the arrangement of the light receiving unit wavelength component transmission filters 18a, 18b. You can know more.
[0053]
Therefore, the first image transmitted through the first opening in FIG. 3 and the second image transmitted through the second opening, which are already optically separated and imaged by the light receiving unit 20, are further electrically connected. And stored in the parallax image storage units 37a and 37b.
[0054]
The parallax image storage units 37 a and 37 b can separate and store the first image and the second image after converting the analog output of the light receiving element of the light receiving unit 20 into a digital signal by the A / D conversion unit 34. it can. As another implementation method, a circuit for separating the analog output of the light receiving element of the light receiving unit 20 is provided, and the first image and the second image are separated at the stage of the analog signal. It may be converted into a signal and stored.
[0055]
The distance calculation unit 38 reads the first image and the second image stored in the parallax image storage units 37a and 37b, detects the parallax amount, and calculates the distance distribution information of the subject.
[0056]
In the above description, a case has been described in which the first and second images captured by the light receiving unit 20 are electrically separated and stored in the parallax image storage units 37a and 37b. Alternatively, it may be stored in the memory 36 without being separated. In that case, the distance calculation unit 38 reads the image stored in the memory 36, identifies which pixel is the pixel of the first or second image from the storage position in the memory 36, and logically determines the first. The first and second images can be identified, the amount of parallax can be detected, and the distance distribution information of the subject can be calculated.
[0057]
A method in which the distance calculation unit 38 detects the amount of parallax from the first and second images and calculates the distance distribution information of the subject will be described. The area of the subject captured in the first image and the second image has a certain amount of parallax. If this amount of parallax is detected, the distance between the openings 15a and 15b in FIG. 3 and the focal length of the optical imaging unit 12 are known, so that the distance from the optical imaging unit 12 to the subject region is determined by the lens formula. The distance can be calculated. In this way, when the amount of parallax is detected for all regions of the subject and the distance from the optical imaging unit 12 to the region is calculated, the distance distribution of the subject is obtained.
[0058]
As described above, when the memory 36 stores the first and second images without separating them, the pixels of the first image and the pixels of the second image are alternately stored. In this case, the distance calculation unit 38 reads the necessary data from the memory 36 based on the pixel address of the first image and the pixel address of the second image corresponding to the pixel, and thereby the distance to the subject. Can be calculated.
[0059]
(Embodiment 2)
FIG. 6 is a configuration diagram of a camera according to the second embodiment of the present invention. The camera of the present embodiment includes an optical imaging unit 12, a light passage unit 14, a light receiving unit 20, a light receiving unit optical filter tray 44, a filter driving unit 42, an A / D conversion unit 34, a memory 36, and the like. , A distance calculation unit 38, a control unit 39, and a recording unit 40.
[0060]
In FIG. 6, the optical imaging unit 12, the light receiving unit 20, the A / D conversion unit 34, the memory 36, the distance calculation unit 38, the control unit 39, and the recording unit 40 are the same as those in the first embodiment. The description is omitted.
[0061]
The light receiving unit optical filter tray 44 includes a light receiving unit specific wavelength component transmission filter 18 and a normal color filter 19.
[0062]
The first and second openings 15a and 15b of the light passing section 14 have opening specific wavelength component transmission filters 22a and 22b, respectively.
[0063]
The filter driving unit 42 can move the light passing unit 14 and the light receiving unit optical filter tray 44 at the same time. When capturing a parallax image of the subject, the filter driving unit 42 moves the light passing unit 14 and the light receiving unit specific wavelength component transmission filter 18 into an optical path from the optical imaging unit 12 to the light receiving unit 20. Thereby, the camera can capture a parallax image of the subject.
[0064]
When the subject is imaged, the filter driving unit 42 moves the light passing unit 14 and the light receiving unit specific wavelength component transmission filter 18 out of the optical path from the optical imaging unit 12 to the light receiving unit 20, and the normal color filter 19. Is moved into the optical path. Thereby, the camera can capture an image of the subject.
[0065]
The process of detecting the amount of parallax from the parallax image and calculating the distance distribution of the subject is the same as in the first embodiment, and thus the description thereof is omitted.
[0066]
According to the present embodiment, unlike the first embodiment, it is possible to capture a parallax image and a subject using the same optical imaging unit and the same light receiving unit. Therefore, by using the common optical imaging unit and the light receiving unit in the imaging of the subject and the distance distribution measurement of the subject, the camera can be downsized and the camera can be manufactured at low cost.
[0067]
(Embodiment 3)
FIG. 7 is a configuration diagram of the parallax image capturing unit 10 in the camera according to the third embodiment of the present invention. The camera of this embodiment is obtained by replacing the parallax image capturing unit 10 in the first embodiment shown in FIG. 2 with the configuration shown in FIG. 7, and the other configuration is the same as the configuration of FIG. The description of the configuration and operation of the common part is omitted.
[0068]
In FIG. 7, the parallax image imaging unit 10 includes an optical imaging unit 12 that images the light of the subject, and a light passage unit that includes first and second openings that irradiate the light that has passed through the optical imaging unit 12. 14, a polarization component separation unit 26 that separates a specific polarization component of light, and imaging units 16 a and 16 b that image the subject imaged by the optical imaging unit 12.
[0069]
The first opening portion 15a of the light passage portion 14 includes, as an example of an opening portion optical filter, an opening portion specific polarization component transmission filter 24a that transmits light having a horizontal polarization plane, and the second opening portion 15b. Has an aperture-specific polarization component transmission filter 24b that transmits light having a vertical polarization plane as an example of the aperture optical filter.
[0070]
As an example of an optical separation unit, a polarization component separation unit 26 that allows light having a horizontal polarization plane to pass and reflects light having a vertical polarization plane in an optical path from the optical imaging unit 12 to the imaging unit 16. And imaging the light having a horizontal polarization plane to the imaging unit 16a and imaging the light having a vertical polarization plane to the imaging unit 16b.
[0071]
The imaging units 16a and 16b include light receiving units 20a and 20b each having a plurality of light receiving elements, and normal color filters 19a and 19b covering the surfaces of the light receiving units 20a and 20b.
[0072]
The first and second images captured by the light receiving units 20a and 20b are stored in the parallax image storage units 37a and 37b via the A / D conversion unit 34, respectively.
[0073]
Since the operation of the distance calculation unit 38 that detects the amount of parallax from the parallax image and calculates the distance distribution of the subject is the same as that of the first embodiment, the description thereof is omitted.
[0074]
(Embodiment 4)
FIG. 8 is a configuration diagram of a camera according to the fourth embodiment of the present invention. The camera of this embodiment includes an optical imaging unit 12, a light passage unit 14, an imaging unit 16, a polarization component separation unit 26, a filter driving unit 42, an A / D conversion unit 34, a memory 36, A distance calculation unit 38, a control unit 39, and a recording unit 40 are included.
[0075]
In FIG. 8, the optical imaging unit 12, the light passage unit 14, the A / D conversion unit 34, the memory 36, the distance calculation unit 38, the control unit 39, and the recording unit 40 are the same as those in the first embodiment. Therefore, the description is omitted. The imaging units 16a and 16b and the polarization component separation unit 26, which are denoted by the same reference numerals as those in FIG. 7, are the same as those in the third embodiment, and thus the description thereof is omitted.
[0076]
The first and second openings 15a and 15b of the light passage section 14 have opening specific polarization component transmission filters 24a and 24b, respectively.
[0077]
The filter driving unit 42 can move the light passage unit 14. When capturing a parallax image, the filter driving unit 42 moves the light passing unit 14 into the optical path from the optical imaging unit 12 to the imaging unit 16. Thereby, the camera can capture a parallax image of the subject.
[0078]
When the subject is imaged, the filter driving unit 42 moves the light passing unit 14 out of the optical path from the optical imaging unit 12 to the imaging unit 16. Thereby, the camera can capture an image of the subject.
[0079]
Since the operation of the distance calculation unit 38 that detects the amount of parallax from the parallax image and calculates the distance distribution of the subject is the same as that of the first embodiment, the description thereof is omitted.
[0080]
According to the present embodiment, unlike the third embodiment, parallax images and subjects can be captured using the same optical imaging unit, the same polarization component separation unit, and the same imaging unit. it can. Therefore, by using the common optical imaging unit and the light receiving unit in the imaging of the subject and the distance distribution measurement of the subject, the camera can be downsized and the camera can be manufactured at low cost.
[0081]
(Embodiment 5)
FIG. 9 is a configuration diagram of the parallax image capturing unit 10 in the camera according to the fifth embodiment of the present invention. The camera of this embodiment is obtained by replacing the parallax image capturing unit 10 in the first embodiment shown in FIG. 2 with the configuration shown in FIG. 9, and the other configuration is the same as the configuration of FIG. The description of the configuration and operation of the common part is omitted.
[0082]
In FIG. 9, the parallax image imaging unit 10 includes an optical imaging unit 12 that images the light of the subject, and first and second openings that irradiate the imaging unit 16 with the light that has passed through the optical imaging unit 12. And a light passage unit 14 and an imaging unit 16 that images the subject imaged by the optical imaging unit 12.
[0083]
The first opening 15a of the light passing section 14 has an opening specific polarization component transmission filter 24a that transmits light having a horizontal polarization plane, and the second opening 15b has a vertical polarization plane. It has an aperture specific polarization component transmission filter 24b that transmits the light it has.
[0084]
The imaging unit 16 includes a light receiving unit 20 and a light receiving unit specific polarization component transmission filter 28 as an example of a light receiving unit optical filter that covers the surface of the light receiving unit 20.
[0085]
The light receiving unit specific polarization component transmission filter 28 includes a light reception unit horizontal polarization component transmission filter 28a that transmits light having a horizontal polarization plane, and a light reception unit vertical polarization component transmission filter 28b that transmits light having a vertical polarization plane. Have
[0086]
As a method of arranging the horizontal polarization component transmission filter 28a and the vertical polarization component transmission filter 28b, it is only necessary that the filters are uniformly distributed without being biased.
[0087]
Since the operation of detecting the amount of parallax from the parallax image and calculating the distance distribution of the subject is the same as that of the first embodiment, description thereof is omitted.
[0088]
(Embodiment 6)
FIG. 10 is a configuration diagram of a camera according to the sixth embodiment of the present invention. The camera of the present embodiment includes an optical imaging unit 12, a light passage unit 14, a light receiving unit 20, a light receiving unit optical filter tray 44, a filter driving unit 42, an A / D conversion unit 34, a memory 36, and the like. , A distance calculation unit 38, a control unit 39, and a recording unit 40.
[0089]
In FIG. 10, since the optical imaging unit 12, the light receiving unit 20, the A / D conversion unit 34, the memory 36, the distance calculation unit 38, the control unit 39, and the recording unit 40 are the same as those in the first embodiment, Description is omitted. Further, the light receiving unit optical filter tray 44 denoted by the same reference numerals as those in FIG. 6 is the same as that in the second embodiment, and thus the description thereof is omitted.
[0090]
The light passage unit 14 is a liquid crystal optical shutter having first, second, and third openings 15a, 15b, and 15c, and electrically switches between light transmission and light blocking in the opening by an electro-optic effect. be able to.
[0091]
The first and second openings 15a and 15b respectively have liquid crystal light shutters having specific wavelength component transmission filters 25a and 25b that transmit different wavelength components, and electrically switch between light transmission and light blocking, The opening can be freely opened and closed.
[0092]
The third opening 15c has a liquid crystal light shutter 25c that does not have a specific wavelength component transmission filter, and can electrically switch between light passage and light blocking to open and close the opening freely.
[0093]
The filter driving unit 42 can move the light receiving unit optical filter tray. When capturing a parallax image of the subject, the filter driving unit 42 moves the light receiving unit specific wavelength component transmission filter 18 into the optical path from the optical imaging unit 12 to the light receiving unit 20, and the light passing unit 14 is configured to perform the first operation. The second openings 15a and 15b are electrically opened, and the third opening 15c is electrically closed. Thereby, the camera can capture a parallax image of the subject.
[0094]
When the subject is imaged, the filter drive unit 42 moves the light receiving unit specific wavelength component transmission filter 18 out of the optical path from the optical imaging unit 12 to the light receiving unit 20, and moves the normal color filter 19 into the optical path. The light passage part electrically opens the third opening 15c, and electrically closes the first and second openings 15a and 15b. Thereby, the camera can capture an image of the subject.
[0095]
The process of detecting the amount of parallax from the parallax image and calculating the distance distribution of the subject is the same as in the first embodiment, and thus the description thereof is omitted.
[0096]
According to the present embodiment, the same optical imaging unit and the same light reception are performed for the parallax image and the subject imaging without moving the light passage unit 14 out of the optical path from the optical imaging unit to the imaging unit. Part. Therefore, the camera can be reduced in size and manufactured at low cost by using a common optical imaging unit, light passage unit, and light receiving unit for imaging the subject and measuring the distance distribution of the subject. it can.
[0097]
(Embodiment 7)
FIG. 11 is a configuration diagram of a camera according to the seventh embodiment of the present invention. The camera of this embodiment includes a parallax image capturing unit 10, a lens 52, an optical path splitting element 53, a diaphragm 54, a relay lens 55, a shutter 56, a color filter 58, a CCD 60, a multiplexer 32, An A / D conversion unit 34, a memory 36, a distance calculation unit 38, a control unit 39, and a recording unit 40 are included.
[0098]
11, the lens 52, the aperture 54, the shutter 56, the A / D conversion unit 34, the memory 36, the distance calculation unit 38, the control unit 39, and the recording unit 40 denoted by the same reference numerals as those in FIG. Since it is the same as that of embodiment, description is abbreviate | omitted.
[0099]
The camera of this embodiment forms an image of a subject using the lens 52. The optical path dividing element 53 divides the optical path of the light that has passed through the lens 52, the light received by the CCD 60 via the aperture 54, the shutter 56, and the color filter 58, and the parallax image capturing unit 10 via the relay lens 55. Divide into input light.
[0100]
The parallax image imaging unit 10 may be any of the parallax image imaging units 10 of the first embodiment, the third embodiment, or the fifth embodiment. The subject image formed by the lens 52 is input to the parallax image capturing unit 10 via the relay lens 55. Since the configuration and operation of the parallax image capturing unit 10 have already been described, description thereof will be omitted.
[0101]
The process of detecting the amount of parallax from the parallax image, calculating the distance distribution of the subject, and controlling the shooting conditions of the camera is the same as in the first embodiment, and thus the description thereof is omitted.
[0102]
The relay lens 55 may be a reduction relay system that reduces an image, and the parallax image capturing unit 10 may be configured by a small optical system and a light receiving unit. On the other hand, the CCD 60 that receives the image of the subject may be a high-definition CCD having a large number of elements. With this configuration, it is possible to form an image of a subject with high resolution on the CCD 60 using the common lens 52 and to capture a parallax image of the subject with low resolution in the parallax image capturing unit 10. it can.
[0103]
According to the camera of the present embodiment, it is possible to capture a subject and a parallax image using the subject image formed by the lens 52. By using a common lens for imaging the subject, the camera can be miniaturized and the camera can be manufactured at low cost.
[0104]
(Embodiment 8)
FIG. 12 is a configuration diagram of a camera according to the eighth embodiment of the present invention. The camera of this embodiment includes a parallax image capturing unit 10, a lens 52, a diaphragm 54, a shutter 56, an image capturing unit 46, an A / D conversion unit 34, a memory 36, a distance calculation unit 38, and a control. A section 39 and a recording section 40.
[0105]
12, the lens 52, the aperture 54, the shutter 56, the A / D conversion unit 34, the memory 36, the distance calculation unit 38, the control unit 39, and the recording unit 40 denoted by the same reference numerals as those in FIG. Since it is the same as that of embodiment, description is abbreviate | omitted.
[0106]
The parallax image imaging unit 10 may be any of the parallax image imaging units 10 of the first embodiment, the third embodiment, or the fifth embodiment. Since the configuration and operation of the parallax image capturing unit 10 have already been described, description thereof will be omitted.
[0107]
The imaging unit 46 causes a silver salt photosensitive film or the like to capture an image of a subject by a photochemical reaction.
[0108]
The process of detecting the amount of parallax from the parallax image, calculating the distance distribution of the subject, and controlling the shooting conditions of the camera is the same as in the first embodiment, and thus the description thereof is omitted.
[0109]
According to the camera of the present embodiment, the distance distribution of the subject is obtained, and based on the distance distribution information of the subject, the photographing conditions such as the focus, the aperture amount, and the exposure time are appropriately adjusted, and the subject image is converted into silver salt. Images can be taken on a photosensitive film or the like.
[0110]
(Embodiment 9)
FIG. 13 is a configuration diagram of a camera according to the ninth embodiment of the present invention. The camera of the present embodiment is a video camera that captures moving images, and includes a parallax image capturing unit 10, a lens 52, a diaphragm 54, a color filter 58, a CCD 60, A / D conversion units 34a and 34b, and a memory 36a. And 36b, a distance calculation unit 38, a control unit 39, and a recording unit 40.
[0111]
13, the lens 52, the diaphragm 54, the color filter 58, the CCD 60, the A / D conversion units 34a and 34b, the memories 36a and 36b, the distance calculation unit 38, the control unit 39, and the recording, which have the same reference numerals as those in FIG. The unit 40 operates in the same manner as in the first embodiment, and thus description thereof is omitted.
[0112]
The parallax image capturing unit 10 may be any of the parallax image capturing units of the first embodiment, the third embodiment, or the fifth embodiment. The parallax image captured by the parallax image capturing unit 10 is stored in the memory 36a, and the distance calculation unit 38 reads the parallax image from the memory 36a, detects the parallax amount, and calculates the distance distribution of the subject. The subject image formed by the lens 52 is received by the CCD 60 and stored in the memory 36b. The captured image of the subject is stored in the recording unit 40. The recording unit 40 may be a recording medium such as a video tape, MO, and DVD.
[0113]
(Embodiment 10)
FIG. 14 is a configuration diagram of a camera according to the tenth embodiment of the present invention. The camera according to the present embodiment is an endoscope apparatus, and images a body such as a stomach and an intestine as an image for medical diagnosis or treatment. In order to observe minute irregularities on the wall surface of the organ in the body, it is important to extract information on the depth of the subject. The endoscope apparatus of the present embodiment captures a subject while acquiring distance distribution information of the subject by capturing a parallax image.
[0114]
The endoscope apparatus according to the present embodiment includes an endoscope 70, a signal processing unit 72, a recording unit 40, and a monitor 74. The distal end portion of the endoscope 70 according to the present embodiment includes a lens 52, a CCD 60, an optical imaging unit 12, a light passage unit 14, and an imaging unit 16, and forms a parallax image between the subject and the subject. .
[0115]
The inside of the tube of the endoscope 70 has a transmission cable 78 and transmits electric signals output from the CCD 60 and the imaging unit 16. The configurations of the optical imaging unit 12, the light passage unit 14, and the imaging unit 16 for capturing a parallax image are the same as those in the first embodiment, the third embodiment, or the fifth embodiment. Part 10 may be used.
[0116]
The signal processing unit 72 is for processing an image picked up by the CCD 60 and the image pickup unit 16, detects the amount of parallax from the parallax image, calculates the distance distribution information of the subject, and performs image processing on the subject image. And output to the monitor 74 and output to the recording unit 40. The signal processing unit 72 outputs to the monitor 74.
[0117]
The monitor 74 displays the subject image together with subject distance information. The monitor 74 may display a stereoscopic image of the subject.
[0118]
In the present embodiment, the CCD 60 and the imaging body 16 are provided at the distal end portion of the endoscope, but the embodiment is not limited to this. The CCD 60 and the imaging body 16 are provided at the rear part of the endoscope, a plurality of relay lenses are provided inside the tube of the endoscope 70, and the image formed by the lens 52 and the optical imaging unit 12 is relayed to the relay lens. The CCD 60 and the imaging body 16 may be imaged at the rear part of the endoscope.
[0119]
According to the endoscope apparatus according to the present embodiment, the subject can be photographed while measuring the distance distribution information of the subject, and minute unevenness on the wall surface of the organ in the body can be observed.
[0120]
As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the description of the scope of claims that embodiments with such changes or improvements can be included in the technical scope of the present invention.
[0121]
【The invention's effect】
As is clear from the above description, according to the present invention, it is possible to simultaneously capture a plurality of parallax images when the subject is viewed from different points, detect parallax amounts of the plurality of parallax images, and obtain depth information of the subject. it can.
[Brief description of the drawings]
FIG. 1 is a configuration diagram of a conventional parallax image capturing device.
FIG. 2 is a configuration diagram of the camera according to the first embodiment of the present invention.
FIG. 3 is a configuration diagram of a parallax image capturing unit.
FIG. 4 is a configuration diagram of an imaging unit.
FIG. 5 is a configuration diagram of a parallax image processing unit.
FIG. 6 is a configuration diagram of a camera according to a second embodiment of the present invention.
FIG. 7 is a configuration diagram of a parallax image capturing unit of a camera according to a third embodiment of the present invention.
FIG. 8 is a configuration diagram of a camera according to a fourth embodiment of the present invention.
FIG. 9 is a configuration diagram of a parallax image capturing unit of a camera according to a fifth embodiment of the present invention.
FIG. 10 is a configuration diagram of a camera according to a sixth embodiment of the present invention.
FIG. 11 is a configuration diagram of a camera according to a seventh embodiment of the present invention.
FIG. 12 is a configuration diagram of a camera according to an eighth embodiment of the present invention.
FIG. 13 is a configuration diagram of a video camera according to a ninth embodiment of the present invention.
FIG. 14 is a configuration diagram of an endoscope according to a tenth embodiment of the present invention.
[Explanation of symbols]
10 parallax imaging unit 12 optical imaging unit
14 Light passing part 16 Imaging part
18 Light receiving part specific wavelength component transmission filter
19 Color filter 20 Receiver
22a, 22b Aperture specific wavelength component transmission filter
24a, 24b Opening specific polarization component transmission filter
26 Polarization component separation unit 28 Light receiving unit specific polarization component transmission filter
32 Multiplexer 34 A / D converter
36 memory 37a, 37b parallax image storage unit
38 Distance calculation unit 39 Control unit
40 Recording unit 42 Filter drive unit
44 Optical receiver optical filter tray 46 Imaging unit
52 Lens 54 Aperture
56 Shutter 58 Color filter 60 CCD

Claims (21)

A parallax image capturing device that captures a plurality of parallax images obtained when viewing a subject from different points,
A single optical axis optical imaging unit for imaging the subject;
A light receiving unit in which a plurality of light receiving elements are arranged, and the subject is imaged by the optical imaging unit;
A light passing portion having a first opening and a second opening for irradiating the light receiving portion with the light that has passed through the first region and the second region in the optical imaging portion;
A first opening optical filter and a second opening optical filter that transmit different light components to the first opening and the second opening, respectively;
An optical separation unit that simultaneously images the first image that has passed through the first opening and the second image that has passed through the second opening to the different light receiving elements of the light receiving unit;
The optical separation unit is
A first light-receiving unit optical filter that transmits again the light component that has passed through the first aperture optical filter;
A second light-receiving unit optical filter that transmits again the light component that has passed through the second aperture optical filter;
Have
The parallax image imaging device, wherein the first light receiving unit optical filter and the second light receiving unit optical filter are alternately arranged .   The first aperture optical filter and the second aperture optical filter are a first aperture specific wavelength component transmission filter and a second aperture specific wavelength component transmission filter that transmit different specific wavelength components of light, respectively. The parallax image imaging device according to claim 1. The optical separation unit transmits the same wavelength component as the first aperture specific wavelength component transmission filter, and the same wavelength as the second aperture specific wavelength component transmission filter. A second light receiving part specific wavelength component transmission filter that transmits the component,
The parallax imaging device according to claim 2, wherein the first light receiving unit specific wavelength component transmission filter and the second light receiving unit specific wavelength component transmission filter are alternately arranged to cover the light receiving unit. The first light receiving unit specific wavelength component transmission filter includes a filter that transmits the wavelength component λR1, the wavelength component λG1, and the wavelength component λB1, respectively.
The second light receiving unit specific wavelength component transmission filter has a filter that transmits the wavelength component λR2, the wavelength component λG2, and the wavelength component λB2, respectively.
A filter that transmits the wavelength component λR1 and a filter that transmits the wavelength component λR2 are adjacent to each other, and a filter that transmits the wavelength component λG1 and a filter that transmits the wavelength component λG2 are adjacent to each other, and transmit the wavelength component λB1 The parallax image capturing device according to claim 3, wherein a filter that transmits light and a filter that transmits the wavelength component λB2 are adjacent to each other.   The first aperture specific polarization component transmission filter and the second aperture specific polarization component transmission filter through which the first aperture optical filter and the second aperture optical filter transmit light having a polarization plane in the horizontal direction or the vertical direction, respectively. The parallax imaging device according to claim 1, wherein The optical separation unit has a light receiving unit specific polarization component transmission filter that transmits light having horizontal and vertical polarization planes,
The parallax image imaging device according to claim 5, wherein the light receiving unit specific polarization component transmission filters that transmit light having polarization planes in the horizontal direction and the vertical direction cover the light receiving unit by being alternately arranged.   The parallax image imaging device according to claim 1, further comprising an electrical separation unit that separates the first image and the second image captured by the light receiving unit. The light receiving element is a charge coupled device;
The parallax image imaging device according to claim 1, wherein the light receiving unit is a photoelectric conversion imaging body in which a plurality of the charge coupled devices are arranged. A camera that acquires information about the distance to the subject,
A first optical imaging unit having a single optical axis for imaging the subject;
A first light receiving unit in which a plurality of light receiving elements are arranged, and the subject is imaged by the first optical imaging unit;
A light passing portion having a first opening and a second opening for irradiating the first light receiving portion with light that has passed through the first region and the second region in the first optical imaging portion;
A first opening optical filter and a second opening optical filter that transmit different light components to the first opening and the second opening, respectively;
An optical separation unit that causes the different light receiving elements to simultaneously image the first image that has passed through the first opening and the second image that has passed through the second opening;
A distance calculation unit that calculates a distance from the first optical imaging unit to at least one point on the subject based on the first image and the second image;
The optical separation unit is
A first light-receiving unit optical filter that transmits again the light component that has passed through the first aperture optical filter;
A second light-receiving unit optical filter that transmits again the light component that has passed through the second aperture optical filter;
Have
The camera, wherein the first light receiving unit optical filter and the second light receiving unit optical filter are alternately arranged . A second optical imaging unit for imaging the subject;
A second light receiving unit on which the subject is imaged by the second optical imaging unit;
And a control unit that controls at least one of a focus and a diaphragm of the second optical imaging unit and an exposure time of the second light receiving unit according to the distance calculated by the distance calculation unit. The camera according to claim 9. A second light receiving unit on which the subject is imaged by the first optical imaging unit;
And a control unit that controls at least one of a focus and a diaphragm of the first optical imaging unit and an exposure time of the second light receiving unit according to the distance calculated by the distance calculation unit. The camera according to claim 9.   The camera according to claim 9, further comprising a drive unit that moves the light passing unit and the optical separation unit out of an optical path while the subject is received by the first light receiving unit. The light passing portion further includes a third opening for irradiating the first light receiving portion with the light that has passed through the third region in the first optical imaging portion;
A first image that has passed through the first opening in a state in which the optical separation section opens the first opening and the second opening and closes the third opening in the light passage section; The second image that has passed through the second opening is simultaneously picked up by the different light receiving elements, the third opening is opened, and the first opening and the second opening are closed in the light passage. The camera according to claim 9, wherein an image that has passed through the third opening is captured by the light receiving element.   The camera according to claim 13, wherein the first opening, the second opening, and the third opening have a liquid crystal light shutter.   Based on the first pixel address of the first image and the second pixel address in the second image of the subject imaged at the first pixel address, the distance calculation unit The camera according to claim 9, wherein a distance to the subject imaged at the first pixel address of the first image is calculated.   The camera according to claim 10, further comprising a recording unit that records an image captured by the second light receiving unit and the distance calculated by the distance calculation unit.   A parallax image capturing device that captures a plurality of parallax images obtained when viewing a subject from different points,
  A single optical axis optical imaging unit for imaging the subject;
  A plurality of light receiving elements, a first light receiving unit and a second light receiving unit on which the subject is imaged by the optical imaging unit;
  A light passing portion having a first opening and a second opening for irradiating the first light receiving portion and the second light receiving portion with the light that has passed through the first region and the second region in the optical imaging portion;
  A first aperture optical filter that transmits light having a horizontal polarization plane in the first aperture;
  A second aperture optical filter that transmits light having a plane of polarization perpendicular to the second aperture;
  By transmitting the light transmitted through the first opening optical filter and irradiating the first light receiving unit, the first light receiving unit picks up a first image, and at the same time, the second opening optical filter An optical separation unit that causes the second light receiving unit to capture a second image by reflecting the transmitted light component and irradiating the second light receiving unit;
A parallax image imaging device comprising:   A camera that acquires information about the distance to the subject,
  A first optical imaging unit having a single optical axis for imaging the subject;
  A plurality of light receiving elements, and a first light receiving unit and a second light receiving unit on which the subject is imaged by the first optical imaging unit;
  A light passing portion having a first opening and a second opening for irradiating the first light receiving portion and the second light receiving portion with light that has passed through the first region and the second region in the first optical imaging portion;
  A first aperture optical filter that transmits light having a horizontal polarization plane in the first aperture;
  A second aperture optical filter that transmits light having a plane of polarization perpendicular to the second aperture;
  By transmitting the light transmitted through the first opening optical filter and irradiating the first light receiving unit, the first light receiving unit picks up a first image, and at the same time, the second opening optical filter An optical separation unit that causes the second light receiving unit to capture a second image by reflecting the transmitted light component and irradiating the second light receiving unit;
  A distance calculation unit that calculates a distance from the first optical imaging unit to at least one point on the subject based on the first image and the second image;
A camera characterized by comprising   A second optical imaging unit for imaging the subject;
  A third light receiving unit on which the subject is imaged by the second optical imaging unit;
  A control unit that controls at least one of a focus of the second optical imaging unit, an aperture, and an exposure time of the third light receiving unit according to the distance calculated by the distance calculation unit;
The camera according to claim 18, further comprising:   A third light receiving unit on which the subject is imaged by the first optical imaging unit;
  A control unit that controls at least one of a focus of the first optical imaging unit, an aperture, and an exposure time of the third light receiving unit according to the distance calculated by the distance calculation unit;
The camera according to claim 18, further comprising:   The camera according to claim 18, further comprising a drive unit that moves the light passage unit and the optical separation unit out of an optical path while the subject is received by the first light receiving unit.

Images