US9912854B2 - Imaging module and imaging apparatus - Google Patents

Imaging module and imaging apparatus Download PDF

Info

Publication number
US9912854B2
US9912854B2 US15/313,116 US201515313116A US9912854B2 US 9912854 B2 US9912854 B2 US 9912854B2 US 201515313116 A US201515313116 A US 201515313116A US 9912854 B2 US9912854 B2 US 9912854B2
Authority
US
United States
Prior art keywords
imaging
spatial light
light modulator
adjuster
space
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
US15/313,116
Other versions
US20170195538A1 (en
Inventor
Tetsuro Saitoh
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ricoh Co Ltd
Original Assignee
Ricoh Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ricoh Co Ltd filed Critical Ricoh Co Ltd
Assigned to RICOH COMPANY, LTD. reassignment RICOH COMPANY, LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SAITOH, TETSURO
Publication of US20170195538A1 publication Critical patent/US20170195538A1/en
Application granted granted Critical
Publication of US9912854B2 publication Critical patent/US9912854B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H04N5/2259—
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00—Details of cameras or camera bodies; Accessories therefor
    • G03B17/02—Bodies
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/58—Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
    • G—PHYSICS
    • G02—OPTICS
    • G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
    • G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour 
    • G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour  based on liquid crystals, e.g. single liquid crystal display cells
    • G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
    • G02F1/1333—Constructional arrangements; Manufacturing methods
    • G02F1/133308—Support structures for LCD panels, e.g. frames or bezels
    • G—PHYSICS
    • G02—OPTICS
    • G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
    • G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour 
    • G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour  based on liquid crystals, e.g. single liquid crystal display cells
    • G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
    • G02F1/1333—Constructional arrangements; Manufacturing methods
    • G02F1/133382—Heating or cooling of liquid crystal cells other than for activation, e.g. circuits or arrangements for temperature control, stabilisation or uniform distribution over the cell
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
    • H04N5/2254—
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/521—Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light

Definitions

  • the present invention relates to an imaging module and an imaging apparatus using a spatial light modulator.
  • An imaging apparatus represented by a camera has been used for many systems, for example, a photographing system, an industrial measurement and object recognition system, and a vehicle hazard detection and security monitoring system.
  • the imaging apparatus for use in these systems is required to obtain not only a subject image but also spatial information such as a distance and an eyesight direction.
  • Patent Literature 1 and Non Patent Literatures 1 to 3.
  • These literatures describe a technique that obtains information regarding an incident angle and a space of a light flux incident on an imaging element by executing a decoding process based on Fourier transform with the imaging element and a coded aperture pattern.
  • Another known technique uses an active spatial light modulator, that is, reconstructible into the coded aperture pattern, to decode images captured with different types of coded patterns for the purpose of improving image quality.
  • the spatial light modulator and the imaging element such as a CCD image sensor and a CMOS image sensor are arranged adjacent to each other to achieve a highly accurate process (for example, Patent Literature 1).
  • the positional offset occurs between the light-receiving portion of the imaging element and the opening portion of the spatial light modulator by thermal expansion of a member caused by a change in environmental temperature of the imaging apparatus.
  • Such a positional offset significantly affects measurement errors.
  • the present invention has been made in view of the above circumstances and aims to provide an imaging module to achieve a highly accurate process by reducing a decrease in accuracy caused by a change in environmental temperature.
  • an aspect of the present invention provides an imaging module including a spatial light modulator that spatially modulates an incident light flux to emit a modulated light flux, an imaging element that obtains the modulated light flux by the spatial light modulator as image information, and an adjuster that adjusts a space between an imaging surface of the imaging element and the spatial light modulator, wherein the adjuster operates to reduce the space between the imaging surface and the spatial light modulator in response to a temperature rise.
  • an imaging module that reduces a decrease in accuracy caused by a change in environmental temperature to achieve a highly accurate process can be provided.
  • FIGS. 1A, 1B, and 1C are views showing an entire configuration of an imaging module and an imaging apparatus according to embodiments of the present invention.
  • FIG. 2 is a view showing a configuration of an imaging module according to a first embodiment of the present invention.
  • FIGS. 3A and 3B are schematic views showing a light-receiving operation of the imaging module illustrated in FIG. 2 .
  • FIGS. 4A and 4B are views showing a configuration of an imaging module according to a second embodiment of the present invention.
  • FIG. 5 is a perspective view showing a configuration of the imaging module illustrated in FIGS. 4A and 4B .
  • FIG. 6 is a view showing a configuration of an imaging module according to a third embodiment of the present invention.
  • FIG. 7 is a view showing a configuration of an imaging module according to a fourth embodiment of the present invention.
  • An imaging apparatus 1 illustrated in FIG. 1A includes an imaging module 2 that obtains an image, an imaging forming optical system 3 that forms an image with an incident light flux to be emitted to the imaging module 2 , and a controller 9 as a process circuit that executes a decoding process to a captured image.
  • an optical axis direction of the incident light flux is represented as a Z-axis direction
  • directions vertical to the Z-axis direction are represented as a Y-axis direction and an X-axis direction respectively, as illustrated by arrows in FIGS. 1A, 1B, and 1C .
  • the imaging module 2 includes a spatial light modulator 21 that spatially modulates the incident light flux and emits the modulated incident light flux and an imaging element 22 that obtains the spatially modulated light flux as image information.
  • the imaging module 2 also includes an adjuster 23 that adjusts a space between the imaging element 22 and the spatial light modulator 21 and a fixed portion 24 that fixes the imaging element 22 for protection.
  • the imaging module 2 further includes a wiring 25 that electrically connects the spatial light modulator 21 and the controller 9 .
  • the spatial light modulator 21 which is made of a transmissive liquid crystal device, spatially modulates the incident light flux by forming a corded aperture pattern, i.e., a mosaic pattern that is formed by changing a transmittance in each position with the controller 9 .
  • the spatial light modulator 21 is mainly made of a quartz board and thus has a coefficient of thermal expansion of 5 ⁇ 10 ⁇ 7 /K of the quartz board.
  • the imaging element 22 which is made of an image sensor using a CCD as a photosensor array, obtains the light flux spatially modulated by the spatial light modulator 21 as image information.
  • a photosensor array 28 as an imaging surface which is made of a plurality of photodiodes as light receiving elements, is disposed on the imaging element 22 .
  • the imaging element 22 converts information of the light flux incident on the imaging surface, for example, an intensity of the light flux into electric signals.
  • the image sensor uses a CCD, but any image sensor, for example, a Complementary Metal-Oxide Semiconductor (CMOS) sensor may be used as long as it can obtain image information.
  • CMOS Complementary Metal-Oxide Semiconductor
  • the imaging element 22 is located below the spatial light modulator 21 to have the photosensor array 28 face the spatial light modulator 21 .
  • the imaging element 22 is mainly made of a single-crystal silicon board, and thus has a coefficient of thermal expansion of 2.4 ⁇ 10 ⁇ 6 /K of the single-crystal silicon board.
  • the adjuster 23 abuts on the imaging element 22 and is disposed on the opposite side of the spatial light modulator 21 across the photosensor array 28 .
  • the adjuster 23 is made of a polyimide sheet having a coefficient of thermal expansion of 6 ⁇ 10 ⁇ 5 /K.
  • the adjuster 23 is located below the imaging element 22 to abut on the lower side of the imaging element 22 .
  • the fixed portion 24 is made of a ceramic concaved protection member as an exterior package that fixes the imaging element 22 to be protected.
  • the imaging element 22 is held in a bottom surface of the concaved protection member.
  • the fixed portion 24 is mainly made from alumina, and thus has a coefficient of thermal expansion of 7 ⁇ 10 ⁇ 6 /K of the alumina.
  • the imaging forming optical system 3 includes an imaging lens group 30 having at least one lens.
  • the imaging lens group 30 is disposed to form an image on the imaging element 22 .
  • the imaging forming optical system 3 is disposed to form an image on the imaging element 22 with the light flux incident on the imaging apparatus 1 . More specifically, the imaging forming optical system 3 is located above the imaging module 2 to focus on the imaging element 22 .
  • the controller 9 operates as a spatial light modulation pattern generator, a decoding processor that converts a light flux having transmitted through the spatial light modulator 21 into image information, and an image property analyzer that separates a field angle based on the obtained image information to obtain an image having spatial information such as a distance and a direction.
  • the light flux incident on the imaging apparatus 1 is deflected by the imaging lens group 30 to form an image on the imaging element 22 .
  • the light flux having transmitted through the imaging forming optical system 3 is incident on the spatial light modulator 21 , and is spatially modulated by the spatial light modulator 21 .
  • the controller 9 as an element driver controls a transmittance distribution of the spatial light modulator 21 by using a spatial transmittance distribution in which a plurality of sine waves of different periods are superimposed.
  • a minimum unit capable of controlling the transmittance distribution is referred to as a cell.
  • the spatial light modulator 21 forms the coded aperture pattern by changing a transmittance in each cell in response to the electric signals, namely, periodical modulation signals, from the controller 9 as the element driver.
  • the spatial light modulator 21 spatially modulates the light flux passing through the spatial light modulator 21 by periodically changing the transmittance of each cell.
  • the controller 9 thus operates as the spatial light modulation pattern generator.
  • a distribution of a finite spatial frequency spectrum band of an image is copied in a form of convolution in the spatial frequency position corresponding to the period of the sine waves, namely, on the Fourier transformed horizontal axis.
  • the distribution of the spatial frequency spectrum of a subject is copied on the axis of the spatial frequency by the number of sine wave cycles.
  • the filed angle can be separated by the mixture of the frequency information of an angular component depending on the frequency of the sine wave.
  • distance information relative to a subject can be obtained by optimizing a distance resolution for a targeted subject in an image.
  • a method for obtaining such spatial information will be described with reference to an example for obtaining distance information.
  • the controller 9 as the spatial light modulation pattern generator generates a spatial light modulation pattern.
  • the controller 9 obtains an image by using the generated spatial light modulation pattern, and extracts field-angle separated information.
  • the controller 9 as a distance resolution determiner and the image property analyzer analyzes the field-angle separated information, and calculates distance information on a local position of the targeted subject in the image.
  • the controller 9 as the distance resolution determiner determines whether the obtained image has a predetermined resolution from the distance information calculated as described above.
  • the controller 9 determines that the resolution of the image is insufficient, the controller 9 as the spatial light modulation pattern generator recalculates the period of the sine wave constituting the spatial light modulation pattern.
  • the controller 9 changes the filed-angle separated resolution based on the calculated spatial light modulation pattern to regenerate the spatial light modulation pattern, and thus obtains a new image.
  • the controller 9 optimizes the distance resolution by forming such a feedback loop, and finally obtains a distance image appropriate to the targeted subject.
  • the spatial light modulator 21 and the photosensor array 28 of the imaging element 22 are arranged adjacent to each other to achieve a highly accurate process.
  • a positional offset slightly occurs between the photosensor array 28 as a light receiver of the imaging element 22 and an opening portion of the spatial light modulator 21 .
  • Such a positional offset significantly affects measurement errors.
  • the spatial light modulation pattern of the spatial light modulator 21 includes high transmittance opening portions 21 a shown by white portions and low transmittance closed portions 21 b shown by black portions.
  • FIG. 3A schematically shows a projection pattern L in which the light fluxes transmitted through the opening portions 21 a of the spatial light modulator 21 are measured on the photosensor array 28 .
  • the projection pattern L increases in height on the Z axis in response to an intensity of the light flux.
  • Such a pattern diagram shows that in an ideal condition the spatial light modulator 21 and the imaging element 22 have no difference in coefficient of thermal expansion, so that a typical projection pattern L 1 is detected.
  • the spatial light modulator 21 and the imaging element 22 actually have a difference in coefficient of thermal expansion caused by exhaust heat of the imaging apparatus 1 , an environmental temperature for the imaging apparatus 1 , or absorption of the light flux transmitted through the spatial light modulator 21 .
  • a positional offset of about 1 ⁇ m occurs between the spatial light modulator 21 and the imaging element 22 in the Y-axis direction.
  • An actual projection pattern L is detected as an expanded projection pattern L 2 by the difference in coefficient of thermal expansion.
  • a pattern difference L′ between the projection pattern L 2 and the projection pattern L 1 is about 1 ⁇ m.
  • the imaging element 22 is a high-accuracy, high-resolution advanced element, and the size of one pixel arranged in the photosensor array 28 is about 5 ⁇ m, the positional offset of about 1 ⁇ m causes an error of about 20% in distance measurement.
  • the imaging module 2 includes the adjuster 23 that adjusts the space between the photosensor array 28 and the spatial light modulator 21 to reduce the positional offset between the spatial light modulator 21 and the imaging element 22 caused by the change in environmental temperature, and thus to achieve a highly accurate process with less error.
  • the adjuster 23 operates to reduce the space between the photosensor array 28 and the spatial light modulator 21 in response to a temperature rise.
  • FIG. 3B is an enlarged view of the expanded imaging element 22 by the above-described thermal expansion. Since the coefficient of thermal expansion of the imaging element 22 is significantly larger than that of the spatial light modulator 21 , the projection pattern L of the light flux from the spatial light modulator 21 remains almost unchanged in relative terms. Thus, it can be approximately considered that the photosensor array 28 is expanded on the imaging element 22 in the Y-axis direction.
  • the light flux is incident on a position of the imaging element 22 shifted from the initial position when the imaging element 22 does not expand, causing the pattern difference L′.
  • the adjuster 23 expands in the Z-axis direction to move the position of the photosensor array 28 in the Z-axis direction toward the spatial light modulator 21 , thereby reducing the positional offset of the light fluxes incident on the photosensor array 28 from that in case of no adjuster 23 provided.
  • the space between the photosensor array 28 and the spatial light modulator 21 reduces.
  • the positional offset of the light fluxes incident on the photosensor array 28 can be thereby reduced to achieve a highly accurate process.
  • the adjuster 23 abuts on the imaging element 22 , and is disposed on the opposite side of the spatial light modulator 21 across the photosensor array 28 .
  • the coefficient of thermal expansion of the adjuster 23 is larger than that of the spatial light modulator 21 .
  • the positional offset of the light fluxes incident on the photosensor array 28 can be thereby reduced to reduce a decrease in accuracy and to achieve a highly accurate process.
  • the space between the photosensor array 28 and the spatial light modulator 21 is adjusted without a driver. Consequently, members such as a control circuit and a power source can be omitted to conserve a space and to achieve downsizing.
  • FIGS. 4A, 4B, and 5 A second embodiment of the present invention will be described with reference to FIGS. 4A, 4B, and 5 .
  • the adjuster 23 includes a heat sink 231 having columnar projections formed on a plate-like base and a buffer 232 disposed between the heat sink 231 and the imaging element 22 .
  • the heat sink 231 is made from aluminum and has a bonded surface 231 a as a contact surface with the buffer 232 and a fixed surface 231 b as a contact surface with the fixed portion 24 , as illustrated in FIG. 4B .
  • the area of the bonded surface 231 a is smaller than that of the fixed surface 231 b.
  • the heat sink 231 is mainly made from aluminum, and thus, has a coefficient of thermal expansion of 2 ⁇ 10 ⁇ 5 /K of the aluminum.
  • the use of the metal such as aluminum having a large coefficient of thermal expansion for the adjuster 23 reduces the space between the photosensor array 28 and the spatial light modulator 21 , and reduces a decrease in accuracy to achieve a highly accurate process while improving the stiffness of the adjuster 23 and the mechanical positional accuracy.
  • the heat sink 231 effectively releases heat in the imaging element 22 , controls the thermal expansion in the Y-axis direction, and thus, reduces a decrease in accuracy to achieve a highly accurate process.
  • the buffer 232 is made of a kovar plate having a coefficient of thermal expansion close to that of the imaging element 22 .
  • the buffer 232 is mainly made from kovar, and thus, has a coefficient of thermal expansion of 5 ⁇ 10 ⁇ 6 /K of the kovar.
  • the buffer 232 has a stress relaxation function that relaxes a stress caused by a difference in coefficient of thermal expansion between the heat sink 231 and the imaging element 22 . That is, the buffer 232 controls the displacement of the heat sink 231 in the Y-axis direction by the thermal expansion.
  • the adjuster 23 supports the imaging element 22 not to prevent the displacement of the imaging element 22 in the Z-axis direction by the thermal expansion, and to reduce the displacement of the imaging element 22 in the Y-axis, direction by the thermal expansion, as illustrated in FIG. 5 .
  • This configuration reduces the positional offset of the photosensor array 28 in the Y-axis direction to reduce a decrease in accuracy and to achieve a highly accurate process while reducing the space between the photosensor array 28 and the spatial light modulator 21 .
  • the reset of the configuration of the second embodiment is similar to that of the first embodiment, and thus, it is omitted.
  • a third embodiment of the present invention will be described with reference to FIG. 6 .
  • the imaging module 2 includes a temperature sensor 27 as a temperature detector that measures a temperature of the imaging module 2 , the adjuster 23 , and the controller 9 that applies voltage to the adjuster 23 in accordance with a temperature detected by the temperature sensor 27 .
  • the adjuster 23 in the third embodiment is made of a laminated type piezoelectric element disposed between the spatial light modulator 21 and the fixed portion 24 .
  • any adjuster for example, a driving member such as a motor and an actuator can be used as long as it adjusts the space between the spatial light modulator 21 and the photosensor array 28 based on control signals such as voltage.
  • An ultrasonic linear displacement motor may be also used.
  • the imaging element 22 is fixed to the fixed portion 24 .
  • the spatial light modulator 21 is supported by the fixed portion 24 to be movable in the Z-axis direction by the adjuster 23 .
  • the controller 9 which is connected to the temperature sensor 27 and the adjuster 23 , operates as a space controller that controls the movement amount of the adjuster 23 in the Z-axis direction by applying voltage to the adjuster 23 in accordance with an environmental temperature detected by the temperature sensor 27 .
  • the controller 9 as the space controller applies voltage to the adjuster 23 in accordance with a temperature detected by the temperature sensor 27 .
  • the adjuster 23 expands or contracts in the Z-axis direction by a value corresponding to the applied voltage.
  • the adjuster 23 is disposed to contract in the Z-axis direction at a rise in environmental temperature of the imaging module 2 . That is, the space between the spatial light modulator 21 and the fixed portion 24 reduces in response to a temperature rise.
  • the contraction amount of the adjuster 23 which is also the operation amount of the adjuster 23 , is adjusted to maintain an appropriate space between the photosensor array 28 and the spatial light modulator 21 at a preset temperature.
  • the contraction of the adjuster 23 displaces the spatial light modulator 21 in the Z-axis direction to adjust the space between the spatial light modulator 21 and the photosensor array 28 .
  • the space between the photosensor array 28 and the spatial light modulator 21 reduces.
  • the offset caused by a relative change in size between the imaging element 22 and the spatial light modulator 21 namely, the positional offset of the light fluxes incident on the photosensor array 28 can be thereby reduced to achieve a highly accurate process.
  • the controller 9 sets the space between the photosensor array 28 and the spatial light modulator 21 in response to a change in environmental temperature of the imaging module 2 , and thus reduces a decrease in accuracy to achieve a highly accurate process.
  • a fourth embodiment of the present invention will be described with reference to FIG. 7 .
  • the adjuster 23 is disposed between the imaging element 22 and the spatial light modulator 21 , as illustrated in FIG. 7 .
  • the imaging element 22 and the spatial light modulator 21 are connected through the adjuster 23 .
  • any adjuster can be used in this embodiment as long as it is made of a piezoelectric element.
  • the adjuster 23 described in the third embodiment may be used.
  • the adjuster 23 adjusts the space between the photosensor array 28 and the spatial light modulator 21 according to the temperature of the imaging module 2 measured by the temperature sensor 27 by adjusting the space between the imaging element 22 and the spatial light modulator 21 .
  • the space between the photosensor array 28 and the spatial light modulator 21 reduces.
  • the offset caused by a relative change in size between the imaging element 22 and the spatial light modulator 21 namely, the positional offset of the light fluxes incident on the photosensor array 28 can be thereby reduced to reduce a decrease in accuracy and to achieve a highly accurate process.
  • the controller 9 sets the space between the photosensor array 28 and the spatial light modulator 21 in response to a change in the environmental temperature of the imaging module 2 , and thus reduces a decrease in accuracy to achieve a highly accurate process.
  • the fixed portion 24 is omitted, and the imaging module 2 is thereby downsized.
  • the imaging apparatus 1 may be various types of imaging apparatus such as a compact digital camera and a small camera equipped with a portable device.
  • the controller 9 may be any controller such as a controller that is provided inside the imaging module 2 and a controller that is provided separately from the imaging module 2 .
  • the spatial light modulator 21 is made of the transmissive liquid crystal device, but it may be made of a transmissive spatial light modulator using an electrowetting effect.
  • the adjuster 23 is made of the polyimide sheet, but the material of the adjuster 23 is not limited thereto. Any material may be used for the adjuster 23 as long as it has a coefficient of thermal expansion in the Z-axis direction larger than that of the fixed portion 24 .

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Nonlinear Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Optics & Photonics (AREA)
  • Mathematical Physics (AREA)
  • Chemical & Material Sciences (AREA)
  • Crystallography & Structural Chemistry (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)
  • Optical Modulation, Optical Deflection, Nonlinear Optics, Optical Demodulation, Optical Logic Elements (AREA)
  • Solid State Image Pick-Up Elements (AREA)
  • Blocking Light For Cameras (AREA)
  • Camera Bodies And Camera Details Or Accessories (AREA)

Abstract

An imaging module includes a spatial light modulator that spatially modulates an incident light flux to emit a modulated light flux, an imaging element that obtains the modulated light flux by the spatial light modulator as image information, and an adjuster that adjusts a space between an imaging surface of the imaging element and the spatial light modulator, wherein the adjuster operates to reduce the space between the imaging surface and the spatial light modulator in response to a temperature rise.

Description

PRIORITY CLAIM
The present application is based on and claims priority to Japanese patent application No. 2014-117041, filed Jun. 5, 2014, the disclosure of which is hereby incorporated by reference herein in its entirety.
TECHNICAL FIELD
The present invention relates to an imaging module and an imaging apparatus using a spatial light modulator.
BACKGROUND ART
An imaging apparatus represented by a camera has been used for many systems, for example, a photographing system, an industrial measurement and object recognition system, and a vehicle hazard detection and security monitoring system. The imaging apparatus for use in these systems is required to obtain not only a subject image but also spatial information such as a distance and an eyesight direction.
A technique that can obtain such spatial information is taught by, for example, Patent Literature 1 and Non Patent Literatures 1 to 3. These literatures describe a technique that obtains information regarding an incident angle and a space of a light flux incident on an imaging element by executing a decoding process based on Fourier transform with the imaging element and a coded aperture pattern.
Another known technique uses an active spatial light modulator, that is, reconstructible into the coded aperture pattern, to decode images captured with different types of coded patterns for the purpose of improving image quality.
In such a technique, the spatial light modulator and the imaging element such as a CCD image sensor and a CMOS image sensor are arranged adjacent to each other to achieve a highly accurate process (for example, Patent Literature 1).
CITATION LIST Patent Literature
  • [PTL 1] JP 5328165B
Non Patent Literature
  • [NPL 1] A. Levin, R. Fergus, F. Durand and W. Freeman, “Image and Depth from a Conventional Camera with a Coded Aperture” (SIGGRAPH 2007), United States 2007
  • [NPL 2] C. Zhou, Stephen Lin and S. Nayar, “Coded Aperture Pairs for Depth from Defocus” (ICCV 2009), United States, 2009
  • [NPL 3] A. Veeraraghavan, R. Raskar, A. Agrawal, “Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing” (Association for Computing Machinery Trans. Graph. 26 (3): 69 2007), United States 2007
SUMMARY OF INVENTION Technical Problem
However, when the spatial light modulator and the imaging element are arranged adjacent to each other, a positional offset slightly occurs between a light-receiving portion of the imaging element and an opening portion of the spatial light modulator. Such a positional offset significantly affects measurement errors.
In particular, due to downsizing of the imaging element and an increase in resolution of the imaging element, the positional offset occurs between the light-receiving portion of the imaging element and the opening portion of the spatial light modulator by thermal expansion of a member caused by a change in environmental temperature of the imaging apparatus. Such a positional offset significantly affects measurement errors.
The present invention has been made in view of the above circumstances and aims to provide an imaging module to achieve a highly accurate process by reducing a decrease in accuracy caused by a change in environmental temperature.
Solution to Problem
To achieve the above object, an aspect of the present invention provides an imaging module including a spatial light modulator that spatially modulates an incident light flux to emit a modulated light flux, an imaging element that obtains the modulated light flux by the spatial light modulator as image information, and an adjuster that adjusts a space between an imaging surface of the imaging element and the spatial light modulator, wherein the adjuster operates to reduce the space between the imaging surface and the spatial light modulator in response to a temperature rise.
Advantageous Effects of Invention
According to the present invention, an imaging module that reduces a decrease in accuracy caused by a change in environmental temperature to achieve a highly accurate process can be provided.
BRIEF DESCRIPTION OF DRAWINGS
FIGS. 1A, 1B, and 1C are views showing an entire configuration of an imaging module and an imaging apparatus according to embodiments of the present invention.
FIG. 2 is a view showing a configuration of an imaging module according to a first embodiment of the present invention.
FIGS. 3A and 3B are schematic views showing a light-receiving operation of the imaging module illustrated in FIG. 2.
FIGS. 4A and 4B are views showing a configuration of an imaging module according to a second embodiment of the present invention.
FIG. 5 is a perspective view showing a configuration of the imaging module illustrated in FIGS. 4A and 4B.
FIG. 6 is a view showing a configuration of an imaging module according to a third embodiment of the present invention.
FIG. 7 is a view showing a configuration of an imaging module according to a fourth embodiment of the present invention.
 DESCRIPTION OF EMBODIMENT
An imaging apparatus 1 illustrated in FIG. 1A according to embodiments includes an imaging module 2 that obtains an image, an imaging forming optical system 3 that forms an image with an incident light flux to be emitted to the imaging module 2, and a controller 9 as a process circuit that executes a decoding process to a captured image.
In the following description, an optical axis direction of the incident light flux is represented as a Z-axis direction, and directions vertical to the Z-axis direction are represented as a Y-axis direction and an X-axis direction respectively, as illustrated by arrows in FIGS. 1A, 1B, and 1C.
As illustrated in FIGS. 1B and 1C, the imaging module 2 includes a spatial light modulator 21 that spatially modulates the incident light flux and emits the modulated incident light flux and an imaging element 22 that obtains the spatially modulated light flux as image information.
As illustrated in FIG. 2, the imaging module 2 also includes an adjuster 23 that adjusts a space between the imaging element 22 and the spatial light modulator 21 and a fixed portion 24 that fixes the imaging element 22 for protection.
The imaging module 2 further includes a wiring 25 that electrically connects the spatial light modulator 21 and the controller 9.
The spatial light modulator 21, which is made of a transmissive liquid crystal device, spatially modulates the incident light flux by forming a corded aperture pattern, i.e., a mosaic pattern that is formed by changing a transmittance in each position with the controller 9.
The spatial light modulator 21 is mainly made of a quartz board and thus has a coefficient of thermal expansion of 5×10−7/K of the quartz board.
The imaging element 22, which is made of an image sensor using a CCD as a photosensor array, obtains the light flux spatially modulated by the spatial light modulator 21 as image information. A photosensor array 28 as an imaging surface, which is made of a plurality of photodiodes as light receiving elements, is disposed on the imaging element 22. The imaging element 22 converts information of the light flux incident on the imaging surface, for example, an intensity of the light flux into electric signals. In this embodiment, the image sensor uses a CCD, but any image sensor, for example, a Complementary Metal-Oxide Semiconductor (CMOS) sensor may be used as long as it can obtain image information.
The imaging element 22 is located below the spatial light modulator 21 to have the photosensor array 28 face the spatial light modulator 21.
The imaging element 22 is mainly made of a single-crystal silicon board, and thus has a coefficient of thermal expansion of 2.4×10−6/K of the single-crystal silicon board.
The adjuster 23 abuts on the imaging element 22 and is disposed on the opposite side of the spatial light modulator 21 across the photosensor array 28. The adjuster 23 is made of a polyimide sheet having a coefficient of thermal expansion of 6×10−5/K. The adjuster 23 is located below the imaging element 22 to abut on the lower side of the imaging element 22.
The fixed portion 24 is made of a ceramic concaved protection member as an exterior package that fixes the imaging element 22 to be protected. The imaging element 22 is held in a bottom surface of the concaved protection member.
The fixed portion 24 is mainly made from alumina, and thus has a coefficient of thermal expansion of 7×10−6/K of the alumina.
As illustrated in FIG. 1A, the imaging forming optical system 3 includes an imaging lens group 30 having at least one lens. The imaging lens group 30 is disposed to form an image on the imaging element 22.
The imaging forming optical system 3 is disposed to form an image on the imaging element 22 with the light flux incident on the imaging apparatus 1. More specifically, the imaging forming optical system 3 is located above the imaging module 2 to focus on the imaging element 22.
The controller 9 operates as a spatial light modulation pattern generator, a decoding processor that converts a light flux having transmitted through the spatial light modulator 21 into image information, and an image property analyzer that separates a field angle based on the obtained image information to obtain an image having spatial information such as a distance and a direction.
The light flux incident on the imaging apparatus 1 is deflected by the imaging lens group 30 to form an image on the imaging element 22.
The light flux having transmitted through the imaging forming optical system 3 is incident on the spatial light modulator 21, and is spatially modulated by the spatial light modulator 21.
The controller 9 as an element driver controls a transmittance distribution of the spatial light modulator 21 by using a spatial transmittance distribution in which a plurality of sine waves of different periods are superimposed.
Hereinafter, a minimum unit capable of controlling the transmittance distribution is referred to as a cell.
The spatial light modulator 21 forms the coded aperture pattern by changing a transmittance in each cell in response to the electric signals, namely, periodical modulation signals, from the controller 9 as the element driver.
More specifically, the spatial light modulator 21 spatially modulates the light flux passing through the spatial light modulator 21 by periodically changing the transmittance of each cell.
The controller 9 thus operates as the spatial light modulation pattern generator.
When forming the corded aperture pattern by using such a spatial transmittance distribution, a distribution of a finite spatial frequency spectrum band of an image is copied in a form of convolution in the spatial frequency position corresponding to the period of the sine waves, namely, on the Fourier transformed horizontal axis.
The distribution of the spatial frequency spectrum of a subject is copied on the axis of the spatial frequency by the number of sine wave cycles. The filed angle can be separated by the mixture of the frequency information of an angular component depending on the frequency of the sine wave.
In the present embodiment, distance information relative to a subject can be obtained by optimizing a distance resolution for a targeted subject in an image.
A method for obtaining such spatial information will be described with reference to an example for obtaining distance information.
However, a detailed description of a method for calculating disparity information from the filed-angle separated images will be appropriately omitted.
At first, the controller 9 as the spatial light modulation pattern generator generates a spatial light modulation pattern. The controller 9 obtains an image by using the generated spatial light modulation pattern, and extracts field-angle separated information.
Next, the controller 9 as a distance resolution determiner and the image property analyzer analyzes the field-angle separated information, and calculates distance information on a local position of the targeted subject in the image. The controller 9 as the distance resolution determiner determines whether the obtained image has a predetermined resolution from the distance information calculated as described above.
When the controller 9 determines that the resolution of the image is insufficient, the controller 9 as the spatial light modulation pattern generator recalculates the period of the sine wave constituting the spatial light modulation pattern.
The controller 9 changes the filed-angle separated resolution based on the calculated spatial light modulation pattern to regenerate the spatial light modulation pattern, and thus obtains a new image.
The controller 9 optimizes the distance resolution by forming such a feedback loop, and finally obtains a distance image appropriate to the targeted subject.
For obtaining the distance image of an object with the imaging module 2, the spatial light modulator 21 and the photosensor array 28 of the imaging element 22 are arranged adjacent to each other to achieve a highly accurate process.
However, when the spatial light modulator 21 and the imaging element 22 are arranged adjacent to each other, a positional offset slightly occurs between the photosensor array 28 as a light receiver of the imaging element 22 and an opening portion of the spatial light modulator 21. Such a positional offset significantly affects measurement errors.
This will be described in detail with reference to FIGS. 3A and 3B.
In FIG. 3A, the spatial light modulation pattern of the spatial light modulator 21 includes high transmittance opening portions 21 a shown by white portions and low transmittance closed portions 21 b shown by black portions.
FIG. 3A schematically shows a projection pattern L in which the light fluxes transmitted through the opening portions 21 a of the spatial light modulator 21 are measured on the photosensor array 28. The projection pattern L increases in height on the Z axis in response to an intensity of the light flux.
Such a pattern diagram shows that in an ideal condition the spatial light modulator 21 and the imaging element 22 have no difference in coefficient of thermal expansion, so that a typical projection pattern L1 is detected.
However, the spatial light modulator 21 and the imaging element 22 actually have a difference in coefficient of thermal expansion caused by exhaust heat of the imaging apparatus 1, an environmental temperature for the imaging apparatus 1, or absorption of the light flux transmitted through the spatial light modulator 21.
By use of the spatial light modulator 21 made of the quartz board and the imaging element 22 made of the single-crystal silicon board in a full size of 36 mm×24 mm, under an environmental temperature change of 30° C., a positional offset of about 1 μm occurs between the spatial light modulator 21 and the imaging element 22 in the Y-axis direction.
Their positional offset changes because the coefficient of thermal expansion of the imaging element 22 is larger than that of the spatial light modulator 21. Consequently, the displacement of the imaging element 22 in the Y-axis direction caused by a temperature change is larger than that of the spatial light modulator 21.
An actual projection pattern L is detected as an expanded projection pattern L2 by the difference in coefficient of thermal expansion. A pattern difference L′ between the projection pattern L2 and the projection pattern L1 is about 1 μm.
Since the imaging element 22 is a high-accuracy, high-resolution advanced element, and the size of one pixel arranged in the photosensor array 28 is about 5 μm, the positional offset of about 1 μm causes an error of about 20% in distance measurement.
The imaging module 2 includes the adjuster 23 that adjusts the space between the photosensor array 28 and the spatial light modulator 21 to reduce the positional offset between the spatial light modulator 21 and the imaging element 22 caused by the change in environmental temperature, and thus to achieve a highly accurate process with less error.
The adjuster 23 operates to reduce the space between the photosensor array 28 and the spatial light modulator 21 in response to a temperature rise.
The detailed operation of the adjuster 23 will be described below.
FIG. 3B is an enlarged view of the expanded imaging element 22 by the above-described thermal expansion. Since the coefficient of thermal expansion of the imaging element 22 is significantly larger than that of the spatial light modulator 21, the projection pattern L of the light flux from the spatial light modulator 21 remains almost unchanged in relative terms. Thus, it can be approximately considered that the photosensor array 28 is expanded on the imaging element 22 in the Y-axis direction.
When the imaging element 22 expands, the light flux is incident on a position of the imaging element 22 shifted from the initial position when the imaging element 22 does not expand, causing the pattern difference L′.
The adjuster 23 expands in the Z-axis direction to move the position of the photosensor array 28 in the Z-axis direction toward the spatial light modulator 21, thereby reducing the positional offset of the light fluxes incident on the photosensor array 28 from that in case of no adjuster 23 provided.
With such a configuration, along with an increase in space between the fixed portion 24 and the imaging element 22 by the thermal expansion of the adjuster 23, the space between the photosensor array 28 and the spatial light modulator 21 reduces. The positional offset of the light fluxes incident on the photosensor array 28 can be thereby reduced to achieve a highly accurate process.
The adjuster 23 abuts on the imaging element 22, and is disposed on the opposite side of the spatial light modulator 21 across the photosensor array 28. The coefficient of thermal expansion of the adjuster 23 is larger than that of the spatial light modulator 21.
This can reduce the space between the photosensor array 28 and the spatial light modulator 21 even when the spatial light modulator 21 expands in the Z-axis direction. The positional offset of the light fluxes incident on the photosensor array 28 can be thereby reduced to reduce a decrease in accuracy and to achieve a highly accurate process.
Further, the space between the photosensor array 28 and the spatial light modulator 21 is adjusted without a driver. Consequently, members such as a control circuit and a power source can be omitted to conserve a space and to achieve downsizing.
A second embodiment of the present invention will be described with reference to FIGS. 4A, 4B, and 5.
According to the second embodiment of the present invention, the adjuster 23 includes a heat sink 231 having columnar projections formed on a plate-like base and a buffer 232 disposed between the heat sink 231 and the imaging element 22.
The heat sink 231 is made from aluminum and has a bonded surface 231 a as a contact surface with the buffer 232 and a fixed surface 231 b as a contact surface with the fixed portion 24, as illustrated in FIG. 4B. The area of the bonded surface 231 a is smaller than that of the fixed surface 231 b.
The heat sink 231 is mainly made from aluminum, and thus, has a coefficient of thermal expansion of 2×10−5/K of the aluminum.
The use of the metal such as aluminum having a large coefficient of thermal expansion for the adjuster 23 reduces the space between the photosensor array 28 and the spatial light modulator 21, and reduces a decrease in accuracy to achieve a highly accurate process while improving the stiffness of the adjuster 23 and the mechanical positional accuracy.
The heat sink 231 effectively releases heat in the imaging element 22, controls the thermal expansion in the Y-axis direction, and thus, reduces a decrease in accuracy to achieve a highly accurate process.
The buffer 232 is made of a kovar plate having a coefficient of thermal expansion close to that of the imaging element 22.
The buffer 232 is mainly made from kovar, and thus, has a coefficient of thermal expansion of 5×10−6/K of the kovar.
The buffer 232 has a stress relaxation function that relaxes a stress caused by a difference in coefficient of thermal expansion between the heat sink 231 and the imaging element 22. That is, the buffer 232 controls the displacement of the heat sink 231 in the Y-axis direction by the thermal expansion.
The adjuster 23 supports the imaging element 22 not to prevent the displacement of the imaging element 22 in the Z-axis direction by the thermal expansion, and to reduce the displacement of the imaging element 22 in the Y-axis, direction by the thermal expansion, as illustrated in FIG. 5.
This configuration reduces the positional offset of the photosensor array 28 in the Y-axis direction to reduce a decrease in accuracy and to achieve a highly accurate process while reducing the space between the photosensor array 28 and the spatial light modulator 21.
The reset of the configuration of the second embodiment is similar to that of the first embodiment, and thus, it is omitted.
A third embodiment of the present invention will be described with reference to FIG. 6.
In the third embodiment, the imaging module 2 includes a temperature sensor 27 as a temperature detector that measures a temperature of the imaging module 2, the adjuster 23, and the controller 9 that applies voltage to the adjuster 23 in accordance with a temperature detected by the temperature sensor 27. The adjuster 23 in the third embodiment is made of a laminated type piezoelectric element disposed between the spatial light modulator 21 and the fixed portion 24. Note that any adjuster, for example, a driving member such as a motor and an actuator can be used as long as it adjusts the space between the spatial light modulator 21 and the photosensor array 28 based on control signals such as voltage. An ultrasonic linear displacement motor may be also used.
In the third embodiment, the imaging element 22 is fixed to the fixed portion 24.
The spatial light modulator 21 is supported by the fixed portion 24 to be movable in the Z-axis direction by the adjuster 23.
The controller 9, which is connected to the temperature sensor 27 and the adjuster 23, operates as a space controller that controls the movement amount of the adjuster 23 in the Z-axis direction by applying voltage to the adjuster 23 in accordance with an environmental temperature detected by the temperature sensor 27.
The operation of the adjuster 23 in the third embodiment will be described. Upon a rise in the environmental temperature of the imaging module 2, the controller 9 as the space controller applies voltage to the adjuster 23 in accordance with a temperature detected by the temperature sensor 27.
After the voltage is applied to the adjuster 23, the adjuster 23 expands or contracts in the Z-axis direction by a value corresponding to the applied voltage. The adjuster 23 is disposed to contract in the Z-axis direction at a rise in environmental temperature of the imaging module 2. That is, the space between the spatial light modulator 21 and the fixed portion 24 reduces in response to a temperature rise. The contraction amount of the adjuster 23, which is also the operation amount of the adjuster 23, is adjusted to maintain an appropriate space between the photosensor array 28 and the spatial light modulator 21 at a preset temperature.
The contraction of the adjuster 23 displaces the spatial light modulator 21 in the Z-axis direction to adjust the space between the spatial light modulator 21 and the photosensor array 28.
Thus, the space between the photosensor array 28 and the spatial light modulator 21 reduces. The offset caused by a relative change in size between the imaging element 22 and the spatial light modulator 21, namely, the positional offset of the light fluxes incident on the photosensor array 28 can be thereby reduced to achieve a highly accurate process.
With this, the controller 9 sets the space between the photosensor array 28 and the spatial light modulator 21 in response to a change in environmental temperature of the imaging module 2, and thus reduces a decrease in accuracy to achieve a highly accurate process.
Note that the rest of the configuration in the third embodiment is similar to that in the first embodiment, and thus the description is omitted.
A fourth embodiment of the present invention will be described with reference to FIG. 7.
In the fourth embodiment, the adjuster 23 is disposed between the imaging element 22 and the spatial light modulator 21, as illustrated in FIG. 7. The imaging element 22 and the spatial light modulator 21 are connected through the adjuster 23.
Any adjuster can be used in this embodiment as long as it is made of a piezoelectric element. The adjuster 23 described in the third embodiment may be used.
In the fourth embodiment, the adjuster 23 adjusts the space between the photosensor array 28 and the spatial light modulator 21 according to the temperature of the imaging module 2 measured by the temperature sensor 27 by adjusting the space between the imaging element 22 and the spatial light modulator 21.
With this, the space between the photosensor array 28 and the spatial light modulator 21 reduces. The offset caused by a relative change in size between the imaging element 22 and the spatial light modulator 21, namely, the positional offset of the light fluxes incident on the photosensor array 28 can be thereby reduced to reduce a decrease in accuracy and to achieve a highly accurate process.
With this, the controller 9 sets the space between the photosensor array 28 and the spatial light modulator 21 in response to a change in the environmental temperature of the imaging module 2, and thus reduces a decrease in accuracy to achieve a highly accurate process.
Further, with this configuration, the fixed portion 24 is omitted, and the imaging module 2 is thereby downsized.
Note that the rest of the configuration in the fourth embodiments is similar to that in the third embodiment, and thus the description is omitted.
Although the embodiments of the present invention have been described above, the present invention is not limited thereto. It should be appreciated that variations may be made in the embodiments described by persons skilled in the art without departing from the scope of the present invention.
For example, in the first to fourth embodiments, the imaging apparatus 1 may be various types of imaging apparatus such as a compact digital camera and a small camera equipped with a portable device.
In the first to fourth embodiments, the controller 9 may be any controller such as a controller that is provided inside the imaging module 2 and a controller that is provided separately from the imaging module 2.
In the first to fourth embodiments, the spatial light modulator 21 is made of the transmissive liquid crystal device, but it may be made of a transmissive spatial light modulator using an electrowetting effect.
In the first embodiment, the adjuster 23 is made of the polyimide sheet, but the material of the adjuster 23 is not limited thereto. Any material may be used for the adjuster 23 as long as it has a coefficient of thermal expansion in the Z-axis direction larger than that of the fixed portion 24.
The effects described in the above embodiments are only the most suitable effects of the present invention. However, the effects of the present invention are not limited to the effects described in the above embodiments.

Claims (10)

The invention claimed is:
1. An imaging module comprising:
a spatial light modulator that spatially modulates an incident light flux to emit a modulated light flux;
an imaging element that obtains the modulated light flux by the spatial light modulator as image information; and
an adjuster that adjusts a space between an imaging surface of the imaging element and the spatial light modulator, wherein
the adjuster operates to reduce the space between the imaging surface and the spatial light modulator in response to a temperature rise;
the adjuster abuts on the imaging element and is disposed on an opposite side of the spatial light modulator across the imaging surface;
the adjuster has a coefficient of thermal expansion larger than that of the spatial light modulator; and
the imaging element and the spatial light modulator are supported to be displaceable in an optical axis direction of the light flux, and to reduce displacement in a direction vertical to the optical axis direction.
2. The imaging module according to claim 1, further comprising a space controller that sets the space between the imaging surface and the spatial light modulator by controlling an operation amount of the adjuster.
3. The imaging module according to claim 2, further comprising a temperature detector that measures a temperature in the imaging module, wherein
the space controller sets the space between the imaging surface and the spatial light modulator according to the temperature measured by the temperature detector.
4. An imaging apparatus comprising:
the imaging module according to claim 1; and
an imaging forming optical system that forms an image on the imaging element.
5. An imaging module comprising:
a spatial light modulator that spatially modulates an incident light flux to emit a modulated light flux;
an imaging element that obtains the modulated light flux by the spatial light modulator as image information; and
an adjuster that adjusts a space between an imaging surface of the imaging element and the spatial light modulator, wherein
the adjuster operates to reduce the space between the imaging surface and the spatial light modulator in response to a temperature rise;
the adjuster abuts on the imaging element and is disposed on an opposite side of the spatial light modulator across the imaging surface;
the adjuster has a coefficient of thermal expansion larger than that of the spatial light modulator; and
the imaging module further comprises a space controller that sets the space between the imaging surface and the spatial light modulator by controlling an operation amount of the adjuster.
6. The imaging module according to claim 5, further comprising a temperature detector that measures a temperature in the imaging module, wherein
the space controller sets the space between the imaging surface and the spatial light modulator according to the temperature measured by the temperature detector.
7. An imaging apparatus comprising:
the imaging module according to claim 5; and
an imaging forming optical system that forms an image on the imaging element.
8. An imaging module comprising:
a spatial light modulator that spatially modulates an incident light flux to emit a modulated light flux;
an imaging element that obtains the modulated light flux by the spatial light modulator as image information; and
an adjuster that adjusts a space between an imaging surface of the imaging element and the spatial light modulator, wherein
the adjuster operates to reduce the space between the imaging surface and the spatial light modulator in response to a temperature rise;
the adjuster abuts on the imaging element and is disposed on an opposite side of the spatial light modulator across the imaging surface;
the adjuster has a coefficient of thermal expansion larger than that of the spatial light modulator;
the imaging element and the spatial light modulator are supported to be displaceable in an optical axis direction of the light flux, and to reduce displacement in a direction vertical to the optical axis direction; and
the imaging module further comprises a space controller that sets the space between the imaging surface and the spatial light modulator by controlling an operation amount of the adjuster.
9. The imaging module according to claim 8, further comprising a temperature detector that measures a temperature in the imaging module, wherein
the space controller sets the space between the imaging surface and the spatial light modulator according to the temperature measured by the temperature detector.
10. An imaging apparatus comprising:
the imaging module according to claim 8; and
an imaging forming optical system that forms an image on the imaging element.
US15/313,116 2014-06-05 2015-06-01 Imaging module and imaging apparatus Expired - Fee Related US9912854B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2014-117041 2014-06-05
JP2014117041A JP2015230989A (en) 2014-06-05 2014-06-05 Imaging module and imaging device
PCT/JP2015/066421 WO2015186840A1 (en) 2014-06-05 2015-06-01 Imaging module and imaging apparatus

Publications (2)

Publication Number Publication Date
US20170195538A1 US20170195538A1 (en) 2017-07-06
US9912854B2 true US9912854B2 (en) 2018-03-06

Family

ID=54766905

Family Applications (1)

Application Number Title Priority Date Filing Date
US15/313,116 Expired - Fee Related US9912854B2 (en) 2014-06-05 2015-06-01 Imaging module and imaging apparatus

Country Status (6)

Country Link
US (1) US9912854B2 (en)
EP (1) EP3152784A1 (en)
JP (1) JP2015230989A (en)
KR (1) KR20170016943A (en)
CN (1) CN106415841A (en)
WO (1) WO2015186840A1 (en)

Citations (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4897846A (en) 1987-03-03 1990-01-30 Fumio Inaba Surface emission type semiconductor light-emitting device
JPH05122709A (en) 1991-10-29 1993-05-18 Kyocera Corp Color solid-state image pickup element
US5631474A (en) 1994-11-11 1997-05-20 Ricoh Company, Ltd. Light emitting element and array of light emitting elements for light source
US20010012047A1 (en) 1997-09-12 2001-08-09 Yasuhiro Osawa Optical apparatus and method of manufacturing optical apparatus
US20020051052A1 (en) 2000-10-27 2002-05-02 Koji Masuda Density unevenness suppressing image forming apparatus and method
US6476551B1 (en) 1998-01-30 2002-11-05 Ricoh Company, Ltd. LED array head and minute reflection optical elements array for use in the LED array head
JP2004072444A (en) 2002-08-07 2004-03-04 Mitsui Chemicals Inc Housing for storing semiconductor chip for imaging device and imaging device
JP2005252918A (en) 2004-03-08 2005-09-15 Sony Corp Imaging device unit and imaging apparatus
US20050243396A1 (en) 2004-04-12 2005-11-03 Mitsumi Fujii Deflector mirror, optical scanning device, and image forming apparatus
US20060132883A1 (en) 2004-11-25 2006-06-22 Tetsurou Saitoh Scanner element having a constant resonance frequency, and optical scanning apparatus and image forming apparatus using such a scanner element
EP1720340A1 (en) 2004-10-28 2006-11-08 Matsushita Electric Industrial Co., Ltd. Camera module
JP2008072305A (en) 2006-09-13 2008-03-27 Ricoh Co Ltd Image reader and image forming apparatus
US20080225363A1 (en) 2007-03-15 2008-09-18 Tetsurou Saitoh Optical deflector and optical device
US7554714B2 (en) * 2004-09-27 2009-06-30 Idc, Llc Device and method for manipulation of thermal response in a modulator
US20090225384A1 (en) 2008-03-10 2009-09-10 Mochizuki Eiji Vibration elements
US7792423B2 (en) 2007-02-06 2010-09-07 Mitsubishi Electric Research Laboratories, Inc. 4D light field cameras
US20100232833A1 (en) 2009-03-16 2010-09-16 Mitsumi Fujii Optical scanner and image forming apparatus
US20100295836A1 (en) * 2007-12-05 2010-11-25 Hamamatsu Photonicks K.K. Phase modulating apparatus and phase modulating method
US7927654B2 (en) * 2005-02-23 2011-04-19 Pixtronix, Inc. Methods and apparatus for spatial light modulation
US20110249544A1 (en) * 2010-04-08 2011-10-13 National Chiao Tung University Reading Device
US20110285963A1 (en) * 2010-05-21 2011-11-24 Kurtz Andrew F Low thermal stress birefringence imaging system
US20110292505A1 (en) * 2010-05-21 2011-12-01 Kurtz Andrew F Low thermal stress birefringence imaging lens
WO2012145313A2 (en) 2011-04-18 2012-10-26 Magna Electronics Inc. Vehicular camera with variable focus capability
DE102011110167A1 (en) 2011-08-13 2013-02-14 Connaught Electronics Ltd. Image pickup apparatus for camera of driver assistance system of motor vehicle, particularly goods vehicle, has error compensation element, which is formed and arranged during thermally induced change in length of retaining element
US20130201297A1 (en) 2012-02-07 2013-08-08 Alcatel-Lucent Usa Inc. Lensless compressive image acquisition
US20140036180A1 (en) * 2011-02-22 2014-02-06 Hamamatsu Photonics K.K. Spatial light modulation device and spatial light modulation method
US9036080B2 (en) * 2012-09-04 2015-05-19 Canon Kabushiki Kaisha Apparatus and method for acquiring information about light-field data
WO2015105199A1 (en) 2014-01-10 2015-07-16 Ricoh Company, Ltd. Imaging module and imaging device
US9304358B2 (en) * 2010-03-10 2016-04-05 Citizen Holdings Co., Ltd. Liquid crystal device and method of manufacturing liquid crystal device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014045304A (en) * 2012-08-27 2014-03-13 Sony Corp Camera module and electronic apparatus

Patent Citations (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4897846A (en) 1987-03-03 1990-01-30 Fumio Inaba Surface emission type semiconductor light-emitting device
JPH05122709A (en) 1991-10-29 1993-05-18 Kyocera Corp Color solid-state image pickup element
US5631474A (en) 1994-11-11 1997-05-20 Ricoh Company, Ltd. Light emitting element and array of light emitting elements for light source
US20010012047A1 (en) 1997-09-12 2001-08-09 Yasuhiro Osawa Optical apparatus and method of manufacturing optical apparatus
US6476551B1 (en) 1998-01-30 2002-11-05 Ricoh Company, Ltd. LED array head and minute reflection optical elements array for use in the LED array head
US20020051052A1 (en) 2000-10-27 2002-05-02 Koji Masuda Density unevenness suppressing image forming apparatus and method
JP2004072444A (en) 2002-08-07 2004-03-04 Mitsui Chemicals Inc Housing for storing semiconductor chip for imaging device and imaging device
JP2005252918A (en) 2004-03-08 2005-09-15 Sony Corp Imaging device unit and imaging apparatus
US20050243396A1 (en) 2004-04-12 2005-11-03 Mitsumi Fujii Deflector mirror, optical scanning device, and image forming apparatus
US7554714B2 (en) * 2004-09-27 2009-06-30 Idc, Llc Device and method for manipulation of thermal response in a modulator
EP1720340A1 (en) 2004-10-28 2006-11-08 Matsushita Electric Industrial Co., Ltd. Camera module
US20060132883A1 (en) 2004-11-25 2006-06-22 Tetsurou Saitoh Scanner element having a constant resonance frequency, and optical scanning apparatus and image forming apparatus using such a scanner element
US7927654B2 (en) * 2005-02-23 2011-04-19 Pixtronix, Inc. Methods and apparatus for spatial light modulation
JP2008072305A (en) 2006-09-13 2008-03-27 Ricoh Co Ltd Image reader and image forming apparatus
JP5328165B2 (en) 2007-02-06 2013-10-30 ミツビシ・エレクトリック・リサーチ・ラボラトリーズ・インコーポレイテッド Apparatus and method for acquiring a 4D light field of a scene
US7792423B2 (en) 2007-02-06 2010-09-07 Mitsubishi Electric Research Laboratories, Inc. 4D light field cameras
US7965936B2 (en) 2007-02-06 2011-06-21 Mitsubishi Electric Research Laboratories, Inc 4D light field cameras
US20080225363A1 (en) 2007-03-15 2008-09-18 Tetsurou Saitoh Optical deflector and optical device
US20100295836A1 (en) * 2007-12-05 2010-11-25 Hamamatsu Photonicks K.K. Phase modulating apparatus and phase modulating method
US8576206B2 (en) * 2007-12-05 2013-11-05 Hamamatsu Photonics K.K. Phase modulating apparatus and phase modulating method
US20090225384A1 (en) 2008-03-10 2009-09-10 Mochizuki Eiji Vibration elements
US20100232833A1 (en) 2009-03-16 2010-09-16 Mitsumi Fujii Optical scanner and image forming apparatus
US9304358B2 (en) * 2010-03-10 2016-04-05 Citizen Holdings Co., Ltd. Liquid crystal device and method of manufacturing liquid crystal device
US8102747B2 (en) * 2010-04-08 2012-01-24 National Chiao Tung University Reading device
US20110249544A1 (en) * 2010-04-08 2011-10-13 National Chiao Tung University Reading Device
US20110292505A1 (en) * 2010-05-21 2011-12-01 Kurtz Andrew F Low thermal stress birefringence imaging lens
US20110285963A1 (en) * 2010-05-21 2011-11-24 Kurtz Andrew F Low thermal stress birefringence imaging system
US9223159B2 (en) * 2011-02-22 2015-12-29 Hamamatsu Photonics K.K. Spatial light modulation device and spatial light modulation method
US20140036180A1 (en) * 2011-02-22 2014-02-06 Hamamatsu Photonics K.K. Spatial light modulation device and spatial light modulation method
WO2012145313A2 (en) 2011-04-18 2012-10-26 Magna Electronics Inc. Vehicular camera with variable focus capability
DE102011110167A1 (en) 2011-08-13 2013-02-14 Connaught Electronics Ltd. Image pickup apparatus for camera of driver assistance system of motor vehicle, particularly goods vehicle, has error compensation element, which is formed and arranged during thermally induced change in length of retaining element
US20130201297A1 (en) 2012-02-07 2013-08-08 Alcatel-Lucent Usa Inc. Lensless compressive image acquisition
US9036080B2 (en) * 2012-09-04 2015-05-19 Canon Kabushiki Kaisha Apparatus and method for acquiring information about light-field data
WO2015105199A1 (en) 2014-01-10 2015-07-16 Ricoh Company, Ltd. Imaging module and imaging device
JP2015133594A (en) 2014-01-10 2015-07-23 株式会社リコー imaging module and imaging device

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
A.Levin, R.Fergus, F.Durand and W.Freeman, "Image and Depth from a Conventional Camera with a Coded Aperture" (SIGGRAPH 2007), United States 2007.
A.Veeraraghavan, R.Raskar, A.Agrawal, A. Mohan and J. Tumblin, "Dappled photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing" (Association for Computing Machinery Trans. Graph. 26(3): 69 2007), United States 2007.
C.Zhou, Stephen Lin and S.Nayar,"Coded Aperture Pairs for Depth from Defocus" (ICCV 2009), United States 2009.
Extended European Search Report issued Mar. 2, 2017 in Patent Application No. 15802612.0.
International Search Report dated Aug. 25, 2015 in PCT/JP2015/066421 filed Jun. 1, 2015.
Takuya Watanabe, Hajime Nagahara, Changyin Zhou, Hiroshi Ishiguro and Shree K.Nayar, "Programmable Aperture Camera" with a partial English translation, 2010.

Also Published As

Publication number Publication date
EP3152784A4 (en) 2017-04-12
CN106415841A (en) 2017-02-15
US20170195538A1 (en) 2017-07-06
KR20170016943A (en) 2017-02-14
EP3152784A1 (en) 2017-04-12
JP2015230989A (en) 2015-12-21
WO2015186840A1 (en) 2015-12-10

Similar Documents

Publication Publication Date Title
US10110811B2 (en) Imaging module and imaging device
JP4510930B2 (en) Imaging device and semiconductor circuit element
JP5549230B2 (en) Ranging device, ranging module, and imaging device using the same
CN101266392A (en) Imaging device and optical device
EP3425437B1 (en) Patterned light irradiation apparatus and method
JP6580578B2 (en) Camera device
JP2013124985A (en) Compound-eye imaging apparatus and distance measuring device
JP2019039672A (en) Temperature correction method for infrared camera
US11393183B2 (en) Integrated electronic module for 3D sensing applications, and 3D scanning device including the integrated electronic module
CN113050291A (en) Structured light projector
JP2009250785A (en) Imaging device
US9912854B2 (en) Imaging module and imaging apparatus
JP2001066655A (en) Photographing device, with vibration-proof function
US9588260B2 (en) Microlens substrate and imaging apparatus
JP6737325B2 (en) Imaging module and imaging device
US11693204B2 (en) Imaging device and method of manufacturing imaging device
US20160044213A1 (en) Image capturing module for saving focusing time and increasing assembly flatness and method of assembling the same
JP2020076882A (en) Positional deviation correction device, projector, and positional deviation correction method
US11867817B2 (en) Camera module and depth information extraction method thereof
JP2016046564A (en) Imaging apparatus
TWI556420B (en) Image capturing module for increasing assembly flatness and method of assembling the same
JP2021043253A (en) Reflective type liquid crystal display device and focus adjustment method for reflective type liquid crystal display device
JP2021018174A (en) Distance detector and imaging apparatus
CN112825139A (en) Structure light emission module and image acquisition device
JP2021043255A (en) Reflective type liquid crystal display device and focus adjustment method for reflective type liquid crystal display device

Legal Events

Date Code Title Description
AS Assignment

Owner name: RICOH COMPANY, LTD., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SAITOH, TETSURO;REEL/FRAME:040398/0141

Effective date: 20160817

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20220306