JP2013117568A - Parallax image acquisition device, portable information terminal, and parallax image acquisition method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a simply-configured device capable of acquiring a high quality parallax image by a single optical system without increasing cost.SOLUTION: An optical deflection member drive actuator selects one of a first state where a first optical deflection member is arranged in front of an imaging optical system, a second state where a second optical deflection member is arranged in front of the imaging optical system, and a third state where neither the first or the second deflection member is arranged in front of the imaging optical system. Object images captured in the first and the third states are parallax images having parallax each other, and object images captured in the second and the third states are parallax images having parallax each other.

Description

  The present invention relates to a parallax image acquisition device, a portable information terminal, and a parallax image acquisition method.

  3D images (stereoscopic images) are more realistic than 2D images (two-dimensional images), and have a greater effect of increasing surprise and excitement. Therefore, there is a strong need to view images as three-dimensional images in various markets. is there. On the other hand, in order to reduce the size of the photographing apparatus and avoid an increase in cost, proposals have been made to acquire a three-dimensional image with a monocular lens.

  For example, Patent Document 1 proposes a method for acquiring a parallax image by shifting a lens in an optical system. In the stereo image generation method described in Patent Document 1, at least one lens among a plurality of lenses arranged on the optical axis is shifted in a plane perpendicular to the optical axis to capture a parallax image.

  Patent Document 2 proposes a method of acquiring a parallax image by driving the entire lens frame. The stereoscopic image forming apparatus described in Patent Document 2 includes a moving unit that changes a relative position between a subject and an imaging unit that captures the subject. The subject is photographed in a first direction and a second direction, and the subject is taken from these two directions. The captured image is created on the same medium.

JP 2010-41381 A Japanese Patent Laid-Open No. 9-171221

However, in the stereo image generation method disclosed in Patent Document 1, it is conceivable that the optical performance is lowered by shifting the lens, and even if a parallax image can be acquired, the image quality may be lowered.
Further, the three-dimensional image forming apparatus disclosed in Patent Document 2 has a problem that the apparatus is first enlarged. Further, since the entire lens frame is moved, a large time lag occurs in photographing from two directions, and therefore, it is not suitable for an apparatus for acquiring an ornamental image such as a digital camera.

  The present invention has been made in view of the above, and it is possible to obtain a parallax image with a single optical system that can obtain a parallax image with a good image quality with a small configuration without significant cost increase. The object is to provide a device that can be obtained.

  In order to solve the above-described problems and achieve the object, a parallax image acquisition device according to the present invention is disposed on an imaging element, an imaging optical system that forms a subject image on the imaging element, and a front surface of the imaging optical system The first optical deflection member that deflects the light beam traveling from the object side to the imaging optical system in the first direction when the light source is moved, and the light beam traveling from the object side to the imaging optical system when disposed in front of the imaging optical system A second optical deflection member that deflects the first optical deflection member in a second direction, and an optical deflection member drive actuator that drives the first optical deflection member and the second optical deflection member. A first state in which the deflection member is disposed in front of the imaging optical system, a second state in which the second optical deflection member is disposed in front of the imaging optical system, and the first optical deflection member is also the second optical deflection member Are both placed in front of the imaging optics. The third state is alternatively selected, and the subject image captured in the first state and the subject image captured in the third state are parallax images having parallax, and the second state The subject image captured in the state and the subject image captured in the third state are parallax images having parallax.

  In the parallax image acquisition device according to the present invention, it is preferable that the first direction and the second direction have different angles with respect to the optical axis of the imaging optical system.

  In the parallax image acquisition device according to the present invention, it is preferable that the first direction and the second direction are approximately 90 degrees in a plane perpendicular to the optical axis of the imaging optical system.

  The parallax image acquisition device according to the present invention further includes a posture sensor that detects the posture of the parallax image acquisition device, and the optical deflection member drive actuator converts the parallax image in the horizontal direction based on the output of the posture sensor. It is preferable to select the first state or the second state, and the third state so as to have.

  In the parallax image acquisition device according to the present invention, the optical deflection member drive actuator transmits at least one power generation source and the power generated by the at least one power generation source to the first optical deflection member, so that the first A first transmission member that disposes the optical deflection member on the front surface of the imaging optical system and power generated by at least one power generation source is transmitted to the second optical deflection member, and the second optical deflection member is used as the imaging optical system. A second transmission member disposed in front of the first optical deflection member, the first optical deflection member and the first transmission member are integrally formed, and the second optical deflection member and the second transmission member are integrally formed. It is preferable that

  In the parallax image acquisition device according to the present invention, the imaging optical system is accommodated in the first casing, and the first optical deflection member, the second optical deflection member, and the optical deflection member drive actuator are the second casing. It is preferable that the first housing and the second housing be assembled in a detachable manner.

  In the parallax image acquisition device according to the present invention, it is preferable that the optical deflection member includes one incident plane and one exit plane, and the entrance plane and the exit plane form a predetermined angle with each other.

  In the parallax image acquisition device according to the present invention, the predetermined angle is preferably 0.1 degrees or more and 3 degrees or less.

  In the parallax image acquisition device according to the present invention, the optical deflection member is preferably an optical glass member.

  In the parallax image acquisition device according to the present invention, the optical deflection member is preferably a resin member.

  In the parallax image acquisition device according to the present invention, the imaging optical system is preferably a coaxial optical system.

  In the parallax image acquisition device according to the present invention, the imaging optical system is preferably a folding system.

  A portable information terminal according to the present invention includes any one of the above-described parallax image acquisition devices.

  The parallax image acquisition method according to the present invention includes an imaging device, an imaging optical system that forms a subject image on the imaging device, and light rays that travel from the object side to the imaging optical system when placed on the front surface of the imaging optical system. A first optical deflection member that deflects the light beam traveling from the object side to the imaging optical system when disposed in front of the imaging optical system in a second direction; A first imaging step of imaging a subject image in a state where the first optical deflection member or the second optical deflection member is disposed in front of the imaging optical system; And a second imaging step of imaging a subject image in a state in which neither the first optical deflection member nor the second optical deflection member is disposed in front of the imaging optical system.

  The parallax image acquisition device according to the present invention can acquire a parallax image having a good image quality with a small and inexpensive configuration, and can thereby acquire a high-quality stereoscopic image.

It is sectional drawing which shows the structure of the image pick-up element used for the parallax image acquisition apparatus which concerns on 1st Embodiment, an imaging optical system, and an optical deflection | deviation member, Comprising: (a) has arrange | positioned the optical deflection | deviation member in the front side of an imaging optical system. (B) is a state in which the first optical deflection member is arranged on the front side of the imaging optical system, and (c) is a diagram showing a state in which the second optical deflection member is arranged on the front side of the imaging optical system. is there. It is sectional drawing which shows the structure of the imaging optical system in the 1st modification in 1st Embodiment. It is sectional drawing which shows the structure of the imaging optical system in the 2nd modification in 1st Embodiment. It is a perspective view which shows the structure of the shutter unit and camera module which are used for the parallax image acquisition apparatus which concerns on 1st Embodiment. It is a disassembled perspective view which shows the structure of a shutter unit and a camera module shown in FIG. It is a top view which shows the internal structure of the parallax image acquisition apparatus in 1st Embodiment, Comprising: It is a figure which shows the state which the optical deflection | deviation member has evacuated from the front side of the imaging optical system. It is a side view which shows the internal structure of the parallax image acquisition apparatus in 1st Embodiment, Comprising: It is a figure which shows the state which the optical deflection | deviation member has evacuated from the front side of the imaging optical system. It is a top view which shows the internal structure of the parallax image acquisition apparatus in 1st Embodiment, Comprising: It is a figure which shows the state by which the 1st optical deflection | deviation member is arrange | positioned at the front side of the imaging optical system. It is a side view which shows the internal structure of the parallax image acquisition apparatus in 1st Embodiment, Comprising: It is a figure which shows the process in which the 2nd optical deflection | deviation member is arrange | positioned at the front side of an imaging optical system. It is a top view which shows the internal structure of the parallax image acquisition apparatus in 1st Embodiment, Comprising: It is a figure which shows the state by which the 2nd optical deflection | deviation member is arrange | positioned at the front side of the imaging optical system. It is a block diagram which shows the structure of the parallax image acquisition apparatus in 1st Embodiment. It is a flowchart which shows the flow of a process of the parallax image acquisition method in 1st Embodiment. It is sectional drawing which shows the structure of the image pick-up element used for the parallax image acquisition apparatus which concerns on 2nd Embodiment, an imaging optical system, and an optical deflection | deviation member, Comprising: (a) is the state which has arrange | positioned the optical deflection | deviation member in the front side of an imaging optical system (B) is a figure which respectively shows the state which has arrange | positioned the optical deflection | deviation member from which an inclination direction differs from (a) to the front side of an imaging optical system. It is a perspective view which shows the example of a shape of the optical deflection | deviation member in 2nd Embodiment. It is a front view which shows the mobile telephone incorporating the parallax image acquisition apparatus which concerns on 2nd Embodiment. FIG. 16 is a plan view showing a relationship between a reference direction V in the mobile phone shown in FIG. 15 and an inclination direction of an optical deflection member in the imaging optical system. FIGS. 16A and 16B are diagrams illustrating a state of the optical deflection member when the mobile phone of FIG. 15 is placed vertically, in which FIG. 15A is a state in which the optical deflection member is retracted from the front side of the imaging optical system, and FIG. It is a figure which respectively shows the state which has arrange | positioned the optical deflection | deviation member which made the inclination direction 270 degree | times on the front side. FIG. 16 is a diagram illustrating a state of the optical deflection member when the mobile phone of FIG. 15 is placed horizontally, where (a) is a state in which the optical deflection member is retracted from the front side of the imaging optical system, and (b) is a diagram of the imaging optical system. It is a figure which shows the state which has arrange | positioned the optical deflection | deviation member which made the inclination direction 180 degree | times on the front side. It is a top view which shows the internal structure of the parallax image acquisition apparatus in 2nd Embodiment, Comprising: It is a figure which shows the state which the optical deflection | deviation member has evacuated from the front side of the imaging optical system. It is a top view which shows the internal structure of the parallax image acquisition apparatus in 2nd Embodiment, Comprising: It is a figure which shows the state by which the 1st optical deflection | deviation member is arrange | positioned at the front side of the imaging optical system. It is a top view which shows the internal structure of the parallax image acquisition apparatus in 2nd Embodiment, Comprising: It is a figure which shows the state by which the 2nd optical deflection | deviation member is arrange | positioned at the front side of the imaging optical system. It is a block diagram which shows the structure of the parallax image acquisition apparatus in 2nd Embodiment. It is a flowchart which shows the flow of a process of the parallax image acquisition method in 2nd Embodiment.

Hereinafter, an embodiment of a parallax image acquisition device according to the present invention will be described in detail with reference to the drawings. In addition, this invention is not limited by the following embodiment.
(First embodiment)
FIG. 1 is a cross-sectional view illustrating configurations of an image sensor 120, an imaging optical system 110, a first optical deflection member 121, and a second optical deflection member 131 used in the parallax image acquisition device according to the first embodiment. a) shows a state in which no optical deflection member is arranged on the front side of the imaging optical system, (b) shows a state in which the first optical deflection member 121 is arranged on the front side of the imaging optical system 110, and (c) shows a state in which the first optical deflection member 121 is arranged on the front side. It is a figure which shows the state which has arrange | positioned the 2 optical deflection | deviation member 131 in the front side of the imaging optical system 110, respectively.

The parallax image acquisition device according to the first embodiment includes an imaging device 120, an imaging optical system 110 that forms a subject image on the imaging device 120, and the object side (see FIG. 1 on the front side of the imaging optical system 110, and a first optical deflection member 121 that deflects the light beam traveling from the left side of 1 to the imaging optical system 110 in the first direction (the direction in which the light beam L1 travels in FIG. 1B). A second optical deflection member 131 that deflects a light beam traveling from the object side to the imaging optical system 110 when disposed in a second direction (a direction in which the light beam L3 travels in FIG. 1C), and a first optical deflection. Optical deflection member drive actuators 220 and 230 (FIG. 11) for driving the member 121 and the second optical deflection member 131, respectively. In these optical deflection member drive actuators 220 and 230, the first optical deflection member 121 is disposed in front of the imaging optical system 110 and the second optical deflection member 131 is disposed in front of the imaging optical system 110. Alternatively, the second state is selected and the third state in which neither the first optical deflection member 121 nor the second optical deflection member 131 is arranged on the front surface of the imaging optical system 110 is selected. The subject image captured in the first state and the subject image captured in the third state are parallax images having parallax with each other, and the subject image captured in the second state is captured in the third state. The subject images are parallax images having parallax.
Here, the front side is the object side, and the rear side is the image plane side.

The imaging optical system 110 is driven along the optical axis Ax by the AF actuator 243 (FIG. 11) in accordance with an instruction signal from the control unit 250 (FIG. 11), and forms a subject image on the image sensor 120. The image sensor 120 photoelectrically converts the subject image formed on the imaging surface to generate an electrical image signal.
The imaging optical system 110 may be composed of one lens as shown in FIG. 1 or two or more lenses.

The optical deflection members 121 and 131 are composed of prisms (wedge-shaped prisms) having an inclination along one direction, and this prism is preferably an optical glass member having a refractive index of about 1.5, for example, a glass material such as BK7. Configure.
As shown in FIG. 1B, the first optical deflection member 121 has an incident plane 122 and an emission plane 123 as optical surfaces arranged on the front side of the imaging optical system 110. The entrance plane 122 and the exit plane 123 are sequentially arranged from the front along the optical axis Ax of the imaging optical system, and form a predetermined angle θ1.
Further, as shown in FIG. 1C, the second optical deflection member 131 has an incident plane 132 and an emission plane 133 as optical surfaces arranged on the front side of the imaging optical system 110. The entrance plane 132 and the exit plane 133 are sequentially arranged from the front along the optical axis Ax of the imaging optical system, and form a predetermined angle θ2.

The angle θ1 formed between the incident plane 122 and the exit plane 123 of the first optical deflection member 121 is smaller than the angle θ2 formed between the incident plane 132 and the exit plane 133 of the second optical deflection member 131. For this reason, the traveling direction (first direction) of the light that enters the first optical deflection member 121 from the object side and travels to the imaging optical system 110 is incident on the second optical deflection member 131 from the object side. The angle of the imaging optical system 110 with respect to the optical axis Ax is small with respect to the light traveling direction (second direction) when traveling to 110. In other words, the amount of deflection of the light beam traveling from the object side to the imaging optical system 110 is greater for the second optical deflection member 131 than for the first optical deflection member 121.
Here, the angle θ1 formed between the incident plane 122 and the exit plane 123 of the first optical deflection member 121 and the angle θ2 formed between the incident plane 132 and the exit plane 133 of the second optical deflection member 131 are 0.1 degrees or more and 3 degrees. This angle range is desirable because the occurrence of chromatic aberration can be reduced if the angle is less than or equal to degrees.
In FIG. 1, for convenience of explanation, the angle θ is illustrated larger than the actual angle so that the difference between the angle θ1 and the angle θ2 becomes clear.

  In addition, the prism which comprises the optical deflection | deviation members 121 and 131 may use a resin member. Use of a resin member is preferable because the weight can be reduced, the material cost can be reduced, and the degree of freedom in processing is further increased.

  In the state shown in FIG. 1A, the light beam L2 traveling from the object side to the imaging optical system 110 travels on the optical axis Ax without being deflected, whereas in the state shown in FIG. When the light beam L1 enters the first optical deflection member 121 from the air, it is refracted by the refractive action at the incident plane 122, and further refracted by the refractive action at the exit plane 123. For this reason, the angle of the light beam can be changed between the incident side and the exit side with respect to the light beam L2 when the first optical deflection member 121 is not disposed on the optical axis Ax. That is, the first optical deflection member 121 can deflect the light beam traveling from the object side to the imaging optical system 110.

Also in the state shown in FIG. 1C, when the light beam L3 enters the optical deflection member 131 from the air, it is refracted by the refraction action at the incident plane 132, and further refracted by the refraction action at the exit plane 133, so that the optical axis Ax The angle of the light beam can be changed between the incident side and the exit side with respect to the light beam L2 when the optical deflecting member 131 is not disposed thereon.
Here, the imaging optical systems shown in FIGS. 1B and 1C are coaxial optical systems, respectively.

As shown in FIGS. 1 (a) and 1 (b), a light beam incident on the imaging optical system 110 from the object side is obtained by exchanging two optical deflection members 121 and 131 having different angles formed by the incident plane and the exit plane. You can change the angle. Therefore, when the first optical deflection member 121 is disposed on the front side of the imaging optical system 110 (FIG. 1B), the first optical axis that provides the first subject image to the imaging element 120 is configured. In the state where the second optical deflection member 131 is disposed on the front side of the imaging optical system 110 (FIG. 1C), the second light that gives the imaging element 120 a second subject image different from the first subject image. An axis is configured. As a result, the subject image photographed in a state where the optical deflection member is not disposed on the front side of the imaging optical system 110 (FIG. 1A) and the first optical deflection member 121 or the second on the front side of the imaging optical system 110. Since parallax occurs between the subject image captured with the optical deflection member 131 disposed (FIG. 1B or FIG. 1C), these subject images become parallax images of the subject. Stereoscopic viewing is possible by reproducing the image. Furthermore, images with different stereoscopic effects can be obtained according to the angle formed by the incident plane and the exit plane of the optical deflection member disposed on the front side of the imaging optical system 110.
It should be noted that the subject image taken with the first optical deflection member 121 disposed on the front side of the imaging optical system 110 (FIG. 1B) and the second optical deflection member 131 disposed on the front side of the imaging optical system 110 are disposed. Even with the subject image shot in the state (FIG. 1C), a parallax occurs between them, and these subject images also become parallax images of the subject.

Here, a modification of the first embodiment will be described.
(First modification)
FIG. 2 is a cross-sectional view illustrating a configuration of an optical system of a parallax image acquisition device according to a first modification of the first embodiment.
The parallax image acquisition device according to the first modification differs from the parallax image acquisition device according to the first embodiment in that a bending optical system is used as the optical system. Since the other configuration is the same as that of the parallax image acquisition device according to the first embodiment, a detailed description thereof will be omitted.

  As shown in FIG. 2, the optical deflection member 151 in the first modified example is an optical deflection member, and is disposed on the front side of the most object side surface of the bending optical system 150. In the first modification, similarly to the optical deflecting members 121 and 131 of the first embodiment, optical deflecting members having different angles formed by the incident plane and the exit plane can be alternatively arranged on the front side of the bending optical system 150. is there. As a result, different optical axes are configured according to the difference in angle between the incident plane and the exit plane of the optical deflection member 151, so that the subject photographed without the optical deflection member 151 being placed on the front side of the bending optical system 150 A parallax is generated between the image and the subject image captured in a state where the optical deflection member 151 at any angle is disposed on the front side of the bending optical system 150. Therefore, these subject images become parallax images of the subject, and stereoscopic viewing is possible by reproducing these two images. Furthermore, images with different stereoscopic effects can be obtained according to the angle formed by the incident plane and the exit plane of the optical deflection member 151 disposed on the front side of the bending optical system 150.

(Second modification)
FIG. 3 is a cross-sectional view showing the configuration of the optical system of the parallax image acquisition device according to the second modification of the first embodiment.
In the parallax image acquisition device according to the second modification, the parallax image acquisition according to the first embodiment is that a DOE (Differential Optical Element) is used as the optical deflection member 161 instead of the first optical deflection member 121 of the first embodiment. Different from the device. Since the other configuration is the same as that of the parallax image acquisition device according to the first embodiment, a detailed description thereof will be omitted.

  The DOE used for the optical deflection member 161 is a diffraction grating formed so that a plurality of grooves are parallel to each other along a direction perpendicular to the optical axis Ax of the imaging optical system 110. The DOE is disposed on the front side of the imaging optical system 110 and controls incident light using a light diffraction phenomenon. Although the incident light beam is diffracted at different angles depending on the order, the diffraction efficiency of a specific order can be enhanced by the shape of the groove. In other words, the angle of the incident light beam can be deflected to a specific angle. Therefore, the angle of the optical axis can be controlled by disposing the DOE as the optical deflection member 161 on the front surface of the imaging optical system 110 as shown in FIG.

  In the second modification, the optical deflection member 161 having a different groove shape can be alternatively arranged on the front side of the imaging optical system 110. As a result, different optical axes are configured according to the difference in the groove shape of the optical deflection member 161, so that the subject image captured without the optical deflection member 161 being arranged on the front side of the imaging optical system 110, A parallax occurs between the object image captured with the groove-shaped optical deflecting member 161 arranged in front of the imaging optical system 110. Therefore, these subject images become parallax images of the subject, and stereoscopic viewing is possible by reproducing these two images. Furthermore, images with different stereoscopic effects can be obtained according to the groove shape of the optical deflection member 161 disposed on the front side of the imaging optical system 110.

Next, the configuration and operation of the parallax image acquisition device according to the first embodiment will be described with reference to FIGS.
FIG. 4 is a perspective view illustrating configurations of the shutter unit 210 and the camera module 240 used in the parallax image acquisition device according to the first embodiment. FIG. 5 is an exploded perspective view showing the configuration of the shutter unit 210 and the camera module 240 shown in FIG. 6 to 10 are diagrams illustrating an internal configuration of the parallax image acquisition device according to the first embodiment, and FIG. 6 is a plan view illustrating a state in which the optical deflection member is retracted from the front side of the imaging optical system. 7 is a side view showing a state in which the second optical deflection member is retracted from the front side of the imaging optical system, FIG. 8 is a plan view showing a state in which the first optical deflection member is arranged on the front side of the imaging optical system, and FIG. FIG. 10 is a side view showing a process in which the second optical deflection member is arranged on the front side of the imaging optical system, and FIG. 10 is a plan view showing a state in which the second optical deflection member is arranged on the front side of the imaging optical system. FIG. 11 is a block diagram illustrating a configuration of the parallax image acquisition device according to the first embodiment.
4 to 10, the Z direction is a vertical direction and is a direction parallel to the optical axis Ax of the imaging optical system 110. The X direction and the Y direction are horizontal directions and perpendicular to the Z direction.
In FIGS. 6 to 10, only portions related to the description are illustrated, and the other configurations are not illustrated.

The parallax image acquisition device 200 includes a shutter unit 210, a camera module 240, a control unit 250, a 3D format conversion unit 262, an output processing unit 263, and a recording unit 264.
The shutter unit 210 and the camera module 240 are detachable from each other. The shutter unit 210 and the camera module 240 are positioned by applying the two inner surfaces 210a and 210b of the shutter unit 210 to the outer surfaces 240a and 240b of the camera module 240, respectively, and are fixed to each other by screws, for example.

The shutter unit 210 includes a first optical deflection member 213, a first optical deflection member drive actuator 220, a second optical deflection member 214, a second optical deflection member drive actuator 230, and a shutter frame 211. The first optical deflection member 213 corresponds to the first optical deflection member 121 in FIG. 1B, and the second optical deflection member 214 corresponds to the second optical deflection member 131 in FIG. That is, the angle formed by the incident plane and the exit plane of the first optical deflection member 213 is smaller than the angle formed by the incident plane and the exit plane of the second optical deflection member 214. Here, the first optical deflection member drive actuator 220 and the second optical deflection member drive actuator 230 constitute an optical deflection member drive actuator.
Since the shutter frame 211 is the same as the existing configuration, the description thereof is omitted.

The first optical deflection member drive actuator 220 arranges the first optical deflection member 213 on the front side of the imaging optical system 110 or retracts the first optical deflection member 213 from the front of the imaging optical system 110. The second optical deflection member drive actuator 230 arranges the second optical deflection member 214 on the front side of the imaging optical system 110 or retracts the second optical deflection member 214 from the front of the imaging optical system 110.
The first optical deflection member 213, the first optical deflection member drive actuator 220, the second optical deflection member 214, and the second optical deflection member drive actuator 230 are arranged inside a unit whose upper surface is closed by a shutter lid 212. Yes. By integrating the members constituting the shutter unit 210 in this way, it is possible to achieve downsizing and cost reduction.

As shown in FIG. 4, the first optical deflection member drive actuator 220 includes a rotor 221, a drive pin 222, a substrate 223, a coil holder 224, a coil 225, and a stator 226. The rotor 221, the coil holder 224, the coil 225, and the stator 226 are power generation sources, and the drive pin 222 is a transmission member.
The coil holder 224 holding the coil 225 and the stator 226 penetratingly arranged at the center of the coil holder 224 are fixed to the side surface of the shutter frame 211. A rotor 221 is rotatably held between both ends of the stator 226. The rotor 221 is made of a magnet, and an N pole is disposed on one end 226a side of the stator 226 and an S pole is disposed on the other end 226b side, respectively, similarly to the rotor 231 shown in FIG.
Further, a cylindrical shaft portion 222 a protrudes from the shutter frame 211. A drive pin 222 and a rotor 221 are arranged concentrically in order on the outer periphery of the shaft portion 222a. The drive pin 222 and the rotor 221 are fixed to each other by, for example, adhesion, and can rotate around the shaft portion 222a. When a current is passed through the coil 225, a force that rotates the rotor 221 and the drive pin 222 about the shaft portion 222a is generated according to Fleming's left-hand rule, and thereby, an arm portion that extends substantially perpendicular to the shaft portion 222a. 222b rotates around the shaft 222a.

In a state in which no current flows from the substrate 223 to the coil 225, the magnetic pole of the stator 226 has one tip 226a having an S pole and the other tip 226b having an N pole. Therefore, the rotor 221 is similar to the rotor 231 shown in FIG. 7 by the attractive force between the N pole of the rotor 221 and the S pole of the tip 226a and the attractive force between the S pole of the rotor 221 and the N pole of the tip 226b. Is held at a fixed position with respect to the stator 226.
On the other hand, in a state in which a current is passed from the substrate 223 to the coil 225, the magnetic pole of the stator 226 changes from one tip 226a to the N pole and the other tip 226b to the S pole according to the right-hand rule. (See FIG. 8). For this reason, a repulsive force is generated between the N pole of the rotor 221 and the N pole of the tip 226a, and between the S pole of the rotor 221 and the S pole of the tip 226b, so that it is the same as the rotor 231 shown in FIG. In addition, the rotor 221 rotates with respect to the stator 226, and the drive pin 222 fixed to the rotor 221 also rotates.

  The first optical deflection member 213 is integrally formed with the transmission portion 213b, the rotation shaft 215, and the connection portion 213a, and can rotate around the rotation shaft 215 held by the shutter frame 211, and the connection portion 213a. Is engaged with the arm portion 222 b of the drive pin 222. As described above, when the drive pin 222 is rotated by applying a current to the coil 225, the connecting portion 213a is displaced along with the rotation of the arm portion 222b, whereby the transmission portion 213b and the first optical deflection member 213 are moved. It rotates around the rotation shaft 215. As a result, the first optical deflection member 213 is retracted from the front side of the imaging optical system 110 and the state of being arranged on the front side of the imaging optical system 110 (the state of being arranged to overlap the opening 249 of the imaging optical system 110). The state can be realized alternatively.

As shown in FIG. 4, the second optical deflection member drive actuator 230 includes a rotor 231, drive pins 232, a substrate 233, a coil holder 234, a coil 235, and a stator 236. The coil holder 234, the coil 235, and the stator 236 are power generation sources, and the drive pin 232 is a transmission member.
The coil holder 234 holding the coil 235 and the stator 236 penetratingly arranged at the center of the coil holder 234 are fixed to the side surface of the shutter frame 211. A rotor 231 is rotatably held between both ends of the stator 236. The rotor 231 is made of a magnet, and as shown in FIG. 7, an N pole is arranged on one end 236a side of the stator 236, and an S pole is arranged on the other end 236b side.
Further, a cylindrical shaft portion 232a protrudes from the shutter frame 211. A drive pin 232 and a rotor 231 are arranged concentrically in order on the outer periphery of the shaft portion 232a. The drive pin 232 and the rotor 231 are fixed to each other by, for example, adhesion, and can be rotated about the shaft portion 232a. When a current is passed through the coil 235, a force that rotates the rotor 231 and the drive pin 232 about the shaft portion 232a is generated according to Fleming's left-hand rule, whereby an arm portion extending substantially perpendicular to the shaft portion 232a. 232b rotates around the shaft portion 232a.

In a state in which no current flows from the substrate 233 to the coil 235, the magnetic pole of the stator 236 has an S pole at one tip 236a and an N pole at the other tip 236b (FIG. 7). Therefore, the rotor 231 is fixed to the stator 236 by the attractive force between the N pole of the rotor 231 and the S pole of the tip 236a and the attractive force between the S pole of the rotor 231 and the N pole of the tip 236b. Holds in a stopped state.
On the other hand, in a state in which a current is passed from the substrate 233 to the coil 235, the magnetic pole of the stator 236 changes from one tip 236a to the N pole and the other tip 236b to the S pole according to the right screw law. FIG. 8). Therefore, a repulsive force is generated between the N pole of the rotor 231 and the N pole of the tip 236a, and between the S pole of the rotor 231 and the S pole of the tip 236b. The drive pin 232 fixed to the rotor 231 also rotates (clockwise direction in FIG. 8).

  The second optical deflection member 214 is integrally formed with the transmission portion 214b, the rotation shaft 216, and the connection portion 214a, and is rotatable about the rotation shaft 216 held by the shutter frame 211, and the connection portion 214a. Is engaged with the arm portion 232 b of the drive pin 232. As described above, when the drive pin 232 is rotated by applying a current to the coil 235, the connecting portion 214a is displaced along with the rotation of the arm portion 232b, thereby causing the transmission portion 214b and the second optical deflection member 214 to move. It rotates around the rotation shaft 216. Accordingly, the second optical deflection member 214 is retracted from the front side of the imaging optical system 110 and the state of being disposed on the front side of the imaging optical system 110 (the state of being disposed so as to overlap the opening 249 of the imaging optical system 110). The state can be realized alternatively.

The camera module 240 includes a module substrate 241 for driving and controlling members constituting the camera module 240, a cover glass holder 242 for holding a cover glass, an AF actuator 243, and a flexible substrate 244 for connecting the camera module 240 and the control unit 250. (FIG. 5), the imaging optical system 110 and the imaging element 120 are provided.
The camera module 240 can be configured by an imaging device used for capturing a normal two-dimensional image. Therefore, the parallax image acquisition device of the first embodiment can easily acquire a parallax image by attaching the shutter unit 210 to a normal imaging device.
The AF actuator 243 is for driving the imaging optical system 110 for autofocus, and uses, for example, a voice coil motor.

  The controller 250 rotates the first optical deflection member 213 or the second optical deflection member 214 by driving the first optical deflection member drive actuator 220 or the second optical deflection member drive actuator 230, and the imaging optical system 110. The parallax is obtained by imaging in a state where the optical deflection member is not disposed on the front side (front surface) of the optical system and imaging in a state where the first optical deflection member 213 or the second optical deflection member 214 is disposed on the front side of the imaging optical system 110. The image sensor 120, the first optical deflection member driving actuator 220, and the second optical deflection member driving actuator 230 are controlled so as to obtain a parallax image having

  The 3D format conversion unit 262 is set to the 3D mode by the control unit 250 when the user selects the 3D mode. The 3D format conversion unit 262 corresponds to the set mode, performs 3D format conversion, and generates a stereoscopic image from the parallax image acquired by the image sensor 120. As the 3D format conversion, for example, SIDE BY SIDE, LINE BY LINE, ABOVE-BELOW, and CHECKERBOARD are used.

  The output processing unit 263 outputs the 3D image processed for display by the 3D format conversion unit 262 to a monitor unit (not shown). Further, the output processing unit 263 also performs image output processing such as display of a 2D image and a menu related to the operation of the parallax image acquisition device 200.

  The recording unit 264 stores the image data converted into the 3D format by the 3D format conversion unit 262 in a nonvolatile manner. The recording unit 264 may be configured as a removable memory that can be carried out of the parallax image acquisition apparatus 200, such as a memory card. Therefore, the recording unit 264 may not have a configuration unique to the parallax image acquisition device 200.

  Next, a parallax image acquisition method using the above-described parallax image acquisition device will be described with reference to FIG. FIG. 12 is a flowchart illustrating a process flow of the parallax image acquisition method according to the first embodiment.

First, when the user operates an instruction switch (not shown) for starting 3D shooting, the control unit 250 starts the parallax image acquisition process shown in FIG. If there is the deflection member 213 and the second optical deflection member 214, they are retracted by driving the first optical deflection member drive actuator 220 and the second optical deflection member drive actuator 230 (step S101).
Subsequently, the control unit 250 causes the camera module 240 to execute the first imaging, and the camera module 240 images the subject image (step S102, second imaging step). The captured subject image is stored in the recording unit 264.

  Here, in the imaging process, by passing a current from the control unit 250 to the AF actuator 243, the imaging optical system 110 is driven in the direction of the optical axis Ax, and AF driving is performed. At this time, the control unit 250 processes the signal input from the image sensor 120 for each step, and acquires the contrast value of the captured image. Then, the position of each lens of the imaging optical system 110 with the best contrast value is acquired as the in-focus position, and the imaging optical system 110 is driven to the in-focus position. In this state, the first image is taken (step S102).

Next, the control unit 250 causes the user to specify the strength of the stereoscopic effect (step S103).
When the user designates a weak stereoscopic effect (when an operation corresponding to “weak” is performed in step S <b> 103), the control unit 250 drives the first optical deflection member drive actuator 220 to drive the first optical deflection member 213. Is arranged on the front side of the imaging optical system 110 (step S104).
On the other hand, when the user designates a strong stereoscopic effect (when an operation corresponding to “strong” is performed in step S103), the control unit 250 drives the second optical deflection member driving actuator 230 to drive the first. 2 The optical deflection member 214 is disposed on the front side of the imaging optical system 110 (step S105).

Subsequently, the control unit 250 causes the imaging optical system 110 to perform the second imaging, and the camera module 240 images the subject image (step S106, first imaging step). The captured subject image is stored in the recording unit 264. The subject image captured here has a parallax with respect to the subject image captured in step S102, and these subject images become parallax images.
Note that the imaging process in step S106 is the same as the imaging process in step S102, and a detailed description thereof will be omitted.

  Further, the control unit 250 causes the 3D format conversion unit 262 to perform 3D format conversion on the pair of subject images captured in step S102 and step S106. The converted data is stored in the recording unit 264. When the image with parallax stored in this way is output from the output processing unit 263 to an external display device (not shown) and reproduced, stereoscopic viewing becomes possible.

According to the parallax image acquisition apparatus and parallax image acquisition method of the first embodiment, the subject image captured without any optical deflection member being placed on the front surface of the imaging optical system 110 and any optical deflection member are captured. A parallax occurs between the subject image captured in the state of being placed on the front surface of the optical system 110, and a 3D image can be created. Moreover, since a 3D image can be acquired simply by bending the light beam with the optical deflection member, the optical performance does not deteriorate. Furthermore, since photography can be performed with a single eye, that is, with one imaging optical system, the apparatus can be reduced in size and cost.
Further, by adopting a configuration in which the optical deflecting members 213 and 214 are accommodated in the shutter unit 210, it can be easily attached to and detached from the imaging camera module 240, can be used in various models, and can be easily assembled. .

(Second Embodiment)
In the parallax image acquisition device according to the second embodiment, the point is that two optical deflection members having different inclination directions are provided, and the optical deflection member in the inclination direction according to the posture of the device is selected selectively. It differs from the parallax image acquisition apparatus which concerns on 1 embodiment. Other configurations are the same as those of the parallax image acquisition device according to the first embodiment, and the same reference numerals are used for the same members, and detailed descriptions thereof are omitted.

FIG. 13 is a cross-sectional view illustrating the configuration of the imaging device 120, the imaging optical system 110, and the optical deflection members 171 and 181 used in the parallax image acquisition device according to the second embodiment, and (a) illustrates the first optical deflection. FIG. 8B is a diagram illustrating a state in which the member 171 is disposed on the front side of the imaging optical system 110, and FIG. 7B is a diagram illustrating a state in which the second optical deflection member 181 having a different tilt direction from that in FIG. It is. FIG. 14 is a perspective view showing a shape example of the first optical deflection member 171 in the second embodiment.
FIG. 14 shows the first optical deflection member 171 in a simplified manner in order to clarify the tilt direction. The second optical deflection member 181 has the same shape as the first optical deflection member 171.

  The parallax image acquisition device according to the second embodiment includes an imaging device 120, an imaging optical system 110 that forms a subject image on the imaging device 120, and an object side (see FIG. 1 on the front side of the imaging optical system 110, and a first optical deflection member 171 that deflects the light beam traveling from the left side of 1 to the imaging optical system 110 in the first direction (the direction in which the light beam L1 travels in FIG. 1B). A second optical deflection member 181 that deflects a light beam traveling from the object side to the imaging optical system 110 when disposed in a second direction (a direction in which the light beam L3 travels in FIG. 1C), and a first optical deflection. Optical deflection member drive actuators 220 and 230 (FIG. 22) for driving the member 171 and the second optical deflection member 181 respectively. In these optical deflection member drive actuators 220 and 230, the first optical deflection member 171 is disposed in front of the imaging optical system 110, and the second optical deflection member 181 is disposed in front of the imaging optical system 110. The second state, and the third state in which neither the first optical deflection member 171 nor the second optical deflection member 181 are arranged on the front surface of the imaging optical system 110 are alternatively selected. The subject image captured in the first state and the subject image captured in the third state are parallax images having parallax with each other, and the subject image captured in the second state is captured in the third state. The subject images are parallax images having parallax.

  The imaging optical system 110 is driven along the optical axis Ax by the AF actuator 243 (FIG. 22) in accordance with an instruction signal from the control unit 350 (FIG. 22), and forms a subject image on the image sensor 120. The image sensor 120 photoelectrically converts the subject image formed on the imaging surface to generate an electrical image signal.

  The first optical deflecting member 171 and the second optical deflecting member 181 have the same shape and are formed of prisms having an inclination along one direction indicated by an arrow in FIG. The first optical deflection member 171 and the second optical deflection member 181 are arranged such that the inclination direction is different when arranged on the front side of the imaging optical system 110. The prism used for the first optical deflection member 171 and the second optical deflection member 181 is preferably an optical glass member having a refractive index of about 1.5, and is made of a glass material such as BK7. Here, the inclination shown in FIG. 14 is such that the interval between the incident plane 172 and the exit plane 173 (FIG. 13) decreases in the first optical deflection member 171, and the exit plane 182 and the exit in the second optical deflection member 181. The direction in which the space between the planes 183 (FIG. 13) decreases is shown.

As shown in FIG. 13, the first optical deflection member 171 has an incident plane 172 and an exit plane 173 as optical surfaces arranged on the front side of the imaging optical system 110. The incident plane 172 and the exit plane 173 are sequentially arranged from the front along the optical axis Ax of the imaging optical system 110, and form a predetermined angle θ with respect to each other.
Similar to the first optical deflection member 171, the second optical deflection member 181 has an incident plane 182 and an exit plane 183 as optical surfaces arranged on the front side of the imaging optical system 110, as shown in FIG. The incident plane 182 and the exit plane 183 are sequentially arranged from the front along the optical axis Ax of the imaging optical system 110, and form a predetermined angle θ with respect to each other.
If the angles θ formed by the incident planes 172 and 182 and the exit planes 173 and 183 are 0.1 degrees or more and 3 degrees or less, the occurrence of chromatic aberration can be reduced.
In FIGS. 13 and 14, for the convenience of explanation, the angle θ is shown larger than the actual one so that the angle θ is clear.

  In addition, the prism which comprises the optical deflection | deviation members 171 and 181 may use a resin member. Use of a resin member is preferable because the weight can be reduced, the material cost can be reduced, and the degree of freedom in processing is further increased.

In the state shown in FIG. 13A, when the light beam L1 enters the first optical deflection member 171 from the air, it is refracted by the refraction action at the incident plane 172, and further refracted by the refraction action at the exit plane 173. For this reason, the angle of the light beam can be changed between the incident side and the exit side with respect to the light beam L2 when the first optical deflection member 171 is not disposed on the optical axis Ax. That is, the first optical deflection member 171 can deflect the light beam traveling from the object side to the imaging optical system 110.
In the state shown in FIG. 13B, as in the state shown in FIG. 13A, when the light beam L3 enters the second optical deflection member 181 from the air, it is refracted by the refraction action at the incident plane 182. The exit plane 183 is also refracted by the refraction action. For this reason, the angle of the light beam can be changed between the incident side and the exit side with respect to the light beam L2 when the second optical deflection member 181 is not disposed on the optical axis Ax. That is, the second optical deflection member 181 can deflect the light beam traveling from the object side to the imaging optical system 110.

  Here, the imaging optical system shown in FIGS. 13A and 13B is a coaxial optical system, and the light beam that is refracted by the optical deflection members 171 and 181 and travels to the imaging element 120 is on the optical axis Ax. It travels on the optical axis Ax in the same manner as the light beam without the optical deflection members 171 and 181.

As shown in FIG. 13A and FIG. 13B, the first optical deflection member 171 and the first optical deflection member 171 are arranged as the optical deflection member arranged on the front side of the imaging optical system 110 according to the angle of the optical axis Ax of the incident light beam. By selecting one of the two optical deflection members 181, the angle of the light beam incident on the imaging optical system 110 from the object side can be changed. Therefore, in the state shown in FIG. 13A, if the first optical axis that provides the first subject image to the image sensor 120 is configured, the state shown in FIG. Thus, a second optical axis that provides a second subject image different from the first subject image is formed. As a result, the subject image shot without the optical deflection member arranged on the front side of the imaging optical system 110 and the first optical deflection member 171 or the second optical deflection member 181 arranged on the front side of the imaging optical system 110 are arranged. Since parallax occurs between the subject image captured in the state (FIG. 13 (a) or FIG. 13 (b)), these subject images become parallax images of the subject, and by reproducing these two images, Stereoscopic viewing is possible.
Furthermore, by selectively selecting the optical deflection member disposed on the front side of the imaging optical system 110 according to the posture of the parallax image acquisition device, it is possible to obtain a stereoscopic image corresponding to the posture.

  FIG. 15 is a front view showing a mobile phone in which the parallax image acquisition device according to the second embodiment is incorporated. FIG. 15 shows a state in which the mobile phone 140 is placed vertically, and the reference direction V along the longitudinal direction of the vertically long mobile phone 140 is set on the vertical direction. This mobile phone is an example of a mobile information terminal provided with the parallax image acquisition apparatus of the second embodiment, and examples of the mobile information terminal include a digital camera, a personal computer, and a mobile terminal.

  As shown in FIG. 15, the mobile phone 140 includes a microphone unit 141, a speaker unit 142, an input dial 143, a monitor unit 144, an imaging optical system 145, an antenna 146, and processing means. Yes.

  Here, the microphone unit 141 is for inputting an operator's voice as information. The speaker unit 142 is for outputting the voice of the other party. The input dial 143 is for an operator to input information. The monitor unit 144 is for displaying information such as a photographed image of the operator himself or the other party, a telephone number, and the like. The antenna 146 is for transmitting and receiving communication radio waves. The processing means (not shown) is for processing image information, communication information, input signals, and the like.

  Here, the monitor unit 144 is a liquid crystal display element. Further, in FIG. 15, the arrangement positions of the respective components are not particularly limited to these. As the imaging optical system 145, for example, the imaging optical system 110 of FIG. 13 is used, and is built in the mobile phone 140.

FIG. 16 shows the relationship between the reference direction V in the mobile phone 140 and the inclination direction (arrow direction in FIG. 14) of the first optical deflection member 171 or the second optical deflection member 181 disposed on the front side of the imaging optical system 145. FIG. 16 is a view of the optical deflection member incorporated in the mobile phone shown in FIG. 15 as seen from the same direction as FIG.
As shown in FIG. 16, the direction along the reference direction V and the upward inclination direction, that is, the direction in which the angle with respect to the reference direction V is 0 degrees is defined as the inclination direction D0. On the other hand, with respect to the center C0 of the optical deflection member having a circular shape in plan view, the direction that forms 90 degrees with respect to the inclination direction D0 in the clockwise direction in FIG. 16 is the inclination direction D90, and the direction that forms 180 degrees is the inclination direction. The direction that forms D180 and 270 degrees is defined as an inclination direction D270.

FIG. 17 is a diagram showing an example of the tilt direction of the optical deflection member when the mobile phone 140 of FIG. 15 is placed vertically, that is, when the mobile phone 140 is placed so that the reference direction V is along the vertical direction. (A) is a state in which the optical deflection member is retracted from the front side of the imaging optical system 110, and (b) is a diagram showing a state in which the optical deflection member having an inclination direction of 270 degrees is arranged on the front side of the imaging optical system 110. It is.
FIG. 18 is a diagram showing an example of the tilt direction of the optical deflection member when the mobile phone 140 of FIG. 15 is placed horizontally, that is, when the mobile phone 140 is placed so that the reference direction V is along the horizontal direction. (A) is a state in which the optical deflection member is retracted from the front side of the imaging optical system 110, and (b) is a diagram showing a state in which the optical deflection member having an inclination direction of 180 degrees is arranged on the front side of the imaging optical system 110. It is.

In the state shown in FIG. 17B, the inclination direction of the optical deflection member is D270, and in the state shown in FIG. 18B, the inclination direction of the optical deflection member is D180. Therefore, the inclination directions of the two are 90 degrees different from each other in a plane perpendicular to the optical axis Ax of the imaging optical system 110.
Here, for example, as the optical deflection member disposed on the front side of the imaging optical system 110 in the state shown in FIG. 17B, the first optical deflection member 171 shown in FIG. 13A is used, and FIG. A second optical deflection member 181 shown in FIG. 13B can be used as an optical deflection member arranged on the front side of the imaging optical system 110 in the state shown.

Next, the configuration and operation of the parallax image acquisition device according to the second embodiment will be described with reference to FIGS. 19 to 22.
19 to 22 are diagrams illustrating an internal configuration of the parallax image acquisition device according to the second embodiment, and FIG. 19 is a plan view illustrating a state in which the optical deflection member is retracted from the front side of the imaging optical system 110. 20 is a plan view showing a state in which the first optical deflection member 313 is arranged on the front side of the imaging optical system 110, and FIG. 21 shows a state in which the second optical deflection member 314 is arranged on the front side of the imaging optical system 110. It is a top view. FIG. 22 is a block diagram illustrating a configuration of the parallax image acquisition device 300 according to the second embodiment.
19 to 21, the Z direction is a vertical direction and is a direction parallel to the optical axis Ax of the imaging optical system 110. The X direction and the Y direction are horizontal directions and perpendicular to the Z direction.
In FIGS. 19 to 21, only the part related to the description is shown, and the other configurations are not shown.

  The parallax image acquisition apparatus 300 includes a shutter unit 210, a camera module 240, an attitude detection sensor 340, a control unit 350, a 3D format conversion unit 262, an output processing unit 263, and a recording unit 264.

  The shutter unit 210 includes a first optical deflection member 313, a first optical deflection member drive actuator 220, a second optical deflection member 314, a second optical deflection member drive actuator 230, and a shutter frame 211. The optical deflection members 313 and 314 use the same prisms as the optical deflection members 171 and 181 in FIG.

The first optical deflection member drive actuator 220 arranges the first optical deflection member 313 on the front side of the imaging optical system 110 or retracts the first optical deflection member 313 from the front side of the imaging optical system 110. The second optical deflection member drive actuator 230 arranges the second optical deflection member 314 on the front side of the imaging optical system 110 or retracts the second optical deflection member 314 from the front of the imaging optical system 110.
The first optical deflection member 313, the first optical deflection member drive actuator 220, the second optical deflection member 314, and the second optical deflection member drive actuator 230 are arranged inside a unit whose upper surface is closed by the shutter lid 212. Yes. By integrating the members constituting the shutter unit 210 in this way, it is possible to achieve downsizing and cost reduction.

  The first optical deflection member 313 is rotatable about a rotation shaft 215 held by the shutter frame 211, and the connecting portion 313 a is engaged with the arm portion 222 b of the drive pin 222. Similar to the parallax image acquisition device of the first embodiment, when the drive pin 222 is rotated by applying a current to the coil 225, the connecting portion 313a is displaced along with the rotation of the arm portion 222b. The optical deflection member 313 rotates around the rotation shaft 215. Thereby, the first optical deflection member 313 is retracted from the front side of the imaging optical system 110 and the state of being arranged on the front side of the imaging optical system 110 (the state of being arranged to overlap the opening 249 of the imaging optical system 110). The state can be realized alternatively.

  The second optical deflection member 314 is rotatable about a rotation shaft 216 held by the shutter frame 211, and the connecting portion 314 a is engaged with the arm portion 232 b of the drive pin 232. Similar to the parallax image acquisition device of the first embodiment, when the drive pin 232 is rotated by applying a current to the coil 235, the connecting portion 314a is displaced along with the rotation of the arm portion 232b. The optical deflection member 314 rotates around the rotation shaft 216. Thereby, the second optical deflection member 314 is retracted from the front side of the imaging optical system 110 and the state of being arranged on the front side of the imaging optical system 110 (the state of being arranged to overlap the opening 249 of the imaging optical system 110). The state can be realized alternatively.

  The posture detection sensor 340 detects the posture of the parallax image acquisition device and uses, for example, an acceleration sensor.

The control unit 350 drives the first optical deflection member drive actuator 220 or the second optical deflection member drive actuator 230 based on the output of the attitude detection sensor 340.
In the following description, the control unit 350 drives the first optical deflection member drive actuator 220 or the second optical deflection member drive actuator 230 according to the attitude of the parallax image acquisition device so that the parallax image has parallax in the horizontal direction. Let That is, the control unit 350 arranges the optical deflection member in the tilt direction D270 on the front side of the imaging optical system 110 when the mobile phone 140 including the parallax image acquisition device is placed vertically, and tilts when the mobile phone 140 is placed horizontally. The optical deflection member in the direction D180 is disposed on the front side of the imaging optical system 110.

Next, a parallax image acquisition method using the above-described parallax image acquisition device will be described with reference to FIG. FIG. 23 is a flowchart illustrating a process flow of the parallax image acquisition method according to the second embodiment.
Hereinafter, although the parallax image acquisition method in the case of the mobile phone 140 provided with the parallax image acquisition device will be described, the same applies to the case of applying to other than the mobile phone.

First, when the user operates an instruction switch (not shown) for starting 3D shooting, the control unit 350 starts the parallax image acquisition process shown in FIG. If there is the deflection member 313 and the second optical deflection member 314, the first optical deflection member drive actuator 220 and the second optical deflection member drive actuator 230 are driven to retreat (step S201, FIG. 17A or FIG. 18). (State of (a)).
Subsequently, the control unit 250 causes the camera module 240 to execute the first imaging, and the camera module 240 images a subject image (step S202, second imaging step). The captured subject image is stored in the recording unit 264.

  Next, control unit 350 causes posture detection sensor 340 to detect the posture of mobile phone 140 (step S203). Control unit 350 determines whether the posture of mobile phone 140 is horizontal or vertical based on the output of posture detection sensor 340 (step S204).

When mobile phone 140 is placed vertically (when it is determined in step S204 that the signal output from posture detection sensor 340 is a signal corresponding to “vertical placement”), control unit 350 drives the first optical deflection member. The actuator 220 is driven, and the first optical deflecting member 313 whose inclination direction is D270 is disposed on the front side of the imaging optical system 110 (step S205).
On the other hand, when mobile phone 140 is in the horizontal position (when it is determined in step S204 that the signal output from posture detection sensor 340 is a signal corresponding to “horizontal position”), control unit 350 The second optical deflection member drive actuator 230 is driven to place the second optical deflection member 314 whose tilt direction is D180 on the front side of the imaging optical system 110 (step S206).

Subsequently, the control unit 350 causes the camera module 240 to execute the second imaging, and the camera module 240 images a subject image (step S207, first imaging step). The captured subject image is stored in the recording unit 264.
The subject image captured here has a parallax with respect to the subject image captured in step S202, and these subject images become parallax images. Therefore, the parallax image acquisition device of the second embodiment acquires a 3D image regardless of the posture of the parallax image acquisition device 300 by disposing an optical deflection member corresponding to the posture of the device on the front side of the imaging optical system 110. It becomes possible to do.

In the above description, the optical deflection member in the tilt direction D270 is disposed on the front side of the imaging optical system 110 when the mobile phone 140 is placed vertically, but an optical deflection member in the tilt direction D90 may be used instead. Further, although the optical deflection member in the tilt direction D180 is disposed on the front side of the imaging optical system 110 when the mobile phone 140 is placed horizontally, an optical deflection member in the tilt direction D0 may be used instead.
In addition, about another structure, an effect | action, and an effect, it is the same as that of 1st Embodiment.

  As described above, the parallax image acquisition device according to the present invention has a small configuration, and can acquire a parallax image with a single optical system that can acquire a parallax image with good image quality without significant cost increase. Useful in terms of acquisition.

DESCRIPTION OF SYMBOLS 110 Image pick-up optical system 120 Image pick-up element 121 1st optical deflection | deviation member 122 Incident plane 123 Ejection plane 131 2nd optical deflection member 132 Incident plane 133 Ejection plane 140 Mobile phone 141 Microphone part 142 Speaker part 143 Input dial 144 Monitor part 145 Imaging optical system 146 Antenna 150 Bending optical system 151 Optical deflecting member 161 Optical deflecting member 171 First optical deflecting member 172 Incident plane 173 Ejecting plane 181 First optical deflecting member 182 Incident plane 183 Ejecting plane 200 Parallax image acquisition device 210 Shutter unit 211 Shutter frame 212 Shutter lid 213 First optical deflection member 213a Connection portion 213b Transmission portion 214 Second optical deflection member 214a Connection portion 214b Transmission portion 215, 216 Rotating shaft 220 First optical deflection member drive arm Tutor 221 Rotor 222 Drive pin 222a Shaft part 222b Arm part 223 Substrate 224 Coil holder 225 Coil 226 Stator 230 Second optical deflection member drive actuator 231 Rotor 232 Drive pin 232a Shaft part 232b Arm part 233 Substrate 234 Coil holder 235 Coil 236 Stator 240 Camera module 241 Module substrate 242 Cover glass holder 243 AF actuator 244 Camera module 249 Aperture 250 Control unit 262 3D format conversion unit 263 Output processing unit 264 Recording unit 300 Parallax image acquisition device 313 First optical deflection member 313a Connection unit 313b Transmission unit 314 Second optical deflection member 314a Connection unit 313b Transmission unit 340 Attitude detection sensor 350 Control unit

Claims (14)

An image sensor;
An imaging optical system that forms a subject image on the imaging element;
A first optical deflection member that deflects light rays traveling from the object side to the imaging optical system when arranged in front of the imaging optical system in a first direction;
A second optical deflection member that deflects light rays traveling from the object side to the imaging optical system when arranged in front of the imaging optical system in a second direction;
An optical deflection member driving actuator for driving the first optical deflection member and the second optical deflection member;
Have
The optical deflection member drive actuator is
A first state in which the first optical deflection member is disposed in front of the imaging optical system;
A second state in which the second optical deflection member is disposed in front of the imaging optical system;
A third state in which neither the first optical deflection member nor the second optical deflection member is disposed on the front surface of the imaging optical system; alternatively,
The subject image captured in the first state and the subject image captured in the third state are parallax images having parallax, and
The parallax image acquisition apparatus characterized in that the subject image captured in the second state and the subject image captured in the third state are parallax images having parallax.   The parallax image acquisition apparatus according to claim 1, wherein the first direction and the second direction have different angles with respect to an optical axis of the imaging optical system.   The parallax image acquisition apparatus according to claim 1, wherein the first direction and the second direction are approximately 90 degrees in a plane perpendicular to the optical axis of the imaging optical system. An attitude sensor for detecting the attitude of the parallax image acquisition device;
The optical deflection member drive actuator, based on the output of the attitude sensor, the first state or the second state, and the third state, so that the parallax image has a parallax in the horizontal direction, The parallax image acquisition apparatus according to claim 3, wherein the parallax image acquisition apparatus is selected. The optical deflection member drive actuator is
At least one power generation source;
A first transmission member configured to transmit power generated by the at least one power generation source to the first optical deflection member and dispose the first optical deflection member on a front surface of the imaging optical system;
A second transmission member configured to transmit power generated by the at least one power generation source to the second optical deflection member, and to dispose the second optical deflection member in front of the imaging optical system;
Have
The first optical deflection member and the first transmission member are integrally formed, and the second optical deflection member and the second transmission member are integrally formed. The parallax image acquisition device described. The imaging optical system is housed in a first housing,
The first optical deflection member, the second optical deflection member, and the optical deflection member drive actuator are housed in a second housing,
The parallax image acquisition apparatus according to claim 1, wherein the first casing and the second casing have a structure in which the first casing and the second casing are detachably attached to each other. The optical deflection member comprises one entrance plane and one exit plane,
The parallax image acquisition apparatus according to any one of claims 1 to 6, wherein the incident plane and the emission plane are at a predetermined angle with each other.   The parallax image acquisition apparatus according to claim 7, wherein the predetermined angle is not less than 0.1 degrees and not more than 3 degrees.   The parallax image acquisition device according to any one of claims 1 to 8, wherein the optical deflection member is an optical glass member.   The parallax image acquisition device according to any one of claims 1 to 8, wherein the optical deflection member is a resin member.   The parallax image acquisition apparatus according to any one of claims 1 to 10, wherein the imaging optical system is a coaxial optical system.   The parallax image acquisition device according to any one of claims 1 to 10, wherein the imaging optical system is a bending system.   A portable information terminal comprising the parallax image acquisition device according to any one of claims 1 to 12. An image sensor;
An imaging optical system that forms a subject image on the imaging element;
A first optical deflection member that deflects light rays traveling from the object side to the imaging optical system when arranged in front of the imaging optical system in a first direction;
A second optical deflection member that deflects light rays traveling from the object side to the imaging optical system when arranged in front of the imaging optical system in a second direction;
A parallax image capturing apparatus having a parallax image
A first imaging step of imaging a subject image in a state where the first optical deflection member or the second optical deflection member is disposed in front of the imaging optical system;
A second imaging step of imaging a subject image in a state in which neither the first optical deflection member nor the second optical deflection member is disposed in front of the imaging optical system;
A parallax image obtaining method characterized by comprising:

Images