JP5362157B1 - Stereoscopic imaging apparatus and stereoscopic imaging method - Google Patents

Abstract

  The first imaging unit (101) and the second imaging unit (111), an imaging parameter determination unit (11a) for determining imaging parameters, and control for setting imaging parameters and imaging a stereoscopic image When the imaging control unit (11a) includes the imaging control unit (11b) and the imaging control unit (11b) captures the first image with a predetermined imaging parameter, the imaging parameter determining unit (11a) determines that the maximum parallax amount in the first image is a predetermined amount. The first period which is out of the range is specified, and the first correction parameter in which the maximum parallax amount of the first image in the first period falls within the predetermined range is determined, and the imaging control unit (11b) When the second video is shot after shooting, control for shooting the second video with the first correction parameter is performed during the second period corresponding to the first period during shooting of the second video. apparatus.

Description

  The present disclosure relates to a stereoscopic image capturing device that captures a stereoscopic image.

  As described in Patent Document 1, a method has been proposed in which, when shooting a stereoscopic video, a shooting parameter such as a lens interval is derived from a depth range of a subject for shooting. According to the technology disclosed in Patent Document 1, it is possible to capture a stereoscopic video (stereo 3D video) without the photographer having specialized knowledge.

JP 2001-142166 A

  However, in the technique of Patent Document 1 described above, for example, when the camera captures an image with pan / tilt movement, a closer subject or a farther subject is captured. In the case of entering a range (shooting angle of view), there is a problem that a scene in which the subject is shown in the captured video is accompanied by excessive parallax.

  The present disclosure provides a stereoscopic image capturing device capable of easily reducing the risk of capturing an image with such excessive parallax.

  A stereoscopic image capturing apparatus according to an aspect of the present disclosure includes a first imaging unit and a second imaging unit that capture an image for stereoscopic viewing, and the first imaging unit and the second imaging unit. The imaging parameter determining unit configured to determine an imaging parameter that is at least one of an inter-lens distance and a convergence angle, and setting the imaging parameters in the first imaging unit and the second imaging unit And a shooting control unit for performing control of shooting a video, wherein the shooting control unit shoots the first video by the first and second shooting units set to predetermined shooting parameters. The photographing parameter determination unit specifies a first period in which the maximum parallax amount is out of a predetermined range in the first image, and the maximum parallax amount of the first image in the first period falls within the predetermined range. Shooting parameter The first correction parameter, which is a first correction parameter, is determined, and the shooting control unit sets the first shooting parameter to the predetermined shooting parameter when shooting a second video corresponding to the first video after shooting the first video. The second imaging unit and the second imaging unit start capturing the second image, and during the second period corresponding to the first period while the second image is being captured, the first correction parameter is set. Control is performed to capture the second image by the first capturing unit and the second capturing unit.

  As described above, by determining the first correction parameter by prior shooting (shooting of the first image), in the case of production shooting (shooting of the second image), the first suitable for the subject to be cut in during shooting Correction parameters can be set automatically. That is, it is possible to easily reduce the risk of capturing an image with excessive parallax.

  Further, the photographing control unit is configured to set the first correction parameter in a third period, which is a period of a predetermined length temporally continuous to the second period, during photographing of the second image. Control may be performed to capture the second image by the first imaging unit and the second imaging unit.

  As a result, even when a slight deviation occurs in the photographing time and the photographing position between the photographing of the first video and the photographing of the second video, it is possible to reduce the risk of occurrence of excessive parallax.

  In addition, the imaging parameter determination unit may be configured to set the imaging parameter as the imaging parameter for a third period, which is a period of a predetermined length temporally continuous to the second period, during imaging of the second image. The second correction parameter, which is the shooting parameter, in which the distance monotonously increases or decreases with the passage of time, or the convergence angle monotonously increases or decreases with the passage of time is determined. During the period, control may be performed to capture the second image by the first imaging unit and the second imaging unit set in the second correction parameter.

  As a result, since the change of the shooting parameter to the first correction parameter is smoothly performed, it is possible to shoot a higher quality video that makes it difficult for the viewer of the video to notice the change of the shooting parameter.

  Further, according to an embodiment of the present disclosure, there is provided a stereoscopic image capturing device including: a camera unit including a first imaging unit and a second imaging unit configured to capture a stereoscopic image; and a movable unit configured to move a position of the camera unit. An imaging parameter determination unit that determines an imaging parameter that is at least one of an inter-lens distance and a convergence angle of the first imaging unit and the second imaging unit; a first imaging unit; And a shooting control unit configured to set the shooting parameters in the second shooting unit and control to shoot the image for stereoscopic viewing, the shooting control unit moving the position of the camera unit by the movable unit, When the first imaging unit and the second imaging unit set to predetermined imaging parameters capture the first image, the imaging parameter determination unit determines that the maximum parallax amount is outside the predetermined range. A first position, which is a position, is specified, and a first correction parameter, which is the shooting parameter, in which the maximum parallax amount of the first image shot at the first position falls within the predetermined range is determined. When shooting the second video corresponding to the first video after shooting the first video, the second shooting unit and the second shooting unit set in the predetermined shooting parameters When shooting of a video is started and the camera unit is positioned at the first position during shooting of the second video, the first shooting unit and the second shooting unit set in the first correction parameter Control to shoot the second image according to

  As described above, by controlling the imaging parameter according to the imaging position, it is possible to reduce the risk of imaging an image with excessive parallax regardless of the imaging time.

  In the above-described configuration, the image capturing apparatus further includes a storage unit that stores position information that is a time change of the position of the camera unit at the time of shooting the first video, and the shooting control unit is configured to shoot the second video. Furthermore, by controlling the movable portion, control may be performed to capture the second image while moving the position of the camera unit according to the position information.

  According to the above configuration, it is possible to match the motion of the camera for the first shooting and the shooting for the second and subsequent shots, and to more accurately match the dynamic change of the stereoscopic shooting parameter in the second and subsequent shootings with the video being shot It becomes possible.

  The stereoscopic image capturing device according to the present disclosure can easily reduce the risk of capturing an image with excessive parallax.

FIG. 1 is a diagram showing the configuration of a stereoscopic video imaging apparatus according to the first embodiment. FIG. 2 is a block diagram showing a detailed configuration of the stereoscopic video imaging device according to the first embodiment. FIG. 3A is a diagram for explaining a method of capturing a stereoscopic video using the stereoscopic video capturing device according to the first embodiment. FIG. 3B is a view showing a left eye image and a right eye image captured under the imaging conditions shown in FIG. 3A. FIG. 4 is a diagram for explaining an example in which a moving image having large parallax is obtained in shooting with the stereoscopic video imaging device according to the first embodiment. FIG. 5 is a diagram showing an example of shooting parameter control of the stereoscopic video shooting apparatus according to the first embodiment. FIG. 6 is a flowchart showing the operation of the stereoscopic video imaging apparatus. FIG. 7 is a diagram showing an example of shooting failure in the stereoscopic video shooting device according to the second embodiment. FIG. 8 is a diagram showing an example of imaging failure notification in the stereoscopic video imaging device according to the second embodiment. FIG. 9 is a diagram showing an example of a stereoscopic video imaging apparatus including a movable portion. FIG. 10 is a diagram showing an example of shooting parameter control using a shooting position in the stereoscopic video shooting apparatus according to the third embodiment.

  Hereinafter, a stereoscopic video imaging apparatus according to the embodiment will be described with reference to the drawings.

  However, the detailed description may be omitted if necessary. For example, detailed description of already well-known matters and redundant description of substantially the same configuration may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art.

  It is noted that the inventors provide the attached drawings and the following description so that those skilled in the art can fully understand the present disclosure, and intend to limit the claimed subject matter by these Absent.

Embodiment 1
FIG. 1 is a diagram showing the configuration of a stereoscopic video imaging apparatus according to the first embodiment.

  FIG. 1A shows a side view of the stereoscopic video imaging apparatus according to the first embodiment. FIG. 1B is a plan view (a top view) of the stereoscopic image capturing device according to the present embodiment. Furthermore, FIG. 2 is a block diagram showing a detailed configuration of the stereoscopic video imaging apparatus.

  The stereoscopic image photographing apparatus 200 shown in FIGS. 1A and 1B includes a control unit 100, a first lens barrel 101, a first lens barrel holding member 102, a beam splitter evaporation surface 105, and the like. Second lens barrel 111, second lens barrel holding member 112, inter-lens distance variable mechanism 113, base member 120, vertical fixing member 121, front window 122, beam splitter prism 130, prism holding member 131, first And a second lens barrel support member 136.

  The control unit 100 controls the entire stereoscopic video imaging device 200. Specific contents of the control unit 100 will be described later.

  The first lens barrel 101 and the second lens barrel 111 respectively capture a pair of images constituting an image for stereoscopic vision, that is, an image for the left eye and an image for the right eye. For convenience of description, it is assumed that the first lens barrel 101 captures an image for the left eye. In addition, the second lens barrel 111 is assumed to capture an image for the right eye.

  As shown in FIG. 2, the first lens barrel 101 includes a first lens group 211, a first imaging unit 212, and a first A / D converter 213. The second lens barrel 111 is configured of a second lens group 221, a second imaging unit 222, and a second A / D conversion unit 223. Hereinafter, the first lens barrel 101 and the second lens barrel 111 will also be described as the camera unit 1.

  The first lens group 211 and the second lens group 221 are composed of a plurality of optical lenses. The first lens group 211 and the second lens group 221 focus light from the subject on the first imaging unit 212 and the second imaging unit 222, respectively.

  The first imaging unit 212 and the second imaging unit 222 include at least an imaging element, and images the light input through the first lens group 211 and the second lens group 221. Specifically, the first imaging unit 212 and the second imaging unit 222 convert the input light signal into an analog signal (electric signal), and respectively convert the analog signal into a first A / D conversion unit. 213 and the second A / D converter 223.

  The first A / D converter 213 and the second A / D converter 223 convert analog signals output from the first imaging unit 212 and the second imaging unit 222 into digital signals. The first A / D converter 213 and the second A / D converter 223 respectively output the image data constituting the converted digital signal to the parallax amount calculator 2 and the signal processor 3 in the control unit 100. .

  The first lens barrel holding member 102 and the second lens barrel holding member 112 support the first lens barrel 101 and the second lens barrel 111 to the vertical fixing member 121 and the base member 120, respectively. It is a member.

  The second lens barrel holding member 112 is supported by the base member 120 via the inter-lens distance changing mechanism 113.

  The user adjusts the mounting position of the first lens barrel 101 and the second lens barrel 111 in the first lens barrel holding member 102 and the second lens barrel holding member 112 to thereby adjust the optical axis. You can adjust the parallelism of the.

  The first lens barrel holding member 102 and the second lens barrel holding member 112 can automatically control the convergence angle by driving with a built-in motor (not shown) or driving with a belt drive from an external motor. It is a structure. Control signals for automatic control are provided from the control unit 100.

  The inter-lens distance variable mechanism 113 is a support member that supports the second lens barrel 111 on the base member 120. The inter-lens distance variable mechanism 113 is configured to move the second lens mirror in a direction (longitudinal direction of the inter-lens distance variable mechanism 113) orthogonal to the optical axis of the second lens barrel 111 based on the control signal from the control unit 100. The tube 111 can be moved. This movement mechanism allows the user to adjust the distance between the lenses in the first lens barrel 101 and the second lens barrel 111. The inter-lens distance variable mechanism 113 can be realized by a general rail, a slider or the like, and is driven by a motor.

  The distance between the lenses is, for example, the distance between the front lenses of the first lens barrel 101 and the second lens barrel 111. The distance between the optical axis of the first lens barrel 101 and the optical axis of the second lens barrel 111 may be the inter-lens distance. That is, as long as it indicates the distance between the shooting position of the first lens barrel 101 and the shooting position of the second lens barrel 111, any type may be used.

  The beam splitter deposition surface 105 is a deposition surface provided to the beam splitter prism 130. The beam splitter deposition surface 105 has a characteristic of splitting light incident on the beam splitter prism 130. Specifically, the beam splitter vapor deposition surface 105 causes a part of the incident light to be incident on the second lens barrel 111 as transmission light. In addition, the beam splitter vapor deposition surface 105 causes a part of the incident light to be incident on the first lens barrel 101 as a reflected light. The spectral characteristics of the beam splitter vapor deposition surface 105 can be intentionally set by the manufacturer of the stereoscopic image pickup device 200, and depending on the characteristics of the first lens barrel 101 and the second lens barrel 111. It may be set.

  The base member 120 supports the second lens barrel 111 via the second lens barrel holding member 112.

  The vertical fixing member 121 supports the first lens barrel 101 via the first lens barrel holding member 102. The vertical fixing member 121 is provided with a front window 122 so as to guide light from the subject to the beam splitter prism 130.

  The beam splitter prism 130 is a substantially cubic prism having a beam splitter vapor deposition surface 105 for splitting light from an object.

  The prism holding member 131 holds the beam splitter prism 130.

  The first lens barrel support member 135 joins the beam splitter prism 130 and the first lens barrel 101.

  The second lens barrel support member 136 joins the beam splitter prism 130 and the second lens barrel 111.

  The first lens barrel holding member 102, the second lens barrel holding member 112, and the inter-lens distance variable mechanism 113 are adjusted when capturing a stereoscopic vision image. It is preferable to adjust the first lens barrel optical axis 104 and the second lens barrel optical axis 114 of the second lens barrel 111 substantially in parallel. By adjusting in this way, the left-right difference of the image obtained by shooting becomes small, and it is possible to shoot a high quality image for stereoscopic vision.

  Note that whether or not the first lens barrel optical axis 104 of the first lens barrel 101 and the second lens barrel optical axis 114 of the second lens barrel 111 are parallel is shown in FIG. Of the first lens barrel optical axis 104 reflected by the beam splitter deposition surface 105, and the left axis of the second lens barrel optical axis 114 transmitted through the beam splitter deposition surface 105; However, when viewed from the lateral direction of the prism parallel to the beam splitter deposition surface, it can be confirmed whether or not they are all in one.

  Hereinafter, the specific configuration of the control unit 100 will be described.

  As shown in FIG. 2, the control unit 100 includes a parallax amount calculation unit 2, a signal processing unit 3, a display processing unit 4, a display unit 5, a GUI generation unit 6, an input unit 9, a control unit 11, a recording processing unit 12 and a camera. The control unit 13 is configured. Each component is connected via a bus 10.

  Based on the input first image and the image data forming the second image, the parallax amount calculation unit 2 generates the parallax of the stereoscopic video composed of the first image and the second image. Information related to the image (hereinafter referred to as disparity information) is calculated. Then, the parallax amount calculation unit 2 outputs the calculated parallax information to the GUI generation unit 6 via the bus 10. In the first embodiment, the first image is an image for the left eye taken by the first lens barrel 101, and the second image is taken by the second lens barrel 111. It is assumed that the image is for the right eye.

  For example, the parallax amount calculation unit 2 divides the first image and the second image into a plurality of areas, and calculates parallax information for each of the divided areas. This area may have any size, for example, 16 × 16 pixel units. When the parallax amount calculation unit 2 calculates parallax information, any method such as a block matching method may be used. Here, the parallax information is a value indicating the amount of horizontal movement of the first image of the object in which both the first image and the second image are taken with reference to the object position of the first image. It is. For example, the parallax information may be a pixel value which is the amount of movement in the horizontal direction.

  Further, the parallax amount calculation unit 2 outputs, to the control unit 11, information related to the maximum parallax information among the calculated parallax information. Here, the maximum disparity information refers to disparity information in an object that is most viewed out when viewed by the user as the stereoscopic image and a disparity of an object that is most viewed in a retracted state when the user views the first image and the second image as a stereoscopic image. Indicates at least one of the information.

  In short, disparity information in an object that is most popped out and viewed may be used as maximum disparity information. In addition, disparity information of an object that is viewed backward most may be used as maximum disparity information. Furthermore, both of the parallax information in the object that is most popped out and visually recognized and the parallax information of the object that is most recessed and visually recognized may be set as the maximum parallax information.

  The signal processing unit 3 performs various processes on the first image and the second image generated by the camera unit 1. The signal processing unit 3 performs processing on image data constituting one or both of the first image and the second image, and a review is image data to be displayed on the display unit 5. It generates an image and generates a video signal to be recorded.

  For example, the signal processing unit 3 performs various video processing such as gamma correction, white balance correction, and scratch correction on the first image and the second image. The signal processing unit 3 outputs the generated review image to the display processing unit 4. The review image generated by the signal processing unit 3 may be a two-dimensional image or a three-dimensional image.

  Furthermore, the signal processing unit 3 applies H.264 to the processed first image and second image, respectively. The image data is compressed by a compression format or the like conforming to a moving image compression standard such as H.264 / AVC. Two compressed signals obtained by compressing the first image and the second image are associated with each other and stored (recorded) in the storage unit 14 (recording medium) via the recording processing unit 12.

  When two are recorded, each frame of a moving image or an image selected by the user during moving image shooting may be compressed and recorded by a compression format or the like conforming to the JPEG standard. In this case, it is desirable to record using MPF (Multi Picture Format). In addition, the MPF and the JPEG image or the MPEG moving image may be simultaneously recorded. The compression format and file format applied when recording the first image and the second image may be any format as long as it is a format suitable for stereoscopic video.

  The signal processing unit 3 can be realized by a DSP or a microcomputer. The resolution of the review image may be set to the screen resolution of the display unit 5, or may be set to the resolution of the image data to be compressed and formed by a compression format or the like conforming to the JPEG standard.

  The display processing unit 4 superimposes the review image input from the signal processing unit 3 and the GUI image input from the GUI generation unit 6. Then, the display processing unit 4 outputs the video signal obtained by the superposition to the display unit 5.

  The display unit 5 displays the video signal input from the display processing unit 4. Also, the GUI image generated by the GUI generation unit 6 is displayed.

  The GUI generation unit 6 generates a GUI image based on the signal input from the control unit 11. For example, the GUI generation unit 6 generates a GUI image on which the parallax information calculated by the parallax amount calculation unit 2 is displayed. Alternatively, the GUI generation unit 6 generates a GUI image for confirming the operation designated by the user using the input unit 9.

  The input unit 9 is configured by a switch, a touch panel, and the like, and receives an operation by the user. When the input unit 9 receives an operation of the user, the input unit 9 converts the operation into an electric signal and outputs the electric signal to the control unit 11. The input unit 9 is not limited to the switch and the touch panel, and any device may be used as long as it is a device that accepts the user's operation.

  The input unit 9 includes at least a prior learning instruction unit 7 and a production recording instruction unit 8.

  The prior learning instruction unit 7 is an instruction unit that instructs the control unit 11 to shoot a stereoscopic video for setting shooting parameters. The shooting parameters here are parameters applied to a stereoscopic video to be shot later in time. Further, the photographing parameters are the distance between the first lens barrel optical axis 104 and the second lens barrel optical axis 114 and the first lens barrel optical axis 104 and the second lens barrel optical axis 114. At least one of the convergence angles to be configured is included.

  Also, the production recording instruction unit 8 is an instruction unit that instructs the control unit 11 to shoot a stereoscopic video for recording. When the production recording instruction unit 8 instructs the imaging, imaging is performed using the imaging parameters obtained at the time of imaging performed by the instruction of the prior learning instruction unit 7.

  That is, the prior learning instruction unit 7 is an instruction unit that instructs shooting of a video for stereoscopic viewing for prior learning, and the production recording instruction unit 8 is a result of prior learning based on the shooting instruction of the prior learning instruction unit 7 It is an instruction | indication part which instruct | indicates imaging | photography of the image | video for stereoscopic vision, Although the preliminary learning instruction unit 7 and the actual recording instruction unit 8 in FIG. 2 are configured independently for convenience of explanation, the preliminary learning instruction unit 7 and the actual recording instruction unit 8 may be integrated. In this case, the stereoscopic video imaging apparatus 200 is provided with a mode selection dial, and can select a mode corresponding to the prior learning instruction unit 7 and the actual recording instruction unit 8. Hereinafter, in the first embodiment, a shooting mode for performing prior learning is described as a prior learning mode (first shooting mode), and a shooting mode for shooting using the result of prior learning is referred to as a real shooting mode (second shooting Mode).

  The bus 10 is a data transmission path that enables exchange of data between each component.

  The control unit 11 controls the entire stereoscopic video imaging device 200. The control unit 11 includes an imaging parameter determination unit 11a and an imaging control unit 11b.

  The photographing parameter determination unit 11 a is at least one of the inter-lens distance and the convergence angle of the first lens barrel 101 (first imaging unit) and the second lens barrel 111 (second imaging unit). Determine the imaging parameters.

  Further, the imaging control unit 11 b sets imaging parameters in the first lens barrel 101 and the second lens barrel 111 and performs control to capture an image for stereoscopic vision. That is, using the information on the maximum parallax information input from the parallax amount calculation unit 2, the photographing control unit 11b uses the first lens barrel holding member 102 and the second lens barrel holding member 112 in FIG. By controlling the inter-lens distance variable mechanism 113, the convergence angle between the first lens barrel 101 and the second lens barrel 111 and the inter-lens distance are automatically controlled.

  The recording processing unit 12 stores (records) the first image and the second image input from the signal processing unit 3 in the storage unit 14 (not shown).

  Under the control of the control unit 11, the camera control unit 13 causes the respective units of the first lens barrel 101 and the second lens barrel 111 to perform operations corresponding to necessary imaging parameters such as focal length and aperture value. Control.

  The storage unit 14 stores a video (image) captured in the actual shooting mode or a video obtained by compressing the video (image). Specifically, the storage unit 14 is a hard disc drive (HDD), a dynamic random access memory (DRAM), a ferroelectric memory, or the like. The storage unit 14 may be removable from the stereoscopic video imaging device 200.

(About adjustment of distance between lenses, convergence angle)
Hereinafter, automatic adjustment of the distance between lenses and the convergence angle in the control unit 11 will be described with reference to the drawings.

  FIGS. 3A and 3B are diagrams for explaining a method of capturing a stereoscopic video using a stereoscopic video capturing device.

  In FIG. 3A, the beam splitter prism 130 is omitted and the first lens barrel 101 and the second lens barrel 111 are illustrated as being located on the same plane, for the sake of simplicity.

  FIG. 3A is a diagram showing the positional relationship between the optical axes of the first and second lens barrels and the lens barrel and the subject in the stereoscopic image capturing apparatus of FIG. FIG. 3B is a view showing an image generated by the first lens barrel 101 and the second lens barrel 111. L in FIG. 3B is a left-eye image captured by the first lens barrel 101, and R in FIG. 3B is a right-eye image captured by the second lens barrel 111.

  In FIG. 3A, the subject 24 is located at a point where the optical axis 28 of the first lens barrel 101 and the optical axis 29 of the second lens barrel 111 intersect. Therefore, the horizontal position in the left-eye image of the subject 24 and the horizontal position in the right-eye image of the subject 24 are at the same position.

  On the other hand, the subject 22 is positioned in front of the subject 24. Here, the subject 22 is photographed as an image projected on the virtual screen (screen) 26 which is a plane perpendicular to the Y direction in FIG. 3A including the subject 24. That is, the subject 22 is photographed as an image 25 projected on the virtual screen 26 by the first lens barrel 101 corresponding to the left eye viewpoint. Further, the subject 22 is photographed as an image 23 projected on the virtual screen 26 by the second lens barrel 111 corresponding to the right eye viewpoint.

  Therefore, the image 25 of the subject 22 in the left-eye image and the image 23 of the subject 22 in the right-eye image are separated by the parallax amount 27 shown in FIG. 3B. The amount of parallax 27 enables a viewer who visually recognizes the left eye image and the right eye image to view the subject 22 stereoscopically.

  As shown in FIG. 3B, when the image 23 is positioned on the left side in the horizontal direction with respect to the image 25, the image of the subject 22 increases as the absolute value of the parallax amount 27 increases (as the distance between the image 23 and the image 25 increases). Appears to pop out in front of the screen 26. Further, when the positional relationship between the image 23 and the image 25 is reversed, and the image 23 is positioned on the right side in the horizontal direction with respect to the image 25, the image of the object 22 is larger than the screen 26 as the absolute value of the parallax amount 27 increases. I can see it in the back.

  That is, the parallax amount when the image 23 is positioned on the left side in the horizontal direction relative to the image 25 is a positive value, and the parallax amount when the image 23 is positioned on the right side in the horizontal direction with respect to the image 25 is a negative value. In this case, as the parallax amount 27 increases, the subject 22 appears to pop out, and as the parallax amount decreases, the object 22 appears to be drawn backward.

  Here, the fact that the amount of parallax 27 as described above is too large (the image is too popped up or retracted too much) causes eyestrain of the viewer. This is due to the fact that the distance between the screen 26 to which the eye is in focus and the subject 22 is too wide. In addition, if the range of parallax (the difference between the maximum amount of parallax in the pop-out direction and the maximum amount of parallax in the retraction direction) in the same screen 26 is too large, that is, the distance between the image to pop out and the image to retract is too wide. , Cause eyestrain of the viewer. Furthermore, the abrupt change in the amount of parallax according to the passage of time also causes eyestrain of the viewer because the viewer's eyes can not follow.

  In order to capture an image for stereoscopic vision so as to obtain the effect of stereoscopic vision while considering such factors of eye strain of the viewer, at least one of the inter-lens distance 20 and the convergence angle 21 It is necessary to set the optimal value by comparing the position distribution of the subject to be photographed. Here, the inter-lens distance 20 is the distance between the imaging position on the first lens barrel optical axis 104 and the imaging position on the second lens barrel optical axis 114 (the distance in the X direction in FIG. 3A Means). The convergence angle 21 means an angle formed by the first lens barrel optical axis 104 and the second lens barrel optical axis 114.

  For example, using the information on the maximum parallax information input from the parallax amount calculation unit 2, the control unit 11 sets the maximum parallax amount in the pop-out direction in the stereoscopic video and the maximum parallax amount in the retraction direction to a predetermined range Control one of the distance between the lenses and the convergence angle so as to be within For example, the control unit 11 controls the convergence angle 21 so that the absolute value of the maximum parallax amount in the pop-out direction and the absolute value of the maximum parallax amount in the retraction direction become the same value. In addition, if the maximum parallax amount exceeds the predetermined range, the control unit 11 reduces the maximum parallax amount by reducing the inter-lens distance 20 so that the parallax amount in the stereoscopic image falls within the predetermined range. Do.

  The method of controlling the inter-lens distance 20 and the convergence angle 21 is not limited to the method described above. For example, after adjusting the convergence angle so that the position of the subject 24 in FIG. 3A is in focus, the control unit 11 may control the inter-lens distance 20 so that the maximum parallax amount falls within the predetermined range. . In addition, when the maximum parallax amount is smaller than a preset value, the control unit 11 may increase the maximum parallax amount within the predetermined range by increasing the inter-lens distance 20. That is, as long as at least one of the convergence angle and the inter-lens distance is controlled using the information on the maximum parallax information input from the parallax amount calculation unit 2, the control unit 11 uses any method. It is good.

(Excessive parallax due to camera movement)
As described above, for example, when the stereoscopic image capturing device 200 captures an image with pan / tilt movement, a closer subject or a farther subject is captured. It may come in range. In such a case, a video (moving image) having a large parallax is captured.

  Hereinafter, an example in which a moving image having a large parallax is obtained when a moving image is captured using the stereoscopic video capturing device 200 will be described with reference to the drawings.

  FIG. 4 is a diagram for describing an example in which a moving image having large parallax is obtained in shooting using the stereoscopic video imaging apparatus 200. FIG. 4 is a top view of the stereoscopic video imaging device 200 and the subject.

  In FIG. 4, the shooting position 30 represents a shooting position at the start of shooting of the stereoscopic video shooting device 200. The shooting position 31 represents a shooting position after the panning operation of the stereoscopic video shooting device 200.

  The stereoscopic video imaging device 200 initially captures the subject 40 at the imaging position 30 when viewed from the top. At this time, the optical axis 36 of the first lens barrel 101 and the optical axis 35 of the second lens barrel 111 are directed to the subject 40. The imaging parameters at this time are optimized so that the subject 40 can stereoscopically view appropriately (the maximum parallax falls within a predetermined range).

  In this state, when shooting is performed while the stereoscopic video shooting device 200 pans from the shooting position 30 to the shooting position 31, as described above, the shooting parameters are set so that the subject 40 can be appropriately viewed stereoscopically. . Here, since each of the distances from the stereoscopic video imaging device 200 to the subjects 41 and 42 is close to the distance from the stereoscopic video imaging device 200 to the subject 40, the viewers of the subjects 41 and 42 can appropriately view stereoscopically It is taken to be able to.

  However, in the middle of the panning operation, the subject 43 at a position closer to the stereoscopic video imaging device 200 enters.

  Here, as illustrated, when the subject 43 enters only the optical axis 38 of the first lens barrel 101, the subject 43 has a right eye image captured by the second lens barrel 111. Since the subject 43 is not captured, the scene where the subject 43 is captured is a video that is difficult for a viewer to see.

  Also, even when the subject 43 enters both of the optical axes 37 and 38, as described above, since the shooting parameters are not set in consideration of the subject 43, the subject 43 has a very large parallax. It will be taken.

(About control of imaging parameters)
Control of shooting parameters of the stereoscopic video shooting apparatus 200 for solving the above-described problems will be described with reference to the drawings.

  FIG. 5 is a diagram showing an example of shooting parameter control in the stereoscopic video shooting apparatus 200. As shown in FIG. Each of the drawings shown in FIG. 5 is a diagram showing the time change of the maximum parallax amount and the photographing parameter when photographing is performed for a predetermined photographing time while panning the photographing position as shown in FIG. .

  In the following description using FIG. 5, as an example, the amount of parallax is represented by a convergence angle, and the predetermined range of the amount of parallax is a convergence angle within ± 0.7 degrees. Further, in the following description using FIG. 5, the distance between lenses is controlled as an example of the imaging parameter. Note that, in FIG. 5, when the convergence angle as the amount of parallax is a value having a positive sign, the image is projected to be visually recognized.

  FIG. 5 (a1) is a diagram showing time change of the imaging parameter when the imaging parameter is not controlled during imaging. FIG. 5A2 is a diagram showing a time change of the maximum amount of parallax when the shooting parameter is not controlled during shooting.

  As shown in FIG. 5 (a1), when the imaging parameter is not controlled during imaging (when the distance between lenses is constant at L1), the maximum parallax amount up to time 50 as shown in FIG. 5 (a2) Is within a predetermined range. However, after time 50, the imaging position pans, and the subject 43 described in FIG. 4 falls within the imaging range, so the maximum parallax amount exceeds +0.7 degrees on the fly-out side.

  Here, in the case where a landscape image is photographed by a pan operation as shown in FIG. 4, if the subject arrangement and the distance between the photographing device and the subject are known in advance, the maximum parallax amount is considered in advance. There is a method of setting imaging parameters and avoiding the occurrence of excessive parallax.

  FIG. 5 (b 1) is a diagram showing time change of the imaging parameter when the imaging parameter is set in consideration of the maximum parallax amount. FIG. 5 (b 2) is a diagram showing a time change of the maximum amount of parallax when the imaging parameter is set in consideration of the maximum amount of parallax.

  In this case, with the subject 43 in the imaging range of the imaging device, the inter-lens distance is set to L2, which is smaller than L1, so that the maximum parallax amount on the launch side is +0.7 degrees or less. A picture is taken (FIG. 5 (b1)). According to this method, it is possible to avoid excessive parallax as shown in FIG. 5 (b 2). However, in this method, the inter-lens distance becomes small even in the time zone before time 50, that is, the amount of parallax obtained becomes small, so there is a problem that the image is poor in three-dimensional feeling as a whole.

  5C1 and 5C2 are diagrams showing the relationship between the maximum amount of parallax and the imaging parameter when the imaging parameter is controlled by the stereoscopic video imaging device 200.

  The stereoscopic video imaging apparatus 200 specifies a first period in which the maximum parallax amount is out of a predetermined range in the first video based on the first video captured at the inter-lens distance L1 as rehearsal in advance. Here, the first video is a video obtained by shooting with the predetermined shooting time while panning the shooting position as shown in FIG. That is, the temporal change of the maximum parallax amount of the first image has the characteristic shown in FIG. 5 (a2), and the first period corresponds to the period t1 shown in FIG. 5 (a2).

  Further, the stereoscopic video imaging apparatus 200 further sets the inter-lens distance L2 (first correction parameter) set such that the maximum parallax amount of the first image in the first period falls within the predetermined range. It determines based on the largest amount of parallax of the 1st picture in a.

  Subsequently, the stereoscopic video imaging apparatus 200 again starts capturing from the beginning the same subject (scene) as the first video (the video captured at this time is taken as the second video). Here, as shown in FIG. 5 (c1), in a period t2 (second period) corresponding to the first period during shooting, control is performed to shoot an image at the inter-lens distance L2. In addition, in the period t0, the stereoscopic video imaging device 200 performs control of capturing an image at the inter-lens distance L1.

  That is, in a period t0 shown in FIG. 5 (c2), an image with almost the same amount of parallax as that in the case of FIG. Thereafter, after time 50, an image with almost the same amount of parallax as that in the case of FIG. 5 (b2) is captured.

  As described above, according to the stereoscopic image capturing device 200, the photographer can easily capture an image in which the maximum amount of parallax is within a predetermined range while securing the overall stereoscopic effect.

  Further, in the example of (c1) of FIG. 5, the control of the inter-lens distance is performed also in the period t3 (third period) in which the maximum parallax amount is within the predetermined range. That is, the stereoscopic video imaging device 200 controls the inter-lens distance in a period t3 which is a period of a predetermined length which is temporally continuous with the period t1. Note that the period t3 may be shorter than any of the periods t1 and t2.

  It is desirable that the shooting of the first video and the shooting of the second video have the same shooting time and the same timing for panning the shooting position. However, for example, when the photographer manually moves the stereoscopic image pickup device 200 to pan the photographing position, the timing at which the excessive parallax occurs and the timing to reduce the distance between the lenses do not coincide completely. There is.

  In such a case, when the inter-lens distance is controlled also in the period t3 in addition to the period t2, the excessive parallax occurs when the timing when the inter-lens distance is controlled deviates from the timing when the inter-lens distance is controlled Can reduce the risk of

  In the period t3, as in the period t2, imaging may be performed with the inter-lens distance L2, but the inter-lens distance may be dynamically controlled as shown in FIG. 5 (c1).

  Specifically, in the period t3, the distance between lenses is controlled so as to decrease monotonously with the passage of time. As a result, the inter-lens distance is not rapidly changed, so it is possible to capture an image that is more easily viewed by the viewer.

  As shown in FIG. 5 (c1), it is not necessary for the distance between lenses to decrease in proportion to the passage of time in the period t3. The reduction of the inter-lens distance may continue in the period t3. Note that the imaging parameter determination unit determines the above imaging parameters in the period t3.

  The details of the operation of the stereoscopic video imaging device 200 will be described below.

  FIG. 6 is a flowchart showing the operation of the stereoscopic video imaging apparatus 200.

  First, the stereoscopic video imaging device 200 captures a first video image with predetermined imaging parameters (S101). Specifically, the photographer operates the prior learning instruction unit 7 to set the control unit 11 to the prior learning mode, and then captures the first image while panning the shooting position as described in FIG. 4 Do. In the pre-learning mode, imaging is performed with predetermined imaging parameters. In the first embodiment, shooting is performed with the inter-lens distance fixed at L1.

  During or after shooting of the first image, the control unit 11 acquires, as data, the time change of the parallax amount calculated by the parallax amount calculation unit 2 and stores the data in a memory incorporated in the control unit 11. At this time, temporal change data of the amount of parallax as shown in FIG. 5 (a2) is obtained.

  Next, the imaging parameter determination unit 11a specifies a first period in which the maximum parallax amount is outside the predetermined range in the first image based on the temporal change of the parallax amount (S102).

  Subsequently, the imaging parameter determination unit 11a determines a correction parameter that is an imaging parameter in which the maximum parallax amount of the first image in the first period falls within a predetermined range (S103). Specifically, the imaging parameter determination unit 11a sets the first lens barrel 101 and the second lens barrel so that the maximum parallax amount of the first image in the first period falls within the convergence angle of ± 0.7 degrees. The distance between lenses with 111 is determined as L2.

  Next, the stereoscopic video imaging device 200 starts imaging of the second image with a predetermined imaging parameter (S104). Specifically, the photographer operates the production recording instruction unit 8 to set the control unit 11 to the production shooting mode, and then shoots the second image while panning the shooting position as described in FIG. 4 Do.

  In the second period (period t2 shown in (c1) and (c2) in FIG. 5) corresponding to the first period during shooting of the second image, the shooting control unit 11b determines the shooting parameter determination unit 11a. The second image is captured using the correction parameter (S105). Specifically, the imaging control unit 11 b changes the inter-lens distance between the first lens barrel 101 and the second lens barrel 111 to L2.

  Although not shown in the flowchart of FIG. 6, the imaging control unit 11b controls the inter-lens distance so that the inter-lens distance decreases monotonically with the passage of time in a period t3.

  Thus, in the actual shooting mode, the shooting control unit 11 b automatically controls the inter-lens distance based on the time change data of the parallax amount acquired in the advance learning mode.

  That is, in the stereoscopic video imaging apparatus 200, the imaging parameters are changed dynamically with the passage of time during imaging, instead of imaging with fixing the imaging parameters to the predetermined imaging parameters. As a result, it is possible to suppress the reduction of the stereoscopic effect in each of a scene in which the shooting parameter is not adjusted and a scene in which an object jumps in suddenly.

  As described above, the stereoscopic image capturing apparatus 200 according to the first embodiment can easily reduce the risk of capturing an image with excessive parallax.

  In the first embodiment, although the imaging control unit 11b controls the inter-lens distance as the correction parameter, the imaging control unit 11b may control the convergence angle. Further, the imaging control unit 11b may control by combining the distance between lenses and the convergence angle as the correction parameter.

  Specifically, when an excessive parallax in the pop-out direction occurs in the period t1, instead of reducing the distance between lenses, the convergence angle may be controlled to be large. In addition, when excessive parallax in the retraction direction occurs in the period t1, instead of reducing the distance between lenses, control may be performed so that the convergence angle is reduced.

  Also, for example, in the period t3, the convergence angle may be controlled so as to increase or decrease monotonously with the passage of time. When the period t3 is a period following the period t1 in which the maximum parallax amount is out of the predetermined range, the distance between lenses may be controlled to monotonously increase in the period t3.

  In the first embodiment, the predetermined parallax range is set within ± 0.7 degrees of the convergence angle, but the predetermined parallax range may be set arbitrarily. For example, as the predetermined parallax range, the parallax range defined by the biosafety guideline may be used.

  In the first embodiment, the period t3 (third period) is a period immediately before the period t1 and is a period that is temporally continuous to the period t1, but is a period immediately after the period t1. It may be a period that is temporally continuous to the period t1. Further, a period immediately before and after the period t1 and temporally continuous to the period t1 may be set as the period t3. Also, the period t3 may not be provided.

  In the first embodiment, the imaging parameters used in period t1 and period t2 are fixed imaging parameters that do not change with the passage of time, but are dynamic imaging parameters that change with the passage of time. It is also good.

  In the first embodiment, the case of panning the shooting position has been described. However, the stereoscopic video shooting device 200 is also applicable to shooting involving other changes in the shooting position. Further, even in the case where the shooting position is fixed, in the situation where the subject jumps into the shooting range, the control of the shooting parameters of the stereoscopic video shooting device 200 can be applied.

  In the first embodiment, an example of capturing a moving image has been described. However, even in the case of capturing a still image continuously, the stereoscopic video capturing device 200 is applicable. That is, the stereoscopic video imaging apparatus 200 is also applicable to capturing a still image.

Second Embodiment
As described above, at the time of shooting of the second image (at the time of shooting in the actual shooting mode), the timing at which the excessive parallax occurs may not completely coincide with the timing at which the distance between lenses is reduced.

  In the case of shooting with a pan at a shooting position with a small angle of rotation, even if shooting in the actual shooting mode with only the photographer's sense, the time change of the shooting position in the actual shooting mode can be taken in advance learning mode It is possible to adjust the position to a time without any problem. Therefore, in this case, it is effective to give a failure warning when the time change (pan speed) of the shooting position in the actual shooting mode changes by a predetermined value or more than the time change of the shooting position in the advance learning mode. .

  FIG. 7 is a diagram showing an example of shooting failure in the stereoscopic video shooting device 200.

  Fig.7 (a) is a figure which shows the time change of the largest amount of parallax acquired by imaging | photography in prior learning mode. On the other hand, FIG. 7B is a diagram showing a time change of the maximum parallax amount when the pan speed in the real shooting mode is too fast. 7 (a) and 7 (b) are diagrams showing the time change of the maximum parallax amount when shooting is performed while panning the shooting position as shown in FIG.

  In FIG. 7A and FIG. 7B, after the time 60, the distance between lenses is automatically controlled to a small value. However, as shown in FIG. 7B, when the panning speed in the actual shooting mode is too fast, the subject 43 in FIG. 4 is in the shooting range at time 61 before the distance between the lenses is automatically controlled to a small value. (Angle of view) come in. Therefore, as a result, in the captured video, excessive parallax occurs between time 61 and time 60.

  The generated parallax amount of the excessive parallax is detected by the parallax amount calculation unit 2 and input to the control unit 11, so that the control unit 11 can detect that there is some failure at the time of shooting in the actual shooting mode.

  In addition, the control unit 11 operates the input unit 9 to measure the time from the shooting start time to the time when the excessive parallax occurs in each of the preliminary learning mode and the real shooting mode, thereby setting the shooting position in the real shooting mode. It is also possible to grasp the situation that the time change (pan speed) is too fast or too slow.

  In such a case, the control unit 11 controls the GUI generation unit 6 and superimposes a warning display as shown in FIG. 8 on the review image displayed on the display unit 5. That is, the control unit 11 (notification unit) notifies the photographer that the shooting of the second video is a failure when the second video includes a period in which the maximum parallax amount is outside the predetermined range. As a result, the stereoscopic video imaging device 200 can request the photographer to redo imaging in the actual imaging mode, and can indicate the correction policy at that time.

  In each of the advance learning mode and the actual shooting mode, when the time from the shooting start time to the shooting end time differs by a predetermined time or more, the control unit 11 may display a warning display. That is, when the difference between the imaging time of the second image and the initial imaging time (imaging time of the first image) is equal to or more than a predetermined time, the control unit 11 (notification unit) fails in the imaging of the second image. The photographer may be notified that At this time, the initial imaging time is stored in a memory incorporated in the storage unit 14 or the control unit 11.

  As a result, the stereoscopic video imaging device 200 can request the photographer to retake imaging in the actual imaging mode with simpler processing.

  In the second embodiment, the control unit 11 displays a warning on the display unit 5 as one mode of the notification to the photographer. However, the notification of the control unit 11 is not limited to this. For example, the notification of the control unit 11 may be voiced.

Third Embodiment
In the pan and tilt operations using the stereoscopic video imaging device 200 and a tripod, the control unit 11 (the imaging unit 200 (or the tripod) detects the imaging direction. A movable unit that can be controlled by the imaging control unit 11 b) may be provided. Thereby, it is possible to reproduce the time change of the imaging position in the advance learning mode in the actual imaging mode. This will be described below with reference to FIG.

  FIG. 9 is a diagram showing an example of a stereoscopic video imaging device 200a including a movable portion.

  As shown in FIG. 9, the stereoscopic video imaging device 200 a includes a movable portion 70 and is connected to a tripod via the movable portion 70. The movable portion 70 is rotatable around the rotation axis of the tripod, and at the same time, the sensor can detect the rotational speed. Specifically, the movable portion 70 can be realized by a combination of a motor for automatically rotating a tripod and a rotary encoder provided in accordance with the rotation axis of the motor.

  In the pre-learning mode, the photographer shoots the first image while manually rotating the movable part. That is, shooting is performed while panning the shooting position of the stereoscopic video shooting device 200a. At this time, the imaging control unit 11 b measures the rotational speed of the movable unit 70 and stores the measurement result in a memory (or storage unit 14) incorporated in the control unit 11. That is, the imaging control unit 11b stores position information that is a time change of the imaging position.

  In the actual shooting mode, the shooting control unit 11b controls the movable unit, and controls the shooting of the second video while moving the position of the stereoscopic video shooting device 200a (camera unit 1) according to the measurement result (position information). I do.

  Thereby, it is possible to reproduce the time change of the imaging position in the advance learning mode in the actual imaging mode. That is, in the pre-learning mode, it is possible to coincide the timing at which the excessive parallax occurs with the timing at which the inter-lens distance is reduced.

  Further, as described above, by using the stereoscopic video imaging device 200a including the movable portion 70, it is also possible to control imaging parameters according to the imaging position. In FIG. 9, the control unit 11 controls the movable unit 70 in the real shooting mode. Even in the actual shooting mode, the photographer manually shoots while rotating the movable unit 70, and using the information input from the movable unit 70, the control unit 11 performs the stereoscopic video imaging device 200a (camera unit 1). The configuration is to control. This configuration will be described below.

  FIG. 10 is a diagram showing an example of shooting parameter control using the shooting position in the stereoscopic video shooting apparatus 200a. FIG. 10 is a diagram showing a time change of the maximum parallax amount when shooting is performed while the shooting position is pan, that is, the shooting angle is changed, as shown in FIG. The shooting angle changes from 0 degrees to 45 degrees, where the direction of the camera unit 1 at the start of shooting is 0 degrees.

  In this case, in the advance learning mode, as in the first embodiment, the photographer manually captures the first image while rotating the movable portion from 0 degrees to 45 degrees.

  In the first image, as shown in FIG. 10, when the imaging angle is 0 degrees to 30 degrees, the maximum parallax amount is within a predetermined range. When the shooting angle exceeds 30 degrees, the subject 43 at a position close to the stereoscopic video shooting device 200a enters, so when the shooting angle is 0 degrees to 30 degrees, the maximum parallax amount is outside the predetermined range. .

  Subsequently, instead of specifying the first period t1 of the first image as in the first embodiment, the shooting parameter determination unit 11a does not specify the first position where the maximum parallax amount is outside the predetermined range. Identify the location. In the third embodiment, the shooting parameter determination unit 11a specifies, as the first position, a shooting angle of 30 degrees to 45 degrees, which is the shooting angle of the camera unit 1 where the maximum parallax amount is outside the predetermined range. The specification of the imaging position can be realized by providing a sensor in the movable unit 70 and acquiring the imaging position detected by the sensor by the control unit 11 (imaging parameter determination unit 11a).

  Further, as in the first embodiment, the imaging parameter determination unit 11a determines a correction parameter that is an imaging parameter in which the maximum parallax amount of the first image captured at the first position falls within a predetermined range.

  In the actual shooting mode, the photographer manually shoots the second image while manually rotating the movable portion to 0 degrees to 45 degrees.

  At this time, as described above, the photographing control unit 11b acquires the photographing angle from the movable unit 70, and when the photographing angle of the camera unit 1 is 30 degrees to 45 degrees while photographing the second image, the correction parameter is used. Control to shoot the second image.

  As described above, by controlling the imaging parameter according to the imaging position, it is possible to reduce the risk of imaging an image with excessive parallax regardless of the imaging time.

  In the third embodiment, the example in which the stereoscopic video imaging apparatus is rotated by the movable unit 70 has been described, but for example, the configuration is such that the movable portion provided in the stereoscopic video imaging apparatus moves on the rail. May be In this case, the control unit 11 controls imaging parameters in accordance with the position on the rail of the stereoscopic video imaging device. As described above, the configuration of the movable portion is not limited to the example of the third embodiment, and may be any configuration.

  In the third embodiment, in the prior learning mode, the photographer manually performs the shooting, but the shooting in the prior learning mode may be performed automatically. For example, the imaging position may be programmed, and the control unit 11 may control the movable unit 70 according to the program to automatically perform imaging in the advance learning mode.

(Other embodiments)
As described above, Embodiments 1 to 3 have been described as examples of the technology disclosed in the present application. However, the technology in the present disclosure is not limited to this, and is also applicable to embodiments in which changes, replacements, additions, omissions, and the like are appropriately made. Moreover, it is also possible to combine each component demonstrated in the said Embodiment 1-3, and to set it as a new embodiment.

  In the above embodiment, an embodiment which can be used as one imaging device (stereoscopic image capturing device) combining the first lens barrel, the second lens barrel, the holding mechanism thereof, and the control unit explained. However, the present disclosure is not limited to these forms. For example, the first lens barrel, the second lens barrel, the holding mechanism, and the control unit may be realized as individual devices, and then may be combined and used only at the time of shooting a stereoscopic image.

  Further, the following cases are also included in the present disclosure.

  (1) Each of the above-described devices can be specifically realized by a computer system including a microprocessor, a ROM, a RAM, a hard disk unit, a display unit, a keyboard, a mouse and the like. A computer program is stored in the RAM or the hard disk unit. Each device achieves its function by the microprocessor operating according to the computer program. Here, the computer program is configured by combining a plurality of instruction codes indicating instructions to the computer in order to achieve a predetermined function.

  (2) Some or all of the components constituting each of the above-described devices may be configured from one system LSI (Large Scale Integration: large scale integrated circuit). The system LSI is a super-multifunctional LSI manufactured by integrating a plurality of components on one chip, and more specifically, a computer system including a microprocessor, a ROM, a RAM, and the like. . A computer program is stored in the ROM. The system LSI achieves its functions as the microprocessor loads a computer program from the ROM to the RAM and operates according to the loaded computer program.

  (3) A part or all of the components constituting each of the above-described devices may be configured from an IC card or a single module which can be detached from each device. The IC card or module is a computer system including a microprocessor, a ROM, a RAM, and the like. The IC card or module may include the above-described ultra-multifunctional LSI. The IC card or module achieves its function by the microprocessor operating according to the computer program. This IC card or this module may have tamper resistance.

  (4) The present disclosure may be realized by the method shown above. Also, these methods may be realized by a computer program realized by a computer, or may be realized by a digital signal consisting of a computer program.

  In addition, the present disclosure relates to a computer program or a recording medium from which a computer signal or a digital signal can be read, such as a flexible disk, a hard disk, a CD-ROM, an MO, a DVD, a DVD-ROM, a DVD-RAM, a BD (Blu-ray (registered trademark) Disc), semiconductor memory, etc. may be realized. Also, it may be realized by digital signals recorded in these recording media.

  In addition, the present disclosure may transmit a computer program or a digital signal via a telecommunication line, a wireless or wired communication line, a network represented by the Internet, data broadcasting, and the like.

  Further, the present disclosure is a computer system including a microprocessor and a memory, the memory storing a computer program, and the microprocessor may operate according to the computer program.

  In addition, it may be implemented by another independent computer system by recording and transporting a program or digital signal on a recording medium, or by transporting a program or digital signal via a network or the like.

  (5) The above embodiment and the above modification may be combined respectively.

  As described above, the embodiment has been described as an example of the technology in the present disclosure. For that purpose, the attached drawings and the detailed description are provided.

  Therefore, among the components described in the attached drawings and the detailed description, not only components essential for solving the problem but also components not essential for solving the problem in order to exemplify the above-mentioned technology May also be included. Therefore, the fact that those non-essential components are described in the attached drawings and the detailed description should not immediately mean that those non-essential components are essential.

  Moreover, since the above-mentioned embodiment is for illustrating the technique in this indication, various change, substitution, addition, omission, etc. can be performed within the range of a claim or its equivalent.

  The stereoscopic image capturing apparatus according to the present disclosure is an image capturer capable of performing rehearsal such as landscape shooting, shooting a work such as a TV drama, and the like performed by a video creator, and in particular, a camera such as pan or tilt. In shooting with motion, it is possible to shoot high-quality 3D images easily. That is, the stereoscopic video imaging device of the present disclosure can be suitably used as a camera or a video camera.

Reference Signs List 1 camera unit 2 parallax amount calculation unit 3 signal processing unit 4 display processing unit 5 display unit 6 GUI generation unit 7 prior learning instruction unit 8 production recording instruction unit 9 input unit 10 bus 11 control unit 11 a imaging parameter determination unit 11 b imaging control unit 12 recording processing unit 13 camera control unit 14 storage unit 20 distance between lenses 21 convergence angle 22, 24 object 23, 25 image 26 virtual screen (screen)
27 Parallax amount 28, 29, 35, 36, 37, 38 Optical axis 30, 31 Shooting position 40, 41, 42, 43 Subject 50, 60, 61 Time 70 Movable part 100 Control unit 101 First lens barrel (first 1 shooting unit)
102 first lens barrel holding member 104 first lens barrel optical axis 105 beam splitter deposition surface 111 second lens barrel (second photographing unit)
112 second lens barrel holding member 113 inter-lens distance variable mechanism 114 second lens barrel light axis 120 base member 121 vertical fixing member 122 front window 130 beam splitter prism 131 prism holding member 135 first lens barrel support Member 136 Second lens barrel support member 200, 200a Stereoscopic imaging device 211 First lens group 212 First imaging unit 213 First A / D conversion unit 221 Second lens group 222 Second Imaging unit 223 Second A / D converter

Claims (10)

A first imaging unit and a second imaging unit that capture an image for stereoscopic viewing;
An imaging parameter determination unit that determines an imaging parameter that is at least one of an inter-lens distance and a convergence angle of the first imaging unit and the second imaging unit;
And an imaging control unit configured to set the imaging parameters in the first imaging unit and the second imaging unit and control the imaging of the stereoscopic image.
When the first imaging unit and the second imaging unit set the imaging parameters to the predetermined imaging parameters, the imaging parameter determination unit determines the maximum parallax amount in the first image. Specifies a first period in which the first image is out of a predetermined range, and determines a first correction parameter as the imaging parameter in which the maximum parallax amount of the first image in the first period falls within the predetermined range
The photographing control unit, when photographing the second image corresponding to the first image after the photographing of the first image, is performed by the first photographing unit and the second photographing unit set to the predetermined photographing parameter. During the second period corresponding to the first period, which starts capturing the second video and is capturing the second video, the first capturing unit and the second set to the first correction parameter A stereoscopic image capturing apparatus, which performs control of capturing the second image by the capturing unit. The imaging control unit sets the first correction parameter to the first correction parameter during a third period, which is a period of a predetermined length temporally continuous with the second period, during imaging of the second image. The image capturing device for stereoscopic vision according to claim 1, wherein the image capturing unit and the second image capturing unit perform control to capture the second image. The imaging parameter determination unit determines the inter-lens distance as the imaging parameter for a third period, which is a period of a predetermined length temporally consecutive to the second period, during imaging of the second image. Determining a second correction parameter, which is the imaging parameter, which monotonously increases or decreases with the passage of time, or the convergence angle monotonously increases or decreases with the passage of time;
The imaging control unit performs control of imaging the second image by the first imaging unit and the second imaging unit set in the second correction parameter in the third period. Stereoscopic imaging device. The imaging control unit controls the first imaging unit and the second imaging unit set in the predetermined imaging parameters in a period other than the second period during imaging of the second image. The video imaging apparatus for stereoscopic vision according to claim 1, which performs control of photographing. further,
A storage unit that stores an imaging time of the first image as an initial imaging time;
A notification unit configured to notify a photographer that shooting of the second video has failed when a difference between the shooting time of the second video and the initial shooting time is equal to or longer than a predetermined time. The image | video imaging device for stereoscopic vision of any one of 1-4. And a notification unit configured to notify the photographer that shooting of the second video is unsuccessful when a period in which the maximum parallax amount is outside the predetermined range is included in the second video. The stereoscopic video imaging device according to any one of 4. The stereoscopic video imaging apparatus according to any one of claims 1 to 6, wherein the second video is a video obtained by shooting a scene substantially the same as a scene to be photographed in the first video. A camera unit having a first imaging unit and a second imaging unit that capture an image for stereoscopic viewing;
A movable unit that moves the position of the camera unit;
An imaging parameter determination unit that determines an imaging parameter that is at least one of an inter-lens distance and a convergence angle of the first imaging unit and the second imaging unit;
The imaging control unit is configured to set the imaging parameters in the first imaging unit and the second imaging unit and perform control of imaging the stereoscopic video.
When the imaging control unit moves the position of the camera unit by the movable unit, the first imaging unit and the second imaging unit set the predetermined imaging parameters capture the first image, the imaging is performed The parameter determination unit identifies a first position, which is the position of the camera unit where the maximum amount of parallax falls outside a predetermined range, and the maximum amount of parallax of the first image captured at the first position falls within the predetermined range. Determine a first correction parameter that is the imaging parameter that fits within
The imaging control unit sets the first imaging unit and the second imaging unit set to the predetermined imaging parameter when imaging the second image corresponding to the first image after imaging the first image. Start shooting the second video, and when the camera unit is positioned at the first position during shooting of the second video, the first shooting unit set in the first correction parameter and the first shooting parameter A stereoscopic video imaging device that performs control to capture the second image by the imaging unit; And a storage unit for storing position information which is a time change of the position of the camera unit at the time of shooting the first image.
The imaging control unit performs control to capture the second image while moving the position of the camera unit according to the position information by further controlling the movable unit while capturing the second image. Item 9. The stereoscopic image capturing device according to item 8. An image for stereoscopic viewing by setting an imaging parameter which is at least one of the distance between lenses and the convergence angle of the first imaging unit and the second imaging unit in the first imaging unit and the second imaging unit A stereoscopic image capturing method for capturing
A photographing step of photographing a first image by the first photographing unit and the second photographing unit set to predetermined photographing parameters;
A specifying step of specifying a first period in which the maximum parallax amount is out of a predetermined range in the first image;
A determination step of determining a correction parameter which is the imaging parameter in which the maximum parallax amount of the first image in the first period falls within the predetermined range;
When shooting a second video corresponding to the first video after shooting the first video, shooting of the second video by the first shooting unit and the second shooting unit set in the predetermined shooting parameter During a second period corresponding to the first period, the second imaging unit and the second imaging unit set in the correction parameter. And a control step of performing control to shoot an image.

Images