JP4496122B2 - Stereoscopic video shooting and playback device - Google Patents

Description

  The present invention relates to a stereoscopic video shooting / playback apparatus using binocular parallax.

  Binocular parallax is used to reproduce a stereoscopic image / video on a two-dimensional display. As a video shooting reproduction technique using binocular parallax, a so-called binocular stereoscopic display is well known. The basic principle of this binocular stereoscopic display is to input a right-eye video only to the right eye and a left-eye video only to the left eye. As is well known, there is a stereo camera as an apparatus for taking images and images for binocular stereoscopic display. The stereo camera is provided with a pair of left and right objective optical systems that are spaced apart in the horizontal direction and whose imaging optical axes are parallel to each other, and individually record images from the left and right objective optical systems. In order to view a stereoscopic display image based on an image taken with a stereo camera, the left and right images with parallax taken at the same time are superimposed on one screen, and then the left and right images are selectively used for the left and right eyes. Let them enter. Alternatively, the respective images are arranged side by side and viewed by a visual method such as a parallel method or a crossing method so that two planar images are recognized as one stereoscopic image on human vision.

  In addition, as a binocular stereoscopic display of a method in which two images are overlapped on one screen, for example, a subject is photographed by attaching filters with different polarization directions to the right and left objective optical systems of a stereo camera, and reproduction display is performed. In some cases, right and left eye images are selectively input to the naked eye using polarized glasses with different polarization directions for the left and right eyes, or one frame is composed of two fields, each field for the right eye and left eye. For example, there is a method of selectively inputting a right-eye image and a left-eye image using a liquid crystal shutter synchronized with a field switching period.

  In the binocular stereoscopic display, in particular, a moving image is not so often used for an application in which the photographer views the image. It is often provided as an attraction at amusement facilities. Therefore, the displayed / reproduced image is intended for an unspecified number of people with different binocular distances. When shooting, the binocular parallax is increased (the distance between the two cameras is increased) to enhance the stereoscopic effect, It is taken with parallax based on the average binocular distance. For this reason, the displayed and reproduced image is less realistic than a subject actually viewed in real time. Further, when photographing a subject very close to the stereo camera, the subject may enter the blind spot of the photographing angle of the left and right objective optical systems, and the stereo camera is not suitable for macro photography.

  Furthermore, since the hardware used for the binocular stereoscopic display is different between the photographing system and the display reproduction system, the photographed stereoscopic image cannot be enjoyed by itself, like an image photographed by a home camera. Of course, there is no device that can easily create stereoscopic images at home.

  The present invention has been made to solve the above-mentioned problems, and the object thereof is to easily create a video work for binocular stereoscopic display corresponding to macro photography and is provided for playback display applications. It is an object of the present invention to provide a stereoscopic video shooting / playback apparatus capable of stereoscopically viewing a video work for binocular stereoscopic display with natural reality.

In order to achieve the above object, the present invention provides a binocular-shaped housing.
Two objective optics for the left and right eyes;
Two imaging devices for the left eye and the right eye, each of which is formed with a subject image through the objective optical system for the left eye and the right eye,
Objective optical system rotating means for rotating the left-eye and right-eye objective optical systems in a symmetrical manner from a state in which the respective optical axes are parallel to each other to a state in the crossing direction;
Two display elements for left eye and right eye,
Two finder parts for the left eye and the right eye for peeking with the left and right eyes from the rear surface so that the binocular distance is approximately equal to the distance between the optical axes when the optical axes of the two objective optical systems are parallel;
Two eyepiece optical systems for the left and right eyes for guiding the images displayed on the left-eye and right-eye display elements to the left-eye and right-eye finder units, respectively;
Image signal output means for individually outputting image signals of a predetermined format based on electrical signals from left-eye and right-eye image sensors; and
Photographed image display control means for individually displaying images based on electrical signals from left-eye and right-eye image sensors on left-eye and right-eye display elements,
Input image display control means for individually displaying and outputting two image signals individually input from the outside to the left-eye and right-eye display elements;
Binocular distance adjusting means that can adjust the distance between the optical axes of the objective optical system and the binocular distance of the finder unit in an interlocking manner is provided as a basic configuration.

  In addition to the basic configuration described above, the first invention of the present invention provides binocular distance information for displaying and outputting binocular distance information input from the outside on the display elements for the left eye, the right eye, or both. The stereoscopic video shooting / reproducing apparatus is provided with display means.

  According to a second aspect of the present invention, in the above basic configuration, the binocular distance adjusting means adjusts the inter-optical axis distance and the binocular distance in conjunction with each other based on binocular distance information input from the outside. It is a shooting and playback device.

  According to a third invention, in the first or second invention, a binocular viewing angle detection unit that detects a rotation angle of the objective optical system by the objective optical system rotation mechanism as a binocular viewing angle; The binocular viewing angle information output means for outputting the image information by external output in a predetermined data format simultaneously with the external output of the image information by the image signal output means, and appropriate information based on the binocular viewing angle information input from the outside for the left eye or the right eye Or a binocular viewing angle information display means for display output on both display elements.

  In a fourth aspect based on the third aspect, the binocular viewing angle information display means calculates a distance to the subject based on the binocular visual information and the binocular distance information, and uses the distance for the left eye or the right eye. For example, a stereoscopic video shooting / playback apparatus provided with subject distance presentation means for display output on both display elements.

  According to the stereoscopic video shooting / playback apparatus of the present invention, it is possible to easily create a video work for binocular stereoscopic display while supporting macro shooting. In addition, it is possible to stereoscopically view a video work for binocular stereoscopic display that is used for reproduction display applications with a natural sense of reality.

=== Configuration of stereoscopic video shooting / playback apparatus ===
FIGS. 1A and 1B are external views of a stereoscopic video shooting / playback apparatus (hereinafter, stereoscopic camera) according to an embodiment of the present invention. (A) is a perspective view from the front upper side, (B) is a perspective view from the rear upper side. FIG. 2 shows a schematic configuration of the optical system when the stereoscopic camera 1 is viewed from above. This camera 1 is an electronic camera, has the same external shape as an opera glass type binoculars, and images for left eye (L) and right eye (R) corresponding to the left and right eyes in the binocular type housing 2. Elements (3a, 3b) and L and R display elements (4a, 4b) are incorporated.

  In this embodiment, a CCD is used as the imaging device (3a, 3b), and a liquid crystal display panel (LCD) with a backlight is used as the display device (4a, 4b). The images of the subject formed on the L and R-CCD (3a, 3b) via the L and R objective optical systems (5a, 5b) are displayed and output by the L and R-LCDs (4a, 4b), respectively. It is configured as follows. The images displayed on the LCD (4a, 4b) are guided to the finder (7a, 7b) via the eyepiece optical system (6a, 6b), and the photographed image of the subject looks into the finder (7a, 7b). Projected to the eye.

Also, in the case of macro photography for photographing a subject that is very close to the stereoscopic camera 1, if the objective optical system (5a, 5b) is a stereoscopic camera 1 having two systems of L and R, the subject is in the blind spot of the objective lens. There is a possibility of entering. Corresponding to such a case, in the stereoscopic camera 1 of the present embodiment, the imaging device (3a, 3b) and the objective optical system (5a, 5b) are configured as an integral unit (9a, 9b). The LR objective optical system (5a, 5b) has a mechanism that rotates in a direction in which the optical axis directions intersect. Note that this rotating mechanism has a symmetric objective (θ _L = θ _R ) from the state (8ap, 8bp) in which the optical axes (8a, 8b) of the LR are parallel to each other in the parallel direction. The optical units (9a, 9b) rotate in conjunction with each other. As the rotation mechanism, an appropriate mechanism may be employed, for example, the LR units (9a, 9b) are symmetrically rotated by a gear link mechanism. Further, the rotation center axes (10a, 10b) of the LR units (9a, 9b) are the distances between the optical axes when the optical axes of the objective optical systems (5a, 5b) are in the parallel state (8ap, 8bp). It is desirable to provide the objective optical system (5a, 5b) on the side closest to the subject so as to coincide with t1 as much as possible. Note that the rotational drive can be electric.

  The stereoscopic camera 1 of the present embodiment has a distance t1 of the LR optical axes (8ap, 8bp) and a binocular distance t2 of the viewfinder (7a, 7b) when the objective optical system (5a, 5b) of the LR is in a parallel state. And are almost equal. Further, when the subject is photographed with the stereoscopic camera 1, the distance between the left and right eyes differs depending on the photographer. Therefore, the stereoscopic camera 1 has a mechanism that can adjust the distance between the L finder 7a and the R finder 7b. As a result, the binocular distance between the photographer and the stereoscopic camera is matched, and the binocular distance t2 is also substantially matched with the optical axis distance t1 of the objective optical system, so that a very realistic stereoscopic image can be obtained in real time. Can do.

  As the binocular distance adjusting mechanism, if the opera glass type housing 2 shown in the present embodiment is used, the housing 2 may be a mechanism that slides in the left-right direction and expands and contracts. In other words, a pair of photographing systems (objective optical system, CCD, LCD, eyepiece optical system, and finder) for each LR may be configured to move integrally to the left and right in conjunction with the sliding operation of the housing 2. Or you may employ | adopt the housing | casing similar to the Porro prism binoculars well-known as a Boschrom (trademark) type | mold or a Tsuei (trademark) type | mold. In other words, the LR includes two lens barrels in which the photographing systems of the LRs are housed, and the two lens barrels are connected in parallel via hinges that can rotate about the front-rear direction as an axis. By rotating the two lens barrels via the hinges and bending the casing, the distance between the two photographing optical axes and the distance between both eyes are linked.

  The stereoscopic camera 1 according to the present embodiment includes a function (shooting function) for externally outputting the captured images of the LR CCDs (3a, 3b) corresponding to both eyes as individual image signals, and an externally input individual LR. There are two operation modes: a function (reproduction function) for displaying an image based on the image signal on the LR individual LCD (4a, 4b).

=== Shooting function ===
First, the photographing function of the stereoscopic camera 1 will be described. FIG. 3 shows a functional block diagram of the stereoscopic camera 1. The CPU 11 receives user operation input information via an operation input unit 12 such as an operation button, controls each component according to the input information, and controls the stereoscopic camera 1. The optical image of the subject in front of the housing 2 is transmitted through the L-CCD 3a and the R-CCD 3a through the left-eye (hereinafter referred to as L) objective optical system 5a and the right-eye (hereinafter referred to as R) objective optical system 5b. The images are individually formed on the CCD 3b. When the user gives an instruction to start the photographing function, the CCD drive unit 13 drives the L and R CCDs (3a, 3b) and individually acquires the electrical signals output from the CCDs (3a, 3b). Then, this signal is sequentially transferred to the video signal processing unit 14. The video signal processing unit 14 performs A / D conversion on the electrical signal from the CCD (3a, 3b) every predetermined sampling period, and outputs it as individual digital data of L and R. Then, L and R two bitmap images are developed and updated in the L video RAM 15a and the R video RAM 15b, respectively, at predetermined frame periods.

  The LCD drive unit 16 individually drives the L and R LCDs (4a and 4b) based on the L and R bitmap images developed in the L and R video RAMs (15a and 15b). Thereby, an L image and an R image of the subject incident through the L objective optical system 5a and the R objective optical system 5b are respectively displayed and output on the L-LCD 4a and the R-LCD 4b. The display images of the L and R LCDs (4a, 4b) are guided to the L finder 7a and the R finder 7b through the L eyepiece optical system 6a and the R eyepiece optical system 6b, respectively, and the L and R viewfinders (7a, 7b) are guided. Projected to the left and right eyes of the user looking through 7b). Then, the user uses the distance t1 of the photographing optical axes (8a, 8b) of the L and R objective optical systems (5a, 5b), that is, a distance substantially the same as the user's binocular distance t2, as the parallax, and The two images projected from each finder (7a, 7b) are recognized as real-time stereoscopic images corresponding to the parallax.

  The video signal processing unit 14 converts the two electric signals corresponding to the L and R CCDs (3a, 3b) from the CCD driving unit 13 into NTSC standard L and R image signals (L shooting video signal and R shooting video, respectively). Signal) individually. Then, the two L and R captured video signals are individually output from the L external output terminal 17a and the R external output terminal 17b. A configuration may be adopted in which a microphone is incorporated and an audio output terminal is provided, and an audio signal collected by the microphone is output from the audio output terminal.

The stereoscopic camera 1 of the present embodiment is attached to the above-described image photographing function, and the binocular distance t2 (binocular distance) detected by the binocular distance detection unit 19 and the LR objective detected by the binocular viewing angle detection unit 20 are included. It also has a function of detecting the angle of the optical axis of the optical system (binocular viewing angle) and outputting the information as numerical data. As binocular viewing angle data, the rotation angle θ _L (= θ _R ) from the optical axis (8ap, 8bp) of the objective optical system (5a, 5b) in a parallel state is output. Then, the binocular distance data and the binocular viewing angle data are multiplexed and output together with the video signal during the feedback period of one of the LR captured video signals. Alternatively, the video signal is output as appropriate digital data such as a transport stream (TS) of the MPEG2 standard, the binocular distance data and the binocular viewing angle data are multiplexed on the TS, and the multiplexed TS is transmitted to a predetermined communication interface. You may make it output externally (USB, IEEE1394 etc.). Note that binocular distance data and binocular viewing angle data can be detected and output whenever necessary, for example, every frame period in a video signal. For example, when recording an externally output video signal with an appropriate recording device, Even if the binocular distance or binocular viewing angle is changed, the change state can be synchronized with the time series of shooting.

=== Playback function ===
It is assumed that there is a reproducing apparatus in which an L photographic video signal and an R photographic video signal output from the stereoscopic camera 1 are individually recorded by appropriate external video recording means, and these video signals can be output in synchronization. Alternatively, it is assumed that a video work created and recorded for binocular stereoscopic display is prepared in a state where it is separated as L and R video signals and can be synchronously reproduced. It is assumed that L and R video signals (L input video signal and R input video signal) are input to the stereoscopic camera 1 via the L video input terminal 18a and the R video input terminal 18b, respectively.

  When a playback function activation instruction is input by the user, the video signal processing unit 14 converts the L and R input video signals input via the L and R video input terminals (18a and 18b) into A / D. In addition to conversion, binocular distance data and binocular viewing angle data multiplexed during the feedback period of the video signal are extracted. Then, the bitmap images corresponding to the L and R input signals are bitmap-developed in the L and R video RAMs (15a, 15b) every predetermined frame period. At this time, the multiplexed data is converted into text, and the text is superimposed on a bitmap image originating from the video signal in either L or R video RAM.

  The LCD drive unit 16 drives the L and R LCDs (4a, 4b) according to the bitmap image developed in each video RAM (15a, 15b). As a result, the character information relating to the binocular distance and viewing angle is superimposed on the video signals input to the L and R video input terminals (18a and 18b), respectively, and displayed on the L and R LCDs (4a and 4b). Is output.

  The user stereoscopically views the video work prepared for the binocular display with the stereoscopic camera 1. Further, the mechanical binocular distance of the stereoscopic camera 1 is adjusted based on the displayed binocular distance information. It is also possible to adopt a mechanism that can automatically move / adjust the mechanical binocular distance of the stereoscopic camera 1 based on the input binocular distance data. Thereby, for example, when the photographer and the viewer are the same, the subject viewed at the time of photographing is reproduced with a sense of reality. In addition, if you have a configuration in which speakers and earphone output terminals, etc. are provided so that audio signals can be input along with input video signals and output acoustically, even if the work contains audio, the audio can be viewed with the video. Can do.

=== Use of binocular viewing angle information ===
The binocular viewing angle information recorded at the time of shooting is not necessary if it is limited to the use of viewing a stereoscopic image at the time of reproduction. This is because an image shot with the binocular viewing angle already adjusted is displayed during playback. However, the binocular viewing angle adjustment mechanism in the stereoscopic camera 1 is not limited to the use of macro photography, and known triangulation can be performed together with the binocular distance information. Accordingly, for example, it is conceivable to calculate the distance to the subject and to superimpose the distance to the subject on the captured video during reproduction.

1 is an external view of a stereoscopic video shooting / playback apparatus according to an embodiment of the present invention. It is an optical block diagram of the said three-dimensional video imaging | photography reproduction apparatus. It is a functional block diagram of the said three-dimensional video imaging | photography reproduction apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Stereoscopic image recording / reproducing apparatus 2 Binoculars type housing 3a, 3b CCD
4a, 4b Liquid crystal display panel 5a, 5b Objective optical system 6a, 6b Eyepiece optical system 7a, 7b Viewfinder 14 Video signal processing unit 17a, 17b Video signal output terminal 18a, 18b Video signal input terminal

Claims (4)

The case has a binocular shape,
Two objective optics for the left and right eyes;
Two imaging devices for the left eye and the right eye, each of which is formed with a subject image through the objective optical system for the left eye and the right eye,
Objective optical system rotating means for rotating the left-eye and right-eye objective optical systems in a symmetrical manner from a state in which the respective optical axes are parallel to each other to a state in the crossing direction;
Two display elements for left eye and right eye,
Two finder parts for the left eye and the right eye for peeking with the left and right eyes from the rear surface so that the binocular distance is approximately equal to the distance between the optical axes when the optical axes of the two objective optical systems are parallel;
Two eyepiece optical systems for the left and right eyes for guiding the images displayed on the left-eye and right-eye display elements to the left-eye and right-eye finder units, respectively;
Image signal output means for individually outputting image signals of a predetermined format based on electrical signals from left-eye and right-eye image sensors; and
Photographed image display control means for individually displaying images based on electrical signals from left-eye and right-eye image sensors on left-eye and right-eye display elements,
Input image display control means for individually displaying and outputting two image signals individually input from the outside to the display elements for the left eye and the right eye,
Binocular distance adjustment means that can adjust the distance between the optical axes of the objective optical system and the binocular distance of the finder unit in conjunction with each other;
Binocular distance information output means for outputting binocular distance information adjusted by the binocular distance adjusting means in a predetermined data format at the same time as external output of the image information by the image signal output means;
Binocular distance information display means for displaying and outputting binocular distance information input from the outside for the left eye or right eye, or both display elements;
A stereoscopic video shooting / playback apparatus comprising: The case has a binocular shape,
Two objective optics for the left and right eyes;
Two imaging devices for the left eye and the right eye, each of which is formed with a subject image through the objective optical system for the left eye and the right eye,
Objective optical system rotating means for rotating the left-eye and right-eye objective optical systems in a symmetrical manner from a state in which the respective optical axes are parallel to each other to a state in the crossing direction;
Two display elements for left eye and right eye,
Two finder parts for the left eye and right eye for peeking with the left and right eyes from the rear surface so that the binocular distance is approximately equal to the distance between the optical axes when the optical axes of the two objective optical systems are parallel,
Two eyepiece optical systems for the left and right eyes for guiding the images displayed on the left-eye and right-eye display elements to the left-eye and right-eye finder units, respectively;
Image signal output means for individually outputting image signals of a predetermined format based on electrical signals from left-eye and right-eye image sensors; and
Photographed image display control means for individually displaying images based on electrical signals from left-eye and right-eye image sensors on left-eye and right-eye display elements,
Input image display control means for individually displaying and outputting two image signals individually input from the outside to the left-eye and right-eye display elements;
Binocular distance adjustment means that can adjust the distance between the optical axes of the objective optical system and the binocular distance of the finder unit in conjunction with each other;
Binocular distance information output means for outputting the binocular distance information adjusted by the binocular distance adjusting means to the outside in a predetermined data format simultaneously with the external output of the image information by the image signal output means,
The binocular distance adjustment means adjusts the inter-optical axis distance and the binocular distance in conjunction with each other based on binocular distance information input from the outside.
A stereoscopic video shooting and reproduction apparatus characterized by the above. In Claim 1 or 2, the binocular viewing angle detection means for detecting the rotation angle of the objective optical system by the objective optical system rotation mechanism as a binocular viewing angle;
Binocular viewing angle information output means for outputting the binocular viewing angle information externally in a predetermined data format simultaneously with external output of the image information by the image signal output means;
Binocular viewing angle information display means for displaying and outputting appropriate information based on binocular viewing angle information input from the outside for left eye or right eye, or both display elements;
A stereoscopic video shooting / playback apparatus comprising:   4. The binocular viewing angle information display unit according to claim 3, wherein the binocular viewing angle information display means calculates a distance to the subject based on the binocular visual information and the binocular distance information, and uses the distance for the left eye, the right eye, or both display elements. A stereoscopic image photographing / reproducing apparatus comprising a subject distance presenting means for displaying and outputting to a subject.

Images