JP2005115251A - Stereoscopic video photographing and reproducing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a stereoscopic video photographing and reproducing apparatus capable of forming, reproducing and displaying video works for binocular stereoscopic display having reality. <P>SOLUTION: The stereoscopic video photographing and reproducing apparatus is equipped with a binocular mirror type casing, imagers for the left eye and the right eye, objective optical systems for the left eye and the right eye which form subject images to the imagers for the left eye and the right eye, display elements for the left eye and the right eye, viewfinder sections for the left eye and the right eye, eyepiece optical systems for the left eye and the right eye which guide the images from the display elements for the left eye and the right eye respectively to the viewfinder sections for the left eye and the right eye, image signal output means which externally output the image signals based on the electric signals from the two imagers discretely for the left eye and the right eye, photographic image display control means which display the images based on the electric signals from the two imagers discretely to the display elements for the left eye and the right eye, and input image display control means which display and output the image signals of the two systems discretely inputted from the outside respectively discretely to the display elements for the left eye and the right eye. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a stereoscopic video shooting / playback apparatus using binocular parallax.

  Binocular parallax is used to reproduce a stereoscopic image / video on a two-dimensional display. As a video shooting reproduction technique using binocular parallax, a so-called binocular stereoscopic display is well known. The basic principle of this binocular stereoscopic display is to input a right-eye video only to the right eye and a left-eye video only to the left eye. As is well known, there is a stereo camera as an apparatus for taking images and images for binocular stereoscopic display. The stereo camera is provided with a pair of left and right objective optical systems that are spaced apart in the horizontal direction and whose imaging optical axes are parallel to each other, and individually record images from the left and right objective optical systems. In order to view a stereoscopic display image based on an image taken with a stereo camera, the left and right images with parallax taken at the same time are superimposed on one screen, and then the left and right images are selectively used for the left and right eyes. Let them enter. Alternatively, the respective images are arranged side by side and viewed by a visual method such as a parallel method or a crossing method so that two planar images are recognized as one stereoscopic image on human vision.

  In addition, as a binocular stereoscopic display of a method in which two images are overlapped on one screen, for example, a subject is photographed by attaching filters with different polarization directions to the right and left objective optical systems of a stereo camera, and reproduction display is performed. In some cases, right and left eye images are selectively input to the naked eye using polarized glasses with different polarization directions for the left and right eyes, or one frame is composed of two fields, each field for the right eye and left eye. For example, there is a method of selectively inputting a right-eye image and a left-eye image using a liquid crystal shutter synchronized with a field switching period.

  In the binocular stereoscopic display, in particular, a moving image is not so often used for an application in which the photographer views the image. It is often provided as an attraction at amusement facilities. Therefore, the displayed / reproduced image is intended for an unspecified number of people with different binocular distances. When shooting, the binocular parallax is increased (the distance between the two cameras is increased) to enhance the stereoscopic effect, It is taken with parallax based on the average binocular distance. For this reason, the displayed and reproduced image is less realistic than a subject actually viewed in real time.

  In addition, since the hardware used for the binocular stereoscopic display is different between the photographing system and the display / reproducing system, the photographed stereoscopic image cannot be enjoyed by itself like an image photographed by a home camera. Of course, there is no device that can easily create stereoscopic images at home.

  The present invention has been made in order to solve the above-mentioned problems, and its purpose is to easily create a video work for binocular stereoscopic display, and to provide a binocular stereoscopic display picture for use in playback display. An object of the present invention is to provide a stereoscopic image photographing / reproducing apparatus capable of stereoscopically viewing a work with natural reality.

  The stereoscopic image photographing / reproducing apparatus according to the present invention has two objective optical systems for the left eye and the right eye having a binocular-shaped housing, a photographing optical axis parallel to each other in the front normal direction with the subject side as the front surface of the housing. And two imaging elements for left eye and right eye on which a subject image is individually formed through the objective optical system for left eye and right eye, two display elements for left eye and right eye, and a rear surface Left-eye and right-eye viewfinders for viewing with the left and right eyes, and the left-eye and right-eye viewfinders for the images displayed on the left-eye and right-eye display elements, respectively. And two eyepiece optical systems for right eye, image signal output means for individually outputting image signals of a predetermined format based on electrical signals from left eye and right eye image sensors, and left eye and right eye image sensors Photographic image display control means for individually displaying images based on the electrical signals on the left-eye and right-eye display elements, and two-line image signals input from the outside separately for the left-eye and right-eye display elements And an input image display control means for individually displaying and outputting.

  In addition, the two finder units are configured so that the left and right separation distances can be adjusted, and are provided with a unit for outputting binocular distance information indicating the separation distances in a predetermined data format simultaneously with the external output of the image signal. It can also be set as a video shooting / playback apparatus. A stereoscopic video imaging / playback apparatus including an input unit for binocular distance information and a unit for appropriately outputting the input binocular distance information may be used. Furthermore, a unit for automatically adjusting the left and right separation distances of the two finder units based on the input binocular parallax information may be provided.

  The two objective optical systems may be configured such that the distance between the two photographing optical axes can be adjusted. In a configuration in which the distance between the two viewfinders can be adjusted, the distance between the two photographing optical axes may be adjusted in conjunction with the distance between the left and right of the viewfinder.

  Further, in the stereoscopic image capturing / reproducing apparatus, the image signal output means individually outputs a moving image video signal of a predetermined format as an image signal from the two image sensors, and outputs a synchronization signal for the individually output moving image signal. It is good also as a structure provided with the means to output.

  It can also be set as the stereoscopic video imaging | photography reproduction apparatus provided with the means to record the image signal from two image sensors as separate information.

  According to the stereoscopic image capturing / reproducing apparatus of the present invention, a video work for binocular stereoscopic display can be easily created, and a video work for binocular stereoscopic display used for reproduction display can be naturally sensed. Can be viewed stereoscopically.

=== Configuration of Stereoscopic Image Shooting / Reproducing Apparatus ===
FIGS. 1A and 1B are external views of a stereoscopic image capturing / reproducing apparatus (hereinafter, stereoscopic camera) according to an embodiment of the present invention. (A) is a perspective view from the front upper side, (B) is a perspective view from the rear upper side. FIG. 2 shows a schematic configuration of the optical system when the stereoscopic camera 1 is viewed from above. This camera 1 is an electronic camera having an external appearance similar to that of an opera glass type binoculars, and an imaging element (3a, 3b) and a display element (4a, 4b) incorporated in the binocular case 2. . In this embodiment, a CCD is used as an image sensor, and a liquid crystal display panel (LCD) with a backlight is used as a display element. The subject image formed on the CCD (3a, 3b) via the objective optical system (5a, 5b) is displayed and output on the LCD (4a, 4b). The images displayed on the LCD (4a, 4b) are guided to the finder (7a, 7b) through the eyepiece optical system (6a, 6b), and the subject's image is seen through the finder (7a, 7b). Projected on.

  The stereoscopic camera 1 separates a subject image into a left-eye image and a right-eye image for binocular stereoscopic display, and individually displays and outputs them. Thereby, a stereoscopic image can be obtained in real time. Also, there are two functions: a function for externally outputting an image signal corresponding to a photographed image of the CCD (3a, 3b) (photographing function) and a function for displaying an image based on the externally input image signal on a display element (reproduction function). It has an operation mode.

=== Shooting function ===
First, the photographing function of the stereoscopic camera 1 will be described. FIG. 3 shows a functional block diagram of the stereoscopic camera 1. The CPU 11 receives user operation input information via an operation input unit 12 such as an operation button, controls each component according to the input information, and controls the stereoscopic camera 1. The optical image of the subject in front of the housing 2 is transmitted through the L-CCD 3a and the R-CCD 3a through the left-eye (hereinafter referred to as L) objective optical system 5a and the right-eye (hereinafter referred to as R) objective optical system 5b. The images are individually formed on the CCD 3b. When the user gives an instruction to start the photographing function, the CCD drive unit 13 drives the L and R CCDs (3a, 3b) and individually acquires the electrical signals output from the CCDs (3a, 3b). Then, this signal is sequentially transferred to the video signal processing unit 14. The video signal processing unit 14 performs A / D conversion on the electrical signal from the CCD (3a, 3b) every predetermined sampling period, and outputs it as individual digital data of L and R. Then, L and R two bitmap images are developed and updated in the L video RAM 15a and the R video RAM 15b, respectively, at predetermined frame periods.

  The LCD drive unit 16 individually drives the L and R LCDs (4a and 4b) based on the L and R bitmap images developed in the L and R video RAMs (15a and 15b). Thereby, an L image and an R image of the subject incident through the L objective optical system 5a and the R objective optical system 5b are respectively displayed and output on the L-LCD 4a and the R-LCD 4b. The display images of the L and R LCDs (4a, 4b) are guided to the L finder 7a and the R finder 7b through the L eyepiece optical system 6a and the R eyepiece optical system 6b, respectively, and the L and R viewfinders (7a, 7b) are guided. Projected to the left and right eyes of the user looking through 7b). Then, the user uses the distance t of the photographing optical axes (8a, 8b) of the L and R objective optical systems (5a, 5b) as a parallax and projects them from the two finders (7a, 7b) of L and R. The image is recognized as a real-time stereoscopic image corresponding to the parallax.

  Further, the video signal processing unit 14 converts the two electrical signals corresponding to the L and R CCDs (3a, 3b) from the CCD driving unit 13 into NTSC standard L and R image signals (L photographing video signal, R Individually converted as a captured video signal). Then, the two L and R captured video signals are individually output from the L external output terminal 17a and the R external output terminal 17b. Note that a microphone may be incorporated, and an audio signal collected by the microphone may be output together with the captured video signal.

=== Playback function ===
It is assumed that there is a reproducing apparatus in which an L photographic video signal and an R photographic video signal output from the stereoscopic camera 1 are individually recorded by appropriate external video recording means, and these video signals can be output in synchronization. Alternatively, it is assumed that a video work created and recorded for binocular stereoscopic display is prepared in a state where it is separated as L and R video signals and can be synchronously reproduced. It is assumed that L and R video signals (L input video signal and R input video signal) are input to the stereoscopic camera 1 via the L video input terminal 18a and the R video input terminal 18b, respectively.

  When a playback function activation instruction is input by the user, the video signal processing unit 14 converts the L and R input video signals input via the L and R video input terminals (18a and 18b) into A / D. The bit map image corresponding to each of the L and R input signals is bitmap-developed in the L and R video RAMs (15a, 15b) every predetermined frame period. The LCD drive unit 16 drives the L and R LCDs (4a, 4b) according to the bitmap image developed in each video RAM (15a, 15b). As a result, the video signals input to the L and R video input terminals (18a, 18b) are displayed and output by the L and R LCDs (4a, 4b), respectively, and the user is prepared for binocular display. The stereoscopic video 1 can be viewed stereoscopically. In addition, if a configuration is provided in which a speaker, earphone output terminal, etc. are provided so that an audio signal can be input together with the input video signal and output acoustically, the audio can be viewed with the video even if the work contains audio. it can.

=== Use of captured video signal ===
The externally output L and R photographic video signals can be appropriately recorded and used for appropriate reproduction. In other words, two systems of captured video signals output simultaneously can be recorded as L video and R video, and these video can be used as video for binocular stereoscopic display at a later date. When the L and R images are reproduced and displayed on the stereoscopic camera 1 again, the stereoscopic image at the time of shooting is reproduced as it is. Of course, it can also be used for other binocular stereoscopic display applications. For example, when L video and R video are synchronized and projected onto one screen using two projectors, two videos with parallax are projected on one screen. For example, if an L image and an R image are projected using light having different polarization directions, a stereoscopic image can be reproduced using known polarized glasses. Of course, if the L video and the R video are processed and recorded so that they are alternately displayed every field period that is half the frame period, the L video and the R video are recorded every field period using a liquid crystal shutter or the like. Can be switched alternately and input to the left and right eyes to reproduce a stereoscopic image.

  If the L and R image signals are recorded synchronously at the time of output, the synchronization control is facilitated when two images are reproduced and output when used at a later date. A synchronization signal may be generated on the stereoscopic camera 1 side and output by being multiplexed with a video signal, or the synchronization signal may be output by a signal output system different from the video signal. The video signal handled by the stereoscopic camera 1 is not limited to an analog video signal such as NTSC standard, but may be a digital data format such as MPEG standard. Of course, the output image is not limited to a moving image but may be a still image.

=== Binocular distance information ===
When the subject is photographed by the stereoscopic camera 1, the distance between the left and right eyes varies depending on the photographer. Therefore, a mechanism that can adjust the distance between the L finder 7a and the R finder 7b may be adopted. In particular, when a photographed image is recorded and the photographer views the photographed image later with the stereoscopic camera 1, if the distance between the two viewfinders (distance between both eyes) is set to the same as that at the time of photographing, the photographing is performed in real time. The viewed stereoscopic image is reproduced as it is. For this reason, a stereoscopic image with a sense of incongruity such as lack of stereoscopic effect or excessive emphasis is not reproduced.

  Therefore, a configuration is adopted in which two binocular distances are recognized at the time of photographing, and data indicating the distance is output at the time of photographing. The binocular distance data may be output after being multiplexed with the captured video signal, or may be output externally by a separate data output system. Then, it may be recorded simultaneously with or in association with the captured video signal. The stereoscopic camera may input binocular distance data at the time of reproducing a stereoscopic image, and output the binocular distance to the user as appropriate. The binocular distance data is simply displayed by displaying the distance, and the user may adjust the finder based on the instructed distance. Alternatively, if a mechanism in which L and R or one of the viewfinders can be moved / adjusted electrically in the left / right direction is used, the mechanism is controlled based on the input distance data and readjusted to the binocular distance at the time of shooting. You can also.

  Not only the viewfinder, but also a mechanism for variably adjusting the distance (parallax) t between the two photographing optical axes in the two objective optical systems may be provided. If the parallax t is wide, the stereoscopic effect is emphasized, and if the parallax t is narrow, a natural stereoscopic effect is obtained. Moreover, it is good also as a mechanism in which the binocular distance by two finders and the parallax t interlock | cooperate. The interlock mechanism may be a mechanism that slides in the left-right direction and expands and contracts in the case of the opera glass type housing shown in the above-described embodiment. In other words, a pair of photographing systems (objective optical system, CCD, LCD, eyepiece optical system, viewfinder) for each LR may be configured to move integrally to the left and right in conjunction with the sliding operation of the housing.

  The shape and structure of the housing itself may be changed. For example, a housing similar to a Porro prism binoculars well known as a Bauschlom (registered trademark) type or a Tsuei (registered trademark) type may be employed. In other words, the LR includes two lens barrels in which the photographing systems of the LRs are housed, and the two lens barrels are connected in parallel via hinges that can rotate about the front-rear direction as an axis. By rotating the two lens barrels via the hinges and bending the casing, the distance between the two photographing optical axes and the distance between both eyes are linked.

  In the configuration where the binocular distance of the finder and the distance between the optical axes of the objective optical system are linked, for example, if the distance between the eyes and the distance between the optical axes of the imaging are adjusted to be always the same, It is possible to match the stereoscopic image visually recognized by the photographer through the viewfinder and the subject visually recognized by the photographer with the naked eye. If the binocular distance data and the left and right captured video signals in this shooting state are recorded, and the photographer views the stereoscopic image reproduced based on these data and signals at a later date, it is extremely realistic. It is possible to appreciate 3D images.

=== Recording of photographic video signal ===
In the above embodiment, the recording means for the L and R photographed video signals is prepared separately. Of course, it is also possible to incorporate the recording means for the captured video signal in the stereoscopic camera. For example, a predetermined recording medium driving means is built in, and a photographed video signal is recorded as it is on a tape medium in an analog format, or converted into appropriate digital video data such as MPEG format or home digital video standard (DV standard). The digital video data may be recorded on a storage medium. As the medium, an appropriate medium such as a built-in or portable solid-state memory, a magnetic tape, a disk (optical, magnetic, magneto-optical, etc.) can be adopted. At the time of reproduction, the L and R video signals read from the medium may be displayed on the LCD.

1 is an external view of a stereoscopic image capturing / reproducing apparatus in an embodiment of the present invention. It is an optical block diagram of the said stereo image imaging | photography reproduction device. It is a functional block diagram of the said stereo image imaging | photography reproduction device.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Stereoscopic image reproduction | regeneration apparatus 2 Binoculars type | mold housing 3a, 3b CCD
4a, 4b Liquid crystal display panel 5a, 5b Objective optical system 6a, 6b Eyepiece optical system 7a, 7b Viewfinder 14 Video signal processing unit 17a, 17b Video signal output terminal 18a, 18b Video signal input terminal

Claims (8)

The case has a binocular shape,
Two objective optical systems for the left eye and the right eye having a photographing optical axis parallel to each other in the front normal direction with the subject side as the front surface of the housing;
Two imaging devices for the left eye and the right eye, each of which is formed with a subject image through the objective optical system for the left eye and the right eye,
Two display elements for left eye and right eye,
Two finder parts for the left eye and right eye for peeking with the left and right eyes from the rear,
Two eyepiece optical systems for the left and right eyes for guiding the images displayed on the left-eye and right-eye display elements to the left-eye and right-eye finder units, respectively;
Image signal output means for individually outputting image signals of a predetermined format based on electrical signals from left-eye and right-eye image sensors; and
Photographed image display control means for individually displaying images based on electrical signals from left-eye and right-eye image sensors on left-eye and right-eye display elements,
Input image display control means for individually displaying and outputting two image signals individually input from the outside to the left-eye and right-eye display elements;
A stereoscopic image photographing / reproducing apparatus comprising:   The two finder units are configured such that the left and right separation distances can be adjusted, and include means for outputting binocular distance information indicating the separation distances in a predetermined data format simultaneously with the external output of the image signal. The stereoscopic video shooting / playback apparatus according to claim 1, wherein   The stereoscopic image capturing / reproducing apparatus according to claim 2, further comprising: binocular distance information input means; and means for appropriately presenting and outputting the input binocular distance information to a user.   4. The stereoscopic image capturing / reproducing apparatus according to claim 3, further comprising means for automatically adjusting the left and right separation distances of the two finder units based on the input binocular parallax information.   The stereoscopic image photographing / reproducing apparatus according to claim 1, wherein the two objective optical systems are configured such that a distance between two photographing optical axes can be adjusted.   The distance between two imaging optical axes in the two objective optical systems is adjusted in conjunction with a left and right separation distance in the two finder units. Stereoscopic image capture / playback device.   The image signal output means includes means for individually outputting a moving image video signal of a predetermined format as image signals from the two image sensors and outputting a synchronization signal for the individually output moving image video signal. The stereoscopic image capturing / reproducing apparatus according to claim 1. The three-dimensional image photographing / reproducing apparatus according to any one of claims 1 to 7, further comprising means for recording image signals from two image sensors as individual information.

Images