JPH09224266A - Method and device for recording stereoscopic image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To attain stereoscopic viewing based on data in various formats by parallelly constituting two images for left and right eyes into one image. SOLUTION: Image data in the state of parallel virtual images 3 and 4 are recorded by photographing them through one camera 10 while interposing an optical image converter 5 in front of the camera (CCD) 10. This recording output is supplied to a display 11 and displayed on a display frame as one image in the state of parallel virtual images 3 and 4. Then, at the time of dynamic image, the image of parallelly displaying the image 3 for left eye and the image 4 for right eye on one screen can be watched. Since the image is watched while double widening screen width through a stereoscopic mirror in comparison with this display screen, the left eye watches the image 3 for left eye, the right eye watches the image 4 for right eye, and the images 3 and 4 can be stereoscopically viewed while being overlapped at the center between the eyes as sight.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a stereoscopic image recording method and device for an electronic moving image stereoscopic vision system, and more particularly to 1.
Stereoscopic image recording method for converting left and right image 1 system image data created by the left and right image 1 system image recording method capable of stereoscopically recording a moving image by one camera into left and right image 2 system image data and outputting the image data. The present invention relates to stereoscopic image recording methods for converting and recording left-and-right image 2-system image data and converting and recording left-and-right image 1-system image data, and apparatuses used for these methods.

[0002]

2. Description of the Related Art Conventionally, an electronic moving image game using an electronic image display called a so-called video game or a personal computer game has been popular. These videos have a three-dimensional color expression like the one inside the TV, but the images are three-dimensional such that they appear to float or animals or objects pop out of the screen. No video processing is done.

[0003]

The widespread use of games as described above has come into widespread use, even if the settings of the game contents can be changed by oneself. Therefore, when a three-dimensional image such as a rocket is launched, There is now a demand for a three-dimensional object that looks like a rocket flying from the display screen toward the viewer. Conventionally, two cameras are used to contrast an image viewed with the left eye and an image viewed with the right eye, and the currently known method is to set the video format to half the screen area in the vertical direction. , When displaying, the image for the left eye and the image for the right eye are alternately displayed on the screen at regular intervals, and when switching between them, the left and right images are distinguished by the goggles synchronized with the liquid crystal shirt. There is one that obtains a stereoscopic effect by the afterimage on the retina. This system has a problem that the screen flickers and the eyes are tired to a large extent because the shirt is indispensable, and the problem that the resolution is poor because the same screen is seen by both eyes. Moreover, it was not possible to take a stereoscopic image with one camera. Therefore, the inventors of the present application have developed an optical adapter (optical image conversion device) for directly capturing an original image as a stereoscopic image with a single camera, and use this optical adapter to generate an image for the left eye. An original screen in which two screens of the image for the right eye are arranged side by side is optically reduced only in the left-right direction and has parallax 2.
We have developed a stereoscopic image recording method that simultaneously projects data above the screen onto a recording element such as a CCD. However, there is a problem in that it cannot be displayed on a conventional data display device in a different format, and there is a problem in that data in a conventional different format cannot be captured and stereoscopic viewing by the new method cannot be performed.

[0004]

The present invention has taken the following technical means in order to solve the above problems.

This method transforms data from different formats. A method using an electronic conversion device for the synthesis. This is a left-eye image output from two conventional CCD cameras and VCRs. Transform the screen data of two systems for each image for the right eye and the data of different formats. Use a device that synthesizes and outputs. Image for the left eye as type 1. The images of the two systems of the image for the right eye are respectively reduced in the horizontal (horizontal) direction by half and combined in parallel in one screen frame. There may be a case where the image is enlarged twice in the vertical (vertical) direction and combined in one screen frame in parallel, or a case where three screens are combined in parallel in one screen frame. Image for left eye as type 2. There is a method of using an electronic conversion device from another format that alternately displays two systems of images for the right eye.

The conventional stereoscopic display device displays images for the left eye. Many have a 2-input terminal for the image for the right eye. Therefore, the image for the left eye as described above. In the left and right image 1-system image system having both right eye images on one screen, only one output terminal is required, but this data is a conventional stereoscopic display device having two input terminals. Requires a conversion to be used for. The stereoscopic image switching conversion device includes the following types. As type 1, compressed stereoscopic image data is expanded in the left-right direction and output in one system, or for the left eye. Allocates to the screen for the right eye and outputs two systems. Type 2 for the left eye. Pixels for the right eye are alternately arranged by one or several pixels and output is performed by one system. In the method of type 3, the expanded data is distributed to the left and right screens and alternately output in one system.

[0007]

According to the present invention constructed as described above, it has the following actions. That is, for example, in order to stereoscopically view an electronic moving image, the images viewed by the left eye and the image viewed by the right eye must be different because the viewing angles of the left and right eyes are different. For example, if you look at a standing tree, you can see the left side of the standing tree far away with your left eye,
Since the right eye can see the right side of the tree far away, the images seen by the left and right eyes are different. Therefore, if the stereoscopic video original images of the left-eye image and the right-eye image are arranged in parallel with each other in the size of one display frame, the originals in the parallel state are the size of one display frame in the vertical direction and the horizontal direction. Is twice the size of one display frame. To enter this directly on the camera,
When an optical image conversion device is inserted between the camera and the original image, the vertical direction. The original images are reduced in size in the horizontal direction (left and right) by the cylindrical lens system with different horizontal magnifications (in this case, 1 in the vertical direction and 0.5 in the horizontal direction), and the display 1 Frame size. On this screen, a left-eye image and a right-eye image are sorted into one screen in parallel by a prism and a reflecting mirror system and projected on a camera. Therefore, in an electronic moving image recorded by this system, a left-eye image and a right-eye image each having a half width are displayed in parallel on one screen on the display. When this is viewed through a stereoscope (goggles), the left eye image and the right eye image are each doubled in width, and the left eye sees the left eye image and the right eye sees the right eye image. Therefore, you will see a stereoscopic image as a vision.

When the left-eye image and the right-eye image are not directly captured by the camera, the left-eye image data and the right-eye image data that are individually created by the conventional method are respectively converted into horizontal widths by an electronic conversion device. Of the left eye image and the right eye image whose horizontal width has been reduced by a factor of 2 are combined in parallel so as to be the size of one display frame. Then, it becomes the same as that input by the direct camera.

Since the stereoscopic image recording method according to the new method has only one data output terminal, it cannot be directly connected to the conventional display device for display output. Therefore, as the output device, data was converted for the conventional display device. A stereoscopic image switching conversion device that can be switched is used. That is, since the new system is configured by arranging two images in parallel into one image, the stereoscopic image switching conversion device performs the reverse conversion, specifically, separating one image into right and left. The image data for the left eye and the image data for the right eye are created by enlarging, and when this is output, the path is switched and output for the conventional device. That is, it is possible to deal with by outputting with two systems of left and right, alternately outputting left and right, or by allocating left and right to one screen and outputting.

[0010]

Embodiments of the present invention will be described with reference to the drawings. FIG. 1 shows a recording method using the left-right image 1-system image recording method. When the left and right images 1 and 2 are arranged side by side, the width of the left-right image is twice the size of one display frame. Looking at this with the optical image conversion device 5,
The widths of the vertical screen in the left-right direction (horizontal direction) are reduced by half to form virtual images 3 and 4. The optical image conversion device 5 has a case body 6 in which optical systems 7, 8 and 9 for reducing the image width and arranging the left and right images in parallel on one screen are arranged. If the image is photographed by one camera 10 with the optical image conversion device 5 interposed therebetween, the image data of the virtual images 3 and 4 in a parallel state is recorded. When this is output to the display 11, the virtual images 3 and 4 are displayed side by side in the display frame as one image. In the case of a moving image, an image in which the left-eye image 3 and the right-eye image 4 are arranged side by side can be seen on one screen. With respect to this display screen, the left eye sees the image 3 for the left eye and the right eye sees the image 4 for the right eye by viewing the image with the screen width doubled with a stereoscope (not shown). Image 3 for the left eye at the center of the eye
And the image 4 for the right eye can be doubled to be viewed three-dimensionally.

FIG. 2 is a schematic diagram of a stereoscopic image conversion device for converting image data in the left / right image 2-system image system into the left / right image 1-system image system. In FIG. 2, the image conversion switching device 1
2 is a conventional two CCD cameras 18A, 18B, video decks 19A, 19B, computer video. C
The image data 18 for the left eye and the image data 19 for the right eye, which are output from the D19C and the like, and the image data of two systems and the data of different formats are taken in, and the data is reduced and deformed by half in the horizontal direction. Reduced left-eye image,
The image for the left eye by incorporating the data of the first type image width conversion device 13 for synthesizing the image for the right eye in parallel on one screen and the system for alternately displaying the image for the left eye and the image for the right eye , A second type image width conversion device 15 for arranging the images for the right eye in parallel on one screen and synthesizing them. A display device such as a computer (VCR, computer) 16,
A switching device 14 that can be switched to be output to a (video camera) 17 is provided. The conventional image for the left eye,
When the data of the system that alternately displays the right-eye images is taken in, the original left-eye image data and right-eye image data are recorded in an alternating upper and lower array, so the data amount is 2
It can be reduced by a factor of 1.

A block circuit diagram of the image width conversion device 13 of the first type has three types 13 as shown in FIG.
1,132,133 can be illustrated. The synchronization device 13A here is a correction device that matches the elapsed times of the left-eye image and the right-eye image. The transforming device 13B is a device for changing the aspect ratio of an image, and has a method of reducing the horizontal direction and a method of expanding the vertical method, and performs analog processing, digital processing, optical processing, and the like. For example, a method of halving the scanning line pitch in the case of analog processing and a method of thinning out every other pixel in the case of digital processing are shown. The processing includes a method of performing it in scanning lines (or one pixel in the vertical direction and one column in the horizontal direction), a method of reading it in a buffer in advance and performing it in the unit of block. Optically, there is a method in which an image once displayed is optically reduced or expanded and converted again into an electric signal by a CCD or the like.
The synthesizing device 13C has a function of gathering a plurality of image frames into one frame in a state where they are arranged in the horizontal and horizontal directions, and there is a method of performing them in scanning line units or buffers in block units.

A block circuit diagram of the image width conversion device 15 of the second type is shown in FIG.
1, 152 is exemplified. Deformation device 1 in this circuit
The functions of both 5A and the synthesizing device 15B are the same as those of the image width converting device 13 of the first type. Just type
Since the image data for the left eye and the image data for the right eye are alternately and repeatedly input, they are respectively reduced in the width direction, and the reduced image for the left eye and image for the right eye are put in a frame of one image width. Combine in parallel. The switching device 14 has an automatic opening / closing device, connects an input destination and an output destination, controls the presence / absence of processing at the input destination, and selects and outputs the output destination.

The image data recorded by the left and right image 1-system image system is output from one terminal. However, since many display devices according to the conventional system have two terminals, they are output as they are. I cannot connect. Therefore, a schematic diagram of an output image conversion device for converting and recording image data so as to match the conventional system and outputting the image data for display on a display device according to the conventional system is illustrated in FIG. In FIG. 5, the output image conversion device 20 includes a game machine 25A, a video 25B, a camera 25C, and a computer 2.
Image data in which the left-eye image and the right-eye image are compressed and configured in parallel in one screen on the left and right is input from a recording device such as 5D, and a switch or a specific input signal is used as a trigger to output to ( Head mount display) 26
A, (2-input system stereoscopic television) 26B, (stereoscopic display device using two projectors) 26C, (1 input system stereoscopic television) 26D, (normal television) 26E, and a switching device 21 for switching, A plurality of converters 22, 23, 24 set according to the output destination are provided. The first type conversion device 22 expands the stereoscopic image data compressed in the horizontal direction in the horizontal direction and outputs it in one system, or separates it into screens for the left eye image and the right eye image and uses two systems. It is a system to output. The second type conversion device 23 is a system in which the pixels of the image for the left eye and the image for the right eye are alternately arranged in the upper and lower parts of the screen by one or several pixels and are output alternately in one system. The third type conversion device 24 is
This is a system in which the expanded image data is distributed to left and right screens and alternately output in one system. In this case, the input and output signals are digital. The type such as analog does not matter.

A block circuit diagram of the first type conversion device 22 has two examples 221 and 222 as illustrated in FIG.
There is. The separating device 22A has a function of separating the images gathered in one frame in parallel into a plurality of frames, and there is a method of performing the scanning line unit or the buffer to the block unit. The transformation device 22B is a device that changes the aspect ratio of an image, and includes analog processing, digital processing,
Performs optical processing. For example, in the case of analog processing, processing for doubling the pitch of scanning lines is performed, and in the case of digital processing, one pixel is doubled to two pixels. Alternatively, a method of performing processing such as complementing a pixel having an intermediate color tone between adjacent pixels will be described. Of course, the magnification is not limited to 2 times, but is basically the inverse multiple of the scale of image registration (3 is used when the scale is 1/3).
Doubled). The processing includes a case where it is performed in a scanning line (or a unit of one pixel in the vertical direction and one column in the horizontal direction), or is read in a buffer in advance and performed in the unit of block. Optically, there is a method in which an image once displayed is optically reduced or expanded and converted again into an electric signal by a CCD or the like.

The block circuit diagram 231 of the second type conversion device 23 includes a left and right pixel rearrangement device 23A, as illustrated in FIG. The left and right pixel rearrangement device 23A is
A device that extracts one to several pixels from the screen in which the left and right images are arranged side by side in one frame and rearranges them in order. It has the function of converting to a format for display on a lenticular plate or a display using a parallax barrier. . There is a method in which it is performed in scanning line units or in blocks from the buffer.

A block circuit diagram of the third type conversion device 24 is as shown in FIG.
There are 42. The separating devices 24A and 24B here are the same as those shown in FIG. Alternate sorting device 24C
Has a function of alternately outputting the separated left and right images in time series, and also has a control function of eyeglasses with a liquid crystal shutter and the like for alternately blocking each eye.

As shown in FIG. 9, the switching device 21 includes a signal detection device 21A and switching devices 21B and 21B. The signal detection device 21A uses the image data signal 21
The control signal 21D sent prior to C is detected to output the opening / closing signal of the opening / closing device 21B to a single or a plurality of opening / closing devices 21.
Send to B, 21B. The opening / closing device 21B opens / closes an image signal output according to an opening / closing signal or control from a panel or the like.

As described above, the image data for the electronic moving image stereoscopic vision system recorded by the image recording method according to the present invention can be easily displayed on the display device by the conventional left / right dual image system. The screen on the display device according to can be viewed with the moving image stereoscopic system according to the conventional system. Further, it is possible to easily output from a one-output type game machine or video to a multi-input type stereoscopic image output device. When switching between the stereoscopic image display device and the normal display device, it is not necessary to connect or disconnect the cable. Further, by incorporating it into one chip, it can be incorporated into a game machine or the like. The conversion device can be expanded by any method such as digital, analog, and optical. The respective block circuits are not limited to this, and may be appropriately modified and combined to suit this purpose.

[0020]

The present invention configured as described above has the following excellent effects.

A. Since it is possible to easily convert the left and right image 2 system image data, which requires a large-scale device or complicated equipment, to the left and right image 1 system image data, simply by using an inexpensive optical stereoscope (goggles). This makes it easier to stereoscopically view with one display, which is not a burden on the user.

B. The stereoscopic image conversion device only reduces the image width for the left and right eyes based on the recording data of the conventional method to less than half of the screen width of the display and performs the combining process so that the images for the left and right eyes are arranged in parallel. It has an effect that it is easy and a small device can be used. In particular, since it can be made into a chip, it can be incorporated in various devices.

Although the conventional display device of the left and right image dual system image system requires two terminals, an output image for connecting from one output terminal of the system of the present application to a display device of two terminals of the conventional system. The conversion device is also the reverse conversion method of the image conversion device. Since the conversion process is easy and the device is simple, the cost burden is light and the image recording. Image conversion. There is an effect that a mechanism such as output image conversion can be connected in series to configure the device. Moreover, when the switching devices are connected in series, there is an effect that even if the output destination is different, the output can be automatically performed without replacing the code.

There is an effect that it is possible to easily output from a one-output type game machine or video to a multi-input type stereoscopic image output device.

[Brief description of drawings]

FIG. 1 is a plan view of an optical image conversion device and a schematic view of a recording method.

FIG. 2 is a schematic diagram of a stereoscopic image conversion device.

FIG. 3 is a schematic diagram of an output image conversion device.

[Explanation of symbols]

1 Image for left eye 2 Image for right eye 3,4 Virtual image 5 Optical image converter 6 Case body 7,8,9 Optical system member 10 Camera 11 Display 12 Stereoscopic image converter 13 Image width converter 13A Synchronizer 13B Deformation device 13C Compositing device 14 Switching device 15 Image width conversion device 15A Deformation device 15B Composing device 16,17 Display device 18 Left eye image data 19 Right eye image data 20 Output image conversion device 21 Switching device 21A Signal detection device 21B Opening / closing Device 21C Image signal 21D Control signal 22, 23, 24 Conversion device 22A Separation device 22B Deformation device 23A Left and right pixel rearrangement device 24A Separation device 24B Deformation device 24C Alternate rearrangement device 25A, 25B, 25C, 25D Recording device 26A, 26B, 26C, 26D, 26E display device

─────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] May 1, 1996

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name] Brief description of the drawing

[Correction method] Change

[Correction contents]

[Brief description of drawings]

FIG. 1 is a schematic diagram of a left-right image 1-system image recording method.

FIG. 2 is a schematic diagram of a stereoscopic image conversion device.

FIG. 3 is a block circuit diagram of a first type image width conversion device.

FIG. 4 is a block circuit diagram of a second type image width conversion device.

FIG. 5 is a schematic diagram of an output image conversion device.

FIG. 6 is a block circuit diagram of a first type conversion device.

FIG. 7 is a block circuit diagram of a second type conversion device.

FIG. 8 is a block circuit diagram of a third type conversion device.

FIG. 9 is a block circuit diagram of a switching device.

[Explanation of Codes] 1 Left-eye image 2 Right-eye image 3,4 Virtual image 5 Optical image conversion device 6 Case body 7, 8, 9 Optical system member 10 Camera 11 Display 12 Stereoscopic image conversion device 13 Image width conversion Device 13A Synchronous device 13B Deformation device 13C Compositing device 14 Switching device 15 Image width conversion device 15A Deformation device 15B Compositing device 16,17 Display device 18 Left eye image data 19 Right eye image data 20 Output image conversion device 21 Switching device 21A Signal detector 21B Switchgear 21C Image signal 21D Control signal 22,23,24 Converter 22A Separator 22B Deformer 23A Left and right pixel reorderer 24A Separator 24B Deformer 24C Alternate reorderer 25A, 25B, 25C, 25D Record Device 26A, 26B, 26C, 26D, 26E Display device 1 1-133 block circuit diagram of the image width conversion apparatus of the first type. 151-152 A block circuit diagram of a second type image width conversion device. 221-222 is a block circuit diagram of a 1st type conversion device. 231 is a block circuit diagram of a second type conversion device. 241-242 is a block circuit diagram of a 3rd type conversion device.

Claims (8)

[Claims] 1. A left-eye image for stereoscopic viewing. Recorded image data in which each of the images for the right eye has been formatted in advance within the size of one frame of the display is input to the stereoscopic image conversion device, and the images for the left eye. Each of the right-eye images has a frame length in the vertical direction, and the width in the left-right direction is deformed to less than half the frame width, and the deformed images are distributed in one screen frame and combined in parallel to form one screen. A method for recording a stereoscopic image, which is characterized by performing a format. 2. An image for the left eye for electronic video stereoscopic viewing. A device for converting recorded image data in which each data of the image for the right eye is formatted in the size of one frame of the display. An electronic system circuit that transforms the left and right widths of the right-eye image to less than half the frame width, and the left-eye image input at different timings. An electronic system circuit that synchronizes the image data for the right eye and the image for the left eye. An image for the left eye is included in one frame image, and an electronic system circuit for arranging and synthesizing the image for the right eye side by side in parallel within a horizontal frame of the display. A stereoscopic image conversion device, which records right-eye images in parallel. 3. An image for the left eye for electronic video stereoscopic viewing. A device for converting recorded image data in which each data of the image for the right eye is formatted in the size of one frame of the display. An electronic system circuit that transforms each of the right-eye images into a size that fits in parallel in one frame, and the left-eye image in one frame image. An electronic system circuit for allocating and synthesizing right-eye images in parallel, and displaying the left-eye image within one frame image of the display. A stereoscopic image conversion device, which records right-eye images in parallel. 4. A left-eye image for electronic moving image stereoscopic viewing. A device for converting recorded image data in which each data of the image for the right eye is formatted in the size of one frame of the display, and is used as a first stereoscopic image conversion device. An electronic system circuit that transforms each of the right-eye images into a size that can be accommodated in parallel in one frame;
Image for the left eye in the frame image. It is equipped with an electronic system circuit that distributes right-eye images in parallel and combines them into one, and displays the left-eye image within one frame image of the display. A second stereoscopic image conversion device having a function of recording images for the right eye in parallel is used as the second image for the left eye. Each of the images for the right eye,
An electronic system circuit that transforms the image into a size that fits side by side in one frame and the image for the left eye in one frame image.
An electronic system circuit for allocating and synthesizing right-eye images in parallel, and a path switching device for allocating and outputting data converted by these converters to different output destinations. And a stereoscopic image conversion device. 5. An image for the left eye for electronic video stereoscopic viewing. The left-eye image 1-system image data in which the data of the right-eye image is distributed and synthesized in parallel within the horizontal width of one frame of the display is recorded as the left-eye image. An image recording method for outputting to an image display device that displays only image data composed of two systems of left and right images in which the left and right widths of the right-eye image are set to the display frame width. An image for the left eye, obtained by electronically processing image data. The image width for each image for the right eye is expanded to the display frame width, and the expanded image for the left eye. A stereoscopic image recording method, characterized in that each of the images for the right eye is separated and recorded, and is output according to the system of the output destination. 6. A left-eye image for electronic moving image stereoscopic viewing. The left-eye image 1-system image data in which the image data for the right eye is distributed and synthesized in parallel within one frame of the display is recorded as the image for the left eye. An image recording device for outputting to an image display device for displaying only image data consisting of two systems of left and right images in which respective sizes of right-eye images are set in a display frame frame. An image for the left eye, which is obtained by electronically processing 1-system image data. Image for the left eye that was paralleled with the system circuit that expands and records the data of the image for the right eye such that the left and right width becomes the display frame width. A stereoscopic image recording apparatus, comprising: a system circuit that separates each of the right-eye image data to form a separate path. 7. An image for the left eye for electronic video stereoscopic viewing. The left-eye image 1-system image data in which the image data for the right eye is distributed and synthesized in parallel within one frame of the display is recorded as the image for the left eye. An image recording device for outputting to an image display device for displaying only image data consisting of two systems of left and right images in which respective sizes of right-eye images are set in a display frame frame. An image for the left eye, which is obtained by electronically processing 1-system image data. A stereoscopic image recording apparatus, comprising: a system circuit that individually extracts data for right-eye images and rearranges them alternately. 8. An image for the left eye for electronic video stereoscopic viewing. The left-eye image 1-system image data in which the image data for the right eye is distributed and synthesized in parallel within one frame of the display is recorded as the image for the left eye. An image recording device for outputting to an image display device for displaying only image data consisting of two systems of left and right images in which respective sizes of right-eye images are set in a display frame frame. An image for the left eye, which is obtained by electronically processing 1-system image data. Image for the left eye that was paralleled with the system circuit that expands and records the data of the image for the right eye such that the left and right width becomes the display frame width. A system circuit that separates each of the right-eye image data and separates them into different paths, and a left-eye image. A stereoscopic image recording apparatus, comprising: a system circuit that individually extracts data of right-eye images and rearranges them alternately.