WO2002073982A1

WO2002073982A1 - Method for virtual images synthesizing into solid image and spectacles type solid television thereof

Info

Publication number: WO2002073982A1
Application number: PCT/CN2002/000019
Authority: WO
Inventors: Shijun Ren
Original assignee: Shijun Ren
Priority date: 2001-01-31
Filing date: 2002-01-16
Publication date: 2002-09-19
Also published as: CN1359240A; CN1204758C; CN1473441A

Abstract

The present invention provides a method that employed in solid television system in which virtual images are synthesized into a solid image and the spectacles type solid television that utilizes the method. In the method, two independent plane images that obtained by two cameras and have visual angle to each other, pass the optical lens and form virtual images in the same dimensional space respectively, and the two virtual images are synthesized synchronously into one dimensional solid image. In the spectacles type solid television that utilizes the method, a pair of optical lens and a pair of screens are mounted on the spectacle frame, behind the two screens, there are two chips in which there arranged circuit boards that provide the left and the right video signals respectively. The left and the right video signals that provided to the screens are two different independent synchronous video signals that obtained by two cameras and have a human-eye visual angel to each other according to the same object. The above method and the spectacles type solid television that utilizes the method can watch solid three-dimensional image and two-dimensional image.

Description

Virtual image synthesis spatial stereo image method and glasses-type stereo television

Field

The invention provides a method and a device for synthesizing a stereo image, and in particular, a method for synthesizing a spatial stereo image with a virtual image applicable to a stereo television system, and a glasses-type stereo television using the method. Background of the invention

Existing stereo television technologies, including stereo television technology with glasses, are based on the principle that the stereo image of the television must be expressed from the same synthesized image screen. When shooting, a dual-lens camera was used to obtain two independent images with different viewing angles. During playback, the two images were combined on a flat display screen. In this way, not only the synthesized image, but still It is flat and has ghosting. It cannot be viewed clearly with the naked eye. As a stereoscopic image, you have to use some reduction methods to re-decompose them and provide them to the left and right eyes respectively.

For example, some of these methods use polarized light or light deletion ("Broadcasting and Television Technology" 1997. 4. pp. 26-27); Chinese patent "color stereo TV viewing device" CN86108494; Chinese patent "light delete , Polarized Universal Stereo Television System "CN1214600, etc."; some are field sequential methods (Chinese patent "a stereo liquid crystal glasses" CN1104776; Chinese patent "stereoscopic color TV system" CN1034839A, etc.); some are color filtering methods (Chinese patent "stereo Camera system and image viewing glasses "CN1041255A; Chinese patent" Interlaced Time Division Complementary Color Separation Stereo Television System "CN1101481A; Chinese patent" A Device and Method for Shooting Stereo Image Film and Television Programs "CN1093470A).

All of these methods require glasses. This kind of thinking is rigid and cumbersome. Very inconvenient in practical use. Moreover, without glasses, the images cannot be viewed normally.

In addition, people have developed a vertical stripe separation method ("Broadcasting and Television Technology" 1997. 4. pp. 30-3; Chinese patent "stereo television system" CN1971544). You do not need to wear glasses. However, this method also requires the addition of a parallel cylindrical convex lens in front of the screen to replace the role of glasses. Therefore, when viewing is also limited, it can only be performed within a specific visual range.

Chinese patent CN1071789A discloses a "high-fidelity stereo television imaging technology". This existing technology eliminates the need to synthesize images shot by a camera lens on the same flat screen. In specific implementation technology, it uses two televisions. When viewing images, one eye directly looks at a television screen in front; the other eye refracts through a mirror, and when viewing another television screen, the mirror must be corresponding The refraction angle of the light is adjusted so that the refracted images are superimposed on the front television screen for direct viewing, and the images on the two television screens are combined in this way to become a stereo image. In the prior art, the positions of the two televisions need to be adjusted very well, and when viewing, the head and neck of a person cannot be moved at all, otherwise a stereoscopic image cannot be viewed. This stereoscopic imaging method is difficult to operate due to harsh conditions, and is not practical.

In the field of portable displays, the glasses-type dual image TV developed and produced by Japan's Olympus still only provides two-dimensional images in a plane, but not three-dimensional images in three dimensions. In portable displays, there is also a lack of technologies and products that provide stereo three-dimensional images. Summary of invention

The technical problem to be solved by the present invention is to provide a virtual image synthesis stereoscopic image method capable of overcoming the defects in the prior art and a glasses-type stereoscopic television using the method. In the virtual image synthesis stereo image method, two independent plane images with mutually different viewing angle differences obtained by a dual-lens camera are synchronized to form a virtual image in the same space through an optical lens, and the two virtual images are combined into a spatial stereo image. People's eyes can directly view the synthesized spatial stereo images. The glasses-type stereo television system adopting the above method provided by the present invention can view stereo three-dimensional images and two-dimensional images.

To this end, the present invention provides a virtual image synthesis method for spatial stereo images, where:

a. Using dual cameras to shoot scenes, generate left and right video signals;

b. Output the left and right video signals to the two image display units through the video synchronization unit; C. The two image display units form mutually synchronized viewing angle differences for the same scene; d. The two image display units form a composite virtual image in space through optical lenses.

As described in the virtual image synthesizing spatial stereoscopic image method, the left and right video signals may be transmitted by wire or may be transmitted by wireless.

As described in the virtual image synthesis spatial stereo image method, the video synchronization system may be a recording or playback system, or may be a recording and playback system.

As described above, the virtual image synthesis spatial stereo image method is provided with two sets of left and right pulse triggers before the recording system and the playback system. The two sets of pulse triggers receive and restore the video signal, and the temporal pulse generator is connected to the pulse trigger. Device.

As described in the virtual image synthesis spatial stereoscopic image method, the left and right video signals can be simulated by digital technology.

A glasses-type stereo television system adopting the above method is provided with a pair of optical lenses and a double screen on the glasses frame, and left and right movement cores are arranged behind the double screen, and the left and right movement cores are provided with circuit boards that provide video signals to the double screen. The left and right video signals provided to the screen are different, synchronized video signals formed by two independent, two-lens filmed, mutually different angles of view on the same object that have similar human eyes.

As described above, in the glasses-type stereoscopic television, the left and right video signals having a poor viewing angle can be formed by analog technology such as digitization.

As described above for the glasses-type stereo television, the video signal may be connected to a changeover switch. When the changeover switch is in a state, the left and right video signals have a difference in viewing angle, and are two different video signals, and the display displays a stereo image; When the switch is in another state, there is no viewing angle difference between the left and right video signal gates. It is the same video signal, and the display shows a flat image.

In the above-mentioned glasses-type stereo television, the changeover switch may be provided between the dual camera and the left and right video signal generating units, that is, the input end of the left and right video signals, and may also be provided at the output end of the left and right video signals.

The advantages and characteristics of the present invention are: The method is used in a television system. The camera is dual-lens, and the video recorder can output the signals from the dual-lens camera directly. It is almost ready for reception. It can be used intact on the equipment composed of the currently widely used flat-screen television technology; especially it can be almost intact. It is used immovably on the glasses-type dual image flat display.

This method tolerates the condition that people's eyes at the current stage are based on the scenes captured by a single-lens camera and present a flat image. When the television system plays the dual-camera signals of the camera, and the stereoscopic display using the method of the present invention receives a stereo image, the flat display can also receive the signal from one of the cameras to obtain a flat image.

Conversely, when a single-lens signal of a video is played by a television system, not only the existing flat display can receive a flat image, but also the glasses-type stereo display using the method can also receive a clear flat image through a switch. . Brief description of the drawings

FIG. 1 is a schematic diagram of an object image being perceived by both eyes of people;

FIG. 2 is a schematic diagram of the virtual image 8 formed by the image 3 in FIG. 1;

FIG. 3 is a schematic diagram of the image 6 in FIG. 1 forming a virtual image 9;

FIG. 4 is a schematic diagram of the three-dimensional image 10 synthesized by the virtual images 8 and 9 in space 7 in FIGS. 2 and 3;

FIG. 5 is a schematic diagram of the present invention, which shows that a video signal obtained with a dual lens camera is converted into a stereo image;

FIG. 6 is a schematic diagram of the present invention, which shows that a video signal obtained by using a dual-lens camera is sorted, merged, and decomposed by a pulse trigger, and converted into a stereo image;

7 is a schematic diagram of the present invention, showing a dual function of the glasses-type dual-screen display of the present invention;

FIG. 8 is a schematic diagram illustrating the relationship between the depths of the scenes in the stereogram to relieve the fatigue caused by binocular viewing of the stereo image;

FIG. 9 is a schematic diagram of a glasses-type stereoscopic television using the above method according to the present invention. Description of the preferred embodiment

Now, specific embodiments of the present invention will be described with reference to the accompanying drawings. In order to have an accurate understanding of the method of the present invention, with reference to FIGS. 1 to 4, the optical principle on which the present invention is based will be described first.

In FIG. 1, image 1 is a cup with a handle set in a cylindrical shape, and a front view is shown on a plane 2. Images 3 and 6 are the images of the cup perceived by the left and right eyes of the person or captured by the camera, respectively, and are implemented on the planes 4 and 5. The difference in viewing angle between the left and right eyes or the left and right cameras of the cup images 3 and 6 is β angle.

Among them, image 3 can clearly show the handle part of the cup, and the handle part displayed there is different from that shown in the front view of image 1, which is obviously more.

Image 6 does not show the handle part on the cup; for image 6, the corresponding right eye or right head is the head part of the cup, which is just blocked by the cylindrical body of the cup itself.

Both images 3 and 6 are different from image 1 and are independent and different from each other. Because of this, people's visual nervous system, based on images 3 and 6, can directly obtain a spatial stereo image different from the cup plane front view 1.

If images 3 and 6 are combined directly or after technical processing on a plane or screen, people's left and right eyes can see an indistinguishable, overlapping, and fuzzy flat image instead of a spatial stereo image.

If the superimposed planar images composed of the images 3 and 6 are re-decomposed into the original images 3 and 6, it needs to be processed by the reduction technology again. As already pointed out in the foregoing: there are polarized light or light deletion method, there are field sequential method, color filter method and vertical fringe method and so on. It is the basic ideas that make up these methods, making current stereo television technology limited to dilemmas.

FIG. 2 is a schematic diagram of the image 3 being a virtual image 8.

In FIG. 2, an image 3 passes through an optical lens to form a virtual image 8 in a space 7. This virtual image 8 does not actually exist in space 7, it is only the visual perception of people; however, for human eyes, it is still flat like image 3. FIG. 3 is a schematic diagram of an image 6 being a virtual image 9.

In FIG. 3, the image 6 passes through an optical lens to form a virtual image 9 in the space 7. This virtual image 9 does not actually exist in space 7, it is only the visual perception of human beings; however, the human eyes are still flat like image 6.

FIG. 4 is a schematic diagram of the virtual image 8 and 9 of FIG. 2 and FIG. 3 synthesizing the stereo image 10 in the space 7. In Figures 2 and 3, the virtual images 8 and 9 formed in space 7 are independent of each other and have a difference in viewing angle β. Therefore, the left and right eyes of the human have different perceptions of the virtual image 10 on the synthesized space 7. On the one hand, the synthesized virtual image 10 is different to the left and right eyes of the human, and does not overlap. On the other hand, the synthesized image is good. If the virtual images 10 are formed on the space part 7 of the same size, they give people the feeling of the visual nervous system, which is the stereo image 10 in the three-dimensional space 7.

The virtual image 10 synthesis principle in Fig. 4 omits such a process compared to the existing stereo imaging technology:

After the images 3 and 6 are technically processed, they are superimposed on a screen or a plane. Then, the overlapping images are restored and decomposed into images 3 and 6 to form a stereoscopic image.

FIG. 5 is a schematic diagram of a video signal acquired by a camera lens of the present invention and converted into a stereo image. A virtual image synthesis spatial stereo image method includes:

a. Using dual cameras to shoot scenes, generate left and right video signals;

b. The left and right video signals are output to the two image display units through the video synchronization unit; c The two image display units form a synchronized viewing angle difference with respect to the same scene; d. the two image display units are formed in space by optical lenses Composite virtual image.

In FIG. 5, the left and right video signals 1 1 and 12 obtained by the left and right cameras 14 and 15 in the Huan lens camera appear as images 3 and 6 through the video synchronization system 13, and the video signals 11 and 12 may be wired transmission or may be The signals 3 and 6 are transmitted wirelessly through the optical lens, and the combined virtual image 10 formed by the human visual nervous system in the space 7 is presented as a three-dimensional image of the space.

In FIG. 5, the images 3 and 6 and corresponding optical lenses, or all or part of the carrier including the video signals 11 and 12, can form a glasses-type dual-image stereoscopic display 20 and 33. The left and right video signals 11 and 12 in FIG. 5 can directly display the images 3 and 6 to form a stereoscopic image 10 when shooting directly without going through the hardware facilities of the video synchronization system 13.

In FIG. 5, the video synchronization system 1 3 through which the left and right video signals 11 and U pass may be a recording or playback system, or may be a recording and playback system.

In FIG. 5, the left and right video signals 11 and 12 having the viewing angle difference β are not necessarily obtained from the left and right cameras ¹⁴ and 15. They can also be simulated by digitization and other technologies. The left and right video signals 11 and 12 formed by digitization and other technology simulations can also generate a stereo image 10.

In terms of the left and right video signal gates 11 and 12 in FIG. 5, images 3 and 6 can be directly displayed without the need to undergo the existing polarized light, light deletion, color filtering, field sequential or vertical stripe method and other technical methods. , On the other hand, if they have been processed by the above-mentioned technical methods, as long as they are still two independent and maintain the characteristics of the difference in perspective of the same object or scene, images 3 and 6, and can also form a stereo image.

The left and right video signal gates 11 and 12 in FIG. 5 as long as they are not the same signal, and have mutually different perspectives on the same object and scene, and can form images on the screen, respectively, then the left and right video signals 11 and 12 The transmission of 12 is the same whether it is performed by electronic technology or light guide technology.

Figure 6 shows the video signal obtained with a dual-lens camera, which is sorted, merged and decomposed by a pulse trigger, and transformed into a stereo image. It is different from FIG. 5 in that the camera signals 14 and 15 are combined with the pulse triggers 37 and 38 before being input to the recording and playback device 13, and the trigger signals of the triggers 37 and 38 are controlled by the time pulse generator 39. In the working state, their signals are emitted and closed, which are opposite to each other.

Another difference is that before the recording and playback device 13 inputs signals to the display 20, the signals pass through the triggers 35 and 34 and are restored to two signals corresponding to the camera signals 14 and 15 under the control of the time pulse generator 36. In other words, the triggers 35 and 34 restore the signals after mixing by the pulse generators 37 and 38 to two independent signals corresponding to the camera signals 14 and 15, and these two signals can be displayed on the left and right screens 4 respectively. 5 and 5, the cup images 3 and 6 are displayed, and then the cup on the space 7 is formed Sub stereo image 10.

For the convenience of description, the input part connected to the front end of the recording and playback device 13 in FIG. 6, that is, triggers 37 and 38 and the time pulse generator 39, and the output part connected to the rear end of the recording and playback device 13, that is, triggers 35, 34 and The time pulse generator 36 is regarded as a component of the recording and playback device 13 and is integrated with the recording and playback device 13.

Fig. 7 illustrates that the glasses-type dual-screen display formed by the method of the present invention can have dual functions of flat and stereo.

It should be noted that not all glasses-type dual-image televisions can present stereo images. Only when the two images of the glasses-type television are not the same image taken by a single lens, and the pair of images must be from the same object or the same scene, under the condition that the viewing angle difference β of human-like eyes is β Only the formed and reproduced images 3 and 6 can present a stereo image.

By adopting the method of synthesizing a spatial stereo image by a virtual image, not only the formed glasses-type dual-screen display can display stereo images, but also the glasses-type dual-image television can have both stereo and flat functions.

In FIG. 7, when the change-over switch 16 is in the A state, the working system of FIG. 7 is the same as that of FIG. 5. At this time, the left and right video signals 11 and 12 can present the stereoscopic image 10 in FIGS. 4 and 5. When in the B state, the left and right video signals 11 and 12 are the same video signal. Their signals are shown in Figure 7 and are provided separately by the left camera 14. At this point, they form a flat image 8.

The transfer switch door 16 may be provided between the dual cameras 14 and 15 shown in FIG. 7 and the left and right video signal generating units, that is, the input terminals of the left and right video signals 11 and 12; and may also be provided on the left and right video signals 11 and 12 Output.

Fig. 8 is a plan view. In the figure, the left and right cameras 14 and 15 capture the scenes 17, 18, and 19, and in the perspective view, there is a spatial depth distance H0 and Hl between them. Such distance values HO and HI cannot be seen in a single-lens plane image. In FIG. 8, the viewing angle differences β1, βθ, and β2 formed by the scenes 17, 18, and 19 and the left and right cameras 14 and 15, respectively, are different. It is these differences in viewing angles of different sizes that show differences in depth between scenes in the stereogram. Different H values or different β values in FIG. 8 can make a person's eyes have a certain range of viewing distance or viewing angle adjustment and change when viewing a stereo image. The threshold value and β value of a plane image are fixed values, and there is no room for adjustment and change when the eyes of a human are viewed. Therefore, when watching stereoscopic television images with spatial depth changes with both eyes, it is not easy to generate the fatigue caused by flat television images without spatial depth changes.

FIG. 9 is a schematic diagram of a glasses-type stereoscopic television system using the above method according to the present invention, and specifically illustrates the application of the virtual image synthesis method for spatial stereoscopic images of the present invention.

FIG. 9 is a schematic perspective view of the left and right movement parts in the glasses-type dual-screen display, and the parts of the outer frame housing of the glasses are omitted. Among them, arrows 27 and 28 indicate the direction in which the eyes of a person view the display image after putting on the glasses frame.

In Figure 9, the structure of the left and right movements are exactly the same. The left movement gives a three-dimensional sectional view. The perspective view of the right movement does not cut through; the right screen 29 in the right movement corresponding to the inside of the left movement and the image 6 displayed thereon, and the right optical lens 30 and the image 9 displayed by it are only in the right movement The labels are given for illustration.

In the left and right movements, 23 and 29 are left and right screens displaying images 3 and 6. When the left and right screens 23 and 29 obtain the video signals 11 and 12 provided by the left and right circuit boards 22 and 21, images 3 and 6 can be displayed respectively. The left and right optical lenses 24 and 30 can display the left and right images 3 and 6 in the direction of the arrows 27 and 28 of the left and right eyes of the person, showing virtual images 8 and 9, and the left and right reflective dustproof glass windows 26 and 31 are embedded in the left and right movements. Sealing shells 25 and 32.

In FIG. 9, the optical imaging system formed by the left and right screens 23 and 29 and the left and right optical lenses 24 and 30 may also be combined with other existing optical lenses (such as a convex mirror, a concave mirror, or a convex mirror and a concave mirror). A combination of optical lenses (mirrors) forms another type of optical imaging system with the same efficacy.

In the above-mentioned left and right movement structure, the left and right video signals 11 and 12 received are two independent, and there is a difference in viewing angle between each other. Overlapping the spatial virtual images 8 and 9 formed by the two video signals 11 and 12 with different viewing angles on the same space, that is, space 7 in FIG. 4 and FIG. 5, a stereo image 10 is formed. Specifically, The circuit on the plates 21 and 22 in the above left and right movements will be as shown in Fig. 7 In the A state arrangement, the video signals 11 and 12 recorded by the dual cameras 14 and 15 provided to the dual screens 23 and 29 are displayed through the optical lenses 24 and 30 to the spatial stereo image door 10 in FIGS. 4 and 5.

The glasses-type dual-screen display shown in FIG. 9 is a stereoscopic image display. Not only this, if the left and right plates 22 and 21 and the connection of the video signals 11 and 12 are set according to the two states of A and B of the changeover switch 16 of FIG. 7, the above-mentioned glasses-type dual-screen display, That is, a stereoscopic image can be displayed by the change-over switch 16, and a planar image can also be displayed by the change-over switch door 16.

Claims

Claim

1. A method for synthesizing spatial stereo images of virtual images, which is characterized by:

a. Using dual cameras to shoot scenes, generate left and right video signals;

2. The method for synthesizing a spatial stereo image of a virtual image according to claim 1, characterized in that the left and right video signals can be wired transmission or wireless transmission signals.

3. The method for synthesizing a spatial stereo image of a virtual image according to claim 1, wherein the video synchronization system is a recording or playback system, or a recording and playback system.

4. The method for synthesizing a spatial stereo image of a virtual image according to claim 1, wherein: before and after the recording system and the playback system, two sets of two pulse triggers are provided, and the set of two pulse triggers receives and restores video signals. The temporal pulse generator is connected to a pulse trigger.

5. The method of claim 1, wherein the left and right video signals can be simulated by digital technology.

6. A goggle-type stereoscopic television adopting the method of claim 1, characterized in that: a pair of optical lenses and a double screen are arranged on the glasses frame, and left and right movements are arranged behind the double screen, and the left and right movements are internally arranged. There is a circuit board that provides video signals to the dual screen. The left and right video signals provided to the screen are different. Two independent cameras filmed by the dual lens, and they have the same viewing angle formed by the difference in the viewing angle of the eyes of a person similar to a person signal.

7. The glasses-type stereo television according to claim 6, characterized in that the left and right video signals having a difference in viewing angle can be analogously formed by technologies such as digitization.

8. The glasses-type stereo television according to claim 6, wherein: the video signal can be connected to a changeover switch, and when the changeover switch is in a state, the left and right video signals have a difference in viewing angle and are two different video signals The monitor displays a stereo image; when the switch is in another state, there is no difference in viewing angle between the left and right video signal gates, which is the same video signal, and the monitor displays a flat surface. Image.

9. The glasses-type stereo television according to claim 8, characterized in that: the transfer switch can be provided between the dual camera and the left and right video signal generating unit, that is, the input end of the left and right video signals; and it can also be set on the left and right video signals Output.