WO2019143263A1

WO2019143263A1 - Television device for generating a stereoscopic image

Info

Publication number: WO2019143263A1
Application number: PCT/RU2018/000448
Authority: WO
Inventors: Александр Михайлович АЛЕКСАНДРОВ; Олег Владимирович УКРАИНСКИЙ
Original assignee: Общество с ограниченной ответственностью "Авиаинформатика"
Priority date: 2018-01-16
Filing date: 2018-07-09
Publication date: 2019-07-25
Also published as: RU2691884C1

Abstract

The invention relates to systems for generating and presenting stereoscopic images. A television device comprises: two television cameras, a transmission channel, a display device, a commutator, light-commutating 3D glasses which can alternately display and sense the two images of a stereoscopic pair, a device for equalizing image scales, a synchronization signal selector, and an operating mode switch, wherein the television cameras have different viewing angles – the first being narrow-angled, the second wide-angled - and have an inbuilt synchronization pulse generator, wherein an output of the narrow-angled camera is connected to an input of the synchronization signal selector, an output of which is connected to a control input of the commutator, to a synchronizing input of the device for equalizing image scales and to a synchronizing input of the light-commutating 3D glasses, wherein an output of the commutator is connected to an input of the display device, wherein the television device is equipped with an operating mode switch.

Description

Television device for stereoscopic imaging

The technical field The invention relates to systems for the formation and presentation of stereoscopic images and is intended for remote visual examination of objects, for example, underwater marine objects, access to which is difficult. Prior art

Known television devices for the formation of stereoscopic images, which are used to receive on the receiving side stereo two identical channel transmission of two images, see Shmakov P.V. Stereo-television installation of walking excavator // Stereo-television - M., “Svyaz”, 1968. - p. 193. The advantages of using stereo-television devices for displaying visual information are as follows, see. G. Mamchev. Stereo-television - M, "Energy", 1979. - P.66:

1. For the operator, a fundamentally new opportunity appears to evaluate the relative position of individual parts in a three-dimensional physical space, i.e., to exercise control over all three coordinates.

2. With stereoscopic perception, the latent period, i.e., the response time of the operator is 1.1–1.2 times shorter compared to the perception of two-dimensional images and is about 0.17 seconds, see Boyko E.I. Human reaction time - M.

"Medicine", 1964 - P.440.

3. When transmitting a three-dimensional image, instead of two-dimensional, the accuracy of estimating the absolute distance of the observed details, compared with the perception of two-dimensional images, is 3 times higher, see V. Baranovsky. To the question of assessing changes in absolute distance // Problems of physiological optics - M., 1958, V. 12, p. 239-245.

4. The speed and reliability of recognition objects is increased.

5. Increased visibility of perceived images.

6. When playing on the effect of looking around in stereo-television systems, the sharpness of observers' deep vision increases approximately 1.5 times, see. EM Belostotsky. Deep vision when moving the head // Problems of physiological optics.— M .: 1953, vol. 8, p. 341— 345. However, the disadvantage of such devices is the difficulty of changing the viewing angle of the observed object and, accordingly, the scale of the stereoscopic image in the case when the operator has a need to consider in more detail a specific fragment of the observed scene or its individual elements. This disadvantage is due to the fact that in order to preserve the stereo effect when viewing various objects, it is necessary to maintain complex mechanical means at the same time to fulfill the focusing conditions of the lenses on the subject in question and the conditions of convergence of the optical axes of television cameras in the area where the subject is located.

This disadvantage is eliminated by devices designed for stereoscopic viewing of images and providing a certain mechanical setting, for example, changing the scale and other parameters of the observed image when changing the conditions of observation, see, for example, RU2128354C1, publ. 03/27/1999. In the specified device, the process of imaging a stereo pair is carried out due to a complex mechanical design that simultaneously changes the angle of convergence of the axes of stereoscopic images and changes the viewing distance by additional focusing. In this case, the tightening of the mechanical requirements for the optical scheme of shooting a stereo image complicates and increases the cost of the device, and also makes it almost impossible to apply stereo photography methods in hard-to-reach places, for example, under water, where It is extremely difficult to ensure the availability of mechanical means to maintain the required parameters of the optical scheme of a stereo photograph when there is an operational need to change the area of observation.

Another disadvantage of stereo-television devices for displaying visual information is certain information redundancy, due to the fact that the observer perceives all the elements of the image in a television frame in stereoscopic form, while the object of observation, as a rule, is only an object located in the central honor of the frame, and it is this object that should be observed with the presence of the stereoscopic effect.

Known television device for the formation of stereoscopic images, see Mamchev G.V. Stereo-television - M., "Energy", 1979 - 66 C, p. 21 fig. 13, FIG. 4 - 6. The device contains two transmitting television cameras and a switch of reproduced signals in order to ensure that both images of the stereo pair are switched on the screen of the reproducing device and are switched along the television fields, performing this switching in synchronization with the operation of the light-switching glasses. From the description of the device given in the indicated source, as well as from the physics of the work of such stereoscopic television systems, it follows that the device described above has disadvantages:

- the need to have on the transmitting side two identical television cameras and, therefore, to reproduce on the receiving side in stereoscopic form all points of a television frame, which, as a rule, is not always necessary;

- the relative complexity of the design of the transmitting part, which is inconvenient, for example, for underwater video surveillance systems.

At the same time, a number of facts are known from the theory of stereoscopic vision, which make it possible to significantly simplify the scheme of stereo photography and at the same time preserve the quality of the stereoscopic image at the required level. Stereoscopic television devices assume reproduction on the receiving side of both images of the stereopair of the observed object, while the identity of the images of the stereo pair is considered as a condition for the undistorted transmission of spatial correlations and compliance with the physiological requirements of the operator’s view. However, when viewing objects extended in space, the object in question is, as a rule, placed in the central part of a television frame; therefore, it is necessary to ensure the greatest detail of the transmitted television image in the central part of the television frame.

In addition, from the theory of stereoscopic vision, see N. Valus. Stereoscopy - M., Ed. The Academy of Sciences of the USSR, 1962, 380 S., P.219, is a fact that when looking at a stereoscopic image formed by two stereo pairs with different clarity, the clarity of the perceived image is determined by the clarity of the best image. The same fact is confirmed by other researchers, see Jaconius V.E. Experimental installation of color surround television // Radio - 1960, - N ° 4.

DISCLOSURE OF INVENTION

Thus, the present invention faces the challenge of expanding the capabilities of a television device by allowing two modes of operation:

- reproduction of the usual two-dimensional television image with a wide angle of view of the lens of the transmitting camera,

reproduction of a stereoscopic television image formed from two stereopair images received from both transmitting television cameras by aligning the scale of the images transmitted by them.

The problem is solved due to the fact that a television device for forming a stereoscopic image containing two television cameras, each of which is configured to generate one of the image signals of a stereo pair, a transmission channel, a playback device, a switch and light-switching stereo glasses made with the possibility of alternate playback and perception of both images of a stereo pair, with the output of each camera through the corresponding transmission channel and the corresponding input the switch is connected to the input of the playback device, and the switch is configured to alternately transmit stereopair signals to the playback device synchronously with According to the invention, the television device is equipped with an image scale equalizer, TV cameras have different viewing angles — the first is narrow-angle, the second is wide-angle, and each camera is equipped with a built-in sync generator, while the output of the narrow-angle camera is directly connected to the first input of the switch, and the output of the wide-angle camera is connected to the second input of the switch through an image scaler, and the output is narrow-angle The camera is connected to the input of the synchronization signal selector, the output of which is connected to the control input of the switch, the synchronization input of the image scale equalization device and the synchronization input of the light-switching stereo glasses, the output of the switch is connected to the input of the playback device, and the television device is equipped with an operation mode switch, the first the input of which is connected to the output of the switch, the second input is connected to the output of the wide-angle camera, and the output is connected to the input of the mouth oystva playback. An image scale alignment device may comprise an image forming device for a central part of a television frame, an interpolator and a synchronizer, the synchronization input of which is connected to the output of the synchronization signal selector.

The applicant has not identified any technical solutions that are identical to the stated one, which allows to conclude according to the invention to the condition of patentability "Novelty"("N").

The applicant has not identified sources of information that would contain information about the effect of the distinctive features of the invention on the technical result achieved. These circumstances allow us to conclude that the claimed technical solution complies with the condition of patentability “Inventive step” (“IS”). Brief Description of the Drawings

The invention is further explained in the detailed description of examples of its implementation with reference to the drawings, on which:

- figure 1 - structural diagram of a television device for the formation of a stereoscopic image;

- figure 2 - the principle of obtaining an image of the object.

The best embodiment of the invention

The transmitting part of the television device contains two television cameras having different viewing angles - narrow-angle television camera 1 and wide-angle television camera 2 oriented in the direction of the transmission object 3, channel 4 for transmitting television signals 5 and 6 from the narrow-angle and wide-angle television cameras to the receiving part television device. Both television cameras 1 and 2 are designed to generate one of the image signals of the stereo pair, each camera 1 and 2 are made with a built-in clock generator.

The receiving part of the television device contains a playback device 7, light-switching stereo glasses 8, a synchronization signal selector 9, an image scale equalization device 10, as well as a switch 1 1 and an operation mode switch 12. The light-coupling stereo glasses 8 are made with the possibility of alternately playing and perceiving both images of a stereo pair.

The output of each camera 1 and 2 through the corresponding transmission channel and the corresponding input of the switch 11 is connected to the input of the playback device 7, and the switch 11 is configured to alternately transmit signals 5 and 6 of the stereo pair to the playback device 7 synchronously with the operation of the light-switching stereo glasses 8. Output of the narrow-angle camera 1 connected to the first input of the switch 1 1 directly, and the output of the wide-angle camera 2 is connected with the second input of the switch 11 through the device 10 scaler images. The output of the switch 11 through the switch 12 of the operating mode is connected to the input of the device 7 playback.

The output of the narrow-angle camera 1 is also connected to the input of the synchronization signal selector 9, the output of which is connected to the control input of the switch 1 1, to the synchronizing input of the image scale equalizer 10 and to the synchronizing input of the light-switching stereo glasses 8. The first input of the operation mode switch 12 is connected to the output of the switch 1 1, the second input is connected directly to the output of the wide-angle camera 2, and the output is connected to the input of the playback device 7.

The device 10 of the scale of images contains the device 13 forming the image of the Central part of the television frame, the interpolator 14 and the synchronizer, the synchronization input of which is connected to the output of the selector 9 of the synchronization signals. The synchronizer is a matrix memory device 15 per television frame. The device 13 imaging the central part of the television frame is designed to write the television frame into the matrix memory device 15 in full format, while the output of the matrix memory device 15 reads only the central part of the television frame during synchronization from the television signal of the narrow-angle television camera 1. The size of the central part TV frame, expressed by the number of picture elements, differs from the size of the full TV frame proportion tional relation angles two transmit television cameras 1 and 2 (Fig. 2, pos. 17).

The device 10 of the scale of images also contains an interpolator 14 for increasing by interpolating the number of picture elements of the central part of a television frame to the number of elements of a full television frame. The device 10 scale equalization of images known in television technology as digital switcher and tool for creating special effects, see M. Krivosheev. Digital television. Krivosheev M.I., Vilenchik L.S. and others - M. 1980 - 264 s, p. 134 fig. 6.6, FIG. 7 - 9.

The switch 11 and the light-coupling stereo glasses 8 are used for switching television image signals across the fields and are synchronized by the television synchronization signals from the narrow-angle television camera 1. The operation mode switch 12 is designed to control the operator via control input 16 and serves to switch the operating modes of the television device in the left switching off the stereoscopic display mode and translating the operation of the playback device 7 into the monoscopic playback mode of the viewing signal from the wideband television camera 2. The light-switching points 8 are not used in this monoscopic mode, and the observer perceives the usual two-dimensional image, but with a wide viewing angle of the observed object defined by the wide-angle television camera 2.

A television device for forming a stereoscopic image works as follows.

Television cameras 1 and 2 capture the image of the observed object from two positions corresponding to the selected left and right positions of the stereo and are oriented in such a way that the optical axes of their lenses intersect at a point located as close as possible to the observed object. Signal 5 image from narrow-angle the television camera 1 and the signal 6 from the wide-angle television camera 2 are transmitted via channel 4 to the receiving part of the device.

In the receiving part of the device, the image signal 6 from the wide-angle television camera 2 (FIG. 2 pos. 19) enters the imaging device 13 of the central part of the television frame of the image scale equalizer 10; the device 13 forming the image of the central part of the television frame is recorded in the matrix memory device 15 on the television frame in full format, and is read at its output only as the central part of the television frame (Fig. 3 pos. 18). The size of the central part of the television frame, expressed by the number of picture elements, differs from the size of the full television frame in proportion to the ratio of the viewing angles of the narrow-angle and wide-angle transmitting television cameras 1 and 2. The image signal of the central part of the television frame containing a smaller number of picture elements than the full television frame enters to interpolator 14, which converts image formats and brings the image of the central part of the frame to the forms Ata of the full TV frame, restoring by the interpolation the values of the missing elements of the image and thus increasing the size of the central part of the frame to the size of the full frame (Fig. 2 pos. 18). The image of the central part of the frame thus obtained is recorded in the matrix memory device 15 on a television frame intended for sync signals from both television cameras. Synchronization is achieved due to the fact that the reading of the image recorded in the memory of the matrix device 15 of the memory on a television frame occurs under the control of synchronization signals from a narrow-angle television camera 1, selected from its signal by the selector 9 of television synchronization signals. As a result, at the output of the matrix memory device 15 to a television frame, an image signal is generated corresponding to the central part of the image from wide-angle television camera 2, which thus can be used as one of the stereo pair images, in which the second image is from narrow-angle television camera 1 The image signals of the specified stereo pair are thus synchronized with each other and are fed to the inputs of the switch 11 controlled by the synchronization signal, conductive with a frequency of television fields from the selector 9 television synchronizing signals. The same signal controls the operation of the light-mutated stereo glasses 8, which allow the observer's eyes (left and right alternately) to observe the stereoscopic image on the screen of the playback device 7. The receiving part of the device also contains a switch 12 of operation mode, designed to switch the operating modes of the playback device 7 and, thereby, to change the character of the image on its screen. When installed by the operator through the input 16 of the switch 12 of the operation mode in the left-hand position, the reproducing device 7 It works in the usual non-stereoscopic mode and allows you to observe a normal monoscopic (two-dimensional) full-format television image from a wide-angle television camera 2. When the operating mode switch 12 is set in the right position, the reproducing device 7 operates in stereoscopic mode, both stereo pairs from transmitting television cameras are displayed alternately 1 and 2 with the same scale of both images, with their switching and alternation on the screen with the frequency of television fields 50 Hz (when using a standard television signal).

The principle of obtaining an image of an object is shown in FIG.

- pos. 17 explains the conventional arrangement of the observation zones of narrow-angle and wide-angle television cameras 1 and 2;

- pos. 18 shows the location of the object of observation in the frame of the narrow-angle television camera 1. The image from the wide-angle television camera 2 after the processing in the imaging device 13 of the central part of the television frame and at the input of the interpolator 14 looks the same scale. At the output of the interpolator 14, the image looks the same , but consists of a larger number of elements, enlarged to the format of a full television frame by interpolation;

- pos. 19 shows the location of the object of observation in the frame of a wide-angle television camera 2.

As follows from the block diagram of the receiving part of the device (figure 1), the information characteristics of the observed images, conventional and stereoscopic, are determined solely by the properties of the signal from television cameras 1 and 2 and the features of stereoscopic vision. Thus, in the stereoscopic mode of the television device (the right position of the switch 12 modes of operation according to the scheme), the stereo pair image formats are the same, and the detail of the perceived stereoscopic object is determined by the detail of the image with the highest definition, namely determined by the clarity of the image from the narrow-angle television camera 1. This circumstance corresponds to the property of vision indicated above, which allows to perceive a stereoscopic image when observing stereo pairs with non-identical characteristics of images in such a way that the quality of the observed stereo image is determined by the quality of the best stereo pair of both images.

This device provides a technical result consisting in expanding the capabilities of a television device by providing the possibility of two modes of operation: reproduction of a conventional two-dimensional television image at a wide viewing angle of a transmitting camera lens, as well as reproduction of a stereoscopic television image formed from two stereopair images received from both transmitting television cameras by aligning the scale of their images. Industrial Applicability

To implement the invention, well-known materials and equipment are used, which determines, in the opinion of the applicant, the compliance of the claimed invention with the Industrial Applicability (“IA”) patentability condition.

Claims

Claim

1. A television device for forming a stereoscopic image containing two television cameras, each of which is configured to generate one of the stereo image signals, a transmission channel, a playback device, a switch and light-switching stereo glasses made with the possibility of alternate playback and perception of both stereo pairs, the output of each camera through the corresponding transmission channel and the corresponding input of the switch is connected to the input of the device The works and the switch are designed to alternately transmit stereopair signals to the playback device synchronously with the operation of the light-switching stereo glasses, characterized in that the television device is equipped with an image scale equalization device, and the television cameras have different viewing angles — the first narrow-angle, the second wide-angle, and each the camera is made with a built-in clock generator, while the output of the narrow-angle camera is connected to the first input of the switch directly, and the output the wide-angle camera is connected to the second input of the switch through an image scaler, the output of the narrow-angle camera is connected to the input of the synchronization signal selector, the output of which is connected to the switch control input, to the sync input of the image scale equalizer and to the synchronizing the input of the light-coupling stereo glasses, while the switch output is connected to the input of the playback device, the television device is equipped with an operation mode switch, the first input of which is connected to the switch output, the second input is connected to the wide-angle camera output, and the output is connected to the playback device input.

2. The television device according to claim 1, that is, that the scaler of the images contains an imaging device for the center of the television frame, an interpolator and a synchronizer, the synchronization input of which is connected to the output of the synchronization signal selector .