RU2730177C1 - Television system with selective image scaling (versions) - Google Patents

Abstract

FIELD: television technology.SUBSTANCE: invention relates to television engineering and can be mainly used in surveillance systems. Result is achieved by using CMOS photodetector arrays as sensors of a television camera, setting the target ratio of gain factors of light-sensitive elements for their targets. To compensate optical loss of light splitting, value of amplification factor of first sensor of television signal in β times exceeds value of amplification factor of second sensor of television signal, where coefficient value β is calculated by formula:where D/ƒ is relative hole of television camera additional lens (beam splitter lens); τis beam splitter lens transmission coefficient; τis coefficient of transmission of collective lens of beam splitter.EFFECT: technical result is reduction of loss in image resolution in time.3 cl, 7 dwg, 3 tbl

Description

The proposed group of inventions relates to television technology and can mainly be used in observation systems, which are made using matrix photodetectors manufactured by the technology of complementary structures "metal-oxide-semiconductor" (CMOS) and computers. In such a system, a combined image is reproduced on a computer monitor screen, which, in relation to the initially presented image, consists of an enlarged area and the rest with a constant scale.

The closest in technical essence to the claimed inventions, both in option 1 and in option 2, should be considered a television system with selective image scaling [1], which contains on the transmitting side a television camera (TV camera), consisting of sequentially located and optically connected input lens, beam splitter, two television signal sensors (TTS) made using the technology of charge-coupled matrix devices (CCD matrices), as well as a guidance unit, a sync pulse selector, a fixed delay unit (BFZ), an adjustable delay unit (BRZ), a signal shaper synchronization and frame signal shaper, while the beam splitter of the TV camera contains sequentially located and optically coupled semitransparent mirror, a collective lens, a reflecting mirror and an additional lens, the input of the beamsplitter is optically connected to the input of the semitransparent mirror, the first output of the beam splitter - with the output of the additional lens a, and the second output - with the second output of the semitransparent mirror, and the first output of the beam splitter is the "output of the normal optical image" (general view image) and is optically connected to the phototarget of the first sensor of the television signal (first TTS), and the second output of the beam splitter is the "output of the enlarged optical image "(image of the enlarged fragment) and is optically connected with the photo target of the second TTS; a guidance unit designed to carry out the spatial positioning of the second TTS, and consisting of a first drive, kinematically connected with the first position sensor, and a second drive, kinematically connected with the second position sensor, while the output of the first position sensor is the first output of the guidance unit, and the output of the second position sensor - the second output of the guidance unit; the first TTS of the TV camera is made on the basis of the CCD matrix with the organization of "line-frame transfer", and the second TTS is based on the CCD matrix with the organization of the "line transfer", while in the memory section of the CCD matrix of the first DTS, the summation of the charge packets formed in the photo-receiving section is provided ; the horizontal synchronization input of the frame signal generator is combined with the first input of the BFZ and connected to the first output of the sync pulse selector, and the frame synchronization input of the frame signal generator is combined with the second input of the BFZ and connected to the second output of the sync pulse selector, the input of which is connected to the "video" output of the first DTS, the "synchro" input of the second DTS is connected to the output of the synchronization signal generator, the first and second inputs of which are connected respectively to the first and second outputs of the BRZ, the first information input of which is connected to the first output of the BFZ, and the second information input of BR3 to the second output of the BFZ, the first control the BRZ input is combined with the first control input of the frame signal shaper and is connected to the first output of the guidance unit, the second output of which is connected to the second control input of the BRZ and, accordingly, to the second control input of the frame signal shaper, and the output of the first TTS is the "video 1" output of the TV camera, the output second diesel fuel With - the output of "video 2" of the TV camera, and the output of the frame signal generator - the output of the "frame" of the TV camera, on the receiving side of the television system there is a personal computer, and between the TV camera and the computer there is a communication line of a multicore cable, two of which connect the signal output for pointing commands "Right / Left" and "Up / Down" on the computer with the inputs of these signals in the camera, and three other conductors of the communication line cable connect the outputs of the signals "video 1", "video 2" and "frame" of the TV camera with the corresponding inputs on the computer; a video card is installed in the expansion connector on the computer motherboard, matched in input / output channels, control and power supply with the computer bus and is designed to convert the first and second input analog video signals into digital form while organizing the synchronization of each of them separately according to the input synchronization signal of the receiver ( SSP), input of digital video signal "video 1" into RAM with a period of nТ _к and output from it with a period of Т _к , where Т _к is the frame duration, n is the number of summed frames, input / output of digital video signal "video 2" with a period T _k , mixing the output digital video signal "video 1" with the signal "frame", generating the signal "window" according to the signal "frame" and performing switching of the video signals "video 1" and "video 2" on the signal "window", and the output of the video signal video card is the output of the image signal of the television system.

Note that in the memory section of the first TTP of the prototype TV camera [1], the summation of n charge packets (for each accumulated frame) is implemented, which provides compensation for the optical losses of the beam splitter, which cause a β-fold decrease in the illumination at its first output relative to the illumination at its second output ...

Let's designate the main parameters for the optical elements of the beam splitter and calculate the resulting optical losses.

So, we have the following indicators:

D / ƒ - relative aperture of the additional camera lens (beam splitter lens);

τ ₁ - transmission coefficient of the beam splitter lens;

τ ₂ is the transmission coefficient of the collective lens of the beam splitter.

Then the value of the optical loss coefficient of the beam splitter β, measured in the prototype [1] as the ratio of the scene illumination at its second output to the illumination at its first output, can be determined by the formula:

In practice, the value of the coefficient β can reach a value of the same order of magnitude (10 times).

However, it must be admitted that the method adopted in the prototype [1] for compensating for optical losses in the beam splitting limits its use in the TV camera of the system by observing only static and sedentary objects, since When controlling dynamic scenes for the photodetector of the first TTS, losses in the image resolution over time inevitably occur.

It should be noted here that the term "time resolution", like the term "field resolution", was proposed by the creator of electron beam television V.K. Zvorykin more than half a century ago. His idea that only taking into account the final values of the resolution in the field of the frame and in time make electronic television realizable was reproduced in the well-known monograph of domestic specialists from the Research Institute of Television [2, p. 34].

This postulate of Zvorykin can be illustrated by the example of a prototype [1]. If, a priori, the time of moving the object over the frame field is less than the total accumulation time of the photodetector in the camera, then specific distortions inevitably appear in its output video signal, which are estimated as losses in the clarity of the television image, i.e. as the loss of the time resolution parameter.

And these losses are the greater, the more dynamic (mobile) the control object itself is.

The objective of the invention is to reduce the loss in the time resolution of the first TTS by using CMOS photodetector matrices as its sensor, as well as the sensor of the second TTS, by setting the required ratio of the gains of the light-sensitive elements for their targets.

The problem is solved by the fact that in the claimed television system according to option 1, which contains a television camera on the transmitting side, consisting of sequentially located and optically connected input lens, a beam splitter, two DTS, a guidance unit, a sync pulse selector, BFZ, BRZ, a synchronization signal generator and a frame signal shaper, while the beam splitter of the TV camera contains sequentially located and optically coupled semitransparent mirror, a collective lens, a reflecting mirror and an additional lens, the input of the beam splitter is optically connected to the input of the semitransparent mirror, the first output of the beam splitter is connected to the output of the additional the output of the semitransparent mirror, where the first output of the beam splitter is the "output of the normal optical image" and is optically connected to the phototarget of the first TTS, and the second output of the beam splitter is the "output of the enlarged optical image" and is optically connected to the photo new second TPA; a guidance unit designed to carry out the spatial positioning of the second TTS, and consisting of a first drive, kinematically connected with the first position sensor, and a second drive, kinematically connected with the second position sensor, while the output of the first position sensor is the first output of the guidance unit, and the output of the second position sensor - the second output of the guidance unit; the horizontal synchronization input of the frame signal generator is combined with the first input of the BFZ and connected to the first output of the sync pulse selector, and the frame synchronization input of the frame signal generator is combined with the second input of the BFZ and connected to the second output of the sync pulse selector, the input of which is connected to the "video" output of the first DTS, the "synchro" input of the second DTS is connected to the output of the synchronization signal generator, the first and second inputs of which are connected respectively to the first and second outputs of the BRZ, the first information input of which is connected to the first output of the BFZ, and the second information input of the BR3 to the second output of the BFZ, the first control the BRZ input is combined with the first control input of the frame signal shaper and is connected to the first output of the guidance unit, the second output of which is connected to the second control input of the BRZ and, accordingly, to the second control input of the frame signal shaper, and the output of the first TTS is the "video 1" output of the TV camera, the output second DTS - the output of the "video 2" of the TV camera, and the output of the frame signal generator - the output of the "frame" of the TV camera, on the receiving side of the TV system there is a personal computer, and between the TV camera and the computer there is a communication line of a multicore cable, two of which connect the signal output for pointing commands "Right / Left" and "Up / Down" on the computer with the inputs of these signals in the camera, and three other conductors of the communication line cable connect the outputs of the signals "video 1", "video 2" and "frame" of the TV camera with the corresponding inputs on the computer; a video card is installed in the expansion connector on the computer motherboard, matched in input / output channels, control and power supply with the computer bus and is designed to convert the first and second input analog video signals ("video 1" and "video 2", respectively) into digital form when organization of synchronization of each of them separately for the input SSP, input / output of digital video signals "video 1" and "video 2" into the computer's RAM; mixing the output digital video signal "video 1" with the signal "frame", generating the signal "window" according to the signal "frame" and switching the video signals "video 1" and "video 2" on the signal "window", and the video output of the video card is the output of the image signal of the television system, while in comparison with the prototype [1], in the television camera of the system, the first and second TTS, respectively, are made according to [2, p. 64, Fig. 1.18] on a sensor crystal made using CMOS technology by implementing the "coordinate addressing" method, and the sensor target consists of photodiode active pixels, each of which has a gain K ₁ , and a transistor MOS switch that provides the transmission of the active pixel video signal to video bus, which combines all active pixels of the target into active columns, each of which additionally has a video signal amplifier with a gain K ₂ , and the control of MOS keys of active pixels located horizontally is carried out using a separately taken horizontal (line) bus, total the number of which determines the number of lines in the sensor, and the number of video buses - the number of elements (pixels) in each line of the sensor; at the same time, on the common crystal of the photodetector, its electronic "framing" is placed - the blocks that perform the scanning and formation of the output voltage of the video signal, namely: the vertical (vertical) scan register, which selects the line; key MOS transistors for each active column, ensuring the transmission of the video signal at the output of its amplifier to the corresponding input of the horizontal (line) multiplexer, which connects the video signal from each active pixel to the input of the output amplifier with a gain of K ₃ , while in the active pixels of the target sensors with a frame period accumulate charge packets of the current frame and simultaneously read the video information of the previous frame sequentially one after the other for each pixel of a single target line and consecutive line by line for the target as a whole, forming the voltage of the sensor video output signal at the output of the photodetector in analog form, and to compensate for optical losses in the beam splitting, the value of the gain K _{1 of the} first TTS is β times greater than the value of the gain K _{1 of the} second TTS, where the value of the coefficient β is calculated by formula (1).

The task is also solved by the fact that in the claimed television system according to option 2, which contains a television camera on the transmitting side, consisting of sequentially located and optically connected input lens, a beam splitter, two DTS, a guidance unit, a sync pulse selector, BFZ, BRZ, a synchronization signal generator and a frame signal shaper, while the beam splitter of the TV camera contains sequentially located and optically coupled semitransparent mirror, a collective lens, a reflecting mirror and an additional lens, the input of the beam splitter is optically connected to the input of the semitransparent mirror, the first output of the beam splitter is connected to the output of the additional lens, and the second output is the second output of the semitransparent mirror, where the first output of the beam splitter is the "output of the normal optical image" and is optically connected to the phototarget of the first TTS, and the second output of the beam splitter is the "output of the enlarged optical image" and is optically connected to the photo the second TPA; a guidance unit designed to carry out the spatial positioning of the second TTS, and consisting of a first drive, kinematically connected with the first position sensor, and a second drive, kinematically connected with the second position sensor, while the output of the first position sensor is the first output of the guidance unit, and the output of the second position sensor - the second output of the guidance unit; the horizontal synchronization input of the frame signal generator is combined with the first input of the BFZ and connected to the first output of the sync pulse selector, and the frame synchronization input of the frame signal generator is combined with the second input of the BFZ and connected to the second output of the sync pulse selector, the input of which is connected to the "video" output of the first DTS, the "synchro" input of the second DTS is connected to the output of the synchronization signal generator, the first and second inputs of which are connected respectively to the first and second outputs of the BRZ, the first information input of which is connected to the first output of the BFZ, and the second information input of the BRZ to the second output of the BFZ, the first control the BRZ input is combined with the first control input of the frame signal shaper and is connected to the first output of the guidance unit, the second output of which is connected to the second control input of the BRZ and, accordingly, to the second control input of the frame signal shaper, and the output of the first TTS is the "video 1" output of the TV camera, the output second diesel fuel With - the output of "video 2" of the TV camera, and the output of the frame signal generator - the output of the "frame" of the TV camera, on the receiving side of the television system there is a personal computer, and between the TV camera and the computer there is a communication line of a multicore cable, two of which connect the signal output for pointing commands "Right / Left" and "Up / Down" on the computer with the inputs of these signals in the camera, and the three other cores of the communication line cable connect the outputs of the signals "video 1", "video 2" and "frame" of the TV camera with the corresponding inputs on the computer; a video card is installed in the expansion slot on the computer motherboard, which is coordinated in input / output channels, control and power supply with the computer bus and is intended for input / output of the first and second input digital video signals ("video 1" and "video 2" into the computer's RAM) respectively); mixing the output digital video signal "video 1" with the signal "frame", generating the signal "window" according to the signal "frame" and switching the video signals "video 1" and "video 2" on the signal "window", and the video output of the video card is the output of the image signal of the television system, while in comparison with the prototype [1], in the television camera of the system, the first and second TTS, respectively, are made according to [2, p. 67, Fig. 1.21] on a CMOS sensor crystal by implementing the "coordinate addressing" method, and the sensor target consists of photodiode active pixels, each of which has an amplifier with a gain K and a built-in analog-to-digital converter (ADC) that provides video signal transmission active pixel to the vertical video bus, which combines all active target pixels into vertical columns, and the ADC control for pixels located along each row is carried out using a separate line bus, the total number of which determines the number of lines in the sensor, and the number of vertical video buses - the number of pixels in each line of the sensor, while on the common crystal of the photodetector there are also blocks that perform scanning and formation of the output voltage of the digital video signal, namely: the vertical scan register, which selects the line; video signal switches for each column, controlled from the corresponding output of the line scan multiplexer, and providing the transmission of the video signal at the output of each video column bus to the video line bus, the output of which is the “Video” output of the photodetector, while the active pixels of the sensor target with a frame period are accumulated charge packets of the current frame and at the same time reading the video information of the previous frame sequentially one after the other for each pixel of a single line of the target and sequential line by line for the target as a whole, forming the voltage of the output video signal of the sensor at the output of the photodetector in digital form, and to compensate for the optical losses of the beam splitting value the gain K of the active pixel of the first TPS is β times greater than the value of the gain K of the active pixel of the second TPS, where the value of the β coefficient is calculated by formula (1).

Comparative analysis shows that both versions of the claimed television system differ from the prototype [1] by the implementation of matrix devices manufactured using single-chip CMOS technology as photodetectors of the first and second TTS of the television camera. But, if for the first variant the CMOS matrix forms an analog video signal at the output, then for the second variant each pixel of the target is active, since it has a built-in ADC of the image signal, thanks to which the video signal at the output is already digital.

The combination of known and new features is not known from the prior art, therefore the proposed solution meets the requirement of novelty.

In the claimed solution, in comparison with the prototype [1], the video signal of the TV camera, which forms a general image, has an undeniable gain in signal-to-noise ratio for dynamic control plots by reducing the loss in image resolution over time.

In terms of the technical result and methods of achieving it, the claimed solution meets the requirement for an inventive step.

FIG. 1 shows a block diagram of the claimed television system with selective image scaling, which is a generalization, i.e. it applies to both versions of the system; in fig. 2a - schematic organization of the television camera photodetectors for the first version of the television system; in fig. 2b - schematic organization of the television camera photodetectors for the second version of the television system; in fig. 3 is a possible electrical diagram of the implementation of the guidance unit as part of a television camera: FIG. 4 shows the relative position of the rasters of the first and second TTS of the television camera, depending on the magnitude of the sync signal delays along the line and frame; in fig. 5 presents, as possible examples, images generated by the proposed television system; in fig. 6 shows the images of the electronic frame against the background of the general view in the process of adjusting the TV camera.

A television system with selective image scaling (see Fig. 1) contains on the transmitting side a television camera in position 1, consisting of sequentially located and optically connected input lens 1-1, a beam splitter 1-2 and two DTS 1-3 and 1-4, moreover, the beam splitter contains sequentially located and optically coupled semitransparent mirror 1-2-1, collective lens 1-2-2, reflecting mirror 1-2-3 and additional lens 1-2-4, and the input of the beam splitter is optically connected to the input of the semitransparent mirror 1 -2-1, the first output of the beam splitter is with the output of the lens 1-2-4, and the second output of the beam splitter is with the second output of the semitransparent mirror 1-2-1, while the first output of the beam splitter 1-2 of the TV camera is the output of the general view and optically connected with the phototarget of the first DTS 1-3, and the second output of the beam splitter 1-2 - with the output of the image of the enlarged fragment and is optically connected with the photo target of the second DTS 1-4; the TV camera also includes a guidance unit 1-5, a sync pulse selector 1-6, BFZ 1-7, BRZ 1-8, a synchronization signal shaper 1-9 and a frame signal shaper 1-10, and a guidance unit designed for spatial positioning ДТС 1-4 and consisting of the first electric drive 1-5-1 (electric drive horizontally), kinematically connected with the first position sensor 1-5-2, and the second electric drive 1-5-3 (electric drive vertically), kinematically connected with the second position sensor 1-5-4, while the output of the first position sensor is the first output of the guidance unit, and the output of the second position sensor is the second output of the guidance unit, the output of DTS 1-3 is connected to the input of the selector 1-6 sync pulses, the input of horizontal synchronization of the shaper 1 -10 of the frame signal is combined with the first input of BFZ 1-7 and connected to the first output of the selector 1-6 sync pulses, and the frame sync input of the frame signal shaper 1-10 is combined with the second input of BFZ 1 -7 and connected to the second output of the selector 1-6 sync pulses, the input of which is connected to the "video" output of the first DTS 1-3, the "synchro" input of the second DTS 1-4 is connected to the output of the synchronization signal shaper 1-9, the first and second inputs which are connected respectively to the first and second outputs of BRZ 1-8, the first information input of which is connected to the first output of BFZ 1-7, and the second information input of BRZ 1-8 to the second output of BFZ 1-7, the first control input of BRZ 1-8 combined with the first control input of the frame signal shaper 1-10 and connected to the first output of the guidance unit 1-5, the second output of which is connected to the second control input of the BRZ 1-8 and, accordingly, to the second control input of the frame signal shaper 1-10, and the output of the first DTS 1-3 is the output of "video 1" of the TV camera, the output of the second DTS 1-4 is the output of "video 2" of the TV camera, and the output of the frame signal shaper 1-10 is the output of the "frame" of the TV camera; on the receiving side of the television system there is a computer in position 3, and a video card is installed in the expansion slot on the motherboard of the computer, and a communication line in position 2 is laid between the receiving and transmitting sides, consisting of five cable cores and providing connection of the outputs of the "video 1" signals , “Video 2” and “frame” of the TV camera with the corresponding inputs on the computer, as well as signal outputs for the guidance commands “Right / Left” and “Up / Down” on the computer with the inputs of these signals to electric drives 1-5-1 and 1- 5-3 on the TV camera, respectively.

The schematic organization of the photodetector for the first and second TTS of the television camera when implementing the first version of the television system is shown in Fig. 2a.

The sensor is made using CMOS technology and contains on a common crystal a photoreceiving area (target) at position 4, a vertical scan register at position 5 and a horizontal scan multiplexer at position 6.

Each active target pixel, see FIG. 2a, includes a photosensitive area (area) 4-1, an amplifier 4-2 with a gain K ₁ and a MOS switch (a key MOS transistor in position 4-3.

The control of the key MOS transistor 4-3 pixels for each line of the photodetector is carried out using a separate (own) line bus 4-4, which transmits a control signal from the corresponding output of the frame scan register 5.

The video signal from the output of each key MOS transistor 4-3 for each active pixel of an individual taken active column is transmitted to the video bus 4-5, and then to the input of the amplifier column 4-6 with a gain of K ₂ . Further, from the output of the amplifier 4-6 using a key MOS transistor 4-7, controlled from one of the outputs of the multiplexer 6, the video signal is transmitted to the input of the output amplifier 4-8 with a gain of K ₃ to obtain the required level of the analog video signal of the current pixel of this active column at the sensor output.

Note that the output amplifier 4-8 is not a member of this separate active column, but is a common element for all active columns of the device.

The same formation of the video signal occurs within the other active columns of the target 4 of this sensor.

As a result, at the output of the amplifier 4-8 in a rectangular raster, one after the other for each pixel of a separate line and sequentially line by line for the target as a whole, the voltage of the output video signal of the photodetector is formed in analog form.

Thanks to the CMOS technology adopted for the manufacture of the sensor, it is possible to integrate into one common crystal not only the photodetector, but also the scanners of the television camera, which can be implemented with a significant decrease in their power consumption.

The schematic organization of the photodetector for the first and second TTP of the TV camera when implementing the second version of the television system is shown in Fig. 2b.

The sensor is made using CMOS technology and contains on a common crystal a photoreceiving area (target) at position 7, a vertical scan register at position 8, a video signal switch at position 9 and a line scan multiplexer at position 10.

As shown in FIG. 2b, active pixels on the sensor target are combined into columns by a vertical video bus 7-5.

Each active pixel of the target includes a light-sensitive area (area) 7-1, an amplifier 7-2 with a gain K ₁ and an ADC 7-3. The video signal switch 9 consists of separate switches 9-1, the number of which corresponds to the number of active pixels in a line, united by a horizontal video bus 7-6.

The ADC 7-3 pixel control for each line of the photodetector is carried out using a separate (own) line bus 7-4, which transmits a control signal from the corresponding output of the frame scan register 8.

The video signal from the output of each ADC 7-3 for each active pixel of a single taken column is transmitted to the horizontal video bus 7-6. Further, using the switch MOS-transistor switch 9-1, controlled from one of the multiplexer 10 outputs, the digital video signal of the current pixel is transmitted to the horizontal video bus 7-6, and then transmitted through it to the sensor output.

The same formation of a digital video signal occurs within the other columns of the target 7 of this sensor.

As a result, at the output of the video in a rectangular raster, one after another for each pixel of a separate line and sequentially line by line for the target as a whole

the voltage of the output video signal of the photodetector is formed in digital form.

Thanks to the CMOS technology adopted for the manufacture of the sensor, it is possible to integrate into one common crystal not only a photodetector with an ADC for each active pixel, but also the necessary digital scanners. Obviously, this sensor is technically more perfect than the previous sensor, but it is more difficult to manufacture, and therefore its price will be significantly higher.

Input lens 1-1, beam splitter 1-2, guidance unit 1-5, selector 1-6 sync pulses, BFZ 1-7, BRZ 1-8, synchronization signal shaper 1-9 and camera frame signal shaper 1-10 for the intended purpose and circuit design do not differ from the corresponding blocks of the prototype [1].

Note that in order to increase the geometrical dimensions of the space within the field of view of the television system, it is desirable that the input lens 1-1 have a wide field of view at a standard 4/3 aspect ratio. For example, the domestic lens "Zenitar-M 2.8 / 16", related to the optics of the "Fisheye" type, can provide for a 1/3-inch sensor phototarget diagonal, a horizontal field of view of at least 100 angular degrees.

Suppose that the target format of the sensors of both TTS, both for the first and the second embodiment of the claimed television system, is, as in the prototype [1], 1/3 inch (4.8 × 3.3) mm. Frame size for the Zenitar-M 2.8 / 16 lens is 24 × 36 mm. Therefore, the scaling factor K _{m of the} optical image formed at the second output of the beam splitter is equal to the ratio:

Guidance block 1-5 is designed for the spatial positioning of the DTS 1-4. The electrical circuit of unit 1-5 can be implemented on the basis of the technical solution "Application of the HSSR-7111 optocoupler to control the reverse of an AC motor", published on the Internet at the site [3].

The HSSR-7111 product is a single-pole normally open optocoupler with a power MOSFET output stage, has a very low on resistance and works exactly like a solid-state relay.

Let us consider the operation of the guidance unit 1-5 (see Fig. 3), the circuit of which is based on four HSSR optocouplers, designated as VT1 ... VT4. We will assume that guidance control is carried out by commands in accordance with table. 1.

It should be noted that the control signals of the guidance unit 1-5 supplied to the camera from the computer via the communication line are constant voltages of positive or negative polarity of (5 ... 30) Volts, measured relative to the "common" wire.

In the absence of control commands, these voltages are also absent. Therefore, the optocouplers VT1 ... VT4 are open, and the motors M1 and M2 are de-energized.

Let the command "Control horizontally" - "Right" come through the communication line to the guidance unit 1-5. Then the optocoupler VT2 closes, and the electric motor M1 is connected to an alternating voltage source ~ U and begins to rotate.

If instead of this command the command "Horizontal control" - "Left" is received, then the VT1 optocoupler will close, and the M1 electric motor will rotate in the other direction.

The same happens for the commands "Vertical control". If the "Up" command is given, then the VT4 optocoupler is closed and the M2 electric motor rotates. When the "Left" command is given instead, the VT3 optocoupler is closed, and the M2 motor changes the direction of rotation. Limit switches SF1 ... SF4 provide the required positioning limits of the DTS 1-4 horizontally and vertically.

As in the prototype guidance unit [1], position sensors 1-5-2 and 1-5-4 are made on the basis of variable resistors RP _x and RP _y , having a linear dependence of the change in resistance on the angle of rotation. Fixed resistors R _x ^* and R _y ^{* are} required to perform fine positioning tuning work.

BFZ 1-7 implements a constant time delay of the horizontal sync pulse for half the line period and the frame sync pulse for half the frame period, i.e .:

- задержка по строке;Where

- line delay;

- задержка по кадру;

- frame delay;

T _s - line period;

T _k - frame period.

BRZ 1-8 implements a controlled time delay of sync pulses from the outputs of BFZ 1-7.

удовлетворяет соотношению:Adjustable line delay

satisfies the ratio:

удовлетворяет другому соотношению:and the adjustable frame delay

satisfies another relationship:

и

осуществляется соответственно от первого (1-5-2) и второго (1-5-4) датчиков положения в блоке наведения 1-5.Adjusting the length of delays

and

carried out respectively from the first (1-5-2) and second (1-5-4) position sensors in the guidance unit 1-5.

The generator 1-9 of the synchronization signal provides, according to the synchronization signals of lines and frames from the outputs of the BRZ 1-8, receiving at the output a synchronization signal of the receiver (SSP) with typical time characteristics of its components, for example, according to GOST 7845-92.

It should be noted that high-precision adjustments (alignments) must be performed in the production process to perform high-quality work of the TV camera during its adjustment.

Alignment of the guidance unit 1-5 should ensure, at all set positions of the potentiometer slides RP _x and RP _y, such a position of the DTS 1-4 relative to the second output of the beam splitter 1-2 so that the geometric center of its phototarget coincides with the geometric center of the projected image. Adjustment is ensured due to the high class of accuracy in manufacturing all mechanical elements of electric drives 1-5-1 and 1-5-3, as well as by using pick-up resistors R _x * and R _y * and using potentiometers RP _x and RP _y with a linear dependence of the resistance change from the angle of rotation.

After completing the adjustment, the images of the electronic frame against the background of the general view must correspond to the positions of the potentiometers RP _x and RP _y , given in table. 2.

If the camera is correctly aligned, after the system is switched to the “Combined image” mode, the enlarged image will occupy a position in the raster in the area of the initial selection, i.e. in that part, which has been marked with the appropriate electronic frame.

Computer 3 is designed to perform the following operations:

преобразования первого («видео 1») и второго («видео 2») входных аналоговых сигналов изображения, транслируемых с телекамеры для первого варианта выполнения телевизионной системы, в соответствующие цифровые видеосигналы;

converting the first ("video 1") and second ("video 2") input analog image signals broadcast from the camera for the first embodiment of the television system into the corresponding digital video signals;

ввода/вывода цифровых видеосигналов «видео 1» и «видео 2»

input / output of digital video signals "video 1" and "video 2"

формирования команд «Управление наведением» и «Выбор режима видео»;

formation of commands "Guidance control" and "Select video mode";

микширования выходного цифрового видеосигнала «видео 1» с сигналом «рамка»,

mixing the output digital video signal "video 1" with the signal "frame",

формирования по сигналу «рамка» сигнала «окошко»;

formation of a "window" signal on the "frame"signal;

выполнения коммутации и воспроизведения цифровых видеосигналов в режимах «Изображение общего вида» и «Комбинированное изображение».

performing switching and playback of digital video signals in the "General view" and "Combined image" modes.

The characteristic of the control signals accompanying the command "Guidance control" was presented above (see Table 1).

The characteristic of control signals accompanying the command "Select video mode" is presented in table. 3.

All signaling operations and control commands are carried out in accordance with the application computer program, which is an integral part of the development of this television system.

Obviously, the control commands can be given from the computer keyboard and / or using the computer mouse.

Note that the command "Select video mode" is distributed within the computer, and therefore is an internal command. The command "Guidance Control" is an external command, since it is designed to control the operation of the TV camera.

It should be noted that the "window" signal can define the raster zone of the "frame" signal or exceed it, but the geometric centers of these zones always coincide.

In the applied computer program developed for the inventive system, it is highly desirable to implement the correction of "pincushion" geometric distortions introduced by the input wide-angle fisheye lens into the "video 1" and "video 2" image signals generated by the television camera.

The claimed television system with selective image scaling (see Fig. 1) operates as follows. Let us distinguish in the operation of the proposed system the two modes mentioned earlier:

"General view and selection of a fragment" (mode 1);

"Combined image" (mode 2).

Regardless of the operating mode of the television system, as in the prototype, the input optical image along the optical path: input lens 1-1, translucent mirror 1-2-1, collective lens 1-2-2, reflecting mirror 1-2-3, additional lens 1-2-4 is projected onto the photo target of the first TTP 1-3.

Simultaneously enlarged (in accordance with the zoom ratio K _{m of the} beam splitter 1-2) a fragment of this image, the boundaries of which are determined by the electronic frame, along a different optical path: the input lens 1-1, the translucent mirror 1-2-1 is projected onto the phototarget of the second TTS 1- 4.

Note that the scaling factor K _{m of the} beam splitter 1-2, as in the prototype [1], is determined by the ratio of the width (height) of the optical frame of the input lens 1-1 to the corresponding sides of the phototarget of the second TTS 1-4.

As a result of photoelectric conversion, the optical image of each TTS is further converted into the corresponding composite video signals. For option 1 of the television system, this is the analog form of composite video signals, and for option 2, the digital form of video signals.

As in the prototype [1], the selector 1-6 sync pulses extracts from the composite video signal "video 1" horizontal and vertical sync pulses, and the shaper 1-10 of the frame signal generates at the output a rectangular frame signal with the format (a × b).

BFZ 1-7 delays horizontal and frame sync pulses from selector 1-6, respectively, by half the line period and half the frame period, i.e.:

и кадровая задержка

составляют:Let us assume that the frame occupies the initial position for selecting the central fragment of the presented general view image. In this case, the potentiometer slides RP _x and RP _y in the guidance unit 1-5 will occupy an average position, and in BRZ 1-8, the horizontal and vertical sync pulses coming from BFZ 1-7 will be delayed, respectively, by half the period of the line and half the period frame. Therefore, in the BRZ 1-8 line delay

and frame delay

make up:

For illustration, FIG. 9c shows the temporary position of the horizontal sync pulse at the output of the BRZ 1-8, and the adjustable delay is τ ₁ .

Then the synchronization signal of the receiver (SSP) at the output of the shaper 1-9 coincides in phase with the SSP, which is "embedded" in the composite image signal "video 2" at the output of the DTS 1-3. Therefore, taking into account that the SSP at the output of the shaper 1-9 determines the slave synchronization mode for TTP 1-4, we get an important result. Namely: the raster of the normal image, formed by the DTS 1-3, and the raster of the enlarged image, formed by 1-4, are not only synchronous with respect to each other, but also in phase, and therefore coincide when superimposed.

This situation is illustrated in FIG. 4а, where there, and further in the whole figure, the normal image raster is indicated by hatching from the center, and the borders of the enlarged image raster are marked by a dash-dotted line. The dotted line in FIG. 4-6 shows the position of the electronic frame.

Let us assume that the electronic frame is in the position shown in FIG. 4b, i.e. in the lower left corner of the normal image raster. In this case, the RP _x and RP _y potentiometer slides in the guidance unit 1-5 will take a new position, and in the BRZ 1-8 another delay of the input horizontal and vertical sync pulses will be performed, satisfying the ratio:

In this situation, the receiver synchronization signal (SSP) at the output of the shaper 1-9 leads in phase with the SSP from the composite "video 1" at the output of the TTS 1-3. As a result, the raster of the enlarged image formed by the TTS 1-4 is displaced relative to the raster of the normal image formed by the TTS 1-3, as shown in FIG. 4b.

Let's assume that the electronic frame takes a new position, namely: in the upper right corner of the normal image raster. In this case, the potentiometer slides RP _x and RP _y in the guidance unit 1-5 will take a different position, and in BRZ 1-8 a different delay of the horizontal and vertical sync pulses will be performed, satisfying the relations:

In this situation, the receiver synchronization signal (SSP) at the output of the shaper 1-9 lags behind the SSP in phase from the composite signal "video 1" at the output of the TTS 1-3. As a result, the raster of the enlarged image formed by the TTS 1-4 is displaced relative to the raster formed by the TTS 1-3, as shown in FIG. 4c.

Quite similarly, if any other position of the electronic frame is chosen, then, thanks to this organization, for TTS 1-4 of the slave synchronization modes from the shaper 1-9, the location of the enlarged fragment in the combined image will be guaranteed only in the area of the initial selection.

Then both analog video signals (for option 1 of the system) or both digital video signals (for option 2 of the system) are transmitted in parallel from camera 1 through communication line 2 to the receiving side of the television system, where they are fed to computer 3.

On the computer video board, analog video signals "video 1" and "video 2" by means of analog-to-digital conversion (ADC) also become digital video signals. It is important to emphasize that the ADC operation for "video 1" and "video 2" must be performed while observing the separate synchronization mode for each of the signals by the input synchronization signal of the receiver (SRP).

Further, digital video signals "video 1" and "video 2", both for the first and for the second embodiment of the television system, are recorded in the computer's RAM 3.

Note that when power is applied, the television system starts operating in mode 1 by default, and the computer generates a logical “1” signal for the “Select video mode” command - “General view and select the fragment of interest”.

Therefore, the digital mixing of the video 1 signal with the electronic frame signal is performed on the computer video card, and as a result of the video signal switching, it is the video 1 signal with the frame superimposed on it that is reproduced on the computer monitor screen.

Recall that the position of the frame within the active part of the raster is determined depending on the position of the potentiometers RP _x and RP _y (position sensors 1-5-2 and 1-5-4) installed in the guidance unit 1-5. At the same time, TTS 1-4 generates a video signal of an optically enlarged "intra-frame" image.

An electronic frame marks an area of increased interest for the operator on the image, and he, by sending commands from the computer to the TV camera “Horizontal control” - “Right / Left” and “Vertical control” - “Up / Down”, can remotely set the frame on any area of the observed image.

The quality of this image for the observed dynamic scenes will certainly be higher than that of the prototype [1], due to the use of CMOS matrices with the required ratio of the indicators of the charge image amplification factors as photodetectors for the first and second TTPs of the TV camera.

Next, the operator switches the television system to operating mode 2 and controls the combined image being formed.

FIG. 5 demonstrates the practical use of the proposed system for organizing television surveillance in a parking lot. FIG. 5a shows an image generated in mode 1, and FIG. 5b - in mode 2, where the car number is clearly visible in the initial selection zone.

The light sensitivity of a television camera for a general view image is increased by the required number (β times), and therefore its real value is not inferior to that for an enlarged image.

Due to the principle achieved in the inventive system, the result of reducing the loss of time resolution, the high quality of the television image of the license plate (see Fig. 5b) will be maintained even when the vehicle starts moving again.

At present, all blocks of the proposed solution of a television system with selective image scaling have been mastered or can be mastered by the domestic industry, therefore, the alleged invention should be considered as corresponding to the requirement of industrial applicability.

SOURCES OF INFORMATION

1. Patent 2504100 RF. IPC H04N 5/225. Selective scaling television system. / V.M. Smelkov // B.I. - 2014. - No. 1.

2. Berezin V.V., Umbitaliev A.A., Fakhmi Sh.S., Tsytsulin A.K. and Shipilov N.N. The Solid State Revolution in Television: TV Systems Based on CCD, System-on-Chip and Video-on-Chip. Ed. A.A. Umbitaliev and A.K. Tsytsulin. - M .: "Radio and Communication", 2006.

3.www.avagotech.com

Claims (7)

1. A television system with selective image scaling, which contains a television camera on the transmitting side, consisting of sequentially located and optically connected input lens, a beam splitter, two television signal sensors (TTS), a guidance unit, a sync pulse selector, a fixed delay unit (BFZ), a unit adjustable delay (BRZ), synchronization signal shaper and frame signal shaper, while the beam splitter of the TV camera contains sequentially located and optically coupled semitransparent mirror, a collective lens, a reflecting mirror and an additional lens, the input of the beam splitter is optically connected to the input of the semitransparent mirror, the first output of the the output of the additional lens, and the second output - with the second output of the semitransparent mirror, and the first output of the beam splitter is the "normal optical image output" and is optically connected to the photo target of the first TTS, and the second output of the beam splitter is "The output of an enlarged optical image" and is optically connected with the phototarget of the second TTS; a guidance unit designed to carry out the spatial positioning of the second TPA and consisting of a first drive kinematically connected to the first position sensor and a second drive kinematically connected to the second position sensor, while the output of the first position sensor is the first output of the guidance unit, and the output of the second sensor position - the second output of the guidance unit; the horizontal synchronization input of the frame signal generator is combined with the first input of the BFZ and connected to the first output of the sync pulse selector, and the frame synchronization input of the frame signal generator is combined with the second input of the BFZ and connected to the second output of the sync pulse selector, the input of which is connected to the "video" output of the first DTS, the "synchro" input of the second DTS is connected to the output of the synchronization signal generator, the first and second inputs of which are connected respectively to the first and second outputs of the BRZ, the first information input of which is connected to the first output of the BFZ, and the second information input of the BRZ to the second output of the BFZ, the first control the BRZ input is combined with the first control input of the frame signal shaper and is connected to the first output of the guidance unit, the second output of which is connected to the second control input of the BRZ and, accordingly, to the second control input of the frame signal shaper, and the output of the first TTS is the "video 1" output of the TV camera, the output second DTS - the output of the "video 2" of the TV camera, and the output of the frame signal generator - the output of the "frame" of the TV camera, on the receiving side of the TV system there is a personal computer, and between the TV camera and the computer there is a communication line of a multicore cable, two of which connect the signal output for pointing commands "Right / Left" and "Up / Down" on the computer with the inputs of these signals in the camera, and three other conductors of the communication line cable connect the outputs of the signals "video 1", "video 2" and "frame" of the TV camera with the corresponding inputs on the computer; a video card is installed in the expansion connector on the computer motherboard, matched in input / output channels, control and power with the computer bus and is designed to convert the first and second input analog video signals ("video 1" and "video 2", respectively) into digital form when organization of synchronization of each of them separately according to the input synchronization signal of the receiver (SSP), input / output of digital video signals "video 1" and "video 2" into the computer's RAM; mixing the output digital video signal "video 1" with the signal "frame", generating the signal "window" according to the signal "frame" and switching the video signals "video 1" and "video 2" on the signal "window", and the video output of the video card is the output of the image signal of the television system, characterized in that in the television camera of the system, the first and second TPS, respectively, are made on a sensor crystal made using CMOS technology, by implementing the "coordinate addressing" method, and the sensor target consists of photodiode active pixels, each of which has a coefficient gain K ₁ , as well as a transistor MOS switch, which provides the transmission of the video signal of the active pixel to the video bus, which combines all the active pixels of the target into active columns, each of which additionally has a video signal amplifier with a gain of K ₂ , and control of the MOS keys of the active pixels , located horizontally, is carried out using separately in the third horizontal (line) bus, the total number of which determines the number of lines in the sensor, and the number of video buses - the number of elements (pixels) in each sensor line; at the same time, on the common crystal of the photodetector, its electronic "framing" is placed - blocks that perform scanning and formation of the output voltage of the video signal, namely: a vertical (vertical) scan register that selects a line; key MOS transistors for each active column, providing the transmission of the video signal at the output of its amplifier to the corresponding input of the horizontal (line) multiplexer, which connects the video signal from each active pixel to the input of the output amplifier with a gain of K ₃ , while in the active pixels of the target sensors with a frame period accumulate charge packets of the current frame and simultaneously read the video information of the previous frame sequentially one after the other for each pixel of a single line of the target and sequentially line by line for the target as a whole, forming the voltage of the output video signal of the sensor at the output of the photodetector in analog form, and to compensate for optical losses in the beam splitting, the gain K _{1 of the} first TTS is β times greater than the value of the gain K _{1 of the} second TTS, where the value of the β coefficient is calculated by the formula:

where D / ƒ is the relative aperture of the additional camera lens (beam splitter lens); τ ₁ - transmission coefficient of the beam splitter lens; τ ₂ is the transmission coefficient of the collective lens of the beam splitter. 2. A television system with selective image scaling, which contains a television camera on the transmitting side, consisting of sequentially located and optically coupled input lens, a beam splitter, two DTS, a guidance unit, a sync pulse selector, BFZ, BRZ, a synchronization signal generator and a frame signal generator, when In this case, the beam splitter of the TV camera contains sequentially located and optically coupled semitransparent mirror, a collective lens, a reflecting mirror and an additional lens, the input of the beam splitter is optically connected to the input of the semitransparent mirror, the first output of the beam splitter is connected to the output of the additional lens, and the second output is connected to the second output of the semitransparent mirror, and the first beam splitter output is the "normal optical image output" and is optically connected to the phototarget of the first TFS, and the second beam splitter output is the "magnified optical image output" and is optically connected to the phototarget of the second TFS; a guidance unit designed to carry out the spatial positioning of the second TPA and consisting of a first drive kinematically connected to the first position sensor and a second drive kinematically connected to the second position sensor, while the output of the first position sensor is the first output of the guidance unit, and the output of the second sensor position - the second output of the guidance unit; the horizontal synchronization input of the frame signal generator is combined with the first input of the BFZ and connected to the first output of the sync pulse selector, and the frame synchronization input of the frame signal generator is combined with the second input of the BFZ and connected to the second output of the sync pulse selector, the input of which is connected to the "video" output of the first DTS, the "synchro" input of the second DTS is connected to the output of the synchronization signal generator, the first and second inputs of which are connected respectively to the first and second outputs of the BRZ, the first information input of which is connected to the first output of the BFZ, and the second information input of the BRZ to the second output of the BFZ, the first control the BRZ input is combined with the first control input of the frame signal shaper and is connected to the first output of the guidance unit, the second output of which is connected to the second control input of the BRZ and, accordingly, to the second control input of the frame signal shaper, and the output of the first TTS is the "video 1" output of the TV camera, the output second DTS - the output of the "video 2" of the TV camera, and the output of the frame signal generator - the output of the "frame" of the TV camera, on the receiving side of the TV system there is a personal computer, and between the TV camera and the computer there is a communication line of a multicore cable, two of which connect the signal output for pointing commands "Right / Left" and "Up / Down" on the computer with the inputs of these signals in the camera, and three other conductors of the communication line cable connect the outputs of the signals "video 1", "video 2" and "frame" of the TV camera with the corresponding inputs on the computer; a video card is installed in the expansion slot on the computer motherboard, coordinated in input / output channels, control and power supply with the computer bus and designed for input / output of the first and second input digital video signals ("video 1" and "video 2" into the computer's RAM respectively); mixing the output digital video signal "video 1" with the signal "frame", generating the signal "window" according to the signal "frame" and switching the video signals "video 1" and "video 2" on the signal "window", and the video output of the video card is the output of the image signal of the television system, characterized in that in the television camera of the system, the first and second TPS, respectively, are made on a sensor crystal made using CMOS technology by implementing the "coordinate addressing" method, and the sensor target consists of photodiode active pixels, each of which has an amplifier with a gain K and a built-in analog-to-digital converter (ADC), which provides the transmission of the active pixel video signal to the vertical video bus, which combines all active target pixels into vertical columns, and the ADC control for pixels located along each row is carried out using a separate line bus, the total number of which is determined It defines the number of lines in the sensor, and the number of vertical video buses - the number of pixels in each line of the sensor, while on the common crystal of the photodetector there are also units that scan and generate the output voltage of the digital video signal, namely: a vertical scan register that selects a line; video signal switches for each column, controlled from the corresponding output of the line scan multiplexer and providing the transmission of the video signal at the output of each video column bus to the video line bus, the output of which is the “Video” output of the photodetector, while the active pixels of the sensor target with a frame period accumulate charge packets of the current frame and simultaneously reading the video information of the previous frame sequentially one after the other for each pixel of a single line of the target and sequentially line by line for the target as a whole, forming at the output of the photodetector in digital form the voltage of the output video signal of the sensor, and to compensate for the optical losses of the beam splitting the value of the coefficient gain K of the active pixel of the first TTP is β times greater than the value of the gain K of the active pixel of the second TTP, where the value of the coefficient β is calculated by formula (1), as in item 1. 3. Television system with selective image scaling according to claim 1 or 2, characterized in that a wide-angle lens is used as the input lens of the camera, and the computer corrects geometric distortions introduced by the lens into the image signals "video 1" and "video 2" ...

Images