RU2585749C1 - Device for computer system for panoramic television surveillance with implementation of exchange of image parameters - Google Patents

Abstract

FIELD: closed circuit television systems.

SUBSTANCE: invention relates to panoramic television surveillance, which is carried out by a computer system by monochromic television camera with all-round view in a region closer to a hemisphere, that is, in a solid angle of 360 degrees on azimuth and tens of degrees on elevation angle. Result is achieved by including an aperture adjustment unit (AAU), data input of which is connected to sixth output of “circular” scanning unit, clock input of AAU - to seventh output of “circular” scanning unit, and output of AAU - to control input of “circular” scanning unit, wherein first control input of AAU is “Start” input of television camera, second control input of AAU is “Stop” input of television camera, and server computer used is a system operator computer which generates and transmits external control commands of television camera “Start” and “Stop”.

EFFECT: implementation in “circular” raster of television camera exchange of image resolution with its sensitivity and vice versa, without adding noise losses to video signal.

3 cl, 6 dwg, 1 tbl

Description

The invention relates to panoramic television surveillance, which is performed by a computer system using a monochrome circular television camera in a region close to the hemisphere, i.e. in a spatial angle of 360 degrees in azimuth and tens of degrees in elevation.

The closest in technical essence to the claimed invention should be considered the device of a computer system for panoramic television surveillance [1], containing a series-connected television camera and a server, which is a node of the local area network, to which two or more personal computers are connected, while the television camera consists of sequentially located and optically coupled panoramic lens and digital television signal sensor, which contains the last solidly located and connected solid-state photodetector and photodetector unit, the television camera forming a “ring” image raster, its photodetector made by charge-coupled device (CCD) technology and has a target crystal in the form of a circular ring, and the photodetector unit provides an analog video signal sweep and generation the output of the television camera is a digital television signal, while the photodetector contains a photodetector region on the common crystal, a “ring” shift register, ending charge-voltage converter (BPS), moreover, on the photodetector region, lines of photosensitive elements alternating with lines of elements shielded from light are located along radial directions from the imaginary center of the circular ring to its outer periphery and the “ring” shift register located there, and the number the elements in each “ring” line of the photodetector region are different and increase as they move to the outer periphery to a maximum value equal to the number of elements in the “ring” reg Shift direction, while a video card is installed in the expansion slot on the server’s motherboard, matched via the I / O channels, control and power supply with the server bus, containing a block for converting a “ring” frame into “rectangular” frames (BPKP), the input of which is connected to the output of the block of RAM per frame, and the output to the output of the "network", and the number of "rectangular" frames corresponding to one current "ring" frame, satisfies the ratio:

where γ _g is the horizontal angle of the field of view in degrees of the image observed by the operator, and this conversion itself is performed programmatically.

For the prototype, it is assumed that the SPD of the photodetector is organized as a "floating diffusion region" [2], and therefore has a control input that provides an element-by-pixel voltage drop in the photodetector; the photodetector unit contains a “ring” scan unit of the video signal, as well as a signal processor and an analog-to-digital converter (ADC) connected in series, while the information input of the signal processor is connected to the output of the SEC of the photodetector, the first output of the “ring” scan unit is connected to the control inputs of the photodetector a photodetector, the second output of the “circular” scan unit to the control inputs of the “circular” shift register of the photodetector, the third output of the “circular” scan unit to the control input of the BPZN f from the receiver, the fourth output of the “ring” scan block to the synchronization input of the signal processor, the fifth output of the “ring” scan block - to the ADC clock input.

The disadvantage of the prototype device of a computer system for panoramic observation is the lack of implementation of an effective exchange of image parameters.

The objective of the invention is the implementation in the "ring" raster of a television camera exchange resolution of the image on its sensitivity and, conversely, without introducing noise loss into the video signal.

The problem in the inventive computer system for panoramic television surveillance is solved by the fact that in the prototype device [1], containing a series-connected television camera and a server, which is a node of a local area network, to which two or more personal computers of users are connected, the television camera forming “Ring” image raster, consists of sequentially located and optically connected panoramic lens and photodetector, as well as a “ring” p video signal wrappers and a signal processor and ADC connected in series, the photodetector made using CCD technology has a target crystal in the form of a circular ring and contains a photodetector region on the common crystal, an “annular” shift register ending with an “overhead diffusion region” organization with on the photodetector region, the lines of photosensitive elements, alternating with the lines of elements shielded from light, are located circularly along the radial directions from the imaginary center ring to its outer periphery and the “annular” shift register located there, and the number of elements in each “annular” line of the photodetector region is different and increases as it moves to the outer periphery to a maximum value equal to the number of elements in the “annular” shift register, the information input of the signal processor is connected to the output of the SPS of the photodetector, the first output of the “ring” scan unit is connected to the control inputs of the photodetector area of the photodetector, the second output of the “ring” scan unit is to the control m inputs of the “circular” register of the shift of the photodetector, the third output of the block of the “circular” scan to the control input of the SPS of the photodetector, the fourth output of the block of the “circular” scan to the synchronization input of the signal processor, the fifth output of the block of the “circular” scan to the clock input of the ADC, at the same time, a video card is installed in the expansion slot on the server motherboard, coordinated via input / output channels, control and power supply with the server bus, containing a block for converting a “ring” frame into “rectangular” frames (BPKP), the input to otorochno connected to the output of the RAM block per frame, and the output to the output of the "network", and the number of "rectangular" frames corresponding to one current "ring" frame, satisfies the ratio (1), introduced the aperture adjustment unit (ARB), information input which is connected to the sixth output of the “circular” scan unit, the synchronizing input of the ARB to the seventh output of the “circular” scan unit, and the output of the ARB to the control input of the “circular” scan unit, while the first control input of the ARB is the “Start” input of the television camera, the second control input of the ARB is the “Stop” input of the television camera, and the system operator’s computer is used as the server, in which the external control commands for the “Start” and “Stop” television cameras are generated and sent.

Comparative analysis with the prototype [1] shows that the inventive device of a computer system for panoramic television monitoring differs in that by using the ARB included in the television camera, which is controlled by the server computer operator, the aperture area of the photodetector in its “ring” raster can be changed without making noise loss. A twofold increase in the area of the aperture provides a twofold increase in the sensitivity of the image, which is accompanied by a twofold decrease in its sharpness horizontally, a four-fold increase in the area of the aperture - a four-fold increase in the sensitivity of the image with a simultaneous decrease in sharpness also by a factor of four, and so on. As a result, the image sensitivity is exchanged for its resolution, which may be useful to the operator in detecting and recognizing objects.

The combination of known and new features for the claimed device is not known from the prior art, therefore, the proposed technical solution meets the criterion of novelty.

The exchange of image parameters is performed in the "ring" image raster. Therefore, this technical solution meets the criterion of the presence of an inventive step.

In FIG. 1 shows a structural diagram of the inventive device of a computer system for panoramic television surveillance; in FIG. 2 shows the circuit organization of the photodetector of a television camera; in FIG. 3 shows a fragment of this photodetector, illustrating the details of its design; in FIG. 4, according to [2, p. 19], a structural diagram of the BPS with the organization "floating diffusion region" is presented; in FIG. 5 shows a functional diagram of an ARB performing a double exchange of sensitivity for resolution; in FIG. 6 - diagrams explaining the implementation of this exchange.

The inventive computer system for panoramic television surveillance, see FIG. 1, comprises a television camera 1 and an operator computer 2 connected in series as a server, which is a local area network node to which two or more personal computers are connected in position 3, and a video card is installed on the server 2 motherboard to record “ ring "video signal into the RAM of the server and the conversion of" ring "frames into" rectangular "frames, and the number of" rectangular "frames corresponding to one current" ring "frame, satisfies the relation (1), and itself comprises a TV camera 1 sequentially disposed and optically coupled panoramic lens 1-1 and 1-2 photodetector; block 1-3 "ring" scan of the video signal connected in series with the signal processor 1-4 and the ADC 1-5, as well as the ARB 1-6, and the photodetector 1-2 has the shape of a circular ring (see Fig. 2 ... 3), which the lines of photosensitive and the lines of light-shielded elements of the photodetector region 1-2-1 are located along radial directions from the imaginary center of the circular ring to its outer periphery and the “circular” shift register 1-2-2 located there, ending in OCR 1-2-3 , and the number of elements in each “ring” line of the photodetector is about area 1-2-1 is different and increases as it moves to the outer periphery to a maximum value equal to the number of elements in the “ring” shift register 1-2-2, while the information input of the signal processor 1-4 is connected to the output of the SPS of the photodetector 1- 2, the first output of block 1-3 - to the control inputs of the photodetector region 1-2-1 of the photodetector, the second output of block 1-3 - to the control inputs of the "circular" shift register 1-2-2 of the photodetector, the third output of block 1-3 - to the control input BPZN 1-2-3 of the photodetector, the fourth output of the block 1-3 - to the synchronization input the signal processor 1-4, the fifth output of the unit 1-3 - to the clock input of the ADC 1-5, the sixth output of the unit 1-3 - to the information input of the ARB 1-6, the seventh output of the unit 1-3 - to the clock input of the ARB 1-6 the output of which is connected to the control input of unit 1-3, the “Start” and “Stop” commands generated in the server computer 2 are supplied to the external inputs of the television camera 1 of the same name and, respectively, to the first and second control inputs of the ARB 1-6.

The panoramic lens 1-1 of the television camera, as in the prototype, is designed to form an optical image of a circular view (ring image). As a technical solution for a panoramic lens 1-1, which coincides with a similar solution for the prototype, a panoramic mirror-lens lens can be proposed, the design of which is patented in Russia by Russian specialists [3].

The angular field in the space of objects for this lens is 360 degrees in azimuth and can reach (75-80) degrees in elevation.

The presence of a passive (non-informative) region in the center of the optical frame of the panoramic lens confirms the advisability of choosing the shape of the photodetector 1-2, as in the prototype, in favor of a circular ring.

Block 1-3 of the "circular" scan of the video signal, the signal processor 1-4 and the ADC 1-5 are made using a set of specialized microcircuits with a high level of integration and are no different from the blocks of the same name of the prototype.

The ARB 1-6 is designed to control the area of the readout aperture in the photodetector 1-2 when element-by-element video signal voltage is detected in the BPZN 1-2-3.

In FIG. Figure 4 shows a possible block diagram of the CCD with the organization "floating diffusion region", which fully coincides with the scheme currently used in CCD matrices for the implementation of a rectangular scan of a video signal. In this drawing, the following notation: U _f1 , U _f2 , U _f3 - voltage on the tires for three-phase control of the "ring" shift register 1-2-2; U _out - voltage at the output gate; D _o , D _sbr - output and reset diodes, respectively.

Before reading information charge of the next pixel in the process of converting into voltage charge video information of the previous element must be cleared in an erasing diode D _RRF.

This procedure is carried out using the reset pulses supplied to the corresponding control bus BPZN 1-2-3.

In FIG. 5 shows the functional diagram of the ARB 1-6, which implements a special case of adjusting the aperture, namely: changing its area by half. This circuit contains an RS-flip-flop at position 7, a D-flip-flop at position 8, the first “And” element at position 9, the second “And” element at position 10 and the “OR” element at position 11.

At the logic input of the ARB 1-6, bit-wise reset pulses with a period T _e (see Fig. 6a) are transmitted at logical levels, transmitted from the sixth output of the 1-3 "ring" sweep block, and frame sync pulses (CSI) with his seventh exit.

From the external input of the television camera to the control inputs of the RS-trigger 7 receives computer commands, the characteristics of which are presented in table. one.

Note that these commands for external control of the television camera can be successfully formed as part of the video card of the computer server 2.

We continue consideration of the functional diagram of the ARB 1-6 shown in FIG. 5. At the output of the D-flip-flop 8, a meander is formed with a period of 2T _e (see Fig. 6b), and at the output of the element "OR" 11, reset pulses following with the same 2T- _e period (see Fig. 6c) are formed. provide summation in one pixel of two adjacent information charges.

In order to further increase the sensitivity of a television camera, the multiplicity of the summation of charge packets in one element, performed in the ARB 1-6, can be increased, for example, to a value of 64 by the necessary complication of its circuit, but without changes for the external control communication line and the characteristics of computer commands.

It is obvious that the ARB 1-6 can be performed as part of the block 1-3 "ring" scan of the video signal.

It is important to note that the summation of the charges cannot be an additional source of noise for the video signal at the output of the television camera.

Therefore, limiting the multiplicity of summation of the aperture determines only the acceptability of the proposed image clarity to the operator.

The device of a computer system for panoramic television surveillance (see Fig. 1) works as follows.

As in the prototype [1], it is assumed that the television camera 1 is installed in a fixed position, for example, using a photographic tripod (in Fig. 1 it is not shown).

In the initial state, at the inputs “Start” and “Stop” of the television camera 1, there are no control signals from the computer 2, i.e. these inputs have low logic levels.

The television camera 1, as in the prototype, operates in a single-element aperture of the video signal. The photodetector 1-2 of a television camera (see Fig. 2 ... 3) implements a "ring" scan of the charge image on the photodetector region 1-2-1, followed by element-by-element reading of the charge packets in the "ring" shift register 1-2-2 and forming on output BPZN 1-2-3 voltage of the video signal in analog form.

At the same time, in the interval of the forward course of the frame, the process of accumulation of charge packets occurs in proportion to the illumination of the panoramic plot in the photosensitive pixels of the photodetector region 1-2-1.

During a short period of the subsequent interval of the reverse rotation of the frame scan, a photo shutter opens, and the charges of all the "ring" lines involved in the accumulation are transferred (in one rotation step) to the screened from light pixels located in the same region 1-2-1.

Then the photo shutter closes and, in a new personnel cycle, another charge “picture” is accumulated on the target, and the charge packets accumulated in the previous frame are transferred in radial directions to the periphery of the photodetector crystal, loading the “ring” register 1-2 in the reverse scan interval -2.

The analog video signal of a photodetector with a single-element aperture, as in the prototype, is further converted using a signal processor 1-4 and ADC 1-5 into a digital television signal (DTS) of the "ring" frame at the output of the television camera. Then, the DTS via the interface (for example, USB 2.0) is transmitted to the server computer 2, where the video information is recorded in its RAM memory per frame.

Suppose that, as in the prototype, the horizontal angle of the field of view (γ _g ) presented to the operator of the image should be 60 °. Then one sixth of each “ring” line from the “ring” frame is recorded in server 2, respectively, in one of the six arrays of RAM per frame.

As in the prototype, in server 2, using the BPC element that implements the functions assigned to it programmatically, the video signal is read with a single-element aperture, and as a result, the “ring” frame is converted into ordinary “rectangular” frames and the possibility of providing this information to output "network" of the server computer 2.

As a result, the digital video recording signal for each "ring" image frame is converted into n "rectangular" frames, which can be offered in the form of a selected sequence to the operators of personal computers 3 of the local computer network.

In our example, this sequence contains 6 different images, and the operator of each personal laptop 3 can select the image proposed by the server 2 and display it on the display screen.

Suppose that to detect or recognize an object of interest to the operator of computer 2, a lack of sensitivity of the television camera 2 is diagnosed.

Consider a special case of a situation where a doubled sensitivity will be sufficient.

Then the computer operator 2 sends a control signal in the form of a short-term logical “1” via the “Start” bus.

When the high level of this signal coincides with the rising edge of the CSI at the synchronizing input of the ARB 1-6 (see Fig. 5), the RS-trigger 7 fires, i.e. at its inverse output, the logic level is set to “0”. Therefore, the output of the element "And" 10 is also set to a low logical level.

On the other hand, for element-by-element reset pulses (see Fig. 6a) supplied to the BRA information input (see FIG. 6a), the D-trigger 8 divides the frequency into two and forms a meander with a period of 2T _e .

Therefore, the logical reset pulses generated at the output of the “AND” element 9, following with a period of 2T _e (see FIG. 6c), pass the OR element 11 without changes and are supplied to the output of the ARB 1-6.

As a result, the television camera 1 enters the mode of generating a video signal with a double aperture, which guarantees an increase in its sensitivity by a factor of two.

The "ring" frame of the video signal with a double aperture is further converted into 6 "rectangular" frames, which can be offered in the form of a selected sequence to computers 3 to the operators of the local area network in the same way as in the operation mode of a television camera with a single-element aperture.

To return the television camera to the single-element aperture mode, it is necessary to send a control signal in the form of a short-term logical “1” via the “Stop” bus.

Then the RS-trigger 7 will be returned to its original state, and the logical reset pulses at the output of the ARB 1-6 will follow with a period of T _e .

Note that the aperture control algorithm, the value of which needs to be multiplied by 4, 8, 16, 32 and 64 times, remains unchanged, but is implemented in the ARB 1-6, executed (compared to Fig. 5) in a different and, obviously, more complicated functional diagram.

Currently, all the elements of the structural diagram of the device of a computer system for panoramic television surveillance mastered or can be mastered by domestic industry.

Therefore, the alleged invention should be considered as meeting the requirement for industrial applicability.

Information sources

1. Patent of the Russian Federation No. 2545519. IPC H04N 7/00. The device of a computer system for panoramic television surveillance and the organization of a photodetector for its implementation. / V.M. Smelkov // BI - 2015. - No. 10.

2. Khromov L.I., Lebedev N.V., Tsytsulin A.K., Kulikov A.N. Solid state television. - "Radio and Communications", 1986.

3. RF patent No. 2185645. IPC G02B 13/06, G02B 17/08. Panoramic mirror lens. / A.V. Kurtov, V.A. Solomatin // BI - 2002. - No. 20.

Claims (3)

1. The device of a computer system for panoramic television surveillance with the implementation of the exchange of image parameters, containing a series-connected television camera and a server, which is the node of the local area network, to which two or more personal computers of users are connected, while the television camera, forming a "ring" image raster, consists of sequentially located and optically connected panoramic lens and photodetector, as well as a block of “ring” scan video signals ala and in series connected signal processor and analog-to-digital converter (ADC), moreover, the photodetector, made by the technology of charge-coupled devices (CCD), has a target crystal in the form of a circular ring and contains a photodetector region on the common crystal, a “ring” shift register, ending with a charge-voltage converter (BPS) with the organization “floating diffusion region”, while on the photodetector region there are lines of photosensitive elements alternating with lines of shielded from light elements located along radial directions from the imaginary center of the circular ring to its outer periphery and the “ring” shift register located there, and the number of elements in each “ring” line of the photodetector region is different and increases as it moves to the outer periphery to a maximum value equal to the number elements in the “circular” shift register, the information input of the signal processor connected to the output of the SPS of the photodetector, the first output of the “circular” scan unit to the control inputs of the photocopier the receiving region of the photodetector, the second output of the "circular" scan unit to the control inputs of the "circular" shift register of the photodetector, the third output of the "circular" scan unit - to the control input of the SEC of the photodetector, the fourth output of the "circular" scan unit - to the synchronization input of the signal processor, the fifth output of the “ring” sweep block is to the ADC clock input, and a video card is installed in the expansion slot on the server motherboard, coordinated via input / output channels, control and power with the server bus, with holding a block for converting a “ring” frame into “rectangular” frames (BPCP), the input of which is connected to the output of the RAM block per frame, and the output to the output “network”, and the number of “rectangular” frames corresponding to one current “ring” frame satisfies the relation:

where γ _g is the horizontal angle of the field of view in degrees observed by the operator of the image, and this conversion is carried out programmatically, characterized in that an aperture adjustment unit (ARB) is introduced, the information input of which is connected to the sixth output of the “ring” scan unit, synchronizing the input of the ARB - to the seventh output of the "circular" scan unit, and the output of the ARB - to the control input of the "circular" scan unit, while the first control input of the BRA is the "Start" input of the television camera, the second control input of the BRA - the “Stop” input of the television camera, and the server of the system operator’s computer is used, in which the external control commands for the “Start” and “Stop” television cameras are generated and from which they are sent. 2. The device of a computer system for panoramic television surveillance according to claim 1, characterized in that the BRA of the television camera is made as part of the “ring” scan signal block. 3. The device of a computer system for panoramic television surveillance according to claim 1, characterized in that the commands for external control of the television camera are formed as part of the video card of the operator’s server computer.

Images