RU2579004C1 - Device for computer system for panoramic television surveillance with implementation of exchange of image parameters - Google Patents

Abstract

FIELD: safety systems.

SUBSTANCE: invention relates to panoramic television surveillance, which is carried out by a computer system by television camera with all-round view in a region closer to a hemisphere, that is, in solid angle of 360 degrees on azimuth and tens of degrees on elevation angle. Result is achieved by controlling scanning area of aperture in radial direction.

EFFECT: realising in "circular" raster of television camera exchange of vertical (crosswise) resolution image on its sensitivity and vice versa, without adding noise losses to video signal.

3 cl, 5 dwg, 1 tbl

Description

The present invention relates to panoramic television surveillance, which is performed by a computer system using a television camera circular view in the area close to the hemisphere, i.e. in a spatial angle of 360 degrees in azimuth and tens of degrees in elevation.

The closest in technical essence to the claimed invention should be considered the device of a computer system for panoramic television surveillance [1], containing a series-connected television camera and a server, which is a node of the local area network, to which two or more personal computers are connected, while the television camera consists of sequentially located and optically coupled panoramic lens and digital television signal sensor, which contains the last solidly located and connected solid-state photodetector and photodetector unit, the television camera forming a “ring” image raster, its photodetector made by charge-coupled device (CCD) technology and has a target crystal in the form of a circular ring, and the photodetector unit provides an analog video signal sweep and generation the output of the television camera is a digital television signal, while the photodetector contains a photodetector region on the common crystal, a “ring” shift register, ending charge-voltage converter (BPS), moreover, on the photodetector region, the lines of photosensitive elements, alternating with the lines of light-shielded elements, are located along radial directions from the imaginary center of the circular ring to its outer periphery and the “ring” shift register located there, and the number of elements in each “ring” line of the photodetector region is equal to the number of elements in the “ring” shift register, and there are boards installed in the expansion slot on the server motherboard video matched via input / output channels, control and power with the server bus, containing a block for converting a “ring” frame into “rectangular” frames (BPCP), the input of which is connected to the output of the main memory block per frame, and the output to the “network” output ", And the number of" rectangular "frames corresponding to one current" circular "frame satisfies the ratio:

where γ _g is the horizontal angle of the field of view in degrees of the image observed by the operator, and this conversion itself is performed programmatically.

For the prototype [1], it is assumed that the photodetector block contains a “ring” scan video signal unit, as well as a signal processor and an analog-to-digital converter (ADC) connected in series, while the information input of the signal processor is connected to the output of the SPS of the photodetector, the first output of the “ring” block "Scan - to the control inputs of the photodetector area of the photodetector, the second output of the" ring "scan unit - to the control inputs of the" ring "register of the shift of the photodetector, the third output of the block of the" ring "ra Zwerth - to the synchronization input of the signal processor, the fourth output of the “ring” sweep block - to the ADC clock input.

We note an important circumstance, namely: in the television camera of the prototype [1], the video signal is formed in the “ring” raster when it is read from the photodetector in the single-element aperture mode.

The disadvantage of the prototype device of a computer system for panoramic observation is the lack of implementation of an effective exchange of image parameters.

The objective of the invention is the implementation in the "circular" raster of the television camera exchange vertical (transverse) resolution of the image on its sensitivity and, conversely, without introducing noise loss into the video signal by controlling the area of the reading aperture in the radial direction.

The problem in the inventive computer system for panoramic television surveillance is solved by the fact that in the prototype device [1], containing a series-connected television camera and a server, which is a node of a local area network, to which two or more personal computers of users are connected, the television camera forming “Ring” image raster, consists of sequentially located and optically connected panoramic lens and photodetector, as well as a “ring” p video signal wrappers and a signal processor and ADC connected in series, the photodetector made using CCD technology has a target crystal in the form of a circular ring and contains a photodetector region on the common crystal, a “ring” shift register ending in OCR, while on the photodetector region of the line of photosensitive elements alternating with rulers of light-shielded elements are located along radial directions from the imaginary center of the circular ring to its outer periphery and located there the “circular” shift register, and the number of elements in each “circular” line of the photodetector region is equal to the number of elements in the “circular” shift register, the information input of the signal processor is connected to the output of the SEC of the photodetector, the first output of the “circular” scan unit is connected to the control inputs the photodetector region of the photodetector, the second output of the “circular” scan unit to the control inputs of the “circular” register of the shift of the photodetector, the third output of the “circular” scan unit to the synchronization input of the signal processor RA, the fourth output of the “ring” sweep block is to the ADC clock input, and a video card is installed in the expansion slot on the server motherboard, coordinated via the I / O channels, control and power supply with the server bus, containing the block of the “ring” frame conversion into “Rectangular” frames (BPKP), the input of which is connected to the output of the random access memory block per frame, and the output is connected to the “network” output, and the number of “rectangular” frames corresponding to one current “ring” frame satisfies relation (1), introduced block regul radial aperture (BRRA), the information input of which is connected to the fifth output of the “circular” scan unit, the first synchronizing input of the BRRA - to the sixth output of the “circular” scan unit, the second synchronizing input of BRRA - to the seventh output of the “circular” scan unit, and the output BRRA - to the control input of the “circular” sweep block, while the first control input of the BRRA is the “Start” input of the television camera, the second control input of the BRRA is the input “Stop” of the television camera, and the computer is used as the server Operator, which are formed with the External commands the television camera, the "Start" and "Stop".

Comparative analysis with the prototype [1] shows that the inventive device of a computer system for panoramic television monitoring differs in that using the BRRA television camera, which is controlled by the server computer operator, in the “ring” raster, the photodetector aperture can be changed in radial direction (radial aperture) without introducing noise loss. A twofold increase in the area of the radial aperture provides a twofold increase in the image sensitivity, which is accompanied by a twofold decrease in its vertical sharpness, a fourfold increase in the area of this aperture - a fourfold increase in the image sensitivity with a fourfold decrease in the vertical sharpness, and so on. As a result, the image sensitivity is exchanged for its vertical resolution, which may be useful to the operator in detecting and recognizing objects.

The combination of known and new features for the claimed device is not known from the prior art, therefore, the proposed technical solution meets the criterion of novelty.

The exchange of image parameters is performed in the "ring" image raster. Therefore, this technical solution meets the criterion of the presence of an inventive step.

In FIG. 1 shows a structural diagram of the inventive device of a computer system for panoramic television surveillance; in FIG. 2 shows the circuit organization of the photodetector of a television camera; in FIG. 3 shows a fragment of this photodetector, illustrating the details of its design; in FIG. 4 shows the functional diagram of the BRRA, performing a double exchange of sensitivity for resolution; in FIG. 5 - diagrams explaining the implementation of this exchange.

The inventive computer system for panoramic television surveillance, see Fig. 1, comprises a television camera 1 and an operator computer 2 connected in series as a server, which is a local area network node to which two or more personal computers are connected in position 3, and a video card is installed on the server 2 motherboard to record “ ring "video signal into the RAM of the server and the conversion of" ring "frames into" rectangular "frames, and the number of" rectangular "frames corresponding to one current" ring "frame, satisfies the relation (1), and itself comprises a TV camera 1 sequentially disposed and optically coupled panoramic lens 1-1 and 1-2 photodetector; block 1-3 "ring" scan of the video signal connected in series with the signal processor 1-4 and the ADC 1-5, as well as BRRA 1-6, and the photodetector 1-2 has the shape of a circular ring (see Fig. 2, 3), which the lines of photosensitive and the lines of light-shielded elements of the photodetector region 1-2-1 are located along radial directions from the imaginary center of the circular ring to its outer periphery and the “circular” shift register 1-2-2 located there, ending in OCR 1-2-3 , and the number of elements in each “ring” line of the photodetector area 1-2-1 is equal to the number of elements in the “ring” shift register 1-2-2, while the information input of the signal processor 1-4 is connected to the output of the SPS of the photodetector 1-2, the first output of the unit 1-3 is connected to the control inputs of the photodetector areas 1-2-1 of the photodetector, the second output of the unit 1-3 - to the control inputs of the "circular" shift register 1-2-2 of the photodetector, the third output of the unit 1-3 - to the synchronization input of the signal processor 1-4, the fourth output of unit 1 -3 - to the clock input of the ADC 1-5, the fifth output of the unit 1-3 - to the information input of the ARB 1-6, the sixth output of the block 1-3 - to the first at the synchronizing input BRRA 1-6, the seventh output of the block 1-3 - to the second synchronizing input BRRA 1-6, the output of which is connected to the control input of the block 1-3, with the “Start” and “Stop” commands generated in the server computer 2, are fed to the external inputs of the same name of the television camera 1 and, respectively, to the first and second control inputs of the BRRA 1-6.

The panoramic lens 1-1 of the television camera, as in the prototype, is designed to form an optical image of a circular view (ring image). As a technical solution for a panoramic lens 1-1, which coincides with a similar solution for the prototype, a panoramic mirror-lens lens can be proposed, the design of which is patented in Russia by Russian specialists [2].

The angular field in the space of objects for this lens is 360 degrees in azimuth and can reach (75-80) degrees in elevation. The presence of a passive (non-informative) region in the center of the optical frame of the panoramic lens confirms the advisability of choosing the shape of the photodetector 1-2, as in the prototype, in favor of a circular ring.

Block 1-3 of the "circular" scan of the video signal, the signal processor 1-4 and the ADC 1-5 are made using a set of specialized microcircuits with a high level of integration and are no different from the blocks of the same name of the prototype.

BRRA 1-6 is designed to control in the photodetector 1-2 the area of its aperture in the radial direction, which was above called (indicated) by the term "radial aperture".

In FIG. 4 shows a functional diagram of BRRA 1-6, which implements a special case of adjusting the radial aperture, namely: changing its area by half. This circuit contains an RS-flip-flop at position 7, a D-flip-flop at position 8, the first element “And” at position 9, the second element “And” at position 10, the third element “And” at position 11, the fourth element “And” at position 12, the fifth element "AND" at position 13, the first element "OR" at position 14, the second element "OR" at position 15, the third element "OR" at position 16 and the fourth element "OR" at position 17.

Three-phase pulses (Ф1Р, Ф2Р, Ф3Р) of control of the "ring" register 1-2-2 in typical mode with a single-element aperture (see Fig. 5b-5g) are fed to the BRRA 1-6 information input in logical levels.

At the first synchronizing input BRRA 1-6 received frame synchronization pulses (CSI), and at the second synchronizing input - horizontal sync pulses (SSI). At the output of the D-flip-flop 8, a meander with a period of 2H is formed (see Fig. 5e).

From the external input of the television camera to the control inputs of the RS-trigger 7 receives computer commands, the characteristics of which are presented in table. one.

Note that these commands for external control of the television camera can be successfully formed as part of the video card

At the output of the BRRA 1-6, three-phase pulses (F1Р _output , Ф2Р _output , Ф3Р _output ) of control of the "ring" register 1-2-2 in the double-aperture mode are formed at logical levels (see Fig. 5e-5z).

It should be clarified that the signal of the second phase F2P _output (see Fig. 5g), which has a high logical level during the row period, provides the summation of the charge packets of adjacent annular rows and their storage in potential wells.

Signals of the first and third phases, i.e. F1R _out and F3R _out , see FIG. 5e and 5c, respectively, determine the physical isolation of the potential accumulation wells arising in the semiconductor structure from each other.

Note that the period of element-wise transfer of charges (T _e ) in the control signals of the “ring” register 1-2-3 of the photodetector does not change.

In order to further increase the sensitivity of a television camera, the multiplicity of the summation of charge packets in one element, performed in BRRA 1-6, can be increased, for example, to 64, by the necessary complication of its circuit, but without changes for the external control communication line and the characteristics of computer commands .

It is obvious that BRRA 1-6 can be performed as part of the block 1-3 "ring" scan video signal.

It is important to note that the summation of the charges cannot be an additional source of noise for the video signal at the output of the television camera.

Therefore, limiting the multiplicity of summation of the aperture determines only the acceptability of the proposed transverse definition of the image to the operator.

The device of a computer system for panoramic television surveillance (see Fig. 1) works as follows.

As in the prototype [1], it is assumed that the television camera 1 is installed in a fixed position, for example, using a photographic tripod (in Fig. 1 it is not shown).

In the initial state, at the inputs “Start” and “Stop” of the television camera 1, there are no control signals from the computer 2, i.e. these inputs have low logic levels.

The television camera 1, as in the prototype, operates in a single-element aperture of the video signal. The photodetector 1-2 of a television camera (see Fig. 2, 3) implements a “ring” scan of the charge image on the photodetector region 1-2-1, followed by element-by-element reading of the charge packets in the “ring” shift register 1-2-2 and forming on output BPZN 1-2-3 voltage of the video signal in analog form.

At the same time, in the interval of the forward course of the frame, the process of accumulation of charge packets occurs in proportion to the illumination of the panoramic plot, in photosensitive pixels of the photodetector region 1-2-1.

During a short period of the subsequent interval of the reverse rotation of the frame scan, a photo shutter opens, and the charges of all the "ring" lines involved in the accumulation are transferred (in one rotation step) to the screened from light pixels located in the same region 1-2-1.

Then the photo shutter closes, and in a new frame cycle, another charge “picture” is accumulated on the target, and the charge packets accumulated in the previous frame are transferred in radial directions to the periphery of the photodetector crystal, loading the “ring” register 1- in the reverse scanning interval, 2-2.

The analog video signal of a photodetector with a single-element aperture, as in the prototype, is further converted using a signal processor 1-4 and ADC 1-5 into a digital television signal (DTS) of the "ring" frame at the output of the television camera. Then, the DTS via the interface (for example, USB 2.0) is transmitted to the server computer 2, where the video information is recorded in its RAM memory per frame.

Suppose that, as in the prototype, the horizontal angle of the field of view (γ _g ) presented to the operator of the image should be 60 °. Then one sixth of each “ring” line from the “ring” frame is recorded in server 2, respectively, in one of the six arrays of RAM per frame.

As in the prototype, in server 2, using the BPC element that implements the functions assigned to it programmatically, the video signal is read with a single-element aperture, and as a result, the “ring” frame is converted into ordinary “rectangular” frames and the possibility of providing this information to output "network" of the server computer 2.

As a result, the digital video recording signal for each "ring" image frame is converted into m "rectangular" frames, which can be offered in the form of a selected sequence to the operators of personal computers 3 of the local computer network.

In our example, this sequence contains 6 different images, and the operator of each personal laptop 3 can select the image proposed by the server 2 and display it on the display screen.

Suppose that to detect or recognize an object of interest to the operator of computer 2, a lack of sensitivity of the television camera 2 is diagnosed.

Consider a special case of a situation where a doubled sensitivity will be sufficient.

Then the computer operator 2 sends a control signal in the form of a short-term logical “1” via the “Start” bus.

When the high level of this signal coincides with the rising edge of the CSI at the synchronizing input of the BRRA 1-6 (see Fig. 4), the RS-trigger 7 fires, i.e. at its inverse output, the logic level is set to “0”. Therefore, the output of the element "And" 10, the element "And" 11 and the element "And" 12 is also set a low logical level.

On the other hand, for horizontal sync pulses (SSI) in D-flip-flop 8, frequency is divided by two and a meander is formed with a period of 2H (see Fig. 5e).

Therefore, at the output of the BRRA 1-6, three-phase pulses (F1Р _output , Ф2Р _output , Ф3Р _output ) of control of the "ring" register 1-2-2 for the double-aperture mode are formed at logical levels (see Fig. 5e-5z).

As a result, the television camera 1 provides the formation of a video signal with a doubled radial aperture, which guarantees an increase in its sensitivity by a factor of two.

The "ring" frame of the video signal with a double aperture is further converted into 6 "rectangular" frames, which can be offered in the form of a selected sequence to computers 3 to the operators of the local area network in the same way as in the operation mode of a television camera with a single-element aperture.

To return the television camera to the single-element aperture mode, it is necessary to send a control signal in the form of a short-term logical “1” via the “Stop” bus.

Then the RS-trigger 7 will be returned to its original state, i.e. logical “1” will be restored on its inverse output, and the input three-phase pulses (see Fig. 5b-5d) will be fed without change to the output of the BRRA 1-6.

Note that the radial aperture control algorithm, the value of which needs to be multiplied by a factor of 4, 8, 16, 32, and 64 times, remains unchanged, but is implemented in BRRA 1-6, executed (compared to Fig. 4) differently and, obviously , more complicated functional diagram.

Currently, all the elements of the structural diagram of the device of a computer system for panoramic television surveillance mastered or can be mastered by domestic industry.

Therefore, the present invention should be considered as meeting the requirement for industrial applicability.

INFORMATION SOURCES

1. Patent of the Russian Federation No. 2545519. IPC H04N 7/00. The device of a computer system for panoramic television surveillance and the organization of a photodetector for its implementation. / V.M. Smelkov // B.I. - 2015. - No. 10.

2. RF patent No. 2185645. IPC G02B 13/06, G02B 17/08. Panoramic mirror lens. / A.V. Kurtov, V.A. Solomatin // B.I. - 2002. - No. 20.

Claims (3)

1. The device of the computer system of panoramic television surveillance with the implementation of the exchange of image parameters, containing a series-connected television camera and a server, which is a node of the local area network, to which two or more personal computers of users are connected, while the television camera, forming a "ring" raster image, consists of sequentially located and optically connected panoramic lens and photodetector, as well as a block of “ring” scan video signals ala and in series connected signal processor and analog-to-digital converter (ADC), moreover, the photodetector, made by the technology of charge-coupled devices (CCD), has a target crystal in the form of a circular ring and contains a photodetector region on the common crystal, a “ring” shift register, ending with a charge-voltage converter (BPS), while on the photodetector region, lines of photosensitive elements alternating with lines of elements shielded from light are located along radial directions from the imaginary center of the circular ring to its outer periphery and the “ring” shift register located there, and the number of elements in each “ring” line of the photodetector region is equal to the number of elements in the “ring” shift register, and the information input of the signal processor is connected to the output of the SEC of the photodetector , the first output of the “circular” scan unit to the control inputs of the photodetector area of the photodetector, the second output of the “circular” scan unit to the control inputs of the “ring” register of the photodetector shift, the third output of the “ring” scan block is to the synchronization input of the signal processor, the fourth output of the “ring” scan block is to the clock input of the ADC, and a video card is installed in the expansion slot on the server motherboard, coordinated via input / output channels, control and power with a server bus containing a block for converting a “ring” frame into “rectangular” frames (BPCP), the input of which is connected to the output of the RAM block per frame, and the output to the “network" output, and the number of "rectangular" frames corresponds to single one current "ring" frame, satisfies the relation:
$$n=\frac{360}{{\gamma }_g}$$

,
where γ _g is the horizontal angle of the field of view in degrees observed by the operator of the image, and this conversion is carried out programmatically, characterized in that a radial aperture adjustment unit (BRRA) is introduced, the information input of which is connected to the fifth output of the “ring” scan unit, the first synchronizing BRRA input - to the sixth output of the “circular” scan unit, the second synchronizing input BRRA - to the seventh output of the “circular” scan unit, and BRRA output - to the control input of the “circular” scan unit, the first control input of the BRRA is the “Start” input of the television camera, the second control input of the BRRA is the “Stop” input of the television camera, and the system operator’s computer is used as the server, in which the external control commands of the “Start” and “television” camera are generated and sent Stop". 2. The device of a computer system for panoramic television surveillance according to claim 1, characterized in that the BRRA of the television camera is made as part of the block of "ring" scan of the video signal. 3. The device of a computer system for panoramic television surveillance according to claim 1, characterized in that the commands for external control of the television camera are formed as part of the video card of the operator’s server computer.

Images