RU2524576C1 - Method for panoramic television surveillance and device for realising said method - Google Patents

Abstract

FIELD: radio engineering, communication.

SUBSTANCE: method includes generating a first analogue image signal within a photodetector target except an inner portion thereof and concurrently generating, in a television camera, a second analogue image signal for a smaller annular region of optical space monitored by a panoramic lens, frequency- and phase-synchronisation of a second video signal with a first video signal, converting said analogue signals to digital form, generating a multiplexed digital video signal consisting of first and second digital video signals, transmitting the multiplexed video signal via an interface to a server, where the input signal is divided (demultiplexed) on two channels and the panoramic image is converted to an ordinary image.

EFFECT: larger area of the annular region of optical space actively monitored by an operator by using two photodetectors in the television camera while maintaining current resolution and element-by-element reading rate.

7 cl, 7 dwg

Description

The present invention relates to panoramic television surveillance, which is performed by a television system using a television circular camera in an area close to the hemisphere, i.e. in a spatial angle of 360 degrees in azimuth and tens of degrees in elevation.

The closest in technical essence to the claimed invention should be considered a method of panoramic television surveillance [1], which consists in installing the television camera in a fixed position, performing image capture in a television camera with an angular field in the space of objects 360 degrees in azimuth, formed in a television the camera an analog image signal of the observed space, convert the analog video signal to a digital video signal, transmit the video signal of the panoramic panoramic image Using the interface in the server, the video signal is recorded in the server’s RAM, the panoramic television image is converted into a regular image in the server, and one current “ring” frame is read from the server’s memory using n “rectangular” frames, the number of which satisfies the ratio:

$$n=\frac{360}{{\gamma }_g},\text{(one)}$$

where γ _g is the horizontal angle of the field of view in degrees observed by the operator of the image.

The disadvantage of the prototype is the limitation on the area for a ring image controlled by the operator, due to insufficient indicators for resolution and speed of element-wise reading of the photodetector of a television camera.

The objective of the invention is to increase the area of the annular region actively controlled by the operator of the optical space due to the use of two photodetectors in the television camera while maintaining the same performance in terms of resolution and speed of element-wise reading.

The problem is solved in that in the claimed method of panoramic television surveillance, which consists in installing the television camera in a fixed position, performing image capture in a television camera with an angular field in the space of objects 360 degrees in azimuth, form the first analog image signal in the television camera of the observed space, the first analog video signal is converted to the first digital video signal, the video signal of the panoramic panoramic image is transmitted space on the interface to the server, the first digital video signal is recorded in the server’s RAM, the panoramic television image is converted into a normal image in the server, and one current “ring” frame is read from the server’s memory using n “rectangular” frames, the number of which satisfies the ratio ( 1), according to the invention, the first analog image signal is generated within the target of the photodetector with the exception of its inner portion, and in parallel is formed in a television camera at least a second analog image signal for a smaller annular optical region controlled by a panoramic lens synchronizes the second video signal with the first video signal in frequency and phase, converts the second analog video signal into a second digital video signal, and multiplex a digital video signal consisting of the first and second digital video signals transmit the multiplex video signal through the interface to the server, perform separation (demultiplexing) of the input video in the server Ignal through two channels, respectively, for the first and second video signals of a television camera, record the second video signal in another random access memory of the server, convert the panoramic image of this area to a normal image in the server, while reading the current second “ring” frame from the server’s memory is performed similarly using n "Rectangular" frames in relation (1).

The problem in the inventive device for panoramic television surveillance, designed to implement the claimed method, is solved by the fact that the prototype device [1], containing a series-connected television camera and a server, which is a local area network node to which two or more personal computers are connected, this prototype television camera consists of sequentially located and optically coupled panoramic lens and a digital television signal sensor (yes sensor, and a video card is installed in the expansion slot on the motherboard of the prototype server that is matched via the I / O, control and power channels with the server bus, containing a block for converting a “ring” frame into “rectangular” frames (BPCP), the input of which is connected to the output of the RAM block per frame, and the output to the “network” output, and this conversion itself is carried out programmatically, a beam splitter, a second PZT sensor synchronized in frequency and phase with the first sensor are introduced into the prototype television camera a DSC comm on the receiver synchronization signal (MSC), as well as a multiplexer, the first information input of which is connected to the output of the first DTC sensor, the second information input of the multiplexer is connected to the output of the second DTC sensor, the multiplexer synchronization input is the output of the frame clock pulses of the first DTC sensor, and the output the multiplexer is the output of the “video” of the television camera, and a video signal demultiplexer and a second BPKP are introduced into the video card of the prototype server, while the input of the beam splitter is optically connected to the optical pano frame an amine lens, the first output of the beam splitter with the target of the photodetector of the first PZT sensor, and the second output of the beam splitter with the target of the photodetector of the second PZT sensor, the input of the second BPKP is connected to the output of the additional (second) memory block per frame, and the output to the output of “network” moreover, the operation of demultiplexing the input video signal and converting the "ring" frame into "rectangular" frames in the second BPCB is performed programmatically.

Comparative analysis with the prototype shows that the inventive method is characterized by the presence of new features, namely the presence of the following actions:

- the formation of the first analog image signal within the entire array of the target of the photodetector, but excluding a certain area located inside this target;

- parallel formation in the television camera of a second digital video signal for a reduced annular region of the optical space controlled by a panoramic lens;

- the formation of the output of the "video" television camera multiplex video signal consisting of the first and second digital video signals;

- demultiplexing the input video signal in the server through two channels corresponding to the first and second video signals of the television camera;

- recording the second "ring" frame of the video signal in the additional RAM memory of the server;

- reading the current second “ring” frame from the server’s memory.

The combination of known and new features is not known from the prior art, therefore, the claimed method meets the requirement of novelty.

Comparative analysis with the prototype shows that the claimed device is different:

- the presence of new structural elements, which include: a beam splitter, a second DTC sensor and a multiplexer as part of a television camera;

- a form of performing new elements, which are the demultiplexer and the second BPC, which are implemented programmatically as part of the video server board.

The combination of known and new features of the claimed device is not known from the prior art, therefore, the proposed technical solution meets the criterion of novelty.

In the claimed solution, operators of personal computers connected to the server can be presented with an enlarged series of “rectangular” frames of television images that record a large area of the annular region of the optical space, and therefore carry new video information.

Therefore, the proposed solution meets the criterion of the presence of an inventive step.

Figure 1 shows the structural diagram of the inventive device that implements the inventive method; figure 2, according to [2], presents a photograph of an image obtained using a domestic panoramic mirror-lens lens; figure 3 shows a ring image perceived by the first sensor of the DTS of the television camera; figure 4 schematically shows a panoramic image of this annular region, proposed to the operator of a personal computer, in the form of a sequence of 6 "rectangular" frames; Figures 5 and 6 show a ring image perceived by the second DTC sensor of a television camera and, accordingly, a panoramic image for the operator of the computer for this ring region, containing in the same way a sequence of 6 "rectangular" frames; 7 shows a beam splitter device for two versions of its design.

The inventive panoramic television monitoring device, see figure 1, contains a series-connected television camera 1 and a server 2, which is a local area network node to which two or more personal computers are connected in position 3, while the television camera 1 consists of sequentially located and optically coupled panoramic lens 1-1 and a beam splitter 1-2, the first output of which is optically connected to the target of the photodetector of the first sensor TsTS 1-3, and the second output of the beam splitter to the target of the photodetector the second sensor TsTS 1-4, which is synchronized in frequency and phase with the first sensor TsTS 1-3 by the synchronization signal of the receiver (SSP), while the output of the first sensor TsTS 1-3 is connected to the first information input of the multiplexer 1-5, the second information the input of which is connected to the output of the second TsTS sensor 1-4, the synchronization input of multiplexer 1-5 is to the output of the frame sync pulses of the first TsTS 1-3 sensor, and the output of multiplexer 1-5 is the video output of television camera 1, and on the server motherboard 2 installed video card lnyayuschaya programmatically division multiplex input video signal into two channels of the digital image signal, respectively, "video 1" and "video 2", these video signals in the recording server RAM and transformation "ring" frames in "rectangular" frames.

The panoramic lens 1-1 of the television camera, as in the prototype, is designed to form an optical image of a circular view (ring image). As a technical solution for the panoramic lens 1-1, which coincides with the similar solution for the prototype, a panoramic mirror-lens lens can be proposed, the design of which is patented in Russia by Russian specialists from Moscow State University of Geodesy and Cartography [2].

A photograph of the annular image formed by the panoramic lens is shown in FIG. The angular field in the space of objects for this lens is 360 degrees in azimuth and can reach (75-80) degrees in elevation.

The beam splitter 1-2 is designed to parallelize the optical image from the output of the panoramic lens 1-1 on the target of each of the two sensors DTS.

A beam splitter 1-2 with a mutually perpendicular arrangement of the targets of the sensors 1-3 and 1-4 contains (see Fig. 7a) a translucent mirror 1-2-1, the input of which is the input of the beam splitter, and the first and second outputs of the translucent mirror are respectively the first and the second outputs of the beam splitter.

The beam splitter 1-2 with mutually parallel arrangement of the targets of the sensors 1-3 and 1-4 contains (see Fig.7b) sequentially located and optically connected translucent mirror 1-2-1 and a reflecting mirror 1-2-2, and the input of the translucent mirror is the input of the beam splitter, and the output of the reflecting mirror and the second output of the translucent mirror are the first and second outputs of the beam splitter, respectively.

In the future, a specialized technical solution for a television panoramic lens with an integrated lens, i.e. in it blocks 1-1 and 1-2 are made in one optical device.

The target of the photodetector of the first sensor TsTS 1-3, as in the prototype, should be inscribed in the vertical size of the optical frame of the panoramic lens 1-1. The resolution of this matrix photodetector directly depends on the horizontal angle of the field of view of the image observed by the operator of the personal computer (γ _g ). The smaller the value of γ _g , the higher the required number of matrix elements horizontally and vertically. Considering that the geometric dimensions of the optical frame of today's panoramic lens coincide with the frame sizes of a standard film, it is necessary to recognize these requirements as extremely high.

Modern megapixel arrays of charge-coupled devices (CCD matrices) have an explicit limitation on the clock speed of the phase electrodes of the output register: the maximum polling frequency of an element (pixel) does not exceed 40 MHz. Hence, the frame rate of the panoramic image observed by the operator of the personal computer should be taken much lower than 50 Hz, which is not always permissible due to the introduction of additional distortions of the video signal during registration of dynamic scenes.

Therefore, the variable read speed mode in the CCD matrix proposed in [3, p. 103] becomes relevant, which allows the redistribution of the read frequencies within one frame to improve the read quality of some image fragment at the cost of deteriorating the read quality of the rest of the array of elements or its section. For example, this obviously necessary fragment of the image is read with optimal speed, i.e. actively, and therefore a useful video signal is generated for it. On the other hand, the obviously useless portion of the image is read at maximum speed or passively, because this leads to the physical elimination of the process of generating a video signal. This solution provides compression of the generated video signal by reducing the bandwidth of transmitted frequencies and a compromise distribution of the compression ratio between the television camera and server.

It is necessary to recognize another condition, namely: a further increase in the resolution of CCD matrices is limited by the production capabilities of their technology, which in many respects approaches physical limits.

However, the rapidly evolving technology for the production of matrices based on complementary metal-oxide-semiconductor structures (CMOS matrices) may well fix this situation in the near future, because the maximum allowable pixel sampling frequency in these photodetectors has already exceeded 100 MHz [4].

The target of the photodetector of the second PZT 1-4 sensor should capture an optical ring image, which is not used when generating the video signal by the photodetector of the first PZT 1-2 sensor. It is obvious that the target format of the photodetector of the second DTC sensor will be smaller than the target format of the photodetector of the first DTC sensor with the same geometric dimensions of their matrix pixels.

Multiplexer 1-5 is designed to combine two video signals onto a single trunk using time division. The electric circuit of multiplexer 1-5 can be performed on operational amplifiers with an external variable bias type CA3078T from RCA (USA) according to the technical solution, which is given in [5, p.295]. The digital multiplex image signal generated at the output of the television camera 1, which contains the “video 1” and “video 2” signals obtained from the sensors 1-3 and sensor 1-4 as components.

The demultiplexing (separation) function of the “video 1” and “video 2” signals is implemented on the video server board.

There, the conversion of the “annular” image frame formed by the second sensor 1-4 into “rectangular” frames is also performed. Note that the read operation of these "rectangular" frames includes software correction of geometric distortions of the corresponding section of the panoramic image in the same way as in the prototype for the image from the first sensor 1-3.

The method of panoramic television surveillance is as follows. We use the scheme of the claimed device for panoramic television surveillance (see figure 1) that implements the claimed method.

A television camera 1, comprising a panoramic lens 1-1, a beam splitter 1-2, a first sensor PZT 1-3, a second sensor PZT 1-4 and a multiplexer 1-5, is installed in a fixed position, for example using a photographic tripod (in figure 1 it not shown). Assume that the targets of the photodetectors of sensors 1-3 and 1-4 have a 1: 1 format and are mutually perpendicular to each other, then the optical beam splitter 1-2 contains only a translucent mirror 1-2-1, as shown in Fig. 7a.

Using a beam splitter 1-2, the annular optical image from the output of the panoramic lens 1-1 is projected simultaneously on the target of the photodetector of the first sensor 1-3 and on the target of the photodetector of the second sensor 1-4.

The photodetector of the first sensor 1-3 generates an analog video signal by reading pixels on a target inscribed in height by the diameter of the ring image, while element-by-element reading is excluded on the area of the target area located inside this target. In Fig. 3, the boundaries of the target of the photodetector of the sensor 1-3 are shown by a dashed line, and the passive region of the target is indicated by oblique hatching.

The target of the photodetector of the second sensor 1-4 is inscribed in height in this vertical dimension of the passive region of the target of the photodetector of the sensor 1-3, as shown in Fig.5. The dashed line in this figure marks the boundaries of the target of the photodetector of sensor 1-4. The photodetector of this sensor reads with optimum speed all the pixels on the target without exception. Therefore, it undergoes a “light-to-signal” transformation and a circular portion of an annular optical image that does not carry any optical information.

The analog video signal of the first sensor 1-3 is further converted into a digital image signal "video 1", and the analog video signal of the second sensor 1-4 is converted into a digital image signal "video 2". Then, thanks to multiplexer 1-5, both video signals on a single communication line are transmitted using a standard interface (for example, USB 2.0) to the input of server 2. On the video server board, the incoming multiplex video signal is divided into two channels, respectively, for “video 1 "And" video 2 "and the recording of each of these ring images in the blocks of RAM.

Suppose that the current angle of view (γ _g ) of the presented panoramic image is 60 degrees horizontally, then the “ring” recording frame for “video 1” includes 6 (six) conditional areas (see figure 3), and the “ring” the recording frame for "video 2" also includes 6 conditional areas (see figure 5). In figure 5, these areas for the "ring" frame "video 2" overlap, because It is desirable to provide video recording while maintaining a constant indicator of image resolution.

The digital video recording signal for each "ring" image frame is converted into n "rectangular" frames, which can be offered in the form of a selected sequence (see Fig. 4 or Fig. 6, respectively) to the operators of the local area network. In our example, these two sequences contain 12 different images.

We assume that the personal computers 3 that make up this network are laptops containing a motherboard with a processor and RAM installed on it, as well as a hard disk, display, keyboard and touchpad - a pointing device used instead of the mouse ". The operator of each laptop 3 can select the image proposed by the server 2 image and its output to the display screen.

The technical result of the invention is that the laptop operator, in comparison with the prototype, offers an increased sequence of images transmitting an increased area of the controlled optical space.

Obviously, the same technical result will be obtained if in the design of the television camera the targets of the photodetectors of sensors 1-3 and 1-4 are mutually parallel relative to each other, and the beam splitter 1-2 contains a translucent mirror 1-2-1 and a reflecting mirror 1- 2-2, as shown in figb.

Currently, all the elements of the structural diagram of a panoramic television monitoring device that implement all the actions according to the claimed method and determine the claimed device, mastered or can be mastered by domestic industry. Therefore, the present invention should be considered as meeting the requirement for industrial applicability.

Information sources

1. RF patent No. 2371880, IPC H04N 7/00. The method of panoramic television surveillance and device for its implementation. / B.M. Smelkov // B.I. - 2009. - No. 30.

2. RF patent No. 2185645, IPC G02B 13/06, G02B 17/08. Panoramic mirror lens. / A.V. Kurtov, V.A. Solomatin // B.I. - 2002. - No. 20.

3. Khromov L.I., Tsytsulin A.K., Kulikov A.N. Video informatics. Transfer and computer processing of video information. - M.: “Radio and Communications”, 1991.

4. Berezin V.V., Umbitaliev A.A., Fakhmi Sh.S., Tsytsulin A.K., Shipilov N.N. Solid State Revolution in Television: Television systems based on charge-coupled devices, systems on a chip, and video systems on a chip / Ed. A.A. Umbitalieva and A.K. Tsytsulina - M.: “Radio and Communications”, 2006.

5. Lenk J. Electronic circuits: a practical guide. Translation from English - M .: "World", 1985.

Claims (7)

1. The method of panoramic television surveillance, which consists in installing the television camera in a fixed position, performing image capture in a television camera with an angular field in the space of objects 360 degrees in azimuth, generating the first analog image signal of the observed space in the television camera, converting the first analog video signal to the first digital video signal, transmit the video signal of the panoramic panoramic image of the observed space via the interface to the server, records the first digital video signal is added to the server’s RAM, the panoramic television image is converted into a regular image in the server, and one current “ring” frame is read from the server’s memory using n “rectangular” frames, the number of which satisfies the ratio:

where γ _g is the horizontal angle of the field of view in degrees of the image observed by the operator, characterized in that the first analog image signal is formed within the target of the photodetector except for its inner portion, and in parallel, a second analog image signal is generated in the television camera for a smaller ring region of the optical spaces controlled by a panoramic lens, synchronize in frequency and phase the second video signal with the first video signal, convert the second analog video the signal into the second digital video signal, a multiplex digital video signal is formed, consisting of the first and second digital video signals, the multiplex video signal is transmitted via the interface to the server, the input video signal is split (demultiplexed) in two channels, respectively, for the first and second video signals of the television camera, the second is recorded video signal to another random access memory of the server, the panoramic image of this area is converted into a normal image in the server, while reading The current second “ring” frame from the server’s memory is carried out similarly using n “rectangular” frames in relation (1). 2. A panoramic television surveillance device comprising a television camera and a server connected in series to a local area network node to which two or more personal computers are connected, the television camera consisting of sequentially located and optically connected panoramic lens and a digital television signal sensor (sensor CTS), and a video card is installed in the expansion slot on the server motherboard, coordinated through the I / O, control and power channels communication with the server bus, which contains a block for converting a “ring” frame into “rectangular” frames (BPKP), the input of which is connected to the output of the main memory block per frame, and the output to the output “network”, and this conversion is carried out programmatically, which differs by the fact that a beam splitter, a second PZT sensor, synchronized in frequency and phase with the first PZT sensor by the receiver synchronization signal (SSP), as well as a multiplexer, the first information input of which is connected to the output of the first PZT sensor, is introduced into the television camera , the second information input of the multiplexer is to the output of the second PZT sensor, the synchronization input of the multiplexer is to the output of the frame sync pulses of the first PZT sensor, and the output of the multiplexer is the output of the “video” television camera, and a video signal demultiplesor and a second BPC are introduced into the video server board, with the input the beam splitter is optically coupled to the optical frame of the panoramic lens, the first beam splitter output is connected to the target of the first DTC sensor, and the second beam splitter output is to the target of the second sensor CTS, the input of the second BPCP is connected to the output of the additional (second) memory block per frame, and the output is connected to the “network” output, and the operation of demultiplexing the input video signal and converting the “ring” frame into “rectangular” frames in the second BPCP is performed by software. 3. The panoramic television observation device according to claim 2, characterized in that the beam splitter contains a translucent mirror, the input of which is the input of the beam splitter, and the first and second outputs of the translucent mirror, respectively, the first and second outputs of the beam splitter. 4. The panoramic television observation device according to claim 2, characterized in that the beam splitter contains sequentially located and optically coupled translucent mirror and a reflecting mirror, the input of the translucent mirror being the input of the beam splitter, and the output of the reflecting mirror and the second output of the translucent mirror, respectively, the first and second beam splitter outputs. 5. The panoramic television surveillance device according to claim 2, characterized in that the panoramic lens and the beam splitter are made in one optical device. 6. The panoramic television observation device according to claim 2, characterized in that the photodetectors of the first and second PZT sensors are made on charge-coupled arrays (CCD matrices) or on matrices with a complementary metal-oxide-semiconductor structure (CMOS matrices). 7. The panoramic television monitoring device according to claim 2, characterized in that the target format of the photodetector of the second PZT sensor is smaller than the target format of the photodetector of the first PZT sensor with the same geometric dimensions of their matrix pixels (image elements).

Images