RU2706008C1 - Computer system for panoramic scanning of a monochrome image - Google Patents

Abstract

FIELD: television scanning.

SUBSTANCE: invention relates to panoramic television scanning, which is carried out by a computer system using a television camera in a region close to the hemisphere, i.e. in spatial angle of 360 degrees in azimuth and tens of degrees on elevation angle. Scanner sensor is a single-line "circular" photodetector of a monochrome (black-and-white) image, made using the technology of complementary "metal-oxide-semiconductor" (CMOS) structures. Control of ADC of active pixels of sensor target is performed from corresponding output of "circular" scanning multiplexer, wherein the television camera further includes a dimmer-setting cell based on an electrochromic device which transmits the light flux from the output of the panoramic lens to the sensor target or is isolated from the light flux by the control signal from the corresponding output of the "circular" multiplexer, which is simultaneously a control signal for the sensor mechanical scanning unit.

EFFECT: high degree of integration of a television camera.

4 cl, 7 dwg

Description

The alleged invention relates to panoramic television scanning, which is carried out by a computer system using a television camera in an area close to the hemisphere, i.e. in a spatial angle of 360 degrees in azimuth and tens of degrees in elevation. The sensor of this scanner is a single-line “ring” photodetector of monochrome (black and white) image, made using the technology of complementary metal-oxide-semiconductor structures (CMOS).

The closest in technical essence to the claimed invention should be considered the device of a computer system for panoramic scanning of a monochrome image [1], containing a series-connected television camera and a server, which is a node of a local area network, to which two or more personal computers are connected, while a television camera, forming a “circular” raster of the scanned image, contains in its composition sequentially located and optically connected panoramic objects a beam and a “ring” photodetector (sensor), which is made using the technology of charge-coupled devices (CCD) and contains on its crystal a “ring” single-line photodetector region, a “ring” photocell, a “ring” output register and a charge-voltage conversion unit "(LPR), moreover, the" circular "photodetector is kinematically connected with the mechanical scanning unit of the sensor, which carries out its stepwise movement in the perpendicular direction relative to the fixed image plane of the panoramic lens; the television camera also includes a “single-line” ring scan unit of the video signal and a signal processor and an analog-to-digital converter (ADC) connected in series, the output of which is the output of the television camera, the first output of the scanner being connected respectively to the control inputs of the “ring” photodetector area of the sensor and its “ring” photo shutter, the second output of the scanner to the control inputs of the “ring” output register of the sensor, the third output of the scanner to the synchronous input signal processor, the fourth output of the scanner to the ADC clock input, the fifth output of the scanner to the synchronization input of the mechanical scanning unit of the sensor, and the control input of the scanner to the exposure control output of the signal processor; a video card is installed in the expansion slot on the server’s motherboard, matched via the I / O, control and power channels with the server bus, containing a block for converting a “ring” frame into “rectangular” frames (BPKP), the input of which is connected to the output of the RAM block on frame, and the output to the output of the "network", and the number of "rectangular" frames n, corresponding to one current "ring" frame for the cycle of mechanical scanning of the sensor, satisfies the ratio:

where γ _g is the horizontal angle of the field of view in degrees of the image observed by the operator, and this conversion itself is performed programmatically.

In the prototype, by stepping a single-line “ring” photodetector stepwise a line width in a direction that is perpendicular to the fixed plane of the image of the panoramic lens, the mode of operation of the original scanner with increased resolution of the generated image is realized.

The disadvantage of the prototype is the limited degree of integration of the television camera due to the applied CCD technology for the manufacture of its “ring” sensor, which in principle does not allow placing an electronic “framing” of the photodetector on the crystal.

Here, this term specifically refers to a block set including a block of “ring” single-line scanning of a video signal, a signal processor, and an ADC.

The objective of the invention is to increase the degree of integration of a television camera by performing a single-line "ring" sensor using CMOS technology and placing an electronic "frame" of the photodetector on its chip.

The problem in the inventive device of a computer system for panoramic image scanning is solved by the fact that, as in the prototype device [1], which contains a series-connected television camera and a server, which is a local area network node to which two or more personal computers are connected, while The television camera, which forms the “annular” raster of the scanned image, contains in its composition sequentially located and optically connected panoramic lens and the “annular” a photodetector (sensor) containing an “annular” single-line photodetector area (target) and kinematically coupled to a mechanical scanning unit of the sensor, which moves it stepwise across the width of the line in the perpendicular direction relative to the fixed image plane of the panoramic lens; a video card is installed in the expansion slot on the server’s motherboard, matched via the I / O, control and power channels with the server bus, containing a control panel, the input of which is connected to the output of the RAM block per frame, and the output to the “network” output, and the number “Rectangular” frames n, corresponding to one current “ring” frame for the cycle of mechanical scanning of the sensor, satisfies the relation (1), but at the same time, unlike the prototype [1], the sensor itself is made on a crystal made by CMOS technology by real of the “coordinate addressing” method, and the single-line “ring” target of the sensor consists of active photodiode pixels, each of which has an analog video signal amplifier with a gain of K, as well as an integrated ADC, and the blocks performing scanning and are placed on the common photodetector crystal generating an output voltage of a digital video signal, namely: a “ring” video switch containing video switches for each active pixel of the target, which are controlled according to the corresponding output of the “ring” scan multiplexer and ensure the transmission of the video signal to the “ring” video bus, the output of which is the “Video” output of the photodetector and at the same time the output of the television camera, the ADC of the active pixels of the sensor target being controlled from the corresponding output of the “ring” scan multiplexer, and a light-regulating cell, which is made on the basis of an electrochromic device, is installed in the rear section of the panoramic object, as part of the television camera willow and performs transmission of luminous flux at the sensor target or its isolation from this light flux on a control signal output from the corresponding "ring" of the multiplexer, which is also the control signal and to block the mechanical scanning sensor.

In relation to the prototype [1], the claimed device is distinguished by CMOS technology instead of the CCD for the manufacture of a single-line "ring" photodetector and the method of "coordinate addressing" of its organization. Thanks to the first fundamental difference, it is possible to integrate into a common chip not only a photodetector with an ADC and an amplifier for each of its photosensitive pixels, but also a horizontal scanning unit, which can be realized with a significant reduction in the total energy consumption.

The second fundamental difference is that the formation of a digital video signal directly in each active pixel of the sensor eliminates the inevitable dragging of the charge for a single-line CCD sensor along the entire line, and therefore avoids the specific distortions associated with the inefficiency of transferring charge packets.

This means that CMOS photodetectors can realize a higher polling frequency that exceeds the charge packet read frequency in single-line CCD sensors, or at the same polling frequency, significantly increase the number of pixels per line, and as a result, achieve an adequate gain in the resolution of the device.

The composition of the television camera of the claimed device introduced a new unit, namely: a light control cell that performs the functions of a "ring" photo shutter as applied to light fluxes, and not to charge image packets, as in the prototype [1].

The combination of known and new features of the claimed device is not known from the prior art, therefore, the proposed technical solution meets the criterion of novelty.

In the inventive device, by stepwise moving a new “ring” photodetector to a line width in a direction that is perpendicular to the fixed image plane of the panoramic lens, the scanner operates with a potentially high resolution and in digital image format.

Therefore, the claimed technical solution meets the criterion of the presence of an inventive step.

In FIG. 1 shows a structural diagram of the claimed invention - a computer system for panoramic scanning of a monochrome image; in FIG. 2 - circuit design organization of a new photodetector of a television camera; in FIG. 3 is the details of this organization as applied to region “A” marked in FIG. 2 dotted line; in Fig 4 and 5, respectively, the design and typical transmission characteristic of the light control cell; in FIG. 6, according to [2], presents a photograph of an image obtained using a domestic panoramic mirror-lens lens; in FIG. 7 - a panoramic image proposed to the operator in the form of a sequence of 6 “rectangular” frames.

The inventive computer system for panoramic television monitoring (see Fig. 1) contains a series-connected television camera 1 and server 2 (with a video card installed in it), which is a local area network node, with the ability to connect two or more personal computers to it in position 3.

The television camera 1 contains sequentially located and optically coupled panoramic lens 1-1, a light control cell 1-4 and a single-line "ring" photodetector 1-2, made according to CMOS technology, on the chip of which there is a "ring" single-line (see Fig. 2) photodetector area 1-2-1, a “ring” 1-2-2 video switch and a “ring” sweep 1-2-3 multiplexer. The television camera also includes a mechanical scanning unit 1-3 of the sensor, which, being kinematically connected with the photodetector 1-2, carries out its mechanical scanning (in increments of line width) in the perpendicular direction relative to the fixed image plane of the panoramic lens 1-1.

The single-line “ring” sensor 1-2 implements the coordinate addressing method when generating a video signal. Consider its implementation in relation to a single pixel 1-2-1 of the target having a photosensitive area 1-2-1-1, an amplifier 1-2-1-2 of an analog video signal and ADC 1-2-1-3.

The digital video signal of the current pixel from the output of the ADC 1-2-1-3 using "its" key MOS transistor of the switch 1-2-2-1, controlled from one of the outputs of the "ring" multiplexer 1-2-3, is transmitted to ring "bus video 1-2-2-2, and then broadcast on it to the output of the sensor. In the interval of reading information of the entire line, the same formation of a digital video signal occurs for all active pixels of the target of the "ring" photodetector 1-2.

As in the prototype [1], the video card in server 2 performs the following operations programmatically:

- recording the “ring” video signal sequentially line by line in the server’s RAM in automatic mode;

- reading the "ring" frame from the RAM using n "rectangular" frames, the number of which satisfies the relation (1).

The digital video signal of the current pixel from the output of the ADC 1-2-1-3 using "its" key MOS transistor of the switch 1-2-2-1, controlled from one of the outputs of the "ring" multiplexer 1-2-3, is transmitted to ring "bus video 1-2-2-2, and then broadcast on it to the output of the sensor.

In the interval of reading information within the entire line, the same formation of a digital video signal occurs for all active pixels of the target of the "ring" photodetector 1-2.

The panoramic lens 1-1 of the television camera, as in the prototype [1], is intended to form an optical image of a circular view ("ring" image).

As a close example of its technical solution, we can consider a panoramic mirror-lens lens, the design of which was patented in Russia by Russian specialists from Moscow State University of Geodesy and Cartography [2].

A photograph of the annular image formed by the panoramic lens is shown in FIG. 6. The angular field in the space of objects for this lens is 360 degrees in azimuth and can reach (75-80) degrees in elevation.

The light control cell 1-4 is designed for controlled abrupt changes in the irradiation of the target of the sensor 1-2 and can be performed according to technology [3] based on an electrochromic device.

The light control cell 1-4 (see Fig. 4) consists of two plane-parallel glasses 2.5 mm thick, interconnected in a cuvette so that a gap of the order of 0.1-0.2 mm filled with electrochromic material is formed between the inner surfaces of the glasses EHM-11. The inner surfaces of the glasses are coated with a conductive coating and form electrodes, the terminals of which are located outside the cell.

The light characteristic of cell 6 (see Fig. 5) is determined by the properties of the electrochromic liquid. The change in the transmittance from τ _max (70%) to τ _min (1 ÷ 1.5%) for the cell is τ _max / τ _min = 70 ÷ 150 when a constant voltage U is applied to the terminals, the value of which is about 1.2 V .

It is important to note that the physical speed of the change in the transmittance of such a cell makes it possible to control the parameter with a frequency of up to 50 Hz.

As shown in FIG. 1, cell 1-4 is installed in the rear segment of the lens 1-1, but for reasons of design decision of the television camera can be installed at its input. It should be added that when designing the optical scheme of a television camera, it is advisable to consider the technological feasibility of combining (integrating) the cell and the lens by creating a monolithic optical unit.

Block 1-3 of the mechanical scanning of the sensor is designed to perform step-by-step movement of the photodetector 1-2 with an interval of distance equal to the width of one "ring" line.

When the photodetector 1-2 is in a static (stationary) state, charge accumulation in the photosensitive pixels of its “ring” target 1-2-1 is carried out. At the same time, the transmittance of the light-regulating cell 1-4 is maximum, ensuring the collection of information charges in the 1-2 photodiodes of the sensor.

When the accumulation interval ends, the transmittance of the light control cell 1-4 abruptly decreases to a minimum, isolating the target of the sensor 1-2, and remains so throughout the entire interval of movement of the photodetector 1-2 in one step.

The duration of the accumulation of charges of the information line is determined by the illumination of the controlled object and the sensitivity of the photodetector 1-2. Given that mechanical scanning of the sensor is essentially slower than electronic, the television camera 1 can rightly be called a low-frame television camera.

The device of a computer system for panoramic scanning of a monochrome image (see Fig. 1) works as follows. The television camera 1 is placed on a tripod (in Fig. 1 it is not shown).

Panoramic lens 1-1 forms an “annular” optical of the controlled scene, projecting it through a dimmer cell 1-4 onto the target 1-2-1 of the television camera photodetector.

Photodetector 1-2 (see Fig. 2) implements a “ring” single-line scan of the charge image on the target and the formation of a digital video voltage at the output of the sensor 1-2.

Via the interface (for example, USB 2.0), the digital video signal of the “ring” line of the photodetector 1-2 will be transmitted to the RAM of server 2 when the photodetector itself is moved stepwise by the pixel width of this line.

As a result, video information about the “ring” frame obtained using the “scanner” recording of the “ring” lines constituting it will be recorded in the RAM of server 2.

Assume that, as in the prototype [1], the horizontal angle of the field of view (γ _g ) of the presented panoramic image is 60 degrees.

Then it should be provided that one sixth of each "ring" line from the "ring" frame is recorded in server 2, respectively, in one of the six arrays of RAM per frame.

Suppose that the total number of “ring” lines in a “ring” frame is m. The mechanical scanning of the sensor determines the mode of formation of the "ring" frame as slow, i.e. small frame.

Therefore, the required recording time of all m lines in server 2 will be several seconds, but it is completely justified by the achieved result - maintaining a constant indicator of the elevation angle of the circular view and optimizing the photodetector for such a review.

After the recording of the last line of the “ring” frame is completed, the block 1-3 of mechanical scanning of the sensor by the reversal signal, as in the prototype [1], returns back to its original position.

And then in server 2, using the BKPP element that implements the functions assigned to it programmatically, a video signal is read, and as a result, the “ring” frame is converted into ordinary “rectangular” frames of broadcast television and the ability to provide this information at the “network” output server 2.

Therefore, the digital video recording signal for this and each subsequent “ring” image frame will be converted into 6 “rectangular” frames, which can be offered as a selected sequence (see Fig. 7) to computer operators 3.

Currently, all the elements of the structural diagram of the device of a computer system for panoramic scanning of a monochrome image are mastered or can be mastered by domestic industry.

Therefore, the alleged invention should be considered as meeting the requirement for industrial applicability.

INFORMATION SOURCES

1. RF patent No. 2579002. IPC H04N 7/00. The device of a computer system for panoramic scanning of a monochrome image. / V.M. Smelkov // B.I. - 2016. - No. 9.

2. RF patent No. 2185645. IPC G02B 13/06, G02B 17/08. Panoramic mirror lens. / A.V. Kurtov, V.A. Solomatin // B.I. - 2002. - No. 20.

3. Development of light control cells and the technological process of their manufacture. Technical on the topic "Baltic". Novgorod (Veliky Novgorod), 1979.

Claims (7)

1. The device of a computer system for panoramic scanning of a monochrome image, containing a television camera and a server connected in series to a local area network, to which two or more personal computers are connected, the television camera forming a “ring” raster of the scanned image contains consisting of sequentially located and optically coupled panoramic lens and a “ring” photodetector (sensor) containing a “ring” single-line photodetector emnuyu region (target) and kinematically coupled with the mechanical scanning of the sensor unit, which carries on its incremental line width in perpendicular direction relative to the fixed plane of the panorama image of the lens; a video card is installed in the expansion slot on the server’s motherboard, coordinated via input / output, control and power channels with the server bus, containing a block for converting a “ring” frame into “rectangular” frames (BPCP), the input of which is connected to the output of the RAM block on frame, and the output to the output of the "network", and the number of "rectangular" frames n, corresponding to one current "ring" frame for the cycle of mechanical scanning of the sensor, satisfies the ratio:

where γ _g is the horizontal angle of the field of view in degrees observed by the operator of the image, and this conversion itself is performed programmatically, characterized in that the sensor itself is made on a crystal made using the technology of complementary metal-oxide-semiconductor structures (CMOS) by implementing the "coordinate addressing" method, and the single-line "ring" sensor target consists of photodiode active pixels, each of which has an analog video signal amplifier with a gain of K, as well as a built-in analog-to-digital converter (ADC), while blocks that perform a scan and output formation are placed on the common photodetector chip voltage of the digital video signal, namely: a “ring” video switch containing video switches for each active pixel of the target, which are controlled from the corresponding output of the “ring” scan multiplexer and transmit the video signal to the “ring” video bus, the output of which is the “Video” output "The photodetector and simultaneously the output of the television camera, and the ADC of the active pixels of the sensor target is controlled from the corresponding output of the" ring "multiplexer aperture, and a light control cell is added to the television camera, which is based on an electrochromic device, is installed in the rear segment of the panoramic lens and transmits the light flux from the output of the panoramic lens to the sensor target or isolates it from this light flux by the control signal from the corresponding output "Ring" multiplexer, which is also a control signal for the mechanical scanning unit of the sensor. 2. The device of the computer system according to claim 1, characterized in that the target electrodes for the photodetector of the television camera are made with a geometric shape in the form of a part of a circular ring. 3. The device of the computer system according to claim 1, characterized in that the photodetector of the television camera is made as part of a mechanical scanning unit of the sensor. 4. The device of the computer system according to claim 1, characterized in that the light control cell of the television camera is integrated with the panoramic lens into the optical unit.

Images