RU2699812C1 - Method for controlling the sensitivity of a television camera on a ccd matrix in conditions of complex illumination and/or complex brightness of objects, computer recording of a video signal and reproduction thereof - Google Patents

Method for controlling the sensitivity of a television camera on a ccd matrix in conditions of complex illumination and/or complex brightness of objects, computer recording of a video signal and reproduction thereof Download PDF

Info

Publication number
RU2699812C1
RU2699812C1 RU2018139594A RU2018139594A RU2699812C1 RU 2699812 C1 RU2699812 C1 RU 2699812C1 RU 2018139594 A RU2018139594 A RU 2018139594A RU 2018139594 A RU2018139594 A RU 2018139594A RU 2699812 C1 RU2699812 C1 RU 2699812C1
Authority
RU
Russia
Prior art keywords
video
accumulation
video signal
photodetector
interval
Prior art date
Application number
RU2018139594A
Other languages
Russian (ru)
Inventor
Вячеслав Михайлович Смелков
Original Assignee
Вячеслав Михайлович Смелков
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Вячеслав Михайлович Смелков filed Critical Вячеслав Михайлович Смелков
Priority to RU2018139594A priority Critical patent/RU2699812C1/en
Application granted granted Critical
Publication of RU2699812C1 publication Critical patent/RU2699812C1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225Television cameras ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, camcorders, webcams, camera modules specially adapted for being embedded in other devices, e.g. mobile phones, computers or vehicles

Abstract

FIELD: electronic equipment.
SUBSTANCE: invention relates to television equipment and is intended for use in television cameras made on the basis of matrix television sensors based on the technology of charge coupled devices (CCD), in which electronic adjustment of sensitivity is provided due to change of intraframe accumulation time. Result is achieved by the fact that the output register is made in the form of two adjacent linear registers acting alternately on the first two-channel CVMB in one direction or on the second two-channel CVMB in the opposite direction, wherein each of said linear registers comprises half the elements of the number of pixels for each photodetector row, and in order to optimize the selection of the accumulation mode of the CCD matrix, spatial rotation of the photoreceiver around the center point of its target is performed at angle of 90° (clockwise), changing spatial position of target from "landscape" to "book", generating a composite video signal "video 1" or "video 2" in accordance with two spatial positions of the CCD matrix. Operation of the television camera, recording of its video signal and its reproduction is carried out using computers integrated into a local computer network.
EFFECT: high sensitivity for fragments of the monitored image by increasing accumulation time for them during parallel arrangement of selection of their spatial position and with computer reconstruction of the formed image, as well as simultaneous implementation of saving power consumption of the photodetector.
1 cl, 10 dwg

Description

The present invention relates to television technology and is focused on the use in television cameras made on the basis of matrix television sensors using charge-coupled device (CCD) technology, in which electronic sensitivity adjustment is provided by changing the intraframe accumulation time.

At the same time, the operation of the television camera, the registration of its video signal and its playback is carried out using computers integrated into a local area network.

The closest in technical essence to the claimed invention should be considered a method of controlling the sensitivity of a television camera on a CCD matrix [1], which consists in the fact that on the target (storage section) of the CCD matrix with the organization of "personnel transfer" with the frame period accumulate information charges in accordance with control voltage for automatic adjustment of the accumulation time (ARVN), while the accumulation section of the CCD matrix is divided horizontally into n isolated targets with the same format, Some of them have simultaneously operating control of photo-reception and scanning processes, transfer information charges with a frame transfer frequency from the accumulation section to the memory section, transfer information charges from the memory section to the output register line by line in the reverse-scan interval, and transfer element-by-element in the forward-scan interval information charges from the output register to the output block of the CCD matrix with simultaneous conversion of the charge into a video signal voltage, moreover, in the storage section In the interval between the personnel transfer of the current frame and the accumulation cycle of the subsequent frame, excess charges are diverted to the photodetector substrate by technological organization of the anti-blooming region and the electronic shutter in the accumulation section, while the personnel transfer of information charges from the accumulation section to the memory section is carried out at the final interval of the backward interval frame sweep with the implementation of the corresponding time delay for the duration of the accumulation of information charges, and in the interval E the interval of the reverse stroke of the personnel scan prior to the transfer of information charges, the memory section is cleaned of stray charges by moving them with the frame transfer frequency to the output register or by removing them to the photodetector substrate by technological organization of the anti-blooming area and electronic shutter in the memory section, the magnitude of the control voltage ARVN and, accordingly, the duration of the accumulation of information charges per frame are determined separately for each of these separately target taken by the peak value of the video signal generated at the photodetector output during the corresponding time slot within a frame on the forward stroke.

Note that the prototype [1] the current download information charge packages the output register of the CCD matrix is performed within the time period, which in the television scan takes the interval τ o.h.s. - the duration of the reverse stroke on the line. The transfer of these charge packets along the output register and reading in the SPZN is carried out with a frequency of element-wise transfer ƒ e .

This method of sensitivity control is able to successfully solve the problem of adapting the photodetector to various illumination (brightness) of parts of the scene observed in the field of view of the camera, but only for those fragments that have this indicator over the entire height of the image.

Therefore, the prototype sensitivity control method [1] does not cope with the situation when fragments of a scene controlled with different illumination (brightness) have a length of the entire image width. Inevitably, a failure occurs in the implementation of the adaptation task and a deterioration in image quality throughout the frame.

This is due to the fact that under these conditions, the automatic accumulation time adjustment (ARVN) of the television camera, working on this sensitivity control signal, performs a voltage count for a single fragment using an amplitude detector according to the peak value of the video signal generated at the output of the photodetector. But it spreads its result, namely: the duration of the accumulation time, to all the elements (pixels) of this section, which it occupies on the target in height.

The disadvantage of the sensitivity control method in the prototype [1] is that there is a limited accumulation mode (in time) for those portions of the image that are observed at low illumination (brightness) of the objects corresponding to them, when their location in the field of view of the television camera is arbitrary.

The objective of the invention is to increase the sensitivity for fragments of a controlled image by increasing the accumulation time for them with parallel organization of the choice of their spatial position and with the computer reconstruction of the generated image, as well as the simultaneous implementation of energy saving of the photodetector.

The problem in the inventive method of controlling the sensitivity of a television camera on a CCD matrix, based on the fact that on the target (accumulation section) of the CCD matrix with the organization "personnel transfer", having a format (the ratio of the width of the section to its height) is more than one, with the frame period accumulate information charges in accordance with the control voltage for ARVN; the accumulation section of the CCD matrix is horizontally divided into n isolated targets of the same format, which have parallel operating control of photo-reception and scanning processes, transfer information charges with a frame transfer frequency from the accumulation section to the memory section shielded from light; line-by-line transfer information charges from the memory section to the output register in the interval of the reverse stroke line scan and in the interval of the forward horizontal scan, the information charges are transferred element-wise from the output register to the output block of the CCD matrix with the simultaneous conversion of the charge into the video signal voltage (CPS), and in the accumulation section in the interval between the frame transfer of the current frame and the accumulation cycle of the subsequent frame, excess charges are transferred to the substrate of the photodetector by technological organization of the anti-blooming region and the electronic shutter in the accumulation section, while the personnel transfer of information charges from section accumulation in the memory section is carried out at the final interval of the interval of the reverse motion of the frame scan with the corresponding time delay of the duration of accumulation of information charges, and in the interval of the interval of the reverse motion of the frame scan, prior to the transfer of information charges, the memory section is cleaned of stray charges due to their movement with the frequency of personnel transfer to the output register or due to their removal into the substrate of the photodetector by technological organization and the anti-blooming region and the electronic shutter in the memory section, while the value of the control voltage of the ARVN and, accordingly, the duration of the accumulation of information charges per frame are determined separately for each separately taken target from the peak value of the video signal generated at the output of the photodetector during the corresponding time interval within the direct course along frame, it is decided that in the output register of the CCD matrix the frequency of the element-wise transfer of charge packets ƒ e is reduced by half, and the output the register is made in the form of two adjacent linear registers, acting alternately on the first two-channel SPS in one direction or on the second two-channel SPS in the opposite direction, with each of these linear registers containing half the elements of the number of pixels for each photodetector, and in the interval τ about .kh.s charge both linear "registers sequentially in time and separately for the odd and even pixels of this line with charge packets of the current information line, and the number of phase electrodes for an individual pixel in both linear registers should be even, making an indicator of 2 or 4, and to optimize the choice of mode CCD array accumulations realize a spatial rotation of the photodetector around the central point of its target by an angle of 90 ° (clockwise), translating the spatial position of the target from “landscape” to “to lower ”, the composite video signal“ video 1 ”or“ video 2 ”is formed in accordance with the two spatial positions of the CCD matrix, the analog video signal is converted to the digital television signal at the output of the television camera, and the digital video signal“ video 1 ”and“ video 2 are alternately recorded for recording »To the input of the first and, accordingly, to the input of the second blocks of RAM per frame of the main computer, which is the server of the local area network, to which two or more personal computers of users are connected moreover, in the second block of the server’s memory, the image is additionally rewritten with its rotation by an angle of 90 ° (counterclockwise), forming the “2 * video” video signal, while personal computer operators are given access to read from the operational blocks upon the “Network” output of the server the server’s memory to the digital video signals “video 1” and “video 2 *”, as well as in addition to the digital array “video 3”, which is a computer reconstruction of the observed image performed by software.

Comparative analysis with the prototype [1] shows that the inventive method is characterized by the presence of the following features:

• selection of one of two possible spatial positions of the CCD by rotating its target through an angle of 90 ° relative to the previous position;

• providing computer access to two digital video data arrays for the same observable scene obtained with different modes of accumulation of informative charges by the CCD matrix, as well as access to the digital array of the reconstructed image.

• a new organization of the output register of the matrix photodetector equipped with two over-voltage sensors, with the implementation of element-wise transfer of charges along the output register in two opposite directions;

• saving energy consumption of the matrix photodetector by halving the frequency of the element-by-element transfer а e as well as by the new organization of its constituent blocks: the output register and the over-voltage protection device.

According to the claimed method, the output register consists of two parallel operating registers, and each of the two SPS is a two-channel unit. In this case, the charge signals will be recorded in the first or second overvoltage protection device in the correct phase ratio due to the choice of an even indicator for the number of phase electrodes as applied to an individual element of these registers.

It is important to note the following. From the monograph [2, p. 153] it is known that in an n-channel CCD with a cell size of 30 μm operating at a frequency of 1 MHz, a charge packet of 0.5 pC consumes a specific power of about 2.8 nW / cell. And this value grows like a square of the operating frequency!

When organizing such a control mode for element-wise transfer of charge packets for a CCD photodetector, the resolution of the video signal of the observed plot remains unchanged, and the power consumption of a television camera based on such a sensor is “braked”, compensating for all or part of the associated energy costs.

The combination of known and new features is not known from the prior art, therefore, the claimed method meets the requirement of novelty.

According to the technical result and the method of its achievement, the proposed technical solution meets the criterion of the presence of an inventive step.

In FIG. 1 shows a structural diagram of a computer system in which the inventive method is implemented; in FIG. 2 shows the circuitry organization of the photodetector of a television camera-matrix CCD frame transfer with four isolated targets (n = 4); in FIG. 3 shows two operating positions of the matrix photodetector in which a spatial rotation of the target through an angle of 90 ° is realized relative to each other; in FIG. 4 is a structural diagram of a device explaining the implementation of the proposed sensitivity control method and is, in fact, the design scheme of the new ARVN photodetector; in FIG. 5 is an example of a circuit diagram of a peak detector, three of which are accepted (indicated) in FIG. 3; in FIG. 6b-6d with respect to the temporary position of the blanking pulse of the rows shown in FIG. 6a, plots of control signals are shown for obtaining the necessary areas (“windows”) of photometric measurements of the charge relief of the photodetector; in FIG. 7b is a diagram illustrating the temporary position of the output signal of the ARVN device (relative to the frame blanking pulse shown in Fig. 7a); in FIG. Figure 8 shows a fragment of the cross section of the accumulation section or memory section of the CCD matrix, illustrating the physical processes that accompany the technological organization of the anti-blooming region and the electronic shutter in these sections of the photodetector; in FIG. 9a) and 9b) shows the position of the four “windows” of the photometry of the storage section of the CCD in the conditions of its complex illumination and / or complex brightness in relation to the two operating positions of the photodetector; in FIG. 10 is a diagram explaining the control of the first and second linear registers of the photodetector, in which the control of the element-wise transfer is carried out according to the claimed method.

Matrix 1 at the CCD (Fig. 1) with the organization "personnel transfer" is made on a silicon crystal and consists of sequentially charge-coupled storage sections 1-1-1, memory sections 1-1-2, the first linear register 1-1-3 - (1), the second linear register 1-1-3- (2), the first BPZN 1-1-4- (1) and the second BPZN 1-1-4- (2).

The dash-dotted lines in FIG. 2 show the selection of four isolated targets with the same format on the photodetector storage section 1-1-1, i.e. n = 4. We introduce the designation of these sensors, respectively, as: 1-1-1-1, 1-1-1-2, 1-1-1-3 and 1-1-1-4.

Similarly to the prototype [1], according to the first embodiment of the CCD matrix, each of these targets contains an anti-blooming region and an electronic shutter GA built into its semiconductor structure. According to the second embodiment of the CCD matrix, the anti-blooming area and the electronic shutter GB are additionally integrated in the memory section 1-2.

Note that the application of these technological features is due to the need to eliminate spurious charges in the photodetector under conditions of its light overloads. For a television camera, such overloads are often a concomitant phenomenon and observation in conditions of complex illumination and / or complex brightness of objects.

As shown in FIG. 8, the GA shutter is an “electronic” shutter of the accumulation section. For a photodetector with three-phase charge transfer in sections (storage and memory) and with an n-channel of conductivity, if the potential is low (relative to the substrate) on the GA gate, the latter is closed, and potential wells under the target phase electrodes are isolated from the drain region due to this barrier displacement. Then, at the photographic target itself, the process of accumulation of charge photoelectrons under the Ф2Н electrodes is initiated (see Fig. 8a).

When a high potential is applied to the GA gate, the potential barrier is removed, the gate opens, and the accumulation of photoelectrons is excluded on the target. This is explained by the fact that the carriers, not lingering in potential wells under the Ф2Н phase electrodes, rush into deeper wells created by the potential DA in the drain region, and then recombine into the photodetector substrate (see Fig. 8b).

Obviously, the “electronic” shutter GB with the anti-blooming area controlled by the DB potential is realized in exactly the same way when they are built into the memory section 1-1-2 around the phase electrodes Ф2П, as shown in FIG. 8.

For all four isolated targets of the CCD matrix 1, parallel control is applied, which ensures the process of the current accumulation of the charge relief in accordance with the duration specified by the output pulse at the input of the electronic shutter of the sensor of each target, i.e. through GA1, GA2, GA3 and GA4, as shown in FIG. 2.

The organization of this parallel control can be carried out by “multiplying” the pulse signals using external buffer stages for finished circuits that implement a set (set) of necessary control voltages.

The method for controlling the sensitivity of a television camera proposed in this technical solution can be implemented for two other technological options for a CCD matrix, i.e. for sensors manufactured according to the method of “line transfer” and “line-frame transfer” [3, p. 134-137]. In this case, the photodetector region of these devices, in which vertically arranged lines of photosensitive elements alternate with vertical lines of pixels isolated from light, should be technologically prepared in the same way as the accumulation section of the CCD matrix of personnel transfer, i.e. by dividing horizontally into n isolated targets of the same format, and the output register of these sensors is made in the form of two adjacent linear registers, acting alternately on the first two-channel OTZN or when changing the direction (reverse) of the element-wise transfer to the second two-channel OTZN.

Consider the previously announced block diagram of ARVN in FIG. 4. It contains a driver of 1-2 signals of "windows" for photometric sensor, sequentially connected to the first peak detector 1-3 and the first pulse-width modulator (PWM) 1-4, sequentially connected to the second peak detector 1-5 and the second PWM 1- 6, the third peak detector 1-7 and the third PWM 1-8 connected in series, as well as the fourth peak detector 1-9 and the fourth PWM 1-10 connected in series. The information inputs of all four peak detectors (1-3, 1-5, 1-7, 1-9) are connected to the output of the video detector 1-1, and the control inputs of these peak detectors are connected to the first, second, third, and fourth outputs of the former 1-2.

The fifth output of the shaper 2 is connected to the reset inputs of all four peak detectors (1-3, 1-5, 1-7, 1-9).

The output of block 1-4 is connected to the electronic shutter GA1 of target 1-1-1-1, the output of block 1-6 is connected to the electronic shutter GA2 of target 1-1-1-2, the output of block 1-8 is connected to the electronic shutter GA3 of target 1 -1-1-3, and the output of block 1-10 - to the electronic shutter GA4 of the target 1-1-1-4. It is assumed that in the television camera from its microcontroller to the input of the shaper 1-2 signals of the "windows" are triggered pulses and synchronization.

Shaper 1-2 is designed to implement four pulse signals (see Fig. 6b-6d), which are fed to the control inputs of the peak detectors. To receive these signals, a three-digit binary counter can be used [see, for example, 4, p. 168-170].

Broadcast through the former 1-2 from the microcontroller of the television camera, a positive-polarity frame sync pulse is supplied to perform at the beginning of each frame zeroing (reset) of all four peak detectors (1-3, 1-5, 1-7, 1-9).

Peak detectors are designed to record the maximum level of an analog video signal supplied to their information inputs in the interval of the presence of a high level of a pulse signal at their control inputs.

Each of the peak detectors can be made on the basis of two operational amplifiers (op amps) according to the scheme proposed in [5, p. 301]. A feature of the circuit shown in FIG. 3, is the selection of the first (input) op-amp. This op-amp must additionally have a control input for implementing external control of the reserve power and operating point using an external bias voltage. An example of such an op-amp is the CA3078T microcircuit manufactured by RCA (USA).

The pulse signals that must be supplied to the control inputs of all four peak detectors (1-3, 1-5, 1-7, 1-9) are shown in the time diagrams shown in FIG. 6b, 6c, 6d, 6d.

The output signals of the peak detectors 1-3, 1-5, 1-7, and 1-9 are the control voltages for blocks 1-4, 1-6, 1-8, and 1-10 of a pulse-width modulator (PWM), at the outputs of each from which a “stand-alone” digital accumulation signal will be generated (see Fig. 7b).

Note that this signal may vary during the frame from the maximum value of the reference

Figure 00000001
to its minimum countdown
Figure 00000002
depending on the magnitude of the input control voltage.

To fulfill its functional “duty”, a digital accumulation signal is fed to the control input of the sensor, which is its “electronic” gate GA.

It is obvious that such a process of optimized accumulation of charges on sections 1-1-1 of the CCD matrix, depending on the level of illumination of the monitored scene, will occur in parallel and on all four targets 1-1-1-1, 1-1-1-2-2, 1- 1-1-3 and 1-1-1-4 by control through the corresponding valves GA1, GA2, GA3 and GA4 (see Fig. 2).

A computer system (see Fig. 1), comprising a television camera in position 1, an operator's computer in position 2, which is a local area network server to which three personal computers are connected in position 3, works as follows.

Assume that in the television camera 1, the initial spatial position of the photodetector 1-1 at the CCD) corresponds to that shown in FIG. 2. Here, the CCD array occupies the position shown in FIG. 3a. This is the so-called "landscape" orientation of the target of our sensor relative to the controlled plot.

An optical image of the observed scene under conditions of complex illumination and / or complex brightness of objects is projected onto the accumulation section 1-1 of the CCD matrix, and, therefore, onto all four of its target components (1-1-1-1, 1-1-1- 2, 1-1-1-3, 1-1-1-4).

Let in our example shown in FIG. 9a, in the conditions of high illumination of the observed plot, the area occupied by the “Window” 1 appears; in low light conditions - “Window” 2; in conditions of medium low light - “Window” 3, and in conditions of significantly reduced light - “Window” 4.

In the forward range of each television frame, the process of optimized accumulation of charges in the photosensitive pixels of all four targets 1-1-1-1, 1-1-1-2, 1-1-1-3 and 1-1-1-4 takes place proportionally Illumination of a controlled plot.

During the interval of the subsequent interval of the reverse scan of the frame scan, the charges of all the lines involved in the accumulation are transferred to the light-shielded pixels located in memory sections 1-1-2.

Then, in the new personnel cycle, another charge “picture” is accumulated, and the charge packets accumulated in the previous frame are transferred from the memory section 1-1-2 to the periphery of the photodetector crystal, loading in the horizontal scan backward interval (τ f.h.s. ) new charges both linear registers. Note that in FIG. 2 loading gates are shown by thickened lines.

Let us consider in more detail the “mechanism” of charge loading using the time diagrams of the signals shown in FIG. 10.

In FIG. 10a shows a plot of a signal for a horizontal blanking pulse of a television scan, active during the interval τ o.h.s. with a period of lines T s .

In FIG. 10b, FIG. 10c shows pulse waveform plots controlling the loading gates of the second linear register 1-1-3- (2) and the first linear register 1-1-3- (1), respectively.

Note that the first linear register 1-1-3- (1) is universal, providing transfer of charge packets in two directions, namely, both along the register and across (through), i.e. into the cells of the second linear register 1-1-3- (2).

To implement the second function, additional electrodes are installed in the gaps between the register elements 1-1-3- (1), which have a pixel width, (they are indicated by a dotted line in Fig. 2), interconnected and connected to a constant voltage, the value of which is not less than the control charge transfer potential. These additional electrodes simultaneously fulfill another important role, namely: they exclude charge losses during transfer in the register 1-1-3- (1). For this reason, exactly the same additional electrodes are installed in the gaps between the elements of the register 1-1-3- (2).

In FIG. 10g, FIG. 10d shows diagrams of pulsed signals that control the operation of both linear registers in parallel with respect to a two-phase charge transfer charge system, where T e = 1 / f e is the period of element-wise transfer of charge packets.

In the interim

Figure 00000003
- the interval of the active pulse in FIG. 9b, through the open loading gate to the register 1-1-3- (2), the cells under the first phase electrodes will receive the charges of the first, third, fifth and other odd elements of this row.

And in the subsequent interval

Figure 00000003
- the interval of the active pulse shown in FIG. 10c, through an open gate, register 1-1-3- (1) will be loaded with charges into the cells under the first phase electrodes, but with reference to the second, fourth, sixth and other even elements of this row.

Note that in this time interval, the charge packets previously loaded into the linear register 1-1-3- (2) remain there “in their places”, while the potential wells of this register are in storage mode.

The charge packets of each line in each subsequent frame cycle are read element-wise in the first CPSU 1-1-4- (1), forming an analog video signal of the observed image at its output.

The technical result of the proposed solution is ensured by the fact that in a television camera the optimal indicators for the accumulation time (T n ) will be obtained in a fully automatic mode for all n sections of the target area of the CCD matrix.

Therefore, for this scene, as in the prototype [1], an increased signal-to-noise ratio (ψ) of the generated video signal and, accordingly, an increase in sensitivity for those portions of the image that are recorded at low illumination (brightness) of the objects corresponding to them, and that no less important - with the implementation of energy saving sensor.

Suppose that the conditions for the complex illumination of the observed scene and / or the complex brightness of the controlled objects have significantly changed from the position of spatial location. Namely, the fragments of images projected onto the accumulation section 1-1-1 from “vertically arranged” become fragments “horizontally arranged”.

Obviously, in this situation, the loss of sensitivity of the television camera on the CCD is inevitable due to an error in counting the accumulation time of the photodetector for fragments of images observed in low light conditions.

But the claimed method successfully overcomes this "situational" difficulty. For this, it is necessary to perform a spatial rotation of the photodetector around the center point of its target by an angle of 90 ° (in the counterclockwise direction). Obviously, the necessary rotation of the photodetector can be performed manually, and can be implemented remotely by the operator of the computer 2 using the command issued to the electromechanical guidance unit, which is part of the television camera 1 (see Fig. .1).

Then the CCD will occupy the spatial position shown in FIG. 3b. This will be the so-called “portrait” or “portrait” orientation of the target of our photodetector relative to the controlled plot.

As a result, for the sensor, the “windows” of photometrics become oriented in space not vertically, but horizontally, as shown in FIG. 9b.

In the considered example, in conditions of high illumination of the observed plot, the area occupied by the “Window” 4 appears there; in low light conditions - “Window” 3; under conditions of medium low light - “Window” 2, and in conditions of significantly low light - “Window” 1. Therefore, the accumulation time for each of these image fragments, due to the peak detection of the video signal, will be correct, i.e. realizing the desired increase in the sensitivity of the sensor.

Then, the first and second registers of the CCD matrix will alternately transfer charges in the opposite direction, i.e. in the direction of the second CPSU 1-1-4- (2), where they are similarly recorded in the form of another analog video signal, which is an alternative to the previous video signal.

As a result, the sensitivity of the photodetector will be increased. It should be noted that the reverse movement of charges in the registers and the introduction of a second SPS in the composition of the photodetector is necessary in order to avoid the “mirroring” of the generated image.

For the plot being monitored, the area of coincidence with respect to the two spatial positions of the photodetector storage section (see the target region in Fig. 3, marked with a dotted line) is the inverse of the target of the format of the target. For a 4: 3 target format, it is 75%, and for a 16: 9 target format, just over 56%.

Obviously, the larger this indicator, the potentially higher technical result can be obtained for the proposed solution. But a 100% match rate only occurs for the target format of the CCD matrix equal to 1: 1.

On the other hand, target formats 4: 3 and 16: 9 are more common in television technology, and this compromise is quite appropriate.

But back to continuing to review the operation of the television camera 1.

From the initial (initial) image signals generated at the first and second outputs of the Video detector 1-1, the composite analog video signals “video 1” and “video 2” are formed in the video processor of the television camera. And then they are converted at the camera output into alternately operating digital television signals - respectively, “video 1” or “video 2”.

Next, the digital video signals are alternately transmitted via the interface (for example, USB 2.0) to the main computer 2 (operator's computer), which is a server of the local area network. In this server, each of the digital video signals is recorded in its own random access memory block, while for “video 2” in the second memory block, the image is additionally overwritten with a rotation of 90 ° (counterclockwise). Denote this new digital video array as “2 * video”.

Personal computer operators 3, upon the “Network” output of server 2, are given access to the digital video signals “video 1” and “video 2 *” read out from the RAM blocks.

The presence of these digital video signals allows you to get additional information in the main computer 2 by implementing a computer reconstruction of the observed image, performed by software in the ratio:

Figure 00000004

Where

Figure 00000005
- pixel samples of the current video signal at the output of the reconstructed image;

Figure 00000006
- pixel counts of images “video 1” or “video 2 *”, selected by the criterion of the largest and undistorted (unlimited) magnitude of the current video signal within the spatial coincidence area of these images.

Note that the digital video 3 array can also be provided to all computer users 3.

Currently, all the elements of the circuit organization of the CCD array photodetector, as well as the blocks and elements of the commented block diagram of the ARVN sensor device that implements the proposed method for controlling the sensitivity of a television camera, computer recording a video signal and reproducing it, are mastered or can be mastered by the domestic industry.

Therefore, the alleged invention should be considered as meeting the requirement for industrial applicability.

INFORMATION SOURCES

1. Patent of the Russian Federation No. 2670420. IPC H04N 5/00. A method for controlling the sensitivity of a television camera on a CCD in complex light conditions and / or complex brightness of objects. / V. M. Smelkov // B.I. - 2018. - No. 30.

2. Seken K., Thompset M. Instruments with charge transfer. Translation from English - "The World", 1978.

3. Vlado Damianowski. CCTV. Bible CCTV. Digital and network technology. Translation from English - M .: "IS-ES Press", 2006.

4. Tokheim R. Fundamentals of Digital Electronics. Translation from English - M.: “World”, 1988.

5. Peyton A. J., Walsh V. Analog electronics on operational amplifiers. Translation from English - M.: “BINOM”, 1994.

Claims (5)

1. A method for controlling the sensitivity of a television camera on a CCD matrix in conditions of complex illumination and / or complex brightness of objects, computer recording of a video signal and its playback, which consists in the fact that on the target (accumulation section) of the CCD matrix with the organization "personnel transfer", having the format (the ratio of the width of the section to its height) is greater than one, with a period of frames, information charges are accumulated in accordance with the control voltage for automatic adjustment of the accumulation time (ARVN), while the section The CCD array coverage is divided horizontally into n isolated targets of the same format, which have parallel operating control of photo-reception and scanning processes, transfer information charges with a frame transfer frequency from the accumulation section to the memory section, and transfer information charges from the memory section to the output line by line the register in the interval of the reverse stroke horizontal scanning, and in the interval of the direct stroke of the horizontal scanning of information-wise transfer information charges from the output register to the output an additional charge-to-video-signal voltage conversion unit (CPS), moreover, in the accumulation section, in the interval between the frame transfer of the current frame and the accumulation cycle of the subsequent frame, excess charges are transferred to the photodetector substrate by technological organization of the anti-blooming area and the electronic shutter in the accumulation section, while transfer of information charges from the accumulation section to the memory section is carried out at the final interval of the interval of the reverse motion of the frame scan with the execution corresponding the total time delay of the duration of the accumulation of information charges, and in the interval of the reverse frame retracement interval, preceding the transfer of information charges, the memory section is cleaned of stray charges by moving them with the frame transfer frequency to the output register or by removing them to the photodetector substrate by means of technological organization of the anti-blooming area and the electronic shutter in the memory section, while the control voltage of the ARVN and, accordingly, the duration of the charge of information charges per frame are determined separately for each individual target by the peak value of the video signal generated at the output of the photodetector during the corresponding time interval within the forward stroke of the frame, characterized in that in the output register of the CCD matrix the frequency of the element-wise transfer of charge packets ƒ e reduced by half, and the output register itself is made in the form of two adjacent linear registers, acting alternately on the first two-channel overhead protection device in one direction or in the second two-channel SPR in the opposite direction, with each of these linear registers containing half the elements of the number of pixels for each photodetector line, and in the interval t 0-xc. they charge both linear registers sequentially in time and separately for the odd and even pixels of this line with charge packets of the current information line, and the number of phase electrodes for an individual pixel in both linear registers should be even, amounting to 2 or 4, and to optimize the choice of the accumulation mode CCD matrices realize the spatial rotation of the photodetector around the central point of its target by an angle of 90 ° (clockwise), translating the spatial position of the target from “landscape” to “pr “”, form the composite video signal “video 1” or “video 2” in accordance with the two spatial positions of the CCD matrix, convert the analog video signal to the digital television signal at the output of the television camera, and transmit the digital video signal “video 1” and “video 2 alternately "To the input of the first and, accordingly, to the input of the second blocks of RAM per frame of the main computer, which is the server of the local area network, to which two or more personal computers of users are connected, In the second block of the server’s memory, they additionally rewrite the image by rotating it by an angle of 90 ° (counterclockwise), generating a “2 * video” video signal, while personal computer operators are given access to read from the main memory blocks upon the “Network” output of the server server output digital signals "video 1" and "video 2 *", and also in addition to the digital array "video 3", which is a computer reconstruction of the observed image, performed programmatically by the ratio:
Figure 00000007
Where
Figure 00000008
- pixel samples of the current video signal at the output of the reconstructed image;
Figure 00000009
- pixel counts of images “video 1” or “video 2 *”, selected by the criterion of the largest and undistorted (unlimited) magnitude of the current video signal within the spatial coincidence area of these images.
2. The sensitivity control method according to claim 1, characterized in that the spatial rotation of the photodetector at an angle of 90 ° and vice versa in the television camera is performed remotely by the command of the operator of the main computer.
RU2018139594A 2018-11-08 2018-11-08 Method for controlling the sensitivity of a television camera on a ccd matrix in conditions of complex illumination and/or complex brightness of objects, computer recording of a video signal and reproduction thereof RU2699812C1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
RU2018139594A RU2699812C1 (en) 2018-11-08 2018-11-08 Method for controlling the sensitivity of a television camera on a ccd matrix in conditions of complex illumination and/or complex brightness of objects, computer recording of a video signal and reproduction thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
RU2018139594A RU2699812C1 (en) 2018-11-08 2018-11-08 Method for controlling the sensitivity of a television camera on a ccd matrix in conditions of complex illumination and/or complex brightness of objects, computer recording of a video signal and reproduction thereof

Publications (1)

Publication Number Publication Date
RU2699812C1 true RU2699812C1 (en) 2019-09-11

Family

ID=67989534

Family Applications (1)

Application Number Title Priority Date Filing Date
RU2018139594A RU2699812C1 (en) 2018-11-08 2018-11-08 Method for controlling the sensitivity of a television camera on a ccd matrix in conditions of complex illumination and/or complex brightness of objects, computer recording of a video signal and reproduction thereof

Country Status (1)

Country Link
RU (1) RU2699812C1 (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4087833A (en) * 1977-01-03 1978-05-02 Reticon Corporation Interlaced photodiode array employing analog shift registers
US4811106A (en) * 1986-05-16 1989-03-07 The General Electric Company, P.L.C. Frame transfer image sensor having two vertical clock standards
US5028970A (en) * 1987-10-14 1991-07-02 Fuji Photo Film Co., Ltd. Image sensor
US5309240A (en) * 1991-01-18 1994-05-03 Nec Corporation CCD linear image sensor including a CCD shift register on both sides of linearly arranged photosensor cells
US7239757B2 (en) * 2003-04-29 2007-07-03 Microsoft Corporation System and process for generating high dynamic range video
US20110019071A1 (en) * 2009-07-23 2011-01-27 Ryosuke Amano Image pickup apparatus and image pickup method
US20110096216A1 (en) * 2009-09-10 2011-04-28 Fujifilm Corporation Imaging pickup device and image pickup method
US20110242378A1 (en) * 2010-04-02 2011-10-06 Sony Corporation Solid-state imaging device, driving method of solid-state imaging device, and electronic apparatus
EP2368226B1 (en) * 2008-12-19 2016-06-15 QUALCOMM Incorporated High dynamic range image combining
RU2670420C1 (en) * 2017-12-18 2018-10-23 Вячеслав Михайлович Смелков Method of controlling the sensitivity of a television camera on a ccd matrix under conditions of complex illumination and/or complex brightness of objects

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4087833A (en) * 1977-01-03 1978-05-02 Reticon Corporation Interlaced photodiode array employing analog shift registers
US4811106A (en) * 1986-05-16 1989-03-07 The General Electric Company, P.L.C. Frame transfer image sensor having two vertical clock standards
US5028970A (en) * 1987-10-14 1991-07-02 Fuji Photo Film Co., Ltd. Image sensor
US5309240A (en) * 1991-01-18 1994-05-03 Nec Corporation CCD linear image sensor including a CCD shift register on both sides of linearly arranged photosensor cells
US7239757B2 (en) * 2003-04-29 2007-07-03 Microsoft Corporation System and process for generating high dynamic range video
EP2368226B1 (en) * 2008-12-19 2016-06-15 QUALCOMM Incorporated High dynamic range image combining
US20110019071A1 (en) * 2009-07-23 2011-01-27 Ryosuke Amano Image pickup apparatus and image pickup method
US20110096216A1 (en) * 2009-09-10 2011-04-28 Fujifilm Corporation Imaging pickup device and image pickup method
US20110242378A1 (en) * 2010-04-02 2011-10-06 Sony Corporation Solid-state imaging device, driving method of solid-state imaging device, and electronic apparatus
RU2670420C1 (en) * 2017-12-18 2018-10-23 Вячеслав Михайлович Смелков Method of controlling the sensitivity of a television camera on a ccd matrix under conditions of complex illumination and/or complex brightness of objects

Similar Documents

Publication Publication Date Title
US10685993B2 (en) Imaging device and imaging system
US9137472B2 (en) Solid-state imaging device and camera system
US9838654B2 (en) Solid-state imaging device, driving method, and electronic device
US20160248956A1 (en) Imaging apparatus, signal processing method, and program
US8896738B2 (en) Solid-state image pickup device and signal processing method therefor
US10498994B2 (en) Solid-state imaging element and camera system
US8878959B2 (en) Solid-state imaging device, signal processing method of solid-state imaging device, and electronic apparatus
US9185369B2 (en) Solid state imaging device
US10044947B2 (en) Electronic apparatus and driving method therefor
US8896735B2 (en) Solid-state imaging device and camera system
US10136090B2 (en) Threshold-monitoring, conditional-reset image sensor
US10291871B2 (en) Imaging apparatus, imaging system, imaging apparatus driving method, and imaging system driving method using pixels outputting signal based on at least part of photoelectric conversion units
US9942482B2 (en) Image sensor with transfer gate control signal lines
CN102469241B (en) Imaging apparatus, radiation imaging system, and control method of image sensor
US20150035030A1 (en) Solid-state imaging apparatus for causing an fd capacitor value to be variable without increasing a number of elements
EP0862829B1 (en) An image sensor with high dynamic range linear output
CN101262565B (en) Imaging method, imaging apparatus, and driving device
CA2034471C (en) Apparatus and method reading data from a solid state x-ray detector
US9407847B2 (en) Solid state imaging apparatus and imaging system with writing memory selecting unit and reading memory selecting unit for outputting signals in an order of spatial arrangement
EP0571908B1 (en) Apparatus and method for generating an interlaced video signal using a progressively scanned high resolution image sensor
US9148590B2 (en) Imaging apparatus with reference signals having different rate of change first and second pixels having same color
CN101990070B (en) Solid-state image sensing device, analog-digital conversion method of solid-state image sensing device, and electronic apparatus
US7528878B2 (en) Solid state image device and camera using it
JP2019169984A (en) Imaging device and image acquisition device
EP3145174B1 (en) Solid-state imaging apparatus and imaging system