JPS61198879A - Television signal processor - Google Patents

Abstract

PURPOSE:To prevent the effect of an image pickup of a blur of a TV camera from being given onto a picture by providing an image pickup means, a means applying A/D conversion to the output, a picture memory, and a movement detecting means and using the output of the movement detecting means so as to control the location to be read in reading a part of the content of the pattern memory. CONSTITUTION:The image pickup tube 4 is activated by a synchronizing signal Sy generated from a synchronizing signal generating circuit 6 and scans the scanning range 3. The image pickup output is used as it is when an analog memory is used for the frame memory 5 and digitized when a digital memory is used therefor, and the result is written in the frame memory 5. The data is read together with the write from the frame memory 5 and the signal before one frame at just the same location as the picked up by the image pickup tube 4 is read in the timing of the same mode II. The signal written in the frame memory, that is, the M-th frame signal and the signal read from the frame memory, that is, (M-1)th frame signal are inputted to the movement detection circuit so as to dynamic vector between the frames.

Description

DETAILED DESCRIPTION OF THE INVENTION Field of Industrial Application The present invention relates to an apparatus for processing a video signal 1 captured by a television camera (hereinafter referred to as a TV camera).

Conventional technology Traditionally, T
V-cameras are in practical use. In a TV camera, the optical image of the subject is photoelectrically converted using an image pickup tube or image pickup plate, and the output is passed through a matrix circuit to obtain a luminance signal and a color signal, and these signals are converted into a composite image signal such as NTSC or PAL and sent to the outside. Send.

Problems to be Solved by the Invention This TV camera is operated by a cameraman when used for broadcasting, and by a general consumer when used for home use. There are not many problems when operating a TV camera while fixed on a tripod, etc., but when a general consumer who is not familiar with the handling of a TV camera tries to hold the camera still and take an image by hand-held shooting, there is a problem of "hand-held shooting". "Break" occurs, and at this time T
When you view the output signal of the V camera on a monitor TV,
The image vibrates vertically and horizontally, resulting in an extremely unsightly image.

Furthermore, even in the case of signals used for broadcasting operated by experts,
In the case of marathon broadcasts, etc., when images of runners are captured by a TV camera mounted on a broadcast vehicle, vibrations caused by the running of the car can be
This is transmitted to the V camera and causes large vertical movements in the image, resulting in an unsightly image.

In addition, with portable VTRs (Ii: NG) used for news gathering, the same problem with camera play occurs when a cameraman takes pictures while running, making it practically impossible. The present invention solves these problems. However, it is an object of the present invention to provide a video signal processing device that performs signal processing such that even when an image is captured by a TV camera with camera shake, the influence does not occur on the image.

Means for Solving the Problems The present invention provides a first television scanning system in which the number of scanning lines is N1, the frame period is TF1, and the horizontal scanning period is TH.
an imaging means operated by a second scanning system with a horizontal scanning period of TH/KV and a scanning range expanded by KH times in the horizontal direction and Kv times in the vertical direction; and means for A/D converting the output of the imaging means. , a screen memory stores the output of the imaging means digitized by the A/D conversion means for a plurality of surfaces, and the movement of the entire lli surface is detected by comparing the contents of the screen memory with the screen being imaged. When a portion of the contents of the screen memory is read out, the location from which the contents are read is controlled by the output of the motion detection means.

According to the present invention, with the above configuration, even when an image is captured by an imaging means that is subjected to motion that is harmful to the image, it is possible to obtain an image free of the influence of the motion. That is, the imaging means is being scanned by the second telescope. This scans a wider range by Kv times in the vertical direction and KH times in the horizontal direction compared to the first television scanning system which is to be obtained as the final output.

The second scanning system, that is, the image by wide scanning is A/D.
converted and stored in screen memory. This screen memory can store multiple screens. If the imaging means moves during imaging, the image being captured will move relative to the image stored in the screen memory. This movement is detected by the movement detection means. The first television scanning system scans a part of the screen of the second television scanning system, but when reading from the screen memory, this reading range is moved according to the movement detected by the motion detection means. For example, an image that is moving in the second television scanning system appears stationary in the first television scanning system.

Therefore, the first television scanning system NTsC1P
If the television signal processing method of the present invention is applied as a standard method such as AL, even if a subject is imaged with a television camera that is subject to harmful motion, the image will be captured as if it were a stationary NTSC or PAL television camera. You can get an image that looks like it was made.

Embodiment Before describing a specific embodiment, an outline of the operating principle will be explained with reference to FIG.

Consider a case where an image pickup tube is used as the image pickup device.

In FIG. 2, reference numeral 1 indicates the target of the image pickup tube, and the range indicated by 2 is the scanning range required when transmitting a normal television signal. Therefore, a normal NTSC TV camera can cover this range with a horizontal scanning frequency of 15.7.
34KH2, vertical scanning frequency 69.9an, scanning line 526
Scanning is performed with a book (excluding blanking period to be exact).

In contrast, the present invention attempts to scan the range indicated by 3 on the target 1, and after signal processing, transmit the range indicated by 2. Furthermore, the position of range 2 within range 3 is 2'
It shall be possible to move freely as follows. The direction and amount of movement are determined so as to follow unnecessary movement of the image within range 3 caused by vibration of the camera during imaging. As a result, even if the image moves within range 3, range 2
The transmitted image is obtained assuming that the image is at a fixed position within the image.

FIG. 1 shows an embodiment of the present invention. 4 is an image pickup tube, 6 is a frame memory capable of storing three images, 6 is a synchronization signal generation circuit, and 7 is a motion detection circuit.

The image pickup tube 4 is operated by a synchronizing signal 5y2 (second scanning system) generated by a synchronizing signal generating circuit 6, and scans the scanning range 3. This image pickup output is written into the frame memory 5 as it is if it is an analog memory, or is digitized and written into the frame memory 5 if it is a digital memory. The operating timing of the frame memory at this time is called mode (2). FIG. 3 shows an explanatory diagram of the operation timing of the frame memory. In this figure, M-M+3 indicates the frame number. When imaging the Mth frame, this frame is written into the frame memory 5 at the same time. Reading from the frame memory 5 is performed at the same time as writing, and in this case, the signal of one frame before the position exactly at the same position as the position being imaged by the image pickup tube 4 is read out at the same timing in mode (2). The signal written in the frame memory, that is, the M frame signal, and the signal read out from the frame memory, that is, (M-1
) frame signals are input to a motion detection circuit 7, and motion vectors between these frames are determined.

The motion detection circuit has a buffer memory corresponding to the capacity of a small part of the screen, and relatively moves the position of the blocks in one frame among the small blocks in the two frames to determine the position and direction where the correlation is greatest. The motion vector is detected by calculating the motion vector.

For such small blocks, motion vectors may be calculated at several positions within one frame, and the motion of the entire screen may be detected using majority logic.

As described above, at the timing of the captured frame A(M), it is determined "in which direction and by how much distance" the frame M has moved compared to the frame (M-1). According to this result, the signal of frame M is read out only in scanning range 2 in FIG. 2 at the timing of imaging frame 4 (M+2). This operating timing of the trout frame memory is called mode I.

This operates based on the synchronization signal 5y1 (first scanning system).

The operation timing of the frame memory, mode I,
II will be explained.

The table below shows the specifications of modes (1) and (2) when obtaining an NTSC signal as the final output signal.

Here, it is clear that the larger Ky and KH are, the greater the movement between two adjacent frames can be compensated for.

However, if KV and KH are increased, (1) the highest frequency of the video signal increases accordingly.

■ The target area of the image pickup tube must be increased.

■ If you do not change the size of the target, the resolution will deteriorate. Problems such as these will become even bigger.

Regarding (2), the highest frequency in scanning system 1 is frr1
a ma, then the highest frequency in scanning system 2 is 'ma'
x2 = KVxKHXfmazl.

Furthermore, since the area of the target is also multiplied by K y X K H , it is considered appropriate for practical use that =Ky=KH=1.2 to 1.6.

Below=1. The difference in operation depending on the mode of the frame memory when s is assumed will be explained.

Figure 4 (al indicates the vertical direction operation timing. The shaded part in the timing shown in mode I is
This corresponds to scanning range 2 in . This part is read out in mode ■ and expanded on the time axis. Furthermore, the shaded area in mode ■ indicates that the scanning range 3 moves from the lower limit to the upper limit between frames M and (M+2). 〇Figure 4(b) shows the movement timing in the horizontal direction. It shows. 87A/D is a horizontal synchronization signal period. Although not shown in the figure, there is a time difference of two frames between writing and reading in this case, as can be seen from (a). This figure shows that the Nth scanning line in mode (2) corresponds to the (N-D)th scanning line in mode I. This is an example where the first scan line of scan range 2 starts from the (D+1)th scan line of scan range 3.

In this way, in order to cool down the frame memory in a narrower range in both the vertical and horizontal directions than the image captured by the second scanning system, in order to obtain a normal image using the first scanning system, the time axis must be expanded as described above. It is necessary to carry out processing.

As is clear from the above description, according to the present invention, when the camera is intentionally moved relative to the unnecessary movement of the camera in the frame memory, that is, when camera operations such as panning and tilting are performed, If the signal processing of the present invention is operated at a certain time, disadvantages may arise. In order to prevent this situation, the camera is equipped with a manual switch that allows you to distinguish between panning, tilting, and stilling, and when you want to perform a certain operation, you can turn on the appropriate switch, and when panning, you can only move up and down. It is sufficient to provide a control signal that compensates for only horizontal movement when tilting, and compensates for vertical and horizontal movement when stationary. It is also necessary to provide a switch to disable this signal processing during complicated camera operations such as zooming.

Furthermore, if you want to completely handle complex camera operations such as those used for broadcasting, you should first record the screen corresponding to scanning range 3 using a VTfL designed for this signal processing, and then use the VTfL designed for this signal processing. After signal processing, it may be possible to edit and re-record on a standard VTR. The advantage of providing such a process is that if the accuracy of the movement detected by the movement detection circuit is not good,
It is possible to give the correct movement according to the editor's instructions, and it can fully handle complex camera work.

Further, in all the above explanations, movement between frames has been considered as a problem, but in order to deal with more intense movement, it is conceivable to perform similar processing between fields.

Effects of the Invention As detailed above, according to the present invention, images obtained by hand-held imaging by general consumers, or images taken by a TV camera installed in a car with strong vibrations, etc. As a result, it is not possible to remove unnecessary pre-images from images containing blur unrelated to the workpiece and restore them to normal images.As a result, in cases such as the above, not only can images with better quality than before be obtained, but also TV It also becomes possible to conduct camera interviews that were previously impossible in practical terms, such as taking images while driving with a camera.

[Brief explanation of the drawing]

Fig. 1 is a block diagram showing an embodiment of the present invention, Fig. 2 is a diagram showing the relationship between the imaging screen and the sending screen, Fig. 3 is an operation timing diagram in an embodiment of the invention, and Fig. 4 is a diagram showing the main FIG. 3 is a more detailed timing diagram in one embodiment of the invention. 4... Image pickup tube, 6... Frame memory, 6... Synchronization signal generation circuit, 7... Motion detection circuit. Name of agent: Patent attorney Toshio Nakao and 1 other person No. 1
ffl

Claims (7)

[Claims] (1) A signal processing device for obtaining a television signal by a first television scanning system having a number of scanning lines N, a frame period T_F, and a horizontal scanning period T_H, the number of scanning lines being K.
It operates by a second television scanning system having a frame period T_F, a horizontal scanning period T_H/K_V, and a horizontal scanning range K_H times that of the first scanning system (K_H>1). an image capturing means, an A/D converter that converts the output of the image capturing means into a digital signal, and an A/D converter that converts the output of the image capturing means into a digital signal;
a plurality of screen memories that store the output of the A/D converter over the entire imaging screen; and the output of the A/D converter;
means for comparing the contents of the screen memory and detecting the movement of the entire screen between consecutive screens;
A television signal characterized in that a range corresponding to _V times and 1/K_H times in the horizontal direction is read by the first television scanning system, and the read position of the screen memory is controlled by the output of the movement detecting means. Processing equipment. (2) 1.2<K_V<1.6, 1.2<K_H<1.
6. The television signal processing device according to claim 1, characterized in that: (3) The television signal processing device according to claim 1, wherein the screen memory is a frame memory. (4) The television signal processing device according to claim 1, wherein the screen memory is a field memory. (5) The television signal processing device according to claim 1, wherein the imaging means includes an imaging tube. (6) The television signal processing device according to claim 1, wherein the imaging means includes a solid-state imaging plate. (7) The first scanning means is NTSC, PAL or S
The television signal processing device according to claim 1, characterized in that it conforms to the ECAM system.