JPH07143258A - Television signal processor - Google Patents

Abstract

PURPOSE:To provide a decoder without cost rise by making constitution extremely simple and to reproduce the pictures of high picture quality even for horizontal high band components without reinforcing signals in a letter box system. CONSTITUTION:Main picture signals at the center of a screen which are interlaced scanning are inputted through a horizontal high pass filter 113, a field memory 114 and a vertical high pass filter 115 to an adder 116. In the adder 116, signals for which non picture part signals at the upper and lower parts of the screen are reproduced and horizontal/vertical high band components extracted from the main picture signals are added. In the route of the main picture signals, a scanning line generation processing is performed in a direct system LPF 204 and an interpolation system LPF 205. Also, in the output signal route of the adder 116, the scanning line generation processing is performed in a direct system HPF 206 and an interpolation system HPF 207 and direct system and interpolation system signals are respectively added in the adders 208 and 209, inputted to a double-speed converter 210 and successively converted to scanning signals.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention transmits a television signal in a letterbox format in which the main screen portion is transmitted in the center of the screen and the reinforcing signal for improving image quality is transmitted in the upper and lower non-picture portions. The present invention relates to a television signal processing device that is effective when used in a system for receiving and restoring signals, and particularly focuses on an interpolation signal processing method.

[0002]

2. Description of the Related Art In the NTSC color broadcast currently being broadcast in Japan, the aspect ratio of the screen is 4: 3. On the other hand, in research on HDTV (High Definition Television), it is known that the screen is preferably horizontally long and has an aspect ratio of 16: 9. The horizontal N (aspect ratio 16: 9) program material
To broadcast so that it can be received by a TSC receiver,
A method is known in which the left and right sides of the horizontally long screen are cut to be 4: 3, or the horizontally long screen is displayed in the center of the 4: 3 screen and the upper and lower parts are not imaged. The latter is called the letterbox format,
There is a feature that program material is not cut even if it is played back by an NTSC receiver. However, since the effective scanning line of the NTSC system is about 480 [lines / frame], 360 [lines / frame] in the vertical direction 3/4 is used to transmit an image with an aspect ratio of 16: 9 as letterbox. It's just that, so you have to sacrifice some image quality.
Therefore, there is a proposal to transmit the image quality enhancement signal by using the 120 [book / frame] upper and lower non-picture portions that are not used.

As an example, the Technical Report Vo of the Television Society of Japan
The system described in l.17, No.65, pp19-24, BCS 93-42 (Dec.1993) is explained. FIG. 24 is a diagram illustrating the principle of the encoder. In this example, 4 as the input television signal.
Adopted sequential scanning of 80 lines and converting this to 360 lines
180 sequential scan signals are output by the known SSKF method.
For interlaced scanning of books, this is used as a main screen signal, and at the same time, a compensation signal LD is created for signals for 180 interlaced scanning. The main screen signal is transmitted in the center of the screen, and the compensation signal LD is transmitted in the upper and lower non-image parts of the screen. In addition, 360 or more vertical high frequency signals are transmitted as VH 'after being multiplexed with the compensation signal LD.

The operation of the encoder shown in FIG. 24 will be described below in detail with reference to the drawings. 480 progressive scan RG
The B signal is input to the matrix circuit 604 and converted into a luminance (Y) signal and a color (I, Q) signal. The band of the converted YIQ signal is limited by the prefilter 605. The output YIQ signal of the pre-filter 605 is input to converters 609, 610 and 611 which perform 4: 3 scanning line conversion and convert into interlaced scanning. The output signals of the converters 609, 610 and 611 are converted into 360 scanning lines, which are then converted to 360 letterbox format signals by the letterbox converter 640. The Y signal on the converter 609 side is a component in the horizontal high band of 4.2 MHz or higher that cannot be transmitted in the current broadcast band, and is a letterbox format signal. This signal is referred to as an HH 'signal.
The HH ′ signal converted into the letterbox format is frequency-shifted by a hall multiplexing circuit 625 to a conjugate position with a color subcarrier called a hall, and multiplexed with a main screen signal.

The I signal is band-limited to 1.5 MHz by a horizontal low-pass filter (hereinafter, horizontal LPF) 626,
The Q signal is band-limited to 0.5 MHz by the horizontal LPF 627. The band-limited I signal and Q signal are transmitted to the modulator 6
It is input to 28 and is subjected to quadrature modulation. The modulated signal is multiplexed with the Y signal of the main screen as in the normal NTSC.

The Y signal at the center of the screen output from the matrix circuit 604 is a 4: 3 scanning line converter, SSKF,
It is input to the vertical processing unit 606 including interlaced scan conversion and the motion detector 612. The vertical processing unit 606 converts the inputted 480 Y signals into 360 signals, and uses the vertical low-pass filter of SSKF (hereinafter vertical LPF) and the vertical high-pass filter (hereinafter vertical HPF) to reduce the vertical low-pass. The signal is divided into a component and a high frequency component, and each signal is converted into interlaced scanning (in the figure, p → i means conversion from sequential scanning to interlaced scanning). The vertical low-frequency component is converted by the letterbox converter 640 into a letterbox format main screen signal. On the other hand, the vertical high frequency component becomes an LD signal, and LD
It is input to the / VH 'multiplexing circuit 613. Prefilter 6
The Y signal output from 05 is input to the vertical high frequency processing unit 608. In the vertical high frequency processing circuit 608, vertical high frequency components of 360 (line per height = 1ph) or more are frequency-shifted in the vertical direction (becomes 0 to 120 lph).
Then, scanning line conversion of 4: 3 is performed to convert to an interlaced scanning signal. This signal becomes a VH ′ signal and is input to the LD / VH ′ multiplexing circuit 613. LD / VH 'multiplex circuit 61
3, the output of the motion detector 612 multiplexes the VH ′ signal (vertical high-frequency component) with the LD signal (vertical compensation signal) when it is determined to be a still image, and when it is determined to be a moving image,
Do not duplicate. The output of the LD / VH 'multiplex circuit 613 is converted by the letterbox converter 640 into a letterbox format signal of the upper and lower non-image parts, and the fsc modulator 6
24 is input. The modulated wave output from the fsc modulator 624 is input to the switch 623, and is output from the output terminal 629 as a letterbox type upper and lower non-image portion signal at a predetermined timing. Letterbox conversion circuit 64
The signal of the main screen output from 0 is the precombing circuit 6
A hole is formed in the frequency domain where the HH 'signal is multiplexed by 20 and 4.2 MHz by the horizontal LPF 621.
Bandwidth is limited to. After band limitation, adder 622
The HH ′ signal and the color signal are added and input to the switch 623. The switch 623 switches at a predetermined timing, and outputs the output from the adder 622 to the output terminal 629 as a letterbox type main screen signal.

The signal encoded by the encoder performing the above processing is reproduced in the main screen portion of the letterbox in the current receiver, and compatibility is ensured. If a signal multiplexed and transmitted to the non-picture part is used as a reinforcement signal, a new receiver for displaying by progressive scanning is constructed.
In this example, a known method called SSKF is used, but it is considered that this method is a method in which a progressive scanning signal is divided into half and transmitted in the main screen portion and the non-image portion. However, since the reinforcement signal for constructing this SSKF is originally 180 [lines / field], it is compressed to ⅓ in the time direction and time-division multiplexed to the non-picture part 60 [lines / field]. It must be noted that

FIG. 26 shows an example of the encoded signal. 480 aspect 16 shown in 1601 of FIG.
When the progressive scan image of No. 9 is encoded in the letterbox format, the main screen portion is 360 as shown in 1610 of the figure.
[Book / frame]. And the upper and lower non-image parts are 120
[Book / frame]. Therefore, in order to transmit 120 signals in the upper and lower non-image parts, 1602 to 1602 in FIG.
As indicated by 607, it is necessary to compress the signal to 1/3 in the horizontal time axis direction and perform time division multiplexing. That is, since the non-picture portion is time-compressed to 1/3 and time-division multiplexed, the signal band that can be transmitted in the non-picture portion is limited to 1/3. For example, if the main screen signal is in the 4.2 MHz band, the non-picture portion signal is 1.4 Hz. Further, considering AM modulation using the color subcarrier fsc = 3.6 MHz for the non-picture part signal, the transmittable band is limited to 1.2 MHz.

Since the encoder shown in FIG. 24 performs fsc modulation, the transmittable band is 1.2 MHz. On the receiving side, the SSKF method using the signals of the main screen portion and the non-image portion at the same time is applied up to 1.2 MHz, and the original progressive scanning signal can be reproduced. However, 1.2 MH
Since the components of z and above are transmitted only by the main screen signal, the receiving side must convert them to the progressive scanning signal without the reinforcement signal. It is natural that a known interlaced scan to progressive scan conversion method can be used for components of 1.2 MHz or higher.

FIG. 25 shows a technical report Vo of the Television Society.
l. 17, No. 65, pp19-24, BCS'93
An example of -42 (Dec. 1993) is shown, and its decoding operation will be described. This is a decoder that decodes the signal encoded by the encoder shown in FIG.

An encode signal is input from the terminal 501. The input encode signal is divided by the switch 502 into a signal for the main screen portion and a signal for the upper and lower non-image portions. The signal of the main screen portion is input to the motion detector 520 and the three-dimensional Y / C / HH ′ signal separation circuit 521. The three-dimensional Y / C / HH ′ signal separation circuit 521 separates the Y signal, the color signal, and the HH ′ signal according to the image motion detection result of the motion detector 520, and the respective signals are added to the adder 523 and demodulated. It is input to the device 522 and the color demodulator 524. The demodulator 522 demodulates HH 'and reproduces a horizontal high frequency signal HH of 4.2 MHz or more,
Input to the adder 523. Therefore, the output signal of the adder 523 is Y having a horizontal resolution of 4.2 MHz or more.
Become a signal. In this conventional example, it is possible to reproduce a Y signal up to 6 MHz.

On the other hand, as for the color signal, the I signal and the Q signal are reproduced by the demodulator 524, and the horizontal LPF 525 and the Q signal are respectively reproduced.
It is input to the horizontal LPF 526. The I signal and the Q signal are converted into scanning lines by the 3: 4 converters 530 and 531 and converted into 480 progressive scanning signals. The output signal of the adder 523 is the adder 508 and the horizontal HPF 50.
1, input to the horizontal LPF 502 and the motion detector 527. As mentioned above, the horizontal band below 1.2 MHz is SS
Since the progressive scanning signal can be reproduced by the KF method, the SS
Input to the vertical LPF 504 of KF, 1.2MHz
For the above components, the motion adaptive scanning line interpolator 1503
Are sequentially converted into scanning signals.

In actual hardware, since conversion to progressive scanning increases the processing speed, the originally transmitted scanning line and the scanning line generated by interpolation are divided into a direct system and an interpolation system, respectively. To process. The output of the motion adaptive scanning line interpolator 1503 is input to the adder 1507 of the interpolation system. On the other hand, the output of the adder 523 is the direct adder 5
08 is input.

The non-picture part signal is demodulated by the fsc demodulator 510 and time-expanded by 3 times by the horizontal expander 511. LD
The LD / VH ′ is separated by the / VH ′ separation demodulator 512. Since the explanation here focuses on the LD signal,
A detailed description of the operation of the D / VH 'separation demodulator 512 is omitted. As described above, the band of the LD signal is a signal whose upper limit is 1.2 MHz and is input to the SSKF vertical LPF 505. The main screen signal corresponding to this LD signal is a horizontal LPF.
It is the output of 502, where the components of 1.2 MHz or less are extracted and input to the SSKF vertical LPF 504.
The outputs of the SSKF vertical LPFs 504 and 505 are the adder 50.
6. Combined in 6 to obtain a complete interpolated scan line signal for 0 to 1.2 MHz. In addition, the horizontal LP from the main screen signal
A horizontal high frequency component of 1.2 MHz or more is extracted in F501, and the known motion adaptive scanning line interpolation is a scanning line interpolator 15
03, and is combined with the output of the adder 506 by the adder 1507.

The output of the adder 508 is a direct system signal, and the output of the adder 1507 is an interpolation system signal 3: 4.
It is input to each of the scanning line converters 509. LD / VH
The VH 'signal output from the'separation demodulator 512 is subjected to 3: 4 scanning line conversion in the vertical processing unit 529 and vertically shifted to 360 or more vertical high frequency components (360 to 480).
Book) and input to the adder 528. Adder 5
Reference numeral 28 synthesizes 360 or less vertical low frequency components and 360 or more vertical high frequency components to reproduce 480 progressive scanning signals. Finally, the matrix circuit 532 converts the Y signal, the I signal, and the Q signal into RGB signals and outputs them as signals for displaying an image on the display.

Decoding can be performed by the above operation, and the vertical processing according to the present invention will be described in more detail below. SSKF is DL Gall and A. Tabatab
ai, "Sabband Coding of Digital Images Using Symmetr
ic Short Kernnel Filters and Arithmmertic Coding T
echniques ", ICASSP 89,2, M2.3, pp761-764 (1998). Technical report of the Institute of Television Engineers of Japan Vol.17, N
65, pp31-36, BCS 93-42 (Dec. 1993), an example actually used for an encoder / decoder is described.

FIG. 27 shows the SSKF of the encoder and the decoder.
The block diagram which extracted the part related to is shown. On the encoder side, 360 sequential scanning signals are input, and are divided into vertical high-frequency components and low-frequency components by the vertical LPF 102 and HPF 103. Each signal is converted into an interlaced scanning signal by the interlaced scanning converters 104 and 105. The vertical low-frequency component output from the interlaced scanning converter 104 is transmitted in the letterbox format main screen section,
On the other hand, the vertical high frequency component which is the output of the interlaced scanning converter 105 is transmitted in the upper and lower non-image parts in the letterbox format.
The respective signals are input to the progressive scan converters 106 and 107, input to the vertical LPF 108 and the vertical HPF 109, and combined by the adder 110 to be a progressive scan signal.
Here, the filters 102, 103, 108, and 109 are S
If the SKF perfect reconstruction condition is satisfied, the output terminal 1
The progressive scan signal output from 11 is exactly the same as the progressive scan signal input from the input terminal 101. If each is configured as a filter having a tap coefficient shown in the figure, the perfect reconstruction condition is satisfied. The conditions for perfect reconstruction are DL Gall and A. Tabatabai, "Sabband Coding of
Digital Images Using Symmetric Short Kernnel Filte
rs and Arithmmertic Coding Techniques ", ICASSP 89,
2, M2.3, pp761-764 (1998).

In the encoder and decoder shown in FIGS. 24 and 25, the band that can be transmitted by the upper and lower non-picture portions is 1.2 MH in the horizontal direction.
Since z is the limit, the actual configuration is as shown in FIG. The parts indicated by the same numbers as in FIG. 27 operate in exactly the same manner. The difference from FIG. 27 is that the horizontal LPF 1802,
112, a horizontal HPF 1801, and a motion adaptive scanning line converter 1803 are added. That is, only the component of 1.2 MHz or less can satisfy the perfect reconstruction and reproduce the same progressive scanning signal as the terminal 101.
The components of 1.2 MHz or higher are sequentially subjected to scanning line conversion by a known motion adaptive scanning line converter 1803, and the signal reproduced by this converter 1803 is added by the output of the adder 110 and the adder 1804. .

As described above, the progressive scan conversion on the decoder side shown in FIG. 25 is performed separately for the direct system and the interpolation system. FIG. 29 shows a system in which the processing on the reception side shown in FIG. 25 is reconfigured by dividing it into a direct system and an interpolation system.

In FIG. 29, the main screen signal is input from the input terminal 201, and the signals of the upper and lower non-image parts are input from the input terminal 202. The main screen signal is the horizontal HPF 1901.
A horizontal high frequency component is extracted by. For components of 1.2 MHz or higher, motion detection 1903, still image interpolation filter 19
04, a video interpolation filter 1905, and a delay 1907. Here, the interpolation filter for the still image outputs the scanning line of one field before, and the interpolation filter for the moving image generates the interpolation scanning line by the average value of the upper and lower scanning lines of the current field.

The output of the still image interpolation filter 1904 and the output of the moving image interpolation filter are input to the mixer 1906, and according to the determination result of the motion detector 1903, the respective outputs are mixed and output, whereby motion adaptation is performed. Scan line conversion is performed. The output of the mixer 1906 is the adder 1909.
Is input to and is combined with the interpolated scanning line of horizontal 1.2 MHz or more. The output of the delay line 1907 is directly input to the adder 1908 of the system, and is combined with the horizontal component of 1.2 MHz or less. The output of the horizontal LPF 1902 is SSK
LPF 204 in which the vertical LPF of F is divided into a direct system and an interpolation system
Is input to the LPF 205. Here, as shown in FIG. 29, since the tap coefficient of the LPF 204 of the direct system is 1, the LPF 204 is equivalent to a simple delay. LPF
The taps of 205 are 1/2 and 1/2. The signals of the upper and lower non-image parts are limited in band by the horizontal LPF 203 of 1.2 MHz, and then input to HPF 206 and HPF 207 which are obtained by dividing the vertical HPF of SSKF into a direct system and an interpolation system. LP
The tap coefficients of F206 are -1/2 and -1/2, and the tap coefficients of HPF 207 of the interpolation system are -1/4, 6/4,-.
It becomes 1/6. The outputs of the HPFs 206 and 207 are input to the adders 208 and 209 of the direct system and the interpolation system, respectively,
It is combined with the LPFs 204 and 205 outputs. Further, after being combined with components of horizontal 1.2 MHz or more by adders 1908 and 1909, they are input to the double speed converter 210. The double speed converter 210 compresses the scanning lines of the direct system and the scanning lines of the interpolating system and alternately outputs them to convert them into sequential scanning signals, which are output from the output terminal 211. The decoder shown in FIG. 25 uses the scanning line of the direct system and the scanning line of the interpolation system,
Scan line conversion of 3: 4 is performed. Therefore, FIG.
The part of the double speed converter 210 shown in FIG. 4 can be used for scanning line conversion.

As described above, in the encoder and decoder shown in FIGS. 24 and 25, the components of 1.2 MHz or less reproduce the original progressive scanning signal by SSKF,
The 1.2 MHz component reproduces a progressive scanning signal by a known motion adaptive scanning line conversion. However, in the above configuration, the decoding function of the SSKF method is required from 0 to 1.2 MHz, and the motion adaptive scanning line interpolation is required from 1.2 MHz or more, which is a complicated configuration and causes high cost. There is.

Further, since the known motion adaptive progressive scanning conversion is used at 1.2 MHz or more, in the case of a moving image, the interpolation scanning line is generated only by the scanning line in the field.
Interpolation using scanning lines only in the field deteriorates the vertical resolution and further deteriorates the image quality because the aliasing component of interlaced scanning cannot be completely removed. In the case of a still image, the vertical resolution does not deteriorate, but the filters are switched according to the movement, so that when a moving image and a still image are mixed, unnaturalness may occur. For example, in an image in which a moving image changes to a still image, the vertical resolution suddenly changes, which causes unnaturalness.

[0024]

As described above, the SS
In the method of transmitting the reinforcement signal based on the KF method in the non-image part, a simple combination of the SSKF decoder would complicate the configuration of the receiver, resulting in high cost. Further, the horizontal high-frequency component is converted into the sequential scanning by the known motion adaptive scanning line interpolation, so that the vertical resolution of the moving image is deteriorated. Also, the vertical resolution of the video is reduced, but the vertical resolution is saved for still images, so
Unnaturalness is likely to occur in an image that changes from motion to static or vice versa.

Therefore, the present invention provides a decoder in which the structure of the receiver is as simple as possible and the cost is not increased. It is another object of the present invention to provide a television signal processing device that reproduces a high quality image even for a horizontal high frequency component having no reinforcement signal.

[0026]

The horizontal low-frequency component to which the reinforcement signal is transmitted is interpolated by SSKF as before, and the horizontal high-frequency component not transmitted is transmitted to the front of the field of the main screen signal. Interpolation is performed using the vertical high frequency components of. At this time, SSKF is also used for the interpolation of the horizontal high frequency components. In other words, the main screen signal is the entire band SS
By converting into a sequential scanning signal by KF, and adding the upper and lower non-picture area signals and the vertical high-frequency component of the main screen signal one field before, the SHPF vertical HPF of the upper and lower non-picture area signals sequentially scans the entire band. It is a conversion.

[0027]

The SSKF enables progressive scanning conversion of the entire horizontal band, and in particular, since it is not necessary to additionally have a motion adaptive scanning line interpolator, the hardware scale is greatly reduced. As for the horizontal high-frequency component, since the vertical high-frequency component of one field before is used, it is possible to prevent the deterioration of the vertical resolution during the moving image. The present invention can also be applied to motion adaptive processing, and since deterioration of vertical resolution during moving images can be suppressed to a minimum,
The unnaturalness of switching can be improved.

[0028]

Embodiments of the present invention will be described below with reference to the drawings. 2 shows the principle part of the first embodiment according to the invention of FIG. The parts indicated by the same numbers as those in the conventional example shown in FIG. 28 perform exactly the same operation.

On the encoder side, 360 sequential scanning signals are input to the input terminal 101, and the vertical LPF 1
02 and the HPF 103, it is divided into vertical high-frequency components and low-frequency components. Each signal is converted into an interlaced scanning signal by the interlaced scanning converters 104 and 105.
The vertical low-frequency component output from the interlaced scan converter 104 is transmitted by the main screen part of the letterbox format, while the vertical high-frequency component output from the interlaced scan converter 105 is the upper and lower non-image parts of the letterbox format. Is transmitted. On the decoder side, the main screen signal is input to the horizontal HPF 113 and the progressive scan converter 106, and the non-image area signal is the HLPF 11
Entered in 2. The output of the horizontal HPF 113 is input to the adder 116 via the vertical LPF 115 after passing through the field delay 114. The output of the horizontal LPF 112 is supplied to the adder 116. In the actual device, the horizontal LPF 112 does not need to be provided because the LD / VH 'separation demodulator (see FIG. 25) performs the same filtering when demodulating the upper and lower non-picture area signals. The output of the adder 116 is the progressive scan converter 107.
Entered in. The outputs of the progressive scan converters 106 and 107 are respectively added by an adder 110 after passing through a vertical LPF 108 and a vertical HPF 109, and an output terminal 111.
Derived from.

In the above structure, the vertical filter 10
2, 103, 108 and 109 satisfy the perfect reconstruction condition of SSKF. The difference from the circuit of FIG. 28 is that there is no motion adaptive scanning line converter on the receiving side, and instead, a field delay device by the field memory 114 and a vertical HPF are used.
115 and an adder 116 are provided.

Here, the horizontal HPF 113 and the horizontal LPF
The cutoffs of the respective 112 are set to around 1.2 MHz, and they are determined to have complementary frequency characteristics. Therefore, in the output signal of the adder 116, the horizontal signal of 1.2 MHz or less is the transmitted reinforcement signal (the output signal from the horizontal LPF 112), and the output signal is 1.2M.
Above Hz is a vertical high frequency component (output signal from the vertical HPF 115) one field before on the output screen.

The main screen signal is the vertical LPF 10 of SSKF.
8, the entire horizontal region is filtered, and the progressive scan signal is output to the adder 110. The output signal of the adder 116 is converted into a progressive scan signal by the progressive scan converter 109, and then the entire horizontal band is filtered by the vertical HPF 109 of SSKF. The output signal is input to adder 110, where it is combined with the output of vertical LPF 108,
It is output from the output terminal 111.

In FIG. 2, the decoder side is divided into a direct system and an interpolation system. A portion surrounded by a broken line corresponds to a circuit block denoted by reference numerals 106 to 110 in FIG. The difference from FIG. 29 is that the motion adaptive scanning line converter does not exist on the receiving side, and instead, the horizontal LPF 113, the field delay unit 114, the vertical HPF 115, and the adder 216 exist. As an example of the vertical HPF 115, a filter having tap coefficients of −3/32, 6/32, −3/32 is used. A main screen signal is input from the input terminal 201. The signals of the upper and lower non-image parts are input to the horizontal LPF 203. Here, the horizontal HPF 112 and the horizontal LPF 113
Are set to have a cutoff near 1.2 MHz and are determined to have complementary frequency characteristics. Therefore, the output signal of the adder 116 is the transmitted reinforcement signal below 1.2 MHz horizontally,
Above 1.2 MHz is the vertical high frequency component one field before on the output screen. The main screen signal is input to vertical LPFs 204 and 205 obtained by dividing the vertical LPF of SSKF into a direct system and an interpolation system. Here, these filters have the same tap coefficient as the conventional example. That is, since the tap coefficient of the vertical LPF 204 of the direct system is 1, it is merely a delay device. The vertical LPF 205 of the interpolation system has tap coefficients of 1/2 and 1/2. The output signal of the adder 116 is input to HPF 206 and HPF 207 obtained by dividing the vertical HPF of SSKF (109 in FIG. 1) into a direct system and an interpolation system. Similar to the conventional example, the HPF 206 has tap coefficients of -1/2 and -1/2, and the HPF 207 has tap coefficients of -1/4, 6/4, and -1/4. The scanning lines of the direct system are combined by the adder 208, and the signals of the interpolation system are combined by the adder 209. The combined direct and interpolation signals are sequentially converted into scanning signals by the double speed converter 210 and output from the output terminal 111.

The first embodiment of the present invention has been described above. Next, the actual operation of the embodiment shown in FIG. 2 will be described with reference to FIG. The description will be divided into a horizontal band of 1.2 MHz or lower and a band higher than that. First, the processing operation for components of 1.2 MHz or less is shown in FIGS.
Vertical HPF115 for components below 1.2 MHz
It is not necessary to consider the output from. Direct LPF20
4, the interpolation system LPF 205, the direct system HPF 206, and the interpolation system HPF 207 may be considered.

FIG. 3A shows the operation of the interpolation system.
(B) shows the operation of the direct system. The fields are represented by A and B, and the scanning lines of the A field are A1, A2, A3 ...
The scan lines of the B field are indicated by B1, B2, B3.
・ Indicated by. In the case of the interpolation system (FIG. 3A), in order to generate the scanning line 301 that has not been transmitted, interpolation is performed from the upper and lower scanning lines 302 and 303 of the main screen signal with the coefficients of 1/2 and 1/2. . Further, the scanning lines 304, 3 for the upper and lower non-image area signals
From 05 and 306, filtering is performed with the coefficients of -1/4, 6/4, and -1/4, and the result is added to the interpolation scanning line 301. In the direct system, the scanning line 30 for the transmitted main screen signal
9 to scan lines 307 and 308 for upper and lower non-image area signals
Interpolation is performed with a coefficient of 2−1 / 2, and the result is added to the scanning line 309.

The above is the original processing of SSKF.
Since the component of 1.2 MHz or higher does not exist in the upper and lower non-image portions, the interpolation operation is performed only by the main screen portion signal. Figure 3
The operation of the interpolation system is shown in (c), and the operation of the direct system is shown in FIG. 3 (d).
The component of 1.2MHz or more is in the signal one field before,
After filtering the vertical HPF 115, SS
KF interpolation system HPF 206 (direct system), HPF 207
(Interpolation system) filtering is applied. If the current field is B and the interpolation scan line is 317, the tap coefficient of the vertical HPF 115 is -3/32, 6/3 in the A field.
2, -3/32 is applied, and tap coefficients of SPF HPF 207 of -1/4, 6/4, and -1/4 are applied. Therefore, tap coefficients obtained by convolving these tap coefficients, 3/12
8, -24/128, 42/128, -24/128,
3/128 will be applied to the scan lines of the A field. Therefore, the scan lines 310 through 314 are multiplied by the coefficient and added to the scan line 317. In the B field, the tap coefficient 1 / of the LPF 205 of the interpolation system of SSKF is 1 /
2, 1/2 are directly applied to the scanning lines 315 and 316. In the direct system, as shown in FIG. 3D, the tap coefficient of the vertical HPF 115 is −3 / 32,6 for the A feed.
/ 32, -3/32, SSKF direct system H
Since the tap coefficients of PF206 -1/2 and -1/2 are applied, as a result, these are convolved, 6/128, -6
It takes / 128, -6/128, 6/128. Therefore, a coefficient is applied to the scan lines 320, 321, 322, 323 and added to the scan line 324.

FIG. 4 shows the interpolation characteristics of the components of 1.2 MHz or higher obtained in the above embodiment. Figure 4 (A)
Indicates the coefficient by which the interpolation scanning line is multiplied by the direct system and the interpolation system, and FIG. 4B shows the interpolation characteristic. 1.2
The frequency characteristics of the components below MHz become flat depending on the condition of SSKF, but the components above 1.2 MHz have the characteristics shown in FIG. The component of 30 Hz in the time direction and 360 components in the vertical direction are attenuated, the aliasing of the interlaced scanning is canceled, and the interpolation characteristic to the progressive scanning is obtained. In particular, the vertical high frequency component of the temporal low frequency component is extended. Since the conventional motion-adaptive progressive scan conversion moving image interpolation interpolated within the field, the cutoff was 180. However, the interpolation characteristics according to the above-mentioned embodiment are compared with the conventional motion adaptive progressive-scan conversion moving image interpolation. It has significantly improved the vertical resolution.

FIG. 5 shows the structure of a decoder to which the first embodiment described above is applied. The same parts as those shown in FIGS. 25 and 2 are designated by the same reference numerals. The difference from the configuration of FIG. 25 is that there is no motion adaptive progressive scan line interpolator,
PF113, field memory 114, vertical HPF
115 and adder 116 are incorporated instead.

An encode signal is input from the terminal 501. The input encode signal is divided by the switch 502 into a signal for the main screen portion and a signal for the upper and lower non-image portions. The non-image part signal is demodulated by the fsc demodulator 510 and is output by the horizontal decompressor 511.
The time is extended by 3 times. LD / VH 'separation demodulator 51
At 2, LD / VH 'is separated. Also, the switch 50
The signals of the main screen section separated by 2 are the motion detectors 520, 3
It is input to the dimension Y / C / HH ′ signal separation circuit 521.
The three-dimensional Y / C / HH ′ signal separation circuit 521 separates the Y signal, the color signal, and the HH ′ signal according to the image motion detection result of the motion detector 520, and the respective signals are added to the adder 523 and demodulated. It is input to the device 522 and the color demodulator 524. The demodulator 522 demodulates HH ′, reproduces a horizontal high frequency signal HH of 4.2 MHz or more, and inputs it to the adder 523. Therefore, the output signal of the adder 523 can reproduce the Y signal up to 0 to 6 MHz.

On the other hand, as for the color signal, the I signal and the Q signal are reproduced by the demodulator 524, and the horizontal LPF 525 and the horizontal LPF 525, respectively.
It is input to the horizontal LPF 526. The I signal and the Q signal are converted into scanning lines by the 3: 4 converters 530 and 531 and converted into 480 progressive scanning signals. The output signal of the previous adder 523 is input to the adder 508. This route corresponds to the route of the direct LPF 204 shown in FIG. The output of the adder 523 is the motion detector 527,
It is input to the vertical LPF 504 of the SSKF. The path of the vertical LPF 504 corresponds to the interpolation LPF 205 of FIG. Further, the output of the adder 523 is the horizontal HPF 11
3, the field memory 114, and the vertical HPF 115.

The output of the vertical HPF 115 (vertical high frequency component) is input to the adder 116 and added to the output (reinforcement signal) of the LD / VH ′ separation demodulator 512. Adder 1
The 16 outputs are input to the vertical HPF 505 of SSKF. This vertical HPF 505 is a direct system HP shown in FIG.
It corresponds to F206 and interpolation system HPF207. Of the output of the vertical HPF 505 of SSKF, the direct system signal is supplied to the adder 508 (this adder 508 corresponds to the adder 208 of FIG. 2). Also, the interpolation system signal is added to the adder 5
06 and is added to the output of the vertical LPF 504 of SSKF (this adder 506 is the adder 2 shown in FIG. 2).
09). The output signals of the adders 508 and 506 are input to the 3: 4 scanning line converter 509. Here, the double speed conversion (corresponding to the double speed converter 210 in FIG. 2) and the vertical expansion of 4/3 are performed. The output of the 3: 4 scanning line converter 509 is input to the adder 528. LD / VH
The VH 'signal output from the'separation demodulator 512 is subjected to 3: 4 scanning line conversion in the vertical processing unit 529 and vertically shifted to 360 or more vertical high frequency components (360 to 480).
Book) and input to the adder 528. Adder 5
Reference numeral 28 synthesizes 360 or less vertical low frequency components and 360 or more vertical high frequency components to reproduce 480 progressive scanning signals. Finally, the matrix circuit 532 converts the Y signal, the I signal, and the Q signal into RGB signals and outputs them as signals for displaying an image on the display.

In the interpolation system, the vertical LPF 5 of SSKF
Reference numeral 04 designates an adder 506 for complementing the horizontal scanning line in the entire band.
Output to. By this operation, 0 to 6MHz on the main screen
Up to the scanning line interpolation is performed by the vertical LPF 504. In addition, 1.2MHz or less reinforcement signal and 1.2MH
The field-delayed vertical high frequency components of the main screen of z or more are combined, and the interpolation of the scanning lines of the entire horizontal band is performed by the vertical H
It is performed by PF505.

As described above, in this embodiment, the field-delayed vertical high-frequency component of the main screen signal is used when interpolating the scanning line of the component of 1.2 MHz or more to which the reinforcement signal is not sent. As a result, interpolation scanning lines with high vertical resolution are generated. Moreover, since it does not require the motion adaptive progressive scanning line conversion processing, compared with the conventional decoder,
The scale of hardware has been greatly reduced.

Next, the second that can further reduce the hardware
An example will be described. The Television Society Technical Report Vol. 17, No. 65, pp25-30, BCS 93-42 (Dec. 1993) describes a method for improving the encoder and decoder described with reference to FIGS. 23 and 24. In the above report, it is explained that when the reinforcement signal is multiplexed in the upper and lower non-picture portions of the signal encoded in the letterbox format, the reinforcement signal is detected as flicker in the current receiver, which causes interference. In order to reduce this interference as much as possible, a method of using the correlation between the signal of the main screen portion and the reinforcement signal multiplexed in the upper and lower non-image areas is applied on the encoder side.

An example of an encoder to which such a technique is applied is shown in FIG. The parts shown by the same numbers as in the conventional example shown in FIG. 24 perform exactly the same operation. Letterbox converters 614, 615, and 616 in FIG. 6 are different from the letterbox converter shown in FIG. 24, and operate similarly.

The 480 RGB signals for progressive scanning are input to the matrix circuit 604 and converted into luminance (Y) signals and color (I, Q) signals. The band of the converted YIQ signal is limited by the prefilter 605. The output YIQ signal of the pre-filter 605 performs a 4: 3 scanning line conversion and a converter 6 for converting to interlaced scanning.
09, 610 and 611. Converter 609, 6
The output signals of 10 and 611 are converted into 360 scanning lines, and the letterbox converter 615 produces 360 letterbox signals. The Y signal on the converter 609 side is 4.2 MHz, which cannot be transmitted in the current broadcast band.
These are the components in the horizontal high frequency range, and become a letterbox format signal. This signal is referred to as an HH 'signal. The HH ′ signal converted to the letterbox format is used by the hole multiplexing circuit 6
The frequency is shifted by 25 to a conjugate position with a color subcarrier called a hole, and multiplexed with the main screen signal.

The I signal is band-limited to 1.5 MHz by the horizontal LPF 626, and the Q signal is horizontal LPF 62.
7 band-limited to 0.5 MHz. The band-limited I and Q signals are input to the modulator 628 and are quadrature-modulated. The modulated signal is multiplexed with the Y signal of the main screen as in the normal NTSC.

The Y signal at the center of the screen output from the matrix circuit 604 is a 4: 3 scanning line converter, SSKF,
It is input to the vertical processing unit 606 including interlaced scan conversion and the motion detector 612. In the vertical processing unit 606, the input 480 Y signals are converted into 360 signals, divided into vertical low-frequency components and high-frequency components by the vertical LPF and vertical HPF of SSKF, and the respective signals are subjected to interlaced scanning. Conversion (in the figure, p → i means conversion from sequential scanning to interlaced scanning). The vertical low-frequency component is the letterbox converter 61.
4 is converted into a letterbox format main screen signal. On the other hand, the vertical high frequency component becomes an LD signal, and the subtractor 6
33 is input. The processing content of the subtractor 633 will be described later. The output of the subtractor 633 is input to the LD / VH ′ multiplexing circuit 613.

Further, Y output from the pre-filter 605
The signal is input to the vertical high frequency processing unit 608. In the vertical high frequency processing circuit 608, 360 (line per height =
lph) or higher vertical frequency components are frequency-shifted in the vertical direction (to be 0 to 120 lph), 4: 3 scanning line conversion is performed, and interlaced scanning signals are converted. This signal is VH
The signal becomes a signal 'and is input to the LD / VH' multiplexing circuit 613. In the LD / VH ′ multiplexing circuit 613, the motion detector 61
According to the output of 2, the VH 'signal (vertical high frequency component) is multiplexed with the LD signal (vertical compensation signal) when it is determined to be a still image, and the multiplexing is not performed when it is determined to be a moving image. L
The output of the D / VH 'multiplex circuit 613 is converted by the letterbox converter 616 into a signal in the upper and lower non-image parts in the letterbox format and input to the fsc modulator 624. fs
The modulated wave output from the c modulator 624 is a switch 623.
Is output to the output terminal 629 as a letterbox type signal of the upper and lower non-image portions at a predetermined timing. The main screen signal output from the letterbox conversion circuit 614 has a hole formed in the frequency region in which the HH ′ signal is multiplexed by the precombing circuit 620, and the horizontal L
The band is limited to 4.2 MHz by the PF 621. After band limitation, the adder 622 adds the HH ′ signal and the color signal, and inputs the added signal to the switch 623. Switch 62
3 switches at a predetermined timing, and the adder 622
Output to the output terminal 629 as a letterbox type main screen signal.

Here, the Y signal whose horizontal band is limited to 4.2 MHz is input to the adder 622 and is also limited to 1.2 MHz by the horizontal LPF 630. The output of the horizontal LPF 630 is field-delayed by the field memory 631, is input to the vertical HPF 632, and the vertical high frequency components are extracted. Since this component and the reinforcement signal have a high correlation, the signal level can be reduced by taking the difference by the adder 633. By transmitting this difference signal in the upper and lower non-picture portions instead of directly transmitting the reinforcement signal, it is possible to reduce interference with the current receiver.

FIG. 7 shows an example of a decoder for decoding a signal which has been encoded as described above. Figure 24
The parts indicated by the same numbers as those of the decoder shown in FIG.

An encode signal is input from the terminal 501. The input encode signal is divided by the switch 502 into a signal for the main screen portion and a signal for the upper and lower non-image portions. The signal of the main screen portion is input to the motion detector 520 and the three-dimensional Y / C / HH ′ signal separation circuit 521. The three-dimensional Y / C / HH ′ signal separation circuit 521 separates the Y signal, the color signal, and the HH ′ signal according to the image motion detection result of the motion detector 520, and the respective signals are added to the adder 523 and demodulated. It is input to the device 522 and the color demodulator 524. The demodulator 522 demodulates HH 'and reproduces a horizontal high frequency signal HH of 4.2 MHz or more,
Input to the adder 523. Therefore, the output signal of the adder 523 is Y having a horizontal resolution of 4.2 MHz or more.
Become a signal. In this conventional example, it is possible to reproduce a Y signal up to 6 MHz.

On the other hand, for the color signal, the I signal and the Q signal are reproduced by the demodulator 524, and the horizontal LPF 525,
It is input to the horizontal LPF 526. The I signal and the Q signal are converted into scanning lines by the 3: 4 converters 530 and 531 and converted into 480 progressive scanning signals. The output signal of the adder 523 is the adder 508 and the horizontal HPF 50.
1, input to the horizontal LPF 502 and the motion detector 527. As mentioned above, the horizontal band below 1.2 MHz is SS
Since the progressive scanning signal can be reproduced by the KF method, the SS
Input to the vertical LPF 504 of KF, 1.2MHz
For the above components, the motion adaptive scanning line interpolator 1503
Are sequentially converted into scanning signals.

In actual hardware, since conversion to progressive scanning increases the processing speed, the originally transmitted scanning line and the scanning line generated by interpolation are divided into a direct system and an interpolation system, respectively. To process. The output of the motion adaptive scanning line converter 1503 is input to the adder 1507 of the interpolation system. On the other hand, the output of the adder 523 is the direct adder 5
08 is input.

The non-picture portion signal is demodulated by the fsc demodulator 510 and time-expanded by 3 times by the horizontal expander 511. LD
The LD / VH ′ is separated by the / VH ′ separation demodulator 512. As described above, the bandwidth of the LD signal is a signal whose upper limit is 1.2 MHz. This LD signal is input to the adder 704. The signals added by the adder 704 will be described later. The output of the adder 704 is the SSKF vertical LPF5.
It is input to 05. The main screen signal corresponding to this LD signal is the output of the horizontal LPF 502, where 1.2 MHz.
The following components are extracted and input to the SSKF vertical LPF 504. The outputs of the SSKF vertical LPFs 504, 505 are combined in adder 506 to obtain a perfect interpolated scan line signal from 0 to 1.2 MHz. A horizontal high frequency component of 1.2 MHz or more is extracted from the main screen signal by the horizontal LPF 501, and the known motion adaptive scan line interpolation is performed by the scan line converter 1503, and the adder 1507 performs adder 5
06 output.

The output of the adder 508 is a direct system signal, and the output of the adder 1507 is an interpolation system signal 3: 4.
It is input to each of the scanning line converters 509. LD / VH
The VH 'signal output from the'separation demodulator 512 is subjected to 3: 4 scanning line conversion in the vertical processing unit 529 and vertically shifted to 360 or more vertical high frequency components (360 to 480).
Book) and input to the adder 528. Adder 5
Reference numeral 28 synthesizes 360 or less vertical low frequency components and 360 or more vertical high frequency components to reproduce 480 progressive scanning signals. Finally, the matrix circuit 532 converts the Y signal, the I signal, and the Q signal into RGB signals and outputs them as signals for displaying an image on the display.

Here, the three-dimensional Y / C / HH 'separation circuit 5
The LPF 701 extracts the horizontal 1.2 MHz or lower component of the Y signal separated in step 21. The output signal of the LPF 701 is field-delayed by the field memory 702, and the vertical high frequency component is extracted by the vertical HPF 703. Since this signal is the same as the signal previously subtracted from the reinforcement signal on the encoder side, it is possible to reproduce the reinforcement signal by adding it to the multiplexed signal of the upper and lower non-picture areas transmitted on the decoder side. it can. Since this is performed by the adder 704, the output of the adder 704 becomes a reinforcement signal.

FIG. 8 shows an example in which the method of reducing the interference with the current receiver described above is devised and further applied to the present invention. FIG. 8 shows a second embodiment of the present invention. In this example,
By sharing the vertical HPF used for the scan line interpolation with the vertical HPF used for the interference reduction method, it is possible to significantly reduce the hardware scale. In FIG. 8A, the parts indicated by the same numbers as those of the first embodiment of the present invention shown in FIG. 2 operate exactly the same. The difference from Figure 2 is the horizontal L in Figure 2.
This is where the PF 113 does not exist. Others have exactly the same configuration. The reason for this will be described below. In the first embodiment, horizontal 1.2 MHz or less is a reinforcement signal and interpolation is performed using a vertical high frequency component of the field delay of the main screen signal at 1.2 MHz or more. I was going. In the above-mentioned interference reduction method for the existing machine, the vertical high frequency component of the field delay of the main screen signal is added in order to reproduce the reinforcement signal of 1.2 MHz or less. Therefore, the reinforcement signal is LD, and the vertical high frequency component of the field delay of the main screen signal is F.
If it is D, it is transmitted from the encoder by the LD-FD in the upper and lower non-image parts. When FD is added to this signal, as shown in FIG.
D) + FD = LD and becomes FD at 1.2 MHz or higher. Therefore, it is not necessary to separate them with a horizontal filter, and it is possible to simultaneously generate an interpolation signal and a reinforcement signal that has been subjected to interference reduction processing.

In the second embodiment, it is possible to reduce the horizontal filter, and in the conventional example, the vertical HPF for generating the reinforcement signal subjected to the interference reduction processing, the field delay, and the interpolation. In the present invention, one vertical HPF
Then, the above two processes can be completed only with the field delay device, and the hardware can be significantly reduced.

FIG. 9 shows an example in which the present invention is actually applied to a decoder. The difference from the embodiment shown in FIG. 5 is that the horizontal LPF is simply reduced. Therefore, in the decoder shown in FIG. 9, it is possible to generate the reinforcement signal subjected to the interference reduction processing and perform the scanning line interpolation with smaller hardware.

FIG. 10 shows a third embodiment. When progressively scanned images are reproduced by using signals that are multiplexed and transmitted in the upper and lower non-picture portions, when the received S / N is lowered, reproduction of the reinforcement signal may be stopped. That is, the reinforcement signal is 3
Since processing such as double horizontal expansion is performed and a noise component multiplexed in the transmission path is shifted to a low frequency band, when the image is reproduced using the reinforcement signal, the visual S / N of the image is lowered. Therefore, in such a case, it is necessary for the receiver side to add a function of stopping the reproduction of the reinforcement signal when the S / N is low.

Therefore, when the S / N is low, the reinforcement signal is stopped. That is, this embodiment differs from the second embodiment shown in FIG. 8 in that a switch 1001 is added between the horizontal LPF 112 and the adder 116. When the S / N is low, the switch 1001 selects zero and the reproduction of the reinforcement signal is stopped. In this case, the field-delayed vertical high-frequency component of the main screen signal similarly forms an interpolated scan line, so that the horizontal 0 to 6 MHz is automatically generated.
Scan line interpolation up to. Therefore, even if the reinforcement signal is stopped, good scanning line interpolation can be performed. To add this function to the first embodiment, the horizontal LP shown in FIG.
A similar function can be realized by switching F113 to through.

FIG. 11 shows a fourth embodiment of the present invention.
In this embodiment, the vertical HPF of SSKF is not used. This case can be realized by adding the vertical high frequency component of the field delay of the main screen signal after the adder 209. Therefore, as in the first embodiment shown in FIG. 2, the horizontal LPF 212, the field delay unit 213, and the vertical HPF 214 extract the vertical high-frequency component of the field delay of the main screen signal, and then the adder 1101.
To directly add to the interpolation system signal.

FIG. 12 shows a two-dimensional frequency characteristic according to this embodiment. 30 MHz above 1.2 MHz in the time direction
It can be seen that 360 components in the vertical direction are attenuated to have the interpolation characteristic. FIG. 12A shows the tap coefficients of the vertical HPF 214 and the interpolation LPF 207 for the previous field, and the tap coefficients of the interpolation LPF 205 for the current field. FIG. 12B shows the interpolation characteristic.

FIG. 13 shows a fifth embodiment, which is an embodiment in which the circuit of the present invention is further combined with motion adaptive processing. As compared with the first embodiment shown in FIG. 2, the selector 1 is provided between the field memory 114 and the vertical HPF 115.
302 is provided. Further, the motion detector 1301 detects the motion using the output of the horizontal HPF 113, and the selector 1302 is controlled. One output of the selector 1302 is supplied to the vertical HPF 115, and the other output is supplied to the adder 1304 via the delay device 1303. The adder 1304 outputs the output of the adder 209 and the delay device 1303.
Of the output of the double speed converter 210 as an interpolation system signal.
Supply to. Except for this, the operation is exactly the same as that of the embodiment of FIG. The output of the horizontal HPF 113 is input to the field memory 114 and the motion detector 1301. The selector 1302 determines, based on the motion detection determination result,
In the case of a moving image, the input is output to the vertical HPF 115, and in the case of a still image, it is output to the delay device 1303. In the case of a moving image, the same operation as in the first embodiment is performed. In the case of a still image, the scanning line of one field before is directly added to the interpolation system, and the vertical resolution can be further improved.

FIG. 14 shows a sixth embodiment according to the present invention. Although the embodiment using only one field memory has been described above, the sixth embodiment is an example using a plurality of field memories. The parts indicated by the same numbers as in FIG. 1 operate exactly the same. The difference from FIG. 1 is that field delay units 2001 and 2002, an adder 2003, and a coefficient unit 2004 are added. Also horizontal HP
The positions of F113 and field memory 114 are interchanged. The signal of the main screen is the field memory 2001.
Entered in. In addition, the signal of the non-picture part is also delayed by the delay device 2002.
Due to the field delay. Field memory 20
01 input signal and output signal are respectively added by the adder 200.
3, input to the field memory 114. Therefore, the output of the field memory 114 is a frame delay with respect to the input signal. The output signal of the field memory 114 and the input signal of the field memory 2001 are added by the adder 2003. Therefore, the adder 2
The output signal of 003 is a sum signal between frames. The sum signal between frames is attenuated to 1/2 in amplitude by the coefficient unit 2004 and input to the horizontal HPF 113. The subsequent operation is the same as in the case of FIG.

FIG. 15 shows an example in which the decoder side of the sixth embodiment (FIG. 14) is divided into a direct system and an interpolation system. The same components as those in FIGS. 14 and 2 are designated by the same reference numerals. The parts indicated by the same numbers as in FIG. 2 operate exactly the same. The main screen signal is input to the field memory 2001, and the signal of the non-image portion is also input to the field memory 2002. The input signal and the output signal of the field memory 2001 are input to the adder 2003 and the field memory 114, respectively. Field memory 114
And the input signal of the field memory 2001 are added by the adder 2003, input to the coefficient unit 2004, and the amplitude thereof is attenuated to 1/2. The following operation is similar to that of the circuit of FIG.

FIG. 16 is a diagram shown for explaining the operation of the sixth embodiment. The first field is shown as A and the second field is shown as B. Scan lines with white circles,
The black circles are the scanning line positions to be interpolated. The above example
Since a plurality of field memories are used, as shown by the broken line in the figure, the interpolation system scan line is interpolated by the front and rear field scan lines, and the direct system scan line is also
Filtering is performed by the scan lines in the front and rear fields.

FIG. 17 shows the two-dimensional frequency characteristic obtained by the above interpolation processing. 30H at time and vertical frequency
It can be seen that the components around z and 360 lines are attenuated and operate as an interpolation filter.

FIG. 18 shows a seventh embodiment. This embodiment differs from the sixth embodiment shown in FIG. 14 in that the horizontal LPF 200
5 and an adder 2006 are added. This embodiment corresponds to the decoder using the main screen correlation shown in FIG. The horizontal LPF 2005 extracts the horizontal low-frequency component from the output signal of the field memory 114, and the horizontal low-frequency component is added to the horizontal L-level by the adder 2006.
It is added to the horizontal high frequency component which is the output of the PF 113. Here, the horizontal high-frequency component is added in advance by the adder 2003 between frames, and therefore operates in the same manner as in the sixth embodiment. On the other hand, for the horizontal low-frequency component, the output signal of the field memory 114 is taken out by the horizontal LPF 2005 and added to the horizontal high-frequency component. Therefore, the horizontal low frequency component is extracted as the horizontal low frequency component and the vertical high frequency component when passing through the vertical HPF 115.
When the adder 116 adds the demodulated signals of the upper and lower non-picture portions, the correlation processing of the main screen portion is performed. That is,
The same operation as described with reference to FIG. 8B is obtained.

FIG. 19 shows an eighth embodiment. The difference from the seventh embodiment (FIG. 18) is that the output of the field memory 114 is supplied to the horizontal LPF 2011,
The output signal of 011 is passed through the vertical HPF 2012, then input to the adder 2013, added to the output of the horizontal LPF 112, and the main screen correlation processing is performed. With this configuration, since the vertical HPFs 2012 and 115 can be set separately, the interpolation characteristic can be set separately from the main screen correlation processing characteristic.

FIG. 20 shows a ninth embodiment. In this embodiment, the input signal of the field memory 2001 is input to the space-time interpolation filter 2021. The output signal of the field memory 2001 is input to the field memory 114 and the space-time interpolation filter 2021. The output signal of the field memory 114 is input to the space-time interpolation filter 2021, and also to the adder 116 via the horizontal LPF 113 and the vertical HPF 115.
The output signal of the space-time interpolation filter 2021 is the adder 11
It is input to the adder 2023 provided in the subsequent stage of 0. The other parts are the same as in the embodiment of FIG. In the case of this embodiment, the horizontal LPF 113 extracts a signal for main screen correlation processing. The input and output signals of the field memory 2001 and the output of the field memory 114 are supplied to the space-time interpolation filter 2021, and the output signal of the field memory 114 is the horizontal LPF 113 and the vertical HP.
After passing through F115, the adder 116 performs the decoding operation of the screen correlation processing.

The interpolation signal output from the spatiotemporal filter 2021 passes through the horizontal HPF 2022 and is added by the adder 2023 to interpolate the scanning lines in the entire horizontal band. Here, the spatiotemporal interpolation filter is composed of a coefficient unit and a line memory, and is interpolated by a process vertical in time and converted into a double speed.

FIG. 21 shows a tenth embodiment. In this embodiment, the case where the vertical HPF of the main screen correlation processing uses tap coefficients -1/16, 2/16, -1/16 is taken as an example. The parts indicated by the same numbers as in FIGS. 19 and 20 perform exactly the same operation. The output signal of the field delay 2001 is input to the field memory 114, and the vertical HPF is input.
It passes through 115 and is input to the adder 116. Thereby, the decoding process of the main screen correlation is performed. On the other hand, the input signal of the field memory 2001 is also supplied to the vertical HPF 2041. The vertical HPF 2041 is the vertical HPF 11
It has the same structure as the No. 5. The output of the vertical HPF 2041 is added to the output of the vertical HPF 115 by the adder 2703, and the added output is the progressive scan converter 204.
Upsampled by 3. Then, the output of the progressive scan converter 2043 is input to the adder 2046 via the horizontal HPF 2045. As a result, the scan of the output from the adder 110 is interpolated.

FIG. 22 shows the two-dimensional frequency characteristic in the operation and interpolation processing of this embodiment. FIG. 22
(A) shows a scanning line forming operation of an interpolation system for obtaining an interpolation scanning line and a scanning line forming operation of a direct system for obtaining a direct scanning line. FIG. 22B shows a two-dimensional frequency characteristic.

FIG. 23 shows an eleventh embodiment according to the present invention. This embodiment is a case where a television signal is received by performing a correlation process with the main screen and reducing the signal levels of the upper and lower non-picture areas. The parts indicated by the same numbers as those in the embodiment of FIG. 2 operate in exactly the same manner. The input main screen signal is sent to the field memory 2001 and the horizontal HPF 205.
Input to 1. The output of the horizontal HPF 2051 is the vertical H
It is input to the PF 2052 and supplied to the adder 2053. The output of the adder 2053 is input to the adder 116. Here, the output signal of the adder 2253 becomes a vertical high-frequency component delayed by two fields by the field memories 2001 and 114 and the vertical HPF 115, and a horizontal low-frequency component is the sum of the current field and the signal two fields before. Becomes The output signal of the adder 2053 is added to the signals of the upper and lower non-picture portions in the adder 116, but the horizontal low-frequency components are reduced in level by the correlation processing with the main screen signal. The horizontal high frequency component is used as a scanning line interpolation signal. Therefore, in the output of the adder 116, the horizontal low band is the reinforcement signal transmitted in the upper and lower non-picture parts, and the horizontal high band component is the sum signal between the two fields. This signal is up-sampled by the progressive scan converter 107, passed through the vertical HPF 109, and input to the adder 110. In the adder 110, the signal obtained by scanning line interpolation of the main screen signal and the reinforcement signal are combined.

In the above description, SSKF has 3 taps and 5 taps.
Horizontal band of tap filter and reinforcement signal is 1.2MHz
However, it is clear that the present invention is applicable to other cases. It is also possible to configure an interpolation filter separately from the correlation processing of the main screen.

[0078]

As described above, the present invention is SSK
By F, progressive scanning conversion of the entire band in the horizontal direction is possible, and since it is not particularly necessary to have a separate motion adaptive scanning line interpolator, the hardware scale is greatly reduced. As for the horizontal high-frequency component, the vertical high-frequency component of one field before is used, so that it is possible to prevent the deterioration of the vertical resolution during the moving image. Further, the present invention can be applied to motion adaptive processing, and since deterioration of vertical resolution during moving images can be suppressed to a minimum, the unnaturalness of switching between moving images and still images due to the motion adaptive processing is improved. can do.

[Brief description of drawings]

FIG. 1 is a diagram showing a first embodiment according to the present invention.

FIG. 2 is an explanatory diagram showing the circuit of FIG. 1 more specifically.

FIG. 3 is an operation explanatory diagram of the first embodiment described above.

FIG. 4 is an explanatory diagram of a two-dimensional frequency characteristic of the first embodiment described above.

FIG. 5 is a diagram showing a decoder to which the first embodiment described above is applied.

FIG. 6 is a diagram showing a conventional encoder using main screen correlation.

FIG. 7 is a diagram showing a conventional decoder using main screen correlation.

FIG. 8 is a diagram showing a second embodiment according to the present invention.

FIG. 9 is a diagram showing a decoder to which the second embodiment described above is applied.

FIG. 10 is a diagram showing a third embodiment according to the present invention.

FIG. 11 is a diagram showing a fourth embodiment according to the present invention.

FIG. 12 is an explanatory diagram of the two-dimensional frequency characteristic of the above-mentioned fourth embodiment.

FIG. 13 is a diagram showing a fifth embodiment according to the present invention.

FIG. 14 is a diagram showing a sixth embodiment according to the present invention.

FIG. 15 is an explanatory diagram more specifically showing the sixth embodiment.

FIG. 16 is an operation explanatory diagram of the sixth embodiment.

FIG. 17 is a diagram of the two-dimensional frequency characteristic of the sixth embodiment.

FIG. 18 is a diagram showing a seventh embodiment according to the present invention.

FIG. 19 is a diagram showing an eighth embodiment according to the present invention.

FIG. 20 is a diagram showing a ninth embodiment according to the present invention.

FIG. 21 is a diagram showing a tenth embodiment according to the present invention.

FIG. 22 is an explanatory diagram of the operation and the two-dimensional frequency characteristic of the tenth embodiment.

FIG. 23 is a diagram showing an eleventh embodiment according to the present invention.

FIG. 24 is a diagram showing a conventional encoder.

FIG. 25 is a diagram showing a conventional decoder.

FIG. 26 is an explanatory diagram of an encode signal.

FIG. 27 is an explanatory diagram showing a signal processing path by SSKF.

FIG. 28 is an explanatory diagram showing a specific example in which SSKF is incorporated in signal processing.

FIG. 29 is a diagram of a decoder to which SSKF is applied.

[Explanation of symbols]

102 ... Vertical low-pass filter (vertical LPF), 103
... Vertical high-pass filter (vertical HPF), 104, 10
5 ... Interlaced scan converter, 106, 107 ... Sequential scan converter, 108 ... Vertical low pass filter (vertical LPF),
109 ... Vertical high-pass filter (vertical HPF), 110
… Adder, 112… Horizontal low-pass filter (horizontal LP
F), 113 ... Horizontal high-pass filter (horizontal HPF),
114 ... Field memory, 115 ... Vertical high-pass filter (vertical HPF), 204 ... Direct LPF, 205 ...
Interpolation system LPF, 206 ... Direct system HPF, 207 ... Interpolation system HPF, 208, 209 ... Adder, 210 ... Double speed converter.

 ─────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor, Hideki Kimata, 14-2 Nibancho, Chiyoda-ku, Tokyo Within Nippon Television Network Co., Ltd. (72) Masayuki Ishida 14-14, Nibancho, Chiyoda-ku, Tokyo Nippon Television Broadcasting Ami Co., Ltd.

Claims (16)

[Claims] Claim: What is claimed is: 1. First means for receiving an interlaced scanning television signal and extracting a vertical low-frequency component of a transmitted current field, and extracting a signal of one field past the present field. Second means, third means for extracting a vertical high frequency component of the signal obtained by the second means, signal obtained by the first means, and third signal obtained by the third means A television signal processing apparatus comprising: a fourth means for synthesizing the generated signal, and a fifth means for interpolating a scanning line by the signal obtained by the fourth means. 2. The fifth means adaptively switches the signal obtained by the second means and the signal obtained by the fourth means according to a result of motion detection, and interpolates a scanning line. The television signal processing device according to claim 1, further comprising: 3. A television receiver for receiving a television signal in which an image having an aspect ratio different from that of the current NTSC broadcast is encoded into a letterbox format image and a reinforcement signal for reinforcing resolution is multiplexed in upper and lower non-picture areas. A first means for vertically filtering the main screen portion of the letterbox format image; a second means for delaying the signal of the main screen portion of the letterbox format image by one field; and the second means. The third means for extracting the vertical high frequency component of the signal obtained by the above, and the signal component obtained by the third means and the reinforcing signal transmitted by the upper and lower non-image parts are combined to perform vertical filtering processing. And a fifth means for interpolating the scanning line by synthesizing the signal obtained by the fourth means and the signal obtained by the first means. Television signal processing apparatus according to claim. 4. A first for performing the vertical filtering process.
4. The television signal processing apparatus according to claim 3, wherein the means and the fourth means each have two paths for performing a direct system processing and an interpolation system processing when performing scanning line interpolation. 5. The television signal processing apparatus according to claim 3, wherein the signal selected by the third means is a vertical high frequency component and a horizontal high frequency component. 6. The fifth means includes means for stopping the transmitted reinforcement signal when the reception S / N is lowered,
4. The television signal processing device according to claim 3, wherein scanning lines are interpolated in the entire horizontal band by the signal obtained by the third means. 7. A first means for receiving an interlaced scanning television signal and extracting a vertical high-frequency component of a transmitted current field, and a second means for extracting a signal one field past from the current field. Means, a third means for extracting a signal two fields past the current field, a fourth means for extracting a vertical low-frequency component of the signal obtained by the second means, and a second means Using the signal obtained by the fourth means and the fourth means for synthesizing the signal obtained by the first field past and the signals obtained by the first and third means, A television signal processing device comprising: a fifth means for interpolating a scanning line. 8. A means for delaying a plurality of fields, a means for delaying a field-delayed signal for a plurality of scanning line periods, and a means for interpolating a scanning line by multiplying each delayed signal by a coefficient. And a television signal processing device. 9. The means for interpolating a scanning line interpolates a scanning line of a horizontal high frequency component, and interpolates a scanning line of a horizontal low frequency component using a reinforcement signal transmitted. And a television signal processing device having means for synthesizing the respective interpolated scanning lines. 10. The interpolation means for interpolating the scanning lines interpolates the scanning lines of the horizontal high-frequency component, and the horizontal low-frequency components interpolate the scanning lines by the transmitted reinforcement signal, 8. The television signal processing device according to claim 7, further comprising means for synthesizing the respective interpolated scanning lines. 11. An image having an aspect ratio different from that of the current NTSC broadcast is encoded into a letterbox image,
Receives a television signal with a reduced signal level in the upper and lower non-picture areas by multiplexing the signals that enhance the resolution in the upper and lower non-picture areas and subtracting the vertical high-frequency components of the main screen signal from the signals in the upper and lower non-picture areas. In the television receiver, the first means for vertically filtering the main screen portion of the letterbox format image, and the second means for delaying the signal of the main screen portion of the letterbox format image by one field Means, and the signals obtained by said first and second means,
A television comprising: a third means for restoring the signals of the upper and lower non-image parts, and further performing scanning line interpolation using the signal obtained by the first means and the restored signal. Signal processing device. 12. An image having an aspect ratio different from that of the current NTSC broadcast is encoded into a letterbox image,
A television signal with a reduced signal level in the upper and lower non-picture areas is obtained by multiplexing a reinforcement signal to the upper and lower non-picture areas and subtracting the vertical high-frequency component of the main screen signal from the signals in the upper and lower non-picture areas. In the receiving television receiver, first means for extracting the signal of the current field of the transmitted signal, and second means for extracting the signal of one field past from the signal of the current field, Third means for extracting a signal of two fields past from the signal of the present field, and a signal obtained by the third means to reproduce a reinforcement signal subtracted from the main screen, First and third
Scanning line interpolation is performed by the signal obtained by the above-mentioned means, and the scanning line is interpolated by the signal obtained by the second means and the reinforcement signals transmitted in the upper and lower non-image parts, and the respective interpolated scanning lines are synthesized. A television signal processing device characterized by: 13. An image having an aspect ratio different from that of the current NTSC broadcast is encoded into a letterbox image,
A television signal with a reduced signal level in the upper and lower non-picture areas is obtained by multiplexing a reinforcement signal to the upper and lower non-picture areas and subtracting the vertical high-frequency component of the main screen signal from the signals in the upper and lower non-picture areas. In a receiving television receiver, first means for extracting a vertical low frequency component from an incoming television signal, second means for obtaining a signal of one field past the television signal, and the second means. A third means for obtaining a vertical high-frequency component from the signal obtained from the above, and a signal obtained from the third means and the reinforcement signal transmitted in the upper and lower non-image parts are combined to obtain a vertical high-frequency component. And a fifth means for performing scanning line interpolation processing using the output signals of the first means and the fourth means. 14. A main screen when a high-definition television signal is divided into a signal of a vertical low-frequency main screen portion and a signal of a vertical high-frequency non-picture portion to be a compatible television signal. Further, the horizontal high frequency component is frequency-shifted and multiplexed in the signal of the non-image part, and the horizontal frequency band of the signal of the non-image part is first divided.
Is a device that receives the compatible television signal and restores it to a high quality by limiting the frequency to a frequency equal to or lower than, and restores the horizontal high frequency component included in the signal of the main screen unit and the scanning line. First means for performing interpolation to obtain a vertical low-frequency component; second means for obtaining a field delay of the restored signal of the main screen section; and first means from the signal obtained from the second means. Third means for obtaining a horizontal high frequency signal having a frequency equal to or higher than the frequency, combining the signal of the non-image part and the horizontal high frequency signal obtained from the third means, and performing scanning line interpolation to perform a vertical high frequency range. Fourth means for obtaining a component and fifth means for combining the signals obtained from the first and fourth means
And a means for processing the signal. 15. The main screen when a high-definition television signal is divided into a signal of a vertical low-frequency main screen portion and a signal of a vertical high-frequency non-picture portion to be a compatible television signal. Further, the horizontal high frequency component is frequency-shifted and multiplexed in the signal of the non-image part, and the horizontal frequency band of the signal of the non-image part is first divided.
Is generated by limiting the frequency to a frequency equal to or lower than, and is a device that receives the compatible television signal and restores it to a high quality, for a reinforcement signal that restores the signal of the non-image part, in the different field. A means for activating a vertical high-frequency component in order to create an interpolated scan line by adding signals in the horizontal direction above the first frequency among the signals of the main screen section is provided. Television signal processor. 16. The main screen when a high-definition television signal is divided into a signal for a vertical low-frequency main screen portion and a signal for a vertical high-frequency non-picture portion to be a compatible television signal. Further, the horizontal high frequency component is frequency-shifted and multiplexed in the signal of the non-image part, and the horizontal frequency band of the signal of the non-image part is first divided.
Is generated by reducing the level of the signal of the main screen by subtracting the vertical high frequency component of the signal of the main screen, and restoring the compatible television signal to a high quality. , To the reinforcement signal obtained by restoring the signal of the non-picture part, restore the original level by adding the vertical high frequency component extracted from the signal of the main screen, and A television signal processing apparatus, comprising means for adding signals in the horizontal direction having a frequency equal to or higher than the first frequency and activating a high frequency component in the vertical direction to create an interpolated scan line.