JPH08125977A - Video signal processor - Google Patents

Abstract

PURPOSE: To prevent picture quality from being degraded by a reinforce signal even in the case of decoding a wide image and providing a skip scan converted output. CONSTITUTION: Concerning this device, a TV signal arranging a main signal at a main picture part and multiplexing the reinforce signal for resolution reinforce at upper and lower non-picture parts. Then, a vertical reducing component as the main signal is reproduced from a 3/4 scanning line converter 522, and the reinforce signal (vertical high frequency band component) is reproduced from a vertical processing part 524. Concerning the reinforce signal, a constant (k) less than '1' is multiplied to it by coefficient equipment 901 so that no line flicker can generate when it is converted into skip scanning later, it is added with the vertical reducing component by an adder 523, and the output of the adder 523 is converted into a skip scanning signal by a skip scan converter 801.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video signal processing apparatus for processing a television signal in which an image having an aspect ratio different from that of the current NTSC broadcast is transmitted in a letterbox format.

[0002]

2. Description of the Related Art In the NTSC color broadcast currently broadcast in Japan, the aspect ratio of the screen is 4: 3. On the other hand, in HDTV (High Definition Television System) research, the screen has a horizontally long aspect ratio of 1
It is known that 6: 9 is preferable. Therefore, the EDTV-2 system, which broadcasts a horizontally long program material so that it can be received by the current NTSC receiver, has been proposed and is being put to practical use.

In the EDTV-2 system, when playing back with an NTSC system receiver, the left and right sides of the horizontally long screen are cut to be 4: 3, or the horizontally long screen is displayed in the center of the 4: 3 screen and the upper and lower sides are displayed. Has been proposed as a non-image part. In particular,
The latter is called the letterbox format and is characterized in that the program material is not cut even when played back by an NTSC receiver.

When the letterbox format is adopted here, NTS is required to transmit an image having an aspect ratio of 16: 9.
There is a proposal to transmit the image quality enhancement signal by using the upper and lower non-image parts of the C method with about 480 effective scanning lines (lines / frame).
As an example, the Technical Report of the Television Society of Japan, Vol.17, No.
The system described in 65, pp19-24, BCS'93-42 (Oct. 1993) will be described below.

FIG. 4 is a diagram for explaining the principle of the encoder. In this example, 480 sequential scanning is adopted for input and converted to 360, and further 360 sequential scanning signals are converted into a known SS signal.
By the KF method, the main screen signal by 180 interlaced scanning and the image quality enhancement signal (hereinafter, simply referred to as compensation signal) LD by 180 interlaced scanning are separately transmitted. At this time, the main screen signal is transmitted in the center of the screen, the compensation signal LD is transmitted in the upper and lower non-image portions of the screen, and 360 or more vertical high frequency signals VH 'are multiplexed and transmitted with the compensation signal LD.

The RGB signals of 480 sequential scanning supplied to the input terminals 601, 602 and 603 are input to a matrix circuit (MATRIX) 604 and converted into YIQ signals. The converted YIQ signal is band-limited by a pre-low-pass filter (fLPF) 605 and then input to scanning line converters 609, 610, and 611, respectively.

The scanning line converters 609, 610 and 611 respectively convert the number of scanning lines from 480 to 360 (4
→ With 3), the sequential scanning is converted into the interlaced scanning (p
→ i), the output signals HH, I, and Q are converted into 360 letterbox format signals by the letterbox converter 640. At this time, with respect to the Y signal, a component of 4.2 MHz or more that cannot be transmitted in the current broadcast band is output in a letterbox format. This signal is HH '.

The HH 'signal converted into the letterbox format is frequency-shifted by a hall multiplexing circuit 625 to a conjugate position with a color subcarrier called a hall, and an adder 62 is provided.
2 is multiplexed with the Y signal of the main screen. The I signal is band-limited to 1.5 MHz by the horizontal low-pass filter (μLPF) 626, and the Q signal is horizontal low-pass filter (μLPF).
F) 627 band-limited to 0.5 MHz. The band-limited I signal and Q signal are quadrature-modulated by an IQ modulator 628. Color signal C obtained by this modulation
Is multiplexed with the Y signal of the main screen by the adder 622 as in the normal NTSC system.

On the other hand, the Y signal output from the matrix circuit 604 is input to the first vertical processing unit 606 including 4 → 3 scanning line conversion, SSKF, and interlaced scanning conversion (p → i). The first vertical processing unit 606 converts the inputted 480 Y signals into 360 (4 → 3), and SS
A vertical low-pass filter (vLPF) based on the KF method separates vertical low-pass components, and converts the signal into interlaced scanning (p → i). The Y signal converted into 360 lines is also input to the second vertical processing unit 607. The second vertical processing unit 607 separates vertical high-frequency components by a vertical high-pass filter (vLHF) based on the SSKF method, and converts the signal into interlaced scanning (p → i).

The vertical low-frequency component output from the first vertical processing unit 606 is converted by the letterbox converter 640 into a letterbox format main screen signal. On the other hand, the vertical high frequency component output from the second vertical processing unit 607 is L
It becomes a D signal and is input to the LD / VH 'multiplexing circuit 613.

The Y signal output from the pre-pass filter 605 is input to the vertical high frequency component processing unit 608.
The vertical high frequency component processing unit 608 vertically shifts the frequency of 360 or more vertical high frequency components (v shift), 4
The scanning line conversion of → 3 is performed (4 → 3), and the interlaced scanning signal is converted (p → i). This signal becomes VH 'signal,
It is input to the LD / VH ′ multiplexing circuit 613.

Y output from the matrix circuit 604
The signal is also input to the motion detector 612. The motion detector 612 detects the motion of the image from the input Y signal and outputs a motion detection signal according to the motion.

The LD / VH 'multiplexing circuit 613 is controlled by the motion detection signal output from the motion detector 612. When the motion detection signal indicates a still image, the VH' signal is multiplexed with the LD signal to obtain the motion detection signal. Is a video, V
Only the LD signal is output without multiplexing the H'signal.

LD / VH 'Multiplexing circuit 613 output LD /
VH 'is converted into a letterbox format signal of the upper and lower non-picture parts by the letterbox converter 640, and then fsc
The frequency signal fsc of the color subcarrier is input to the modulator 624.
To modulate. The modulated wave output from the fsc modulator 624 is derived by the switch 623 as a letterbox-type upper and lower non-image portion signal at a predetermined timing, and is output from the output terminal 629.

On the other hand, in the signal of the main screen output from the letterbox converter 640, holes are formed in the frequency region in which the HH 'signal is multiplexed by the precombing 620, and 4.2 MHz is generated by the horizontal low-pass filter (μLPF) 621. Bandwidth is limited to. After the band is limited, the HH ′ signal and the color signal C are added by the adder 622.
This addition output is derived at a predetermined timing as a letterbox type main screen signal by a switch 623,
It is output from the output terminal 629. As a result, the encoded EDTV signal is transmitted from the output terminal 629.

FIG. 6 shows the LD / VH 'multiplex circuit 61 described above.
3 shows the configuration of FIG. The terminal 701 is supplied with the LD signal from the second vertical processing unit 607, and the terminal 702 is supplied with the VH ′ signal from the vertical high frequency component processing unit 608. A motion detection signal from the motion detector 612 is supplied to the terminal 703.

The LD signal supplied to the terminal 701 is input to the time frequency modulator 705 and frequency-shifted in the time vertical frequency domain by the modulation carrier. Terminal 702
The VH ′ signal supplied to is input to the multiplier 704. The value (1-k) is input to the other input terminal of the multiplier 704. Here, k represents the value of the motion detection signal, and takes a value of 0 ≦ k ≦ 1. 0 represents a still image, and 1 represents a moving image. Therefore, the output of the multiplier 704 changes according to the movement, the VH 'signal is output during a still image, and nothing is output during a moving image.

The signal output from the multiplier 704 is input to the time frequency modulator 706 and frequency-shifted in the time vertical frequency domain by the carrier signal. The outputs of the frequency modulators 705 and 706 are both input to the adder 707,
The LD signal and the VH 'signal are multiplexed. Adder 707
Is supplied to the terminal 708 and becomes the output of the LD / VH ′ multiplexing circuit 613.

When the modulation carrier of the time-frequency modulators 705 and 706 is properly selected, the LD signal is time-frequency 0-30.
Can be placed at Hz and the VH 'signal can be placed at 15 Hz. At this time, since the spectra do not overlap with each other during a still image, the LD signal and the VH ′ signal can be multiplexed and transmitted. Therefore, at the time of moving image, the VH ′ signal is multiplexed and transmitted at a time frequency of 15 Hz.

FIG. 5 shows a decoder corresponding to the above encoder. This decoder is also a technical report of the Television Society of Japan Vol.17, No.65, pp19-24, BCS'93-42 (Oct.1993)
It is described in.

The encode signal (EDTV signal) input from the input terminal 501 is divided by the switch 502 into a signal for the main screen portion and a signal for the upper and lower non-image portions. The signal of the main screen is the three-dimensional Y / C / HH 'signal separation circuit 50.
3, input to the motion detector 504. Motion detector 504
Detects the motion of the image from the signal of the main image section and outputs a motion detection signal according to the presence or absence of the motion. 3D Y / C / HH
The signal separation circuit 503 separates the Y signal, the color signal C, and the HH ′ signal according to the motion detection signal output from the motion detector 504, and the respective signals are added by an adder 508, a demodulator 507, and an IQ demodulator. Input to the device 509.

The demodulator 507 demodulates the HH 'signal to 4.
A horizontal high frequency signal HH of 2 MHz or more is reproduced. This HH
The signal is input to the adder 508. Therefore, adder 5
The output signal of 08 is a Y signal having a horizontal resolution of 4.2 MHz or more. In this example, it is possible to reproduce Y signals up to 6 MHz.

On the other hand, the color signal C is input to the IQ demodulator 509, where the I signal and the Q signal are reproduced. The I signal is processed by the horizontal low-pass filter (μLPF) 510.
It is band-limited to 5 MHz, and the Q signal is band-limited to 0.5 MHz by the horizontal low-pass filter (μLPF) 511. Band-limited I and Q signals are 3 →
It is input to the four scanning line converters 525 and 526, and converted into 480 progressive scanning signals by scanning line conversion. The outputs of the 3 → 4 scanning line converters 525 and 526 are both input to the matrix circuit (MATRIX) 527.

On the other hand, the output signal of the adder 508 includes an adder 519, a horizontal high-pass filter (μHPF) 512, a horizontal low-pass filter (μLPF) 513, and a motion detector 5.
15 is input. The motion detector 515 detects the motion of the image from the Y signal output from the adder 508, and outputs a motion detection signal according to the presence or absence of motion. Motion detector 515
The motion detection signal output from the above is input to the LD / VH ′ separation demodulation circuit 514 and the motion adaptive scanning line interpolator 516.

Here, since the horizontal scanning frequency of 1.2 MHz or less can reproduce the progressive scanning signal by the SSKF method,
Horizontal 1.2 output from the horizontal low-pass filter 513
The components below MHz are input to the vertical low-pass filter (vLPF) 517 of the SSKF method, and are converted into progressive scanning signals. Then, the 1.2 MHz or higher component output from the horizontal high-pass filter 512 is input to the motion adaptive scanning line interpolator 516, and is converted into a sequential scanning signal by the known motion adaptive scanning line interpolation.

In actual hardware, the processing speed becomes faster when converted to progressive scanning. Therefore, the originally transmitted scanning line and the scanning line generated by interpolation are directly and interpolated, respectively. It is divided and processed. That is,
The output of the motion adaptive scanning line interpolator 516 is input to the adder 520 as an interpolation system. On the other hand, the output of the adder 508 is input to the adder 519 as a direct system.

On the other hand, the non-picture part signal selectively taken out by the switch 502 is demodulated by the fsc demodulator 505, and time-expanded by 3 times by the horizontal expander 506. The output of the horizontal expander 506 is the LD / VH ′ separation demodulation circuit 514.
Is input to This LD / VH 'separation demodulation circuit 514
Separates the LD signal and the VH ′ signal based on the motion detection signal output from the motion detector 515. This LD / V
The detailed operation of the H'separation / demodulation circuit 514 will be described later.

The LD signal output from the LD / VH 'separation demodulation circuit 514 has an upper limit of its band of 1.2 MHz, and the vertical high-pass filter (vHP) by the SSKF method is used.
F) is input to 518. The SSKF vertical high-pass filter (vHPF) 518 outputs the signals of the direct system and the interpolation system, the signals of the direct system are input to the adder 519, and the signals of the interpolation system are input to the adder 521. In the adder 521, the signals of the interpolation system of the SSKF vertical low pass filter 517 and the SSKF vertical high pass filter 518 are added,
A complete interpolated scan line signal is obtained for 0 to 1.2 MHz. The output of the adder 521 is input to the adder 520 and is output from the motion adaptive scan line interpolator 516 1.
The component of 2 MHz or more is added to the interpolation scan line which is the known motion adaptive scan line interpolation. Also, in the adder 519, SS
The direct system signal output from the KF vertical high pass filter 518 and the output of the adder 508 are added.

The output of the adder 519 is input as a direct system signal, and the output of the adder 520 is input as an interpolation system signal to the 3 → 4 scanning line converter 522. By the scanning line conversion, the effective scanning line number of 480 is input. It is converted into a progressive scanning signal.

The VH ′ signal output from the LD / VH ′ separation demodulator 514 is input to the vertical processing unit 524 and 3 →
Vertical shift (v shift) is performed along with 4 scan line conversion, and 3
Converted to 60 or more vertical high frequency components. The output of the vertical processing unit 524 is input to the adder 523. The adder 523 synthesizes 360 or less vertical low-frequency components and 360 or more vertical high-frequency components to reproduce 480 progressive scanning signals. The output signal of the adder 523 is the matrix circuit 52.
7 is input.

Finally, the Y signal output from the adder 523 by the matrix circuit 527 and the I signal and Q signal output from the 3 → 4 scanning line converters 525 and 526 are RGB signals.
It is converted into a signal, output from the output terminals 528, 529, 530 as RGB and displayed as an image on the display.

In FIG. 7, an LD / VH 'separation demodulator 514 is shown.
Is shown. A horizontal expander 511 is connected to the terminal 711.
The LD / VH 'signal output from the
4 is supplied with the motion detection signal output from the motion detector 527. The LD / VH ′ signal supplied to the terminal 711 is supplied to the subtractor 715 and the time band pass filter (fBP).
F) is input to 712. The time bandpass filter 712 extracts components near the time frequency of 15 Hz. The output of the time bandpass filter 712 is the multiplier 7
It is input to 13 and is multiplied by the value of (1-k). here,
k represents the value of the motion detection signal, and has a value of 0 ≦ k ≦ 1.
0 represents a still image, and 1 represents a moving image. Therefore, the multiplier 7
The output of 13 changes according to the movement, and nothing is output during a moving image. That is, the multiplier 713 outputs the VH ′ signal multiplexed only in the still image.

The VH 'signal output from the multiplier 713 is input to the subtractor 715 and subtracted from the LD / VH' signal input from the terminal 711. Therefore, the LD signal is output from the subtractor 715. Subtractor 715
The LD signal output from the VH 'signal and the VH' signal output from the multiplier 713 are input to demodulators 716 and 717, respectively, and are shifted to the original frequency components in the time vertical frequency domain based on the demodulation carrier.

The outputs of the demodulators 716 and 717 are supplied to the output terminals 718 and 719, respectively, and become the outputs of the LD / VH 'separation demodulation circuit 514. By this processing, it is possible to separate the VH ′ signal multiplexed with the LD signal during a still image.

As described above, according to the encoder and decoder described with reference to FIGS. 4 and 5, it is possible to transmit and reproduce high quality wide images. Although the decoder of FIG. 5 outputs a sequential scanning signal, it is possible to obtain a decoder which outputs an interlaced scanning signal.

FIG. 8 shows an example of a decoder for obtaining an interlaced scanning signal. 8, the same parts as those of the device of FIG. 5 are designated by the same reference numerals and the description thereof will be omitted. The progressive scan luminance signal output from the adder 523 is input to the interlaced scan converter 801. With the interlaced scan converter 801,
Conversion from the progressive scanning signal to the interlaced scanning signal is performed. The interlaced scan luminance signal output from the interlaced scan converter 801 is input to the matrix circuit 527.

The I and Q signals output from the 3 → 4 scanning line converters 525 and 526 are input to the interlaced scanning converters 802 and 803, respectively. Interlaced scan converter 80
In 2 and 803, the input sequential scanning signal is converted into an interlaced scanning signal. Interlaced scan converters 802, 80
I and Q signals for interlaced scanning output from
Converted into a GB signal and output terminals 528, 529, 530
Image is displayed on the interlaced scanning display.

As described above, the processing apparatus having the configuration shown in FIG. 8 can reproduce an interlaced scanning wide image. By the way, the VH signal of the reinforcement signal is a vertical high frequency component. This vertical high frequency component is effective in the case of a progressive scanning image receiver, but in the case of an interlaced scanning receiver, it causes line flicker due to aliasing of the interlaced scanning. Therefore, in the case of the interlaced scanning receiver, there is a problem that a line flicker occurs due to a reinforcement signal (VH signal) for improving image quality, which causes interference.

[0039]

As described above, a first image for arranging an image having an aspect ratio different from that of the current NTSC broadcasting in the main image part of the letterbox format and for enhancing the resolution in the upper and lower non-image parts is provided. A television signal obtained by multiplexing the reinforcement signal and the second reinforcement signal is decoded as a wide image,
When output as an interlaced scanning signal, there is a problem that a reinforcement signal for improving image quality causes interference such as line flicker and deteriorates image quality.

Therefore, it is an object of the present invention to provide a video signal processing device in which the enhancement signal does not cause image quality deterioration even when a wide image is decoded and output as an interlaced scanning signal.

[0041]

According to the present invention, a first reinforcement for arranging an image having an aspect ratio different from that of the current NTSC broadcasting in the main image part of the letterbox format and reinforcing the resolution in the upper and lower non-image parts. An input section for receiving a television signal in which a signal and a second reinforcement signal are multiplexed, a first reproducing means for reproducing the first reinforcement signal multiplexed in the upper and lower non-picture areas, and the upper and lower non-picture areas. Second reproduction means for reproducing the second reinforcement signal multiplexed in the section, the first reinforcement signal obtained by the first reproduction means, and the signal of the main picture portion of the input television signal. Scanning line conversion means for converting the scanning lines by using the second scanning line conversion means for converting the scanning lines of the second reinforcement signal obtained by the second reproducing means; The output of the scanning line conversion means of No. 1 and the second scan multiplied by the coefficient. Comprising synthesizing means for synthesizing the output of the line converting means, and a scanning format conversion means for converting the scanning format of the output of the first scanning line conversion means.

[0042]

According to the above means, it is possible to solve the problem that the reinforcing signal useful when the wide image is used as the sequential scanning signal causes the image quality deterioration when the wide image is used as the interlaced scanning signal.

[0043]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 shows a decoder according to an embodiment of the present invention. Many parts of this decoder are the same as the decoder described in FIG. 8, and the same parts are denoted by the same reference numerals, and different parts will be described. According to this embodiment, the output signal of the vertical processing unit 524 which performs the vertical frequency shift by performing the 3 → 4 scanning line conversion on the VH ′ signal separated by the LD / VH ′ separation demodulation circuit 514 is the coefficient unit 901.
Is input to the adder 523 via the input signal and added to the output vertical low-pass component from the 3 → 4 scanning line converter 522.

According to the above configuration, the image is reproduced by using the VH signal multiplied by the constant k. Then, if the constant k is made smaller than 1, it becomes smaller than the original reproduction level. Therefore, the level of line flicker that occurs can be lowered as compared with the conventional case.

FIG. 2 shows another embodiment of the present invention. In the case of this embodiment, the constant k in the coefficient unit 901 of the first embodiment is set to 0. That is, the VH signal is not used, and in this case, the vertical processing unit 522, the coefficient unit 901 and the adder 523 in the first embodiment are unnecessary. The vertical low-frequency component output from the 3 → 4 scan line converter 522 is directly interlaced scan converter 8
01 is input and converted into an interlaced scanning signal.

Therefore, the VH signal is not reproduced and the line flicker is not generated by the VH signal. FIG. 3 shows a third embodiment of the present invention. This embodiment is a decoder configured to have both progressive scan output and interlaced scan output. The vertical low frequency component output from the 3 → 4 scanning line converter 522 is input to the adder 523 and the adder 902. The VH signal output from the vertical processing unit 524 is supplied to the adder 523 and also input to the adder 902 via the coefficient unit 901.

Therefore, in the adder 523, the vertical low-frequency component from the 3 → 4 scanning line converter 522 and the vertical high-frequency component from the vertical processing unit 524 are added, and the output thereof is input to the matrix circuit 527. It Further, the coefficient k is multiplied by the constant k in the coefficient unit 901 and added to the vertical low frequency component in the adder 902, which is input to the interlaced scanning converter 801. The interlaced scanning converter 801 converts the input sequential scanning signal into an interlaced scanning signal and supplies it to the video encoder 903.

On the other hand, the color signal processing path is constructed as follows. I signal 3 → 4 scanning line converter 52
The output of No. 5 is supplied to the matrix circuit 527 and also input to the interlaced scan converter 802. The output of the 3 → 4 scanning line converter 526 of the Q signal is supplied to the matrix circuit 527 and the interlaced scanning converter 8 is provided.
It is input to 03. Interlaced scan converters 802, 803
Converts interlaced scanning signals from the respectively input sequential scanning signals, and the output thereof is input to the video encoder 903. The video encoder 903 generates a composite video signal using the interlaced scanning signals from the interlaced scanning converters 801, 802, and 803, which are Y signals, I signals, and Q signals, and outputs this video signal to an output terminal 904. There is.

In the above decoder, the coefficient unit 901
If the constant k of is smaller than 1, the interlaced scanning video signal output from the progressive scanning receiver can reduce line flicker interference due to the VH signal. Further, if the constant k is set to 0, it is possible to prevent the line flicker from being disturbed by the VH signal. Although the coefficient unit 901 is used in the above-described first and third embodiments, an operating means for adjusting or switching the constant k of the coefficient unit from the outside may be provided.

[0050]

As described above, according to the present invention,
Even when a wide image is decoded and an interlaced scanning conversion output is obtained, the image quality is prevented from being deteriorated by the reinforcement signal.

[Brief description of drawings]

FIG. 1 is a circuit diagram showing a first embodiment of the present invention.

FIG. 2 is a circuit diagram showing a second embodiment of the present invention.

FIG. 3 is a circuit diagram showing a third embodiment of the present invention.

FIG. 4 is a diagram showing an encoder in a television system adopting the EDTV-2 format.

FIG. 5 is a diagram showing a decoder in the television system.

FIG. 6 is a diagram showing an LD / VH ′ multiplexing circuit of the encoder of FIG. 2.

7 is a diagram showing an LD / VH 'separation demodulation circuit of the decoder of FIG.

FIG. 8 is a diagram showing a decoder for obtaining an interlaced scanning signal.

[Explanation of symbols]

502 ... Switch, 503 ... Three-dimensional Y / C / HH 'signal separation circuit, 504 ... Motion detector, 505 ... fsc demodulator,
506 ... Horizontal decompressor, 507 ... Demodulator, 508 ... Adder, 509 ... IQ demodulator, 510 ... Horizontal low-pass filter, 511 ... Horizontal low-pass filter, 514 ... LD / V
H'separation / demodulation circuit, 515 ... Motion detector, 517 ... SS
KF vertical low-pass filter, 518 ... SSKF vertical high-pass filter, 519, 520, 521 ... Adder, 52
2 ... 3 → 4 scanning line converter, 523 ... Adder, 524 ... Vertical processing unit, 525, 526 ... 3 → 4 scanning line converter, 52
7 ... Matrix circuit, 801, 802, 803 ... Interlaced scan converter, 901 ... Coefficient unit, 902 ... Adder, 9
03 ... Video decoder.

Claims (3)

[Claims] 1. A first reinforcement signal and a second reinforcement signal for arranging an image having an aspect ratio different from that of the current NTSC broadcast in a main image part of a letterbox format and reinforcing resolution in the upper and lower non-image parts. An input section to which a television signal in which the above is multiplexed is input, first reproducing means for reproducing the first reinforcing signal multiplexed in the upper and lower non-picture sections, and a second reproducing section which is multiplexed in the upper and lower non-picture sections Second reproduction means for reproducing the reinforcement signal, conversion of the scanning line using the first reinforcement signal obtained by the first reproduction means and the signal of the main picture portion of the input television signal. First scanning line converting means for performing, second scanning line converting means for converting the scanning line of the second reinforcement signal obtained by the second reproducing means, and output of the first scanning line converting means And the output of the second scanning line conversion means multiplied by a constant are combined. Combining means and video signal processing apparatus characterized by comprising a scanning format conversion means for converting the scanning format of the output of said combining means. 2. A first reinforcement signal and a second reinforcement signal for arranging an image having an aspect ratio different from that of the current NTSC broadcast in the main image part of the letterbox format and reinforcing the resolution in the upper and lower non-image parts. An input section to which a television signal in which the above is multiplexed is input, first reproducing means for reproducing the first reinforcing signal multiplexed in the upper and lower non-picture sections, and a second reproducing section which is multiplexed in the upper and lower non-picture sections Second reproduction means for reproducing the reinforcement signal, conversion of the scanning line using the first reinforcement signal obtained by the first reproduction means and the signal of the main picture portion of the input television signal. First scanning line converting means for performing, second scanning line converting means for converting the scanning line of the second reinforcement signal obtained by the second reproducing means, and output of the first scanning line converting means And the output of the second scanning line conversion means multiplied by a constant are combined. First synthesizing means, scanning format converting means for converting the scanning format of the output of the first synthesizing means, encoding means for obtaining an interlaced scan output using the output of the scanning format converting means, and the first The image forming apparatus further comprises: second synthesizing means for synthesizing the output of the scanning line converting means and the output of the second scanning line converting means; and matrix means for obtaining a progressive scan output by using the output of the second synthesizing means. A video signal processing device characterized by the above. 3. The video signal processing apparatus according to claim 1, wherein the constant applied to the output of the second scanning line conversion means is a value smaller than 1.