WO2012114373A1

WO2012114373A1 - Image signal processing method and device

Info

Publication number: WO2012114373A1
Application number: PCT/JP2011/001000
Authority: WO
Inventors: 健一米司; 浜田　宏一; 義崇平松
Original assignee: 株式会社日立製作所
Priority date: 2011-02-23
Filing date: 2011-02-23
Publication date: 2012-08-30

Abstract

The purpose of the present invention is to provide high-quality images in which color shift and noise have been minimized. As a means of achieving this purpose, an image signal processing device, which converts a first image signal to a second image signal, is provided with: a luminance/color difference separation unit that separates or generates a first luminance signal and a first color difference signal from the first image signal; a luminance signal processing unit that converts the first luminance signal to a second luminance signal using a first spatial filter; a color difference signal processing unit that converts the first color difference signal into a second color difference signal using a second spatial filter which differs from the first spatial filter; and a luminance/color difference signal joining unit that outputs the second image signal from the second luminance signal and the second color difference signal.

Description

Video signal processing method and apparatus

The present invention relates to a video signal processing technique using a spatial filter.

In recent years, in a video signal processing apparatus, signal processing such as enlargement or reduction of a video signal input in the middle of a processing system is performed. For example, a process is generally performed in which an image captured by a camera is temporarily reduced and stored in a storage medium such as a personal computer, and then enlarged and displayed on a television.

An example of video signal processing for enlarging / reducing video is disclosed in Non-Patent Document 1 and Non-Patent Document 2.

In the prior art, when image processing is performed on the luminance signal and color difference signal of the input signal, image processing including a spatial filter that matches the enlargement ratio and reduction ratio is performed. In such image processing, processing for preserving or enhancing the sharpness of an image that retains the sharpness of the image is usually performed. However, when processing for preserving such sharpness is performed, color misalignment noise may occur. Color shift noise degrades video quality.

An object of the present invention is to provide a high-quality image in which color shift noise is suppressed.

Actual images include images in which the spatial frequency characteristics of the luminance signal and the spatial frequency characteristics of the color difference signal are completely different.

Despite this, the luminance signal and the color difference signal have been processed with the same spatial filter.

As described above, when preserving or enhancing the sharpness of an image, a filter that generates a shoot (overshoot or undershoot) is used as a spatial filter. As a result, color misalignment noise was generated.

Therefore, the inventors have used a second spatial filter that is different from the first spatial filter that inputs the luminance signal as a spatial filter that performs image processing on the color difference signal, thereby shooting the color difference signal after image processing. I thought that the color shift noise caused by this could be suppressed.

Specifically, the luminance signal is processed by the first filter that generates a shoot with respect to the first input signal, and the color difference signal is output by the second filter that has a smaller shoot than when the first input signal is processed by the first filter. To handle.

1 is a block diagram of a video signal processing apparatus according to Embodiment 1. FIG. 3 is a block diagram of a luminance / color discrimination signal processing unit according to Embodiment 1. FIG. FIG. 3 is a block diagram of an image signal processing unit according to the first embodiment. FIG. 3 is a block diagram of a color difference signal reduction processing unit and a color difference signal enlargement processing unit according to the first embodiment. It is a figure which shows the spatial frequency characteristic of a low-pass filter. FIG. 6 is a diagram showing the result of reducing / enlarging the input signal of Example 1 with a spatial filter. 6 is a block diagram of a luminance / color discrimination signal processing unit according to Embodiment 2. FIG. FIG. 6 is a diagram showing the result of reducing / enlarging the input signal of Example 2 with a spatial filter. FIG. 10 is a block diagram of color difference signal enlargement processing according to the third embodiment. 10 is a block diagram of a luminance / color discrimination signal processing unit according to Embodiment 4. FIG. FIG. 10 is a block diagram of a color difference signal reduction processing unit and a color difference signal enlargement processing unit according to a fourth embodiment. FIG. 10 is a block diagram of a luminance / color discrimination signal processing unit according to a fifth embodiment. FIG. 10 is a block diagram of color difference signal super-resolution processing according to a fifth embodiment. FIG. 10 is a block diagram of color difference signal super-resolution processing according to a sixth embodiment. FIG. 10 is a block diagram of a video display device in Example 7. FIG. 10 is a block diagram of a recording / playback apparatus according to an eighth embodiment.

The following examples will be described, but the present invention is not limited to these examples.

FIG. 1 shows a block diagram of a video signal processing apparatus according to the first embodiment.

The input signal (101) is input to the luminance / color difference signal separation unit (102). The luminance / chrominance signal separation unit (102) decomposes the input signal (101) into a luminance signal (103) and a color difference signal (104). The luminance signal (103) and the color difference signal (104) are input to the luminance color discrimination signal processing unit (105). In the luminance color discrimination signal processing unit (105), the luminance signal and the color difference signal are processed separately. The luminance signal (103) is input to the luminance signal processing unit (106), and the color difference signal (104) is input to the color difference signal processing unit (107). Each processing result is input to the luminance / chrominance signal combining unit (108) and output as one output signal (109). With the configuration described above, it is possible to perform separate signal processing on the luminance signal (103) and the color difference signal (104).

In the luminance / chrominance signal separation unit (102), when the input signal (101) is a signal using a luminance and color difference, such as YCbCr system or YPbPr system, the luminance signal (103) and color difference The signal (104) is divided and output as it is. When expressed in other formats, for example, when expressed in RGB or XYZ systems, after converting to YCbCr or YPbPr system, the luminance signal (103) and color difference signal (104) are output separately. . This conversion method is performed by multiplying conversion coefficients. Further, if the input signal is originally such that the luminance signal and the color difference signal are separated, the output may be performed without any processing.

The luminance / chrominance signal combining unit (108) collectively outputs the output signals from the luminance / color discrimination signal processing unit (105). At this time, if the format of the output signal (109) needs to be RGB or XYZ, the signal format is converted according to a predetermined method, and then the signals are output together. In addition, when there is an apparatus that receives the output signal (109) and performs further processing behind this apparatus, it is necessary to separately input the luminance signal and the color difference signal when it is necessary to input the luminance signal and the color difference signal separately. It is sufficient to output the data as it is without putting it together.

In the luminance color discrimination signal processing unit (105), image signal processing including processing using a spatial filter is performed. The process using the spatial filter is a process in which the spatial frequency characteristics change before and after the image signal processing. In this embodiment, as shown in FIG. 2, an example in which reduction / enlargement processing is performed as processing using a spatial filter will be described. The luminance signal (103) is subjected to image reduction processing by the luminance signal reduction processing unit (201). Similarly, the color difference signal (103) is subjected to image reduction processing by the color difference signal reduction processing unit (202). Outputs of the luminance signal reduction processing unit (201) and the color difference signal reduction processing unit (202) are input to the image signal processing unit (203). The image signal processing unit (203) performs the image signal processing shown in FIG. Among the outputs of the image signal processing unit (203), the luminance signal is input to the luminance signal enlargement processing unit (204), and the color difference signal is input to the color difference signal enlargement processing unit (205). The luminance signal enlargement processing unit (204) and the color difference signal enlargement processing unit (205) each perform image enlargement processing.

Fig. 3 shows a block diagram of the image signal processing unit (203). The input luminance signal (301) and the input color difference signal (302) are input to the encoding unit (303). The encoding unit (303) performs encoding processing in a standardized encoding format such as MPEG2, MPEG4, H.264, HEVC, and the like, thereby reducing the data amount. The reduced data is transmitted by a transmission / recording medium such as a broadcast wave (304), and the received signal is input to the decoding unit (305). The decoding unit (305) performs a decoding process corresponding to the encoding process to obtain an output luminance signal (306) and an output color difference signal (307). Here, since the input luminance signal (301) and the input color difference signal (302) have a smaller number of pixels than the luminance signal (201) and the color difference signal (202) in FIG. 2, the luminance signal reduction processing unit (203 ) And the color difference signal reduction processing unit (204), there is an advantage that transmission (304) is possible with a smaller amount of data.

FIG. 4 shows a block diagram of the color difference signal reduction processing unit (202) and the color difference signal enlargement processing unit (205). In the color difference signal reduction processing unit (202), an input signal is first input to the filter processing unit (401). The reduction filter processing unit (401) performs spatial filter processing using a low-pass filter. The output of the reduction filter processing unit (401) is input to the pixel thinning unit (402), and image reduction processing is performed by thinning out pixels. This flow is a general image reduction process, and the luminance signal reduction processing unit (201) has the same configuration. In the color difference signal enlargement processing unit (205), an input signal is first input to the pixel interpolation unit (403). The pixel interpolation unit (403) inserts black at regular intervals until the required number of pixels is reached, thereby increasing the number of pixels. The output of the pixel interpolation unit (403) is input to the enlargement filter processing unit (404). The enlargement filter processing unit (404) performs spatial filter processing using a low-pass filter to obtain an enlarged image. This flow is a general image enlargement process, and the luminance signal enlargement processing unit (204) has the same configuration. Depending on the enlargement ratio and reduction ratio, a pixel interpolation unit may be required for the reduction process, and a pixel thinning unit may be required for the enlargement process.

The reduction filter processing unit (401) and the enlargement filter processing unit (402) each require a low-pass filter that drops high-frequency components. Fig. 5 shows the spatial frequency characteristics of the low-pass filter. FIG. 5A shows the spatial frequency characteristic (501) of the low-pass filter. This low-pass filter is a filter that drops the spatial frequency components after the cutoff frequency (505). This cut-off frequency (505) is set in consideration of the sampling theorem from the enlargement ratio and reduction ratio. The spatial filter (502) of FIG. 5 (b) is obtained by Fourier transforming this filter, and filter processing is performed by convolution operation using this spatial filter (502).

FIG. 6 is a diagram showing the result of reducing and enlarging the input signal. FIG. 6A shows an input luminance signal (601) and an input color difference signal (602). On the other hand, the results of processing the luminance signal and the color difference signal using the spatial filter (502) of FIG. 5 (b) are shown in the output luminance signal (603) and the output color difference signal (604) of FIG. 6 (b). As described above, when the reduction and enlargement processing is performed by the general spatial filter (502), an overshoot (605) and an undershoot (606) are generated as shown in FIG. 6 (b). This overshoot (605) and undershoot (606) of the color difference signal may be visually recognized as a picture in which the color difference component protrudes outside the edge line when viewed in the image, and this is color shift noise. is there. This color shift noise is caused by overshoot (605) and undershoot (606), and this overshoot (605) and undershoot (606) are vibrations in the spatial filter (502) of FIG.5 (b). Occurs due to component (503). Therefore, considering this, the result of processing the luminance signal and the color difference signal using the filter (504) with a small vibration component as shown in FIG. 5 (c) is the output luminance signal (607) and the output of FIG. 6 (c). A color difference signal (608). This makes it possible to reduce overshoot and undershoot. On the other hand, a signal that was originally steep may become a gentle signal component (609). Therefore, there is a problem that the sharpness of the reduction and enlargement processing results is lost, and the video is blurred as a whole. In view of the above, a filter capable of preserving steep components but generating overshoot and undershoot, such as the spatial filter (502) in FIG. Then, a filter in which the spatial rise of the output signal is gentler than that of the input signal, such as the filter (503) with less vibration components in FIG. A filter used for processing such a color difference signal is suitable if it is a filter that does not cause overshoot and undershoot, or a filter that has a smaller shoot than the filter used for processing the luminance signal. As a result, as shown in FIG. 6 (d), an output luminance signal (610) in which a steep component is stored in the luminance signal is obtained, and an output color difference signal (611) in which overshoot and undershoot are reduced is obtained as the color difference signal. It is done. As a result, it is possible to suppress color misregistration noise while preserving the sharpness of the reduction and enlargement processing results. According to the video signal processing device according to the first embodiment described above, the sharpness of the reduction and enlargement processing results is preserved by changing (making different) the spatial filter used for signal processing between the luminance signal and the color difference signal. As a result, it is possible to suppress color shift noise.

Example 2 describes an example in which the input signal is a signal that has already been reduced in Example 1.

Considering the case where the input signal is a reduced signal, an example of modification of the luminance / color discrimination signal processing unit in FIG. FIG. 7 is a block diagram of the luminance / color discrimination signal processing unit when the reduced input signal is enlarged. The luminance signal (103) is input to the luminance signal enlargement processing unit (703) and subjected to enlargement processing. The color difference signal (104) is input to the color difference signal enlargement processing unit (704) and subjected to enlargement processing.

If the input signal is a reduced signal, overshoot and undershoot may already occur in the color difference signal depending on the reduction method. When the video reduced using the reduction filter (802) as shown in FIG. 8 (b) is an input video, overshoot and undershoot have already occurred, and the enlargement processing unit takes this into consideration. Is required. In order to prevent the occurrence of overshoot and undershoot, the reduction and enlargement filter may be a filter (801) having a small vibration component as shown in FIG. 8 (a). Therefore, by using the enlargement filter (803) such that the result of convolution of the reduction filter (802) and the enlargement filter (803) becomes a filter (801) with less vibration components that are less likely to cause overshoot and undershoot. It is possible to reduce overshoot and undershoot. Therefore, it is possible to suppress the color shift noise of the enlarged video by enlarging the color difference signal using such an enlargement filter (803).

As in the case of the color difference signal, when the luminance signal is a reduced signal, a steep component of the luminance signal may already be lost depending on the reduction method. Also in this case, as in the case of the color difference signal processing, the enlargement filter is designed so that the result of convolution of the reduction filter and the enlargement filter becomes a filter that stores the steep component of the luminance signal.

Since the luminance / chrominance signal separation unit (102) and the luminance / chrominance signal combination processing unit (108) have already been described in the first embodiment, description thereof is omitted here.

According to the video signal processing device according to the second embodiment described above, even when a reduced signal has already been input, by appropriately processing the luminance signal and the color difference signal, the sharpness of the enlargement processing result can be obtained. It is possible to suppress color misregistration noise while it is stored.

Example 3 describes a modification of the color difference signal enlargement process (205) in Example 1.

FIG. 9 shows a modification (block diagram) of the color difference signal enlargement processing (205). The input color difference reduction signal is enlarged by the pixel interpolation unit (403) and the enlargement filter processing unit (404). Thereafter, the shoot detection unit (901) detects a region where overshoot and undershoot occur. In this process, an overshoot and undershoot region is detected by detecting a portion where the signal changes greatly using an edge detection process of an image and detecting a fine step generated in the vicinity thereof as a shoot. The detected overshoot and undershoot regions and the output of the enlargement filter processing unit (404) are input to the shoot reduction unit (902). The shoot reduction unit reduces the overshoot and undershoot of the output of the enlargement filter processing unit (404) based on the information of the overshoot and undershoot areas detected by the shoot detection unit (901). As this reduction method, a method of applying a low-pass filter to the overshoot and undershoot regions is used.

Since the color difference reduction signal has already been described in the first embodiment with respect to the pixel interpolation unit (403) and the enlargement filter processing unit (404), description thereof is omitted here.

With the configuration described above, it is possible to use an enlargement filter that can store a steep component although overshoot and undershoot occur during enlargement processing for a color difference signal, thereby blurring the color difference component. Can be prevented.

According to the video signal processing apparatus according to the third embodiment described above, by detecting and reducing overshoot and undershoot in the processing of the color difference signal, color misalignment noise is reduced while preserving the sharpness of the enlargement processing result. It becomes possible to suppress.

Example 4 describes a modification of the luminance color discrimination signal processing unit (105) in Example 1.

FIG. 10 shows a modification (block diagram) of the luminance / color discrimination signal processing unit (105). The difference between this modification and the first embodiment is that the luminance signal reduction processing unit (1003) and the color difference signal reduction processing unit (1004) output the luminance control signal (1001) and the color difference control signal (1002). This signal is used in luminance signal enlargement processing (1005) and color difference signal enlargement processing (1006).

The luminance control signal (1001) and the color difference control signal (1002) are used to store steep components while suppressing color shift noise.

FIG. 11 is a block diagram of the color difference signal reduction processing unit (1004) and the color difference signal enlargement processing unit (1006). The input signal is input to the control signal generator (1101). The control signal generator (1101) generates a control signal (1102). In many cases, overshoot or undershoot generated by the reduction and enlargement processing occurs near the edge of the image. Therefore, the control signal generation unit (1101) detects an edge using the image edge detection method, assumes that the vicinity is an area where a shoot is generated, and outputs the information as a control signal (1102). A control signal (1102) is input to the color difference enlargement processing unit (1006). FIG. 11 shows an example in which the control signal (1102) is input to the enlargement filter processing unit (404). By this control signal, the processing is switched so that a filter that hardly causes overshoot or undershoot near the edge is used, and a filter that stores a steep component of the image is used otherwise. For example, the enlargement filter of the color difference enlargement processing unit is used near the edge, and the brightness enlargement filter is used otherwise. In this way, by switching the filter of the enlargement filter processing unit (404) by the control signal (1102), it is possible to suppress the occurrence of overshoot and undershoot and to store the steep component of the image.

The luminance signal reduction processing unit (1003) and the luminance signal enlargement processing unit (1005) may have the same configuration as the color difference signal reduction processing unit (1004) and the color difference signal enlargement processing unit (1006).

Here, the control signal is used in both the luminance signal processing and the color difference signal processing, but the control signal may be used only for the color difference signal processing, for example.

According to the video signal processing apparatus according to the fourth embodiment described above, the control signal is generated from the input signal, and the processing is switched using the control signal, thereby maintaining the sharpness of the reduction and enlargement processing results while maintaining the color shift. Noise can be suppressed.

Example 5 describes a modification of the luminance color discrimination signal processing unit (105) in Example 1.

FIG. 12 shows a modification (block diagram) of the luminance / color discrimination signal processing unit (105). In this embodiment, the luminance signal enlargement processing unit (204) and the color difference signal enlargement processing unit (205) in the first embodiment are changed to enlargement processing by super-resolution processing.

Super-resolution processing is processing for improving the resolution of an image, and is a technique for obtaining an image with higher resolution than general enlargement processing. For this reason, it is possible to obtain an enlargement processing result with a sharper sharpness compared to a general enlargement processing. Super-resolution processing includes a technique that has an effect of recovering image blur that occurs during reduction and enlargement as in Non-Patent Document 2. Such super-resolution processing requires a transfer function for recovering image blur that occurs during imaging. Generally, this transfer function is given by a low-pass filter. If this low-pass filter is a low-pass filter with a high degree of reduction of high-frequency components (hereinafter referred to as a strong low-pass filter), the blur recovery effect of super-resolution processing is strengthened. If the low-pass filter is weak, the blur recovery effect of the super-resolution processing is weakened. When this low-pass filter is set strongly, the blurring recovery effect becomes strong, and an enlarged result with a high sharpness can be obtained. However, as in general enlargement processing, when the processing is strengthened, overshoot and undershoot may occur around the image edge. Therefore, even in enlargement using super-resolution processing, there is a problem in that color misalignment noise is generated when overshoot and undershoot occur in the color difference signal. On the other hand, if the low-pass filter is set to be weak, the blur recovery effect of the super-resolution processing is weakened, so that high sharpness cannot be obtained.

Therefore, in this embodiment, the luminance signal super-resolution processing unit (1201) sets the transfer function low-pass filter strongly, and the chrominance signal super-resolution processing unit (1202) sets the transfer function low-pass filter weakly. As a result, a processing result in which a steep component is stored in the luminance signal is obtained, and a processing result with less overshoot and undershoot is obtained in the color difference signal.

Fig. 13 shows a block diagram of super-resolution processing (1202) for color difference signals. First, a transfer function necessary for super-resolution processing is generated by a transfer function generation unit (1301). An external signal (1303) is input to the transfer function generator (1301), and a transfer function is generated according to the external signal (1303). The external signal (1303) is, for example, an image enlargement rate, and the higher the image enlargement rate, the stronger the transfer function generally becomes a low-pass filter. Using the generated transfer function, the super-resolution enlargement processing unit (1302) performs super-resolution processing. The low-pass filter of the transfer function used for the color difference signal super-resolution processing (1202) is a weak low-pass filter in which overshoot and undershoot hardly occur.

The luminance signal super-resolution processing (1201) may be designed in the same manner as the color difference signal super-resolution processing (1202). At this time, the transfer function is a strong low-pass filter so that a high sharpness can be obtained.

In this embodiment, super-resolution processing is used for both enlargement processing. However, super-resolution processing may be used only for the luminance signal, and the color difference signal may be used for enlargement processing as described in the first embodiment. .

According to the video signal processing apparatus according to Example 5 described above, when super-resolution processing is used for enlargement processing, the transfer function used for super-resolution processing is changed between the luminance signal and the color difference signal, respectively. It is possible to suppress color misregistration noise while preserving the sharpness of the reduction and enlargement processing results.

Example 6 describes a modification of the color difference signal super-resolution processing (1202) in Example 5.

Fig. 14 shows a block diagram of super-resolution processing (1202) for color difference signals. The transfer function generation unit (1401) receives the external signal (1303) and the number of repetitions output from the super-resolution enlargement processing unit (1402), and generates a transfer function according to this. Using the generated transfer function, the super-resolution enlargement processing unit (1302) performs super-resolution processing.

In super-resolution processing, there is a method of gradually improving the sharpness of an image using iterative calculation. In such a process, when the number of iterations is small, a weak low-pass filter is used as the transfer function low-pass filter, and as the number of iterations increases, a strong low-pass filter is used to suppress the occurrence of overshoot and undershoot. It is possible to obtain a processing result with high sharpness. This is because in the processing using a weak low-pass filter, the difference between the processing result and the processing result is small, so that the super-resolution processing is stable and large overshoot and undershoot are unlikely to occur. Therefore, in this embodiment, it is assumed that the super-resolution enlargement processing unit (1402) is a super-resolution process using iterative calculation, and the number of repetitions is passed to the transfer function generation unit (1401), so that To switch the low-pass filter of the transfer function. As a result, overshoot and undershoot can be reduced, and color shift noise can be suppressed. In addition, by using a strong low-pass filter as the number of repetitions increases, the final super-resolution processing result of the color difference signal is higher in sharpness than the result of super-resolution processing using a weak low-pass filter. Become.

In this embodiment, the color difference signal super-resolution processing (1202) has been described, but the same processing may be used for the luminance signal super-resolution processing (1201). At this time, by using a low-pass filter that is stronger than the transfer function used in the color difference signal super-resolution processing (1202), it is possible to obtain a processing result with higher sharpness.

According to the video signal processing device according to the sixth embodiment described above, when the super-resolution process is used for the enlargement process, the transfer function used for the super-resolution process is changed every time the super-resolution process is repeated. Thus, it is possible to suppress color shift noise while preserving the sharpness of the reduction and enlargement processing results.

FIG. 15 is a block diagram of a video display apparatus according to the seventh embodiment. The video display apparatus according to the present embodiment is a video display apparatus configured to perform the image signal processing described in the first embodiment.
In the figure, a video display device (1500) includes, for example, an input unit (1501) for inputting a broadcast signal, video content, image content, etc. via a transmission medium such as a broadcast wave or a network including a television signal, Recording / playback unit (1502) for recording or playing back content input from the input unit (1501), content storage unit (1503) for recording content by the recording / playback unit (1502), and playback by the recording / playback unit (1502) The image signal processing unit (1504) which is the image signal processing apparatus described in the first embodiment, and a display for displaying the video signal or image signal processed by the image signal processing unit (1504) Unit (1505), audio output unit (1506) that outputs the audio signal reproduced by the recording / playback unit (1502), control unit (1507) that controls each component of the video display device (1500), and the user User interface for operating the video display device (1500) And the like (1508).
Since the detailed configuration and operation of the image signal processing unit (1504) are as described in the first embodiment, the description thereof is omitted.
Since the video display device (1500) includes the image signal processing unit (1504) that is the image signal processing device described in the first embodiment, the video signal or the image signal input to the input unit (1501) It can be displayed on the display portion (1505) as a simple video signal or image signal.

Therefore, even when a signal having a resolution lower than the resolution of the display device of the display unit (1505) is input from the input unit (1501), it is possible to display the playback signal with a higher resolution.
Also, when playing back video content or image content stored in the content storage unit (1503), it can be converted into a higher resolution video signal or image signal and displayed on the display unit (1505).
In addition, by performing image processing of the image signal processing unit (1504) after reproduction of video content or image content stored in the content storage unit (1503), data stored in the content storage unit (1503) The resolution is relatively lower than the resolution displayed in (1505). Therefore, there is an effect that the content data amount can be relatively reduced and stored.

The image signal processing unit (1504) may be included in the recording / playback unit (1502), and the above-described image signal processing may be performed during recording. In this case, since it is not necessary to perform the above-described image signal processing during reproduction, the processing load during reproduction can be reduced.

According to the video display device according to the seventh embodiment described above, the video display device having the effects shown in the first embodiment can be realized. That is, the image can be displayed with higher resolution.

FIG. 16 is a block diagram of the recording / playback apparatus according to the eighth embodiment. The recording / playback apparatus according to the present embodiment is a recording / playback apparatus configured to perform the image signal processing described in the first embodiment.
In the figure, a recording / playback apparatus (1600) includes, for example, an input unit (1601) for inputting a broadcast signal, video content, image content, etc. via a broadcast wave including a television signal or a network, and an input unit ( 1601) for recording or playing back content input, a content storage unit (1603) for recording content by the recording / playback unit (1602), and a video signal played by the recording / playback unit (1602) Alternatively, the image signal processing unit (1604) that is the image signal processing device described in the first embodiment is output to the image signal, and the video signal or the image signal processed by the image signal processing unit (1604) is output to another device or the like. The video / video output unit (1605), the audio output unit (1606) for outputting the audio signal reproduced by the recording / reproducing unit (1602) to other devices, and the respective components of the recording / reproducing device (1600) are controlled. The controller (1607) and the user can operate the recording / playback device (1600). A user interface unit (1608) for performing operations is provided.
Since the recording / playback apparatus (1600) includes the image signal processing unit (1604) that is the image signal processing apparatus described in the first embodiment, the video signal or the image signal input to the input unit (1601) can have a higher resolution. Thus, it can be output to another device or the like as a high-quality video signal or image signal.

In addition, by performing image processing of the image signal processing unit (1604) after reproduction of video content or image content stored in the content storage unit (1603), data stored in the content storage unit (1603) The resolution is relatively lower than the resolution of the signal output to the apparatus. Therefore, there is an effect that the content data amount can be relatively reduced and stored.
Further, the image signal processing unit (1604) may be included in the recording / playback unit (1602), and the above-described image signal processing may be performed during recording. In this case, since it is not necessary to perform the above-described image signal processing during reproduction, the processing load during reproduction can be reduced.
According to the recording / playback apparatus according to the eighth embodiment described above, the recording / playback apparatus having the effects shown in the first embodiment can be realized. That is, it is possible to record, reproduce or output an image with higher resolution.

DESCRIPTION OF SYMBOLS 101 ... Input signal, 102 ... Luminance color difference signal separation part, 103 ... Luminance signal, 104 ... Color difference signal, 105 ... Luminance color discrimination signal processing part, 106 ... Luminance signal processing part, 107 ... Color difference signal processing part, 108 ... Luminance color difference Signal combining unit 109 ... Output signal 201 ... Luminance signal reduction processing unit 202 ... Color difference signal reduction processing unit 203 ... Image signal processing unit 204 ... Luminance signal enlargement processing unit 205 ... Color difference signal enlargement processing , 301 ... Input luminance signal, 302 ... Input color difference signal, 303 ... Encoding unit, 304 ... Transmission, 305 ... Decoding unit, 306 ... Output luminance signal, 307 ... Output color difference signal, 401 ... Reduction filter processing unit, 402: Pixel decimation unit, 403 ... Pixel interpolation unit, 404 ... Enlargement filter processing unit, 501 ... Frequency characteristics of low-pass filter, 502 ... Spatial filter, 503 ... Vibration component, 504 ... Filter with less vibration component, 505 ... Cut-off Frequency, 601 ... Input luminance signal, 602 ... Input color difference signal, 603 ... Output luminance signal, 604 ... Force color difference signal, 605 ... Overshoot, 606 ... Undershoot, 607 ... Output luminance signal, 608 ... Output color difference signal, 609 ... Smooth signal component, 610 ... Output luminance signal, 611 ... Output color difference signal, 701 ... For luminance signal Enlargement processing unit, 702 ... Color difference signal enlargement processing unit, 801 ... Filter with few vibration components, 802 ... Reduction filter, 803 ... Enlargement filter, 901 ... Shoot detection unit, 902 ... Chute reduction unit, 1001 ... Luminance control signal, 1002 ... Color difference control signal, 1003 ... Luminance signal reduction processing unit, 1004 ... Color difference signal reduction processing unit, 1005 ... Luminance signal enlargement processing unit, 1006 ... Color difference signal enlargement processing unit, 1101 ... Control signal generation unit, 1102 ... Control signal, 1201 ... Super-resolution processor for luminance signal, 1202 ... Super-resolution processor for color difference signal, 1301 ... Transfer function generator, 1302 ... Super-resolution enlargement processor, 1303 ... External signal, 1401 ... Transfer function generation unit, 1402 ... number of repetitions, 1500 ... image display device 1501 ... Input unit, 1502 ... Recording / playback unit, 1503 ... Content storage unit, 1504 ... Image signal processing unit, 1505 ... Display unit, 1506 ... Audio output unit, 1507 ... Control unit, 1508 ... User interface unit, 1600 ... Recording / playback Device 1601 Input unit 1602 Recording / playback unit 1603 Content storage unit 1604 Image signal processing unit 1605 Image video output unit 1606 Audio output unit 1607 Control unit 1608 User interface unit

Claims

In the video signal processing device that converts the first video signal to the second video signal,
A luminance / chrominance separation unit that separates or extracts the first luminance signal and the first color difference signal from the first video signal;
A luminance signal processing unit that converts the first luminance signal into a second luminance signal by the first spatial filter;
A color difference signal processing unit that converts the first color difference signal into a second color difference signal using a second spatial filter different from the first spatial filter;
A video signal processing apparatus comprising: a luminance color difference signal combining unit that generates and outputs a second video signal from the second luminance signal and the second color difference signal.
In claim 1,
The second luminance signal has a chute,
The video signal processing apparatus, wherein the second color difference signal has no shoot.
In claim 1,
The first spatial filter is:
Shooting occurs even when the first luminance signal is input,
It is a filter that generates a shoot even if the first color difference signal is input,
The second spatial filter is
Even if the first luminance signal is input, no shoot occurs.
A video signal processing apparatus characterized by being a filter that does not generate a shoot even when a second luminance signal is inputted.
In claim 1,
The second spatial filter is a filter in which the second color difference signal causes a shoot smaller than the shoot of the third color difference signal obtained by inputting the first color difference signal to the first spatial filter or does not cause a shoot. A video signal processing apparatus.
In claim 1,
The luminance signal processing unit and the color difference signal processing unit are:
An image reduction unit that performs a reduction process on an input signal;
A video signal processing apparatus comprising one or both of an image enlarging unit that performs enlarging processing on an input signal.
In claim 1,
One or both of the luminance signal processing unit and the color difference signal processing unit is a detection unit that detects occurrence of a noise component;
A video signal processing apparatus comprising: a signal processing unit that performs processing for reducing a noise component detected by the detection unit.
In claim 1,
One or both of the luminance signal processing unit and the color difference signal processing unit is a detection unit that detects a region where a shoot may occur in an image;
A video signal processing apparatus comprising: a signal processing unit that switches the first filter and the second filter between a region detected by the detection unit and a region other than the region detected by the detection unit.
In claim 1,
The luminance image enlargement unit
A video signal processing apparatus comprising one or both of a luminance super-resolution image enlarging unit for enlarging a luminance image by super-resolution processing and a color difference super-resolution image enlarging unit for enlarging color difference images by super-resolution processing .
In the video signal processing method for converting the first video signal into the second video signal,
Separating or extracting the first luminance signal and the first color difference signal from the first video signal;
The first luminance signal is converted into the second luminance signal by the first spatial filter,
The first color difference signal is changed to a second color difference signal by a second spatial filter different from the first spatial filter,
A video signal processing method comprising generating and outputting a second video signal from a second luminance signal and a second color difference signal.
In claim 9,
The second luminance signal has a chute,
The video signal processing method, wherein the second color difference signal has no shoot.
In claim 9,
The first spatial filter is:
Shooting occurs even when the first luminance signal is input,
It is a filter that generates a shoot even if the first color difference signal is input,
The second spatial filter is
Even if the first luminance signal is input, no shoot occurs.
A video signal processing method characterized by being a filter that does not generate a shoot even when a second luminance signal is inputted.
In claim 9,
The second spatial filter is a filter in which the second color difference signal causes a shoot smaller than the shoot of the third color difference signal obtained by inputting the first color difference signal to the first spatial filter or does not cause a shoot. And a video signal processing method.
In claim 9,
The video signal processing method characterized in that the processing performed by the first spatial filter and the second spatial filter is included in at least one of image reduction processing for an input signal and image enlargement processing for an input signal.
In claim 9,
A video signal processing method characterized by using a filter that detects the occurrence of a noise component and reduces the detected noise component as a second filter.
In claim 9,
An image signal processing method comprising: detecting an area where a shoot may occur in an image; and performing signal processing by switching between the first filter and the second filter in the detected area and other areas.
In claim 9,
The video signal processing method, wherein the first filter and the second filter are included in a super-resolution process.