JP2009130556A - Image display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To display a higher-definition image in an image display device. <P>SOLUTION: The image display device includes: an input section for inputting an input image; an image processing section for performing image processing to a video signal inputted to the input section; and a display section for displaying an image after the image processing by the image processing section. The image processing section performs the-number-of-pixels reduction processing for reducing the number of pixels in the video signal, and low-pass filtering differing according to the amount of movement of an object included in the video signal inputted into the input section. When the amount of movement of the object included in the video signal inputted into the input section corresponds to the amount of movement other than an integral multiple of one pixel of the display section, a cutoff frequency in low-pass filtering is set to be higher than that when the amount of movement of the object included in the video signal corresponds to an amount of movement of an integral multiple of one pixel at the display section. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a video display device that displays a video signal.

  When an image having a frequency component equal to or greater than the number of display pixels of the display device is displayed, such as when an image having more pixels than the number of pixels of the display device is input, distortion called aliasing distortion occurs and the image quality deteriorates.

  In order to prevent the occurrence of the aliasing distortion, it is known that the high-frequency component of the original image data is removed by subjecting the original image data to a filtering process using a low-pass filter (see the conventional technique of Patent Document 1). .)

JP 2002-152502 A

  However, in the method described in Patent Document 1, frequency components equal to or higher than the frequency corresponding to the number of pixels after image reduction (Nyquist frequency) are removed. Here, since the number of pixels after image reduction is the largest, it is the number of display pixels of the display device. Therefore, when the frequency component higher than the Nyquist frequency is removed, the viewer of the display device corresponds to the number of display pixels of the display device. There was a problem that the above high-definition video could not be perceived.

  The present invention has been made in view of such problems, and an object of the present invention is to display a higher-definition image.

  In order to achieve the above object, an embodiment of the present invention may be configured as described in the claims, for example.

  According to the present invention, it is possible to display a higher definition video.

  Embodiments of the present invention will be described below with reference to the drawings.

  Moreover, in each drawing, the component to which the same code | symbol was attached | subjected shall have the same function.

  In addition, the expression “motion amount” in the descriptions and drawings of the present specification means the amount of motion of the subject included in the video signal.

  FIG. 1 shows an example of a video display apparatus according to Embodiment 1 of the present invention.

  The video display device 100 includes a receiving unit 103 that receives a broadcast wave via an antenna 101, an image processing unit 103 that performs image processing on a video signal included in the broadcast wave received by the receiving unit 103, and an image processing unit 103. A display unit 108 for displaying the image-processed signal is provided.

  The receiving unit 103 receives, for example, a TV broadcast wave from the antenna 101, extracts a video signal from the received broadcast wave, and outputs the video signal to the image processing unit 103.

  The image processing unit 103 performs a process of reducing the size of the image included in the video signal input to the image processing unit 103 so as to match the number of display pixels of the display unit 108.

  In the following description, it is assumed that the video signal input to the image processing unit 103 has a larger number of pixels than the number of display pixels of the display unit 108.

  In addition, different types of low pass filter (LPF) processing is performed on the image included in the video signal in units of pixels.

  Here, an example of the image processing unit 103 can be configured by a pixel position calculation unit 105, a motion search unit 106, a determination unit 107, and a motion adaptive scaler 104.

  The motion adaptive scaler 104 has a plurality of different types of low-pass filters LPF1, LPF2,... LPFn and a switch 114, and switches a low-pass filter to be processed according to an instruction from the determination unit 107. At this time, the low-pass filters LPF1, LPF2,... LPFn perform different low-pass filters, respectively, and perform image reduction processing at the same time. Details of the image reduction processing will be described later.

  The pixel position calculation unit 105 calculates the position of the image processing target pixel in the image to be processed (image processing target frame or image processing target field), and outputs the calculated position to the determination unit 107.

  A motion vector and a motion amount for the image processing target pixel calculated by the motion search unit 106 are calculated and output to the determination unit 107. Here, the motion vector and the motion amount for the image processing target pixel can be calculated according to the motion of the subject included in the video signal, and can be calculated for each image processing target pixel and each image block. In the following description, the calculation is performed for each pixel. When calculating for each block, the motion vector and motion amount calculated for the image block to which the image processing target pixel belongs may be used as the motion vector and motion amount for each image processing target pixel.

  The determination unit 107 acquires pixel position information for the image processing target pixel calculated by the pixel position calculation unit 105, and uses the motion vector and the motion amount for the image processing target pixel calculated by the motion search unit 106. The type of low-pass filter processing in the motion adaptive scaler 104 is selected, and an instruction signal is output to the motion adaptive scaler 104.

  Here, the motion search performed by the motion search unit 106 may use a commonly used conventional technique.

  For example, in an image (frame, field) that is temporally placed after an image (image processing target frame, image processing target field) of the image processing target in the video signal, the image processing target pixel or the image processing target pixel is A method may be used in which a pixel or block having a pixel value close to the pixel value of the central block is searched, and a motion vector for obtaining a motion vector starting from the image processing target pixel is used.

  In addition, in each of a set of images (frames and fields) arranged before and after the image to be processed (image processing target frame and image processing target field) in the video signal, A pixel is selected and a motion vector between the two is calculated. In this method, a motion vector that passes through the image processing target pixel on the image processing target image is calculated by calculating the motion vector in each pixel of the set of images, and this is used as a motion vector to be obtained. May be.

  Next, low pass filter processing and image reduction processing performed by the motion adaptive scaler 104 of the image processing unit 103 will be described.

  The image reduction processing performed by the motion adaptive scaler 104 of the image processing unit 103 is as follows. For example, with respect to the video signal 201 in which the number of pixels in the horizontal direction is X and the number of pixels in the vertical direction is Y, as shown in FIG. 2A, α times in the vertical direction (α: reduction ratio, greater than 0) 1 or less) and β times in the horizontal direction (β: reduction ratio, is a value greater than 0 and less than or equal to 1), α times only in the vertical direction as shown in FIG. There is a process for generating the video signal 203 and a process for generating the video signal 204 multiplied by β only in the horizontal direction as shown in FIG.

  A specific process will be described with reference to FIG. 3. FIG. 3 is a diagram illustrating an image reduction process performed by the motion adaptive scaler 104 of the image processing unit 103 in a one-dimensional direction.

  A pixel column 301 indicates a pixel column in the one-dimensional direction of the video signal before image processing, and a pixel column 302 indicates a pixel column in the one-dimensional direction of the video signal after image processing.

  In the motion adaptive scaler 104 of the image processing unit 103, for example, the pixels 311, 312, 313, 314, and 315 of the pixel row 301 are multiplied by coefficients a, b, c, d, and e, respectively, and the sum is obtained as the pixel row 302. It is set as the pixel value of the pixel 321.

  Here, the coefficients a, b, c, d, and e are called tap coefficients, and various filter processes can be performed by changing the tap coefficients. The motion adaptive scaler 104 of the image processing unit 103 realizes different types of low-pass filter processing by switching a plurality of low-pass filters LPF1, LPF2,.

  Similarly, the pixels 322 and 323 in the pixel column 302 are also generated from the sum of the pixel values of a plurality of pixels in the pixel column 301 multiplied by a coefficient. At this time, as shown in FIG. 3, the motion adaptive scaler 104 of the image processing unit 103 generates the number of pixels in the pixel column 302 smaller than the number of pixels in the pixel column 301, that is, reduces the number of pixels by generating the pixels. Realize processing.

  At this time, it is possible to adjust the magnifications α and β shown in FIGS. 2A to 2C by changing the thinning frequency.

  Note that the image processing unit 103 of the video display apparatus 100 according to the first embodiment performs low-pass filter processing and image reduction processing in either the horizontal direction or the vertical direction. Here, when the low-pass filter process is performed in the horizontal direction, for example, the low-pass filter process may be performed using the tap filter coefficients as shown in FIGS. Here, when the low-pass filter processing is performed in the vertical direction, for example, the low-pass filter processing may be performed using tap filter coefficients as shown in (a) to (d) of FIG.

  4 and 5 show an example of a low-pass filter that can be simply configured, and the low-pass filter performed in the image processing unit 103 is not limited to this example. Any tap coefficient of a low-pass filter designed by a conventional low-pass filter design method may be used.

  In the following description of the first embodiment, it is assumed that the image processing unit 103 of the video display device 100 performs low-pass filter processing and image reduction processing in the vertical direction. In the following description of the first embodiment, the moving direction of the object in the video is the moving direction of the direction in which the low-pass filter process and the image reduction process are performed, that is, the vertical direction. In addition, the number of pixels of the display unit 108 in the following description of the first embodiment refers to the number of pixels in the direction in which low-pass filter processing and image reduction processing are performed, that is, the number of pixels in the vertical direction.

  Next, the principle that the video display apparatus 100 according to the present embodiment can display a higher-definition video will be described with reference to FIG.

FIG. 6 shows one-dimensionally the pixels displayed by the display unit 108 of the video display device 100. The pixel columns of two frames (frame 1 and frame 2) separated by T ₀ (sec) in the time direction, and the display A pixel row perceived by a viewer who views the unit 108 is shown.

  In the following description, for the sake of simplicity, description will be made using pixel columns in units of frames, but these units are not particularly limited as long as they are continuous images. That is, the two frames used in the description of FIG. 6 need not be in units of frames as long as they are two images that are continuously displayed.

  Here, FIG. 6 shows a state where the object displayed in the video signal is stationary.

  At this time, since the same pixel value is displayed as the pixel values of the two frames, the number of pixels perceived by the viewer is not different from the number of pixels of the display unit 108.

Next, when the object displayed in the video signal of FIG. 6 moves at a speed of 1/2 pixel in a unit corresponding to the pixel of the display unit (hereinafter referred to as “display pixel”) per frame, that case the motion amount per frame is 1/2 display pixel (when moving T ₀ (sec) to rate 1/2 display pixels), two frames apart T ₀ (sec) time direction FIG. 7 shows the pixel columns and the pixel columns perceived by the viewer who views the display unit 108.

  Here, in the image reduction processing in the image processing unit 103, assuming that the image is reduced in the vertical direction at the reduction rate α, the motion search is performed with the image size before the image reduction processing in the image processing unit 103. The case where the amount of motion obtained in this way is (1/2) / α pixel in the pixel unit of the image before the image reduction processing corresponds to the above-mentioned “motion amount is ½ display pixel”. That is, the motion amount in units of display pixels can be calculated by converting the result of motion search in the input image (the amount of motion in pixel units of the input image) using the reduction rate α.

  In FIG. 7, when the moving direction of the object is the upward direction in FIG. 7, the line of sight of the viewer is inclined by following the movement of the object displayed on the display unit 108. Then, as shown in FIG. 7, the number of pixels that the viewer views is twice the number of pixels of the display unit 108.

In this way, the number of pixels viewed by the viewer is doubled when moving at a speed of 1/2 display pixel per frame (moving at a speed of 1/2 display pixel in T ₀ (sec)). This is the same when moving at a speed of 1/2 + m display pixels per frame (when moving at a speed of 1/2 + m display pixels in T ₀ (sec)) (where m is 1). An integer greater than.) This is because it is the same as the case of moving at a speed of 1/2 display pixel per frame except that the line of sight becomes steep only by m display pixels.

  Here, in the conventional video display device, even if the number of pixels viewed by the viewer is doubled as shown in FIG. 7, the resolution cannot be doubled. This will be described with reference to FIGS.

  FIG. 8 shows the processing of the conventional video display apparatus for frame 1 and frame 2 in FIG. 7, and the pixel row of the original signal before image reduction and the pixel row of the display signal after image reduction are represented by pixel values, respectively. Is shown.

  Here, it is assumed that the original signal has twice the number of pixels of the display unit in the direction of the pixel column shown in FIG. At this time, the image signal of the original signal is displayed by being reduced by a factor of 1/2 in the direction of the pixel column shown in FIG.

  Further, in the conventional video display device shown in FIG. 8, when the original video signal is reduced by a factor of 1/2, a low-pass filter process is performed to prevent image quality deterioration due to the occurrence of aliasing distortion. The frequency component corresponding to the number of display pixels is removed. Details of the low-pass filter process and the frequency band to be cut will be described later.

  The process shown in FIG. 8 shows an example, and a display signal in which the number of pixels is reduced by a factor of 2 is obtained by a smoothing filter process using an average value of two consecutive pixels in the original signal as a pixel value of the display signal. Is generated. At this time, when the display signals of the frames 1 and 2 are viewed without considering the movement of the object, a high-definition resolution higher than the number of pixels in the display unit cannot be viewed, but an image without aliasing distortion. Can be observed.

  FIG. 9 shows the pixel values of the pixel columns in the frame 1 and the frame 2 of the display signal generated by the processing shown in FIG. 8 and the pixel values that the viewer views.

  Here, the pixel value of the pixel row of the original signal in FIG. 8 is composed of repetitions of 1 and 2 and repetitions of 3 and 4 including information on increase / decrease of the pixel value by one pixel period of the original signal. On the other hand, as shown in FIG. 9, when the line of sight is tilted by the movement of the display object, the pixel values of the pixel columns to be viewed include a portion where 1.5 is continuous and a portion where 3.5 is continuous. Therefore, information on increase / decrease of the pixel value by one pixel period of the original signal is lost. This is because frequency components equal to or higher than the frequency corresponding to the number of pixels of the display unit are reduced from the original signal by the low-pass filter processing shown in FIG. Therefore, even if the number of pixels in the pixel row viewed in FIG. 9 is doubled, the resolution does not double the number of pixels in the display unit.

  Next, in the video display apparatus 100 according to the first embodiment, the resolution can be doubled when the number of pixels viewed by the viewer is doubled as shown in FIG. This will be described with reference to FIGS.

  Next, FIG. 10 shows the processing of the image processing unit 103 of the video display apparatus 100 according to the first embodiment for the frame 1 and the frame 2 of FIG. The pixel columns of the subsequent display signals are shown with pixel values described.

  Here, it is assumed that the original signal has twice the number of pixels of the display unit in the pixel column direction shown in FIG. At this time, the image signal of the original signal is displayed by being reduced by a factor of 1/2 in the direction of the pixel column shown in FIG.

  Further, in the video display device 100 according to the first embodiment shown in FIG. 10, when the video signal of the original signal is reduced by a factor of 1/2, a component having a frequency equal to or higher than the number of display pixels of the display unit is also displayed.

  In the example of FIG. 10, a display signal in which the number of pixels is reduced by a factor of two is generated by using the pixel value of one pixel out of two consecutive pixels in the original signal as the pixel value of the display signal. Yes. That is, in the case of this figure, a reduced image is generated by simply thinning out one pixel per two pixels. At this time, when the display signals of the frame 1 and the frame 2 are viewed without considering the movement of the object, as is generally known, the frequency component equal to or greater than the number of pixels in the display unit is aliasing distortion. An image with degraded image quality is viewed.

  Next, FIG. 10 shows the pixel values of the pixel columns of the frame 1 and frame 2 of the display signal generated by the processing shown in FIG. 10 and the pixel values that the viewer views.

  Here, the pixel value of the pixel row of the original signal in FIG. 10 is composed of repetitions of 1 and 2 and repetitions of 3 and 4 including information on increase / decrease of the pixel value by one pixel period of the original signal. On the other hand, as shown in FIG. 11, when the line of sight is tilted by the movement of the display object, the pixel value of the pixel column viewed is the pixel value with one pixel cycle similar to the pixel value of the pixel column of the original signal. 1 and 2 repetitions, and 3 and 4 repetitions including information on increase / decrease.

  That is, in the process shown in FIG. 10, frequency components equal to or greater than the number of pixels of the display unit 108 are not removed, and therefore, when the number of pixels to be viewed exceeds the number of pixels of the display unit 108, it is not lost. This is because the high frequency component can be restored.

  When performing the processing of the video display apparatus 100 according to the first embodiment illustrated in FIGS. 10 and 11, the viewer may view a high-definition video having a resolution twice the number of pixels of the display unit 108. It becomes possible.

  Next, a case where there is no effect of the processing of the video display apparatus 100 according to the first embodiment shown in FIGS. 10 and 11 will be described with reference to FIGS. 6, 12, and 13.

  FIG. 6 shows a state where an object in the video signal is stationary as already described. In this case, the number of pixels viewed by the viewer is the same as the number of pixels of the display unit 108. Since the number of pixels to be viewed does not increase, the resolution to be viewed cannot be increased.

  Furthermore, as shown in FIG. 10, if the frequency component corresponding to the number of pixels of the display unit 108 in the video signal is not removed and displayed on the display unit 108, the displayed image includes aliasing components and the image quality is degraded. .

As shown in FIG. 12, when an object in the video signal moves at a speed of one display pixel per frame (when moving at a speed of one display pixel in T ₀ (sec)), a plurality of frames are used. This overlaps the line of sight of the viewer, and the number of pixels to be viewed does not increase from the number of pixels of the display unit 108. Therefore, as in FIG. 6, the number of pixels to be viewed does not increase, and therefore the resolution cannot be increased.

  In this case, since the image viewed by the viewer is the last frame itself, the frequency component corresponding to the number of pixels of the display unit 108 in the video signal is displayed for the last displayed frame as shown in FIG. If the image is displayed on the display unit 108 without being removed, the displayed image includes the aliasing component and the image quality is degraded.

Further, as shown in FIG. 13, when moving at a speed of m display pixels per frame in the video signal (when moving at a speed of m display pixels in T ₀ (sec)), the video signal is similarly viewed. The number of pixels does not increase from the number of pixels in the display unit 108, and the viewed resolution does not increase.

  As described above, as described with reference to FIGS. 10, 11, 6, 12, and 13, the resolution and image quality of the viewed image differ depending on the amount of movement or the moving speed of the object in the video signal. It will be a thing.

  Therefore, in the video display device 100 according to the first embodiment, the image processing unit 103 adjusts the frequency component in the video signal by performing different low-pass filter processing according to the motion search result for each pixel in the video. , The image is displayed on the display unit 108, and high-definition video display can be suitably performed.

  Next, low-pass filter processing and frequency components of the video signal in the image processing unit 103 will be described with reference to FIGS. 14, 15, 16, and 17. FIG.

First, FIG. 14 shows frequency components when the maximum value of the signal intensity of a general video signal included in a TV broadcast wave or the like is 1. Here, the vertical axis in FIG. 14 is normalized signal intensity, the horizontal axis is frequency, and the origin of the frequency component is called a direct current (DC) component. Further, f _n1 shown in the figure indicates the Nyquist frequency.

  In this embodiment, the Nyquist frequency is a frequency corresponding to the display pixel of the display unit 108. In the case where the display unit 108 is a display unit configured with 768 pixels in the vertical direction, the Nyquist frequency is a frequency equivalent to 768 TV lines. Become.

  Next, the relationship between the number of pixels in the display unit and the aliasing component of the video signal will be described with reference to FIG.

The shaded area shown in FIG. 15A indicates the aliasing component when the video signal of FIG. 14 is displayed on the display unit having the number of pixels corresponding to the Nyquist frequency of f _n1 .

Here, if the Nyquist frequency shown in FIG. 15 (a) is displayed by reducing the image on the display unit having a number of pixels half than f _n1 considerable number of pixels, is f _n2 is f _n2 = f _n1 The Nyquist frequency is obtained, and the hatched portion shown in FIG.

Here, as described above, the case where the display unit 108 of the video display apparatus 100 according to the first embodiment has the number of pixels corresponding to the Nyquist frequency f _n2 is as illustrated in FIGS. 6, 12, and 13. When the moving amount of the object in the video signal is 0, or when moving at a speed of m display pixels (m is an integer of 1 or more) per frame (moving at the speed of m display pixels in T ₀ (sec)) In this case, in order to reduce the aliasing distortion of the viewed image, it is desirable to remove a component having a frequency higher than the Nyquist frequency f _n2 in the frequency component of the video signal.

In addition, when moving at a speed of 1/2 + m display pixels per frame (where m is an integer of 0 or more) as shown in FIG. 11 (at T ₀ (sec), at a speed of 1/2 + m display pixels. When moving, the frequency component of the video signal is twice the Nyquist frequency f _n2 , that is, up to f _n1 so that the viewer can view a layer having a resolution twice the number of pixels of the display unit. It is desirable to pass the folding component.

Therefore, the video display apparatus 100 according to the first embodiment switches the low-pass filter process in the image processing unit 103 according to the motion amount of the motion vector for each pixel in the video signal, as illustrated in FIG. by the maximum frequency f _c of the aliasing components to pass variable, it makes it possible to preferably perform the high-definition image display on the display unit 108.

  That is, the low-pass filter processing in the image processing unit 103 of the video display apparatus 100 according to the first embodiment, that is, the characteristics of the plurality of low-pass filters of the motion adaptive scaler 104 are set to a plurality of characteristics as shown in FIG. Is realized.

  FIG. 16 shows the pass characteristic of the frequency component of the low-pass filter. The vertical axis represents the gain of the low-pass filter, and the horizontal axis represents the frequency. Generally, in the characteristics of a low-pass filter, a frequency at which a gain is 0.5, that is, a frequency at which a frequency component pass rate is 50% is referred to as a cutoff frequency (cutoff frequency).

Therefore, in order to remove the aliasing component of the shaded portion, which is a higher frequency component than the frequency f _n1 as shown in FIG. 15A, the determination unit 107 of the image processing unit 103 is as shown in FIG. If the motion adaptive scaler 104 is instructed to select a low-pass filter whose cutoff frequency is the frequency f _n1 , and the switch of the motion adaptive scaler 104 selects the low-pass filter from a plurality of low-pass filters LPF1, LPF2,. Good.

Similarly, in order to remove the aliasing component of the hatched portion, which is a higher frequency component than the frequency f _n2 as shown in FIG. 15B, the determination unit 107 of the image processing unit 103 is as shown in FIG. Further, the motion adaptive scaler 104 is instructed to select the low pass filter whose cutoff frequency is the frequency f _n2 , and the switch of the motion adaptive scaler 104 selects the low pass filter from the plurality of low pass filters LPF1, LPF2,. That's fine.

Further, as shown in FIG. 15C, in order to make the frequency f _max variable and remove the aliasing portion of the hatched portion that is a higher frequency component than the frequency f _max , the determination unit 107 of the image processing unit 103 is shown in FIG. as shown in 16 (c), so that the cut-off frequency frequency f _cv is the desired frequency f _max, the selection of the low-pass filter instructs the motion adaptive scaler 104, a motion adaptive scaler 104 switches the low pass filter May be selected from a plurality of low-pass filters LPF1, LPF2,... LPFn.

Here, in the video display apparatus 100 according to the first embodiment, the low-pass filter having the characteristics shown in FIGS. 15A, 15B, and 15C is selected for the video signal shown in FIG. FIG. 17 (a), FIG. 17 (b), and FIG. 17 (c) show the pass components of the frequency component of the video signal when processed in the above manner. The maximum frequency f _max of each passing component is as shown in the figure. In FIG. 17A, the maximum frequency f _max = f _n1 , and in FIG. 17B, the maximum frequency f _max = f _n2 .

In any frequency component of the video signal, a frequency component greater than the maximum frequency f _max is removed by low-pass filter processing, and a frequency component equal to or less than the maximum frequency f _max passes.

  Next, using FIG. 18, FIG. 19, FIG. 20, and FIG. 21, the characteristics of the low pass filter processing in the image processing unit 103 of the video display apparatus 100 according to the first embodiment are compared with the amount of motion in the video signal. I will explain.

  First, FIG. 18 shows the relationship between the characteristics of the low-pass filter processing in the conventional video display device and the amount of motion in the video signal. The vertical axis represents the maximum frequency of the video signal displayed on the display unit.

  At this time, when it is clear that the maximum frequency of the video signal input to the video display device is larger than the cutoff frequency of the low-pass filter processing in the video display device, the vertical axis indicates the cutoff frequency of the low-pass filter. Become.

  The horizontal axis indicates the amount of motion between two consecutive images in the video signal (the magnitude of the motion vector in the vertical or horizontal direction or the moving speed of the video between the two consecutive images). The amount of the decimal part excluding the integer pixels when expressed in units is shown. For example, when the amount of motion is an m + γ display pixel (m is an integer greater than or equal to 0, and γ is a value greater than or equal to 0 and less than or equal to 1), the horizontal axis of FIG. Here, in the following description, m is referred to as an integer pixel component of the motion amount, and γ is referred to as a decimal pixel component of the motion amount.

F _n is a Nyquist frequency corresponding to the number of pixels of the display unit.

At this time, in the characteristics of the low-pass filter processing in the conventional video display device shown in FIG. 18, even if a higher frequency component than the Nyquist frequency f _n exists in the video signal, regardless of the amount of motion in the video signal, High-frequency components are removed from the Nyquist frequency f _n by low-pass filter processing.

Therefore, when the fractional pixel component of the amount of motion shown in FIG. 18 is 0.5 display pixel (1/2 display pixel), the number of pixels viewed as shown in FIG. Since the high-frequency component is removed from the Nyquist frequency f _n2 by the filtering process, the resolution to be viewed does not improve, and the viewer cannot view the video with high definition.

  On the other hand, the characteristics of the low-pass filter processing in the image processing unit 103 of the video display apparatus 100 according to the first embodiment are shown in FIG. The vertical and horizontal axes are the same as those in FIG.

In the example of FIG. 19, when the decimal component of the motion amount of the video signal is 0, a low-pass filter is used so that the maximum frequency of the video signal becomes the Nyquist frequency f _n of the display unit 108 in order to prevent occurrence of aliasing distortion. Perform processing. Next, if the motion amount of the fractional part of the number of pixels to be forceps is twice of 0.5 display pixels, the maximum frequency of the video signal so that the 2f _n is twice the Nyquist frequency f _n Low-pass filter processing is performed, and the viewed resolution is doubled. Further, when the decimal component of the motion amount of the video signal is one display pixel, low-pass filter processing is performed so that the maximum frequency of the video signal becomes the Nyquist frequency f _n in order to prevent occurrence of aliasing distortion again.

Here, in FIG. 19, on the assumption that the video signal input to the image processing unit 103 has a frequency component more than twice the Nyquist frequency of the display unit 108, the decimal part of the motion amount is displayed as 0.5. for pixels, and the maximum frequency of the video signal so as to be 2f _n is twice the Nyquist frequency f _n.

  Here, when the video signal input to the image processing unit 103 does not have a frequency component more than twice the Nyquist frequency of the display unit 108, the video is displayed when the decimal part of the motion amount is 0.5 display pixel. By passing the signal up to the maximum without removing the high frequency component of the signal, the viewed resolution can be improved as much as possible without reaching up to twice.

  That is, in the low-pass filter processing according to the first embodiment shown in FIG. 19, compared to the case where the decimal component of the motion amount of the video signal is 0 or 1 display pixel, that is, the motion amount is an integral multiple of 1 display pixel. Thus, the maximum frequency of the video signal or the cutoff wavelength of the low-pass filter is set to a higher frequency when the number of pixels to be viewed is doubled and the fractional part of the motion amount is 0.5 display pixel.

  As a result, the video display device 100 according to the first embodiment can improve the resolution observed when the decimal part of the motion amount is 0.5 display pixels, and can realize high-definition video display. .

  In the low-pass filter processing according to the first embodiment shown in FIG. 19, the low-pass filter is cut so that the maximum frequency of the frequency component of the video signal is higher than the Nyquist frequency of the display unit according to the amount of motion of the video signal. When the off-frequency is selected and the amount of motion of the video signal is an integral multiple of one display pixel, low-pass filter processing is performed to remove the frequency component of the video signal equal to or higher than the Nyquist frequency of the display unit.

  Thereby, the video display apparatus 100 according to the first embodiment can achieve both high-definition video display and prevention of image quality deterioration due to aliasing distortion.

  In other words, in the low-pass filter processing according to the first embodiment shown in FIG. 19, the frequency component removal band of the video signal in the higher frequency portion than the Nyquist frequency of the display unit is changed according to the amount of motion of the video signal. When the amount of motion of the video signal is an integral multiple of one display pixel, a high-frequency component in a wider band is removed compared to cases other than when the amount of motion of the video signal is an integral multiple of one display pixel. Perform low-pass filter processing.

  Thereby, the video display apparatus 100 according to the first embodiment can achieve both high-definition video display and prevention of image quality deterioration due to aliasing distortion.

  Here, the characteristics of the low-pass filter processing when the horizontal axis in FIGS. 18 and 19 is the motion amount itself are as shown in FIGS. 20 (a) and 20 (b), respectively.

FIG. 20A shows the characteristics of the low-pass filter processing of the conventional video display device, and the frequency of the vertical axis that is the maximum frequency of the video signal or the cutoff frequency of the low-pass filter processing is constant at the Nyquist frequency f _n of the display unit. It is.

On the other hand, FIG. 20B shows the characteristics of the low-pass filter processing of the image processing unit 103 of the video display device 100 according to the first embodiment, and the maximum frequency of the video signal or the cutoff frequency of the low-pass filter processing is changed. When the amount is an integer multiple of one display pixel, the Nyquist frequency f _n is used, and when the amount of movement is other than an integer multiple of one display pixel, the Nyquist frequency f _n or higher is used. The period in this case is one display pixel period in the change of the motion amount of the video signal.

  That is, as shown in FIG. 20B, the video display device 100 according to the first embodiment uses the maximum frequency of the video signal or the cutoff frequency of the low-pass filter processing in the characteristics of the low-pass filter processing of the image processing unit 103. When the amount of motion is an integral multiple of one display pixel, the value is a minimum value, and when the decimal component of the amount of motion is 0.5 display pixel, the characteristic of one display pixel cycle with respect to the change in the amount of motion becomes a maximum value.

  As a result, the video display device 100 according to the first embodiment can realize a video display that achieves both high-definition video display and prevention of aliasing.

  In this case, the minimum value is a value at which the change amount with respect to the increase in the motion amount changes from decrease to increase, and the maximum value is a value at which the change amount with respect to the increase in motion amount changes from increase to decrease.

  In other words, in the video display device 100 according to the first embodiment, in the low-pass filter processing of the image processing unit 103, the removal band of the frequency component of the video signal in the higher frequency portion than the Nyquist frequency of the display unit is used as the motion of the video signal. When the amount of motion of the video signal is an integer multiple of one display pixel, the amount of motion of the video signal is an integer multiple of one display pixel, compared to the case other than when the amount of motion of the video signal is an integer multiple of one display pixel A low pass filter process is performed to remove high frequency components in a wider band.

  Thereby, the video display apparatus 100 according to the first embodiment can achieve both high-definition video display and prevention of image quality deterioration due to aliasing distortion.

  The maximum frequency of the video signal shown in FIGS. 18, 19, and 20 described above or the cutoff frequency of the low-pass filter processing can be confirmed from the display video displayed on the display unit 108. In order to confirm the maximum frequency of the video signal from the displayed video, for example, “Movie Resolution (APDC system)” (Moving Picture Resolution Measurement System / the APDC) proposed by the Advanced PDP Development Center Corporation. In a measurement method called (Method) (a method in which the moving image resolution evaluation pattern is moved at a predetermined speed and the movement of the camera is imaged in accordance with the moving speed of the image), the display speed of the moving image resolution evaluation pattern is shown in FIGS. Measurement is possible by adjusting the amount of movement shown in FIG.

  However, depending on the display device constituting the display unit 108, the maximum frequency of the display video displayed on the display unit 108 may decrease as the amount of motion of the video signal increases. In this case, when the maximum frequency of the video signal or the cut-off frequency of the low-pass filter processing shown in FIGS. 20A and 20B is confirmed as the maximum frequency of the display video, FIGS. 21A and 21B, respectively. As shown in (b).

  In this case, the maximum frequency of the display image displayed on the display unit is a value that is inclined as the amount of motion increases as compared with FIGS. 20 (a) and 20 (b).

  However, even in this case, as shown in FIG. 20B, the video display apparatus 100 according to the first embodiment sets the maximum frequency of the display video to be displayed on the display unit 108, and the amount of motion is one display pixel. A minimum value is obtained when the number is an integral multiple, and a characteristic of one display pixel cycle with respect to a change in the amount of movement that is a maximum value when the decimal component of the amount of movement is 0.5 display pixels.

  As a result, the video display device 100 according to the first embodiment can realize a video display that achieves both high-definition video display and prevention of aliasing.

  In addition, as illustrated in FIG. 20B, the video display device 100 according to the first embodiment has, for example, a motion amount m display pixel (m is an integer greater than or equal to 0) with respect to the maximum frequency of the display video displayed on the display unit 108. ), The maximum frequency of the display image in the case of the movement amount m + 0.5 display pixel is higher than the maximum frequency of the display image in the case of the movement amount m + 1 display pixel. .

  As a result, the video display device 100 according to the first embodiment can realize a video display that achieves both high-definition video display and prevention of aliasing.

  In the video display device 100 according to the first embodiment, as shown in FIG. 20B, the maximum frequency of the display video displayed on the display unit 108 decreases as the motion amount of the video signal increases. However, as shown in FIG. 20B, when the amount of motion is an integer multiple of one display pixel, the line H01 connecting the maximum frequencies of the display image has the same inclination as the decrease in the maximum frequency with respect to the amount of motion of the video signal. Indicates.

At this time, the motion amount of the video signal is v, and this straight line is a function value f (v) having the motion amount as a variable. Here, in FIG. 21B, f _n / f (v) which is the reciprocal of the ratio of f (v) to the Nyquist frequency f _n corresponding to the number of pixels of the display unit 108 is displayed on the display unit 108. By multiplying the maximum frequency measured from the display video, it is possible to calculate the maximum frequency of the video signal after the low-pass filter processing of the image processing unit 103 shown in FIG. 20B or the cutoff frequency of the low-pass filter processing. is there.

  In the above description, the signal that the image processing unit 103 performs image processing has been described as a video signal that is input from the receiving unit 103 to the image processing unit 103. However, the video display device 100 may receive signals from other devices. In the case of including the input unit 109 that receives an input of a video signal, the signal that the image processing unit 103 performs image processing may be a video signal that is input from the input unit 109 to the image processing unit 103.

  In this case, the video display apparatus 100 can display video signals input from other devices with higher definition.

  In addition, when the video display device 100 includes the network interface unit 110 that acquires a video signal from a server connected to the set work via a network, the signal that the image processing unit 103 performs image processing from the network interface unit 110. It may be a video signal input to the image processing unit 103.

  In this case, the video display apparatus 100 can display the video signal acquired from the server connected to the set work via the network with higher definition.

  The video display device 100 reads out recording data including a video signal from a removable medium made of an optical disk, a magnetic disk such as an HDD (hard disk drive), a semiconductor, and the like, and the recording data read out by the reading unit 111 When the image processing unit 103 includes the reproduction control unit 113 that reproduces the video signal from the reproduction control unit 113, the signal processed by the image processing unit 103 may be a video signal input from the reproduction control unit 113 to the image processing unit 103.

  In this case, the video display apparatus 100 can display the video signal included in the recording data recorded on the removable medium with higher definition.

  Further, when the video display device 100 includes a recording unit 112 made of a magnetic disk such as an HDD (Hard Disk Drive), a semiconductor, and the like, and a reproduction control unit 113 that reproduces a video signal from the recording unit 112, image processing is performed. The signal processed by the unit 103 may be a video signal input from the reproduction control unit 113 to the image processing unit 103.

  In this case, the video display device 100 can display the video signal included in the recording data recorded in the recording unit included in the video display device 100 with higher definition.

  According to the video display device according to the first embodiment described above, a video signal having a frequency component equal to or higher than the Nyquist frequency corresponding to the number of pixels of the display unit, such as when inputting a video having a larger number of pixels than the number of pixels of the display unit. When is input, it is possible to display a higher-definition video by performing different types of low-pass filter processing depending on the amount of motion of the video signal. In addition, the occurrence of aliasing distortion can be reduced.

  Next, an example of a video display apparatus according to Embodiment 2 of the present invention will be described.

  The video display apparatus according to the second embodiment of the present invention differs from the video display apparatus 100 according to the first embodiment shown in FIG. 1 only in the low-pass filter characteristics of the image processing unit 103, and the other parts are common.

  Therefore, description of portions other than the low-pass filter characteristics of the image processing unit 103 is omitted.

Here, when an object displayed in the same video signal as in FIG. 6 moves at a speed of 1/3 display pixel per frame (when it moves at a speed of 1/3 display pixel per T ₀ (sec)). FIG. 22 shows a pixel sequence of three frames separated by T ₀ (sec) in the time direction and a pixel sequence perceived by a viewer watching the display unit 108.

  Then, it can be seen that the number of pixels perceived by the viewer watching the display unit 108 is tripled based on the same principle as in FIG.

This effect is the same even when moving at a speed of 1/3 + m display pixels (m is an integer of 0 or more) per frame (when moving at a speed of 1/3 + m display pixels in T ₀ (sec)).

  At this time, if the video signal input to the display unit 108 has a high-frequency component three times the Nyquist frequency of the display unit 108 based on the same principle as in FIGS. The viewing resolution is tripled.

  Therefore, the video display apparatus 100 according to the second embodiment has the maximum frequency of the video signal in the characteristics of the low-pass filter processing of the image processing unit 103 in order to achieve both the high-definition display effect of the video signal and the prevention of aliasing. Alternatively, the cutoff frequency of the low-pass filter process is set to a characteristic as indicated by 2301 in FIG.

  In addition, 2302 shown in FIG. 23 has shown the characteristic of the low-pass filter process in the video display apparatus based on Example 1. FIG.

  That is, in the characteristics of the low-pass filter processing of the image processing unit 103 shown in FIG. 23, when the fractional pixel component of the motion amount is 1/3 display pixel, and the 2/3 display pixel, the fractional pixel component of motion amount is 0. The higher resolution effect shown in FIG. 22 can be realized by increasing the maximum frequency of the video signal or the cut-off frequency of the low-pass filter process.

  In other words, the video display apparatus 100 according to the second embodiment can increase the resolution not only when the number of viewing pixels of FIG. 6 is doubled but also when the number of viewing pixels of FIG. 22 is three times.

  Further, as shown in FIG. 23, when the fractional pixel component of the motion amount is 1/2 display pixel, the maximum frequency of the video signal or the cut of the low-pass filter processing is cut as compared with the case where the fractional pixel component of the motion amount is 0. By increasing the off-frequency, the high resolution effect shown in FIG. 11 can be realized as in the first embodiment.

At this time, when the fractional pixel component of the motion amount is 0 or 1 display pixel, the low-pass filter processing is performed so that the maximum frequency of the video signal or the cutoff frequency of the low-pass filter processing becomes the Nyquist frequency f _n , and the aliasing distortion Image quality degradation due to the occurrence of

In order to maximize the above-described high resolution effect, the maximum frequency of the video signal or the cutoff frequency of the low-pass filter processing when the decimal pixel component of the motion amount is 1/3 display pixel or 2/3 display pixel. Is preferably about three times the Nyquist frequency f _n .

However, in the video display device 100 according to the second embodiment, when the video signal input to the image processing unit 103 does not have a frequency component that is three times or more the Nyquist frequency f _n of the display unit 108, the motion amount is a decimal number. When the portion is a 1/3 display pixel or a 2/3 display pixel, the high-frequency component of the frequency component of the video signal is passed to the maximum without being removed, so that the resolution to be viewed does not reach up to 3 times. It can be improved as much as possible.

  Here, the characteristic of the low-pass filter processing when the horizontal axis in FIG. 23 is the amount of motion itself is as shown in FIG.

As shown in FIG. 20C, in the characteristics of the low-pass filter processing of the image processing unit 103 of the video display device 100 according to the second embodiment, the maximum frequency of the video signal or the low-pass filter processing is the same as in the first embodiment. Periodic characteristics in which the cutoff frequency is the Nyquist frequency f _n when the amount of motion is an integral multiple of one display pixel, and the Nyquist frequency f _n or more when the amount of motion is other than an integer multiple of one display pixel. It is said. The period in this case is one display pixel period in the change of the motion amount of the video signal.

  Thereby, the video display apparatus 100 according to the second embodiment can realize a video display that achieves both high-definition video display and prevention of aliasing.

  In other words, in the video display device 100 according to the second embodiment, in the low-pass filter processing of the image processing unit 103, the removal band of the frequency component of the video signal in the higher frequency portion than the Nyquist frequency of the display unit is changed to the motion of the video signal. When the amount of motion of the video signal is an integer multiple of one display pixel, the amount of motion of the video signal is an integer multiple of one display pixel, compared to the case other than when the amount of motion of the video signal is an integer multiple of one display pixel. A low pass filter process is performed to remove high frequency components in a wider band.

  Thereby, the video display apparatus 100 according to the second embodiment can achieve both high-definition video display and prevention of image quality degradation due to aliasing distortion.

  When the maximum frequency of the display video displayed on the display unit 108 decreases as the amount of motion of the video signal increases, the maximum frequency of the video signal shown in FIG. When the frequency is confirmed as the maximum frequency of the display image, it is as shown in FIG.

Here, in FIG. 21 (c), f _n / f (v) shown in the first embodiment is multiplied by the maximum frequency measured from the display image displayed on the display unit 108, thereby being shown in FIG. 20 (c). It is possible to calculate the maximum frequency of the video signal after the low-pass filter processing of the image processing unit 103 to be calculated or the cutoff frequency of the low-pass filter processing as in the first embodiment.

  According to the video display device according to the second embodiment described above, a video signal having a frequency component equal to or higher than the Nyquist frequency corresponding to the number of pixels of the display unit, such as when inputting a video having a larger number of pixels than the number of pixels of the display unit. When is input, it is possible to display a higher-definition video by performing different types of low-pass filter processing depending on the amount of motion of the video signal. In addition, the occurrence of aliasing distortion can be reduced.

  Next, an example of a video display apparatus according to Embodiment 3 of the present invention will be described.

  The video display device according to the third embodiment of the present invention is different from the video display device 100 according to the first embodiment shown in FIG. 1 only in the low-pass filter characteristics of the image processing unit 103, and the other parts are common.

  Therefore, description of portions other than the low-pass filter characteristics of the image processing unit 103 is omitted.

  The video display apparatus 100 according to the third embodiment is capable of increasing the resolution even when the number of viewing pixels is four times based on the same principle as in FIGS.

Here, the number of viewing pixels is quadrupled when the video signal moves at a speed of 1/4 + m display pixels (m is an integer of 0 or more) per frame (1/0 in T ₀ (sec)). When moving at a speed of 4 + m display pixels).

  Therefore, the video display apparatus 100 according to the third embodiment has the maximum frequency of the video signal in the characteristics of the low-pass filter processing of the image processing unit 103 in order to achieve both the high-definition display effect of the video signal and the prevention of aliasing. Alternatively, the cut-off frequency of the low-pass filter process has a characteristic as indicated by 2401 shown in FIG.

  That is, in the characteristics of the low-pass filter processing of the image processing unit 103 shown in FIG. 23, when the fractional pixel component of the motion amount is a 1/4 display pixel, a 2/4 display pixel, or a 3/4 display pixel, By increasing the maximum frequency of the video signal or the cut-off frequency of the low-pass filter process as compared with the case where the fractional pixel component is 0, it is possible to achieve a high resolution effect in the amount of motion in which the number of viewing pixels is quadrupled.

At this time, when the fractional pixel component of the motion amount is 0 or 1 display pixel, the low-pass filter processing is performed so that the maximum frequency of the video signal or the cutoff frequency of the low-pass filter processing becomes the Nyquist frequency f _n , and the aliasing distortion Image quality degradation due to the occurrence of

In order to maximize the above-described high resolution effect, the maximum frequency of the video signal or the cutoff frequency of the low-pass filter processing when the decimal pixel component of the motion amount is 1/4 display pixel or 2/4 display pixel. Is preferably about 4 times the Nyquist frequency f _n .

Further, when the fractional pixel component of the motion amount is a 2/4 display pixel, the situation is the same as in FIG. 7 of the first embodiment, and thus the number of viewing pixels is doubled, so that the maximum frequency of the video signal or The cut-off frequency for the low-pass filter processing is sufficient if it is about twice the Nyquist frequency f _n .

However, in the video display device 100 according to the second embodiment, when the video signal input to the image processing unit 103 does not have a frequency component that is four times or more the Nyquist frequency f _n of the display unit 108, the motion amount is a decimal number. When the portion is a 1/4 display pixel or a 3/4 display pixel, the high frequency component of the frequency component of the video signal is passed through to the maximum without removing the resolution to be viewed up to 4 times. It can be improved as much as possible.

  Here, the characteristic of the low-pass filter processing when the horizontal axis in FIG. 24 is the motion amount itself is as shown in FIG.

As shown in FIG. 20D, in the characteristics of the low-pass filter processing of the image processing unit 103 of the video display device 100 according to the third embodiment, the maximum frequency of the video signal or the low-pass filter processing is the same as in the first embodiment. Periodic characteristics in which the cutoff frequency is the Nyquist frequency f _n when the amount of motion is an integral multiple of one display pixel, and the Nyquist frequency f _n or more when the amount of motion is other than an integer multiple of one display pixel. It is said. The period in this case is one display pixel period in the change of the motion amount of the video signal.

  Thereby, the video display apparatus 100 according to the third embodiment can realize a video display that achieves both high-definition video display and prevention of aliasing.

  In other words, in the video display device 100 according to the third embodiment, in the low-pass filter processing of the image processing unit 103, the removal band of the frequency component of the video signal in the higher frequency portion than the Nyquist frequency of the display unit is used as the motion of the video signal. When the amount of motion of the video signal is an integer multiple of one display pixel, the amount of motion of the video signal is an integer multiple of one display pixel, compared to the case other than when the amount of motion of the video signal is an integer multiple of one display pixel. A low pass filter process is performed to remove high frequency components in a wider band.

  Thereby, the video display apparatus 100 according to the third embodiment can achieve both high-definition video display and prevention of image quality deterioration due to aliasing distortion.

  When the maximum frequency of the display video displayed on the display unit 108 decreases as the amount of motion of the video signal increases, the maximum frequency of the video signal shown in FIG. When the frequency is confirmed as the maximum frequency of the display image, it is as shown in FIG.

Here, in FIG. 21D, f _n / f (v) shown in the first embodiment is multiplied by the maximum frequency measured from the display image displayed on the display unit 108 to obtain the result shown in FIG. It is possible to calculate the maximum frequency of the video signal after the low-pass filter processing of the image processing unit 103 to be calculated or the cutoff frequency of the low-pass filter processing as in the first embodiment.

  According to the video display device according to the third embodiment described above, a video signal having a frequency component equal to or higher than the Nyquist frequency corresponding to the number of pixels of the display unit, such as when inputting a video having a larger number of pixels than the number of pixels of the display unit. When is input, it is possible to display a higher-definition video by performing different types of low-pass filter processing depending on the amount of motion of the video signal. In addition, the occurrence of aliasing distortion can be reduced.

  Next, an example of a video display apparatus according to Embodiment 4 of the present invention will be described.

  The video display apparatus according to the fourth embodiment of the present invention is different from the video display apparatus 100 according to the first embodiment shown in FIG. 1 only in the low-pass filter characteristics of the image processing unit 103, and the other parts are common.

  Therefore, description of portions other than the low-pass filter characteristics of the image processing unit 103 is omitted.

  The video display apparatus 100 according to the fourth embodiment is capable of increasing the resolution even when the number of viewing pixels is five times based on the same principle as in FIGS. 6 and 22.

Here, the number of viewing pixels becomes five times when the video signal moves at a speed of 1/5 + m display pixels (m is an integer of 0 or more) per frame (1/0 in T ₀ (sec)). When moving at a speed of 5 + m display pixels).

  Therefore, the video display apparatus 100 according to the fourth embodiment has the maximum frequency of the video signal in the characteristics of the low-pass filter processing of the image processing unit 103 in order to achieve both the high-definition display effect of the video signal and the prevention of aliasing. Alternatively, the cutoff frequency of the low-pass filter process is set to a characteristic as indicated by 2501 in FIG.

  That is, in the characteristics of the low-pass filter processing of the image processing unit 103 shown in FIG. 23, the decimal pixel component of the motion amount is 1/5 display pixel, 2/5 display pixel, 3/5 display pixel, and 4/5 display pixel. In this case, by increasing the maximum frequency of the video signal or the cut-off frequency of the low-pass filter processing compared to the case where the fractional pixel component of the motion amount is 0, the resolution is increased in the motion amount in which the number of viewing pixels is five times higher. The effect can be realized.

At this time, when the fractional pixel component of the motion amount is 0 or 1 display pixel, the low-pass filter processing is performed so that the maximum frequency of the video signal or the cutoff frequency of the low-pass filter processing becomes the Nyquist frequency f _n , and the aliasing distortion Image quality degradation due to the occurrence of

Further, in order to maximize the above-described high resolution effect, the video when the fractional pixel component of the motion amount is 1/5 display pixel, 2/5 display pixel, 3/5 display pixel, 4/5 display pixel. cut-off frequency of the maximum frequency or the low-pass filtering of the signal is desirably 5 times the Nyquist frequency f _n.

However, in the video display device 100 according to the fourth embodiment, when the video signal input to the image processing unit 103 does not have a frequency component that is five times or more the Nyquist frequency f _n of the display unit 108, the motion amount is a decimal number. When the portion is 1/5 display pixel, 2/5 display pixel, 3/5 display pixel, 4/5 display pixel, the high frequency component of the frequency component of the video signal is allowed to pass through to the maximum without being removed. Even if the resolution to be achieved does not reach 5 times, it can be improved as much as possible.

  Here, the characteristics of the low-pass filter processing when the horizontal axis in FIG. 25 is the motion amount itself are as shown in FIG.

As shown in FIG. 20 (e), in the characteristics of the low-pass filter processing of the image processing unit 103 of the video display device 100 according to the third embodiment, the maximum frequency of the video signal or the low-pass filter processing is the same as in the first embodiment. Periodic characteristics in which the cutoff frequency is the Nyquist frequency f _n when the amount of motion is an integral multiple of one display pixel, and the Nyquist frequency f _n or more when the amount of motion is other than an integer multiple of one display pixel. It is said. The period in this case is one display pixel period in the change of the motion amount of the video signal.

  Thereby, the video display apparatus 100 according to the fourth embodiment can realize a video display that achieves both high-definition video display and prevention of aliasing.

  In other words, in the video display device 100 according to the third embodiment, in the low-pass filter processing of the image processing unit 103, the removal band of the frequency component of the video signal in the higher frequency portion than the Nyquist frequency of the display unit is used as the motion of the video signal. When the amount of motion of the video signal is an integer multiple of one display pixel, the amount of motion of the video signal is an integer multiple of one display pixel, compared to the case other than when the amount of motion of the video signal is an integer multiple of one display pixel. A low pass filter process is performed to remove high frequency components in a wider band.

  Thereby, the video display apparatus 100 according to the fourth embodiment can achieve both high-definition video display and prevention of image quality degradation due to aliasing distortion.

  When the maximum frequency of the display video displayed on the display unit 108 decreases as the amount of motion of the video signal increases, the maximum frequency of the video signal shown in FIG. When the frequency is confirmed as the maximum frequency of the display image, it is as shown in FIG.

Here, in FIG. 21 (e), f _n / f (v) shown in the first embodiment is multiplied by the maximum frequency measured from the display image displayed on the display unit 108, thereby being shown in FIG. It is possible to calculate the maximum frequency of the video signal after the low-pass filter processing of the image processing unit 103 to be calculated or the cutoff frequency of the low-pass filter processing as in the first embodiment.

  According to the video display apparatus according to the fourth embodiment described above, a video signal having a frequency component equal to or higher than the Nyquist frequency corresponding to the number of pixels of the display unit, such as when inputting a video having a larger number of pixels than the number of pixels of the display unit. When is input, it is possible to display a higher-definition video by performing different types of low-pass filter processing depending on the amount of motion of the video signal. In addition, the occurrence of aliasing distortion can be reduced.

  Next, an example of a video display apparatus according to Embodiment 5 of the present invention will be described.

  The video display apparatus according to the fifth embodiment of the present invention is different from the video display apparatus 100 according to the first embodiment shown in FIG. 1 only in the low-pass filter characteristics of the image processing unit 103, and the other parts are common.

  Therefore, description of portions other than the low-pass filter characteristics of the image processing unit 103 is omitted.

  The video display device 100 according to the fifth embodiment enables high resolution and low-pass filter processing when the number of viewing pixels is i times (i is an integer of 3 or more) based on the same principle as in FIGS. These characteristics are simplified, and the amount of processing required for switching processing of the low-pass filter characteristics is reduced.

Here, as shown in FIG. 26, in the video signal, when moving at a speed of 1 / i + m display pixels (m is an integer of 0 or more) per frame (T ₀ (sec), the speed of 1 / i + m display pixels. In principle, the number of viewing pixels becomes i times.

  Here, in order to realize a high-definition display effect of the video signal, the video display device 100 according to the fifth embodiment uses the maximum frequency of the video signal or the low-pass filter processing in the characteristics of the low-pass filter processing of the image processing unit 103. The cut-off frequency has a characteristic as 2701 shown in FIG.

  In other words, in the characteristics of the low-pass filter processing of the image processing unit 103 shown in FIG. 27, the decimal pixel component of the motion amount is 1 / i display pixel, 2 / i display pixel, i-2 / i display pixel, i-1 / In any of the i display pixels, the number of viewing pixels becomes i times by increasing the maximum frequency of the video signal or the cut-off frequency of the low-pass filter processing compared to the case where the decimal pixel component of the motion amount is 0. The effect of increasing the resolution in the amount of motion can be realized.

At this time, when the fractional pixel component of the motion amount is 0 or 1 display pixel, the low-pass filter processing is performed so that the maximum frequency of the video signal or the cutoff frequency of the low-pass filter processing becomes the Nyquist frequency f _n , and the aliasing distortion Image quality degradation due to the occurrence of

here. In the example of FIG. 27, the maximum frequency of the video signal or the cutoff frequency of the low-pass filter processing is set to the Nyquist frequency f _n when the motion amount decimal pixel component is 0, and the motion amount decimal pixel component is displayed in 1 / i. In the case of a pixel, it is i times the frequency f _n
When the fractional pixel component of the motion amount is from 1 / i display pixel to i-1 / i display pixel, the maximum frequency of the video signal or the cutoff frequency of the low-pass filter processing is constant, and the fractional pixel component of the motion amount is 1. Again, the Nyquist frequency f _{n is} assumed.

  Thus, compared to the characteristics of the low-pass filter processing shown in FIGS. 23, 24, and 25, the amount of motion that does not require switching of the low-pass filter processing (the fractional pixel component of the motion amount is 1 / i display pixel to i -1 / i display pixels), and it is possible to reduce the amount of processing required for switching the low-pass filter processing.

  In addition, the characteristics of the low-pass filter process itself can be simplified.

Here, if i is considered to be infinite, the 1 / i display pixel approaches 0 pixel, and the i−1 / i display pixel approaches 1. Further, i × f _n shown in FIG. 27 becomes infinite, which means that high-frequency component removal by the low-pass filter is not performed.

In other words, in this case, the video display device 100 according to the fifth embodiment uses the Nyquist frequency f _{n as} the maximum frequency of the video signal or the cutoff frequency of the low-pass filter process when the amount of motion of the video signal is an integral multiple of one display pixel. In other cases, the characteristic is a simple low-pass filter process in which the low-pass filter process is turned off.

  Here, when the horizontal axis in FIG. 25 is the amount of motion itself, the characteristics of the low-pass filter processing are as shown in FIG.

As shown in FIG. 20F, in the characteristics of the low-pass filter processing of the image processing unit 103 of the video display device 100 according to the third embodiment, the maximum frequency of the video signal or the low-pass filter processing is the same as in the first embodiment. Periodic characteristics in which the cutoff frequency is the Nyquist frequency f _n when the amount of motion is an integral multiple of one display pixel, and the Nyquist frequency f _n or more when the amount of motion is other than an integer multiple of one display pixel. It is said. The period in this case is one display pixel period in the change of the motion amount of the video signal.

  Thereby, the video display apparatus 100 according to the fifth embodiment can realize high-definition video display by relatively simple low-pass filter switching.

  In other words, in the video display device 100 according to the fifth embodiment, in the low-pass filter processing of the image processing unit 103, the removal band of the frequency component of the video signal in the higher frequency portion than the Nyquist frequency of the display unit is used as the motion of the video signal. When the amount of motion of the video signal is an integer multiple of one display pixel, the amount of motion of the video signal is an integer multiple of one display pixel, compared to the case other than when the amount of motion of the video signal is an integer multiple of one display pixel. A low pass filter process is performed to remove high frequency components in a wider band.

  Thereby, the video display apparatus 100 according to the fifth embodiment can realize high-definition video display by relatively simple low-pass filter switching.

  When the maximum frequency of the display image displayed on the display unit 108 decreases as the amount of motion of the image signal increases, the maximum frequency of the image signal shown in FIG. When the frequency is confirmed as the maximum frequency of the display image, it is as shown in FIG.

Here, in FIG. 21 (f), f _n / f (v) shown in the first embodiment is multiplied by the maximum frequency measured from the display image displayed on the display unit 108, thereby being shown in FIG. 20 (e). It is possible to calculate the maximum frequency of the video signal after the low-pass filter processing of the image processing unit 103 to be calculated or the cutoff frequency of the low-pass filter processing as in the first embodiment.

  According to the video display device according to the fifth embodiment described above, a video signal having a frequency component equal to or higher than the Nyquist frequency corresponding to the number of pixels of the display unit, such as when inputting an image having a larger number of pixels than the number of pixels of the display unit. Is input, it is possible to display a high-definition image by switching the low-pass filter process more simply.

  Next, an example of a video display apparatus according to Embodiment 6 of the present invention will be described with reference to FIG.

  In the video display device according to the sixth embodiment of the present invention, the image processing unit 103 is changed to an image processing unit 2801 shown in FIG. 28 in contrast to the video display devices 100 of the first to fifth embodiments. The configuration other than the image processing unit is common.

  Therefore, description of portions other than the image processing unit is omitted.

  The image processing unit 2801 performs low-pass filter processing and image reduction processing performed by the motion adaptive scaler 104 of the image processing unit 103 illustrated in FIG. 1 in the horizontal direction and the vertical direction, respectively.

  Here, examples of the image processing unit 2801 shown in FIG. 28 include a motion search unit 106, a horizontal direction adaptive adaptive scaler 2802 that performs horizontal low-pass filter processing and image reduction processing, and image processing target pixels in the image processing target image. A horizontal pixel position calculation unit 2803 that calculates a horizontal position, a determination unit 2804, a low-pass filter process in the vertical direction, a horizontal motion adaptive scaler 2805 that performs an image reduction process, and a vertical position of an image processing target pixel in an image to be processed A vertical pixel position calculation unit 2806 and a determination unit 2807.

  Here, since the motion search part 106 is the same as that of Example 1, description is abbreviate | omitted.

  Next, the horizontal pixel position calculation unit 2803 calculates the horizontal position of the image processing target pixel in the image processing target image, and outputs the horizontal position to the determination unit 2804.

  The determination unit 2804 acquires information on the pixel position in the horizontal direction for the image processing target pixel calculated by the horizontal pixel position calculation unit 2803, and the motion vector and motion amount for the image processing target pixel calculated by the motion search unit 106. Among them, the horizontal direction component is used to select the type of horizontal low-pass filter processing in the horizontal direction motion adaptive scaler 2802, and an instruction signal is output to the horizontal direction motion adaptive scaler 2802.

  The motion adaptive scaler 2802 includes a plurality of different types of low-pass filters LPFH1, LPFH2,.

  For example, the filters shown in FIGS. 4A to 4D may be used as examples of the coefficients of the tap filters of the filters constituting the different types of low-pass filters LPFH1, LPFH2,... LPFHn.

  Next, the vertical pixel position calculation unit 2807 calculates the vertical position of the image processing target pixel in the image processing target image and outputs the vertical position to the determination unit 2808.

  The determination unit 2808 acquires information on the pixel position in the vertical direction for the image processing target pixel calculated by the vertical pixel position calculation unit 2807, and the motion vector and the motion amount for the image processing target pixel calculated by the motion search unit 106. Of these, the vertical component is used to select the type of vertical low-pass filter processing in the vertical motion adaptive scaler 2806, and an instruction signal is output to the vertical motion adaptive scaler 2806.

  The motion adaptive scaler 2806 includes a plurality of different types of low-pass filters LPFV1, LPFV2,... LPFVn and a switch 2809, and switches a low-pass filter to be processed according to an instruction from the determination unit 2808.

  For example, the filters shown in FIGS. 5A to 5D may be used as examples of the coefficients of the tap filters of the filters constituting the different types of low-pass filters LPFV1, LPFV2,... LPFVn.

  In this image processing unit 2801, the one-dimensional scaler process including the horizontal pixel position calculation unit 2803, the determination unit 2804, and the horizontal direction motion adaptive scaler 2802 includes a vertical pixel position calculation unit 2807, a determination unit 2808, and the vertical unit. The processing of the one-dimensional scaler composed of the directional motion adaptive scaler 2806 performs the processing of the image processing unit shown in the first to fifth embodiments in the horizontal direction and the vertical direction, respectively.

  Therefore, according to the horizontal direction component and the vertical direction component of the amount of motion of the object in the video signal, the low pass filter processing in each direction is switched independently, so that the first to fifth embodiments for each direction. The effect of high-definition video display shown in FIG.

  According to the video display apparatus according to the sixth embodiment described above, the high-definition video display effects shown in the first to fifth embodiments can be realized not only in the one-dimensional direction but also in the two-dimensional direction.

  That is, when a video signal having a frequency component equal to or higher than the Nyquist frequency corresponding to the number of pixels of the display unit is input, such as when inputting a video having a larger number of pixels than the number of pixels of the display unit, By performing different types of low-pass filter processing in the vertical direction and the horizontal direction according to the direction of movement, it becomes possible to display a higher-definition video. In addition, the occurrence of aliasing distortion can be reduced.

  Next, an example of a video display apparatus according to Embodiment 7 of the present invention will be described with reference to FIG.

  In the video display device according to the seventh embodiment of the present invention, the image processing unit 103 is changed to an image processing unit 2901 shown in FIG. 29 in contrast to the video display devices 100 according to the first to sixth embodiments. The configuration other than the image processing unit is common.

  Therefore, description of portions other than the image processing unit is omitted.

  The image processing unit 2901 can be configured by a pixel position calculation unit 105, a motion search unit 106, a motion adaptive scaler (low pass filter) 2902, and a coefficient generation unit 2903.

  Here, since the operations of the pixel position calculation unit 105 and the motion search unit 106 are the same as those in the first embodiment, description thereof will be omitted.

  Next, unlike the motion adaptive scaler 104 of the first embodiment, the motion adaptive scaler (low-pass filter) 2902 does not switch between a plurality of low-pass filters, but according to the coefficients generated by the coefficient generator 2903 in FIG. EEE1 or FIG. A plurality of types of low-pass filter processing and image reduction processing are selectively performed by changing the coefficient of the tap filter as shown.

  The coefficient generation unit 2903 acquires pixel position information for the image processing target pixel calculated by the pixel position calculation unit 105, and calculates the motion vector and motion amount for the image processing target pixel calculated by the motion search unit 106. By using this, the type of low-pass filter processing in the motion adaptive scaler (low-pass filter) 2902 is selected, and a coefficient for changing the tap filter of the motion adaptive scaler (low-pass filter) 2902 is calculated and output.

  For example, when the image processing unit 2901 of the seventh embodiment performs the same one-dimensional low-pass filter processing as the image processing unit 103 shown in the first to fifth embodiments, for example, the horizontal low-pass filter processing may be used. For example, an example of the coefficients of the tap filter calculated by the coefficient generator 2903 may be the filters shown in (a) to (d) of FIG. Further, for example, in the case of vertical low-pass filter processing, examples of tap filter coefficients calculated by the coefficient generator 2903 may be filters shown in (a) to (d) of FIG.

  Further, for example, when the image processing unit 2901 of the seventh embodiment performs the low-pass filter processing in the same direction as the image processing unit 103 shown in the sixth embodiment, for example, the tap filter calculated by the coefficient generation unit 2903 is used. An example of the coefficients may be the filters shown in (a) to (d) of FIG. 30A shows an example in which the low-pass filter of FIG. 4A is applied in the horizontal direction and the low-pass filter of FIG. 5B is applied in the vertical direction. FIG. 30B shows an example in which the low-pass filter of FIG. 4B is applied in the horizontal direction and the low-pass filter of FIG. 5C is applied in the vertical direction. FIG. 30C shows an example in which the low-pass filter of FIG. 4C is applied in the horizontal direction and the low-pass filter of FIG. 5D is applied in the vertical direction. FIG. 30 (d) shows an example in which the low-pass filter of FIG. 4 (d) is applied in the horizontal direction and the low-pass filter of FIG. 5 (a) is applied in the vertical direction.

  In addition to the effects of the first to sixth embodiments, the video display device according to the seventh embodiment described above realizes switching processing of a plurality of types of low-pass filter processes in the image processing unit with a smaller hardware configuration. It has the effect that it is possible.

  Next, an example of a video display apparatus according to Embodiment 8 of the present invention will be described.

  The video display device 3100 according to the eighth embodiment of the present invention is different from the video display device 100 according to the first embodiment illustrated in FIG. 1 in that an image resolution increasing unit 3101 is newly provided.

  The image processing unit 3102 is the image processing unit 103 according to the first to fifth embodiments illustrated in FIG. 1, the image processing unit 2801 according to the sixth embodiment illustrated in FIG. 28, or the image processing unit according to the seventh embodiment illustrated in FIG. 29. 2901. Details of the processing of these image processing units are the same as those in each embodiment, and thus description thereof is omitted.

  Other parts of the video display device 3100 are the same as those of the video display device 100 of the first embodiment, and a description thereof will be omitted.

  In the first to seventh embodiments, the image processing unit of each example performs a process of reducing the size of an image included in the input video signal so as to match the number of display pixels of the display unit 108. ing.

  That is, in the first to seventh embodiments, it is assumed that the number of pixels of an image acquired by the video display device 100 by reception or the like is larger than the number of display pixels of the display unit 108.

  On the other hand, in the present embodiment, the video signal acquired by the video display device 3100 is received, etc., while the image resolution increasing unit 3101 increases the resolution, the number of pixels is increased, and the video with the increased number of pixels is displayed. Input to the image processing unit 3102.

  Accordingly, for example, even when the number of pixels of the video signal acquired by the video display device 3100 by reception or the like is the same as or smaller than the number of display pixels of the display unit 108, the Nyquist frequency corresponding to the number of pixels of the display unit It becomes possible to perform the above high-definition video display.

  At this time, in order to obtain an effect of high-definition video display, the image high-resolution unit 3101 has the number of images on the display unit when the number of pixels of the video after high-resolution is either the vertical direction or the horizontal direction. Therefore, it is necessary to perform a resolution enhancement process for the video so that the number of images increases.

  In addition, when the video signal whose resolution is increased by the image resolution increasing unit 3101 is larger than the number of display pixels of the display unit 108, there is a possibility that aliasing may occur at the time of display. In the image processing unit 3102, By performing the low pass filter processing shown in the first to seventh embodiments, this can be reduced.

  Here, the image size handled by the video display apparatus 3100 according to the eighth embodiment will be described with reference to FIG. The image high-resolution processing shown in each example of FIG. 41 is image high-resolution processing performed in the image high-resolution unit 3101 of the video display device 3100 according to the eighth embodiment. The image reduction process illustrated in each example of FIG. 41 is an image reduction process performed in the image processing unit 3102 of the video display device 3100 according to the eighth embodiment.

  In FIG. 41, an image 4101, an image 4104, and an image 4106 are images that are input to the image resolution increasing unit 3101. An image 4102, an image 4105, and an image 4107 are images after the resolution is increased by the image resolution increasing unit 3101. An image 4103 is an image displayed on the display unit after being reduced in the image processing unit 3102.

  Here, Y is the number of pixels in the vertical direction of the images 4101, 4104, and 4106, and X is the number of pixels in the horizontal direction of the images 4101, 4104, and 4106.

  Further, a is the vertical enlargement ratio of the image of the high resolution processing in the image high resolution increasing section 3101, and b is the horizontal enlargement ratio of the image of the high resolution processing in the image high resolution increasing section 3101.

  Further, α is a reduction ratio in the vertical direction of the image for high resolution processing in the image processing unit 3102, and β is a reduction rate in the horizontal direction of the image for high resolution processing in the image processing unit 3102.

  First, the example of FIG. 41 (a) will be described. In the example of FIG. 41A, the case where the number of pixels of the image 4101 and the image 4103 is the same is shown. That is, Y = Y × a × α, X = X × b × β, a = 1 / α, and b = 1 / β.

  In the video display device 3100 according to the eighth embodiment, as shown in FIG. 41A, the number of pixels of the video signal acquired by the video display device 3100 by reception or the like is the same as the number of display pixels of the display unit 108. However, by performing the high resolution processing in the image high resolution unit 3101, higher definition video display can be performed as in the first to seventh embodiments.

  Next, the example of FIG. 41B will be described. In the example of FIG. 41B, the image 4104 has a smaller number of pixels than the image 4103. That is, Y <Y × a × α, X <X × b × β, a> 1 / α, and b> 1 / β.

  In the video display device 3100 according to the eighth embodiment, as illustrated in FIG. 41B, the number of pixels of the video signal acquired by the video display device 3100 by reception or the like is smaller than the number of display pixels of the display unit 108. Even so, by performing the high resolution processing in the image high resolution unit 3101, higher definition video display can be performed as in the first to seventh embodiments.

  Next, an example of FIG. 41 (c) will be described. In the example of FIG. 41C, the image 4106 has a larger number of pixels than the image 4103. That is, Y> Y × a × α, X> X × b × β, a <1 / α, b <1 / β.

  In the video display device 3100 according to the eighth embodiment, as illustrated in FIG. 41C, the number of pixels of the video signal acquired by the video display device 3100 by reception or the like is larger than the number of display pixels of the display unit 108. In addition, as in the first to seventh embodiments, it is possible to display a higher-definition video, but the number of pixels of the image is temporarily expanded to the size of the image 4107 by the resolution enhancement processing in the image resolution enhancement unit 3101. Thereafter, reduction processing is performed. Thereby, compared with Examples 1-7 which do not involve high resolution processing, the difference in the number of pixels before and after the reduction processing is increased, and higher definition video display can be performed. Since this principle is as shown in the first to seventh embodiments, the description thereof is omitted.

  Next, the image high-resolution part 3101 according to the present embodiment will be described with reference to FIGS.

  Next, details of the resolution enhancement processing performed by the image resolution enhancement unit 3101 according to the eighth embodiment will be described.

  In the following description of the image resolution increasing unit 3101, an image input to the image resolution increasing unit 3101 may be either a frame unit or a field unit. However, for the sake of simplification of description, it is assumed that the image is a frame unit. To do.

  First, the image resolution enhancement unit 3101 performs resolution enhancement by, for example, three processes of (1) position estimation, (2) wideband interpolation, and (3) weighted sum. Here, (1) position estimation is to estimate the difference in sampling phase (sampling position) of each image data using each image data of a plurality of input image frames. (2) Wideband interpolation increases the image data density by interpolating and increasing the number of pixels (sampling points) using a wide-band low-pass filter that transmits all high-frequency components of the original signal, including aliasing components. It is to become. (3) The weighted sum is a weighted sum corresponding to the sampling phase of each densified data, canceling out aliasing components generated during pixel sampling and simultaneously removing the high-frequency components of the original signal. Is to restore.

  FIG. 33 shows an outline of this high resolution technology. As shown in (a) of the figure, frame # 1 (3301), frame # 2 (3302), and frame # 3 (3303) on different time axes are input, and these are combined to form an output frame (3306). Assume that you get. For simplicity, first consider the case where the subject moves in the horizontal direction (3304), and then consider increasing the resolution by one-dimensional signal processing on the horizontal line (3305). At this time, as shown in (b) and (d) in the figure, the position of the signal waveform is shifted according to the amount of movement (3304) of the subject in frame # 2 (3302) and frame # 1 (3301). Occurs. The position deviation amount is obtained by the above (1) position estimation, and as shown in FIG. 5C, the frame # 2 (3302) is motion-compensated (3307) so that the position deviation is eliminated, and the pixels ( The phase difference θ (3311) between the sampling phases (3309) and (3310) of 3308) is obtained. Based on this phase difference θ (3311), by performing the above (2) wideband interpolation and (3) weighted sum, as shown in FIG. = High resolution is realized by generating a new pixel (3312) at the position of π). (3) The weighted sum will be described later. Actually, the movement of the subject may be accompanied by movements such as rotation and enlargement / reduction as well as parallel movement, but if the time interval between frames is very small or the movement of the subject is slow, These movements can also be considered by approximating local translation.

At this time, the first configuration example of the image resolution increasing unit 3101 is configured to perform the high resolution processing described in Reference Document 1, Reference Document 2, or Non-Patent Document 2. In this case, when performing the weighted sum of the above (3), as shown in FIG. 34, if signals of at least three frame images are used, the resolution can be increased by a factor of 2 in the one-dimensional direction.
[Reference Document 1] JP-A-8-336046 [Reference Document 2] JP-A-9-69755 Here, with reference to FIG. 34, the high resolution processing in the first configuration example of the image high resolution unit 3101 will be described. To do. FIG. 34 is a diagram showing a frequency spectrum of each component in a one-dimensional frequency region. In the figure, the distance from the frequency axis represents the signal intensity, and the rotation angle around the frequency axis represents the phase. The weighted sum of (3) above will be described in detail below.

  When the pixel interpolation is performed by the broadband low-pass filter that transmits twice the Nyquist frequency band (frequency band 0 to sampling frequency fs) in the broadband interpolation of (2) above, the same component as the original signal (hereinafter referred to as the original component) And the sum of the aliasing components according to the sampling phase is obtained. At this time, when the (2) wideband interpolation processing is performed on the signals of the three frame images, as shown in FIG. 34 (a), the original components (3401), (3402), and (3403) of the respective frames are obtained. It is well known that the phases are all coincident and the phase of the aliasing components (3404) (3405) (3406) rotates in accordance with the difference in sampling phase of each frame. In order to facilitate understanding of the respective phase relationships, the phase relationship of the original components of each frame is shown in FIG. 5B, and the phase relationship of the folded components of each frame is shown in FIG.

  Here, by appropriately selecting a coefficient to be multiplied for the signals of the three frame images and performing the above (3) weighted sum, the aliasing components (3404) (3405) (3406) of each frame are mutually connected. It can be canceled out and only the original components can be extracted. At this time, the vector sum of the folded components (3404), (3405), and (3406) of each frame is set to 0, that is, both the Re axis (real axis) component and the Im axis (imaginary axis) component are set to 0. For this purpose, at least three folding components are required. Therefore, by using signals of at least three frame images, it is possible to achieve double the resolution, that is, to remove one aliasing component.

  Next, FIG. 32 shows a second configuration example of the image resolution increasing unit 3101. In this case, if the signals of at least two frame images are used, the resolution can be increased to twice that in the one-dimensional direction. Details will be described below.

  First, a plurality of images are input to the input unit 3200 of the image resolution increasing unit 3101.

  Next, the position estimation unit 3201 estimates the position of the corresponding pixel on the frame # 2 based on the sampling phase (sampling position) of the pixel to be processed on the frame # 1 input to the input unit 3200. The sampling phase difference θ3202 is obtained. The sampling phase difference θ3202 is information equivalent to the motion vector information. The sampling phase difference θ3202 can be calculated, for example, by performing a motion search process.

  Next, the motion compensation / uprate unit 3215 uses the upraters 3203 and 3204 to compensate the frame # 2 by using the information of the phase difference θ3202 to align the position with the frame # 1, and to match the frame # 1 and the frame # The number of pixels of 2 is doubled to increase the density. The phase shift unit 3216 shifts the phase of the densified data by a certain amount. Here, π / 2 phase shifters 3206 and 3208 can be used as means for shifting the phase of data by a certain amount. Further, in order to compensate for the delay generated in the π / 2 phase shifters 3206 and 3208, the signals of the frame # 1 and the frame # 2 that have been densified by the delay devices 3205 and 3207 are delayed. In the aliasing component removal unit 3217, the coefficients C0, C2, C1, and C3 generated based on the phase difference θ3202 by the coefficient determiner 3209 for the output signals of the delay units 3205 and 3207 and the Hilbert transformers 3206 and 3208, respectively. Are multiplied by multipliers 3210, 3211, 3212 and 3213, respectively, and these signals are added by an adder 3214 to obtain an output. This output is output from the output unit 3218.

  Note that the position estimation unit 3201 can be realized using the above conventional technique as it is. Details of the up-raters 3203 and 3204, the π / 2 phase shifters 3206 and 3208, and the aliasing component removal unit 3217 will be described later.

  FIG. 35 shows an operation in the second configuration example of the image resolution increasing unit 3101 in FIG. This figure shows the outputs of the delay devices 3205 and 3207 and the π / 2 phase shifters 3206 and 3208 shown in FIG. 32 in a one-dimensional frequency domain. In (a) of the figure, the frame # 1 and frame # 2 signals output from the delay devices 3205 and 3207 are folded back from the original components 3501 and 3502 and the original sampling frequency (fs), respectively. The signal is obtained by adding folded components 3505 and 3506. At this time, the aliasing component 3506 is rotated in phase by the above-described phase difference θ3202. On the other hand, the up-rate frame # 1 and frame # 2 signals output from the π / 2 phase shifters 3206 and 3208 are the original components 3503 and 3504 after the π / 2 phase shift and the π / 2 phase shift, respectively. The signal is obtained by adding the subsequent folding components 3507 and 3508. (B) and (c) show the original component and the aliasing component extracted for easy understanding of the phase relationship between the components shown in (a). Here, when the vector sum of the four components shown in FIG. 4B is taken, the Re-axis component is set to 1, the Im-axis component is set to 0, and the four components shown in FIG. When the vector sum is taken, the coefficients to be multiplied by each component are determined so that both the Re-axis and Im-axis components are set to 0, and the weighted sum is taken. Only the components can be extracted. In other words, it is possible to realize an image signal processing apparatus that uses only two frame images to increase the resolution twice in the one-dimensional direction. Details of this coefficient determination method will be described later.

  FIG. 36 shows the operations of the up-raters 3203 and 3204 used in the second configuration example of the image resolution increasing unit 3101 in FIG. In the figure, the horizontal axis represents frequency, and the vertical axis represents gain (the value of the ratio of the output signal amplitude to the input signal amplitude), indicating the “frequency-gain” characteristics of the up-raters 3203 and 3204. Here, in the up-raters 3203 and 3204, the new sampling frequency is set to a frequency (2 fs) that is twice the sampling frequency (fs) of the original signal, and the new pixel is located at a position just in the middle of the original pixel interval. The sampling point (= zero point) is inserted to double the number of pixels to increase the density, and a filter with a frequency between −fs and + fs all having a gain of 2.0 is applied. At this time, as shown in the figure, due to the symmetry of the digital signal, the characteristic repeats every frequency that is an integral multiple of 2fs.

  FIG. 37 shows a specific example of the up-raters 3203 and 3204 used in the second configuration example of the image resolution increasing unit 3101 in FIG. This figure shows the filter tap coefficients obtained by inverse Fourier transform of the frequency characteristics shown in FIG. At this time, each tap coefficient Ck (where k is an integer) is a generally known sinc function, and is shifted by (−θ) to compensate for the sampling phase difference θ3202, and Ck = 2sin (πk + θ) / (πk + θ) may be used. In the up-rater 3203, the phase difference θ3202 may be set to 0 and Ck = 2sin (πk) / (πk). In addition, by expressing the phase difference θ (102) by the phase difference in integer pixel units (2π) + the phase difference in decimal pixel units, the phase difference compensation in integer pixel units is realized by a simple pixel shift, and decimal For compensation of the phase difference in pixel units, the filters of the up-raters 3203 and 3204 may be used.

  FIG. 38 shows an operation example of the π / 2 phase shifters 3206 and 3208 used in the second configuration example of the image resolution increasing unit 3101 in FIG. As the π / 2 phase shifters 3206 and 3208, generally known Hilbert transformers can be used. In FIG. 5A, the horizontal axis represents frequency, and the vertical axis represents gain (value of the ratio of output signal amplitude to input signal amplitude), indicating the “frequency-gain” characteristics of the Hilbert transformer. Here, in the Hilbert transformer, the frequency (2fs) that is twice the sampling frequency (fs) of the original signal is used as a new sampling frequency, and all frequency components except -0 between -fs and + fs are gained. A pass band of 1.0. In FIG. 2B, the horizontal axis represents frequency, and the vertical axis represents phase difference (difference in output signal phase with respect to input signal phase), indicating the “frequency-phase difference” characteristic of the Hilbert transformer. Here, the phase of the frequency component between 0 and fs is delayed by π / 2, and the phase of the frequency component between 0 and −fs is advanced by π / 2. At this time, as shown in the figure, due to the symmetry of the digital signal, the characteristic repeats every frequency that is an integral multiple of 2fs.

  FIG. 39 shows an example in which the π / 2 phase shifters 3206 and 3208 used in the second configuration example of the image resolution increasing unit 3101 in FIG. 32 are configured by Hilbert transformers. This figure shows the filter tap coefficients obtained by inverse Fourier transform of the frequency characteristics shown in FIG. At this time, each tap coefficient Ck may be Ck = 0 when k = 2m (where m is an integer), and Ck = −2 / (πk) when k = 2m + 1.

  The π / 2 phase shifters 3206 and 3208 used in the first embodiment of the present invention can also use differentiators. In this case, if the general expression cos (ωt + α) representing a sine wave is differentiated by t and multiplied by 1 / ω, d (cos (ωt + α)) / dt * (1 / ω) =-sin (ωt + α) = cos (ωt + α + π / 2), and the function of π / 2 phase shift can be realized. In other words, after taking the difference between the value of the target pixel and the value of the adjacent pixel, a π / 2 phase shift function is realized by applying a filter with a frequency / amplitude characteristic of 1 / ω. May be.

  FIG. 40 shows the operation and specific example of the coefficient determiner (109) used in the second configuration example of the image resolution increasing unit 3101 in FIG. As shown in FIG. 35 (a), when the vector sum of the four components shown in FIG. 35 (b) is taken, the Re-axis component is set to 1, the Im-axis component is set to 0, and FIG. If the coefficients to be multiplied by each component are determined so that both the Re-axis and Im-axis components are 0 when the vector sum of the four components shown in (c) is taken, two frame images Can be used to realize an image signal processing apparatus that achieves a resolution twice as high as that in the one-dimensional direction. As shown in FIG. 1, the coefficient for the output of the delay unit (105) (the sum of the original and folded components of frame # 1 after the up-rate) is C0, and the output of the π / 2 phase shifter 3206 (after the up-rate) The coefficient for the sum of the π / 2 phase shift results of the original and folded components of frame # 1 is C1, and the coefficient for the output of delay device 3207 (the sum of the original and folded components of frame # 2 after the up-rate) C2 and the coefficient for the output of the Hilbert transformer 3206 (the sum of the π / 2 phase shift results of the original component and the aliasing component of the frame # 2 after the up-rate) as C3, satisfying the condition of FIG. By doing so, the simultaneous equations shown in FIG. 40 (b) can be obtained from the phase relationships of the components shown in FIG. 35 (b) and FIG. 35 (c). The results shown can be derived. The coefficient determiner 3209 may output the coefficients C0, C1, C2, and C3 obtained in this way. As an example, FIG. 40 (d) shows values of the coefficients C0, C1, C2, and C3 when the phase difference θ3202 is changed from 0 to 2π every π / 8. This corresponds to a case where the position of the signal of the original frame # 2 is estimated with an accuracy of 1/16 pixel and motion compensation is performed on the frame # 1.

  The up-raters 3203 and 3204 and the π / 2 phase shifters 3206 and 3207 require an infinite number of taps in order to obtain ideal characteristics. But there is no practical problem. At this time, a general window function (such as a Hanning window function or a Hamming window function) may be used. If the coefficient of each tap of the simplified Hilbert transformer is the value of the left and right points centered on C0, that is, C (-k) = -Ck (k is an integer), the phase can be shifted by a certain amount. it can.

  As described above, when the configuration of the image resolution increasing unit 3101 in FIG. 31 is the configuration described in FIGS. 32 to 40, it is possible to generate a high resolution image from a plurality of images.

  In particular, according to the second configuration of the image resolution increasing unit 3101 shown in FIG. 32, it is possible to generate one high-resolution image from two images.

  By repeating the high-resolution image generation processing in the image high-resolution unit 3101 described above, it is possible to convert a video composed of a plurality of images into a high-pixel count video composed of a plurality of high-resolution images.

  In the video display apparatus according to the eighth embodiment, after the above-described processing, the image resolution enhancement unit 3101 increases the resolution of the video signal to increase the number of pixels of the video signal, and then increases the number of pixels in the image processing unit 3102. Input the selected video.

  The image processing unit 3102 performs the processing described in the first to seventh embodiments on the video with the increased number of pixels, so that the number of pixels of the video signal acquired by the video display device 3100 by reception or the like is displayed. Even when the number of display pixels of the unit 108 is the same as or less than that, it is possible to display a high-definition image having a Nyquist frequency equal to or higher than the number of pixels of the display unit.

  According to the video display apparatus according to the eighth embodiment described above, even when a video signal having the same number of pixels as the display unit or a small number of pixels is input, the resolution enhancement process is performed and the video is displayed. High-definition video display can be performed by performing different types of low-pass filter processing in accordance with the amount of signal movement. In addition, the occurrence of aliasing distortion can be reduced.

It is explanatory drawing of an example of the video display apparatus which concerns on Example 1 of this invention. It is explanatory drawing of an example of the image reduction process which concerns on Example 1 of this invention. It is explanatory drawing of an example of the low pass filter process which concerns on Example 1 of this invention. It is explanatory drawing of an example of the tap filter coefficient of the low-pass filter process which concerns on Example 1 of this invention. It is explanatory drawing of an example of the tap filter coefficient of the low-pass filter process which concerns on Example 1 of this invention. It is explanatory drawing of an example of the pixel row | line | column seen. It is explanatory drawing of an example of the pixel row | line | column seen. It is explanatory drawing of an example of the image reduction process and low-pass filter process in the conventional video display apparatus. It is explanatory drawing of an example of the pixel row | line | column seen in the conventional video display apparatus. It is explanatory drawing of an example of the image reduction process and low-pass filter process in the video display apparatus which concerns on Example 1 of this invention. It is explanatory drawing of an example of the pixel row | line | column seen in the video display apparatus which concerns on Example 1 of this invention. It is explanatory drawing of an example of the pixel row | line | column seen. It is explanatory drawing of an example of the pixel row | line | column seen. It is explanatory drawing of an example of the relationship between the signal strength of a video signal, and a frequency. It is explanatory drawing of an example of the folding component in the signal strength of a video signal. It is explanatory drawing of an example of the low-pass filter characteristic in Example 1 of this invention. It is explanatory drawing of an example of the signal strength of the video signal in Example 1 of this invention. It is explanatory drawing of an example of the maximum frequency of the video signal in the conventional video display apparatus, or the cutoff frequency of a low-pass filter. It is explanatory drawing of an example of the maximum frequency of the video signal in the video display apparatus which concerns on Example 1 of this invention, or the cutoff frequency of a low-pass filter. It is explanatory drawing of an example of the maximum frequency of the video signal in a video display apparatus, or the cutoff frequency of a low-pass filter. It is explanatory drawing of an example of the display maximum frequency in a video display apparatus. It is explanatory drawing of an example of the pixel row | line | column seen. It is explanatory drawing of an example of the low-pass filter characteristic in Example 2 of this invention. It is explanatory drawing of an example of the low-pass filter characteristic in Example 3 of this invention. It is explanatory drawing of an example of the low-pass filter characteristic in Example 4 of this invention. It is explanatory drawing of an example of the pixel row | line | column seen. It is explanatory drawing of an example of the low-pass filter characteristic in Example 5 of this invention. It is explanatory drawing of an example of the image process part of the video display apparatus which concerns on Example 6 of this invention. It is explanatory drawing of an example of the image process part of the video display apparatus which concerns on Example 7 of this invention. It is explanatory drawing of an example of the tap filter coefficient of the low-pass filter process which concerns on Example 7 of this invention. It is explanatory drawing of an example of the video display apparatus which concerns on Example 8 of this invention. It is explanatory drawing of an example of the image high resolution part which concerns on Example 8 of this invention. It is explanatory drawing of the image high resolution process which concerns on Example 8 of this invention. It is explanatory drawing of the image high resolution process which concerns on Example 8 of this invention. It is explanatory drawing of the image high resolution process which concerns on Example 8 of this invention. It is explanatory drawing of the up-rate device which concerns on Example 8 of this invention. It is explanatory drawing of the up-rate device which concerns on Example 8 of this invention. It is explanatory drawing of the phase shifter which concerns on Example 8 of this invention. It is explanatory drawing of the phase shifter which concerns on Example 8 of this invention. It is explanatory drawing of the coefficient determiner which concerns on Example 8 of this invention. It is explanatory drawing of an example of the image high resolution process and image reduction process which concern on Example 8 of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Video display apparatus, 101 ... Antenna, 102 ... Reception part, 103 ... Image processing part, 104 ... Motion adaptive scaler, 105 ... Pixel position calculation part, 106 ... Motion search part, 107 ... Determination part, 108 ... Display part, DESCRIPTION OF SYMBOLS 109 ... Input part, 110 ... Network interface part, 111 ... Reading part, 112 ... Recording part, 113 ... Reproduction control part, 114 ... Switch, 2801 ... Image processing part, 2802 ... Horizontal motion adaptive scaler, 2803 ... Horizontal pixel Position calculation unit, 2804 ... determination unit, 2805 ... switch, 2806 ... vertical motion adaptive scaler, 2807 ... vertical pixel position calculation unit, 2808 ... determination unit, 2809 ... switch, 2901 ... image processing unit, 2902 ... motion adaptive scaler 2903 ... coefficient calculation unit, 3200 ... input unit, 3201 ... position estimation unit, 3203 ... up 3204 ... up-rate device, 3205 ... delay device, 3206 ... Hilbert transformer, 3207 ... delay device, 3208 ... Hilbert transformer, 3209 ... coefficient determiner, 3210 ... multiplier, 3211 ... multiplier, 3212 ... Multiplier, 3213 ... Multiplier, 3214 ... Adder, 3215 ... Motion compensation / up-rate unit, 3216 ... Phase shift unit, 3217 ... Folding component removal unit

Claims (20)

A receiver for receiving broadcast waves including a video signal;
An image processing unit that performs image processing on a video signal included in a broadcast wave received by the receiving unit;
A display unit for displaying the video after the image processing of the image processing unit,
The video display device, wherein the image processing unit performs a pixel number reduction process for reducing the number of pixels of the video signal, and a low-pass filter process that varies depending on a motion amount of a subject included in the video signal. The video display device according to claim 1,
The image processing unit uses the cut-off frequency in the low-pass filter processing as the video signal when the amount of movement of the subject included in the video signal corresponds to a movement amount other than an integer multiple of one pixel in the display unit. An image display device characterized by having a higher frequency than a case in which the amount of movement of an included subject corresponds to an integral multiple of one pixel in the display unit. The video display device according to claim 1,
The image processing unit is included in the video signal when the maximum frequency of frequency components included in the video signal is N times (N is an integer of 2 or more) a frequency corresponding to the number of pixels of the display unit. The cutoff frequency in the case where the amount of movement of the subject corresponds to the amount of movement obtained by adding 1 / N pixels to an integral multiple of one pixel in the display unit, and the amount of movement of the subject included in the video signal in the display unit An image display device, wherein low-pass filter processing is performed to make the frequency higher than a cutoff frequency corresponding to an integer multiple of one pixel. The video display device according to claim 1,
The image processing unit has a cut-off frequency in the low-pass filter processing when the amount of movement of the subject included in the video signal corresponds to a movement amount obtained by adding 0.5 pixels to an integer multiple of one pixel in the display unit. Is a high frequency compared to the case where the amount of motion of the subject included in the video signal corresponds to an integral multiple of one pixel in the display unit. A video display device according to claim 2,
The image processing unit corresponds to one pixel in the display unit where the cut-off frequency is a minimum value when the amount of movement of the subject included in the video signal corresponds to an integral multiple of one pixel in the display unit. A video display device that performs low-pass filter processing of a cycle. The video display device according to claim 1,
The image processing unit has a minimum cut-off frequency when the amount of movement of the subject included in the video signal corresponds to an integer multiple of one pixel in the display unit, and the amount of movement of the subject included in the video signal is Performing a low-pass filter process with a period corresponding to one pixel in the display unit, in which the cut-off frequency becomes a maximum value when it corresponds to a motion amount obtained by adding 0.5 pixels to an integral multiple of one pixel in the display unit A video display device characterized by the above. A video display device according to claim 2,
The image processing unit includes a motion search unit, a determination unit, a plurality of low-pass filter units having different cutoff wavelengths of the low-pass filter processing, and a changeover switch.
The motion search unit calculates a motion amount of a subject included in the video signal from the video signal;
The determination unit determines the motion vector calculated by the motion search unit, determines a cutoff wavelength of the low-pass filter processing,
The changeover switch selects a low-pass filter unit corresponding to the cutoff wavelength determined by the determination unit from the plurality of low-pass filter units,
The video display device, wherein the selected low-pass filter unit performs low-pass filter processing on a video signal included in a broadcast wave received by the receiving unit. A video display device according to claim 2,
The image processing unit includes a motion search unit, a coefficient generation unit, and a low-pass filter unit,
The motion search unit calculates a motion amount of a subject included in the video signal from the video signal;
The coefficient generation unit generates a tap filter coefficient corresponding to the motion vector calculated by the motion search unit,
The video display device, wherein the low-pass filter unit performs low-pass filter processing on a video signal included in a broadcast wave received by the receiving unit, using a tap filter generated by the coefficient generating unit. An input unit for inputting an input video;
An image processing unit that performs image processing on the input video input to the input unit;
A display unit for displaying the video processed by the image processing unit,
The image processing unit performs image reduction processing for reducing the image size of the input video and high-frequency component removal processing for removing a high-frequency component of the video signal according to the amount of movement of the subject included in the video signal. A characteristic video display device. The video display device according to claim 9,
When the amount of motion of the subject included in the video signal is an integer multiple of pixels, the amount of motion of the subject included in the video signal is a motion amount other than an integer multiple of one pixel in the display unit. An image display device that performs high-frequency component removal processing that removes a wider range of high-frequency components than a corresponding case. The video display device according to claim 9,
The image processing unit includes two consecutive images included in the video signal when the amount of movement of the subject between the two consecutive images included in the video signal corresponds to an integral multiple of one pixel in the display unit. A high-frequency component removal process for removing a wide range of high-frequency components is performed compared to a case where the amount of motion of the subject between the images corresponds to a motion amount obtained by adding 0.5 pixels to an integral multiple of one pixel in the display unit. A video display device. The video display device according to claim 9,
The image processing unit is included in the video signal when the maximum frequency of frequency components included in the video signal is N times (N is an integer of 2 or more) a frequency corresponding to the number of pixels of the display unit. When the subject motion amount corresponds to a motion amount obtained by adding 1 / N pixels to an integer multiple of one pixel in the display unit, the subject motion amount included in the video signal is an integer of one pixel in the display unit. A video display device that performs high-frequency component removal processing that removes a wider range of high-frequency components than in the case corresponding to double. The video display device according to claim 9,
The image processing unit performs high-frequency component removal processing to remove a high-frequency component of the video signal when the amount of movement of the subject included in the video signal corresponds to an integer multiple of one pixel in the display unit, and the video signal When the amount of movement of the subject included in the image corresponds to a movement amount other than an integral multiple of one pixel in the display unit, the high-frequency component removal processing of the video signal is not performed, and only the image reduction processing is performed. Display device. An input unit for inputting a video signal;
An image processing unit that performs image processing on the video signal input to the input unit;
A display unit for displaying a video signal processed by the image processing unit,
The video display device, wherein the display unit displays a display video having a different maximum frequency in accordance with a movement amount of a subject included in a video signal input to the input unit. The video display device according to claim 14,
When the amount of motion of the subject included in the video signal corresponds to a amount of motion other than an integral multiple of one pixel in the display unit, the display unit displays the amount of motion of the subject included in the video signal in the display unit. An image display device that displays a display image having a maximum frequency higher than that corresponding to an integer multiple of one pixel. The video display device according to claim 14,
The display unit moves the subject included in the video signal when the amount of motion of the subject included in the video signal corresponds to a motion amount obtained by adding 0.5 pixels to an integral multiple of one pixel in the display unit. An image display device, wherein a display image having a maximum frequency higher than that in a case where the amount corresponds to an integral multiple of one pixel in the display unit is displayed. The video display device according to claim 14,
In the case where the amount of movement of the subject included in the video signal corresponds to the amount of movement obtained by adding 0.5 pixels to M times one pixel (M is an integer of 2 or more) in the display unit, An image display apparatus, wherein a display image having a higher maximum frequency is displayed as compared with a case where an amount of movement of a subject included in an image signal corresponds to an amount of movement of M times one pixel in the display unit. The video display device according to claim 14,
In the case where the amount of movement of the subject included in the video signal corresponds to the amount of movement obtained by adding 0.5 pixels to M times one pixel (M is an integer of 2 or more) in the display unit, Compared to the case where the amount of movement of the subject included in the video signal corresponds to M times one pixel in the display unit and the case where the amount of movement of the subject included in the video signal corresponds to M + 1 times one pixel in the display unit. An image display device for displaying a display image having a high maximum frequency. The video display device according to claim 14,
When the display unit inputs a video signal in which the amount of movement of the subject increases to the input unit, the amount of movement of the subject included in the video signal corresponds to an integral multiple of one pixel in the display unit. An image display apparatus for displaying the display image in which the maximum frequency of the display image is a minimum value. The video display device according to claim 14,
When the video signal that increases the amount of movement of the subject is input to the input unit, the display unit is maximum when the amount of movement of the subject included in the video signal corresponds to an integral multiple of one pixel in the display unit. When a display image having a minimum frequency is displayed and the amount of motion of the subject included in the recorded video signal corresponds to the amount of motion obtained by adding 0.5 pixels to an integral multiple of one pixel in the display unit, An image display device characterized by displaying a display image.

Images