JP5032350B2 - Image processing device - Google Patents

Description

  The present invention prevents an image lag and prevents flickering and flickering while displaying an image corresponding to an image frame on a display panel, and can obtain an optimal moving image response. The present invention relates to a processing apparatus.

  In a conventional liquid crystal display device, various devices have been considered in order to prevent an afterimage feeling from appearing in a displayed image. For example, a method of inserting an interpolation frame of a black screen between consecutive image frames, a method of adjusting the amount of backlight that irradiates a liquid crystal panel, and the like have been proposed.

  Specifically, in Patent Document 1 described below, video is inserted by inserting an interpolated black frame into a series of successive image frames so that the interpolated frames and the image frames are displayed alternately. Discloses a technique for preventing a feeling of afterimage. Further, in Patent Document 2 below, black is inserted only in odd-numbered lines or only even-numbered lines of the front image frame in consecutive image frames before and after, and only even-numbered lines are included in the rear image frame. There is disclosed a technique for preventing an afterimage feeling from being generated in an image by inserting black in only odd lines.

Further, Patent Document 3 below discloses a technique for preventing afterimages from appearing in an image by blinking a plurality of backlights at high speed. Furthermore, Patent Document 4 below discloses a technique for preventing an afterimage from appearing in an image by attaching a belt having a portion that transmits light and a portion that blocks light around a backlight. Further, in Patent Document 5 below, it is detected whether a moving image part (a moving part) is included in an image frame for each series of image frames, and there is no moving image part. Is detected, the backlight of the liquid crystal panel is adjusted to suppress the decrease in luminance.
JP 2001-42282 A JP 2002-132220 A JP 2000-321551 A JP 2001-159871 A JP 2006-323300 A

  In the technology disclosed in Patent Document 1, an interpolation frame with a black surface is inserted, but since the black interpolation surface has a large degree of blocking the light emitted from the backlight, the luminance of the displayed image is reduced, There is a problem that the display screen looks dark. In Japanese Patent Laid-Open No. 2004-228867, since the black frame interpolation frame is uniformly inserted without detecting whether or not the moving image portion is included in each image frame to be inserted, there are many still image portions. Even for an image in which a feeling of afterimage does not easily occur, the luminance is reduced by inserting a black interpolation frame. In addition, when a black interpolation frame is inserted, the refresh rate, which is the switching frequency of image frames other than the interpolation frame, decreases, and blinking occurs when switching image frames, resulting in flickering in the displayed video. There is a problem that it is easy to do.

  Furthermore, the technique disclosed in Patent Document 2 also inserts a black signal into either the even or odd row of the image frame, and thus the degree of blocking the backlight is still large, resulting in a decrease in luminance and the screen. Appears dark and blinks when the image frame is switched, so that there is a problem that flickering is likely to occur in the displayed video as in Patent Document 1.

  In addition, the conventional technique has a problem in that it cannot obtain an optimal video response according to the type of video content. In other words, the image to be displayed includes many image parts with large movements in the image frame such as sports or action movies, and many image parts such as landscapes that do not move much in the image frame. There are things to include. When displaying a video, if display processing is performed according to an image frame that includes many image portions that do not move much, if the content of the video changes and the portions with large motion increase, optimal video response cannot be obtained. . Therefore, for example, in the technique disclosed in Patent Document 5, the image portion that does not move much occupies the majority, and the moving image responsiveness is improved with respect to the video that is composed of the image frame that includes the image portion that moves greatly only in a part. It is not possible.

  The present invention has been made in view of such a problem, and detects whether or not a moving image part is included in a series of image frames in units of pixels and responds to the moving image part. By generating an interpolated frame that assigns black or gray to pixels in a pinpoint manner, while preventing the occurrence of afterimage, it prevents brightness reduction and flickering, and improves video response to each video content An object of the present invention is to provide an image processing apparatus which can be used.

  In order to solve the above problem, an image processing apparatus according to the present invention is an image processing apparatus for generating an interpolation frame to be inserted between successive image frames in a series of image frames corresponding to a video. A comparison unit that performs comparison of image signals included in pixels that form a pixel at the same position in successive image frames, and a moving image portion in the image frame based on a comparison result of the comparison unit Detecting means for detecting, and interpolation frame generating means for generating an interpolation frame in which pixels corresponding to the moving image portion detected by the detecting means are made black or gray.

  In the present invention, an interpolated frame in which the pixels corresponding to the moving image portion (the moving image portion) are black or gray is generated based on the comparison result of the pixel units of consecutive image frames. Therefore, the degree of blocking the backlight is smaller than that of the black interpolation frame or the black interpolation frame. Therefore, it is possible to prevent an afterimage feeling from occurring in an image portion having a motion in the video, and to suppress a decrease in luminance and flickering, and a good moving image response can be obtained. Note that whether the pixel of the interpolation frame corresponding to the moving image part is black or gray may be distinguished depending on the degree of movement, for example, whether black or gray is assigned to the target pixel. A reference value is set, the comparison result exceeds the reference value, and black is assigned to a pixel that is judged to have a large movement. The comparison result is below the reference value and there is movement, but the degree of movement is not so large. Alternatively, gray may be assigned to the pixel determined to be.

  In the image processing apparatus according to the present invention, the interpolated frame generating means is adapted to perform comparison before and after the comparison by the comparing means to pixels corresponding to other parts in the image frame that the detecting means has not detected as moving image parts. The image signal which the pixel corresponding to the said other part in any one image frame of this image frame has is allocated.

  In the present invention, the pixel corresponding to the other part corresponding to one of the previous and subsequent image frames used for comparison is included in the pixel of the interpolation frame corresponding to the other part that is not detected as the moving image part. Therefore, an interpolation frame that matches the preceding and succeeding image frames can be generated smoothly. In consideration of the processing flow related to a general image frame, the pixel information of the pixels in the front image frame is assigned to the interpolation frame as compared with the case of assigning the pixel information of the pixels of the rear image frame. Therefore, it is in line with the flow of image frame processing, which is preferable because the waiting time of processing related to image information allocation can be reduced.

  In the image processing apparatus according to the present invention, when the value relating to the comparison result of the comparison means is greater than a threshold, the detection means detects a portion corresponding to the pixel relating to the comparison result as a moving image portion, Image frame acquisition means for acquiring an image frame corresponding to a video of a broadcast program; genre information acquisition means for acquiring genre information indicating a genre related to a video of a broadcast program related to an image frame acquired by the image frame acquisition means; A correction value table storing threshold correction values in association with each of a plurality of types of genre information, a storage unit storing a reference threshold, and a threshold correction value corresponding to the genre information acquired by the genre information acquisition unit are corrected. Based on the specifying means specified from the table, the threshold correction value specified by the specifying means and the reference threshold value stored by the storage means, Characterized in that it comprises a threshold value specifying means for specifying a threshold.

  In the present invention, when acquiring an image frame corresponding to a video of a broadcast program, if the genre information related to the video of the broadcast program to be acquired can be acquired, threshold values used for detecting a moving image portion are stored in various genres. Since the information is corrected by the threshold correction value according to the acquired genre information, it is possible to detect a moving image portion according to the genre level of the acquired video content.

  Therefore, for example, when a broadcast program such as a television broadcast is selected by a normal channel operation, if the genre information is superimposed on the video signal related to the broadcast program, the genre of the video content is obtained by the process as described above. The corresponding moving image portion can be detected. Therefore, it is possible to prevent afterimages that match the genre of any genre, such as when displaying sports images that contain many parts with large movements, or when displaying landscape pictures that contain many parts with small movements. The process can be executed and the response of the moving image can be improved. In addition, when acquiring the image frame according to the broadcast program video, when acquiring through a broadcast radio wave, when acquiring through a cable for cable television, acquire the image frame of the video distributed through a network such as the Internet. Cases are assumed (hereinafter the same).

  In the image processing apparatus according to the present invention, when the value relating to the comparison result of the comparison means is greater than a threshold, the detection means detects a portion corresponding to the pixel relating to the comparison result as a moving image portion, An electronic program guide including a broadcast program title and a genre information indicating a broadcast program genre associated with each other is generated by the program guide generating means for generating a selection of the title of the broadcast program, and the program guide generating means When receiving selection of any of the broadcast program titles included in the electronic program guide, image frame acquisition means for acquiring an image frame corresponding to the video of the broadcast program related to the selected title, and the selected title The genre information corresponding to the genre information specifying means for specifying from the electronic program guide and the threshold value correction in association with each of a plurality of types of genre information A correction value table storing values, a storage means storing a reference threshold, a specifying means for specifying a threshold correction value corresponding to the genre information specified by the genre information specifying means from the correction table, and the specifying means; And a threshold value specifying means for specifying the threshold value based on the specified threshold correction value and the reference threshold value stored in the storage means.

  In the present invention, when acquiring an image frame corresponding to a video of a broadcast program through a selection operation of a title included in an electronic program guide, genre information corresponding to the selected title is specified, and a moving image portion is detected. The threshold to be used is corrected by a threshold correction value corresponding to the specified genre information from various genre information stored in advance. As a result, it is possible to detect a moving image portion according to the genre level of the video content based on the use of the electronic program guide. Along with this, it is possible to generate an interpolation frame that can be applied to the afterimage feeling prevention process corresponding to each of various genres having different degrees of motion and to adjust the responsiveness of the moving image according to the genre.

  In the image processing apparatus according to the present invention, when the value relating to the comparison result of the comparison means is greater than a threshold, the detection means detects a portion corresponding to the pixel relating to the comparison result as a moving image portion, An external video output device connection means that can be connected to an external video output device and can accept device type information indicating the device type sent from the connected video output device, and the device type information A genre table that stores genre information related to a video in association with each model type; a correction value table that stores a threshold correction value in association with each of a plurality of types of genre information; a storage unit that stores a reference threshold; An external output device is connected to the external video output device connection means, and an image frame and device type information corresponding to the video sent from the external output device are output to the external video output device. When received by the device connection means, the genre information corresponding to the received device type information is specified from the genre table, and the threshold correction value corresponding to the genre information specified by the genre specification means is the correction value. Comparing according to the image frame received by the external video output device connecting means based on the correction value specifying means specified from the table, the threshold correction value specified by the correction value specifying means and the reference threshold value stored by the storage means And a threshold value specifying means for specifying the threshold value related to the result.

  In the present invention, when an image frame corresponding to a video is acquired from an external video output device, the specification is such that the external video output device also outputs device type information indicating the type of its own device. Since the threshold used for detecting the moving image portion is corrected according to the type of the external video output device, the detection of the moving image portion according to the type of the external video output device that outputs an image frame corresponding to the video can be performed. It becomes possible.

  That is, various devices such as a game device, a DVD player, and a digital video camera are assumed as devices that output video. For example, video (game video) output from a game device is limited to a portion that moves in a game. In general, it is considered that the moving image part becomes partial, and the video output from the DVD player is often movie content. The genre tendency is seen. Therefore, the moving image portion detection process is performed based on a threshold value suitable for an external video output device that can be specified from a genre table in which video genres are associated with each device type and a correction value table in which threshold correction values are stored for each genre information. For example, it is possible to display a video that secures a moving image response suitable for the video output device. In order for an external output device to output device type information and to be able to receive output device type information, it is necessary to comply with a connection standard that defines the output of such device type information. Such connection standards include, for example, HDMI (High-Definition Multimedia Interface), IEEE 1394, and the like.

The image processing apparatus according to the present invention is characterized in that the comparison means compares either a luminance signal corresponding to an image signal or a luminance signal and a color difference signal corresponding to the image signal.
In the present invention, the luminance signal or the luminance signal and the color difference signal are compared with the preceding and succeeding image frames as the image signal that the image frame has for each pixel, so that the moving image portion can be detected stably. become. In addition, as a specific process of comparison, it is detected that the difference between the luminance signal and the color difference signal is calculated between the pixels at the same position in the previous and subsequent image frames, and the calculated difference is handled as the comparison result. It is preferable for facilitating the treatment. In addition, when the target video is a color video, the moving image portion can be detected with higher accuracy by comparing both the luminance signal and the color difference signal.

The image processing apparatus according to the present invention is characterized in that the comparison means compares the motion vector corresponding to the image signal and the signal amplitude related to the image signal.
In the present invention, since the comparison is made also with respect to the motion vector according to the image signal and the signal amplitude related to the image signal, it becomes possible to distinguish the moving image portion from the noise included in the image frame. The moving image portion can be detected with high accuracy. That is, by comparing both the motion vector and the signal amplitude, it is possible to determine whether the pixel is a moving image portion or a simple noise. For example, even if a moving image portion is determined based on the luminance signal described above, if it can be determined that the moving image portion is not a moving image portion according to the motion vector, it can be detected that the portion is not a moving image portion but merely a noise portion. In addition, according to the motion vector, it can be determined as a non-moving image part. It becomes possible to detect that it is a part, and the detection accuracy can be improved.

  The image processing apparatus according to the present invention inserts an interpolation frame generated by the interpolation frame generation means for each image frame in a series of image frames related to a video, and each image frame at twice the reference frame rate. And frame output means for outputting an interpolated frame.

  In the present invention, the generated interpolated frame is inserted for each image frame, and the frame is output at twice the reference frame rate, so that afterimage is prevented and the display content is not dark and the video response It is possible to display images with excellent characteristics. The reference frame rate means a frame rate when outputting a series of image frames when no interpolation frame is inserted (hereinafter the same).

  The image processing apparatus according to the present invention inserts the interpolation frame generated by the interpolation frame generation means for every two image frames in a series of image frames related to the video, and each of them is 1.5 times the reference frame rate. Frame output means for outputting an image frame and an interpolation frame is provided.

  In the present invention, since the generated interpolation frame is inserted every two image frames and the frame is output at 1.5 times the reference frame rate, the burden of the interpolation frame generation process is reduced. Even in such a case, it is possible to display an image having a display content that is not dark and excellent in responsiveness to moving images while preventing a feeling of afterimage.

In the present invention, an interpolation frame in which pixels corresponding to a moving image portion are black or gray is generated based on a comparison result of pixel units of consecutive image frames before and after, so that the interpolation frame is a backlight light. As compared with the prior art, it is possible to reduce the degree of shading, prevent the occurrence of afterimage, and suppress the decrease in luminance and flickering.
In the present invention, the pixel of the interpolation frame corresponding to the portion (still image portion) that is not detected as a moving image portion has a pixel corresponding to any of the previous and subsequent image frames used for comparison. Since the image signal is assigned, an interpolation frame matching the preceding and following image frames can be generated efficiently, and the video display can be performed smoothly.

  In the present invention, since the moving image portion is detected based on the threshold value corrected with the threshold value correction value corresponding to the genre information related to the video of the broadcast program to be acquired, the moving image is recorded at a level corresponding to the genre of the acquired video content. The image portion can be detected, and accordingly, it is possible to contribute to a video display process in which a moving image responsiveness suitable for the genre of the video content is ensured.

  In the present invention, when acquiring an image frame corresponding to a video of a broadcast program through a selection operation of a title included in the electronic program guide, genre information corresponding to the selected title is specified from the electronic program guide. By using the information contained in the program guide, it is possible to detect moving image parts at a level corresponding to the genre of video content, and accordingly, contribute to video display processing that ensures video response that matches the genre of video content. .

  In the present invention, when an image frame corresponding to a video is acquired from an external video output device, if the device type information output from the external video output device is also acquired, a threshold value used for detecting a moving image portion is set. Because it corrects according to the type of external video output device, it can detect the moving image part according to the type of external video output device that outputs the image frame according to the video, and accordingly the type of video output device It can contribute to the display processing of the video that ensures the matching video response.

In the present invention, since the luminance signal or the luminance signal and the color difference signal are compared with the previous and subsequent image frames as the image signal that the image frame has for each pixel, the moving image portion can be stably detected.
In the present invention, the motion vector corresponding to the image signal and the signal amplitude related to the image signal are also compared, so that the moving image portion and the noise included in the image frame can be distinguished, and the accuracy is further improved. The moving image portion can be detected well.

In the present invention, the generated interpolation frame is inserted for each image frame, and the frame is output at twice the reference frame rate. Therefore, the brightness of the display content can be ensured while preventing afterimages. At the same time, it can display images with excellent video response.
Further, in the present invention, the generated interpolation frame is inserted every two image frames, and the frame is output at 1.5 times the reference frame rate, so that the load of the interpolation frame generation process can be reduced. Even in such a case, it is possible to display an image with excellent response to moving images while maintaining the brightness of the display content while preventing afterimages.

  FIG. 1 is a block diagram showing a main configuration of a television apparatus 1 according to an embodiment of the present invention. The television apparatus 1 of the present embodiment is configured to include the image processing apparatus according to the present invention, and includes a unit that performs various processes according to the present invention. The television apparatus 1 performs a process of acquiring a series of image frames according to the video from the outside and outputting each image frame to the display panel 9 (liquid crystal panel). In particular, the television apparatus 1 according to the present embodiment detects a portion (moving image portion) having a motion in each image frame based on an image signal (luminance signal and color difference signal) that each image frame has in pixel units. An interpolation frame in which the detected portion is blackened in a pinpoint manner is generated, and the generated interpolation frame is mixed into a series of image frames and output is performed.

  The television apparatus 1 has an electronic program information acquisition unit 2 and a digital input unit 3 for acquiring image frames, and a threshold specification unit 4, a frame memory 5, a comparison detection unit 6, and a processing unit as a processing system for image processing. 7 has a mixing section 8. Furthermore, the television device 1 includes a display panel 9 on which video is displayed and a control unit 10 that performs overall control of the device, an operation unit 20 that receives an operation from a user, and a remote operation from a remote control device 22. A light receiving unit 21 that receives infrared light including a signal is provided. Hereinafter, each part of the television apparatus 1 will be described in detail.

  The electronic program information acquisition unit 2 includes a tuner unit 2b. The tuner unit 2b is connected to a BS / CS system receiving antenna 2a, and receives a broadcast signal (video content of a broadcast program, information indicating the title of the broadcast program, and the genre of the broadcast program) supplied from an external broadcast facility or the like. The signal including the genre information shown) is received. In addition to the tuner unit 2b, the electronic program information acquisition unit 2 also includes a processing unit for digital demodulation of the received broadcast signal, restoration and correction for errors in the digitally demodulated signal, and the like. A series of image frames showing the video of the broadcast program is acquired. The electronic program information acquisition unit 2 sends information indicating the title acquired by reception, genre information, and the like in association with each other to the control unit 10, and also sends the genre information to the threshold value specifying unit 4. It is transmitted to the frame memory 5.

  The digital input unit 3 (corresponding to the video device connection means) is a video output device compatible with external HDMI capable of outputting a series of image frames corresponding to digital video and outputting device type information indicating device type information. This is an HDMI compatible connection interface that connects to a game device, digital camera, recording device (eg, DVD player), etc. via a connection cable. The digital input unit 3 can acquire an image frame output from an external video output device and accept device type information. The digital input unit 3 transmits the received device type information to the threshold specifying unit 4 and acquires the acquired image frame. Is sent to the frame memory 5. Note that IEEE 1394 can also be applied as a connection standard between the digital input unit 3 and an external video output device.

  The threshold value specifying unit 4 specifies a threshold value used when the comparison detection unit 6 detects a moving image part, and includes two types of luminance signal and color difference signal of an image signal included in a pixel unit of an image frame related to video. A total of two threshold values (first threshold value and second threshold value) are specified for these signals. The threshold specifying unit 4 also performs processing for specifying the type (genre) of video content corresponding to the type of external video output device connected to the digital input unit 3.

  FIG. 3A shows an internal block diagram of the threshold value specifying unit 4. The threshold value specifying unit 4 includes a first specifying unit 4a for specifying a first threshold value for processing on a luminance signal, and a second for processing on a color difference signal. A second specifying unit 4b for specifying a threshold value and a third specifying unit 4c for specifying the type genre of video content corresponding to the type of external video output device are provided. Further, the threshold value specifying unit 4 also includes a nonvolatile internal memory 4d (corresponding to a storage unit). The internal memory 4d stores in advance default values (corresponding to reference threshold values) “D1” and “D2” relating to each threshold as information for specifying the first threshold and the second threshold, and FIG. The first table 30 to the third table 32 shown in FIG. 2C are also stored in advance.

  A first table 30 shown in FIG. 2A is a correction value table for luminance signal processing, and is for each genre information related to video (image frame) acquired by the electronic program information acquisition unit 2 or the digital input unit 3. Threshold correction values are stored in association with each other. The threshold value that matches the video genre can be specified by the threshold correction value stored in the first table 30 (the same applies to the second table 31). A second table 31 shown in FIG. 2B is a correction value table for color difference signal processing, and genre information related to video (image frames) acquired by the electronic program information acquisition unit 2 or the digital input unit 3. A threshold correction value is stored in association with each other. Further, the third table 32 shown in FIG. 2C is a genre table storing video genres corresponding to each device type information indicating the types of external video output devices, and the third table 32 of the present embodiment. The video genre having the highest tendency to be displayed on each video output device is associated with the device type information.

  When genre information is transmitted to the threshold specifying unit 4 or when genre information is specified by a third specifying unit 4c described later, the threshold specifying unit 4 passes the genre information to the first specifying unit 4a. Then, processing for specifying the first threshold value for the luminance signal is performed. Specifically, when the genre information is passed to the first specifying unit 4a, the first specifying unit 4a specifies the threshold correction value corresponding to the passed genre information based on the first table 30 in FIG. Then, a process of adding the specified threshold correction value to the default value for the first threshold is performed, and the addition result is specified as the first threshold. For example, when the first specifying unit 4a receives information indicating “movie” as genre information, the first specifying unit 4a reads the threshold correction value corresponding to “movie” from the first table 30 in FIG. “A” is specified, and “a” is added to the default value “D1” for the first threshold. If the value obtained by this addition processing is “T1”, this “T1” becomes the first threshold value, and the threshold value specifying unit 4 compares the first threshold value T1 specified by the first specifying unit 4a with the comparison detection unit 6. Transmit to.

  The threshold value specifying unit 4 performs the process of specifying the second threshold value for the color difference signal in the same manner as described above in the second specifying unit 4b. That is, the threshold value specifying unit 4 specifies the threshold correction value corresponding to the passed genre information on the basis of the second table 31 in FIG. 2B by the second specifying unit 4a, and sets the specified threshold correction value. A process of adding to the default value for the second threshold is performed, and the addition result is specified as the second threshold. The threshold value specifying unit 4 also transmits the second threshold value (for example, “T2”) specified by the second specifying unit 4 b to the comparison detecting unit 6. In the case where the genre information is transmitted to the threshold value specifying unit 4, the broadcast station channel is selected by the user's manual operation, and the genre information is transmitted from the electronic program information acquiring unit 2 of FIG. There are two cases: a broadcast program is selected based on an electronic program guide generated by the control unit 10 described later, and genre information is transmitted from the control unit 10.

  Further, when the threshold value specifying unit 4 acquires device type information for identifying information on an external video output device from the digital input unit 3, the third specifying unit 4c displays genre information corresponding to the acquired device type information in FIG. It specifies based on the 3rd table 32 of (c). For example, when the threshold specifying unit 4 acquires device type information whose external video output device is “DVD player” from the digital input unit 3, the third specifying unit 4 c is based on the third table 32 of FIG. Then, “movie” is specified as the genre information “corresponding to the DVD player”, and the specified genre information is transmitted to the first specifying unit 4a.

  The frame memory 5 shown in FIG. 1 is a memory for sequentially storing a series of image frames transmitted from the electronic program information acquisition unit 2 or the digital input unit 3 as shown in FIG. In FIG. 4A, the frame memory 5 sequentially starts from the first image frame F (1) as a series of image frames acquired and stored from the electronic program information acquisition unit 2 or the digital input unit 3 ( N + 1) (N is a natural number) image frames F (N + 1) are included, and F (1), F (2)... Correspond to frame numbers.

  The comparison detection unit 6 compares the image signals of the pixels forming the image frame between the pixels at the same position with respect to the successive image frames in the series of image frames stored in the frame memory 5, A moving image portion in an image frame is detected based on the comparison result.

  As shown in FIG. 3B, the comparison detection unit 6 includes a first calculation unit 6a, a second calculation unit 6b, a first detection unit 6c, and a second detection unit 6d. The first calculation unit 6a calculates the difference value between the luminance signals of the preceding and succeeding image frames as a comparison result in order to compare the luminance signals as the image signals of the pixels at the same position in the successive image frames. . Further, the second calculation unit 6b calculates the difference value between the color difference signals of the preceding and succeeding image frames as a comparison result in order to compare the color difference signals as the image signals of the pixels at the same position in the consecutive image frames.

  The first calculation unit 6a and the second calculation unit 6b sequentially perform the above-described processing on all the pixels forming the image frame in the order of frame numbers with respect to a series of image frames stored in the frame memory 5. For example, in the case shown in FIG. 4 (a), when processing is performed using the image frame F (1) as the front image frame and the image frame F (2) as the rear image frame, The image frame F (2) is processed as the front image frame, the image frame F (3) is processed as the rear image frame, and in the next processing, the image frame F (3) is processed as the front image frame and image. Processing is performed using the frame F (4) as the rear image frame.

  Further, the first detection unit 6c compares the difference value of the luminance signal for each pixel in the image frame calculated by the first calculation unit 6a with the first threshold value for the luminance signal specified by the threshold value specifying unit 4. Thus, a process of detecting a pixel having a luminance signal difference value larger than the first threshold as constituting a moving image portion in the image frame is performed. The second detection unit 6dc compares the difference value of the color difference signal for each pixel in the image frame calculated by the second calculation unit 6b with the second threshold value for the color difference signal specified by the threshold value specifying unit 4. Thus, processing is performed to detect pixels having a difference value of the color difference signal larger than the second threshold as constituting a moving image portion in the image frame. In addition, the comparison detection unit 6 transmits the pixel positions detected by the first detection unit 6c and the second detection unit 6d to the processing unit 7 together with the frame number of the image frame used for comparison detection. Note that a portion corresponding to a pixel that is not detected by each of the detection units 6c and 6d can be considered as a portion with a small motion (a non-moving image portion or a still image portion) in the image frame.

  In addition, depending on the calculated difference value, the same pixel in the image frame may be different from the case where the first detection unit 6c and the second detection unit 6d detect the same pixel as a pixel constituting the moving image part. In some cases, the first detection unit 6c and the second detection unit 6d detect a pixel as a pixel constituting a moving image portion. In the present embodiment, a moving image is generated using two types of signals (luminance signal and color difference signal). By detecting the image portion, it is possible to detect the moving image portion with multifaceted and high accuracy.

  As shown in FIG. 5A, the processing unit 7 (corresponding to the interpolation frame generation means) includes a first allocation unit 7a and a second allocation unit 7b, and uses the frame memory 5 as a work area. Thus, processing for generating an interpolation frame is performed. When the image frame starts to be stored in the frame memory 5, the processing unit 7 generates an interpolation frame in a plain state having the same number of pixels as the image frame to be stored. The plain interpolation frame is a state in which no image signal is assigned to each pixel forming the interpolation frame. The first assigning unit 7a performs a process of assigning black to the pixels transmitted from the comparison detecting unit 6 for the interpolation frame. Further, the second assigning unit 7b assigns the image information of the pixel at the same position in the front image frame related to the comparison detection to the pixel (corresponding to the pixel corresponding to the other part) that has not been transmitted from the comparison detection unit 6. Processing is in progress.

  Specifically, when the detected pixel position is sent together with the frame number from the comparison detection unit 6, the processing unit 7 generates an interpolation frame to be inserted between the received frame numbers. For example, when “F (1)” and “F (2)” are sent as the frame numbers, as shown in FIG. 6, the processing unit 7 causes the image frame F (1) and the image frame F (2). ) To generate an interpolation frame FH1 to be inserted. In this case, as the pixel positions detected by the comparison detection unit 6, the pixel position of (X, Y) = (160, 120) and the pixel position of (X, Y) = (480, 360) are sent to the processing unit 7. When sent, the processing unit 7 performs processing for allocating black color to (X, Y) = (160, 120), (480, 360) of the interpolation frame FH1 in the first allocation unit 7a.

  Further, a process of copying and assigning the image signal of the pixel of the front image frame F (1) to the pixel of the interpolation frame FH1 that has not been transmitted from the comparison detection unit 6 (corresponding to a pixel corresponding to another part). This is performed by the second allocation unit 7b. For example, as shown in FIG. 6, if the pixel position of (X, Y) = (80, 60), (320, 240) is not transmitted from the comparison detection unit 6 to the processing unit 7, the processing unit 7 , (X, Y) = (80, 60), (320, 240) of the interpolation frame FH1 to (X, Y) = (80, 60), (320, 240) of the front image frame F (1). The second assigning unit 7b performs a process of copying and assigning an image signal (indicated by x in the figure) of the pixel 240).

  The processing unit 7 sequentially performs the above-described processing in conjunction with the pixel position and frame number sent from the comparison detection unit 6. By such processing by the processing unit 7, the interpolation frame FH1 assigned in a black pinpoint manner in units of pixels as shown in FIG. 4B is efficiently used by using the front image frame F (1). Generated. When a certain number of interpolation frames are generated in the frame memory 5, a predetermined number of image frames and interpolation frames inserted into them are sequentially sent to the mixing unit 8 under the control of the control unit 10.

  In FIG. 6, the pixels of (X, Y) = (160, 120), (480, 360) in the image frame are represented by (X, Y) of the front image frame F (1) that is successively moved back and forth. ) = (160, 120), (480, 360) The luminance and color difference signals of the pixels, and (X, Y) = (160, 120), (480, 360) of the rear image frame F (2) ) Is detected as a pixel constituting the moving image portion based on the luminance signal and the color difference signal of the pixel. In addition, (X, Y) = (80, 60), (320, 240) pixels in the image frame are (X, Y) = (80, 60), ( 320, 240) luminance signal and color difference signal, and the rear image frame F (2) (X, Y) = (80, 60), (320, 240) pixel luminance signal and color difference Based on the signal, it is detected as a pixel constituting the still image portion.

As shown in FIG. 5B, the mixing unit 8 includes a mixing processing unit 8a and an OSD (On
Screen display) superimposing unit 8b. The mixing processing unit 8a arranges the order of the image frames and the interpolation frames sent from the frame memory 5 and sends them to the display panel 9 at an appropriate frame rate. In this embodiment, the mixing processing unit 8a in FIG. As shown in FIG. 4, the generated interpolation frame FH1 is inserted between the front image frame F (1) and the rear image frame F (2) that have been subjected to the comparison detection for generating the interpolation frame FH1. To mix.

  As shown in FIG. 7A, the mixing processing unit 8a converts the interpolated frames FH1, FH2, FH3... Into a series of image frames F (1), F (2), F (3), F (4 )... Is mixed so that it is inserted every image frame. Further, when the mixing processing unit 8a performs the mixing processing as shown in FIG. 7A, the number of frames increases, so that a general series of image frames F (1), F (2), F (3) , F (4)... Is output to the display panel 9 at a frame rate twice that of the frame rate (corresponding to the reference frame rate).

  By such a frame output process, the image frame and the interpolation frame are alternately displayed on the display panel 9 in the order shown in FIG. For this reason, the moving image portion in the image frame is displayed with no sense of afterimage because the preceding and following image frames are blocked once by the black color of the interpolation frame, and the black color of the interpolation frame is pinpointed. The degree of blocking the backlight light of the display panel 9 (liquid crystal panel) is minimized, the displayed image is not darkened, and flicker does not occur. Further, in the black allocation of the interpolation frame, the threshold is appropriately corrected (adjusted) according to the genre of the video content or the type of the external video output device when the video content is acquired from the external video output device. Therefore, it is possible to display a video with a moving image response that matches the genre of the video content or an external video output device.

  When the OSD superimposing unit 8b of the mixing unit 8 shown in FIG. 5B displays the menu or the electronic program guide on the display panel 9, it is sent from the control unit 10 to the above-described image frame and interpolation frame. A process of superimposing a coming menu or an electronic program guide is performed, and a process of outputting to the display panel 9 is performed.

  Returning to FIG. 1 and continuing the description, the control unit 10 is connected to the operation unit 20 and the light receiving unit 21 of the remote control device 22 so as to transmit a user's operation instruction. The operation unit 20 and the remote control device 22 include up / down / left / right keys for accepting user operations, a determination button, various instruction buttons, a power button, and the like. Therefore, for example, the operation unit 20 or the remote control device 22 receives an instruction from the user as to whether the video content is acquired by the tuner unit 2b or the digital input unit 3, and sends the instruction to the control unit 10. In this case, the control unit 10 Controls the output of the tuner unit 2b and the digital input unit 3 so as to acquire video content from the instructed one.

  In addition, when the tuner unit 2b is instructed as a video content acquisition destination, and further receives a channel designation by the operation unit 20 or the remote control device 22, the control unit 10 performs channel selection according to the designated channel. Thus, the tuner unit 2b is controlled. Further, when the display designation of the electronic program guide is accepted by the operation unit 20 or the remote control device 22, the control unit 10 performs a control process of generating the electronic program guide and displaying it on the display panel 9.

  FIG. 8 shows an example of an electronic program guide generated by the control unit 10. The electronic program guide 35 is a grid-like table in which channels and broadcast time zones are associated with each other, and broadcast program titles and genre information are arranged in association with grid portions 35a to 35d corresponding to the channels and broadcast time zones. The broadcast program arranged in each of the lattice portions 35 a to 35 d can be selected by a frame-like cursor 36. The control unit 10 stores information indicating the title and genre information, etc. sent from the electronic program information acquisition unit 2 in an internal memory (not shown), and stores the title and genre in the grid-like table data stored in advance in the memory. 8 is generated and an electronic program guide 35 as shown in FIG. 8 is generated and displayed on the display panel 9.

  The cursor 36 positioned on the electronic program guide 35 can be moved with the up / down / left / right keys of the operation unit 20 or the remote control device 22, and the determination key of the operation unit 20 or the remote control device 22 is displayed with the cursor 36 stopped. When operated, the title of the broadcast program corresponding to the grid portions 35a to 35d where the cursor 36 is positioned at that time is selected. In this case, if the broadcast program of the selected title is currently being broadcast, the control unit 10 controls the tuner unit 2b to select the broadcast program and the genre associated with the selected title. A process of specifying information from the electronic program guide 35 and transmitting it to the threshold specifying unit 4 is performed.

  The first flowchart shown in FIG. 9 is an arrangement of a series of processing procedures for image frames in the television apparatus 1 that performs the above-described processing. Hereinafter, processing related to image processing of an image frame acquired based on the first flowchart of FIG. 9 will be described. In the following description, the tuner unit 2b of the electronic program information acquisition unit 2 is selected by the user as an input source after the power-on operation by the user, and a channel is already selected by manual operation.

  First, the television apparatus 1 sequentially acquires a series of image frames related to the broadcast program video of the channel selected by the user in the tuner unit 2b (S1). Then, the television apparatus 1 specifies the first threshold value and the second threshold value according to the video of the image frame to be acquired by the threshold value specifying unit 4 (S2), and the comparison detection unit 6 determines the luminance of the previous and next image frames. A difference value between the signal and the color difference signal is calculated (S3), and it is determined whether or not the difference value between the luminance signals is larger than the first threshold (S4).

  When the difference value of the luminance signal is larger than the first threshold value (S4: YES), the television apparatus 1 performs processing for assigning black to the pixel of the interpolation frame corresponding to the portion larger than the first threshold value in the processing unit 7 ( S6). If the difference value of the luminance signal is not greater than the first threshold value (S4: NO), the television apparatus 1 determines whether or not the difference value of the color difference signal is greater than the second threshold value (S5). When the difference value of the color difference signal is larger than the second threshold value (S5: YES), the television apparatus 1 performs the process of assigning black to the pixels of the interpolation frame corresponding to the portion larger than the second threshold value (Step S7). S6).

  On the other hand, when the difference value of the color difference signal is not larger than the second threshold value (S5: NO), the television apparatus 1 applies the same image of the front image frame to the pixel of the interpolation frame corresponding to the portion not larger than the second threshold value. The processing unit 7 performs a process of assigning an image signal included in the position image (S7). In addition, when YES is obtained in the steps S4 and S5, the television apparatus 1 performs a process of assigning an image signal included in an image at the same position in the front image frame to a portion in which black is not assigned in the step S6. Do. Note that the television apparatus 1 performs the above-described processes in steps S3 to S7 on all the pixels forming the image frame and the interpolation frame, respectively.

  Then, the television apparatus 1 inserts and mixes interpolation frames for each image frame of the image frames by the mixing unit 8 (S8), and displays the image frames and the interpolation frames at the frame rate twice the reference frame rate on the display panel 9. To display the video corresponding to the image frame (S9). Finally, in the television apparatus 1, the control unit 10 determines whether or not the power-off operation is accepted by the operation unit 20 or the remote control device 22 (S10), and the power-off operation is not accepted (S10: NO). Returning to the first stage (S1), the above-described processing is continued. Moreover, when the power-off operation is received from the user (S10: YES), the television apparatus 1 ends a series of processes.

  Therefore, since the television apparatus 1 of the present invention performs the processing as described above, when an image frame of a broadcast program broadcast by television broadcasting is composed of a portion having a small motion and a portion having a large motion, Since black is assigned only to a pixel that has been determined to have movement, it is possible to prevent an afterimage from appearing in the displayed video and to prevent a decrease in luminance. Furthermore, the television apparatus 1 according to the present invention has a black color corresponding to the genre of program data such as a drama, a movie, or an animation that changes depending on the broadcast time of the content of a broadcast program broadcast by television broadcasting. Since the first threshold value and the second threshold value, which are reference values for performing the allocation, are corrected and adjusted as appropriate, it is possible to always obtain an optimal moving image response. Note that, when a broadcast program is received based on the electronic program guide 35 shown in FIG.

  When the digital input unit 3 is selected as the input source, the step S1 in the first flowchart of FIG. 9 is the content for acquiring the image frame from the digital input unit 3, and the step S2 is the digital input unit. Each threshold value is determined after the type of the video output device connected to 3 is determined. Accordingly, the television apparatus 1 can always obtain an optimal moving image response in accordance with the type of the video output device.

  Moreover, the television apparatus 1 according to the present invention is not limited to the above-described embodiment, and can be applied to various modifications. For example, when the processing content is simplified according to the specifications of the television apparatus 1, the moving image portion may be detected based only on the luminance signal. In this case, in the above description, only the process related to the first threshold value is performed, and the process related to the second threshold value is not necessary. Therefore, the television apparatus 1 can simplify the configuration and reduce the processing load. I can plan. That is, the second table 31 in FIG. 2B, the second specifying unit 4b in FIG. 3A, the second calculation unit 6b and the second detection unit 6d in FIG. The processing configuration can be simplified. In addition to the luminance signal and the color difference signal, the moving image portion can be detected based on motion vectors obtained from the previous and next image frames.

  In order to further reduce the processing load, it is possible to generate an interpolation frame without overlapping a series of consecutive image frames, thereby reducing the number of generated interpolation frames. For example, as shown in FIG. 7B, an interpolation frame FH1 is generated based on the front image frame F (1) and the rear image frame F (2), and the front image frame F (3) and the rear image frame F (2) are generated. The interpolation frame FH2 may be generated based on the image frame F (4). In the case shown in FIG. 7B, the mixing unit 8 converts each interpolation frame FH1, FH2,... Into two image frames in a series of image frames F (1), F (2). Each frame is inserted and mixed, and an image frame and an interpolation frame are output to the display panel 9 at 1.5 times the reference frame rate.

  On the other hand, it is also conceivable to increase the detection accuracy of the moving image portion by detecting the moving image portion separately from the noise portion included in the image frame. That is, the noise portion has a large difference between the luminance signal and the color difference signal, and thus may be detected as a moving image portion. However, a partial flowchart as shown in FIG. 10 is added to the first flowchart in FIG. As a result, the noise portion can be accurately distinguished from the moving image portion. The partial flowchart of FIG. 10 is incorporated into the first flowchart so that the portion “A” shown in the partial flowchart of FIG. 10 is connected after “S5: NO” in the first flowchart of FIG. 9. When the partial flowchart of FIG. 10 is incorporated, the motion vector threshold value (motion vector threshold value) and the signal amplitude value threshold value (amplitude threshold value) are stored in advance in the internal memory of the control unit 10, and the control unit 10 or The threshold specifying unit 4 specifies the motion vector and the signal amplitude value from the luminance signal and the color difference signal.

  In this case, when the difference value of the color difference signal is not larger than the second threshold value in the first flowchart of FIG. 9 which is an incorporation part of the partial flowchart of FIG. 10 described above (S5: NO. In the position of “A” in FIG. The television apparatus 1 detects whether or not the motion vector is larger than the motion vector threshold (S20). If the motion vector is larger than the motion vector threshold (S20: YES), the portion is not a noise portion but a moving image. This can be determined as a portion, and the process (black assignment) in step S6 in FIG. 9 is performed. When the motion vector is not larger than the motion vector threshold (S20: NO), the television apparatus 1 detects whether the signal amplitude value is larger than the amplitude threshold (S21). If the motion vector is larger than the amplitude threshold (S21: (YES), the portion is determined as a noise portion (noise pixel) having a minute amplitude (S22), and the processing of step S7 in FIG. 9 (image signal allocation of the front image frame) is performed. On the other hand, when the signal amplitude value is not larger than the amplitude threshold value (S21: NO), the television apparatus 1 determines that the portion is a still image portion (S23), and performs the process at the stage of S7 in FIG. Frame image signal allocation).

Note that the partial flowchart shown in FIG. 10 can be performed instead of the processes in steps S4 and S5 of the first flowchart in FIG. 9. In this case, the process of S20 is performed instead of S4, and the process of S5 is performed. Instead, the processes of S21 to S23 are performed. By doing so, it is possible to generate an interpolation frame in which black is assigned only to the moving image portion based on the moving image vector and the signal amplitude of each pixel.

  In the above description, the television apparatus 1 uses the same value for all the pixels constituting the image frame as each threshold value. However, depending on the genre of the video, the television apparatus 1 differs for each region in the same image frame. You may make it use each threshold value (1st threshold value, 2nd threshold value) of a value.

  For example, if the video genre is a movie, as shown in FIG. 11 (a), subtitles are often placed in the lower band-like area A2 in the entire range of the image frame F. It is preferable to handle it as an image part, and since the upper rectangular area A1 often has moving contents, it is basically preferable to handle it as a moving image part. Therefore, as the table for the first threshold correction value, as shown in FIG. 11B, the threshold correction value “a” corresponding to the rectangular area A1 and the threshold correction value “a ′” corresponding to the strip area A2. As the second threshold correction value table, as shown in FIG. 11 (c), the threshold correction value “0” corresponding to the rectangular area A1 is used. b ”, a correction value table 31 ′ storing threshold correction values“ b ′ (b ′> b) ”corresponding to the band-like area A2 is used. In this way, by using threshold values having different values depending on the area of the image frame, it is possible to display an image with more optimal moving image response. Whether the pixel to be compared belongs to the rectangular area A1 or the band-like area A2 can be determined by the position information of the pixel (X and Y coordinate positions).

  Furthermore, in the above description, the threshold value specifying unit 4 specifies each threshold value by adding the threshold correction value to the default value (reference threshold value) when specifying each threshold value. Depending on the setting method, the calculation method is not limited to addition, and subtraction, multiplication, division, or the like can be used. In the above description, the image signal of the pixel in the front image frame is assigned to the interpolation frame in the process of step S7 in the first flowchart of FIG. 9, but this corresponds to the front image frame. It is also possible to assign the image signal of the pixel of the rear image frame to the interpolation frame. In this case, since the image signal of the rear image frame is used, each image frame is buffered to generate an interpolation frame.

  In the above description, the color assigned to the moving image portion is black, but the assigned color can be gray instead of black as long as the afterimage feeling can be prevented. Furthermore, two threshold values are set for the luminance signal, etc., black is assigned to pixels that exceed the larger threshold value, and gray is assigned to pixels that exceed the smaller threshold value and do not exceed the larger threshold value, Black or gray may be assigned depending on the motion level of the moving image portion. The processing of the present invention relating to such black or gray allocation can be applied to a display device that performs hold-type driving as the display panel 9, such as a liquid crystal panel.

1 is a block diagram of a television apparatus including an image processing apparatus according to an embodiment of the present invention. (A) is a chart showing a first table for luminance signals, (b) is a chart showing a second table for color difference signals, and (c) is a chart showing a third table relating to device type information. (A) is a block diagram which shows a threshold value specific | specification part, (b) is a block diagram which shows a comparison detection part. (A) is the schematic which shows a series of image frames, (b) is the schematic which shows the state which inserted the interpolation frame into the image frame. (A) is a block diagram which shows a process part, (b) is a block diagram which shows a mixing part. It is the schematic for demonstrating the production | generation condition of an interpolation frame. (A) is the schematic which shows the state which inserted the interpolation frame for every 1 image frame, (b) is the schematic which shows the state which inserted the interpolation frame for every 2 image frames. It is the schematic which shows a part of electronic program guide. It is a 1st flowchart which shows the processing content of this embodiment. It is a partial flowchart which shows the partial processing content of a modification. (A) is a schematic diagram showing a segmented area of an image frame, (b) is a schematic diagram showing a correction table for luminance signals in a modified example, and (c) is a schematic diagram showing a correction table for color difference signals in a modified example. FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Television apparatus 4 Threshold judgment part 5 Frame memory 6 Comparison detection part 7 Processing part 8 Mixing part 9 Display panel 10 Control part 20 Operation part 22 Remote control device

Claims (7)

In an image processing apparatus for generating an interpolation frame to be inserted between successive image frames in a series of image frames according to a video,
Image frame acquisition means for acquiring an image frame corresponding to the video of the broadcast program;
Genre information acquisition means for acquiring genre information indicating a genre related to a video of a broadcast program related to an image frame acquired by the image frame acquisition means;
A correction value table storing threshold correction values in association with each of a plurality of types of genre information;
Storage means for storing a reference threshold;
A specifying means for specifying a threshold correction value corresponding to the genre information acquired by the genre information acquiring means from the correction value table;
Threshold specifying means for specifying a threshold based on the threshold correction value specified by the specifying means and the reference threshold stored by the storage means;
A comparison unit that performs comparison of image signals included in pixels that form an image frame acquired by the image frame acquisition unit between pixels at the same position in successive image frames;
A detection unit that detects a portion corresponding to a pixel related to the comparison result as a moving image portion in an image frame when a value related to the comparison result of the comparison unit is larger than the threshold;
An image processing apparatus comprising: an interpolation frame generation unit configured to generate an interpolation frame in which pixels corresponding to a moving image portion detected by the detection unit are black or gray. In an image processing apparatus for generating an interpolation frame to be inserted between successive image frames in a series of image frames according to a video,
A program guide generating means for generating an electronic program guide including a broadcast program title and genre information indicating a broadcast program genre in association with each other so that selection of the title of the broadcast program can be accepted;
Image frame acquisition for acquiring an image frame corresponding to a video of a broadcast program related to the selected title when receiving a selection of any of the broadcast program titles included in the electronic program guide generated by the program guide generation unit Means,
Genre information identifying means for identifying the genre information corresponding to the title for which selection has been received from the electronic program guide;
A correction value table storing threshold correction values in association with each of a plurality of types of genre information;
Storage means for storing a reference threshold;
Specifying means for specifying a threshold correction value corresponding to the genre information specified by the genre information specifying means from the correction value table;
Threshold specifying means for specifying a threshold based on the threshold correction value specified by the specifying means and the reference threshold stored by the storage means;
A comparison unit that performs comparison of image signals included in pixels that form an image frame acquired by the image frame acquisition unit between pixels at the same position in successive image frames;
A detection unit that detects a portion corresponding to a pixel related to the comparison result as a moving image portion in an image frame when a value related to the comparison result of the comparison unit is larger than the threshold;
An image processing apparatus comprising: an interpolation frame generation unit configured to generate an interpolation frame in which pixels corresponding to a moving image portion detected by the detection unit are black or gray. In an image processing apparatus for generating an interpolation frame to be inserted between successive image frames in a series of image frames according to a video,
An external video output device connection means that can be connected to an external video output device and can accept device type information representing a device type sent from the connected video output device;
A genre table storing genre information related to video in association with each model type related to device type information;
A correction value table storing threshold correction values in association with each of a plurality of types of genre information;
Storage means for storing a reference threshold;
Accepted when an external output device is connected to the external video output device connecting means, and the image frame and device type information corresponding to the video sent from the external output device is received by the external video output device connecting means. Genre specifying means for specifying the genre information corresponding to the device type information from the genre table;
Correction value specifying means for specifying a threshold correction value corresponding to the genre information specified by the genre specifying means from the correction value table;
Threshold value specifying means for specifying a threshold value corresponding to an image frame received by the external video output device connecting means based on a threshold correction value specified by the correction value specifying means and a reference threshold value stored by the storage means;
A comparison unit that performs comparison of image signals included in pixels that form an image frame received by the external video output device connection unit between pixels at the same position in successive image frames; and
A detection unit that detects a portion corresponding to a pixel related to the comparison result as a moving image portion in an image frame when a value related to the comparison result of the comparison unit is larger than the threshold;
An image processing apparatus comprising: an interpolation frame generation unit configured to generate an interpolation frame in which pixels corresponding to a moving image portion detected by the detection unit are black or gray. The interpolated frame generation means is configured to apply either one of the previous and subsequent image frames related to the comparison by the comparison means to a pixel corresponding to another part in the image frame that the detection means has not detected as a moving image portion. The image processing apparatus according to claim 1, wherein an image signal included in a pixel corresponding to the other part in the frame is assigned. Said comparing means, the image processing according to any one of claims 1 to 4 luminance signals corresponding to the image signal, or a comparison to either the luminance signal and the color difference signals corresponding to the image signal performed apparatus. Frame output for inserting the interpolation frame generated by the interpolation frame generation means for each image frame in a series of image frames related to the video and outputting each image frame and interpolation frame at twice the reference frame rate The image processing apparatus according to claim 1, comprising means. The interpolation frame generated by the interpolation frame generation means is inserted every two image frames in a series of image frames related to the video, and each image frame and interpolation frame is output at 1.5 times the reference frame rate. The image processing apparatus according to claim 1, further comprising a frame output unit.

Images