JP2009290310A - Image processing unit, display device, program, and information storage - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing unit, or the like, capable of performing determination appropriately, even if a still image domain and a moving image domain are determined with a rapidly blinking moving image, a moving image where characters travel speedily, and the like, as targets. <P>SOLUTION: The image processing unit comprises: a still/motion determining section 151; an operation section 152 of a differential value of a field in front of the previous field; an operation section 154 of the differential value of a field after the next field; a moving image determination value generating section 156-1 for generating a first moving image determination value for each corresponding pixel position, by performing first operation by a plurality of differential values of a field in front of the previous field and a plurality of differential values of a field after the next one; a peripheral domain determining section 157-1; and a domain determining section 159 for determining that the pixel to be interpolated is in a moving image domain, when it is determined that the pixel to be interpolated is in a still image domain and the determination result of the first peripheral domain determination is true. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image processing device, a display device, a program, and an information storage medium that convert an interlaced image into a progressive image.

For example, as described in Japanese Patent Application Laid-Open No. 2007-195062, when an interlaced image is converted into a progressive image, the image processing apparatus uses a pixel value of a field image before and after to convert a still image region and a moving image region. judge.
JP 2007-195062 A

  However, image processing devices that simply determine the still image area and moving image area using the pixel values of the preceding and following field images are intended for moving images that are blinking quickly, moving images that move characters at high speed, etc. When determining the still image region and the moving image region, the region is erroneously determined, and the image quality may be deteriorated.

  The object of the present invention is to enable appropriate determination even when determining a still image region and a moving image region for a moving image with fast blinking, a moving image in which characters move at high speed, or the like. An image processing apparatus, a display apparatus, a program, and an information storage medium are provided.

  In order to solve the above-described problem, an image processing apparatus according to the present invention is an image processing apparatus that converts an interlaced image into a progressive image by performing an interpolation process on the interlaced image, based on the image signal of the interlaced image. A static determination unit for determining whether an interpolation target pixel in the interpolation target field image is in a still image region or a moving image region, and a line one or one above the interpolation target pixel in the interpolation target field image Pixel values of the first plurality of pixels located on the lower line and around the interpolation target pixel, and pixels corresponding to the first plurality of pixels in the field image two before the interpolation target field image Each pixel at the corresponding pixel position between fields for the pixel values of the second plurality of pixels at the position A second previous field difference value calculation unit that calculates a plurality of second previous field difference values that are different from each other, a line positioned one line above or one line below the interpolation target pixel, and the interpolation The pixel values of the third plurality of pixels around the target pixel and the pixel values of the fourth plurality of pixels at the pixel position corresponding to the third plurality of pixels in the field image two times after the interpolation target field image And a second subsequent field difference value calculation unit for calculating a plurality of second subsequent field difference values that are difference values of pixel values at corresponding positions between fields, and the plurality of two previous field differences. The first calculation is performed using the value, the pixel position of the second previous field difference value, and the plurality of second subsequent field difference values at the corresponding pixel position between fields, and the first calculation is performed for each corresponding pixel position. A first moving image determination value generating unit that generates a moving image determination value, and a first peripheral region determination that determines whether at least one of the first moving image determination values is equal to or greater than a first predetermined value When the surrounding area determination unit and the static movement determination unit determine that the interpolation target pixel is in the still image area, and the determination result of the first surrounding area determination is true , When the interpolation target pixel is determined to be in the moving image region, and the static motion determination unit determines that the interpolation target pixel is in the still image region, and the first peripheral region determination And a region determination unit that determines that the interpolation target pixel is in the still image region.

  According to another aspect of the present invention, there is provided a display device including the image processing apparatus and a display unit that displays the progressive image converted by the interpolation process.

  Further, a program according to the present invention is a program for converting an interlaced image into a progressive image by executing an interpolation process on the interlaced image, the computer interpolating based on the image signal of the interlaced image. A static motion determination unit that determines whether an interpolation target pixel in the target field image is in a still image region or a moving image region; and a line one above or below the interpolation target pixel in the interpolation target field image The pixel values of the first plurality of pixels located on the line and around the interpolation target pixel and the pixel positions corresponding to the first plurality of pixels in the field image two before the interpolation target field image Each pixel at the corresponding pixel position between fields for the pixel values of a certain second plurality of pixels A second previous field difference value calculation unit that calculates a plurality of second previous field difference values that are different from each other, a line positioned one line above or one line below the interpolation target pixel, and the interpolation The pixel values of the third plurality of pixels around the target pixel and the pixel values of the fourth plurality of pixels at the pixel position corresponding to the third plurality of pixels in the field image two times after the interpolation target field image And a second subsequent field difference value calculation unit for calculating a plurality of second subsequent field difference values that are difference values of pixel values at corresponding positions between fields, and the plurality of two previous field differences. The first calculation is performed using the value, the pixel position of the second previous field difference value, and the plurality of second subsequent field difference values at the corresponding pixel position between fields, and the first calculation is performed for each corresponding pixel position. A first moving image determination value generating unit that generates a moving image determination value, and a first peripheral region determination that determines whether at least one of the first moving image determination values is equal to or greater than a first predetermined value When the surrounding area determination unit and the static movement determination unit determine that the interpolation target pixel is in the still image area, and the determination result of the first surrounding area determination is true , When the interpolation target pixel is determined to be in the moving image region, and the static motion determination unit determines that the interpolation target pixel is in the still image region, and the first peripheral region determination When the determination result is false, it is made to function as an area determination unit that determines that the interpolation target pixel is in a still image area.

  An information storage medium according to the present invention is an information storage medium storing a computer-readable program, and stores the program.

  According to the present invention, an image processing device or the like uses a pixel value of not only a pixel value in the same field image but also a pixel value of a second previous field image and a second subsequent field image, thereby quickly moving a moving image. Even when the still image region and the moving image region are determined for an image or a moving image in which characters move at high speed, the determination can be made appropriately.

  Further, the image processing device or the like corresponds to the pixel values of two pixels on the left and right of the interpolation target pixel in the interpolation target field image, and the left and right pixels in the field image immediately before the interpolation target field image. A previous field difference value calculation unit that calculates two previous field difference values that are difference values between the pixel values of two pixels at a pixel position to be detected, and left and right of the interpolation target pixel in the interpolation target field image And one of the two pixel values of the two pixels at the pixel positions corresponding to the left and right pixels in the field image immediately after the interpolation target field image. The next field difference value calculation unit for calculating the next field difference value, the two previous field difference values, and the image of the previous field difference value. A second moving image determination value generation unit that generates a second moving image determination value by performing a second calculation using the two subsequent field difference values at the corresponding pixel position between the position and the field; A second peripheral region determination unit that performs a second peripheral region determination to determine whether at least one of the second moving image determination value is equal to or greater than a second predetermined value, and the region determination unit, It is a case where it is determined by the static motion determination that the pixel to be interpolated is in a still image region, a determination result of the first peripheral region determination is false, and the second peripheral region When the determination result is true, it is determined that the pixel to be interpolated is in the moving image region, and it is determined by the static motion determination that the pixel to be interpolated is in the still image region. If the judgment result of the surrounding area judgment is false I, and said second peripheral region determination result of the determination if false, the interpolation target pixel may be determined to be in the still picture area.

  According to this, the image processing apparatus or the like uses not only the pixel values in the same field image but also the pixel values of the previous field image and the subsequent field image, so that the moving image is rapidly blinked. Even when the still image region and the moving image region are determined for a moving image or the like in which characters move at high speed, the determination can be made appropriately.

  Embodiments in which the present invention is applied to a projector will be described below with reference to the drawings. In addition, the Example shown below does not limit the content of the invention described in the claim at all. In addition, all the configurations shown in the following embodiments are not necessarily essential as means for solving the invention described in the claims.

(Explanation of interpolation)
First, an overview of moving image interpolation and still image interpolation and an example of an image that is not properly displayed by the interpolation method will be described. In order to effectively use a narrow transmission band, video is distributed in an interlaced manner. In the interlace method, odd field images (top field images) and even field images (bottom field images) are alternately repeated at 60 Hz.

  In the odd field image, only the pixel information of the odd lines is provided, and in the even field image, only the pixel information of the even lines is provided. In order to increase the resolution of an image, the image processing apparatus interpolates a line without pixel information of each interlaced image and converts it into a progressive image (IP conversion).

  FIG. 1 is a diagram illustrating an example of moving image interpolation. For example, in the case of a moving image, interpolation is performed using pixel values of pixels that exist above and below an interpolation target pixel in the same field (for example, field n) image. Such an interpolation method is called a line double or a line average.

  FIG. 2 is a diagram illustrating an example of still image interpolation. For example, in the case of a still image, interpolation is performed using pixel values of pixels that actually exist at corresponding positions in fields (for example, field n−1 and field n + 1) before and after the field of interpolation target pixels (for example, field n). Is called. Such an interpolation method is called field weaving.

  FIG. 3A is a diagram illustrating an example of an image 300 that has failed to be interpolated, and FIG. 3B is a diagram illustrating an example of an image 301 that has been successfully interpolated. For example, in the case of images 300 and 301 in which characters scroll in the direction indicated by the arrow, if video interpolation such as line average is simply performed, the characters are blurred as shown in FIG. 3A, and stationary such as field weaving. Combing occurs when image interpolation is performed.

  FIG. 4A is a diagram illustrating an example of an image that has failed to be interpolated, and FIG. 4B is a diagram illustrating an example of an image that has been successfully interpolated. For example, when moving image interpolation such as line average is simply performed on the slowly rotating bar images 302 and 303, when the bar angle is a high angle higher than 45 degrees, as shown in FIG. Occurs.

  FIG. 5A is a diagram illustrating an example of an image that has failed to be interpolated, and FIG. 5B is a diagram illustrating an example of an image that has been successfully interpolated. Further, when moving image interpolation such as line average is simply performed on the slowly rotating bar images 304 and 305, if the bar angle is a low angle lower than 45 degrees, a line as shown in FIG. Rippling or jaggy.

  The image processing apparatus according to the present exemplary embodiment generates appropriate progressive images as shown in FIGS. 3B, 4B, and 5B by performing interpolation according to various conditions. Next, functional blocks of the projector having such a function will be described.

(Description of functional block)
FIG. 6 is a diagram illustrating an example of functional blocks of the projector 100 according to the present embodiment. A projector 100, which is a type of display device, includes an image signal input unit 110 that inputs an image signal such as an interlaced image, an image processing device 120, an image generation unit 198 that forms a progressive image or the like on a liquid crystal panel, and a liquid crystal panel. A projection unit 199 that projects the formed image is included. The image generation unit 198 and the projection unit 199 are a kind of display unit.

  In addition, the image processing apparatus 120 includes a storage unit 130 that stores various data, a difference value calculation unit 140, a determination result data generation unit 150, a moving image edge pixel interpolation processing unit 160, and a high-angle oblique interpolation processing unit 170. And a low-angle oblique interpolation processing unit 180 and an interpolation processing unit 190 which is a second interpolation unit.

  In addition, the storage unit 130 includes pixel value data 131 that indicates a pixel value for each pixel, determination result data 132 that indicates a determination value for each pixel, difference value data 133, two previous field difference value data 134, and two subsequent field differences. Value data 135, one-preceding field difference value data 136, one-following field difference value data 137, post-interpolation data 138 indicating pixel values after interpolation, and the like are stored.

  For example, the following may be employed as hardware for mounting the functions of these units in the projector 100. For example, the image signal input unit 110 includes an image input port, a converter, an image processing circuit, a difference value calculation unit 140, a determination result data generation unit 150, a moving image edge pixel interpolation processing unit 160, a high-angle diagonal interpolation processing unit 170, The low-angle oblique interpolation processing unit 180 and the interpolation processing unit 190 include a CPU and an image processing circuit, the storage unit 130 includes a RAM, the image generation unit 198 includes an image processing circuit, the projection unit 199 includes a lamp and a liquid crystal panel. A liquid crystal driving circuit, a lens, or the like may be employed.

  In addition, the projector 100 may implement the functions of these units by reading a program from the information storage medium 200. As such an information storage medium 200, for example, a CD-ROM, DVD-ROM, ROM, RAM, HDD or the like can be applied, and the program reading method may be a contact method or a non-contact method. Good.

  Hereinafter, the determination result data generation unit 150 and the like will be described in more detail. FIG. 7 is a diagram illustrating an example of functional blocks of the determination result generation unit 150 in the present embodiment. The determination result data generation unit 150 includes a static motion determination unit 151 that determines whether the interpolation target pixel is in the still image region or the moving image region, the second previous field difference value calculation unit 152, and the first previous field difference value. The calculation unit 153, the second field difference value calculation unit 154, the next field difference value calculation unit 155, the (first) moving image determination value generation unit 156-1, and the (second) moving image determination value The generation unit 156-2, the (first) peripheral region determination unit 157-1, the (second) peripheral region determination unit 157-2, and the edge determination that determines whether or not the interpolation target pixel is in the edge region A unit 158 and a region determining unit 159.

  The second previous field difference value calculation unit 152 is a first plurality of pixels that are located in a line one line above or one line below the interpolation target pixel in the interpolation target field image and that are around the interpolation target pixel. And the pixel values of the second plurality of pixels at the pixel positions corresponding to the first plurality of pixels in the field image two prior to the interpolation target field image at the pixel positions corresponding between the fields. A plurality of previous two field difference values, which are the difference values of each pixel value, are calculated and stored in the storage unit 130 as second previous field difference value data 134.

  Also, the previous field difference value calculation unit 153 applies the pixel values of the two pixels on the left and right of the interpolation target pixel in the interpolation target field image, and the left and right pixels in the field image immediately before the interpolation target field image. Two previous field difference values, which are the difference values between the pixel values of two pixels at corresponding pixel positions, are calculated and stored in the storage unit 130 as previous field difference value data 136.

  The second field difference value calculation unit 154 is a pixel value of a third plurality of pixels that are located on the line that is one pixel above or below the pixel to be interpolated and that are around the pixel to be interpolated. And the pixel values of the fourth plurality of pixels at the pixel positions corresponding to the third plurality of pixels in the field image after the interpolation target field image, and the pixel values at the positions corresponding between the fields. Are calculated and stored in the storage unit 130 as second subsequent field difference value data 135.

  Also, the pixel values of the two pixels on the left and right of the interpolation target pixel in the interpolation target field image, and the pixels of the two pixels at the pixel positions corresponding to the left and right pixels in the field image immediately after the interpolation target field image Two subsequent field difference values, which are difference values from the values, are calculated and stored in the storage unit 130 as the subsequent field difference value data 137.

  In addition, the moving image determination value generation unit 156-1 generates a plurality of two previous field difference values and the second previous field difference value based on the second previous field difference value data 134 and the second subsequent field difference value data 135. A first moving image determination is performed for each corresponding pixel position by performing a first calculation (for example, an averaging calculation) using the pixel position and a plurality of subsequent field difference values at the corresponding pixel position between the fields. Generate a value.

  In addition, the moving image determination value generation unit 156-2 generates two previous field difference values and one previous field difference value based on the previous field difference value data 136 and the next field difference value data 137. A second moving image determination value is generated by performing a second calculation (for example, an averaging calculation or the like) using the pixel position and the two next field difference values at the corresponding pixel positions between the fields.

  In addition, the surrounding area determination unit 157-1 performs a first surrounding area determination that determines whether at least one first moving image determination value is equal to or greater than a first predetermined value (for example, 1). In addition, the surrounding area determination unit 157-2 performs a second surrounding area determination that determines whether at least one second moving image determination value is equal to or greater than a second predetermined value (for example, 1).

  Further, even when the static motion determination unit 151 determines that the interpolation target pixel is in the still image region, the region determination unit 159 determines that the interpolation target pixel is in the moving image region if the predetermined condition is satisfied. To do. As this predetermined condition, for example, a condition that the determination result of the first peripheral region determination is true, a determination result of the first peripheral region determination is false, and the second peripheral region determination The condition that the determination result is true is true.

  FIG. 8 is a diagram illustrating an example of functional blocks of the moving image edge pixel interpolation processing unit 160 in the present embodiment. The moving image edge pixel interpolation processing unit 160 continuously determines whether or not there are a plurality of moving image edge pixels, which are interpolation target pixels determined to be in the edge region, in the interpolation target field image. When the determination result of the continuity determination is true and the determination result of the continuity determination is true, the direction determination unit 162 that determines the direction of the edge including a plurality of moving image edge pixels, and the determination result of the continuity determination If true, out of the combinations of the pixels in the upper pixel group and the pixels in the lower pixel group, the combination having the smallest difference value among the combinations at positions along the direction determined by the direction determination unit. A candidate pixel determining unit 163 to be determined and a moving image edge pixel interpolating unit 164 that interpolates moving image edge pixels in accordance with the combination determined by the candidate pixel determining unit 163 are configured.

  FIG. 9 is a diagram illustrating an example of functional blocks of the high-angle oblique interpolation processing unit 170 in the present embodiment. The high-angle diagonal interpolation processing unit 170 is a difference value between the pixel value of the upper pixel that is the pixel immediately above the interpolation target pixel and the pixel value of the lower pixel that is the pixel immediately below the interpolation target pixel. An upper / lower difference value determination unit 171 that performs upper / lower difference value determination to determine whether a certain upper / lower difference value is less than a first threshold value (for example, 2 etc.), a first combination difference value determination unit 172, The interpolation unit 173 is included.

  The first combination difference value determination unit 172 includes pixels directly above the interpolation target pixel, the upper pixel, the upper left pixel that is the upper left pixel, and the upper right pixel that is the upper right pixel. The pixel value of each pixel of at least one of the values and a right-down pixel that is one pixel below the interpolation target pixel, a lower-left pixel that is one lower-left pixel, and a lower-right pixel that is one lower-right pixel It is determined whether or not there is a combination having a difference value smaller than a vertical difference value that is a difference value between the pixel value of the upper pixel and the pixel value of the lower pixel among the difference values of the combination with at least one of First combination difference value determination is performed.

  In addition, the first interpolation unit 173 determines that the combination is obtained when the determination result of the first combination difference value determination is true and the combination of pixels determined to be true satisfies a predetermined condition. And interpolating the pixel to be interpolated using pixel values of 3 pixels or 4 pixels of the 6 pixels of the upper right pixel, the upper left pixel, the upper right pixel, the lower right pixel, the lower left pixel, and the lower right pixel. When the determination result of the combination difference value determination of 1 is true and the predetermined condition is not satisfied, the interpolation of the interpolation target pixel is performed using the pixel values of the two pixels, the upper pixel and the lower pixel. I do.

  FIG. 10 is a diagram illustrating an example of functional blocks of the low-angle oblique interpolation processing unit 180 in the present embodiment. The low-angle oblique interpolation processing unit 180 includes a second combination difference value determination unit 181, a minimum combination determination unit 182, and a low-angle oblique interpolation unit 183.

  When the determination result of the vertical difference value determination by the vertical difference value determination unit 171 is false, the second combination difference value determination unit 181 includes at least a pixel value of each pixel of the upper pixel, the upper left pixel, and the upper right pixel. Among the first combination difference values that are the difference values of one and the combination of at least one of the pixel values of each of the lower right pixel, the lower left pixel, and the lower right pixel, a second threshold value (for example, 2 Etc.) A second combination difference value determination is performed to determine whether there are any less than the above.

  Further, when the result of the second combination difference value determination is false, the minimum combination determination unit 182 passes through the pixel value of each pixel in the upper pixel group and the interpolation target pixel among the upper pixel group and the lower pixel group. Then, the combination of the pixels of the upper pixel group and the pixels of the lower pixel group having the smallest diagonal pixel difference value, which is the difference value with the pixel value of each pixel of the lower pixel group at an oblique position, is determined.

  The low-angle oblique interpolation unit 183 also includes the pixel values of the two pixels of the combination determined by the minimum combination determination unit 182 and the pixels of the already-existing pixels that have been subjected to the interpolation processing next to the interpolation target pixel. The interpolation target pixel is interpolated using the value.

(Description of overall image processing)
Next, the flow of image processing will be described. FIG. 11 is a flowchart illustrating an example of an image processing procedure in the present embodiment. The image signal input unit 110 inputs an image signal (step S1).

  The image processing apparatus 120 determines whether or not the image signal is a 3: 2 pull-down image signal (step S2), and if the image signal is a 3: 2 pull-down image signal, executes the 3: 2 pull-down image processing ( Step S3). Note that 3: 2 pull-down is, for example, converting 24 images per second into 60 images per second as in a movie. Since 3: 2 pull-down image processing is general image processing, description thereof is omitted.

  Further, the image processing apparatus 120 determines whether or not the image signal is a 2: 2 pull-down image signal (step S4), and if it is a 2: 2 pull-down image signal, executes the 2: 2 pull-down image processing. (Step S5). Note that 2: 2 pull-down is, for example, conversion of 30 images per second into 60 images / second like computer graphics and animation. Since 2: 2 pull-down image processing is general image processing, description thereof is omitted.

  In the case of an image signal not corresponding to 3: 2 pulldown or 2: 2 pulldown (for example, a television signal), the image processing apparatus 120 executes IP (Interlace Progressive) conversion processing (step S6) of the present embodiment.

  The image generation unit 198 forms an image converted by each image processing (steps S3, S5, S6) on the liquid crystal panel, and the projection unit 199 displays the image by projecting the image (step S7).

  The projector 100 determines whether or not the input of the image signal has been completed (step S8). If the input has not been completed, the projector 100 continues to input, convert, and display the image signal.

  Next, the procedure of the IP conversion process (step S6) will be described in more detail. FIG. 12 is a flowchart illustrating an example of an IP conversion procedure in the present embodiment.

  The image signal input unit 110 stores pixel value data 131 indicating the pixel value (for example, RGB value, luminance value, etc.) of each pixel in the storage unit 130. The difference value calculation unit 140 calculates the difference value between the pixel value of the upper pixel group and the pixel value of the lower pixel group based on the pixel value data 131 (step S11).

  Here, the interpolation target pixel in the interpolation target field image and the pixels around the interpolation target pixel will be described. FIG. 13 is a schematic diagram of the interpolation target pixel 414 and pixels around the interpolation target pixel in this embodiment.

  The difference value calculation unit 140 calculates a difference value between the seven pixels 421 to 427 of the upper pixel group 420 and the seven pixels 431 to 437 of the lower pixel group 430 at symmetrical positions via the interpolation target pixel 414, The difference value data 133 is stored in the storage unit 130 as a part. In addition, the difference value calculation unit 140 includes a difference value between the upper right pixel 424 and the lower left pixel 433, a difference value between the upper upper pixel 424 and the lower right pixel 435, a difference value between the upper left pixel 423 and the lower right pixel 434, and an upper right pixel. The difference value between 425 and the directly below pixel 434 is calculated and stored in the storage unit 130 as part of the difference value data 133.

  The determination result data generation unit 150 performs static motion determination (step S12) and stores a determination value indicating the determination result in the storage unit 130 as determination result data 132.

  The image processing apparatus 120 determines whether or not the determination value is 2 or more (step S13). If the determination value is 2 or more, the moving image edge pixel interpolation processing unit 160 performs moving image edge pixel interpolation (step S14), and high The angle oblique interpolation processing unit 170, the low angle oblique interpolation processing unit 180, and the interpolation processing unit 190 perform moving image interpolation (step S15).

  On the other hand, when the determination value is less than 2, the image processing apparatus 120 performs still image interpolation (step S16). The still image interpolation is a general interpolation method described with reference to FIG.

(Explanation of static judgment)
Here, the static motion determination (step S12) will be described in more detail. FIG. 14 is a flowchart illustrating an example of a static motion determination procedure in the present embodiment.

  The static motion determination unit 151 determines the upper left pixels around the interpolation target pixel 414 based on the pixel values of the upper pixel group 420 and the lower pixel group 430 of the second previous field image and the second subsequent field image indicated by the pixel value data 131. 423, the upper right pixel 424, the upper right pixel 425, the left horizontal pixel 413, the right horizontal pixel 415, the lower left pixel 433, the lower right pixel 434, and the lower right pixel 435, which pixel is determined to be a moving image region, and an edge determination unit In step S <b> 21, it is determined whether the interpolation target pixel 414 is in the edge region based on the pixel value data 131.

  The moving image determination value generation unit 156-1 determines whether or not the interpolation target pixel 414 is in the moving image area and in the edge area (step S22), and if the determination result is true, whether or not interpolation is possible. Determination is made (step S23).

  When the determination result in step S23 is true, the moving image determination value generation unit 156-1 sets 4 as the determination value of the interpolation target pixel 414 and stores it in the storage unit 130 as part of the determination result data 132 (step S24). ).

  On the other hand, when the determination result of step S23 is false, the moving image determination value generation unit 156-1 sets 3 as the determination value of the interpolation target pixel 414 and stores it in the storage unit 130 as part of the determination result data 132 ( Step S25).

  Furthermore, when the determination result of step S22 is false, the moving image determination value generation unit 156-1 determines whether or not the interpolation target pixel 414 is in the moving image region (step S26). When the determination result is true, the moving image determination value generation unit 156-1 sets 2 as the determination value of the interpolation target pixel 414 and stores it in the storage unit 130 as a part of the determination result data 132 (step S27).

  On the other hand, when the determination result in step S26 is false, that is, when the interpolation target pixel 414 is in the still image region, the moving image determination value generation unit 156-2 has the interpolation target pixel 414 in the still image region, and It is determined whether it is in the edge region (step S28).

  When the determination result of step S28 is true, the moving image determination value generation unit 156-2 determines whether at least one of the eight surrounding pixels of the interpolation target pixel 414 is in the moving image region (step S29).

  When the determination result of step S29 is true, the moving image determination value generation unit 156-2 sets 5 as the determination value of the interpolation target pixel 414 and stores it in the storage unit 130 as part of the determination result data 132 (step S30). ).

  On the other hand, when the determination result of step S29 is false, the moving image determination value generation unit 156-2 sets 1 as the determination value of the interpolation target pixel 414 and stores it in the storage unit 130 as part of the determination result data 132 ( Step S31).

  Furthermore, when the determination result of step S28 is false, the moving image determination value generation unit 156-2 determines whether or not at least one of the eight surrounding pixels of the interpolation target pixel 414 is in the moving image region (step S32). .

  When the determination result of step S32 is true, the moving image determination value generation unit 156-2 sets 5 as the determination value of the interpolation target pixel 414 and stores it in the storage unit 130 as part of the determination result data 132 (step S33). ).

  On the other hand, when the determination result of step S32 is false, the moving image determination value generation unit 156-2 sets the determination value of the interpolation target pixel 414 to 0 and stores it in the storage unit 130 as part of the determination result data 132 ( Step S34).

  Note that determination value = 0 indicates that the image is in the still image region and does not exist in the edge region, determination value = 1 indicates that the image is in the still image region and in the edge region, and determination value = 2 In the moving image area, it is not in the edge area, and the determination value = 3 indicates that it is in the moving image area and in the edge area, but the interpolation method cannot be determined, and the determination value = 4 is It is in the moving image area and in the edge area, and indicates that the interpolation method is also determined. A determination value = 5 indicates that the area is in the still image area but the surrounding area is in the moving image area.

(Description of video edge pixel interpolation)
Next, the moving image edge pixel interpolation (step S14) will be described in more detail. FIG. 15 is a flowchart showing an example of the first moving image edge pixel interpolation procedure in the present embodiment. Based on the determination result data 132, the continuity determination unit 161 determines whether a plurality of moving image edge pixels (determination value = 3 or 4) are present in the interpolation target field image (step S41).

  The direction determination unit 162 determines whether or not the determination result in step S41 is true (step S42). If true, the direction determination unit 162 determines a direction in which a plurality of moving image edge pixels are continuous (step S43).

  Based on the determined direction and the difference value data 133, the candidate pixel determining unit 163 has the direction determined by the direction determining unit 162 out of the combinations of the pixels of the upper pixel group 420 and the pixels of the lower pixel group 430. A combination (candidate pixel) having the smallest difference value among the combinations at the positions along the line is determined (step S44).

  FIG. 16 is a diagram illustrating an example of an image 310 having a low-angle oblique line in the present embodiment. FIG. 17 is a schematic diagram showing an interpolation method in the case of an image 310 in which a low-angle oblique line exists in the present embodiment.

  For example, as illustrated in FIG. 16, when the moving image edge region indicated by diagonal lines exists from the upper right to the lower left direction of the image 310, the candidate pixel determination unit 163 moves from the upper right to the lower left direction indicated by the arrow in FIG. 17. Among the difference values of a certain pixel combination, the combination having the smallest difference value is determined.

  The moving image edge pixel interpolation unit 164 interpolates the interpolation target pixel 414 in accordance with the combination determined by the candidate pixel determination unit 163 (step S45). For example, when the combination of the pixel 427 and the pixel 431 has the smallest difference value, the moving image edge pixel interpolation unit 164 interpolates the interpolation target pixel 414 using the pixel values of the pixel 427 and the pixel 431.

  On the other hand, when the result of the continuity determination is false, the image processing apparatus 120 executes the following processing. FIG. 18 is a flowchart illustrating an example of the second moving image edge pixel interpolation procedure in the present embodiment.

  The up / down difference value determination unit 171 performs the up / down difference value determination that determines whether the upper / lower difference value, which is the difference value between the pixel value of the upper pixel 424 and the pixel value of the lower pixel 434, is less than a first threshold value. (Step S51). For example, the vertical difference value determination unit 171 determines that the absolute value of the difference value between the R value of the upper pixel 424 and the R value of the lower pixel 434 is less than 1, and the difference between the G value of the upper pixel 424 and the G value of the lower pixel 434. If the absolute value of the value is less than 1, and the absolute value of the difference value between the B value of the upper pixel 424 and the B value of the lower pixel 434 is less than 1, an edge (horizontal direction edge) straddling the upper and lower pixels is satisfied. Guess no edge).

  The first combination difference value determination unit 172 determines whether it is estimated that there is no edge straddling the upper and lower pixels (step S52). If the determination result is true, the first combination difference value determination is performed (step S52). S53). More specifically, the first combination difference value determination unit 172, for example, based on the difference value data 133, the absolute value of the difference luminance value between the upper left pixel 423 and the lower right pixel 434, and the upper right pixel 424 and the lower left pixel 433. Any of the absolute value of the difference luminance value, the absolute value of the difference luminance value of the upper right pixel 424 and the lower right pixel 435, or the absolute value of the difference luminance value of the upper right pixel 425 and the lower right pixel 434 is any of the upper right pixel 424 and the lower right pixel 434. It is determined whether the difference luminance value is smaller than the absolute value.

  The first interpolation unit 173 determines whether or not the determination result in step S53 is true (step S54). If the determination result in step S54 is true, the first interpolation unit 173 determines whether or not a predetermined case is satisfied (step S55). If the determination result in step S55 is true, interpolation is performed with a pixel value of 3 pixels or 4 pixels depending on the case (step S56).

  FIG. 19 is a schematic diagram showing the relationship between the case and the interpolation pixel in this embodiment. For example, when the combination of the upper right pixel 424 and the lower left pixel 433 is applicable, the interpolation pixels are three pixels of the upper right pixel 424, the lower left pixel 433, and the upper right pixel 424.

  Similarly, the combination of the upper right pixel 425 and the lower right pixel 434, the combination of the upper left pixel 423 and the lower right pixel 434, and the combination of the upper right pixel 424 and the lower right pixel 435 are also three interpolation pixels.

  Further, for example, when a combination of the upper pixel 424 and the lower left pixel 433 and a combination of the upper right pixel 425 and the lower pixel 434 are applicable, the interpolation pixels are 4 of the upper pixel 424, the lower left pixel 433, the upper right pixel 425, and the lower pixel 434. Pixel. Further, for example, when the combination of the upper left pixel 423 and the lower right pixel 434 and the combination of the upper right pixel 424 and the lower right pixel 435 are applicable, the interpolation pixels are the upper left pixel 423, the lower right pixel 434, the upper right pixel 424, and the lower right pixel 435. 4 pixels.

  Further, for example, when a combination of the upper left pixel 423 and the lower right pixel 434 and a combination of the upper right pixel 424 and the lower left pixel 433 are applicable, the interpolation pixels are 4 of the upper left pixel 423, the lower right pixel 434, the upper right pixel 424, and the lower left pixel 433. Pixel. Further, for example, when the combination of the upper right pixel 424 and the lower right pixel 435 and the combination of the upper right pixel 425 and the lower right pixel 434 are applicable, the interpolation pixels are the upper right pixel 424, the lower right pixel 435, the upper right pixel 425, and the lower right pixel 434. 4 pixels.

  In addition, when these cases do not apply or when the result of the first combination difference value determination is false, the first interpolation unit 173 interpolates with the pixel values of two pixels, the upper pixel 424 and the lower pixel 434. (Step S57).

  In addition, when the determination result of step S52 is false, that is, when it is determined that there may be an edge straddling the upper and lower pixels, the second combination difference value determination unit 181 performs the second combination difference value determination ( Step S58). More specifically, for example, the second combination difference value determination unit 181 determines the absolute value of the difference RGB value between the upper left pixel 423 and the lower right pixel 434 based on the difference value data 133, the upper right pixel 424 and the lower left pixel 433. Any of the absolute value of the difference RGB value, the absolute value of the difference RGB value of the upper right pixel 424 and the lower right pixel 435, or the absolute value of the difference RGB value of the upper right pixel 425 and the lower right pixel 434 is smaller than the second threshold value. Determine whether or not.

  Here, the absolute value of the difference RGB value is smaller than the second threshold value, for example, the absolute value of the difference R value is smaller than the R threshold value, and the absolute value of the difference G value is G value. It means that the absolute value of the difference B value is smaller than the threshold value for B and smaller than the threshold value. Further, the R threshold, the G threshold, and the B threshold may be the same value, for example, 2 or the like.

  The interpolation processing unit 190 determines whether or not the determination result in step S58 is true (step S59). If the determination result in step S58 is true, it determines whether or not the vertical difference value is equal to or less than the diagonal difference value (step S60). .

  More specifically, for example, the interpolation processing unit 190 determines a combination that minimizes the absolute value of the difference luminance value from among the pixel combinations used in step S58, and uses it as an oblique difference value according to the combination. A pixel combination is determined. For example, when the absolute value of the difference luminance value between the upper left pixel 423 and the lower pixel 434 is the minimum, the interpolation processing unit 190 determines that the absolute value (upper and lower difference value) of the difference luminance value between the upper pixel 424 and the lower pixel 434 is It is determined whether or not the absolute value (oblique difference value) of the difference luminance value between the upper pixel 424 and the lower right pixel 435 is less than or equal to.

  When the vertical difference value is equal to or smaller than the diagonal difference value, the interpolation processing unit 190 performs interpolation using the pixel values of the upper pixel 424, the lower pixel 434, and another pixel (in this case, the upper left pixel 423) (step S61).

  On the other hand, when the vertical difference value is larger than the diagonal difference value, the interpolation processing unit 190 calculates the diagonal pixel value and any of the upper and lower pixel values (in this case, the pixel values of the upper left pixel 423, the lower right pixel 434, and the lower right pixel 435). ) To perform interpolation (step S62).

  When the determination result in step S58 is false, the low angle diagonal interpolation processing unit 180 performs low angle diagonal interpolation (step S63).

(Description of low-angle diagonal interpolation)
Next, the low angle oblique interpolation (step S63) will be described in more detail. FIG. 20 is a flowchart illustrating an example of a low-angle oblique interpolation procedure in the present embodiment.

  The minimum combination determining unit 182 determines a combination having the smallest diagonal pixel difference value from among the combinations of the upper pixel group 420 of the pixels 421 to 427 and the lower pixel group 430 of the pixels 431 to 437 (step S71).

  The low-angle oblique interpolation unit 183 uses the pixel value of the minimum combination (for example, the combination of the pixel 421 and the pixel 437) and the pixel value of the left horizontal pixel 413, which is an already-exposed pixel on the left side of the interpolation target pixel 414. The interpolated pixel value is calculated (step S72).

  Further, the low-angle oblique interpolation unit 183 calculates a difference value between the pixel value after interpolation and the pixel value of the left lateral pixel 413 (step S73), and whether the difference value is larger than a predetermined value (for example, 1). It is determined whether or not (step S74).

  When the difference value is larger than the predetermined value, the low-angle oblique interpolation unit 183 performs interpolation using the pixel values of the combination of the pixels having the smallest oblique pixel difference value (Step S75).

  On the other hand, when the difference value is equal to or smaller than the predetermined value, the low-angle oblique interpolation unit 183 determines whether the pixel value after the interpolation has a predetermined difference from the pixel values of the upper and lower pixels. For example, the larger of the R value of the upper pixel 424 and the R value of the lower pixel 434 is RMAX, the smaller is RMIN, and the larger of the G value of the upper pixel 424 and the G value of the lower pixel 434 is GMAX. The smaller one is defined as GMIN, the larger one of the B value of the upper pixel 424 and the B value of the lower pixel 434 is BMAX, and the smaller one is BMIN.

  For example, when the combination of the pixel 426 and the pixel 432 is minimum, the low-angle oblique interpolation unit 183 causes the R value of the pixel 426 and the R value of the pixel 432 to be RMIN or more and RMAX or less, the G value of the pixel 426, and the G value of the pixel 432 Is determined to be not less than GMIN and not more than GMAX and whether the B value of the pixel 426 and the B value of the pixel 432 do not satisfy the condition of not less than BMIN and not more than BMAX (there is a predetermined difference), the determination in step S76 is performed.

  When the determination result in step S76 is true, the low-angle oblique interpolation unit 183 performs interpolation using the pixel value of the upper pixel 424 and the pixel value of the lower pixel 434 (step S77).

  On the other hand, when the determination result in step S76 is false, the low-angle oblique interpolation unit 183 performs interpolation using the pixel value of the minimum combination (for example, the pixel 421 and the pixel 437) and the pixel value of the left lateral pixel 413. (Step S78). For example, assuming that the pixel value of the pixel of the upper pixel group 420 that is the minimum combination is a, the pixel value of the pixel of the lower pixel group 430 is b, and the pixel value of the left lateral pixel 413 is c, the pixel value after interpolation is {(A + b) / 2 + c} / 2 may be sufficient, and (a + b + c) / 3 may be sufficient.

  The pixel values after each interpolation process (steps S16, S45, S56, S57, S61, S62, S75, S77, and S78) are stored in the storage unit 130 as post-interpolation data 138, and the image generation unit 198 performs post-interpolation. An image is generated based on the data 138.

  As described above, according to the present embodiment, the projector 100 performs interpolation by determining the continuity and direction of moving image edge pixels, so that even when the inclination of the diagonal line in the image with respect to the horizontal line is small, The occurrence of jaggy can be suppressed.

  Further, according to the present embodiment, the projector 100 can perform accurate interpolation by performing interpolation using pixel values of pixels adjacent to the interpolation target pixel. In particular, the projector 100 can perform more accurate interpolation by preferentially interpolating the pixels close to the interpolation target pixel (for example, the upper pixel 424 and the lower pixel 434).

  In addition, according to the present embodiment, the projector 100 changes the color by interpolating the pixel values of 3 pixels or 4 pixels when the interpolation target pixel is not determined to be any color at the color boundary. Since it can be blurred, the occurrence of jaggy can be suppressed even when the edge is at a low angle or high angle.

  In addition, according to the present embodiment, the projector 100 not only includes the pixel values in the same field image, but also the pixel values of the previous field image, the previous field image, the subsequent field image, and the subsequent field image. By using also, it is possible to make an appropriate determination even when determining a still image region and a moving image region for a moving image in which quick blinking is performed or a moving image in which characters move at high speed. In addition, according to the present embodiment, the projector 100 can perform interpolation according to appropriate determination, and thus can perform interpolation more accurately.

  Further, according to the present embodiment, the projector 100 can perform interpolation more appropriately by performing the first combination difference value determination when there is a high possibility that there is no edge straddling the upper and lower pixels.

  Further, according to the present embodiment, the projector 100 can perform interpolation with the original color by not using the pixel value of the already-existing pixel when the pixel value of the already-existing pixel is significantly different from the pixel value of the interpolation target pixel. it can.

  Further, according to the present embodiment, the projector 100 can prevent a change from the original color by using the pixel values of the upper and lower pixels when there is a predetermined difference when performing low-angle oblique interpolation. it can.

(Other examples)
In addition, application of this invention is not limited to the Example mentioned above, A various deformation | transformation is possible. For example, the luminance value is used in the first combination difference value determination (step S53) and the second combination difference value determination (step S58), but an RGB value may be used.

  Further, the interpolation order is not limited to the above-described embodiment. For example, the projector 100 may perform interpolation in a plurality of stages according to the interpolation type as in the above-described embodiment, or in one stage in order from the upper left pixel to the lower right pixel of the interpolation target field image. Interpolation may be performed.

  In addition, in FIG. 13 described above, it has been described that 7 pixels of the upper pixel group 420 and 7 pixels of the lower pixel group 430 are used. However, the number of pixels used is not limited to 7 each, and 9 pixels 5 It may be individual.

  In FIG. 13 described above, the difference value calculation unit 140 has been described as calculating the difference value of the pixel at the target position. However, the difference value calculation unit 140 calculates the difference value for all combinations of the upper pixel group 420 and the lower pixel group 430. May be.

  Further, specific values such as a threshold value and a predetermined value are not limited to the values in the above-described embodiment, and any value can be applied according to the applied circuit, the number of processing bits, and the like. For example, when the number of processing bits is 10 bits, values such as a threshold value and a predetermined value may be increased compared to when the number of processing bits is 8 bits.

  The display device on which the image processing device 120 can be mounted is not limited to the projector 100, and may be a television, a monitor, a mobile phone, a PDA, or the like, for example.

  The projector 100 is not limited to a liquid crystal projector, and may be a projector using a DMD (Digital Micromirror Device), for example. DMD is a trademark of Texas Instruments Incorporated. The projection method may be a front projection method or a rear projection method, and may be a transmission type or a reflection type such as LCOS (Liquid Crystal On Silicon). Further, the function of the projector 100 may be distributed and implemented in a plurality of devices (for example, a PC and a projector).

It is a figure which shows an example of a moving image interpolation. It is a figure which shows an example of a still image interpolation. FIG. 3A is a diagram illustrating an example of an image that has failed to be interpolated, and FIG. 3B is a diagram illustrating an example of an image that has been successfully interpolated. FIG. 4A is a diagram illustrating an example of an image that has failed to be interpolated, and FIG. 4B is a diagram illustrating an example of an image that has been successfully interpolated. FIG. 5A is a diagram illustrating an example of an image that has failed to be interpolated, and FIG. 5B is a diagram illustrating an example of an image that has been successfully interpolated. It is a figure which shows an example of the functional block of the projector in a present Example. It is a figure which shows an example of the functional block of the determination result production | generation part in a present Example. It is a figure which shows an example of the functional block of the moving image edge pixel interpolation process part in a present Example. It is a figure which shows an example of the functional block of the high angle diagonal interpolation process part in a present Example. It is a figure which shows an example of the functional block of the low angle diagonal interpolation process part in a present Example. It is a flowchart which shows an example of the image processing procedure in a present Example. It is a flowchart which shows an example of the IP conversion procedure in a present Example. It is a flowchart which shows an example of the static determination procedure in a present Example. It is a schematic diagram of the pixel in the circumference | surroundings of the interpolation object pixel and interpolation object pixel in a present Example. It is a flowchart which shows an example of the 1st moving image edge pixel interpolation procedure in a present Example. It is a figure which shows an example of the image in which a low angle diagonal line exists in a present Example. It is a schematic diagram which shows the interpolation system in the case of the image in which a low angle diagonal line exists in a present Example. It is a flowchart which shows an example of the 2nd moving image edge pixel interpolation procedure in a present Example. It is a schematic diagram which shows the relationship between the case and interpolation pixel in a present Example. It is a flowchart which shows an example of the low angle diagonal interpolation procedure in a present Example.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 100 Projector (display apparatus), 110 Image signal input part, 120 Image processing apparatus, 130 Memory | storage part, 131 Pixel value data, 132 Judgment result data, 133 Difference value data, 134 Two fields before field difference value data, 135 Two behind Field difference value data, 136 Previous field difference value data, 137 Next field difference value data, 138 Post-interpolation data, 140 Difference value calculation unit, 150 Determination result data generation unit, 151 Static motion determination unit, 152 Two Previous field difference value calculation unit, 153 One previous field difference value calculation unit, 154 Two subsequent field difference value calculation units, 155 One next field difference value calculation unit, 156 Video determination value generation unit, 157 Surrounding region determination unit, 158 Edge determination unit, 159 region determination unit, 160 video edge pixel interpolation processing , 161 continuity determination unit, 162 direction determination unit, 163 candidate pixel determination unit, 164 moving image edge pixel interpolation unit, 170 image signal input unit, 171 vertical difference value determination unit, 172 first combination difference value determination unit, 173 First interpolation unit, 180 Low angle diagonal interpolation processing unit, 181 Second combination difference value determination unit, 182 Low angle diagonal interpolation unit, 183 Low angle diagonal interpolation unit, 190 Interpolation processing unit, 198 Image generation unit (display unit) 199 Projection unit (display unit), 200 Information storage medium, 414 Interpolation target pixel, 420 Upper pixel group, 423 Upper left pixel, 424 Right upper pixel, 425 Upper right pixel, 430 Lower pixel group, 433 Lower left pixel, 434 Right lower pixel 435 Lower right pixel

Claims (5)

In an image processing apparatus that converts an interlaced image into a progressive image by performing an interpolation process on the interlaced image,
A static determination unit that determines whether the interpolation target pixel in the interpolation target field image is in the still image region or the moving image region based on the image signal of the interlaced image;
A pixel value of a first plurality of pixels located in a line one line above or one line below the interpolation target pixel in the interpolation target field image and around the interpolation target pixel, and the interpolation target field The difference value of each pixel value at the corresponding pixel position between the fields with the pixel value of the second plurality of pixels at the pixel position corresponding to the first plurality of pixels in the field image two before the image as a target A second previous field difference value calculation unit for calculating a plurality of second previous field difference values,
The pixel values of the third plurality of pixels that are located in the line one line above or one line below the pixel to be interpolated and are around the pixel to be interpolated, and two pixels after the field image to be interpolated For a pixel value of a fourth plurality of pixels at a pixel position corresponding to the third plurality of pixels in the field image, a plurality of two subsequent values that are the difference values of each pixel value at a position corresponding between the fields A second field difference value calculation unit for calculating a field difference value;
The first calculation is performed using the plurality of second previous field difference values, the pixel position of the second previous field difference value, and the plurality of second subsequent field difference values at corresponding pixel positions between fields. A first moving image determination value generation unit that generates a first moving image determination value for each corresponding pixel position;
A first peripheral region determination unit that performs a first peripheral region determination to determine whether at least one of the first moving image determination values is equal to or greater than a first predetermined value;
When the static motion determination unit determines that the interpolation target pixel is in the still image region and the determination result of the first peripheral region determination is true, the interpolation target pixel is a moving image region And the static motion determination unit determines that the interpolation target pixel is in the still image region, and the determination result of the first peripheral region determination is false. An area determining unit that determines that the interpolation target pixel is in a still image area;
including,
Image processing device. The image processing apparatus according to claim 1.
The pixel values of the two pixels on the left and right of the interpolation target pixel in the interpolation target field image, and the two pixels at the pixel positions corresponding to the left and right pixels in the field image immediately before the interpolation target field image A previous field difference value calculation unit that calculates two previous field difference values that are difference values from the pixel value;
The pixel values of the two pixels on the left and right of the interpolation target pixel in the interpolation target field image, and the two pixels at the pixel positions corresponding to the left and right pixels in the field image immediately after the interpolation target field image A next-next field difference value calculation unit that calculates two next-next field difference values that are difference values from the pixel value;
A second calculation is performed using the two previous field difference values, the pixel position of the previous field difference value, and the two next field difference values at the corresponding pixel positions between fields. A second moving image determination value generating unit for generating a second moving image determination value;
A second peripheral region determination unit that performs a second peripheral region determination to determine whether at least one second moving image determination value is equal to or greater than a second predetermined value;
Including
The region determination unit is a case where the interpolation target pixel is determined to be in a still image region by the static motion determination, and the determination result of the first peripheral region determination is false, and When the determination result of the second peripheral region determination is true, it is determined that the interpolation target pixel is in the moving image region, and it is determined by the static motion determination that the interpolation target pixel is in the still image region. If the determination result of the first surrounding area determination is false and the determination result of the second surrounding area determination is false, it is determined that the interpolation target pixel is in a still image area. To
Image processing device. An image processing apparatus according to any one of claims 1 and 2,
A display unit for displaying the progressive image converted by the interpolation process;
including,
Display device. A program for converting an interlaced image into a progressive image by performing an interpolation process on the interlaced image,
Computer
A static determination unit that determines whether the interpolation target pixel in the interpolation target field image is in the still image region or the moving image region based on the image signal of the interlaced image;
A pixel value of a first plurality of pixels located in a line one line above or one line below the interpolation target pixel in the interpolation target field image and around the interpolation target pixel, and the interpolation target field The difference value of each pixel value at the corresponding pixel position between the fields with the pixel value of the second plurality of pixels at the pixel position corresponding to the first plurality of pixels in the field image two before the image as a target A second previous field difference value calculation unit for calculating a plurality of second previous field difference values,
The pixel values of the third plurality of pixels that are located in the line one line above or one line below the pixel to be interpolated and are around the pixel to be interpolated, and two pixels after the field image to be interpolated For a pixel value of a fourth plurality of pixels at a pixel position corresponding to the third plurality of pixels in the field image, a plurality of two subsequent values that are the difference values of each pixel value at a position corresponding between the fields A second field difference value calculation unit for calculating a field difference value;
The first calculation is performed using the plurality of second previous field difference values, the pixel position of the second previous field difference value, and the plurality of second subsequent field difference values at corresponding pixel positions between fields. A first moving image determination value generation unit that generates a first moving image determination value for each corresponding pixel position;
A first peripheral region determination unit that performs a first peripheral region determination to determine whether at least one of the first moving image determination values is equal to or greater than a first predetermined value;
When the static motion determination unit determines that the interpolation target pixel is in the still image region and the determination result of the first peripheral region determination is true, the interpolation target pixel is a moving image region And the static motion determination unit determines that the interpolation target pixel is in the still image region, and the determination result of the first peripheral region determination is false. Function as an area determination unit that determines that the interpolation target pixel is in a still image area,
program. An information storage medium storing a computer-readable program,
The program according to claim 4 is stored,
Information storage medium.

Images