JP2018160725A - Video signal processor, video signal processing method, and video signal processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video signal processor with which it is possible to generate an interpolation frame not susceptible to picture quality degradation.SOLUTION: An additional information area detection unit 2 detects the additional information area of a static image present in the video signal of a moving image. A static interpolation source signal selection unit 51 selects a first and a second static interpolation source pixel in a first and a second frame at the same positions as interpolation pixels of an interpolation frame interpolated between the first and the second frame. A motion interpolation source signal selection unit 52 selects a first and a second motion interpolation source pixel in the first and the second frame in a direction indicated by a motion vector. An interpolation signal generation unit 6 generates an interpolated video signal in accordance with case separation based on whether each of the first and the second static interpolation source pixel, the first motion interpolation source pixel, and the second motion interpolation source pixel is located within the additional information area and the magnitude relation of a first difference value between the first and the second static interpolation source pixel and a second difference value between the first and the second motion interpolation source pixel.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a video signal processing apparatus, a video signal processing method, and a video signal processing program for generating an interpolation frame to be interpolated between adjacent frames in a video signal.

  In recent years, in a video signal display device, it is common to display a moving image that is smooth and less blurred by interpolating an interpolated frame between adjacent frames in a video signal to increase the frame rate. The video signal processing device detects a motion vector of an image, selects a pixel in an adjacent frame based on the motion vector, and generates each interpolation pixel in the interpolation frame.

JP 2011-205519 A JP-A-11-205679

  Additional information such as captions, telops, and OSD (On Screen Display) information may be superimposed on the video signal (see Patent Document 1). The OSD information is characters, symbols, figures, etc. indicating information such as channel number, volume, menu, etc. in the television receiver. When the additional information of the still image is superimposed on the video signal of the moving image, the motion of the image differs between the moving image area and the additional information area in the frame.

  Then, it becomes difficult to detect the motion vector of the image at the boundary between the moving image and the additional information. If a motion vector is erroneously detected, an interpolation pixel cannot be generated correctly, resulting in degradation of the image quality of the interpolation frame. In particular, the image quality is noticeably deteriorated in the area where the additional information is superimposed and in the vicinity thereof. Even for a video signal on which additional information is superimposed, it is desired to generate an interpolation frame with little image quality degradation.

  An object of the present invention is to provide a video signal processing device, a video signal processing method, and a video signal processing program capable of generating an interpolation frame with little image quality degradation even for a video signal on which additional information is superimposed. To do.

  The present invention provides an additional information area detecting unit for detecting an additional information area of a still image existing in each frame of an input video signal of a moving image, and at least adjacent first and second frames in the video signal. A motion vector detection unit that detects a motion vector of the moving image based on the pixel, and static interpolation of the interpolation pixel at each pixel position of the interpolation frame interpolated between the first and second frames in the video signal In order to do so, a still interpolation source signal selection unit that selects and outputs the first and second still interpolation source pixels in the first and second frames at the same position as each pixel position, and each of the interpolation frames In order to interpolate the interpolated pixel at the pixel position, the first and second directions in the direction indicated by the motion vector detected by the motion vector detection unit A motion interpolation source signal selection unit that selects and outputs the first and second motion interpolation source pixels in the frame; a first difference value of the first and second static interpolation source pixels; and the first and second motion interpolation source pixels. A second difference value of the second motion interpolation source pixel, and the first and second static interpolation source pixels, the first motion interpolation source pixel, and the second motion interpolation source pixel are: , Depending on whether or not it is located in the additional information area detected by the additional information area detection unit, and the case classification based on the magnitude relationship between the first difference value and the second difference value A state in which the interpolation pixel is generated using only the first and second still interpolation source pixels, and the first and second still interpolation source pixels and the first and second motion interpolation source pixels. A state in which the interpolation pixel is generated using both, and only the first motion interpolation source pixel The state of generating the interpolation pixel, the state of generating the interpolation pixel using only the second motion interpolation source pixel, and the interpolation pixel using only the first and second motion interpolation source pixels. There is provided an image signal processing device comprising an interpolation signal generation unit that selects an generation state and generates an interpolation image signal that is the interpolation frame.

  The present invention detects an additional information area of a still image present in each frame of a video signal of an input moving image, and based on at least adjacent first and second frame pixels in the video signal, In order to detect a motion vector of a moving image and perform static interpolation on the interpolation pixel at each pixel position of the interpolation frame interpolated between the first and second frames in the video signal, the same position as each pixel position Selected by the motion vector detection unit to select the first and second static interpolation source pixels in the first and second frames and to interpolate the interpolation pixels at the respective pixel positions of the interpolation frame. First and second motion interpolation source pixels in the first and second frames in the direction indicated by the motion vector are selected, and the first and second static interpolation pixels are selected. A first difference value of the interpolation source pixel and a second difference value of the first and second motion interpolation source pixels are calculated, the first and second static interpolation source pixels, and the first difference value Whether or not the motion interpolation source pixel and the second motion interpolation source pixel are respectively located in the additional information area, and the magnitude relationship between the first difference value and the second difference value. According to the case classification, the state of generating the interpolation pixel using only the first and second still interpolation source pixels, the first and second still interpolation source pixels, the first and second A state in which the interpolation pixel is generated using both of the motion interpolation source pixels, a state in which the interpolation pixel is generated using only the first motion interpolation source pixel, and only the second motion interpolation source pixel. And using only the first and second motion interpolation source pixels to generate the interpolation pixel Select a state for generating a serial interpolated pixel, to provide a video signal processing method characterized by generating an interpolated video signal is the interpolation frame.

  According to the present invention, a step of detecting an additional information area of a still image present in each frame of a video signal of a moving image input to a computer, and pixels of at least adjacent first and second frames in the video signal To detect a motion vector of the moving image based on the image signal, and to statically interpolate the interpolation pixel at each pixel position of the interpolation frame interpolated between the first and second frames in the video signal, Selecting the first and second static interpolation source pixels in the first and second frames at the same position as the respective pixel positions, and motion interpolating the interpolated pixels at the respective pixel positions in the interpolation frame , First and second frames in the first and second frames in the direction indicated by the motion vector detected by the motion vector detection unit. Selecting a second motion interpolation source pixel; a first difference value of the first and second still interpolation source pixels; a second difference value of the first and second motion interpolation source pixels; And calculating whether the first and second static interpolation source pixels, the first motion interpolation source pixel, and the second motion interpolation source pixel are located in the additional information area, respectively. The interpolation pixel is determined using only the first and second static interpolation source pixels depending on whether or not and based on the magnitude relationship between the first difference value and the second difference value. A state of generating, a state of generating the interpolation pixel using both the first and second static interpolation source pixels and the first and second motion interpolation source pixels, and the first motion interpolation source pixel. A state in which the interpolation pixel is generated using only the second motion interpolation source pixel Selecting the state for generating the interpolation pixel and the state for generating the interpolation pixel using only the first and second motion interpolation source pixels, and generating an interpolated video signal that is the interpolation frame; A video signal processing program is provided.

  According to the video signal processing device, the video signal processing method, and the video signal processing program of the present invention, it is possible to generate an interpolated frame with little image quality degradation even for a video signal on which additional information is superimposed.

It is a block diagram which shows the video signal processing apparatus of 1st Embodiment. It is a figure which shows the 1st example of an additional information area | region. It is a figure which shows the 2nd example of an additional information area | region. It is a figure which shows an example of a static interpolation original pixel and a motion interpolation original pixel for producing | generating the interpolation pixel of the predetermined position in an interpolation frame. It is a block diagram which shows the specific structural example of the interpolation signal generation part 6 in FIG. It is a figure which shows the example of case division when the video signal processing apparatus and method of 1st Embodiment produce | generate an interpolation pixel. It is a figure which shows the example of case division when the video signal processing apparatus and method of 2nd Embodiment produce | generate an interpolation pixel. It is a block diagram which shows the video signal processing apparatus of 3rd Embodiment. It is a block diagram which shows the schematic structure of the computer which performs the video signal processing program of 1st-3rd embodiment. It is a flowchart which shows the process which the video signal processing program of 1st-3rd embodiment performs.

  Hereinafter, a video signal processing device, a video signal processing method, and a video signal processing program of each embodiment will be described with reference to the accompanying drawings.

<First Embodiment>
The operation of the video signal processing apparatus according to the first embodiment and the video signal processing method according to the first embodiment will be described with reference to FIGS. In FIG. 1, a video signal on which additional information such as caption, telop, and OSD information is superimposed is input to an additional information area detection unit 2, a frame memory 3, a motion vector detection unit 4, and an interpolation source signal selection unit 5. Is done. The video signal is assumed to be 8 bits.

  For example, the additional information includes a score superimposed on a sports broadcast video signal, a broadcast station mark, and the like. Assume that additional information of a still image is superimposed on a video signal of a moving image.

  The frame memory 3 delays each frame of the input video signal by one frame to generate a delayed video signal. The delayed video signal is input to the additional information region detection unit 2, the motion vector detection unit 4, and the interpolation source signal selection unit 5. The interpolation source signal selection unit 5 includes a static interpolation source signal selection unit 51 and a motion interpolation source signal selection unit 52. An input video signal frame (first frame) is referred to as a current frame F0, and a delayed video signal frame (second frame) is referred to as a previous frame F1.

  The additional information area detection unit 2 detects whether each pixel position in each frame is an area where additional information is superimposed (hereinafter referred to as an additional information area), and detects a detection signal Sdet indicating the additional information area. Is generated. The detection signal Sdet is, for example, a signal having a value “1” at a pixel position detected as an additional information area and a value “0” at a pixel position detected as not being an additional information area.

  For example, the additional information area detection unit 2 can detect a pixel position that does not change over a plurality of frames and whose movement is different from the surrounding area as the additional information area. The additional information area detection unit 2 can also detect the additional information area by the method described in Patent Document 2. The additional information area detection unit 2 may use any method for detecting the additional information area.

  The additional information area detection unit 2 supplies the detection signal Sdet to the interpolation signal generation unit 6. As shown in FIGS. 2A and 2B, a case where character information ABC is superimposed on the frame F as additional information is taken as an example. The additional information area detection unit 2 may generate a detection signal Sdet having a value “1” in an area surrounding the character information in a rectangular shape as shown in FIG. 2A, or as shown in FIG. 2B. A detection signal Sdet having a value “1” in an area surrounding the outer shape of the signal may be generated.

  The motion vector detection unit 4 performs block matching on a pixel basis or on a block basis of a plurality of pixels in the adjacent current frame F0 and previous frame F1, and detects a motion vector MV between the current frame F0 and the previous frame F1. . For example, the motion vector detection unit 4 uses 64 pixels of 8 horizontal pixels and 8 vertical pixels as a block, and obtains a difference between the blocks of the current frame F0 and the previous frame F1 in a plurality of directions passing through the interpolation pixel to be generated. The motion vector detection unit 4 detects the direction with the smallest difference as the motion vector MV.

  The motion vector detection unit 4 supplies the motion vector MV to the motion interpolation source signal selection unit 52. A frame memory that delays the current frame F0 by 2 frames or more may be provided, and the motion vector MV may be detected using a plurality of frames of 3 frames or more.

  An interpolation frame interpolated between the current frame F0 and the previous frame F1 is referred to as an interpolation frame F01. As shown in FIG. 3, the static interpolation source signal selection unit 51 performs the static interpolation on each interpolation pixel Pi that constitutes the interpolation frame F01. The pixel S1 is selected and output.

  Pixels S0 and S1 are first and second static interpolation source pixels necessary for static interpolation of the interpolation pixel Pi. The still vector SV is a vector in a direction connecting the pixel of the current frame F0 and the pixel of the previous frame F1 at the same position as each interpolation pixel Pi. The pixels S0 and S1 are pixels at the same position as the interpolation pixel Pi in the current frame F0 and the previous frame F1.

  As shown in FIG. 3, the motion interpolation source signal selection unit 52 performs the motion interpolation on each interpolation pixel Pi constituting the interpolation frame F01, so that the pixel M0 and the previous frame F1 in the current frame F0 in the direction indicated by the motion vector MV. Are selected and output. Pixels M0 and M1 are first and second motion interpolation source pixels necessary for motion interpolation of the interpolation pixel Pi.

  The interpolation pixel Pi shown in FIG. 3 exemplifies one of the interpolation pixels constituting the interpolation frame F01, and the direction of the motion vector MV is an example. Similarly, the interpolation source signal selection unit 5 selects the pair of the pixels S0 and S1 and the pair of the pixels M0 and M1 at the positions of all the interpolation pixels in the interpolation frame F01, and supplies them to the interpolation signal generation unit 6. .

  The interpolation signal generation unit 6 refers to the detection signal Sdet and generates each interpolation pixel Pi as described later, thereby outputting an interpolation video signal that is an interpolation frame F01. The interpolation signal generation unit 6 may generate the interpolation pixel Pi using only the pixels S0 and S1, and may generate the interpolation pixel Pi using both the pixels S0 and S1 and the pixels M0 and M1. The interpolation signal generation unit 6 may generate the interpolation pixel Pi using only the pixels M0 and M1, and may generate the interpolation pixel Pi using only the pixel M0 or M1.

  As illustrated in FIG. 4, the interpolation signal generation unit 6 includes difference calculation units 61 and 62 and an interpolation pixel generation unit 63. The difference calculation unit 61 calculates a difference value Ds (first difference value) between the pixel S0 and the pixel S1 and supplies the difference value Ds to the interpolation pixel generation unit 63. The difference calculation unit 62 calculates a difference value Dm (second difference value) between the pixel M0 and the pixel M1 and supplies the difference value Dm to the interpolation pixel generation unit 63.

  The interpolation pixel generation unit 63 refers to the detection signal Sdet, determines whether the pixels S0 and S1 are pixels in the additional information area, whether the pixel M0 is a pixel in the additional information area, and whether the pixel M1 is The calculation formula for generating the interpolation pixel Pi is varied depending on whether or not the pixel is in the additional information area. In addition to this, the interpolation pixel generation unit 63 may change the calculation formula for generating the interpolation pixel Pi according to the magnitude relationship between the difference value Ds and the difference value Dm.

  Specifically, as an example, the interpolation signal generation unit 6 generates the interpolation pixel Pi for each case as shown in FIG. In the column of the additional information area determination result in FIG. 5, “determine as additional information area” means that the interpolation signal generation unit 6 sets the interpolation pixel Pi based on the detection signal Sdet supplied from the additional information area detection unit 2. This indicates that it is determined that the pixels S0 and S1, the pixel M0, and the pixel M1 selected to be generated are located in the additional information area.

  In FIG. 5, “arbitrary” indicates that it may be determined to be located within the additional information area, or may be determined to be located outside the additional information area.

  In each case shown in the additional information area determination result column, the interpolation signal generation unit 6 divides the case into a case where the difference value Ds is smaller than the difference value Dm and a case where the difference value Ds is greater than or equal to the difference value Dm. The interpolation pixel Pi is generated.

  Since the additional information area is an area where the additional information of the still image is superimposed, the difference value Ds is originally smaller than the difference value Dm. However, the difference value Ds may be greater than or equal to the difference value Dm due to erroneous detection of the additional information area by the additional information area detection unit 2.

  As shown in FIG. 5, a combination of states in which it is determined that the pixels S0 and S1 are located in the additional information area and the pixels M0 and M1 are not located in the additional information area (1) And When the difference value Ds is smaller than the difference value Dm in the combination (1), the interpolation signal generation unit 6 is considered to detect the additional information region correctly. Therefore, the interpolation signal generation unit 6 sets the average value of the pixels S0 and S1 as the interpolation pixel Pi based on the calculation formula (S0 + S1) / 2.

  When the difference value Ds is equal to or greater than the difference value Dm in the combination (1), the interpolation signal generation unit 6 may cause the additional information region detection unit 2 to erroneously detect the additional information region. Therefore, the interpolation signal generation unit 6 generates the interpolation pixel Pi based on the calculation formula {(1−C) × (S0 + S1) + C × (M0 + M1)} / 2. As an example, the interpolation signal generation unit 6 sets C to 1 if (Ds−Dm) is 128 or more, and sets C to (Ds−Dm) / 128 if (Ds−Dm) is 0 or more and less than 128.

  When (Ds−Dm) is 0 or more and less than 128, the interpolation signal generation unit 6 increases the ratio of the average values of the pixels M0 and M1 as the (Ds−Dm) increases, so that the pixels S0 and S1 and the pixel M0 are increased. And M1 are weighted averaged to generate an interpolated pixel Pi. When the difference value Ds is much larger than the difference value Dm (Ds−Dm) is 128 or more, the interpolation signal generation unit 6 sets the average value of the pixels M0 and M1 as the interpolation pixel Pi.

  Even if the motion vector MV is accurately detected, if the additional information area is erroneously detected, the difference value Dm may be smaller than the difference value Ds even in the additional information area. Rather than generating the interpolation pixel Pi only with the average value of the pixels S0 and S1, the interpolation pixel Pi is generated by weighted averaging of the pixels S0 and S1 and the pixels M0 and M1, or the average value of the pixels M0 and M1 Only by generating the interpolation pixel Pi, it is possible to suppress deterioration in image quality in the additional information area and its surroundings.

  A state in which it is determined that the pixels S0 and S1 are located in the additional information area and the pixel M0 is located in the additional information area (the pixel M1 is arbitrary) is a combination (2). A state in which it is determined that the pixels S0 and S1 are located in the additional information area and the pixel M1 is located in the additional information area (the pixel M0 is arbitrary) is defined as a combination (3). When it is determined that at least one of the pixel M0 and the pixel M1 is located in the additional information area, if the interpolation pixel Pi is generated using the pixel M0 and the pixel M1 as in the combination (1), the image quality is reduced. There is a risk of deterioration.

  Therefore, in the combinations (2) and (3), the interpolation signal generation unit 6 determines whether the difference value Ds is smaller than the difference value Dm or the difference value Ds is equal to or greater than the difference value Dm. ) / 2, the average value of the pixels S0 and S1 is set as the interpolation pixel Pi.

  A state in which it is determined that the pixels S0 and S1 are not located in the additional information area and the pixels M0 and M1 are located in the additional information area is defined as a combination (4). In the combination (4), when the difference value Ds is smaller than the difference value Dm, the interpolation signal generation unit 6 calculates the average value of the pixels S0 and S1 as the interpolation pixel in both cases where the difference value Ds is greater than or equal to the difference value Dm. Pi. In this case, it is considered that the pixels M0 and M1 are located in the additional information areas at different positions which coincide with each other in the direction of the motion vector MV, so that the average value of the pixels S0 and S1 is the interpolation pixel Pi. However, image quality deterioration can be suppressed.

  It is determined that the pixels S0 and S1 are not located in the additional information area, the pixel M0 is determined not to be located in the additional information area, and the pixel M1 is determined not to be located in the additional information area. The state is set to combination (5). In the combination (5), the interpolation signal generation unit 6 sets the pixel M1 as the interpolation pixel Pi regardless of the magnitude relationship between the difference value Ds and the difference value Dm. Since it is assumed that the additional information area hardly moves, image quality deterioration can be suppressed when the pixel M1 determined not to be located in the additional information area is used as the interpolation pixel Pi.

  It is determined that the pixels S0 and S1 are not located in the additional information area, the pixel M0 is determined not to be located in the additional information area, and the pixel M1 is determined not to be located in the additional information area. The state is set to combination (6). In the combination (6), the interpolation signal generation unit 6 sets the pixel M0 as the interpolation pixel Pi regardless of the magnitude relationship between the difference value Ds and the difference value Dm. Similarly, image quality deterioration can be suppressed when the pixel M0 determined not to be located in the additional information area is set as the interpolation pixel Pi.

  A state in which it is determined that the pixels S0 and S1, the pixel M0, and the pixel M1 are not located in the additional information area is a combination (7). In the combination (7), the interpolation signal generation unit 6 sets the average value of the pixels M0 and M1, which is normal motion interpolation, as the interpolation pixel Pi regardless of the magnitude relationship between the difference value Ds and the difference value Dm.

  As described above, in the first embodiment, the additional information area detection unit 2 detects the additional information area in the frame, and the interpolation signal generation unit 6 determines that the pixels S0 and S1, the pixel M0, and the pixel M1 are additional information. Cases are divided according to whether or not they are located in the area. The interpolation signal generation unit 6 selects any one of the combinations (1) to (7) to generate the interpolation pixel Pi.

  According to the video signal processing apparatus and method of the first embodiment, it is possible to generate an interpolation frame (interpolated video signal) with little image quality degradation, even for a video signal on which additional information is superimposed.

Second Embodiment
The configuration of the second embodiment is the same as that of the first embodiment shown in FIG. 1, and the specific operations of the additional information region detection unit 2 and the interpolation signal generation unit 6 are different from those of the first embodiment. Therefore, the video signal processing apparatus and method according to the second embodiment will be described focusing on differences from the video signal processing apparatus and method according to the first embodiment.

  In the second embodiment, the additional information area detection unit 2 detects the probability that each pixel position is an additional information area in a plurality of stages, and generates a detection value in a plurality of stages. The interpolation signal generation unit 6 generates an interpolation pixel Pi by dividing the case according to whether the detected values of the pixels S0 and S1, the pixel M0, and the pixel M1 are located in the additional information area. To do.

  For example, a value “0” indicating that it is not an additional information area, a value “1” indicating that there is a possibility of being an additional information area, The value “2” indicates that there is a high possibility of being an additional information area. In FIG. 1, the additional information area detection unit 2 supplies a detection signal Sdet indicating one of values “0”, “1”, and “2” to the interpolation signal generation unit 6 in units of pixels.

  The value “2” corresponds to the case where it is detected as an additional information area in the first embodiment, and the value “0” corresponds to the case where it is detected as not an additional information area in the first embodiment. To do.

  As an example, the interpolation pixel generation unit 63 generates the interpolation pixel Pi for each case as shown in FIG. The method of generating the interpolation pixel Pi in the combinations (1), (13), (18), and (20) in FIG. 6 is the same as that in the combinations (1), (5) to (7) in FIG.

When the pixel M0 has the value “2” in the combination (2) in FIG. 6, the method of generating the interpolation pixel Pi is the same as that in the combination (2) in FIG. When the pixel M1 has the value “2” in the combination (3) in FIG. 6, the method of generating the interpolation pixel Pi is the same as that in the combination (3) in FIG. When the pixels S0 and S1 have the value “0” in the combination (4) in FIG. 6, the method of generating the interpolation pixel Pi is the same as that in the combination (4) in FIG.
But

  In the combinations (5) to (12), (14) to (17), and (19), the interpolation signal generation unit 6 has a case where the difference value Ds is smaller than the difference value Dm, and the difference value Ds is greater than or equal to the difference value Dm. The interpolated pixel Pi is generated based on the calculation formula shown in FIG.

  According to the video signal processing apparatus and method of the second embodiment, it is possible to generate an appropriate interpolation pixel Pi according to the probability of a plurality of stages as the additional information area, and to generate an interpolation frame with little image quality degradation. Can do.

<Third Embodiment>
In the video signal processing apparatus of the third embodiment shown in FIG. 7, the same parts as those of the video signal processing apparatus of the first embodiment shown in FIG.

  The video signal processing apparatus according to the third embodiment shown in FIG. 7 includes an OSD superimposing unit 1 that superimposes OSD information on a video signal. When the OSD superimposing instruction signal is input to the OSD superimposing unit 1, the OSD superimposing unit 1 superimposes the OSD information on the video signal.

  The OSD superimposing unit 1 supplies a video signal on which the OSD information is superimposed to the additional information region detecting unit 2. The position where the OSD superimposing unit 1 superimposes the OSD information is determined in advance, and the OSD superimposing unit 1 supplies the OSD superimposing position information to the additional information area detecting unit 2. The additional information area detection unit 2 generates a detection signal Sdet indicating the additional information area based on the OSD superposition position information.

  The additional information area detection unit 2 may detect the additional information area based only on the OSD superimposition position information, but in addition to detecting the additional information area by the same method as in the first and second embodiments, the OSD The additional information area may be detected based on the superposition position information.

  In the video signal processing apparatus and method according to the third embodiment, the interpolation signal generation unit 6 may generate the interpolation pixel Pi according to the case classification shown in FIG. 5, or generate the interpolation pixel Pi according to the case classification shown in FIG. May be.

<Video signal processing program>
It is also possible to cause a computer to execute the operations of the video signal processing apparatuses of the first to third embodiments by a computer program (video signal processing program).

  In FIG. 8, the computer 20 includes a central processing unit 21 (hereinafter, CPU 21) and a storage unit 22. The storage unit 22 is a non-temporary storage medium. A video signal is input to the CPU 21. The storage unit 22 stores a video signal processing program. The storage unit 22 is a ROM or a hard disk drive.

  The video signal processing programs that cause the computer 20 to execute the operations of the video signal processing apparatuses of the first to third embodiments are referred to as video signal processing programs of the first to third embodiments, respectively. FIG. 9 shows processing executed by the computer 20 in common with the video signal processing programs of the first to third embodiments.

  In FIG. 9, the video signal processing program causes the computer 20 to sequentially input pixels in the frame in step S1. In step S2, the video signal processing program causes the computer 20 to detect the additional information area. In step S3, the video signal processing program causes the computer 20 to detect a motion vector.

  In step S4, the video signal processing program causes the computer 20 to select and output the pixels S0 and S1 at the pixel position to be generated. In step S5, the video signal processing program causes the computer 20 to select and output the pixels M0 and M1 based on the motion vector. In step S6, the video signal processing program causes the computer 20 to calculate the difference values Ds and Dm.

  In step S <b> 7, the video signal processing program causes the computer 20 to generate the interpolation pixel Pi based on the detection result of the additional information area and the case classification according to the magnitude relationship between the difference value Ds and the difference value Dm. In step S8, the video signal processing program causes the computer 20 to determine whether or not all the interpolation pixels Pi within the interpolation frame have been generated.

  If all the interpolation pixels Pi in the interpolation frame have not been generated (NO), the video signal processing program causes the computer 20 to repeatedly execute the processes of steps S4 to S8. If all the interpolation pixels Pi within the interpolation frame have been generated (YES), the image signal processing program causes the computer 20 to determine whether or not there is a next frame in step S9.

  If there is a next frame (YES), the image signal processing program causes the computer 20 to repeatedly execute the processes of steps S1 to S9. If there is no next frame (NO), the video signal processing program ends the process.

  In step S7, the video signal processing program of the first embodiment causes the computer 20 to generate the interpolation pixel Pi according to the case classification shown in FIG. In step S7, the video signal processing program of the second embodiment causes the computer 20 to generate the interpolation pixel Pi according to the case classification shown in FIG.

  In step S2, the video signal processing program according to the third embodiment causes the computer 20 to detect the additional information area based only on the OSD superposition position information or by the same method as in the first and second embodiments. In addition, the additional information area is detected based on the OSD superposition position information.

  The video signal processing program may be stored in a non-transitory storage medium and provided to the user. The video signal processing program may be provided to the user (computer 20) via an arbitrary network such as the Internet.

  The present invention is not limited to the first to third embodiments described above, and various modifications can be made without departing from the scope of the present invention.

DESCRIPTION OF SYMBOLS 1 OSD superimposition part 2 Additional information area | region detection part 3 Frame memory 4 Motion vector detection part 5 Interpolation source signal selection part 6 Interpolation signal generation part 20 Computer 21 Central processing unit 22 Storage part 51 Static interpolation source signal selection part 52 Motion interpolation source signal Select part

Claims (9)

An additional information area detection unit for detecting an additional information area of a still image present in each frame of the video signal of the input moving image;
A motion vector detection unit that detects a motion vector of the moving image based on at least adjacent pixels of the first and second frames in the video signal;
In order to statically interpolate interpolation pixels at respective pixel positions of an interpolation frame interpolated between the first and second frames in the video signal, the first and second frames at the same positions as the respective pixel positions A static interpolation source signal selection unit that selects and outputs the first and second static interpolation source pixels in
First and second motion interpolations in the first and second frames in the direction indicated by the motion vector detected by the motion vector detection unit in order to interpolate the interpolation pixel at each pixel position of the interpolation frame. A motion interpolation source signal selector that selects and outputs the source pixel;
Calculating a first difference value between the first and second still interpolation source pixels and a second difference value between the first and second motion interpolation source pixels, and the first and second still interpolations; Whether or not the original pixel, the first motion interpolation source pixel, and the second motion interpolation source pixel are respectively located in the additional information area detected by the additional information area detection unit; and According to the case classification based on the magnitude relationship between the first difference value and the second difference value, the state of generating the interpolation pixel using only the first and second still interpolation source pixels; A state in which the interpolation pixel is generated using both the first and second static interpolation source pixels and the first and second motion interpolation source pixels, and only the first motion interpolation source pixel is used. The interpolation pixel is generated using only the state of generating the interpolation pixel and only the second motion interpolation source pixel. And it states that, by selecting the condition for generating the interpolated pixel by using only the first and second motion interpolation based on pixels, and the interpolation signal generator for generating an interpolated video signal is said interpolated frame,
A video signal processing apparatus comprising: In the interpolation signal generation unit, the first and second static interpolation source pixels are located in the additional information area, and the first and second motion interpolation source pixels are located in the additional information area. When the first difference value is greater than or equal to the second difference value,
If the difference obtained by subtracting the second difference value from the first difference value is greater than or equal to a predetermined value, the average value of the first and second motion interpolation source pixels is the interpolation pixel,
If the difference obtained by subtracting the second difference value from the first difference value is less than the predetermined value, the difference obtained by subtracting the second difference value from the first difference value becomes larger. A value obtained by weighted averaging the first and second static interpolation source pixels and the first and second motion interpolation source pixels so that the ratio of the average values of the first and second motion interpolation source pixels is increased. The video signal processing apparatus according to claim 1, wherein the interpolated pixel is used.   In the interpolation signal generation unit, the first and second static interpolation source pixels are located in the additional information area, and the first and second motion interpolation source pixels are located in the additional information area. The average value of the first and second static interpolation source pixels is used as the interpolation pixel when the first difference value is less than the second difference value. 2. A video signal processing apparatus according to 1. In the interpolation signal generation unit, the first and second static interpolation source pixels are located in the additional information area, and at least one of the first motion interpolation source pixel and the second motion interpolation source pixel. When one is located in the additional information area,
4. The average value of the first and second static interpolation source pixels is used as the interpolation pixel regardless of the magnitude relationship between the first difference value and the second difference value. The video signal processing apparatus described. The interpolation signal generation unit, when the first and second static interpolation source pixels are not located in the additional information area,
If the first and second motion interpolation source pixels are located in the additional information area, the average value of the first and second static interpolation source pixels is the interpolation pixel,
If one of the first motion interpolation source pixel and the second motion interpolation source pixel is located in the additional information area and the other is not located in the additional information area, the additional information area The motion interpolation source pixel that is not located inside is the interpolation pixel,
When the first and second motion interpolation source pixels are not located in the additional information area, an average value of the first and second motion interpolation source pixels is set as the interpolation pixel. Item 5. The video signal processing device according to Item 4. The additional information area detection unit detects the probability that each pixel position of each frame is an additional information area in a plurality of stages,
The interpolation signal generation unit is located in the additional information area of the probability that the first and second static interpolation source pixels, the first motion interpolation source pixel, and the second motion interpolation source pixel are located. The interpolated video signal is generated in accordance with whether the first difference value and the second difference value are based on the size of the first difference value and the second difference value. The video signal processing apparatus described. An OSD superimposing unit that superimposes OSD information on the video signal;
The video signal processing apparatus according to claim 1, wherein the additional information area detection unit detects an additional information area based on OSD superposition position information output from the OSD superposition unit. . Detect additional information areas of still images present in each frame of the video signal of the input video,
Detecting a motion vector of the moving image based on at least adjacent pixels of the first and second frames in the video signal;
In order to statically interpolate interpolation pixels at respective pixel positions of an interpolation frame interpolated between the first and second frames in the video signal, the first and second frames at the same positions as the respective pixel positions Selecting the first and second static interpolation source pixels in
First and second motion interpolations in the first and second frames in the direction indicated by the motion vector detected by the motion vector detection unit in order to interpolate the interpolation pixel at each pixel position of the interpolation frame. Select the original pixel,
Calculating a first difference value of the first and second still interpolation source pixels and a second difference value of the first and second motion interpolation source pixels;
Whether each of the first and second static interpolation source pixels, the first motion interpolation source pixel, and the second motion interpolation source pixel is located in the additional information area; and According to the case classification based on the magnitude relationship between the first difference value and the second difference value, the state of generating the interpolation pixel using only the first and second static interpolation source pixels, A state in which the interpolation pixel is generated using both the first and second static interpolation source pixels and the first and second motion interpolation source pixels, and the interpolation using only the first motion interpolation source pixel A state of generating a pixel, a state of generating the interpolation pixel using only the second motion interpolation source pixel, and a state of generating the interpolation pixel using only the first and second motion interpolation source pixels To generate an interpolated video signal that is the interpolated frame. A video signal processing method. On the computer,
Detecting an additional information area of a still image present in each frame of the video signal of the input moving image;
Detecting a motion vector of the moving image based on at least adjacent pixels of the first and second frames in the video signal;
In order to statically interpolate interpolation pixels at respective pixel positions of an interpolation frame interpolated between the first and second frames in the video signal, the first and second frames at the same positions as the respective pixel positions Selecting first and second static interpolation source pixels in
First and second motion interpolations in the first and second frames in the direction indicated by the motion vector detected by the motion vector detection unit in order to interpolate the interpolation pixel at each pixel position of the interpolation frame. Selecting an original pixel;
Calculating a first difference value of the first and second still interpolation source pixels and a second difference value of the first and second motion interpolation source pixels;
Whether each of the first and second static interpolation source pixels, the first motion interpolation source pixel, and the second motion interpolation source pixel is located in the additional information area; and According to the case classification based on the magnitude relationship between the first difference value and the second difference value, the state of generating the interpolation pixel using only the first and second static interpolation source pixels, A state in which the interpolation pixel is generated using both the first and second static interpolation source pixels and the first and second motion interpolation source pixels, and the interpolation using only the first motion interpolation source pixel A state of generating a pixel, a state of generating the interpolation pixel using only the second motion interpolation source pixel, and a state of generating the interpolation pixel using only the first and second motion interpolation source pixels To generate an interpolated video signal that is the interpolated frame. And-flops,
A video signal processing program characterized in that

Images