JP5882940B2 - Information processing apparatus, control method, and program - Google Patents

Description

  The present invention relates to an information processing apparatus, a control method, and a program.

  In general, the frame frequency of a broadcast video transmitted from a television station or the like and the clock frequency (so-called refresh rate) of a display that displays the broadcast video often do not completely match. For this reason, if the broadcast video is continuously displayed on the display, there is gradually a gap between the audio and the video, and in the worst case, the audio is preceded and the video is displayed with a delay. Occurs and gives viewers a sense of incongruity.

  In order to eliminate such a difference between audio and video, an excess of a video scene (hereinafter, also referred to as “frame”) generated by accumulating the frequency difference between the broadcast video and the display. Is being skipped (destroyed). However, depending on the timing of skipping (discarding) the surplus frames, a phenomenon such as so-called clicks or dropped frames of the broadcast video may occur, so that the video may also give the viewer a sense of discomfort at the frame skipping (discarding) timing. There is a problem that can be.

  This problem will be described using a specific example. FIG. 4 is a diagram illustrating an example of a phenomenon in which frames are surplus due to a frequency difference between a display and a broadcast video. In FIG. 4, a monitor display of an information processing apparatus such as a personal computer (PC) operates at a clock frequency of 59.90 Hz, whereas a broadcast video operates at a frame frequency of 59.94 Hz. The difference is 0.04 Hz. An extra video frame corresponding to this difference frequency is present in one frame every 25 seconds. Therefore, if no measures are taken, the video gradually delays with respect to the sound, and reaches a level recognized by the viewer.

  Therefore, it is attempted to balance audio and video by discarding the surplus video frames at a predetermined stage. FIG. 6 is a diagram for explaining a state in which a surplus video frame is discarded by discarding a frame of a specific scene from a predetermined video scene. In the example of FIG. 6, among a series of video scenes in which a series of video scenes A composed of four-frame scenes and a series of video scenes B composed of four-frame scenes are broadcast continuously. The second frame (x mark) of the video scene A is discarded as an extra video frame.

  However, if an arbitrary video frame in the series of video scenes A is discarded as a surplus video frame, the video scenes before and after the discarded surplus video frame are discontinuous, and the video appears to fly. As a result, a phenomenon such as the so-called “cracking” or frame dropping of the video signal as described above occurs, giving the viewer a sense of incongruity.

  Contrary to the case of FIG. 4, the case where the frame frequency of the broadcast video is lower than the clock frequency of the monitor display will be described. FIG. 5 is a diagram illustrating an example of a phenomenon in which frames are insufficient due to a frequency difference between a display and a broadcast video. In FIG. 5, the monitor display operates at a clock frequency of 60.00 Hz, while the broadcast video operates at a frame frequency of 59.94 Hz, and the difference between the two is 0.06 Hz. Then, one frame of the shortage video frame corresponding to this difference frequency exists in about 17 seconds. Therefore, if no measures are taken, the video gradually precedes the audio and reaches a level recognized by the viewer.

  Here, a conventional image processing apparatus will be described with reference to FIG. FIG. 7 is a block diagram showing a schematic configuration of a conventional image processing apparatus. In FIG. 7, an image processing device 70 is a device that processes a video signal input from the outside as a video signal including video data synchronized with an internal synchronization signal. The image processing apparatus 70 includes a video input unit 71, a threshold setting unit 72, a motion amount detection unit 73, a capacity monitoring unit 74, a write control unit 75, a read control unit 76, a memory unit 77, and a video processing unit 78. I have.

The video input unit 71 receives input video data S ₁ including a plurality of frames and a timing signal including a synchronization signal and a clock for the input video data S ₁ from an input video signal S _IN input from the outside (hereinafter referred to as an input timing signal). separating the referred) and S _2. The video input unit 71 outputs the input video data S ₁ to the motion amount detection unit 73, and outputs the input timing signal S ₂ to the motion amount detection unit 73, the write control unit 75, and the memory unit 77.

The synchronization signal is a signal for transmitting the writing timing of each frame to the motion amount detection unit 73, the write control unit 75, and the memory unit 77, and the clock is the motion amount detection unit 73, the write control unit 75, and This signal is generated periodically so that the operation of the memory unit 77 is in tune. The input video data S ₁ is data synchronized with the input timing signal S ₂ .

The threshold value setting unit 72 stores information indicating the threshold value of the motion amount for determining the low motion frame, and outputs the first threshold value signal S ₃ with the information indicating the threshold value of the motion amount to the motion amount detection unit 73. To do. Further, the threshold setting unit 72 stores the video data in the memory unit 77 from the state where the video data storage amount in the memory unit 77 is empty, and the reference for stopping the frame writing from the memory unit 77 or the reference for starting the reading. The information indicating the threshold value of the accumulated amount is stored. Further, the threshold setting unit 72 stores information indicating a memory allowable range with respect to a free capacity of the memory unit 77 or an accumulation amount of video data in the memory unit 77 as a reference for starting output of the skip instruction signal S ₇ .

In addition, the threshold setting unit 72 outputs a second threshold signal S _{4 on} which information indicating the threshold of the storage amount and information indicating the memory allowable range are placed to the capacity monitoring unit 74. Note that the motion amount threshold value and the accumulation amount threshold value are appropriately set by the designer of the image processing apparatus 70. As the accumulation amount threshold value, for example, the storage capacity of the memory unit 77 is equivalent to seven frames. When the video data S ₅ can be stored, it is conceivable to set the frame to 3 frames.

Further, the input video data S ₁ includes a plurality of frames that are continuous in time series, and the higher the correlation between the images in the preceding and succeeding frames, the smaller the amount of motion of the subsequent frames with respect to the previous frames. Also, the input video data S ₁ indicates that the lower the correlation between the images in the previous and subsequent frames, the greater the amount of movement of the subsequent frame relative to the previous frame. For this reason, when the motion amount of the frame is lower than the motion amount threshold, it can be determined that the change in the video scene is small, and one of the frames before and after this (for example, the previous frame) is defined as a low motion frame.

The motion amount detection unit 73 detects the motion amount of each frame by comparing consecutive frames of the input video data S ₁ , and the motion amount in the first threshold signal S ₃ input from the threshold setting unit 72. A frame lower than the motion amount threshold is identified as a low motion frame. The motion amount detection unit 73 outputs the video data S ₅ from which the motion amount has been detected to the memory unit 77 in synchronization with the input timing signal S ₂ . In addition, the motion amount detection unit 73 performs write control in synchronization with the input timing signal S ₂ with the first identification signal S _{6 on} which the low operation frame identification information indicating the identification result as to whether or not the frame is a low operation frame. Output to the unit 75 and the memory unit 77. That is, the motion amount detection unit 73, and a first identification signal S ₆ for each frame and each frame of the video data S ₅ in a pair, in synchronization with the input timing signal S _2, the image data S ₅ and the first The identification signal S ₆ is output to the memory unit 77.

  The amount of motion can be detected by, for example, comparing data at an arbitrary position in a certain frame with data located at the same position in the next frame and its surroundings.

The capacity monitoring unit 74 is based on the difference in the number of inputs between a write completion notification signal S _{12 (} described later) input from the write control unit 75 and a read completion notification signal S _{15 (} described later) input from the read control unit 76. calculating the accumulated amount of free space or the video data S ₅ of the memory unit 77. That is, the capacity monitoring unit 74, the write completion notice signal S _12, to recognize that the accumulation amount of the video data in the memory unit 77 is increased by one frame, the read completion notification signal S _15, the image in the memory unit 77 It can be recognized that the amount of accumulated data has decreased by one frame. Therefore, the capacity monitoring unit 74 can calculate the amount of video data stored in the memory unit 77 based on the difference in the number of inputs of the write completion notification signal S ₁₂ and the read completion notification signal S ₁₅ , and the storage capacity of the memory unit 77 can be calculated. By subtracting the accumulated amount from the above, the free capacity of the memory unit 77 can be calculated.

Further, the capacity monitoring unit 74 writes the skip instruction signal S _{7 on} which information for instructing the limitation of writing of the low operation frame to the memory unit 77 is loaded when the free capacity of the memory unit 77 is less than the allowable memory range. Output to the control unit 75.

The memory allowable range is for the designer of the image processing apparatus 70 is appropriately set, for example, when the storage capacity of the memory unit 77 can store the video data S ₅ of 7 frames, from 3 frames Setting up to 5 frames is conceivable.

  In particular, if real-time processing is required to process video data input from the outside and output it immediately, the image processing device 70 reduces the storage capacity of the memory unit 77 and sets the lower limit of the allowable memory range. By increasing the value, it is conceivable to frequently use low-motion frame skip processing. If real-time performance is not required, the image processing apparatus 70 increases the storage capacity of the memory unit 77, reduces the lower limit value of the memory allowable range, and increases the upper limit value, thereby reducing the skip processing of the low operation frame. It is possible to faithfully reproduce video data input from the outside.

Write control unit 75, in synchronization with the input timing signal S ₂ of the synchronization signal, it controls the writing of a frame into the memory unit 77. That is, the write control unit 75 gives an instruction to write a frame to the memory unit 77 and an instruction to write the storage area for each frame of the video data S ₅ input from the motion amount detection unit 73 to the memory unit 77. A signal carrying the indicated information is output to the memory unit 77.

In this case, while the skip instruction signal S ₇ is being input from the capacity monitoring unit 74, the write control unit 75 is identified based on the first identification signal S ₆ input from the motion amount detection unit 73. The write instruction signal S ₁₁ is not output to the memory unit 77 for the operation frame. Thereby, the write control unit 75 skips (discards) the low operation frame without causing the memory unit 77 to write the low operation frame while the skip instruction signal S ₇ is input from the capacity monitoring unit 74. To do. Note that the write instruction signal S ₁₁ is output from the write control unit 75 for frames other than the low operation frame, not the target of the skip processing.

  As described above, in the conventional image processing apparatus, the frame skip processing, which is generated by changing the synchronization signal of the video signal, is processed for the low motion frame which is a frame with a small change in the video scene. As a result, the image processing apparatus outputs a video that does not make the viewer feel the frame skip even though the frame skip has occurred.

JP 2011-015063 A

  In the image processing apparatus described in Patent Document 1, skip processing is performed on a frame with a small amount of motion only when the free space of the memory or the amount of video data stored in the memory is outside a predetermined allowable range. Therefore, the moving image is smoothly reproduced by performing the skip processing on the minimum necessary frames.

  However, since the skip processing target is limited to frames with a small amount of motion, depending on the type of video, there may be a video with a small amount of motion itself (a video with a pan scene). When the target is video, skip processing is reduced, but a large amount of surplus frames may be accumulated due to accumulation of frequency difference between the video and the display.

  In Patent Document 1, skip processing is performed on a frame with a small amount of motion. For example, in a video taken from a distance with a fixed camera often seen in travel programs, the scenery is almost stationary. Because it is displayed like a picture and the train moves slowly in it, the amount of motion of the image becomes very small. In this case, there is a problem that if the frame skip is entered, the movement of the train is displayed awkwardly.

  Therefore, the present invention has been made in view of the above-described conventional problems, and by discarding surplus frames according to the amount of motion and the temporal change in the amount of motion, the video can be smoothly displayed without giving the viewer a sense of incongruity. It is an object to provide an information processing apparatus, a control method, and a program that can be reproduced.

In order to solve the above problem, the information processing apparatus according to the present invention described in claim 1 is an information processing apparatus having a difference between a frequency of a video signal and a frequency of a display unit that displays the video signal. Deletion of surplus frames that occur when the frequency of the video signal is higher than the frequency of the display means, or missing frames that occur when the frequency of the video signal is lower than the frequency of the display means A display frame adjustment unit for performing interpolation, and a motion amount between a frame displayed on the display unit and a frame nearest to the frame displayed on the display unit among a plurality of frames constituting the video signal. A motion amount detecting means for detecting, and a buffer for temporarily storing the motion amount detected by the motion amount detecting means for the most recent frame, and displayed on the display means. Der on amount of motion first Ne以in the frame to be Luca, or, when the difference between the motion amount in the last frame stored temporarily in the buffer is below a second Ne以, the display The frame adjustment means deletes the extra frame or interpolates the deficient frame when the number of the surplus frames or the number of the deficient frames reaches a value that allows video delay or video advance. It is characterized by.

  The information processing apparatus according to the present invention is the information processing apparatus according to claim 1, wherein the number of the surplus frames or the number of the insufficient frames is a delay of the video signal caused by the difference with respect to real time. Alternatively, the number of frames corresponding to a time in a range in which the preceding of the video signal is allowed is set.

  Furthermore, the information processing apparatus according to the present invention is the information processing apparatus according to claim 1 or 2, wherein the display frame adjustment unit continues to display the same frame as the frame displayed on the display unit on the display unit. The shortage frame is interpolated by displaying it.

In order to solve the above problem, the control method according to the present invention according to claim 4 is a method for controlling an information processing apparatus having a difference between a frequency of a video signal and a frequency of display means for displaying the video signal. A method of deleting an extra frame that occurs when the frequency of the video signal is higher than the frequency of the display means, or when the frequency of the video signal is lower than the frequency of the display means An amount of motion between the frame displayed on the display unit and the frame nearest to the frame displayed on the display unit among the plurality of frames constituting the video signal Detecting the amount of motion of the latest frame, temporarily storing the amount of motion detected in the step of detecting the amount of motion in a buffer, and displaying the frame displayed on the display means. Der on amount of motion first Ne以Luca in over arm, or, when the difference between the motion amount in the last frame stored temporarily in the buffer is below a second Ne以, said ordinary frames Or the step of deleting the surplus frames or interpolating the deficient frames when the number of frames or the number of deficient frames reaches a value that allows video delay or video advancement to be allowed. To do.

In order to solve the above problem, the program according to the present invention described in claim 5 is a computer of an information processing apparatus having a difference between a frequency of a video signal and a frequency of display means for displaying the video signal. In addition, deletion of surplus frames that occur when the frequency of the video signal is higher than the frequency of the display means, or insufficient frames that occur when the frequency of the video signal is lower than the frequency of the display means And a motion amount between a frame displayed on the display unit and a frame nearest to the frame displayed on the display unit among a plurality of frames constituting the video signal is detected. Processing, processing for temporarily storing the amount of motion detected by the processing for detecting the amount of motion for the most recent frame in a buffer, and display on the display means Der on amount of motion first Ne以in the frame Luke, or, when the difference between the motion amount in the last frame stored temporarily in the buffer is below a second Ne以, said ordinary frames When the number or the number of the deficient frames reaches a value at which video delay or video advance is allowed, a process of deleting the surplus frames or interpolating the deficient frames is realized. To do.

  ADVANTAGE OF THE INVENTION According to this invention, the information processing apparatus, control method, and program which can reproduce | regenerate an image | video smoothly without giving a discomfort to a viewer are obtained.

It is a schematic block diagram which shows the structure of the information processing apparatus in embodiment of this invention. It is a flowchart figure explaining operation | movement of the information processing apparatus in embodiment of this invention. It is a figure for demonstrating the timing which discards a surplus video frame | frame in the information processing apparatus in embodiment of this invention. It is the figure which showed an example of the phenomenon in which a frame surplus originates in the frequency difference of a display and a broadcast image | video. It is the figure which showed an example of the phenomenon where a frame runs short due to the frequency difference between a display and broadcast video. It is a figure explaining the state which discards an excess video frame by discarding the flame | frame of a certain specific scene from predetermined | prescribed video scenes. It is a block diagram which shows schematic structure of the conventional image processing apparatus.

  Next, embodiments for carrying out the present invention will be described in detail with reference to the drawings. In addition, in each figure, the same code | symbol is attached | subjected to the part which is the same or it corresponds, The duplication description is simplified thru | or abbreviate | omitted suitably. Briefly describing the contents of the present invention, an information processing apparatus having a difference between the frequency of a video signal and the frequency of a display means for displaying the video signal, the frequency of the video signal being compared with the frequency of the display means. Display frame adjustment means for performing deletion of excess frames that occur when the frequency is high, or interpolation of insufficient frames that occur when the frequency of the video signal is low compared to the frequency of the display means, and a plurality of video signals Of the frames, a motion amount detection means for detecting a motion amount between a frame displayed on the display means and a frame nearest to the frame displayed on the display means, and a motion amount detection means for the latest frame is detected. A buffer that temporarily stores the amount of motion, and the amount of motion in the frame displayed on the display means is less than or equal to the first value and is temporarily stored in the buffer When the difference from the motion amount in the near frame is greater than or equal to the second value, the display frame adjustment means smooths the video without giving the viewer a sense of incongruity by deleting the excess frame or interpolating the insufficient frame. It is possible to play back.

  First, the configuration of the information processing apparatus according to the embodiment of the present invention will be described with reference to FIG. FIG. 1 is a schematic block diagram showing the configuration of the information processing apparatus according to the embodiment of the present invention. Referring to FIG. 1, an information processing apparatus 10 according to an embodiment of the present invention is an information processing apparatus including a personal computer (PC) or the like, and is a tuner that receives and demodulates a broadcast wave transmitted from a broadcasting facility such as a television station. 11, a content recording unit 12 that records the received content, a moving image reproduction processing unit 13 that performs processing for displaying the received moving image content on the display 15, and a moving image processed by the moving image reproduction processing unit 13 Are detected by the motion amount detection unit 14 and the motion amount detection unit 14 that detect the amount of motion between the currently displayed frame and the frame immediately before (eg, immediately before) the frame. Whether the amount of motion of the currently displayed frame satisfies the first condition and the amount of motion of the currently displayed frame A frame adjusting unit 16 that performs deletion or interpolation of a frame processed by the moving image reproduction processing unit 13 depending on whether or not the difference between the motion amount of the most recent frame of the frame satisfies the second condition, and a moving image And a display 15 for displaying the moving image content processed by the reproduction processing unit 13.

  Next, the operation of the information processing apparatus according to the embodiment of the present invention will be described with reference to FIG. FIG. 2 is a flowchart for explaining the operation of the information processing apparatus according to the embodiment of the present invention. In FIG. 2, a broadcast wave transmitted from a broadcasting facility such as a television station is received and demodulated by the tuner 11 (FIG. 1), and the demodulated moving image content is recorded in the content recording unit 12 and reaches the moving image reproduction processing unit 13. Then, in the process of step (hereinafter referred to as “S”) 201, a moving image decoding process is performed. In this case, the moving image content (moving image data) recorded in the content recording unit 12 (FIG. 1) is decoded (decoded) by the moving image reproduction processing unit 13, and a video frame is created (restored).

  Next, in the process of S202, a motion amount detection process is performed. This is because the motion amount detection unit 14 refers to the video frame created in S201 (referred to as “display target frame”) and the most recent (for example, immediately preceding) frame (referred to as “nearest frame”). (FIG. 1) is input, and the display target frame is compared with the latest frame. If the moving image content to be displayed is encoded together with the amount of motion between frames, the amount of motion can be detected by referring to the amount of motion stored in the moving image content. Note that in moving image content encoded using both intraframe encoding and interframe encoding, there is no motion amount in the intraframe encoded frame, so the intraframe encoded frame and immediately thereafter These frames are preferably excluded from the frame adjustment targets.

  The motion amount of the display target frame detected by the motion amount detection unit 14 is compared with the motion amount of the most recent frame temporarily stored in a buffer (not shown), and the motion amount of the display target frame and the motion of the most recent frame are compared. The difference from the quantity is detected.

  In the process of S203, it is determined whether or not the amount of motion of the display target frame detected in the process of S202 is smaller than the first value. If it is determined in S203 that the amount of motion is smaller than the first value (S203: YES), the process proceeds to S204, and it is determined that the amount of motion is equal to or greater than the first value (S203: NO). Then, the process proceeds to S207.

  In the process of S204, it is determined whether or not the difference between the motion amount of the display target frame detected in the process of S202 and the motion amount of the latest frame is larger than the second value. If it is determined in S204 that the difference is greater than the second value (S204: YES), the process proceeds to S205, and if it is determined that the difference is equal to or less than the second value (S204: NO), S207 Move on to processing. Note that the first value and the second value will be described later.

  In the process of S205, it is determined whether or not there is a surplus frame or a deficient frame due to the difference between the frequency of the video signal and the frequency of the display 15. The surplus frame is a frame that is generated when the frame frequency of the video signal is higher than the clock frequency of the display 15 and is left undisplayed on the display 15 due to a phenomenon that the video is delayed by the difference frequency between the two. Say. Also, the shortage frame occurs when the frame frequency of the video signal is lower than the clock frequency of the display 15, and due to the phenomenon that the video is preceded by the difference frequency between the two, it will be insufficiently displayed on the display 15. A frame.

  In the example of FIG. 4, one extra frame corresponding to this difference frequency exists every 25 seconds, and in the example shown in FIG. 5, one extra frame exists in about 17 seconds. Therefore, if no measures are taken, the video is gradually delayed with respect to the audio, or the video is gradually advanced with respect to the audio, thereby reaching a level that can be recognized by the viewer.

  If it is determined in S205 that there is a surplus frame or a shortage frame (S205: YES), the process proceeds to S206. If it is determined that there are no surplus frames or insufficient frames (S205: NO), the process proceeds to S207.

  In the process of S207, it is determined whether or not the number of surplus frames or insufficient frames is equal to or greater than a specified number. That is, it is determined whether or not the number of surplus frames or the number of insufficient frames managed by the moving image reproduction processing unit 13 (FIG. 1) is equal to or greater than a predetermined number. In other words, if the video playback is continued without deleting or interpolating the surplus frames or the shortage frames, the video is displayed delayed from the actual time for the specified number of frames, or the video is displayed from the actual time. It will be displayed in advance (sound and video appear to be out of alignment). Therefore, from the human eye, the maximum number of frames that cannot be realized when the video is delayed or advanced from the actual time (if the maximum number of frames is exceeded, the image is delayed from the actual time. Or the actual number of frames) is defined as the predetermined specified number, and the number of surplus frames or the number of insufficient frames is determined to be equal to or greater than the specified number (S207: YES) Shifts to the process of S206, and when it is determined that the number of surplus frames or the number of insufficient frames is less than the prescribed number (S207: NO), the process shifts to the process of S208.

  In the process of S206, a frame adjustment process is performed. That is, in the frame adjustment unit 16 (FIG. 1), the display target frame is deleted as a surplus frame, or is interpolated as a deficient frame in the display target frame, and the process returns to S201. The deletion of the surplus frame will be described with reference to FIG. FIG. 3 is a diagram for explaining the timing of discarding surplus video frames in the information processing apparatus according to the embodiment of the present invention.

  In FIG. 3, a series of motions composed of a four-frame scene is large, or a scene 31 having a constant motion amount (the latest frame) and a series of motions composed of a four-frame scene are small. Among the video scenes in which the scene 32 (display target frame) is continuously broadcast, when the amount of motion of the series of scenes 32 is small, it is determined that the amount of motion of the scene 32 is smaller than the first value (S203). : YES). If the amount of motion of the scene 31 is large or the amount of motion is constant, it is determined that the difference in amount of motion with the scene 32 having a small amount of motion is greater than the second value (S204: YES). Therefore, the first frame of the scene 32 existing between the scene 31 and the scene 32 is discarded as a surplus frame. As a result, the video can be smoothly reproduced without causing the viewer to feel uncomfortable.

  Returning to FIG. 2, in the processing of S208, frame display processing is performed. That is, in the process of S207, when it is determined that the number of surplus frames or the number of insufficient frames is less than the specified number (S207: NO), the moving picture reproduction processing unit 13 (FIG. 1) displays the current frame. 15 (FIG. 1).

  The operation flow of the information processing apparatus 10 according to the embodiment of the present invention shown in FIG. 2 can be executed by a program on a computer. That is, a CPU (not shown) incorporated in a control unit (not shown) loads a program stored in a storage unit (not shown) including a ROM (Read Only Memory), a RAM (Random Access Memory), etc. Are performed by sequentially executing.

  Here, the first value and the second value will be described. The first value is a value with which the amount of motion of the display target frame is compared. This is, for example, a level in which a frame is not deleted in a scene in which a person in the screen is moving in a video such as a drama. Is the value of Specifically, the value is about the amount of motion when a rectangular block (macroblock) of about 15% of 16 × 16 pixels in the screen moves a distance corresponding to about 1/16 of the screen width.

  Further, the second value is a value to which the difference between the amount of motion of the display target frame and the amount of motion of the latest frame is compared. Even if the value is smaller than the value, it is a value that does not delete the frame in the scene where the train is photographed in the distance. Specifically, the difference between the amount of motion of the display target frame and the amount of motion of the most recent frame is a value that is about 30% of the amount of motion of the most recent frame.

  The interpolation of the deficient frame in the frame adjustment process executed in the process of S206 in FIG. 2 may be performed by, for example, causing the display 15 to continuously display the same frame as the display target frame a plurality of times, This is done by creating an intermediate image between the frame and the most recent frame and displaying it on the display 15.

  Here, the above-described surplus frame will be supplementarily described. As described above with reference to FIG. 4 or FIG. 5, when the frame frequency of the broadcast video is 59.94 Hz, one frame is displayed at 1 / 59.94≈16.68 ms. In the process of S205 in FIG. 2, it is determined whether or not there are surplus frames or insufficient frames. For each frame of the video scene, each frame should be displayed on the display 15 (FIG. 1). Time (hereinafter, this time is referred to as “sample time”) is added.

  Then, the sample time is compared with the current time (device clock of the information processing apparatus 10). When the sample time is delayed by 16.68 ms from the device clock, there is one surplus frame, which is 16.68 ms ahead. If there is, one missing frame exists. If there is a difference of 33.36 ms between the sample time and the device clock, there are two surplus frames or two insufficient frames.

  When such a surplus frame or insufficient frame exists and the video is displayed with a delay or when it is displayed in advance, the delayed or advanced video is displayed as the current time (device of the information processing apparatus 10). Clock). What is executed at this time is a frame adjustment process performed in the process of S206 of FIG.

  Originally, the frame to be deleted (also referred to as “frame”) or the frame to be interpolated is not determined, and as a result, the video only needs to catch up with the current time (real time). It is. Therefore, the specified number of surplus frames or the specified number of insufficient frames in S207 in FIG. 2 is set to a limit value (delay or advance) for the viewer to recognize that the video is delayed or that the video is advanced. In the process of S203, when the motion amount of the display target frame is equal to or greater than the first value (S203: NO), or in the process of S204, When the difference from the motion amount of the most recent frame is equal to or smaller than the second value (S204: NO), the number of surplus frames or insufficient frames is accumulated until the limit value is reached, and the limit value is reached. At this stage (S207: YES), the display target frame is deleted as a surplus frame in the process of S206, or the display target frame is interpolated as a deficient frame. No adjustment process may be performed.

  However, if the limit value is set to a very high value, a large amount of surplus frames or insufficient frames are accumulated until the limit value is reached, so that the video is considerably delayed or preceded by the real time. There is also a problem that the shift is conspicuous, the video is displayed later than other televisions, or the video is displayed in advance, so the limit value is set to an appropriate value, that is, the video for the real time. It is necessary to set the delay or leading within the allowable range.

  As described above, when the frame frequency of the broadcast video is 59.94 Hz, the time occupying one frame (frame) is 16.68 ms, and in general, a shift between audio and video is recognized. Since it is said that it is in the range of 50 ms to 100 ms in human sense, it may be deleted or interpolated after accumulating the number of surplus frames or the number of deficient frames about 4 to 5 frames. .

  Furthermore, since it prevents the occurrence of a gap between audio and video, in the case of video images and still images that do not accompany audio, extra frames are not accumulated at any point without accumulating extra frames. It is possible to delete a frame.

  Further, in the above-described embodiment, a case where a live image is viewed on an information processing apparatus including a personal computer (PC) having a function of receiving a broadcast wave transmitted from a broadcasting facility such as a television station will be mainly described. However, it is an information processing apparatus including a personal computer (PC) that does not have a function of receiving a broadcast wave when reproducing a recorded video recorded in the content recording unit 12 (FIG. 1). The same applies to the case of playing back recorded content.

  Thus, according to the present invention, there is provided an information processing apparatus having a difference between the frequency of the video signal and the frequency of the display means for displaying the video signal, wherein the frequency of the video signal is compared with the frequency of the display means. Display frame adjustment means for performing deletion of excess frames that occur when the frequency is high, or interpolation of insufficient frames that occur when the frequency of the video signal is low compared to the frequency of the display means, and a plurality of video signals Of the frames, a motion amount detection means for detecting a motion amount between a frame displayed on the display means and a frame nearest to the frame displayed on the display means, and a motion amount detection means for the latest frame is detected. A buffer that temporarily saves the amount of movement, and the amount of movement in the frame displayed on the display means is equal to or less than the first value and is the latest temporarily saved in the buffer When the difference from the amount of motion in the frame is greater than or equal to the second value, the display frame adjustment means smoothly reproduces the video without giving the viewer a sense of incongruity by deleting the extra frames or interpolating the deficient frames. An information processing apparatus, a control method, and a program that can be provided can be provided.

  The present invention has been described above by the preferred embodiments of the present invention. While the invention has been described with reference to specific embodiments thereof, various modifications and changes can be made to these embodiments without departing from the broader spirit and scope of the invention as defined in the claims. is there.

10 Personal computer (PC)
DESCRIPTION OF SYMBOLS 11 Tuner 12 Content recording part 13 Movie reproduction | regeneration processing part 14 Motion amount detection part 15 Display 16 Frame adjustment part

Claims (5)

An information processing apparatus having a difference between a frequency of a video signal and a frequency of display means for displaying the video signal,
Deletion of surplus frames that occur when the frequency of the video signal is higher than the frequency of the display means, or interpolation of insufficient frames that occur when the frequency of the video signal is lower than the frequency of the display means Display frame adjusting means for performing
A motion amount detecting means for detecting a motion amount between a frame displayed on the display means and a frame nearest to the frame displayed on the display means among a plurality of frames constituting the video signal;
A buffer for temporarily storing the amount of motion detected by the motion amount detection means for the most recent frame,
The motion amount in the frame to be displayed on the display means the first Ne以on Der Luke, or the difference between the motion amount in the last frame stored temporarily in the buffer under the second Ne以In some cases, the display frame adjustment means deletes the surplus frame or the deficiency when the number of the surplus frames or the number of the deficient frames reaches a value that allows video delay or video advancement. An information processing apparatus characterized by interpolating frames.   The number of surplus frames or the number of insufficient frames is the number of frames corresponding to the delay of the video signal caused by the difference with respect to real time or the time in a range in which the preceding of the video signal is allowed. The information processing apparatus according to claim 1, wherein the information processing apparatus is set.   3. The display frame adjusting unit interpolates the deficient frame by continuously displaying the same frame as the frame displayed on the display unit on the display unit. Information processing device. A method for controlling an information processing apparatus having a difference between a frequency of a video signal and a frequency of display means for displaying the video signal,
Deletion of surplus frames that occur when the frequency of the video signal is higher than the frequency of the display means, or interpolation of insufficient frames that occur when the frequency of the video signal is lower than the frequency of the display means A process of performing
Detecting a motion amount between a frame displayed on the display means and a frame nearest to the frame displayed on the display means among a plurality of frames constituting the video signal;
Temporarily storing in a buffer the amount of motion detected by the step of detecting the amount of motion for the most recent frame;
The motion amount in the frame to be displayed on the display means the first Ne以on Der Luke, or the difference between the motion amount in the last frame stored temporarily in the buffer under the second Ne以When the number of the surplus frames or the number of the deficient frames reaches a value that allows a video delay or a video advance to be allowed , deleting the surplus frames or interpolating the deficient frames;
The control method characterized by including. In the computer of the information processing apparatus having a difference between the frequency of the video signal and the frequency of the display means for displaying the video signal,
Deletion of surplus frames that occur when the frequency of the video signal is higher than the frequency of the display means, or interpolation of insufficient frames that occur when the frequency of the video signal is lower than the frequency of the display means Processing to perform
A process of detecting a motion amount between a frame displayed on the display unit and a frame nearest to the frame displayed on the display unit among a plurality of frames constituting the video signal;
A process of temporarily storing the amount of motion detected by the process of detecting the amount of motion for the latest frame in a buffer;
The motion amount in the frame to be displayed on the display means the first Ne以on Der Luke, or the difference between the motion amount in the last frame stored temporarily in the buffer under the second Ne以When the number of the surplus frames or the number of the deficient frames reaches a value at which video delay or video advance is allowed, a process of deleting the surplus frames or interpolating the deficient frames;
A program to realize

Images