JP2007158901A - Image processing apparatus and computer program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing apparatus which can raise the response of a single frame step function, and provide computer program. <P>SOLUTION: The image processing apparatus is provided with a decoder (128), a frame image memory (141), a frame image write-in portion (113) and a frame image capturing portion (143). The decoder (128) decodes a picture which is configured to video image streams and outputs frame image. The frame image memory (141) memorizes the frame image (141). The frame image write-in portion (113) writes the frame image outputted from the decoder in the frame image memory so that at least two frame images are memorized continuously. The frame image capturing portion (143) captures the frame image from the frame image memory or the decoder so as to correspond to any one reproduction mode out of a forward reproduction mode (134) which outputs and reproduces the frame image in forward direction and a reverse reproduction mode (136) which outputs and reproduces the frame image backward the forward direction. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a video processing apparatus and a computer program, and more particularly to a video processing apparatus and a computer program capable of frame-by-frame playback.

  Currently, there are MPEG (Motion Picture Coding Experts Group) systems and the like as a system for encoding and recording moving images and audio. In this manner, the encoded moving image or sound is decoded and then output on the screen.

  Using the above-mentioned MPEG video and other video compression coding techniques, frame-by-frame playback that plays back video while frame-by-frame is played back, and reverse frame-by-frame playback that plays back images on the video stream retroactively There has been a reproducing apparatus that can perform the processing (see, for example, Patent Document 1, Patent Document 2, Patent Document 3, and the like).

JP 2003-101956 A JP 2003-101967 A JP-A-8-70429

  However, the reverse frame advance reproduction by the reproduction apparatus of Patent Document 1 and Patent Document 2 merely shows an output procedure of an image to be displayed on the screen at the time of reverse frame advance reproduction. In such a reproduction method, it is difficult to realize a quick response to reverse frame advance reproduction by the reproduction apparatus.

  In the moving image compression encoding method such as the MPEG system, for example, when processing such as encoding, there are images that need to refer to future and past images. This makes it difficult to improve the responsiveness of such a playback device.

  Further, the frame advance reproduction processing apparatus of Patent Document 3 can perform forward and reverse frame advance reproduction. In the frame advance playback processing device, when the 3GOP image is held in the frame memory of the memory 3 and is output from the output terminal 6 as a video signal, the memory 3 from which the image is read is switched according to the forward method or the reverse direction. ing.

  However, in the playback method using the frame advance playback processing apparatus, since the memory 3 stores 3 GOP images and at least 45 frame images (or frame images), it is essential to increase the capacity of the frame memory. There was a risk that the composition would be large.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a new and improved video processing apparatus and computer program capable of enhancing the response of frame-by-frame playback. is there.

  In order to solve the above problems, according to a first aspect of the present invention, a decoder that decodes a picture configured in a video stream and outputs a frame image; a frame image storage unit that stores the frame image; and the decoder A frame image writing unit for writing the frame image output from the frame image storage unit so that the frame image is stored continuously for at least two frames; a forward direction for outputting and reproducing the frame image in the forward direction; The frame image is acquired from the frame image storage unit or the decoder so as to correspond to the playback mode or the playback mode of the reverse playback mode in which the frame image is output in the direction opposite to the forward direction and played back. And a frame image acquisition unit.

  According to the present invention, the writing destination to which the frame image output from the decoder is to be written is determined, and writing of the frame image is controlled to the determined writing destination frame image storing unit. Further, an acquisition destination is determined from which frame image storage unit to acquire a frame image to be output, and an acquisition process of acquiring a frame image from the determined frame image storage unit is controlled. According to such a configuration, even when the playback mode is switched, frame images can be obtained seamlessly without delay, and responsiveness can be improved with respect to switching of the playback mode.

  The forward playback mode is a mode indicating that the frame images are sequentially played back from the past to the future according to the time series, and the backward playback mode is a frame image from the future to the past according to the reverse of the time series. May be a mode indicating that the images are reproduced in order.

  In order to solve the above-described problem, according to another aspect of the present invention, a first frame image storage unit that continuously stores two frame images obtained by decoding and outputting pictures configured in a video stream by a decoder. And a frame image storage unit including a second frame image storage unit; causing the decoder to decode a future image than the image stored in the frame image storage unit with a plurality of arranged pictures and outputting from the decoder The acquisition destination for acquiring the frame image by determining the writing destination of the frame image by alternately changing the writing destination for writing the frame image alternately with the first frame image storage unit or the second frame image storage unit, A first sequential transition model storage unit that stores a first sequential transition model for determining a frame image acquisition source so as to be the decoder; The decoder stores a plurality of pictures arranged earlier than the image stored in the frame image storage unit, and the write destination to which the frame image output from the decoder is written is stored in the first frame image storage. Or the second frame image storage unit alternately and repeatedly transits to determine the frame image writing destination, and the acquisition destination for acquiring the frame image is the writing destination to which the frame image output from the decoder is written A second sequential transition model storage unit for storing a second sequential transition model for determining a frame image acquisition destination so as to be a frame image storage unit other than the above; the first sequential transition model or the second sequential transition A frame image writing unit for writing the frame image into the first frame image storage unit or the second frame image storage unit according to a model; A frame image acquisition unit that acquires a frame image from the first frame image storage unit, the second frame image storage unit, or the decoder according to the first sequential transition model or the second sequential transition model. It is characterized by.

  The frame image acquisition unit may seamlessly acquire a frame image from the frame image storage unit or the decoder regardless of whether the frame is switched to the first sequential transition model or the second sequential transition model.

  When the first sequential transition model is changed to the second sequential transition model, the frame image acquisition unit stores the frame image already stored in the first frame image storage unit or the second frame image storage unit. You may make it acquire.

  When the frame image writing unit writes a frame image in the first frame image storage unit and switches from the first sequential transition model to the second sequential transition model, the frame image acquisition unit The frame image stored in the image storage unit is acquired; the decoder outputs a frame image one frame before the frame image acquired by the frame image acquisition unit; the frame image writing unit is output by the decoder The output frame image may be written in the first frame image storage unit.

  When the frame image writing unit writes a frame image in the first frame image storage unit and switches from the second sequential transition model to the first sequential transition model, the frame image acquisition unit The frame image stored in the storage unit may be acquired, and the decoder may output a frame image one ahead of the frame image stored in the first frame image storage unit.

  When a frame image is written in the second frame image storage unit by the frame image writing unit and the first sequential transition model is switched to the second sequential transition model, the frame image acquisition unit The frame image stored in the image storage unit is acquired; the decoder outputs a frame image one frame before the frame image acquired by the frame image acquisition unit; the frame image writing unit The frame image output by the decoder may be written in the second frame image storage unit.

  When the frame image writing unit writes a frame image in the first frame image storage unit and switches from the second sequential transition model to the first sequential transition model, the frame image acquisition unit The frame image stored in the storage unit may be acquired, and the decoder may output a frame image one ahead of the frame image stored in the first frame image storage unit.

  In order to solve the above-described problem, according to another aspect of the present invention, a first frame image storage unit stores three consecutive frame images obtained by decoding and outputting a picture configured in a video stream by a decoder. A frame image storage unit including a second frame image storage unit and a third frame image storage unit; decoding a future image than an image stored in the frame image storage unit with a plurality of pictures arranged for the decoder In addition, the writing destination to which the frame image output from the decoder is written is repeatedly changed in the order of the first frame image storage unit, the second frame image storage unit, or the third frame image storage unit to The acquisition destination that determines the writing destination and obtains the frame image is the writing destination in which the frame image output from the decoder is written. A first sequential transition model storage unit for storing a first sequential transition model for determining a frame image acquisition destination so as to be a frame image storage unit other than the previous one; a plurality of pictures arranged for the decoder in a frame image The storage unit decodes an image past the image stored therein and writes the frame image output from the decoder to the first frame image storage unit, the second frame image storage unit, or the above The frame image write destination is determined by repeatedly making transitions in the order of the third frame image storage unit, and the acquisition destination for acquiring the frame image is a frame image other than the write destination in which the frame image output from the decoder is written. A second sequential transition model storage unit that stores a second sequential transition model that determines a frame image acquisition destination so as to be a storage unit; A frame image writing unit for writing the frame image to the first frame image storage unit, the second frame image storage unit, or the third frame image storage unit according to the sequential transition model or the second sequential transition model; A frame image acquisition for acquiring a frame image from the first frame image storage unit, the second frame image storage unit, or the third frame image storage unit according to the first sequential transition model or the second sequential transition model; And a section.

  The frame image acquisition unit may seamlessly acquire a frame image from the frame image storage unit or the decoder regardless of whether the frame is switched to the first sequential transition model or the second sequential transition model.

  The acquisition destination for acquiring the frame image may exclude the frame image storage unit that stores the frame image acquired immediately before by the frame image acquisition unit.

  Whichever of the first sequential transition model or the second sequential transition model is used, any one of the first frame image storage unit, the second frame image storage unit, and the third frame image storage unit is used. Thus, the frame image acquired by the frame image acquisition unit can be configured to be a frame image corresponding to the middle frame among three consecutive frame images. With this configuration, frame images can be acquired and output smoothly without interruption.

  When switching from the first sequential transition model to the second sequential transition model, the decoder outputs a frame image two frames before the frame image acquired by the frame image acquisition unit immediately before switching; the frame image The writing unit writes the frame image output by the decoder to the frame image storage unit in which the frame image is written immediately before the switching; the frame image acquiring unit is configured by the frame image acquiring unit immediately before the switching. A frame image one frame before the acquired frame image may be acquired.

  When switching from the second sequential transition model to the first sequential transition model, the decoder outputs a frame image two frames after the frame image acquired by the frame image acquisition unit immediately before switching; the frame image The writing unit writes the frame image output by the decoder to the frame image storage unit in which the frame image is written immediately before the switching; the frame image acquiring unit is configured by the frame image acquiring unit immediately before the switching. A frame image one frame after the acquired frame image may be acquired.

  In order to solve the above problem, according to another aspect of the present invention, a computer decodes a picture configured in a video stream and outputs a frame image, and a frame image storage for storing the frame image. And a computer program that functions as a video processing apparatus. The computer program includes frame image writing means for writing the frame image output from the decoder into the frame image storage unit so that the frame image is stored continuously for at least two frames; The frame image storage unit or the frame image storage unit so as to correspond to any one of the reproduction modes of the forward reproduction mode for outputting and reproducing the frame image, or the reverse reproduction mode for outputting and reproducing the frame image in the direction opposite to the forward direction. And a frame image acquisition means for acquiring a frame image from the decoder.

  In order to solve the above-described problem, according to another aspect of the present invention, a computer decodes a picture configured in a video stream and outputs a frame image, and a frame image output by the decoder. There is provided a computer program that functions as a video processing apparatus that includes a frame image storage unit including a first frame image storage unit and a second frame image storage unit that stores two frames continuously. The computer program causes the decoder to decode a future image from the image stored in the frame image storage unit with a plurality of arranged pictures, and sets a writing destination to write the frame image output from the decoder. The frame image writing destination is determined by determining the writing destination of the frame image by repeatedly making transitions alternately with the first frame image storage unit or the second frame image storage unit, and acquiring the frame image so that the acquisition destination is the decoder. A first order transition means for determining a destination; and a frame image output from the decoder while decoding a past image from the image stored in the frame image storage unit by a plurality of pictures arranged for the decoder. The writing destination for writing is alternately repeated with the first frame image storage unit or the second frame image storage unit. The acquisition destination for acquiring the frame image is determined by moving the frame image so that the frame image output from the decoder is a frame image storage unit other than the writing destination to which the frame image is written. Second order transition means for determining an acquisition destination; and according to the determination by the first order transition means or the second order transition means, the frame image is stored in the first frame image storage unit or the second frame image storage. A frame image writing means for writing to the frame; a frame image from the first frame image storage section, the second frame image storage section, or the decoder according to the determination by the first order transition means or the second order transition means. And a frame image acquisition means for acquiring the image data.

  In order to solve the above-described problem, according to another aspect of the present invention, a computer decodes a picture configured in a video stream and outputs a frame image, and a frame image output by the decoder. Provided is a computer program that functions as a video processing apparatus that includes a frame image storage unit including a first frame image storage unit, a second frame image storage unit, and a third frame image storage unit, which stores three frames continuously. The The computer program causes the decoder to decode a future image from the image stored in the frame image storage unit with a plurality of arranged pictures, and sets a writing destination to write the frame image output from the decoder. The first frame image storage unit, the second frame image storage unit, or the third frame image storage unit is repeatedly transited in this order to determine the frame image writing destination, and the acquisition destination for acquiring the frame image is the decoder First order transition means for determining a frame image acquisition source so as to be a frame image storage unit other than the write destination to which the frame image output from the frame is written; and a plurality of pictures arranged for the decoder The image storage unit decodes a past image than the image stored in the image storage unit and also outputs a frame output from the decoder. The frame image writing destination is repeatedly changed in the order of the first frame image storage unit, the second frame image storage unit, or the third frame image storage unit to determine the writing destination of the frame image. The acquisition destination for acquiring the image is second order transition means for determining the acquisition destination of the frame image so as to be a frame image storage unit other than the writing destination to which the frame image output from the decoder is written; A frame image for writing the frame image to the first frame image storage unit, the second frame image storage unit, or the third frame image storage unit according to the determination by the first order transition unit or the second order transition unit. Writing means; according to the determination by the first order transition means or the second order transition means, the first frame image storage unit, the second frame image憶部 or is characterized by causing a computer to function as a frame image obtaining means for obtaining a frame image from the third frame image storage unit.

  As described above, according to the present invention, it is possible to improve the responsiveness of frame advance playback.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments of the invention will be described in detail with reference to the accompanying drawings. In the following description and the accompanying drawings, components having substantially the same functions and configurations are denoted by the same reference numerals, and redundant description is omitted.

(About video playback device)
First, a video playback apparatus (video processing apparatus) 101 according to the first embodiment will be described with reference to FIG. FIG. 1 is a block diagram illustrating an example of a schematic configuration of the video reproduction apparatus according to the first embodiment.

  The video playback device 101 is a device having a playback function for decoding video data recorded on the recording medium 131 and outputting the frame image from the selection unit 143 to an output device (output device) such as a display device.

  As shown in FIG. 1, the video playback apparatus 101 according to the first embodiment includes an instruction receiving unit 111 that receives an instruction for frame-by-frame playback from the user in the future or the past, a controller 113, and a recording medium reading Unit 123, future image reproduction model storage unit (first order transition model storage unit) 125, buffer 127, decoding unit 128, and past image reproduction model storage unit (second order transition model storage unit). 129, a frame memory 141, and a selection unit 143.

  The instruction receiving unit 111 receives, for example, an instruction from a user for future frame-by-frame playback that plays video toward the end of the video in time series, or past frame-by-frame playback that plays the video retrospectively. The button is composed of one or more buttons (future frame advance playback button, playback stop button, past frame advance playback button, playback end button, etc.) that can be used. As long as various instructions can be received from the user, a pointing device such as a trackball, a trackpad, a stylus pen, a dial log, or a joystick or a keyboard may be used.

  Note that future frame-by-frame playback or past frame-by-frame playback according to this embodiment is performed by referring to or executing the future image playback model 125 or the past image playback model 136 by the controller 113. The details will be described later.

  In addition, when the instruction receiving unit 111 receives an instruction from the user, the instruction receiving unit 111 transmits an instruction signal such as a future frame advance reproduction signal indicating the instruction content to the controller 113. Upon receiving such an instruction signal, the controller 113 controls each unit such as the recording medium reading unit 123 to execute frame-by-frame playback.

  The recording medium reading unit 123 reads the video stream recorded on the recording medium 131 from the recording medium 131 in units of GOPs, for example, and transfers it to the buffer 127. The buffer 127 sequentially writes and stores video streams transferred from the recording medium reading unit 123.

  In addition, the image signal sequence is rearranged (reordered) on the recording medium 131 and encoded into a GOP (Group Of Picture, or a group of pictures) composed of one or more pictures. A video stream is recorded. Therefore, the video stream includes one or more GOPs. The video stream includes moving images and / or audio. Note that the video stream is not limited to the moving image, and may include a still image, for example.

  The recording medium 131 according to the present embodiment exemplifies an optical disk such as a CD-ROM or a DVD, or a magnetic disk such as a hard disk drive, for example, as long as it can store a video stream encoded by the MPEG method or the like. However, it is not limited to such an example.

  The buffer 127 according to the present embodiment can be exemplified by a memory such as SDRAM or DRAM, but is not limited to such an example.

  The future image reproduction model storage unit 125 is a storage unit that stores the future image reproduction model 134. Similarly to the future image reproduction model storage unit 125, the past image reproduction model storage unit 129 is a storage unit that stores the past image reproduction model 136. The future image reproduction model storage unit 125 and the past image reproduction model storage unit 129 are, for example, a ROM (Read Only Memory) or an HDD (Hard Disk Drive), but are not limited thereto.

  The future image reproduction model 134 and the past image reproduction model 136 are written in the frame memory 141 from the frame memory 141 and the frame image to be read is transferred from the frame memory 141 to the frame memory 141. It represents the behavior of the transition between the acquisition source and the acquisition destination.

  More specifically, the future image reproduction model 134 and the past image reproduction model 136 are programs such as firmware or instruction data that are executed or referred to when the controller 113 controls frame advance reproduction. The future image reproduction model 134 and the past image reproduction model 136 will be described in detail later.

  As described above, the instruction data includes, for example, the write destination of the frame memory 141 into which the frame image is written and the acquisition destination of the frame memory 141 from which the frame image is acquired so that the controller 113 can refer to and control the data. Such information is included, but is not limited to such an example.

  The decoding unit 128 reads the video stream stored in the buffer 127 from the storage area of the buffer 127, decodes each of one or more frames configured in the GOP, and outputs a frame image. As described above, the frame image indicates an image decoded by the decoding unit 128.

  When decoding the picture, the decoding unit 128 outputs the frame image to one of the frame memories 141 (141-1, 141-2) based on an instruction from the controller 113.

  The frame memory 141 can store a frame image for one frame transferred from the decoding unit 128. That is, as shown in FIG. 1, two frame images can be stored in the frame memory 141-1 and the frame memory 141-2.

  The frame memory 141 according to the present embodiment is not limited to the type of memory as long as it is a memory that can store a frame image or delete a stored frame image.

  The selection unit 143 acquires a frame image from any one of the decoding unit 128, the frame memory 141-1, and the frame memory 141-2, and outputs the frame image to a display device or the like.

  The selection unit 143 acquires a frame image from the decoding unit 128, the frame memory 141-1, or the frame memory 141-2 based on an instruction from the controller 113.

  As shown in FIG. 1, the future image reproduction model storage unit 125 and the past image reproduction model storage unit 129 according to the first embodiment have been described as an example. The present invention is not limited to an example, and for example, the present invention can be implemented even when the future image reproduction model storage unit 125 and the past image reproduction model storage unit 129 are integrally configured as one storage unit.

  Further, as shown in FIG. 1, the frame memory 141 has been described by taking as an example the case where the frame memory 141 is composed of two storage areas of the frame memory 141-1 and the frame memory 141-2, but is not limited to such an example. If the frame images for two frames can be divided and stored, for example, one storage area of the frame memory 141 is divided into two, and two frame images are stored in each storage area. It may be the case.

  Although not shown in FIG. 1, the video reproduction device 101 further includes a display device (not shown) corresponding to a display unit that can output the video signal output from the decoding unit 128. Good. For example, the display device can display the video signal output from the decoding unit 128 on the screen. The display device can be exemplified by a liquid crystal display, for example, and can output a still image, a moving image, audio, or any combination thereof.

  Next, the GOP will be described. The GOP is a collection of pictures (image data) of one or more frames encoded according to the MPEG system or the like. Note that a GOP is generally composed of, for example, 10 frames to 15 frames of picture in one GOP. However, the GOP is not limited to such an example, and is called a so-called Long GOP. It may be the case.

  The picture includes an I picture (Intra picture or intra-frame encoded image), a P picture (Predictive picture or inter-frame forward prediction encoded image), and a B picture (Bidirectionally predictive encoded image). Or bi-predictive encoded image) and three types of pictures. In addition, although the picture concerning this Embodiment says the image or data of each flame | frame comprised in the image data after encoding, for example, it is not limited to this example.

  The I picture is an independent picture that does not use the correlation with the previous frame, the P picture is a picture that uses the correlation with the previous frame, and the B picture includes both the previous and next frames. It is a picture that uses the correlation of.

  In general, the image quality at the same bit rate is better when the B picture is sandwiched between the I picture or the P picture than when only the I picture and the P picture are used without using the B picture.

  Further, the video playback apparatus 101 according to the first embodiment has been described by taking as an example a case having a playback function. However, the video playback apparatus 101 is not limited to such an example. Or an apparatus that further includes at least one of a recording apparatus that encodes an input video signal into video data and records it on the recording medium 131.

  The video playback apparatus 101 according to the present embodiment may be provided with a display device that outputs video, or may be connected to the outside as a separate display device.

(About frame-by-frame playback processing)
Next, with reference to FIG. 1 and FIG. 2, the frame feed reproduction processing by the video reproduction apparatus 101 according to the first embodiment will be described. FIG. 2 is an explanatory diagram in which a part of the configuration of the video reproduction apparatus 101 in FIG. 1 is enlarged.

  As shown in FIGS. 1 and 2, in the frame advance playback processing by the video playback apparatus 101, the controller 113 performs control as shown in the following (1) to (4).

  (1) The controller 113 plays a frame memory 141 (one past frame image, one current frame image, one future frame image) one by one, centering on the currently reproduced frame image. 141-1, 141-2).

  (2) In accordance with the future or past frame advance reproduction instructed by the user, the controller 113 sends the frame image of the display image to be output to the selection unit 143 as the frame memory 141 (141-1, 141-2) or It is acquired from the decoding unit 128.

  (3) In response to future or past frame-by-frame playback, the controller 113 instructs the decoding unit 128 to frame-by-frame for playback of the future image based on the frame image of the display image to be output from the selection unit 143 ( In the case of future frame-by-frame playback), an instruction is given to decode a future picture that is one frame later in time, and in the case of past frame-by-frame playback (past frame-by-frame playback), one frame before in time Instructs to decode past pictures. Note that only when decoding is performed immediately after the playback mode is switched to future frame-by-frame playback or past frame-by-frame playback, the controller 113 instructs the decoding unit 128 to 2 of the frame image decoded immediately before when switching to future frame-by-frame playback. An instruction is given to decode a picture corresponding to a frame after the frame, and an instruction is given to decode a picture corresponding to two frames before the frame image decoded immediately before when switching to past frame advance playback is performed. In addition, the controller 113 controls the buffer 127 to output the corresponding picture of the video stream to be decoded by the decoding unit 128 to the decoding unit 128.

  The controller 113 or the decoding unit 128 performs management for each frame image / picture by detecting the PES header in the video stream stored in the buffer 127, for example, and the controller 113 or the decoding unit 128 detects the video stream. Are detected, read, decoded, and output based on the PES header information, but the present invention is not limited to this example.

  (4) The controller 113 instructs the decoding unit 128 to output the frame image decoded from the picture by the decoding unit 128 to either the frame memory 141-1 or the frame memory 141-2, and the frame memory 141 Stores the frame image output from the decoding unit 128.

  Next, the frame advance reproduction process according to the first embodiment will be described more specifically with reference to FIG. FIG. 3 is an explanatory diagram showing an outline of the frame advance playback process according to the first embodiment.

  For the convenience of explanation, numbers for identifying the frame images are assigned to the frame images in FIG. In the following description, the frame image number will be used for explanation. In future frame-by-frame playback, the description will be made using the frame image numbers. For example, the order of the frame images output on the screen is frame image 5, frame image 6, frame image 7,. Then, it becomes frame image 7, frame image 6, frame image 5,.

  If the controller 113 refers to or executes the future image reproduction model 134 or the past image reproduction model 136, the processing of each unit included in the video reproduction apparatus 101 for the future or past frame advance reproduction is illustrated in FIG. )become that way.

  In FIG. 3B, as an initial state, for example, the frame image 7 is stored in the frame memory 141-1 (FM1), the frame image 6 is stored in the frame memory 141-2 (FM2), and the decoding unit 128 (D ), The frame image 7 is decoded and the frame image 7 from the decoding unit 128 is output on the screen. However, the present invention is not limited to this example.

  Note that the playback mode “0” shown in FIG. 3B indicates a state where playback has not started, the playback mode “+1” indicates the future frame-by-frame playback, and “−1” indicates the state of the past frame-by-frame playback. Show.

  Next, when an instruction signal for future frame advance playback is transmitted from the instruction receiving unit 111 to the controller 113, the controller 113 executes or references the future image playback model 134 and sets the playback mode to “+1”. Then, the controller 113 instructs the decoding unit 128 to output the frame image 8 after the frame image 7 to the FM 2 based on the future image reproduction model 134.

  The decoding unit 128 receives the picture in the video stream necessary for decoding the frame image 8 from the buffer 127, and the decoding unit 128 decodes the picture received from the buffer 127 into the frame image 8.

  Furthermore, the decoding unit 128 outputs the frame image 8 to FM2. Upon receiving the frame image 8 from the decoding unit 128, the FM 2 overwrites the frame image 6 with the frame image 8 (“6 → 8” in FIG. 3B) and writes the frame image 8 (FIG. 3B). , 8 → FM2).

  Next, the controller 113 instructs the selection unit 143 to acquire the frame image 8 output by the decoding unit 128 based on the future image reproduction model 134. The frame image 8 acquired by the selection unit 143 is output on the screen (D (8) in FIG. 3B).

  When the frame image 8 is output, the future frame advance playback is continued. Therefore, the controller 113 outputs the frame image 9 one frame after the frame image 8 to the decoding unit 128 to FM1. Instruct.

  By storing the frame image 9 as the display image in the FM 1 and storing the frame image 8 one frame before in the FM 2, the video playback device 101 always holds the previous frame image for one frame in future frame advance playback. can do.

  The decoding unit 128 receives the picture in the video stream necessary for decoding the frame image 9 from the buffer 127, and the decoding unit 128 decodes the picture received from the buffer 127 into the frame image 9.

  Further, the decoding unit 128 outputs the frame image 9 to FM1. Upon receiving the frame image 9 from the decoding unit 128, the FM 1 overwrites the frame image 7 with the frame image 9 (the second playback mode “+1” in FIG. 3B, “7 → 9” from the top), The frame image 9 is written (writing in FIG. 3B, 9 → FM1). That is, the frame memory 141 stores two consecutive frame images such as the frame image 8 and the frame image 9.

  Next, the controller 113 instructs the selection unit 143 to acquire the frame image 9 output from the decoding unit 128 based on the forward reproduction model 134. The frame image 9 acquired by the selection unit 143 is output on the screen (D (9) in FIG. 3B).

  Similarly to the above, when the frame image 9 is output, the future frame advance playback is continued. Therefore, the controller 113 next outputs the frame image 10 after the frame image 9 to the decoding unit 128 to the FM 2. Instruct to do.

  The decoding unit 128 receives the picture in the video stream necessary for decoding the frame image 10 from the buffer 127, and the decoding unit 128 decodes the picture received from the buffer 127 into the frame image 10.

  Furthermore, the decoding unit 128 outputs the frame image 10 to FM2. When the FM 2 receives the frame image 10 from the decoding unit 128, the FM 2 overwrites the already stored frame image 8 (“8 → 10” in FIG. 3B) and writes the frame image 10 (FIG. 3). 3 (b) writing, 10 → FM2).

  Thus, the frame images stored in the frame memory 141 are alternately stored as FM1 or FM2. That is, in forward frame advance reproduction, frame images are sequentially stored one frame at a time toward the future while frame images are alternately stored in FM1 or FM2.

  Next, the controller 113 instructs the selection unit 143 to acquire the frame image 10 output from the decoding unit 128 based on the forward reproduction model 134. The frame image 10 acquired by the selection unit 143 is output on the screen (D (10) in FIG. 3B).

  When the frame image 9 is output and an instruction signal for backward frame-by-frame playback is transmitted from the instruction receiving unit 111 to the controller 113, the controller 113 stops execution or reference of the future image playback model 134, and the past image The playback model 136 is executed or referred to, and the playback mode is set to “−1”. Then, based on the past image reproduction model 136, the controller 113 switches the frame image 8 two frames before the frame image 10 decoded immediately before the frame advance reproduction switching to the decoding unit 128. Instruct to output to FM2 written immediately before. As described above, the frame image two frames before or after two frames is decoded, for example, immediately after the frame advance reproduction is switched to the future or past frame advance reproduction. However, the present invention is not limited to this example.

  Next, the decoding unit 128 outputs the picture in the video stream necessary for decoding the frame image 8 from the buffer 127, and the decoding unit 128 decodes the picture received from the buffer 127 into the frame image 8. (Arrow A in FIG. 3B).

  Furthermore, the decoding unit 128 outputs the frame image 8 to FM2. When the FM 2 receives the frame image 8 from the decoding unit 128, the FM 2 overwrites the frame image 8 already stored (“10 → 8” in FIG. 3B) and writes the frame image 8 (FIG. 3). 3 (b) writing, 8 → FM2).

  In this way, when the future frame-by-frame playback is switched, the frame image 141 first decoded by the past frame-by-frame playback is stored in the frame memory 141 that stores the frame image last written by the future frame-by-frame playback. The

  Next, the controller 113 instructs the selection unit 143 to acquire the frame image 9 already stored in the FM 1 based on the past image reproduction model 136. The frame image 9 acquired by the selection unit 143 is output on the screen (FM1 (9) in FIG. 3B).

  In this way, by outputting the frame image stored in the frame memory 141 instead of from the decoding unit 128, even if a delay occurs due to the decoding of the frame image two frames before by the decoding unit 128, the future or past The frame-by-frame playback can be switched smoothly, and the responsiveness to switching of the frame-by-frame playback from the user can be improved.

  When the frame image 9 is output, the controller 113 instructs the decoding unit 128 to output the frame image 7 one frame before the frame image 8 to the FM 1 in order to continue the frame advance playback. .

  By storing the frame image 7 in FM1 and storing the frame image 8 which becomes the display image after one frame in FM2, the video reproduction apparatus 101 always displays the past frame image for one frame even in the past frame advance reproduction. Can be held.

  The decoding unit 128 outputs the picture in the video stream necessary for decoding the frame image 7 from the buffer 127, and the decoding unit 128 decodes the picture received from the buffer 127 into the frame image 7.

  Furthermore, the decoding unit 128 outputs the frame image 7 to FM1. Upon receiving the frame image 7 from the decoding unit 128, the FM 1 overwrites the frame image 9 with the frame image 7 (“9 → 7” in FIG. 3B) and writes the frame image 7 (FIG. 3B). , 7 → FM1). That is, the frame memory 141 stores two consecutive frame images such as the frame image 7 and the frame image 8.

  Next, the controller 113 instructs the selection unit 143 to acquire the frame image 8 already stored in the FM 2 based on the past image reproduction model 136. The frame image 8 acquired by the selection unit 143 is output on the screen (FM2 (8) in FIG. 3B). Therefore, the video playback apparatus 101 can output the frame image by going back to the past one frame at a time, and can appropriately execute the past frame-by-frame playback. In the subsequent frame-by-frame playback, as in the playback mode “−1” in FIG. 3B, the frame image in the frame memory 141 one frame before the frame image decoded by the decoding unit 128 is used as the display image. Is output.

  As shown in FIG. 3B, when the frame image 8 is output in the past frame advance reproduction and the instruction signal for the future frame advance reproduction is transmitted from the instruction receiving unit 111 to the controller 113, the controller 113 The execution or reference of the image reproduction model 136 is stopped, the future image reproduction model 134 is executed or referred again, and the reproduction mode is set to “+1”. Then, based on the future image reproduction model 134, the controller 113 switches the frame image 9 two frames after the frame image 7 decoded immediately before the frame advance reproduction switching to the decoding unit 128. Instruct to output to FM1 written immediately before.

  Next, the decoding unit 128 receives the picture in the video stream necessary for decoding the frame image 9 from the buffer 127, and the decoding unit 128 decodes the picture received from the buffer 127 into the frame image 9. (Arrow B in FIG. 3B).

  Further, the decoding unit 128 outputs the frame image 9 to FM1. When FM1 receives the frame image 9 from the decoding unit 128, it overwrites the already stored frame image 7 with the frame image 9 ("7 → 9" at the bottom in FIG. 3B). Write (write in FIG. 3B, 9 → FM1).

  Next, the controller 113 instructs the selection unit 143 to acquire the frame image 9 decoded by the previous decoding unit 128 based on the past image reproduction model 136. The frame image 9 acquired by the selection unit 143 is output on the screen (D (9) in FIG. 3B).

  In this way, when switching from future frame advance playback to past frame advance playback, since the frame image to be the display image is not stored in the frame memory 141, it is selected until the decoding of the frame image 9 after the second frame is completed. The unit 143 cannot output a frame image, and a delay occurs in switching frame-by-frame playback. Thereafter, the same operation as described above continues until the future or past frame-by-frame playback stops.

  In the frame-by-frame playback according to the first embodiment, the case where the frame memory 141 is two frame memories of the frame memory 141-1 and the frame memory 141-2 has been described as an example. The frame memory 141 is not limited to an example, and can be implemented even when the frame memory 141 includes two or more frame memories. The case where the frame memory 141 has three frame memories will be described later.

  Here, a delay when decoding into a frame image will be described with reference to FIG. FIG. 4 is an explanatory diagram showing a schematic configuration of a plurality of pictures configured in a video stream.

  As shown in FIG. 4, for example, a video stream includes a plurality of pictures such as B0, B1, I2,. In FIG. 4, “B” indicates a B picture, “I” indicates an I picture, and “P” indicates a P picture.

  When decoding B3 in FIG. 4 into a frame image, the decoding unit 128 needs the pictures I2 and P5 in FIG. On the other hand, when decoding P5 two frames after B3 into a frame image, the decoding unit 128 needs a picture of I2 in FIG. 4, and decoding of B3 requires more pictures than decoding of P5.

  Also, when decoding B6 of FIG. 4 into a frame image, the decoding unit 128 needs the pictures P5 and P8 of FIG. On the other hand, when decoding P8 two frames after B6 into a frame image, the decoding unit 128 requires pictures of I2 and P5 in FIG. 4, and therefore decoding of B6 has more pictures than decoding of P8. There is a delay required.

  Therefore, even if a delay due to decoding by the decoding unit 128 occurs, frame-by-frame playback that can smoothly switch to future or past frame-by-frame playback and improve the responsiveness of instructions from the user will be described below.

(About the second embodiment)
Next, the video playback device 101a according to the second embodiment will be described with reference to FIG. FIG. 5 is a block diagram showing a schematic configuration of a video reproduction apparatus according to the second embodiment.

  Note that the video playback device 101a according to the second embodiment is particularly different from the video playback device 101a according to the second embodiment and the video playback device 101 according to the first embodiment. The point will be described. Others are substantially the same unless otherwise specified, and will not be described in detail.

  As shown in FIG. 5, the video playback apparatus 101a according to the second embodiment further includes a frame memory 141-3 as compared with the video playback apparatus 101 according to the first embodiment shown in FIG. This is the first feature. That is, the frame memory 141 includes a frame memory 141-1, a frame memory 141-2, and a frame memory 141-3.

  The future image reproduction model storage unit (first order transition model storage unit) 125a stores the future image reproduction model 137, and the past image reproduction model storage unit (second order transition model storage unit) 129a. The second feature is that a past image reproduction model 138 is stored.

  The future image reproduction model 134 and the past image reproduction model 136 described above are used in the controller 113 when the frame memory 141 can store two frames of frame images, whereas the future image reproduction model 137 described above. The past image reproduction model 138 is different in that it is used when the frame memory 141 can store frame images for three frames. Details will be described later.

  When the picture is decoded, the decoding unit 128a outputs a frame image to one of the frame memories 141 (141-1, 141-2, 141-3) based on an instruction from the controller 113.

  The selection unit 143a acquires a frame image from any one of the frame memory 141-1, the frame memory 141-2, and the frame memory 141-3 in accordance with an instruction from the controller 113. The acquired frame image is output to a display device or the like.

  As shown in FIG. 5, the future image reproduction model storage unit 125a and the past image reproduction model storage unit 129a according to the second embodiment have been described as examples. The present invention is not limited to this example. For example, the present invention can be implemented even when the future image reproduction model storage unit 125a and the past image reproduction model storage unit 129a are integrally configured as one storage unit.

  Further, as shown in FIG. 5, the frame memory 141 has been described by taking as an example a case where the frame memory 141 is configured by three storage areas of the frame memory 141-1, the frame memory 141-2, and the frame memory 141-3. However, the present invention is not limited to this example. If it is possible to store frame images for three frames in a divided manner, for example, one storage area of the frame memory 141 is divided into three and the frame image of three frames is It may be stored in each storage area.

(About frame-by-frame playback processing)
Next, with reference to FIG. 5 and FIG. 6, a frame feed reproduction process by the video reproduction apparatus 101a according to the second embodiment will be described. FIG. 6 is an explanatory diagram in which a part of the configuration of the video reproduction apparatus 101a in FIG. 5 is enlarged.

  As shown in FIG. 5 and FIG. 6, in the frame advance playback processing by the video playback apparatus 101a, the controller 113 performs the control as shown in the following (1) to (4).

  (1) The controller 113 plays a frame memory 141 (one past frame image, one current frame image, one future frame image) one by one, centering on the currently reproduced frame image. 141-1, 141-2, 141-3).

  (2) In accordance with the future or past frame advance playback instructed by the user, the controller 113 sends the frame image of the display image to be output to the selection unit 143a as the frame memory 141-1, the frame memory 141-2, or It is acquired from any of the frame memories 141-3.

  (3) In response to future or past frame-by-frame playback, the controller 113 causes the decoding unit 128a to perform frame-by-frame playback of future images based on the frame image of the display image to be output from the selection unit 143a ( In the case of future frame advance playback), an instruction is given to decode the picture one frame later in time, and in the case of past frame advance playback (past frame advance playback), the picture one frame earlier in time is selected. Instruct to decrypt. Note that only when decoding is performed immediately after the playback mode is switched to future frame-by-frame playback or past frame-by-frame playback, the controller 113 instructs the decoding unit 128a to 3 An instruction is given to decode a picture corresponding to a frame, and when switching to past frame advance playback, an instruction is given to decode a picture corresponding to three frames before the frame image decoded immediately before. In addition, the controller 113 controls the buffer 127 to output the corresponding picture of the video stream to be decoded by the decoding unit 128a to the decoding unit 128a. That is, the controller 113 instructs to decode a picture corresponding to two frames before the frame image output on the screen immediately before.

  (4) The controller 113 instructs the decoding unit 128a to output the frame image decoded from the picture by the decoding unit 128a to either the frame memory 141-1, the frame memory 141-2, or the frame memory 141-3. The frame memory 141 stores the frame image output from the decoding unit 128a.

  Next, the frame advance reproduction processing according to the first embodiment will be described more specifically with reference to FIG. FIG. 7 is an explanatory diagram showing an outline of the frame advance playback processing according to the first embodiment.

  In the frame image of FIG. 7A, as in FIG. 3A, numbers for identifying the frame images are given in time series for convenience of explanation. In the following description, the frame image number will be used for explanation. Other details are substantially the same as in FIG. 3A, and detailed description thereof is omitted.

  When the controller 113 refers to or executes the future image reproduction model 137 or the past image reproduction model 138, the control of each unit included in the video reproduction apparatus 101 for the future or past frame advance reproduction is illustrated in FIG. )become that way.

  In FIG. 7B, as an initial state, for example, frame image 5 is stored in frame memory 141-1 (FM1), frame image 6 is stored in frame memory 141-2 (FM2), and frame memory 141-3. The frame image 7 is stored in (FM3), the frame image 7 is decoded by the decoding unit 128 (D), and the frame image 6 of the FM2 is output on the screen (the output of FIG. 7B, FM2). (6)) is not limited to such an example.

  Next, when an instruction signal for future frame advance playback is transmitted from the instruction receiving unit 111 to the controller 113, the controller 113 executes or references the future image playback model 137 and sets the playback mode to “+1”. Then, based on the future image reproduction model 137, the controller 113 instructs the decoding unit 128a to output the frame image 8 two frames after the frame image 6 that is a display image to the FM1.

  That is, in the initial state, it is FM1 that stores the oldest (oldest numbered) frame image among FM1, FM2, or FM3. The frame images are updated in order.

  The decoding unit 128 a outputs the picture in the video stream necessary for decoding the frame image 8 from the buffer 127, and the decoding unit 128 decodes the picture received from the buffer 127 into the frame image 8.

  Furthermore, the decoding unit 128a outputs the frame image 8 to the FM1. Upon receiving the frame image 8 from the decoding unit 128a, the FM 1 overwrites the frame image 5 with the frame image 8 (the first “5 → 8” from the top in the reproduction mode “+1” in FIG. 7B), The frame image 8 is written (writing in FIG. 7B, 8 → FM1).

  If the state in which frame images 5 to 7 are stored in FM1, FM2, and FM3 in the initial state continues as they are, the frame image 7 of FM3 is output on the screen in the first reproduction mode + 1, and then the reproduction mode Under the condition of +1, since the frame image 8 to be displayed next to the frame image 7 does not already exist in the frame memory 141, a delay may occur in displaying.

  Referring to FIG. 7 again, next, the controller 113 instructs the selection unit 143a to acquire the frame image 7 already stored in the FM 3 based on the future image reproduction model 137. The frame image 7 acquired by the selection unit 143a is output on the screen (FM3 (7) in FIG. 7B).

  When the frame image 7 is output, the future frame advance playback is continued. Therefore, the controller 113 outputs the frame image 9 after the decoded frame image 8 to the decoding unit 128a to the FM2. Instruct.

  The decoding unit 128 a outputs a picture in the video stream necessary for decoding the frame image 9 from the buffer 127, and the decoding unit 128 a decodes the picture received from the buffer 127 into the frame image 9.

  Furthermore, the decoding unit 128a outputs the frame image 9 to the FM2. Upon receiving the frame image 9 from the decoding unit 128a, the FM 2 overwrites the frame image 6 with the frame image 9 (the second from the top in the reproduction mode “+1” in FIG. 7B “6 → 9”), The frame image 9 is written (writing in FIG. 7B, 9 → FM2). That is, the frame memory 141 stores three consecutive frame images such as the frame image 7 to the frame image 9.

  Next, the controller 113 instructs the selection unit 143a to acquire the frame image 8 already stored in the FM1, based on the future image reproduction model 137. The frame image 8 acquired by the selection unit 143a is output on the screen (FM (8) in FIG. 7B).

  Similarly to the above, when the frame image 8 is output, the future frame-by-frame playback is continued. Therefore, the controller 113 next sends the frame image 10 after the decoded frame image 9 to the decoding unit 128a. Instruct to output.

  The decoding unit 128 a outputs the picture in the video stream necessary for decoding the frame image 10 from the buffer 127, and the decoding unit 128 a decodes the picture received from the buffer 127 into the frame image 10.

  Furthermore, the decoding unit 128a outputs the frame image 10 to the FM3. When the FM 3 receives the frame image 10 from the decoding unit 128a, the FM 3 overwrites the already stored frame image 7 with the frame image 10 (“7 → 10” in FIG. 7B), and writes the frame image 10 (FIG. 7 (b) writing, 10 → FM3).

  Thus, the frame image stored in the frame memory 141 stores FM1, FM2, or FM3 in order. That is, in the future frame advance playback, the frame image is sequentially stored one frame at a time toward the future while the frame image is sequentially stored in FM1, FM2, or FM3.

  Next, the controller 113 instructs the selection unit 143a to acquire the frame image 9 already stored in the FM 2 based on the future image reproduction model 137. The frame image 9 acquired by the selection unit 143 is output on the screen (FM2 (9) in FIG. 3B).

  From the above, in future frame advance playback, the frame image decoded by the decoding unit 128a and written in the frame memory 141 and the frame image acquired from the frame memory 141 by the selection unit 143a are shifted by one frame. . That is, since the frame image acquired by the selection unit 143a always exists on the frame memory 141, the frame image can be smoothly output on the screen without delay.

  When the frame image 9 is output on the screen and an instruction signal for past frame advance reproduction is transmitted from the instruction reception unit 111 to the controller 113, the controller 113 stops execution or reference of the future image reproduction model 137, and the past The image reproduction model 138 is executed or referred to, and the reproduction mode is set to “−1”. Then, based on the past image reproduction model 138, the controller 113 instructs the decoding unit 128a to switch the frame image 7 three frames before the frame image 10 decoded immediately before the frame advance reproduction switching to the frame advance reproduction switching. Instruct to output to FM3 written immediately before. As described above, decoding into the frame image three frames before or after three frames is performed only immediately after switching to the future or past frame advance playback.

  Next, the decoding unit 128a outputs the picture in the video stream necessary for decoding the frame image 7 from the buffer 127, and the decoding unit 128a decodes the picture received from the buffer 127 into the frame image 7. To do.

  Further, the decoding unit 128a outputs the frame image 7 to the FM3. When the FM 3 receives the frame image 7 from the decoding unit 128a, the FM 3 overwrites the already stored frame image 10 with the frame image 7 (“10 → 7” in FIG. 7B) and writes the frame image 7 (FIG. 7). 7 (b) writing, 7 → FM3).

  As described above, when switching from future frame advance playback to past frame advance playback, the frame image 141 decoded in the past frame advance playback is stored in the frame memory 141 that stores the frame image last written in the future frame advance playback. Remembered.

  Next, the controller 113 instructs the selection unit 143a to acquire the frame image 8 already stored in the FM1, based on the past image reproduction model 138. The frame image 8 acquired by the selection unit 143a is output on the screen (FM1 (8) in FIG. 7B).

  In this way, by outputting the frame image stored in the frame memory 141 instead of from the decoding unit 128a, it takes time to decode the frame image corresponding to the previous three frames when switching frame-by-frame playback. However, the frame image can be decoded while the frame image is output from the frame memory 141 (for example, for 0.3 seconds or more). Responsiveness to switching of frame-by-frame playback can be improved.

  When the frame image 8 is output on the screen, the past frame advance reproduction is continued. Therefore, the controller 113 sends the frame image 6 before the frame image 7 decoded immediately before to the FM 2 to the decoding unit 128a. Instruct to output.

  The decoding unit 128 a outputs a picture in the video stream necessary for decoding the frame image 6 from the buffer 127, and the decoding unit 128 a decodes the picture received from the buffer 127 into the frame image 6.

  Furthermore, the decoding unit 128a outputs the frame image 6 to the FM2. Upon receiving the frame image 6 from the decoding unit 128a, the FM 2 overwrites the frame image 8 with the frame image 6 (“8 → 6” in FIG. 7B) and writes the frame image 6 (FIG. 7B). , 6 → FM2).

  Next, the controller 113 instructs the selection unit 143a to acquire the frame image 7 already stored in the FM 3 based on the past image reproduction model 138. The frame image 7 acquired by the selection unit 143a is output on the screen (FM3 (7) in FIG. 7B).

  Similarly, when the frame image 7 is output on the screen, the controller 113 instructs the decoding unit 128a to output the frame image 5 before the frame image 6 decoded immediately before to the FM1.

  The decoding unit 128 a outputs a picture in the video stream necessary for decoding the frame image 5 from the buffer 127, and the decoding unit 128 a decodes the picture received from the buffer 127 into the frame image 5.

  Further, the decoding unit 128a outputs the frame image 5 to the FM1. Upon receiving the frame image 5 from the decoding unit 128a, the FM 1 overwrites the frame image 8 with the frame image 5 (“8 → 5” in FIG. 7B) and writes the frame image 5 (FIG. 7B). Writing, 5 → FM1).

  Next, the controller 113 instructs the selection unit 143a to acquire the frame image 6 already stored in the FM 2 based on the past image reproduction model 138. The frame image 6 acquired by the selection unit 143a is output on the screen (FM2 (6) in FIG. 7B).

  From the above, the video playback apparatus 101 can output the frame image by going back to the past one frame at a time, and can appropriately execute the past frame advance playback. In the subsequent frame-by-frame playback, as in the playback mode “−1” in FIG. 7B, the frame image in the frame memory 141 one frame after the frame image decoded by the decoding unit 128a is used as the display image. Is output.

  Next, as shown in FIG. 7B, when the frame image 6 is output on the screen in the past frame advance reproduction and an instruction signal for future frame advance reproduction is transmitted from the instruction receiving unit 111 to the controller 113, The controller 113 stops execution or reference of the past image reproduction model 138, executes or references the future image reproduction model 137 again, and sets the reproduction mode to “+1”. Then, based on the future image reproduction model 137, the controller 113 instructs the decoding unit 128a to switch the frame image 8 three frames after the frame image 5 decoded immediately before the frame advance reproduction switching, to the frame advance reproduction switching. Instruct to output to FM1 written immediately before.

  Next, the decoding unit 128a receives the picture in the video stream necessary for decoding the frame image 8 from the buffer 127, and the decoding unit 128a decodes the picture received from the buffer 127 into the frame image 8. To do.

  Furthermore, the decoding unit 128a outputs the frame image 8 to the FM1. When the FM 1 receives the frame image 8 from the decoding unit 128a, the FM 1 overwrites the already stored frame image 5 with the frame image 8 (the second “5” from the lowest level in the reproduction mode “+1” in FIG. 7B). → 8 ″), the frame image 8 is written (writing in FIG. 7B, 8 → FM1).

  Next, the controller 113 instructs the selection unit 143a to acquire the frame image 7 already stored in the FM 3 based on the past image reproduction model 138. The frame image 7 acquired by the selection unit 143a is output on the screen (FM3 (7) in FIG. 7B).

  Similarly, when the frame image 7 is output on the screen, the controller 113 instructs the decoding unit 128a to output the frame image 9 after the frame image 8 decoded immediately before to the FM2.

  The decoding unit 128 a outputs a picture in the video stream necessary for decoding the frame image 9 from the buffer 127, and the decoding unit 128 a decodes the picture received from the buffer 127 into the frame image 9.

  Further, the decoding unit 128a outputs the frame image 9 to the FM1. Upon receiving the frame image 9 from the decoding unit 128a, the FM 1 overwrites the frame image 6 with the frame image 9 (the first “6 → 9” from the bottom in the reproduction mode “+1” in FIG. 7B). , Frame image 9 is written (writing in FIG. 7B, 9 → FM2).

  Next, the controller 113 instructs the selection unit 143a to acquire the frame image 8 already stored in the FM1, based on the past image reproduction model 138. The frame image 8 acquired by the selection unit 143a is output on the screen (FM1 (8) in FIG. 7B). The subsequent future frame advance playback is the same as the process shown in the playback mode “+1” in FIG. 7B.

  Thus, unlike the frame-by-frame playback according to the first embodiment, the frame-by-frame playback according to the second embodiment provides a display image regardless of whether the frame-by-frame playback is switched to the past or the future. A frame image can be output from the frame memory 141. Therefore, the decoding process by the decoding unit 128a can be completed while the frame image is output from the frame memory 141, and the frame-by-frame playback is smoothly switched to improve the responsiveness of the frame-by-frame playback instruction to the user. be able to.

  In the frame-by-frame playback according to the second embodiment, the frame memory 141 is an example in which the frame memory 141 is a frame memory of the frame memory 141-1, the frame memory 141-2, and the frame memory 141-3. However, the present invention is not limited to this example, and the frame memory 141 can be implemented even when it has four or more frame memories.

Although the description of the video playback apparatus 101 according to the present embodiment is finished as described above, the video playback apparatus 101 has the following excellent effects.
(1) When there is an instruction to switch frame-by-frame playback from the user, the video processing apparatus 101 can immediately and smoothly switch to past or future frame-by-frame playback, thereby improving the responsiveness to the instruction from the user. Can do.
(2) Since the video processing apparatus 101 can suppress the storage capacity of the frame memory 141 to a capacity capable of storing frame images for at least two frames, the configuration of the frame memory 141 is reduced and the circuit configuration is reduced to a small scale. By using this, the video processing apparatus 101 can be downsized.

  The series of processes described above can be performed by dedicated hardware or software. When a series of processing is performed by software, a program constituting the software is installed in an information processing apparatus such as a general-purpose computer or a microcomputer, and causes the information processing apparatus to function as the video reproduction apparatus 101.

  The program can be recorded in advance in a hard disk or ROM as a recording medium built in the computer as the video reproduction apparatus 101.

  Alternatively, the program is not limited to a hard disk drive, but a removable recording medium such as a flexible disk, CD-ROM (Compact Disc Read Only Memory), MO (Magneto Optical) disk, DVD (Digital Versatile Disc), magnetic disk, and semiconductor memory. In addition, it can be stored (recorded) temporarily or permanently. Such a removable recording medium can be provided as so-called package software.

  The program is installed on the computer from the removable recording medium 111 as described above, or transferred from the download site to the computer wirelessly via a digital satellite broadcasting artificial satellite, or a LAN (Local Area Network), The program can be transferred by wire to a computer as the video playback apparatus 101 via a network such as the Internet, and the computer can receive the program transferred in this way and install it in a built-in hard disk or the like.

  Here, in this specification, the processing steps for describing a program for causing a computer to perform various processes do not necessarily have to be processed in time series in the order described in the flowchart, but in parallel or individually. This includes processing to be executed (for example, parallel processing or processing by an object).

  The program may be processed by one computer, or may be distributedly processed by a plurality of computers.

  As mentioned above, although preferred embodiment of this invention was described referring an accompanying drawing, this invention is not limited to this example. It is obvious for a person skilled in the art that various changes or modifications can be envisaged within the scope of the technical idea described in the claims, and these are naturally within the technical scope of the present invention. It is understood that it belongs.

  In the above-described embodiment, the frame memory 141 has been described by taking the case of having two frame memories and the case of having three frame memories as examples, but the present invention is not limited to such examples. For example, the frame memory 141 can be implemented even when it has four or more frame memories.

  In the above embodiment, the controller 113, the future image reproduction model storage unit 125, and the past image reproduction model storage unit 129 have been described as examples. However, the present invention is limited to such an example. For example, even when the controller 113, the future image reproduction model storage unit 125, and the past image reproduction model storage unit 129 are integrally configured, the present invention can be implemented. In such a case, the future image reproduction model 134 and the past image reproduction model 136 may function as one of the controllers 113 in hardware or software.

  The present invention can be applied to a video processing apparatus capable of frame-by-frame playback.

It is a block diagram which shows an example of a schematic structure of the video reproduction apparatus concerning 1st Embodiment. It is explanatory drawing which expanded a part of structure of the video reproduction apparatus shown in FIG. It is explanatory drawing which shows the outline of the frame advance reproduction | regeneration processing concerning 1st Embodiment. It is explanatory drawing which shows schematic structure of the some picture comprised in a video stream. It is a block diagram which shows schematic structure of the video reproduction apparatus concerning 2nd Embodiment. It is explanatory drawing which expanded a part of structure of the video reproduction | regeneration apparatus 101a shown in FIG. It is explanatory drawing which shows the outline of the frame advance reproduction | regeneration processing concerning 1st Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Video reproduction apparatus 111 Instruction reception part 113 Controller 123 Recording medium reading part 125 Future image reproduction model memory | storage part 127 Buffer 128 Decoding part 129 Past image reproduction model memory | storage part 131 Recording medium 134,137 Future image reproduction model 136,138 Past image reproduction model 141 Frame memory 143 Selection unit

Claims (13)

A decoder that decodes a picture configured in a video stream and outputs a frame image;
A frame image storage unit for storing the frame image;
A frame image writing unit for writing the frame image output from the decoder to the frame image storage unit so that the frame image is stored continuously for at least two frames;
Corresponding to one of the playback modes of the forward playback mode in which the frame image is output in the forward direction and played back, or the backward playback mode in which the frame image is output in the reverse direction of the forward direction and played back, A frame image acquisition unit for acquiring a frame image from the frame image storage unit or the decoder;
A video processing apparatus comprising: A frame image storage unit including a first frame image storage unit and a second frame image storage unit, which continuously store two frame images obtained by decoding and outputting pictures configured in a video stream by a decoder;
The decoder decodes a future image from the image stored in the frame image storage unit with a plurality of pictures arranged in the decoder, and sets the write destination to which the frame image output from the decoder is written as the first frame image The frame image writing destination is determined by making repeated transitions alternately with the storage unit or the second frame image storage unit, and the acquisition destination for acquiring the frame image determines the acquisition destination of the frame image so as to be the decoder. A first sequential transition model storage unit for storing a first sequential transition model;
The decoder causes the decoder to decode a past image from the image stored in the frame image storage unit with a plurality of arranged pictures, and to write the frame image output from the decoder to the first frame image The storage unit or the second frame image storage unit is alternately and repeatedly transited to determine the frame image writing destination, and the acquisition destination for acquiring the frame image is the writing in which the frame image output from the decoder is written. A second sequential transition model storage unit that stores a second sequential transition model that determines a frame image acquisition destination so as to be a frame image storage unit other than the previous one;
A frame image writing unit for writing the frame image into the first frame image storage unit or the second frame image storage unit according to the first sequential transition model or the second sequential transition model;
A frame image acquisition unit for acquiring a frame image from the first frame image storage unit, the second frame image storage unit, or the decoder according to the first sequential transition model or the second sequential transition model;
A video processing apparatus comprising:   When the first sequential transition model is changed to the second sequential transition model, the frame image acquisition unit uses the frame image already stored in the first frame image storage unit or the second frame image storage unit. The video processing device according to claim 2, wherein the video processing device is acquired. When a frame image is written into the first frame image storage unit by the frame image writing unit and the first sequential transition model is switched to the second sequential transition model, the frame image acquisition unit Obtaining a frame image stored in the image storage unit;
The decoder outputs a frame image one frame before the frame image acquired by the frame image acquisition unit;
4. The video processing apparatus according to claim 2, wherein the frame image writing unit writes the frame image output by the decoder into the first frame image storage unit. 5. When a frame image is written in the second frame image storage unit by the frame image writing unit and the first sequential transition model is switched to the second sequential transition model, the frame image acquisition unit Obtaining a frame image stored in the image storage unit;
The decoder outputs a frame image one frame before the frame image acquired by the frame image acquisition unit;
5. The video processing apparatus according to claim 2, wherein the frame image writing unit writes the frame image output by the decoder into the second frame image storage unit. 6. A frame including a first frame image storage unit, a second frame image storage unit, and a third frame image storage unit, which continuously stores three frame images obtained by decoding and outputting pictures configured in a video stream by a decoder An image storage unit;
The decoder decodes a future image from the image stored in the frame image storage unit with a plurality of pictures arranged in the decoder, and sets the write destination to which the frame image output from the decoder is written as the first frame image The storage unit, the second frame image storage unit, or the third frame image storage unit is repeatedly transited in this order to determine the writing destination of the frame image, and the acquisition destination from which the frame image is acquired is output from the decoder A first sequential transition model storage unit that stores a first sequential transition model that determines a frame image acquisition destination so as to be a frame image storage unit other than the writing destination in which the frame image is written;
The decoder causes the decoder to decode a past image from the image stored in the frame image storage unit with a plurality of arranged pictures, and to write the frame image output from the decoder to the first frame image The storage unit, the second frame image storage unit, or the third frame image storage unit is repeatedly transited in this order to determine the writing destination of the frame image, and the acquisition destination from which the frame image is acquired is output from the decoder A second sequential transition model storage unit that stores a second sequential transition model that determines a frame image acquisition destination so as to be a frame image storage unit other than the writing destination in which the frame image is written;
A frame image document for writing the frame image to the first frame image storage unit, the second frame image storage unit, or the third frame image storage unit in accordance with the first sequential transition model or the second sequential transition model. With the insert;
A frame image acquisition unit that acquires a frame image from the first frame image storage unit, the second frame image storage unit, or the third frame image storage unit according to the first sequential transition model or the second sequential transition model When;
A video processing apparatus comprising:   The video processing apparatus according to claim 6, wherein an acquisition destination for acquiring the frame image excludes a frame image storage unit that stores a frame image acquired immediately before by the frame image acquisition unit. .   Whichever of the first sequential transition model or the second sequential transition model, any one of the first frame image storage unit, the second frame image storage unit, and the third frame image storage unit is selected. The video processing apparatus according to claim 6, wherein the frame image acquired by the frame image acquisition unit is a frame image corresponding to a middle frame among three consecutive frame images. . When switching from the first sequential transition model to the second sequential transition model, the decoder outputs a frame image two frames before the frame image acquired by the frame image acquisition unit immediately before switching;
The frame image writing unit writes the frame image output by the decoder to the frame image storage unit in which the frame image is written immediately before the switching;
The video processing according to any one of claims 6 to 8, wherein the frame image acquisition unit acquires a frame image one frame before the frame image acquired by the frame image acquisition unit immediately before switching. apparatus. When switching from the second sequential transition model to the first sequential transition model, the decoder outputs a frame image two frames after the frame image acquired by the frame image acquisition unit immediately before switching;
The frame image writing unit writes the frame image output by the decoder to the frame image storage unit in which the frame image is written immediately before the switching;
The video processing according to any one of claims 6 to 9, wherein the frame image acquisition unit acquires a frame image one frame after the frame image acquired by the frame image acquisition unit immediately before switching. apparatus. A computer program for causing a computer to function as a video processing apparatus including a decoder that decodes pictures configured in a video stream and outputs a frame image, and a frame image storage unit that stores the frame image:
Frame image writing means for writing the frame image output from the decoder to the frame image storage unit so that the frame image is stored continuously for at least two frames;
Corresponding to one of the playback modes of the forward playback mode in which the frame image is output in the forward direction and played back, or the backward playback mode in which the frame image is output in the reverse direction of the forward direction and played back, Frame image acquisition means for acquiring a frame image from the frame image storage unit or the decoder;
A computer program characterized by functioning as A decoder for decoding a picture configured in a video stream and outputting a frame image by using a computer, and a first frame image storage unit and a second frame for storing two consecutive frame images output by the decoder A computer program that functions as a video processing device including a frame image storage unit including an image storage unit:
The decoder decodes a future image from the image stored in the frame image storage unit with a plurality of pictures arranged in the decoder, and sets the write destination to which the frame image output from the decoder is written as the first frame image The frame image writing destination is determined by making repeated transitions alternately with the storage unit or the second frame image storage unit, and the acquisition destination for acquiring the frame image determines the acquisition destination of the frame image so as to be the decoder. First order transition means;
The decoder causes the decoder to decode a past image from the image stored in the frame image storage unit with a plurality of arranged pictures, and to write the frame image output from the decoder to the first frame image The storage unit or the second frame image storage unit is alternately and repeatedly transited to determine the frame image writing destination, and the acquisition destination for acquiring the frame image is the writing in which the frame image output from the decoder is written. Second order transition means for determining a frame image acquisition destination so as to be a frame image storage unit other than the destination;
Frame image writing means for writing the frame image into the first frame image storage unit or the second frame image storage unit according to the determination by the first order transition unit or the second order transition unit;
Frame image acquisition means for acquiring a frame image from the first frame image storage section, the second frame image storage section, or the decoder according to the determination by the first order transition means or the second order transition means;
A computer program characterized by functioning as A first frame image storage unit, a second frame, which stores a frame image output from the decoder by decoding a picture composed in a video stream and outputting a frame image, and a frame image output by the decoder in succession. A computer program that functions as a video processing apparatus including an image storage unit and a frame image storage unit including a third frame image storage unit:
The decoder decodes a future image from the image stored in the frame image storage unit with a plurality of pictures arranged in the decoder, and sets the write destination to which the frame image output from the decoder is written as the first frame image The storage unit, the second frame image storage unit, or the third frame image storage unit is repeatedly transited in this order to determine the writing destination of the frame image, and the acquisition destination from which the frame image is acquired is output from the decoder First order transition means for determining a frame image acquisition destination so as to be a frame image storage unit other than the writing destination in which the frame image is written;
The decoder causes the decoder to decode a past image from the image stored in the frame image storage unit with a plurality of arranged pictures, and to write the frame image output from the decoder to the first frame image The storage unit, the second frame image storage unit, or the third frame image storage unit is repeatedly transited in this order to determine the writing destination of the frame image, and the acquisition destination from which the frame image is acquired is output from the decoder Second order transition means for determining a frame image acquisition destination so as to be a frame image storage unit other than the writing destination in which the frame image is written;
A frame for writing the frame image to the first frame image storage unit, the second frame image storage unit, or the third frame image storage unit according to the determination by the first order transition unit or the second order transition unit. Image writing means;
A frame image for acquiring a frame image from the first frame image storage unit, the second frame image storage unit, or the third frame image storage unit according to the determination by the first order transition unit or the second order transition unit. Acquisition means;
A computer program characterized by functioning as

Images