KR20070059847A - Apparatus for image processing and method thereof - Google Patents

Abstract

An apparatus and a method for processing an image are provided to improve frame advance reproduction response with a small-capacity memory and a small-scale circuit configuration. An image processing apparatus(101) includes a decoder(128), a plurality of frame memories(141-1,141-2), a selector(143), and a controller(113). The decoder decodes a picture composed of video streams and outputs frame images. The frame memories respectively store the frame images. The selector selects one of the frame images output from the decoder and the frame images stored in the frame memories according to a forward or backward reproduction mode designated by a user. The controller controls the decoder, the frame memories and the selector according to a first sequence transition model and a second sequence transition model which designate frame images to be decoded by the decoder, frame images to be stored in the frame memories and a frame image to be selected by the selector when the video streams are reproduced forward and when the video streams are reproduced backward.

Description

Apparatus for image processing and method

1 is a block diagram showing an example of a schematic configuration of a video reproducing apparatus according to the first embodiment.

FIG. 2 is an explanatory diagram in which a part of the configuration of the video reproducing apparatus shown in FIG. 1 is enlarged.

3 is a schematic explanatory diagram of a frame advance reproduction process according to the first embodiment.

4 is an explanatory diagram showing a schematic configuration of a plurality of pictures composed of a video stream.

5 is a block diagram showing a schematic configuration of a video reproducing apparatus according to the second embodiment.

FIG. 6 is an explanatory diagram in which a part of the configuration of the video reproducing apparatus 101a shown in FIG. 5 is enlarged.

7 is a schematic explanatory diagram of a frame advance reproduction process according to the second embodiment.

<Description of the code>

101, 101a: video playback device (image processing device)

111: instruction receiving unit 113: controller

123: Recording medium acquisition unit (reading unit)

125, 125a: Future image (forward) reproduction model storage unit

127: buffer 128, 128a: decoder

129, 129a: past image (reverse) reproduction model storage unit

131: recording medium

134, 137: future image (forward) reproduction model

136, 138: past image (reverse) reproduction model

141: frame memory 143, 143a: selection

The present invention relates to image processing, and more particularly, to an image processing apparatus and method for improving frame advance reproduction responsiveness.

The MPEG (Motion Picture Coding Experts Group) method and the like exist as a method of encoding and recording a moving picture or voice. The video or audio coded in this way is decoded and output on the screen.

Background Art [0002] There is a frame advance reproducing apparatus for reproducing an image while advancing a frame every frame using the moving picture compression encoding technique such as the MPEG method.

However, since the reverse frame advance playback by these devices represents only the output order of the image to be displayed on the screen during the reverse frame advance playback, such a playback method speeds up the response to the reverse frame advance playback by the playback device. It was difficult to realize.

In the moving picture compression coding method such as the MPEG method, for example, since there is an image that needs to refer to a future and past image at the time of encoding or the like, the reverse playback which plays back the image on the video stream to the past is reproduced. It becomes complicated and it is difficult to raise the responsiveness of such a reproduction apparatus.

In addition, the frame advance reproduction processing apparatus capable of forward and reverse frame advance reproduction maintains a 3GOP image in the frame memory of the memory and reads the image in the forward or reverse direction when outputting from the output terminal as a video signal. Changing target memory.

However, in the reproduction method using the frame advance reproduction processing apparatus, since the memory stores 3GOP images, that is, at least 45 frames (or frame images), the capacity of the frame memory is indispensable (inevitable) and the circuit configuration is large. There is a problem.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and an object of the present invention is to provide an image processing apparatus and method capable of increasing frame advance reproduction responsiveness while having a small memory and a small circuit configuration.

Another object of the present invention is to provide a computer-readable recording medium having recorded thereon a program for executing the image processing method on a computer.

An image processing apparatus for achieving the technical problem comprises: a decoding unit for decoding a picture composed of an image stream and outputting a frame image; A plurality of frame memories each storing one frame image successively output by the decoder; A selection unit for selecting one of the frame images output from the decoding unit or one of the frame images stored in the frame memory according to a forward or reverse reproduction mode instructed by a user; And a first order of designating a frame image to be decoded by the decoding unit, a frame memory to store the decoded frame image, and a frame image to be selected by the selection unit, respectively, when the video stream is played in the forward direction and in the reverse direction. And a controller for controlling the decoding unit, the frame memory, and the selection unit as specified in the transition model and the second sequence transition model. When the second sequence transition model plays the video stream in the reverse direction, The decoding unit decodes the frame image one frame past than the frame image of the past among the frame images stored in the frame memory, and the decoded frame image stores the most future frame image among the plurality of frame memories. Frame memory in memory To allow to select a frame image in the previous frame of an image of stored in the frame memory other than the frame memory stores the decoded frame in which parts are preferred.

In one embodiment, the number of the plurality of frame memories is two, and the first sequence shifting model causes the decoder to determine the most of the frame images stored in the frame memory when the video stream is reproduced in the forward direction. And decodes the frame image of one frame later than the frame image of the future, and the decoded frame image stores the frame memory storing the frame image of the past among the plurality of frame memories, and causes the selection unit to decode the frame image. It is preferable to select the frame image additionally output.

More preferably, the first sequence shift model, when reproducing the video stream in the forward direction, causes the decoder to decode an image one frame future from the frame image of the future among the frame images stored in the frame memory. The decoded frame image is stored in a frame memory that stores the most recent frame image of the plurality of frame memories, and the selection unit is stored in a frame memory other than the frame memory in which the decoded frame is stored. It is desirable to select the future frame image among the frame images which have been taken.

The number of the plurality of frame memories is n, and immediately after the controller changes from the first sequence shift model to the second sequence shift model, the decoder decodes a frame past n frames from a frame image previously decoded. The image is decoded, and immediately after the second sequence shift model is changed to the first sequence shift, it is preferable that the decoder decodes a frame image of an n-frame future from a frame image previously decoded.

An image processing method for achieving the technical problem comprises the steps of: decoding a picture consisting of a video stream to output a frame image; Successively writing the decoded frame image to one of a plurality of frame memories; And selecting and playing one of the decoded frame image or the frame image stored in the frame memory according to a forward or reverse reproduction mode instructed by a user, and outputting the frame image comprises: Decoding the frame image one frame past the most recent frame image among the frame images stored in the frame memory when the video stream is played in the reverse direction, and the recording of the decoded frame image includes: Recording the decoded frame image into a frame memory storing the most recent frame image of the plurality of frame memories when the video stream is played in the reverse direction, and selecting and playing the frame image includes: When the video stream is played in the reverse direction, the It is preferable to include the step of selecting the oldest frame image among the frame images stored in the frame memory other than the frame memory in which the called frame is stored.

The outputting of the frame image may further include decoding a frame image of one frame future than the frame image of the future among the frame images stored in the frame memory when the video stream is reproduced in the forward direction. The recording of the decoded frame image further includes recording the decoded frame image to a frame memory that stores the most recent frame image of the plurality of frame memories when the video stream is reproduced in the forward direction. Selecting and reproducing the frame image may include selecting a future frame image among frame images stored in a frame memory other than a frame memory in which the decoded frame is stored when reproducing the video stream in a forward direction. It is more preferable to further include.

The number of the plurality of frame memories is n, and the outputting of the frame image includes the past n frames from the previously decoded frame image immediately after the video stream is changed from the forward playback mode to the reverse playback mode. Decoding a frame image of the frame; And immediately after the change from the mode of reproducing the video stream in the reverse direction to the mode of reproducing in the forward direction, decoding the frame image of n frames in the future from the previously decoded frame image.

In order to solve the above problems, according to another aspect of the present invention, a decoder for decoding a picture consisting of a video stream and outputs a frame image; A frame image storage section for storing the frame image; A frame image recording unit for recording the frame image output from the decoder so that the frame image is stored at least two consecutive frames; The frame image storage unit or the decoder so as to correspond to any one of a forward playback mode in which the frame image is output in a forward direction and reproduced; or a reverse playback mode in which the frame image is output in a reverse direction to the forward direction and reproduced. And a frame image acquiring unit for acquiring a frame image from the apparatus.

According to the present invention, a recording portion is determined in which frame image storage unit to record the frame image output by the decoder, and the recording of the frame image is controlled in the frame image storage unit of the determined recording portion. Moreover, in order to acquire the frame image to output, it acquires which acquisition part is acquired from which frame image storage part, and controls the acquisition process which acquires a frame image from the frame image storage part of the determined acquisition part. According to such a structure, even if a reproduction mode is changed, a frame image can be acquired without delay and interruption, and responsiveness can be improved about conversion of a reproduction mode.

The forward playback mode is a mode indicating playback of frame images in order from the past to the future according to time series, and the reverse playback mode is a mode indicating playback of frame images in order from the future to the past, as opposed to time series. Can be.

In order to solve the above problems, according to still another aspect of the present invention, a first frame image storage unit and a second frame image which store a frame image decoded and outputted by a decoder in a frame composed of a video stream in two consecutive frames A frame image storage section including a storage section; The first frame image storage section or the first frame recording section records a frame image output from the decoder while decoding a future image from a picture stored in the frame image storage section. The recording portion of the frame image is determined by repeatedly shifting alternately with the two-frame image storage section, and the acquiring portion for acquiring the frame image stores a first sequence transition model for determining the acquiring portion of the frame image so that the decoder is the decoder. A first sequence shift model memory; The first frame image storage section or the first frame recording section records a frame image output from the decoder while decoding a past image from the image stored in the frame image storage section. The recording portion of the frame image is determined by repeatedly shifting alternately with the two-frame image storage portion, and the acquisition portion for acquiring the frame image is such that the frame image storage portion other than the recording portion in which the frame image output from the decoder is recorded is recorded. A second sequence shift model storage unit for storing a second sequence shift model for determining an acquisition portion of the second transition sequence model; A frame image recording unit for recording the frame image in the first frame image storage unit or the second frame image storage unit in accordance with the first sequence shift model or the second sequence shift model; And a frame image acquisition unit for acquiring a frame image from the first frame image storage unit, the second frame image storage unit, or the decoder according to the first sequence shift model or the second sequence shift model. have.

The frame image acquisition unit may be configured to acquire a frame image from the frame image storage unit or the decoder without interruption even if either of the first sequence transition model or the second sequence transition model is switched.

When switching from the first sequence shift model to the second sequence shift model, the frame image acquisition unit may acquire a frame image already stored in the first frame image storage unit or the second frame image storage unit.

When the frame image is recorded in the first frame image storage unit by the frame image recording unit and is switched from the first sequence transition model to the second sequence transition model, the frame image acquisition unit is stored in the second frame image storage unit. A frame image is acquired, and the decoder outputs a frame image one frame before the frame image acquired by the frame image acquisition unit, and the frame image recording unit stores the frame image output by the decoder in the first frame image storage. You may record in the department.

When the frame image is recorded in the first frame image storage unit by the frame image recording unit and is switched from the second sequence transition model to the first sequence transition model, the frame image acquisition unit is stored in the second frame image storage unit. The frame image may be acquired, and the decoder may output the frame image one preceding the frame image stored in the first frame image storage unit.

When the frame image is recorded in the second frame image storage unit by the frame image recording unit and is switched from the first sequence transition model to the second sequence transition model, the frame image acquisition unit is stored in the first frame image storage unit. Acquire a frame image, and the decoder outputs a frame image one frame before the frame image acquired by the frame image acquisition unit, and the frame image recording unit replaces the frame image output by the decoder with the second frame image. It may be recorded in the storage unit.

When the frame image is recorded in the first frame image storage unit by the frame image recording unit and is switched from the second sequence transition model to the first sequence transition model, the frame image acquisition unit is stored in the second frame image storage unit. The frame image may be acquired, and the decoder may output the frame image one preceding the frame image stored in the first frame image storage unit.

In order to solve the above problems, according to still another aspect of the present invention, there is provided a first frame image storage unit and a second frame image which store three consecutive frames of a frame image decoded and output by a decoder. A frame image storage section including a storage section and a third frame image storage section; The first frame image storage section, the first frame image storage section which decodes a future image from a picture stored in a frame image storage section for a plurality of pictures aligned with the decoder, and records a frame image output from the decoder. The recording portion of the frame image is determined by repeatedly shifting in the order of the two-frame image storage portion or the third frame image storage portion, and the acquisition portion for acquiring the frame image is other than the recording portion in which the frame image output from the decoder is recorded. A first sequence shift model storage unit for storing a first sequence shift model for determining an acquisition portion of the frame image to be a frame image storage unit of the first image; The first frame image storage section, the first frame image storage section which decodes a picture of the past from an image stored in the frame image storage section for a plurality of pictures aligned with the decoder, and records a frame image output from the decoder. The recording portion of the frame image is determined by repeatedly shifting in the order of the two-frame image storage portion or the third frame image storage portion, and the acquisition portion for acquiring the frame image is other than the recording portion in which the frame image output from the decoder is recorded. A second sequence shift model storage unit for storing a second sequence shift model for determining an acquisition portion of the frame image such that the frame image storage unit is a frame image storage unit; A frame image recording unit for recording the frame image in the first frame image storage unit, the second frame image storage unit, or the third frame image storage unit according to the first sequence shift model or the second sequence shift model; ; And a frame image acquisition unit for acquiring a frame image from the first frame image storage unit, the second frame image storage unit, or the third frame image storage unit according to the first sequence shift model or the second sequence shift model. It is characterized by.

The frame image acquisition unit may be configured to acquire a frame image from the frame image storage unit or the decoder without interruption even if either of the first sequence transition model or the second sequence transition model is switched.

The acquisition part which acquires the said frame image may make it the object out of the frame image storage part which memorize | stores the frame image acquired immediately before by the said frame image acquisition part.

The frame image acquisition unit from any one of the first frame image storage unit, the second frame image storage unit, or the third frame image storage unit is switched to either the first sequence transition model or the second sequence transition model. The frame image obtained by means of the frame image can be configured to be a frame image corresponding to a center frame among frame images that are three frames continuous. With such a configuration, the frame image can be obtained and output smoothly without interruption.

When switching from the first sequence shift model to the second sequence shift model, the decoder outputs a frame image two frames before the frame image acquired by the frame image acquisition unit immediately before the change, and the frame image recording unit The frame image output by the decoder is recorded for the frame image storage section in which the frame image is recorded immediately before the switching, and the frame image acquisition section is one frame before the frame image acquired by the frame image acquisition section immediately before the switching. You may make it acquire a frame image.

When the second sequence shift model is switched from the second sequence shift model to the first sequence shift model, the decoder outputs a frame image two frames after the frame image acquired by the frame image acquisition unit immediately before switching, and the frame image recording unit The frame image output by the decoder is recorded for the frame image storage unit in which the frame image is recorded immediately before the switching, and the frame image acquisition unit is a frame one frame after the frame image acquired by the frame image acquisition unit just before the switching. You may acquire an image.

In order to solve the above problems, according to another aspect of the present invention, a computer includes a decoder for decoding a picture composed of a video stream and outputting a frame image, and a frame image storage unit for storing the frame image. A computer program for functioning as an apparatus is provided. The computer program includes frame image recording means for recording the frame image output from the decoder so that the frame image is stored at least two consecutive frames; And a forward playback mode for outputting and reproducing the frame image in the forward direction, or a reverse playback mode for outputting and reproducing the frame image in the reverse direction to the forward direction. And a frame image obtaining means for acquiring a frame image from the apparatus.

In order to solve the above problems, according to another aspect of the present invention, a computer allows a computer to decode a picture composed of a video stream and output a frame image, and to store two consecutive frames of the frame image output by the decoder. A computer program for functioning as an image processing apparatus having a frame image storage section including a first frame image storage section and a second frame image storage section is provided. The computer program decodes a future image from a picture stored in a frame image storage section with a plurality of pictures arranged for the decoder, and simultaneously records a recording portion for recording a frame image output from the decoder. A first sequence shifting means for determining a recording portion of a frame image by repeatedly shifting alternately with the second frame image storage portion or the second frame image storage portion, and for acquiring a frame image to obtain the frame image ; The first frame image storage section or the first frame recording section records a frame image output from the decoder while decoding a past image from the image stored in the frame image storage section. The recording portion of the frame image is determined by repeatedly shifting alternately with the two-frame image storage portion, and the acquisition portion for acquiring the frame image is such that the frame image storage portion other than the recording portion in which the frame image output from the decoder is recorded is recorded. Second sequence shifting means for determining an acquisition portion of the; Frame image recording means for recording the frame image in the first frame image storage section or the second frame image storage section in accordance with the determination by the first sequence transition means or the second sequence transition means; And frame image acquisition means for acquiring a frame image from the first frame image storage unit, the second frame image storage unit, or the decoder in accordance with the determination by the first sequence transition means or the second sequence transition means. It is characterized by the function.

In order to solve the above problems, according to another aspect of the present invention, a computer allows a computer to decode a picture composed of a video stream and output a frame image, and to store three consecutive frames of the frame image output by the decoder. A computer program is provided which functions as an image processing apparatus including a frame image storage section including a first frame image storage section, a second frame image storage section, and a third frame image storage section. The computer program decodes a future image from a picture stored in a frame image storage section with a plurality of pictures arranged for the decoder, and simultaneously records a recording portion for recording a frame image output from the decoder. The second frame image storage section or the third frame image storage section is repeatedly transitioned to determine the recording portion of the frame image, and the acquisition portion for acquiring the frame image is recorded by the frame image output from the decoder. First sequence shifting means for determining an acquisition portion of the frame image to be a frame image storage portion other than the recorded portion; The first frame image storage section, the first frame image storage section which decodes a picture of the past from an image stored in the frame image storage section for a plurality of pictures aligned with the decoder, and records a frame image output from the decoder. The recording portion of the frame image is determined by repeatedly shifting in the order of the two-frame image storage portion or the third frame image storage portion, and the obtaining portion for obtaining the frame image is other than the recording portion in which the frame image output from the decoder is recorded. Second sequence shifting means for determining an acquisition portion of the frame image so as to be a frame image storage section of the frame; A frame for recording the frame image in the first frame image storage unit, the second frame image storage unit, or the third frame image storage unit in accordance with the determination by the first sequence transition unit or the second sequence transition unit. Image recording means; And a frame for acquiring a frame image from the first frame image storage unit, the second frame image storage unit, or the third frame image storage unit in accordance with the determination by the first sequence transition unit or the second sequence transition unit. A computer is operated by an image acquisition means.

Hereinafter, an image processing apparatus and a method according to the present invention will be described in detail with reference to the accompanying drawings. In the description and the accompanying drawings, redundant description is omitted by adding the same reference numerals to the components having the same function and configuration.

(About video playback device)

First, the video reproducing apparatus (video processing apparatus) 101 according to the first embodiment will be described with reference to FIG. 1. 1 is a block diagram showing an example of a schematic configuration of a video reproducing apparatus according to the first embodiment.

The video reproducing apparatus 101 has a reproducing function for decoding the video data recorded on the recording medium 131 and outputting the frame image from the selecting unit 143 to an output device (output device) such as a display device. to be.

As shown in Fig. 1, the video reproducing apparatus 101 according to the first embodiment is an instruction receiving unit 111 and a controller 113 for receiving a frame advance reproduction instruction from a user toward the future or the past, that is, in the forward or reverse direction. ), Recording medium reading unit (acquisition unit) 123, future image (forward) reproduction model storage unit (first order transition model storage unit) 125, buffer 127, decoding unit 128, past image ( Backward) A reproduction model storage unit (second sequence shift model storage unit) 129, a frame memory 141, and a selection unit 143 are provided.

The instruction reception unit 111 may, for example, display a future frame (forward) advance playback for reproducing the image toward the end of the image according to a time series, or a past frame (reverse) advance reproduction instruction for replaying the image back to the past. A button consisting of one or two or more that can be received from a user (a future frame advance play button, a play stop button, a past frame advance play button, a play end button, etc.), but is not limited to this example, and the instruction receiving unit 111 is provided to the user. As long as it can receive various instructions, it may be a pointing device such as a track ball, a track pad, a stylus pen, a dialog, or a joystick or a keyboard.

Further, in the future frame advance playback or the past frame advance playback according to the present embodiment, frame advance playback is performed by the controller 113 referencing or executing the future image playback model 134 or the past image playback model 136. Detailed description will be described later.

In addition, when the instruction reception unit 111 receives an instruction from the user, the instruction reception unit 111 transmits an instruction signal such as a future frame advance playback signal indicating the instruction content to the controller 113. When the controller 113 receives such an instruction signal, the controller 113 controls each unit such as the recording medium reading unit 123 and executes frame advance reproduction.

The recording medium reading unit 123 reads the video stream recorded on the recording medium 131 from the recording medium 131 in GOP units and transmits the image stream to the buffer 127, for example. The buffer 127 sequentially records and stores the video stream transmitted from the recording medium reading unit 123.

In addition, the recording medium 131 records a video stream encoded by a GOP (Group of Picture, or group of pictures) composed of one or two or more pictures by rearranging a sequence of image signals (ordering). Therefore, the video stream contains one or two or more GOPs. The video stream also contains moving pictures and / or audio. Moreover, the video stream is not limited to the above moving picture, and may include, for example, a still picture.

In addition, the recording medium 131 according to the present embodiment can exemplify an optical disk such as a CD-ROM or a DVD or a magnetic disk such as a hard disk drive as long as it can store a video stream encoded by, for example, an MPEG method. However, the example is not limited thereto.

In addition, the buffer 127 according to the present embodiment may exemplify a memory such as an SDRAM or a DRAM, but is not limited thereto.

The future image reproduction model storage section 125 is a storage means for storing the future image reproduction model 134. Similarly to the future image reproduction model storage unit 125, the past image reproduction model storage unit 129 is a storage unit that stores the past image reproduction model 136. In addition, the future image reproduction model storage unit 125 and the past image reproduction model storage unit 129 include, for example, a read only memory (ROM) or an HDD (hard disk drive), but are not limited to these examples.

The future image reproducing model 134 and the past image reproducing model 136 are configured to transition between a recording portion and a recording portion for recording a target frame image in the frame memory 141, and a frame image of the target frame image. The transition behavior between the acquisition part and the acquisition part obtained from (141) is expressed.

More specifically, the future image reproduction model 134 and the past image reproduction model 136 are programs or instruction data such as firmware or the like that the controller 113 executes or refers to when controlling the frame advance reproduction. The future image reproduction model 134 and the past image reproduction model 136 will be described in detail below.

In addition, as described above, the instruction data is referred to, for example, by the controller 113, and the recording portion of the frame memory 141 for recording the frame image so as to be controllable, and the frame memory 141 for acquiring the frame image. Although information, such as an acquisition part, is included, it is not limited to this example.

The decoding unit 128 obtains the video stream stored in the buffer 127 in the storage area of the buffer 127, decodes one or more frames or more of the pictures configured in the GOP, and outputs a frame image. As described above, the frame image refers to the image decoded by the decoding unit 128.

The decoder 128 outputs the frame image to one of the frame memories 141 (141-1, 141-2) based on the instruction from the controller 113 when the picture is decoded.

The frame memory 141 can store a frame image for one frame transmitted from the decoder 128. That is, as shown in Fig. 1, frame images for two frames can be stored in the frame memory 141-1 and the frame memory 141-2.

The frame memory 141 according to the present embodiment is not limited to the type of memory or the like as long as the memory can store the frame image or delete the stored frame image.

The selector 143 acquires a frame image from either the decoder 128, the frame memory 141-1, or the frame memory 141-2 and outputs the frame image to a display device or the like.

The selector 143 acquires a frame image from the decoder 128, the frame memory 141-1, or the frame memory 141-2 based on an instruction from the controller 113.

In addition, as illustrated in FIG. 1, the future image reproduction model storage unit 125 and the past image reproduction model storage unit 129 according to the first embodiment have been described as separate examples, but the present invention is not limited thereto. For example, the future image reproduction model storage unit 125 and the past image reproduction model storage unit 129 may be integrally configured as one storage unit.

In addition, as illustrated in FIG. 1, the frame memory 141 has been described with an example in which two memory regions of the frame memory 141-1 and the frame memory 141-2 are used. As long as it is possible to distinguish and store frame images for each frame, for example, one storage area of the frame memory 141 may be divided into two and two frame images may be stored in each of the storage areas.

Although not shown in FIG. 1, the video reproducing apparatus 101 may further include a display device (not shown) corresponding to a display unit or the like capable of outputting the video signal output from the decoder 128. For example, the display device may display a video signal output from the decoder 128 on a screen. The display device includes, for example, a liquid crystal display and the like, and can output still images, moving images, or audio or any combination thereof.

Next, the GOP will be described. A GOP is a collection of pictures (picture data) of one or two frames or more encoded according to the MPEG method or the like. In addition, the GOP is generally composed of 10 frames to 15 frames of pictures in 1 GOP, but is not limited to this example. The GOP is called a long GOP, for example, even when a picture including 60 frames or more is included in 1 GOP. do.

In addition, the picture includes three of an I picture (Intra picture or intra-frame coded picture), a P picture (Predictive picture or inter-frame forward predictive coded picture), and B picture (Bidirectionally predictive coded picture or bidirectional predictive coded picture). There is a picture of type. Further, the picture according to the present embodiment refers to an image or data of each frame composed of image data after encoding, for example, but is not limited to this example.

The I picture is an independent picture that does not use correlation with the previous frame, the P picture is a picture using correlation with the previous frame, and the B picture is a picture using correlation with both front and rear frames.

In general, the use of a B picture between an I picture or a P picture is better than a case of only using an I picture and a P picture without using a B picture.

The video reproducing apparatus 101 according to the first embodiment has been described as an example of a device having a reproducing function. However, the image reproducing apparatus 101 is not limited to this example. For example, the video reproducing apparatus 101 captures an image having a CCD or the like. The apparatus may further include at least one of a recording apparatus which encodes an input video signal into video data and records the same on the recording medium 131.

In addition, the video reproducing apparatus 101 according to the present embodiment may be integrated with a display device for outputting an image or a case in which the display device is connected to an external device.

(About frame advance reproduction processing)

Next, the frame advance reproduction processing by the video reproducing apparatus 101 according to the first embodiment will be described with reference to FIGS. 1 and 2. 2 is an explanatory diagram in which a part of the configuration of the video reproducing apparatus 101 of FIG. 1 is enlarged.

1 and 2, in the frame advance reproduction processing by the video reproducing apparatus 101, the controller 113 performs the control shown in (1) to (4) below.

(1) The controller 113 stores the past, present, or future frame image (or past frame image, current frame image, future frame image) one by one, centering on the frame image currently being reproduced. 141-1, 141- 2).

(2) In accordance with the future or past frame advance playback instructed by the user, the controller 113 displays the frame image of the display image to be output to the selection unit 143 in the frame memory 141 (141-1, 141- 2). Or, it acquires from the decoder 128.

(3) In accordance with future or past frame advance reproduction, the controller 113 frames advance the future image with respect to the decoder 128 based on the frame image of the display image to be output from the selection unit 143. In the case of playback (future frame advance playback), it is instructed to decode a future picture one frame later in time, and in the case of frame advance playback (past frame advance playback) of a past image, it is instructed to decode a past picture one frame before in time. do. Also, only the decoding immediately after the playback mode is changed to future frame advance playback or past frame advance playback, and the controller 113 changes the frame 128 to future frame advance playback, so that two frames of the frame image decoded immediately before are changed. Subsequently, a corresponding picture is decoded, and when a change is made to past frame advance playback, a corresponding picture is decoded two frames before the frame image decoded immediately before. The controller 113 also controls the buffer 127 to output the corresponding picture of the video stream to be decoded by the decoder 128 to the decoder 128.

In addition, the controller 113 or the decoder 128 manages for each frame image / picture by detecting, for example, the PES header in the video stream stored in the buffer 127, and the controller 113 or the decoder ( 128 detects, acquires, decodes, and outputs a picture included in an image stream based on the PES header information, but is not limited to this example.

(4) The controller 113 instructs the decoder 128 to output the frame image decoded by the decoder 128 to the picture to one of the frame memory 141-1 or the frame memory 141-2. The frame memory 141 stores the frame image output from the decoder 128.

Next, with reference to FIG. 3, the frame advance reproduction process which concerns on 1st Embodiment is demonstrated more concretely. 3 is an explanatory diagram showing an outline of a frame advance reproduction process according to the first embodiment.

For convenience of explanation, the frame image of FIG. 3A is assigned a number for identifying the frame image along the time series. In the following description, the number of such frame image will be described. When future frame advance playback is described using the number of such frame picture, the order of the frame picture output on the screen is, for example, frame picture 5, frame picture 6, frame picture 7,. In the past, the frame advance reproduction is performed by the frame image 7, frame image 6, frame image 5,... Becomes

When the controller 113 refers to or executes the future image reproduction model 134 or the past image reproduction model 136, the processing of each part provided in the image reproduction apparatus 101 for future or past frame advance reproduction is shown. It becomes like 3 (b).

In FIG. 3B, as an initial state, for example, the frame image 7 is stored in the frame memory 141-1 (FM1), the frame image 6 is stored in the frame memory 141-2 (FM2), and decoded. In the unit 128 (D), the frame image 7 is decoded, and the frame image 7 from the decoding unit 128 is output on the screen, but is not limited to this example.

Further, the playback mode " 0 "shown in Fig. 3B shows a state in which playback is not started, the playback mode " + 1 " represents a future frame advance playback, and " -1 " indicates a past frame advance playback state.

Next, when the future frame advance reproduction instruction signal is transmitted from the instruction acceptor 111 to the controller 113, the controller 113 executes or references the future image reproduction model 134 to set the reproduction mode to "+1". . The controller 113 instructs the decoder 128 to output the frame image 8 following the frame image 7 to FM2 based on the future image reproduction model 134.

The decoder 128 receives the picture in the video stream necessary for decoding the frame image 8 from the buffer 127, and the decoder 128 decodes the picture received from the buffer 127 into the frame image 8.

The decoding unit 128 also outputs the frame image 8 to FM2. Upon receiving the frame image 8 from the decoder 128, FM2 overwrites the frame image 8 with the frame image 6 (" 6 → 8 " in Fig. 3 (b)) and records the frame image 8 (Fig. 3 (b)). Record, 8 → FM2).

Next, the controller 113 instructs the selection unit 143 to acquire the frame image 8 output by the decoding unit 128 based on the future image reproduction model 134. The frame image 8 acquired by the selection unit 143 is output on the screen (D (8) in Fig. 3B).

When the frame image 8 is outputted, the controller 113 next instructs the decoder 128 to output the frame image 9 after one frame of the frame image 8 to FM1 in order to continue playback of the future frame advance.

By storing the frame image 9 as a display image in FM1 and storing the frame image 8 one frame before in FM2, the video reproducing apparatus 101 always retains the frame image of one frame past in future frame advance playback. can do.

The decoder 128 outputs the picture in the video stream necessary for decoding the frame image 9 from the buffer 127, and the decoder 128 decodes the picture received from the buffer 127 into the frame image 9.

In addition, the decoder 128 outputs the frame image 9 to FM1. Upon receiving the frame image 9 from the decoder 128, FM1 overwrites the frame image 9 with the frame image 7 ("7 → 9" from the top in the reproduction mode "+1" in Fig. 3B), The frame image 9 is recorded (recording in Fig. 3B, 9 → FM1). That is, the frame memory 141 stores frame images that are two consecutive frames, such as the frame image 8 and the frame image 9.

Next, the controller 113 instructs the selection unit 143 to acquire the frame image 9 output by the decoding unit 128 based on the forward (future image) reproduction model 134. The frame image 9 acquired by the selection unit 143 is output on the screen (D9 in Fig. 3B).

As described above, when the frame image 9 is outputted, the controller 113 next instructs the decoder 128 to output the next frame image 10 of the frame image 9 to FM2 in order to continue the future frame advance reproduction.

The decoder 128 outputs the picture in the video stream necessary for decoding to the frame image 10 from the buffer 127, and the decoder 128 decodes the picture received from the buffer 127 into the frame image 10.

Furthermore, the decoder 128 outputs the frame image 10 to FM2. When the FM2 receives the frame image 10 from the decoder 128, the frame image 10 is overwritten with the frame image 8 already stored ("8 → 10" in Fig. 3B) to record the frame image 10 (Fig. Record 3 (b), 10 → FM2).

In this way, the frame images stored in the frame memory 141 are alternately stored in the FM1 or the FM2. In other words, forward frame advance reproduction advances frame images one by one in order toward the future while alternately storing the frame images in FM1 or FM2.

Next, the controller 113 instructs the selection unit 143 to acquire the frame image 10 output by the decoder 128 based on the forward playback model 134. The frame image 10 acquired by the selection unit 143 is output on the screen (D (10) in Fig. 3 (b)).

When the frame image 9 is output and a reverse (past) frame advance reproduction instruction signal is transmitted from the instruction receiving unit 111 to the controller 113, the controller 113 stops executing or referring to the future image reproduction model 134. Then, the reproduction mode is set to "-1" by executing or referring to the past image reproduction model 136. The controller 113 records the frame image 8 of two frames before the frame advance reproduction switching immediately before the frame advance reproduction switching to the decoding unit 128 based on the past image reproduction model 136. Instructs the output to FM2. As described above, decoding the frame image two frames before or after two frames is only immediately after, for example, the frame advance reproduction is changed to the future or past frame advance reproduction, but is not limited to this example.

Next, the decoder 128 outputs the picture in the video stream necessary for decoding to the frame image 8 from the buffer 127, and the decoder 128 converts the picture received from the buffer 127 into the frame image 8. Decode (arrow A in FIG. 3 (b)).

The decoding unit 128 also outputs the frame image 8 to FM2. When the FM2 receives the frame image 8 from the decoder 128, the frame image 8 is overwritten with the frame image 10 already stored ("10 → 8" in Fig. 3B) to record the frame image 8 (Fig. Record 3 (b), 8 → FM2).

When the future or past frame advance playback is switched in this manner, the frame image decoded for the first time in the past frame advance playback is stored in the frame memory 141 which stores the frame image last recorded in the future frame advance playback.

Next, the controller 113 instructs the selection unit 143 to acquire the frame image 9 already stored in FM1 based on the past image reproduction model 136. The frame image 9 acquired by the selection unit 143 is output on the screen (FM1 (9) in Fig. 3B).

In this way, by outputting the frame image stored in the frame memory 141 instead of the decoder 128, even if a delay occurs due to decoding to the frame image two frames before, the future or past frame advance By smoothly switching playback, you can increase the responsiveness to the user's frame advance playback switching.

When the frame image 9 is output, the controller 113 instructs the decoder 128 to output the frame image 7 one frame before the frame image 8 to FM1 in order to continue playback of past frame advances.

By storing the frame image 7 in FM1 and the frame image 8 which becomes a display image after one frame in FM2, the video reproducing apparatus 101 always retains a frame image of one frame past even in past frame advance playback. Can be.

The decoder 128 receives the picture in the video stream necessary for decoding the frame image 7 from the buffer 127, and the decoder 128 decodes the picture received from the buffer 127 into the frame image 7. FIG.

The decoding unit 128 also outputs the frame image 7 to FM1. Upon receiving the frame image 7 from the decoder 128, FM1 overwrites the frame image 7 with the frame image 9 (" 9 → 7 " in Fig. 3 (b)), and records the frame image 7 (Fig. 3 (b). ), 7 → FM1). That is, the frame memory 141 stores frame images that are two consecutive frames, such as the frame image 7 and the frame image 8.

Next, the controller 113 instructs the selection unit 143 to acquire the frame image 8 already stored in FM2 based on the past image reproduction model 136. The frame image 8 acquired by the selection unit 143 is output on the screen (FM2 (8) in Fig. 3B). Therefore, the video reproducing apparatus 101 can output the frame image by turning back one frame at a time in order, and can appropriately perform the past frame advance playback. Further, even in the subsequent past frame advance playback, as shown in the playback mode " -1 " in FIG. 3B, the frame image of the frame memory 141 one frame before the frame image decoded by the decoder 128 is displayed. Is output as.

As shown in Fig. 3 (b), when the frame image 8 is output to the past frame advance reproduction, and the future frame advance reproduction instruction signal is transmitted from the instruction acceptor 111 to the controller 113, the controller 113 returns to the past. The execution or reference of the image reproduction model 136 is stopped, the future image reproduction model 134 is executed or referenced again, and the reproduction mode is set to "+1". The controller 113 records the frame image 9 after two frames of the frame image 7 decoded immediately before the frame advance reproduction conversion to the decoding unit 128 based on the future image reproduction model 134 before the frame advance reproduction conversion. Instructs the output to FM1.

Next, the decoder 128 outputs the picture in the video stream necessary for decoding to the frame image 9 from the buffer 127, and the decoder 128 converts the picture received from the buffer 127 into the frame image 9. It decodes (arrow B of FIG. 3 (b)).

The decoder 128 also outputs the frame image 9 to FM1. When the FM1 receives the frame image 9 from the decoder 128, the frame image 9 is overwritten with the frame image 7 already stored ("7 → 9" at the bottom of FIG. 3B), and the frame image 9 is recorded. (9 → FM1 at the bottom of Fig. 3 (b)).

Next, the controller 113 instructs the selection unit 143 to acquire the frame image 9 decoded by the decoder 128 just before, based on the future image reproduction model 134. The frame image 9 acquired by the selection unit 143 is output on the screen (D (9) in Fig. 3 (b)).

The operation as described above then continues until future or past frame advance playback stops.

In the frame advance reproduction according to the first embodiment, the case in which the frame memory 141 is two frame memories of the frame memory 141-1 and the frame memory 141-2 is described as an example, but is not limited thereto. The memory 141 can be implemented even when it has two or more frame memories. The case where the frame memory 141 has three frame memories will be described later.

In the frame advance playback according to the first embodiment, when the change from the past frame advance playback to the future frame advance playback, the frame image to be the display image is not stored in the frame memory 141. Until the decoding is completed, the selection unit 143 cannot output the frame image, and a delay occurs in switching the frame advance reproduction.

Delay in decoding to a frame image will be described with reference to FIG. 4.

4 is an explanatory diagram showing a schematic configuration of a plurality of pictures composed of a video stream.

As shown in Fig. 4, for example, the video stream includes B0, B1, I2,... Like this, a plurality of pictures are included. In addition, "B" shown in FIG. 4 represents B picture, "I" represents I picture, and "P" represents P picture.

When decoding B3 of FIG. 4 into a frame image, the decoding unit 128 requires pictures of I2 and P5 of FIG. On the other hand, when decoding P5 two frames after B3 into a frame image, the decoding unit 128 requires the picture of I2 in Fig. 4, and the decoding side of B3 requires more pictures than the decoding of P5.

In addition, when decoding B6 of FIG. 4 into a frame image, the decoding unit 128 requires pictures of P5 and P8 of FIG. On the other hand, when decoding P8 two frames after B6 into a frame image, the decoding unit 128 requires the pictures of I2 and P5 in Fig. 4, so that the decoding of B6 requires more pictures than the decoding of P8. This occurs.

Therefore, even if a delay caused by the decoding of the decoding unit 128 occurs, frame advance playback that can smoothly switch to future or past frame advance playback, and can improve the responsiveness of a user instruction, will be described below.

(About 2nd embodiment)

Next, the video reproducing apparatus 101a according to the second embodiment will be described with reference to FIG. 5. 5 is a block diagram showing a schematic configuration of a video reproducing apparatus according to the second embodiment.

In addition, the video reproducing apparatus 101a according to the second embodiment compares the video reproducing apparatus 101a according to the second embodiment and the video reproducing apparatus 101 according to the first embodiment, in particular with respect to differences. Explain. Otherwise, since there is no special description, since it is substantially the same, detailed description is omitted.

As shown in FIG. 5, the video reproducing apparatus 101a according to the second embodiment further includes a frame memory 141-3 as compared with the video reproducing apparatus 101 according to the first embodiment shown in FIG. The point is the first feature. That is, the frame memory 141 includes a frame memory 141-1, a frame memory 141-2, and a frame memory 141-3.

Further, the future image reproduction model storage unit (first sequence shift model storage unit) 125a stores the future image reproduction model 137 and the past image reproduction model storage unit (second sequence transition model storage unit) 129a. The second feature is that the past image reproduction model 138 is stored.

The future image reproduction model 134 and the past image reproduction model 136 described above are used for the controller 113 when the frame memory 141 can store frame images for two frames. The reproduction model 137 and the past image reproduction model 138 are different in that they are used when the frame memory 141 can store frame images for three frames. Details will be described later.

The decoding unit 128a decodes the picture and outputs the frame image to one of the frame memories 141 (141-1, 141-2, 141-3) based on the instruction from the controller 113.

The selector 143a acquires a frame image from any one of the frame memory 141-1, the frame memory 141-2, or the frame memory 141-3 according to an instruction from the controller 113. . The acquired frame image is output to a display device or the like.

In addition, as shown in FIG. 5, although the case where the future image reproduction model memory | storage part 125a and the past image reproduction model memory | storage part 129a which concerns on 2nd Embodiment consisted of a separate body was demonstrated as an example, it is not limited to this example. For example, the future image reproduction model storage unit 125a and the past image reproduction model storage unit 129a may be implemented as one storage unit.

In addition, as shown in FIG. 5, the frame memory 141 is composed of three storage areas of the frame memory 141-1, the frame memory 141-2, and the frame memory 141-3. For example, the present invention is not limited to these examples. If it is possible to classify and store three frames of frame images, for example, one frame area of the frame memory 141 is divided into three frames. The case may be stored in each of the storage areas.

(About frame advance reproduction processing)

Next, the frame advance reproduction processing by the video reproducing apparatus 101a according to the second embodiment will be described with reference to FIGS. 5 and 6. FIG. 6 is an explanatory diagram in which a part of the configuration of the video reproducing apparatus 101a of FIG. 5 is enlarged.

As shown in Figs. 5 and 6, in the frame advance reproduction processing by the video reproducing apparatus 101a, the controller 113 performs the control as shown in (1) to (4) below.

(1) The controller 113 selects a frame memory 141 each of past, present, or future frame images (or past frame images, current frame images, future frame images), centering on the frame image currently being reproduced. 141-1, 141-2, and 141-3).

(2) In accordance with the future or past frame advance playback instructed by the user, the controller 113 outputs the frame image of the display image to be output to the selection unit 143a in the frame memory 141-1 and the frame memory 141-. 2) or from one location of the frame memory 141-3.

(3) In response to future or past frame advance playback, the controller 113 frames the future image based on the frame image of the display image to be output from the selection unit 143a with respect to the decoder 128a. In the case of advanced playback (future frame advance playback), it is instructed to decode a picture after one frame temporally, and in the case of performing frame advance playback (past frame advance playback) of a past image, it is instructed to decode a picture before one frame temporally. . Then, only the decoding immediately after the playback mode is completely changed to future frame advance playback or past frame advance playback, and the controller 113 decodes the frame image decoded immediately before when the decoder 128a is switched to future frame advance playback. After three frames, the corresponding picture is decoded, and when switching to past frame advance playback is instructed, the corresponding picture is decoded three frames before the immediately decoded frame image. The controller 113 also controls the buffer 127 to output the corresponding picture of the video stream to be decoded by the decoder 128a to the decoder 128a. That is, the controller 113 instructs to decode the corresponding picture two frames before the frame image output on the screen immediately before.

(4) The controller 113 outputs the frame image decoded by the decoder 128a from the picture to one of the frame memory 141-1, the frame memory 141-2, or the frame memory 141-3. The decoding unit 128a is instructed so that the frame memory 141 stores the frame image output from the decoding unit 128a.

Next, with reference to FIG. 7, the frame advance reproduction process which concerns on 2nd Embodiment is demonstrated more concretely. 7 is a schematic explanatory diagram of a frame advance reproduction process according to the second embodiment.

In the frame image of FIG. 7A, as in FIG. 3A, a number for identifying the frame image is assigned along the time series for convenience of description. The following description will be made by using the number of such a frame image. Other details are substantially the same as those of FIG. 3A, and thus detailed descriptions thereof will be omitted.

When the controller 113 refers to or executes the future image reproduction model 137 or the past image reproduction model 138, the control of each part provided in the image reproducing apparatus 101 for future or past frame advance reproduction is shown. Same as 7 (b).

In FIG. 7B, as an initial state, for example, the frame image 5 is stored in the frame memories 141-1 and FM1, and the frame image 6 is stored in the frame memories 141-2 and FM2. The frame image 7 is stored in the frame memory 141-3 (FM3), the frame image 7 is decoded in the decoding unit 128 (D), and the frame image 6 of the FM2 is output on the screen (Fig. 7 ( The output of b), FM2 (6)), is not limited to this example.

Next, when the future frame advance reproduction instruction signal is transmitted from the instruction reception unit 111 to the controller 113, the controller 113 executes or references the future image reproduction model 137 and sets the reproduction mode to "+1". . Then, the controller 113 instructs the decoding unit 128a to output the frame image 8 after two frames of the frame image 6, which is the display image, to FM1 based on the future image reproduction model 137. FIG.

In other words, in the initial state, FM1, the oldest (oldest numbered) frame image of FM1, FM2, or FM3 is stored. In the future frame advance playback, the frame image is updated in order from the most recent frame image. I'm going.

The decoder 128a outputs the picture in the video stream necessary for decoding to the frame image 8 from the buffer 127, and the decoder 128 decodes the picture received from the buffer 127 into the frame image 8.

The decoding unit 128a also outputs the frame image 8 to FM1. When FM1 receives the frame image 8 from the decoder 128a, the frame image 8 overwrites the frame image 8 to the frame image 5 (the first "5 → 8" from the top of the reproduction mode "+1" in Fig. 7B), The frame image 8 is recorded (recording in Fig. 7 (b), 8 → FM1).

If the state in which the frame image 5 to frame image 7 is stored in the initial states FM1, FM2, and FM3 continues as it is, the first playback mode +1 outputs the frame image 7 of FM3 on the screen, and then the playback mode +1 Under the situation, since the frame image 8 displayed next to the frame image 7 does not already exist in the frame memory 141, there may be a delay in displaying.

Referring again to FIG. 7, the controller 113 instructs the selection unit 143a to acquire the frame image 7 already stored in FM3 based on the future image reproduction model 137. The frame image 7 acquired by the selection unit 143a is output on the screen (FM3 (7) in Fig. 7 (b)).

When the frame image 7 is outputted, the controller 113 next instructs the decoder 128a to output the next frame image 9 of the decoded frame image 8 to FM2 in order to continue the future frame advance reproduction.

The decoder 128a receives the picture in the video stream necessary for decoding the frame image 9 from the buffer 127, and the decoder 128a decodes the picture received from the buffer 127 into the frame image 9.

The decoding unit 128a also outputs the frame image 9 to FM2. When FM2 receives the frame image 9 from the decoder 128a, the frame image 9 overwrites the frame image 9 in the frame image 6 (the second "6 → 9" from the top in the reproduction mode "+1" in Fig. 7B), The frame image 9 is recorded (recording in Fig. 7 (b), 9 → FM2). That is, the frame memory 141 stores frame images of three consecutive frames as in the frame images 7 to 9.

Next, the controller 113 instructs the selection unit 143a to acquire the frame image 8 already stored in FM1 based on the future image reproduction model 137. The frame image 8 acquired by the selection unit 143a is output on the screen (FM (8) in Fig. 7 (b)).

As described above, when the frame image 8 is outputted, in order to continue future frame advance playback, the controller 113 next outputs the next frame image 10 of the decoded frame image 9 to the decoder 128a to FM3. Instruct.

The decoder 128a receives the picture in the video stream necessary for decoding with respect to the frame image 10 from the buffer 127, and the decoder 128a decodes the picture received from the buffer 127 into the frame image 10. FIG.

The decoding unit 128a also outputs the frame image 10 to FM3. When FM3 receives the frame image 10 from the decoder 128a, the frame image 10 overwrites the frame image 7 already stored ("7 → 10" in Fig. 7B), and records the frame image 10 (Fig. 7). Record 7 (b), 10 → FM3).

In this way, the frame images stored in the frame memory 141 are sequentially stored in the FM1, FM2, or FM3, respectively. That is, in future frame advance playback, frame images are frame-advanced one by one frame toward the future while the frame images are sequentially stored in FM1, FM2, or FM3.

Next, the controller 113 instructs the selection unit 143a to acquire the frame image 9 already stored in FM2 based on the future image reproduction model 137. The frame image 9 acquired by the selection unit 143 is output on the screen (FM2 (9) in Fig. 3B).

As described above, in future frame advance playback, the frame image decoded by the decoding unit 128a and recorded in the frame memory 141 and the frame image acquired from the frame memory 141 by the selecting unit 143a are one frame. There is a difference of minutes. That is, since the frame image acquired by the selection unit 143a always exists on the frame memory 141, the frame image can be output smoothly on the screen without delay.

When the frame image 9 is output on the screen and the past frame advance reproduction instruction signal is transmitted from the instruction reception unit 111 to the controller 113, the controller 113 stops executing or referring to the future image reproduction model 137. Then, the past image reproduction model 138 is executed or referred to, and the reproduction mode is set to "-1". Based on the past image reproduction model 138, the controller 113 immediately before the frame advance reproduction conversion of the frame image 7 of the frame image 10 decoded immediately before the frame advance reproduction conversion to the decoding unit 128a. Instructs the output to FM3 recorded in As described above, the decoding of the frame image before or after three frames is performed immediately after switching to future or past frame advance playback.

Next, the decoder 128a outputs the picture in the video stream necessary for decoding to the frame image 7 from the buffer 127, and the decoder 128a transfers the picture received from the buffer 127 into the frame image 7. Decrypt

The decoding unit 128a also outputs the frame image 7 to FM3. When the FM3 receives the frame image 7 from the decoder 128a, the frame image 7 overwrites the frame image 7 already stored ("10 → 7" in Fig. 7B), and records the frame image 7 (Fig. Record 7 (b), 7 → FM3).

When switching from future frame advance playback to past frame advance playback in this manner, the frame image decoded for the first time in past frame advance playback is stored in the frame memory 141 which stores the frame image recorded last in future frame advance playback. .

Next, the controller 113 instructs the selection unit 143a to acquire the frame image 8 already stored in FM1 based on the past image reproduction model 138. The frame image 8 acquired by the selection unit 143a is output on the screen (FM1 (8) in Fig. 7 (b)). Thus stored in the frame memory 141, not from the decoder 128a. While outputting the frame image requires a time to decode the frame image equivalent to three frames before the frame advance playback switching, while outputting the frame image from the frame memory 141 (for example, for 0.3 seconds or more) The frame image can be decoded, the smooth frame advance reproduction switching can be realized, and the user's responsiveness to the frame advance reproduction switching can be improved.

When the frame image 8 is output on the screen, the controller 113 outputs, to the decoding unit 128a, the previous frame image 6 before the frame image 7 decoded immediately before to the FM2 in order to continue playback of the previous frame advance. Instruct.

The decoder 128a outputs the picture in the video stream necessary for decoding to the frame image 6 from the buffer 127, and the decoder 128a decodes the picture received from the buffer 127 into the frame image 6.

The decoding unit 128a also outputs the frame image 6 to FM2. Upon receiving the frame image 6 from the decoder 128a, FM2 overwrites the frame image 6 with the frame image 8 (" 8 → 6 " in Fig. 7 (b)) and records the frame image 6 (Fig. 7 (b). ), 6 → FM2).

Next, the controller 113 instructs the selection unit 143a to acquire the frame image 7 already stored in FM3 based on the past image reproduction model 138. The frame image 7 acquired by the selection unit 143a is output on the screen (FM3 (7) in Fig. 7 (b)).

Similarly, when the frame image 7 is output on the screen, the controller 113 instructs the decoding unit 128a to output the frame image 5 before the frame image 6 decoded immediately before to FM1.

The decoding unit 128a receives the picture in the video stream necessary for decoding from the buffer 127 with respect to the frame image 5, and the decoding unit 128a decodes the picture received from the buffer 127 into the frame image 5.

The decoding unit 128a also outputs the frame image 5 to FM1. Upon receiving the frame image 5 from the decoder 128a, FM1 overwrites the frame image 5 with the frame image 8 (" 8 → 5 " in Fig. 7 (b)), and records the frame image 5 (Fig. 7 (b). ), 5 → FM1).

Next, the controller 113 instructs the selection unit 143a to acquire the frame image 6 already stored in FM2 based on the past image reproduction model 138. The frame image 6 acquired by the selection unit 143a is output on the screen (FM2 (6) in Fig. 7B).

In the above, the video reproducing apparatus 101 can output the frame image by turning back one frame at a time in order, and can appropriately perform the past frame advance playback.

Furthermore, even in the subsequent past frame advance playback, as shown in the playback mode " -1 " in FIG. 7B, the frame image of the frame memory 141 one frame after the frame image decoded by the decoder 128a is displayed. Is output as.

Next, as shown in Fig. 7 (b), when the frame image 6 is outputted on the screen in past frame advance reproduction, and the future frame advance reproduction instruction signal is transmitted from the instruction acceptor 111 to the controller 113, The controller 113 stops the execution or reference of the past image reproduction model 138, and executes or references the future image reproduction model 137 again to set the reproduction mode to "+1". The controller 113 records the frame image after three frames of the frame image 5 decoded immediately before the frame advance reproduction conversion to the decoding unit 128a based on the future image reproduction model 137 before the frame advance reproduction conversion. Instructs the output to FM1.

Next, the decoder 128a outputs the picture in the video stream necessary for decoding to the frame image 8 from the buffer 127, and the decoder 128a transfers the picture received from the buffer 127 into the frame image 8. Decrypt

The decoding unit 128a also outputs the frame image 8 to FM1. When FM1 receives the frame image 8 from the decoder 128a, it overwrites the frame image 8 to the frame image 5 already stored (the second "5-" at the bottom of the reproduction mode " + 1 " 8 "), and the frame image 8 is recorded (recording in Fig. 7B, 8 → FM1).

Next, the controller 113 instructs the selection unit 143a to acquire the frame image 7 already stored in FM3 based on the past image reproduction model 138. The frame image 7 acquired by the selection unit 143a is output on the screen (FM3 (7) in Fig. 7 (b)).

Similarly, when the frame image 7 is output on the screen, the controller 113 instructs the decoding unit 128a to output the next frame image 9 of the immediately preceding decoded frame image 8 to FM2.

The decoder 128a outputs the picture in the video stream necessary for decoding to the frame image 9 from the buffer 127, and the decoder 128a decodes the picture received from the buffer 127 into the frame image 9.

The decoding unit 128a also outputs the frame image 9 to FM2. Upon receiving the frame image 9 from the decoder 128a, FM2 overwrites the frame image 9 with the frame image 6 (the first "6 → 9" at the bottom of the reproduction mode "+1" in Fig. 7B). The frame image 9 is recorded (recording in Fig. 7B, 9 → FM2).

Next, the controller 113 instructs the selection unit 143a to acquire the frame image 8 already stored in FM1 based on the past image reproduction model 138. The frame image 8 acquired by the selection unit 143a is output on the screen (FM1 (8) in Fig. 7B).

Subsequent future frame advance reproduction is also the same as the processing indicated by the reproduction mode " + 1 "

As described above, unlike the frame advance playback according to the first embodiment, in the frame advance playback according to the second embodiment, a frame image which becomes a display image even if the frame advance playback is switched to either past or future is loaded into the frame memory 141. Can be printed out. Therefore, while the frame image is output from the frame memory 141, the decoding process by the decoding unit 128a can be completed, and the frame advance reproduction is smoothly switched to improve the frame advance reproduction instruction responsiveness to the user. Can be.

In the frame advance playback according to the second embodiment, the frame memory 141 is three frame memories of the frame memory 141-1, the frame memory 141-2, and the frame memory 141-3. Although described as an example, the present invention is not limited to this example, and the frame memory 141 may be implemented even when the frame memory has four or more frame memories.

As described above, the video reproducing apparatuses 101 and 101a have been described in the present embodiment. However, the following excellent effects are provided by the video reproducing apparatuses 101 and 101a.

(1) If the user has a frame advance reproduction switching instruction from the user, the image processing apparatus can immediately switch to past or future frame advance reproduction, thereby improving the responsiveness to the user's instruction.

(2) Since the image processing apparatus can suppress the storage capacity of the frame memory to a capacity capable of storing at least two frames of frame images, the structure of the frame memory can be miniaturized and the circuit configuration can be made small. The processing apparatus can be miniaturized.

In addition, the above-described series of processes may be executed by dedicated hardware or may be executed by software. When a series of processes are performed by software, a program constituting the software is installed in an information processing apparatus such as a general purpose computer or a microcomputer, and makes the information processing apparatus function as the video reproducing apparatus 101.

The program can be recorded in advance in a hard disk or a ROM as a recording medium built in a computer as a video reproducing apparatus.

In addition, the program is not limited to a hard disk drive, and removable programs such as a flexible disk, a compact disc read only memory (CD-ROM), a magneto optical (MO) disk, a digital versatile disc (DVD), a magnetic disk, and a semiconductor memory can be removed. The recording medium can be stored (recorded) temporarily or permanently. Such a removable recording medium can be provided as so-called package software.

In addition, the program can be installed on a computer from the above-described removable recording medium, and can be wirelessly transmitted from a download site to a computer through a satellite for digital satellite broadcasting, or a video can be transmitted through a network such as a local area network (LAN) or the Internet. By wired transmission to a computer as a reproducing apparatus, the computer can receive such a transferred program and install it in a built-in hard disk or the like.

In the present specification, processing steps for explaining a program for causing a computer to execute various processes do not necessarily need to be processed in time series in the order described in the flowchart, and are executed in parallel or separately (for example, in parallel Processing or processing by an object).

In addition, the program may be processed by one computer or may be distributedly processed by a plurality of computers.

As mentioned above, although preferred embodiment of this invention was described referring an accompanying drawing, this invention is not limited to this example. Those skilled in the art will clearly appreciate that various changes or modifications can be made within the scope of the technical idea described in the claims, and they are naturally understood to belong to the technical scope of the present invention.

In the above embodiment, when the frame memory has two frame memories, the case of having three frame memories has been described as an example, but the present invention is not limited to these examples. For example, the frame memory can be implemented even when there are four or more frame memories.

In the above embodiment, the controller, the future image reproduction model storage unit, and the past image reproduction model storage unit have been described as examples, but are not limited to these examples. For example, the controller, the future image reproduction model storage unit, and the past image reproduction model storage unit are past. This can be done even when the image reproduction model storage unit is integrally formed. In such a case, the future image reproduction model and the past image reproduction model may function in hardware or software as one of the controllers.

The present invention can be embodied as code that can be read by a computer (including all devices having an information processing function) in a computer-readable recording medium. The computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable recording devices include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like.

Although the foregoing description has been focused on the novel features of the invention as applied to various embodiments, those skilled in the art will appreciate that the apparatus and method described above without departing from the scope of the invention. It will be understood that various deletions, substitutions, and changes in form and detail of the invention are possible. Accordingly, the scope of the invention is defined by the appended claims rather than in the foregoing description. All modifications within the scope of equivalents of the claims are to be embraced within the scope of the present invention.

According to the image processing apparatus and method according to the present invention, the frame image stored in the frame memory is decoded in advance to record the frame image in the future or in the past rather than the frame images stored in the frame memory, so that even when the user has a frame advance reproduction switching instruction from the user, Switching to past or future frame advance playback can increase the responsiveness to the user's instruction, and can reduce the structure of the frame memory and reduce the circuit configuration.

Claims (8)

A decoder for decoding a picture composed of a video stream and outputting a frame image; A plurality of frame memories each storing one frame image successively output by the decoder; A selection unit for selecting one of the frame images output from the decoding unit or one of the frame images stored in the frame memory according to a forward or reverse reproduction mode instructed by a user; And In each of the forward and reverse playback of the video stream, a first sequence shift designating a frame image to be decoded by the decoding unit, a frame memory to store the decoded frame image, and a frame image to be selected by the selection unit. A controller for controlling the decoding unit, the frame memory, and the selection unit as specified in the model and the second sequence shifting model, The second sequence shifting model causes the decoder to decode a frame image one frame past one of the frame images stored in the frame memory when the video stream is reproduced in the reverse direction. The decoded frame image causes the frame memory to store the most recent frame image of the plurality of frame memories, and causes the selection unit to store the frame images stored in a frame memory other than the frame memory in which the decoded frame is stored. And the frame image of the past is selected. The method of claim 1, wherein the number of the plurality of frame memories is two, The first sequence shift model, when reproducing the video stream in the forward direction, causes the decoder to decode a frame image one frame future than the frame image of the future among the frame images stored in the frame memory. The decoded frame image is stored in a frame memory which stores the frame image of the past among the plurality of frame memories, and causes the selection unit to select a frame image output by the decoding unit. The method of claim 1, The first sequence shifting model causes the decoder to decode an image one frame future from the most recent frame image among the frame images stored in the frame memory when the video stream is reproduced in the forward direction. The stored frame image is stored in a frame memory that stores the most recent frame image of the plurality of frame memories, and causes the selection unit to store a frame image stored in a frame memory other than the frame memory in which the decoded frame is stored. An image processing apparatus characterized by selecting a future frame image. The method of claim 1, wherein the number of the plurality of frame memories is n pieces. Immediately after the controller changes from the first sequence shift model to the second sequence shift model, the controller causes the decoder to decode a frame image past n frames from a previously decoded frame image, and the second sequence shift model. And immediately after the change to the first order transition in the processor, causes the decoder to decode an n-frame future frame image from a previously decoded frame image. Outputting a frame image by decoding a picture consisting of a video stream; Successively writing the decoded frame image to one of a plurality of frame memories; And Selecting and playing one of the decoded frame image or the frame image stored in the frame memory according to a forward or reverse reproduction mode instructed by a user, The outputting of the frame image includes decoding a frame image of one frame past the frame image of the past among the frame images stored in the frame memory when the video stream is reproduced in the reverse direction. The recording of the decoded frame image includes recording the decoded frame image into a frame memory that stores the future frame image of the plurality of frame memories when the video stream is reproduced in the reverse direction. , Selecting and reproducing the frame image may include selecting the most recent frame image among frame images stored in a frame memory other than a frame memory in which the decoded frame is stored when reproducing the video stream in a reverse direction. Image processing method comprising a. The method of claim 5, The outputting of the frame image may further include decoding a frame image of one frame future than the frame image of the future among the frame images stored in the frame memory when the video stream is reproduced in the forward direction. The recording of the decoded frame image may further include recording the decoded frame image into a frame memory storing the most recent frame image of the plurality of frame memories when the video stream is reproduced in the forward direction. , Selecting and reproducing the frame image may include selecting a future frame image among frame images stored in a frame memory other than a frame memory in which the decoded frame is stored when reproducing the video stream in a forward direction. Image processing method further comprising. 6. The method of claim 5, wherein the number of the plurality of frame memories is n pieces. The step of outputting the frame image, Decoding a frame image past n frames from a previously decoded frame image immediately after the video stream is changed from the mode of forward playback to the mode of backward playback; And And immediately after the change from the mode of reproducing the video stream in the reverse direction to the mode of reproducing in the forward direction, decoding the frame image of n frames in the future from the previously decoded frame image. A computer-readable recording medium having recorded thereon a program for executing the method of any one of claims 5 to 7.

Images