JP2005020339A - Moving image decoding apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a moving image decoding apparatus capable of seeking for the multiplexed data not including frame information. <P>SOLUTION: Multiplexed data 100 (A, V, T) are stored in a storage memory 13 through an input/output interface 11 (step ST1). Next, a data size Sall for the multiplexed data itself, a whole regenerating time Tall for regenerating the whole data, and a regenerating time Tseek up to a specified time are obtained (step ST2). A data position Sseek corresponding to the specified time is searched from the multiplexed data 100 using the ratio of the whole regenerating time Tall to the regenerating time Tseek up to the specified time (step ST3). The frame corresponding to the determined data position Sseek (encoded moving image data (A4)) is separated from the multiplexed data, and decoded for output on a display device 2 through an input/output interface 15. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

【００２３】
〔ステップＳＴ４〕
次に、ＣＰＵ１２は、多重化データの中から検索したデータ位置Ｓｓｅｅｋ以降の符号化動画像データのパケットＶ４を分離する。次に、そのパケットＶ４の中から一番先頭のフレームを分離する。分離されたフレームは蓄積メモリ１３に蓄積される。
【００２４】
〔ステップＳＴ５〕
次に、ＣＰＵ１２は、蓄積されたフレームを復号化する。
【００２５】
〔ステップＳＴ６〕
次に、ＣＰＵ１２は、復号化したフレームＶ４をフレームバッファ１４に蓄積する。
【００２６】
〔ステップＳＴ７〕
次に、入出力インターフェイス１５は、復号化したフレームを表示装置２へ出力する。
【００２７】
以上のように、第１の実施形態では、シーク動作時にデータサイズＳａｌｌと、全体再生時間Ｔａｌｌと、指定時刻までの再生時間Ｔｓｅｅｋとを用いて、データ位置Ｓｓｅｅｋを決定することによって、フレーム情報が存在しない場合もシーク動作を行うことができる。
【００２８】
なお、シーク動作後に通常再生を行う場合では、シーク動作によって表示したフレーム以降の符号化動画像データをデータの先頭に近い順番にて復号化して、復号化した順番にて表示装置２へ出力する。
【００２９】
（第２の実施形態）
第２の実施形態による動画像再生システムの全体構成は図１に示したものと同じであるがＣＰＵ１２の動作が異なる。第２の実施形態は、データ位置Ｓｓｅｅｋを検索する際、データサイズＳａｌｌと全体再生時間Ｔａｌｌとに代えてビットレートＲｍｕｘを用いる。
【００３０】
次に、第２の実施形態による動画像再生システムにおけるシーク動作について、図５を参照しつつ説明する。
【００３１】
〔ステップＳＴ１〕
入出力インターフェイス１１を介して多重化データ１００が動画像復号化装置１に入力される。
【００３２】
〔ステップＳＴ１１〕
次に、ＣＰＵ１２は、多重化データ１００に含まれるストリーム情報の中から、ビットレートＲｍｕｘを取得する。また、指定時刻情報２００が示す指定時刻を取得して、データの先頭から指定時刻までの再生時間Ｔｓｅｅｋを求める。ビットレートＲｍｕｘは、単位時間あたりに動画像復号化装置１へ入力される多重化データ１００のデータ量を示す。
【００３３】
〔ステップＳＴ１２〕
次に、ＣＰＵ１２は、ビットレートＲｍｕｘと、指定時刻までの再生時間Ｔｓｅｅｋとを用いて多重化データ１００の中から指定時刻に対応するデータ位置Ｓｓｅｅｋを検索する。データ位置Ｓｓｅｅｋは多重化データ１００の先頭に対しての位置を示す。
【００３４】
以下に、図６を参照してデータ位置Ｓｓｅｅｋの検索方法を説明する。
【００３５】
ビットレートＲｍｕｘは単位時間あたりに出力するデータ量を示すので、指定時刻までを再生する時間Ｔｓｅｅｋとの積を求めるとデータ位置Ｓｓｅｅｋが算出される。つまり、数２のように示すことができる。
【００３６】
【数２】

【００３７】
次に、第１の実施形態と同様に、ステップＳＴ４〜ステップＳＴ７における処理が行われる。
【００３８】
以上のように、第２の実施形態によれば、ビットレート情報Ｒｍｕｘと、指定時刻までの再生時間Ｔｓｅｅｋとを用いてデータ位置Ｓｓｅｅｋを検索することによって、フレーム情報がない場合もシーク動作を行うことができる。
【００３９】
（第３の実施形態）
第３の実施形態による動画像再生システムの全体構成は図１に示したものと同じであるがＣＰＵ１２の動作が異なる。多重化データの中にフレーム情報がない場合で、かつ動画像データ、音声・オーディオデータ、テキストデータのどれか１つのデータが、それぞれに設定された一定のサイズ以上同じデータが並んで配置されていた場合、第１〜第２の実施形態で説明した手法を用いても、ユーザから指示された表示時刻のフレームデータを表示するシーク動作を行うことが困難となってしまう。そこで第３の実施形態では、そのような多重化データに対しても動画像データ、音声・オーディオデータ、テキストデータがそれぞれ一定サイズを超えないような形式へと再構成することで、容易にシーク動作を行うことを可能とする。
【００４０】
次に、第３の実施形態による動画像再生システムにおけるシーク動作について、図７を参照しつつ説明する。
【００４１】
〔ステップＳＴ１〕
入出力インターフェイス１１を介して多重化データ１００が動画像復号化装置１に入力される。
【００４２】
〔ステップＳＴ２１〕
次に、ＣＰＵ１２は、多重化データ１００の先頭からデータを走査し多重化データ１００に含まれている各符号化データ（動画像データ，音声・オーディオデータ，テキストデータ）の配列単位（多重化単位）を調べる。各符号化データの配列単位は、同じ種類の符号化データのパケットが連続する区間を示す。具体的には、図８のように音声・オーディオデータ（Ａ）の配列単位はＡ１〜Ａ６の区間（６パケット）であり、動画像データ（Ｖ）の配列単位はＶ１〜Ｖ５の区間（５パケット）であり、テキストデータ（Ｔ）の配列単位はＴ１〜Ｔ５（５パケット）である。各データの配列単位（Ａ，Ｖ，Ｔ）を調べた結果が図８のように各データに定められたサイズ（Ａｓ，Ｖｓ，Ｔｓ）を超える場合にはステップＳＴ２２へ進み、各データに定められたサイズを超えない場合には、ステップＳＴ２に進む。
【００４３】
〔ステップＳＴ２２〕
次に、ＣＰＵ１２は、動画像データ、音声オーディオデータ、テキストデータをそれぞれのデータに対して定められたサイズ以下で連続するように分割し、分割されたそれぞれのデータに対してデータの種類に関係なく表示時間の順番に並べて多重化する。すなわち、各符号化データの配列単位を定められたサイズ以下になるように分割し、分割した各データを、図９のように各符号化データの先頭に存在するものから順に多重化する。
【００４４】
〔ステップＳＴ２〜ステップＳＴ７〕
次に、第１の実施形態と同様に、ステップＳＴ２からステップＳＴ７の処理が行われる。
【００４５】
以上のように、多重化データ１００を再構成することによって、多重化データ１００に含まれる各データの配列単位が定められたサイズを超える場合でかつフレーム情報が存在しない場合でもシーク動作を行うことができる。
【００４６】
なお、ステップＳＴ２１より後の処理（ステップＳＴ２〜ステップＳＴ７）は、第２の実施形態のステップＳＴ１１〜ステップＳＴ７における処理を代わりに行ってもよい。
【００４７】
（第４の実施形態）
第４の実施形態による動画像再生システムの全体構成は図１に示したものと同じであるがＣＰＵ１２の動作が異なる。第４の実施形態は、第３の実施形態において構成を新たにした多重化データに対してフレーム情報を作成し付加する。
【００４８】
次に、第４の実施形態による動画像再生システムにおけるシーク動作について、図１０を参照しつつ説明する。
【００４９】
〔ステップＳＴ１〕
入出力インターフェイス１１を介して多重化データ１００が動画像復号化装置１に入力される。
【００５０】
〔ステップＳＴ２１，ステップＳＴ２２〕
次に、ステップＳＴ２１における処理を行い、多重化データ１００に含まれている各符号化データの配列単位（Ａ，Ｖ，Ｔ）を調べる。各符号化データの配列単位を調べた結果が図８のように定められたサイズ（Ａｓ，Ｖｓ，Ｔｓ）を超える場合にはステップＳＴ２２における処理を行う。定められたサイズを超えない場合にはステップＳＴ３１に進む。
【００５１】
〔ステップＳＴ３１〕
次に、ＣＰＵ１２は、多重化データ１００またはステップＳＴ２２で新たに構成した多重化データを解析する。つまり、多重化データ（多重化データ２００または新たに構築された多重化データ）に含まれる各符号化データの配列単位の並びを調べて表示時刻情報を取得する。ＣＰＵ１２は、表示時刻情報を基にフレーム情報（図１１参照）を作成して付加する。
【００５２】
〔ステップＳＴ３２〕
次に、ＣＰＵ１２は、フレーム情報の表示時刻（ＰＴＳ情報）とユーザによって指示された指定時刻とを比較する。そして、最も時間軸上で近い表示時刻に対応する符号化動画像データのフレームをフレーム情報を付加した多重化データの中から検索する。
【００５３】
〔ステップＳＴ３３〕
次に、ＣＰＵ１２は、検索したフレーム以降の符号化動画像データを多重化データ１００またはステップＳＴ２２で新たに構成した多重化データより分離する。分離された符号化動画像データのフレームは蓄積メモリ１３に蓄積される。
【００５４】
〔ステップＳＴ５からステップＳＴ７〕
次に、ステップＳＴ５〜ステップＳＴ７における処理が行われる。
【００５５】
以上のように、フレーム情報を作成し多重化データ１００に付加することによって、ユーザが指示した時刻に対応するデータ位置をフレーム情報を参照するだけで取得でき、容易にシーク動作を行うことができる。
【００５６】
【発明の効果】
この発明による動画像復号化装置では、フレーム情報が含まれていない多重化データに対してユーザが指示する時刻のフレームを表示するシーク動作を行う場合、従来の技術ではシーク動作自体を行うことが困難であったが、多重化データのファイルサイズ、もしくはビットレートを用いることでシーク動作が可能となる。また、多重化データを再構成する手段を備えることにより、より容易にシーク動作を行うことができる形式へと再構成することができる。
【図面の簡単な説明】
【図１】この発明の第１の実施形態における動画像復号化装置の全体構成を示すブロック図である。
【図２】図１に示した動画像復号化装置による処理の手順を示したフローチャートである。
【図３】図１に示した多重化データの一例である。
【図４】図２に示した指定時刻に対応するデータ位置の検索方法を示す図である。
【図５】この発明の第２の実施形態における処理の手順を示したフローチャートである。
【図６】図５に示した指定時刻に対応するデータ位置の検索方法を示す図である。
【図７】この発明の第３の実施形態における処理の手順を示したフローチャートである。
【図８】各データに定められたサイズを超えて連続して各データが並んでいる多重化データの一例である。
【図９】図７に示した多重化データを並び替える方法について示す図である。
【図１０】この発明の第４の実施形態における処理の手順を示したフローチャートである。
【図１１】フレーム情報の一例である。
【符号の説明】
１ 動画像復号化装置
２ 表示装置
１１，１５ 入出力インターフェイス
１２ ＣＰＵ
１３ 蓄積メモリ
１４ フレームバッファ
１００ 多重化データ
２００ 指定時刻情報[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an apparatus for decoding encoded moving image data (encoded moving image data), and more particularly to control of a seek operation of encoded moving image data.
[0002]
[Prior art]
Today, with the development of information technology, it has become possible to play and enjoy audio and video (video) compressed and stored in storage media based on multiplexing standards such as ASF and MP4. When such AV data (multiplexed data) is decoded and played back, a seek operation (an operation for searching for a frame corresponding to a time (specified time) specified by the user) is an easy and quick content search. It is an important function to do. When this seek operation is performed, a frame to be seeked is searched using frame information included in the multiplexed data. When frame information is included in the multiplexed data, the PTS information, which is the display time for each reference image frame included in the frame information, is compared with the specified time, so that the frame at the nearest time is It is possible to uniquely search at which position in the multiplexed data the encoded moving image data exists.
[0003]
[Problems to be solved by the invention]
In addition, users can now independently multiplex their own voices and moving images (videos) and save them on storage media. However, some multiplexed data (AV data) created by the user does not include frame information. It is difficult to perform a seek operation on multiplexed data for which no frame information exists using the above-described method.
[0004]
An object of the present invention is to provide a moving picture decoding apparatus capable of performing a seek operation on encoded moving picture data having no frame information.
[0005]
[Means for Solving the Problems]
According to one aspect of the present invention, a video decoding device is a device that decodes encoded video data, and includes an acquisition unit, a search unit, and a decoding unit. The encoded moving image data includes a plurality of frames. The encoded moving image data is multiplexed with AV data. The acquisition unit acquires the data size of the AV data, the reproduction time of the AV data, and the specified time. The designated time indicates a display time designated from the outside. The retrieval unit retrieves the data position corresponding to the designated time from the AV data using the information (AV data size, AV data reproduction time, designated time) obtained by the obtaining unit. The decoding unit decodes a frame corresponding to the data position obtained by the search unit.
[0006]
In the moving picture decoding apparatus, the position of the designated time on the time axis in the reproduction time of the AV data is obtained using the data size of the AV data, the reproduction time of the AV data, and the designated time. Specifically, the data position including the frame data corresponding to the specified time is calculated based on the data size of the entire AV data and the ratio between the reproduction time of the entire AV data and the specified time. Therefore, it is possible to perform a seek operation on encoded moving image data having no frame information.
[0007]
According to another aspect of the present invention, a video decoding device is a device that decodes encoded video data, and includes an acquisition unit, a search unit, and a decoding unit. The encoded moving image data includes a plurality of frames. The encoded moving image data is multiplexed with AV data. The acquisition unit acquires a bit rate and a specified time. The bit rate indicates the amount of AV data consumed per unit time. The search unit searches for a data position corresponding to the specified time using the bit rate.
[0008]
In the moving picture decoding apparatus, the bit rate indicates the amount of AV data consumed by being input to the moving picture decoding apparatus per unit time. The search unit calculates the data position of the frame data corresponding to the specified time (data position from the beginning in the AV data) using the bit rate and the specified time. Therefore, it is possible to perform a seek operation on encoded moving image data having no frame information.
[0009]
Preferably, in the AV data, encoded moving image data and other encoded data are multiplexed in a predetermined arrangement unit. The moving picture decoding apparatus further includes a determination unit and a reconstruction unit. The determination unit determines whether the data size of the array unit of the AV data exceeds a predetermined size. When the determination unit determines that the data size of the array unit of the AV data exceeds a predetermined size, the reconstruction unit includes the AV data so that the data size of the array unit of the AV data is equal to or less than the predetermined size. The order of each encoded data is changed.
[0010]
When a seek operation is performed on AV data for which no frame information exists, it may not be possible depending on the combination order of encoded data included in the AV data. For example, it is assumed that AV data is multiplexed so that the encoded moving image data (A) is included in the first half of the data and the other encoded data (B) is included in the half of the data from the last. A data position was searched for the AV data using the relationship between the total reproduction time and the specified time. As a result, it is assumed that a 3/4 position is retrieved as the data position from the top of the data to the entire data. Then, only the other encoded data (B) is decoded, and the encoded moving image data is not decoded at all. As described above, when the combination order of the encoded data included in the AV data is biased, the seek operation cannot be performed well.
[0011]
In the moving picture decoding apparatus, when the data size of the array unit in each encoded data included in the AV data exceeds a predetermined size, each data in the AV data is set so that the data size of the array unit is equal to or less than the predetermined size. Change the sequence of encoded data. That is, when there is a large deviation in the coupling order of the encoded data included in the AV data, the arrangement of the encoded data in the AV data is changed. Therefore, the above problems can be solved and a seek operation can be performed.
[0012]
According to yet another aspect of the present invention, a video decoding device is a device that decodes encoded video data multiplexed with AV data, and includes a determination unit, a reconstruction unit, a frame, And an information creation unit. In AV data, encoded moving image data and other encoded moving image data are multiplexed in a predetermined arrangement unit. The encoded moving image data includes a plurality of frames. The determination unit determines whether the data size of the array unit of the AV data exceeds a predetermined size. When the determination unit determines that the data size of the array unit of the AV data exceeds a predetermined size, the reconstruction unit includes the AV data so that the data size of the array unit of the AV data is equal to or less than the predetermined size. The order of each encoded data is changed. The frame information creation unit creates frame information for the AV data whose arrangement has been changed by the reconstruction unit, and adds the created frame information to the AV data. The frame information includes information indicating the arrangement on the time axis of frames included in the AV data.
[0013]
In the video decoding apparatus, frame information is added to AV data in which the order of combining encoded data is changed. Therefore, the seek operation can be performed by comparing the display time of the frame information with the user-specified time and searching for the display time of the closest frame on the time axis.
[0014]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the drawings, the same or corresponding parts are denoted by the same reference numerals, and description thereof will not be repeated.
[0015]
(First embodiment)
FIG. 1 shows the overall configuration of a moving image playback system according to the first embodiment. This system reproduces encoded moving image data included in AV data (multiplexed data 100) multiplexed according to a predetermined multiplexing standard (for example, ASF or MP4). In this system, encoded moving image data can be reproduced from a position (time) designated by the user (seek operation). This system includes a moving picture decoding apparatus 1 and a display apparatus 2. The moving picture decoding apparatus 1 includes input / output interfaces 11 and 15, a CPU 12, a storage memory 13, and a frame buffer 14. The input / output interface 11 performs input processing of multiplexed data 100 from the outside. The CPU 12 analyzes the multiplexed data 100, separates the multiplexed data 100, decodes the encoded moving image data, and performs overall control according to the specified time information 200. The designated time information 200 indicates a display time (designated time) designated by the user. The storage memory 13 stores the multiplexed data 100 and the encoded moving image data. The frame buffer 14 stores the decoded moving image data (frame data). The input / output interface 15 outputs the frame data stored in the frame buffer 14 to the display device 2.
[0016]
Next, the operation of the moving image reproduction system shown in FIG. 1 will be described. Here, the seek operation will be described. The seek operation is a process of displaying a frame corresponding to the display time designated by the user from the multiplexed data 100 (AV data). Hereinafter, the seek operation will be described with reference to FIG.
[0017]
[Step ST1]
Multiplexed data 100 is input to the moving picture decoding apparatus 1 via the input / output interface 11. An example of the multiplexed data 100 is shown in FIG. The multiplexed data 100 includes encoded moving image data (V), encoded audio / audio data (A), encoded text data (T) and the like in a predetermined arrangement unit (in the case of the multiplexed data 100 shown in FIG. 3). The arrangement unit of the encoded moving image data (V), the encoded audio data, the audio data (A), and the encoded text data (T) is one packet, and each packet includes at least one frame. Data) (AV data) multiplexed.
[0018]
[Step ST2]
Next, the CPU 12 acquires from the stream information included in the multiplexed data 100 the data size Sall of the multiplexed data itself and the total playback time Tall for playing back the entire data. Also, the designated time indicated by the designated time information 200 is acquired, and the reproduction time Tseek from the beginning of the data to the designated time is obtained.
[0019]
[Step ST3]
Next, the CPU 12 searches the multiplexed data 100 for a data position Sseek corresponding to the specified time using the data size Sall, the total playback time Tall, and the playback time Tseek until the specified time. The data position Sseek indicates the position from the beginning of the data.
[0020]
Hereinafter, a method of searching for the data position Sseek will be described with reference to FIG.
[0021]
As shown in FIG. 4, the data position Sseek is searched as shown in Equation 1 using the ratio between the total playback time Tall and the playback time Tseek until the specified time with respect to the data size Sall of the multiplexed data itself.
[0022]
[Expression 1]

[0023]
[Step ST4]
Next, the CPU 12 separates the encoded moving image data packet V4 after the data position Sseek searched from the multiplexed data. Next, the first frame is separated from the packet V4. The separated frames are stored in the storage memory 13.
[0024]
[Step ST5]
Next, the CPU 12 decodes the accumulated frame.
[0025]
[Step ST6]
Next, the CPU 12 stores the decoded frame V4 in the frame buffer 14.
[0026]
[Step ST7]
Next, the input / output interface 15 outputs the decoded frame to the display device 2.
[0027]
As described above, in the first embodiment, the frame information is determined by determining the data position Sseek using the data size Sall, the total playback time Tall, and the playback time Tseek up to the specified time during the seek operation. The seek operation can be performed even when it does not exist.
[0028]
When normal playback is performed after the seek operation, the encoded moving image data after the frame displayed by the seek operation is decoded in the order close to the head of the data, and is output to the display device 2 in the decoded order. .
[0029]
(Second Embodiment)
The overall configuration of the moving image playback system according to the second embodiment is the same as that shown in FIG. 1, but the operation of the CPU 12 is different. In the second embodiment, when searching for the data position Sseek, the bit rate Rmux is used instead of the data size Sall and the total playback time Tall.
[0030]
Next, a seek operation in the moving image reproduction system according to the second embodiment will be described with reference to FIG.
[0031]
[Step ST1]
Multiplexed data 100 is input to the moving picture decoding apparatus 1 via the input / output interface 11.
[0032]
[Step ST11]
Next, the CPU 12 acquires the bit rate Rmux from the stream information included in the multiplexed data 100. Also, the designated time indicated by the designated time information 200 is acquired, and the reproduction time Tseek from the beginning of the data to the designated time is obtained. The bit rate Rmux indicates the amount of multiplexed data 100 input to the video decoding device 1 per unit time.
[0033]
[Step ST12]
Next, the CPU 12 searches the multiplexed data 100 for the data position Sseek corresponding to the specified time using the bit rate Rmux and the reproduction time Tseek until the specified time. The data position Sseek indicates a position with respect to the head of the multiplexed data 100.
[0034]
Hereinafter, a method for searching for the data position Sseek will be described with reference to FIG.
[0035]
Since the bit rate Rmux indicates the amount of data to be output per unit time, the data position Sseek is calculated when the product of the reproduction time Tseek until the specified time is obtained. In other words, it can be expressed as in Equation 2.
[0036]
[Expression 2]

[0037]
Next, similarly to the first embodiment, the processes in steps ST4 to ST7 are performed.
[0038]
As described above, according to the second embodiment, the seek operation is performed even when there is no frame information by searching the data position Sseek using the bit rate information Rmux and the reproduction time Tseek up to the specified time. be able to.
[0039]
(Third embodiment)
The overall configuration of the moving image playback system according to the third embodiment is the same as that shown in FIG. 1, but the operation of the CPU 12 is different. When there is no frame information in the multiplexed data, and any one of moving image data, audio / audio data, and text data is arranged side by side with the same data more than a predetermined size set for each. In this case, even if the methods described in the first to second embodiments are used, it is difficult to perform a seek operation for displaying the frame data at the display time instructed by the user. Therefore, in the third embodiment, seek is easily performed by reconfiguring such multiplexed data into a format in which moving image data, audio / audio data, and text data do not exceed a certain size. It is possible to perform an operation.
[0040]
Next, a seek operation in the moving image reproduction system according to the third embodiment will be described with reference to FIG.
[0041]
[Step ST1]
Multiplexed data 100 is input to the moving picture decoding apparatus 1 via the input / output interface 11.
[0042]
[Step ST21]
Next, the CPU 12 scans the data from the head of the multiplexed data 100, and arranges each encoded data (moving image data, audio / audio data, text data) included in the multiplexed data 100 (multiplex unit). ) The unit of arrangement of each encoded data indicates a section in which packets of the same type of encoded data are continuous. Specifically, as shown in FIG. 8, the arrangement unit of voice / audio data (A) is a section (6 packets) of A1 to A6, and the arrangement unit of moving image data (V) is a section of V1 to V5 (5 Packet), and the arrangement unit of the text data (T) is T1 to T5 (5 packets). If the result of checking the array unit (A, V, T) of each data exceeds the size (As, Vs, Ts) determined for each data as shown in FIG. If it does not exceed the specified size, the process proceeds to step ST2.
[0043]
[Step ST22]
Next, the CPU 12 divides the moving image data, the audio audio data, and the text data so as to be continuous within a predetermined size for each data, and relates to the data type for each divided data. Instead, they are multiplexed in the order of display time. That is, the array unit of each encoded data is divided so as to be equal to or smaller than a predetermined size, and each divided data is multiplexed in order from the one existing at the head of each encoded data as shown in FIG.
[0044]
[Step ST2 to Step ST7]
Next, similarly to the first embodiment, the processing from step ST2 to step ST7 is performed.
[0045]
As described above, by reconstructing the multiplexed data 100, a seek operation is performed even when the arrangement unit of each data included in the multiplexed data 100 exceeds a predetermined size and no frame information exists. Can do.
[0046]
Note that the processing after step ST21 (step ST2 to step ST7) may be performed instead of the processing in step ST11 to step ST7 of the second embodiment.
[0047]
(Fourth embodiment)
The overall configuration of the moving image playback system according to the fourth embodiment is the same as that shown in FIG. 1, but the operation of the CPU 12 is different. In the fourth embodiment, frame information is created and added to the multiplexed data having a new configuration in the third embodiment.
[0048]
Next, a seek operation in the moving image reproduction system according to the fourth embodiment will be described with reference to FIG.
[0049]
[Step ST1]
Multiplexed data 100 is input to the moving picture decoding apparatus 1 via the input / output interface 11.
[0050]
[Step ST21, Step ST22]
Next, the process in step ST21 is performed, and the array unit (A, V, T) of each encoded data included in the multiplexed data 100 is examined. If the result of checking the array unit of each encoded data exceeds the size (As, Vs, Ts) defined as shown in FIG. 8, the process in step ST22 is performed. If the predetermined size is not exceeded, the process proceeds to step ST31.
[0051]
[Step ST31]
Next, the CPU 12 analyzes the multiplexed data 100 or the multiplexed data newly configured in step ST22. That is, the display time information is obtained by examining the arrangement of the array units of each encoded data included in the multiplexed data (multiplexed data 200 or newly constructed multiplexed data). The CPU 12 creates and adds frame information (see FIG. 11) based on the display time information.
[0052]
[Step ST32]
Next, the CPU 12 compares the display time (PTS information) of the frame information with the designated time designated by the user. Then, the frame of the encoded moving image data corresponding to the display time closest on the time axis is searched from the multiplexed data to which the frame information is added.
[0053]
[Step ST33]
Next, the CPU 12 separates the encoded moving image data after the searched frame from the multiplexed data 100 or the multiplexed data newly configured in step ST22. The separated frame of encoded moving image data is stored in the storage memory 13.
[0054]
[Step ST5 to Step ST7]
Next, processing in step ST5 to step ST7 is performed.
[0055]
As described above, by creating the frame information and adding it to the multiplexed data 100, the data position corresponding to the time designated by the user can be obtained simply by referring to the frame information, and the seek operation can be easily performed. .
[0056]
【The invention's effect】
In the moving picture decoding apparatus according to the present invention, when performing a seek operation for displaying a frame at a time designated by a user for multiplexed data not including frame information, the conventional technique may perform the seek operation itself. Although difficult, a seek operation can be performed by using the file size or bit rate of the multiplexed data. Also, by providing means for reconfiguring multiplexed data, it can be reconfigured into a format that allows a seek operation to be performed more easily.
[Brief description of the drawings]
FIG. 1 is a block diagram showing an overall configuration of a moving picture decoding apparatus according to a first embodiment of the present invention.
FIG. 2 is a flowchart showing a processing procedure performed by the video decoding device shown in FIG. 1;
FIG. 3 is an example of multiplexed data shown in FIG. 1;
4 is a diagram showing a method for searching for a data position corresponding to the designated time shown in FIG. 2. FIG.
FIG. 5 is a flowchart showing a processing procedure in the second embodiment of the present invention;
6 is a diagram showing a method for searching for a data position corresponding to the designated time shown in FIG.
FIG. 7 is a flowchart showing a processing procedure in the third embodiment of the present invention;
FIG. 8 is an example of multiplexed data in which each data is continuously arranged exceeding the size determined for each data.
9 is a diagram showing a method for rearranging multiplexed data shown in FIG. 7; FIG.
FIG. 10 is a flowchart showing a processing procedure in the fourth embodiment of the present invention.
FIG. 11 is an example of frame information.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Moving image decoding apparatus 2 Display apparatus 11,15 Input / output interface 12 CPU
13 Storage memory 14 Frame buffer 100 Multiplexed data 200 Designated time information

Claims (4)

An apparatus for decoding encoded video data multiplexed with AV data,
The encoded moving image data includes a plurality of frames,
The device is
An acquisition unit that acquires a data size of the AV data, a reproduction time of the AV data, and a designated time indicating a display time designated from outside;
A search unit for searching for a data position corresponding to the specified time from the AV data using the data size, playback time, and specified time acquired by the acquisition unit;
A moving picture decoding apparatus comprising: a decoding unit that decodes a frame corresponding to a data position obtained by the search unit. An apparatus for decoding encoded video data multiplexed with AV data,
The device is
The encoded moving image data includes a plurality of frames,
An acquisition unit for acquiring a bit rate of the AV data and a designated time indicating a display time designated from outside;
A search unit for searching for a data position corresponding to the specified time from the AV data using the output speed information acquired by the acquiring unit and the specified time;
A decoding unit for decoding a frame corresponding to the data position obtained by the search unit,
The video decoding apparatus, wherein the bit rate indicates a data amount of AV data consumed per unit time. In claim 1 or claim 2,
The AV data is
The encoded moving image data and other encoded data are multiplexed in a predetermined array unit,
The video decoding device further includes:
A determination unit for determining whether or not the data size of the array unit of the AV data exceeds a predetermined size;
When the determination unit determines that the data size of the array unit of the AV data exceeds a predetermined size, the data size in the AV data is set so that the data size of the array unit of the AV data is equal to or less than the predetermined size. And a reconstructing unit that changes the arrangement of the encoded data. An apparatus for decoding encoded video data multiplexed with AV data,
The AV data is
The encoded moving image data and other encoded data are multiplexed in a predetermined array unit,
The device is
A determination unit for determining whether or not the data size of the array unit of the AV data exceeds a predetermined size;
When the determination unit determines that the data size of the array unit of the AV data exceeds a predetermined size, the AV data is set so that the data size of the array unit of the AV data is equal to or less than the predetermined size. A reconstruction unit for changing the order of each encoded data in
A frame information creation unit that creates frame information for the AV data whose arrangement has been changed by the reconstruction unit, and adds the created frame information to the AV data;
The frame information is
A moving picture decoding apparatus comprising information indicating a sequence on a time axis of frames included in the AV data.

Images