JP2006166154A - Moving image reproducing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve problems that processing loads of a general purpose processor increase and time management in real time for moving image reproduction cannot be performed in the case of reproducing high bit rate moving image data of high image quality in a moving image reproducing system in which demultiplex processing and time management processing are performed in the general purpose processor. <P>SOLUTION: The moving image reproducing system is provided with a transfer device 103 capable of directly transferring multiplex stream data from a storage medium 100 to the demultiplex processing 108 or decoding processing 109 and 110 without interposing file management processing 107 in the general purpose processor 101. Thus, the demultiplex processing 108 is made possible by a processor other than the general purpose processor 101, and synchronization control processing 111 is also controlled by a processor other than the general purpose processor 101. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a stream reproduction system for reproducing a multiplexed stream in which a plurality of streams are multiplexed. In particular, a multiplexed stream in which video encoded data and audio encoded data are multiplexed is reproduced in real time from a storage medium. The present invention relates to a moving image reproduction system.

  As a moving image reproduction system for reproducing a multiplexed stream in which video encoded data and audio encoded data are multiplexed from a storage medium in real time, Patent Document 1 is known. This conventional example is characterized in that a general-purpose processor (indicated as CPU in the literature) performs demultiplexing processing of multiplexed streams by software in order to support multiplexed streams of various systems.

  On the other hand, for example, there is ASF (Advanced System Format) as a multiplexing method of multiplexed streams stored in the storage medium. FIG. 12 shows a schematic structural diagram of the ASF. FIG. 12A shows the data structure of the highest layer of the ASF. This layer consists of a HeaderObject (hereinafter referred to as “header object”) that stores information such as ASF file properties, audio and video encoding methods, and encoded audio data and video data as DataObject (hereinafter referred to as “data object”). And IndexObject (hereinafter referred to as “index object”) that stores reference screen information. 12B, 12C, and 12D show the internal structure of the lower layer in the data object. As shown in FIG. 12B, data objects are managed in units of fixed-length packets (hereinafter referred to as packets). Further, as shown in FIG. 12C, the packets are referred to as PacketHeader (hereinafter referred to as “packet header”). It consists of one or more data blocks called Payload (hereinafter referred to as “payload”). As shown in FIG. 12D, the payload includes a payload header and payload data. The payload header stores the size of the payload data and the reproduction time information PTS.

  Next, FIG. 13 shows an outline of a general processing flow of ASF file separation processing. At the start of playback, in step 1300, a header object is acquired. In step 1301, the acquired header object is analyzed, and information such as a file size and a packet size is acquired. Based on these pieces of information, the packet position in the multiplexed stream can be calculated. The above is the content performed in the management information analysis process.

Next, in step 1302, in order to acquire audio and video data, a packet is acquired based on the information acquired from the header object. In step 1303, the packet is analyzed to obtain a video or audio payload. In step 1304, the acquired payload is analyzed, and video data and audio data are extracted and their reproduction time information is acquired. The above is the content performed by the demultiplexing process.
Therefore, each media data and reproduction time information of each medium are acquired by the demultiplexing process of the multiplexed stream. Therefore, it is preferable to perform the synchronization process between the demultiplexing process and the reproduction time by the same processor. ASF is described in detail in Non-Patent Document 1.

  In addition, recent storage media are used not only for video and audio, but also for storing various data such as text data and applications. It is common. Since this file system largely depends on an operating system (hereinafter referred to as OS), it is generally performed by a general-purpose processor on which the OS operates.

  As described above, the configuration shown in FIG. 11 is a general example of a known real-time moving image playback system. This conventional configuration includes a storage medium 1100 for storing a multiplexed stream, a general-purpose processor 1101, a signal processor 1102 for performing video and audio decoding processing, an audio output unit 1103 for output to an external device (not shown), and video. And an output unit 1104. The general-purpose processor 1101 converts the management information analysis process 1105 for analyzing the data management information in the multiplexed stream file, and converts the positional information in the multiplexed stream file into the positional information in the storage medium based on the file system. The file management process 1106 for accessing the file, the demultiplexing process 1107 for separating the multiplexed stream, and the start of the audio or video decoding process based on the reproduction time information, or the synchronization for controlling the output time of the decoded audio or video data Control 1108 is performed. In the signal processor 1102, an audio decoding process 1109 for decoding the audio encoded data separated from the demultiplexing process 1107 and a video decoding process 1110 for decoding the video encoded data separated from the demultiplexing process 1107. I do.

FIG. 14 shows a timing chart for task transitions processed by the conventional general-purpose processor. Since it is necessary to perform synchronization control according to the playback time of audio and video, it is necessary to perform real-time processing with a time constraint of several ms. On the other hand, the access processing to the storage medium and the demultiplexing processing are time constraints of several hundred ms.
JP-A-1996-296078 Microsoft Advanced Systems Format (“ASF”) Specification v. 1.2 ISO / IEC14496-1Information technology-Coding of audio-visual objects-Part 1: Systems

  However, when moving image data with a high bit rate corresponding to high image quality expected in the future is reproduced from the storage medium, it is expected that the access to the storage medium and the processing of separating the multiplexed stream will increase.

  If this is realized with the conventional system configuration, it becomes difficult to control the synchronization of audio and video data in accordance with the playback time due to an increase in processing load on the general-purpose processor, and real-time video playback becomes impossible. .

  In recent years, examples of using a non-real-time operating system that cannot guarantee real-time performance such as Linux have been seen as an operating system for a general-purpose processor.

  In such a non-real-time operating system environment, it is difficult to perform synchronous control of several tens of milliseconds rather than the processing load.

As one of means for solving these problems, it is conceivable that a signal processor that performs video and audio decoding processing performs access to the storage medium and separation processing of the multiplexed stream. However, it is inefficient to access a storage medium having a file system structure by a signal processor that performs video and audio decoding processing. In addition, in order to perform demultiplexing processing with a hardware configuration, it is difficult to support various multiplexing methods.
The present invention has been made to solve such a conventional problem, and when reproducing moving image data having a high bit rate from a storage medium, or even in a non-real-time operating system environment, An object of the present invention is to provide a moving image reproduction system capable of realizing smooth moving image reproduction.

In order to solve the above-described problems, the present invention provides a moving image reproduction system according to the present invention, video encoded data and audio encoded data, data management information for managing video encoded data and audio encoded data, A moving image reproduction system for reproducing a multiplexed stream in which reproduction time information for managing reproduction times of video encoded data and audio encoded data is multiplexed,
A storage medium for storing the multiplexed stream, a transfer device for transferring the multiplexed stream from the storage medium, a buffer for temporarily storing the transferred multiplexed stream, and the multiplexed stream temporarily stored in the buffer as video encoded data Demultiplexing means for separating audio encoded data, data management information and reproduction time information, video decoding means for decoding video encoded data, audio decoding means for decoding audio encoded data, A signal processor comprising: synchronization control means for controlling the output of video data decoded by the video decoding means or audio data decoded by the audio decoding means with the reproduction time information as an input;
Management information analysis means for analyzing data management information, and file management means for setting a transfer device as a setting for accessing an arbitrary location in the storage medium using the result analyzed by the management information analysis means as an input It consists of a general-purpose processor,
The transfer device is characterized in that, based on the access information to the storage medium set by the file management means, the multiplexed stream can be directly transferred from the storage medium to the buffer by a transfer start instruction from the demultiplexing means. is there.

  In the above configuration, the general-purpose processor calculates the position of the next data in the multiplexed stream file according to the request for the next data transmitted from the demultiplexing means, the audio decoding means, or the video decoding means, On the other hand, conversion to a position in the storage medium and setting processing to the transfer device are performed based on the file system.

  In the above configuration, the transfer device includes a request accumulation queue capable of queuing a plurality of transfer requests from the file management means, and a queue detection means for detecting that the request accumulation queue is empty or falls below a certain threshold. The separation means controls the request timing to the management information analysis means based on the detection signal of the queue detection means.

Another moving image reproduction system according to the present invention includes video encoded data and audio encoded data, data management information for managing the video encoded data and audio encoded data, video encoded data and audio encoded A moving image reproduction system for reproducing a multiplexed stream in which reproduction time information for managing reproduction time is multiplexed,
Transfer having storage medium for storing the multiplexed stream and first transfer means for transferring the audio encoded data in the multiplexed stream, and having a second transfer means for transferring the video encoded data in the multiplexed stream An audio buffer for temporarily storing the encoded audio data transferred by the first transfer means, a video buffer for temporarily storing the encoded video data transferred by the second transfer means, and an audio buffer. Audio decoding means for decoding the encoded data, video decoding means for decoding the encoded data stored in the video buffer, and encoded data stored in the audio buffer or video buffer, respectively. A time information buffer that temporarily stores playback time information and the time information buffer Acquires reproduction time information, and a signal processor that includes a synchronous control means for controlling the output of the decoded audio data by decoding video data or audio decoding means by the video decoding unit,
Management information analysis means for analyzing data management information, and file management for setting a transfer device to access any location in the storage medium from access to the storage medium or data management information analyzed by the management information analysis means And a general-purpose processor with means,
The transfer device can directly transfer from the storage medium to the audio buffer and video buffer by the transfer start instruction from the audio decoding means and video decoding means based on the access information to the storage medium set by the file management processing means. It is characterized by being.

  In the above configuration, the transfer device has reproduction time combining means for combining reproduction time information obtained from the management information analyzing means, audio encoded data, and video encoded data, from the storage medium to the audio buffer or video buffer. When transferring the audio encoded data or the video encoded data, the reproduction time information obtained from the management information analyzing means is added to the audio encoded data or the video encoded data and transferred.

  However, in the present invention, the signal processor has two processor configurations including a signal processing processor including a demultiplexing unit, an audio decoding unit, and a synchronization control unit, and a processor including a video decoding unit. The detailed configuration of the signal processor is not specified, such as the two processor configurations of the signal processing processor including the decoding unit and the synchronization control unit and the processor including the audio decoding unit.

  According to the moving image reproduction system of the present invention, a file management process in a general-purpose processor is newly added by adding a transfer device that can directly transfer multiplexed stream data from a storage medium to demultiplexing processing or decoding processing means. Multiplexed streams can be transferred without going through. Furthermore, the storage media based on an inefficient file system structure is used in a signal processor that performs video and audio decoding processing by performing management information analysis processing of multiplexed streams and file management processing of storage media on a general-purpose processor. The access processing is not performed. Further, the general-purpose processor does not perform the synchronization control.

  Therefore, the general-purpose processor calculates the position of the next data in the multiplexed stream file in response to the request for the next data transmitted from the demultiplexing process or the decoding process, and based on the file system structure, Only the conversion to the position and the setting process to the transfer device are performed.

  As a result, the occurrence frequency of the processing necessary for moving image playback by the general-purpose processor is released from the real-time processing having the time constraint of several ms of the synchronous control task shown in FIG. 14, and the time constraint is set at intervals of several hundred ms. Can be reduced. Furthermore, even in an environment where a non-real-time OS is used with a general-purpose processor, it is possible to provide smooth moving image reproduction processing of high-bit-rate moving image data.

  Embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram of a first embodiment of a moving image reproduction system according to claim 1 of the present invention.

  In the moving image reproduction system in FIG. 1, a storage medium 100 that stores a multiplexed stream, a signal processor 102 that performs video and audio decoding processing with a general-purpose processor 101, and a transfer device 103 that transfers the multiplexed stream from the storage medium. And a buffer 112 for temporarily storing the multiplexed stream, and an audio output unit 104 and a video output unit 105 for outputting to an external device (not shown). In the general-purpose processor 101, management information analysis processing 106 for analyzing data management information in the multiplexed stream file, and file management for converting the position information in the multiplexed stream file into the position information in the storage medium based on the file system structure. Processing 107 is performed. In the signal processor 102, a demultiplexing process 108 for separating the multiplexed stream, an audio decoding process 109 for decoding the audio encoded data separated from the demultiplexing process 108, and a video separated from the demultiplexing process 108. A video decoding process 110 for decoding the encoded data, and a synchronization control process 111 for controlling the start time of the audio or video decoding process or the output time of the decoded audio or video data according to the reproduction time information. Do. In the figure, thin line arrows indicate data flow, and dotted line arrows indicate control.

  Next, in the operation example of the present embodiment configured as described above, the above-described ASF is applied as a multiplexed stream method, and according to the processing flow outline of FIGS. 2 and 3, referring to FIG. explain. However, FIG. 2 shows processing steps in the general-purpose processor, and FIG. 3 shows processing steps in the demultiplexing processing portion in the signal processor.

  First, processing steps in the general-purpose processor will be described.

  At the start of playback, in step 200, the management information analysis process 106 acquires the header object portion from the storage medium 100 via the file management process 107. In step 201, the management information analysis processing 106 analyzes the header object and acquires information such as the file size, the packet size, and the total number of all packets. Thereby, the position in the multiplexed stream file of the packet to be acquired can be calculated by the packet request from the demultiplexing process 108. In step 202, processing for transferring the first packet to the buffer 112 is performed. In step 203, the signal processor 102 is instructed to start the demultiplexing process 108. In step 204, it is determined whether or not the current packet number exceeds the total number of packets. If it has not exceeded, it becomes a state of waiting for a next packet request 205 from the signal processor.

  When the signal processor 102 starts the demultiplexing process 108 and the decoding processes 109 and 110, and the general-purpose processor 101 receives a request for the next packet from the demultiplexing process 108, the signal processor 102 is released from the waiting state. In the next step 206, the management information analysis process 106 calculates the position of the request packet in the multiplexed stream based on the packet number included in the request information received from the demultiplexing process 108. In step 207, the file management process 107 converts the position of the request packet calculated by the management information analysis process 106 into a position inside the storage medium. In step 208, the converted position in the storage medium is set in the transfer device 103. Then, the next packet waiting state 205 from the signal processor is entered again. The general-purpose processor 101 performs these series of operations, and ends the reproduction when the requested packet number exceeds the total number of packets.

  Next, processing steps in the demultiplexing process in the signal processor 102 will be described.

  After the general processor 101 instructs the demultiplexing process 108 to start, in step 300, a request for the next packet is made, and the state waits for a data request 301 from the video or audio decoding processes 109 and 110. Become. When a data request comes from the decoding process, in step 302, it is determined whether the request is video or audio. If the request is from a video, in step 303, the packet in the buffer 112 is analyzed and the video encoded data is extracted. In step 304, reproduction time information corresponding to the extracted video encoded data is extracted. Then, the encoded data is transmitted to the video decoding process 110, and the reproduction time information is transmitted to the synchronization control process 111. In step 305, it is determined whether all data has been extracted from the packet. If the extraction has not been completed, the state again waits for a data request 301 from video or audio decoding processing. When the extraction is completed, in step 308, the transfer apparatus 103 is instructed to start transfer of the next packet data. Then, a transfer completion waiting state 309 is entered. After the transfer is completed, in step 300, the request for the next packet is transmitted to the general-purpose processor again. The signal processor continues these series of operations until the end of reproduction.

  As described above, in the moving image reproduction system shown in the present embodiment, by newly adding the transfer device 103, transfer from the storage medium 100 to the demultiplexing process 108 can be performed without going through the general-purpose processor 101. Further, the general-purpose processor 101 processes the multiplexed stream management information analysis processing 106 and the file management processing 107 for accessing the storage medium 100, so that the signal processing processor 102 is based on an inefficient file system structure. The storage medium 100 is not subjected to access processing.

  Therefore, during playback of a moving image, the general-purpose processor 101 is based on the file system structure and the process of calculating the position of the next packet in the multiplexed stream file in response to the next packet request transmitted from the demultiplexing process 108. Only conversion to a position in the storage medium 100 and setting processing to the transfer device 103 are performed. Therefore, in the timing chart of the conventional example shown in FIG. 14, the synchronization control task process and the demultiplexing task are eliminated, and only the file management process task (including the management information analysis process) is provided. As an example, assuming that the packet size is 8 KB and the bit rate of the moving image to be played back is 384 kbps, the file management task is activated at an interval of about 160 ms. It is greatly eased. As a result, even in an environment where a non-real-time OS is used with a general-purpose processor, it is possible to provide smooth moving image reproduction processing of high-bit-rate moving image data.

  Next, a second embodiment according to the third aspect of the present invention will be specifically described with reference to the drawings.

  FIG. 4 is a block diagram of a moving image reproduction system according to a second embodiment of the present invention.

  In the moving image reproduction system in FIG. 4, in addition to the configuration of the moving image reproduction system according to claim 1 in FIG. 1, the transfer device 400 includes a request accumulation queue 401 and an accumulation queue 401 that store a plurality of transfer requests. Queue detection means 402 is provided for detecting that the threshold value is below a certain threshold.

Next, the operation of the present embodiment configured as described above will be described below.
The basic operation is the same as that of the first embodiment in the moving image reproduction system according to claim 1, but the demultiplexing process 403 is output from the queue detection unit 402 when the number of stages of the request accumulation queue 401 falls below a certain threshold. A plurality of packet requests are collectively requested based on the received signal. Now, assuming that the number of stages in the queue is five and the threshold is one, transfer requests can be made in four stages. Therefore, in the case of the previous embodiment, the activation interval of the file management task is about 640 ms, the time restriction in the further general-purpose processor can be relaxed, and it is possible to cope with the higher bit rate moving image file.

  Next, a third embodiment of the fourth aspect of the present invention will be specifically described with reference to the drawings.

  FIG. 5 is a block diagram of a third embodiment of the moving image reproduction system according to claim 4 of the present invention.

  5, the storage medium 500 for storing the multiplexed stream, the signal processor 502 for decoding video and audio with the general-purpose processor 501, and a plurality of channels for transferring the multiplexed stream from the storage medium. A transfer device 503 having first transfer means 514 and second transfer means 515, an audio buffer 504 for temporarily storing audio encoded data of the multiplexed stream data, and a video of the multiplexed stream data The video buffer 505 temporarily stores encoded data, and an audio output unit 506 and a video output unit 507 that output to an external device (not shown).

  In the general-purpose processor 501, a management information analysis process 508 for analyzing the management information in the multiplexed stream file, and a file management process for converting the position information in the multiplexed stream file into the position information in the storage medium based on the file system structure 509. In the signal processor 502, an audio decoding process 510 that acquires and decodes encoded data from the audio buffer 504, a video decoding process 511 that acquires and decodes encoded data from the video buffer 505, and a management information analysis process The process of inputting the reproduction time information of each of video and audio from 508 to the time information buffer 512 and the reproduction time information stored in the time information buffer 512 are acquired, and the start time of the audio or video decoding process or the decoding A synchronization control process 513 for controlling the output time of the audio or video data thus performed is performed.

  This embodiment is a configuration suitable for a file format (hereinafter referred to as MP4) detailed in Non-Patent Document 2 as another method of multiplexed streams stored in the storage medium 500, and this MP4 is outlined below. To do.

  FIG. 6 shows a schematic structural diagram of MP4. FIG. 6A shows the data structure of the highest layer of MP4. This layer consists of an ftyp part that stores file identifiers, a moov part that stores codec information such as audio and video, playback time information, and data size, and an mdat part that stores data such as audio and video in units of samples. Consists of. 6B and 6C show the internal structure of the lower layer in the moov part and the mdat part. As shown in FIG. 6B, the moov part is composed of audio and video trak, and the mdat part is composed of a set of samples (hereinafter referred to as samples) of audio data and video data. Furthermore, as shown in FIG. 6C, the audio and video trak has a stbl part in which codec information, reproduction time information, and data size are stored, and there are several samples in the mdat part. The frame is stored.

  In this MP4 multiplexed stream, all information related to audio data or video data is contained in the trak of the moov part, so by analyzing the moov part, it is possible to determine where the data to be played is located in the file. It can be calculated.

Next, in the operation example of the present embodiment configured as described above, MP4 is applied as a multiplexed stream method, and according to the processing flow outline of FIGS. 7 and 8, referring to FIG. explain. However, FIG. 7 shows processing steps in the general-purpose processor, and FIG. 8 shows processing steps in the audio decoding processing portion in the signal processing processor.
First, processing steps in the general-purpose processor will be described.

  At the start of playback, in step 700, the management information analysis process 508 acquires the moov part from the storage medium 500 via the file management process 509. In step 701, the management information analysis processing 508 analyzes the moov part and acquires information such as codec information, reproduction time information, and the number of frames in the sample. As a result, it is possible to calculate the position of encoded data of audio and video stored in the mdat part of the multiplexed stream. In step 702, transfer processing of initial audio or video data is performed. Here, the transfer amount depends on the size of the audio buffer 504 and the video buffer 505. In step 703, the signal processor 502 is instructed to start the decoding processes 510 and 511. Then, a data request waiting state 704 from the signal processor 502 is entered.

  When the signal processor 502 starts the decoding process and receives a data request from the signal processor 502, the signal processor 502 is released from the waiting state. In step 705, it is determined whether the data request is from a video decoding process or an audio decoding process. In the case of the audio decoding processing 510, in the next step 711, it is determined whether there is audio data to be reproduced. If there is data, in step 712, the management information analysis processing 508 calculates the position of the audio encoded data to be transferred next. In step 713, the file management process 509 converts the position of the audio encoded data calculated by the management information analysis process 508 into a position inside the storage medium. In step 714, the converted position in the storage medium is set in the transfer device 503. In step 715, reproduction time information corresponding to the audio encoded data to be transferred next is transferred to the time information buffer 512. Then, the state again waits for a data request 704 from the signal processor. The same operation is performed in the case of a data request from the video decoding process 511 (steps 707 to 710). The general-purpose processor 501 performs these series of operations, and ends the reproduction when there is no more data.

  Next, an encoding process in the signal processor 502, here, a processing step in the audio decoding process 510 will be described. The video encoding process 511 is also omitted because of the same processing flow.

  After the general processor 501 instructs activation to the audio decoding process 510, in step 800, the next data is requested. In step 801, encoded data for one frame is obtained from the audio buffer 504. In step 802, the acquired encoded data is decoded. After the decoding process is completed, the data output timing wait state 803 is entered until an output instruction is received from the synchronization control process 513. After receiving an output instruction from the synchronization control processing 513 and completing the output of data to the audio output unit 506, in the next step 804, it is determined whether or not the data should be transferred to the audio buffer 504. If there is sufficient data in the audio buffer 504, the encoded data for one frame is again acquired from the audio buffer 504. If there is not enough data in the audio buffer 504, in step 805, the transfer device 503 is instructed to start transfer of the next data. Then, a transfer completion wait state 806 is entered. After the transfer is completed, a request for next data is transmitted to the general-purpose processor 501 again in step 800. The signal processor 502 continues these series of operations until the reproduction ends.

  As described above, in the moving image reproduction system shown in the present embodiment, a transfer device 503 including a plurality of transfer units 514 and 515 is newly added, so that the audio code can be read from the storage medium 500 without passing through the general-purpose processor 501. The encoded data and the video encoded data can be independently transferred to the respective decoding processes.

  Thus, during the moving image reproduction, the general-purpose processor 501 calculates the position of the next packet in the multiplexed stream file according to the request for data transmitted from the decoding processes 510 and 511, and changes the file system structure. Only conversion based on the location information in the storage medium 500 based on this and setting processing to the transfer device 503 are performed. Accordingly, in the timing chart of the conventional example shown in FIG. 14, the synchronization control task process and the demultiplexing task are eliminated, and only the file management process task (including the reproduction time information transmission to the management information analysis process and the synchronization control process). It becomes. As a result, it is possible to support a multiplexed format such as MP4, and to provide smooth video playback processing of high bit rate moving image data even in an environment using a non-real-time OS with a general-purpose processor. It becomes.

  Next, a fourth embodiment of the fifth aspect of the present invention will be specifically described with reference to the drawings.

  FIG. 9 is a block diagram of a fifth embodiment of the moving image reproduction system according to claim 5 of the present invention.

  FIG. 9 shows a configuration in which a playback time combining process 903 is provided in the transfer apparatus 900 in the moving picture playback system of FIG. 5 and the playback time information is appended to audio data and video data and transferred to the audio buffer 901 and the video buffer 902. is there.

Next, the operation of the present embodiment configured as described above will be described below.
The basic operation is the same as that in the moving image reproduction system according to the fourth aspect, but in the moving image reproduction system of FIG. 9, the transfer device 900 is activated by the video decoding process 904 or the audio decoding process 905. When transferring from the storage medium (906), the reproduction time information PTS acquired from the management information analysis process (907) and the frame data corresponding to the reproduction time information PTS are displayed in the reproduction time combining process 903. 10 is combined and transferred to the audio buffer 901 or the video buffer 902.

  Thereby, the frame data of the audio encoded data and the video encoded data and the respective reproduction time information PTS can be managed on a one-to-one basis, thereby facilitating data management.

  The moving image reproduction system according to the present invention has an effect that smooth moving image reproduction can be realized even when reproducing moving image data at a high bit rate from a storage medium or in a non-real-time operating system environment, Useful for video playback systems.

1 is a block diagram of a moving image reproduction system according to a first embodiment of the present invention. FIG. It is a processing flow figure of the general-purpose processor part of the moving image reproduction | regeneration system in 1st Embodiment of Claim 1 of this invention. It is a processing flow figure of the signal processor part of the moving image reproduction system in 1st Embodiment of Claim 1 of this invention. It is a moving image reproduction | regeneration system block diagram in 2nd Embodiment of Claim 3 of this invention. It is a moving image reproduction | regeneration system block diagram in 3rd Embodiment of Claim 4 of this invention. It is a schematic diagram of a multiplexing format system (MPEG-4MP4). It is a processing flow figure of the general purpose processor part of the moving image reproduction | regeneration system in 3rd Embodiment of Claim 4 of this invention. It is a processing flow figure of the signal processor part of the moving image reproduction | regeneration system in 3rd Embodiment of Claim 4 of this invention. It is a moving image reproduction | regeneration system block diagram in 4th Embodiment of Claim 5 of this invention. It is a data format figure which concerns on the 4th Embodiment of this invention. It is a moving image reproduction | regeneration system block diagram in a prior art example. It is a schematic diagram of a multiplexing format system (ASF). It is a multiplexing format method (ASF) demultiplexing flow. It is a timing chart figure of the processing task in the general purpose processor in a prior art example.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Storage medium 101 General-purpose processor 102 Signal processor 103 Transfer apparatus 108 Demultiplexing process 109 Audio decoding process 110 Video decoding process 111 Synchronization control process 401 Storage queue 402 Queue detection means 403 Demultiplexing process 500 Storage medium 501 General-purpose processor 502 Signal Processing processor 503 Transfer device 510 Audio decoding processing 511 Video decoding processing 512 Time information buffer 903 Playback time combining processing

Claims (5)

To manage video encoded data and audio encoded data, data management information for managing the video encoded data and audio encoded data, and the playback time of the video encoded data and audio encoded data A reproduction system for reproducing a multiplexed stream in which the reproduction time information is multiplexed,
A storage medium for storing the multiplexed stream, a transfer device for transferring the multiplexed stream from the storage medium, a buffer for temporarily storing the transferred multiplexed stream, and the multiplexing temporarily stored in the buffer Demultiplexing means for separating a stream into the video encoded data, the audio encoded data, the data management information, and the reproduction time information, video decoding means for decoding the video encoded data, and the audio code Audio decoding means for decoding the encoded data, and synchronization for controlling the output of the video data decoded by the video decoding means or the audio data decoded by the audio decoding means with the reproduction time information as an input A signal processor comprising a control means;
Management information analysis means for analyzing the data management information, and file management means for inputting the result analyzed by the management information analysis means and setting the transfer device to access any location in the storage medium And a general-purpose processor with
The transfer device can directly transfer the multiplexed stream from the storage medium to the buffer by a transfer start instruction from the demultiplexing means based on the access information to the storage medium set by the file management means A moving image reproduction system characterized by the above.   The general-purpose processor calculates the position of the next data in the multiplexed stream file in response to a request for the next data transmitted from the demultiplexing means, the audio decoding means or the video decoding means, and a file system for the position. The moving image reproduction system according to claim 1, wherein conversion to a position in the storage medium and setting processing to the transfer device are performed based on the information.   The transfer apparatus includes a request accumulation queue capable of queuing a plurality of transfer requests from the file management means, and a queue detection means for detecting that the request accumulation queue is empty or falls below a certain threshold value. 2. The moving image reproduction system according to claim 1, wherein a request timing to the management information analysis unit is controlled based on a detection signal of the queue detection unit. Video encoded data and audio encoded data; data management information for managing the video encoded data and audio encoded data; and management of playback times of the video encoded data and audio encoded data A moving image reproduction system for reproducing a multiplexed stream in which reproduction time information is multiplexed,
A storage medium for storing the multiplexed stream; and a first transfer means for transferring the audio encoded data in the multiplexed stream; and a second transfer unit for transferring the video encoded data in the multiplexed stream. A transfer device having transfer means; an audio buffer for temporarily storing the audio encoded data transferred by the first transfer means; and temporarily storing the video encoded data transferred by the second transfer means. A video buffer; audio decoding means for decoding encoded data stored in the audio buffer; video decoding means for decoding encoded data stored in the video buffer; and the audio buffer or the video Temporary playback time information corresponding to each piece of encoded data stored in the buffer A time information buffer to be stored, and synchronization for obtaining reproduction time information from the time information buffer and controlling output of video data decoded by the video decoding means or audio data decoded by the audio decoding means A signal processor comprising a control means;
Management information analysis means for analyzing the data management information, and settings for accessing the storage medium or accessing any location in the storage medium from the data management information analyzed by the management information analysis means A general-purpose processor having file management means for the transfer device,
The transfer device is configured to transfer the audio buffer from the storage medium according to a transfer start instruction from the audio decoding unit and the video decoding unit based on access information to the storage medium set by the file management processing unit. And a moving picture reproducing system capable of being directly transferred to the video buffer. The transfer device has reproduction time combining means for combining reproduction time information obtained from the management information analyzing means, audio encoded data and video encoded data, and from the storage medium to the audio buffer or the video buffer. 5. When transferring the audio encoded data or the video encoded data, the reproduction time information obtained from the management information analyzing means is added to the audio encoded data or the video encoded data and transferred. The moving image reproduction system described.

Images